2024-04-20T12:06:20.761 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-20T12:06:20.761 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --owner scheduled_rishabh@teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/direct_io}} --archive /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664595 --verbose -- /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664595/orig.config.yaml 2024-04-20T12:06:20.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-20T12:06:20.950 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664595 branch: wip-rishabh-testing-20240416.193735 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/direct_io}} email: null first_in_suite: false job_id: '7664595' kernel: client: sha1: distro flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true name: rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240416.193735 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow metadata IO - SLOW_OPS - slow request sha1: a8c84f5997950fd7d008204839253291d52e6eda subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: a8c84f5997950fd7d008204839253291d52e6eda kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240416.193735 sha1: a8c84f5997950fd7d008204839253291d52e6eda owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7954 sha1: a8c84f5997950fd7d008204839253291d52e6eda sleep_before_teardown: 0 subset: 364/512 suite: fs suite_branch: wip-rishabh-testing-20240416.193735 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a8c84f5997950fd7d008204839253291d52e6eda syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHeDb61NkP2IqoU8IFStrkh1ThQZU/4x5e4J5AeomELHwKO3x5NI3XfGSxBFu9ptbE0LjY1AjEw/4OwyoQuNn28= smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHojZpyB6A47T8obbUZ4esXHIEkRNsKpIrk0YZDG0fapc8OPL/DTFV+7sQEwaMn5wKnCpTXpVM7PpcZkEGI3OTM= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH3hmdbBzsM3lM9gkSd9LIhpeVzkIpWDHknnv4fK4LnOiAvsqDIG15ctYzaQmgQY4klFt9DI83+2YRkoC+ut/Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - direct_io teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-20_09:50:15 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-20T12:06:20.950 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa; will attempt to use it 2024-04-20T12:06:20.951 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks 2024-04-20T12:06:20.951 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-20T12:06:20.954 INFO:teuthology.task.internal:Checking packages... 2024-04-20T12:06:20.982 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a8c84f5997950fd7d008204839253291d52e6eda' 2024-04-20T12:06:20.983 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-20T12:06:20.983 INFO:teuthology.packaging:ref: None 2024-04-20T12:06:20.983 INFO:teuthology.packaging:tag: None 2024-04-20T12:06:20.983 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240416.193735 2024-04-20T12:06:20.983 INFO:teuthology.packaging:sha1: a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T12:06:20.983 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240416.193735 2024-04-20T12:06:21.199 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3133.ga8c84f59 2024-04-20T12:06:21.201 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-20T12:06:21.207 INFO:teuthology.task.internal:no buildpackages task found 2024-04-20T12:06:21.207 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-20T12:06:21.238 INFO:teuthology.task.internal:Saving configuration 2024-04-20T12:06:21.260 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-20T12:06:21.265 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-20T12:06:21.288 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664595', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-20 12:01:02.924328', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHeDb61NkP2IqoU8IFStrkh1ThQZU/4x5e4J5AeomELHwKO3x5NI3XfGSxBFu9ptbE0LjY1AjEw/4OwyoQuNn28='} 2024-04-20T12:06:21.306 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664595', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-20 12:01:02.925762', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHojZpyB6A47T8obbUZ4esXHIEkRNsKpIrk0YZDG0fapc8OPL/DTFV+7sQEwaMn5wKnCpTXpVM7PpcZkEGI3OTM='} 2024-04-20T12:06:21.328 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664595', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-20 12:01:02.926812', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH3hmdbBzsM3lM9gkSd9LIhpeVzkIpWDHknnv4fK4LnOiAvsqDIG15ctYzaQmgQY4klFt9DI83+2YRkoC+ut/Ac='} 2024-04-20T12:06:21.328 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-20T12:06:21.334 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-04-20T12:06:21.334 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-04-20T12:06:21.334 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-04-20T12:06:21.334 INFO:teuthology.run_tasks:Running task console_log... 2024-04-20T12:06:21.462 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4e9b250160>, signals=[15]) 2024-04-20T12:06:21.463 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-20T12:06:21.469 INFO:teuthology.task.internal:Opening connections... 2024-04-20T12:06:21.470 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-04-20T12:06:21.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T12:06:21.547 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-04-20T12:06:21.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T12:06:21.620 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-04-20T12:06:21.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T12:06:21.694 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-20T12:06:21.700 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-04-20T12:06:21.718 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-04-20T12:06:21.718 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-04-20T12:06:21.775 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-04-20T12:06:21.775 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-04-20T12:06:21.775 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-04-20T12:06:21.775 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-04-20T12:06:21.775 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-04-20T12:06:21.775 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-04-20T12:06:21.775 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-20T12:06:21.775 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-04-20T12:06:21.776 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-04-20T12:06:21.776 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-20T12:06:21.776 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-04-20T12:06:21.776 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-20T12:06:21.776 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-20T12:06:21.776 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-20T12:06:21.776 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-04-20T12:06:21.800 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-04-20T12:06:21.817 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-04-20T12:06:21.817 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-04-20T12:06:21.874 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2024-04-20T12:06:21.874 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2024-04-20T12:06:21.874 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2024-04-20T12:06:21.874 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2024-04-20T12:06:21.874 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2024-04-20T12:06:21.875 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2024-04-20T12:06:21.875 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-20T12:06:21.875 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2024-04-20T12:06:21.875 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2024-04-20T12:06:21.875 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-20T12:06:21.875 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2024-04-20T12:06:21.875 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-20T12:06:21.875 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-20T12:06:21.875 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-20T12:06:21.875 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-04-20T12:06:21.900 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-04-20T12:06:21.918 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-04-20T12:06:21.918 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-04-20T12:06:21.975 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-04-20T12:06:21.975 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-04-20T12:06:21.975 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-04-20T12:06:21.975 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-04-20T12:06:21.975 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-04-20T12:06:21.975 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-04-20T12:06:21.975 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-20T12:06:21.975 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-04-20T12:06:21.975 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-04-20T12:06:21.975 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-20T12:06:21.975 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-04-20T12:06:21.976 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-20T12:06:21.976 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-20T12:06:21.976 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-20T12:06:21.976 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-04-20T12:06:22.000 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-20T12:06:22.010 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-20T12:06:22.031 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-20T12:06:22.031 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-04-20T12:06:22.033 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-04-20T12:06:22.036 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-04-20T12:06:22.052 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-20T12:06:22.057 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-20T12:06:22.057 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-04-20T12:06:22.090 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-04-20T12:06:22.093 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-04-20T12:06:22.371 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-20T12:06:22.443 INFO:teuthology.run_tasks:Running task kernel... 2024-04-20T12:06:22.457 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-20T12:06:22.457 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-04-20T12:06:22.457 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-04-20T12:06:22.458 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-20T12:06:22.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T12:06:22.474 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-04-20T12:06:22.531 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-437.el9.x86_64 2024-04-20T12:06:22.531 INFO:teuthology.task.kernel:Running kernel on smithi135: 5.14.0-437.el9.x86_64 2024-04-20T12:06:22.531 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum install -y kernel 2024-04-20T12:06:26.651 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.0 MB 00:02 2024-04-20T12:06:28.419 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-04-20T12:06:40.252 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 769 kB/s | 6.2 MB 00:08 2024-04-20T12:06:42.086 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-20T12:06:43.396 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-04-20T12:06:48.447 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-20T12:06:50.369 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-20T12:06:50.369 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-20T12:06:50.462 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-04-20T12:06:50.463 INFO:teuthology.orchestra.run.smithi135.stdout:Nothing to do. 2024-04-20T12:06:50.463 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-04-20T12:06:50.566 DEBUG:teuthology.orchestra.run.smithi135:> echo no | sudo yum reinstall kernel || true 2024-04-20T12:06:51.065 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:03 ago on Sat 20 Apr 2024 12:06:48 PM UTC. 2024-04-20T12:06:51.185 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-04-20T12:06:51.202 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-04-20T12:06:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-04-20T12:06:51.202 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-04-20T12:06:51.202 INFO:teuthology.orchestra.run.smithi135.stdout:Reinstalling: 2024-04-20T12:06:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-20T12:06:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:06:51.202 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-04-20T12:06:51.202 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-04-20T12:06:51.202 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:06:51.202 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 255 k 2024-04-20T12:06:51.202 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 0 2024-04-20T12:06:51.203 INFO:teuthology.orchestra.run.smithi135.stderr:Operation aborted. 2024-04-20T12:06:51.262 INFO:teuthology.orchestra.run.smithi135.stdout:Is this ok [y/N]: 2024-04-20T12:06:51.262 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum reinstall -y kernel || true 2024-04-20T12:06:51.751 INFO:teuthology.orchestra.run.smithi135.stdout:Last metadata expiration check: 0:00:03 ago on Sat 20 Apr 2024 12:06:48 PM UTC. 2024-04-20T12:06:51.867 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-04-20T12:06:51.868 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-04-20T12:06:51.868 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-04-20T12:06:51.868 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-04-20T12:06:51.868 INFO:teuthology.orchestra.run.smithi135.stdout:Reinstalling: 2024-04-20T12:06:51.868 INFO:teuthology.orchestra.run.smithi135.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-20T12:06:51.868 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:06:51.868 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-04-20T12:06:51.868 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-04-20T12:06:51.868 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:06:51.868 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 255 k 2024-04-20T12:06:51.868 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 0 2024-04-20T12:06:51.869 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-04-20T12:06:52.207 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.1 MB/s | 255 kB 00:00 2024-04-20T12:06:52.208 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-04-20T12:06:52.208 INFO:teuthology.orchestra.run.smithi135.stdout:Total 751 kB/s | 255 kB 00:00 2024-04-20T12:06:52.225 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-04-20T12:06:52.408 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-04-20T12:06:52.408 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-04-20T12:06:52.413 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-04-20T12:06:52.414 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-04-20T12:06:52.551 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-04-20T12:06:52.626 INFO:teuthology.orchestra.run.smithi135.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-20T12:06:52.626 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-20T12:06:53.279 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-20T12:06:53.279 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-20T12:06:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-20T12:06:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:06:54.002 INFO:teuthology.orchestra.run.smithi135.stdout:Reinstalled: 2024-04-20T12:06:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-20T12:06:54.002 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:06:54.003 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-04-20T12:06:54.170 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-04-20T12:06:54.217 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-20T12:06:54.217 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-20T12:06:54.217 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-20T12:06:54.217 DEBUG:teuthology.parallel:result is None 2024-04-20T12:06:54.218 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-20T12:06:54.224 INFO:teuthology.task.internal:Creating test directory... 2024-04-20T12:06:54.224 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-20T12:06:54.226 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-20T12:06:54.228 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-20T12:06:54.246 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-20T12:06:54.254 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-20T12:06:54.286 INFO:teuthology.task.internal:Creating archive directory... 2024-04-20T12:06:54.286 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-20T12:06:54.288 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-20T12:06:54.291 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-20T12:06:54.385 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-20T12:06:54.392 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-20T12:06:54.392 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-20T12:06:54.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T12:06:54.409 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-20T12:06:54.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T12:06:54.426 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-20T12:06:54.428 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-20T12:06:54.452 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-20T12:06:54.471 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T12:06:54.488 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T12:06:54.496 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T12:06:54.509 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T12:06:54.513 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T12:06:54.541 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T12:06:54.543 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-20T12:06:54.551 INFO:teuthology.task.internal:Configuring sudo... 2024-04-20T12:06:54.551 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-20T12:06:54.553 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-20T12:06:54.556 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-20T12:06:54.611 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-20T12:06:54.621 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-20T12:06:54.621 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-20T12:06:54.624 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-20T12:06:54.626 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-20T12:06:54.668 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T12:06:54.711 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T12:06:54.766 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T12:06:54.846 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T12:06:54.887 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:06:54.887 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-20T12:06:54.950 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T12:06:54.993 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T12:06:55.049 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T12:06:55.130 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T12:06:55.174 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-20T12:06:55.174 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-20T12:06:55.239 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T12:06:55.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T12:06:55.343 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T12:06:55.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T12:06:55.469 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-20T12:06:55.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-20T12:06:55.535 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-04-20T12:06:55.538 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2024-04-20T12:06:55.540 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-04-20T12:06:55.574 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T12:06:55.575 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T12:06:55.616 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T12:06:56.042 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-20T12:06:56.049 INFO:teuthology.task.internal:Starting timer... 2024-04-20T12:06:56.050 INFO:teuthology.run_tasks:Running task pcp... 2024-04-20T12:06:56.108 INFO:teuthology.run_tasks:Running task selinux... 2024-04-20T12:06:56.145 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-20T12:06:56.146 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-04-20T12:06:56.217 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-04-20T12:06:56.219 DEBUG:teuthology.orchestra.run.smithi139:> sudo service auditd rotate 2024-04-20T12:06:56.288 INFO:teuthology.orchestra.run.smithi139.stdout:Rotating logs: 2024-04-20T12:06:56.290 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2024-04-20T12:06:56.348 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2024-04-20T12:06:56.349 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-20T12:06:56.349 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-04-20T12:06:56.378 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-04-20T12:06:56.379 DEBUG:teuthology.orchestra.run.smithi139:> /usr/sbin/getenforce 2024-04-20T12:06:56.408 INFO:teuthology.orchestra.run.smithi139.stdout:Permissive 2024-04-20T12:06:56.409 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2024-04-20T12:06:56.440 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2024-04-20T12:06:56.441 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi135.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi139.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive'} 2024-04-20T12:06:56.441 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T12:06:56.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T12:06:56.466 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T12:06:56.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T12:06:56.494 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T12:06:56.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T12:06:56.523 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-20T12:06:56.523 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-04-20T12:06:56.546 DEBUG:teuthology.orchestra.run.smithi139:> sudo /usr/sbin/setenforce permissive 2024-04-20T12:06:56.572 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2024-04-20T12:06:56.601 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-20T12:06:56.611 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-20T12:06:56.629 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-20T12:06:56.630 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi135.front.sepia.ceph.com,smithi139.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-20T12:09:31.363 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi135.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2024-04-20T12:09:31.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-04-20T12:09:31.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T12:09:31.438 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-04-20T12:09:31.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-04-20T12:09:31.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-20T12:09:31.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T12:09:31.625 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-04-20T12:09:31.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-20T12:09:31.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-20T12:09:31.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T12:09:31.783 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-04-20T12:09:31.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-20T12:09:31.863 INFO:teuthology.run_tasks:Running task clock... 2024-04-20T12:09:31.874 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-20T12:09:31.874 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-20T12:09:31.875 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T12:09:31.877 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-20T12:09:31.877 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T12:09:31.879 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-20T12:09:31.880 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T12:09:31.904 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-20T12:09:31.907 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-20T12:09:31.917 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-20T12:09:31.920 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-20T12:09:31.931 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-20T12:09:31.940 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-04-20T12:09:31.944 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: ntpd: command not found 2024-04-20T12:09:31.945 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-20T12:09:31.950 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-04-20T12:09:31.955 INFO:teuthology.orchestra.run.smithi139.stdout:506 Cannot talk to daemon 2024-04-20T12:09:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-20T12:09:31.968 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-20T12:09:31.968 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2024-04-20T12:09:31.976 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-20T12:09:31.979 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2024-04-20T12:09:31.981 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-20T12:09:31.993 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-20T12:09:32.006 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-20T12:09:32.031 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-04-20T12:09:32.034 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T12:09:32.034 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-04-20T12:09:32.034 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T12:09:32.034 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T12:09:32.034 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T12:09:32.035 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T12:09:32.040 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-04-20T12:09:32.043 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T12:09:32.043 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-04-20T12:09:32.043 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T12:09:32.043 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T12:09:32.043 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T12:09:32.043 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T12:09:32.065 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-04-20T12:09:32.069 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T12:09:32.069 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-04-20T12:09:32.069 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T12:09:32.069 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T12:09:32.069 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T12:09:32.069 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T12:09:32.070 INFO:teuthology.run_tasks:Running task install... 2024-04-20T12:09:32.079 DEBUG:teuthology.task.install:project ceph 2024-04-20T12:09:32.079 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}} 2024-04-20T12:09:32.079 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'} 2024-04-20T12:09:32.079 INFO:teuthology.task.install:Using flavor: default 2024-04-20T12:09:32.084 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-20T12:09:32.085 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-20T12:09:32.085 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'tag': None, 'wait_for_package': False} 2024-04-20T12:09:32.085 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T12:09:32.087 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'tag': None, 'wait_for_package': False} 2024-04-20T12:09:32.087 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T12:09:32.088 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'tag': None, 'wait_for_package': False} 2024-04-20T12:09:32.088 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T12:09:32.226 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/ 2024-04-20T12:09:32.226 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3133.ga8c84f59 2024-04-20T12:09:32.237 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/ 2024-04-20T12:09:32.237 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3133.ga8c84f59 2024-04-20T12:09:32.241 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/ 2024-04-20T12:09:32.241 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3133.ga8c84f59 2024-04-20T12:09:32.352 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-20T12:09:32.352 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-20T12:09:32.352 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-20T12:09:32.377 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-20T12:09:32.377 DEBUG:teuthology.orchestra.run.smithi139:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c84f5997950fd7d008204839253291d52e6eda/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-20T12:09:32.434 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-20T12:09:32.434 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:09:32.434 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-20T12:09:32.441 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-20T12:09:32.442 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-20T12:09:32.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-20T12:09:32.443 DEBUG:teuthology.orchestra.run.smithi139:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-20T12:09:32.458 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-20T12:09:32.459 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c84f5997950fd7d008204839253291d52e6eda/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-20T12:09:32.467 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-20T12:09:32.467 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c84f5997950fd7d008204839253291d52e6eda/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-20T12:09:32.515 DEBUG:teuthology.orchestra.run.smithi139:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-20T12:09:32.523 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-20T12:09:32.531 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-20T12:09:32.578 INFO:teuthology.orchestra.run.smithi139.stdout:check_obsoletes = 1 2024-04-20T12:09:32.580 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum clean all 2024-04-20T12:09:32.596 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-20T12:09:32.605 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-20T12:09:32.659 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-04-20T12:09:32.661 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-04-20T12:09:32.668 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2024-04-20T12:09:32.670 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2024-04-20T12:09:32.804 INFO:teuthology.orchestra.run.smithi139.stdout:48 files removed 2024-04-20T12:09:32.830 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-20T12:09:32.886 INFO:teuthology.orchestra.run.smithi135.stdout:48 files removed 2024-04-20T12:09:32.896 INFO:teuthology.orchestra.run.smithi154.stdout:48 files removed 2024-04-20T12:09:32.913 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-20T12:09:32.923 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-20T12:09:33.495 INFO:teuthology.orchestra.run.smithi139.stdout:ceph packages for x86_64 207 kB/s | 84 kB 00:00 2024-04-20T12:09:33.560 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 216 kB/s | 84 kB 00:00 2024-04-20T12:09:33.587 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 207 kB/s | 84 kB 00:00 2024-04-20T12:09:33.921 INFO:teuthology.orchestra.run.smithi139.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-04-20T12:09:33.986 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-04-20T12:09:34.004 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-04-20T12:09:34.265 INFO:teuthology.orchestra.run.smithi139.stdout:ceph source packages 6.2 kB/s | 1.9 kB 00:00 2024-04-20T12:09:34.397 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 5.3 kB/s | 1.9 kB 00:00 2024-04-20T12:09:34.399 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-04-20T12:09:35.005 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-20T12:09:35.022 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-20T12:09:36.981 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-04-20T12:09:37.281 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-04-20T12:09:37.387 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.0 MB 00:02 2024-04-20T12:09:39.564 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-04-20T12:09:41.457 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.2 MB 00:00 2024-04-20T12:09:43.615 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-20T12:09:45.207 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-04-20T12:09:46.149 INFO:teuthology.orchestra.run.smithi154.stdout:CentOS Stream 9 - Extras packages 4.6 kB/s | 16 kB 00:03 2024-04-20T12:09:46.801 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-20T12:09:47.156 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 959 kB/s | 6.2 MB 00:06 2024-04-20T12:09:49.481 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-04-20T12:09:51.291 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-20T12:09:51.776 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-20T12:09:53.961 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-20T12:09:53.961 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-20T12:09:53.972 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-20T12:09:53.973 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-20T12:09:53.974 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-20T12:09:53.975 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-20T12:09:53.976 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-20T12:09:53.979 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-20T12:09:53.979 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-20T12:09:54.040 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-04-20T12:09:54.049 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-04-20T12:09:54.049 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-04-20T12:09:54.050 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-04-20T12:09:54.050 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-04-20T12:09:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-20T12:09:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 6.6 k 2024-04-20T12:09:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-20T12:09:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 893 k 2024-04-20T12:09:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 145 k 2024-04-20T12:09:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 1.5 M 2024-04-20T12:09:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 142 k 2024-04-20T12:09:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 3.5 M 2024-04-20T12:09:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 7.4 M 2024-04-20T12:09:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 49 k 2024-04-20T12:09:54.050 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 11 M 2024-04-20T12:09:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 49 M 2024-04-20T12:09:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 273 k 2024-04-20T12:09:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 763 k 2024-04-20T12:09:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 225 k 2024-04-20T12:09:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 27 k 2024-04-20T12:09:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 18 k 2024-04-20T12:09:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-20T12:09:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-20T12:09:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-20T12:09:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 32 k 2024-04-20T12:09:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 748 k 2024-04-20T12:09:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 126 k 2024-04-20T12:09:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-20T12:09:54.051 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 162 k 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 321 k 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 299 k 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 99 k 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 85 k 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 170 k 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.4 M 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-20T12:09:54.052 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-04-20T12:09:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-20T12:09:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-20T12:09:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-20T12:09:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 21 M 2024-04-20T12:09:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 34 k 2024-04-20T12:09:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 2.4 M 2024-04-20T12:09:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 249 k 2024-04-20T12:09:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 4.7 M 2024-04-20T12:09:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 17 M 2024-04-20T12:09:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 16 k 2024-04-20T12:09:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 25 k 2024-04-20T12:09:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-20T12:09:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-20T12:09:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-20T12:09:54.053 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-20T12:09:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-20T12:09:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-20T12:09:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-20T12:09:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-20T12:09:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 163 k 2024-04-20T12:09:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-20T12:09:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-20T12:09:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-20T12:09:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-20T12:09:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-20T12:09:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 501 k 2024-04-20T12:09:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-20T12:09:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-20T12:09:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-20T12:09:54.054 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-20T12:09:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-20T12:09:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-20T12:09:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-20T12:09:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-20T12:09:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-20T12:09:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-20T12:09:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-20T12:09:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-20T12:09:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-20T12:09:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-20T12:09:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-20T12:09:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-20T12:09:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-20T12:09:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 45 k 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 135 k 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-20T12:09:54.056 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-20T12:09:54.057 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-20T12:09:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-20T12:09:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-20T12:09:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-20T12:09:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-20T12:09:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-20T12:09:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-20T12:09:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-20T12:09:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-20T12:09:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-20T12:09:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-20T12:09:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-20T12:09:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-20T12:09:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-20T12:09:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-20T12:09:54.058 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-20T12:09:54.059 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-20T12:09:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-20T12:09:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-20T12:09:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-20T12:09:54.060 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2024-04-20T12:09:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-20T12:09:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:09:54.060 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-04-20T12:09:54.060 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-04-20T12:09:54.060 INFO:teuthology.orchestra.run.smithi135.stdout:Install 148 Packages 2024-04-20T12:09:54.060 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 2 Packages 2024-04-20T12:09:54.060 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:09:54.060 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 218 M 2024-04-20T12:09:54.061 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-04-20T12:09:55.033 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 2.4 MB/s | 21 MB 00:08 2024-04-20T12:09:56.307 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-20T12:09:56.877 INFO:teuthology.orchestra.run.smithi135.stdout:(1/150): ceph-19.0.0-3133.ga8c84f59.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-04-20T12:09:57.694 INFO:teuthology.orchestra.run.smithi135.stdout:(2/150): ceph-fuse-19.0.0-3133.ga8c84f59.el9.x8 1.1 MB/s | 893 kB 00:00 2024-04-20T12:09:57.853 INFO:teuthology.orchestra.run.smithi135.stdout:(3/150): ceph-immutable-object-cache-19.0.0-313 915 kB/s | 145 kB 00:00 2024-04-20T12:09:58.534 INFO:teuthology.orchestra.run.smithi139.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-20T12:09:58.534 INFO:teuthology.orchestra.run.smithi139.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-20T12:09:58.545 INFO:teuthology.orchestra.run.smithi139.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-20T12:09:58.546 INFO:teuthology.orchestra.run.smithi139.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-20T12:09:58.547 INFO:teuthology.orchestra.run.smithi139.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-20T12:09:58.547 INFO:teuthology.orchestra.run.smithi139.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-20T12:09:58.549 INFO:teuthology.orchestra.run.smithi139.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-20T12:09:58.551 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-20T12:09:58.552 INFO:teuthology.orchestra.run.smithi139.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-20T12:09:58.570 INFO:teuthology.orchestra.run.smithi135.stdout:(4/150): ceph-base-19.0.0-3133.ga8c84f59.el9.x8 2.6 MB/s | 5.4 MB 00:02 2024-04-20T12:09:58.611 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-20T12:09:58.637 INFO:teuthology.orchestra.run.smithi135.stdout:(5/150): ceph-mds-19.0.0-3133.ga8c84f59.el9.x86 3.0 MB/s | 2.4 MB 00:00 2024-04-20T12:09:58.649 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-04-20T12:09:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-04-20T12:09:58.649 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-04-20T12:09:58.649 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-20T12:09:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-20T12:09:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: ceph x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 6.6 k 2024-04-20T12:09:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-20T12:09:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 893 k 2024-04-20T12:09:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 145 k 2024-04-20T12:09:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 1.5 M 2024-04-20T12:09:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 142 k 2024-04-20T12:09:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 3.5 M 2024-04-20T12:09:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 7.4 M 2024-04-20T12:09:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 49 k 2024-04-20T12:09:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 11 M 2024-04-20T12:09:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 49 M 2024-04-20T12:09:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 273 k 2024-04-20T12:09:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 763 k 2024-04-20T12:09:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 225 k 2024-04-20T12:09:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-shell x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 27 k 2024-04-20T12:09:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 18 k 2024-04-20T12:09:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-20T12:09:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-20T12:09:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-20T12:09:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 32 k 2024-04-20T12:09:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 748 k 2024-04-20T12:09:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 126 k 2024-04-20T12:09:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-20T12:09:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-20T12:09:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-20T12:09:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-20T12:09:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-20T12:09:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-20T12:09:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 162 k 2024-04-20T12:09:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 321 k 2024-04-20T12:09:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 299 k 2024-04-20T12:09:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 99 k 2024-04-20T12:09:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 85 k 2024-04-20T12:09:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-20T12:09:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 170 k 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrading: 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.4 M 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 21 M 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 34 k 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 2.4 M 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 249 k 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 4.7 M 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 17 M 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 16 k 2024-04-20T12:09:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 25 k 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 163 k 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 501 k 2024-04-20T12:09:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-20T12:09:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-20T12:09:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-20T12:09:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-20T12:09:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-20T12:09:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-20T12:09:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-20T12:09:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-20T12:09:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-20T12:09:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-20T12:09:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-20T12:09:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-20T12:09:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-20T12:09:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-20T12:09:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-20T12:09:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-20T12:09:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-20T12:09:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-20T12:09:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-20T12:09:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 45 k 2024-04-20T12:09:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 135 k 2024-04-20T12:09:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-20T12:09:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-20T12:09:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-20T12:09:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-20T12:09:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-20T12:09:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-20T12:09:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-20T12:09:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-20T12:09:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-20T12:09:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-20T12:09:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-20T12:09:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-20T12:09:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-20T12:09:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-20T12:09:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-20T12:09:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-20T12:09:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-20T12:09:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-20T12:09:58.659 INFO:teuthology.orchestra.run.smithi139.stdout:Installing weak dependencies: 2024-04-20T12:09:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-20T12:09:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-20T12:09:58.659 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-20T12:09:58.659 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================= 2024-04-20T12:09:58.659 INFO:teuthology.orchestra.run.smithi139.stdout:Install 148 Packages 2024-04-20T12:09:58.659 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrade 2 Packages 2024-04-20T12:09:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-20T12:09:58.660 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 218 M 2024-04-20T12:09:58.660 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-20T12:09:58.896 INFO:teuthology.orchestra.run.smithi135.stdout:(6/150): ceph-mgr-19.0.0-3133.ga8c84f59.el9.x86 4.6 MB/s | 1.5 MB 00:00 2024-04-20T12:09:59.267 INFO:teuthology.orchestra.run.smithi139.stdout:(1/150): ceph-19.0.0-3133.ga8c84f59.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-04-20T12:09:59.701 INFO:teuthology.orchestra.run.smithi139.stdout:(2/150): ceph-fuse-19.0.0-3133.ga8c84f59.el9.x8 2.0 MB/s | 893 kB 00:00 2024-04-20T12:09:59.776 INFO:teuthology.orchestra.run.smithi139.stdout:(3/150): ceph-immutable-object-cache-19.0.0-313 1.9 MB/s | 145 kB 00:00 2024-04-20T12:10:00.276 INFO:teuthology.orchestra.run.smithi139.stdout:(4/150): ceph-base-19.0.0-3133.ga8c84f59.el9.x8 4.2 MB/s | 5.4 MB 00:01 2024-04-20T12:10:00.325 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-04-20T12:10:00.668 INFO:teuthology.orchestra.run.smithi139.stdout:(5/150): ceph-mgr-19.0.0-3133.ga8c84f59.el9.x86 3.8 MB/s | 1.5 MB 00:00 2024-04-20T12:10:00.893 INFO:teuthology.orchestra.run.smithi139.stdout:(6/150): ceph-mds-19.0.0-3133.ga8c84f59.el9.x86 2.1 MB/s | 2.4 MB 00:01 2024-04-20T12:10:01.296 INFO:teuthology.orchestra.run.smithi135.stdout:(7/150): ceph-mon-19.0.0-3133.ga8c84f59.el9.x86 1.8 MB/s | 4.7 MB 00:02 2024-04-20T12:10:01.560 INFO:teuthology.orchestra.run.smithi139.stdout:(7/150): ceph-mon-19.0.0-3133.ga8c84f59.el9.x86 5.3 MB/s | 4.7 MB 00:00 2024-04-20T12:10:02.517 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-20T12:10:02.518 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-20T12:10:02.529 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-20T12:10:02.530 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-20T12:10:02.531 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-20T12:10:02.532 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-20T12:10:02.533 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-20T12:10:02.535 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-20T12:10:02.536 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-20T12:10:02.596 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2024-04-20T12:10:02.617 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-04-20T12:10:02.617 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2024-04-20T12:10:02.617 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-04-20T12:10:02.617 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2024-04-20T12:10:02.617 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-20T12:10:02.617 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 6.6 k 2024-04-20T12:10:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-20T12:10:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 893 k 2024-04-20T12:10:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 145 k 2024-04-20T12:10:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 1.5 M 2024-04-20T12:10:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 142 k 2024-04-20T12:10:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 3.5 M 2024-04-20T12:10:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 7.4 M 2024-04-20T12:10:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 49 k 2024-04-20T12:10:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 11 M 2024-04-20T12:10:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 49 M 2024-04-20T12:10:02.618 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 273 k 2024-04-20T12:10:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 763 k 2024-04-20T12:10:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 225 k 2024-04-20T12:10:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 27 k 2024-04-20T12:10:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 18 k 2024-04-20T12:10:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-20T12:10:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-20T12:10:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-20T12:10:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 32 k 2024-04-20T12:10:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 748 k 2024-04-20T12:10:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 126 k 2024-04-20T12:10:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-20T12:10:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-20T12:10:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-20T12:10:02.619 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-20T12:10:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-20T12:10:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-20T12:10:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 162 k 2024-04-20T12:10:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 321 k 2024-04-20T12:10:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 299 k 2024-04-20T12:10:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 99 k 2024-04-20T12:10:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 85 k 2024-04-20T12:10:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-20T12:10:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 170 k 2024-04-20T12:10:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-20T12:10:02.620 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2024-04-20T12:10:02.620 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.4 M 2024-04-20T12:10:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-20T12:10:02.621 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2024-04-20T12:10:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-20T12:10:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-20T12:10:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-20T12:10:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 21 M 2024-04-20T12:10:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 34 k 2024-04-20T12:10:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 2.4 M 2024-04-20T12:10:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 249 k 2024-04-20T12:10:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 4.7 M 2024-04-20T12:10:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 17 M 2024-04-20T12:10:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 16 k 2024-04-20T12:10:02.621 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 25 k 2024-04-20T12:10:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-20T12:10:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-20T12:10:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-20T12:10:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-20T12:10:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-20T12:10:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-20T12:10:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-20T12:10:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-20T12:10:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 163 k 2024-04-20T12:10:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-20T12:10:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-20T12:10:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-20T12:10:02.622 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-20T12:10:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-20T12:10:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 501 k 2024-04-20T12:10:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-20T12:10:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-20T12:10:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-20T12:10:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-20T12:10:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-20T12:10:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-20T12:10:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-20T12:10:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-20T12:10:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-20T12:10:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-20T12:10:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-20T12:10:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-20T12:10:02.623 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-20T12:10:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-20T12:10:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-20T12:10:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-20T12:10:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-20T12:10:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-20T12:10:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-20T12:10:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 45 k 2024-04-20T12:10:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 135 k 2024-04-20T12:10:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-20T12:10:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-20T12:10:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-20T12:10:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-20T12:10:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-20T12:10:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-20T12:10:02.624 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-20T12:10:02.625 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-20T12:10:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-20T12:10:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-20T12:10:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-20T12:10:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-20T12:10:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-20T12:10:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-20T12:10:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-20T12:10:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-20T12:10:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-20T12:10:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-20T12:10:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-20T12:10:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-20T12:10:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-20T12:10:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-20T12:10:02.626 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-20T12:10:02.627 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-20T12:10:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-20T12:10:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-20T12:10:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-20T12:10:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-20T12:10:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-20T12:10:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-20T12:10:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-20T12:10:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-20T12:10:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-20T12:10:02.628 INFO:teuthology.orchestra.run.smithi154.stdout:Installing weak dependencies: 2024-04-20T12:10:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-20T12:10:02.628 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:10:02.628 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2024-04-20T12:10:02.629 INFO:teuthology.orchestra.run.smithi154.stdout:======================================================================================= 2024-04-20T12:10:02.629 INFO:teuthology.orchestra.run.smithi154.stdout:Install 148 Packages 2024-04-20T12:10:02.629 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 2 Packages 2024-04-20T12:10:02.629 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:10:02.629 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 218 M 2024-04-20T12:10:02.629 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2024-04-20T12:10:03.077 INFO:teuthology.orchestra.run.smithi139.stdout:(8/150): ceph-common-19.0.0-3133.ga8c84f59.el9. 5.2 MB/s | 21 MB 00:04 2024-04-20T12:10:03.143 INFO:teuthology.orchestra.run.smithi139.stdout:(9/150): ceph-selinux-19.0.0-3133.ga8c84f59.el9 380 kB/s | 25 kB 00:00 2024-04-20T12:10:03.269 INFO:teuthology.orchestra.run.smithi139.stdout:(10/150): ceph-radosgw-19.0.0-3133.ga8c84f59.el 6.2 MB/s | 11 MB 00:01 2024-04-20T12:10:03.369 INFO:teuthology.orchestra.run.smithi139.stdout:(11/150): cephfs-mirror-19.0.0-3133.ga8c84f59.e 2.2 MB/s | 225 kB 00:00 2024-04-20T12:10:03.436 INFO:teuthology.orchestra.run.smithi139.stdout:(12/150): cephfs-shell-19.0.0-3133.ga8c84f59.el 406 kB/s | 27 kB 00:00 2024-04-20T12:10:03.503 INFO:teuthology.orchestra.run.smithi139.stdout:(13/150): libcephfs-devel-19.0.0-3133.ga8c84f59 476 kB/s | 32 kB 00:00 2024-04-20T12:10:03.551 INFO:teuthology.orchestra.run.smithi154.stdout:(1/150): ceph-19.0.0-3133.ga8c84f59.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-04-20T12:10:03.653 INFO:teuthology.orchestra.run.smithi139.stdout:(14/150): libcephfs2-19.0.0-3133.ga8c84f59.el9. 4.9 MB/s | 748 kB 00:00 2024-04-20T12:10:03.736 INFO:teuthology.orchestra.run.smithi139.stdout:(15/150): libcephsqlite-19.0.0-3133.ga8c84f59.e 1.9 MB/s | 163 kB 00:00 2024-04-20T12:10:03.870 INFO:teuthology.orchestra.run.smithi139.stdout:(16/150): librados-devel-19.0.0-3133.ga8c84f59. 949 kB/s | 126 kB 00:00 2024-04-20T12:10:04.020 INFO:teuthology.orchestra.run.smithi139.stdout:(17/150): libradosstriper1-19.0.0-3133.ga8c84f5 3.3 MB/s | 501 kB 00:00 2024-04-20T12:10:04.426 INFO:teuthology.orchestra.run.smithi154.stdout:(2/150): ceph-fuse-19.0.0-3133.ga8c84f59.el9.x8 1.0 MB/s | 893 kB 00:00 2024-04-20T12:10:04.593 INFO:teuthology.orchestra.run.smithi154.stdout:(3/150): ceph-immutable-object-cache-19.0.0-313 870 kB/s | 145 kB 00:00 2024-04-20T12:10:05.420 INFO:teuthology.orchestra.run.smithi139.stdout:(18/150): librgw2-19.0.0-3133.ga8c84f59.el9.x86 3.8 MB/s | 5.4 MB 00:01 2024-04-20T12:10:05.521 INFO:teuthology.orchestra.run.smithi139.stdout:(19/150): python3-ceph-argparse-19.0.0-3133.ga8 452 kB/s | 45 kB 00:00 2024-04-20T12:10:05.629 INFO:teuthology.orchestra.run.smithi139.stdout:(20/150): python3-ceph-common-19.0.0-3133.ga8c8 1.2 MB/s | 135 kB 00:00 2024-04-20T12:10:05.738 INFO:teuthology.orchestra.run.smithi139.stdout:(21/150): python3-cephfs-19.0.0-3133.ga8c84f59. 1.5 MB/s | 162 kB 00:00 2024-04-20T12:10:05.905 INFO:teuthology.orchestra.run.smithi139.stdout:(22/150): python3-rados-19.0.0-3133.ga8c84f59.e 1.9 MB/s | 321 kB 00:00 2024-04-20T12:10:06.001 INFO:teuthology.orchestra.run.smithi154.stdout:(4/150): ceph-mds-19.0.0-3133.ga8c84f59.el9.x86 1.7 MB/s | 2.4 MB 00:01 2024-04-20T12:10:06.005 INFO:teuthology.orchestra.run.smithi139.stdout:(23/150): python3-rbd-19.0.0-3133.ga8c84f59.el9 2.9 MB/s | 299 kB 00:00 2024-04-20T12:10:06.068 INFO:teuthology.orchestra.run.smithi154.stdout:(5/150): ceph-base-19.0.0-3133.ga8c84f59.el9.x8 1.9 MB/s | 5.4 MB 00:02 2024-04-20T12:10:06.089 INFO:teuthology.orchestra.run.smithi139.stdout:(24/150): python3-rgw-19.0.0-3133.ga8c84f59.el9 1.2 MB/s | 99 kB 00:00 2024-04-20T12:10:06.181 INFO:teuthology.orchestra.run.smithi139.stdout:(25/150): rbd-fuse-19.0.0-3133.ga8c84f59.el9.x8 930 kB/s | 85 kB 00:00 2024-04-20T12:10:06.371 INFO:teuthology.orchestra.run.smithi135.stdout:(8/150): ceph-osd-19.0.0-3133.ga8c84f59.el9.x86 2.3 MB/s | 17 MB 00:07 2024-04-20T12:10:06.739 INFO:teuthology.orchestra.run.smithi139.stdout:(26/150): ceph-osd-19.0.0-3133.ga8c84f59.el9.x8 2.9 MB/s | 17 MB 00:05 2024-04-20T12:10:06.769 INFO:teuthology.orchestra.run.smithi154.stdout:(6/150): ceph-mgr-19.0.0-3133.ga8c84f59.el9.x86 2.0 MB/s | 1.5 MB 00:00 2024-04-20T12:10:06.838 INFO:teuthology.orchestra.run.smithi135.stdout:(9/150): ceph-selinux-19.0.0-3133.ga8c84f59.el9 54 kB/s | 25 kB 00:00 2024-04-20T12:10:06.881 INFO:teuthology.orchestra.run.smithi139.stdout:(27/150): rbd-nbd-19.0.0-3133.ga8c84f59.el9.x86 1.2 MB/s | 170 kB 00:00 2024-04-20T12:10:06.965 INFO:teuthology.orchestra.run.smithi139.stdout:(28/150): rbd-mirror-19.0.0-3133.ga8c84f59.el9. 3.9 MB/s | 3.1 MB 00:00 2024-04-20T12:10:06.998 INFO:teuthology.orchestra.run.smithi139.stdout:(29/150): ceph-grafana-dashboards-19.0.0-3133.g 293 kB/s | 34 kB 00:00 2024-04-20T12:10:07.049 INFO:teuthology.orchestra.run.smithi139.stdout:(30/150): ceph-mgr-cephadm-19.0.0-3133.ga8c84f5 1.7 MB/s | 142 kB 00:00 2024-04-20T12:10:07.060 INFO:teuthology.orchestra.run.smithi154.stdout:(7/150): ceph-mon-19.0.0-3133.ga8c84f59.el9.x86 4.7 MB/s | 4.7 MB 00:00 2024-04-20T12:10:08.130 INFO:teuthology.orchestra.run.smithi135.stdout:(10/150): ceph-radosgw-19.0.0-3133.ga8c84f59.el 1.6 MB/s | 11 MB 00:06 2024-04-20T12:10:08.422 INFO:teuthology.orchestra.run.smithi135.stdout:(11/150): cephfs-mirror-19.0.0-3133.ga8c84f59.e 771 kB/s | 225 kB 00:00 2024-04-20T12:10:08.530 INFO:teuthology.orchestra.run.smithi135.stdout:(12/150): cephfs-shell-19.0.0-3133.ga8c84f59.el 249 kB/s | 27 kB 00:00 2024-04-20T12:10:08.630 INFO:teuthology.orchestra.run.smithi135.stdout:(13/150): libcephfs-devel-19.0.0-3133.ga8c84f59 317 kB/s | 32 kB 00:00 2024-04-20T12:10:08.768 INFO:teuthology.orchestra.run.smithi139.stdout:(31/150): ceph-mgr-dashboard-19.0.0-3133.ga8c84 2.0 MB/s | 3.5 MB 00:01 2024-04-20T12:10:08.935 INFO:teuthology.orchestra.run.smithi139.stdout:(32/150): ceph-mgr-modules-core-19.0.0-3133.ga8 1.5 MB/s | 249 kB 00:00 2024-04-20T12:10:09.027 INFO:teuthology.orchestra.run.smithi139.stdout:(33/150): ceph-mgr-rook-19.0.0-3133.ga8c84f59.e 538 kB/s | 49 kB 00:00 2024-04-20T12:10:09.160 INFO:teuthology.orchestra.run.smithi139.stdout:(34/150): ceph-mgr-diskprediction-local-19.0.0- 3.5 MB/s | 7.4 MB 00:02 2024-04-20T12:10:09.185 INFO:teuthology.orchestra.run.smithi139.stdout:(35/150): ceph-prometheus-alerts-19.0.0-3133.ga 104 kB/s | 16 kB 00:00 2024-04-20T12:10:09.239 INFO:teuthology.orchestra.run.smithi135.stdout:(14/150): ceph-common-19.0.0-3133.ga8c84f59.el9 1.7 MB/s | 21 MB 00:12 2024-04-20T12:10:09.269 INFO:teuthology.orchestra.run.smithi139.stdout:(36/150): ceph-volume-19.0.0-3133.ga8c84f59.el9 2.5 MB/s | 273 kB 00:00 2024-04-20T12:10:09.323 INFO:teuthology.orchestra.run.smithi135.stdout:(15/150): libcephfs2-19.0.0-3133.ga8c84f59.el9. 1.1 MB/s | 748 kB 00:00 2024-04-20T12:10:09.328 INFO:teuthology.orchestra.run.smithi139.stdout:(37/150): cephfs-top-19.0.0-3133.ga8c84f59.el9. 312 kB/s | 18 kB 00:00 2024-04-20T12:10:09.386 INFO:teuthology.orchestra.run.smithi154.stdout:(8/150): ceph-common-19.0.0-3133.ga8c84f59.el9. 3.5 MB/s | 21 MB 00:06 2024-04-20T12:10:09.423 INFO:teuthology.orchestra.run.smithi135.stdout:(16/150): libcephsqlite-19.0.0-3133.ga8c84f59.e 891 kB/s | 163 kB 00:00 2024-04-20T12:10:09.448 INFO:teuthology.orchestra.run.smithi135.stdout:(17/150): librados-devel-19.0.0-3133.ga8c84f59. 1.0 MB/s | 126 kB 00:00 2024-04-20T12:10:09.452 INFO:teuthology.orchestra.run.smithi154.stdout:(9/150): ceph-selinux-19.0.0-3133.ga8c84f59.el9 379 kB/s | 25 kB 00:00 2024-04-20T12:10:09.453 INFO:teuthology.orchestra.run.smithi139.stdout:(38/150): cephadm-19.0.0-3133.ga8c84f59.el9.noa 2.8 MB/s | 763 kB 00:00 2024-04-20T12:10:09.537 INFO:teuthology.orchestra.run.smithi139.stdout:(39/150): fuse-2.9.9-15.el9.x86_64.rpm 385 kB/s | 80 kB 00:00 2024-04-20T12:10:09.578 INFO:teuthology.orchestra.run.smithi154.stdout:(10/150): ceph-radosgw-19.0.0-3133.ga8c84f59.el 4.2 MB/s | 11 MB 00:02 2024-04-20T12:10:09.612 INFO:teuthology.orchestra.run.smithi139.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 195 kB 00:00 2024-04-20T12:10:09.636 INFO:teuthology.orchestra.run.smithi154.stdout:(11/150): cephfs-mirror-19.0.0-3133.ga8c84f59.e 3.8 MB/s | 225 kB 00:00 2024-04-20T12:10:09.665 INFO:teuthology.orchestra.run.smithi135.stdout:(18/150): libradosstriper1-19.0.0-3133.ga8c84f5 2.0 MB/s | 501 kB 00:00 2024-04-20T12:10:09.687 INFO:teuthology.orchestra.run.smithi154.stdout:(12/150): cephfs-shell-19.0.0-3133.ga8c84f59.el 541 kB/s | 27 kB 00:00 2024-04-20T12:10:09.687 INFO:teuthology.orchestra.run.smithi139.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-04-20T12:10:09.720 INFO:teuthology.orchestra.run.smithi139.stdout:(42/150): libgfortran-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 803 kB 00:00 2024-04-20T12:10:09.741 INFO:teuthology.orchestra.run.smithi135.stdout:(19/150): python3-ceph-argparse-19.0.0-3133.ga8 600 kB/s | 45 kB 00:00 2024-04-20T12:10:09.745 INFO:teuthology.orchestra.run.smithi154.stdout:(13/150): libcephfs-devel-19.0.0-3133.ga8c84f59 544 kB/s | 32 kB 00:00 2024-04-20T12:10:09.788 INFO:teuthology.orchestra.run.smithi139.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-20T12:10:09.821 INFO:teuthology.orchestra.run.smithi139.stdout:(44/150): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.2 MB 00:00 2024-04-20T12:10:09.863 INFO:teuthology.orchestra.run.smithi139.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-04-20T12:10:09.874 INFO:teuthology.orchestra.run.smithi135.stdout:(20/150): python3-ceph-common-19.0.0-3133.ga8c8 1.0 MB/s | 135 kB 00:00 2024-04-20T12:10:09.888 INFO:teuthology.orchestra.run.smithi139.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-20T12:10:09.920 INFO:teuthology.orchestra.run.smithi154.stdout:(14/150): libcephfs2-19.0.0-3133.ga8c84f59.el9. 4.2 MB/s | 748 kB 00:00 2024-04-20T12:10:09.930 INFO:teuthology.orchestra.run.smithi139.stdout:(47/150): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-04-20T12:10:09.987 INFO:teuthology.orchestra.run.smithi154.stdout:(15/150): libcephsqlite-19.0.0-3133.ga8c84f59.e 2.4 MB/s | 163 kB 00:00 2024-04-20T12:10:10.016 INFO:teuthology.orchestra.run.smithi135.stdout:(21/150): python3-cephfs-19.0.0-3133.ga8c84f59. 1.1 MB/s | 162 kB 00:00 2024-04-20T12:10:10.054 INFO:teuthology.orchestra.run.smithi154.stdout:(16/150): librados-devel-19.0.0-3133.ga8c84f59. 1.9 MB/s | 126 kB 00:00 2024-04-20T12:10:10.156 INFO:teuthology.orchestra.run.smithi139.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-04-20T12:10:10.188 INFO:teuthology.orchestra.run.smithi154.stdout:(17/150): libradosstriper1-19.0.0-3133.ga8c84f5 3.7 MB/s | 501 kB 00:00 2024-04-20T12:10:10.214 INFO:teuthology.orchestra.run.smithi139.stdout:(49/150): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-04-20T12:10:10.225 INFO:teuthology.orchestra.run.smithi135.stdout:(22/150): python3-rados-19.0.0-3133.ga8c84f59.e 1.5 MB/s | 321 kB 00:00 2024-04-20T12:10:10.239 INFO:teuthology.orchestra.run.smithi139.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 107 kB 00:00 2024-04-20T12:10:10.265 INFO:teuthology.orchestra.run.smithi139.stdout:(51/150): elfutils-libelf-devel-0.190-2.el9.x86 427 kB/s | 21 kB 00:00 2024-04-20T12:10:10.323 INFO:teuthology.orchestra.run.smithi139.stdout:(52/150): flexiblas-3.0.4-8.el9.x86_64.rpm 561 kB/s | 33 kB 00:00 2024-04-20T12:10:10.348 INFO:teuthology.orchestra.run.smithi139.stdout:(53/150): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-04-20T12:10:10.416 INFO:teuthology.orchestra.run.smithi139.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-04-20T12:10:10.483 INFO:teuthology.orchestra.run.smithi139.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-04-20T12:10:10.501 INFO:teuthology.orchestra.run.smithi135.stdout:(23/150): python3-rbd-19.0.0-3133.ga8c84f59.el9 1.1 MB/s | 299 kB 00:00 2024-04-20T12:10:10.550 INFO:teuthology.orchestra.run.smithi139.stdout:(56/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-04-20T12:10:10.616 INFO:teuthology.orchestra.run.smithi139.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 678 kB/s | 45 kB 00:00 2024-04-20T12:10:10.618 INFO:teuthology.orchestra.run.smithi135.stdout:(24/150): python3-rgw-19.0.0-3133.ga8c84f59.el9 854 kB/s | 99 kB 00:00 2024-04-20T12:10:10.693 INFO:teuthology.orchestra.run.smithi135.stdout:(25/150): rbd-fuse-19.0.0-3133.ga8c84f59.el9.x8 1.1 MB/s | 85 kB 00:00 2024-04-20T12:10:10.758 INFO:teuthology.orchestra.run.smithi139.stdout:(58/150): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-04-20T12:10:10.892 INFO:teuthology.orchestra.run.smithi139.stdout:(59/150): libtool-2.4.6-45.el9.x86_64.rpm 4.3 MB/s | 582 kB 00:00 2024-04-20T12:10:10.942 INFO:teuthology.orchestra.run.smithi139.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 511 kB/s | 25 kB 00:00 2024-04-20T12:10:11.034 INFO:teuthology.orchestra.run.smithi139.stdout:(61/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.2 MB/s | 3.0 MB 00:00 2024-04-20T12:10:11.060 INFO:teuthology.orchestra.run.smithi139.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 405 kB/s | 47 kB 00:00 2024-04-20T12:10:11.118 INFO:teuthology.orchestra.run.smithi139.stdout:(63/150): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-04-20T12:10:11.143 INFO:teuthology.orchestra.run.smithi139.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-04-20T12:10:11.177 INFO:teuthology.orchestra.run.smithi139.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 601 kB/s | 35 kB 00:00 2024-04-20T12:10:11.197 INFO:teuthology.orchestra.run.smithi154.stdout:(18/150): librgw2-19.0.0-3133.ga8c84f59.el9.x86 5.3 MB/s | 5.4 MB 00:01 2024-04-20T12:10:11.264 INFO:teuthology.orchestra.run.smithi154.stdout:(19/150): python3-ceph-argparse-19.0.0-3133.ga8 679 kB/s | 45 kB 00:00 2024-04-20T12:10:11.339 INFO:teuthology.orchestra.run.smithi154.stdout:(20/150): python3-ceph-common-19.0.0-3133.ga8c8 1.8 MB/s | 135 kB 00:00 2024-04-20T12:10:11.414 INFO:teuthology.orchestra.run.smithi154.stdout:(21/150): python3-cephfs-19.0.0-3133.ga8c84f59. 2.1 MB/s | 162 kB 00:00 2024-04-20T12:10:11.598 INFO:teuthology.orchestra.run.smithi154.stdout:(22/150): python3-rados-19.0.0-3133.ga8c84f59.e 1.7 MB/s | 321 kB 00:00 2024-04-20T12:10:11.681 INFO:teuthology.orchestra.run.smithi154.stdout:(23/150): python3-rbd-19.0.0-3133.ga8c84f59.el9 3.5 MB/s | 299 kB 00:00 2024-04-20T12:10:11.744 INFO:teuthology.orchestra.run.smithi139.stdout:(66/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 7.3 MB/s | 4.1 MB 00:00 2024-04-20T12:10:11.757 INFO:teuthology.orchestra.run.smithi154.stdout:(24/150): python3-rgw-19.0.0-3133.ga8c84f59.el9 1.3 MB/s | 99 kB 00:00 2024-04-20T12:10:11.832 INFO:teuthology.orchestra.run.smithi154.stdout:(25/150): rbd-fuse-19.0.0-3133.ga8c84f59.el9.x8 1.1 MB/s | 85 kB 00:00 2024-04-20T12:10:11.961 INFO:teuthology.orchestra.run.smithi139.stdout:(67/150): postgresql-13.14-1.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2024-04-20T12:10:12.111 INFO:teuthology.orchestra.run.smithi139.stdout:(68/150): postgresql-contrib-13.14-1.el9.x86_64 5.9 MB/s | 911 kB 00:00 2024-04-20T12:10:12.170 INFO:teuthology.orchestra.run.smithi139.stdout:(69/150): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-20T12:10:12.482 INFO:teuthology.orchestra.run.smithi154.stdout:(26/150): rbd-mirror-19.0.0-3133.ga8c84f59.el9. 4.8 MB/s | 3.1 MB 00:00 2024-04-20T12:10:12.486 INFO:teuthology.orchestra.run.smithi139.stdout:(70/150): openblas-openmp-0.3.21-2.el9.x86_64.r 3.5 MB/s | 4.7 MB 00:01 2024-04-20T12:10:12.493 INFO:teuthology.orchestra.run.smithi135.stdout:(26/150): librgw2-19.0.0-3133.ga8c84f59.el9.x86 1.8 MB/s | 5.4 MB 00:03 2024-04-20T12:10:12.541 INFO:teuthology.orchestra.run.smithi154.stdout:(27/150): rbd-nbd-19.0.0-3133.ga8c84f59.el9.x86 2.9 MB/s | 170 kB 00:00 2024-04-20T12:10:12.544 INFO:teuthology.orchestra.run.smithi135.stdout:(27/150): rbd-mirror-19.0.0-3133.ga8c84f59.el9. 1.7 MB/s | 3.1 MB 00:01 2024-04-20T12:10:12.608 INFO:teuthology.orchestra.run.smithi154.stdout:(28/150): ceph-grafana-dashboards-19.0.0-3133.g 513 kB/s | 34 kB 00:00 2024-04-20T12:10:12.627 INFO:teuthology.orchestra.run.smithi135.stdout:(28/150): ceph-grafana-dashboards-19.0.0-3133.g 411 kB/s | 34 kB 00:00 2024-04-20T12:10:12.653 INFO:teuthology.orchestra.run.smithi135.stdout:(29/150): rbd-nbd-19.0.0-3133.ga8c84f59.el9.x86 1.0 MB/s | 170 kB 00:00 2024-04-20T12:10:12.700 INFO:teuthology.orchestra.run.smithi154.stdout:(29/150): ceph-mgr-cephadm-19.0.0-3133.ga8c84f5 1.5 MB/s | 142 kB 00:00 2024-04-20T12:10:12.779 INFO:teuthology.orchestra.run.smithi135.stdout:(30/150): ceph-mgr-cephadm-19.0.0-3133.ga8c84f5 945 kB/s | 142 kB 00:00 2024-04-20T12:10:12.779 INFO:teuthology.orchestra.run.smithi139.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 3.5 MB/s | 1.0 MB 00:00 2024-04-20T12:10:12.854 INFO:teuthology.orchestra.run.smithi139.stdout:(72/150): postgresql-server-13.14-1.el9.x86_64. 8.5 MB/s | 5.8 MB 00:00 2024-04-20T12:10:12.879 INFO:teuthology.orchestra.run.smithi139.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 873 kB/s | 87 kB 00:00 2024-04-20T12:10:13.004 INFO:teuthology.orchestra.run.smithi139.stdout:(74/150): python3-devel-3.9.18-3.el9.x86_64.rpm 1.9 MB/s | 244 kB 00:00 2024-04-20T12:10:13.163 INFO:teuthology.orchestra.run.smithi139.stdout:(75/150): python3-jinja2-2.11.3-5.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-04-20T12:10:13.213 INFO:teuthology.orchestra.run.smithi139.stdout:(76/150): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-04-20T12:10:13.264 INFO:teuthology.orchestra.run.smithi139.stdout:(77/150): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-04-20T12:10:13.339 INFO:teuthology.orchestra.run.smithi139.stdout:(78/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-20T12:10:13.397 INFO:teuthology.orchestra.run.smithi139.stdout:(79/150): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-04-20T12:10:13.409 INFO:teuthology.orchestra.run.smithi154.stdout:(30/150): ceph-mgr-dashboard-19.0.0-3133.ga8c84 5.0 MB/s | 3.5 MB 00:00 2024-04-20T12:10:13.639 INFO:teuthology.orchestra.run.smithi139.stdout:(80/150): python3-babel-2.9.1-2.el9.noarch.rpm 7.6 MB/s | 6.0 MB 00:00 2024-04-20T12:10:13.698 INFO:teuthology.orchestra.run.smithi139.stdout:(81/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-04-20T12:10:13.748 INFO:teuthology.orchestra.run.smithi139.stdout:(82/150): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-04-20T12:10:13.798 INFO:teuthology.orchestra.run.smithi139.stdout:(83/150): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-20T12:10:14.034 INFO:teuthology.orchestra.run.smithi154.stdout:(31/150): ceph-osd-19.0.0-3133.ga8c84f59.el9.x8 2.3 MB/s | 17 MB 00:07 2024-04-20T12:10:14.168 INFO:teuthology.orchestra.run.smithi154.stdout:(32/150): ceph-mgr-modules-core-19.0.0-3133.ga8 1.8 MB/s | 249 kB 00:00 2024-04-20T12:10:14.234 INFO:teuthology.orchestra.run.smithi154.stdout:(33/150): ceph-mgr-rook-19.0.0-3133.ga8c84f59.e 742 kB/s | 49 kB 00:00 2024-04-20T12:10:14.257 INFO:teuthology.orchestra.run.smithi139.stdout:(84/150): ceph-test-19.0.0-3133.ga8c84f59.el9.x 4.4 MB/s | 49 MB 00:11 2024-04-20T12:10:14.282 INFO:teuthology.orchestra.run.smithi139.stdout:(85/150): python3-prettytable-0.7.2-27.el9.noar 87 kB/s | 42 kB 00:00 2024-04-20T12:10:14.301 INFO:teuthology.orchestra.run.smithi154.stdout:(34/150): ceph-prometheus-alerts-19.0.0-3133.ga 247 kB/s | 16 kB 00:00 2024-04-20T12:10:14.362 INFO:teuthology.orchestra.run.smithi135.stdout:(31/150): ceph-mgr-dashboard-19.0.0-3133.ga8c84 2.1 MB/s | 3.5 MB 00:01 2024-04-20T12:10:14.366 INFO:teuthology.orchestra.run.smithi139.stdout:(86/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-04-20T12:10:14.418 INFO:teuthology.orchestra.run.smithi154.stdout:(35/150): ceph-volume-19.0.0-3133.ga8c84f59.el9 2.3 MB/s | 273 kB 00:00 2024-04-20T12:10:14.450 INFO:teuthology.orchestra.run.smithi139.stdout:(87/150): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-04-20T12:10:14.475 INFO:teuthology.orchestra.run.smithi139.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 1.2 MB/s | 269 kB 00:00 2024-04-20T12:10:14.500 INFO:teuthology.orchestra.run.smithi139.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-20T12:10:14.521 INFO:teuthology.orchestra.run.smithi135.stdout:(32/150): ceph-mgr-modules-core-19.0.0-3133.ga8 1.5 MB/s | 249 kB 00:00 2024-04-20T12:10:14.526 INFO:teuthology.orchestra.run.smithi139.stdout:(90/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-20T12:10:14.576 INFO:teuthology.orchestra.run.smithi139.stdout:(91/150): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-04-20T12:10:14.596 INFO:teuthology.orchestra.run.smithi135.stdout:(33/150): ceph-mgr-rook-19.0.0-3133.ga8c84f59.e 659 kB/s | 49 kB 00:00 2024-04-20T12:10:14.626 INFO:teuthology.orchestra.run.smithi139.stdout:(92/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 890 kB/s | 44 kB 00:00 2024-04-20T12:10:14.652 INFO:teuthology.orchestra.run.smithi154.stdout:(36/150): cephadm-19.0.0-3133.ga8c84f59.el9.noa 3.2 MB/s | 763 kB 00:00 2024-04-20T12:10:14.671 INFO:teuthology.orchestra.run.smithi135.stdout:(34/150): ceph-prometheus-alerts-19.0.0-3133.ga 218 kB/s | 16 kB 00:00 2024-04-20T12:10:14.693 INFO:teuthology.orchestra.run.smithi139.stdout:(93/150): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-04-20T12:10:14.736 INFO:teuthology.orchestra.run.smithi154.stdout:(37/150): ceph-mgr-diskprediction-local-19.0.0- 5.6 MB/s | 7.4 MB 00:01 2024-04-20T12:10:14.751 INFO:teuthology.orchestra.run.smithi139.stdout:(94/150): qatlib-service-24.02.0-1.el9.x86_64.r 617 kB/s | 36 kB 00:00 2024-04-20T12:10:14.761 INFO:teuthology.orchestra.run.smithi154.stdout:(38/150): cephfs-top-19.0.0-3133.ga8c84f59.el9. 168 kB/s | 18 kB 00:00 2024-04-20T12:10:14.771 INFO:teuthology.orchestra.run.smithi135.stdout:(35/150): ceph-volume-19.0.0-3133.ga8c84f59.el9 2.7 MB/s | 273 kB 00:00 2024-04-20T12:10:14.810 INFO:teuthology.orchestra.run.smithi139.stdout:(95/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 814 kB/s | 47 kB 00:00 2024-04-20T12:10:14.878 INFO:teuthology.orchestra.run.smithi154.stdout:(39/150): fuse-2.9.9-15.el9.x86_64.rpm 567 kB/s | 80 kB 00:00 2024-04-20T12:10:14.894 INFO:teuthology.orchestra.run.smithi139.stdout:(96/150): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 305 kB 00:00 2024-04-20T12:10:14.952 INFO:teuthology.orchestra.run.smithi139.stdout:(97/150): uuid-1.6.2-55.el9.x86_64.rpm 994 kB/s | 58 kB 00:00 2024-04-20T12:10:14.953 INFO:teuthology.orchestra.run.smithi154.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 195 kB 00:00 2024-04-20T12:10:15.004 INFO:teuthology.orchestra.run.smithi154.stdout:(41/150): libgfortran-11.4.1-3.el9.x86_64.rpm 3.2 MB/s | 803 kB 00:00 2024-04-20T12:10:15.005 INFO:teuthology.orchestra.run.smithi135.stdout:(36/150): cephadm-19.0.0-3133.ga8c84f59.el9.noa 3.2 MB/s | 763 kB 00:00 2024-04-20T12:10:15.011 INFO:teuthology.orchestra.run.smithi139.stdout:(98/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-20T12:10:15.054 INFO:teuthology.orchestra.run.smithi154.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-04-20T12:10:15.069 INFO:teuthology.orchestra.run.smithi139.stdout:(99/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-20T12:10:15.080 INFO:teuthology.orchestra.run.smithi135.stdout:(37/150): cephfs-top-19.0.0-3133.ga8c84f59.el9. 243 kB/s | 18 kB 00:00 2024-04-20T12:10:15.096 INFO:teuthology.orchestra.run.smithi154.stdout:(43/150): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-04-20T12:10:15.121 INFO:teuthology.orchestra.run.smithi154.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-20T12:10:15.128 INFO:teuthology.orchestra.run.smithi139.stdout:(100/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 769 kB/s | 45 kB 00:00 2024-04-20T12:10:15.155 INFO:teuthology.orchestra.run.smithi154.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-20T12:10:15.180 INFO:teuthology.orchestra.run.smithi154.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-20T12:10:15.214 INFO:teuthology.orchestra.run.smithi154.stdout:(47/150): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-04-20T12:10:15.223 INFO:teuthology.orchestra.run.smithi135.stdout:(38/150): fuse-2.9.9-15.el9.x86_64.rpm 567 kB/s | 80 kB 00:00 2024-04-20T12:10:15.237 INFO:teuthology.orchestra.run.smithi139.stdout:(101/150): python3-numpy-1.20.1-5.el9.x86_64.rp 2.8 MB/s | 5.1 MB 00:01 2024-04-20T12:10:15.314 INFO:teuthology.orchestra.run.smithi154.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 5.0 MB/s | 689 kB 00:00 2024-04-20T12:10:15.348 INFO:teuthology.orchestra.run.smithi154.stdout:(49/150): bison-3.7.4-5.el9.x86_64.rpm 6.9 MB/s | 943 kB 00:00 2024-04-20T12:10:15.356 INFO:teuthology.orchestra.run.smithi135.stdout:(39/150): libgfortran-11.4.1-3.el9.x86_64.rpm 5.9 MB/s | 803 kB 00:00 2024-04-20T12:10:15.373 INFO:teuthology.orchestra.run.smithi154.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-20T12:10:15.407 INFO:teuthology.orchestra.run.smithi154.stdout:(51/150): elfutils-libelf-devel-0.190-2.el9.x86 366 kB/s | 21 kB 00:00 2024-04-20T12:10:15.407 INFO:teuthology.orchestra.run.smithi135.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-04-20T12:10:15.420 INFO:teuthology.orchestra.run.smithi139.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-04-20T12:10:15.440 INFO:teuthology.orchestra.run.smithi154.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-04-20T12:10:15.457 INFO:teuthology.orchestra.run.smithi135.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-04-20T12:10:15.466 INFO:teuthology.orchestra.run.smithi154.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 556 kB/s | 33 kB 00:00 2024-04-20T12:10:15.516 INFO:teuthology.orchestra.run.smithi154.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-04-20T12:10:15.600 INFO:teuthology.orchestra.run.smithi154.stdout:(55/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-04-20T12:10:15.625 INFO:teuthology.orchestra.run.smithi154.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-04-20T12:10:15.654 INFO:teuthology.orchestra.run.smithi139.stdout:(103/150): abseil-cpp-20211102.0-3.el9.x86_64.r 2.3 MB/s | 548 kB 00:00 2024-04-20T12:10:15.661 INFO:teuthology.orchestra.run.smithi154.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-04-20T12:10:15.683 INFO:teuthology.orchestra.run.smithi135.stdout:(42/150): python3-cryptography-36.0.1-4.el9.x86 5.4 MB/s | 1.2 MB 00:00 2024-04-20T12:10:15.684 INFO:teuthology.orchestra.run.smithi154.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-04-20T12:10:15.713 INFO:teuthology.orchestra.run.smithi139.stdout:(104/150): gperftools-libs-2.9.1-2.el9.x86_64.r 5.2 MB/s | 309 kB 00:00 2024-04-20T12:10:15.718 INFO:teuthology.orchestra.run.smithi154.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-20T12:10:15.760 INFO:teuthology.orchestra.run.smithi154.stdout:(60/150): libtool-2.4.6-45.el9.x86_64.rpm 7.6 MB/s | 582 kB 00:00 2024-04-20T12:10:15.763 INFO:teuthology.orchestra.run.smithi139.stdout:(105/150): grpc-data-1.46.7-10.el9.noarch.rpm 390 kB/s | 19 kB 00:00 2024-04-20T12:10:15.783 INFO:teuthology.orchestra.run.smithi135.stdout:(43/150): ceph-mgr-diskprediction-local-19.0.0- 2.5 MB/s | 7.4 MB 00:03 2024-04-20T12:10:15.785 INFO:teuthology.orchestra.run.smithi154.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-04-20T12:10:15.808 INFO:teuthology.orchestra.run.smithi135.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 849 kB/s | 106 kB 00:00 2024-04-20T12:10:15.810 INFO:teuthology.orchestra.run.smithi154.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-04-20T12:10:15.852 INFO:teuthology.orchestra.run.smithi154.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-04-20T12:10:15.859 INFO:teuthology.orchestra.run.smithi135.stdout:(45/150): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-20T12:10:15.877 INFO:teuthology.orchestra.run.smithi154.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-20T12:10:15.903 INFO:teuthology.orchestra.run.smithi154.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 703 kB/s | 35 kB 00:00 2024-04-20T12:10:15.909 INFO:teuthology.orchestra.run.smithi135.stdout:(46/150): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-20T12:10:15.930 INFO:teuthology.orchestra.run.smithi139.stdout:(106/150): libarrow-9.0.0-10.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-04-20T12:10:15.935 INFO:teuthology.orchestra.run.smithi135.stdout:(47/150): python3-pycparser-2.20-6.el9.noarch.r 894 kB/s | 135 kB 00:00 2024-04-20T12:10:15.980 INFO:teuthology.orchestra.run.smithi139.stdout:(107/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 522 kB/s | 26 kB 00:00 2024-04-20T12:10:16.005 INFO:teuthology.orchestra.run.smithi139.stdout:(108/150): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-04-20T12:10:16.030 INFO:teuthology.orchestra.run.smithi139.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 968 kB/s | 49 kB 00:00 2024-04-20T12:10:16.081 INFO:teuthology.orchestra.run.smithi139.stdout:(110/150): luarocks-3.9.2-1.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-04-20T12:10:16.131 INFO:teuthology.orchestra.run.smithi139.stdout:(111/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 16 MB/s | 838 kB 00:00 2024-04-20T12:10:16.157 INFO:teuthology.orchestra.run.smithi139.stdout:(112/150): libunwind-1.6.2-1.el9.x86_64.rpm 447 kB/s | 67 kB 00:00 2024-04-20T12:10:16.181 INFO:teuthology.orchestra.run.smithi139.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-04-20T12:10:16.207 INFO:teuthology.orchestra.run.smithi139.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 865 kB/s | 43 kB 00:00 2024-04-20T12:10:16.224 INFO:teuthology.orchestra.run.smithi139.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 765 kB/s | 32 kB 00:00 2024-04-20T12:10:16.249 INFO:teuthology.orchestra.run.smithi139.stdout:(116/150): python3-certifi-2021.10.8-2.el9.noar 358 kB/s | 15 kB 00:00 2024-04-20T12:10:16.275 INFO:teuthology.orchestra.run.smithi139.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-04-20T12:10:16.325 INFO:teuthology.orchestra.run.smithi139.stdout:(118/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-04-20T12:10:16.358 INFO:teuthology.orchestra.run.smithi139.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-04-20T12:10:16.384 INFO:teuthology.orchestra.run.smithi139.stdout:(120/150): python3-colorama-0.4.4-12.el9.noarch 603 kB/s | 35 kB 00:00 2024-04-20T12:10:16.453 INFO:teuthology.orchestra.run.smithi154.stdout:(66/150): ceph-test-19.0.0-3133.ga8c84f59.el9.x 7.0 MB/s | 49 MB 00:07 2024-04-20T12:10:16.529 INFO:teuthology.orchestra.run.smithi154.stdout:(67/150): openblas-openmp-0.3.21-2.el9.x86_64.r 7.3 MB/s | 4.7 MB 00:00 2024-04-20T12:10:16.534 INFO:teuthology.orchestra.run.smithi139.stdout:(121/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.0 MB/s | 16 MB 00:02 2024-04-20T12:10:16.559 INFO:teuthology.orchestra.run.smithi139.stdout:(122/150): python3-google-auth-2.28.2-1.el9.noa 1.0 MB/s | 203 kB 00:00 2024-04-20T12:10:16.587 INFO:teuthology.orchestra.run.smithi154.stdout:(68/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 6.0 MB/s | 4.1 MB 00:00 2024-04-20T12:10:16.609 INFO:teuthology.orchestra.run.smithi139.stdout:(123/150): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-04-20T12:10:16.621 INFO:teuthology.orchestra.run.smithi154.stdout:(69/150): postgresql-contrib-13.14-1.el9.x86_64 9.7 MB/s | 911 kB 00:00 2024-04-20T12:10:16.635 INFO:teuthology.orchestra.run.smithi139.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-04-20T12:10:16.646 INFO:teuthology.orchestra.run.smithi154.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-20T12:10:16.660 INFO:teuthology.orchestra.run.smithi139.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-04-20T12:10:16.685 INFO:teuthology.orchestra.run.smithi139.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-04-20T12:10:16.693 INFO:teuthology.orchestra.run.smithi135.stdout:(48/150): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-04-20T12:10:16.710 INFO:teuthology.orchestra.run.smithi139.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-04-20T12:10:16.719 INFO:teuthology.orchestra.run.smithi135.stdout:(49/150): automake-1.16.2-8.el9.noarch.rpm 852 kB/s | 689 kB 00:00 2024-04-20T12:10:16.735 INFO:teuthology.orchestra.run.smithi139.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-04-20T12:10:16.755 INFO:teuthology.orchestra.run.smithi154.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-04-20T12:10:16.761 INFO:teuthology.orchestra.run.smithi139.stdout:(129/150): python3-grpcio-tools-1.46.7-10.el9.x 638 kB/s | 144 kB 00:00 2024-04-20T12:10:16.786 INFO:teuthology.orchestra.run.smithi139.stdout:(130/150): python3-logutils-0.3.5-21.el9.noarch 923 kB/s | 46 kB 00:00 2024-04-20T12:10:16.802 INFO:teuthology.orchestra.run.smithi135.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 984 kB/s | 107 kB 00:00 2024-04-20T12:10:16.820 INFO:teuthology.orchestra.run.smithi139.stdout:(131/150): python3-kubernetes-26.1.0-2.el9.noar 9.4 MB/s | 1.0 MB 00:00 2024-04-20T12:10:16.821 INFO:teuthology.orchestra.run.smithi154.stdout:(72/150): postgresql-13.14-1.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2024-04-20T12:10:16.828 INFO:teuthology.orchestra.run.smithi135.stdout:(51/150): elfutils-libelf-devel-0.190-2.el9.x86 198 kB/s | 21 kB 00:00 2024-04-20T12:10:16.845 INFO:teuthology.orchestra.run.smithi139.stdout:(132/150): python3-more-itertools-8.12.0-2.el9. 942 kB/s | 79 kB 00:00 2024-04-20T12:10:16.847 INFO:teuthology.orchestra.run.smithi154.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 953 kB/s | 87 kB 00:00 2024-04-20T12:10:16.870 INFO:teuthology.orchestra.run.smithi139.stdout:(133/150): python3-natsort-7.1.1-5.el9.noarch.r 688 kB/s | 58 kB 00:00 2024-04-20T12:10:16.896 INFO:teuthology.orchestra.run.smithi139.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-04-20T12:10:16.911 INFO:teuthology.orchestra.run.smithi135.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-04-20T12:10:16.921 INFO:teuthology.orchestra.run.smithi139.stdout:(135/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-04-20T12:10:16.931 INFO:teuthology.orchestra.run.smithi154.stdout:(74/150): postgresql-server-13.14-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-04-20T12:10:16.937 INFO:teuthology.orchestra.run.smithi135.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-04-20T12:10:16.946 INFO:teuthology.orchestra.run.smithi139.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 565 kB/s | 28 kB 00:00 2024-04-20T12:10:16.956 INFO:teuthology.orchestra.run.smithi154.stdout:(75/150): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-04-20T12:10:16.966 INFO:teuthology.orchestra.run.smithi139.stdout:(137/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 975 kB/s | 90 kB 00:00 2024-04-20T12:10:16.988 INFO:teuthology.orchestra.run.smithi139.stdout:(138/150): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-04-20T12:10:17.013 INFO:teuthology.orchestra.run.smithi139.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-04-20T12:10:17.039 INFO:teuthology.orchestra.run.smithi139.stdout:(140/150): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-04-20T12:10:17.045 INFO:teuthology.orchestra.run.smithi135.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-04-20T12:10:17.056 INFO:teuthology.orchestra.run.smithi154.stdout:(76/150): python3-jinja2-2.11.3-5.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-04-20T12:10:17.064 INFO:teuthology.orchestra.run.smithi139.stdout:(141/150): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2024-04-20T12:10:17.081 INFO:teuthology.orchestra.run.smithi154.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 204 kB/s | 26 kB 00:00 2024-04-20T12:10:17.089 INFO:teuthology.orchestra.run.smithi139.stdout:(142/150): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-04-20T12:10:17.123 INFO:teuthology.orchestra.run.smithi139.stdout:(143/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-20T12:10:17.148 INFO:teuthology.orchestra.run.smithi139.stdout:(144/150): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-04-20T12:10:17.154 INFO:teuthology.orchestra.run.smithi135.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-04-20T12:10:17.157 INFO:teuthology.orchestra.run.smithi154.stdout:(78/150): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-04-20T12:10:17.173 INFO:teuthology.orchestra.run.smithi139.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-04-20T12:10:17.182 INFO:teuthology.orchestra.run.smithi154.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 153 kB/s | 19 kB 00:00 2024-04-20T12:10:17.207 INFO:teuthology.orchestra.run.smithi139.stdout:(146/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-04-20T12:10:17.207 INFO:teuthology.orchestra.run.smithi154.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-04-20T12:10:17.233 INFO:teuthology.orchestra.run.smithi154.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 459 kB/s | 35 kB 00:00 2024-04-20T12:10:17.257 INFO:teuthology.orchestra.run.smithi139.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-04-20T12:10:17.263 INFO:teuthology.orchestra.run.smithi135.stdout:(56/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-04-20T12:10:17.282 INFO:teuthology.orchestra.run.smithi139.stdout:(148/150): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-04-20T12:10:17.313 INFO:teuthology.orchestra.run.smithi135.stdout:(57/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.4 MB/s | 3.0 MB 00:00 2024-04-20T12:10:17.364 INFO:teuthology.orchestra.run.smithi135.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 450 kB/s | 45 kB 00:00 2024-04-20T12:10:17.408 INFO:teuthology.orchestra.run.smithi154.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 250 kB 00:00 2024-04-20T12:10:17.422 INFO:teuthology.orchestra.run.smithi135.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-04-20T12:10:17.466 INFO:teuthology.orchestra.run.smithi154.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 951 kB/s | 222 kB 00:00 2024-04-20T12:10:17.492 INFO:teuthology.orchestra.run.smithi154.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 924 kB/s | 77 kB 00:00 2024-04-20T12:10:17.514 INFO:teuthology.orchestra.run.smithi135.stdout:(60/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 277 kB/s | 25 kB 00:00 2024-04-20T12:10:17.517 INFO:teuthology.orchestra.run.smithi154.stdout:(85/150): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-04-20T12:10:17.593 INFO:teuthology.orchestra.run.smithi154.stdout:(86/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-04-20T12:10:17.615 INFO:teuthology.orchestra.run.smithi135.stdout:(61/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-04-20T12:10:17.626 INFO:teuthology.orchestra.run.smithi154.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 2.0 MB/s | 269 kB 00:00 2024-04-20T12:10:17.652 INFO:teuthology.orchestra.run.smithi154.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-04-20T12:10:17.677 INFO:teuthology.orchestra.run.smithi154.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-20T12:10:17.702 INFO:teuthology.orchestra.run.smithi154.stdout:(90/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-20T12:10:17.708 INFO:teuthology.orchestra.run.smithi139.stdout:(149/150): librbd1-19.0.0-3133.ga8c84f59.el9.x8 7.0 MB/s | 3.1 MB 00:00 2024-04-20T12:10:17.723 INFO:teuthology.orchestra.run.smithi135.stdout:(62/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-04-20T12:10:17.727 INFO:teuthology.orchestra.run.smithi154.stdout:(91/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-04-20T12:10:17.753 INFO:teuthology.orchestra.run.smithi154.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-04-20T12:10:17.786 INFO:teuthology.orchestra.run.smithi154.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-04-20T12:10:17.811 INFO:teuthology.orchestra.run.smithi154.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-04-20T12:10:17.832 INFO:teuthology.orchestra.run.smithi135.stdout:(63/150): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-04-20T12:10:17.837 INFO:teuthology.orchestra.run.smithi154.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-04-20T12:10:17.862 INFO:teuthology.orchestra.run.smithi154.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-04-20T12:10:17.866 INFO:teuthology.orchestra.run.smithi135.stdout:(64/150): libtool-2.4.6-45.el9.x86_64.rpm 1.1 MB/s | 582 kB 00:00 2024-04-20T12:10:17.899 INFO:teuthology.orchestra.run.smithi139.stdout:(150/150): librados2-19.0.0-3133.ga8c84f59.el9. 4.9 MB/s | 3.4 MB 00:00 2024-04-20T12:10:17.902 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-20T12:10:17.902 INFO:teuthology.orchestra.run.smithi139.stdout:Total 11 MB/s | 218 MB 00:19 2024-04-20T12:10:17.904 INFO:teuthology.orchestra.run.smithi154.stdout:(97/150): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-04-20T12:10:17.929 INFO:teuthology.orchestra.run.smithi154.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 865 kB/s | 58 kB 00:00 2024-04-20T12:10:17.933 INFO:teuthology.orchestra.run.smithi135.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 351 kB/s | 35 kB 00:00 2024-04-20T12:10:17.997 INFO:teuthology.orchestra.run.smithi154.stdout:(99/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.0 MB/s | 94 kB 00:00 2024-04-20T12:10:18.025 INFO:teuthology.orchestra.run.smithi154.stdout:(100/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 668 kB/s | 64 kB 00:00 2024-04-20T12:10:18.080 INFO:teuthology.orchestra.run.smithi154.stdout:(101/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 536 kB/s | 45 kB 00:00 2024-04-20T12:10:18.564 INFO:teuthology.orchestra.run.smithi154.stdout:(102/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-04-20T12:10:18.748 INFO:teuthology.orchestra.run.smithi154.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-04-20T12:10:18.923 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-20T12:10:19.049 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-20T12:10:19.049 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-20T12:10:19.173 INFO:teuthology.orchestra.run.smithi154.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 903 kB/s | 548 kB 00:00 2024-04-20T12:10:19.292 INFO:teuthology.orchestra.run.smithi154.stdout:(105/150): grpc-data-1.46.7-10.el9.noarch.rpm 164 kB/s | 19 kB 00:00 2024-04-20T12:10:19.315 INFO:teuthology.orchestra.run.smithi154.stdout:(106/150): gperftools-libs-2.9.1-2.el9.x86_64.r 545 kB/s | 309 kB 00:00 2024-04-20T12:10:19.416 INFO:teuthology.orchestra.run.smithi154.stdout:(107/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 259 kB/s | 26 kB 00:00 2024-04-20T12:10:19.524 INFO:teuthology.orchestra.run.smithi154.stdout:(108/150): liboath-2.6.7-2.el9.x86_64.rpm 448 kB/s | 49 kB 00:00 2024-04-20T12:10:19.658 INFO:teuthology.orchestra.run.smithi154.stdout:(109/150): libunwind-1.6.2-1.el9.x86_64.rpm 505 kB/s | 67 kB 00:00 2024-04-20T12:10:19.742 INFO:teuthology.orchestra.run.smithi154.stdout:(110/150): libarrow-9.0.0-10.el9.x86_64.rpm 9.8 MB/s | 4.4 MB 00:00 2024-04-20T12:10:19.783 INFO:teuthology.orchestra.run.smithi154.stdout:(111/150): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-04-20T12:10:19.859 INFO:teuthology.orchestra.run.smithi154.stdout:(112/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.0 MB/s | 838 kB 00:00 2024-04-20T12:10:19.951 INFO:teuthology.orchestra.run.smithi154.stdout:(113/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 474 kB/s | 43 kB 00:00 2024-04-20T12:10:19.985 INFO:teuthology.orchestra.run.smithi154.stdout:(114/150): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-04-20T12:10:20.026 INFO:teuthology.orchestra.run.smithi154.stdout:(115/150): protobuf-compiler-3.14.0-13.el9.x86_ 444 kB/s | 863 kB 00:01 2024-04-20T12:10:20.051 INFO:teuthology.orchestra.run.smithi154.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 319 kB/s | 32 kB 00:00 2024-04-20T12:10:20.085 INFO:teuthology.orchestra.run.smithi154.stdout:(117/150): python3-certifi-2021.10.8-2.el9.noar 150 kB/s | 15 kB 00:00 2024-04-20T12:10:20.161 INFO:teuthology.orchestra.run.smithi154.stdout:(118/150): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-04-20T12:10:20.203 INFO:teuthology.orchestra.run.smithi154.stdout:(119/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-04-20T12:10:20.261 INFO:teuthology.orchestra.run.smithi154.stdout:(120/150): python3-colorama-0.4.4-12.el9.noarch 352 kB/s | 35 kB 00:00 2024-04-20T12:10:20.291 INFO:teuthology.orchestra.run.smithi135.stdout:(66/150): openblas-openmp-0.3.21-2.el9.x86_64.r 2.0 MB/s | 4.7 MB 00:02 2024-04-20T12:10:20.311 INFO:teuthology.orchestra.run.smithi154.stdout:(121/150): python3-google-auth-2.28.2-1.el9.noa 1.8 MB/s | 203 kB 00:00 2024-04-20T12:10:20.412 INFO:teuthology.orchestra.run.smithi154.stdout:(122/150): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-04-20T12:10:20.437 INFO:teuthology.orchestra.run.smithi154.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-04-20T12:10:20.487 INFO:teuthology.orchestra.run.smithi154.stdout:(124/150): python3-cheroot-8.6.0-4.el9.noarch.r 373 kB/s | 172 kB 00:00 2024-04-20T12:10:20.512 INFO:teuthology.orchestra.run.smithi154.stdout:(125/150): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2024-04-20T12:10:20.538 INFO:teuthology.orchestra.run.smithi154.stdout:(126/150): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-04-20T12:10:20.588 INFO:teuthology.orchestra.run.smithi154.stdout:(127/150): python3-jaraco-collections-3.0.0-8.e 230 kB/s | 23 kB 00:00 2024-04-20T12:10:20.613 INFO:teuthology.orchestra.run.smithi154.stdout:(128/150): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-04-20T12:10:20.638 INFO:teuthology.orchestra.run.smithi154.stdout:(129/150): python3-jaraco-text-3.2.0-6.el9.noar 195 kB/s | 20 kB 00:00 2024-04-20T12:10:20.706 INFO:teuthology.orchestra.run.smithi154.stdout:(130/150): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-04-20T12:10:20.731 INFO:teuthology.orchestra.run.smithi154.stdout:(131/150): python3-logutils-0.3.5-21.el9.noarch 395 kB/s | 46 kB 00:00 2024-04-20T12:10:20.756 INFO:teuthology.orchestra.run.smithi154.stdout:(132/150): python3-more-itertools-8.12.0-2.el9. 672 kB/s | 79 kB 00:00 2024-04-20T12:10:20.767 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-20T12:10:20.768 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-20T12:10:20.806 INFO:teuthology.orchestra.run.smithi154.stdout:(133/150): python3-natsort-7.1.1-5.el9.noarch.r 574 kB/s | 58 kB 00:00 2024-04-20T12:10:20.873 INFO:teuthology.orchestra.run.smithi154.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2024-04-20T12:10:20.891 INFO:teuthology.orchestra.run.smithi135.stdout:(67/150): postgresql-13.14-1.el9.x86_64.rpm 2.6 MB/s | 1.6 MB 00:00 2024-04-20T12:10:20.907 INFO:teuthology.orchestra.run.smithi154.stdout:(135/150): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-04-20T12:10:20.941 INFO:teuthology.orchestra.run.smithi154.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 670 kB/s | 90 kB 00:00 2024-04-20T12:10:20.974 INFO:teuthology.orchestra.run.smithi154.stdout:(137/150): python3-pyperclip-1.8.2-2.el9.noarch 280 kB/s | 28 kB 00:00 2024-04-20T12:10:20.984 INFO:teuthology.orchestra.run.smithi135.stdout:(68/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 1.4 MB/s | 4.1 MB 00:03 2024-04-20T12:10:21.050 INFO:teuthology.orchestra.run.smithi154.stdout:(138/150): python3-repoze-lru-0.7-16.el9.noarch 216 kB/s | 31 kB 00:00 2024-04-20T12:10:21.075 INFO:teuthology.orchestra.run.smithi154.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 588 kB/s | 59 kB 00:00 2024-04-20T12:10:21.109 INFO:teuthology.orchestra.run.smithi154.stdout:(140/150): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-04-20T12:10:21.200 INFO:teuthology.orchestra.run.smithi154.stdout:(141/150): python3-tempora-5.0.0-2.el9.noarch.r 238 kB/s | 36 kB 00:00 2024-04-20T12:10:21.226 INFO:teuthology.orchestra.run.smithi154.stdout:(142/150): python3-typing-extensions-4.4.0-2.el 339 kB/s | 51 kB 00:00 2024-04-20T12:10:21.251 INFO:teuthology.orchestra.run.smithi154.stdout:(143/150): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-04-20T12:10:21.309 INFO:teuthology.orchestra.run.smithi135.stdout:(69/150): postgresql-contrib-13.14-1.el9.x86_64 2.1 MB/s | 911 kB 00:00 2024-04-20T12:10:21.318 INFO:teuthology.orchestra.run.smithi154.stdout:(144/150): python3-websocket-client-1.2.3-2.el9 764 kB/s | 90 kB 00:00 2024-04-20T12:10:21.326 INFO:teuthology.orchestra.run.smithi135.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 389 kB/s | 133 kB 00:00 2024-04-20T12:10:21.352 INFO:teuthology.orchestra.run.smithi154.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-04-20T12:10:21.377 INFO:teuthology.orchestra.run.smithi154.stdout:(146/150): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-04-20T12:10:21.436 INFO:teuthology.orchestra.run.smithi154.stdout:(147/150): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-04-20T12:10:21.478 INFO:teuthology.orchestra.run.smithi154.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-20T12:10:22.436 INFO:teuthology.orchestra.run.smithi154.stdout:(149/150): librbd1-19.0.0-3133.ga8c84f59.el9.x8 3.1 MB/s | 3.1 MB 00:01 2024-04-20T12:10:22.652 INFO:teuthology.orchestra.run.smithi135.stdout:(71/150): ceph-test-19.0.0-3133.ga8c84f59.el9.x 3.1 MB/s | 49 MB 00:15 2024-04-20T12:10:22.844 INFO:teuthology.orchestra.run.smithi135.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 681 kB/s | 1.0 MB 00:01 2024-04-20T12:10:22.961 INFO:teuthology.orchestra.run.smithi135.stdout:(73/150): postgresql-server-13.14-1.el9.x86_64. 3.5 MB/s | 5.8 MB 00:01 2024-04-20T12:10:23.078 INFO:teuthology.orchestra.run.smithi135.stdout:(74/150): python3-devel-3.9.18-3.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-04-20T12:10:23.103 INFO:teuthology.orchestra.run.smithi135.stdout:(75/150): python3-attrs-20.3.0-7.el9.noarch.rpm 194 kB/s | 87 kB 00:00 2024-04-20T12:10:23.187 INFO:teuthology.orchestra.run.smithi135.stdout:(76/150): python3-jinja2-2.11.3-5.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-04-20T12:10:23.212 INFO:teuthology.orchestra.run.smithi135.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-04-20T12:10:23.286 INFO:teuthology.orchestra.run.smithi154.stdout:(150/150): librados2-19.0.0-3133.ga8c84f59.el9. 1.8 MB/s | 3.4 MB 00:01 2024-04-20T12:10:23.287 INFO:teuthology.orchestra.run.smithi135.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-04-20T12:10:23.289 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2024-04-20T12:10:23.289 INFO:teuthology.orchestra.run.smithi154.stdout:Total 11 MB/s | 218 MB 00:20 2024-04-20T12:10:23.388 INFO:teuthology.orchestra.run.smithi135.stdout:(79/150): python3-markupsafe-1.1.1-12.el9.x86_6 347 kB/s | 35 kB 00:00 2024-04-20T12:10:23.488 INFO:teuthology.orchestra.run.smithi135.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 624 kB/s | 172 kB 00:00 2024-04-20T12:10:23.672 INFO:teuthology.orchestra.run.smithi135.stdout:(81/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-04-20T12:10:23.780 INFO:teuthology.orchestra.run.smithi135.stdout:(82/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.0 MB/s | 222 kB 00:00 2024-04-20T12:10:23.881 INFO:teuthology.orchestra.run.smithi135.stdout:(83/150): python3-packaging-20.9-5.el9.noarch.r 772 kB/s | 77 kB 00:00 2024-04-20T12:10:23.973 INFO:teuthology.orchestra.run.smithi135.stdout:(84/150): python3-prettytable-0.7.2-27.el9.noar 461 kB/s | 42 kB 00:00 2024-04-20T12:10:24.081 INFO:teuthology.orchestra.run.smithi135.stdout:(85/150): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-04-20T12:10:24.198 INFO:teuthology.orchestra.run.smithi135.stdout:(86/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-04-20T12:10:24.307 INFO:teuthology.orchestra.run.smithi135.stdout:(87/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-04-20T12:10:24.319 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2024-04-20T12:10:24.407 INFO:teuthology.orchestra.run.smithi135.stdout:(88/150): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2024-04-20T12:10:24.445 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2024-04-20T12:10:24.445 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2024-04-20T12:10:24.508 INFO:teuthology.orchestra.run.smithi135.stdout:(89/150): python3-requests-oauthlib-1.3.0-12.el 536 kB/s | 54 kB 00:00 2024-04-20T12:10:24.667 INFO:teuthology.orchestra.run.smithi135.stdout:(90/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.0 MB/s | 5.1 MB 00:01 2024-04-20T12:10:24.767 INFO:teuthology.orchestra.run.smithi135.stdout:(91/150): python3-toml-0.10.2-6.el9.noarch.rpm 417 kB/s | 42 kB 00:00 2024-04-20T12:10:24.884 INFO:teuthology.orchestra.run.smithi135.stdout:(92/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 379 kB/s | 44 kB 00:00 2024-04-20T12:10:25.009 INFO:teuthology.orchestra.run.smithi135.stdout:(93/150): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-04-20T12:10:25.102 INFO:teuthology.orchestra.run.smithi135.stdout:(94/150): qatlib-service-24.02.0-1.el9.x86_64.r 391 kB/s | 36 kB 00:00 2024-04-20T12:10:25.193 INFO:teuthology.orchestra.run.smithi135.stdout:(95/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 518 kB/s | 47 kB 00:00 2024-04-20T12:10:25.302 INFO:teuthology.orchestra.run.smithi135.stdout:(96/150): socat-1.7.4.1-5.el9.x86_64.rpm 2.7 MB/s | 305 kB 00:00 2024-04-20T12:10:25.394 INFO:teuthology.orchestra.run.smithi135.stdout:(97/150): uuid-1.6.2-55.el9.x86_64.rpm 630 kB/s | 58 kB 00:00 2024-04-20T12:10:25.503 INFO:teuthology.orchestra.run.smithi135.stdout:(98/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 864 kB/s | 94 kB 00:00 2024-04-20T12:10:25.595 INFO:teuthology.orchestra.run.smithi135.stdout:(99/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 695 kB/s | 64 kB 00:00 2024-04-20T12:10:25.695 INFO:teuthology.orchestra.run.smithi135.stdout:(100/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 448 kB/s | 45 kB 00:00 2024-04-20T12:10:26.164 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2024-04-20T12:10:26.164 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2024-04-20T12:10:26.371 INFO:teuthology.orchestra.run.smithi135.stdout:(101/150): lua-devel-5.4.4-4.el9.x86_64.rpm 33 kB/s | 22 kB 00:00 2024-04-20T12:10:26.698 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-20T12:10:26.777 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-20T12:10:26.810 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-20T12:10:26.869 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-20T12:10:27.200 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-20T12:10:27.344 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 5/152 2024-04-20T12:10:27.450 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 5/152 2024-04-20T12:10:27.478 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T12:10:27.570 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T12:10:27.612 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/152 2024-04-20T12:10:27.641 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-20T12:10:27.676 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-20T12:10:27.828 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-20T12:10:27.881 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-20T12:10:27.930 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T12:10:28.038 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T12:10:28.060 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 13/152 2024-04-20T12:10:28.062 INFO:teuthology.orchestra.run.smithi135.stdout:(102/150): protobuf-compiler-3.14.0-13.el9.x86_ 510 kB/s | 863 kB 00:01 2024-04-20T12:10:28.106 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 13/152 2024-04-20T12:10:28.128 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-20T12:10:28.151 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-20T12:10:28.424 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-20T12:10:28.461 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-20T12:10:28.569 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-20T12:10:28.675 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-20T12:10:28.718 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-20T12:10:28.738 INFO:teuthology.orchestra.run.smithi135.stdout:(103/150): abseil-cpp-20211102.0-3.el9.x86_64.r 813 kB/s | 548 kB 00:00 2024-04-20T12:10:28.753 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-20T12:10:28.826 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-20T12:10:28.860 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-20T12:10:28.863 INFO:teuthology.orchestra.run.smithi135.stdout:(104/150): gperftools-libs-2.9.1-2.el9.x86_64.r 2.4 MB/s | 309 kB 00:00 2024-04-20T12:10:28.904 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-20T12:10:28.936 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-20T12:10:28.964 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-20T12:10:28.972 INFO:teuthology.orchestra.run.smithi135.stdout:(105/150): grpc-data-1.46.7-10.el9.noarch.rpm 179 kB/s | 19 kB 00:00 2024-04-20T12:10:29.034 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-20T12:10:29.087 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-20T12:10:29.116 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-20T12:10:29.144 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-20T12:10:29.155 INFO:teuthology.orchestra.run.smithi135.stdout:(106/150): python3-babel-2.9.1-2.el9.noarch.rpm 967 kB/s | 6.0 MB 00:06 2024-04-20T12:10:29.221 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-20T12:10:29.257 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 30/152 2024-04-20T12:10:29.292 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 31/152 2024-04-20T12:10:29.320 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 32/152 2024-04-20T12:10:29.392 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-20T12:10:29.414 INFO:teuthology.orchestra.run.smithi135.stdout:(107/150): libarrow-9.0.0-10.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-04-20T12:10:29.435 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-20T12:10:29.515 INFO:teuthology.orchestra.run.smithi135.stdout:(108/150): liboath-2.6.7-2.el9.x86_64.rpm 486 kB/s | 49 kB 00:00 2024-04-20T12:10:29.518 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-20T12:10:29.540 INFO:teuthology.orchestra.run.smithi135.stdout:(109/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 68 kB/s | 26 kB 00:00 2024-04-20T12:10:29.615 INFO:teuthology.orchestra.run.smithi135.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 671 kB/s | 67 kB 00:00 2024-04-20T12:10:29.653 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-20T12:10:29.705 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-20T12:10:29.741 INFO:teuthology.orchestra.run.smithi135.stdout:(111/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.5 MB/s | 838 kB 00:00 2024-04-20T12:10:29.808 INFO:teuthology.orchestra.run.smithi135.stdout:(112/150): luarocks-3.9.2-1.el9.noarch.rpm 564 kB/s | 151 kB 00:00 2024-04-20T12:10:29.850 INFO:teuthology.orchestra.run.smithi135.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-04-20T12:10:29.917 INFO:teuthology.orchestra.run.smithi135.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 399 kB/s | 43 kB 00:00 2024-04-20T12:10:29.951 INFO:teuthology.orchestra.run.smithi135.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 320 kB/s | 32 kB 00:00 2024-04-20T12:10:30.018 INFO:teuthology.orchestra.run.smithi135.stdout:(116/150): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2024-04-20T12:10:30.051 INFO:teuthology.orchestra.run.smithi135.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-04-20T12:10:30.152 INFO:teuthology.orchestra.run.smithi135.stdout:(118/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-04-20T12:10:30.235 INFO:teuthology.orchestra.run.smithi135.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 1.6 MB/s | 358 kB 00:00 2024-04-20T12:10:30.241 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-20T12:10:30.252 INFO:teuthology.orchestra.run.smithi135.stdout:(120/150): python3-colorama-0.4.4-12.el9.noarch 352 kB/s | 35 kB 00:00 2024-04-20T12:10:30.317 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-20T12:10:30.346 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-20T12:10:30.353 INFO:teuthology.orchestra.run.smithi135.stdout:(121/150): python3-google-auth-2.28.2-1.el9.noa 1.7 MB/s | 203 kB 00:00 2024-04-20T12:10:30.388 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-20T12:10:30.411 INFO:teuthology.orchestra.run.smithi135.stdout:(122/150): python3-grpcio-1.46.7-10.el9.x86_64. 13 MB/s | 2.0 MB 00:00 2024-04-20T12:10:30.426 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 42/152 2024-04-20T12:10:30.459 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-20T12:10:30.462 INFO:teuthology.orchestra.run.smithi135.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-04-20T12:10:30.504 INFO:teuthology.orchestra.run.smithi135.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-04-20T12:10:30.515 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-20T12:10:30.554 INFO:teuthology.orchestra.run.smithi135.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-04-20T12:10:30.588 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-20T12:10:30.598 INFO:teuthology.orchestra.run.smithi135.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 251 kB/s | 23 kB 00:00 2024-04-20T12:10:30.618 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-20T12:10:30.655 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-20T12:10:30.655 INFO:teuthology.orchestra.run.smithi135.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-04-20T12:10:30.697 INFO:teuthology.orchestra.run.smithi135.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-04-20T12:10:30.702 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-20T12:10:30.737 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-20T12:10:30.781 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-20T12:10:30.797 INFO:teuthology.orchestra.run.smithi135.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 463 kB/s | 46 kB 00:00 2024-04-20T12:10:30.822 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-20T12:10:30.873 INFO:teuthology.orchestra.run.smithi135.stdout:(130/150): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-04-20T12:10:30.898 INFO:teuthology.orchestra.run.smithi135.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 787 kB/s | 79 kB 00:00 2024-04-20T12:10:30.962 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-20T12:10:30.973 INFO:teuthology.orchestra.run.smithi135.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 575 kB/s | 58 kB 00:00 2024-04-20T12:10:30.999 INFO:teuthology.orchestra.run.smithi135.stdout:(133/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-04-20T12:10:31.003 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-20T12:10:31.033 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-20T12:10:31.074 INFO:teuthology.orchestra.run.smithi135.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-04-20T12:10:31.075 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-20T12:10:31.100 INFO:teuthology.orchestra.run.smithi135.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 892 kB/s | 90 kB 00:00 2024-04-20T12:10:31.175 INFO:teuthology.orchestra.run.smithi135.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-04-20T12:10:31.180 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-20T12:10:31.200 INFO:teuthology.orchestra.run.smithi135.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 307 kB/s | 31 kB 00:00 2024-04-20T12:10:31.241 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-20T12:10:31.275 INFO:teuthology.orchestra.run.smithi135.stdout:(138/150): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-04-20T12:10:31.281 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-20T12:10:31.301 INFO:teuthology.orchestra.run.smithi135.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 588 kB/s | 59 kB 00:00 2024-04-20T12:10:31.307 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-20T12:10:31.331 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-20T12:10:31.376 INFO:teuthology.orchestra.run.smithi135.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2024-04-20T12:10:31.402 INFO:teuthology.orchestra.run.smithi135.stdout:(141/150): python3-typing-extensions-4.4.0-2.el 509 kB/s | 51 kB 00:00 2024-04-20T12:10:31.407 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-20T12:10:31.485 INFO:teuthology.orchestra.run.smithi135.stdout:(142/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-04-20T12:10:31.502 INFO:teuthology.orchestra.run.smithi135.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 893 kB/s | 90 kB 00:00 2024-04-20T12:10:31.552 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-20T12:10:31.597 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-20T12:10:31.603 INFO:teuthology.orchestra.run.smithi135.stdout:(144/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-04-20T12:10:31.625 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-20T12:10:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 140 kB/s | 20 kB 00:00 2024-04-20T12:10:31.659 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-20T12:10:31.704 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-20T12:10:31.712 INFO:teuthology.orchestra.run.smithi135.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-04-20T12:10:31.741 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-20T12:10:31.780 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-20T12:10:31.787 INFO:teuthology.orchestra.run.smithi135.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-20T12:10:31.811 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-20T12:10:31.845 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-20T12:10:31.878 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-20T12:10:31.920 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-20T12:10:31.954 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-20T12:10:32.042 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-20T12:10:32.156 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2024-04-20T12:10:32.203 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-20T12:10:32.233 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-20T12:10:32.239 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-20T12:10:32.264 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-20T12:10:32.281 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-20T12:10:32.315 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-20T12:10:32.390 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-20T12:10:32.443 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-20T12:10:32.645 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-20T12:10:32.704 INFO:teuthology.orchestra.run.smithi135.stdout:(148/150): librbd1-19.0.0-3133.ga8c84f59.el9.x8 3.4 MB/s | 3.1 MB 00:00 2024-04-20T12:10:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 5/152 2024-04-20T12:10:32.879 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 5/152 2024-04-20T12:10:32.916 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T12:10:33.008 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T12:10:33.049 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/152 2024-04-20T12:10:33.079 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-20T12:10:33.104 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-20T12:10:33.173 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-20T12:10:33.223 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-20T12:10:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-20T12:10:33.264 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-20T12:10:33.310 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-20T12:10:33.338 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T12:10:33.365 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-20T12:10:33.415 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-20T12:10:33.425 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T12:10:33.473 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 13/152 2024-04-20T12:10:33.502 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-20T12:10:33.544 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 13/152 2024-04-20T12:10:33.566 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-20T12:10:33.571 INFO:teuthology.orchestra.run.smithi135.stdout:(149/150): librados2-19.0.0-3133.ga8c84f59.el9. 1.8 MB/s | 3.4 MB 00:01 2024-04-20T12:10:33.586 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-20T12:10:33.589 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-20T12:10:33.761 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-20T12:10:33.789 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-20T12:10:33.868 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-20T12:10:33.868 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-20T12:10:33.899 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-20T12:10:34.007 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-20T12:10:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-20T12:10:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-20T12:10:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-20T12:10:34.257 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-20T12:10:34.301 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-20T12:10:34.345 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-20T12:10:34.377 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-20T12:10:34.405 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-20T12:10:34.478 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-20T12:10:34.528 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-20T12:10:34.545 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-20T12:10:34.574 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-20T12:10:34.610 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-20T12:10:34.638 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-20T12:10:34.695 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-20T12:10:34.746 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 30/152 2024-04-20T12:10:34.789 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 31/152 2024-04-20T12:10:34.818 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 32/152 2024-04-20T12:10:34.890 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-20T12:10:34.942 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-20T12:10:35.017 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-20T12:10:35.151 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-20T12:10:35.212 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-20T12:10:35.751 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-20T12:10:35.832 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-20T12:10:35.869 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-20T12:10:35.903 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-20T12:10:35.920 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-20T12:10:35.967 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 42/152 2024-04-20T12:10:35.984 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-20T12:10:36.000 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-20T12:10:36.012 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-20T12:10:36.045 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-20T12:10:36.056 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-20T12:10:36.128 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-20T12:10:36.159 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-20T12:10:36.196 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-20T12:10:36.242 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-20T12:10:36.278 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-20T12:10:36.322 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-20T12:10:36.357 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-20T12:10:36.363 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-20T12:10:36.371 INFO:teuthology.orchestra.run.smithi135.stdout:(150/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.4 MB/s | 16 MB 00:11 2024-04-20T12:10:36.377 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-04-20T12:10:36.377 INFO:teuthology.orchestra.run.smithi135.stdout:Total 5.1 MB/s | 218 MB 00:42 2024-04-20T12:10:36.399 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 97/152 2024-04-20T12:10:36.490 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 97/152 2024-04-20T12:10:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-20T12:10:36.521 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 98/152 2024-04-20T12:10:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-20T12:10:36.557 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-20T12:10:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-20T12:10:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-20T12:10:36.719 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-20T12:10:36.766 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-20T12:10:36.807 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-20T12:10:36.832 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-20T12:10:36.857 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-20T12:10:36.932 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-20T12:10:37.044 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-20T12:10:37.069 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-20T12:10:37.077 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 101/152 2024-04-20T12:10:37.115 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-20T12:10:37.143 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-20T12:10:37.149 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 101/152 2024-04-20T12:10:37.177 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-20T12:10:37.178 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 102/152 2024-04-20T12:10:37.221 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-20T12:10:37.259 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-20T12:10:37.290 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-20T12:10:37.320 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-20T12:10:37.355 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-20T12:10:37.388 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-20T12:10:37.410 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-04-20T12:10:37.430 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-20T12:10:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-20T12:10:37.534 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-04-20T12:10:37.535 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-04-20T12:10:37.569 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-20T12:10:37.704 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-20T12:10:37.735 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-20T12:10:37.783 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-20T12:10:37.891 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-20T12:10:37.945 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-20T12:10:38.695 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-20T12:10:38.742 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-20T12:10:38.776 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-20T12:10:38.877 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-20T12:10:38.942 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-20T12:10:39.039 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-20T12:10:39.078 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-20T12:10:39.239 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-04-20T12:10:39.239 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-04-20T12:10:39.255 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-20T12:10:39.284 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-20T12:10:39.363 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-20T12:10:39.535 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T12:10:39.576 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T12:10:40.021 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-20T12:10:40.119 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T12:10:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-20T12:10:40.162 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 104/152 2024-04-20T12:10:40.253 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 104/152 2024-04-20T12:10:40.253 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-20T12:10:40.254 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-20T12:10:40.254 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-20T12:10:40.271 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 105/152 2024-04-20T12:10:41.382 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-20T12:10:41.481 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-20T12:10:41.509 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-20T12:10:41.542 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-20T12:10:41.854 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-20T12:10:41.896 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 97/152 2024-04-20T12:10:41.987 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 97/152 2024-04-20T12:10:42.018 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 98/152 2024-04-20T12:10:42.054 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-20T12:10:42.535 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-20T12:10:42.574 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 101/152 2024-04-20T12:10:42.637 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 101/152 2024-04-20T12:10:42.668 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 102/152 2024-04-20T12:10:44.926 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T12:10:45.027 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-04-20T12:10:45.031 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T12:10:45.098 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-20T12:10:45.132 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-20T12:10:45.175 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-20T12:10:45.505 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-20T12:10:45.574 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T12:10:45.609 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 104/152 2024-04-20T12:10:45.617 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 5/152 2024-04-20T12:10:45.701 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 104/152 2024-04-20T12:10:45.701 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-20T12:10:45.701 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-20T12:10:45.702 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:10:45.731 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 5/152 2024-04-20T12:10:45.736 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 105/152 2024-04-20T12:10:45.769 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T12:10:45.860 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T12:10:45.902 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/152 2024-04-20T12:10:45.932 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-20T12:10:45.958 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-20T12:10:46.108 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-20T12:10:46.156 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-20T12:10:46.176 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T12:10:46.280 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T12:10:46.302 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 13/152 2024-04-20T12:10:46.365 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 13/152 2024-04-20T12:10:46.387 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-20T12:10:46.411 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-20T12:10:46.703 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-20T12:10:46.739 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-20T12:10:46.851 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-20T12:10:46.958 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-20T12:10:46.989 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-20T12:10:47.025 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-20T12:10:47.100 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-20T12:10:47.140 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-20T12:10:47.184 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-20T12:10:47.216 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-20T12:10:47.270 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-20T12:10:47.347 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-20T12:10:47.401 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-20T12:10:47.431 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-20T12:10:47.475 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-20T12:10:47.551 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-20T12:10:47.586 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 30/152 2024-04-20T12:10:47.630 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 31/152 2024-04-20T12:10:47.659 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 32/152 2024-04-20T12:10:47.729 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-20T12:10:47.773 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-20T12:10:47.850 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-20T12:10:47.983 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-20T12:10:48.044 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-20T12:10:48.570 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-20T12:10:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-20T12:10:48.686 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-20T12:10:48.728 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-20T12:10:48.767 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 42/152 2024-04-20T12:10:48.800 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-20T12:10:48.855 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-20T12:10:48.929 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-20T12:10:48.960 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-20T12:10:48.996 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-20T12:10:49.043 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-20T12:10:49.079 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-20T12:10:49.122 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-20T12:10:49.165 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-20T12:10:49.302 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-20T12:10:49.346 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-20T12:10:49.376 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-20T12:10:49.418 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-20T12:10:49.513 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-20T12:10:49.626 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-20T12:10:49.667 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-20T12:10:49.693 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-20T12:10:49.717 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-20T12:10:49.792 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-20T12:10:49.921 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-20T12:10:49.960 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-20T12:10:49.987 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-20T12:10:50.022 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-20T12:10:50.066 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-20T12:10:50.104 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-20T12:10:50.144 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-20T12:10:50.174 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-20T12:10:50.209 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-20T12:10:50.242 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-20T12:10:50.284 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-20T12:10:50.310 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-20T12:10:50.398 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-20T12:10:50.441 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-20T12:10:50.472 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-20T12:10:50.520 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-20T12:10:50.619 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-20T12:10:50.666 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-20T12:10:51.399 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-20T12:10:51.448 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-20T12:10:51.476 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 105/152 2024-04-20T12:10:51.476 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /sys 2024-04-20T12:10:51.476 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /proc 2024-04-20T12:10:51.476 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /mnt 2024-04-20T12:10:51.476 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /var/tmp 2024-04-20T12:10:51.476 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /home 2024-04-20T12:10:51.477 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /root 2024-04-20T12:10:51.477 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /tmp 2024-04-20T12:10:51.477 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-20T12:10:51.481 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-20T12:10:51.582 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-20T12:10:51.655 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 106/152 2024-04-20T12:10:51.656 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-20T12:10:51.670 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 106/152 2024-04-20T12:10:51.670 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:10:51.671 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-20T12:10:51.671 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-20T12:10:51.745 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-20T12:10:51.784 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-20T12:10:51.961 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-20T12:10:51.991 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-20T12:10:52.069 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-20T12:10:52.711 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-20T12:10:52.816 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-20T12:10:53.150 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 107/152 2024-04-20T12:10:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 107/152 2024-04-20T12:10:53.175 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:10:53.175 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-20T12:10:53.175 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T12:10:53.175 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T12:10:53.175 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-20T12:10:53.392 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 108/152 2024-04-20T12:10:53.414 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 108/152 2024-04-20T12:10:53.414 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:10:53.414 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-20T12:10:53.414 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T12:10:53.415 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T12:10:53.415 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-20T12:10:53.851 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 109/152 2024-04-20T12:10:53.873 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 109/152 2024-04-20T12:10:53.873 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:10:53.874 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-20T12:10:53.874 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T12:10:53.874 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T12:10:53.874 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-20T12:10:53.973 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-20T12:10:54.029 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-20T12:10:54.055 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-20T12:10:54.085 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-20T12:10:54.250 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-20T12:10:54.271 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-20T12:10:54.278 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-20T12:10:54.313 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-20T12:10:54.318 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-20T12:10:54.396 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-20T12:10:54.485 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-20T12:10:54.622 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-20T12:10:54.623 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-20T12:10:54.668 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-20T12:10:54.700 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-20T12:10:54.707 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 97/152 2024-04-20T12:10:54.728 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-20T12:10:54.799 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 97/152 2024-04-20T12:10:54.829 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 98/152 2024-04-20T12:10:54.866 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-20T12:10:55.179 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 121/152 2024-04-20T12:10:55.201 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 121/152 2024-04-20T12:10:55.225 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 122/152 2024-04-20T12:10:55.286 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 123/152 2024-04-20T12:10:55.332 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 124/152 2024-04-20T12:10:55.345 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-20T12:10:55.378 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 101/152 2024-04-20T12:10:55.449 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 101/152 2024-04-20T12:10:55.472 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 102/152 2024-04-20T12:10:56.372 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 124/152 2024-04-20T12:10:56.409 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 125/152 2024-04-20T12:10:57.091 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 105/152 2024-04-20T12:10:57.092 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2024-04-20T12:10:57.092 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2024-04-20T12:10:57.092 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2024-04-20T12:10:57.092 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2024-04-20T12:10:57.092 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2024-04-20T12:10:57.093 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /root 2024-04-20T12:10:57.093 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2024-04-20T12:10:57.093 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:10:57.264 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 106/152 2024-04-20T12:10:57.279 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 106/152 2024-04-20T12:10:57.279 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:10:57.279 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-20T12:10:57.279 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:10:57.376 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 125/152 2024-04-20T12:10:57.411 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 126/152 2024-04-20T12:10:57.511 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 126/152 2024-04-20T12:10:57.674 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 127/152 2024-04-20T12:10:57.711 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/152 2024-04-20T12:10:57.734 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/152 2024-04-20T12:10:57.734 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:10:57.734 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-20T12:10:57.734 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T12:10:57.735 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T12:10:57.735 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-20T12:10:57.779 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 129/152 2024-04-20T12:10:57.786 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T12:10:57.790 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 129/152 2024-04-20T12:10:57.820 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T12:10:57.879 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 130/152 2024-04-20T12:10:57.935 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 131/152 2024-04-20T12:10:58.366 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T12:10:58.407 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 104/152 2024-04-20T12:10:58.498 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 104/152 2024-04-20T12:10:58.498 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-20T12:10:58.498 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-20T12:10:58.498 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:10:58.525 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 105/152 2024-04-20T12:10:58.767 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 107/152 2024-04-20T12:10:58.792 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 107/152 2024-04-20T12:10:58.792 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:10:58.792 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-20T12:10:58.792 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T12:10:58.792 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T12:10:58.793 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:10:58.861 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-20T12:10:58.889 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 133/152 2024-04-20T12:10:58.912 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 133/152 2024-04-20T12:10:58.912 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:10:58.912 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-20T12:10:58.912 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T12:10:58.912 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T12:10:58.912 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-20T12:10:58.957 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 134/152 2024-04-20T12:10:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 134/152 2024-04-20T12:10:58.978 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:10:58.978 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-20T12:10:58.978 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-20T12:10:59.024 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/152 2024-04-20T12:10:59.028 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 108/152 2024-04-20T12:10:59.046 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/152 2024-04-20T12:10:59.046 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:10:59.047 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-20T12:10:59.047 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-20T12:10:59.047 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-20T12:10:59.047 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-20T12:10:59.050 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 108/152 2024-04-20T12:10:59.050 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:10:59.050 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-20T12:10:59.050 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T12:10:59.050 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T12:10:59.050 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:10:59.349 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/152 2024-04-20T12:10:59.372 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/152 2024-04-20T12:10:59.372 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:10:59.372 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-20T12:10:59.372 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T12:10:59.372 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T12:10:59.372 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-20T12:10:59.495 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 109/152 2024-04-20T12:10:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 109/152 2024-04-20T12:10:59.517 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:10:59.517 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-20T12:10:59.517 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T12:10:59.517 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T12:10:59.517 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:10:59.617 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-20T12:10:59.674 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-20T12:10:59.730 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-20T12:10:59.914 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-20T12:10:59.963 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-20T12:11:00.041 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-20T12:11:00.130 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-20T12:11:00.269 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-20T12:11:00.313 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-20T12:11:00.345 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-20T12:11:00.373 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-20T12:11:00.759 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 121/152 2024-04-20T12:11:00.788 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 121/152 2024-04-20T12:11:00.820 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 122/152 2024-04-20T12:11:00.882 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 123/152 2024-04-20T12:11:00.911 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 124/152 2024-04-20T12:11:01.951 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 124/152 2024-04-20T12:11:01.988 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 125/152 2024-04-20T12:11:02.956 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 125/152 2024-04-20T12:11:02.988 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 126/152 2024-04-20T12:11:03.091 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 126/152 2024-04-20T12:11:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 127/152 2024-04-20T12:11:03.273 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/152 2024-04-20T12:11:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/152 2024-04-20T12:11:03.296 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:11:03.296 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-20T12:11:03.296 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T12:11:03.296 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T12:11:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:11:03.341 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 129/152 2024-04-20T12:11:03.351 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 129/152 2024-04-20T12:11:03.452 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 130/152 2024-04-20T12:11:03.506 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 131/152 2024-04-20T12:11:03.986 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 137/152 2024-04-20T12:11:04.027 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 138/152 2024-04-20T12:11:04.068 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 139/152 2024-04-20T12:11:04.100 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-20T12:11:04.127 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-20T12:11:04.310 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 142/152 2024-04-20T12:11:04.357 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-20T12:11:04.387 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 144/152 2024-04-20T12:11:04.433 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-20T12:11:04.469 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 133/152 2024-04-20T12:11:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 133/152 2024-04-20T12:11:04.491 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:11:04.491 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-20T12:11:04.491 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T12:11:04.491 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T12:11:04.491 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:11:04.536 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 134/152 2024-04-20T12:11:04.557 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 134/152 2024-04-20T12:11:04.557 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:11:04.557 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-20T12:11:04.558 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:11:04.603 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/152 2024-04-20T12:11:04.625 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/152 2024-04-20T12:11:04.625 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:11:04.626 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-20T12:11:04.626 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-20T12:11:04.626 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-20T12:11:04.626 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:11:04.938 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/152 2024-04-20T12:11:04.959 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/152 2024-04-20T12:11:04.960 INFO:teuthology.orchestra.run.smithi154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:11:04.960 INFO:teuthology.orchestra.run.smithi154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-20T12:11:04.960 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T12:11:04.960 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T12:11:04.960 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:11:04.984 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T12:11:05.017 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T12:11:05.037 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T12:11:05.812 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 146/152 2024-04-20T12:11:05.888 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-20T12:11:05.929 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-20T12:11:06.010 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-20T12:11:06.042 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-20T12:11:06.042 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-20T12:11:06.126 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-20T12:11:06.126 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T12:11:09.566 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 137/152 2024-04-20T12:11:09.624 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 138/152 2024-04-20T12:11:09.665 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 139/152 2024-04-20T12:11:09.697 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-20T12:11:09.724 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-20T12:11:09.910 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 142/152 2024-04-20T12:11:09.962 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-20T12:11:09.992 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 144/152 2024-04-20T12:11:10.361 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 105/152 2024-04-20T12:11:10.361 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-04-20T12:11:10.361 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-04-20T12:11:10.361 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-04-20T12:11:10.362 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-04-20T12:11:10.362 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-04-20T12:11:10.362 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2024-04-20T12:11:10.362 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-04-20T12:11:10.362 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:11:10.539 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 106/152 2024-04-20T12:11:10.554 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 106/152 2024-04-20T12:11:10.554 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:11:10.554 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-20T12:11:10.554 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:11:10.625 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T12:11:10.666 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T12:11:10.685 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T12:11:11.488 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 146/152 2024-04-20T12:11:11.570 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-20T12:11:11.611 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-20T12:11:11.693 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-20T12:11:11.724 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-20T12:11:11.725 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-20T12:11:11.763 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T12:11:11.763 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 1/152 2024-04-20T12:11:11.763 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2/152 2024-04-20T12:11:11.763 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 3/152 2024-04-20T12:11:11.763 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 4/152 2024-04-20T12:11:11.763 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 5/152 2024-04-20T12:11:11.763 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T12:11:11.763 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/152 2024-04-20T12:11:11.764 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 8/152 2024-04-20T12:11:11.764 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 9/152 2024-04-20T12:11:11.764 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 10/152 2024-04-20T12:11:11.764 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 11/152 2024-04-20T12:11:11.764 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T12:11:11.764 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 13/152 2024-04-20T12:11:11.764 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 14/152 2024-04-20T12:11:11.764 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 15/152 2024-04-20T12:11:11.764 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 16/152 2024-04-20T12:11:11.764 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 17/152 2024-04-20T12:11:11.764 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 18/152 2024-04-20T12:11:11.764 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 19/152 2024-04-20T12:11:11.764 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 20/152 2024-04-20T12:11:11.764 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 21/152 2024-04-20T12:11:11.764 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 22/152 2024-04-20T12:11:11.765 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 23/152 2024-04-20T12:11:11.765 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 24/152 2024-04-20T12:11:11.765 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 25/152 2024-04-20T12:11:11.765 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 26/152 2024-04-20T12:11:11.765 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 27/152 2024-04-20T12:11:11.776 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 28/152 2024-04-20T12:11:11.776 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 29/152 2024-04-20T12:11:11.776 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 30/152 2024-04-20T12:11:11.776 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 31/152 2024-04-20T12:11:11.776 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 32/152 2024-04-20T12:11:11.776 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 33/152 2024-04-20T12:11:11.776 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 34/152 2024-04-20T12:11:11.776 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 35/152 2024-04-20T12:11:11.776 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 36/152 2024-04-20T12:11:11.776 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 37/152 2024-04-20T12:11:11.777 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 38/152 2024-04-20T12:11:11.777 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 39/152 2024-04-20T12:11:11.777 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-20T12:11:11.777 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-20T12:11:11.777 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-20T12:11:11.777 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-20T12:11:11.777 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-20T12:11:11.777 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-20T12:11:11.777 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-20T12:11:11.777 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-20T12:11:11.777 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-20T12:11:11.777 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-20T12:11:11.777 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-20T12:11:11.777 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-20T12:11:11.778 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-20T12:11:11.778 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-20T12:11:11.778 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-20T12:11:11.778 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-20T12:11:11.778 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-20T12:11:11.778 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-20T12:11:11.778 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-20T12:11:11.778 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-20T12:11:11.778 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-20T12:11:11.778 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-20T12:11:11.778 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-20T12:11:11.778 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-20T12:11:11.778 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-20T12:11:11.778 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-20T12:11:11.778 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-20T12:11:11.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-20T12:11:11.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-20T12:11:11.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-20T12:11:11.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-20T12:11:11.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-20T12:11:11.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-20T12:11:11.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-20T12:11:11.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-20T12:11:11.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-20T12:11:11.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-20T12:11:11.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-20T12:11:11.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-20T12:11:11.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-20T12:11:11.779 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-20T12:11:11.780 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-20T12:11:11.781 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-20T12:11:11.781 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-20T12:11:11.781 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-20T12:11:11.781 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-20T12:11:11.781 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-20T12:11:11.781 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-20T12:11:11.781 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-20T12:11:11.781 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-20T12:11:11.781 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-20T12:11:11.781 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-20T12:11:11.781 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-20T12:11:11.781 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-20T12:11:11.781 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-20T12:11:11.781 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-20T12:11:11.781 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-20T12:11:11.782 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-20T12:11:11.782 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-20T12:11:11.782 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-20T12:11:11.782 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-20T12:11:11.782 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-20T12:11:11.782 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-20T12:11:11.782 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-20T12:11:11.782 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-20T12:11:11.782 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-20T12:11:11.782 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-20T12:11:11.782 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-20T12:11:11.782 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-20T12:11:11.782 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-20T12:11:11.782 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-20T12:11:11.782 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-20T12:11:11.783 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-20T12:11:11.783 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-20T12:11:11.783 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-20T12:11:11.783 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-20T12:11:11.783 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-20T12:11:11.783 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-20T12:11:11.783 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-20T12:11:11.783 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-20T12:11:11.783 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-20T12:11:11.783 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-20T12:11:11.783 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-20T12:11:11.783 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-20T12:11:11.783 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-20T12:11:11.783 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-20T12:11:11.784 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-20T12:11:11.784 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-20T12:11:11.784 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-20T12:11:11.784 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-20T12:11:11.784 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-20T12:11:11.784 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-20T12:11:11.784 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-20T12:11:11.784 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-20T12:11:11.784 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 149/152 2024-04-20T12:11:11.784 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-20T12:11:11.784 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 151/152 2024-04-20T12:11:11.808 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-20T12:11:11.808 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T12:11:12.027 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 107/152 2024-04-20T12:11:12.052 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 107/152 2024-04-20T12:11:12.052 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:11:12.052 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-20T12:11:12.052 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T12:11:12.052 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T12:11:12.052 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:11:12.277 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 108/152 2024-04-20T12:11:12.299 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 108/152 2024-04-20T12:11:12.299 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:11:12.300 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-20T12:11:12.300 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T12:11:12.300 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T12:11:12.300 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:11:12.745 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 109/152 2024-04-20T12:11:12.767 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 109/152 2024-04-20T12:11:12.767 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:11:12.767 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-20T12:11:12.767 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T12:11:12.767 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T12:11:12.767 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:11:12.883 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-20T12:11:12.939 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-20T12:11:12.996 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-20T12:11:13.180 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-20T12:11:13.230 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-20T12:11:13.315 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-20T12:11:13.404 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-20T12:11:13.545 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-20T12:11:13.590 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-20T12:11:13.622 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-20T12:11:13.650 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-20T12:11:13.892 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T12:11:13.893 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-20T12:11:13.893 INFO:teuthology.orchestra.run.smithi139.stdout:Upgraded: 2024-04-20T12:11:13.893 INFO:teuthology.orchestra.run.smithi139.stdout: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.893 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.893 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-20T12:11:13.893 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-20T12:11:13.893 INFO:teuthology.orchestra.run.smithi139.stdout: automake-1.16.2-8.el9.noarch 2024-04-20T12:11:13.893 INFO:teuthology.orchestra.run.smithi139.stdout: bison-3.7.4-5.el9.x86_64 2024-04-20T12:11:13.893 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-20T12:11:13.893 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.893 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.893 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.893 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.893 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.894 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:13.895 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:13.895 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.895 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.895 INFO:teuthology.orchestra.run.smithi139.stdout: cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:13.895 INFO:teuthology.orchestra.run.smithi139.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-20T12:11:13.895 INFO:teuthology.orchestra.run.smithi139.stdout: flex-2.6.4-9.el9.x86_64 2024-04-20T12:11:13.895 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-20T12:11:13.895 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-20T12:11:13.895 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-20T12:11:13.895 INFO:teuthology.orchestra.run.smithi139.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-20T12:11:13.895 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-20T12:11:13.895 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-20T12:11:13.895 INFO:teuthology.orchestra.run.smithi139.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-20T12:11:13.895 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-20T12:11:13.896 INFO:teuthology.orchestra.run.smithi139.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-20T12:11:13.897 INFO:teuthology.orchestra.run.smithi139.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-20T12:11:13.897 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-20T12:11:13.897 INFO:teuthology.orchestra.run.smithi139.stdout: lua-5.4.4-4.el9.x86_64 2024-04-20T12:11:13.897 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-20T12:11:13.897 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-20T12:11:13.897 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-20T12:11:13.897 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-20T12:11:13.897 INFO:teuthology.orchestra.run.smithi139.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-20T12:11:13.897 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-20T12:11:13.897 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-13.14-1.el9.x86_64 2024-04-20T12:11:13.897 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-20T12:11:13.897 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-20T12:11:13.897 INFO:teuthology.orchestra.run.smithi139.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-20T12:11:13.897 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-20T12:11:13.898 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-20T12:11:13.898 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-20T12:11:13.898 INFO:teuthology.orchestra.run.smithi139.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-20T12:11:13.898 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-20T12:11:13.898 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-20T12:11:13.898 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-20T12:11:13.898 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.898 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.898 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.898 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-20T12:11:13.898 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-20T12:11:13.898 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-20T12:11:13.898 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-20T12:11:13.898 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-20T12:11:13.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-20T12:11:13.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-20T12:11:13.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-20T12:11:13.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-20T12:11:13.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-20T12:11:13.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-20T12:11:13.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-20T12:11:13.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-20T12:11:13.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-20T12:11:13.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-20T12:11:13.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-20T12:11:13.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-20T12:11:13.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-20T12:11:13.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-20T12:11:13.899 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-20T12:11:13.900 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-20T12:11:13.900 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-20T12:11:13.900 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-20T12:11:13.900 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-20T12:11:13.900 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-20T12:11:13.900 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-20T12:11:13.900 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-20T12:11:13.900 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-20T12:11:13.900 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-20T12:11:13.900 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-20T12:11:13.900 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply-3.11-14.el9.noarch 2024-04-20T12:11:13.900 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-20T12:11:13.900 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-20T12:11:13.900 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-20T12:11:13.900 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-20T12:11:13.901 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-20T12:11:13.901 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-20T12:11:13.901 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-20T12:11:13.901 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-20T12:11:13.901 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-20T12:11:13.901 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.901 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.901 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-20T12:11:13.901 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-20T12:11:13.901 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-20T12:11:13.901 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.901 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-20T12:11:13.901 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-20T12:11:13.902 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-20T12:11:13.902 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-20T12:11:13.902 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-20T12:11:13.902 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-20T12:11:13.902 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-20T12:11:13.902 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-20T12:11:13.902 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-20T12:11:13.902 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-20T12:11:13.902 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-20T12:11:13.902 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-20T12:11:13.902 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-20T12:11:13.902 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-20T12:11:13.902 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-20T12:11:13.902 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.902 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.903 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:13.903 INFO:teuthology.orchestra.run.smithi139.stdout: re2-1:20211101-3.el9.x86_64 2024-04-20T12:11:13.903 INFO:teuthology.orchestra.run.smithi139.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-20T12:11:13.903 INFO:teuthology.orchestra.run.smithi139.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-20T12:11:13.903 INFO:teuthology.orchestra.run.smithi139.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-20T12:11:13.903 INFO:teuthology.orchestra.run.smithi139.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-20T12:11:13.903 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-20T12:11:13.903 INFO:teuthology.orchestra.run.smithi139.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-20T12:11:13.903 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-20T12:11:13.903 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-20T12:11:14.127 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 121/152 2024-04-20T12:11:14.158 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 121/152 2024-04-20T12:11:14.190 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 122/152 2024-04-20T12:11:14.251 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 123/152 2024-04-20T12:11:14.256 DEBUG:teuthology.parallel:result is None 2024-04-20T12:11:14.281 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 124/152 2024-04-20T12:11:15.309 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 124/152 2024-04-20T12:11:15.342 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 125/152 2024-04-20T12:11:16.304 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 125/152 2024-04-20T12:11:16.334 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 126/152 2024-04-20T12:11:16.436 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 126/152 2024-04-20T12:11:16.599 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 127/152 2024-04-20T12:11:16.628 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/152 2024-04-20T12:11:16.651 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/152 2024-04-20T12:11:16.651 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:11:16.651 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-20T12:11:16.651 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T12:11:16.651 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T12:11:16.651 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:11:16.696 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 129/152 2024-04-20T12:11:16.707 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 129/152 2024-04-20T12:11:16.805 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 130/152 2024-04-20T12:11:16.853 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 131/152 2024-04-20T12:11:17.777 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-20T12:11:17.807 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 133/152 2024-04-20T12:11:17.829 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 133/152 2024-04-20T12:11:17.829 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:11:17.829 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-20T12:11:17.829 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T12:11:17.829 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T12:11:17.830 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:11:17.876 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T12:11:17.876 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 1/152 2024-04-20T12:11:17.876 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2/152 2024-04-20T12:11:17.876 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 3/152 2024-04-20T12:11:17.876 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 4/152 2024-04-20T12:11:17.877 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 5/152 2024-04-20T12:11:17.877 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T12:11:17.877 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/152 2024-04-20T12:11:17.877 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 8/152 2024-04-20T12:11:17.877 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 9/152 2024-04-20T12:11:17.877 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 10/152 2024-04-20T12:11:17.877 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 11/152 2024-04-20T12:11:17.877 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T12:11:17.877 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 13/152 2024-04-20T12:11:17.877 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 14/152 2024-04-20T12:11:17.877 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 15/152 2024-04-20T12:11:17.877 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 16/152 2024-04-20T12:11:17.877 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 17/152 2024-04-20T12:11:17.878 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 18/152 2024-04-20T12:11:17.878 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 19/152 2024-04-20T12:11:17.878 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 20/152 2024-04-20T12:11:17.878 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 21/152 2024-04-20T12:11:17.878 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 22/152 2024-04-20T12:11:17.878 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 23/152 2024-04-20T12:11:17.878 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 24/152 2024-04-20T12:11:17.878 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 25/152 2024-04-20T12:11:17.878 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 26/152 2024-04-20T12:11:17.878 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 27/152 2024-04-20T12:11:17.878 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 28/152 2024-04-20T12:11:17.878 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 29/152 2024-04-20T12:11:17.879 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 30/152 2024-04-20T12:11:17.879 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 31/152 2024-04-20T12:11:17.879 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 134/152 2024-04-20T12:11:17.891 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 32/152 2024-04-20T12:11:17.891 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 33/152 2024-04-20T12:11:17.891 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 34/152 2024-04-20T12:11:17.891 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 35/152 2024-04-20T12:11:17.891 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 36/152 2024-04-20T12:11:17.892 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 37/152 2024-04-20T12:11:17.892 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 38/152 2024-04-20T12:11:17.892 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 39/152 2024-04-20T12:11:17.892 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-20T12:11:17.892 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-20T12:11:17.892 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-20T12:11:17.892 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-20T12:11:17.892 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-20T12:11:17.892 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-20T12:11:17.892 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-20T12:11:17.892 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-20T12:11:17.893 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-20T12:11:17.893 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-20T12:11:17.893 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-20T12:11:17.893 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-20T12:11:17.893 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-20T12:11:17.893 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-20T12:11:17.893 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-20T12:11:17.893 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-20T12:11:17.893 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-20T12:11:17.893 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-20T12:11:17.893 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-20T12:11:17.893 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-20T12:11:17.893 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-20T12:11:17.894 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-20T12:11:17.894 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-20T12:11:17.894 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-20T12:11:17.894 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-20T12:11:17.894 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-20T12:11:17.894 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-20T12:11:17.894 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-20T12:11:17.894 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-20T12:11:17.894 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-20T12:11:17.894 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-20T12:11:17.894 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-20T12:11:17.894 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-20T12:11:17.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-20T12:11:17.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-20T12:11:17.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-20T12:11:17.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-20T12:11:17.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-20T12:11:17.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-20T12:11:17.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-20T12:11:17.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-20T12:11:17.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-20T12:11:17.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-20T12:11:17.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-20T12:11:17.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-20T12:11:17.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-20T12:11:17.895 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-20T12:11:17.896 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-20T12:11:17.896 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-20T12:11:17.896 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-20T12:11:17.896 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-20T12:11:17.896 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-20T12:11:17.896 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-20T12:11:17.896 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-20T12:11:17.896 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-20T12:11:17.896 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-20T12:11:17.896 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-20T12:11:17.896 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-20T12:11:17.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-20T12:11:17.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-20T12:11:17.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-20T12:11:17.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-20T12:11:17.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-20T12:11:17.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-20T12:11:17.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-20T12:11:17.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-20T12:11:17.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-20T12:11:17.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-20T12:11:17.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-20T12:11:17.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-20T12:11:17.897 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-20T12:11:17.898 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-20T12:11:17.898 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-20T12:11:17.898 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-20T12:11:17.898 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-20T12:11:17.898 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-20T12:11:17.898 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-20T12:11:17.898 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-20T12:11:17.898 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-20T12:11:17.898 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-20T12:11:17.898 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-20T12:11:17.898 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-20T12:11:17.898 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-20T12:11:17.899 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-20T12:11:17.899 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-20T12:11:17.899 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-20T12:11:17.899 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-20T12:11:17.899 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-20T12:11:17.899 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-20T12:11:17.899 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-20T12:11:17.899 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-20T12:11:17.899 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-20T12:11:17.899 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-20T12:11:17.899 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-20T12:11:17.899 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-20T12:11:17.899 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-20T12:11:17.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-20T12:11:17.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-20T12:11:17.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-20T12:11:17.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-20T12:11:17.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-20T12:11:17.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-20T12:11:17.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-20T12:11:17.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-20T12:11:17.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-20T12:11:17.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-20T12:11:17.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-20T12:11:17.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-20T12:11:17.900 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-20T12:11:17.901 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 149/152 2024-04-20T12:11:17.901 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-20T12:11:17.901 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 151/152 2024-04-20T12:11:17.901 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 134/152 2024-04-20T12:11:17.901 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:11:17.901 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-20T12:11:17.901 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:11:17.942 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/152 2024-04-20T12:11:17.964 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/152 2024-04-20T12:11:17.964 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:11:17.964 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-20T12:11:17.964 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-20T12:11:17.964 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-20T12:11:17.964 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:11:18.268 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/152 2024-04-20T12:11:18.291 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/152 2024-04-20T12:11:18.291 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T12:11:18.291 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-20T12:11:18.291 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T12:11:18.291 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T12:11:18.291 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:11:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T12:11:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:11:19.927 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2024-04-20T12:11:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.927 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2024-04-20T12:11:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-20T12:11:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.2-8.el9.noarch 2024-04-20T12:11:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.7.4-5.el9.x86_64 2024-04-20T12:11:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-20T12:11:19.927 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.928 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-20T12:11:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.4-9.el9.x86_64 2024-04-20T12:11:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-20T12:11:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-20T12:11:19.929 INFO:teuthology.orchestra.run.smithi154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-20T12:11:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-20T12:11:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-20T12:11:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-20T12:11:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-20T12:11:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-20T12:11:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-20T12:11:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-20T12:11:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-20T12:11:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-20T12:11:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-20T12:11:19.930 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-20T12:11:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-20T12:11:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-20T12:11:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-20T12:11:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-20T12:11:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-20T12:11:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-20T12:11:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: lua-5.4.4-4.el9.x86_64 2024-04-20T12:11:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-20T12:11:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-20T12:11:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-20T12:11:19.931 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-20T12:11:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-20T12:11:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-20T12:11:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-13.14-1.el9.x86_64 2024-04-20T12:11:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-20T12:11:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-20T12:11:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-20T12:11:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-20T12:11:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-20T12:11:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-20T12:11:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-20T12:11:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-20T12:11:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-20T12:11:19.932 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-20T12:11:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-20T12:11:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-20T12:11:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-20T12:11:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-20T12:11:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-20T12:11:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-20T12:11:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-20T12:11:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-20T12:11:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-20T12:11:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-20T12:11:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-20T12:11:19.933 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-20T12:11:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-20T12:11:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-20T12:11:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-20T12:11:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-20T12:11:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-20T12:11:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-20T12:11:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-20T12:11:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-20T12:11:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-20T12:11:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-20T12:11:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-20T12:11:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-20T12:11:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-20T12:11:19.934 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-20T12:11:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-20T12:11:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-20T12:11:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-20T12:11:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-20T12:11:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ply-3.11-14.el9.noarch 2024-04-20T12:11:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-20T12:11:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-20T12:11:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-20T12:11:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-20T12:11:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-20T12:11:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-20T12:11:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-20T12:11:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-20T12:11:19.935 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-20T12:11:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-20T12:11:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-20T12:11:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-20T12:11:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-20T12:11:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-20T12:11:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-20T12:11:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-20T12:11:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-20T12:11:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-20T12:11:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-20T12:11:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-20T12:11:19.936 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-20T12:11:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-20T12:11:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-20T12:11:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-20T12:11:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-20T12:11:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-20T12:11:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-20T12:11:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: re2-1:20211101-3.el9.x86_64 2024-04-20T12:11:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-20T12:11:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-20T12:11:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-20T12:11:19.937 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-20T12:11:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-20T12:11:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-20T12:11:19.938 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:11:19.938 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2024-04-20T12:11:20.323 DEBUG:teuthology.parallel:result is None 2024-04-20T12:11:23.164 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 137/152 2024-04-20T12:11:23.206 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 138/152 2024-04-20T12:11:23.247 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 139/152 2024-04-20T12:11:23.279 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-20T12:11:23.307 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-20T12:11:23.477 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 142/152 2024-04-20T12:11:23.529 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-20T12:11:23.559 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 144/152 2024-04-20T12:11:24.175 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T12:11:24.226 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T12:11:24.246 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T12:11:25.012 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 146/152 2024-04-20T12:11:25.100 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-20T12:11:25.141 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-20T12:11:25.222 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-20T12:11:25.263 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-20T12:11:25.263 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-20T12:11:25.347 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-20T12:11:25.348 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T12:11:31.501 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T12:11:31.502 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 1/152 2024-04-20T12:11:31.502 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2/152 2024-04-20T12:11:31.502 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 3/152 2024-04-20T12:11:31.502 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 4/152 2024-04-20T12:11:31.502 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 5/152 2024-04-20T12:11:31.502 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T12:11:31.502 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/152 2024-04-20T12:11:31.502 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 8/152 2024-04-20T12:11:31.502 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 9/152 2024-04-20T12:11:31.502 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 10/152 2024-04-20T12:11:31.502 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 11/152 2024-04-20T12:11:31.503 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T12:11:31.503 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 13/152 2024-04-20T12:11:31.503 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 14/152 2024-04-20T12:11:31.503 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 15/152 2024-04-20T12:11:31.503 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 16/152 2024-04-20T12:11:31.503 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 17/152 2024-04-20T12:11:31.503 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 18/152 2024-04-20T12:11:31.503 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 19/152 2024-04-20T12:11:31.503 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 20/152 2024-04-20T12:11:31.503 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 21/152 2024-04-20T12:11:31.503 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 22/152 2024-04-20T12:11:31.503 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 23/152 2024-04-20T12:11:31.503 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 24/152 2024-04-20T12:11:31.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 25/152 2024-04-20T12:11:31.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 26/152 2024-04-20T12:11:31.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 27/152 2024-04-20T12:11:31.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 28/152 2024-04-20T12:11:31.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 29/152 2024-04-20T12:11:31.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 30/152 2024-04-20T12:11:31.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 31/152 2024-04-20T12:11:31.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 32/152 2024-04-20T12:11:31.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 33/152 2024-04-20T12:11:31.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 34/152 2024-04-20T12:11:31.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 35/152 2024-04-20T12:11:31.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 36/152 2024-04-20T12:11:31.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 37/152 2024-04-20T12:11:31.504 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 38/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 39/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-20T12:11:31.505 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-20T12:11:31.506 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-20T12:11:31.506 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-20T12:11:31.506 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-20T12:11:31.506 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-20T12:11:31.506 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-20T12:11:31.506 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-20T12:11:31.506 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-20T12:11:31.506 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-20T12:11:31.506 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-20T12:11:31.506 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-20T12:11:31.506 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-20T12:11:31.506 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-20T12:11:31.506 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-20T12:11:31.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-20T12:11:31.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-20T12:11:31.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-20T12:11:31.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-20T12:11:31.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-20T12:11:31.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-20T12:11:31.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-20T12:11:31.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-20T12:11:31.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-20T12:11:31.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-20T12:11:31.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-20T12:11:31.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-20T12:11:31.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-20T12:11:31.507 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-20T12:11:31.508 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-20T12:11:31.508 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-20T12:11:31.508 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-20T12:11:31.508 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-20T12:11:31.508 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-20T12:11:31.508 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-20T12:11:31.508 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-20T12:11:31.508 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-20T12:11:31.508 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-20T12:11:31.508 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-20T12:11:31.508 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-20T12:11:31.508 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-20T12:11:31.508 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-20T12:11:31.508 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-20T12:11:31.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-20T12:11:31.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-20T12:11:31.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-20T12:11:31.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-20T12:11:31.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-20T12:11:31.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-20T12:11:31.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-20T12:11:31.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-20T12:11:31.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-20T12:11:31.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-20T12:11:31.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-20T12:11:31.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-20T12:11:31.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-20T12:11:31.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-20T12:11:31.509 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-20T12:11:31.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-20T12:11:31.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-20T12:11:31.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-20T12:11:31.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-20T12:11:31.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-20T12:11:31.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-20T12:11:31.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-20T12:11:31.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-20T12:11:31.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-20T12:11:31.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-20T12:11:31.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-20T12:11:31.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-20T12:11:31.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-20T12:11:31.510 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-20T12:11:31.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-20T12:11:31.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-20T12:11:31.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-20T12:11:31.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-20T12:11:31.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-20T12:11:31.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-20T12:11:31.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-20T12:11:31.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-20T12:11:31.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-20T12:11:31.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-20T12:11:31.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-20T12:11:31.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-20T12:11:31.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-20T12:11:31.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-20T12:11:31.511 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-20T12:11:31.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-20T12:11:31.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-20T12:11:31.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-20T12:11:31.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-20T12:11:31.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-20T12:11:31.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-20T12:11:31.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-20T12:11:31.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-20T12:11:31.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-20T12:11:31.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 149/152 2024-04-20T12:11:31.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-20T12:11:31.512 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 151/152 2024-04-20T12:11:33.641 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T12:11:33.641 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:11:33.642 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-04-20T12:11:33.642 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.642 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.642 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-04-20T12:11:33.642 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-20T12:11:33.642 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.2-8.el9.noarch 2024-04-20T12:11:33.642 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.7.4-5.el9.x86_64 2024-04-20T12:11:33.642 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-20T12:11:33.642 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.642 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.642 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.642 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.642 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:33.643 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.643 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.643 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.643 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:33.643 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:33.643 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:33.643 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:33.643 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:33.643 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.643 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.643 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:33.643 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.643 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.643 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.644 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:33.644 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:33.644 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.644 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.644 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T12:11:33.644 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-20T12:11:33.644 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.4-9.el9.x86_64 2024-04-20T12:11:33.644 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-20T12:11:33.644 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-20T12:11:33.644 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-20T12:11:33.644 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-20T12:11:33.644 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-20T12:11:33.644 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-20T12:11:33.644 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-20T12:11:33.645 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-20T12:11:33.645 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-20T12:11:33.645 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.645 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.645 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.645 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-20T12:11:33.645 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-20T12:11:33.645 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-20T12:11:33.645 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-20T12:11:33.645 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-20T12:11:33.645 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.645 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.645 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-20T12:11:33.645 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.646 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-20T12:11:33.646 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-20T12:11:33.646 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-20T12:11:33.646 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-20T12:11:33.646 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-20T12:11:33.646 INFO:teuthology.orchestra.run.smithi135.stdout: lua-5.4.4-4.el9.x86_64 2024-04-20T12:11:33.646 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-20T12:11:33.646 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-20T12:11:33.646 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-20T12:11:33.646 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-20T12:11:33.646 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-20T12:11:33.646 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-20T12:11:33.646 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-13.14-1.el9.x86_64 2024-04-20T12:11:33.646 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-20T12:11:33.647 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-20T12:11:33.647 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-20T12:11:33.647 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-20T12:11:33.647 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-20T12:11:33.647 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-20T12:11:33.647 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-20T12:11:33.647 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-20T12:11:33.647 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-20T12:11:33.647 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-20T12:11:33.647 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.647 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.647 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.647 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-20T12:11:33.647 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-20T12:11:33.648 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-20T12:11:33.649 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-20T12:11:33.649 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-20T12:11:33.649 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-20T12:11:33.649 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-20T12:11:33.649 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-20T12:11:33.649 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-20T12:11:33.649 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-20T12:11:33.649 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-20T12:11:33.649 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-20T12:11:33.649 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-20T12:11:33.649 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-20T12:11:33.649 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-20T12:11:33.649 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2024-04-20T12:11:33.649 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-20T12:11:33.650 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-20T12:11:33.650 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-20T12:11:33.650 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-20T12:11:33.650 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-20T12:11:33.650 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-20T12:11:33.650 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-20T12:11:33.650 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-20T12:11:33.650 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-20T12:11:33.650 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.650 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.650 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-20T12:11:33.650 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-20T12:11:33.650 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-20T12:11:33.650 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.650 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-20T12:11:33.651 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-20T12:11:33.651 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-20T12:11:33.651 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-20T12:11:33.651 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-20T12:11:33.651 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-20T12:11:33.651 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-20T12:11:33.651 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-20T12:11:33.651 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-20T12:11:33.651 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-20T12:11:33.651 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-20T12:11:33.651 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-20T12:11:33.651 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-20T12:11:33.651 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-20T12:11:33.651 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-20T12:11:33.652 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.652 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.652 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T12:11:33.652 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-3.el9.x86_64 2024-04-20T12:11:33.652 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-20T12:11:33.652 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-20T12:11:33.652 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-20T12:11:33.652 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-20T12:11:33.652 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-20T12:11:33.653 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-20T12:11:33.653 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:11:33.653 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-04-20T12:11:34.065 DEBUG:teuthology.parallel:result is None 2024-04-20T12:11:34.066 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T12:11:34.291 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-20T12:11:34.312 INFO:teuthology.orchestra.run.smithi135.stdout:19.0.0-3133.ga8c84f59.el9 2024-04-20T12:11:34.312 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3133.ga8c84f59.el9 2024-04-20T12:11:34.312 INFO:teuthology.task.install:The correct ceph version 19.0.0-3133.ga8c84f59 is installed. 2024-04-20T12:11:34.314 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T12:11:34.465 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-20T12:11:34.491 INFO:teuthology.orchestra.run.smithi139.stdout:19.0.0-3133.ga8c84f59.el9 2024-04-20T12:11:34.492 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3133.ga8c84f59.el9 2024-04-20T12:11:34.492 INFO:teuthology.task.install:The correct ceph version 19.0.0-3133.ga8c84f59 is installed. 2024-04-20T12:11:34.494 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T12:11:34.635 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-20T12:11:34.661 INFO:teuthology.orchestra.run.smithi154.stdout:19.0.0-3133.ga8c84f59.el9 2024-04-20T12:11:34.661 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3133.ga8c84f59.el9 2024-04-20T12:11:34.661 INFO:teuthology.task.install:The correct ceph version 19.0.0-3133.ga8c84f59 is installed. 2024-04-20T12:11:34.663 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-20T12:11:34.664 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:11:34.664 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-20T12:11:34.689 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-20T12:11:34.689 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-20T12:11:34.720 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-20T12:11:34.720 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-20T12:11:34.751 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-20T12:11:34.751 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:11:34.751 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-04-20T12:11:34.775 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-20T12:11:34.838 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-20T12:11:34.838 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2024-04-20T12:11:34.867 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-20T12:11:34.933 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-20T12:11:34.933 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-04-20T12:11:34.958 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-20T12:11:35.022 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-20T12:11:35.022 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:11:35.022 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-20T12:11:35.045 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-20T12:11:35.112 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-20T12:11:35.112 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-20T12:11:35.140 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-20T12:11:35.207 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-20T12:11:35.207 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-20T12:11:35.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-20T12:11:35.296 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-20T12:11:35.296 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:11:35.296 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-04-20T12:11:35.319 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-20T12:11:35.384 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-20T12:11:35.384 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2024-04-20T12:11:35.411 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-20T12:11:35.478 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-20T12:11:35.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-04-20T12:11:35.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-20T12:11:35.566 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-20T12:11:35.665 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-04-20T12:11:35.665 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T12:11:35.665 INFO:tasks.cephadm:Cluster fsid is 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:11:35.665 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-20T12:11:35.666 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.135', 'mon.b': '172.21.15.139', 'mon.c': '172.21.15.154'} 2024-04-20T12:11:35.666 INFO:tasks.cephadm:First mon is mon.a on smithi135 2024-04-20T12:11:35.666 INFO:tasks.cephadm:First mgr is x 2024-04-20T12:11:35.666 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-20T12:11:35.666 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname $(hostname -s) 2024-04-20T12:11:35.690 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname $(hostname -s) 2024-04-20T12:11:35.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname $(hostname -s) 2024-04-20T12:11:35.742 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-04-20T12:11:35.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T12:11:35.958 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/78637/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3133-ga8c84f59', 'node_name': '172.21.5.35+adami05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3133.ga8c84f59'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-04-16 21:41:56.138585', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240416.193735', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-04-20T12:11:36.099 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-rishabh-testing-20240416.193735, sha1 a8c84f5997950fd7d008204839253291d52e6eda from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T12:11:36.100 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/x86_64/flavors/default/cephadm 2024-04-20T12:11:36.100 DEBUG:teuthology.orchestra.run.smithi135:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-20T12:11:37.036 INFO:teuthology.orchestra.run.smithi135.stdout:-rw-r--r--. 1 ubuntu ubuntu 781646 Apr 20 12:11 /home/ubuntu/cephtest/cephadm 2024-04-20T12:11:37.036 DEBUG:teuthology.orchestra.run.smithi139:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-20T12:11:38.128 INFO:teuthology.orchestra.run.smithi139.stdout:-rw-r--r--. 1 ubuntu ubuntu 781646 Apr 20 12:11 /home/ubuntu/cephtest/cephadm 2024-04-20T12:11:38.129 DEBUG:teuthology.orchestra.run.smithi154:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-20T12:11:39.062 INFO:teuthology.orchestra.run.smithi154.stdout:-rw-r--r--. 1 ubuntu ubuntu 781646 Apr 20 12:11 /home/ubuntu/cephtest/cephadm 2024-04-20T12:11:39.062 DEBUG:teuthology.orchestra.run.smithi135:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-20T12:11:39.081 DEBUG:teuthology.orchestra.run.smithi139:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-20T12:11:39.100 DEBUG:teuthology.orchestra.run.smithi154:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-20T12:11:39.135 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda on all hosts... 2024-04-20T12:11:39.135 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda pull 2024-04-20T12:11:39.138 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda pull 2024-04-20T12:11:39.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda pull 2024-04-20T12:11:40.663 INFO:teuthology.orchestra.run.smithi139.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda... 2024-04-20T12:11:40.694 INFO:teuthology.orchestra.run.smithi154.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda... 2024-04-20T12:11:40.895 INFO:teuthology.orchestra.run.smithi135.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda... 2024-04-20T12:12:08.554 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:12:08.554 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-20T12:12:08.554 INFO:teuthology.orchestra.run.smithi135.stdout: "image_id": "76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d", 2024-04-20T12:12:08.555 INFO:teuthology.orchestra.run.smithi135.stdout: "repo_digests": [ 2024-04-20T12:12:08.555 INFO:teuthology.orchestra.run.smithi135.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1" 2024-04-20T12:12:08.555 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-04-20T12:12:08.555 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:12:22.237 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-20T12:12:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-20T12:12:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "image_id": "76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d", 2024-04-20T12:12:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "repo_digests": [ 2024-04-20T12:12:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1" 2024-04-20T12:12:22.237 INFO:teuthology.orchestra.run.smithi139.stdout: ] 2024-04-20T12:12:22.237 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-20T12:12:34.125 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-20T12:12:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-20T12:12:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "image_id": "76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d", 2024-04-20T12:12:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "repo_digests": [ 2024-04-20T12:12:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1" 2024-04-20T12:12:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-20T12:12:34.125 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-20T12:12:34.150 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph 2024-04-20T12:12:34.181 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph 2024-04-20T12:12:34.212 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph 2024-04-20T12:12:34.238 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /etc/ceph 2024-04-20T12:12:34.263 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /etc/ceph 2024-04-20T12:12:34.289 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /etc/ceph 2024-04-20T12:12:34.312 INFO:tasks.cephadm:Writing seed config... 2024-04-20T12:12:34.313 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-20T12:12:34.313 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-20T12:12:34.314 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-20T12:12:34.314 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-20T12:12:34.314 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-20T12:12:34.314 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-04-20T12:12:34.314 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-20T12:12:34.314 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-20T12:12:34.314 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-20T12:12:34.314 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-04-20T12:12:34.314 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-04-20T12:12:34.314 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-04-20T12:12:34.314 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-04-20T12:12:34.314 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-20T12:12:34.314 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-20T12:12:34.314 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-20T12:12:34.314 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-20T12:12:34.315 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-04-20T12:12:34.316 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-20T12:12:34.316 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-04-20T12:12:34.316 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-04-20T12:12:34.316 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-20T12:12:34.316 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-20T12:12:34.316 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-04-20T12:12:34.316 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-20T12:12:34.316 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-20T12:12:34.316 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-20T12:12:34.316 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-20T12:12:34.316 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-20T12:12:34.316 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-20T12:12:34.316 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-04-20T12:12:34.316 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-04-20T12:12:34.317 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:12:34.317 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-20T12:12:34.333 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 22180be8-ff0f-11ee-bc92-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-20T12:12:34.333 DEBUG:teuthology.orchestra.run.smithi135:mon.a> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mon.a.service 2024-04-20T12:12:34.376 DEBUG:teuthology.orchestra.run.smithi135:mgr.x> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.x.service 2024-04-20T12:12:34.418 INFO:tasks.cephadm:Bootstrapping... 2024-04-20T12:12:34.418 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda -v bootstrap --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.135 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-20T12:12:34.612 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-04-20T12:12:34.612 INFO:teuthology.orchestra.run.smithi135.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda', '-v', 'bootstrap', '--fsid', '22180be8-ff0f-11ee-bc92-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.135', '--skip-admin-label'] 2024-04-20T12:12:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-20T12:12:34.613 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying podman|docker is present... 2024-04-20T12:12:34.640 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-20T12:12:34.640 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying lvm2 is present... 2024-04-20T12:12:34.640 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying time synchronization is in place... 2024-04-20T12:12:34.647 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-20T12:12:34.647 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-20T12:12:34.653 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-20T12:12:34.654 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-04-20T12:12:34.660 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout enabled 2024-04-20T12:12:34.667 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout active 2024-04-20T12:12:34.667 INFO:teuthology.orchestra.run.smithi135.stdout:Unit chronyd.service is enabled and running 2024-04-20T12:12:34.667 INFO:teuthology.orchestra.run.smithi135.stdout:Repeating the final host check... 2024-04-20T12:12:34.692 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-20T12:12:34.692 INFO:teuthology.orchestra.run.smithi135.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-20T12:12:34.692 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl is present 2024-04-20T12:12:34.693 INFO:teuthology.orchestra.run.smithi135.stdout:lvcreate is present 2024-04-20T12:12:34.699 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-20T12:12:34.699 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-20T12:12:34.705 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-20T12:12:34.705 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-04-20T12:12:34.712 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout enabled 2024-04-20T12:12:34.719 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout active 2024-04-20T12:12:34.720 INFO:teuthology.orchestra.run.smithi135.stdout:Unit chronyd.service is enabled and running 2024-04-20T12:12:34.720 INFO:teuthology.orchestra.run.smithi135.stdout:Host looks OK 2024-04-20T12:12:34.720 INFO:teuthology.orchestra.run.smithi135.stdout:Cluster fsid: 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:12:34.720 INFO:teuthology.orchestra.run.smithi135.stdout:Acquiring lock 140167267847328 on /run/cephadm/22180be8-ff0f-11ee-bc92-c7b262605968.lock 2024-04-20T12:12:34.720 INFO:teuthology.orchestra.run.smithi135.stdout:Lock 140167267847328 acquired on /run/cephadm/22180be8-ff0f-11ee-bc92-c7b262605968.lock 2024-04-20T12:12:34.720 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying IP 172.21.15.135 port 3300 ... 2024-04-20T12:12:34.720 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying IP 172.21.15.135 port 6789 ... 2024-04-20T12:12:34.720 INFO:teuthology.orchestra.run.smithi135.stdout:Base mon IP(s) is [172.21.15.135:3300, 172.21.15.135:6789], mon addrv is [v2:172.21.15.135:3300,v1:172.21.15.135:6789] 2024-04-20T12:12:34.724 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.135 metric 100 2024-04-20T12:12:34.724 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.135 metric 100 2024-04-20T12:12:34.726 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-20T12:12:34.727 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-04-20T12:12:34.727 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-04-20T12:12:34.729 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-20T12:12:34.729 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-20T12:12:34.729 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-20T12:12:34.729 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-04-20T12:12:34.729 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout inet6 fe80::cde4:bb11:2417:569c/64 scope link noprefixroute 2024-04-20T12:12:34.729 INFO:teuthology.orchestra.run.smithi135.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-20T12:12:34.730 INFO:teuthology.orchestra.run.smithi135.stdout:Mon IP `172.21.15.135` is in CIDR network `172.21.0.0/20` 2024-04-20T12:12:34.730 INFO:teuthology.orchestra.run.smithi135.stdout:Mon IP `172.21.15.135` is in CIDR network `172.21.0.0/20` 2024-04-20T12:12:34.730 INFO:teuthology.orchestra.run.smithi135.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-20T12:12:34.730 INFO:teuthology.orchestra.run.smithi135.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-20T12:12:34.731 INFO:teuthology.orchestra.run.smithi135.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda... 2024-04-20T12:12:35.166 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stdout 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d 2024-04-20T12:12:35.167 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda... 2024-04-20T12:12:35.167 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Getting image source signatures 2024-04-20T12:12:35.167 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Copying blob sha256:9473d3fd79377e8e2904ab0f292b04da81cb2f2bfccde15ec927b481a725f6f4 2024-04-20T12:12:35.167 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Copying blob sha256:426fede9fffa2c7dfe40a4f9322a34794b72405170134d54d2c30d9cc6c6a5be 2024-04-20T12:12:35.167 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Copying config sha256:76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d 2024-04-20T12:12:35.167 INFO:teuthology.orchestra.run.smithi135.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-20T12:12:36.495 INFO:teuthology.orchestra.run.smithi135.stdout:ceph: stdout ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev) 2024-04-20T12:12:36.496 INFO:teuthology.orchestra.run.smithi135.stdout:Ceph version: ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev) 2024-04-20T12:12:36.496 INFO:teuthology.orchestra.run.smithi135.stdout:Extracting ceph user uid/gid from container image... 2024-04-20T12:12:37.326 INFO:teuthology.orchestra.run.smithi135.stdout:stat: stdout 167 167 2024-04-20T12:12:37.326 INFO:teuthology.orchestra.run.smithi135.stdout:Creating initial keys... 2024-04-20T12:12:38.265 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph-authtool: stdout AQA1sSNmbo/nJhAAJR7NAB0xoVbcuHuQnxVmKA== 2024-04-20T12:12:39.170 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph-authtool: stdout AQA2sSNmSyy8IhAAhOL3Vm0mrsF9MSgLtwRakw== 2024-04-20T12:12:40.084 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph-authtool: stdout AQA3sSNmUZMiHRAADin1CBjvlYsrkf3rlu3ZRw== 2024-04-20T12:12:40.085 INFO:teuthology.orchestra.run.smithi135.stdout:Creating initial monmap... 2024-04-20T12:12:41.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-20T12:12:41.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-04-20T12:12:41.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:12:41.050 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-20T12:12:41.050 INFO:teuthology.orchestra.run.smithi135.stdout:monmaptool for a [v2:172.21.15.135:3300,v1:172.21.15.135:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-20T12:12:41.050 INFO:teuthology.orchestra.run.smithi135.stdout:setting min_mon_release = quincy 2024-04-20T12:12:41.051 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: set fsid to 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:12:41.051 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-20T12:12:41.051 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:12:41.051 INFO:teuthology.orchestra.run.smithi135.stdout:Creating mon... 2024-04-20T12:12:41.951 INFO:teuthology.orchestra.run.smithi135.stdout:create mon.a on 2024-04-20T12:12:42.167 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-20T12:12:42.308 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-20T12:12:42.486 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-22180be8-ff0f-11ee-bc92-c7b262605968.target → /etc/systemd/system/ceph-22180be8-ff0f-11ee-bc92-c7b262605968.target. 2024-04-20T12:12:42.486 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-22180be8-ff0f-11ee-bc92-c7b262605968.target → /etc/systemd/system/ceph-22180be8-ff0f-11ee-bc92-c7b262605968.target. 2024-04-20T12:12:42.709 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mon.a 2024-04-20T12:12:42.710 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Failed to reset failed state of unit ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mon.a.service: Unit ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mon.a.service not loaded. 2024-04-20T12:12:42.873 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-22180be8-ff0f-11ee-bc92-c7b262605968.target.wants/ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mon.a.service → /etc/systemd/system/ceph-22180be8-ff0f-11ee-bc92-c7b262605968@.service. 2024-04-20T12:12:43.409 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-20T12:12:43.409 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout disabled 2024-04-20T12:12:43.416 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-20T12:12:43.416 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-04-20T12:12:43.416 INFO:teuthology.orchestra.run.smithi135.stdout:firewalld.service is not enabled 2024-04-20T12:12:43.416 INFO:teuthology.orchestra.run.smithi135.stdout:Not possible to enable service . firewalld.service is not available 2024-04-20T12:12:43.417 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mon to start... 2024-04-20T12:12:43.417 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mon... 2024-04-20T12:12:44.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:44 smithi135 ceph-mon[17896]: from='client.? 172.21.15.135:0/2924279064' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-20T12:12:44.478 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout cluster: 2024-04-20T12:12:44.478 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout id: 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:12:44.479 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-20T12:12:44.479 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-04-20T12:12:44.479 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout services: 2024-04-20T12:12:44.479 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.550693s) 2024-04-20T12:12:44.479 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-20T12:12:44.479 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-20T12:12:44.479 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-04-20T12:12:44.479 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout data: 2024-04-20T12:12:44.479 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-20T12:12:44.479 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-20T12:12:44.479 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-20T12:12:44.479 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout pgs: 2024-04-20T12:12:44.479 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-04-20T12:12:44.479 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.838+0000 7f9205b7d700 1 Processor -- start 2024-04-20T12:12:44.479 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.838+0000 7f9205b7d700 1 -- start start 2024-04-20T12:12:44.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.838+0000 7f9205b7d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9200108c30 0x7f9200109050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:12:44.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.838+0000 7f9205b7d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9200109620 con 0x7f9200108c30 2024-04-20T12:12:44.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.839+0000 7f91ff7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9200108c30 0x7f9200109050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:12:44.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.839+0000 7f91ff7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9200108c30 0x7f9200109050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35812/0 (socket says 172.21.15.135:35812) 2024-04-20T12:12:44.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.839+0000 7f91ff7fe700 1 -- 172.21.15.135:0/506127667 learned_addr learned my addr 172.21.15.135:0/506127667 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:12:44.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.839+0000 7f91ff7fe700 1 -- 172.21.15.135:0/506127667 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9200107800 con 0x7f9200108c30 2024-04-20T12:12:44.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.839+0000 7f91ff7fe700 1 --2- 172.21.15.135:0/506127667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9200108c30 0x7f9200109050 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f91f8009e80 tx=0x7f91f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c2d978ed9edc8b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:12:44.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.839+0000 7f91fe7fc700 1 -- 172.21.15.135:0/506127667 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91f8017070 con 0x7f9200108c30 2024-04-20T12:12:44.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.840+0000 7f91fe7fc700 1 -- 172.21.15.135:0/506127667 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f8003a20 con 0x7f9200108c30 2024-04-20T12:12:44.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.840+0000 7f91fe7fc700 1 -- 172.21.15.135:0/506127667 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91f8003d20 con 0x7f9200108c30 2024-04-20T12:12:44.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.840+0000 7f9205b7d700 1 -- 172.21.15.135:0/506127667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9200108c30 msgr2=0x7f9200109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:12:44.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.840+0000 7f9205b7d700 1 --2- 172.21.15.135:0/506127667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9200108c30 0x7f9200109050 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f91f8009e80 tx=0x7f91f800b330 comp rx=0 tx=0).stop 2024-04-20T12:12:44.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.840+0000 7f9205b7d700 1 -- 172.21.15.135:0/506127667 shutdown_connections 2024-04-20T12:12:44.480 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.840+0000 7f9205b7d700 1 --2- 172.21.15.135:0/506127667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9200108c30 0x7f9200109050 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:12:44.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.840+0000 7f9205b7d700 1 -- 172.21.15.135:0/506127667 >> 172.21.15.135:0/506127667 conn(0x7f9200102310 msgr2=0x7f9200104730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:12:44.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.840+0000 7f9205b7d700 1 -- 172.21.15.135:0/506127667 shutdown_connections 2024-04-20T12:12:44.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.840+0000 7f9205b7d700 1 -- 172.21.15.135:0/506127667 wait complete. 2024-04-20T12:12:44.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.841+0000 7f9205b7d700 1 Processor -- start 2024-04-20T12:12:44.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.841+0000 7f9205b7d700 1 -- start start 2024-04-20T12:12:44.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.841+0000 7f9205b7d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9200108c30 0x7f9200107170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:12:44.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.841+0000 7f9205b7d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9200107cd0 con 0x7f9200108c30 2024-04-20T12:12:44.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.841+0000 7f91ff7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9200108c30 0x7f9200107170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:12:44.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.841+0000 7f91ff7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9200108c30 0x7f9200107170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35820/0 (socket says 172.21.15.135:35820) 2024-04-20T12:12:44.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.841+0000 7f91ff7fe700 1 -- 172.21.15.135:0/2924279064 learned_addr learned my addr 172.21.15.135:0/2924279064 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:12:44.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.841+0000 7f91ff7fe700 1 -- 172.21.15.135:0/2924279064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920019eb10 con 0x7f9200108c30 2024-04-20T12:12:44.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.842+0000 7f91ff7fe700 1 --2- 172.21.15.135:0/2924279064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9200108c30 0x7f9200107170 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9200068600 tx=0x7f91f8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:12:44.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.842+0000 7f91fcff9700 1 -- 172.21.15.135:0/2924279064 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91f8022020 con 0x7f9200108c30 2024-04-20T12:12:44.481 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.842+0000 7f91fcff9700 1 -- 172.21.15.135:0/2924279064 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f8018040 con 0x7f9200108c30 2024-04-20T12:12:44.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.842+0000 7f91fcff9700 1 -- 172.21.15.135:0/2924279064 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91f8017070 con 0x7f9200108c30 2024-04-20T12:12:44.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.842+0000 7f9205b7d700 1 -- 172.21.15.135:0/2924279064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920019ece0 con 0x7f9200108c30 2024-04-20T12:12:44.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.842+0000 7f9205b7d700 1 -- 172.21.15.135:0/2924279064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f920019f100 con 0x7f9200108c30 2024-04-20T12:12:44.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.842+0000 7f91fcff9700 1 -- 172.21.15.135:0/2924279064 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f91f8025020 con 0x7f9200108c30 2024-04-20T12:12:44.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.842+0000 7f91fcff9700 1 -- 172.21.15.135:0/2924279064 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f91f800f050 con 0x7f9200108c30 2024-04-20T12:12:44.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.843+0000 7f9205b7d700 1 -- 172.21.15.135:0/2924279064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92000640b0 con 0x7f9200108c30 2024-04-20T12:12:44.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.845+0000 7f91fcff9700 1 -- 172.21.15.135:0/2924279064 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f91f802c030 con 0x7f9200108c30 2024-04-20T12:12:44.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.914+0000 7f9205b7d700 1 -- 172.21.15.135:0/2924279064 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f920002e200 con 0x7f9200108c30 2024-04-20T12:12:44.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.914+0000 7f91fcff9700 1 -- 172.21.15.135:0/2924279064 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f91f801e480 con 0x7f9200108c30 2024-04-20T12:12:44.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.915+0000 7f9205b7d700 1 -- 172.21.15.135:0/2924279064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9200108c30 msgr2=0x7f9200107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:12:44.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.915+0000 7f9205b7d700 1 --2- 172.21.15.135:0/2924279064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9200108c30 0x7f9200107170 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9200068600 tx=0x7f91f8004ad0 comp rx=0 tx=0).stop 2024-04-20T12:12:44.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.915+0000 7f9205b7d700 1 -- 172.21.15.135:0/2924279064 shutdown_connections 2024-04-20T12:12:44.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.915+0000 7f9205b7d700 1 --2- 172.21.15.135:0/2924279064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9200108c30 0x7f9200107170 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:12:44.482 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.915+0000 7f9205b7d700 1 -- 172.21.15.135:0/2924279064 >> 172.21.15.135:0/2924279064 conn(0x7f9200102310 msgr2=0x7f9200191a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:12:44.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.916+0000 7f9205b7d700 1 -- 172.21.15.135:0/2924279064 shutdown_connections 2024-04-20T12:12:44.483 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:43.916+0000 7f9205b7d700 1 -- 172.21.15.135:0/2924279064 wait complete. 2024-04-20T12:12:44.483 INFO:teuthology.orchestra.run.smithi135.stdout:mon is available 2024-04-20T12:12:44.483 INFO:teuthology.orchestra.run.smithi135.stdout:Assimilating anything we can from ceph.conf... 2024-04-20T12:12:45.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:45 smithi135 ceph-mon[17896]: from='client.? 172.21.15.135:0/3000624223' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-20T12:12:45.478 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:45 smithi135 ceph-mon[17896]: from='client.? 172.21.15.135:0/3000624223' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-20T12:12:45.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-04-20T12:12:45.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [global] 2024-04-20T12:12:45.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout fsid = 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:12:45.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.135:3300,v1:172.21.15.135:6789] 2024-04-20T12:12:45.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-20T12:12:45.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-20T12:12:45.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-20T12:12:45.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-20T12:12:45.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-04-20T12:12:45.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-20T12:12:45.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-20T12:12:45.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-04-20T12:12:45.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [osd] 2024-04-20T12:12:45.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-20T12:12:45.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-20T12:12:45.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-20T12:12:45.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-20T12:12:45.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-20T12:12:45.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.847+0000 7f8511e70700 1 Processor -- start 2024-04-20T12:12:45.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.847+0000 7f8511e70700 1 -- start start 2024-04-20T12:12:45.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.847+0000 7f8511e70700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c1086a0 0x7f850c108ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:12:45.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.847+0000 7f8511e70700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f850c109090 con 0x7f850c1086a0 2024-04-20T12:12:45.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.847+0000 7f850b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c1086a0 0x7f850c108ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:12:45.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.847+0000 7f850b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c1086a0 0x7f850c108ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35832/0 (socket says 172.21.15.135:35832) 2024-04-20T12:12:45.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.847+0000 7f850b7fe700 1 -- 172.21.15.135:0/3961817258 learned_addr learned my addr 172.21.15.135:0/3961817258 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:12:45.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.847+0000 7f850b7fe700 1 -- 172.21.15.135:0/3961817258 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c109850 con 0x7f850c1086a0 2024-04-20T12:12:45.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.848+0000 7f850b7fe700 1 --2- 172.21.15.135:0/3961817258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c1086a0 0x7f850c108ac0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0098a0 tx=0x7f84fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f8fbfbbaeb2f58 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:12:45.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.848+0000 7f850a7fc700 1 -- 172.21.15.135:0/3961817258 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84fc004160 con 0x7f850c1086a0 2024-04-20T12:12:45.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.848+0000 7f850a7fc700 1 -- 172.21.15.135:0/3961817258 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84fc004300 con 0x7f850c1086a0 2024-04-20T12:12:45.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.848+0000 7f850a7fc700 1 -- 172.21.15.135:0/3961817258 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84fc0036a0 con 0x7f850c1086a0 2024-04-20T12:12:45.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.848+0000 7f8511e70700 1 -- 172.21.15.135:0/3961817258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c1086a0 msgr2=0x7f850c108ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:12:45.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.848+0000 7f8511e70700 1 --2- 172.21.15.135:0/3961817258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c1086a0 0x7f850c108ac0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0098a0 tx=0x7f84fc009bb0 comp rx=0 tx=0).stop 2024-04-20T12:12:45.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.848+0000 7f8511e70700 1 -- 172.21.15.135:0/3961817258 shutdown_connections 2024-04-20T12:12:45.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.848+0000 7f8511e70700 1 --2- 172.21.15.135:0/3961817258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c1086a0 0x7f850c108ac0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:12:45.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.848+0000 7f8511e70700 1 -- 172.21.15.135:0/3961817258 >> 172.21.15.135:0/3961817258 conn(0x7f850c103d40 msgr2=0x7f850c106160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:12:45.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.848+0000 7f8511e70700 1 -- 172.21.15.135:0/3961817258 shutdown_connections 2024-04-20T12:12:45.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.848+0000 7f8511e70700 1 -- 172.21.15.135:0/3961817258 wait complete. 2024-04-20T12:12:45.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.849+0000 7f8511e70700 1 Processor -- start 2024-04-20T12:12:45.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.849+0000 7f8511e70700 1 -- start start 2024-04-20T12:12:45.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.849+0000 7f8511e70700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c1086a0 0x7f850c19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:12:45.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.849+0000 7f8511e70700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f850c109d80 con 0x7f850c1086a0 2024-04-20T12:12:45.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.849+0000 7f850b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c1086a0 0x7f850c19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:12:45.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.850+0000 7f850b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c1086a0 0x7f850c19bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35838/0 (socket says 172.21.15.135:35838) 2024-04-20T12:12:45.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.850+0000 7f850b7fe700 1 -- 172.21.15.135:0/3000624223 learned_addr learned my addr 172.21.15.135:0/3000624223 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:12:45.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.850+0000 7f850b7fe700 1 -- 172.21.15.135:0/3000624223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c19c280 con 0x7f850c1086a0 2024-04-20T12:12:45.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.850+0000 7f850b7fe700 1 --2- 172.21.15.135:0/3000624223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c1086a0 0x7f850c19bd40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f84fc000c00 tx=0x7f84fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:12:45.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.850+0000 7f8508ff9700 1 -- 172.21.15.135:0/3000624223 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84fc003db0 con 0x7f850c1086a0 2024-04-20T12:12:45.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.850+0000 7f8508ff9700 1 -- 172.21.15.135:0/3000624223 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84fc011630 con 0x7f850c1086a0 2024-04-20T12:12:45.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.850+0000 7f8511e70700 1 -- 172.21.15.135:0/3000624223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850c19c510 con 0x7f850c1086a0 2024-04-20T12:12:45.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.850+0000 7f8508ff9700 1 -- 172.21.15.135:0/3000624223 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84fc011950 con 0x7f850c1086a0 2024-04-20T12:12:45.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.850+0000 7f8511e70700 1 -- 172.21.15.135:0/3000624223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f850c19f200 con 0x7f850c1086a0 2024-04-20T12:12:45.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.850+0000 7f8508ff9700 1 -- 172.21.15.135:0/3000624223 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f84fc011af0 con 0x7f850c1086a0 2024-04-20T12:12:45.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.850+0000 7f8508ff9700 1 -- 172.21.15.135:0/3000624223 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f84fc01c450 con 0x7f850c1086a0 2024-04-20T12:12:45.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.851+0000 7f8511e70700 1 -- 172.21.15.135:0/3000624223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f850c0640b0 con 0x7f850c1086a0 2024-04-20T12:12:45.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.853+0000 7f8508ff9700 1 -- 172.21.15.135:0/3000624223 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f84fc032020 con 0x7f850c1086a0 2024-04-20T12:12:45.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.920+0000 7f8511e70700 1 -- 172.21.15.135:0/3000624223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f850c02e0d0 con 0x7f850c1086a0 2024-04-20T12:12:45.491 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.923+0000 7f8508ff9700 1 -- 172.21.15.135:0/3000624223 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+431 (secure 0 0 0) 0x7f84fc011de0 con 0x7f850c1086a0 2024-04-20T12:12:45.491 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.924+0000 7f8508ff9700 1 -- 172.21.15.135:0/3000624223 <== mon.0 v2:172.21.15.135:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84fc004260 con 0x7f850c1086a0 2024-04-20T12:12:45.491 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.925+0000 7f8511e70700 1 -- 172.21.15.135:0/3000624223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c1086a0 msgr2=0x7f850c19bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:12:45.491 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.925+0000 7f8511e70700 1 --2- 172.21.15.135:0/3000624223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c1086a0 0x7f850c19bd40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f84fc000c00 tx=0x7f84fc004750 comp rx=0 tx=0).stop 2024-04-20T12:12:45.491 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.925+0000 7f8511e70700 1 -- 172.21.15.135:0/3000624223 shutdown_connections 2024-04-20T12:12:45.491 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.925+0000 7f8511e70700 1 --2- 172.21.15.135:0/3000624223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f850c1086a0 0x7f850c19bd40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:12:45.491 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.925+0000 7f8511e70700 1 -- 172.21.15.135:0/3000624223 >> 172.21.15.135:0/3000624223 conn(0x7f850c103d40 msgr2=0x7f850c1929a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:12:45.491 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.925+0000 7f8511e70700 1 -- 172.21.15.135:0/3000624223 shutdown_connections 2024-04-20T12:12:45.491 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:44.925+0000 7f8511e70700 1 -- 172.21.15.135:0/3000624223 wait complete. 2024-04-20T12:12:45.491 INFO:teuthology.orchestra.run.smithi135.stdout:Generating new minimal ceph.conf... 2024-04-20T12:12:46.466 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.869+0000 7f0f2d1c3700 1 Processor -- start 2024-04-20T12:12:46.467 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.869+0000 7f0f2d1c3700 1 -- start start 2024-04-20T12:12:46.467 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.869+0000 7f0f2d1c3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f281069a0 0x7f0f28106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:12:46.467 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.869+0000 7f0f2d1c3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f28107390 con 0x7f0f281069a0 2024-04-20T12:12:46.467 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.869+0000 7f0f26d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f281069a0 0x7f0f28106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:12:46.467 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.869+0000 7f0f26d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f281069a0 0x7f0f28106dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35850/0 (socket says 172.21.15.135:35850) 2024-04-20T12:12:46.467 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.869+0000 7f0f26d9d700 1 -- 172.21.15.135:0/3349912203 learned_addr learned my addr 172.21.15.135:0/3349912203 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:12:46.467 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.870+0000 7f0f26d9d700 1 -- 172.21.15.135:0/3349912203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f28109930 con 0x7f0f281069a0 2024-04-20T12:12:46.467 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.870+0000 7f0f26d9d700 1 --2- 172.21.15.135:0/3349912203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f281069a0 0x7f0f28106dc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0f180098a0 tx=0x7f0f18009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e63ff9254c9cd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:12:46.467 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.870+0000 7f0f2659c700 1 -- 172.21.15.135:0/3349912203 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f18004160 con 0x7f0f281069a0 2024-04-20T12:12:46.467 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.870+0000 7f0f2659c700 1 -- 172.21.15.135:0/3349912203 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f18004300 con 0x7f0f281069a0 2024-04-20T12:12:46.467 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.870+0000 7f0f2659c700 1 -- 172.21.15.135:0/3349912203 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f18011b50 con 0x7f0f281069a0 2024-04-20T12:12:46.468 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.870+0000 7f0f2d1c3700 1 -- 172.21.15.135:0/3349912203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f281069a0 msgr2=0x7f0f28106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:12:46.468 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.870+0000 7f0f2d1c3700 1 --2- 172.21.15.135:0/3349912203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f281069a0 0x7f0f28106dc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0f180098a0 tx=0x7f0f18009bb0 comp rx=0 tx=0).stop 2024-04-20T12:12:46.468 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.871+0000 7f0f2d1c3700 1 -- 172.21.15.135:0/3349912203 shutdown_connections 2024-04-20T12:12:46.468 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.871+0000 7f0f2d1c3700 1 --2- 172.21.15.135:0/3349912203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f281069a0 0x7f0f28106dc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:12:46.468 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.871+0000 7f0f2d1c3700 1 -- 172.21.15.135:0/3349912203 >> 172.21.15.135:0/3349912203 conn(0x7f0f28102310 msgr2=0x7f0f28104730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:12:46.468 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.871+0000 7f0f2d1c3700 1 -- 172.21.15.135:0/3349912203 shutdown_connections 2024-04-20T12:12:46.468 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.871+0000 7f0f2d1c3700 1 -- 172.21.15.135:0/3349912203 wait complete. 2024-04-20T12:12:46.468 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.871+0000 7f0f2d1c3700 1 Processor -- start 2024-04-20T12:12:46.468 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.871+0000 7f0f2d1c3700 1 -- start start 2024-04-20T12:12:46.468 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.872+0000 7f0f2d1c3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f281069a0 0x7f0f281091b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:12:46.468 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.872+0000 7f0f2d1c3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2810cce0 con 0x7f0f281069a0 2024-04-20T12:12:46.468 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.872+0000 7f0f26d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f281069a0 0x7f0f281091b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:12:46.468 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.872+0000 7f0f26d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f281069a0 0x7f0f281091b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35858/0 (socket says 172.21.15.135:35858) 2024-04-20T12:12:46.468 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.872+0000 7f0f26d9d700 1 -- 172.21.15.135:0/2590021165 learned_addr learned my addr 172.21.15.135:0/2590021165 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:12:46.469 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.872+0000 7f0f26d9d700 1 -- 172.21.15.135:0/2590021165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f281096f0 con 0x7f0f281069a0 2024-04-20T12:12:46.469 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.872+0000 7f0f26d9d700 1 --2- 172.21.15.135:0/2590021165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f281069a0 0x7f0f281091b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0f18011850 tx=0x7f0f18011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:12:46.469 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.872+0000 7f0f24d99700 1 -- 172.21.15.135:0/2590021165 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f18003af0 con 0x7f0f281069a0 2024-04-20T12:12:46.469 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.872+0000 7f0f24d99700 1 -- 172.21.15.135:0/2590021165 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f18020070 con 0x7f0f281069a0 2024-04-20T12:12:46.469 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.872+0000 7f0f24d99700 1 -- 172.21.15.135:0/2590021165 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f180195a0 con 0x7f0f281069a0 2024-04-20T12:12:46.469 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.872+0000 7f0f2d1c3700 1 -- 172.21.15.135:0/2590021165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f281078e0 con 0x7f0f281069a0 2024-04-20T12:12:46.469 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.872+0000 7f0f2d1c3700 1 -- 172.21.15.135:0/2590021165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f28107e20 con 0x7f0f281069a0 2024-04-20T12:12:46.469 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.873+0000 7f0f24d99700 1 -- 172.21.15.135:0/2590021165 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0f18019c30 con 0x7f0f281069a0 2024-04-20T12:12:46.469 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.873+0000 7f0f24d99700 1 -- 172.21.15.135:0/2590021165 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0f18011e00 con 0x7f0f281069a0 2024-04-20T12:12:46.469 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.873+0000 7f0f2d1c3700 1 -- 172.21.15.135:0/2590021165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f280640b0 con 0x7f0f281069a0 2024-04-20T12:12:46.469 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.875+0000 7f0f24d99700 1 -- 172.21.15.135:0/2590021165 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f0f18003c90 con 0x7f0f281069a0 2024-04-20T12:12:46.469 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.943+0000 7f0f2d1c3700 1 -- 172.21.15.135:0/2590021165 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f0f28108100 con 0x7f0f281069a0 2024-04-20T12:12:46.469 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.943+0000 7f0f24d99700 1 -- 172.21.15.135:0/2590021165 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7f0f1801a430 con 0x7f0f281069a0 2024-04-20T12:12:46.469 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.944+0000 7f0f2d1c3700 1 -- 172.21.15.135:0/2590021165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f281069a0 msgr2=0x7f0f281091b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:12:46.469 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.944+0000 7f0f2d1c3700 1 --2- 172.21.15.135:0/2590021165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f281069a0 0x7f0f281091b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0f18011850 tx=0x7f0f18011c10 comp rx=0 tx=0).stop 2024-04-20T12:12:46.470 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.944+0000 7f0f2d1c3700 1 -- 172.21.15.135:0/2590021165 shutdown_connections 2024-04-20T12:12:46.470 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.944+0000 7f0f2d1c3700 1 --2- 172.21.15.135:0/2590021165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f281069a0 0x7f0f281091b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:12:46.470 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.944+0000 7f0f2d1c3700 1 -- 172.21.15.135:0/2590021165 >> 172.21.15.135:0/2590021165 conn(0x7f0f28102310 msgr2=0x7f0f28102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:12:46.470 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.944+0000 7f0f2d1c3700 1 -- 172.21.15.135:0/2590021165 shutdown_connections 2024-04-20T12:12:46.470 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:45.944+0000 7f0f2d1c3700 1 -- 172.21.15.135:0/2590021165 wait complete. 2024-04-20T12:12:46.470 INFO:teuthology.orchestra.run.smithi135.stdout:Restarting the monitor... 2024-04-20T12:12:46.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:46 smithi135 ceph-mon[17896]: from='client.? 172.21.15.135:0/2590021165' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:12:46.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:46 smithi135 systemd[1]: Stopping Ceph mon.a for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:12:47.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:46 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-a[17892]: 2024-04-20T12:12:46.729+0000 7f70d1dd1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:12:47.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:46 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-a[17892]: 2024-04-20T12:12:46.729+0000 7f70d1dd1700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-20T12:12:47.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:46 smithi135 podman[18140]: 2024-04-20 12:12:46.914328221 +0000 UTC m=+0.287231796 container died 1fad6d509e05eb4322c5a2e7815386f035d6096d7561722fd87c66f554d113bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-20T12:12:47.555 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:47 smithi135 podman[18140]: 2024-04-20 12:12:47.280273479 +0000 UTC m=+0.653177060 container cleanup 1fad6d509e05eb4322c5a2e7815386f035d6096d7561722fd87c66f554d113bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0) 2024-04-20T12:12:47.555 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:47 smithi135 bash[18140]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-a 2024-04-20T12:12:47.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:47 smithi135 podman[18154]: 2024-04-20 12:12:47.556277763 +0000 UTC m=+0.640802302 container remove 1fad6d509e05eb4322c5a2e7815386f035d6096d7561722fd87c66f554d113bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-a, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-20T12:12:47.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:47 smithi135 systemd[1]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mon.a.service: Deactivated successfully. 2024-04-20T12:12:47.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:47 smithi135 systemd[1]: Stopped Ceph mon.a for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:12:47.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:47 smithi135 systemd[1]: Starting Ceph mon.a for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:12:48.169 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:47 smithi135 podman[18245]: 2024-04-20 12:12:47.821177807 +0000 UTC m=+0.017848692 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T12:12:48.170 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:47 smithi135 podman[18245]: 2024-04-20 12:12:47.923612394 +0000 UTC m=+0.120283279 container create a65046714468fb4b1a44c2b0e8a924c18e0bd2a7a117cbb4a713066265dbbbb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-04-20T12:12:48.170 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 podman[18245]: 2024-04-20 12:12:48.167497822 +0000 UTC m=+0.364168707 container init a65046714468fb4b1a44c2b0e8a924c18e0bd2a7a117cbb4a713066265dbbbb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-a, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-20T12:12:48.170 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 podman[18245]: 2024-04-20 12:12:48.170780015 +0000 UTC m=+0.367450901 container start a65046714468fb4b1a44c2b0e8a924c18e0bd2a7a117cbb4a713066265dbbbb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-a, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T12:12:48.264 INFO:teuthology.orchestra.run.smithi135.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-20T12:12:48.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: set uid:gid to 167:167 (ceph:ceph) 2024-04-20T12:12:48.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev), process ceph-mon, pid 2 2024-04-20T12:12:48.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: pidfile_write: ignore empty --pid-file 2024-04-20T12:12:48.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: load: jerasure load: lrc 2024-04-20T12:12:48.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: RocksDB version: 7.9.2 2024-04-20T12:12:48.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Git sha 0 2024-04-20T12:12:48.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Compile date 2024-04-17 00:07:32 2024-04-20T12:12:48.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: DB SUMMARY 2024-04-20T12:12:48.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: DB Session ID: PK2RNNR3OGS3GS5KR19F 2024-04-20T12:12:48.489 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: CURRENT file: CURRENT 2024-04-20T12:12:48.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: IDENTITY file: IDENTITY 2024-04-20T12:12:48.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-04-20T12:12:48.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-04-20T12:12:48.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 106236 ; 2024-04-20T12:12:48.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.error_if_exists: 0 2024-04-20T12:12:48.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.create_if_missing: 0 2024-04-20T12:12:48.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.paranoid_checks: 1 2024-04-20T12:12:48.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-20T12:12:48.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-20T12:12:48.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-20T12:12:48.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.env: 0x55a042162cc0 2024-04-20T12:12:48.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.fs: PosixFileSystem 2024-04-20T12:12:48.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.info_log: 0x55a043b37c20 2024-04-20T12:12:48.490 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_file_opening_threads: 16 2024-04-20T12:12:48.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.statistics: (nil) 2024-04-20T12:12:48.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.use_fsync: 0 2024-04-20T12:12:48.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_log_file_size: 0 2024-04-20T12:12:48.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-20T12:12:48.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-20T12:12:48.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.keep_log_file_num: 1000 2024-04-20T12:12:48.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.recycle_log_file_num: 0 2024-04-20T12:12:48.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.allow_fallocate: 1 2024-04-20T12:12:48.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.allow_mmap_reads: 0 2024-04-20T12:12:48.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.allow_mmap_writes: 0 2024-04-20T12:12:48.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.use_direct_reads: 0 2024-04-20T12:12:48.491 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.create_missing_column_families: 0 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.db_log_dir: 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.wal_dir: 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.advise_random_on_open: 1 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.db_write_buffer_size: 0 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.write_buffer_manager: 0x55a043b061e0 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-20T12:12:48.492 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.rate_limiter: (nil) 2024-04-20T12:12:48.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-20T12:12:48.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.wal_recovery_mode: 2 2024-04-20T12:12:48.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.enable_thread_tracking: 0 2024-04-20T12:12:48.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.enable_pipelined_write: 0 2024-04-20T12:12:48.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.unordered_write: 0 2024-04-20T12:12:48.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-20T12:12:48.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-20T12:12:48.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-20T12:12:48.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-20T12:12:48.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.row_cache: None 2024-04-20T12:12:48.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.wal_filter: None 2024-04-20T12:12:48.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-20T12:12:48.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.allow_ingest_behind: 0 2024-04-20T12:12:48.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.two_write_queues: 0 2024-04-20T12:12:48.493 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.manual_wal_flush: 0 2024-04-20T12:12:48.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.wal_compression: 0 2024-04-20T12:12:48.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.atomic_flush: 0 2024-04-20T12:12:48.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-20T12:12:48.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-20T12:12:48.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-20T12:12:48.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.log_readahead_size: 0 2024-04-20T12:12:48.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-20T12:12:48.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.best_efforts_recovery: 0 2024-04-20T12:12:48.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-20T12:12:48.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-20T12:12:48.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.allow_data_in_errors: 0 2024-04-20T12:12:48.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.db_host_id: __hostname__ 2024-04-20T12:12:48.494 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-20T12:12:48.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_background_jobs: 2 2024-04-20T12:12:48.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_background_compactions: -1 2024-04-20T12:12:48.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_subcompactions: 1 2024-04-20T12:12:48.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-20T12:12:48.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-20T12:12:48.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-20T12:12:48.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_total_wal_size: 0 2024-04-20T12:12:48.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-20T12:12:48.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-20T12:12:48.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-20T12:12:48.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-20T12:12:48.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_open_files: -1 2024-04-20T12:12:48.496 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.bytes_per_sync: 0 2024-04-20T12:12:48.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-20T12:12:48.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-20T12:12:48.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compaction_readahead_size: 0 2024-04-20T12:12:48.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_background_flushes: -1 2024-04-20T12:12:48.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Compression algorithms supported: 2024-04-20T12:12:48.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-20T12:12:48.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: kZSTD supported: 0 2024-04-20T12:12:48.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: kXpressCompression supported: 0 2024-04-20T12:12:48.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: kLZ4HCCompression supported: 1 2024-04-20T12:12:48.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: kZlibCompression supported: 1 2024-04-20T12:12:48.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: kSnappyCompression supported: 1 2024-04-20T12:12:48.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: kLZ4Compression supported: 1 2024-04-20T12:12:48.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: kBZip2Compression supported: 0 2024-04-20T12:12:48.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-20T12:12:48.497 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-20T12:12:48.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-04-20T12:12:48.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-20T12:12:48.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-20T12:12:48.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.merge_operator: 2024-04-20T12:12:48.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compaction_filter: None 2024-04-20T12:12:48.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compaction_filter_factory: None 2024-04-20T12:12:48.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.sst_partitioner_factory: None 2024-04-20T12:12:48.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-20T12:12:48.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-20T12:12:48.498 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a043b37de0) 2024-04-20T12:12:48.498 INFO:journalctl@ceph.mon.a.smithi135.stdout: cache_index_and_filter_blocks: 1 2024-04-20T12:12:48.499 INFO:journalctl@ceph.mon.a.smithi135.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-20T12:12:48.499 INFO:journalctl@ceph.mon.a.smithi135.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-20T12:12:48.499 INFO:journalctl@ceph.mon.a.smithi135.stdout: pin_top_level_index_and_filter: 1 2024-04-20T12:12:48.499 INFO:journalctl@ceph.mon.a.smithi135.stdout: index_type: 0 2024-04-20T12:12:48.499 INFO:journalctl@ceph.mon.a.smithi135.stdout: data_block_index_type: 0 2024-04-20T12:12:48.499 INFO:journalctl@ceph.mon.a.smithi135.stdout: index_shortening: 1 2024-04-20T12:12:48.499 INFO:journalctl@ceph.mon.a.smithi135.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-20T12:12:48.499 INFO:journalctl@ceph.mon.a.smithi135.stdout: checksum: 4 2024-04-20T12:12:48.499 INFO:journalctl@ceph.mon.a.smithi135.stdout: no_block_cache: 0 2024-04-20T12:12:48.499 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_cache: 0x55a043b39090 2024-04-20T12:12:48.499 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_cache_name: BinnedLRUCache 2024-04-20T12:12:48.499 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_cache_options: 2024-04-20T12:12:48.499 INFO:journalctl@ceph.mon.a.smithi135.stdout: capacity : 536870912 2024-04-20T12:12:48.499 INFO:journalctl@ceph.mon.a.smithi135.stdout: num_shard_bits : 4 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: strict_capacity_limit : 0 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: high_pri_pool_ratio: 0.000 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_cache_compressed: (nil) 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: persistent_cache: (nil) 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_size: 4096 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_size_deviation: 10 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_restart_interval: 16 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: index_block_restart_interval: 1 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: metadata_block_size: 4096 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: partition_filters: 0 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: use_delta_encoding: 1 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: filter_policy: bloomfilter 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: whole_key_filtering: 1 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: verify_compression: 0 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: read_amp_bytes_per_bit: 0 2024-04-20T12:12:48.500 INFO:journalctl@ceph.mon.a.smithi135.stdout: format_version: 5 2024-04-20T12:12:48.501 INFO:journalctl@ceph.mon.a.smithi135.stdout: enable_index_compression: 1 2024-04-20T12:12:48.501 INFO:journalctl@ceph.mon.a.smithi135.stdout: block_align: 0 2024-04-20T12:12:48.501 INFO:journalctl@ceph.mon.a.smithi135.stdout: max_auto_readahead_size: 262144 2024-04-20T12:12:48.501 INFO:journalctl@ceph.mon.a.smithi135.stdout: prepopulate_block_cache: 0 2024-04-20T12:12:48.501 INFO:journalctl@ceph.mon.a.smithi135.stdout: initial_auto_readahead_size: 8192 2024-04-20T12:12:48.501 INFO:journalctl@ceph.mon.a.smithi135.stdout: num_file_reads_for_auto_readahead: 2 2024-04-20T12:12:48.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.write_buffer_size: 33554432 2024-04-20T12:12:48.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_write_buffer_number: 2 2024-04-20T12:12:48.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compression: NoCompression 2024-04-20T12:12:48.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.bottommost_compression: Disabled 2024-04-20T12:12:48.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.prefix_extractor: nullptr 2024-04-20T12:12:48.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-20T12:12:48.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.num_levels: 7 2024-04-20T12:12:48.501 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-20T12:12:48.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-20T12:12:48.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-20T12:12:48.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-20T12:12:48.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-20T12:12:48.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-20T12:12:48.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-20T12:12:48.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-20T12:12:48.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-20T12:12:48.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-20T12:12:48.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-20T12:12:48.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-20T12:12:48.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-20T12:12:48.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compression_opts.level: 32767 2024-04-20T12:12:48.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compression_opts.strategy: 0 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compression_opts.enabled: false 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.target_file_size_base: 67108864 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-20T12:12:48.503 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.arena_block_size: 1048576 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.disable_auto_compactions: 0 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-20T12:12:48.504 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.inplace_update_support: 0 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.bloom_locality: 0 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.max_successive_merges: 0 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.paranoid_file_checks: 0 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.force_consistency_checks: 1 2024-04-20T12:12:48.505 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.report_bg_io_stats: 0 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.ttl: 2592000 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.enable_blob_files: false 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.min_blob_size: 0 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.blob_file_size: 268435456 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.blob_file_starting_level: 0 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-04-20T12:12:48.506 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-04-20T12:12:48.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ebce59b4-abf8-422d-8817-268ed39451e4 2024-04-20T12:12:48.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713615168199463, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-04-20T12:12:48.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-04-20T12:12:48.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713615168200405, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 101304, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 330, "table_properties": {"data_size": 99191, "index_size": 305, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14439, "raw_average_key_size": 49, "raw_value_size": 91322, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 289, "num_filter_entries": 289, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713615168, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ebce59b4-abf8-422d-8817-268ed39451e4", "db_session_id": "PK2RNNR3OGS3GS5KR19F", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-04-20T12:12:48.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713615168200487, "job": 1, "event": "recovery_finished"} 2024-04-20T12:12:48.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-04-20T12:12:48.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-20T12:12:48.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a043c26000 2024-04-20T12:12:48.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: DB pointer 0x55a043c10000 2024-04-20T12:12:48.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-20T12:12:48.507 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-20T12:12:48.507 INFO:journalctl@ceph.mon.a.smithi135.stdout: ** DB Stats ** 2024-04-20T12:12:48.507 INFO:journalctl@ceph.mon.a.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-20T12:12:48.507 INFO:journalctl@ceph.mon.a.smithi135.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-20T12:12:48.508 INFO:journalctl@ceph.mon.a.smithi135.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-20T12:12:48.508 INFO:journalctl@ceph.mon.a.smithi135.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-20T12:12:48.508 INFO:journalctl@ceph.mon.a.smithi135.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-20T12:12:48.508 INFO:journalctl@ceph.mon.a.smithi135.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-20T12:12:48.508 INFO:journalctl@ceph.mon.a.smithi135.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-20T12:12:48.508 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-04-20T12:12:48.508 INFO:journalctl@ceph.mon.a.smithi135.stdout: ** Compaction Stats [default] ** 2024-04-20T12:12:48.508 INFO:journalctl@ceph.mon.a.smithi135.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-20T12:12:48.508 INFO:journalctl@ceph.mon.a.smithi135.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-20T12:12:48.508 INFO:journalctl@ceph.mon.a.smithi135.stdout: L0 2/0 100.79 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-20T12:12:48.508 INFO:journalctl@ceph.mon.a.smithi135.stdout: Sum 2/0 100.79 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-20T12:12:48.508 INFO:journalctl@ceph.mon.a.smithi135.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 162.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-20T12:12:48.508 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-04-20T12:12:48.508 INFO:journalctl@ceph.mon.a.smithi135.stdout: ** Compaction Stats [default] ** 2024-04-20T12:12:48.508 INFO:journalctl@ceph.mon.a.smithi135.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 162.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: Cumulative compaction: 0.00 GB write, 33.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: Interval compaction: 0.00 GB write, 33.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: Block cache BinnedLRUCache@0x55a043b39090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-04-20T12:12:48.509 INFO:journalctl@ceph.mon.a.smithi135.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-04-20T12:12:48.510 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-04-20T12:12:48.510 INFO:journalctl@ceph.mon.a.smithi135.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-20T12:12:48.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: starting mon.a rank 0 at public addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] at bind addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:12:48.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: mon.a@-1(???) e1 preinit fsid 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:12:48.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: mon.a@-1(???).mds e1 new map 2024-04-20T12:12:48.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: mon.a@-1(???).mds e1 print_map 2024-04-20T12:12:48.510 INFO:journalctl@ceph.mon.a.smithi135.stdout: e1 2024-04-20T12:12:48.510 INFO:journalctl@ceph.mon.a.smithi135.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T12:12:48.510 INFO:journalctl@ceph.mon.a.smithi135.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-20T12:12:48.510 INFO:journalctl@ceph.mon.a.smithi135.stdout: legacy client fscid: -1 2024-04-20T12:12:48.510 INFO:journalctl@ceph.mon.a.smithi135.stdout: 2024-04-20T12:12:48.510 INFO:journalctl@ceph.mon.a.smithi135.stdout: No filesystems configured 2024-04-20T12:12:48.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-20T12:12:48.510 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 bash[18245]: a65046714468fb4b1a44c2b0e8a924c18e0bd2a7a117cbb4a713066265dbbbb2 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: mon.a is new leader, mons a in quorum (ranks 0) 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: monmap epoch 1 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: fsid 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: last_changed 2024-04-20T12:12:40.408375+0000 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: created 2024-04-20T12:12:40.408375+0000 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: min_mon_release 19 (squid) 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: election_strategy: 1 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: 0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: fsmap 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: osdmap e1: 0 total, 0 up, 0 in 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 ceph-mon[18264]: mgrmap e1: no daemons active 2024-04-20T12:12:48.511 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:48 smithi135 systemd[1]: Started Ceph mon.a for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:12:49.318 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.698+0000 7f80fb363700 1 Processor -- start 2024-04-20T12:12:49.318 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.698+0000 7f80fb363700 1 -- start start 2024-04-20T12:12:49.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.698+0000 7f80fb363700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80f4109140 0x7f80f410b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:12:49.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.698+0000 7f80fb363700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80f407be90 con 0x7f80f4109140 2024-04-20T12:12:49.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.699+0000 7f80f90ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80f4109140 0x7f80f410b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:12:49.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.699+0000 7f80f90ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80f4109140 0x7f80f410b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35864/0 (socket says 172.21.15.135:35864) 2024-04-20T12:12:49.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.699+0000 7f80f90ff700 1 -- 172.21.15.135:0/2307306430 learned_addr learned my addr 172.21.15.135:0/2307306430 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:12:49.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.699+0000 7f80f90ff700 1 -- 172.21.15.135:0/2307306430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f410ba70 con 0x7f80f4109140 2024-04-20T12:12:49.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.699+0000 7f80f90ff700 1 --2- 172.21.15.135:0/2307306430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80f4109140 0x7f80f410b530 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f80e40098a0 tx=0x7f80e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4b78f298b86d97 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:12:49.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.700+0000 7f80f3fff700 1 -- 172.21.15.135:0/2307306430 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80e4004160 con 0x7f80f4109140 2024-04-20T12:12:49.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.700+0000 7f80f3fff700 1 -- 172.21.15.135:0/2307306430 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f80e4004300 con 0x7f80f4109140 2024-04-20T12:12:49.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.700+0000 7f80f3fff700 1 -- 172.21.15.135:0/2307306430 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80e4011b50 con 0x7f80f4109140 2024-04-20T12:12:49.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.700+0000 7f80fb363700 1 -- 172.21.15.135:0/2307306430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80f4109140 msgr2=0x7f80f410b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:12:49.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.700+0000 7f80fb363700 1 --2- 172.21.15.135:0/2307306430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80f4109140 0x7f80f410b530 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f80e40098a0 tx=0x7f80e4009bb0 comp rx=0 tx=0).stop 2024-04-20T12:12:49.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.700+0000 7f80fb363700 1 -- 172.21.15.135:0/2307306430 shutdown_connections 2024-04-20T12:12:49.319 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.700+0000 7f80fb363700 1 --2- 172.21.15.135:0/2307306430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80f4109140 0x7f80f410b530 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:12:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.700+0000 7f80fb363700 1 -- 172.21.15.135:0/2307306430 >> 172.21.15.135:0/2307306430 conn(0x7f80f4102b50 msgr2=0x7f80f4104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:12:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.700+0000 7f80fb363700 1 -- 172.21.15.135:0/2307306430 shutdown_connections 2024-04-20T12:12:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.700+0000 7f80fb363700 1 -- 172.21.15.135:0/2307306430 wait complete. 2024-04-20T12:12:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.701+0000 7f80fb363700 1 Processor -- start 2024-04-20T12:12:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.701+0000 7f80fb363700 1 -- start start 2024-04-20T12:12:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.701+0000 7f80fb363700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80f4109140 0x7f80f419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:12:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.701+0000 7f80fb363700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80f410ca90 con 0x7f80f4109140 2024-04-20T12:12:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.701+0000 7f80f90ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80f4109140 0x7f80f419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:12:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.701+0000 7f80f90ff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80f4109140 0x7f80f419c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35866/0 (socket says 172.21.15.135:35866) 2024-04-20T12:12:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.701+0000 7f80f90ff700 1 -- 172.21.15.135:0/1952470547 learned_addr learned my addr 172.21.15.135:0/1952470547 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:12:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.701+0000 7f80f90ff700 1 -- 172.21.15.135:0/1952470547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80f419cbd0 con 0x7f80f4109140 2024-04-20T12:12:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.702+0000 7f80f90ff700 1 --2- 172.21.15.135:0/1952470547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80f4109140 0x7f80f419c690 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f80e4011b60 tx=0x7f80e4011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:12:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.702+0000 7f80f27fc700 1 -- 172.21.15.135:0/1952470547 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80e4003970 con 0x7f80f4109140 2024-04-20T12:12:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.702+0000 7f80fb363700 1 -- 172.21.15.135:0/1952470547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80f419ce60 con 0x7f80f4109140 2024-04-20T12:12:49.320 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.702+0000 7f80f27fc700 1 -- 172.21.15.135:0/1952470547 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f80e4003b10 con 0x7f80f4109140 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.702+0000 7f80f27fc700 1 -- 172.21.15.135:0/1952470547 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80e4024610 con 0x7f80f4109140 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.702+0000 7f80fb363700 1 -- 172.21.15.135:0/1952470547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80f419fb50 con 0x7f80f4109140 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.702+0000 7f80f27fc700 1 -- 172.21.15.135:0/1952470547 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f80e4024ca0 con 0x7f80f4109140 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.702+0000 7f80f27fc700 1 -- 172.21.15.135:0/1952470547 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f80e4011e00 con 0x7f80f4109140 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.703+0000 7f80fb363700 1 -- 172.21.15.135:0/1952470547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80f40640b0 con 0x7f80f4109140 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.705+0000 7f80f27fc700 1 -- 172.21.15.135:0/1952470547 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f80e4043e50 con 0x7f80f4109140 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.772+0000 7f80fb363700 1 -- 172.21.15.135:0/1952470547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f80f419fd20 con 0x7f80f4109140 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.774+0000 7f80f27fc700 1 -- 172.21.15.135:0/1952470547 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f80e4032030 con 0x7f80f4109140 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.774+0000 7f80fb363700 1 -- 172.21.15.135:0/1952470547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80f4109140 msgr2=0x7f80f419c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.774+0000 7f80fb363700 1 --2- 172.21.15.135:0/1952470547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80f4109140 0x7f80f419c690 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f80e4011b60 tx=0x7f80e4011c40 comp rx=0 tx=0).stop 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.774+0000 7f80fb363700 1 -- 172.21.15.135:0/1952470547 shutdown_connections 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.774+0000 7f80fb363700 1 --2- 172.21.15.135:0/1952470547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80f4109140 0x7f80f419c690 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.774+0000 7f80fb363700 1 -- 172.21.15.135:0/1952470547 >> 172.21.15.135:0/1952470547 conn(0x7f80f4102b50 msgr2=0x7f80f4103720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.774+0000 7f80fb363700 1 -- 172.21.15.135:0/1952470547 shutdown_connections 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:48.774+0000 7f80fb363700 1 -- 172.21.15.135:0/1952470547 wait complete. 2024-04-20T12:12:49.321 INFO:teuthology.orchestra.run.smithi135.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-20T12:12:49.336 INFO:teuthology.orchestra.run.smithi135.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-20T12:12:49.336 INFO:teuthology.orchestra.run.smithi135.stdout:Creating mgr... 2024-04-20T12:12:49.337 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying port 0.0.0.0:9283 ... 2024-04-20T12:12:49.337 INFO:teuthology.orchestra.run.smithi135.stdout:Verifying port 0.0.0.0:8765 ... 2024-04-20T12:12:49.581 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.x 2024-04-20T12:12:49.581 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Failed to reset failed state of unit ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.x.service: Unit ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.x.service not loaded. 2024-04-20T12:12:49.726 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-22180be8-ff0f-11ee-bc92-c7b262605968.target.wants/ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-22180be8-ff0f-11ee-bc92-c7b262605968@.service. 2024-04-20T12:12:49.748 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:49 smithi135 systemd[1]: Starting Ceph mgr.x for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:12:50.070 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:49 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1952470547' entity='client.admin' 2024-04-20T12:12:50.070 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:49 smithi135 podman[18477]: 2024-04-20 12:12:49.867963452 +0000 UTC m=+0.017838191 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T12:12:50.070 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:49 smithi135 podman[18477]: 2024-04-20 12:12:49.965707399 +0000 UTC m=+0.115582137 container create 9b7af0bd19de78b6b0c119cd0666f45add2bc17392aaf783d979e6fc9464dbda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:12:50.291 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-20T12:12:50.291 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout disabled 2024-04-20T12:12:50.298 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-20T12:12:50.298 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-04-20T12:12:50.298 INFO:teuthology.orchestra.run.smithi135.stdout:firewalld.service is not enabled 2024-04-20T12:12:50.298 INFO:teuthology.orchestra.run.smithi135.stdout:Not possible to enable service . firewalld.service is not available 2024-04-20T12:12:50.306 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-20T12:12:50.306 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout disabled 2024-04-20T12:12:50.313 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-20T12:12:50.314 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-04-20T12:12:50.314 INFO:teuthology.orchestra.run.smithi135.stdout:firewalld.service is not enabled 2024-04-20T12:12:50.314 INFO:teuthology.orchestra.run.smithi135.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-04-20T12:12:50.314 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mgr to start... 2024-04-20T12:12:50.314 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mgr... 2024-04-20T12:12:50.360 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:50 smithi135 podman[18477]: 2024-04-20 12:12:50.203628633 +0000 UTC m=+0.353503372 container init 9b7af0bd19de78b6b0c119cd0666f45add2bc17392aaf783d979e6fc9464dbda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2) 2024-04-20T12:12:50.360 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:50 smithi135 podman[18477]: 2024-04-20 12:12:50.206143477 +0000 UTC m=+0.356018227 container start 9b7af0bd19de78b6b0c119cd0666f45add2bc17392aaf783d979e6fc9464dbda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416) 2024-04-20T12:12:50.360 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:50 smithi135 bash[18477]: 9b7af0bd19de78b6b0c119cd0666f45add2bc17392aaf783d979e6fc9464dbda 2024-04-20T12:12:50.360 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:50 smithi135 systemd[1]: Started Ceph mgr.x for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:12:50.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:50 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:50.359+0000 7ffb05f26200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-20T12:12:50.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:50 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:50.548+0000 7ffb05f26200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:12:50.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:50 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/74341445' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-20T12:12:50.981 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:50 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:50.655+0000 7ffb05f26200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-20T12:12:50.982 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:50 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:50.980+0000 7ffb05f26200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-20T12:12:51.363 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:51 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:51.067+0000 7ffb05f26200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-20T12:12:51.498 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-04-20T12:12:51.498 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-04-20T12:12:51.498 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsid": "22180be8-ff0f-11ee-bc92-c7b262605968", 2024-04-20T12:12:51.498 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "health": { 2024-04-20T12:12:51.498 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-20T12:12:51.498 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-20T12:12:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-20T12:12:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-20T12:12:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-20T12:12:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 0 2024-04-20T12:12:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-04-20T12:12:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-20T12:12:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "a" 2024-04-20T12:12:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-04-20T12:12:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-04-20T12:12:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-20T12:12:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:12:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-20T12:12:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-20T12:12:51.499 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:51.500 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-20T12:12:51.500 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:12:51.500 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-20T12:12:51.500 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-20T12:12:51.500 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-20T12:12:51.500 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-20T12:12:51.500 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-20T12:12:51.500 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-20T12:12:51.500 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:51.500 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-20T12:12:51.500 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-20T12:12:51.501 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-20T12:12:51.501 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-20T12:12:51.501 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-20T12:12:51.501 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-20T12:12:51.501 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-20T12:12:51.501 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-20T12:12:51.501 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-20T12:12:51.503 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:51.503 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-20T12:12:51.503 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:12:51.503 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-20T12:12:51.503 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-20T12:12:51.503 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:51.504 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-20T12:12:51.504 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-20T12:12:51.504 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-20T12:12:51.504 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-20T12:12:51.504 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-20T12:12:51.504 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-20T12:12:51.504 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "restful" 2024-04-20T12:12:51.504 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-04-20T12:12:51.504 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T12:12:51.504 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:51.504 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-20T12:12:51.504 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:12:51.504 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modified": "2024-04-20T12:12:43.366771+0000", 2024-04-20T12:12:51.504 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T12:12:51.505 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:51.505 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-20T12:12:51.505 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-04-20T12:12:51.505 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.764+0000 7f80c0aa6700 1 Processor -- start 2024-04-20T12:12:51.505 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.764+0000 7f80c0aa6700 1 -- start start 2024-04-20T12:12:51.505 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.764+0000 7f80c0aa6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80bc106980 0x7f80bc106da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:12:51.505 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.764+0000 7f80c0aa6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc107370 con 0x7f80bc106980 2024-04-20T12:12:51.505 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.764+0000 7f80ba59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80bc106980 0x7f80bc106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:12:51.505 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.764+0000 7f80ba59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80bc106980 0x7f80bc106da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39906/0 (socket says 172.21.15.135:39906) 2024-04-20T12:12:51.505 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.765+0000 7f80ba59c700 1 -- 172.21.15.135:0/1119217660 learned_addr learned my addr 172.21.15.135:0/1119217660 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:12:51.505 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.765+0000 7f80ba59c700 1 -- 172.21.15.135:0/1119217660 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc109910 con 0x7f80bc106980 2024-04-20T12:12:51.505 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.765+0000 7f80ba59c700 1 --2- 172.21.15.135:0/1119217660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80bc106980 0x7f80bc106da0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0098a0 tx=0x7f80ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c8d4567eb8fabe server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:12:51.505 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.765+0000 7f80b959a700 1 -- 172.21.15.135:0/1119217660 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80ac004160 con 0x7f80bc106980 2024-04-20T12:12:51.505 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.765+0000 7f80b959a700 1 -- 172.21.15.135:0/1119217660 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f80ac004300 con 0x7f80bc106980 2024-04-20T12:12:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.765+0000 7f80b959a700 1 -- 172.21.15.135:0/1119217660 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80ac011b50 con 0x7f80bc106980 2024-04-20T12:12:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.766+0000 7f80c0aa6700 1 -- 172.21.15.135:0/1119217660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80bc106980 msgr2=0x7f80bc106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:12:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.766+0000 7f80c0aa6700 1 --2- 172.21.15.135:0/1119217660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80bc106980 0x7f80bc106da0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0098a0 tx=0x7f80ac009bb0 comp rx=0 tx=0).stop 2024-04-20T12:12:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.766+0000 7f80c0aa6700 1 -- 172.21.15.135:0/1119217660 shutdown_connections 2024-04-20T12:12:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.766+0000 7f80c0aa6700 1 --2- 172.21.15.135:0/1119217660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80bc106980 0x7f80bc106da0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:12:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.766+0000 7f80c0aa6700 1 -- 172.21.15.135:0/1119217660 >> 172.21.15.135:0/1119217660 conn(0x7f80bc102310 msgr2=0x7f80bc104730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:12:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.766+0000 7f80c0aa6700 1 -- 172.21.15.135:0/1119217660 shutdown_connections 2024-04-20T12:12:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.766+0000 7f80c0aa6700 1 -- 172.21.15.135:0/1119217660 wait complete. 2024-04-20T12:12:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.767+0000 7f80c0aa6700 1 Processor -- start 2024-04-20T12:12:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.767+0000 7f80c0aa6700 1 -- start start 2024-04-20T12:12:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.767+0000 7f80c0aa6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80bc106980 0x7f80bc19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:12:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.767+0000 7f80c0aa6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc10ccc0 con 0x7f80bc106980 2024-04-20T12:12:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.767+0000 7f80ba59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80bc106980 0x7f80bc19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:12:51.506 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.767+0000 7f80ba59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80bc106980 0x7f80bc19c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39914/0 (socket says 172.21.15.135:39914) 2024-04-20T12:12:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.767+0000 7f80ba59c700 1 -- 172.21.15.135:0/74341445 learned_addr learned my addr 172.21.15.135:0/74341445 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:12:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.767+0000 7f80ba59c700 1 -- 172.21.15.135:0/74341445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc19cbe0 con 0x7f80bc106980 2024-04-20T12:12:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.767+0000 7f80ba59c700 1 --2- 172.21.15.135:0/74341445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80bc106980 0x7f80bc19c6a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f80ac011850 tx=0x7f80ac011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:12:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.768+0000 7f80ab7fe700 1 -- 172.21.15.135:0/74341445 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80ac003af0 con 0x7f80bc106980 2024-04-20T12:12:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.768+0000 7f80ab7fe700 1 -- 172.21.15.135:0/74341445 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f80ac020070 con 0x7f80bc106980 2024-04-20T12:12:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.768+0000 7f80c0aa6700 1 -- 172.21.15.135:0/74341445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80bc19ce70 con 0x7f80bc106980 2024-04-20T12:12:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.768+0000 7f80ab7fe700 1 -- 172.21.15.135:0/74341445 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80ac0195a0 con 0x7f80bc106980 2024-04-20T12:12:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.768+0000 7f80c0aa6700 1 -- 172.21.15.135:0/74341445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80bc19fb60 con 0x7f80bc106980 2024-04-20T12:12:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.768+0000 7f80ab7fe700 1 -- 172.21.15.135:0/74341445 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f80ac019be0 con 0x7f80bc106980 2024-04-20T12:12:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.768+0000 7f80ab7fe700 1 -- 172.21.15.135:0/74341445 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f80ac011e00 con 0x7f80bc106980 2024-04-20T12:12:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.769+0000 7f80c0aa6700 1 -- 172.21.15.135:0/74341445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80bc0640b0 con 0x7f80bc106980 2024-04-20T12:12:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.771+0000 7f80ab7fe700 1 -- 172.21.15.135:0/74341445 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f80ac003c90 con 0x7f80bc106980 2024-04-20T12:12:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.843+0000 7f80c0aa6700 1 -- 172.21.15.135:0/74341445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f80bc19fd30 con 0x7f80bc106980 2024-04-20T12:12:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.843+0000 7f80ab7fe700 1 -- 172.21.15.135:0/74341445 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f80ac025460 con 0x7f80bc106980 2024-04-20T12:12:51.507 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.844+0000 7f80c0aa6700 1 -- 172.21.15.135:0/74341445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80bc106980 msgr2=0x7f80bc19c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:12:51.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.844+0000 7f80c0aa6700 1 --2- 172.21.15.135:0/74341445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80bc106980 0x7f80bc19c6a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f80ac011850 tx=0x7f80ac011c10 comp rx=0 tx=0).stop 2024-04-20T12:12:51.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.844+0000 7f80c0aa6700 1 -- 172.21.15.135:0/74341445 shutdown_connections 2024-04-20T12:12:51.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.844+0000 7f80c0aa6700 1 --2- 172.21.15.135:0/74341445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80bc106980 0x7f80bc19c6a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:12:51.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.844+0000 7f80c0aa6700 1 -- 172.21.15.135:0/74341445 >> 172.21.15.135:0/74341445 conn(0x7f80bc102310 msgr2=0x7f80bc102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:12:51.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.844+0000 7f80c0aa6700 1 -- 172.21.15.135:0/74341445 shutdown_connections 2024-04-20T12:12:51.508 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:50.844+0000 7f80c0aa6700 1 -- 172.21.15.135:0/74341445 wait complete. 2024-04-20T12:12:51.508 INFO:teuthology.orchestra.run.smithi135.stdout:mgr not available, waiting (1/15)... 2024-04-20T12:12:52.456 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:52 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:52.286+0000 7ffb05f26200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-20T12:12:52.456 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:52 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:52.456+0000 7ffb05f26200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-20T12:12:52.863 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:52 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:52.627+0000 7ffb05f26200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-20T12:12:53.209 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:52 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:52.912+0000 7ffb05f26200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-20T12:12:53.209 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:53 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:53.004+0000 7ffb05f26200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-20T12:12:53.209 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:53 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:53.208+0000 7ffb05f26200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-20T12:12:53.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:53 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:53.401+0000 7ffb05f26200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:12:54.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:54 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/337882100' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-20T12:12:54.364 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:54 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:54.022+0000 7ffb05f26200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-20T12:12:54.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-04-20T12:12:54.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-04-20T12:12:54.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsid": "22180be8-ff0f-11ee-bc92-c7b262605968", 2024-04-20T12:12:54.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "health": { 2024-04-20T12:12:54.655 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-20T12:12:54.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-20T12:12:54.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-20T12:12:54.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:54.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-20T12:12:54.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-20T12:12:54.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 0 2024-04-20T12:12:54.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-04-20T12:12:54.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-20T12:12:54.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "a" 2024-04-20T12:12:54.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-04-20T12:12:54.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-04-20T12:12:54.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-20T12:12:54.656 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:12:54.657 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-20T12:12:54.657 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-20T12:12:54.657 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:54.657 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-20T12:12:54.657 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:12:54.657 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-20T12:12:54.657 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-20T12:12:54.657 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-20T12:12:54.665 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-20T12:12:54.665 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-20T12:12:54.665 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-20T12:12:54.665 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:54.665 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-20T12:12:54.665 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-20T12:12:54.665 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-20T12:12:54.665 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-20T12:12:54.665 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-20T12:12:54.665 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-20T12:12:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-20T12:12:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-20T12:12:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-20T12:12:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-20T12:12:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:12:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-20T12:12:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-20T12:12:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-20T12:12:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-20T12:12:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-20T12:12:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-20T12:12:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-20T12:12:54.666 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-20T12:12:54.667 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "restful" 2024-04-20T12:12:54.667 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-04-20T12:12:54.667 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T12:12:54.667 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:54.667 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-20T12:12:54.667 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:12:54.667 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modified": "2024-04-20T12:12:43.366771+0000", 2024-04-20T12:12:54.667 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T12:12:54.667 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:54.667 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-20T12:12:54.667 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-04-20T12:12:54.667 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.948+0000 7f20fc2f5700 1 Processor -- start 2024-04-20T12:12:54.667 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.948+0000 7f20fc2f5700 1 -- start start 2024-04-20T12:12:54.667 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.948+0000 7f20fc2f5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f4107ab0 0x7f20f4107ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:12:54.667 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.948+0000 7f20fc2f5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20f41084a0 con 0x7f20f4107ab0 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.948+0000 7f20fa091700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f4107ab0 0x7f20f4107ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.948+0000 7f20fa091700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f4107ab0 0x7f20f4107ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39926/0 (socket says 172.21.15.135:39926) 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.948+0000 7f20fa091700 1 -- 172.21.15.135:0/221543815 learned_addr learned my addr 172.21.15.135:0/221543815 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.948+0000 7f20fa091700 1 -- 172.21.15.135:0/221543815 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f41087d0 con 0x7f20f4107ab0 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.949+0000 7f20fa091700 1 --2- 172.21.15.135:0/221543815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f4107ab0 0x7f20f4107ed0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f20f00098a0 tx=0x7f20f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f409fde927d56ccf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.949+0000 7f20f908f700 1 -- 172.21.15.135:0/221543815 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0004160 con 0x7f20f4107ab0 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.949+0000 7f20f908f700 1 -- 172.21.15.135:0/221543815 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f20f0004300 con 0x7f20f4107ab0 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.949+0000 7f20f908f700 1 -- 172.21.15.135:0/221543815 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0011b50 con 0x7f20f4107ab0 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.950+0000 7f20fc2f5700 1 -- 172.21.15.135:0/221543815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f4107ab0 msgr2=0x7f20f4107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.950+0000 7f20fc2f5700 1 --2- 172.21.15.135:0/221543815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f4107ab0 0x7f20f4107ed0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f20f00098a0 tx=0x7f20f0009bb0 comp rx=0 tx=0).stop 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.950+0000 7f20fc2f5700 1 -- 172.21.15.135:0/221543815 shutdown_connections 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.950+0000 7f20fc2f5700 1 --2- 172.21.15.135:0/221543815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f4107ab0 0x7f20f4107ed0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.950+0000 7f20fc2f5700 1 -- 172.21.15.135:0/221543815 >> 172.21.15.135:0/221543815 conn(0x7f20f4102310 msgr2=0x7f20f4104730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.950+0000 7f20fc2f5700 1 -- 172.21.15.135:0/221543815 shutdown_connections 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.950+0000 7f20fc2f5700 1 -- 172.21.15.135:0/221543815 wait complete. 2024-04-20T12:12:54.668 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.950+0000 7f20fc2f5700 1 Processor -- start 2024-04-20T12:12:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.950+0000 7f20fc2f5700 1 -- start start 2024-04-20T12:12:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.951+0000 7f20fc2f5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f4107ab0 0x7f20f41926f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:12:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.951+0000 7f20fc2f5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20f410bb80 con 0x7f20f4107ab0 2024-04-20T12:12:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.951+0000 7f20fa091700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f4107ab0 0x7f20f41926f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:12:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.951+0000 7f20fa091700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f4107ab0 0x7f20f41926f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39930/0 (socket says 172.21.15.135:39930) 2024-04-20T12:12:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.951+0000 7f20fa091700 1 -- 172.21.15.135:0/337882100 learned_addr learned my addr 172.21.15.135:0/337882100 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:12:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.951+0000 7f20fa091700 1 -- 172.21.15.135:0/337882100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f4192c30 con 0x7f20f4107ab0 2024-04-20T12:12:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.951+0000 7f20fa091700 1 --2- 172.21.15.135:0/337882100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f4107ab0 0x7f20f41926f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20f0011b60 tx=0x7f20f0011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:12:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.951+0000 7f20eb7fe700 1 -- 172.21.15.135:0/337882100 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0003970 con 0x7f20f4107ab0 2024-04-20T12:12:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.951+0000 7f20eb7fe700 1 -- 172.21.15.135:0/337882100 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f20f0003b10 con 0x7f20f4107ab0 2024-04-20T12:12:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.951+0000 7f20fc2f5700 1 -- 172.21.15.135:0/337882100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f4190e70 con 0x7f20f4107ab0 2024-04-20T12:12:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.951+0000 7f20eb7fe700 1 -- 172.21.15.135:0/337882100 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0024610 con 0x7f20f4107ab0 2024-04-20T12:12:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.951+0000 7f20fc2f5700 1 -- 172.21.15.135:0/337882100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f4191350 con 0x7f20f4107ab0 2024-04-20T12:12:54.669 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.952+0000 7f20eb7fe700 1 -- 172.21.15.135:0/337882100 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f20f0024ca0 con 0x7f20f4107ab0 2024-04-20T12:12:54.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.952+0000 7f20eb7fe700 1 -- 172.21.15.135:0/337882100 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f20f0011e00 con 0x7f20f4107ab0 2024-04-20T12:12:54.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.952+0000 7f20fc2f5700 1 -- 172.21.15.135:0/337882100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f40640b0 con 0x7f20f4107ab0 2024-04-20T12:12:54.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:53.957+0000 7f20eb7fe700 1 -- 172.21.15.135:0/337882100 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f20f0043e50 con 0x7f20f4107ab0 2024-04-20T12:12:54.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:54.028+0000 7f20fc2f5700 1 -- 172.21.15.135:0/337882100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f20f4196330 con 0x7f20f4107ab0 2024-04-20T12:12:54.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:54.029+0000 7f20eb7fe700 1 -- 172.21.15.135:0/337882100 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f20f0032030 con 0x7f20f4107ab0 2024-04-20T12:12:54.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:54.030+0000 7f20fc2f5700 1 -- 172.21.15.135:0/337882100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f4107ab0 msgr2=0x7f20f41926f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:12:54.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:54.030+0000 7f20fc2f5700 1 --2- 172.21.15.135:0/337882100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f4107ab0 0x7f20f41926f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20f0011b60 tx=0x7f20f0011c40 comp rx=0 tx=0).stop 2024-04-20T12:12:54.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:54.030+0000 7f20fc2f5700 1 -- 172.21.15.135:0/337882100 shutdown_connections 2024-04-20T12:12:54.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:54.030+0000 7f20fc2f5700 1 --2- 172.21.15.135:0/337882100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20f4107ab0 0x7f20f41926f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:12:54.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:54.030+0000 7f20fc2f5700 1 -- 172.21.15.135:0/337882100 >> 172.21.15.135:0/337882100 conn(0x7f20f4102310 msgr2=0x7f20f41031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:12:54.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:54.030+0000 7f20fc2f5700 1 -- 172.21.15.135:0/337882100 shutdown_connections 2024-04-20T12:12:54.670 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:54.030+0000 7f20fc2f5700 1 -- 172.21.15.135:0/337882100 wait complete. 2024-04-20T12:12:54.670 INFO:teuthology.orchestra.run.smithi135.stdout:mgr not available, waiting (2/15)... 2024-04-20T12:12:54.760 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:54 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:54.458+0000 7ffb05f26200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-20T12:12:54.760 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:54 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:54.554+0000 7ffb05f26200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-20T12:12:54.760 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:54 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:54.760+0000 7ffb05f26200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-20T12:12:55.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:55 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:55.303+0000 7ffb05f26200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-20T12:12:55.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:55 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:55.394+0000 7ffb05f26200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-20T12:12:55.979 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:55 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:55.639+0000 7ffb05f26200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-20T12:12:55.979 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:55 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:55.769+0000 7ffb05f26200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-20T12:12:55.979 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:55 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:55.863+0000 7ffb05f26200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-20T12:12:55.979 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:55 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:55.979+0000 7ffb05f26200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-20T12:12:56.613 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:56 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:56.283+0000 7ffb05f26200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-20T12:12:57.077 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:56 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:56.898+0000 7ffb05f26200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-20T12:12:57.364 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:12:57 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:12:57.122+0000 7ffb05f26200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-20T12:12:57.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:57 smithi135 ceph-mon[18264]: Activating manager daemon x 2024-04-20T12:12:57.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:57 smithi135 ceph-mon[18264]: mgrmap e2: x(active, starting, since 0.0036298s) 2024-04-20T12:12:57.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:57 smithi135 ceph-mon[18264]: from='mgr.14100 172.21.15.135:0/4236105847' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T12:12:57.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:57 smithi135 ceph-mon[18264]: from='mgr.14100 172.21.15.135:0/4236105847' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T12:12:57.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:57 smithi135 ceph-mon[18264]: from='mgr.14100 172.21.15.135:0/4236105847' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T12:12:57.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:57 smithi135 ceph-mon[18264]: from='mgr.14100 172.21.15.135:0/4236105847' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:12:57.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:57 smithi135 ceph-mon[18264]: from='mgr.14100 172.21.15.135:0/4236105847' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-20T12:12:57.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:57 smithi135 ceph-mon[18264]: Manager daemon x is now available 2024-04-20T12:12:57.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:57 smithi135 ceph-mon[18264]: from='mgr.14100 172.21.15.135:0/4236105847' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-20T12:12:57.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:57 smithi135 ceph-mon[18264]: from='mgr.14100 172.21.15.135:0/4236105847' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-20T12:12:57.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:57 smithi135 ceph-mon[18264]: from='mgr.14100 172.21.15.135:0/4236105847' entity='mgr.x' 2024-04-20T12:12:57.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:57 smithi135 ceph-mon[18264]: from='mgr.14100 172.21.15.135:0/4236105847' entity='mgr.x' 2024-04-20T12:12:57.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:57 smithi135 ceph-mon[18264]: from='mgr.14100 172.21.15.135:0/4236105847' entity='mgr.x' 2024-04-20T12:12:57.744 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-04-20T12:12:57.744 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-04-20T12:12:57.744 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsid": "22180be8-ff0f-11ee-bc92-c7b262605968", 2024-04-20T12:12:57.744 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "health": { 2024-04-20T12:12:57.744 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-20T12:12:57.744 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-20T12:12:57.744 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-20T12:12:57.745 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:57.745 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-20T12:12:57.745 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-20T12:12:57.745 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 0 2024-04-20T12:12:57.745 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-04-20T12:12:57.745 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-20T12:12:57.745 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "a" 2024-04-20T12:12:57.745 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-04-20T12:12:57.745 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-04-20T12:12:57.745 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-20T12:12:57.745 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:12:57.745 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-20T12:12:57.745 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-20T12:12:57.745 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:57.745 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-20T12:12:57.746 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:12:57.746 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-20T12:12:57.746 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-20T12:12:57.746 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-20T12:12:57.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-20T12:12:57.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-20T12:12:57.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-20T12:12:57.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:57.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-20T12:12:57.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-20T12:12:57.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-20T12:12:57.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-20T12:12:57.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-20T12:12:57.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-20T12:12:57.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-20T12:12:57.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-20T12:12:57.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-20T12:12:57.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "restful" 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:57.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-20T12:12:57.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:12:57.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modified": "2024-04-20T12:12:43.366771+0000", 2024-04-20T12:12:57.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T12:12:57.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:12:57.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-20T12:12:57.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-04-20T12:12:57.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.100+0000 7fafdc0ab700 1 Processor -- start 2024-04-20T12:12:57.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.101+0000 7fafdc0ab700 1 -- start start 2024-04-20T12:12:57.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.101+0000 7fafdc0ab700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd4109100 0x7fafd410b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:12:57.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.101+0000 7fafdc0ab700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fafd407bed0 con 0x7fafd4109100 2024-04-20T12:12:57.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.101+0000 7fafd9e47700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd4109100 0x7fafd410b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:12:57.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.101+0000 7fafd9e47700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd4109100 0x7fafd410b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39942/0 (socket says 172.21.15.135:39942) 2024-04-20T12:12:57.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.101+0000 7fafd9e47700 1 -- 172.21.15.135:0/4197653241 learned_addr learned my addr 172.21.15.135:0/4197653241 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:12:57.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.101+0000 7fafd9e47700 1 -- 172.21.15.135:0/4197653241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd410ba30 con 0x7fafd4109100 2024-04-20T12:12:57.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.102+0000 7fafd9e47700 1 --2- 172.21.15.135:0/4197653241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd4109100 0x7fafd410b4f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fafd00098a0 tx=0x7fafd0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6d0a40afc70635 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.102+0000 7fafd8e45700 1 -- 172.21.15.135:0/4197653241 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafd0004160 con 0x7fafd4109100 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.102+0000 7fafd8e45700 1 -- 172.21.15.135:0/4197653241 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fafd0004300 con 0x7fafd4109100 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.102+0000 7fafd8e45700 1 -- 172.21.15.135:0/4197653241 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafd0011b50 con 0x7fafd4109100 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.102+0000 7fafdc0ab700 1 -- 172.21.15.135:0/4197653241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd4109100 msgr2=0x7fafd410b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.102+0000 7fafdc0ab700 1 --2- 172.21.15.135:0/4197653241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd4109100 0x7fafd410b4f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fafd00098a0 tx=0x7fafd0009bb0 comp rx=0 tx=0).stop 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.102+0000 7fafdc0ab700 1 -- 172.21.15.135:0/4197653241 shutdown_connections 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.102+0000 7fafdc0ab700 1 --2- 172.21.15.135:0/4197653241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd4109100 0x7fafd410b4f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.102+0000 7fafdc0ab700 1 -- 172.21.15.135:0/4197653241 >> 172.21.15.135:0/4197653241 conn(0x7fafd4102b70 msgr2=0x7fafd4104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.103+0000 7fafdc0ab700 1 -- 172.21.15.135:0/4197653241 shutdown_connections 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.103+0000 7fafdc0ab700 1 -- 172.21.15.135:0/4197653241 wait complete. 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.103+0000 7fafdc0ab700 1 Processor -- start 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.103+0000 7fafdc0ab700 1 -- start start 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.103+0000 7fafdc0ab700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd4109100 0x7fafd419c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.103+0000 7fafdc0ab700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fafd410ca60 con 0x7fafd4109100 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.103+0000 7fafd9e47700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd4109100 0x7fafd419c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:12:57.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.103+0000 7fafd9e47700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd4109100 0x7fafd419c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39946/0 (socket says 172.21.15.135:39946) 2024-04-20T12:12:57.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.103+0000 7fafd9e47700 1 -- 172.21.15.135:0/1157805729 learned_addr learned my addr 172.21.15.135:0/1157805729 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:12:57.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.104+0000 7fafd9e47700 1 -- 172.21.15.135:0/1157805729 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd419cba0 con 0x7fafd4109100 2024-04-20T12:12:57.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.104+0000 7fafd9e47700 1 --2- 172.21.15.135:0/1157805729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd4109100 0x7fafd419c660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009fb0 tx=0x7fafd0011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:12:57.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.104+0000 7fafcaffd700 1 -- 172.21.15.135:0/1157805729 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafd00038b0 con 0x7fafd4109100 2024-04-20T12:12:57.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.104+0000 7fafcaffd700 1 -- 172.21.15.135:0/1157805729 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fafd0011e50 con 0x7fafd4109100 2024-04-20T12:12:57.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.104+0000 7fafdc0ab700 1 -- 172.21.15.135:0/1157805729 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd419ce30 con 0x7fafd4109100 2024-04-20T12:12:57.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.104+0000 7fafcaffd700 1 -- 172.21.15.135:0/1157805729 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafd0019420 con 0x7fafd4109100 2024-04-20T12:12:57.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.104+0000 7fafdc0ab700 1 -- 172.21.15.135:0/1157805729 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd419fb20 con 0x7fafd4109100 2024-04-20T12:12:57.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.104+0000 7fafcaffd700 1 -- 172.21.15.135:0/1157805729 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fafd0019ac0 con 0x7fafd4109100 2024-04-20T12:12:57.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.104+0000 7fafcaffd700 1 -- 172.21.15.135:0/1157805729 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fafd0024730 con 0x7fafd4109100 2024-04-20T12:12:57.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.105+0000 7fafdc0ab700 1 -- 172.21.15.135:0/1157805729 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd40640b0 con 0x7fafd4109100 2024-04-20T12:12:57.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.107+0000 7fafcaffd700 1 -- 172.21.15.135:0/1157805729 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fafd0003a50 con 0x7fafd4109100 2024-04-20T12:12:57.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.125+0000 7fafcaffd700 1 -- 172.21.15.135:0/1157805729 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 2) ==== 46314+0+0 (secure 0 0 0) 0x7fafd00249d0 con 0x7fafd4109100 2024-04-20T12:12:57.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.187+0000 7fafdc0ab700 1 -- 172.21.15.135:0/1157805729 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fafd41a0010 con 0x7fafd4109100 2024-04-20T12:12:57.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.187+0000 7fafcaffd700 1 -- 172.21.15.135:0/1157805729 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fafd0020cb0 con 0x7fafd4109100 2024-04-20T12:12:57.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.188+0000 7fafdc0ab700 1 -- 172.21.15.135:0/1157805729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd4109100 msgr2=0x7fafd419c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:12:57.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.188+0000 7fafdc0ab700 1 --2- 172.21.15.135:0/1157805729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd4109100 0x7fafd419c660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fafd0009fb0 tx=0x7fafd0011bf0 comp rx=0 tx=0).stop 2024-04-20T12:12:57.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.188+0000 7fafdc0ab700 1 -- 172.21.15.135:0/1157805729 shutdown_connections 2024-04-20T12:12:57.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.188+0000 7fafdc0ab700 1 --2- 172.21.15.135:0/1157805729 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fafd4109100 0x7fafd419c660 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:12:57.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.188+0000 7fafdc0ab700 1 -- 172.21.15.135:0/1157805729 >> 172.21.15.135:0/1157805729 conn(0x7fafd4102b70 msgr2=0x7fafd41036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:12:57.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.188+0000 7fafdc0ab700 1 -- 172.21.15.135:0/1157805729 shutdown_connections 2024-04-20T12:12:57.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:12:57.188+0000 7fafdc0ab700 1 -- 172.21.15.135:0/1157805729 wait complete. 2024-04-20T12:12:57.759 INFO:teuthology.orchestra.run.smithi135.stdout:mgr not available, waiting (3/15)... 2024-04-20T12:12:58.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:58 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1157805729' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-20T12:12:58.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:12:58 smithi135 ceph-mon[18264]: mgrmap e3: x(active, since 1.00763s) 2024-04-20T12:13:00.438 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:00 smithi135 ceph-mon[18264]: mgrmap e4: x(active, since 2s) 2024-04-20T12:13:00.990 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-04-20T12:13:00.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-04-20T12:13:00.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsid": "22180be8-ff0f-11ee-bc92-c7b262605968", 2024-04-20T12:13:00.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "health": { 2024-04-20T12:13:00.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-20T12:13:00.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-20T12:13:00.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-20T12:13:00.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:13:00.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-20T12:13:00.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-20T12:13:00.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 0 2024-04-20T12:13:00.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-04-20T12:13:00.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-20T12:13:00.991 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "a" 2024-04-20T12:13:00.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-04-20T12:13:00.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-04-20T12:13:00.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-20T12:13:00.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:13:00.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-04-20T12:13:00.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-20T12:13:00.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:13:00.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-20T12:13:00.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:13:00.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-20T12:13:00.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-20T12:13:00.992 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-20T12:13:01.000 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-20T12:13:01.000 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-20T12:13:01.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-20T12:13:01.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:13:01.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-20T12:13:01.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-20T12:13:01.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-20T12:13:01.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-20T12:13:01.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-20T12:13:01.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-20T12:13:01.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-20T12:13:01.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-20T12:13:01.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-20T12:13:01.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:13:01.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-20T12:13:01.001 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:13:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-20T12:13:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-20T12:13:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:13:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-20T12:13:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-20T12:13:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-20T12:13:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-20T12:13:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-20T12:13:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-20T12:13:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "restful" 2024-04-20T12:13:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ], 2024-04-20T12:13:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T12:13:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:13:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-20T12:13:01.002 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-20T12:13:01.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "modified": "2024-04-20T12:12:43.366771+0000", 2024-04-20T12:13:01.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-20T12:13:01.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout }, 2024-04-20T12:13:01.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-20T12:13:01.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-04-20T12:13:01.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.150+0000 7f7c92b9d700 1 Processor -- start 2024-04-20T12:13:01.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.150+0000 7f7c92b9d700 1 -- start start 2024-04-20T12:13:01.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.150+0000 7f7c92b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8c107590 0x7f7c8c1079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:01.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.150+0000 7f7c92b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c107f80 con 0x7f7c8c107590 2024-04-20T12:13:01.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.151+0000 7f7c90939700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8c107590 0x7f7c8c1079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:01.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.151+0000 7f7c90939700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8c107590 0x7f7c8c1079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40008/0 (socket says 172.21.15.135:40008) 2024-04-20T12:13:01.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.151+0000 7f7c90939700 1 -- 172.21.15.135:0/3775029770 learned_addr learned my addr 172.21.15.135:0/3775029770 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:01.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.151+0000 7f7c90939700 1 -- 172.21.15.135:0/3775029770 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8c108790 con 0x7f7c8c107590 2024-04-20T12:13:01.003 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.151+0000 7f7c90939700 1 --2- 172.21.15.135:0/3775029770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8c107590 0x7f7c8c1079b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009e80 tx=0x7f7c8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b156c35aac9a15 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:01.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.151+0000 7f7c8b7fe700 1 -- 172.21.15.135:0/3775029770 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c84017070 con 0x7f7c8c107590 2024-04-20T12:13:01.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.151+0000 7f7c8b7fe700 1 -- 172.21.15.135:0/3775029770 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c8400b8c0 con 0x7f7c8c107590 2024-04-20T12:13:01.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.151+0000 7f7c8b7fe700 1 -- 172.21.15.135:0/3775029770 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c840045c0 con 0x7f7c8c107590 2024-04-20T12:13:01.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.152+0000 7f7c92b9d700 1 -- 172.21.15.135:0/3775029770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8c107590 msgr2=0x7f7c8c1079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:01.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.152+0000 7f7c92b9d700 1 --2- 172.21.15.135:0/3775029770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8c107590 0x7f7c8c1079b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009e80 tx=0x7f7c8400b330 comp rx=0 tx=0).stop 2024-04-20T12:13:01.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.152+0000 7f7c92b9d700 1 -- 172.21.15.135:0/3775029770 shutdown_connections 2024-04-20T12:13:01.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.152+0000 7f7c92b9d700 1 --2- 172.21.15.135:0/3775029770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8c107590 0x7f7c8c1079b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:01.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.152+0000 7f7c92b9d700 1 -- 172.21.15.135:0/3775029770 >> 172.21.15.135:0/3775029770 conn(0x7f7c8c102b70 msgr2=0x7f7c8c104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:01.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.152+0000 7f7c92b9d700 1 -- 172.21.15.135:0/3775029770 shutdown_connections 2024-04-20T12:13:01.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.152+0000 7f7c92b9d700 1 -- 172.21.15.135:0/3775029770 wait complete. 2024-04-20T12:13:01.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.152+0000 7f7c92b9d700 1 Processor -- start 2024-04-20T12:13:01.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.152+0000 7f7c92b9d700 1 -- start start 2024-04-20T12:13:01.004 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.153+0000 7f7c92b9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8c107590 0x7f7c8c192740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.153+0000 7f7c92b9d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c10bb40 con 0x7f7c8c107590 2024-04-20T12:13:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.153+0000 7f7c90939700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8c107590 0x7f7c8c192740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.153+0000 7f7c90939700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8c107590 0x7f7c8c192740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40016/0 (socket says 172.21.15.135:40016) 2024-04-20T12:13:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.153+0000 7f7c90939700 1 -- 172.21.15.135:0/2888437741 learned_addr learned my addr 172.21.15.135:0/2888437741 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.153+0000 7f7c90939700 1 -- 172.21.15.135:0/2888437741 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8c192c80 con 0x7f7c8c107590 2024-04-20T12:13:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.153+0000 7f7c90939700 1 --2- 172.21.15.135:0/2888437741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8c107590 0x7f7c8c192740 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009e50 tx=0x7f7c8400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.153+0000 7f7c89ffb700 1 -- 172.21.15.135:0/2888437741 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c84020020 con 0x7f7c8c107590 2024-04-20T12:13:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.153+0000 7f7c89ffb700 1 -- 172.21.15.135:0/2888437741 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c84003b50 con 0x7f7c8c107590 2024-04-20T12:13:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.153+0000 7f7c92b9d700 1 -- 172.21.15.135:0/2888437741 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c8c190e70 con 0x7f7c8c107590 2024-04-20T12:13:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.153+0000 7f7c89ffb700 1 -- 172.21.15.135:0/2888437741 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c84017040 con 0x7f7c8c107590 2024-04-20T12:13:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.153+0000 7f7c92b9d700 1 -- 172.21.15.135:0/2888437741 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c8c1913b0 con 0x7f7c8c107590 2024-04-20T12:13:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.154+0000 7f7c89ffb700 1 -- 172.21.15.135:0/2888437741 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f7c84023020 con 0x7f7c8c107590 2024-04-20T12:13:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.154+0000 7f7c89ffb700 1 --2- 172.21.15.135:0/2888437741 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f7c78039510 0x7f7c7803b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.154+0000 7f7c89ffb700 1 -- 172.21.15.135:0/2888437741 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7c8400f050 con 0x7f7c8c107590 2024-04-20T12:13:01.006 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.154+0000 7f7c8bfff700 1 --2- 172.21.15.135:0/2888437741 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f7c78039510 0x7f7c7803b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:01.006 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.154+0000 7f7c92b9d700 1 -- 172.21.15.135:0/2888437741 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c8c0640b0 con 0x7f7c8c107590 2024-04-20T12:13:01.006 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.155+0000 7f7c8bfff700 1 --2- 172.21.15.135:0/2888437741 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f7c78039510 0x7f7c7803b9d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7c74006fd0 tx=0x7f7c74006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:01.006 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.160+0000 7f7c89ffb700 1 -- 172.21.15.135:0/2888437741 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f7c8402a020 con 0x7f7c8c107590 2024-04-20T12:13:01.006 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.438+0000 7f7c92b9d700 1 -- 172.21.15.135:0/2888437741 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f7c8c196490 con 0x7f7c8c107590 2024-04-20T12:13:01.006 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.438+0000 7f7c89ffb700 1 -- 172.21.15.135:0/2888437741 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f7c8401b730 con 0x7f7c8c107590 2024-04-20T12:13:01.006 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.440+0000 7f7c92b9d700 1 -- 172.21.15.135:0/2888437741 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f7c78039510 msgr2=0x7f7c7803b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:01.006 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.440+0000 7f7c92b9d700 1 --2- 172.21.15.135:0/2888437741 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f7c78039510 0x7f7c7803b9d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7c74006fd0 tx=0x7f7c74006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:01.006 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.440+0000 7f7c92b9d700 1 -- 172.21.15.135:0/2888437741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8c107590 msgr2=0x7f7c8c192740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:01.006 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.440+0000 7f7c92b9d700 1 --2- 172.21.15.135:0/2888437741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8c107590 0x7f7c8c192740 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009e50 tx=0x7f7c8400bd30 comp rx=0 tx=0).stop 2024-04-20T12:13:01.006 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.440+0000 7f7c92b9d700 1 -- 172.21.15.135:0/2888437741 shutdown_connections 2024-04-20T12:13:01.006 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.440+0000 7f7c92b9d700 1 --2- 172.21.15.135:0/2888437741 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f7c78039510 0x7f7c7803b9d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:01.006 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.440+0000 7f7c92b9d700 1 --2- 172.21.15.135:0/2888437741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c8c107590 0x7f7c8c192740 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:01.007 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.440+0000 7f7c92b9d700 1 -- 172.21.15.135:0/2888437741 >> 172.21.15.135:0/2888437741 conn(0x7f7c8c102b70 msgr2=0x7f7c8c103a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:01.007 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.441+0000 7f7c92b9d700 1 -- 172.21.15.135:0/2888437741 shutdown_connections 2024-04-20T12:13:01.007 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:00.441+0000 7f7c92b9d700 1 -- 172.21.15.135:0/2888437741 wait complete. 2024-04-20T12:13:01.007 INFO:teuthology.orchestra.run.smithi135.stdout:mgr is available 2024-04-20T12:13:01.574 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:01 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2888437741' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-20T12:13:02.120 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-04-20T12:13:02.120 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [global] 2024-04-20T12:13:02.120 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout fsid = 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:13:02.120 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-20T12:13:02.120 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-20T12:13:02.120 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-20T12:13:02.120 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-20T12:13:02.120 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-04-20T12:13:02.120 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-20T12:13:02.120 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-20T12:13:02.120 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 2024-04-20T12:13:02.120 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout [osd] 2024-04-20T12:13:02.120 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-20T12:13:02.120 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-20T12:13:02.121 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-20T12:13:02.121 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-20T12:13:02.121 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-20T12:13:02.121 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.371+0000 7f3caddfe700 1 Processor -- start 2024-04-20T12:13:02.121 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.371+0000 7f3caddfe700 1 -- start start 2024-04-20T12:13:02.121 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.371+0000 7f3caddfe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca8106960 0x7f3ca8106d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:02.121 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.371+0000 7f3caddfe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca8107350 con 0x7f3ca8106960 2024-04-20T12:13:02.121 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.372+0000 7f3ca77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca8106960 0x7f3ca8106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:02.121 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.372+0000 7f3ca77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca8106960 0x7f3ca8106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54240/0 (socket says 172.21.15.135:54240) 2024-04-20T12:13:02.121 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.372+0000 7f3ca77fe700 1 -- 172.21.15.135:0/3280286724 learned_addr learned my addr 172.21.15.135:0/3280286724 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:02.121 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.372+0000 7f3ca77fe700 1 -- 172.21.15.135:0/3280286724 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca8109940 con 0x7f3ca8106960 2024-04-20T12:13:02.121 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.372+0000 7f3ca77fe700 1 --2- 172.21.15.135:0/3280286724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca8106960 0x7f3ca8106d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3c980098a0 tx=0x7f3c98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfa2ab0ba2c6cb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:02.121 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.372+0000 7f3ca67fc700 1 -- 172.21.15.135:0/3280286724 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c98004160 con 0x7f3ca8106960 2024-04-20T12:13:02.121 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.372+0000 7f3ca67fc700 1 -- 172.21.15.135:0/3280286724 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c98004300 con 0x7f3ca8106960 2024-04-20T12:13:02.121 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.372+0000 7f3ca67fc700 1 -- 172.21.15.135:0/3280286724 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c98011b50 con 0x7f3ca8106960 2024-04-20T12:13:02.122 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.373+0000 7f3caddfe700 1 -- 172.21.15.135:0/3280286724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca8106960 msgr2=0x7f3ca8106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:02.122 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.373+0000 7f3caddfe700 1 --2- 172.21.15.135:0/3280286724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca8106960 0x7f3ca8106d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3c980098a0 tx=0x7f3c98009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:02.122 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.373+0000 7f3caddfe700 1 -- 172.21.15.135:0/3280286724 shutdown_connections 2024-04-20T12:13:02.122 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.373+0000 7f3caddfe700 1 --2- 172.21.15.135:0/3280286724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca8106960 0x7f3ca8106d80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:02.122 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.373+0000 7f3caddfe700 1 -- 172.21.15.135:0/3280286724 >> 172.21.15.135:0/3280286724 conn(0x7f3ca81022e0 msgr2=0x7f3ca8104700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:02.122 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.373+0000 7f3caddfe700 1 -- 172.21.15.135:0/3280286724 shutdown_connections 2024-04-20T12:13:02.122 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.373+0000 7f3caddfe700 1 -- 172.21.15.135:0/3280286724 wait complete. 2024-04-20T12:13:02.122 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.374+0000 7f3caddfe700 1 Processor -- start 2024-04-20T12:13:02.122 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.374+0000 7f3caddfe700 1 -- start start 2024-04-20T12:13:02.122 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.374+0000 7f3caddfe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca8106960 0x7f3ca819c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:02.122 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.374+0000 7f3caddfe700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca810ccf0 con 0x7f3ca8106960 2024-04-20T12:13:02.122 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.374+0000 7f3ca77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca8106960 0x7f3ca819c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:02.122 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.374+0000 7f3ca77fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca8106960 0x7f3ca819c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54248/0 (socket says 172.21.15.135:54248) 2024-04-20T12:13:02.122 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.374+0000 7f3ca77fe700 1 -- 172.21.15.135:0/4059656528 learned_addr learned my addr 172.21.15.135:0/4059656528 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:02.122 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.374+0000 7f3ca77fe700 1 -- 172.21.15.135:0/4059656528 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca819cc30 con 0x7f3ca8106960 2024-04-20T12:13:02.123 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.374+0000 7f3ca77fe700 1 --2- 172.21.15.135:0/4059656528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca8106960 0x7f3ca819c6f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3c98011850 tx=0x7f3c98011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:02.123 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.375+0000 7f3ca4ff9700 1 -- 172.21.15.135:0/4059656528 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c98003af0 con 0x7f3ca8106960 2024-04-20T12:13:02.123 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.375+0000 7f3ca4ff9700 1 -- 172.21.15.135:0/4059656528 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3c98020070 con 0x7f3ca8106960 2024-04-20T12:13:02.123 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.375+0000 7f3caddfe700 1 -- 172.21.15.135:0/4059656528 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca819cec0 con 0x7f3ca8106960 2024-04-20T12:13:02.123 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.375+0000 7f3ca4ff9700 1 -- 172.21.15.135:0/4059656528 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c980195a0 con 0x7f3ca8106960 2024-04-20T12:13:02.123 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.375+0000 7f3caddfe700 1 -- 172.21.15.135:0/4059656528 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca819fbb0 con 0x7f3ca8106960 2024-04-20T12:13:02.123 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.376+0000 7f3ca4ff9700 1 -- 172.21.15.135:0/4059656528 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7f3c980198a0 con 0x7f3ca8106960 2024-04-20T12:13:02.123 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.376+0000 7f3caddfe700 1 -- 172.21.15.135:0/4059656528 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca80640b0 con 0x7f3ca8106960 2024-04-20T12:13:02.123 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.376+0000 7f3ca4ff9700 1 --2- 172.21.15.135:0/4059656528 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f3c90039560 0x7f3c9003ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:02.123 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.376+0000 7f3ca4ff9700 1 -- 172.21.15.135:0/4059656528 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3c98011e00 con 0x7f3ca8106960 2024-04-20T12:13:02.123 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.376+0000 7f3ca6ffd700 1 --2- 172.21.15.135:0/4059656528 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f3c90039560 0x7f3c9003ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:02.123 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.376+0000 7f3ca6ffd700 1 --2- 172.21.15.135:0/4059656528 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f3c90039560 0x7f3c9003ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c006fd0 tx=0x7f3c9c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:02.124 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.381+0000 7f3ca4ff9700 1 -- 172.21.15.135:0/4059656528 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f3c98003c90 con 0x7f3ca8106960 2024-04-20T12:13:02.124 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.574+0000 7f3caddfe700 1 -- 172.21.15.135:0/4059656528 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f3ca81a12c0 con 0x7f3ca8106960 2024-04-20T12:13:02.124 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.575+0000 7f3ca4ff9700 1 -- 172.21.15.135:0/4059656528 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+373 (secure 0 0 0) 0x7f3c98023530 con 0x7f3ca8106960 2024-04-20T12:13:02.124 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.578+0000 7f3caddfe700 1 -- 172.21.15.135:0/4059656528 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f3c90039560 msgr2=0x7f3c9003ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:02.124 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.578+0000 7f3caddfe700 1 --2- 172.21.15.135:0/4059656528 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f3c90039560 0x7f3c9003ba20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c006fd0 tx=0x7f3c9c006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:02.124 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.578+0000 7f3caddfe700 1 -- 172.21.15.135:0/4059656528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca8106960 msgr2=0x7f3ca819c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:02.124 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.578+0000 7f3caddfe700 1 --2- 172.21.15.135:0/4059656528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca8106960 0x7f3ca819c6f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3c98011850 tx=0x7f3c98011c10 comp rx=0 tx=0).stop 2024-04-20T12:13:02.124 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.578+0000 7f3caddfe700 1 -- 172.21.15.135:0/4059656528 shutdown_connections 2024-04-20T12:13:02.124 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.578+0000 7f3caddfe700 1 --2- 172.21.15.135:0/4059656528 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f3c90039560 0x7f3c9003ba20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:02.124 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.578+0000 7f3caddfe700 1 --2- 172.21.15.135:0/4059656528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3ca8106960 0x7f3ca819c6f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:02.124 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.578+0000 7f3caddfe700 1 -- 172.21.15.135:0/4059656528 >> 172.21.15.135:0/4059656528 conn(0x7f3ca81022e0 msgr2=0x7f3ca8102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:02.124 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.578+0000 7f3caddfe700 1 -- 172.21.15.135:0/4059656528 shutdown_connections 2024-04-20T12:13:02.124 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:01.578+0000 7f3caddfe700 1 -- 172.21.15.135:0/4059656528 wait complete. 2024-04-20T12:13:02.124 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling cephadm module... 2024-04-20T12:13:02.440 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:02 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/4059656528' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-20T12:13:03.467 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:03 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2361507188' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-20T12:13:03.468 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:03 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: ignoring --setuser ceph since I am not root 2024-04-20T12:13:03.468 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:03 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: ignoring --setgroup ceph since I am not root 2024-04-20T12:13:03.468 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:03 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:03.350+0000 7f4ee4917200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-20T12:13:03.744 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:03 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:03.535+0000 7f4ee4917200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:13:03.745 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:03 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:03.637+0000 7f4ee4917200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-20T12:13:03.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.540+0000 7fad780c8700 1 Processor -- start 2024-04-20T12:13:03.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.540+0000 7fad780c8700 1 -- start start 2024-04-20T12:13:03.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.540+0000 7fad780c8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad70106f70 0x7fad70107390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:03.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.540+0000 7fad780c8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad7007be50 con 0x7fad70106f70 2024-04-20T12:13:03.752 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.540+0000 7fad75e64700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad70106f70 0x7fad70107390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.540+0000 7fad75e64700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad70106f70 0x7fad70107390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54254/0 (socket says 172.21.15.135:54254) 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.540+0000 7fad75e64700 1 -- 172.21.15.135:0/605929113 learned_addr learned my addr 172.21.15.135:0/605929113 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.541+0000 7fad75e64700 1 -- 172.21.15.135:0/605929113 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad701078d0 con 0x7fad70106f70 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.541+0000 7fad75e64700 1 --2- 172.21.15.135:0/605929113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad70106f70 0x7fad70107390 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0098a0 tx=0x7fad6c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e8f0d0e69481c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.541+0000 7fad74e62700 1 -- 172.21.15.135:0/605929113 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad6c004160 con 0x7fad70106f70 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.541+0000 7fad74e62700 1 -- 172.21.15.135:0/605929113 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad6c004300 con 0x7fad70106f70 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.541+0000 7fad74e62700 1 -- 172.21.15.135:0/605929113 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad6c011b50 con 0x7fad70106f70 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.541+0000 7fad780c8700 1 -- 172.21.15.135:0/605929113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad70106f70 msgr2=0x7fad70107390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.541+0000 7fad780c8700 1 --2- 172.21.15.135:0/605929113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad70106f70 0x7fad70107390 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0098a0 tx=0x7fad6c009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.541+0000 7fad780c8700 1 -- 172.21.15.135:0/605929113 shutdown_connections 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.541+0000 7fad780c8700 1 --2- 172.21.15.135:0/605929113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad70106f70 0x7fad70107390 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.542+0000 7fad780c8700 1 -- 172.21.15.135:0/605929113 >> 172.21.15.135:0/605929113 conn(0x7fad70102bb0 msgr2=0x7fad70104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.542+0000 7fad780c8700 1 -- 172.21.15.135:0/605929113 shutdown_connections 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.542+0000 7fad780c8700 1 -- 172.21.15.135:0/605929113 wait complete. 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.542+0000 7fad780c8700 1 Processor -- start 2024-04-20T12:13:03.753 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.542+0000 7fad780c8700 1 -- start start 2024-04-20T12:13:03.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.542+0000 7fad780c8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad70106f70 0x7fad7019e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:03.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.542+0000 7fad780c8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad70108960 con 0x7fad70106f70 2024-04-20T12:13:03.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.542+0000 7fad75e64700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad70106f70 0x7fad7019e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:03.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.542+0000 7fad75e64700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad70106f70 0x7fad7019e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54266/0 (socket says 172.21.15.135:54266) 2024-04-20T12:13:03.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.542+0000 7fad75e64700 1 -- 172.21.15.135:0/2361507188 learned_addr learned my addr 172.21.15.135:0/2361507188 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:03.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.543+0000 7fad75e64700 1 -- 172.21.15.135:0/2361507188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7019ed70 con 0x7fad70106f70 2024-04-20T12:13:03.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.543+0000 7fad75e64700 1 --2- 172.21.15.135:0/2361507188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad70106f70 0x7fad7019e830 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad6c011b60 tx=0x7fad6c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:03.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.543+0000 7fad66ffd700 1 -- 172.21.15.135:0/2361507188 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad6c003b20 con 0x7fad70106f70 2024-04-20T12:13:03.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.543+0000 7fad66ffd700 1 -- 172.21.15.135:0/2361507188 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad6c003cc0 con 0x7fad70106f70 2024-04-20T12:13:03.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.543+0000 7fad66ffd700 1 -- 172.21.15.135:0/2361507188 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad6c024840 con 0x7fad70106f70 2024-04-20T12:13:03.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.543+0000 7fad780c8700 1 -- 172.21.15.135:0/2361507188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7019f000 con 0x7fad70106f70 2024-04-20T12:13:03.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.543+0000 7fad780c8700 1 -- 172.21.15.135:0/2361507188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad701a1cf0 con 0x7fad70106f70 2024-04-20T12:13:03.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.544+0000 7fad66ffd700 1 -- 172.21.15.135:0/2361507188 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 4) ==== 46547+0+0 (secure 0 0 0) 0x7fad6c022020 con 0x7fad70106f70 2024-04-20T12:13:03.754 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.544+0000 7fad780c8700 1 -- 172.21.15.135:0/2361507188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad700640b0 con 0x7fad70106f70 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.544+0000 7fad66ffd700 1 --2- 172.21.15.135:0/2361507188 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7fad5c0395b0 0x7fad5c03ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.544+0000 7fad66ffd700 1 -- 172.21.15.135:0/2361507188 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fad6c011e00 con 0x7fad70106f70 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.544+0000 7fad75663700 1 --2- 172.21.15.135:0/2361507188 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7fad5c0395b0 0x7fad5c03ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.544+0000 7fad75663700 1 --2- 172.21.15.135:0/2361507188 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7fad5c0395b0 0x7fad5c03ba70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fad60006fd0 tx=0x7fad60006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.549+0000 7fad66ffd700 1 -- 172.21.15.135:0/2361507188 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fad6c04d190 con 0x7fad70106f70 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:02.801+0000 7fad780c8700 1 -- 172.21.15.135:0/2361507188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fad7002e200 con 0x7fad70106f70 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:03.183+0000 7fad66ffd700 1 -- 172.21.15.135:0/2361507188 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fad6c01a7b0 con 0x7fad70106f70 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:03.184+0000 7fad66ffd700 1 -- 172.21.15.135:0/2361507188 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7fad6c00b3e0 con 0x7fad70106f70 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:03.186+0000 7fad780c8700 1 -- 172.21.15.135:0/2361507188 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7fad5c0395b0 msgr2=0x7fad5c03ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:03.186+0000 7fad780c8700 1 --2- 172.21.15.135:0/2361507188 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7fad5c0395b0 0x7fad5c03ba70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fad60006fd0 tx=0x7fad60006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:03.186+0000 7fad780c8700 1 -- 172.21.15.135:0/2361507188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad70106f70 msgr2=0x7fad7019e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:03.186+0000 7fad780c8700 1 --2- 172.21.15.135:0/2361507188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad70106f70 0x7fad7019e830 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fad6c011b60 tx=0x7fad6c011c40 comp rx=0 tx=0).stop 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:03.186+0000 7fad780c8700 1 -- 172.21.15.135:0/2361507188 shutdown_connections 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:03.186+0000 7fad780c8700 1 --2- 172.21.15.135:0/2361507188 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7fad5c0395b0 0x7fad5c03ba70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:03.186+0000 7fad780c8700 1 --2- 172.21.15.135:0/2361507188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad70106f70 0x7fad7019e830 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:03.755 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:03.186+0000 7fad780c8700 1 -- 172.21.15.135:0/2361507188 >> 172.21.15.135:0/2361507188 conn(0x7fad70102bb0 msgr2=0x7fad701954d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:03.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:03.186+0000 7fad780c8700 1 -- 172.21.15.135:0/2361507188 shutdown_connections 2024-04-20T12:13:03.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:03.186+0000 7fad780c8700 1 -- 172.21.15.135:0/2361507188 wait complete. 2024-04-20T12:13:04.039 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:03 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:03.951+0000 7f4ee4917200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-20T12:13:04.039 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:04 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:04.039+0000 7f4ee4917200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-20T12:13:04.354 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:04 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2361507188' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-20T12:13:04.354 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:04 smithi135 ceph-mon[18264]: mgrmap e5: x(active, since 6s) 2024-04-20T12:13:04.993 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-04-20T12:13:04.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-20T12:13:04.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-20T12:13:04.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-20T12:13:04.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-20T12:13:04.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-04-20T12:13:04.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.148+0000 7fe44a7b2700 1 Processor -- start 2024-04-20T12:13:04.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.148+0000 7fe44a7b2700 1 -- start start 2024-04-20T12:13:04.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.148+0000 7fe44a7b2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe444109cd0 0x7fe44410a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:04.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.148+0000 7fe44a7b2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe44410a6c0 con 0x7fe444109cd0 2024-04-20T12:13:04.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.148+0000 7fe443fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe444109cd0 0x7fe44410a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:04.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.148+0000 7fe443fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe444109cd0 0x7fe44410a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54292/0 (socket says 172.21.15.135:54292) 2024-04-20T12:13:04.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.148+0000 7fe443fff700 1 -- 172.21.15.135:0/416982887 learned_addr learned my addr 172.21.15.135:0/416982887 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:04.994 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.149+0000 7fe443fff700 1 -- 172.21.15.135:0/416982887 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44410a840 con 0x7fe444109cd0 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.149+0000 7fe443fff700 1 --2- 172.21.15.135:0/416982887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe444109cd0 0x7fe44410a0f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe4380098a0 tx=0x7fe438009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db246ac6fb2e23cc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.149+0000 7fe442ffd700 1 -- 172.21.15.135:0/416982887 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe438004160 con 0x7fe444109cd0 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.149+0000 7fe442ffd700 1 -- 172.21.15.135:0/416982887 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe438004300 con 0x7fe444109cd0 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.149+0000 7fe442ffd700 1 -- 172.21.15.135:0/416982887 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe438011b50 con 0x7fe444109cd0 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.150+0000 7fe44a7b2700 1 -- 172.21.15.135:0/416982887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe444109cd0 msgr2=0x7fe44410a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.150+0000 7fe44a7b2700 1 --2- 172.21.15.135:0/416982887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe444109cd0 0x7fe44410a0f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe4380098a0 tx=0x7fe438009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.150+0000 7fe44a7b2700 1 -- 172.21.15.135:0/416982887 shutdown_connections 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.150+0000 7fe44a7b2700 1 --2- 172.21.15.135:0/416982887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe444109cd0 0x7fe44410a0f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.150+0000 7fe44a7b2700 1 -- 172.21.15.135:0/416982887 >> 172.21.15.135:0/416982887 conn(0x7fe444102310 msgr2=0x7fe444104730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.150+0000 7fe44a7b2700 1 -- 172.21.15.135:0/416982887 shutdown_connections 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.150+0000 7fe44a7b2700 1 -- 172.21.15.135:0/416982887 wait complete. 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.151+0000 7fe44a7b2700 1 Processor -- start 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.151+0000 7fe44a7b2700 1 -- start start 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.151+0000 7fe44a7b2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe444109cd0 0x7fe44419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.151+0000 7fe44a7b2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe444107540 con 0x7fe444109cd0 2024-04-20T12:13:04.995 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.151+0000 7fe443fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe444109cd0 0x7fe44419c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.151+0000 7fe443fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe444109cd0 0x7fe44419c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54304/0 (socket says 172.21.15.135:54304) 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.151+0000 7fe443fff700 1 -- 172.21.15.135:0/1988236600 learned_addr learned my addr 172.21.15.135:0/1988236600 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.151+0000 7fe443fff700 1 -- 172.21.15.135:0/1988236600 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44419cb90 con 0x7fe444109cd0 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.152+0000 7fe443fff700 1 --2- 172.21.15.135:0/1988236600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe444109cd0 0x7fe44419c650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe438009fb0 tx=0x7fe438011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.152+0000 7fe4417fa700 1 -- 172.21.15.135:0/1988236600 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4380038b0 con 0x7fe444109cd0 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.152+0000 7fe4417fa700 1 -- 172.21.15.135:0/1988236600 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe438011e50 con 0x7fe444109cd0 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.152+0000 7fe44a7b2700 1 -- 172.21.15.135:0/1988236600 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe44419ce80 con 0x7fe444109cd0 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.152+0000 7fe4417fa700 1 -- 172.21.15.135:0/1988236600 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe438019550 con 0x7fe444109cd0 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.152+0000 7fe44a7b2700 1 -- 172.21.15.135:0/1988236600 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe44419fb10 con 0x7fe444109cd0 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.153+0000 7fe4417fa700 1 -- 172.21.15.135:0/1988236600 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7fe438019850 con 0x7fe444109cd0 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.153+0000 7fe44a7b2700 1 -- 172.21.15.135:0/1988236600 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4440640b0 con 0x7fe444109cd0 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.153+0000 7fe4417fa700 1 --2- 172.21.15.135:0/1988236600 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7fe42c039560 0x7fe42c03ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.153+0000 7fe4417fa700 1 -- 172.21.15.135:0/1988236600 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe43804da50 con 0x7fe444109cd0 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.153+0000 7fe4437fe700 1 -- 172.21.15.135:0/1988236600 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7fe42c039560 msgr2=0x7fe42c03ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/469891744 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.153+0000 7fe4437fe700 1 --2- 172.21.15.135:0/1988236600 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7fe42c039560 0x7fe42c03ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T12:13:04.996 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.158+0000 7fe4417fa700 1 -- 172.21.15.135:0/1988236600 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fe438023e20 con 0x7fe444109cd0 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.354+0000 7fe4437fe700 1 -- 172.21.15.135:0/1988236600 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7fe42c039560 msgr2=0x7fe42c03ba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/469891744 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.354+0000 7fe4437fe700 1 --2- 172.21.15.135:0/1988236600 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7fe42c039560 0x7fe42c03ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.428+0000 7fe44a7b2700 1 -- 172.21.15.135:0/1988236600 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fe4441a0210 con 0x7fe444109cd0 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.429+0000 7fe4417fa700 1 -- 172.21.15.135:0/1988236600 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7fe43804d470 con 0x7fe444109cd0 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.431+0000 7fe44a7b2700 1 -- 172.21.15.135:0/1988236600 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7fe42c039560 msgr2=0x7fe42c03ba20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.431+0000 7fe44a7b2700 1 --2- 172.21.15.135:0/1988236600 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7fe42c039560 0x7fe42c03ba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.431+0000 7fe44a7b2700 1 -- 172.21.15.135:0/1988236600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe444109cd0 msgr2=0x7fe44419c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.431+0000 7fe44a7b2700 1 --2- 172.21.15.135:0/1988236600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe444109cd0 0x7fe44419c650 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe438009fb0 tx=0x7fe438011bf0 comp rx=0 tx=0).stop 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.434+0000 7fe44a7b2700 1 -- 172.21.15.135:0/1988236600 shutdown_connections 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.434+0000 7fe44a7b2700 1 --2- 172.21.15.135:0/1988236600 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7fe42c039560 0x7fe42c03ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.434+0000 7fe44a7b2700 1 --2- 172.21.15.135:0/1988236600 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe444109cd0 0x7fe44419c650 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.434+0000 7fe44a7b2700 1 -- 172.21.15.135:0/1988236600 >> 172.21.15.135:0/1988236600 conn(0x7fe444102310 msgr2=0x7fe444102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.436+0000 7fe44a7b2700 1 -- 172.21.15.135:0/1988236600 shutdown_connections 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:04.436+0000 7fe44a7b2700 1 -- 172.21.15.135:0/1988236600 wait complete. 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for the mgr to restart... 2024-04-20T12:13:04.997 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mgr epoch 5... 2024-04-20T12:13:05.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:05 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1988236600' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-20T12:13:05.364 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:05 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:05.276+0000 7f4ee4917200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-20T12:13:05.628 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:05 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:05.459+0000 7f4ee4917200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-20T12:13:05.941 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:05 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:05.641+0000 7f4ee4917200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-20T12:13:05.941 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:05 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:05.940+0000 7f4ee4917200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-20T12:13:06.245 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:06 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:06.035+0000 7f4ee4917200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-20T12:13:06.245 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:06 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:06.245+0000 7f4ee4917200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-20T12:13:06.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:06 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:06.444+0000 7f4ee4917200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:13:07.114 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:07.037+0000 7f4ee4917200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-20T12:13:07.751 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:07.455+0000 7f4ee4917200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-20T12:13:07.751 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:07.551+0000 7f4ee4917200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-20T12:13:07.751 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:07.750+0000 7f4ee4917200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-20T12:13:08.604 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:08.270+0000 7f4ee4917200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-20T12:13:08.604 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:08.363+0000 7f4ee4917200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-20T12:13:08.864 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:08.605+0000 7f4ee4917200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-20T12:13:08.864 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:08.736+0000 7f4ee4917200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-20T12:13:08.864 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:08.830+0000 7f4ee4917200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-20T12:13:09.246 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:08.945+0000 7f4ee4917200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-20T12:13:09.246 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:09 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:09.247+0000 7f4ee4917200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-20T12:13:10.111 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:09 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:09.840+0000 7f4ee4917200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-20T12:13:10.111 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:10.059+0000 7f4ee4917200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-20T12:13:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: Active manager daemon x restarted 2024-04-20T12:13:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: Activating manager daemon x 2024-04-20T12:13:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: osdmap e2: 0 total, 0 up, 0 in 2024-04-20T12:13:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: mgrmap e6: x(active, starting, since 0.00344162s) 2024-04-20T12:13:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:13:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-20T12:13:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T12:13:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T12:13:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T12:13:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: Manager daemon x is now available 2024-04-20T12:13:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' 2024-04-20T12:13:10.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' 2024-04-20T12:13:10.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:13:10.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:13:10.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-20T12:13:10.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:10 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-20T12:13:11.333 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:11 smithi135 ceph-mon[18264]: Found migration_current of "None". Setting to last migration. 2024-04-20T12:13:11.333 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:11 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' 2024-04-20T12:13:11.333 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:11 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' 2024-04-20T12:13:11.333 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:11 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:13:11.333 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:11 smithi135 ceph-mon[18264]: mgrmap e7: x(active, since 1.00607s) 2024-04-20T12:13:11.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-04-20T12:13:11.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-20T12:13:11.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-20T12:13:11.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-04-20T12:13:11.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.391+0000 7f713afbd700 1 Processor -- start 2024-04-20T12:13:11.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.391+0000 7f713afbd700 1 -- start start 2024-04-20T12:13:11.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.391+0000 7f713afbd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7134107590 0x7f71341079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:11.618 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.391+0000 7f713afbd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7134107f80 con 0x7f7134107590 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.391+0000 7f7138d59700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7134107590 0x7f71341079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.391+0000 7f7138d59700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7134107590 0x7f71341079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54320/0 (socket says 172.21.15.135:54320) 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.391+0000 7f7138d59700 1 -- 172.21.15.135:0/2789335706 learned_addr learned my addr 172.21.15.135:0/2789335706 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.392+0000 7f7138d59700 1 -- 172.21.15.135:0/2789335706 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7134108790 con 0x7f7134107590 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.392+0000 7f7138d59700 1 --2- 172.21.15.135:0/2789335706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7134107590 0x7f71341079b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f71280098a0 tx=0x7f7128009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967837db0358613 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.392+0000 7f71337fe700 1 -- 172.21.15.135:0/2789335706 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7128004160 con 0x7f7134107590 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.392+0000 7f71337fe700 1 -- 172.21.15.135:0/2789335706 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7128004300 con 0x7f7134107590 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.392+0000 7f71337fe700 1 -- 172.21.15.135:0/2789335706 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7128011b50 con 0x7f7134107590 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.393+0000 7f713afbd700 1 -- 172.21.15.135:0/2789335706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7134107590 msgr2=0x7f71341079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.393+0000 7f713afbd700 1 --2- 172.21.15.135:0/2789335706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7134107590 0x7f71341079b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f71280098a0 tx=0x7f7128009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.393+0000 7f713afbd700 1 -- 172.21.15.135:0/2789335706 shutdown_connections 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.393+0000 7f713afbd700 1 --2- 172.21.15.135:0/2789335706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7134107590 0x7f71341079b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.393+0000 7f713afbd700 1 -- 172.21.15.135:0/2789335706 >> 172.21.15.135:0/2789335706 conn(0x7f7134102b90 msgr2=0x7f7134104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.393+0000 7f713afbd700 1 -- 172.21.15.135:0/2789335706 shutdown_connections 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.393+0000 7f713afbd700 1 -- 172.21.15.135:0/2789335706 wait complete. 2024-04-20T12:13:11.619 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.394+0000 7f713afbd700 1 Processor -- start 2024-04-20T12:13:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.394+0000 7f713afbd700 1 -- start start 2024-04-20T12:13:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.394+0000 7f713afbd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7134107590 0x7f713407ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.394+0000 7f713afbd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f713410bb40 con 0x7f7134107590 2024-04-20T12:13:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.394+0000 7f7138d59700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7134107590 0x7f713407ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.394+0000 7f7138d59700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7134107590 0x7f713407ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54336/0 (socket says 172.21.15.135:54336) 2024-04-20T12:13:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.395+0000 7f7138d59700 1 -- 172.21.15.135:0/3374495654 learned_addr learned my addr 172.21.15.135:0/3374495654 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.395+0000 7f7138d59700 1 -- 172.21.15.135:0/3374495654 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f713419f430 con 0x7f7134107590 2024-04-20T12:13:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.395+0000 7f7138d59700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7134107590 0x7f713407ba70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7128011850 tx=0x7f7128011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.395+0000 7f7131ffb700 1 -- 172.21.15.135:0/3374495654 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7128003af0 con 0x7f7134107590 2024-04-20T12:13:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.395+0000 7f7131ffb700 1 -- 172.21.15.135:0/3374495654 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7128020070 con 0x7f7134107590 2024-04-20T12:13:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.395+0000 7f713afbd700 1 -- 172.21.15.135:0/3374495654 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f713419f600 con 0x7f7134107590 2024-04-20T12:13:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.395+0000 7f7131ffb700 1 -- 172.21.15.135:0/3374495654 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71280195a0 con 0x7f7134107590 2024-04-20T12:13:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.395+0000 7f713afbd700 1 -- 172.21.15.135:0/3374495654 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f713419f9a0 con 0x7f7134107590 2024-04-20T12:13:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.396+0000 7f7131ffb700 1 -- 172.21.15.135:0/3374495654 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 5) ==== 46558+0+0 (secure 0 0 0) 0x7f71280198a0 con 0x7f7134107590 2024-04-20T12:13:11.620 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.396+0000 7f7131ffb700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f71240395b0 0x7f712403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:11.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.396+0000 7f7131ffb700 1 -- 172.21.15.135:0/3374495654 --> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f712403c180 con 0x7f71240395b0 2024-04-20T12:13:11.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.396+0000 7f7131ffb700 1 -- 172.21.15.135:0/3374495654 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7128011e00 con 0x7f7134107590 2024-04-20T12:13:11.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.396+0000 7f7133fff700 1 -- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f71240395b0 msgr2=0x7f712403ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/469891744 2024-04-20T12:13:11.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.397+0000 7f7133fff700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f71240395b0 0x7f712403ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T12:13:11.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.598+0000 7f7133fff700 1 -- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f71240395b0 msgr2=0x7f712403ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/469891744 2024-04-20T12:13:11.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.598+0000 7f7133fff700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f71240395b0 0x7f712403ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-20T12:13:11.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.999+0000 7f7133fff700 1 -- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f71240395b0 msgr2=0x7f712403ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/469891744 2024-04-20T12:13:11.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:05.999+0000 7f7133fff700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f71240395b0 0x7f712403ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-20T12:13:11.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:06.800+0000 7f7133fff700 1 -- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f71240395b0 msgr2=0x7f712403ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/469891744 2024-04-20T12:13:11.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:06.800+0000 7f7133fff700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f71240395b0 0x7f712403ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-20T12:13:11.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:08.401+0000 7f7133fff700 1 -- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f71240395b0 msgr2=0x7f712403ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/469891744 2024-04-20T12:13:11.621 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:08.401+0000 7f7133fff700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f71240395b0 0x7f712403ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-20T12:13:11.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:10.063+0000 7f7131ffb700 1 -- 172.21.15.135:0/3374495654 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mgrmap(e 6) ==== 46325+0+0 (secure 0 0 0) 0x7f712802bd00 con 0x7f7134107590 2024-04-20T12:13:11.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:10.063+0000 7f7131ffb700 1 -- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f71240395b0 msgr2=0x7f712403ba70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T12:13:11.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:10.063+0000 7f7131ffb700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f71240395b0 0x7f712403ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:11.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.064+0000 7f7131ffb700 1 -- 172.21.15.135:0/3374495654 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7f712804f270 con 0x7f7134107590 2024-04-20T12:13:11.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.064+0000 7f7131ffb700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f712403cea0 0x7f712403f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:11.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.065+0000 7f7131ffb700 1 -- 172.21.15.135:0/3374495654 --> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f712403c180 con 0x7f712403cea0 2024-04-20T12:13:11.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.065+0000 7f7133fff700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f712403cea0 0x7f712403f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:11.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.065+0000 7f7133fff700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f712403cea0 0x7f712403f290 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7120003a10 tx=0x7f7120009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:11.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.066+0000 7f7131ffb700 1 -- 172.21.15.135:0/3374495654 <== mgr.14120 v2:172.21.15.135:6800/2178168771 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f712403c180 con 0x7f712403cea0 2024-04-20T12:13:11.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.072+0000 7f713afbd700 1 -- 172.21.15.135:0/3374495654 --> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f713410b980 con 0x7f712403cea0 2024-04-20T12:13:11.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.073+0000 7f7131ffb700 1 -- 172.21.15.135:0/3374495654 <== mgr.14120 v2:172.21.15.135:6800/2178168771 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f7120008850 con 0x7f712403cea0 2024-04-20T12:13:11.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.073+0000 7f713afbd700 1 -- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f712403cea0 msgr2=0x7f712403f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:11.622 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.073+0000 7f713afbd700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f712403cea0 0x7f712403f290 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7120003a10 tx=0x7f7120009290 comp rx=0 tx=0).stop 2024-04-20T12:13:11.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.073+0000 7f713afbd700 1 -- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7134107590 msgr2=0x7f713407ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:11.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.073+0000 7f713afbd700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7134107590 0x7f713407ba70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7128011850 tx=0x7f7128011c10 comp rx=0 tx=0).stop 2024-04-20T12:13:11.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.073+0000 7f713afbd700 1 -- 172.21.15.135:0/3374495654 shutdown_connections 2024-04-20T12:13:11.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.073+0000 7f713afbd700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f712403cea0 0x7f712403f290 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:11.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.073+0000 7f713afbd700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7134107590 0x7f713407ba70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:11.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.073+0000 7f713afbd700 1 --2- 172.21.15.135:0/3374495654 >> [v2:172.21.15.135:6800/469891744,v1:172.21.15.135:6801/469891744] conn(0x7f71240395b0 0x7f712403ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:11.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.073+0000 7f713afbd700 1 -- 172.21.15.135:0/3374495654 >> 172.21.15.135:0/3374495654 conn(0x7f7134102b90 msgr2=0x7f7134103790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:11.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.073+0000 7f713afbd700 1 -- 172.21.15.135:0/3374495654 shutdown_connections 2024-04-20T12:13:11.623 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:11.073+0000 7f713afbd700 1 -- 172.21.15.135:0/3374495654 wait complete. 2024-04-20T12:13:11.623 INFO:teuthology.orchestra.run.smithi135.stdout:mgr epoch 5 is available 2024-04-20T12:13:11.623 INFO:teuthology.orchestra.run.smithi135.stdout:Setting orchestrator backend to cephadm... 2024-04-20T12:13:12.274 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:12 smithi135 ceph-mon[18264]: [20/Apr/2024:12:13:10] ENGINE Bus STARTING 2024-04-20T12:13:12.275 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:12 smithi135 ceph-mon[18264]: [20/Apr/2024:12:13:10] ENGINE Serving on http://172.21.15.135:8765 2024-04-20T12:13:12.275 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:12 smithi135 ceph-mon[18264]: [20/Apr/2024:12:13:10] ENGINE Serving on https://172.21.15.135:7150 2024-04-20T12:13:12.275 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:12 smithi135 ceph-mon[18264]: [20/Apr/2024:12:13:10] ENGINE Bus STARTED 2024-04-20T12:13:12.275 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:12 smithi135 ceph-mon[18264]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-20T12:13:12.275 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:12 smithi135 ceph-mon[18264]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-20T12:13:12.805 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.047+0000 7f8f53b44700 1 Processor -- start 2024-04-20T12:13:12.805 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.047+0000 7f8f53b44700 1 -- start start 2024-04-20T12:13:12.806 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.047+0000 7f8f53b44700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c1086d0 0x7f8f4c108af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:12.806 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.047+0000 7f8f53b44700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c1090c0 con 0x7f8f4c1086d0 2024-04-20T12:13:12.806 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.047+0000 7f8f518e0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c1086d0 0x7f8f4c108af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:12.806 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.047+0000 7f8f518e0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c1086d0 0x7f8f4c108af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42912/0 (socket says 172.21.15.135:42912) 2024-04-20T12:13:12.806 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.047+0000 7f8f518e0700 1 -- 172.21.15.135:0/2066828567 learned_addr learned my addr 172.21.15.135:0/2066828567 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:12.806 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.048+0000 7f8f518e0700 1 -- 172.21.15.135:0/2066828567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4c109880 con 0x7f8f4c1086d0 2024-04-20T12:13:12.806 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.048+0000 7f8f518e0700 1 --2- 172.21.15.135:0/2066828567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c1086d0 0x7f8f4c108af0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8f480098a0 tx=0x7f8f48009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c940945e39b3ef server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:12.806 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.048+0000 7f8f508de700 1 -- 172.21.15.135:0/2066828567 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f48004160 con 0x7f8f4c1086d0 2024-04-20T12:13:12.806 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.048+0000 7f8f508de700 1 -- 172.21.15.135:0/2066828567 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f48004300 con 0x7f8f4c1086d0 2024-04-20T12:13:12.806 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.048+0000 7f8f508de700 1 -- 172.21.15.135:0/2066828567 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f48011b50 con 0x7f8f4c1086d0 2024-04-20T12:13:12.806 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.049+0000 7f8f53b44700 1 -- 172.21.15.135:0/2066828567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c1086d0 msgr2=0x7f8f4c108af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:12.806 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.049+0000 7f8f53b44700 1 --2- 172.21.15.135:0/2066828567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c1086d0 0x7f8f4c108af0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8f480098a0 tx=0x7f8f48009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:12.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.049+0000 7f8f53b44700 1 -- 172.21.15.135:0/2066828567 shutdown_connections 2024-04-20T12:13:12.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.049+0000 7f8f53b44700 1 --2- 172.21.15.135:0/2066828567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c1086d0 0x7f8f4c108af0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:12.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.049+0000 7f8f53b44700 1 -- 172.21.15.135:0/2066828567 >> 172.21.15.135:0/2066828567 conn(0x7f8f4c103d70 msgr2=0x7f8f4c106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:12.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.049+0000 7f8f53b44700 1 -- 172.21.15.135:0/2066828567 shutdown_connections 2024-04-20T12:13:12.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.049+0000 7f8f53b44700 1 -- 172.21.15.135:0/2066828567 wait complete. 2024-04-20T12:13:12.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.049+0000 7f8f53b44700 1 Processor -- start 2024-04-20T12:13:12.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.049+0000 7f8f53b44700 1 -- start start 2024-04-20T12:13:12.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.049+0000 7f8f53b44700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c1086d0 0x7f8f4c07db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:12.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.049+0000 7f8f53b44700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4c10cc30 con 0x7f8f4c1086d0 2024-04-20T12:13:12.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.050+0000 7f8f518e0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c1086d0 0x7f8f4c07db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:12.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.050+0000 7f8f518e0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c1086d0 0x7f8f4c07db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42918/0 (socket says 172.21.15.135:42918) 2024-04-20T12:13:12.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.050+0000 7f8f518e0700 1 -- 172.21.15.135:0/3771629591 learned_addr learned my addr 172.21.15.135:0/3771629591 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:12.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.050+0000 7f8f518e0700 1 -- 172.21.15.135:0/3771629591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4c07e0d0 con 0x7f8f4c1086d0 2024-04-20T12:13:12.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.050+0000 7f8f518e0700 1 --2- 172.21.15.135:0/3771629591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c1086d0 0x7f8f4c07db90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009fb0 tx=0x7f8f48011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.050+0000 7f8f42ffd700 1 -- 172.21.15.135:0/3771629591 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f480038b0 con 0x7f8f4c1086d0 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.050+0000 7f8f53b44700 1 -- 172.21.15.135:0/3771629591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4c07c2c0 con 0x7f8f4c1086d0 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.050+0000 7f8f42ffd700 1 -- 172.21.15.135:0/3771629591 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f48011e50 con 0x7f8f4c1086d0 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.050+0000 7f8f42ffd700 1 -- 172.21.15.135:0/3771629591 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f48019550 con 0x7f8f4c1086d0 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.050+0000 7f8f53b44700 1 -- 172.21.15.135:0/3771629591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f4c07c800 con 0x7f8f4c1086d0 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.051+0000 7f8f42ffd700 1 -- 172.21.15.135:0/3771629591 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 7) ==== 46452+0+0 (secure 0 0 0) 0x7f8f48019850 con 0x7f8f4c1086d0 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.051+0000 7f8f42ffd700 1 --2- 172.21.15.135:0/3771629591 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8f38039450 0x7f8f3803b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.051+0000 7f8f42ffd700 1 -- 172.21.15.135:0/3771629591 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8f4804d7a0 con 0x7f8f4c1086d0 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.051+0000 7f8f510df700 1 --2- 172.21.15.135:0/3771629591 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8f38039450 0x7f8f3803b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.051+0000 7f8f53b44700 1 -- 172.21.15.135:0/3771629591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f4c0640b0 con 0x7f8f4c1086d0 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.052+0000 7f8f510df700 1 --2- 172.21.15.135:0/3771629591 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8f38039450 0x7f8f3803b910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c006fd0 tx=0x7f8f3c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.057+0000 7f8f42ffd700 1 -- 172.21.15.135:0/3771629591 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f8f4800fda0 con 0x7f8f4c1086d0 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.116+0000 7f8f42ffd700 1 -- 172.21.15.135:0/3771629591 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f8f4802d960 con 0x7f8f4c1086d0 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.275+0000 7f8f53b44700 1 -- 172.21.15.135:0/3771629591 --> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f8f4c07d130 con 0x7f8f38039450 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.280+0000 7f8f42ffd700 1 -- 172.21.15.135:0/3771629591 <== mgr.14120 v2:172.21.15.135:6800/2178168771 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8f4c07d130 con 0x7f8f38039450 2024-04-20T12:13:12.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.283+0000 7f8f53b44700 1 -- 172.21.15.135:0/3771629591 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8f38039450 msgr2=0x7f8f3803b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:12.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.283+0000 7f8f53b44700 1 --2- 172.21.15.135:0/3771629591 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8f38039450 0x7f8f3803b910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c006fd0 tx=0x7f8f3c006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:12.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.283+0000 7f8f53b44700 1 -- 172.21.15.135:0/3771629591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c1086d0 msgr2=0x7f8f4c07db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:12.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.283+0000 7f8f53b44700 1 --2- 172.21.15.135:0/3771629591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c1086d0 0x7f8f4c07db90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009fb0 tx=0x7f8f48011bf0 comp rx=0 tx=0).stop 2024-04-20T12:13:12.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.283+0000 7f8f53b44700 1 -- 172.21.15.135:0/3771629591 shutdown_connections 2024-04-20T12:13:12.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.283+0000 7f8f53b44700 1 --2- 172.21.15.135:0/3771629591 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8f38039450 0x7f8f3803b910 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:12.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.283+0000 7f8f53b44700 1 --2- 172.21.15.135:0/3771629591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f4c1086d0 0x7f8f4c07db90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:12.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.283+0000 7f8f53b44700 1 -- 172.21.15.135:0/3771629591 >> 172.21.15.135:0/3771629591 conn(0x7f8f4c103d70 msgr2=0x7f8f4c1048a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:12.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.283+0000 7f8f53b44700 1 -- 172.21.15.135:0/3771629591 shutdown_connections 2024-04-20T12:13:12.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:12.283+0000 7f8f53b44700 1 -- 172.21.15.135:0/3771629591 wait complete. 2024-04-20T12:13:13.150 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:13 smithi135 ceph-mon[18264]: mgrmap e8: x(active, since 2s) 2024-04-20T12:13:13.150 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:13 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' 2024-04-20T12:13:13.150 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:13 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:13:13.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-20T12:13:13.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.181+0000 7f14a9293700 1 Processor -- start 2024-04-20T12:13:13.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.181+0000 7f14a9293700 1 -- start start 2024-04-20T12:13:13.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.181+0000 7f14a9293700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a4107590 0x7f14a41079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:13.955 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.181+0000 7f14a9293700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f14a4107f80 con 0x7f14a4107590 2024-04-20T12:13:13.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.181+0000 7f14a2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a4107590 0x7f14a41079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:13.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.181+0000 7f14a2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a4107590 0x7f14a41079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42922/0 (socket says 172.21.15.135:42922) 2024-04-20T12:13:13.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.181+0000 7f14a2ffd700 1 -- 172.21.15.135:0/452649080 learned_addr learned my addr 172.21.15.135:0/452649080 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:13.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.181+0000 7f14a2ffd700 1 -- 172.21.15.135:0/452649080 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a4108790 con 0x7f14a4107590 2024-04-20T12:13:13.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.182+0000 7f14a2ffd700 1 --2- 172.21.15.135:0/452649080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a4107590 0x7f14a41079b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f14940098a0 tx=0x7f1494009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b197d9d00d8dab server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:13.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.182+0000 7f14a1ffb700 1 -- 172.21.15.135:0/452649080 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1494004160 con 0x7f14a4107590 2024-04-20T12:13:13.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.182+0000 7f14a1ffb700 1 -- 172.21.15.135:0/452649080 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1494004300 con 0x7f14a4107590 2024-04-20T12:13:13.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.182+0000 7f14a1ffb700 1 -- 172.21.15.135:0/452649080 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1494011b50 con 0x7f14a4107590 2024-04-20T12:13:13.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.182+0000 7f14a9293700 1 -- 172.21.15.135:0/452649080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a4107590 msgr2=0x7f14a41079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:13.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.182+0000 7f14a9293700 1 --2- 172.21.15.135:0/452649080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a4107590 0x7f14a41079b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f14940098a0 tx=0x7f1494009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:13.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.182+0000 7f14a9293700 1 -- 172.21.15.135:0/452649080 shutdown_connections 2024-04-20T12:13:13.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.182+0000 7f14a9293700 1 --2- 172.21.15.135:0/452649080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a4107590 0x7f14a41079b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:13.956 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.182+0000 7f14a9293700 1 -- 172.21.15.135:0/452649080 >> 172.21.15.135:0/452649080 conn(0x7f14a4102c30 msgr2=0x7f14a4105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:13.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.183+0000 7f14a9293700 1 -- 172.21.15.135:0/452649080 shutdown_connections 2024-04-20T12:13:13.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.183+0000 7f14a9293700 1 -- 172.21.15.135:0/452649080 wait complete. 2024-04-20T12:13:13.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.183+0000 7f14a9293700 1 Processor -- start 2024-04-20T12:13:13.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.183+0000 7f14a9293700 1 -- start start 2024-04-20T12:13:13.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.183+0000 7f14a9293700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a4107590 0x7f14a419c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:13.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.183+0000 7f14a9293700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f14a410bb40 con 0x7f14a4107590 2024-04-20T12:13:13.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.184+0000 7f14a2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a4107590 0x7f14a419c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:13.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.184+0000 7f14a2ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a4107590 0x7f14a419c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42934/0 (socket says 172.21.15.135:42934) 2024-04-20T12:13:13.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.184+0000 7f14a2ffd700 1 -- 172.21.15.135:0/336422139 learned_addr learned my addr 172.21.15.135:0/336422139 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:13.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.184+0000 7f14a2ffd700 1 -- 172.21.15.135:0/336422139 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a419cbe0 con 0x7f14a4107590 2024-04-20T12:13:13.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.184+0000 7f14a2ffd700 1 --2- 172.21.15.135:0/336422139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a4107590 0x7f14a419c6a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1494009fb0 tx=0x7f1494011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:13.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.184+0000 7f148bfff700 1 -- 172.21.15.135:0/336422139 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14940038b0 con 0x7f14a4107590 2024-04-20T12:13:13.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.184+0000 7f148bfff700 1 -- 172.21.15.135:0/336422139 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1494011e50 con 0x7f14a4107590 2024-04-20T12:13:13.957 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.184+0000 7f148bfff700 1 -- 172.21.15.135:0/336422139 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1494019550 con 0x7f14a4107590 2024-04-20T12:13:13.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.184+0000 7f14a9293700 1 -- 172.21.15.135:0/336422139 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a419ce70 con 0x7f14a4107590 2024-04-20T12:13:13.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.184+0000 7f14a9293700 1 -- 172.21.15.135:0/336422139 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a419fb60 con 0x7f14a4107590 2024-04-20T12:13:13.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.185+0000 7f148bfff700 1 -- 172.21.15.135:0/336422139 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f149401a430 con 0x7f14a4107590 2024-04-20T12:13:13.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.185+0000 7f148bfff700 1 --2- 172.21.15.135:0/336422139 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f148c039560 0x7f148c03ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:13.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.185+0000 7f14a9293700 1 -- 172.21.15.135:0/336422139 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14a4069ba0 con 0x7f14a4107590 2024-04-20T12:13:13.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.185+0000 7f148bfff700 1 -- 172.21.15.135:0/336422139 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f149404d960 con 0x7f14a4107590 2024-04-20T12:13:13.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.185+0000 7f14a27fc700 1 --2- 172.21.15.135:0/336422139 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f148c039560 0x7f148c03ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:13.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.186+0000 7f14a27fc700 1 --2- 172.21.15.135:0/336422139 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f148c039560 0x7f148c03ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1498006fd0 tx=0x7f1498006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:13.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.190+0000 7f148bfff700 1 -- 172.21.15.135:0/336422139 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f1494020240 con 0x7f14a4107590 2024-04-20T12:13:13.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.391+0000 7f14a9293700 1 -- 172.21.15.135:0/336422139 --> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f14a402e240 con 0x7f148c039560 2024-04-20T12:13:13.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.392+0000 7f148bfff700 1 -- 172.21.15.135:0/336422139 <== mgr.14120 v2:172.21.15.135:6800/2178168771 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f14a402e240 con 0x7f148c039560 2024-04-20T12:13:13.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.394+0000 7f14a9293700 1 -- 172.21.15.135:0/336422139 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f148c039560 msgr2=0x7f148c03ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:13.958 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.394+0000 7f14a9293700 1 --2- 172.21.15.135:0/336422139 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f148c039560 0x7f148c03ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1498006fd0 tx=0x7f1498006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:13.959 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.394+0000 7f14a9293700 1 -- 172.21.15.135:0/336422139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a4107590 msgr2=0x7f14a419c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:13.959 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.394+0000 7f14a9293700 1 --2- 172.21.15.135:0/336422139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a4107590 0x7f14a419c6a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1494009fb0 tx=0x7f1494011bf0 comp rx=0 tx=0).stop 2024-04-20T12:13:13.959 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.394+0000 7f14a9293700 1 -- 172.21.15.135:0/336422139 shutdown_connections 2024-04-20T12:13:13.959 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.394+0000 7f14a9293700 1 --2- 172.21.15.135:0/336422139 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f148c039560 0x7f148c03ba20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:13.959 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.394+0000 7f14a9293700 1 --2- 172.21.15.135:0/336422139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14a4107590 0x7f14a419c6a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:13.959 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.394+0000 7f14a9293700 1 -- 172.21.15.135:0/336422139 >> 172.21.15.135:0/336422139 conn(0x7f14a4102c30 msgr2=0x7f14a4103af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:13.959 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.394+0000 7f14a9293700 1 -- 172.21.15.135:0/336422139 shutdown_connections 2024-04-20T12:13:13.959 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:13.394+0000 7f14a9293700 1 -- 172.21.15.135:0/336422139 wait complete. 2024-04-20T12:13:13.959 INFO:teuthology.orchestra.run.smithi135.stdout:Generating ssh key... 2024-04-20T12:13:14.248 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:14 smithi135 ceph-mon[18264]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:13:15.334 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-mon[18264]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:13:15.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' 2024-04-20T12:13:15.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' 2024-04-20T12:13:15.335 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: Generating public/private rsa key pair. 2024-04-20T12:13:15.335 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: Your identification has been saved in /tmp/tmpy6qxx90u/key. 2024-04-20T12:13:15.335 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: Your public key has been saved in /tmp/tmpy6qxx90u/key.pub. 2024-04-20T12:13:15.335 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: The key fingerprint is: 2024-04-20T12:13:15.335 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: SHA256:6GX7S5DwpjkAFxkVwV6IBSRLJjRiQv0932BQh8PI+Sc ceph-22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:13:15.335 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: The key's randomart image is: 2024-04-20T12:13:15.335 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: +---[RSA 3072]----+ 2024-04-20T12:13:15.335 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: |*==.=O*+=... | 2024-04-20T12:13:15.335 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: |++.+o.o=.+. | 2024-04-20T12:13:15.336 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: | o o.o.o . | 2024-04-20T12:13:15.336 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: | o ..* E . | 2024-04-20T12:13:15.336 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: | . . S = | 2024-04-20T12:13:15.336 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: | o * + . | 2024-04-20T12:13:15.336 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: | = . . | 2024-04-20T12:13:15.336 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: | . o | 2024-04-20T12:13:15.336 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: | o. | 2024-04-20T12:13:15.336 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: +----[SHA256]-----+ 2024-04-20T12:13:15.609 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.349+0000 7f846307a700 1 Processor -- start 2024-04-20T12:13:15.609 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.349+0000 7f846307a700 1 -- start start 2024-04-20T12:13:15.609 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.349+0000 7f846307a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f845c107590 0x7f845c1079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:15.609 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.349+0000 7f846307a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f845c107f80 con 0x7f845c107590 2024-04-20T12:13:15.609 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.349+0000 7f8460e16700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f845c107590 0x7f845c1079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:15.609 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.349+0000 7f8460e16700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f845c107590 0x7f845c1079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42946/0 (socket says 172.21.15.135:42946) 2024-04-20T12:13:15.610 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.349+0000 7f8460e16700 1 -- 172.21.15.135:0/4116302473 learned_addr learned my addr 172.21.15.135:0/4116302473 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:15.610 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.349+0000 7f8460e16700 1 -- 172.21.15.135:0/4116302473 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845c108790 con 0x7f845c107590 2024-04-20T12:13:15.610 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.349+0000 7f8460e16700 1 --2- 172.21.15.135:0/4116302473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f845c107590 0x7f845c1079b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8454009e80 tx=0x7f845400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8f7c3e220efb1a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:15.610 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.350+0000 7f845b7fe700 1 -- 172.21.15.135:0/4116302473 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8454017070 con 0x7f845c107590 2024-04-20T12:13:15.610 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.350+0000 7f845b7fe700 1 -- 172.21.15.135:0/4116302473 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f845400b8c0 con 0x7f845c107590 2024-04-20T12:13:15.610 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.350+0000 7f845b7fe700 1 -- 172.21.15.135:0/4116302473 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84540045c0 con 0x7f845c107590 2024-04-20T12:13:15.610 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.350+0000 7f846307a700 1 -- 172.21.15.135:0/4116302473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f845c107590 msgr2=0x7f845c1079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:15.610 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.350+0000 7f846307a700 1 --2- 172.21.15.135:0/4116302473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f845c107590 0x7f845c1079b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8454009e80 tx=0x7f845400b330 comp rx=0 tx=0).stop 2024-04-20T12:13:15.610 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.350+0000 7f846307a700 1 -- 172.21.15.135:0/4116302473 shutdown_connections 2024-04-20T12:13:15.610 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.350+0000 7f846307a700 1 --2- 172.21.15.135:0/4116302473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f845c107590 0x7f845c1079b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:15.610 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.350+0000 7f846307a700 1 -- 172.21.15.135:0/4116302473 >> 172.21.15.135:0/4116302473 conn(0x7f845c102bb0 msgr2=0x7f845c104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:15.610 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.350+0000 7f846307a700 1 -- 172.21.15.135:0/4116302473 shutdown_connections 2024-04-20T12:13:15.610 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.350+0000 7f846307a700 1 -- 172.21.15.135:0/4116302473 wait complete. 2024-04-20T12:13:15.610 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.351+0000 7f846307a700 1 Processor -- start 2024-04-20T12:13:15.610 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.351+0000 7f846307a700 1 -- start start 2024-04-20T12:13:15.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.351+0000 7f846307a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f845c107590 0x7f845c07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:15.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.351+0000 7f846307a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f845c10bb40 con 0x7f845c107590 2024-04-20T12:13:15.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.351+0000 7f8460e16700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f845c107590 0x7f845c07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:15.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.351+0000 7f8460e16700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f845c107590 0x7f845c07ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42962/0 (socket says 172.21.15.135:42962) 2024-04-20T12:13:15.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.351+0000 7f8460e16700 1 -- 172.21.15.135:0/2956045252 learned_addr learned my addr 172.21.15.135:0/2956045252 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:15.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.351+0000 7f8460e16700 1 -- 172.21.15.135:0/2956045252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845c19f3a0 con 0x7f845c107590 2024-04-20T12:13:15.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.351+0000 7f8460e16700 1 --2- 172.21.15.135:0/2956045252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f845c107590 0x7f845c07ba70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8454004210 tx=0x7f845400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:15.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.352+0000 7f8459ffb700 1 -- 172.21.15.135:0/2956045252 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8454020020 con 0x7f845c107590 2024-04-20T12:13:15.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.352+0000 7f8459ffb700 1 -- 172.21.15.135:0/2956045252 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8454003b50 con 0x7f845c107590 2024-04-20T12:13:15.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.352+0000 7f846307a700 1 -- 172.21.15.135:0/2956045252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f845c19f570 con 0x7f845c107590 2024-04-20T12:13:15.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.352+0000 7f8459ffb700 1 -- 172.21.15.135:0/2956045252 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8454017040 con 0x7f845c107590 2024-04-20T12:13:15.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.352+0000 7f846307a700 1 -- 172.21.15.135:0/2956045252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f845c19f990 con 0x7f845c107590 2024-04-20T12:13:15.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.353+0000 7f8459ffb700 1 -- 172.21.15.135:0/2956045252 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f8454023020 con 0x7f845c107590 2024-04-20T12:13:15.611 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.353+0000 7f8459ffb700 1 --2- 172.21.15.135:0/2956045252 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f84440395b0 0x7f844403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:15.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.353+0000 7f846307a700 1 -- 172.21.15.135:0/2956045252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f845c0640b0 con 0x7f845c107590 2024-04-20T12:13:15.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.353+0000 7f8459ffb700 1 -- 172.21.15.135:0/2956045252 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f845400f050 con 0x7f845c107590 2024-04-20T12:13:15.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.353+0000 7f845bfff700 1 --2- 172.21.15.135:0/2956045252 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f84440395b0 0x7f844403ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:15.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.353+0000 7f845bfff700 1 --2- 172.21.15.135:0/2956045252 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f84440395b0 0x7f844403ba70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8450006fd0 tx=0x7f8450006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:15.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.358+0000 7f8459ffb700 1 -- 172.21.15.135:0/2956045252 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f845402a020 con 0x7f845c107590 2024-04-20T12:13:15.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:14.554+0000 7f846307a700 1 -- 172.21.15.135:0/2956045252 --> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f845c103df0 con 0x7f84440395b0 2024-04-20T12:13:15.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:15.043+0000 7f8459ffb700 1 -- 172.21.15.135:0/2956045252 <== mgr.14120 v2:172.21.15.135:6800/2178168771 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f845c103df0 con 0x7f84440395b0 2024-04-20T12:13:15.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:15.045+0000 7f846307a700 1 -- 172.21.15.135:0/2956045252 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f84440395b0 msgr2=0x7f844403ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:15.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:15.045+0000 7f846307a700 1 --2- 172.21.15.135:0/2956045252 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f84440395b0 0x7f844403ba70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8450006fd0 tx=0x7f8450006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:15.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:15.045+0000 7f846307a700 1 -- 172.21.15.135:0/2956045252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f845c107590 msgr2=0x7f845c07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:15.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:15.045+0000 7f846307a700 1 --2- 172.21.15.135:0/2956045252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f845c107590 0x7f845c07ba70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8454004210 tx=0x7f845400bd50 comp rx=0 tx=0).stop 2024-04-20T12:13:15.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:15.045+0000 7f846307a700 1 -- 172.21.15.135:0/2956045252 shutdown_connections 2024-04-20T12:13:15.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:15.045+0000 7f846307a700 1 --2- 172.21.15.135:0/2956045252 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f84440395b0 0x7f844403ba70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:15.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:15.045+0000 7f846307a700 1 --2- 172.21.15.135:0/2956045252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f845c107590 0x7f845c07ba70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:15.612 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:15.045+0000 7f846307a700 1 -- 172.21.15.135:0/2956045252 >> 172.21.15.135:0/2956045252 conn(0x7f845c102bb0 msgr2=0x7f845c1036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:15.613 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:15.046+0000 7f846307a700 1 -- 172.21.15.135:0/2956045252 shutdown_connections 2024-04-20T12:13:15.613 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:15.046+0000 7f846307a700 1 -- 172.21.15.135:0/2956045252 wait complete. 2024-04-20T12:13:16.268 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:16 smithi135 ceph-mon[18264]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:13:16.268 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:16 smithi135 ceph-mon[18264]: Generating ssh key... 2024-04-20T12:13:16.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD0rHYL/H7Q/0tHUvFVU/5YlvNa9Or6xs0XL1ZYAc9yW2nwu8vRBUe+AVEKAB7txQy7TxRfcTYC525aosjgEzSff5i63p3yMM9hVK602AD3dkytsdf4ma2YODfQb34L2b8UG+xm4iTmzzUzqV0zFjaVINNFWhck8hQ3gBVAUw3RlQI2Er65jRbWylnigsIUDsaMYSvXkH4iDtcnNNJIh2BTK+RERQ+Lbk5+PY2OFh0zfxwpYH1ORz/I1IeR0a8MiKTTEOaRJ1YQk6nZ8pa/C6+3f8b83x6QYpP2Sv1+lfaDdX2UkHop73GPVTk1ZZTPbnGss3bFxMeBwdQjHcxu6i62N3OYwE6QcnX74ixXDFpeHabBWRLwAUqo8eoriyeFGLGUOAmvZLacu0S9DeocCJJmio2BPBbiYRGcNuAQH01K+VstEcVxR34R/heDTg7XHxzk0oZDHU1oldDl+nk6Aa456Br+pTKg+uaWKkzcvErHV5bbS+VqNJvdB45HGX0bZmE= ceph-22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:13:16.807 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.059+0000 7f6ea9059700 1 Processor -- start 2024-04-20T12:13:16.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.060+0000 7f6ea9059700 1 -- start start 2024-04-20T12:13:16.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.060+0000 7f6ea9059700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea41086f0 0x7f6ea4108b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:16.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.060+0000 7f6ea9059700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea41090e0 con 0x7f6ea41086f0 2024-04-20T12:13:16.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.060+0000 7f6ea2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea41086f0 0x7f6ea4108b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:16.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.060+0000 7f6ea2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea41086f0 0x7f6ea4108b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42972/0 (socket says 172.21.15.135:42972) 2024-04-20T12:13:16.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.060+0000 7f6ea2d9d700 1 -- 172.21.15.135:0/1923808277 learned_addr learned my addr 172.21.15.135:0/1923808277 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:16.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.060+0000 7f6ea2d9d700 1 -- 172.21.15.135:0/1923808277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea41098a0 con 0x7f6ea41086f0 2024-04-20T12:13:16.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.060+0000 7f6ea2d9d700 1 --2- 172.21.15.135:0/1923808277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea41086f0 0x7f6ea4108b10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e980098a0 tx=0x7f6e98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea08c8be2549520 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:16.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.061+0000 7f6ea1d9b700 1 -- 172.21.15.135:0/1923808277 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e98004160 con 0x7f6ea41086f0 2024-04-20T12:13:16.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.061+0000 7f6ea1d9b700 1 -- 172.21.15.135:0/1923808277 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e98004300 con 0x7f6ea41086f0 2024-04-20T12:13:16.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.061+0000 7f6ea1d9b700 1 -- 172.21.15.135:0/1923808277 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e98011b50 con 0x7f6ea41086f0 2024-04-20T12:13:16.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.061+0000 7f6ea9059700 1 -- 172.21.15.135:0/1923808277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea41086f0 msgr2=0x7f6ea4108b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:16.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.061+0000 7f6ea9059700 1 --2- 172.21.15.135:0/1923808277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea41086f0 0x7f6ea4108b10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e980098a0 tx=0x7f6e98009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:16.808 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.061+0000 7f6ea9059700 1 -- 172.21.15.135:0/1923808277 shutdown_connections 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.061+0000 7f6ea9059700 1 --2- 172.21.15.135:0/1923808277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea41086f0 0x7f6ea4108b10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.061+0000 7f6ea9059700 1 -- 172.21.15.135:0/1923808277 >> 172.21.15.135:0/1923808277 conn(0x7f6ea4103d70 msgr2=0x7f6ea4106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.061+0000 7f6ea9059700 1 -- 172.21.15.135:0/1923808277 shutdown_connections 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.061+0000 7f6ea9059700 1 -- 172.21.15.135:0/1923808277 wait complete. 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.062+0000 7f6ea9059700 1 Processor -- start 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.062+0000 7f6ea9059700 1 -- start start 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.062+0000 7f6ea9059700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea41086f0 0x7f6ea419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.062+0000 7f6ea9059700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea410cc50 con 0x7f6ea41086f0 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.063+0000 7f6ea2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea41086f0 0x7f6ea419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.063+0000 7f6ea2d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea41086f0 0x7f6ea419c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42980/0 (socket says 172.21.15.135:42980) 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.063+0000 7f6ea2d9d700 1 -- 172.21.15.135:0/3591447768 learned_addr learned my addr 172.21.15.135:0/3591447768 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.063+0000 7f6ea2d9d700 1 -- 172.21.15.135:0/3591447768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea419cb40 con 0x7f6ea41086f0 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.063+0000 7f6ea2d9d700 1 --2- 172.21.15.135:0/3591447768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea41086f0 0x7f6ea419c600 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e98011670 tx=0x7f6e98011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.063+0000 7f6e8bfff700 1 -- 172.21.15.135:0/3591447768 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e980039c0 con 0x7f6ea41086f0 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.063+0000 7f6ea9059700 1 -- 172.21.15.135:0/3591447768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea419cdd0 con 0x7f6ea41086f0 2024-04-20T12:13:16.809 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.063+0000 7f6e8bfff700 1 -- 172.21.15.135:0/3591447768 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e98011e50 con 0x7f6ea41086f0 2024-04-20T12:13:16.810 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.063+0000 7f6e8bfff700 1 -- 172.21.15.135:0/3591447768 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9801a5c0 con 0x7f6ea41086f0 2024-04-20T12:13:16.810 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.063+0000 7f6ea9059700 1 -- 172.21.15.135:0/3591447768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea419fac0 con 0x7f6ea41086f0 2024-04-20T12:13:16.810 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.064+0000 7f6e8bfff700 1 -- 172.21.15.135:0/3591447768 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f6e9801a8c0 con 0x7f6ea41086f0 2024-04-20T12:13:16.810 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.064+0000 7f6ea9059700 1 -- 172.21.15.135:0/3591447768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea40640b0 con 0x7f6ea41086f0 2024-04-20T12:13:16.810 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.064+0000 7f6e8bfff700 1 --2- 172.21.15.135:0/3591447768 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f6e8c039560 0x7f6e8c03ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:16.810 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.064+0000 7f6e8bfff700 1 -- 172.21.15.135:0/3591447768 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6e9804daf0 con 0x7f6ea41086f0 2024-04-20T12:13:16.810 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.064+0000 7f6ea259c700 1 --2- 172.21.15.135:0/3591447768 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f6e8c039560 0x7f6e8c03ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:16.810 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.065+0000 7f6ea259c700 1 --2- 172.21.15.135:0/3591447768 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f6e8c039560 0x7f6e8c03ba20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6e94006fd0 tx=0x7f6e94006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:16.810 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.069+0000 7f6e8bfff700 1 -- 172.21.15.135:0/3591447768 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f6e98019c70 con 0x7f6ea41086f0 2024-04-20T12:13:16.810 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.269+0000 7f6ea9059700 1 -- 172.21.15.135:0/3591447768 --> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f6ea4104ff0 con 0x7f6e8c039560 2024-04-20T12:13:16.810 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.269+0000 7f6e8bfff700 1 -- 172.21.15.135:0/3591447768 <== mgr.14120 v2:172.21.15.135:6800/2178168771 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f6ea4104ff0 con 0x7f6e8c039560 2024-04-20T12:13:16.810 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.272+0000 7f6ea9059700 1 -- 172.21.15.135:0/3591447768 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f6e8c039560 msgr2=0x7f6e8c03ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:16.810 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.272+0000 7f6ea9059700 1 --2- 172.21.15.135:0/3591447768 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f6e8c039560 0x7f6e8c03ba20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6e94006fd0 tx=0x7f6e94006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:16.810 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.272+0000 7f6ea9059700 1 -- 172.21.15.135:0/3591447768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea41086f0 msgr2=0x7f6ea419c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:16.811 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.272+0000 7f6ea9059700 1 --2- 172.21.15.135:0/3591447768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea41086f0 0x7f6ea419c600 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6e98011670 tx=0x7f6e98011b60 comp rx=0 tx=0).stop 2024-04-20T12:13:16.811 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.272+0000 7f6ea9059700 1 -- 172.21.15.135:0/3591447768 shutdown_connections 2024-04-20T12:13:16.811 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.272+0000 7f6ea9059700 1 --2- 172.21.15.135:0/3591447768 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f6e8c039560 0x7f6e8c03ba20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:16.811 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.272+0000 7f6ea9059700 1 --2- 172.21.15.135:0/3591447768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ea41086f0 0x7f6ea419c600 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:16.811 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.272+0000 7f6ea9059700 1 -- 172.21.15.135:0/3591447768 >> 172.21.15.135:0/3591447768 conn(0x7f6ea4103d70 msgr2=0x7f6ea41048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:16.811 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.272+0000 7f6ea9059700 1 -- 172.21.15.135:0/3591447768 shutdown_connections 2024-04-20T12:13:16.811 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:16.272+0000 7f6ea9059700 1 -- 172.21.15.135:0/3591447768 wait complete. 2024-04-20T12:13:16.811 INFO:teuthology.orchestra.run.smithi135.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-20T12:13:16.811 INFO:teuthology.orchestra.run.smithi135.stdout:Adding key to root@localhost authorized_keys... 2024-04-20T12:13:16.811 INFO:teuthology.orchestra.run.smithi135.stdout:Adding host smithi135... 2024-04-20T12:13:17.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:17 smithi135 ceph-mon[18264]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:13:18.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:18 smithi135 ceph-mon[18264]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "addr": "172.21.15.135", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:13:18.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:18 smithi135 ceph-mon[18264]: Deploying cephadm binary to smithi135 2024-04-20T12:13:22.149 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout Added host 'smithi135' with addr '172.21.15.135' 2024-04-20T12:13:22.149 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.177+0000 7fe7c61c7700 1 Processor -- start 2024-04-20T12:13:22.149 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.177+0000 7fe7c61c7700 1 -- start start 2024-04-20T12:13:22.149 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.177+0000 7fe7c61c7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0106960 0x7fe7c0106d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:22.149 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.177+0000 7fe7c61c7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c0107350 con 0x7fe7c0106960 2024-04-20T12:13:22.149 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.177+0000 7fe7bf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0106960 0x7fe7c0106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:22.149 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.177+0000 7fe7bf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0106960 0x7fe7c0106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42982/0 (socket says 172.21.15.135:42982) 2024-04-20T12:13:22.149 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.177+0000 7fe7bf7fe700 1 -- 172.21.15.135:0/805038083 learned_addr learned my addr 172.21.15.135:0/805038083 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:22.149 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.178+0000 7fe7bf7fe700 1 -- 172.21.15.135:0/805038083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c01074d0 con 0x7fe7c0106960 2024-04-20T12:13:22.149 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.178+0000 7fe7bf7fe700 1 --2- 172.21.15.135:0/805038083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0106960 0x7fe7c0106d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009e80 tx=0x7fe7b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb7bd84d318368e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:22.149 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.178+0000 7fe7be7fc700 1 -- 172.21.15.135:0/805038083 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b8017070 con 0x7fe7c0106960 2024-04-20T12:13:22.149 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.178+0000 7fe7be7fc700 1 -- 172.21.15.135:0/805038083 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe7b800b8c0 con 0x7fe7c0106960 2024-04-20T12:13:22.150 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.178+0000 7fe7be7fc700 1 -- 172.21.15.135:0/805038083 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b80045c0 con 0x7fe7c0106960 2024-04-20T12:13:22.150 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.179+0000 7fe7c61c7700 1 -- 172.21.15.135:0/805038083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0106960 msgr2=0x7fe7c0106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:22.150 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.179+0000 7fe7c61c7700 1 --2- 172.21.15.135:0/805038083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0106960 0x7fe7c0106d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009e80 tx=0x7fe7b800b330 comp rx=0 tx=0).stop 2024-04-20T12:13:22.150 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.179+0000 7fe7c61c7700 1 -- 172.21.15.135:0/805038083 shutdown_connections 2024-04-20T12:13:22.150 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.179+0000 7fe7c61c7700 1 --2- 172.21.15.135:0/805038083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0106960 0x7fe7c0106d80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:22.150 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.179+0000 7fe7c61c7700 1 -- 172.21.15.135:0/805038083 >> 172.21.15.135:0/805038083 conn(0x7fe7c01023c0 msgr2=0x7fe7c01047e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:22.150 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.179+0000 7fe7c61c7700 1 -- 172.21.15.135:0/805038083 shutdown_connections 2024-04-20T12:13:22.150 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.179+0000 7fe7c61c7700 1 -- 172.21.15.135:0/805038083 wait complete. 2024-04-20T12:13:22.150 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.179+0000 7fe7c61c7700 1 Processor -- start 2024-04-20T12:13:22.150 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.179+0000 7fe7c61c7700 1 -- start start 2024-04-20T12:13:22.150 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.180+0000 7fe7c61c7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0106960 0x7fe7c019c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:22.150 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.180+0000 7fe7c61c7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c010cc10 con 0x7fe7c0106960 2024-04-20T12:13:22.150 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.180+0000 7fe7bf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0106960 0x7fe7c019c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:22.151 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.180+0000 7fe7bf7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0106960 0x7fe7c019c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42984/0 (socket says 172.21.15.135:42984) 2024-04-20T12:13:22.151 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.180+0000 7fe7bf7fe700 1 -- 172.21.15.135:0/3282286346 learned_addr learned my addr 172.21.15.135:0/3282286346 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:22.151 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.180+0000 7fe7bf7fe700 1 -- 172.21.15.135:0/3282286346 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c019cba0 con 0x7fe7c0106960 2024-04-20T12:13:22.151 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.180+0000 7fe7bf7fe700 1 --2- 172.21.15.135:0/3282286346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0106960 0x7fe7c019c660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8004210 tx=0x7fe7b800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:22.151 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.180+0000 7fe7bcff9700 1 -- 172.21.15.135:0/3282286346 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b8020020 con 0x7fe7c0106960 2024-04-20T12:13:22.151 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.180+0000 7fe7bcff9700 1 -- 172.21.15.135:0/3282286346 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe7b8003b50 con 0x7fe7c0106960 2024-04-20T12:13:22.151 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.180+0000 7fe7c61c7700 1 -- 172.21.15.135:0/3282286346 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c019ce30 con 0x7fe7c0106960 2024-04-20T12:13:22.151 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.180+0000 7fe7bcff9700 1 -- 172.21.15.135:0/3282286346 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b8017040 con 0x7fe7c0106960 2024-04-20T12:13:22.151 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.180+0000 7fe7c61c7700 1 -- 172.21.15.135:0/3282286346 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c019fb20 con 0x7fe7c0106960 2024-04-20T12:13:22.151 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.181+0000 7fe7bcff9700 1 -- 172.21.15.135:0/3282286346 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fe7b8023020 con 0x7fe7c0106960 2024-04-20T12:13:22.151 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.181+0000 7fe7bcff9700 1 --2- 172.21.15.135:0/3282286346 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7fe7ac039600 0x7fe7ac03bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:22.151 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.181+0000 7fe7c61c7700 1 -- 172.21.15.135:0/3282286346 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c00640b0 con 0x7fe7c0106960 2024-04-20T12:13:22.151 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.181+0000 7fe7bcff9700 1 -- 172.21.15.135:0/3282286346 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe7b800f050 con 0x7fe7c0106960 2024-04-20T12:13:22.152 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.181+0000 7fe7beffd700 1 --2- 172.21.15.135:0/3282286346 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7fe7ac039600 0x7fe7ac03bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:22.152 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.182+0000 7fe7beffd700 1 --2- 172.21.15.135:0/3282286346 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7fe7ac039600 0x7fe7ac03bac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8006fd0 tx=0x7fe7a8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:22.152 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.187+0000 7fe7bcff9700 1 -- 172.21.15.135:0/3282286346 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fe7b802a020 con 0x7fe7c0106960 2024-04-20T12:13:22.152 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:17.391+0000 7fe7c61c7700 1 -- 172.21.15.135:0/3282286346 --> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi135", "addr": "172.21.15.135", "target": ["mon-mgr", ""]}) -- 0x7fe7c0103630 con 0x7fe7ac039600 2024-04-20T12:13:22.152 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:21.527+0000 7fe7bcff9700 1 -- 172.21.15.135:0/3282286346 <== mgr.14120 v2:172.21.15.135:6800/2178168771 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fe7c0103630 con 0x7fe7ac039600 2024-04-20T12:13:22.152 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:21.529+0000 7fe7c61c7700 1 -- 172.21.15.135:0/3282286346 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7fe7ac039600 msgr2=0x7fe7ac03bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:22.152 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:21.529+0000 7fe7c61c7700 1 --2- 172.21.15.135:0/3282286346 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7fe7ac039600 0x7fe7ac03bac0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8006fd0 tx=0x7fe7a8006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:22.152 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:21.529+0000 7fe7c61c7700 1 -- 172.21.15.135:0/3282286346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0106960 msgr2=0x7fe7c019c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:22.152 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:21.529+0000 7fe7c61c7700 1 --2- 172.21.15.135:0/3282286346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0106960 0x7fe7c019c660 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8004210 tx=0x7fe7b800bd50 comp rx=0 tx=0).stop 2024-04-20T12:13:22.152 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:21.529+0000 7fe7c61c7700 1 -- 172.21.15.135:0/3282286346 shutdown_connections 2024-04-20T12:13:22.152 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:21.529+0000 7fe7c61c7700 1 --2- 172.21.15.135:0/3282286346 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7fe7ac039600 0x7fe7ac03bac0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:22.152 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:21.529+0000 7fe7c61c7700 1 --2- 172.21.15.135:0/3282286346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7c0106960 0x7fe7c019c660 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:22.152 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:21.529+0000 7fe7c61c7700 1 -- 172.21.15.135:0/3282286346 >> 172.21.15.135:0/3282286346 conn(0x7fe7c01023c0 msgr2=0x7fe7c0102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:22.152 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:21.530+0000 7fe7c61c7700 1 -- 172.21.15.135:0/3282286346 shutdown_connections 2024-04-20T12:13:22.153 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:21.530+0000 7fe7c61c7700 1 -- 172.21.15.135:0/3282286346 wait complete. 2024-04-20T12:13:22.153 INFO:teuthology.orchestra.run.smithi135.stdout:Deploying unmanaged mon service... 2024-04-20T12:13:22.753 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:22 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' 2024-04-20T12:13:22.753 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:22 smithi135 ceph-mon[18264]: Added host smithi135 2024-04-20T12:13:22.753 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:22 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:13:23.323 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-20T12:13:23.324 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.530+0000 7f2f81b14700 1 Processor -- start 2024-04-20T12:13:23.324 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.530+0000 7f2f81b14700 1 -- start start 2024-04-20T12:13:23.324 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.530+0000 7f2f81b14700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c108650 0x7f2f7c108a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:23.324 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.530+0000 7f2f81b14700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c109040 con 0x7f2f7c108650 2024-04-20T12:13:23.324 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.530+0000 7f2f7b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c108650 0x7f2f7c108a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:23.324 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.530+0000 7f2f7b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c108650 0x7f2f7c108a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40162/0 (socket says 172.21.15.135:40162) 2024-04-20T12:13:23.324 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.530+0000 7f2f7b7fe700 1 -- 172.21.15.135:0/717790049 learned_addr learned my addr 172.21.15.135:0/717790049 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:23.324 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.530+0000 7f2f7b7fe700 1 -- 172.21.15.135:0/717790049 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7c109850 con 0x7f2f7c108650 2024-04-20T12:13:23.324 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.530+0000 7f2f7b7fe700 1 --2- 172.21.15.135:0/717790049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c108650 0x7f2f7c108a70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0098a0 tx=0x7f2f6c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3223b853c5a6fb03 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:23.324 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.530+0000 7f2f7a7fc700 1 -- 172.21.15.135:0/717790049 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f6c004160 con 0x7f2f7c108650 2024-04-20T12:13:23.324 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.530+0000 7f2f7a7fc700 1 -- 172.21.15.135:0/717790049 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f6c004300 con 0x7f2f7c108650 2024-04-20T12:13:23.324 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.530+0000 7f2f7a7fc700 1 -- 172.21.15.135:0/717790049 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f6c011b50 con 0x7f2f7c108650 2024-04-20T12:13:23.324 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.531+0000 7f2f81b14700 1 -- 172.21.15.135:0/717790049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c108650 msgr2=0x7f2f7c108a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:23.324 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.531+0000 7f2f81b14700 1 --2- 172.21.15.135:0/717790049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c108650 0x7f2f7c108a70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0098a0 tx=0x7f2f6c009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:23.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.531+0000 7f2f81b14700 1 -- 172.21.15.135:0/717790049 shutdown_connections 2024-04-20T12:13:23.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.531+0000 7f2f81b14700 1 --2- 172.21.15.135:0/717790049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c108650 0x7f2f7c108a70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:23.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.531+0000 7f2f81b14700 1 -- 172.21.15.135:0/717790049 >> 172.21.15.135:0/717790049 conn(0x7f2f7c103c70 msgr2=0x7f2f7c106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:23.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.531+0000 7f2f81b14700 1 -- 172.21.15.135:0/717790049 shutdown_connections 2024-04-20T12:13:23.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.531+0000 7f2f81b14700 1 -- 172.21.15.135:0/717790049 wait complete. 2024-04-20T12:13:23.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.532+0000 7f2f81b14700 1 Processor -- start 2024-04-20T12:13:23.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.532+0000 7f2f81b14700 1 -- start start 2024-04-20T12:13:23.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.532+0000 7f2f81b14700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c108650 0x7f2f7c07db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:23.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.532+0000 7f2f81b14700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c10cc00 con 0x7f2f7c108650 2024-04-20T12:13:23.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.532+0000 7f2f7b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c108650 0x7f2f7c07db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:23.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.532+0000 7f2f7b7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c108650 0x7f2f7c07db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40176/0 (socket says 172.21.15.135:40176) 2024-04-20T12:13:23.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.532+0000 7f2f7b7fe700 1 -- 172.21.15.135:0/3670912330 learned_addr learned my addr 172.21.15.135:0/3670912330 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:23.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.532+0000 7f2f7b7fe700 1 -- 172.21.15.135:0/3670912330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7c07e0d0 con 0x7f2f7c108650 2024-04-20T12:13:23.325 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.533+0000 7f2f7b7fe700 1 --2- 172.21.15.135:0/3670912330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c108650 0x7f2f7c07db90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009fb0 tx=0x7f2f6c011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:23.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.533+0000 7f2f78ff9700 1 -- 172.21.15.135:0/3670912330 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f6c0038b0 con 0x7f2f7c108650 2024-04-20T12:13:23.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.533+0000 7f2f78ff9700 1 -- 172.21.15.135:0/3670912330 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f6c011e50 con 0x7f2f7c108650 2024-04-20T12:13:23.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.533+0000 7f2f81b14700 1 -- 172.21.15.135:0/3670912330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7c07c2c0 con 0x7f2f7c108650 2024-04-20T12:13:23.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.533+0000 7f2f78ff9700 1 -- 172.21.15.135:0/3670912330 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f6c019550 con 0x7f2f7c108650 2024-04-20T12:13:23.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.533+0000 7f2f81b14700 1 -- 172.21.15.135:0/3670912330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f7c07c800 con 0x7f2f7c108650 2024-04-20T12:13:23.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.534+0000 7f2f78ff9700 1 -- 172.21.15.135:0/3670912330 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f2f6c019850 con 0x7f2f7c108650 2024-04-20T12:13:23.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.534+0000 7f2f78ff9700 1 --2- 172.21.15.135:0/3670912330 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f2f64039560 0x7f2f6403ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:23.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.534+0000 7f2f81b14700 1 -- 172.21.15.135:0/3670912330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f7c0640b0 con 0x7f2f7c108650 2024-04-20T12:13:23.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.534+0000 7f2f78ff9700 1 -- 172.21.15.135:0/3670912330 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2f6c04dae0 con 0x7f2f7c108650 2024-04-20T12:13:23.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.534+0000 7f2f7affd700 1 --2- 172.21.15.135:0/3670912330 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f2f64039560 0x7f2f6403ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:23.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.534+0000 7f2f7affd700 1 --2- 172.21.15.135:0/3670912330 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f2f64039560 0x7f2f6403ba20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2f70006fd0 tx=0x7f2f70006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:23.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.539+0000 7f2f78ff9700 1 -- 172.21.15.135:0/3670912330 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f2f6c018dc0 con 0x7f2f7c108650 2024-04-20T12:13:23.326 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.753+0000 7f2f81b14700 1 -- 172.21.15.135:0/3670912330 --> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f2f7c104f70 con 0x7f2f64039560 2024-04-20T12:13:23.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.760+0000 7f2f78ff9700 1 -- 172.21.15.135:0/3670912330 <== mgr.14120 v2:172.21.15.135:6800/2178168771 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2f7c104f70 con 0x7f2f64039560 2024-04-20T12:13:23.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.762+0000 7f2f81b14700 1 -- 172.21.15.135:0/3670912330 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f2f64039560 msgr2=0x7f2f6403ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:23.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.762+0000 7f2f81b14700 1 --2- 172.21.15.135:0/3670912330 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f2f64039560 0x7f2f6403ba20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2f70006fd0 tx=0x7f2f70006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:23.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.762+0000 7f2f81b14700 1 -- 172.21.15.135:0/3670912330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c108650 msgr2=0x7f2f7c07db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:23.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.762+0000 7f2f81b14700 1 --2- 172.21.15.135:0/3670912330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c108650 0x7f2f7c07db90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009fb0 tx=0x7f2f6c011bf0 comp rx=0 tx=0).stop 2024-04-20T12:13:23.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.762+0000 7f2f81b14700 1 -- 172.21.15.135:0/3670912330 shutdown_connections 2024-04-20T12:13:23.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.762+0000 7f2f81b14700 1 --2- 172.21.15.135:0/3670912330 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f2f64039560 0x7f2f6403ba20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:23.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.762+0000 7f2f81b14700 1 --2- 172.21.15.135:0/3670912330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f7c108650 0x7f2f7c07db90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:23.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.762+0000 7f2f81b14700 1 -- 172.21.15.135:0/3670912330 >> 172.21.15.135:0/3670912330 conn(0x7f2f7c103c70 msgr2=0x7f2f7c104860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:23.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.762+0000 7f2f81b14700 1 -- 172.21.15.135:0/3670912330 shutdown_connections 2024-04-20T12:13:23.327 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:22.762+0000 7f2f81b14700 1 -- 172.21.15.135:0/3670912330 wait complete. 2024-04-20T12:13:23.327 INFO:teuthology.orchestra.run.smithi135.stdout:Deploying unmanaged mgr service... 2024-04-20T12:13:24.038 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:23 smithi135 ceph-mon[18264]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:13:24.038 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:23 smithi135 ceph-mon[18264]: Saving service mon spec with placement count:5 2024-04-20T12:13:24.038 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:23 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' 2024-04-20T12:13:25.562 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:25 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' 2024-04-20T12:13:25.562 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:25 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' 2024-04-20T12:13:25.562 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:25 smithi135 ceph-mon[18264]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:13:25.562 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:25 smithi135 ceph-mon[18264]: Saving service mgr spec with placement count:2 2024-04-20T12:13:25.562 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:25 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' 2024-04-20T12:13:25.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-20T12:13:25.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.743+0000 7f8adb08c700 1 Processor -- start 2024-04-20T12:13:25.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.743+0000 7f8adb08c700 1 -- start start 2024-04-20T12:13:25.569 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.743+0000 7f8adb08c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad41090f0 0x7f8ad410b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:25.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.743+0000 7f8adb08c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad407beb0 con 0x7f8ad41090f0 2024-04-20T12:13:25.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.743+0000 7f8ad8e28700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad41090f0 0x7f8ad410b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:25.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.743+0000 7f8ad8e28700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad41090f0 0x7f8ad410b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40190/0 (socket says 172.21.15.135:40190) 2024-04-20T12:13:25.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.743+0000 7f8ad8e28700 1 -- 172.21.15.135:0/3765266388 learned_addr learned my addr 172.21.15.135:0/3765266388 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:25.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.744+0000 7f8ad8e28700 1 -- 172.21.15.135:0/3765266388 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad410ba20 con 0x7f8ad41090f0 2024-04-20T12:13:25.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.744+0000 7f8ad8e28700 1 --2- 172.21.15.135:0/3765266388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad41090f0 0x7f8ad410b4e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80098a0 tx=0x7f8ac8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181c784289c5251b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:25.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.744+0000 7f8ad37fe700 1 -- 172.21.15.135:0/3765266388 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ac8004160 con 0x7f8ad41090f0 2024-04-20T12:13:25.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.744+0000 7f8ad37fe700 1 -- 172.21.15.135:0/3765266388 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ac8004300 con 0x7f8ad41090f0 2024-04-20T12:13:25.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.744+0000 7f8ad37fe700 1 -- 172.21.15.135:0/3765266388 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ac8011b20 con 0x7f8ad41090f0 2024-04-20T12:13:25.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.744+0000 7f8adb08c700 1 -- 172.21.15.135:0/3765266388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad41090f0 msgr2=0x7f8ad410b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:25.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.744+0000 7f8adb08c700 1 --2- 172.21.15.135:0/3765266388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad41090f0 0x7f8ad410b4e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80098a0 tx=0x7f8ac8009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:25.570 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.745+0000 7f8adb08c700 1 -- 172.21.15.135:0/3765266388 shutdown_connections 2024-04-20T12:13:25.571 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.745+0000 7f8adb08c700 1 --2- 172.21.15.135:0/3765266388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad41090f0 0x7f8ad410b4e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:25.571 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.745+0000 7f8adb08c700 1 -- 172.21.15.135:0/3765266388 >> 172.21.15.135:0/3765266388 conn(0x7f8ad4102ba0 msgr2=0x7f8ad4104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:25.571 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.745+0000 7f8adb08c700 1 -- 172.21.15.135:0/3765266388 shutdown_connections 2024-04-20T12:13:25.571 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.745+0000 7f8adb08c700 1 -- 172.21.15.135:0/3765266388 wait complete. 2024-04-20T12:13:25.571 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.745+0000 7f8adb08c700 1 Processor -- start 2024-04-20T12:13:25.571 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.745+0000 7f8adb08c700 1 -- start start 2024-04-20T12:13:25.571 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.745+0000 7f8adb08c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad41090f0 0x7f8ad419c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:25.571 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.745+0000 7f8adb08c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad410ca20 con 0x7f8ad41090f0 2024-04-20T12:13:25.571 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.745+0000 7f8ad8e28700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad41090f0 0x7f8ad419c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:25.571 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.745+0000 7f8ad8e28700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad41090f0 0x7f8ad419c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40194/0 (socket says 172.21.15.135:40194) 2024-04-20T12:13:25.571 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.745+0000 7f8ad8e28700 1 -- 172.21.15.135:0/4124863322 learned_addr learned my addr 172.21.15.135:0/4124863322 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:25.571 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.746+0000 7f8ad8e28700 1 -- 172.21.15.135:0/4124863322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad419cab0 con 0x7f8ad41090f0 2024-04-20T12:13:25.571 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.746+0000 7f8ad8e28700 1 --2- 172.21.15.135:0/4124863322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad41090f0 0x7f8ad419c570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80117e0 tx=0x7f8ac8011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:25.571 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.746+0000 7f8ad1ffb700 1 -- 172.21.15.135:0/4124863322 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ac8003bf0 con 0x7f8ad41090f0 2024-04-20T12:13:25.572 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.746+0000 7f8ad1ffb700 1 -- 172.21.15.135:0/4124863322 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ac801a910 con 0x7f8ad41090f0 2024-04-20T12:13:25.572 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.746+0000 7f8adb08c700 1 -- 172.21.15.135:0/4124863322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad419cda0 con 0x7f8ad41090f0 2024-04-20T12:13:25.572 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.746+0000 7f8ad1ffb700 1 -- 172.21.15.135:0/4124863322 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ac8024970 con 0x7f8ad41090f0 2024-04-20T12:13:25.572 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.746+0000 7f8adb08c700 1 -- 172.21.15.135:0/4124863322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad419fa30 con 0x7f8ad41090f0 2024-04-20T12:13:25.572 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.747+0000 7f8ad1ffb700 1 -- 172.21.15.135:0/4124863322 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f8ac8022020 con 0x7f8ad41090f0 2024-04-20T12:13:25.572 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.747+0000 7f8adb08c700 1 -- 172.21.15.135:0/4124863322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad40640b0 con 0x7f8ad41090f0 2024-04-20T12:13:25.572 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.747+0000 7f8ad1ffb700 1 --2- 172.21.15.135:0/4124863322 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8ac40395b0 0x7f8ac403ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:25.572 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.747+0000 7f8ad1ffb700 1 -- 172.21.15.135:0/4124863322 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8ac804d970 con 0x7f8ad41090f0 2024-04-20T12:13:25.572 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.748+0000 7f8ad3fff700 1 --2- 172.21.15.135:0/4124863322 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8ac40395b0 0x7f8ac403ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:25.572 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.748+0000 7f8ad3fff700 1 --2- 172.21.15.135:0/4124863322 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8ac40395b0 0x7f8ac403ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0006fd0 tx=0x7f8ac0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:25.572 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.753+0000 7f8ad1ffb700 1 -- 172.21.15.135:0/4124863322 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f8ac8011e20 con 0x7f8ad41090f0 2024-04-20T12:13:25.573 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.980+0000 7f8adb08c700 1 -- 172.21.15.135:0/4124863322 --> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f8ad4103da0 con 0x7f8ac40395b0 2024-04-20T12:13:25.573 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.985+0000 7f8ad1ffb700 1 -- 172.21.15.135:0/4124863322 <== mgr.14120 v2:172.21.15.135:6800/2178168771 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8ad4103da0 con 0x7f8ac40395b0 2024-04-20T12:13:25.573 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.989+0000 7f8adb08c700 1 -- 172.21.15.135:0/4124863322 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8ac40395b0 msgr2=0x7f8ac403ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:25.573 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.989+0000 7f8adb08c700 1 --2- 172.21.15.135:0/4124863322 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8ac40395b0 0x7f8ac403ba70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0006fd0 tx=0x7f8ac0006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:25.573 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.989+0000 7f8adb08c700 1 -- 172.21.15.135:0/4124863322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad41090f0 msgr2=0x7f8ad419c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:25.573 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.989+0000 7f8adb08c700 1 --2- 172.21.15.135:0/4124863322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad41090f0 0x7f8ad419c570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8ac80117e0 tx=0x7f8ac8011c10 comp rx=0 tx=0).stop 2024-04-20T12:13:25.574 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.989+0000 7f8adb08c700 1 -- 172.21.15.135:0/4124863322 shutdown_connections 2024-04-20T12:13:25.574 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.989+0000 7f8adb08c700 1 --2- 172.21.15.135:0/4124863322 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8ac40395b0 0x7f8ac403ba70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:25.574 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.989+0000 7f8adb08c700 1 --2- 172.21.15.135:0/4124863322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ad41090f0 0x7f8ad419c570 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:25.574 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.989+0000 7f8adb08c700 1 -- 172.21.15.135:0/4124863322 >> 172.21.15.135:0/4124863322 conn(0x7f8ad4102ba0 msgr2=0x7f8ad4103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:25.574 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.989+0000 7f8adb08c700 1 -- 172.21.15.135:0/4124863322 shutdown_connections 2024-04-20T12:13:25.575 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:24.989+0000 7f8adb08c700 1 -- 172.21.15.135:0/4124863322 wait complete. 2024-04-20T12:13:26.818 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.992+0000 7f0e75b7a700 1 Processor -- start 2024-04-20T12:13:26.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.992+0000 7f0e75b7a700 1 -- start start 2024-04-20T12:13:26.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.992+0000 7f0e75b7a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e701069a0 0x7f0e70106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:26.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.992+0000 7f0e75b7a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e70107390 con 0x7f0e701069a0 2024-04-20T12:13:26.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.992+0000 7f0e6f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e701069a0 0x7f0e70106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:26.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.992+0000 7f0e6f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e701069a0 0x7f0e70106dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40206/0 (socket says 172.21.15.135:40206) 2024-04-20T12:13:26.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.992+0000 7f0e6f7fe700 1 -- 172.21.15.135:0/1066959027 learned_addr learned my addr 172.21.15.135:0/1066959027 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:26.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.992+0000 7f0e6f7fe700 1 -- 172.21.15.135:0/1066959027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e701076c0 con 0x7f0e701069a0 2024-04-20T12:13:26.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.992+0000 7f0e6f7fe700 1 --2- 172.21.15.135:0/1066959027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e701069a0 0x7f0e70106dc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0e600098a0 tx=0x7f0e60009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa165971ba3f039e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:26.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.993+0000 7f0e6e7fc700 1 -- 172.21.15.135:0/1066959027 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e60004160 con 0x7f0e701069a0 2024-04-20T12:13:26.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.993+0000 7f0e6e7fc700 1 -- 172.21.15.135:0/1066959027 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e60004300 con 0x7f0e701069a0 2024-04-20T12:13:26.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.993+0000 7f0e6e7fc700 1 -- 172.21.15.135:0/1066959027 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e60011b20 con 0x7f0e701069a0 2024-04-20T12:13:26.819 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.993+0000 7f0e75b7a700 1 -- 172.21.15.135:0/1066959027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e701069a0 msgr2=0x7f0e70106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:26.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.993+0000 7f0e75b7a700 1 --2- 172.21.15.135:0/1066959027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e701069a0 0x7f0e70106dc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0e600098a0 tx=0x7f0e60009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:26.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.994+0000 7f0e75b7a700 1 -- 172.21.15.135:0/1066959027 shutdown_connections 2024-04-20T12:13:26.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.994+0000 7f0e75b7a700 1 --2- 172.21.15.135:0/1066959027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e701069a0 0x7f0e70106dc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:26.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.994+0000 7f0e75b7a700 1 -- 172.21.15.135:0/1066959027 >> 172.21.15.135:0/1066959027 conn(0x7f0e70102310 msgr2=0x7f0e70104730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:26.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.994+0000 7f0e75b7a700 1 -- 172.21.15.135:0/1066959027 shutdown_connections 2024-04-20T12:13:26.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.994+0000 7f0e75b7a700 1 -- 172.21.15.135:0/1066959027 wait complete. 2024-04-20T12:13:26.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.994+0000 7f0e75b7a700 1 Processor -- start 2024-04-20T12:13:26.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.995+0000 7f0e75b7a700 1 -- start start 2024-04-20T12:13:26.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.995+0000 7f0e75b7a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e701069a0 0x7f0e701a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:26.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.995+0000 7f0e75b7a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7010aa90 con 0x7f0e701069a0 2024-04-20T12:13:26.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.995+0000 7f0e6f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e701069a0 0x7f0e701a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:26.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.995+0000 7f0e6f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e701069a0 0x7f0e701a2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40210/0 (socket says 172.21.15.135:40210) 2024-04-20T12:13:26.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.995+0000 7f0e6f7fe700 1 -- 172.21.15.135:0/66903402 learned_addr learned my addr 172.21.15.135:0/66903402 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:26.820 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.995+0000 7f0e6f7fe700 1 -- 172.21.15.135:0/66903402 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e701a3160 con 0x7f0e701069a0 2024-04-20T12:13:26.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.995+0000 7f0e6f7fe700 1 --2- 172.21.15.135:0/66903402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e701069a0 0x7f0e701a2c20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0e60000c00 tx=0x7f0e60011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:26.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.995+0000 7f0e6cff9700 1 -- 172.21.15.135:0/66903402 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e60003b60 con 0x7f0e701069a0 2024-04-20T12:13:26.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.996+0000 7f0e6cff9700 1 -- 172.21.15.135:0/66903402 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e6001a910 con 0x7f0e701069a0 2024-04-20T12:13:26.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.996+0000 7f0e75b7a700 1 -- 172.21.15.135:0/66903402 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e701a33f0 con 0x7f0e701069a0 2024-04-20T12:13:26.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.996+0000 7f0e75b7a700 1 -- 172.21.15.135:0/66903402 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e701a3850 con 0x7f0e701069a0 2024-04-20T12:13:26.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.996+0000 7f0e6cff9700 1 -- 172.21.15.135:0/66903402 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e60024930 con 0x7f0e701069a0 2024-04-20T12:13:26.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.997+0000 7f0e6cff9700 1 -- 172.21.15.135:0/66903402 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f0e60022020 con 0x7f0e701069a0 2024-04-20T12:13:26.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.997+0000 7f0e75b7a700 1 -- 172.21.15.135:0/66903402 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e700640b0 con 0x7f0e701069a0 2024-04-20T12:13:26.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.997+0000 7f0e6cff9700 1 --2- 172.21.15.135:0/66903402 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f0e580395b0 0x7f0e5803ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:26.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.997+0000 7f0e6cff9700 1 -- 172.21.15.135:0/66903402 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0e6004da20 con 0x7f0e701069a0 2024-04-20T12:13:26.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.997+0000 7f0e6effd700 1 --2- 172.21.15.135:0/66903402 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f0e580395b0 0x7f0e5803ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:26.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:25.997+0000 7f0e6effd700 1 --2- 172.21.15.135:0/66903402 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f0e580395b0 0x7f0e5803ba70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0e64006fd0 tx=0x7f0e64006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:26.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:26.004+0000 7f0e6cff9700 1 -- 172.21.15.135:0/66903402 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f0e6000b5a0 con 0x7f0e701069a0 2024-04-20T12:13:26.821 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:26.225+0000 7f0e75b7a700 1 -- 172.21.15.135:0/66903402 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f0e70063660 con 0x7f0e701069a0 2024-04-20T12:13:26.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:26.227+0000 7f0e6cff9700 1 -- 172.21.15.135:0/66903402 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f0e60021d80 con 0x7f0e701069a0 2024-04-20T12:13:26.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:26.229+0000 7f0e75b7a700 1 -- 172.21.15.135:0/66903402 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f0e580395b0 msgr2=0x7f0e5803ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:26.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:26.229+0000 7f0e75b7a700 1 --2- 172.21.15.135:0/66903402 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f0e580395b0 0x7f0e5803ba70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0e64006fd0 tx=0x7f0e64006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:26.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:26.229+0000 7f0e75b7a700 1 -- 172.21.15.135:0/66903402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e701069a0 msgr2=0x7f0e701a2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:26.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:26.229+0000 7f0e75b7a700 1 --2- 172.21.15.135:0/66903402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e701069a0 0x7f0e701a2c20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0e60000c00 tx=0x7f0e60011c10 comp rx=0 tx=0).stop 2024-04-20T12:13:26.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:26.230+0000 7f0e75b7a700 1 -- 172.21.15.135:0/66903402 shutdown_connections 2024-04-20T12:13:26.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:26.230+0000 7f0e75b7a700 1 --2- 172.21.15.135:0/66903402 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f0e580395b0 0x7f0e5803ba70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:26.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:26.230+0000 7f0e75b7a700 1 --2- 172.21.15.135:0/66903402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e701069a0 0x7f0e701a2c20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:26.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:26.230+0000 7f0e75b7a700 1 -- 172.21.15.135:0/66903402 >> 172.21.15.135:0/66903402 conn(0x7f0e70102310 msgr2=0x7f0e7010d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:26.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:26.230+0000 7f0e75b7a700 1 -- 172.21.15.135:0/66903402 shutdown_connections 2024-04-20T12:13:26.822 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:26.230+0000 7f0e75b7a700 1 -- 172.21.15.135:0/66903402 wait complete. 2024-04-20T12:13:27.298 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:27 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/66903402' entity='client.admin' 2024-04-20T12:13:28.169 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.323+0000 7fced7cb5700 1 Processor -- start 2024-04-20T12:13:28.169 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.324+0000 7fced7cb5700 1 -- start start 2024-04-20T12:13:28.169 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.324+0000 7fced7cb5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced01086d0 0x7fced0108af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:28.169 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.324+0000 7fced7cb5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fced01090c0 con 0x7fced01086d0 2024-04-20T12:13:28.169 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.324+0000 7fced5a51700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced01086d0 0x7fced0108af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:28.169 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.324+0000 7fced5a51700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced01086d0 0x7fced0108af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40214/0 (socket says 172.21.15.135:40214) 2024-04-20T12:13:28.169 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.324+0000 7fced5a51700 1 -- 172.21.15.135:0/4138865861 learned_addr learned my addr 172.21.15.135:0/4138865861 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:28.169 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.324+0000 7fced5a51700 1 -- 172.21.15.135:0/4138865861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced0109880 con 0x7fced01086d0 2024-04-20T12:13:28.169 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.324+0000 7fced5a51700 1 --2- 172.21.15.135:0/4138865861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced01086d0 0x7fced0108af0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0098a0 tx=0x7fcecc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349bdde9f79d9ce7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:28.169 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.325+0000 7fced4a4f700 1 -- 172.21.15.135:0/4138865861 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcecc004160 con 0x7fced01086d0 2024-04-20T12:13:28.169 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.325+0000 7fced4a4f700 1 -- 172.21.15.135:0/4138865861 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcecc004300 con 0x7fced01086d0 2024-04-20T12:13:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.325+0000 7fced4a4f700 1 -- 172.21.15.135:0/4138865861 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcecc011b20 con 0x7fced01086d0 2024-04-20T12:13:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.325+0000 7fced7cb5700 1 -- 172.21.15.135:0/4138865861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced01086d0 msgr2=0x7fced0108af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.325+0000 7fced7cb5700 1 --2- 172.21.15.135:0/4138865861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced01086d0 0x7fced0108af0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0098a0 tx=0x7fcecc009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.325+0000 7fced7cb5700 1 -- 172.21.15.135:0/4138865861 shutdown_connections 2024-04-20T12:13:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.325+0000 7fced7cb5700 1 --2- 172.21.15.135:0/4138865861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced01086d0 0x7fced0108af0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.325+0000 7fced7cb5700 1 -- 172.21.15.135:0/4138865861 >> 172.21.15.135:0/4138865861 conn(0x7fced0103d70 msgr2=0x7fced0106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.325+0000 7fced7cb5700 1 -- 172.21.15.135:0/4138865861 shutdown_connections 2024-04-20T12:13:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.325+0000 7fced7cb5700 1 -- 172.21.15.135:0/4138865861 wait complete. 2024-04-20T12:13:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.326+0000 7fced7cb5700 1 Processor -- start 2024-04-20T12:13:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.326+0000 7fced7cb5700 1 -- start start 2024-04-20T12:13:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.326+0000 7fced7cb5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced01086d0 0x7fced007db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.326+0000 7fced7cb5700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fced010cc30 con 0x7fced01086d0 2024-04-20T12:13:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.326+0000 7fced5a51700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced01086d0 0x7fced007db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:28.170 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.326+0000 7fced5a51700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced01086d0 0x7fced007db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40230/0 (socket says 172.21.15.135:40230) 2024-04-20T12:13:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.326+0000 7fced5a51700 1 -- 172.21.15.135:0/190801292 learned_addr learned my addr 172.21.15.135:0/190801292 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.326+0000 7fced5a51700 1 -- 172.21.15.135:0/190801292 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced007e0d0 con 0x7fced01086d0 2024-04-20T12:13:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.327+0000 7fced5a51700 1 --2- 172.21.15.135:0/190801292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced01086d0 0x7fced007db90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0116a0 tx=0x7fcecc011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.327+0000 7fcec6ffd700 1 -- 172.21.15.135:0/190801292 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcecc003a40 con 0x7fced01086d0 2024-04-20T12:13:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.327+0000 7fcec6ffd700 1 -- 172.21.15.135:0/190801292 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcecc003be0 con 0x7fced01086d0 2024-04-20T12:13:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.327+0000 7fced7cb5700 1 -- 172.21.15.135:0/190801292 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced007c2c0 con 0x7fced01086d0 2024-04-20T12:13:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.327+0000 7fcec6ffd700 1 -- 172.21.15.135:0/190801292 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcecc01a720 con 0x7fced01086d0 2024-04-20T12:13:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.327+0000 7fced7cb5700 1 -- 172.21.15.135:0/190801292 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced007c780 con 0x7fced01086d0 2024-04-20T12:13:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.328+0000 7fcec6ffd700 1 -- 172.21.15.135:0/190801292 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7fcecc024aa0 con 0x7fced01086d0 2024-04-20T12:13:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.328+0000 7fced7cb5700 1 -- 172.21.15.135:0/190801292 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced00640b0 con 0x7fced01086d0 2024-04-20T12:13:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.328+0000 7fcec6ffd700 1 --2- 172.21.15.135:0/190801292 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7fcebc039560 0x7fcebc03ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.328+0000 7fcec6ffd700 1 -- 172.21.15.135:0/190801292 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcecc04dd90 con 0x7fced01086d0 2024-04-20T12:13:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.328+0000 7fced5250700 1 --2- 172.21.15.135:0/190801292 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7fcebc039560 0x7fcebc03ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.328+0000 7fced5250700 1 --2- 172.21.15.135:0/190801292 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7fcebc039560 0x7fcebc03ba20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcec0006fd0 tx=0x7fcec0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:28.171 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.333+0000 7fcec6ffd700 1 -- 172.21.15.135:0/190801292 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fcecc011e20 con 0x7fced01086d0 2024-04-20T12:13:28.172 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.532+0000 7fced7cb5700 1 -- 172.21.15.135:0/190801292 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fced007ca00 con 0x7fced01086d0 2024-04-20T12:13:28.172 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.535+0000 7fcec6ffd700 1 -- 172.21.15.135:0/190801292 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fcecc04d6a0 con 0x7fced01086d0 2024-04-20T12:13:28.172 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.538+0000 7fced7cb5700 1 -- 172.21.15.135:0/190801292 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7fcebc039560 msgr2=0x7fcebc03ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:28.172 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.538+0000 7fced7cb5700 1 --2- 172.21.15.135:0/190801292 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7fcebc039560 0x7fcebc03ba20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcec0006fd0 tx=0x7fcec0006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:28.172 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.538+0000 7fced7cb5700 1 -- 172.21.15.135:0/190801292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced01086d0 msgr2=0x7fced007db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:28.172 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.538+0000 7fced7cb5700 1 --2- 172.21.15.135:0/190801292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced01086d0 0x7fced007db90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0116a0 tx=0x7fcecc011ba0 comp rx=0 tx=0).stop 2024-04-20T12:13:28.172 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.538+0000 7fced7cb5700 1 -- 172.21.15.135:0/190801292 shutdown_connections 2024-04-20T12:13:28.172 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.538+0000 7fced7cb5700 1 --2- 172.21.15.135:0/190801292 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7fcebc039560 0x7fcebc03ba20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:28.172 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.538+0000 7fced7cb5700 1 --2- 172.21.15.135:0/190801292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fced01086d0 0x7fced007db90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:28.172 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.538+0000 7fced7cb5700 1 -- 172.21.15.135:0/190801292 >> 172.21.15.135:0/190801292 conn(0x7fced0103d70 msgr2=0x7fced0104880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:28.172 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.538+0000 7fced7cb5700 1 -- 172.21.15.135:0/190801292 shutdown_connections 2024-04-20T12:13:28.172 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:27.538+0000 7fced7cb5700 1 -- 172.21.15.135:0/190801292 wait complete. 2024-04-20T12:13:28.172 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling the dashboard module... 2024-04-20T12:13:28.862 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:28 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/190801292' entity='client.admin' 2024-04-20T12:13:30.085 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:29 smithi135 ceph-mon[18264]: from='mgr.14120 172.21.15.135:0/4162414754' entity='mgr.x' 2024-04-20T12:13:30.085 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:29 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3758841707' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-20T12:13:30.085 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:29 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: ignoring --setuser ceph since I am not root 2024-04-20T12:13:30.085 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:29 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: ignoring --setgroup ceph since I am not root 2024-04-20T12:13:30.086 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:29 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:29.970+0000 7f9d6e3b9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-20T12:13:30.351 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:30 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:30.158+0000 7f9d6e3b9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:13:30.352 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:30 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:30.260+0000 7f9d6e3b9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-20T12:13:30.359 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.574+0000 7f1a1ef9b700 1 Processor -- start 2024-04-20T12:13:30.359 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.574+0000 7f1a1ef9b700 1 -- start start 2024-04-20T12:13:30.359 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.574+0000 7f1a1ef9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a18107590 0x7f1a181079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:30.359 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.574+0000 7f1a1ef9b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a18107f80 con 0x7f1a18107590 2024-04-20T12:13:30.359 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.574+0000 7f1a1cd37700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a18107590 0x7f1a181079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:30.359 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.575+0000 7f1a1cd37700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a18107590 0x7f1a181079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40238/0 (socket says 172.21.15.135:40238) 2024-04-20T12:13:30.359 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.575+0000 7f1a1cd37700 1 -- 172.21.15.135:0/2708307775 learned_addr learned my addr 172.21.15.135:0/2708307775 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:30.359 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.575+0000 7f1a1cd37700 1 -- 172.21.15.135:0/2708307775 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a18108790 con 0x7f1a18107590 2024-04-20T12:13:30.360 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.575+0000 7f1a1cd37700 1 --2- 172.21.15.135:0/2708307775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a18107590 0x7f1a181079b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009e80 tx=0x7f1a1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ce10511fec7f35 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:30.360 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.575+0000 7f1a177fe700 1 -- 172.21.15.135:0/2708307775 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a10017070 con 0x7f1a18107590 2024-04-20T12:13:30.360 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.575+0000 7f1a177fe700 1 -- 172.21.15.135:0/2708307775 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a1000b8c0 con 0x7f1a18107590 2024-04-20T12:13:30.360 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.575+0000 7f1a177fe700 1 -- 172.21.15.135:0/2708307775 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a100045c0 con 0x7f1a18107590 2024-04-20T12:13:30.360 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.576+0000 7f1a1ef9b700 1 -- 172.21.15.135:0/2708307775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a18107590 msgr2=0x7f1a181079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:30.360 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.576+0000 7f1a1ef9b700 1 --2- 172.21.15.135:0/2708307775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a18107590 0x7f1a181079b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009e80 tx=0x7f1a1000b330 comp rx=0 tx=0).stop 2024-04-20T12:13:30.360 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.576+0000 7f1a1ef9b700 1 -- 172.21.15.135:0/2708307775 shutdown_connections 2024-04-20T12:13:30.360 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.576+0000 7f1a1ef9b700 1 --2- 172.21.15.135:0/2708307775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a18107590 0x7f1a181079b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:30.360 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.576+0000 7f1a1ef9b700 1 -- 172.21.15.135:0/2708307775 >> 172.21.15.135:0/2708307775 conn(0x7f1a18102bb0 msgr2=0x7f1a18104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:30.360 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.576+0000 7f1a1ef9b700 1 -- 172.21.15.135:0/2708307775 shutdown_connections 2024-04-20T12:13:30.360 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.576+0000 7f1a1ef9b700 1 -- 172.21.15.135:0/2708307775 wait complete. 2024-04-20T12:13:30.360 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.576+0000 7f1a1ef9b700 1 Processor -- start 2024-04-20T12:13:30.360 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.576+0000 7f1a1ef9b700 1 -- start start 2024-04-20T12:13:30.360 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.576+0000 7f1a1ef9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a18107590 0x7f1a1819e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:30.360 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.576+0000 7f1a1ef9b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1807aff0 con 0x7f1a18107590 2024-04-20T12:13:30.361 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.576+0000 7f1a1cd37700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a18107590 0x7f1a1819e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:30.361 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.576+0000 7f1a1cd37700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a18107590 0x7f1a1819e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40248/0 (socket says 172.21.15.135:40248) 2024-04-20T12:13:30.361 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.576+0000 7f1a1cd37700 1 -- 172.21.15.135:0/3758841707 learned_addr learned my addr 172.21.15.135:0/3758841707 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:30.361 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.577+0000 7f1a1cd37700 1 -- 172.21.15.135:0/3758841707 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1819edc0 con 0x7f1a18107590 2024-04-20T12:13:30.361 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.577+0000 7f1a1cd37700 1 --2- 172.21.15.135:0/3758841707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a18107590 0x7f1a1819e880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009530 tx=0x7f1a10003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:30.361 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.577+0000 7f1a15ffb700 1 -- 172.21.15.135:0/3758841707 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a10020020 con 0x7f1a18107590 2024-04-20T12:13:30.361 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.577+0000 7f1a15ffb700 1 -- 172.21.15.135:0/3758841707 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a1000bba0 con 0x7f1a18107590 2024-04-20T12:13:30.361 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.577+0000 7f1a1ef9b700 1 -- 172.21.15.135:0/3758841707 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a1819f050 con 0x7f1a18107590 2024-04-20T12:13:30.361 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.577+0000 7f1a15ffb700 1 -- 172.21.15.135:0/3758841707 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a10017040 con 0x7f1a18107590 2024-04-20T12:13:30.361 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.577+0000 7f1a1ef9b700 1 -- 172.21.15.135:0/3758841707 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a181a1d40 con 0x7f1a18107590 2024-04-20T12:13:30.361 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.578+0000 7f1a15ffb700 1 -- 172.21.15.135:0/3758841707 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 8) ==== 46558+0+0 (secure 0 0 0) 0x7f1a10023020 con 0x7f1a18107590 2024-04-20T12:13:30.361 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.578+0000 7f1a1ef9b700 1 -- 172.21.15.135:0/3758841707 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a180640b0 con 0x7f1a18107590 2024-04-20T12:13:30.361 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.578+0000 7f1a15ffb700 1 --2- 172.21.15.135:0/3758841707 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f1a000395b0 0x7f1a0003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:30.362 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.578+0000 7f1a15ffb700 1 -- 172.21.15.135:0/3758841707 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1a1000f050 con 0x7f1a18107590 2024-04-20T12:13:30.362 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.578+0000 7f1a17fff700 1 --2- 172.21.15.135:0/3758841707 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f1a000395b0 0x7f1a0003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:30.362 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.579+0000 7f1a17fff700 1 --2- 172.21.15.135:0/3758841707 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f1a000395b0 0x7f1a0003ba70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c006fd0 tx=0x7f1a0c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:30.362 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.583+0000 7f1a15ffb700 1 -- 172.21.15.135:0/3758841707 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f1a1002a020 con 0x7f1a18107590 2024-04-20T12:13:30.362 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:28.862+0000 7f1a1ef9b700 1 -- 172.21.15.135:0/3758841707 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f1a181939d0 con 0x7f1a18107590 2024-04-20T12:13:30.362 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:29.790+0000 7f1a15ffb700 1 -- 172.21.15.135:0/3758841707 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f1a181939d0 con 0x7f1a18107590 2024-04-20T12:13:30.362 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:29.791+0000 7f1a15ffb700 1 -- 172.21.15.135:0/3758841707 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f1a1002dc70 con 0x7f1a18107590 2024-04-20T12:13:30.362 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:29.793+0000 7f1a1ef9b700 1 -- 172.21.15.135:0/3758841707 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f1a000395b0 msgr2=0x7f1a0003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:30.362 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:29.793+0000 7f1a1ef9b700 1 --2- 172.21.15.135:0/3758841707 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f1a000395b0 0x7f1a0003ba70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c006fd0 tx=0x7f1a0c006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:30.362 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:29.793+0000 7f1a1ef9b700 1 -- 172.21.15.135:0/3758841707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a18107590 msgr2=0x7f1a1819e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:30.362 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:29.793+0000 7f1a1ef9b700 1 --2- 172.21.15.135:0/3758841707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a18107590 0x7f1a1819e880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009530 tx=0x7f1a10003d00 comp rx=0 tx=0).stop 2024-04-20T12:13:30.362 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:29.793+0000 7f1a1ef9b700 1 -- 172.21.15.135:0/3758841707 shutdown_connections 2024-04-20T12:13:30.362 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:29.793+0000 7f1a1ef9b700 1 --2- 172.21.15.135:0/3758841707 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f1a000395b0 0x7f1a0003ba70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:30.362 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:29.793+0000 7f1a1ef9b700 1 --2- 172.21.15.135:0/3758841707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a18107590 0x7f1a1819e880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:30.363 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:29.793+0000 7f1a1ef9b700 1 -- 172.21.15.135:0/3758841707 >> 172.21.15.135:0/3758841707 conn(0x7f1a18102bb0 msgr2=0x7f1a18190ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:30.363 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:29.793+0000 7f1a1ef9b700 1 -- 172.21.15.135:0/3758841707 shutdown_connections 2024-04-20T12:13:30.363 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:29.794+0000 7f1a1ef9b700 1 -- 172.21.15.135:0/3758841707 wait complete. 2024-04-20T12:13:30.604 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:30 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:30.582+0000 7f9d6e3b9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-20T12:13:30.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:30 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3758841707' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-20T12:13:30.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:30 smithi135 ceph-mon[18264]: mgrmap e9: x(active, since 19s) 2024-04-20T12:13:30.864 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:30 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:30.670+0000 7f9d6e3b9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-20T12:13:31.641 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-04-20T12:13:31.642 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-20T12:13:31.642 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-20T12:13:31.642 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-04-20T12:13:31.642 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-20T12:13:31.642 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-04-20T12:13:31.642 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.789+0000 7f8dc2347700 1 Processor -- start 2024-04-20T12:13:31.642 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.790+0000 7f8dc2347700 1 -- start start 2024-04-20T12:13:31.642 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.790+0000 7f8dc2347700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc108b70 0x7f8dbc108f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:31.642 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.790+0000 7f8dc2347700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc109560 con 0x7f8dbc108b70 2024-04-20T12:13:31.642 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.790+0000 7f8dbbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc108b70 0x7f8dbc108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:31.643 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.790+0000 7f8dbbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc108b70 0x7f8dbc108f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38474/0 (socket says 172.21.15.135:38474) 2024-04-20T12:13:31.643 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.790+0000 7f8dbbfff700 1 -- 172.21.15.135:0/722208015 learned_addr learned my addr 172.21.15.135:0/722208015 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:31.643 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.790+0000 7f8dbbfff700 1 -- 172.21.15.135:0/722208015 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc107780 con 0x7f8dbc108b70 2024-04-20T12:13:31.643 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.790+0000 7f8dbbfff700 1 --2- 172.21.15.135:0/722208015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc108b70 0x7f8dbc108f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0098a0 tx=0x7f8dac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0a77f18a67e26c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:31.643 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.792+0000 7f8dbaffd700 1 -- 172.21.15.135:0/722208015 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dac004160 con 0x7f8dbc108b70 2024-04-20T12:13:31.643 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.792+0000 7f8dbaffd700 1 -- 172.21.15.135:0/722208015 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dac004300 con 0x7f8dbc108b70 2024-04-20T12:13:31.643 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.792+0000 7f8dbaffd700 1 -- 172.21.15.135:0/722208015 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dac011b20 con 0x7f8dbc108b70 2024-04-20T12:13:31.643 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.793+0000 7f8dc2347700 1 -- 172.21.15.135:0/722208015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc108b70 msgr2=0x7f8dbc108f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:31.643 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.793+0000 7f8dc2347700 1 --2- 172.21.15.135:0/722208015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc108b70 0x7f8dbc108f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8dac0098a0 tx=0x7f8dac009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:31.643 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.793+0000 7f8dc2347700 1 -- 172.21.15.135:0/722208015 shutdown_connections 2024-04-20T12:13:31.643 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.793+0000 7f8dc2347700 1 --2- 172.21.15.135:0/722208015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc108b70 0x7f8dbc108f90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:31.643 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.793+0000 7f8dc2347700 1 -- 172.21.15.135:0/722208015 >> 172.21.15.135:0/722208015 conn(0x7f8dbc102310 msgr2=0x7f8dbc104730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:31.643 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.793+0000 7f8dc2347700 1 -- 172.21.15.135:0/722208015 shutdown_connections 2024-04-20T12:13:31.644 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.793+0000 7f8dc2347700 1 -- 172.21.15.135:0/722208015 wait complete. 2024-04-20T12:13:31.644 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.794+0000 7f8dc2347700 1 Processor -- start 2024-04-20T12:13:31.644 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.794+0000 7f8dc2347700 1 -- start start 2024-04-20T12:13:31.644 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.794+0000 7f8dc2347700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc108b70 0x7f8dbc1070f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:31.644 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.794+0000 7f8dc2347700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc10bb40 con 0x7f8dbc108b70 2024-04-20T12:13:31.644 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.794+0000 7f8dbbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc108b70 0x7f8dbc1070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:31.644 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.794+0000 7f8dbbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc108b70 0x7f8dbc1070f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38476/0 (socket says 172.21.15.135:38476) 2024-04-20T12:13:31.644 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.794+0000 7f8dbbfff700 1 -- 172.21.15.135:0/1190246785 learned_addr learned my addr 172.21.15.135:0/1190246785 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:31.644 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.795+0000 7f8dbbfff700 1 -- 172.21.15.135:0/1190246785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc19f3b0 con 0x7f8dbc108b70 2024-04-20T12:13:31.644 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.795+0000 7f8dbbfff700 1 --2- 172.21.15.135:0/1190246785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc108b70 0x7f8dbc1070f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8dac000c00 tx=0x7f8dac011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:31.644 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.795+0000 7f8db97fa700 1 -- 172.21.15.135:0/1190246785 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dac003b60 con 0x7f8dbc108b70 2024-04-20T12:13:31.644 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.795+0000 7f8db97fa700 1 -- 172.21.15.135:0/1190246785 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8dac01a910 con 0x7f8dbc108b70 2024-04-20T12:13:31.644 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.795+0000 7f8db97fa700 1 -- 172.21.15.135:0/1190246785 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dac024930 con 0x7f8dbc108b70 2024-04-20T12:13:31.644 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.795+0000 7f8dc2347700 1 -- 172.21.15.135:0/1190246785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dbc19f580 con 0x7f8dbc108b70 2024-04-20T12:13:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.795+0000 7f8dc2347700 1 -- 172.21.15.135:0/1190246785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dbc19f920 con 0x7f8dbc108b70 2024-04-20T12:13:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.796+0000 7f8dc2347700 1 -- 172.21.15.135:0/1190246785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dbc0640b0 con 0x7f8dbc108b70 2024-04-20T12:13:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.796+0000 7f8db97fa700 1 -- 172.21.15.135:0/1190246785 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f8dac022020 con 0x7f8dbc108b70 2024-04-20T12:13:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.796+0000 7f8db97fa700 1 --2- 172.21.15.135:0/1190246785 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8da4039660 0x7f8da403bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.796+0000 7f8db97fa700 1 -- 172.21.15.135:0/1190246785 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8dac04da40 con 0x7f8dbc108b70 2024-04-20T12:13:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.796+0000 7f8dbb7fe700 1 -- 172.21.15.135:0/1190246785 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8da4039660 msgr2=0x7f8da403bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/2178168771 2024-04-20T12:13:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.796+0000 7f8dbb7fe700 1 --2- 172.21.15.135:0/1190246785 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8da4039660 0x7f8da403bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T12:13:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.801+0000 7f8db97fa700 1 -- 172.21.15.135:0/1190246785 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f8dac04fe20 con 0x7f8dbc108b70 2024-04-20T12:13:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.997+0000 7f8dbb7fe700 1 -- 172.21.15.135:0/1190246785 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8da4039660 msgr2=0x7f8da403bb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/2178168771 2024-04-20T12:13:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:30.997+0000 7f8dbb7fe700 1 --2- 172.21.15.135:0/1190246785 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8da4039660 0x7f8da403bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-20T12:13:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:31.092+0000 7f8dc2347700 1 -- 172.21.15.135:0/1190246785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f8dbc19fd10 con 0x7f8dbc108b70 2024-04-20T12:13:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:31.093+0000 7f8db97fa700 1 -- 172.21.15.135:0/1190246785 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f8dac02c510 con 0x7f8dbc108b70 2024-04-20T12:13:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:31.099+0000 7f8dc2347700 1 -- 172.21.15.135:0/1190246785 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8da4039660 msgr2=0x7f8da403bb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T12:13:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:31.099+0000 7f8dc2347700 1 --2- 172.21.15.135:0/1190246785 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8da4039660 0x7f8da403bb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:31.645 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:31.099+0000 7f8dc2347700 1 -- 172.21.15.135:0/1190246785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc108b70 msgr2=0x7f8dbc1070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:31.646 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:31.099+0000 7f8dc2347700 1 --2- 172.21.15.135:0/1190246785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc108b70 0x7f8dbc1070f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8dac000c00 tx=0x7f8dac011c10 comp rx=0 tx=0).stop 2024-04-20T12:13:31.646 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:31.101+0000 7f8dc2347700 1 -- 172.21.15.135:0/1190246785 shutdown_connections 2024-04-20T12:13:31.646 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:31.101+0000 7f8dc2347700 1 --2- 172.21.15.135:0/1190246785 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f8da4039660 0x7f8da403bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:31.646 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:31.101+0000 7f8dc2347700 1 --2- 172.21.15.135:0/1190246785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8dbc108b70 0x7f8dbc1070f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:31.646 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:31.101+0000 7f8dc2347700 1 -- 172.21.15.135:0/1190246785 >> 172.21.15.135:0/1190246785 conn(0x7f8dbc102310 msgr2=0x7f8dbc102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:31.646 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:31.104+0000 7f8dc2347700 1 -- 172.21.15.135:0/1190246785 shutdown_connections 2024-04-20T12:13:31.646 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:31.104+0000 7f8dc2347700 1 -- 172.21.15.135:0/1190246785 wait complete. 2024-04-20T12:13:31.646 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for the mgr to restart... 2024-04-20T12:13:31.646 INFO:teuthology.orchestra.run.smithi135.stdout:Waiting for mgr epoch 9... 2024-04-20T12:13:32.077 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:31 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1190246785' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-20T12:13:32.077 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:31 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:31.900+0000 7f9d6e3b9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-20T12:13:32.077 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:32 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:32.076+0000 7f9d6e3b9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-20T12:13:32.364 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:32 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:32.249+0000 7f9d6e3b9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-20T12:13:32.834 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:32 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:32.538+0000 7f9d6e3b9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-20T12:13:32.834 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:32 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:32.630+0000 7f9d6e3b9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-20T12:13:32.834 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:32 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:32.833+0000 7f9d6e3b9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-20T12:13:33.113 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:33 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:33.026+0000 7f9d6e3b9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:13:33.864 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:33 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:33.624+0000 7f9d6e3b9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-20T12:13:34.344 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:34 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:34.046+0000 7f9d6e3b9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-20T12:13:34.344 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:34 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:34.142+0000 7f9d6e3b9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-20T12:13:34.344 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:34 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:34.344+0000 7f9d6e3b9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-20T12:13:35.245 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:34 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:34.894+0000 7f9d6e3b9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-20T12:13:35.245 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:34 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:34.991+0000 7f9d6e3b9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-20T12:13:35.578 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:35 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:35.244+0000 7f9d6e3b9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-20T12:13:35.578 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:35 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:35.383+0000 7f9d6e3b9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-20T12:13:35.578 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:35 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:35.481+0000 7f9d6e3b9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-20T12:13:35.864 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:35 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:35.602+0000 7f9d6e3b9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-20T12:13:36.364 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:35 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:35.904+0000 7f9d6e3b9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-20T12:13:36.773 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:36 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:36.500+0000 7f9d6e3b9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-20T12:13:36.773 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:13:36 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:13:36.717+0000 7f9d6e3b9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-20T12:13:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:36 smithi135 ceph-mon[18264]: Active manager daemon x restarted 2024-04-20T12:13:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:36 smithi135 ceph-mon[18264]: Activating manager daemon x 2024-04-20T12:13:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:36 smithi135 ceph-mon[18264]: osdmap e3: 0 total, 0 up, 0 in 2024-04-20T12:13:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:36 smithi135 ceph-mon[18264]: mgrmap e10: x(active, starting, since 0.00333263s) 2024-04-20T12:13:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:13:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-20T12:13:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T12:13:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T12:13:37.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T12:13:37.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:36 smithi135 ceph-mon[18264]: Manager daemon x is now available 2024-04-20T12:13:37.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:13:37.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-20T12:13:37.978 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-20T12:13:37.978 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:37 smithi135 ceph-mon[18264]: mgrmap e11: x(active, since 1.00592s) 2024-04-20T12:13:38.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout { 2024-04-20T12:13:38.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-20T12:13:38.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-20T12:13:38.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout } 2024-04-20T12:13:38.485 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.086+0000 7f4292f26700 1 Processor -- start 2024-04-20T12:13:38.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.086+0000 7f4292f26700 1 -- start start 2024-04-20T12:13:38.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.086+0000 7f4292f26700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f428c1086b0 0x7f428c108ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:38.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.086+0000 7f4292f26700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f428c1090a0 con 0x7f428c1086b0 2024-04-20T12:13:38.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.087+0000 7f4290cc2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f428c1086b0 0x7f428c108ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:38.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.087+0000 7f4290cc2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f428c1086b0 0x7f428c108ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38488/0 (socket says 172.21.15.135:38488) 2024-04-20T12:13:38.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.087+0000 7f4290cc2700 1 -- 172.21.15.135:0/3797027856 learned_addr learned my addr 172.21.15.135:0/3797027856 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:38.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.087+0000 7f4290cc2700 1 -- 172.21.15.135:0/3797027856 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428c109860 con 0x7f428c1086b0 2024-04-20T12:13:38.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.087+0000 7f4290cc2700 1 --2- 172.21.15.135:0/3797027856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f428c1086b0 0x7f428c108ad0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f42800098a0 tx=0x7f4280009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9ee21a93a39901 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:38.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.087+0000 7f428b7fe700 1 -- 172.21.15.135:0/3797027856 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4280004160 con 0x7f428c1086b0 2024-04-20T12:13:38.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.087+0000 7f428b7fe700 1 -- 172.21.15.135:0/3797027856 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4280004300 con 0x7f428c1086b0 2024-04-20T12:13:38.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.087+0000 7f428b7fe700 1 -- 172.21.15.135:0/3797027856 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4280011b20 con 0x7f428c1086b0 2024-04-20T12:13:38.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.088+0000 7f4292f26700 1 -- 172.21.15.135:0/3797027856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f428c1086b0 msgr2=0x7f428c108ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:38.486 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.088+0000 7f4292f26700 1 --2- 172.21.15.135:0/3797027856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f428c1086b0 0x7f428c108ad0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f42800098a0 tx=0x7f4280009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.088+0000 7f4292f26700 1 -- 172.21.15.135:0/3797027856 shutdown_connections 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.088+0000 7f4292f26700 1 --2- 172.21.15.135:0/3797027856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f428c1086b0 0x7f428c108ad0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.088+0000 7f4292f26700 1 -- 172.21.15.135:0/3797027856 >> 172.21.15.135:0/3797027856 conn(0x7f428c103cb0 msgr2=0x7f428c1060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.088+0000 7f4292f26700 1 -- 172.21.15.135:0/3797027856 shutdown_connections 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.088+0000 7f4292f26700 1 -- 172.21.15.135:0/3797027856 wait complete. 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.089+0000 7f4292f26700 1 Processor -- start 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.089+0000 7f4292f26700 1 -- start start 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.089+0000 7f4292f26700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f428c1086b0 0x7f428c19e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.089+0000 7f4292f26700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f428c10cc10 con 0x7f428c1086b0 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.089+0000 7f4290cc2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f428c1086b0 0x7f428c19e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.089+0000 7f4290cc2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f428c1086b0 0x7f428c19e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38502/0 (socket says 172.21.15.135:38502) 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.089+0000 7f4290cc2700 1 -- 172.21.15.135:0/2587154486 learned_addr learned my addr 172.21.15.135:0/2587154486 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.089+0000 7f4290cc2700 1 -- 172.21.15.135:0/2587154486 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428c19ed60 con 0x7f428c1086b0 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.090+0000 7f4290cc2700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f428c1086b0 0x7f428c19e820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f42800116a0 tx=0x7f4280011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.090+0000 7f4289ffb700 1 -- 172.21.15.135:0/2587154486 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4280003a40 con 0x7f428c1086b0 2024-04-20T12:13:38.487 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.090+0000 7f4292f26700 1 -- 172.21.15.135:0/2587154486 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f428c19eff0 con 0x7f428c1086b0 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.090+0000 7f4289ffb700 1 -- 172.21.15.135:0/2587154486 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4280003be0 con 0x7f428c1086b0 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.090+0000 7f4289ffb700 1 -- 172.21.15.135:0/2587154486 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f428001a720 con 0x7f428c1086b0 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.090+0000 7f4292f26700 1 -- 172.21.15.135:0/2587154486 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f428c19f450 con 0x7f428c1086b0 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.091+0000 7f4289ffb700 1 -- 172.21.15.135:0/2587154486 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 9) ==== 46571+0+0 (secure 0 0 0) 0x7f428001aa20 con 0x7f428c1086b0 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.091+0000 7f4289ffb700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f427c0395b0 0x7f427c03ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.091+0000 7f4289ffb700 1 -- 172.21.15.135:0/2587154486 --> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f427c03c180 con 0x7f427c0395b0 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.091+0000 7f4289ffb700 1 -- 172.21.15.135:0/2587154486 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f428004ed20 con 0x7f428c1086b0 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.091+0000 7f428bfff700 1 -- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f427c0395b0 msgr2=0x7f427c03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/2178168771 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.091+0000 7f428bfff700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f427c0395b0 0x7f427c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.292+0000 7f428bfff700 1 -- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f427c0395b0 msgr2=0x7f427c03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/2178168771 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.292+0000 7f428bfff700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f427c0395b0 0x7f427c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.693+0000 7f428bfff700 1 -- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f427c0395b0 msgr2=0x7f427c03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/2178168771 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:32.693+0000 7f428bfff700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f427c0395b0 0x7f427c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:33.494+0000 7f428bfff700 1 -- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f427c0395b0 msgr2=0x7f427c03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/2178168771 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:33.494+0000 7f428bfff700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f427c0395b0 0x7f427c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-20T12:13:38.488 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:35.095+0000 7f428bfff700 1 -- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f427c0395b0 msgr2=0x7f427c03ba70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/2178168771 2024-04-20T12:13:38.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:35.095+0000 7f428bfff700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f427c0395b0 0x7f427c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-20T12:13:38.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:36.720+0000 7f4289ffb700 1 -- 172.21.15.135:0/2587154486 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mgrmap(e 10) ==== 46338+0+0 (secure 0 0 0) 0x7f428002d910 con 0x7f428c1086b0 2024-04-20T12:13:38.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:36.720+0000 7f4289ffb700 1 -- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f427c0395b0 msgr2=0x7f427c03ba70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T12:13:38.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:36.720+0000 7f4289ffb700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f427c0395b0 0x7f427c03ba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:38.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.722+0000 7f4289ffb700 1 -- 172.21.15.135:0/2587154486 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 11) ==== 46465+0+0 (secure 0 0 0) 0x7f428004fc20 con 0x7f428c1086b0 2024-04-20T12:13:38.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.722+0000 7f4289ffb700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f427c03cfe0 0x7f427c03f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:38.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.722+0000 7f4289ffb700 1 -- 172.21.15.135:0/2587154486 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4280012ec0 con 0x7f427c03cfe0 2024-04-20T12:13:38.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.723+0000 7f428bfff700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f427c03cfe0 0x7f427c03f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:38.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.724+0000 7f428bfff700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f427c03cfe0 0x7f427c03f3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4278003a10 tx=0x7f42780092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:38.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.724+0000 7f4289ffb700 1 -- 172.21.15.135:0/2587154486 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f4280012ec0 con 0x7f427c03cfe0 2024-04-20T12:13:38.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.732+0000 7f4292f26700 1 -- 172.21.15.135:0/2587154486 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f428c10ca60 con 0x7f427c03cfe0 2024-04-20T12:13:38.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.732+0000 7f4289ffb700 1 -- 172.21.15.135:0/2587154486 <== mgr.14152 v2:172.21.15.135:6800/3831149339 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f428c10ca60 con 0x7f427c03cfe0 2024-04-20T12:13:38.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.733+0000 7f4292f26700 1 -- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f427c03cfe0 msgr2=0x7f427c03f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:38.489 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.733+0000 7f4292f26700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f427c03cfe0 0x7f427c03f3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4278003a10 tx=0x7f42780092b0 comp rx=0 tx=0).stop 2024-04-20T12:13:38.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.733+0000 7f4292f26700 1 -- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f428c1086b0 msgr2=0x7f428c19e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:38.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.733+0000 7f4292f26700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f428c1086b0 0x7f428c19e820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f42800116a0 tx=0x7f4280011ba0 comp rx=0 tx=0).stop 2024-04-20T12:13:38.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.733+0000 7f4292f26700 1 -- 172.21.15.135:0/2587154486 shutdown_connections 2024-04-20T12:13:38.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.733+0000 7f4292f26700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f427c03cfe0 0x7f427c03f3d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:38.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.733+0000 7f4292f26700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f428c1086b0 0x7f428c19e820 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:38.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.733+0000 7f4292f26700 1 --2- 172.21.15.135:0/2587154486 >> [v2:172.21.15.135:6800/2178168771,v1:172.21.15.135:6801/2178168771] conn(0x7f427c0395b0 0x7f427c03ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:38.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.733+0000 7f4292f26700 1 -- 172.21.15.135:0/2587154486 >> 172.21.15.135:0/2587154486 conn(0x7f428c103cb0 msgr2=0x7f428c104730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:38.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.733+0000 7f4292f26700 1 -- 172.21.15.135:0/2587154486 shutdown_connections 2024-04-20T12:13:38.490 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:37.733+0000 7f4292f26700 1 -- 172.21.15.135:0/2587154486 wait complete. 2024-04-20T12:13:38.490 INFO:teuthology.orchestra.run.smithi135.stdout:mgr epoch 9 is available 2024-04-20T12:13:38.490 INFO:teuthology.orchestra.run.smithi135.stdout:Generating a dashboard self-signed certificate... 2024-04-20T12:13:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:38 smithi135 ceph-mon[18264]: [20/Apr/2024:12:13:37] ENGINE Bus STARTING 2024-04-20T12:13:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:38 smithi135 ceph-mon[18264]: [20/Apr/2024:12:13:37] ENGINE Serving on http://172.21.15.135:8765 2024-04-20T12:13:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:38 smithi135 ceph-mon[18264]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-20T12:13:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:38 smithi135 ceph-mon[18264]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-20T12:13:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:38 smithi135 ceph-mon[18264]: [20/Apr/2024:12:13:37] ENGINE Serving on https://172.21.15.135:7150 2024-04-20T12:13:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:38 smithi135 ceph-mon[18264]: [20/Apr/2024:12:13:37] ENGINE Bus STARTED 2024-04-20T12:13:39.756 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.948+0000 7fa44a7a6700 1 Processor -- start 2024-04-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.948+0000 7fa44a7a6700 1 -- start start 2024-04-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.948+0000 7fa44a7a6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444108bb0 0x7fa444108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.948+0000 7fa44a7a6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa4441095a0 con 0x7fa444108bb0 2024-04-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.949+0000 7fa443fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444108bb0 0x7fa444108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.949+0000 7fa443fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444108bb0 0x7fa444108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38594/0 (socket says 172.21.15.135:38594) 2024-04-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.949+0000 7fa443fff700 1 -- 172.21.15.135:0/1314115268 learned_addr learned my addr 172.21.15.135:0/1314115268 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.949+0000 7fa443fff700 1 -- 172.21.15.135:0/1314115268 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa444107860 con 0x7fa444108bb0 2024-04-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.949+0000 7fa443fff700 1 --2- 172.21.15.135:0/1314115268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444108bb0 0x7fa444108fd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa4340098a0 tx=0x7fa434009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2be037d86d3fcd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.949+0000 7fa442ffd700 1 -- 172.21.15.135:0/1314115268 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa434004160 con 0x7fa444108bb0 2024-04-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.949+0000 7fa442ffd700 1 -- 172.21.15.135:0/1314115268 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa434004300 con 0x7fa444108bb0 2024-04-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.949+0000 7fa442ffd700 1 -- 172.21.15.135:0/1314115268 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa434011b20 con 0x7fa444108bb0 2024-04-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.950+0000 7fa44a7a6700 1 -- 172.21.15.135:0/1314115268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444108bb0 msgr2=0x7fa444108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:39.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.950+0000 7fa44a7a6700 1 --2- 172.21.15.135:0/1314115268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444108bb0 0x7fa444108fd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa4340098a0 tx=0x7fa434009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:39.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.950+0000 7fa44a7a6700 1 -- 172.21.15.135:0/1314115268 shutdown_connections 2024-04-20T12:13:39.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.950+0000 7fa44a7a6700 1 --2- 172.21.15.135:0/1314115268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444108bb0 0x7fa444108fd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:39.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.950+0000 7fa44a7a6700 1 -- 172.21.15.135:0/1314115268 >> 172.21.15.135:0/1314115268 conn(0x7fa444102370 msgr2=0x7fa444104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:39.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.950+0000 7fa44a7a6700 1 -- 172.21.15.135:0/1314115268 shutdown_connections 2024-04-20T12:13:39.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.950+0000 7fa44a7a6700 1 -- 172.21.15.135:0/1314115268 wait complete. 2024-04-20T12:13:39.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.951+0000 7fa44a7a6700 1 Processor -- start 2024-04-20T12:13:39.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.951+0000 7fa44a7a6700 1 -- start start 2024-04-20T12:13:39.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.951+0000 7fa44a7a6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444108bb0 0x7fa44419b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:39.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.951+0000 7fa44a7a6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa44410bc20 con 0x7fa444108bb0 2024-04-20T12:13:39.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.951+0000 7fa443fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444108bb0 0x7fa44419b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:39.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.951+0000 7fa443fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444108bb0 0x7fa44419b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38606/0 (socket says 172.21.15.135:38606) 2024-04-20T12:13:39.758 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.951+0000 7fa443fff700 1 -- 172.21.15.135:0/1552517113 learned_addr learned my addr 172.21.15.135:0/1552517113 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:39.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.951+0000 7fa443fff700 1 -- 172.21.15.135:0/1552517113 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44419baa0 con 0x7fa444108bb0 2024-04-20T12:13:39.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.952+0000 7fa443fff700 1 --2- 172.21.15.135:0/1552517113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444108bb0 0x7fa44419b560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa434000c00 tx=0x7fa434011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:39.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.952+0000 7fa4417fa700 1 -- 172.21.15.135:0/1552517113 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa434003b60 con 0x7fa444108bb0 2024-04-20T12:13:39.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.952+0000 7fa4417fa700 1 -- 172.21.15.135:0/1552517113 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa43401a910 con 0x7fa444108bb0 2024-04-20T12:13:39.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.952+0000 7fa44a7a6700 1 -- 172.21.15.135:0/1552517113 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa44419bd30 con 0x7fa444108bb0 2024-04-20T12:13:39.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.952+0000 7fa4417fa700 1 -- 172.21.15.135:0/1552517113 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa434024930 con 0x7fa444108bb0 2024-04-20T12:13:39.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.952+0000 7fa44a7a6700 1 -- 172.21.15.135:0/1552517113 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa44419c190 con 0x7fa444108bb0 2024-04-20T12:13:39.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.953+0000 7fa4417fa700 1 -- 172.21.15.135:0/1552517113 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7fa434022020 con 0x7fa444108bb0 2024-04-20T12:13:39.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.953+0000 7fa4417fa700 1 --2- 172.21.15.135:0/1552517113 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa42c039600 0x7fa42c03bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:39.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.953+0000 7fa4417fa700 1 -- 172.21.15.135:0/1552517113 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa43404da40 con 0x7fa444108bb0 2024-04-20T12:13:39.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.953+0000 7fa44a7a6700 1 -- 172.21.15.135:0/1552517113 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4440640b0 con 0x7fa444108bb0 2024-04-20T12:13:39.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.953+0000 7fa4437fe700 1 --2- 172.21.15.135:0/1552517113 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa42c039600 0x7fa42c03bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:39.759 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.953+0000 7fa4437fe700 1 --2- 172.21.15.135:0/1552517113 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa42c039600 0x7fa42c03bac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa438006fd0 tx=0x7fa438006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:39.760 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:38.958+0000 7fa4417fa700 1 -- 172.21.15.135:0/1552517113 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fa434021d80 con 0x7fa444108bb0 2024-04-20T12:13:39.760 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:39.166+0000 7fa44a7a6700 1 -- 172.21.15.135:0/1552517113 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fa444103590 con 0x7fa42c039600 2024-04-20T12:13:39.760 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:39.247+0000 7fa4417fa700 1 -- 172.21.15.135:0/1552517113 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fa444103590 con 0x7fa42c039600 2024-04-20T12:13:39.760 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:39.249+0000 7fa44a7a6700 1 -- 172.21.15.135:0/1552517113 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa42c039600 msgr2=0x7fa42c03bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:39.760 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:39.249+0000 7fa44a7a6700 1 --2- 172.21.15.135:0/1552517113 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa42c039600 0x7fa42c03bac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa438006fd0 tx=0x7fa438006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:39.760 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:39.249+0000 7fa44a7a6700 1 -- 172.21.15.135:0/1552517113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444108bb0 msgr2=0x7fa44419b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:39.760 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:39.249+0000 7fa44a7a6700 1 --2- 172.21.15.135:0/1552517113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444108bb0 0x7fa44419b560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa434000c00 tx=0x7fa434011c10 comp rx=0 tx=0).stop 2024-04-20T12:13:39.760 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:39.249+0000 7fa44a7a6700 1 -- 172.21.15.135:0/1552517113 shutdown_connections 2024-04-20T12:13:39.760 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:39.249+0000 7fa44a7a6700 1 --2- 172.21.15.135:0/1552517113 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa42c039600 0x7fa42c03bac0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:39.760 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:39.249+0000 7fa44a7a6700 1 --2- 172.21.15.135:0/1552517113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa444108bb0 0x7fa44419b560 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:39.760 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:39.250+0000 7fa44a7a6700 1 -- 172.21.15.135:0/1552517113 >> 172.21.15.135:0/1552517113 conn(0x7fa444102370 msgr2=0x7fa444102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:39.760 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:39.250+0000 7fa44a7a6700 1 -- 172.21.15.135:0/1552517113 shutdown_connections 2024-04-20T12:13:39.760 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:39.250+0000 7fa44a7a6700 1 -- 172.21.15.135:0/1552517113 wait complete. 2024-04-20T12:13:39.760 INFO:teuthology.orchestra.run.smithi135.stdout:Creating initial admin user... 2024-04-20T12:13:40.076 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:39 smithi135 ceph-mon[18264]: mgrmap e12: x(active, since 2s) 2024-04-20T12:13:40.076 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:40.076 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:40.076 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:41.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:40 smithi135 ceph-mon[18264]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:13:41.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:40 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:41.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$vCx8IFGzTG7THtmrd473Fe40bz41izolapM3bKeharK.5HWKv2FXO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1713615220, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-20T12:13:41.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.179+0000 7f904e6bc700 1 Processor -- start 2024-04-20T12:13:41.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.179+0000 7f904e6bc700 1 -- start start 2024-04-20T12:13:41.281 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.180+0000 7f904e6bc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9048109ca0 0x7f904810a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:41.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.180+0000 7f904e6bc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f904810a690 con 0x7f9048109ca0 2024-04-20T12:13:41.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.180+0000 7f9047fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9048109ca0 0x7f904810a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:41.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.180+0000 7f9047fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9048109ca0 0x7f904810a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38620/0 (socket says 172.21.15.135:38620) 2024-04-20T12:13:41.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.180+0000 7f9047fff700 1 -- 172.21.15.135:0/1399610673 learned_addr learned my addr 172.21.15.135:0/1399610673 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:41.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.180+0000 7f9047fff700 1 -- 172.21.15.135:0/1399610673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904810a810 con 0x7f9048109ca0 2024-04-20T12:13:41.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.180+0000 7f9047fff700 1 --2- 172.21.15.135:0/1399610673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9048109ca0 0x7f904810a0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f90380098a0 tx=0x7f9038009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcae194ce14c3df server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:41.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.180+0000 7f9046ffd700 1 -- 172.21.15.135:0/1399610673 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9038004160 con 0x7f9048109ca0 2024-04-20T12:13:41.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.180+0000 7f9046ffd700 1 -- 172.21.15.135:0/1399610673 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9038004300 con 0x7f9048109ca0 2024-04-20T12:13:41.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.180+0000 7f9046ffd700 1 -- 172.21.15.135:0/1399610673 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9038011b20 con 0x7f9048109ca0 2024-04-20T12:13:41.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.181+0000 7f904e6bc700 1 -- 172.21.15.135:0/1399610673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9048109ca0 msgr2=0x7f904810a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:41.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.181+0000 7f904e6bc700 1 --2- 172.21.15.135:0/1399610673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9048109ca0 0x7f904810a0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f90380098a0 tx=0x7f9038009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:41.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.181+0000 7f904e6bc700 1 -- 172.21.15.135:0/1399610673 shutdown_connections 2024-04-20T12:13:41.282 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.181+0000 7f904e6bc700 1 --2- 172.21.15.135:0/1399610673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9048109ca0 0x7f904810a0c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:41.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.181+0000 7f904e6bc700 1 -- 172.21.15.135:0/1399610673 >> 172.21.15.135:0/1399610673 conn(0x7f90481023c0 msgr2=0x7f90481047e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:41.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.181+0000 7f904e6bc700 1 -- 172.21.15.135:0/1399610673 shutdown_connections 2024-04-20T12:13:41.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.181+0000 7f904e6bc700 1 -- 172.21.15.135:0/1399610673 wait complete. 2024-04-20T12:13:41.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.181+0000 7f904e6bc700 1 Processor -- start 2024-04-20T12:13:41.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.182+0000 7f904e6bc700 1 -- start start 2024-04-20T12:13:41.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.182+0000 7f904e6bc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9048109ca0 0x7f904819c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:41.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.182+0000 7f904e6bc700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f90481075b0 con 0x7f9048109ca0 2024-04-20T12:13:41.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.182+0000 7f9047fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9048109ca0 0x7f904819c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:41.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.182+0000 7f9047fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9048109ca0 0x7f904819c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38628/0 (socket says 172.21.15.135:38628) 2024-04-20T12:13:41.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.182+0000 7f9047fff700 1 -- 172.21.15.135:0/4265203949 learned_addr learned my addr 172.21.15.135:0/4265203949 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:41.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.182+0000 7f9047fff700 1 -- 172.21.15.135:0/4265203949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f904819cb10 con 0x7f9048109ca0 2024-04-20T12:13:41.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.182+0000 7f9047fff700 1 --2- 172.21.15.135:0/4265203949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9048109ca0 0x7f904819c5d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f90380116a0 tx=0x7f9038011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:41.283 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.182+0000 7f90457fa700 1 -- 172.21.15.135:0/4265203949 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9038003a40 con 0x7f9048109ca0 2024-04-20T12:13:41.284 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.182+0000 7f90457fa700 1 -- 172.21.15.135:0/4265203949 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9038003be0 con 0x7f9048109ca0 2024-04-20T12:13:41.284 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.182+0000 7f90457fa700 1 -- 172.21.15.135:0/4265203949 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f903801a720 con 0x7f9048109ca0 2024-04-20T12:13:41.284 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.183+0000 7f904e6bc700 1 -- 172.21.15.135:0/4265203949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f904819ce00 con 0x7f9048109ca0 2024-04-20T12:13:41.284 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.183+0000 7f904e6bc700 1 -- 172.21.15.135:0/4265203949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f904819fa90 con 0x7f9048109ca0 2024-04-20T12:13:41.284 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.183+0000 7f90457fa700 1 -- 172.21.15.135:0/4265203949 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7f9038024aa0 con 0x7f9048109ca0 2024-04-20T12:13:41.284 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.184+0000 7f90457fa700 1 --2- 172.21.15.135:0/4265203949 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f90300395b0 0x7f903003ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:41.284 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.184+0000 7f904e6bc700 1 -- 172.21.15.135:0/4265203949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90480640b0 con 0x7f9048109ca0 2024-04-20T12:13:41.284 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.184+0000 7f90457fa700 1 -- 172.21.15.135:0/4265203949 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f903804de00 con 0x7f9048109ca0 2024-04-20T12:13:41.284 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.184+0000 7f90477fe700 1 --2- 172.21.15.135:0/4265203949 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f90300395b0 0x7f903003ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:41.284 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.184+0000 7f90477fe700 1 --2- 172.21.15.135:0/4265203949 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f90300395b0 0x7f903003ba70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f903c006fd0 tx=0x7f903c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:41.284 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.189+0000 7f90457fa700 1 -- 172.21.15.135:0/4265203949 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f9038011e20 con 0x7f9048109ca0 2024-04-20T12:13:41.284 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.415+0000 7f904e6bc700 1 -- 172.21.15.135:0/4265203949 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f904819fc60 con 0x7f90300395b0 2024-04-20T12:13:41.284 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.642+0000 7f90457fa700 1 -- 172.21.15.135:0/4265203949 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f904819fc60 con 0x7f90300395b0 2024-04-20T12:13:41.285 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.645+0000 7f904e6bc700 1 -- 172.21.15.135:0/4265203949 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f90300395b0 msgr2=0x7f903003ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:41.285 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.645+0000 7f904e6bc700 1 --2- 172.21.15.135:0/4265203949 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f90300395b0 0x7f903003ba70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f903c006fd0 tx=0x7f903c006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:41.285 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.645+0000 7f904e6bc700 1 -- 172.21.15.135:0/4265203949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9048109ca0 msgr2=0x7f904819c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:41.285 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.645+0000 7f904e6bc700 1 --2- 172.21.15.135:0/4265203949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9048109ca0 0x7f904819c5d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f90380116a0 tx=0x7f9038011ba0 comp rx=0 tx=0).stop 2024-04-20T12:13:41.285 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.645+0000 7f904e6bc700 1 -- 172.21.15.135:0/4265203949 shutdown_connections 2024-04-20T12:13:41.285 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.645+0000 7f904e6bc700 1 --2- 172.21.15.135:0/4265203949 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f90300395b0 0x7f903003ba70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:41.285 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.645+0000 7f904e6bc700 1 --2- 172.21.15.135:0/4265203949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9048109ca0 0x7f904819c5d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:41.285 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.645+0000 7f904e6bc700 1 -- 172.21.15.135:0/4265203949 >> 172.21.15.135:0/4265203949 conn(0x7f90481023c0 msgr2=0x7f9048102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:41.285 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.645+0000 7f904e6bc700 1 -- 172.21.15.135:0/4265203949 shutdown_connections 2024-04-20T12:13:41.285 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:40.645+0000 7f904e6bc700 1 -- 172.21.15.135:0/4265203949 wait complete. 2024-04-20T12:13:41.285 INFO:teuthology.orchestra.run.smithi135.stdout:Fetching dashboard port number... 2024-04-20T12:13:41.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:41 smithi135 ceph-mon[18264]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:13:41.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:41 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:43.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:42 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2212242465' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-20T12:13:43.202 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stdout 8443 2024-04-20T12:13:43.202 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.744+0000 7fd0f4e86700 1 Processor -- start 2024-04-20T12:13:43.202 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.744+0000 7fd0f4e86700 1 -- start start 2024-04-20T12:13:43.202 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.745+0000 7fd0f4e86700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0f0107ab0 0x7fd0f0107ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:43.202 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.745+0000 7fd0f4e86700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f01084a0 con 0x7fd0f0107ab0 2024-04-20T12:13:43.202 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.745+0000 7fd0ee59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0f0107ab0 0x7fd0f0107ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:43.202 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.745+0000 7fd0ee59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0f0107ab0 0x7fd0f0107ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48014/0 (socket says 172.21.15.135:48014) 2024-04-20T12:13:43.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.745+0000 7fd0ee59c700 1 -- 172.21.15.135:0/2863028303 learned_addr learned my addr 172.21.15.135:0/2863028303 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:43.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.745+0000 7fd0ee59c700 1 -- 172.21.15.135:0/2863028303 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f01087d0 con 0x7fd0f0107ab0 2024-04-20T12:13:43.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.745+0000 7fd0ee59c700 1 --2- 172.21.15.135:0/2863028303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0f0107ab0 0x7fd0f0107ed0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00098a0 tx=0x7fd0e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ff21f7d824ce7f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:43.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.746+0000 7fd0ed59a700 1 -- 172.21.15.135:0/2863028303 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e0004160 con 0x7fd0f0107ab0 2024-04-20T12:13:43.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.746+0000 7fd0ed59a700 1 -- 172.21.15.135:0/2863028303 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0e0004300 con 0x7fd0f0107ab0 2024-04-20T12:13:43.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.746+0000 7fd0ed59a700 1 -- 172.21.15.135:0/2863028303 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e0011b20 con 0x7fd0f0107ab0 2024-04-20T12:13:43.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.746+0000 7fd0f4e86700 1 -- 172.21.15.135:0/2863028303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0f0107ab0 msgr2=0x7fd0f0107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:43.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.746+0000 7fd0f4e86700 1 --2- 172.21.15.135:0/2863028303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0f0107ab0 0x7fd0f0107ed0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00098a0 tx=0x7fd0e0009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:43.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.747+0000 7fd0f4e86700 1 -- 172.21.15.135:0/2863028303 shutdown_connections 2024-04-20T12:13:43.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.747+0000 7fd0f4e86700 1 --2- 172.21.15.135:0/2863028303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0f0107ab0 0x7fd0f0107ed0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:43.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.747+0000 7fd0f4e86700 1 -- 172.21.15.135:0/2863028303 >> 172.21.15.135:0/2863028303 conn(0x7fd0f0102310 msgr2=0x7fd0f0104730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:43.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.747+0000 7fd0f4e86700 1 -- 172.21.15.135:0/2863028303 shutdown_connections 2024-04-20T12:13:43.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.747+0000 7fd0f4e86700 1 -- 172.21.15.135:0/2863028303 wait complete. 2024-04-20T12:13:43.203 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.747+0000 7fd0f4e86700 1 Processor -- start 2024-04-20T12:13:43.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.747+0000 7fd0f4e86700 1 -- start start 2024-04-20T12:13:43.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.747+0000 7fd0f4e86700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0f0107ab0 0x7fd0f01070b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:43.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.747+0000 7fd0f4e86700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f010bb80 con 0x7fd0f0107ab0 2024-04-20T12:13:43.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.748+0000 7fd0ee59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0f0107ab0 0x7fd0f01070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:43.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.748+0000 7fd0ee59c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0f0107ab0 0x7fd0f01070b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48016/0 (socket says 172.21.15.135:48016) 2024-04-20T12:13:43.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.748+0000 7fd0ee59c700 1 -- 172.21.15.135:0/2212242465 learned_addr learned my addr 172.21.15.135:0/2212242465 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:43.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.748+0000 7fd0ee59c700 1 -- 172.21.15.135:0/2212242465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f019d120 con 0x7fd0f0107ab0 2024-04-20T12:13:43.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.748+0000 7fd0ee59c700 1 --2- 172.21.15.135:0/2212242465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0f0107ab0 0x7fd0f01070b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00116a0 tx=0x7fd0e0011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:43.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.748+0000 7fd0df7fe700 1 -- 172.21.15.135:0/2212242465 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e0003a40 con 0x7fd0f0107ab0 2024-04-20T12:13:43.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.748+0000 7fd0f4e86700 1 -- 172.21.15.135:0/2212242465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0f01a1730 con 0x7fd0f0107ab0 2024-04-20T12:13:43.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.748+0000 7fd0df7fe700 1 -- 172.21.15.135:0/2212242465 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0e0003be0 con 0x7fd0f0107ab0 2024-04-20T12:13:43.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.748+0000 7fd0df7fe700 1 -- 172.21.15.135:0/2212242465 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e0003a40 con 0x7fd0f0107ab0 2024-04-20T12:13:43.204 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.748+0000 7fd0f4e86700 1 -- 172.21.15.135:0/2212242465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0f01a1ad0 con 0x7fd0f0107ab0 2024-04-20T12:13:43.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.749+0000 7fd0df7fe700 1 -- 172.21.15.135:0/2212242465 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 12) ==== 46571+0+0 (secure 0 0 0) 0x7fd0e00196c0 con 0x7fd0f0107ab0 2024-04-20T12:13:43.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.749+0000 7fd0df7fe700 1 --2- 172.21.15.135:0/2212242465 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd0d8039790 0x7fd0d803bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:43.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.749+0000 7fd0df7fe700 1 -- 172.21.15.135:0/2212242465 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd0e004ebf0 con 0x7fd0f0107ab0 2024-04-20T12:13:43.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.749+0000 7fd0f4e86700 1 -- 172.21.15.135:0/2212242465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0f00640b0 con 0x7fd0f0107ab0 2024-04-20T12:13:43.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.750+0000 7fd0edd9b700 1 --2- 172.21.15.135:0/2212242465 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd0d8039790 0x7fd0d803bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:43.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.750+0000 7fd0edd9b700 1 --2- 172.21.15.135:0/2212242465 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd0d8039790 0x7fd0d803bc50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4006fd0 tx=0x7fd0e4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:43.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.755+0000 7fd0df7fe700 1 -- 172.21.15.135:0/2212242465 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fd0e0011e20 con 0x7fd0f0107ab0 2024-04-20T12:13:43.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.973+0000 7fd0f4e86700 1 -- 172.21.15.135:0/2212242465 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fd0f01a20e0 con 0x7fd0f0107ab0 2024-04-20T12:13:43.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.973+0000 7fd0df7fe700 1 -- 172.21.15.135:0/2212242465 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fd0e004e420 con 0x7fd0f0107ab0 2024-04-20T12:13:43.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.975+0000 7fd0f4e86700 1 -- 172.21.15.135:0/2212242465 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd0d8039790 msgr2=0x7fd0d803bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:43.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.975+0000 7fd0f4e86700 1 --2- 172.21.15.135:0/2212242465 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd0d8039790 0x7fd0d803bc50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4006fd0 tx=0x7fd0e4006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:43.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.975+0000 7fd0f4e86700 1 -- 172.21.15.135:0/2212242465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0f0107ab0 msgr2=0x7fd0f01070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:43.205 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.975+0000 7fd0f4e86700 1 --2- 172.21.15.135:0/2212242465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0f0107ab0 0x7fd0f01070b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00116a0 tx=0x7fd0e0011ba0 comp rx=0 tx=0).stop 2024-04-20T12:13:43.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.975+0000 7fd0f4e86700 1 -- 172.21.15.135:0/2212242465 shutdown_connections 2024-04-20T12:13:43.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.975+0000 7fd0f4e86700 1 --2- 172.21.15.135:0/2212242465 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd0d8039790 0x7fd0d803bc50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:43.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.975+0000 7fd0f4e86700 1 --2- 172.21.15.135:0/2212242465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0f0107ab0 0x7fd0f01070b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:43.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.975+0000 7fd0f4e86700 1 -- 172.21.15.135:0/2212242465 >> 172.21.15.135:0/2212242465 conn(0x7fd0f0102310 msgr2=0x7fd0f0102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:43.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.975+0000 7fd0f4e86700 1 -- 172.21.15.135:0/2212242465 shutdown_connections 2024-04-20T12:13:43.206 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:41.975+0000 7fd0f4e86700 1 -- 172.21.15.135:0/2212242465 wait complete. 2024-04-20T12:13:43.207 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-20T12:13:43.207 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout disabled 2024-04-20T12:13:43.214 INFO:teuthology.orchestra.run.smithi135.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-20T12:13:43.215 INFO:teuthology.orchestra.run.smithi135.stdout:systemctl: stdout inactive 2024-04-20T12:13:43.215 INFO:teuthology.orchestra.run.smithi135.stdout:firewalld.service is not enabled 2024-04-20T12:13:43.215 INFO:teuthology.orchestra.run.smithi135.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-20T12:13:43.216 INFO:teuthology.orchestra.run.smithi135.stdout:Ceph Dashboard is now available at: 2024-04-20T12:13:43.216 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:13:43.216 INFO:teuthology.orchestra.run.smithi135.stdout: URL: https://smithi135:8443/ 2024-04-20T12:13:43.216 INFO:teuthology.orchestra.run.smithi135.stdout: User: admin 2024-04-20T12:13:43.216 INFO:teuthology.orchestra.run.smithi135.stdout: Password: qg4nmnu7vz 2024-04-20T12:13:43.216 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:13:43.217 INFO:teuthology.orchestra.run.smithi135.stdout:Saving cluster configuration to /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config directory 2024-04-20T12:13:43.217 INFO:teuthology.orchestra.run.smithi135.stdout:Enabling autotune for osd_memory_target 2024-04-20T12:13:44.107 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:43 smithi135 ceph-mon[18264]: mgrmap e13: x(active, since 6s) 2024-04-20T12:13:44.366 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.606+0000 7f8199116700 1 Processor -- start 2024-04-20T12:13:44.366 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.606+0000 7f8199116700 1 -- start start 2024-04-20T12:13:44.366 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.606+0000 7f8199116700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8194109140 0x7f819410b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:44.366 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.606+0000 7f8199116700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f819407be90 con 0x7f8194109140 2024-04-20T12:13:44.366 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.607+0000 7f8192d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8194109140 0x7f819410b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:44.366 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.607+0000 7f8192d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8194109140 0x7f819410b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48028/0 (socket says 172.21.15.135:48028) 2024-04-20T12:13:44.366 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.607+0000 7f8192d9d700 1 -- 172.21.15.135:0/842091359 learned_addr learned my addr 172.21.15.135:0/842091359 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:44.366 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.607+0000 7f8192d9d700 1 -- 172.21.15.135:0/842091359 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819410ba70 con 0x7f8194109140 2024-04-20T12:13:44.367 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.607+0000 7f8192d9d700 1 --2- 172.21.15.135:0/842091359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8194109140 0x7f819410b530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81840098a0 tx=0x7f8184009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9625a244acdba6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:44.367 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.607+0000 7f819259c700 1 -- 172.21.15.135:0/842091359 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8184004160 con 0x7f8194109140 2024-04-20T12:13:44.367 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.607+0000 7f819259c700 1 -- 172.21.15.135:0/842091359 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8184004300 con 0x7f8194109140 2024-04-20T12:13:44.367 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.607+0000 7f819259c700 1 -- 172.21.15.135:0/842091359 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8184011b20 con 0x7f8194109140 2024-04-20T12:13:44.367 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.608+0000 7f8199116700 1 -- 172.21.15.135:0/842091359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8194109140 msgr2=0x7f819410b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:44.367 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.608+0000 7f8199116700 1 --2- 172.21.15.135:0/842091359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8194109140 0x7f819410b530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81840098a0 tx=0x7f8184009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:44.367 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.608+0000 7f8199116700 1 -- 172.21.15.135:0/842091359 shutdown_connections 2024-04-20T12:13:44.367 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.608+0000 7f8199116700 1 --2- 172.21.15.135:0/842091359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8194109140 0x7f819410b530 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:44.367 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.608+0000 7f8199116700 1 -- 172.21.15.135:0/842091359 >> 172.21.15.135:0/842091359 conn(0x7f8194102b50 msgr2=0x7f8194104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:44.367 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.608+0000 7f8199116700 1 -- 172.21.15.135:0/842091359 shutdown_connections 2024-04-20T12:13:44.367 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.608+0000 7f8199116700 1 -- 172.21.15.135:0/842091359 wait complete. 2024-04-20T12:13:44.367 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.608+0000 7f8199116700 1 Processor -- start 2024-04-20T12:13:44.367 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.609+0000 7f8199116700 1 -- start start 2024-04-20T12:13:44.367 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.609+0000 7f8199116700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8194109140 0x7f81941089c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:44.368 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.609+0000 7f8199116700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f819410cad0 con 0x7f8194109140 2024-04-20T12:13:44.368 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.609+0000 7f8192d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8194109140 0x7f81941089c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:44.368 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.609+0000 7f8192d9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8194109140 0x7f81941089c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48038/0 (socket says 172.21.15.135:48038) 2024-04-20T12:13:44.368 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.609+0000 7f8192d9d700 1 -- 172.21.15.135:0/169211347 learned_addr learned my addr 172.21.15.135:0/169211347 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:44.368 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.609+0000 7f8192d9d700 1 -- 172.21.15.135:0/169211347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8194108f00 con 0x7f8194109140 2024-04-20T12:13:44.368 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.609+0000 7f8192d9d700 1 --2- 172.21.15.135:0/169211347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8194109140 0x7f81941089c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81840116a0 tx=0x7f8184011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:44.368 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.609+0000 7f8190d99700 1 -- 172.21.15.135:0/169211347 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8184003a40 con 0x7f8194109140 2024-04-20T12:13:44.368 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.610+0000 7f8190d99700 1 -- 172.21.15.135:0/169211347 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8184003be0 con 0x7f8194109140 2024-04-20T12:13:44.368 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.610+0000 7f8199116700 1 -- 172.21.15.135:0/169211347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81941070f0 con 0x7f8194109140 2024-04-20T12:13:44.368 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.610+0000 7f8190d99700 1 -- 172.21.15.135:0/169211347 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f818401a750 con 0x7f8194109140 2024-04-20T12:13:44.368 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.610+0000 7f8199116700 1 -- 172.21.15.135:0/169211347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81941075b0 con 0x7f8194109140 2024-04-20T12:13:44.368 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.610+0000 7f8190d99700 1 -- 172.21.15.135:0/169211347 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f818401aa50 con 0x7f8194109140 2024-04-20T12:13:44.368 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.611+0000 7f8199116700 1 -- 172.21.15.135:0/169211347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81940640b0 con 0x7f8194109140 2024-04-20T12:13:44.368 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.611+0000 7f8190d99700 1 --2- 172.21.15.135:0/169211347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8180039650 0x7f818003bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:44.368 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.611+0000 7f8190d99700 1 -- 172.21.15.135:0/169211347 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f818404e1b0 con 0x7f8194109140 2024-04-20T12:13:44.369 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.611+0000 7f818a59c700 1 --2- 172.21.15.135:0/169211347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8180039650 0x7f818003bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:44.369 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.611+0000 7f818a59c700 1 --2- 172.21.15.135:0/169211347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8180039650 0x7f818003bb10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f817c006fd0 tx=0x7f817c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:44.369 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.616+0000 7f8190d99700 1 -- 172.21.15.135:0/169211347 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f8184011e20 con 0x7f8194109140 2024-04-20T12:13:44.369 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.813+0000 7f8199116700 1 -- 172.21.15.135:0/169211347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f8194107830 con 0x7f8194109140 2024-04-20T12:13:44.369 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.814+0000 7f8190d99700 1 -- 172.21.15.135:0/169211347 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f818400ba00 con 0x7f8194109140 2024-04-20T12:13:44.369 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.816+0000 7f8199116700 1 -- 172.21.15.135:0/169211347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8180039650 msgr2=0x7f818003bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:44.369 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.816+0000 7f8199116700 1 --2- 172.21.15.135:0/169211347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8180039650 0x7f818003bb10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f817c006fd0 tx=0x7f817c006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:44.369 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.816+0000 7f8199116700 1 -- 172.21.15.135:0/169211347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8194109140 msgr2=0x7f81941089c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:44.369 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.816+0000 7f8199116700 1 --2- 172.21.15.135:0/169211347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8194109140 0x7f81941089c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81840116a0 tx=0x7f8184011ba0 comp rx=0 tx=0).stop 2024-04-20T12:13:44.369 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.816+0000 7f8199116700 1 -- 172.21.15.135:0/169211347 shutdown_connections 2024-04-20T12:13:44.369 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.816+0000 7f8199116700 1 --2- 172.21.15.135:0/169211347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8180039650 0x7f818003bb10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:44.369 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.816+0000 7f8199116700 1 --2- 172.21.15.135:0/169211347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8194109140 0x7f81941089c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:44.369 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.816+0000 7f8199116700 1 -- 172.21.15.135:0/169211347 >> 172.21.15.135:0/169211347 conn(0x7f8194102b50 msgr2=0x7f81941036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:44.369 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.816+0000 7f8199116700 1 -- 172.21.15.135:0/169211347 shutdown_connections 2024-04-20T12:13:44.369 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:43.816+0000 7f8199116700 1 -- 172.21.15.135:0/169211347 wait complete. 2024-04-20T12:13:45.681 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.760+0000 7f5b013a1700 1 Processor -- start 2024-04-20T12:13:45.681 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.760+0000 7f5b013a1700 1 -- start start 2024-04-20T12:13:45.681 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.760+0000 7f5b013a1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5afc109010 0x7f5afc10b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:45.681 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.760+0000 7f5b013a1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5afc07bdf0 con 0x7f5afc109010 2024-04-20T12:13:45.681 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.760+0000 7f5afbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5afc109010 0x7f5afc10b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:45.682 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.761+0000 7f5afbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5afc109010 0x7f5afc10b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48044/0 (socket says 172.21.15.135:48044) 2024-04-20T12:13:45.682 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.761+0000 7f5afbfff700 1 -- 172.21.15.135:0/2897209552 learned_addr learned my addr 172.21.15.135:0/2897209552 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:45.682 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.761+0000 7f5afbfff700 1 -- 172.21.15.135:0/2897209552 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5afc10b940 con 0x7f5afc109010 2024-04-20T12:13:45.682 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.761+0000 7f5afbfff700 1 --2- 172.21.15.135:0/2897209552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5afc109010 0x7f5afc10b400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0098a0 tx=0x7f5aec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67809dfa3c064aad server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:45.682 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.761+0000 7f5afaffd700 1 -- 172.21.15.135:0/2897209552 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5aec004160 con 0x7f5afc109010 2024-04-20T12:13:45.682 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.761+0000 7f5afaffd700 1 -- 172.21.15.135:0/2897209552 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aec004300 con 0x7f5afc109010 2024-04-20T12:13:45.682 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.761+0000 7f5afaffd700 1 -- 172.21.15.135:0/2897209552 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5aec011b20 con 0x7f5afc109010 2024-04-20T12:13:45.682 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.762+0000 7f5b013a1700 1 -- 172.21.15.135:0/2897209552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5afc109010 msgr2=0x7f5afc10b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:45.682 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.762+0000 7f5b013a1700 1 --2- 172.21.15.135:0/2897209552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5afc109010 0x7f5afc10b400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0098a0 tx=0x7f5aec009bb0 comp rx=0 tx=0).stop 2024-04-20T12:13:45.682 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.762+0000 7f5b013a1700 1 -- 172.21.15.135:0/2897209552 shutdown_connections 2024-04-20T12:13:45.682 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.762+0000 7f5b013a1700 1 --2- 172.21.15.135:0/2897209552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5afc109010 0x7f5afc10b400 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:45.682 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.762+0000 7f5b013a1700 1 -- 172.21.15.135:0/2897209552 >> 172.21.15.135:0/2897209552 conn(0x7f5afc1029e0 msgr2=0x7f5afc104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:45.682 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.762+0000 7f5b013a1700 1 -- 172.21.15.135:0/2897209552 shutdown_connections 2024-04-20T12:13:45.683 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.762+0000 7f5b013a1700 1 -- 172.21.15.135:0/2897209552 wait complete. 2024-04-20T12:13:45.683 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.762+0000 7f5b013a1700 1 Processor -- start 2024-04-20T12:13:45.683 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.762+0000 7f5b013a1700 1 -- start start 2024-04-20T12:13:45.683 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.763+0000 7f5b013a1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5afc109010 0x7f5afc19c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:45.683 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.763+0000 7f5b013a1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5afc10c8e0 con 0x7f5afc109010 2024-04-20T12:13:45.683 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.763+0000 7f5afbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5afc109010 0x7f5afc19c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:45.683 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.763+0000 7f5afbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5afc109010 0x7f5afc19c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48056/0 (socket says 172.21.15.135:48056) 2024-04-20T12:13:45.683 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.763+0000 7f5afbfff700 1 -- 172.21.15.135:0/4162304362 learned_addr learned my addr 172.21.15.135:0/4162304362 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:45.683 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.763+0000 7f5afbfff700 1 -- 172.21.15.135:0/4162304362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5afc19c9a0 con 0x7f5afc109010 2024-04-20T12:13:45.683 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.763+0000 7f5afbfff700 1 --2- 172.21.15.135:0/4162304362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5afc109010 0x7f5afc19c460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0116a0 tx=0x7f5aec011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:45.683 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.763+0000 7f5af97fa700 1 -- 172.21.15.135:0/4162304362 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5aec003a40 con 0x7f5afc109010 2024-04-20T12:13:45.683 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.763+0000 7f5af97fa700 1 -- 172.21.15.135:0/4162304362 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5aec003be0 con 0x7f5afc109010 2024-04-20T12:13:45.683 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.763+0000 7f5af97fa700 1 -- 172.21.15.135:0/4162304362 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5aec01a750 con 0x7f5afc109010 2024-04-20T12:13:45.683 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.763+0000 7f5b013a1700 1 -- 172.21.15.135:0/4162304362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5afc19cc30 con 0x7f5afc109010 2024-04-20T12:13:45.683 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.763+0000 7f5b013a1700 1 -- 172.21.15.135:0/4162304362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5afc19d090 con 0x7f5afc109010 2024-04-20T12:13:45.684 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.764+0000 7f5af97fa700 1 -- 172.21.15.135:0/4162304362 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f5aec01aa50 con 0x7f5afc109010 2024-04-20T12:13:45.684 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.764+0000 7f5b013a1700 1 -- 172.21.15.135:0/4162304362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5afc069ba0 con 0x7f5afc109010 2024-04-20T12:13:45.684 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.764+0000 7f5af97fa700 1 --2- 172.21.15.135:0/4162304362 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ae4039650 0x7f5ae403bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:45.684 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.764+0000 7f5af97fa700 1 -- 172.21.15.135:0/4162304362 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5aec04e0d0 con 0x7f5afc109010 2024-04-20T12:13:45.684 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.765+0000 7f5afb7fe700 1 --2- 172.21.15.135:0/4162304362 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ae4039650 0x7f5ae403bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:45.684 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.765+0000 7f5afb7fe700 1 --2- 172.21.15.135:0/4162304362 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ae4039650 0x7f5ae403bb10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5af0006fd0 tx=0x7f5af0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:45.684 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:44.769+0000 7f5af97fa700 1 -- 172.21.15.135:0/4162304362 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f5aec011e20 con 0x7f5afc109010 2024-04-20T12:13:45.684 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:45.084+0000 7f5b013a1700 1 -- 172.21.15.135:0/4162304362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f5afc19fa60 con 0x7f5afc109010 2024-04-20T12:13:45.684 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:45.086+0000 7f5af97fa700 1 -- 172.21.15.135:0/4162304362 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f5aec019c70 con 0x7f5afc109010 2024-04-20T12:13:45.684 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:45.088+0000 7f5b013a1700 1 -- 172.21.15.135:0/4162304362 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ae4039650 msgr2=0x7f5ae403bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:45.684 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:45.088+0000 7f5b013a1700 1 --2- 172.21.15.135:0/4162304362 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ae4039650 0x7f5ae403bb10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5af0006fd0 tx=0x7f5af0006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:45.684 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:45.088+0000 7f5b013a1700 1 -- 172.21.15.135:0/4162304362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5afc109010 msgr2=0x7f5afc19c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:45.684 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:45.088+0000 7f5b013a1700 1 --2- 172.21.15.135:0/4162304362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5afc109010 0x7f5afc19c460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0116a0 tx=0x7f5aec011ba0 comp rx=0 tx=0).stop 2024-04-20T12:13:45.684 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:45.088+0000 7f5b013a1700 1 -- 172.21.15.135:0/4162304362 shutdown_connections 2024-04-20T12:13:45.684 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:45.088+0000 7f5b013a1700 1 --2- 172.21.15.135:0/4162304362 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ae4039650 0x7f5ae403bb10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:45.088+0000 7f5b013a1700 1 --2- 172.21.15.135:0/4162304362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5afc109010 0x7f5afc19c460 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:45.088+0000 7f5b013a1700 1 -- 172.21.15.135:0/4162304362 >> 172.21.15.135:0/4162304362 conn(0x7f5afc1029e0 msgr2=0x7f5afc1034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:45.088+0000 7f5b013a1700 1 -- 172.21.15.135:0/4162304362 shutdown_connections 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr 2024-04-20T12:13:45.088+0000 7f5b013a1700 1 -- 172.21.15.135:0/4162304362 wait complete. 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout:Or, if you are only running a single cluster on this host: 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:13:45.685 INFO:teuthology.orchestra.run.smithi135.stdout: ceph telemetry on 2024-04-20T12:13:45.686 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:13:45.686 INFO:teuthology.orchestra.run.smithi135.stdout:For more information see: 2024-04-20T12:13:45.686 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:13:45.686 INFO:teuthology.orchestra.run.smithi135.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-04-20T12:13:45.686 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:13:45.686 INFO:teuthology.orchestra.run.smithi135.stdout:Bootstrap complete. 2024-04-20T12:13:45.713 INFO:tasks.cephadm:Fetching config... 2024-04-20T12:13:45.713 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:13:45.713 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-20T12:13:45.728 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-20T12:13:45.728 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:13:45.728 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-20T12:13:45.782 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-20T12:13:45.782 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:13:45.783 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/keyring of=/dev/stdout 2024-04-20T12:13:45.847 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-20T12:13:45.847 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:13:45.847 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-20T12:13:45.902 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-20T12:13:45.902 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD0rHYL/H7Q/0tHUvFVU/5YlvNa9Or6xs0XL1ZYAc9yW2nwu8vRBUe+AVEKAB7txQy7TxRfcTYC525aosjgEzSff5i63p3yMM9hVK602AD3dkytsdf4ma2YODfQb34L2b8UG+xm4iTmzzUzqV0zFjaVINNFWhck8hQ3gBVAUw3RlQI2Er65jRbWylnigsIUDsaMYSvXkH4iDtcnNNJIh2BTK+RERQ+Lbk5+PY2OFh0zfxwpYH1ORz/I1IeR0a8MiKTTEOaRJ1YQk6nZ8pa/C6+3f8b83x6QYpP2Sv1+lfaDdX2UkHop73GPVTk1ZZTPbnGss3bFxMeBwdQjHcxu6i62N3OYwE6QcnX74ixXDFpeHabBWRLwAUqo8eoriyeFGLGUOAmvZLacu0S9DeocCJJmio2BPBbiYRGcNuAQH01K+VstEcVxR34R/heDTg7XHxzk0oZDHU1oldDl+nk6Aa456Br+pTKg+uaWKkzcvErHV5bbS+VqNJvdB45HGX0bZmE= ceph-22180be8-ff0f-11ee-bc92-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-20T12:13:45.980 INFO:teuthology.orchestra.run.smithi135.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD0rHYL/H7Q/0tHUvFVU/5YlvNa9Or6xs0XL1ZYAc9yW2nwu8vRBUe+AVEKAB7txQy7TxRfcTYC525aosjgEzSff5i63p3yMM9hVK602AD3dkytsdf4ma2YODfQb34L2b8UG+xm4iTmzzUzqV0zFjaVINNFWhck8hQ3gBVAUw3RlQI2Er65jRbWylnigsIUDsaMYSvXkH4iDtcnNNJIh2BTK+RERQ+Lbk5+PY2OFh0zfxwpYH1ORz/I1IeR0a8MiKTTEOaRJ1YQk6nZ8pa/C6+3f8b83x6QYpP2Sv1+lfaDdX2UkHop73GPVTk1ZZTPbnGss3bFxMeBwdQjHcxu6i62N3OYwE6QcnX74ixXDFpeHabBWRLwAUqo8eoriyeFGLGUOAmvZLacu0S9DeocCJJmio2BPBbiYRGcNuAQH01K+VstEcVxR34R/heDTg7XHxzk0oZDHU1oldDl+nk6Aa456Br+pTKg+uaWKkzcvErHV5bbS+VqNJvdB45HGX0bZmE= ceph-22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:13:45.996 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD0rHYL/H7Q/0tHUvFVU/5YlvNa9Or6xs0XL1ZYAc9yW2nwu8vRBUe+AVEKAB7txQy7TxRfcTYC525aosjgEzSff5i63p3yMM9hVK602AD3dkytsdf4ma2YODfQb34L2b8UG+xm4iTmzzUzqV0zFjaVINNFWhck8hQ3gBVAUw3RlQI2Er65jRbWylnigsIUDsaMYSvXkH4iDtcnNNJIh2BTK+RERQ+Lbk5+PY2OFh0zfxwpYH1ORz/I1IeR0a8MiKTTEOaRJ1YQk6nZ8pa/C6+3f8b83x6QYpP2Sv1+lfaDdX2UkHop73GPVTk1ZZTPbnGss3bFxMeBwdQjHcxu6i62N3OYwE6QcnX74ixXDFpeHabBWRLwAUqo8eoriyeFGLGUOAmvZLacu0S9DeocCJJmio2BPBbiYRGcNuAQH01K+VstEcVxR34R/heDTg7XHxzk0oZDHU1oldDl+nk6Aa456Br+pTKg+uaWKkzcvErHV5bbS+VqNJvdB45HGX0bZmE= ceph-22180be8-ff0f-11ee-bc92-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-20T12:13:46.035 INFO:teuthology.orchestra.run.smithi139.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD0rHYL/H7Q/0tHUvFVU/5YlvNa9Or6xs0XL1ZYAc9yW2nwu8vRBUe+AVEKAB7txQy7TxRfcTYC525aosjgEzSff5i63p3yMM9hVK602AD3dkytsdf4ma2YODfQb34L2b8UG+xm4iTmzzUzqV0zFjaVINNFWhck8hQ3gBVAUw3RlQI2Er65jRbWylnigsIUDsaMYSvXkH4iDtcnNNJIh2BTK+RERQ+Lbk5+PY2OFh0zfxwpYH1ORz/I1IeR0a8MiKTTEOaRJ1YQk6nZ8pa/C6+3f8b83x6QYpP2Sv1+lfaDdX2UkHop73GPVTk1ZZTPbnGss3bFxMeBwdQjHcxu6i62N3OYwE6QcnX74ixXDFpeHabBWRLwAUqo8eoriyeFGLGUOAmvZLacu0S9DeocCJJmio2BPBbiYRGcNuAQH01K+VstEcVxR34R/heDTg7XHxzk0oZDHU1oldDl+nk6Aa456Br+pTKg+uaWKkzcvErHV5bbS+VqNJvdB45HGX0bZmE= ceph-22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:13:46.046 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD0rHYL/H7Q/0tHUvFVU/5YlvNa9Or6xs0XL1ZYAc9yW2nwu8vRBUe+AVEKAB7txQy7TxRfcTYC525aosjgEzSff5i63p3yMM9hVK602AD3dkytsdf4ma2YODfQb34L2b8UG+xm4iTmzzUzqV0zFjaVINNFWhck8hQ3gBVAUw3RlQI2Er65jRbWylnigsIUDsaMYSvXkH4iDtcnNNJIh2BTK+RERQ+Lbk5+PY2OFh0zfxwpYH1ORz/I1IeR0a8MiKTTEOaRJ1YQk6nZ8pa/C6+3f8b83x6QYpP2Sv1+lfaDdX2UkHop73GPVTk1ZZTPbnGss3bFxMeBwdQjHcxu6i62N3OYwE6QcnX74ixXDFpeHabBWRLwAUqo8eoriyeFGLGUOAmvZLacu0S9DeocCJJmio2BPBbiYRGcNuAQH01K+VstEcVxR34R/heDTg7XHxzk0oZDHU1oldDl+nk6Aa456Br+pTKg+uaWKkzcvErHV5bbS+VqNJvdB45HGX0bZmE= ceph-22180be8-ff0f-11ee-bc92-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-20T12:13:46.085 INFO:teuthology.orchestra.run.smithi154.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD0rHYL/H7Q/0tHUvFVU/5YlvNa9Or6xs0XL1ZYAc9yW2nwu8vRBUe+AVEKAB7txQy7TxRfcTYC525aosjgEzSff5i63p3yMM9hVK602AD3dkytsdf4ma2YODfQb34L2b8UG+xm4iTmzzUzqV0zFjaVINNFWhck8hQ3gBVAUw3RlQI2Er65jRbWylnigsIUDsaMYSvXkH4iDtcnNNJIh2BTK+RERQ+Lbk5+PY2OFh0zfxwpYH1ORz/I1IeR0a8MiKTTEOaRJ1YQk6nZ8pa/C6+3f8b83x6QYpP2Sv1+lfaDdX2UkHop73GPVTk1ZZTPbnGss3bFxMeBwdQjHcxu6i62N3OYwE6QcnX74ixXDFpeHabBWRLwAUqo8eoriyeFGLGUOAmvZLacu0S9DeocCJJmio2BPBbiYRGcNuAQH01K+VstEcVxR34R/heDTg7XHxzk0oZDHU1oldDl+nk6Aa456Br+pTKg+uaWKkzcvErHV5bbS+VqNJvdB45HGX0bZmE= ceph-22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:13:46.097 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-20T12:13:46.335 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:13:46.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:46 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/4162304362' entity='client.admin' 2024-04-20T12:13:48.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.438+0000 7f3317a27700 1 -- 172.21.15.135:0/1877104717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3310103af0 msgr2=0x7f3310103f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:48.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.438+0000 7f3317a27700 1 --2- 172.21.15.135:0/1877104717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3310103af0 0x7f3310103f10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f330c009910 tx=0x7f330c009c20 comp rx=0 tx=0).stop 2024-04-20T12:13:48.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.438+0000 7f3317a27700 1 -- 172.21.15.135:0/1877104717 shutdown_connections 2024-04-20T12:13:48.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.438+0000 7f3317a27700 1 --2- 172.21.15.135:0/1877104717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3310103af0 0x7f3310103f10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:48.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.438+0000 7f3317a27700 1 -- 172.21.15.135:0/1877104717 >> 172.21.15.135:0/1877104717 conn(0x7f33100fc130 msgr2=0x7f33100fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:48.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.438+0000 7f3317a27700 1 -- 172.21.15.135:0/1877104717 shutdown_connections 2024-04-20T12:13:48.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.438+0000 7f3317a27700 1 -- 172.21.15.135:0/1877104717 wait complete. 2024-04-20T12:13:48.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.439+0000 7f3317a27700 1 Processor -- start 2024-04-20T12:13:48.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.439+0000 7f3317a27700 1 -- start start 2024-04-20T12:13:48.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.439+0000 7f3317a27700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3310103af0 0x7f3310197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:48.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.439+0000 7f3317a27700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33101084d0 con 0x7f3310103af0 2024-04-20T12:13:48.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.439+0000 7f33157c3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3310103af0 0x7f3310197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:48.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.439+0000 7f33157c3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3310103af0 0x7f3310197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48074/0 (socket says 172.21.15.135:48074) 2024-04-20T12:13:48.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.439+0000 7f33157c3700 1 -- 172.21.15.135:0/3044988268 learned_addr learned my addr 172.21.15.135:0/3044988268 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:48.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.439+0000 7f33157c3700 1 -- 172.21.15.135:0/3044988268 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3310198080 con 0x7f3310103af0 2024-04-20T12:13:48.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.439+0000 7f33157c3700 1 --2- 172.21.15.135:0/3044988268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3310103af0 0x7f3310197b40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f330c006010 tx=0x7f330c005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:48.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.440+0000 7f33067fc700 1 -- 172.21.15.135:0/3044988268 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c027070 con 0x7f3310103af0 2024-04-20T12:13:48.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.440+0000 7f33067fc700 1 -- 172.21.15.135:0/3044988268 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f330c00be40 con 0x7f3310103af0 2024-04-20T12:13:48.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.440+0000 7f33067fc700 1 -- 172.21.15.135:0/3044988268 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f330c00f460 con 0x7f3310103af0 2024-04-20T12:13:48.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.440+0000 7f3317a27700 1 -- 172.21.15.135:0/3044988268 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3310198370 con 0x7f3310103af0 2024-04-20T12:13:48.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.440+0000 7f3317a27700 1 -- 172.21.15.135:0/3044988268 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f331019b000 con 0x7f3310103af0 2024-04-20T12:13:48.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.441+0000 7f33067fc700 1 -- 172.21.15.135:0/3044988268 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f330c02a070 con 0x7f3310103af0 2024-04-20T12:13:48.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.441+0000 7f3317a27700 1 -- 172.21.15.135:0/3044988268 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3310108c50 con 0x7f3310103af0 2024-04-20T12:13:48.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.441+0000 7f33067fc700 1 --2- 172.21.15.135:0/3044988268 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f32fc0396b0 0x7f32fc03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:48.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.441+0000 7f33067fc700 1 -- 172.21.15.135:0/3044988268 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f330c01e030 con 0x7f3310103af0 2024-04-20T12:13:48.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.441+0000 7f3314fc2700 1 --2- 172.21.15.135:0/3044988268 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f32fc0396b0 0x7f32fc03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:48.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.441+0000 7f3314fc2700 1 --2- 172.21.15.135:0/3044988268 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f32fc0396b0 0x7f32fc03bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3300006fd0 tx=0x7f3300006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:48.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.446+0000 7f33067fc700 1 -- 172.21.15.135:0/3044988268 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f330c013070 con 0x7f3310103af0 2024-04-20T12:13:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.652+0000 7f3317a27700 1 -- 172.21.15.135:0/3044988268 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f331002e180 con 0x7f3310103af0 2024-04-20T12:13:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.655+0000 7f33067fc700 1 -- 172.21.15.135:0/3044988268 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f330c031020 con 0x7f3310103af0 2024-04-20T12:13:48.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.657+0000 7f3317a27700 1 -- 172.21.15.135:0/3044988268 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f32fc0396b0 msgr2=0x7f32fc03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:48.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.657+0000 7f3317a27700 1 --2- 172.21.15.135:0/3044988268 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f32fc0396b0 0x7f32fc03bb70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3300006fd0 tx=0x7f3300006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:48.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.657+0000 7f3317a27700 1 -- 172.21.15.135:0/3044988268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3310103af0 msgr2=0x7f3310197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.657+0000 7f3317a27700 1 --2- 172.21.15.135:0/3044988268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3310103af0 0x7f3310197b40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f330c006010 tx=0x7f330c005050 comp rx=0 tx=0).stop 2024-04-20T12:13:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.657+0000 7f3317a27700 1 -- 172.21.15.135:0/3044988268 shutdown_connections 2024-04-20T12:13:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.657+0000 7f3317a27700 1 --2- 172.21.15.135:0/3044988268 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f32fc0396b0 0x7f32fc03bb70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.657+0000 7f3317a27700 1 --2- 172.21.15.135:0/3044988268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3310103af0 0x7f3310197b40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.657+0000 7f3317a27700 1 -- 172.21.15.135:0/3044988268 >> 172.21.15.135:0/3044988268 conn(0x7f33100fc130 msgr2=0x7f33100fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.657+0000 7f3317a27700 1 -- 172.21.15.135:0/3044988268 shutdown_connections 2024-04-20T12:13:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:48.657+0000 7f3317a27700 1 -- 172.21.15.135:0/3044988268 wait complete. 2024-04-20T12:13:49.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:49.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:49.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:13:49.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:49.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:13:49.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:49.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:49 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3044988268' entity='client.admin' 2024-04-20T12:13:49.243 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:13:49.244 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:49.268 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-20T12:13:49.269 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-20T12:13:49.509 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:13:50.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.871+0000 7f7cb3f5a700 1 -- 172.21.15.135:0/1951020675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cac1024c0 msgr2=0x7f7cac1028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:50.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.871+0000 7f7cb3f5a700 1 --2- 172.21.15.135:0/1951020675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cac1024c0 0x7f7cac1028e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009910 tx=0x7f7ca8009c20 comp rx=0 tx=0).stop 2024-04-20T12:13:50.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.872+0000 7f7cb3f5a700 1 -- 172.21.15.135:0/1951020675 shutdown_connections 2024-04-20T12:13:50.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.872+0000 7f7cb3f5a700 1 --2- 172.21.15.135:0/1951020675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cac1024c0 0x7f7cac1028e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.872+0000 7f7cb3f5a700 1 -- 172.21.15.135:0/1951020675 >> 172.21.15.135:0/1951020675 conn(0x7f7cac0fda80 msgr2=0x7f7cac0ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.872+0000 7f7cb3f5a700 1 -- 172.21.15.135:0/1951020675 shutdown_connections 2024-04-20T12:13:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.872+0000 7f7cb3f5a700 1 -- 172.21.15.135:0/1951020675 wait complete. 2024-04-20T12:13:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.872+0000 7f7cb3f5a700 1 Processor -- start 2024-04-20T12:13:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.872+0000 7f7cb3f5a700 1 -- start start 2024-04-20T12:13:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.872+0000 7f7cb3f5a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cac1024c0 0x7f7cac0766c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.872+0000 7f7cb3f5a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7cac108550 con 0x7f7cac1024c0 2024-04-20T12:13:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.872+0000 7f7cb1cf6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cac1024c0 0x7f7cac0766c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.873+0000 7f7cb1cf6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cac1024c0 0x7f7cac0766c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58946/0 (socket says 172.21.15.135:58946) 2024-04-20T12:13:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.873+0000 7f7cb1cf6700 1 -- 172.21.15.135:0/496789342 learned_addr learned my addr 172.21.15.135:0/496789342 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.873+0000 7f7cb1cf6700 1 -- 172.21.15.135:0/496789342 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cac076c00 con 0x7f7cac1024c0 2024-04-20T12:13:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.873+0000 7f7cb1cf6700 1 --2- 172.21.15.135:0/496789342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cac1024c0 0x7f7cac0766c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800b980 tx=0x7f7ca800ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.873+0000 7f7ca2ffd700 1 -- 172.21.15.135:0/496789342 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca8026070 con 0x7f7cac1024c0 2024-04-20T12:13:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.873+0000 7f7cb3f5a700 1 -- 172.21.15.135:0/496789342 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cac074e40 con 0x7f7cac1024c0 2024-04-20T12:13:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.873+0000 7f7ca2ffd700 1 -- 172.21.15.135:0/496789342 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7ca8005dc0 con 0x7f7cac1024c0 2024-04-20T12:13:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.873+0000 7f7ca2ffd700 1 -- 172.21.15.135:0/496789342 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ca8003d20 con 0x7f7cac1024c0 2024-04-20T12:13:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.873+0000 7f7cb3f5a700 1 -- 172.21.15.135:0/496789342 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cac075320 con 0x7f7cac1024c0 2024-04-20T12:13:50.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.874+0000 7f7ca2ffd700 1 -- 172.21.15.135:0/496789342 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f7ca8029070 con 0x7f7cac1024c0 2024-04-20T12:13:50.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.874+0000 7f7cb3f5a700 1 -- 172.21.15.135:0/496789342 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cac108cd0 con 0x7f7cac1024c0 2024-04-20T12:13:50.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.874+0000 7f7ca2ffd700 1 --2- 172.21.15.135:0/496789342 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7c98039650 0x7f7c9803bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:50.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.874+0000 7f7ca2ffd700 1 -- 172.21.15.135:0/496789342 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7ca801e070 con 0x7f7cac1024c0 2024-04-20T12:13:50.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.874+0000 7f7cb14f5700 1 --2- 172.21.15.135:0/496789342 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7c98039650 0x7f7c9803bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:50.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.875+0000 7f7cb14f5700 1 --2- 172.21.15.135:0/496789342 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7c98039650 0x7f7c9803bb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c006fd0 tx=0x7f7c9c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:50.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:50.879+0000 7f7ca2ffd700 1 -- 172.21.15.135:0/496789342 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f7ca8013070 con 0x7f7cac1024c0 2024-04-20T12:13:51.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:51.079+0000 7f7cb3f5a700 1 -- 172.21.15.135:0/496789342 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f7cac190f90 con 0x7f7c98039650 2024-04-20T12:13:51.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:51.083+0000 7f7ca2ffd700 1 -- 172.21.15.135:0/496789342 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7cac190f90 con 0x7f7c98039650 2024-04-20T12:13:51.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:51.085+0000 7f7cb3f5a700 1 -- 172.21.15.135:0/496789342 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7c98039650 msgr2=0x7f7c9803bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:51.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:51.085+0000 7f7cb3f5a700 1 --2- 172.21.15.135:0/496789342 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7c98039650 0x7f7c9803bb10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c006fd0 tx=0x7f7c9c006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:51.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:51.085+0000 7f7cb3f5a700 1 -- 172.21.15.135:0/496789342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cac1024c0 msgr2=0x7f7cac0766c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:51.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:51.085+0000 7f7cb3f5a700 1 --2- 172.21.15.135:0/496789342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cac1024c0 0x7f7cac0766c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800b980 tx=0x7f7ca800ba60 comp rx=0 tx=0).stop 2024-04-20T12:13:51.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:51.085+0000 7f7cb3f5a700 1 -- 172.21.15.135:0/496789342 shutdown_connections 2024-04-20T12:13:51.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:51.085+0000 7f7cb3f5a700 1 --2- 172.21.15.135:0/496789342 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7c98039650 0x7f7c9803bb10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:51.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:51.085+0000 7f7cb3f5a700 1 --2- 172.21.15.135:0/496789342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cac1024c0 0x7f7cac0766c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:51.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:51.085+0000 7f7cb3f5a700 1 -- 172.21.15.135:0/496789342 >> 172.21.15.135:0/496789342 conn(0x7f7cac0fda80 msgr2=0x7f7cac0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:51.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:51.085+0000 7f7cb3f5a700 1 -- 172.21.15.135:0/496789342 shutdown_connections 2024-04-20T12:13:51.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:51.085+0000 7f7cb3f5a700 1 -- 172.21.15.135:0/496789342 wait complete. 2024-04-20T12:13:51.803 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi139 2024-04-20T12:13:51.804 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-20T12:13:51.804 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/etc/ceph/ceph.conf 2024-04-20T12:13:51.822 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-20T12:13:51.822 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:13:51.880 INFO:tasks.cephadm:Adding host smithi139 to orchestrator... 2024-04-20T12:13:51.880 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch host add smithi139 2024-04-20T12:13:52.120 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:13:52.335 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:52 smithi135 ceph-mon[18264]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:13:52.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:52.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:13:52.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:13:52.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:13:52.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:52 smithi135 ceph-mon[18264]: Updating smithi135:/etc/ceph/ceph.conf 2024-04-20T12:13:52.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:52 smithi135 ceph-mon[18264]: Updating smithi135:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:13:52.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:52 smithi135 ceph-mon[18264]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:13:52.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:52 smithi135 ceph-mon[18264]: Updating smithi135:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T12:13:52.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:52.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:52.336 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:53.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.435+0000 7f57895dd700 1 -- 172.21.15.135:0/1168331164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57841015c0 msgr2=0x7f57841019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:53.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.435+0000 7f57895dd700 1 --2- 172.21.15.135:0/1168331164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57841015c0 0x7f57841019a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5774009910 tx=0x7f5774009c20 comp rx=0 tx=0).stop 2024-04-20T12:13:53.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.435+0000 7f57895dd700 1 -- 172.21.15.135:0/1168331164 shutdown_connections 2024-04-20T12:13:53.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.435+0000 7f57895dd700 1 --2- 172.21.15.135:0/1168331164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57841015c0 0x7f57841019a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:53.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.436+0000 7f57895dd700 1 -- 172.21.15.135:0/1168331164 >> 172.21.15.135:0/1168331164 conn(0x7f57840fce90 msgr2=0x7f57840ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:53.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.436+0000 7f57895dd700 1 -- 172.21.15.135:0/1168331164 shutdown_connections 2024-04-20T12:13:53.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.436+0000 7f57895dd700 1 -- 172.21.15.135:0/1168331164 wait complete. 2024-04-20T12:13:53.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.436+0000 7f57895dd700 1 Processor -- start 2024-04-20T12:13:53.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.436+0000 7f57895dd700 1 -- start start 2024-04-20T12:13:53.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.437+0000 7f57895dd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57841015c0 0x7f5784103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:53.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.437+0000 7f57895dd700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f578410b990 con 0x7f57841015c0 2024-04-20T12:13:53.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.437+0000 7f5782ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57841015c0 0x7f5784103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:53.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.437+0000 7f5782ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57841015c0 0x7f5784103060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58958/0 (socket says 172.21.15.135:58958) 2024-04-20T12:13:53.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.437+0000 7f5782ffd700 1 -- 172.21.15.135:0/3970939690 learned_addr learned my addr 172.21.15.135:0/3970939690 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:13:53.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.437+0000 7f5782ffd700 1 -- 172.21.15.135:0/3970939690 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5784104f50 con 0x7f57841015c0 2024-04-20T12:13:53.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.437+0000 7f5782ffd700 1 --2- 172.21.15.135:0/3970939690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57841015c0 0x7f5784103060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5774006010 tx=0x7f5774005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:53.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.437+0000 7f576bfff700 1 -- 172.21.15.135:0/3970939690 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5774026070 con 0x7f57841015c0 2024-04-20T12:13:53.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.437+0000 7f576bfff700 1 -- 172.21.15.135:0/3970939690 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f577400bc30 con 0x7f57841015c0 2024-04-20T12:13:53.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.437+0000 7f576bfff700 1 -- 172.21.15.135:0/3970939690 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57740039d0 con 0x7f57841015c0 2024-04-20T12:13:53.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.437+0000 7f57895dd700 1 -- 172.21.15.135:0/3970939690 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5784103600 con 0x7f57841015c0 2024-04-20T12:13:53.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.437+0000 7f57895dd700 1 -- 172.21.15.135:0/3970939690 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5784103ac0 con 0x7f57841015c0 2024-04-20T12:13:53.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.438+0000 7f576bfff700 1 -- 172.21.15.135:0/3970939690 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f5774029070 con 0x7f57841015c0 2024-04-20T12:13:53.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.438+0000 7f57895dd700 1 -- 172.21.15.135:0/3970939690 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5784102aa0 con 0x7f57841015c0 2024-04-20T12:13:53.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.438+0000 7f576bfff700 1 --2- 172.21.15.135:0/3970939690 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f576c0396b0 0x7f576c03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:13:53.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.438+0000 7f576bfff700 1 -- 172.21.15.135:0/3970939690 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f577401e070 con 0x7f57841015c0 2024-04-20T12:13:53.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.438+0000 7f57827fc700 1 --2- 172.21.15.135:0/3970939690 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f576c0396b0 0x7f576c03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:13:53.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.439+0000 7f57827fc700 1 --2- 172.21.15.135:0/3970939690 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f576c0396b0 0x7f576c03bb70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5778006fd0 tx=0x7f5778006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:13:53.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.443+0000 7f576bfff700 1 -- 172.21.15.135:0/3970939690 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f5774013070 con 0x7f57841015c0 2024-04-20T12:13:53.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:53.646+0000 7f57895dd700 1 -- 172.21.15.135:0/3970939690 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}) -- 0x7f5784104600 con 0x7f576c0396b0 2024-04-20T12:13:54.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:53 smithi135 ceph-mon[18264]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi139", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:13:55.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:54 smithi135 ceph-mon[18264]: Deploying cephadm binary to smithi139 2024-04-20T12:13:57.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:57.803+0000 7f576bfff700 1 -- 172.21.15.135:0/3970939690 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f5784104600 con 0x7f576c0396b0 2024-04-20T12:13:57.803 INFO:teuthology.orchestra.run.smithi135.stdout:Added host 'smithi139' with addr '172.21.15.139' 2024-04-20T12:13:57.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:57.806+0000 7f57895dd700 1 -- 172.21.15.135:0/3970939690 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f576c0396b0 msgr2=0x7f576c03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:57.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:57.806+0000 7f57895dd700 1 --2- 172.21.15.135:0/3970939690 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f576c0396b0 0x7f576c03bb70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5778006fd0 tx=0x7f5778006e40 comp rx=0 tx=0).stop 2024-04-20T12:13:57.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:57.806+0000 7f57895dd700 1 -- 172.21.15.135:0/3970939690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57841015c0 msgr2=0x7f5784103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:13:57.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:57.806+0000 7f57895dd700 1 --2- 172.21.15.135:0/3970939690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57841015c0 0x7f5784103060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5774006010 tx=0x7f5774005030 comp rx=0 tx=0).stop 2024-04-20T12:13:57.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:57.806+0000 7f57895dd700 1 -- 172.21.15.135:0/3970939690 shutdown_connections 2024-04-20T12:13:57.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:57.806+0000 7f57895dd700 1 --2- 172.21.15.135:0/3970939690 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f576c0396b0 0x7f576c03bb70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:57.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:57.806+0000 7f57895dd700 1 --2- 172.21.15.135:0/3970939690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f57841015c0 0x7f5784103060 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:13:57.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:57.806+0000 7f57895dd700 1 -- 172.21.15.135:0/3970939690 >> 172.21.15.135:0/3970939690 conn(0x7f57840fce90 msgr2=0x7f578406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:13:57.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:57.806+0000 7f57895dd700 1 -- 172.21.15.135:0/3970939690 shutdown_connections 2024-04-20T12:13:57.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:13:57.806+0000 7f57895dd700 1 -- 172.21.15.135:0/3970939690 wait complete. 2024-04-20T12:13:58.111 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:57 smithi135 ceph-mon[18264]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:13:58.379 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch host ls --format=json 2024-04-20T12:13:58.616 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:13:58.931 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:58 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:58.931 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:58 smithi135 ceph-mon[18264]: Added host smithi139 2024-04-20T12:13:58.931 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:58 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:13:58.931 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:58 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:13:59.909 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:59 smithi135 ceph-mon[18264]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:13:59.909 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:13:59 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:00.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.147+0000 7f4f45173700 1 -- 172.21.15.135:0/2426322385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f40103660 msgr2=0x7f4f40103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:00.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.147+0000 7f4f45173700 1 --2- 172.21.15.135:0/2426322385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f40103660 0x7f4f40103a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4f30009910 tx=0x7f4f30009c20 comp rx=0 tx=0).stop 2024-04-20T12:14:00.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.147+0000 7f4f45173700 1 -- 172.21.15.135:0/2426322385 shutdown_connections 2024-04-20T12:14:00.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.147+0000 7f4f45173700 1 --2- 172.21.15.135:0/2426322385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f40103660 0x7f4f40103a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:00.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.147+0000 7f4f45173700 1 -- 172.21.15.135:0/2426322385 >> 172.21.15.135:0/2426322385 conn(0x7f4f400fce50 msgr2=0x7f4f400ff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:00.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.147+0000 7f4f45173700 1 -- 172.21.15.135:0/2426322385 shutdown_connections 2024-04-20T12:14:00.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.147+0000 7f4f45173700 1 -- 172.21.15.135:0/2426322385 wait complete. 2024-04-20T12:14:00.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.148+0000 7f4f45173700 1 Processor -- start 2024-04-20T12:14:00.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.148+0000 7f4f45173700 1 -- start start 2024-04-20T12:14:00.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.148+0000 7f4f45173700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f40103660 0x7f4f40197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:00.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.148+0000 7f4f45173700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4010cae0 con 0x7f4f40103660 2024-04-20T12:14:00.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.148+0000 7f4f3ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f40103660 0x7f4f40197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.148+0000 7f4f3ed9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f40103660 0x7f4f40197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58962/0 (socket says 172.21.15.135:58962) 2024-04-20T12:14:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.148+0000 7f4f3ed9d700 1 -- 172.21.15.135:0/429776964 learned_addr learned my addr 172.21.15.135:0/429776964 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:14:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.148+0000 7f4f3ed9d700 1 -- 172.21.15.135:0/429776964 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f40198530 con 0x7f4f40103660 2024-04-20T12:14:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.148+0000 7f4f3ed9d700 1 --2- 172.21.15.135:0/429776964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f40103660 0x7f4f40197ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4f30006010 tx=0x7f4f30005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.149+0000 7f4f3cd99700 1 -- 172.21.15.135:0/429776964 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f30026070 con 0x7f4f40103660 2024-04-20T12:14:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.149+0000 7f4f3cd99700 1 -- 172.21.15.135:0/429776964 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f3000bc30 con 0x7f4f40103660 2024-04-20T12:14:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.149+0000 7f4f45173700 1 -- 172.21.15.135:0/429776964 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f401987c0 con 0x7f4f40103660 2024-04-20T12:14:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.149+0000 7f4f3cd99700 1 -- 172.21.15.135:0/429776964 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f30003ab0 con 0x7f4f40103660 2024-04-20T12:14:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.149+0000 7f4f45173700 1 -- 172.21.15.135:0/429776964 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f40198c20 con 0x7f4f40103660 2024-04-20T12:14:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.149+0000 7f4f3cd99700 1 -- 172.21.15.135:0/429776964 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f4f30029070 con 0x7f4f40103660 2024-04-20T12:14:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.150+0000 7f4f3cd99700 1 --2- 172.21.15.135:0/429776964 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f2c039650 0x7f4f2c03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.150+0000 7f4f3cd99700 1 -- 172.21.15.135:0/429776964 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4f3001e070 con 0x7f4f40103660 2024-04-20T12:14:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.150+0000 7f4f37fff700 1 --2- 172.21.15.135:0/429776964 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f2c039650 0x7f4f2c03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:00.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.150+0000 7f4f45173700 1 -- 172.21.15.135:0/429776964 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f4006b130 con 0x7f4f40103660 2024-04-20T12:14:00.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.150+0000 7f4f37fff700 1 --2- 172.21.15.135:0/429776964 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f2c039650 0x7f4f2c03bb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f28006fd0 tx=0x7f4f28006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:00.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.155+0000 7f4f3cd99700 1 -- 172.21.15.135:0/429776964 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f4f30030070 con 0x7f4f40103660 2024-04-20T12:14:00.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.360+0000 7f4f45173700 1 -- 172.21.15.135:0/429776964 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4f401993e0 con 0x7f4f2c039650 2024-04-20T12:14:00.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.361+0000 7f4f3cd99700 1 -- 172.21.15.135:0/429776964 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f4f401993e0 con 0x7f4f2c039650 2024-04-20T12:14:00.360 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:14:00.361 INFO:teuthology.orchestra.run.smithi135.stdout:[{"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}, {"addr": "172.21.15.139", "hostname": "smithi139", "labels": [], "status": ""}] 2024-04-20T12:14:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.364+0000 7f4f45173700 1 -- 172.21.15.135:0/429776964 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f2c039650 msgr2=0x7f4f2c03bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.364+0000 7f4f45173700 1 --2- 172.21.15.135:0/429776964 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f2c039650 0x7f4f2c03bb10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f28006fd0 tx=0x7f4f28006e40 comp rx=0 tx=0).stop 2024-04-20T12:14:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.364+0000 7f4f45173700 1 -- 172.21.15.135:0/429776964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f40103660 msgr2=0x7f4f40197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.364+0000 7f4f45173700 1 --2- 172.21.15.135:0/429776964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f40103660 0x7f4f40197ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4f30006010 tx=0x7f4f30005050 comp rx=0 tx=0).stop 2024-04-20T12:14:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.364+0000 7f4f45173700 1 -- 172.21.15.135:0/429776964 shutdown_connections 2024-04-20T12:14:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.364+0000 7f4f45173700 1 --2- 172.21.15.135:0/429776964 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f2c039650 0x7f4f2c03bb10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.364+0000 7f4f45173700 1 --2- 172.21.15.135:0/429776964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f40103660 0x7f4f40197ff0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:00.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.364+0000 7f4f45173700 1 -- 172.21.15.135:0/429776964 >> 172.21.15.135:0/429776964 conn(0x7f4f400fce50 msgr2=0x7f4f40104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:00.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.364+0000 7f4f45173700 1 -- 172.21.15.135:0/429776964 shutdown_connections 2024-04-20T12:14:00.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:00.364+0000 7f4f45173700 1 -- 172.21.15.135:0/429776964 wait complete. 2024-04-20T12:14:00.986 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi154 2024-04-20T12:14:00.987 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-20T12:14:00.987 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.conf 2024-04-20T12:14:01.005 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-20T12:14:01.005 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:14:01.063 INFO:tasks.cephadm:Adding host smithi154 to orchestrator... 2024-04-20T12:14:01.063 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch host add smithi154 2024-04-20T12:14:01.299 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:14:01.668 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:01 smithi135 ceph-mon[18264]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:14:01.668 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:01.668 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:01 smithi135 ceph-mon[18264]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:02.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.781+0000 7fc3631da700 1 -- 172.21.15.135:0/3407393464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc35c108440 msgr2=0x7fc35c108820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:02.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.781+0000 7fc3631da700 1 --2- 172.21.15.135:0/3407393464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc35c108440 0x7fc35c108820 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc350009910 tx=0x7fc350009c20 comp rx=0 tx=0).stop 2024-04-20T12:14:02.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.781+0000 7fc3631da700 1 -- 172.21.15.135:0/3407393464 shutdown_connections 2024-04-20T12:14:02.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.781+0000 7fc3631da700 1 --2- 172.21.15.135:0/3407393464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc35c108440 0x7fc35c108820 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:02.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.781+0000 7fc3631da700 1 -- 172.21.15.135:0/3407393464 >> 172.21.15.135:0/3407393464 conn(0x7fc35c078950 msgr2=0x7fc35c078d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:02.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.781+0000 7fc3631da700 1 -- 172.21.15.135:0/3407393464 shutdown_connections 2024-04-20T12:14:02.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.781+0000 7fc3631da700 1 -- 172.21.15.135:0/3407393464 wait complete. 2024-04-20T12:14:02.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.781+0000 7fc3631da700 1 Processor -- start 2024-04-20T12:14:02.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.781+0000 7fc3631da700 1 -- start start 2024-04-20T12:14:02.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.782+0000 7fc3631da700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc35c108440 0x7fc35c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:02.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.782+0000 7fc3631da700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc35c10ca80 con 0x7fc35c108440 2024-04-20T12:14:02.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.782+0000 7fc360f76700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc35c108440 0x7fc35c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:02.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.782+0000 7fc360f76700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc35c108440 0x7fc35c197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53888/0 (socket says 172.21.15.135:53888) 2024-04-20T12:14:02.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.782+0000 7fc360f76700 1 -- 172.21.15.135:0/4175039757 learned_addr learned my addr 172.21.15.135:0/4175039757 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:14:02.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.782+0000 7fc360f76700 1 -- 172.21.15.135:0/4175039757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35c198420 con 0x7fc35c108440 2024-04-20T12:14:02.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.782+0000 7fc360f76700 1 --2- 172.21.15.135:0/4175039757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc35c108440 0x7fc35c197ee0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc350006010 tx=0x7fc350005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:02.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.782+0000 7fc359ffb700 1 -- 172.21.15.135:0/4175039757 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc350026070 con 0x7fc35c108440 2024-04-20T12:14:02.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.782+0000 7fc3631da700 1 -- 172.21.15.135:0/4175039757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35c198710 con 0x7fc35c108440 2024-04-20T12:14:02.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.782+0000 7fc359ffb700 1 -- 172.21.15.135:0/4175039757 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc35000bbd0 con 0x7fc35c108440 2024-04-20T12:14:02.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.782+0000 7fc359ffb700 1 -- 172.21.15.135:0/4175039757 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc350003910 con 0x7fc35c108440 2024-04-20T12:14:02.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.783+0000 7fc3631da700 1 -- 172.21.15.135:0/4175039757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc35c19c7b0 con 0x7fc35c108440 2024-04-20T12:14:02.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.783+0000 7fc359ffb700 1 -- 172.21.15.135:0/4175039757 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7fc350029070 con 0x7fc35c108440 2024-04-20T12:14:02.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.783+0000 7fc359ffb700 1 --2- 172.21.15.135:0/4175039757 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc34c0396b0 0x7fc34c03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:02.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.783+0000 7fc3631da700 1 -- 172.21.15.135:0/4175039757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc35c06a5e0 con 0x7fc35c108440 2024-04-20T12:14:02.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.784+0000 7fc359ffb700 1 -- 172.21.15.135:0/4175039757 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc35001e070 con 0x7fc35c108440 2024-04-20T12:14:02.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.784+0000 7fc35bfff700 1 --2- 172.21.15.135:0/4175039757 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc34c0396b0 0x7fc34c03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:02.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.784+0000 7fc35bfff700 1 --2- 172.21.15.135:0/4175039757 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc34c0396b0 0x7fc34c03bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc348006fd0 tx=0x7fc348006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:02.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.789+0000 7fc359ffb700 1 -- 172.21.15.135:0/4175039757 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fc350013070 con 0x7fc35c108440 2024-04-20T12:14:02.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:02.992+0000 7fc3631da700 1 -- 172.21.15.135:0/4175039757 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}) -- 0x7fc35c199240 con 0x7fc34c0396b0 2024-04-20T12:14:04.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:03 smithi135 ceph-mon[18264]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:04.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:04.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:04.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:04.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:04.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:14:04.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:04.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:05.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:04 smithi135 ceph-mon[18264]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:14:05.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:04 smithi135 ceph-mon[18264]: Updating smithi139:/etc/ceph/ceph.conf 2024-04-20T12:14:05.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:04 smithi135 ceph-mon[18264]: Deploying cephadm binary to smithi154 2024-04-20T12:14:05.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:04 smithi135 ceph-mon[18264]: Updating smithi139:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:14:06.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:05 smithi135 ceph-mon[18264]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:14:06.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:05 smithi135 ceph-mon[18264]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:07.156 INFO:teuthology.orchestra.run.smithi135.stdout:Added host 'smithi154' with addr '172.21.15.154' 2024-04-20T12:14:07.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:07.155+0000 7fc359ffb700 1 -- 172.21.15.135:0/4175039757 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fc35c199240 con 0x7fc34c0396b0 2024-04-20T12:14:07.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:07.157+0000 7fc3631da700 1 -- 172.21.15.135:0/4175039757 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc34c0396b0 msgr2=0x7fc34c03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:07.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:07.157+0000 7fc3631da700 1 --2- 172.21.15.135:0/4175039757 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc34c0396b0 0x7fc34c03bb70 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc348006fd0 tx=0x7fc348006e40 comp rx=0 tx=0).stop 2024-04-20T12:14:07.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:07.157+0000 7fc3631da700 1 -- 172.21.15.135:0/4175039757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc35c108440 msgr2=0x7fc35c197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:07.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:07.157+0000 7fc3631da700 1 --2- 172.21.15.135:0/4175039757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc35c108440 0x7fc35c197ee0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc350006010 tx=0x7fc350005030 comp rx=0 tx=0).stop 2024-04-20T12:14:07.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:07.157+0000 7fc3631da700 1 -- 172.21.15.135:0/4175039757 shutdown_connections 2024-04-20T12:14:07.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:07.157+0000 7fc3631da700 1 --2- 172.21.15.135:0/4175039757 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc34c0396b0 0x7fc34c03bb70 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:07.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:07.157+0000 7fc3631da700 1 --2- 172.21.15.135:0/4175039757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc35c108440 0x7fc35c197ee0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:07.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:07.157+0000 7fc3631da700 1 -- 172.21.15.135:0/4175039757 >> 172.21.15.135:0/4175039757 conn(0x7fc35c078950 msgr2=0x7fc35c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:07.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:07.158+0000 7fc3631da700 1 -- 172.21.15.135:0/4175039757 shutdown_connections 2024-04-20T12:14:07.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:07.158+0000 7fc3631da700 1 -- 172.21.15.135:0/4175039757 wait complete. 2024-04-20T12:14:07.756 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch host ls --format=json 2024-04-20T12:14:07.989 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:14:08.096 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:07 smithi135 ceph-mon[18264]: Updating smithi139:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T12:14:08.097 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:07 smithi135 ceph-mon[18264]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:08.097 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:08.097 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:08.097 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:08.097 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:08.097 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:08.097 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:08 smithi135 ceph-mon[18264]: Added host smithi154 2024-04-20T12:14:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:08 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:09.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.497+0000 7f2620209700 1 -- 172.21.15.135:0/226079873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26181084d0 msgr2=0x7f26181088b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:09.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.497+0000 7f2620209700 1 --2- 172.21.15.135:0/226079873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26181084d0 0x7f26181088b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2614009910 tx=0x7f2614009c20 comp rx=0 tx=0).stop 2024-04-20T12:14:09.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.497+0000 7f2620209700 1 -- 172.21.15.135:0/226079873 shutdown_connections 2024-04-20T12:14:09.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.497+0000 7f2620209700 1 --2- 172.21.15.135:0/226079873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26181084d0 0x7f26181088b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:09.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.497+0000 7f2620209700 1 -- 172.21.15.135:0/226079873 >> 172.21.15.135:0/226079873 conn(0x7f26180fdf70 msgr2=0x7f2618100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:09.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.497+0000 7f2620209700 1 -- 172.21.15.135:0/226079873 shutdown_connections 2024-04-20T12:14:09.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.497+0000 7f2620209700 1 -- 172.21.15.135:0/226079873 wait complete. 2024-04-20T12:14:09.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.498+0000 7f2620209700 1 Processor -- start 2024-04-20T12:14:09.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.498+0000 7f2620209700 1 -- start start 2024-04-20T12:14:09.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.498+0000 7f2620209700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26181084d0 0x7f2618197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:09.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.498+0000 7f2620209700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f261810ca80 con 0x7f26181084d0 2024-04-20T12:14:09.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.498+0000 7f261dfa5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26181084d0 0x7f2618197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:09.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.498+0000 7f261dfa5700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26181084d0 0x7f2618197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53902/0 (socket says 172.21.15.135:53902) 2024-04-20T12:14:09.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.498+0000 7f261dfa5700 1 -- 172.21.15.135:0/1126080033 learned_addr learned my addr 172.21.15.135:0/1126080033 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:14:09.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.499+0000 7f261dfa5700 1 -- 172.21.15.135:0/1126080033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2618198510 con 0x7f26181084d0 2024-04-20T12:14:09.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.499+0000 7f261dfa5700 1 --2- 172.21.15.135:0/1126080033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26181084d0 0x7f2618197fd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2614006010 tx=0x7f2614005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:09.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.499+0000 7f260effd700 1 -- 172.21.15.135:0/1126080033 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2614026070 con 0x7f26181084d0 2024-04-20T12:14:09.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.499+0000 7f260effd700 1 -- 172.21.15.135:0/1126080033 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f261400bbd0 con 0x7f26181084d0 2024-04-20T12:14:09.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.499+0000 7f2620209700 1 -- 172.21.15.135:0/1126080033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2618198800 con 0x7f26181084d0 2024-04-20T12:14:09.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.499+0000 7f260effd700 1 -- 172.21.15.135:0/1126080033 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2614003910 con 0x7f26181084d0 2024-04-20T12:14:09.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.499+0000 7f2620209700 1 -- 172.21.15.135:0/1126080033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f261819c8a0 con 0x7f26181084d0 2024-04-20T12:14:09.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.500+0000 7f260effd700 1 -- 172.21.15.135:0/1126080033 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f2614029070 con 0x7f26181084d0 2024-04-20T12:14:09.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.500+0000 7f2620209700 1 -- 172.21.15.135:0/1126080033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2618103b80 con 0x7f26181084d0 2024-04-20T12:14:09.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.500+0000 7f260effd700 1 --2- 172.21.15.135:0/1126080033 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2604039650 0x7f260403bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:09.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.500+0000 7f260effd700 1 -- 172.21.15.135:0/1126080033 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f261401e070 con 0x7f26181084d0 2024-04-20T12:14:09.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.500+0000 7f261d7a4700 1 --2- 172.21.15.135:0/1126080033 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2604039650 0x7f260403bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:09.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.500+0000 7f261d7a4700 1 --2- 172.21.15.135:0/1126080033 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2604039650 0x7f260403bb10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2608006fd0 tx=0x7f2608006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:09.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.505+0000 7f260effd700 1 -- 172.21.15.135:0/1126080033 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f2614013070 con 0x7f26181084d0 2024-04-20T12:14:09.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.706+0000 7f2620209700 1 -- 172.21.15.135:0/1126080033 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2618199330 con 0x7f2604039650 2024-04-20T12:14:09.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.707+0000 7f260effd700 1 -- 172.21.15.135:0/1126080033 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f2618199330 con 0x7f2604039650 2024-04-20T12:14:09.708 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:14:09.708 INFO:teuthology.orchestra.run.smithi135.stdout:[{"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}, {"addr": "172.21.15.139", "hostname": "smithi139", "labels": [], "status": ""}, {"addr": "172.21.15.154", "hostname": "smithi154", "labels": [], "status": ""}] 2024-04-20T12:14:09.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.710+0000 7f2620209700 1 -- 172.21.15.135:0/1126080033 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2604039650 msgr2=0x7f260403bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:09.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.710+0000 7f2620209700 1 --2- 172.21.15.135:0/1126080033 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2604039650 0x7f260403bb10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2608006fd0 tx=0x7f2608006e40 comp rx=0 tx=0).stop 2024-04-20T12:14:09.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.710+0000 7f2620209700 1 -- 172.21.15.135:0/1126080033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26181084d0 msgr2=0x7f2618197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:09.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.710+0000 7f2620209700 1 --2- 172.21.15.135:0/1126080033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26181084d0 0x7f2618197fd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2614006010 tx=0x7f2614005030 comp rx=0 tx=0).stop 2024-04-20T12:14:09.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.710+0000 7f2620209700 1 -- 172.21.15.135:0/1126080033 shutdown_connections 2024-04-20T12:14:09.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.710+0000 7f2620209700 1 --2- 172.21.15.135:0/1126080033 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2604039650 0x7f260403bb10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:09.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.710+0000 7f2620209700 1 --2- 172.21.15.135:0/1126080033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26181084d0 0x7f2618197fd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:09.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.710+0000 7f2620209700 1 -- 172.21.15.135:0/1126080033 >> 172.21.15.135:0/1126080033 conn(0x7f26180fdf70 msgr2=0x7f26180fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:09.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.710+0000 7f2620209700 1 -- 172.21.15.135:0/1126080033 shutdown_connections 2024-04-20T12:14:09.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:09.710+0000 7f2620209700 1 -- 172.21.15.135:0/1126080033 wait complete. 2024-04-20T12:14:10.015 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:09 smithi135 ceph-mon[18264]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:10.016 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:09 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:10.312 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-20T12:14:10.313 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd crush tunables default 2024-04-20T12:14:10.545 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:14:10.977 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:10 smithi135 ceph-mon[18264]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:14:12.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.003+0000 7f4b05658700 1 -- 172.21.15.135:0/1333388020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b001084c0 msgr2=0x7f4b001088a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:12.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.003+0000 7f4b05658700 1 --2- 172.21.15.135:0/1333388020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b001084c0 0x7f4b001088a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4af000b0a0 tx=0x7f4af000b3b0 comp rx=0 tx=0).stop 2024-04-20T12:14:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.003+0000 7f4b05658700 1 -- 172.21.15.135:0/1333388020 shutdown_connections 2024-04-20T12:14:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.003+0000 7f4b05658700 1 --2- 172.21.15.135:0/1333388020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b001084c0 0x7f4b001088a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.003+0000 7f4b05658700 1 -- 172.21.15.135:0/1333388020 >> 172.21.15.135:0/1333388020 conn(0x7f4b000fdf40 msgr2=0x7f4b00100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.003+0000 7f4b05658700 1 -- 172.21.15.135:0/1333388020 shutdown_connections 2024-04-20T12:14:12.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.003+0000 7f4b05658700 1 -- 172.21.15.135:0/1333388020 wait complete. 2024-04-20T12:14:12.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.004+0000 7f4b05658700 1 Processor -- start 2024-04-20T12:14:12.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.004+0000 7f4b05658700 1 -- start start 2024-04-20T12:14:12.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.004+0000 7f4b05658700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b001084c0 0x7f4b00197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:12.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.004+0000 7f4b05658700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0010ca70 con 0x7f4b001084c0 2024-04-20T12:14:12.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.004+0000 7f4afeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b001084c0 0x7f4b00197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.004+0000 7f4afeffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b001084c0 0x7f4b00197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56566/0 (socket says 172.21.15.135:56566) 2024-04-20T12:14:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.004+0000 7f4afeffd700 1 -- 172.21.15.135:0/3754548241 learned_addr learned my addr 172.21.15.135:0/3754548241 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:14:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.005+0000 7f4afeffd700 1 -- 172.21.15.135:0/3754548241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b00198470 con 0x7f4b001084c0 2024-04-20T12:14:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.005+0000 7f4afeffd700 1 --2- 172.21.15.135:0/3754548241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b001084c0 0x7f4b00197f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4af0015040 tx=0x7f4af0003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.005+0000 7f4af7fff700 1 -- 172.21.15.135:0/3754548241 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af0017040 con 0x7f4b001084c0 2024-04-20T12:14:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.005+0000 7f4af7fff700 1 -- 172.21.15.135:0/3754548241 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4af0022070 con 0x7f4b001084c0 2024-04-20T12:14:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.005+0000 7f4b05658700 1 -- 172.21.15.135:0/3754548241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b00198700 con 0x7f4b001084c0 2024-04-20T12:14:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.005+0000 7f4af7fff700 1 -- 172.21.15.135:0/3754548241 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af001d5d0 con 0x7f4b001084c0 2024-04-20T12:14:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.005+0000 7f4b05658700 1 -- 172.21.15.135:0/3754548241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b0019c800 con 0x7f4b001084c0 2024-04-20T12:14:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.006+0000 7f4af7fff700 1 -- 172.21.15.135:0/3754548241 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f4af001d8d0 con 0x7f4b001084c0 2024-04-20T12:14:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.006+0000 7f4b05658700 1 -- 172.21.15.135:0/3754548241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b00103b70 con 0x7f4b001084c0 2024-04-20T12:14:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.006+0000 7f4af7fff700 1 --2- 172.21.15.135:0/3754548241 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4aec039650 0x7f4aec03bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.006+0000 7f4af7fff700 1 -- 172.21.15.135:0/3754548241 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4af000f050 con 0x7f4b001084c0 2024-04-20T12:14:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.006+0000 7f4afe7fc700 1 --2- 172.21.15.135:0/3754548241 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4aec039650 0x7f4aec03bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:12.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.006+0000 7f4afe7fc700 1 --2- 172.21.15.135:0/3754548241 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4aec039650 0x7f4aec03bb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8006fd0 tx=0x7f4ae8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:12.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.011+0000 7f4af7fff700 1 -- 172.21.15.135:0/3754548241 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f4af0007e20 con 0x7f4b001084c0 2024-04-20T12:14:12.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:11 smithi135 ceph-mon[18264]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:12.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.218+0000 7f4b05658700 1 -- 172.21.15.135:0/3754548241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f4b000640e0 con 0x7f4b001084c0 2024-04-20T12:14:12.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.832+0000 7f4af7fff700 1 -- 172.21.15.135:0/3754548241 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f4b000640e0 con 0x7f4b001084c0 2024-04-20T12:14:12.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.835+0000 7f4b05658700 1 -- 172.21.15.135:0/3754548241 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4aec039650 msgr2=0x7f4aec03bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:12.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.835+0000 7f4b05658700 1 --2- 172.21.15.135:0/3754548241 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4aec039650 0x7f4aec03bb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8006fd0 tx=0x7f4ae8006e40 comp rx=0 tx=0).stop 2024-04-20T12:14:12.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.835+0000 7f4b05658700 1 -- 172.21.15.135:0/3754548241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b001084c0 msgr2=0x7f4b00197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:12.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.835+0000 7f4b05658700 1 --2- 172.21.15.135:0/3754548241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b001084c0 0x7f4b00197f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4af0015040 tx=0x7f4af0003d50 comp rx=0 tx=0).stop 2024-04-20T12:14:12.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.835+0000 7f4b05658700 1 -- 172.21.15.135:0/3754548241 shutdown_connections 2024-04-20T12:14:12.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.835+0000 7f4b05658700 1 --2- 172.21.15.135:0/3754548241 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4aec039650 0x7f4aec03bb10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:12.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.835+0000 7f4b05658700 1 --2- 172.21.15.135:0/3754548241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b001084c0 0x7f4b00197f30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:12.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.835+0000 7f4b05658700 1 -- 172.21.15.135:0/3754548241 >> 172.21.15.135:0/3754548241 conn(0x7f4b000fdf40 msgr2=0x7f4b00109f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:12.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.835+0000 7f4b05658700 1 -- 172.21.15.135:0/3754548241 shutdown_connections 2024-04-20T12:14:12.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:12.835+0000 7f4b05658700 1 -- 172.21.15.135:0/3754548241 wait complete. 2024-04-20T12:14:12.836 INFO:teuthology.orchestra.run.smithi135.stderr:adjusted tunables profile to default 2024-04-20T12:14:13.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:12 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3754548241' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-20T12:14:13.448 INFO:tasks.cephadm:Adding mon.a on smithi135 2024-04-20T12:14:13.448 INFO:tasks.cephadm:Adding mon.b on smithi139 2024-04-20T12:14:13.448 INFO:tasks.cephadm:Adding mon.c on smithi154 2024-04-20T12:14:13.448 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch apply mon '3;smithi135:172.21.15.135=a;smithi139:172.21.15.139=b;smithi154:172.21.15.154=c' 2024-04-20T12:14:13.681 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:14:14.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:13 smithi135 ceph-mon[18264]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:14.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:13 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3754548241' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-20T12:14:14.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:13 smithi135 ceph-mon[18264]: osdmap e4: 0 total, 0 up, 0 in 2024-04-20T12:14:14.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:14.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:14.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:14.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:14.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:14:14.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:14.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:14.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:14.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:14.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:14 smithi135 ceph-mon[18264]: Updating smithi154:/etc/ceph/ceph.conf 2024-04-20T12:14:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:14 smithi135 ceph-mon[18264]: Updating smithi154:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:14:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:14 smithi135 ceph-mon[18264]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:14:15.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:14 smithi135 ceph-mon[18264]: Updating smithi154:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T12:14:15.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.159+0000 7f6cfbd15700 1 -- 172.21.15.154:0/4088424302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf41015c0 msgr2=0x7f6cf41019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:15.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.159+0000 7f6cfbd15700 1 --2- 172.21.15.154:0/4088424302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf41015c0 0x7f6cf41019a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0009910 tx=0x7f6cf0009c20 comp rx=0 tx=0).stop 2024-04-20T12:14:15.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.159+0000 7f6cfbd15700 1 -- 172.21.15.154:0/4088424302 shutdown_connections 2024-04-20T12:14:15.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.159+0000 7f6cfbd15700 1 --2- 172.21.15.154:0/4088424302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf41015c0 0x7f6cf41019a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:15.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.159+0000 7f6cfbd15700 1 -- 172.21.15.154:0/4088424302 >> 172.21.15.154:0/4088424302 conn(0x7f6cf40fce90 msgr2=0x7f6cf40ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:15.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.159+0000 7f6cfbd15700 1 -- 172.21.15.154:0/4088424302 shutdown_connections 2024-04-20T12:14:15.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.159+0000 7f6cfbd15700 1 -- 172.21.15.154:0/4088424302 wait complete. 2024-04-20T12:14:15.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.160+0000 7f6cfbd15700 1 Processor -- start 2024-04-20T12:14:15.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.160+0000 7f6cfbd15700 1 -- start start 2024-04-20T12:14:15.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.160+0000 7f6cfbd15700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf41015c0 0x7f6cf4196c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:15.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.160+0000 7f6cfbd15700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf410b990 con 0x7f6cf41015c0 2024-04-20T12:14:15.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.160+0000 7f6cf9ab1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf41015c0 0x7f6cf4196c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:15.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.160+0000 7f6cf9ab1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf41015c0 0x7f6cf4196c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.154:40604/0 (socket says 172.21.15.154:40604) 2024-04-20T12:14:15.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.160+0000 7f6cf9ab1700 1 -- 172.21.15.154:0/4113397484 learned_addr learned my addr 172.21.15.154:0/4113397484 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-20T12:14:15.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.160+0000 7f6cf9ab1700 1 -- 172.21.15.154:0/4113397484 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf406b670 con 0x7f6cf41015c0 2024-04-20T12:14:15.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.161+0000 7f6cf9ab1700 1 --2- 172.21.15.154:0/4113397484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf41015c0 0x7f6cf4196c00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0006010 tx=0x7f6cf0005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:15.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.161+0000 7f6ceaffd700 1 -- 172.21.15.154:0/4113397484 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf0026070 con 0x7f6cf41015c0 2024-04-20T12:14:15.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.161+0000 7f6cfbd15700 1 -- 172.21.15.154:0/4113397484 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf4197140 con 0x7f6cf41015c0 2024-04-20T12:14:15.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.161+0000 7f6ceaffd700 1 -- 172.21.15.154:0/4113397484 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cf000bbd0 con 0x7f6cf41015c0 2024-04-20T12:14:15.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.161+0000 7f6ceaffd700 1 -- 172.21.15.154:0/4113397484 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf0003910 con 0x7f6cf41015c0 2024-04-20T12:14:15.162 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.161+0000 7f6cfbd15700 1 -- 172.21.15.154:0/4113397484 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf4197600 con 0x7f6cf41015c0 2024-04-20T12:14:15.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.162+0000 7f6ceaffd700 1 -- 172.21.15.154:0/4113397484 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f6cf0029070 con 0x7f6cf41015c0 2024-04-20T12:14:15.163 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.162+0000 7f6cfbd15700 1 -- 172.21.15.154:0/4113397484 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf4102aa0 con 0x7f6cf41015c0 2024-04-20T12:14:15.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.162+0000 7f6ceaffd700 1 --2- 172.21.15.154:0/4113397484 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6ce0039650 0x7f6ce003bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:15.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.162+0000 7f6ceaffd700 1 -- 172.21.15.154:0/4113397484 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6cf001e070 con 0x7f6cf41015c0 2024-04-20T12:14:15.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.162+0000 7f6cf92b0700 1 --2- 172.21.15.154:0/4113397484 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6ce0039650 0x7f6ce003bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:15.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.163+0000 7f6cf92b0700 1 --2- 172.21.15.154:0/4113397484 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6ce0039650 0x7f6ce003bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4006fd0 tx=0x7f6ce4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:15.167 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.168+0000 7f6ceaffd700 1 -- 172.21.15.154:0/4113397484 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f6cf0013070 con 0x7f6cf41015c0 2024-04-20T12:14:15.373 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.373+0000 7f6cfbd15700 1 -- 172.21.15.154:0/4113397484 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi135:172.21.15.135=a;smithi139:172.21.15.139=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}) -- 0x7f6cf406aed0 con 0x7f6ce0039650 2024-04-20T12:14:15.381 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.381+0000 7f6ceaffd700 1 -- 172.21.15.154:0/4113397484 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f6cf406aed0 con 0x7f6ce0039650 2024-04-20T12:14:15.381 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mon update... 2024-04-20T12:14:15.383 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.383+0000 7f6cfbd15700 1 -- 172.21.15.154:0/4113397484 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6ce0039650 msgr2=0x7f6ce003bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.383+0000 7f6cfbd15700 1 --2- 172.21.15.154:0/4113397484 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6ce0039650 0x7f6ce003bb10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4006fd0 tx=0x7f6ce4006e40 comp rx=0 tx=0).stop 2024-04-20T12:14:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.383+0000 7f6cfbd15700 1 -- 172.21.15.154:0/4113397484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf41015c0 msgr2=0x7f6cf4196c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.383+0000 7f6cfbd15700 1 --2- 172.21.15.154:0/4113397484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf41015c0 0x7f6cf4196c00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0006010 tx=0x7f6cf0005030 comp rx=0 tx=0).stop 2024-04-20T12:14:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.383+0000 7f6cfbd15700 1 -- 172.21.15.154:0/4113397484 shutdown_connections 2024-04-20T12:14:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.383+0000 7f6cfbd15700 1 --2- 172.21.15.154:0/4113397484 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6ce0039650 0x7f6ce003bb10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.383+0000 7f6cfbd15700 1 --2- 172.21.15.154:0/4113397484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cf41015c0 0x7f6cf4196c00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.383+0000 7f6cfbd15700 1 -- 172.21.15.154:0/4113397484 >> 172.21.15.154:0/4113397484 conn(0x7f6cf40fce90 msgr2=0x7f6cf4102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.383+0000 7f6cfbd15700 1 -- 172.21.15.154:0/4113397484 shutdown_connections 2024-04-20T12:14:15.384 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:15.384+0000 7f6cfbd15700 1 -- 172.21.15.154:0/4113397484 wait complete. 2024-04-20T12:14:16.011 DEBUG:teuthology.orchestra.run.smithi139:mon.b> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mon.b.service 2024-04-20T12:14:16.013 DEBUG:teuthology.orchestra.run.smithi154:mon.c> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mon.c.service 2024-04-20T12:14:16.015 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-20T12:14:16.015 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph mon dump -f json 2024-04-20T12:14:16.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:15 smithi135 ceph-mon[18264]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:16.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:15 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:16.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:15 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:16.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:15 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:16.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:15 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:16.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:15 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:16.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:15 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T12:14:16.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:15 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:17.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:16 smithi135 ceph-mon[18264]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi135:172.21.15.135=a;smithi139:172.21.15.139=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:14:17.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:16 smithi135 ceph-mon[18264]: Saving service mon spec with placement smithi135:172.21.15.135=a;smithi139:172.21.15.139=b;smithi154:172.21.15.154=c;count:3 2024-04-20T12:14:17.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:16 smithi135 ceph-mon[18264]: Deploying daemon mon.c on smithi154 2024-04-20T12:14:18.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:17 smithi135 ceph-mon[18264]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:18.164 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:14:19.293 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:19 smithi154 systemd[1]: Starting Ceph mon.c for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:14:20.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.039+0000 7f043b29a700 1 -- 172.21.15.154:0/297453057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04341074d0 msgr2=0x7f04341078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:20.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.039+0000 7f043b29a700 1 --2- 172.21.15.154:0/297453057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04341074d0 0x7f04341078b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f042c00b0a0 tx=0x7f042c00b3b0 comp rx=0 tx=0).stop 2024-04-20T12:14:20.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.039+0000 7f043b29a700 1 -- 172.21.15.154:0/297453057 shutdown_connections 2024-04-20T12:14:20.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.039+0000 7f043b29a700 1 --2- 172.21.15.154:0/297453057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04341074d0 0x7f04341078b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:20.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.039+0000 7f043b29a700 1 -- 172.21.15.154:0/297453057 >> 172.21.15.154:0/297453057 conn(0x7f04340fcf30 msgr2=0x7f04340ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:20.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.040+0000 7f043b29a700 1 -- 172.21.15.154:0/297453057 shutdown_connections 2024-04-20T12:14:20.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.040+0000 7f043b29a700 1 -- 172.21.15.154:0/297453057 wait complete. 2024-04-20T12:14:20.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.040+0000 7f043b29a700 1 Processor -- start 2024-04-20T12:14:20.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.040+0000 7f043b29a700 1 -- start start 2024-04-20T12:14:20.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.040+0000 7f043b29a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04341074d0 0x7f0434197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:20.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.040+0000 7f043b29a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f043410ba80 con 0x7f04341074d0 2024-04-20T12:14:20.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.041+0000 7f0439036700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04341074d0 0x7f0434197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:20.041 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.041+0000 7f0439036700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04341074d0 0x7f0434197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.154:40616/0 (socket says 172.21.15.154:40616) 2024-04-20T12:14:20.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.041+0000 7f0439036700 1 -- 172.21.15.154:0/845911147 learned_addr learned my addr 172.21.15.154:0/845911147 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-20T12:14:20.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.041+0000 7f0439036700 1 -- 172.21.15.154:0/845911147 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0434198500 con 0x7f04341074d0 2024-04-20T12:14:20.042 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.041+0000 7f0439036700 1 --2- 172.21.15.154:0/845911147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04341074d0 0x7f0434197fc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f042c015040 tx=0x7f042c003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:20.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.041+0000 7f042a7fc700 1 -- 172.21.15.154:0/845911147 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f042c017040 con 0x7f04341074d0 2024-04-20T12:14:20.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.041+0000 7f042a7fc700 1 -- 172.21.15.154:0/845911147 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f042c022070 con 0x7f04341074d0 2024-04-20T12:14:20.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.041+0000 7f043b29a700 1 -- 172.21.15.154:0/845911147 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0434198790 con 0x7f04341074d0 2024-04-20T12:14:20.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.041+0000 7f042a7fc700 1 -- 172.21.15.154:0/845911147 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f042c01d5d0 con 0x7f04341074d0 2024-04-20T12:14:20.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.041+0000 7f043b29a700 1 -- 172.21.15.154:0/845911147 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f043419c890 con 0x7f04341074d0 2024-04-20T12:14:20.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.042+0000 7f043b29a700 1 -- 172.21.15.154:0/845911147 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0434102b80 con 0x7f04341074d0 2024-04-20T12:14:20.043 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.042+0000 7f042a7fc700 1 -- 172.21.15.154:0/845911147 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f042c004000 con 0x7f04341074d0 2024-04-20T12:14:20.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.042+0000 7f042a7fc700 1 --2- 172.21.15.154:0/845911147 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0420039650 0x7f042003bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:20.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.043+0000 7f042a7fc700 1 -- 172.21.15.154:0/845911147 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f042c00f050 con 0x7f04341074d0 2024-04-20T12:14:20.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.043+0000 7f0438835700 1 --2- 172.21.15.154:0/845911147 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0420039650 0x7f042003bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:20.044 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.043+0000 7f0438835700 1 --2- 172.21.15.154:0/845911147 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0420039650 0x7f042003bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0424006fd0 tx=0x7f0424006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:20.047 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.048+0000 7f042a7fc700 1 -- 172.21.15.154:0/845911147 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f042c007e20 con 0x7f04341074d0 2024-04-20T12:14:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:19 smithi135 ceph-mon[18264]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:20.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.352+0000 7f043b29a700 1 -- 172.21.15.154:0/845911147 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f0434199320 con 0x7f04341074d0 2024-04-20T12:14:20.352 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.352+0000 7f042a7fc700 1 -- 172.21.15.154:0/845911147 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7f042c00bcc0 con 0x7f04341074d0 2024-04-20T12:14:20.352 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:14:20.353 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":1,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","modified":"2024-04-20T12:12:40.408375Z","created":"2024-04-20T12:12:40.408375Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-20T12:14:20.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.354+0000 7f043b29a700 1 -- 172.21.15.154:0/845911147 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0420039650 msgr2=0x7f042003bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:20.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.354+0000 7f043b29a700 1 --2- 172.21.15.154:0/845911147 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0420039650 0x7f042003bb10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0424006fd0 tx=0x7f0424006e40 comp rx=0 tx=0).stop 2024-04-20T12:14:20.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.354+0000 7f043b29a700 1 -- 172.21.15.154:0/845911147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04341074d0 msgr2=0x7f0434197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:20.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.354+0000 7f043b29a700 1 --2- 172.21.15.154:0/845911147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04341074d0 0x7f0434197fc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f042c015040 tx=0x7f042c003d50 comp rx=0 tx=0).stop 2024-04-20T12:14:20.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.354+0000 7f043b29a700 1 -- 172.21.15.154:0/845911147 shutdown_connections 2024-04-20T12:14:20.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.354+0000 7f043b29a700 1 --2- 172.21.15.154:0/845911147 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0420039650 0x7f042003bb10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:20.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.354+0000 7f043b29a700 1 --2- 172.21.15.154:0/845911147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04341074d0 0x7f0434197fc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:20.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.354+0000 7f043b29a700 1 -- 172.21.15.154:0/845911147 >> 172.21.15.154:0/845911147 conn(0x7f04340fcf30 msgr2=0x7f043406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:20.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.355+0000 7f043b29a700 1 -- 172.21.15.154:0/845911147 shutdown_connections 2024-04-20T12:14:20.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:20.355+0000 7f043b29a700 1 -- 172.21.15.154:0/845911147 wait complete. 2024-04-20T12:14:20.355 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 1 2024-04-20T12:14:20.708 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:20 smithi154 podman[22038]: 2024-04-20 12:14:20.256840573 +0000 UTC m=+0.107093317 container create efa34d747380206a0ed449e76c252323c3906321f488877da4d64ebe4f96e1b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-c, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5) 2024-04-20T12:14:20.709 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:20 smithi154 podman[22038]: 2024-04-20 12:14:20.167546001 +0000 UTC m=+0.017798760 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:14:21.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:20 smithi135 ceph-mon[18264]: from='client.? 172.21.15.154:0/845911147' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T12:14:21.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 podman[22038]: 2024-04-20 12:14:21.005784598 +0000 UTC m=+0.856037342 container init efa34d747380206a0ed449e76c252323c3906321f488877da4d64ebe4f96e1b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-c, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T12:14:21.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 podman[22038]: 2024-04-20 12:14:21.009225824 +0000 UTC m=+0.859478569 container start efa34d747380206a0ed449e76c252323c3906321f488877da4d64ebe4f96e1b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T12:14:21.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: set uid:gid to 167:167 (ceph:ceph) 2024-04-20T12:14:21.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev), process ceph-mon, pid 2 2024-04-20T12:14:21.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: pidfile_write: ignore empty --pid-file 2024-04-20T12:14:21.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: load: jerasure load: lrc 2024-04-20T12:14:21.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: RocksDB version: 7.9.2 2024-04-20T12:14:21.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Git sha 0 2024-04-20T12:14:21.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Compile date 2024-04-17 00:07:32 2024-04-20T12:14:21.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: DB SUMMARY 2024-04-20T12:14:21.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: DB Session ID: V0KTFYNRPSGJ1Y7LB20G 2024-04-20T12:14:21.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: CURRENT file: CURRENT 2024-04-20T12:14:21.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: IDENTITY file: IDENTITY 2024-04-20T12:14:21.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-04-20T12:14:21.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-04-20T12:14:21.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-04-20T12:14:21.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.error_if_exists: 0 2024-04-20T12:14:21.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.create_if_missing: 0 2024-04-20T12:14:21.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.paranoid_checks: 1 2024-04-20T12:14:21.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-20T12:14:21.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-20T12:14:21.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-20T12:14:21.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.env: 0x55ff565e4cc0 2024-04-20T12:14:21.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.fs: PosixFileSystem 2024-04-20T12:14:21.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.info_log: 0x55ff57e59c20 2024-04-20T12:14:21.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_file_opening_threads: 16 2024-04-20T12:14:21.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.statistics: (nil) 2024-04-20T12:14:21.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.use_fsync: 0 2024-04-20T12:14:21.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_log_file_size: 0 2024-04-20T12:14:21.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-20T12:14:21.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-20T12:14:21.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.keep_log_file_num: 1000 2024-04-20T12:14:21.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.recycle_log_file_num: 0 2024-04-20T12:14:21.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.allow_fallocate: 1 2024-04-20T12:14:21.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.allow_mmap_reads: 0 2024-04-20T12:14:21.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.allow_mmap_writes: 0 2024-04-20T12:14:21.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.use_direct_reads: 0 2024-04-20T12:14:21.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-20T12:14:21.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.create_missing_column_families: 0 2024-04-20T12:14:21.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.db_log_dir: 2024-04-20T12:14:21.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.wal_dir: 2024-04-20T12:14:21.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-20T12:14:21.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-20T12:14:21.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-20T12:14:21.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-20T12:14:21.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-20T12:14:21.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-20T12:14:21.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.advise_random_on_open: 1 2024-04-20T12:14:21.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.db_write_buffer_size: 0 2024-04-20T12:14:21.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.write_buffer_manager: 0x55ff57e281e0 2024-04-20T12:14:21.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-20T12:14:21.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-20T12:14:21.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-20T12:14:21.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.rate_limiter: (nil) 2024-04-20T12:14:21.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-20T12:14:21.507 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.wal_recovery_mode: 2 2024-04-20T12:14:21.508 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.enable_thread_tracking: 0 2024-04-20T12:14:21.508 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.enable_pipelined_write: 0 2024-04-20T12:14:21.508 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.unordered_write: 0 2024-04-20T12:14:21.508 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-20T12:14:21.508 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-20T12:14:21.508 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-20T12:14:21.508 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-20T12:14:21.508 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.row_cache: None 2024-04-20T12:14:21.508 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.wal_filter: None 2024-04-20T12:14:21.508 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-20T12:14:21.508 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.allow_ingest_behind: 0 2024-04-20T12:14:21.508 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.two_write_queues: 0 2024-04-20T12:14:21.508 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.manual_wal_flush: 0 2024-04-20T12:14:21.508 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.wal_compression: 0 2024-04-20T12:14:21.508 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.atomic_flush: 0 2024-04-20T12:14:21.509 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-20T12:14:21.509 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-20T12:14:21.509 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-20T12:14:21.509 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.log_readahead_size: 0 2024-04-20T12:14:21.509 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-20T12:14:21.509 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.best_efforts_recovery: 0 2024-04-20T12:14:21.509 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-20T12:14:21.509 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-20T12:14:21.509 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.allow_data_in_errors: 0 2024-04-20T12:14:21.509 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.db_host_id: __hostname__ 2024-04-20T12:14:21.509 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-20T12:14:21.509 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_background_jobs: 2 2024-04-20T12:14:21.509 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_background_compactions: -1 2024-04-20T12:14:21.509 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_subcompactions: 1 2024-04-20T12:14:21.509 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-20T12:14:21.510 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-20T12:14:21.510 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-20T12:14:21.510 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_total_wal_size: 0 2024-04-20T12:14:21.510 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-20T12:14:21.510 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-20T12:14:21.510 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-20T12:14:21.510 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-20T12:14:21.510 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_open_files: -1 2024-04-20T12:14:21.510 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.bytes_per_sync: 0 2024-04-20T12:14:21.510 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-20T12:14:21.510 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-20T12:14:21.510 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compaction_readahead_size: 0 2024-04-20T12:14:21.510 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_background_flushes: -1 2024-04-20T12:14:21.510 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Compression algorithms supported: 2024-04-20T12:14:21.511 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-20T12:14:21.511 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: kZSTD supported: 0 2024-04-20T12:14:21.511 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: kXpressCompression supported: 0 2024-04-20T12:14:21.511 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: kLZ4HCCompression supported: 1 2024-04-20T12:14:21.511 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: kZlibCompression supported: 1 2024-04-20T12:14:21.511 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: kSnappyCompression supported: 1 2024-04-20T12:14:21.511 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: kLZ4Compression supported: 1 2024-04-20T12:14:21.511 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: kBZip2Compression supported: 0 2024-04-20T12:14:21.511 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-20T12:14:21.511 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-20T12:14:21.511 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-04-20T12:14:21.511 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-20T12:14:21.511 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-20T12:14:21.511 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.merge_operator: 2024-04-20T12:14:21.512 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compaction_filter: None 2024-04-20T12:14:21.512 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compaction_filter_factory: None 2024-04-20T12:14:21.512 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.sst_partitioner_factory: None 2024-04-20T12:14:21.512 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-20T12:14:21.512 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-20T12:14:21.512 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ff57e59de0) 2024-04-20T12:14:21.512 INFO:journalctl@ceph.mon.c.smithi154.stdout: cache_index_and_filter_blocks: 1 2024-04-20T12:14:21.512 INFO:journalctl@ceph.mon.c.smithi154.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-20T12:14:21.512 INFO:journalctl@ceph.mon.c.smithi154.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-20T12:14:21.512 INFO:journalctl@ceph.mon.c.smithi154.stdout: pin_top_level_index_and_filter: 1 2024-04-20T12:14:21.512 INFO:journalctl@ceph.mon.c.smithi154.stdout: index_type: 0 2024-04-20T12:14:21.512 INFO:journalctl@ceph.mon.c.smithi154.stdout: data_block_index_type: 0 2024-04-20T12:14:21.512 INFO:journalctl@ceph.mon.c.smithi154.stdout: index_shortening: 1 2024-04-20T12:14:21.512 INFO:journalctl@ceph.mon.c.smithi154.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-20T12:14:21.513 INFO:journalctl@ceph.mon.c.smithi154.stdout: checksum: 4 2024-04-20T12:14:21.513 INFO:journalctl@ceph.mon.c.smithi154.stdout: no_block_cache: 0 2024-04-20T12:14:21.513 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache: 0x55ff57e5b090 2024-04-20T12:14:21.513 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache_name: BinnedLRUCache 2024-04-20T12:14:21.513 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache_options: 2024-04-20T12:14:21.513 INFO:journalctl@ceph.mon.c.smithi154.stdout: capacity : 536870912 2024-04-20T12:14:21.513 INFO:journalctl@ceph.mon.c.smithi154.stdout: num_shard_bits : 4 2024-04-20T12:14:21.513 INFO:journalctl@ceph.mon.c.smithi154.stdout: strict_capacity_limit : 0 2024-04-20T12:14:21.513 INFO:journalctl@ceph.mon.c.smithi154.stdout: high_pri_pool_ratio: 0.000 2024-04-20T12:14:21.513 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_cache_compressed: (nil) 2024-04-20T12:14:21.513 INFO:journalctl@ceph.mon.c.smithi154.stdout: persistent_cache: (nil) 2024-04-20T12:14:21.513 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_size: 4096 2024-04-20T12:14:21.513 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_size_deviation: 10 2024-04-20T12:14:21.514 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_restart_interval: 16 2024-04-20T12:14:21.514 INFO:journalctl@ceph.mon.c.smithi154.stdout: index_block_restart_interval: 1 2024-04-20T12:14:21.514 INFO:journalctl@ceph.mon.c.smithi154.stdout: metadata_block_size: 4096 2024-04-20T12:14:21.514 INFO:journalctl@ceph.mon.c.smithi154.stdout: partition_filters: 0 2024-04-20T12:14:21.514 INFO:journalctl@ceph.mon.c.smithi154.stdout: use_delta_encoding: 1 2024-04-20T12:14:21.514 INFO:journalctl@ceph.mon.c.smithi154.stdout: filter_policy: bloomfilter 2024-04-20T12:14:21.514 INFO:journalctl@ceph.mon.c.smithi154.stdout: whole_key_filtering: 1 2024-04-20T12:14:21.514 INFO:journalctl@ceph.mon.c.smithi154.stdout: verify_compression: 0 2024-04-20T12:14:21.514 INFO:journalctl@ceph.mon.c.smithi154.stdout: read_amp_bytes_per_bit: 0 2024-04-20T12:14:21.514 INFO:journalctl@ceph.mon.c.smithi154.stdout: format_version: 5 2024-04-20T12:14:21.514 INFO:journalctl@ceph.mon.c.smithi154.stdout: enable_index_compression: 1 2024-04-20T12:14:21.514 INFO:journalctl@ceph.mon.c.smithi154.stdout: block_align: 0 2024-04-20T12:14:21.514 INFO:journalctl@ceph.mon.c.smithi154.stdout: max_auto_readahead_size: 262144 2024-04-20T12:14:21.514 INFO:journalctl@ceph.mon.c.smithi154.stdout: prepopulate_block_cache: 0 2024-04-20T12:14:21.514 INFO:journalctl@ceph.mon.c.smithi154.stdout: initial_auto_readahead_size: 8192 2024-04-20T12:14:21.515 INFO:journalctl@ceph.mon.c.smithi154.stdout: num_file_reads_for_auto_readahead: 2 2024-04-20T12:14:21.515 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.write_buffer_size: 33554432 2024-04-20T12:14:21.515 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_write_buffer_number: 2 2024-04-20T12:14:21.515 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compression: NoCompression 2024-04-20T12:14:21.515 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.bottommost_compression: Disabled 2024-04-20T12:14:21.515 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.prefix_extractor: nullptr 2024-04-20T12:14:21.515 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-20T12:14:21.515 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.num_levels: 7 2024-04-20T12:14:21.515 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-20T12:14:21.515 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-20T12:14:21.515 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-20T12:14:21.515 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-20T12:14:21.515 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-20T12:14:21.515 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-20T12:14:21.515 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-20T12:14:21.516 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-20T12:14:21.516 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-20T12:14:21.516 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-20T12:14:21.516 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-20T12:14:21.516 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-20T12:14:21.516 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-20T12:14:21.516 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compression_opts.level: 32767 2024-04-20T12:14:21.516 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compression_opts.strategy: 0 2024-04-20T12:14:21.516 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-20T12:14:21.516 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-20T12:14:21.516 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-20T12:14:21.516 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-20T12:14:21.516 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compression_opts.enabled: false 2024-04-20T12:14:21.517 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-20T12:14:21.517 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-20T12:14:21.517 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-20T12:14:21.517 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-20T12:14:21.517 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.target_file_size_base: 67108864 2024-04-20T12:14:21.517 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-20T12:14:21.517 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-20T12:14:21.517 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-20T12:14:21.517 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-20T12:14:21.517 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-20T12:14:21.517 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-20T12:14:21.517 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-20T12:14:21.517 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-20T12:14:21.517 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-20T12:14:21.517 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-20T12:14:21.518 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-20T12:14:21.518 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-20T12:14:21.518 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-20T12:14:21.518 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-20T12:14:21.518 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.arena_block_size: 1048576 2024-04-20T12:14:21.518 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-20T12:14:21.518 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-20T12:14:21.518 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.disable_auto_compactions: 0 2024-04-20T12:14:21.518 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-20T12:14:21.518 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-20T12:14:21.518 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-20T12:14:21.518 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-20T12:14:21.518 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-20T12:14:21.518 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.inplace_update_support: 0 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.bloom_locality: 0 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.max_successive_merges: 0 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.paranoid_file_checks: 0 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.force_consistency_checks: 1 2024-04-20T12:14:21.519 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.report_bg_io_stats: 0 2024-04-20T12:14:21.520 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.ttl: 2592000 2024-04-20T12:14:21.520 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-20T12:14:21.520 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-20T12:14:21.520 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-20T12:14:21.520 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.enable_blob_files: false 2024-04-20T12:14:21.520 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.min_blob_size: 0 2024-04-20T12:14:21.520 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.blob_file_size: 268435456 2024-04-20T12:14:21.520 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-20T12:14:21.520 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-20T12:14:21.520 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-20T12:14:21.520 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-20T12:14:21.520 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-20T12:14:21.520 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.blob_file_starting_level: 0 2024-04-20T12:14:21.520 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-20T12:14:21.520 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-20T12:14:21.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-04-20T12:14:21.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1c82546f-d667-4652-8670-b2d331c90368 2024-04-20T12:14:21.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713615261040115, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-20T12:14:21.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-04-20T12:14:21.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713615261040553, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1713615261, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1c82546f-d667-4652-8670-b2d331c90368", "db_session_id": "V0KTFYNRPSGJ1Y7LB20G", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-04-20T12:14:21.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: EVENT_LOG_v1 {"time_micros": 1713615261040634, "job": 1, "event": "recovery_finished"} 2024-04-20T12:14:21.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-04-20T12:14:21.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-20T12:14:21.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ff57f48000 2024-04-20T12:14:21.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: DB pointer 0x55ff57f32000 2024-04-20T12:14:21.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-20T12:14:21.521 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-20T12:14:21.521 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** DB Stats ** 2024-04-20T12:14:21.521 INFO:journalctl@ceph.mon.c.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-20T12:14:21.522 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-20T12:14:21.522 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-20T12:14:21.522 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-20T12:14:21.522 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-20T12:14:21.522 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-20T12:14:21.522 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-20T12:14:21.522 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-04-20T12:14:21.522 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** Compaction Stats [default] ** 2024-04-20T12:14:21.522 INFO:journalctl@ceph.mon.c.smithi154.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-20T12:14:21.522 INFO:journalctl@ceph.mon.c.smithi154.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-20T12:14:21.522 INFO:journalctl@ceph.mon.c.smithi154.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-20T12:14:21.522 INFO:journalctl@ceph.mon.c.smithi154.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-20T12:14:21.522 INFO:journalctl@ceph.mon.c.smithi154.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-20T12:14:21.522 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-04-20T12:14:21.522 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** Compaction Stats [default] ** 2024-04-20T12:14:21.523 INFO:journalctl@ceph.mon.c.smithi154.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-20T12:14:21.523 INFO:journalctl@ceph.mon.c.smithi154.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-20T12:14:21.523 INFO:journalctl@ceph.mon.c.smithi154.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-04-20T12:14:21.523 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-04-20T12:14:21.523 INFO:journalctl@ceph.mon.c.smithi154.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-20T12:14:21.523 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-04-20T12:14:21.523 INFO:journalctl@ceph.mon.c.smithi154.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-20T12:14:21.523 INFO:journalctl@ceph.mon.c.smithi154.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-20T12:14:21.523 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-20T12:14:21.523 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-20T12:14:21.523 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-20T12:14:21.523 INFO:journalctl@ceph.mon.c.smithi154.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-20T12:14:21.523 INFO:journalctl@ceph.mon.c.smithi154.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-20T12:14:21.523 INFO:journalctl@ceph.mon.c.smithi154.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-20T12:14:21.523 INFO:journalctl@ceph.mon.c.smithi154.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout: Block cache BinnedLRUCache@0x55ff57e5b090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: using public_addr v2:172.21.15.154:0/0 -> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: starting mon.c rank -1 at public addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] at bind addrs [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: mon.c@-1(???) e0 preinit fsid 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: mon.c@-1(synchronizing).mds e1 new map 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: mon.c@-1(synchronizing).mds e1 print_map 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout: e1 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout: legacy client fscid: -1 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout: 2024-04-20T12:14:21.524 INFO:journalctl@ceph.mon.c.smithi154.stdout: No filesystems configured 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.525 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi139", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi154", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: Updating smithi139:/etc/ceph/ceph.conf 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: Deploying cephadm binary to smithi154 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: Updating smithi139:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: Updating smithi139:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:21.526 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: Added host smithi154 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3754548241' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3754548241' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: osdmap e4: 0 total, 0 up, 0 in 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi154", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:14:21.527 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: Updating smithi154:/etc/ceph/ceph.conf 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: Updating smithi154:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: Updating smithi154:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:21.528 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi135:172.21.15.135=a;smithi139:172.21.15.139=b;smithi154:172.21.15.154=c", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:14:21.529 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: Saving service mon spec with placement smithi135:172.21.15.135=a;smithi139:172.21.15.139=b;smithi154:172.21.15.154=c;count:3 2024-04-20T12:14:21.529 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: Deploying daemon mon.c on smithi154 2024-04-20T12:14:21.529 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:21.529 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:21.529 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: from='client.? 172.21.15.154:0/845911147' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T12:14:21.529 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 ceph-mon[22073]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-04-20T12:14:21.529 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 bash[22038]: efa34d747380206a0ed449e76c252323c3906321f488877da4d64ebe4f96e1b6 2024-04-20T12:14:21.529 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:21 smithi154 systemd[1]: Started Ceph mon.c for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:14:21.890 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-20T12:14:21.890 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph mon dump -f json 2024-04-20T12:14:22.127 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:14:26.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:14:26.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: mon.a calling monitor election 2024-04-20T12:14:26.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:26.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:26.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:26.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:26.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: mon.c calling monitor election 2024-04-20T12:14:26.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:26.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:26.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:26.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: monmap epoch 2 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: fsid 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: last_changed 2024-04-20T12:14:21.063448+0000 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: created 2024-04-20T12:12:40.408375+0000 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: min_mon_release 19 (squid) 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: election_strategy: 1 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: 0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: fsmap 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: osdmap e4: 0 total, 0 up, 0 in 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: mgrmap e13: x(active, since 49s) 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: overall HEALTH_OK 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:26.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:26.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T12:14:26.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:26.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.575+0000 7f26a21d7700 1 -- 172.21.15.154:0/402316599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26880035c0 msgr2=0x7f2688005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:26.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.575+0000 7f26a21d7700 1 --2- 172.21.15.154:0/402316599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26880035c0 0x7f2688005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f269c101370 tx=0x7f268c00feb0 comp rx=0 tx=0).stop 2024-04-20T12:14:26.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.576+0000 7f26a21d7700 1 -- 172.21.15.154:0/402316599 shutdown_connections 2024-04-20T12:14:26.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.576+0000 7f26a21d7700 1 --2- 172.21.15.154:0/402316599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26880035c0 0x7f2688005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:26.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.576+0000 7f26a21d7700 1 -- 172.21.15.154:0/402316599 >> 172.21.15.154:0/402316599 conn(0x7f269c0fcf30 msgr2=0x7f269c0ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:26.576 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.576+0000 7f26a21d7700 1 -- 172.21.15.154:0/402316599 shutdown_connections 2024-04-20T12:14:26.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.576+0000 7f26a21d7700 1 -- 172.21.15.154:0/402316599 wait complete. 2024-04-20T12:14:26.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.576+0000 7f26a21d7700 1 Processor -- start 2024-04-20T12:14:26.577 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.576+0000 7f26a21d7700 1 -- start start 2024-04-20T12:14:26.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.577+0000 7f26a21d7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26880035c0 0x7f269c198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:26.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.577+0000 7f26a21d7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f269c198690 0x7f269c19c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:26.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.577+0000 7f26a21d7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f269c1094e0 con 0x7f26880035c0 2024-04-20T12:14:26.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.577+0000 7f26a21d7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f269c109360 con 0x7f269c198690 2024-04-20T12:14:26.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.577+0000 7f2693fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f269c198690 0x7f269c19c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:26.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.577+0000 7f2693fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f269c198690 0x7f269c19c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51224/0 (socket says 172.21.15.154:51224) 2024-04-20T12:14:26.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.577+0000 7f2693fff700 1 -- 172.21.15.154:0/3460362996 learned_addr learned my addr 172.21.15.154:0/3460362996 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-20T12:14:26.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.577+0000 7f269b7fe700 1 --2- 172.21.15.154:0/3460362996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26880035c0 0x7f269c198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:26.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.577+0000 7f2693fff700 1 -- 172.21.15.154:0/3460362996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f269c198690 msgr2=0x7f269c19c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-20T12:14:26.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.577+0000 7f2693fff700 1 -- 172.21.15.154:0/3460362996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f269c198690 msgr2=0x7f269c19c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-20T12:14:26.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.577+0000 7f2693fff700 1 --2- 172.21.15.154:0/3460362996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f269c198690 0x7f269c19c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-20T12:14:26.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.577+0000 7f2693fff700 1 --2- 172.21.15.154:0/3460362996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f269c198690 0x7f269c19c9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T12:14:26.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.577+0000 7f269b7fe700 1 -- 172.21.15.154:0/3460362996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f269c198690 msgr2=0x7f269c19c9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T12:14:26.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.577+0000 7f269b7fe700 1 --2- 172.21.15.154:0/3460362996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f269c198690 0x7f269c19c9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:26.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.577+0000 7f269b7fe700 1 -- 172.21.15.154:0/3460362996 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269c198cd0 con 0x7f26880035c0 2024-04-20T12:14:26.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.578+0000 7f269b7fe700 1 --2- 172.21.15.154:0/3460362996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26880035c0 0x7f269c198150 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f268c0059d0 tx=0x7f268c0057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:26.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.578+0000 7f26997fa700 1 -- 172.21.15.154:0/3460362996 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f268c004b20 con 0x7f26880035c0 2024-04-20T12:14:26.579 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.578+0000 7f26997fa700 1 -- 172.21.15.154:0/3460362996 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f268c013e40 con 0x7f26880035c0 2024-04-20T12:14:26.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.578+0000 7f26a21d7700 1 -- 172.21.15.154:0/3460362996 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f269c19cf10 con 0x7f26880035c0 2024-04-20T12:14:26.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.578+0000 7f26997fa700 1 -- 172.21.15.154:0/3460362996 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f268c011cd0 con 0x7f26880035c0 2024-04-20T12:14:26.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.578+0000 7f26a21d7700 1 -- 172.21.15.154:0/3460362996 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f269c19d470 con 0x7f26880035c0 2024-04-20T12:14:26.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.579+0000 7f26997fa700 1 -- 172.21.15.154:0/3460362996 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f268c023070 con 0x7f26880035c0 2024-04-20T12:14:26.580 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.579+0000 7f26997fa700 1 --2- 172.21.15.154:0/3460362996 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f267c039440 0x7f267c03b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:26.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.579+0000 7f26a21d7700 1 -- 172.21.15.154:0/3460362996 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f269c102b80 con 0x7f26880035c0 2024-04-20T12:14:26.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.579+0000 7f26997fa700 1 -- 172.21.15.154:0/3460362996 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f268c020050 con 0x7f26880035c0 2024-04-20T12:14:26.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.580+0000 7f2693fff700 1 --2- 172.21.15.154:0/3460362996 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f267c039440 0x7f267c03b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:26.581 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.580+0000 7f2693fff700 1 --2- 172.21.15.154:0/3460362996 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f267c039440 0x7f267c03b900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2684009180 tx=0x7f2684008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:26.584 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.585+0000 7f26997fa700 1 -- 172.21.15.154:0/3460362996 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f268c031020 con 0x7f26880035c0 2024-04-20T12:14:26.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:14:26.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: mon.a calling monitor election 2024-04-20T12:14:26.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:26.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:26.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:26.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:26.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: mon.c calling monitor election 2024-04-20T12:14:26.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:26.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:26.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:26.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:26.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-04-20T12:14:26.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: monmap epoch 2 2024-04-20T12:14:26.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: fsid 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:14:26.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: last_changed 2024-04-20T12:14:21.063448+0000 2024-04-20T12:14:26.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: created 2024-04-20T12:12:40.408375+0000 2024-04-20T12:14:26.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: min_mon_release 19 (squid) 2024-04-20T12:14:26.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: election_strategy: 1 2024-04-20T12:14:26.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: 0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-04-20T12:14:26.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-04-20T12:14:26.616 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: fsmap 2024-04-20T12:14:26.616 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: osdmap e4: 0 total, 0 up, 0 in 2024-04-20T12:14:26.616 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: mgrmap e13: x(active, since 49s) 2024-04-20T12:14:26.616 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: overall HEALTH_OK 2024-04-20T12:14:26.616 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:26.616 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:26.616 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:26.616 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T12:14:26.616 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.868+0000 7f26a21d7700 1 -- 172.21.15.154:0/3460362996 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f269c19d750 con 0x7f26880035c0 2024-04-20T12:14:26.868 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.869+0000 7f26997fa700 1 -- 172.21.15.154:0/3460362996 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f268c028030 con 0x7f26880035c0 2024-04-20T12:14:26.868 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:14:26.868 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":2,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","modified":"2024-04-20T12:14:21.063448Z","created":"2024-04-20T12:12:40.408375Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-20T12:14:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.871+0000 7f26a21d7700 1 -- 172.21.15.154:0/3460362996 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f267c039440 msgr2=0x7f267c03b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:26.870 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.871+0000 7f26a21d7700 1 --2- 172.21.15.154:0/3460362996 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f267c039440 0x7f267c03b900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2684009180 tx=0x7f2684008040 comp rx=0 tx=0).stop 2024-04-20T12:14:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.871+0000 7f26a21d7700 1 -- 172.21.15.154:0/3460362996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26880035c0 msgr2=0x7f269c198150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.871+0000 7f26a21d7700 1 --2- 172.21.15.154:0/3460362996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26880035c0 0x7f269c198150 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f268c0059d0 tx=0x7f268c0057d0 comp rx=0 tx=0).stop 2024-04-20T12:14:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.871+0000 7f26a21d7700 1 -- 172.21.15.154:0/3460362996 shutdown_connections 2024-04-20T12:14:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.871+0000 7f26a21d7700 1 --2- 172.21.15.154:0/3460362996 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f267c039440 0x7f267c03b900 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.871+0000 7f26a21d7700 1 --2- 172.21.15.154:0/3460362996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f26880035c0 0x7f269c198150 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.871+0000 7f26a21d7700 1 --2- 172.21.15.154:0/3460362996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f269c198690 0x7f269c19c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.871+0000 7f26a21d7700 1 -- 172.21.15.154:0/3460362996 >> 172.21.15.154:0/3460362996 conn(0x7f269c0fcf30 msgr2=0x7f269c06a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.871+0000 7f26a21d7700 1 -- 172.21.15.154:0/3460362996 shutdown_connections 2024-04-20T12:14:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:26.871+0000 7f26a21d7700 1 -- 172.21.15.154:0/3460362996 wait complete. 2024-04-20T12:14:26.871 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 2 2024-04-20T12:14:27.442 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:27 smithi154 ceph-mon[22073]: Deploying daemon mon.b on smithi139 2024-04-20T12:14:27.443 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:27 smithi154 ceph-mon[22073]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:27.443 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:27 smithi154 ceph-mon[22073]: from='client.? 172.21.15.154:0/3460362996' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T12:14:27.443 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:27.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:27 smithi135 ceph-mon[18264]: Deploying daemon mon.b on smithi139 2024-04-20T12:14:27.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:27 smithi135 ceph-mon[18264]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:27.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:27 smithi135 ceph-mon[18264]: from='client.? 172.21.15.154:0/3460362996' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T12:14:27.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:28.468 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-04-20T12:14:28.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph mon dump -f json 2024-04-20T12:14:28.726 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:14:30.045 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:29 smithi154 ceph-mon[22073]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:30.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:29 smithi139 systemd[1]: Started Ceph mon.b for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:14:30.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:29 smithi135 ceph-mon[18264]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:35.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:14:35.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: mon.a calling monitor election 2024-04-20T12:14:35.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: mon.c calling monitor election 2024-04-20T12:14:35.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:35.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:35.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.253 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: mon.b calling monitor election 2024-04-20T12:14:35.253 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:35.253 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.253 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.253 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:35.253 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.253 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-20T12:14:35.253 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: monmap epoch 3 2024-04-20T12:14:35.253 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: fsid 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:14:35.253 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: last_changed 2024-04-20T12:14:29.875196+0000 2024-04-20T12:14:35.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: created 2024-04-20T12:12:40.408375+0000 2024-04-20T12:14:35.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: min_mon_release 19 (squid) 2024-04-20T12:14:35.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: election_strategy: 1 2024-04-20T12:14:35.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: 0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-04-20T12:14:35.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-04-20T12:14:35.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: 2: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-04-20T12:14:35.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: fsmap 2024-04-20T12:14:35.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: osdmap e4: 0 total, 0 up, 0 in 2024-04-20T12:14:35.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: mgrmap e13: x(active, since 58s) 2024-04-20T12:14:35.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: overall HEALTH_OK 2024-04-20T12:14:35.255 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:35.255 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:34 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:35.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:14:35.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: mon.a calling monitor election 2024-04-20T12:14:35.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: mon.c calling monitor election 2024-04-20T12:14:35.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:35.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:35.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: mon.b calling monitor election 2024-04-20T12:14:35.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:35.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:35.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-20T12:14:35.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: monmap epoch 3 2024-04-20T12:14:35.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: fsid 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:14:35.332 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: last_changed 2024-04-20T12:14:29.875196+0000 2024-04-20T12:14:35.332 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: created 2024-04-20T12:12:40.408375+0000 2024-04-20T12:14:35.332 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: min_mon_release 19 (squid) 2024-04-20T12:14:35.332 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: election_strategy: 1 2024-04-20T12:14:35.332 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: 0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-04-20T12:14:35.332 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-04-20T12:14:35.332 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: 2: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-04-20T12:14:35.332 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: fsmap 2024-04-20T12:14:35.332 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: osdmap e4: 0 total, 0 up, 0 in 2024-04-20T12:14:35.332 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: mgrmap e13: x(active, since 58s) 2024-04-20T12:14:35.332 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: overall HEALTH_OK 2024-04-20T12:14:35.332 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:35.332 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:34 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:35.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:14:35.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: mon.a calling monitor election 2024-04-20T12:14:35.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: mon.c calling monitor election 2024-04-20T12:14:35.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:14:35.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:35.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: mon.b calling monitor election 2024-04-20T12:14:35.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:35.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:35.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:35.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-04-20T12:14:35.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: monmap epoch 3 2024-04-20T12:14:35.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: fsid 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:14:35.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: last_changed 2024-04-20T12:14:29.875196+0000 2024-04-20T12:14:35.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: created 2024-04-20T12:12:40.408375+0000 2024-04-20T12:14:35.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: min_mon_release 19 (squid) 2024-04-20T12:14:35.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: election_strategy: 1 2024-04-20T12:14:35.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: 0: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.a 2024-04-20T12:14:35.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: 1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.c 2024-04-20T12:14:35.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: 2: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.b 2024-04-20T12:14:35.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: fsmap 2024-04-20T12:14:35.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: osdmap e4: 0 total, 0 up, 0 in 2024-04-20T12:14:35.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: mgrmap e13: x(active, since 58s) 2024-04-20T12:14:35.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: overall HEALTH_OK 2024-04-20T12:14:35.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:35.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:34 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:36.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.242+0000 7f560c4e6700 1 -- 172.21.15.154:0/458089044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ec006240 msgr2=0x7f55ec0086b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:36.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.242+0000 7f560c4e6700 1 --2- 172.21.15.154:0/458089044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ec006240 0x7f55ec0086b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5604103630 tx=0x7f55fc0095d0 comp rx=0 tx=0).stop 2024-04-20T12:14:36.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.242+0000 7f560c4e6700 1 -- 172.21.15.154:0/458089044 shutdown_connections 2024-04-20T12:14:36.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.242+0000 7f560c4e6700 1 --2- 172.21.15.154:0/458089044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ec006240 0x7f55ec0086b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:36.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.242+0000 7f560c4e6700 1 -- 172.21.15.154:0/458089044 >> 172.21.15.154:0/458089044 conn(0x7f56040fe060 msgr2=0x7f5604100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:36.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.242+0000 7f560c4e6700 1 -- 172.21.15.154:0/458089044 shutdown_connections 2024-04-20T12:14:36.243 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.242+0000 7f560c4e6700 1 -- 172.21.15.154:0/458089044 wait complete. 2024-04-20T12:14:36.243 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:36.244 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:36.244 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:36.244 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:36.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.243+0000 7f560c4e6700 1 Processor -- start 2024-04-20T12:14:36.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.243+0000 7f560c4e6700 1 -- start start 2024-04-20T12:14:36.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.243+0000 7f560c4e6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55ec006240 0x7f5604198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:36.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.243+0000 7f560c4e6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5604198780 0x7f560419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:36.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.243+0000 7f560c4e6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f560419d050 0x7f560419d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:36.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.243+0000 7f560c4e6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f560410a590 con 0x7f5604198780 2024-04-20T12:14:36.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.243+0000 7f560c4e6700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f560410a410 con 0x7f560419d050 2024-04-20T12:14:36.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.243+0000 7f560c4e6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f560410a710 con 0x7f55ec006240 2024-04-20T12:14:36.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.243+0000 7f560a282700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55ec006240 0x7f5604198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:36.246 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.243+0000 7f560a282700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55ec006240 0x7f5604198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:47558/0 (socket says 172.21.15.154:47558) 2024-04-20T12:14:36.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.243+0000 7f560a282700 1 -- 172.21.15.154:0/2996012762 learned_addr learned my addr 172.21.15.154:0/2996012762 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-20T12:14:36.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.244+0000 7f5609a81700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5604198780 0x7f560419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:36.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.244+0000 7f560a282700 1 -- 172.21.15.154:0/2996012762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f560419d050 msgr2=0x7f560419d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:36.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.244+0000 7f560aa83700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f560419d050 0x7f560419d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:36.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.244+0000 7f560a282700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f560419d050 0x7f560419d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:36.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.244+0000 7f560a282700 1 -- 172.21.15.154:0/2996012762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5604198780 msgr2=0x7f560419cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:36.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.244+0000 7f560a282700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5604198780 0x7f560419cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:36.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.244+0000 7f560a282700 1 -- 172.21.15.154:0/2996012762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56041a4dc0 con 0x7f55ec006240 2024-04-20T12:14:36.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.244+0000 7f5609a81700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5604198780 0x7f560419cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:14:36.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.244+0000 7f560aa83700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f560419d050 0x7f560419d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:14:36.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.244+0000 7f560a282700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55ec006240 0x7f5604198240 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f55fc003df0 tx=0x7f55fc003ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:36.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.244+0000 7f56037fe700 1 -- 172.21.15.154:0/2996012762 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc01bd70 con 0x7f55ec006240 2024-04-20T12:14:36.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.244+0000 7f56037fe700 1 -- 172.21.15.154:0/2996012762 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55fc005730 con 0x7f55ec006240 2024-04-20T12:14:36.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.244+0000 7f560c4e6700 1 -- 172.21.15.154:0/2996012762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56041a4f90 con 0x7f55ec006240 2024-04-20T12:14:36.247 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.244+0000 7f56037fe700 1 -- 172.21.15.154:0/2996012762 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc019ba0 con 0x7f55ec006240 2024-04-20T12:14:36.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.244+0000 7f560c4e6700 1 -- 172.21.15.154:0/2996012762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56041a5460 con 0x7f55ec006240 2024-04-20T12:14:36.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.245+0000 7f56037fe700 1 -- 172.21.15.154:0/2996012762 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f55fc015040 con 0x7f55ec006240 2024-04-20T12:14:36.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.245+0000 7f56037fe700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f55f0039ae0 0x7f55f003bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:36.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.245+0000 7f56037fe700 1 -- 172.21.15.154:0/2996012762 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f55fc04fd50 con 0x7f55ec006240 2024-04-20T12:14:36.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.245+0000 7f560c4e6700 1 -- 172.21.15.154:0/2996012762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56040640b0 con 0x7f55ec006240 2024-04-20T12:14:36.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.245+0000 7f5609a81700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f55f0039ae0 0x7f55f003bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:36.248 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.246+0000 7f5609a81700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f55f0039ae0 0x7f55f003bfa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f55f80079b0 tx=0x7f55f8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:36.250 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.251+0000 7f56037fe700 1 -- 172.21.15.154:0/2996012762 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f55fc0132b0 con 0x7f55ec006240 2024-04-20T12:14:36.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:36.394 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:36.394 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:36.394 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:36.395 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:36.395 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:36.395 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:36.395 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:14:36.559 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.560+0000 7f560c4e6700 1 -- 172.21.15.154:0/2996012762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f560402e0b0 con 0x7f55ec006240 2024-04-20T12:14:36.560 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.560+0000 7f56037fe700 1 -- 172.21.15.154:0/2996012762 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1289 (secure 0 0 0) 0x7f55fc009570 con 0x7f55ec006240 2024-04-20T12:14:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-20T12:14:36.560 INFO:teuthology.orchestra.run.smithi154.stdout:{"epoch":3,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","modified":"2024-04-20T12:14:29.875196Z","created":"2024-04-20T12:12:40.408375Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:3300","nonce":0},{"type":"v1","addr":"172.21.15.139:6789","nonce":0}]},"addr":"172.21.15.139:6789/0","public_addr":"172.21.15.139:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-04-20T12:14:36.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.562+0000 7f560c4e6700 1 -- 172.21.15.154:0/2996012762 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f55f0039ae0 msgr2=0x7f55f003bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:36.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.562+0000 7f560c4e6700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f55f0039ae0 0x7f55f003bfa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f55f80079b0 tx=0x7f55f8008040 comp rx=0 tx=0).stop 2024-04-20T12:14:36.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.562+0000 7f560c4e6700 1 -- 172.21.15.154:0/2996012762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55ec006240 msgr2=0x7f5604198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:36.562 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.562+0000 7f560c4e6700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55ec006240 0x7f5604198240 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f55fc003df0 tx=0x7f55fc003ed0 comp rx=0 tx=0).stop 2024-04-20T12:14:36.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.562+0000 7f560c4e6700 1 -- 172.21.15.154:0/2996012762 shutdown_connections 2024-04-20T12:14:36.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.562+0000 7f560c4e6700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f55f0039ae0 0x7f55f003bfa0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:36.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.562+0000 7f560c4e6700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f560419d050 0x7f560419d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:36.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.562+0000 7f560c4e6700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f55ec006240 0x7f5604198240 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:36.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.562+0000 7f560c4e6700 1 --2- 172.21.15.154:0/2996012762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5604198780 0x7f560419cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:36.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.562+0000 7f560c4e6700 1 -- 172.21.15.154:0/2996012762 >> 172.21.15.154:0/2996012762 conn(0x7f56040fe060 msgr2=0x7f56041070b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:36.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.563+0000 7f560c4e6700 1 -- 172.21.15.154:0/2996012762 shutdown_connections 2024-04-20T12:14:36.563 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:36.563+0000 7f560c4e6700 1 -- 172.21.15.154:0/2996012762 wait complete. 2024-04-20T12:14:36.563 INFO:teuthology.orchestra.run.smithi154.stderr:dumped monmap epoch 3 2024-04-20T12:14:37.236 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-20T12:14:37.236 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph config generate-minimal-conf 2024-04-20T12:14:37.487 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:14:37.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:37.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:37.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: Updating smithi135:/etc/ceph/ceph.conf 2024-04-20T12:14:37.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: Updating smithi139:/etc/ceph/ceph.conf 2024-04-20T12:14:37.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: Updating smithi154:/etc/ceph/ceph.conf 2024-04-20T12:14:37.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='client.? 172.21.15.154:0/2996012762' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T12:14:37.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: Updating smithi135:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:14:37.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: Updating smithi154:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:14:37.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: Updating smithi139:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:14:37.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:37.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T12:14:37.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T12:14:37.506 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:37.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:37.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:37.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: Updating smithi135:/etc/ceph/ceph.conf 2024-04-20T12:14:37.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: Updating smithi139:/etc/ceph/ceph.conf 2024-04-20T12:14:37.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: Updating smithi154:/etc/ceph/ceph.conf 2024-04-20T12:14:37.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='client.? 172.21.15.154:0/2996012762' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T12:14:37.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: Updating smithi135:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:14:37.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: Updating smithi154:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:14:37.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: Updating smithi139:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:14:37.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:37.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T12:14:37.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T12:14:37.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:37.595 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.595 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.595 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.595 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.595 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:37.595 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:37.595 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: Updating smithi135:/etc/ceph/ceph.conf 2024-04-20T12:14:37.595 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: Updating smithi139:/etc/ceph/ceph.conf 2024-04-20T12:14:37.595 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: Updating smithi154:/etc/ceph/ceph.conf 2024-04-20T12:14:37.595 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='client.? 172.21.15.154:0/2996012762' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-20T12:14:37.596 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: Updating smithi135:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:14:37.596 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: Updating smithi154:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:14:37.596 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: Updating smithi139:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:14:37.596 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:37.596 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.596 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.596 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.596 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.596 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.596 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.596 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.596 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.596 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.596 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.597 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.597 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:37.597 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T12:14:37.597 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T12:14:37.597 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:38.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:38 smithi135 ceph-mon[18264]: Reconfiguring mon.a (unknown last config time)... 2024-04-20T12:14:38.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:38 smithi135 ceph-mon[18264]: Reconfiguring daemon mon.a on smithi135 2024-04-20T12:14:38.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:38 smithi154 ceph-mon[22073]: Reconfiguring mon.a (unknown last config time)... 2024-04-20T12:14:38.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:38 smithi154 ceph-mon[22073]: Reconfiguring daemon mon.a on smithi135 2024-04-20T12:14:38.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:38 smithi139 ceph-mon[21834]: Reconfiguring mon.a (unknown last config time)... 2024-04-20T12:14:38.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:38 smithi139 ceph-mon[21834]: Reconfiguring daemon mon.a on smithi135 2024-04-20T12:14:39.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:39 smithi135 ceph-mon[18264]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:39.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:39 smithi154 ceph-mon[22073]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:39.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:39 smithi139 ceph-mon[21834]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:39.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.985+0000 7f68a243e700 1 -- 172.21.15.135:0/1485540215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689c103460 msgr2=0x7f689c10f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:39.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.985+0000 7f68a243e700 1 --2- 172.21.15.135:0/1485540215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689c103460 0x7f689c10f8c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f689400b0a0 tx=0x7f689400b3b0 comp rx=0 tx=0).stop 2024-04-20T12:14:39.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.985+0000 7f68a243e700 1 -- 172.21.15.135:0/1485540215 shutdown_connections 2024-04-20T12:14:39.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.985+0000 7f68a243e700 1 --2- 172.21.15.135:0/1485540215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689c103460 0x7f689c10f8c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:39.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.985+0000 7f68a243e700 1 --2- 172.21.15.135:0/1485540215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f689c108a60 0x7f689c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:39.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.985+0000 7f68a243e700 1 --2- 172.21.15.135:0/1485540215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689c102aa0 0x7f689c102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:39.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.985+0000 7f68a243e700 1 -- 172.21.15.135:0/1485540215 >> 172.21.15.135:0/1485540215 conn(0x7f689c079bb0 msgr2=0x7f689c079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:39.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.985+0000 7f68a243e700 1 -- 172.21.15.135:0/1485540215 shutdown_connections 2024-04-20T12:14:39.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.985+0000 7f68a243e700 1 -- 172.21.15.135:0/1485540215 wait complete. 2024-04-20T12:14:39.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.985+0000 7f68a243e700 1 Processor -- start 2024-04-20T12:14:39.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f68a243e700 1 -- start start 2024-04-20T12:14:39.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f68a243e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689c102aa0 0x7f689c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f68a243e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689c103460 0x7f689c199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f68a243e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f689c108a60 0x7f689c19db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f68a243e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f689c112d80 con 0x7f689c102aa0 2024-04-20T12:14:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f68a243e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f689c112c00 con 0x7f689c108a60 2024-04-20T12:14:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f68a243e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f689c112f00 con 0x7f689c103460 2024-04-20T12:14:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f689bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689c102aa0 0x7f689c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f689bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689c102aa0 0x7f689c199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43404/0 (socket says 172.21.15.135:43404) 2024-04-20T12:14:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f689bfff700 1 -- 172.21.15.135:0/2887711463 learned_addr learned my addr 172.21.15.135:0/2887711463 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:14:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f689b7fe700 1 --2- 172.21.15.135:0/2887711463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689c103460 0x7f689c199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f68a09db700 1 --2- 172.21.15.135:0/2887711463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f689c108a60 0x7f689c19db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f689bfff700 1 -- 172.21.15.135:0/2887711463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689c103460 msgr2=0x7f689c199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f689bfff700 1 --2- 172.21.15.135:0/2887711463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689c103460 0x7f689c199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f689bfff700 1 -- 172.21.15.135:0/2887711463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f689c108a60 msgr2=0x7f689c19db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:39.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f689bfff700 1 --2- 172.21.15.135:0/2887711463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f689c108a60 0x7f689c19db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:39.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f689bfff700 1 -- 172.21.15.135:0/2887711463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689c19e260 con 0x7f689c102aa0 2024-04-20T12:14:39.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.986+0000 7f689bfff700 1 --2- 172.21.15.135:0/2887711463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689c102aa0 0x7f689c199250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f688c00d980 tx=0x7f688c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:39.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.987+0000 7f68997fa700 1 -- 172.21.15.135:0/2887711463 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c016070 con 0x7f689c102aa0 2024-04-20T12:14:39.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.987+0000 7f68997fa700 1 -- 172.21.15.135:0/2887711463 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f688c004d10 con 0x7f689c102aa0 2024-04-20T12:14:39.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.987+0000 7f68a243e700 1 -- 172.21.15.135:0/2887711463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f689c19e550 con 0x7f689c102aa0 2024-04-20T12:14:39.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.987+0000 7f68997fa700 1 -- 172.21.15.135:0/2887711463 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c005670 con 0x7f689c102aa0 2024-04-20T12:14:39.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.987+0000 7f68a243e700 1 -- 172.21.15.135:0/2887711463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f689c1a5dd0 con 0x7f689c102aa0 2024-04-20T12:14:39.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.988+0000 7f68997fa700 1 -- 172.21.15.135:0/2887711463 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f688c00f690 con 0x7f689c102aa0 2024-04-20T12:14:39.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.988+0000 7f68a243e700 1 -- 172.21.15.135:0/2887711463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f689c069740 con 0x7f689c102aa0 2024-04-20T12:14:39.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.988+0000 7f68997fa700 1 --2- 172.21.15.135:0/2887711463 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6884039890 0x7f688403bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:39.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.988+0000 7f68997fa700 1 -- 172.21.15.135:0/2887711463 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f688c04c850 con 0x7f689c102aa0 2024-04-20T12:14:39.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.988+0000 7f689b7fe700 1 --2- 172.21.15.135:0/2887711463 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6884039890 0x7f688403bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:39.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.988+0000 7f689b7fe700 1 --2- 172.21.15.135:0/2887711463 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6884039890 0x7f688403bd50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f689c07a270 tx=0x7f689000b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:39.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:39.993+0000 7f68997fa700 1 -- 172.21.15.135:0/2887711463 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f688c01f020 con 0x7f689c102aa0 2024-04-20T12:14:40.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:40.188+0000 7f68a243e700 1 -- 172.21.15.135:0/2887711463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f689c02df90 con 0x7f689c102aa0 2024-04-20T12:14:40.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:40.188+0000 7f68997fa700 1 -- 172.21.15.135:0/2887711463 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7f688c00b340 con 0x7f689c102aa0 2024-04-20T12:14:40.189 INFO:teuthology.orchestra.run.smithi135.stdout:# minimal ceph.conf for 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:14:40.189 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2024-04-20T12:14:40.189 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:14:40.189 INFO:teuthology.orchestra.run.smithi135.stdout: mon_host = [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-04-20T12:14:40.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:40.190+0000 7f68a243e700 1 -- 172.21.15.135:0/2887711463 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6884039890 msgr2=0x7f688403bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:40.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:40.190+0000 7f68a243e700 1 --2- 172.21.15.135:0/2887711463 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6884039890 0x7f688403bd50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f689c07a270 tx=0x7f689000b3c0 comp rx=0 tx=0).stop 2024-04-20T12:14:40.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:40.190+0000 7f68a243e700 1 -- 172.21.15.135:0/2887711463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689c102aa0 msgr2=0x7f689c199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:40.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:40.190+0000 7f68a243e700 1 --2- 172.21.15.135:0/2887711463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689c102aa0 0x7f689c199250 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f688c00d980 tx=0x7f688c00dc90 comp rx=0 tx=0).stop 2024-04-20T12:14:40.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:40.191+0000 7f68a243e700 1 -- 172.21.15.135:0/2887711463 shutdown_connections 2024-04-20T12:14:40.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:40.191+0000 7f68a243e700 1 --2- 172.21.15.135:0/2887711463 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6884039890 0x7f688403bd50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:40.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:40.191+0000 7f68a243e700 1 --2- 172.21.15.135:0/2887711463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f689c108a60 0x7f689c19db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:40.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:40.191+0000 7f68a243e700 1 --2- 172.21.15.135:0/2887711463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f689c102aa0 0x7f689c199250 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:40.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:40.191+0000 7f68a243e700 1 --2- 172.21.15.135:0/2887711463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f689c103460 0x7f689c199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:40.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:40.191+0000 7f68a243e700 1 -- 172.21.15.135:0/2887711463 >> 172.21.15.135:0/2887711463 conn(0x7f689c079bb0 msgr2=0x7f689c1017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:40.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:40.191+0000 7f68a243e700 1 -- 172.21.15.135:0/2887711463 shutdown_connections 2024-04-20T12:14:40.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:40.191+0000 7f68a243e700 1 -- 172.21.15.135:0/2887711463 wait complete. 2024-04-20T12:14:40.757 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-20T12:14:40.758 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:14:40.758 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.conf 2024-04-20T12:14:40.783 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:14:40.784 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:14:40.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:40 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:40.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:40 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:40.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:40 smithi139 ceph-mon[21834]: Reconfiguring mon.b (monmap changed)... 2024-04-20T12:14:40.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:40 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T12:14:40.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:40 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T12:14:40.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:40 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:40.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:40 smithi139 ceph-mon[21834]: Reconfiguring daemon mon.b on smithi139 2024-04-20T12:14:40.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:40 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2887711463' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:40.847 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-20T12:14:40.847 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.conf 2024-04-20T12:14:40.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:40 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:40.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:40 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:40.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:40 smithi135 ceph-mon[18264]: Reconfiguring mon.b (monmap changed)... 2024-04-20T12:14:40.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:40 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T12:14:40.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:40 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T12:14:40.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:40 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:40.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:40 smithi135 ceph-mon[18264]: Reconfiguring daemon mon.b on smithi139 2024-04-20T12:14:40.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:40 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2887711463' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:40.873 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-20T12:14:40.873 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:14:40.937 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-20T12:14:40.937 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.conf 2024-04-20T12:14:40.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:40 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:40.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:40 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:40.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:40 smithi154 ceph-mon[22073]: Reconfiguring mon.b (monmap changed)... 2024-04-20T12:14:40.963 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:40 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T12:14:40.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:40 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T12:14:40.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:40 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:40.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:40 smithi154 ceph-mon[22073]: Reconfiguring daemon mon.b on smithi139 2024-04-20T12:14:40.964 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:40 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2887711463' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:40.969 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-20T12:14:40.969 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:14:41.036 INFO:tasks.cephadm:Adding mgr.x on smithi135 2024-04-20T12:14:41.036 INFO:tasks.cephadm:Adding mgr.y on smithi139 2024-04-20T12:14:41.036 INFO:tasks.cephadm:Adding mgr.z on smithi154 2024-04-20T12:14:41.036 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch apply mgr '3;smithi135=x;smithi139=y;smithi154=z' 2024-04-20T12:14:41.323 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:14:41.703 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:41 smithi154 ceph-mon[22073]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:41.704 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:41 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:41.704 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:41 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:41.704 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:41 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T12:14:41.704 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:41 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T12:14:41.704 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:41 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:41.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:41 smithi135 ceph-mon[18264]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:41.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:41 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:41.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:41 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:41.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:41 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T12:14:41.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:41 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T12:14:41.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:41 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:42.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:41 smithi139 ceph-mon[21834]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:42.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:41 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:42.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:41 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:42.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:41 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-20T12:14:42.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:41 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-20T12:14:42.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:41 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:42.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:42 smithi154 ceph-mon[22073]: Reconfiguring mon.c (monmap changed)... 2024-04-20T12:14:42.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:42 smithi154 ceph-mon[22073]: Reconfiguring daemon mon.c on smithi154 2024-04-20T12:14:42.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:42 smithi135 ceph-mon[18264]: Reconfiguring mon.c (monmap changed)... 2024-04-20T12:14:42.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:42 smithi135 ceph-mon[18264]: Reconfiguring daemon mon.c on smithi154 2024-04-20T12:14:43.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:42 smithi139 ceph-mon[21834]: Reconfiguring mon.c (monmap changed)... 2024-04-20T12:14:43.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:42 smithi139 ceph-mon[21834]: Reconfiguring daemon mon.c on smithi154 2024-04-20T12:14:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.317+0000 7fd21d524700 1 -- 172.21.15.154:0/3228465062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2181025f0 msgr2=0x7fd218102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.317+0000 7fd21d524700 1 --2- 172.21.15.154:0/3228465062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2181025f0 0x7fd218102a10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd208009910 tx=0x7fd208009c20 comp rx=0 tx=0).stop 2024-04-20T12:14:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.317+0000 7fd21d524700 1 -- 172.21.15.154:0/3228465062 shutdown_connections 2024-04-20T12:14:43.317 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.317+0000 7fd21d524700 1 --2- 172.21.15.154:0/3228465062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2181025f0 0x7fd218102a10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:43.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.318+0000 7fd21d524700 1 -- 172.21.15.154:0/3228465062 >> 172.21.15.154:0/3228465062 conn(0x7fd2180fdb90 msgr2=0x7fd2180fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:43.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.318+0000 7fd21d524700 1 -- 172.21.15.154:0/3228465062 shutdown_connections 2024-04-20T12:14:43.318 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.318+0000 7fd21d524700 1 -- 172.21.15.154:0/3228465062 wait complete. 2024-04-20T12:14:43.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.318+0000 7fd21d524700 1 Processor -- start 2024-04-20T12:14:43.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.318+0000 7fd21d524700 1 -- start start 2024-04-20T12:14:43.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.318+0000 7fd21d524700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2181025f0 0x7fd218197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:43.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.318+0000 7fd21d524700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd218198370 0x7fd21819d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:43.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.318+0000 7fd21d524700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2181987f0 0x7fd21819f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:43.320 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd21d524700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd218108630 con 0x7fd2181987f0 2024-04-20T12:14:43.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd21d524700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd2181084b0 con 0x7fd218198370 2024-04-20T12:14:43.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd21d524700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd2181087b0 con 0x7fd2181025f0 2024-04-20T12:14:43.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd216ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2181025f0 0x7fd218197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:43.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd216ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2181025f0 0x7fd218197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:54106/0 (socket says 172.21.15.154:54106) 2024-04-20T12:14:43.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd216ffd700 1 -- 172.21.15.154:0/3469235554 learned_addr learned my addr 172.21.15.154:0/3469235554 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-20T12:14:43.321 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd2177fe700 1 --2- 172.21.15.154:0/3469235554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2181987f0 0x7fd21819f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:43.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd216ffd700 1 -- 172.21.15.154:0/3469235554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd218198370 msgr2=0x7fd21819d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:43.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd216ffd700 1 --2- 172.21.15.154:0/3469235554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd218198370 0x7fd21819d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:43.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd216ffd700 1 -- 172.21.15.154:0/3469235554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2181987f0 msgr2=0x7fd21819f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:43.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd216ffd700 1 --2- 172.21.15.154:0/3469235554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2181987f0 0x7fd21819f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:43.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd216ffd700 1 -- 172.21.15.154:0/3469235554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2181a01f0 con 0x7fd2181025f0 2024-04-20T12:14:43.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd216ffd700 1 --2- 172.21.15.154:0/3469235554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2181025f0 0x7fd218197e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd208000c00 tx=0x7fd208005000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:43.322 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd20ffff700 1 -- 172.21.15.154:0/3469235554 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208027070 con 0x7fd2181025f0 2024-04-20T12:14:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd21d524700 1 -- 172.21.15.154:0/3469235554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2181a0480 con 0x7fd2181025f0 2024-04-20T12:14:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd20ffff700 1 -- 172.21.15.154:0/3469235554 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd208022470 con 0x7fd2181025f0 2024-04-20T12:14:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd20ffff700 1 -- 172.21.15.154:0/3469235554 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20800f680 con 0x7fd2181025f0 2024-04-20T12:14:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.319+0000 7fd21d524700 1 -- 172.21.15.154:0/3469235554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2181a09e0 con 0x7fd2181025f0 2024-04-20T12:14:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.320+0000 7fd20ffff700 1 -- 172.21.15.154:0/3469235554 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7fd20802a070 con 0x7fd2181025f0 2024-04-20T12:14:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.320+0000 7fd21d524700 1 -- 172.21.15.154:0/3469235554 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2180640b0 con 0x7fd2181025f0 2024-04-20T12:14:43.323 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.320+0000 7fd20ffff700 1 --2- 172.21.15.154:0/3469235554 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd204039ae0 0x7fd20403bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:43.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.320+0000 7fd20ffff700 1 -- 172.21.15.154:0/3469235554 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd20804dc90 con 0x7fd2181025f0 2024-04-20T12:14:43.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.321+0000 7fd2167fc700 1 --2- 172.21.15.154:0/3469235554 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd204039ae0 0x7fd20403bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:43.324 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.321+0000 7fd2167fc700 1 --2- 172.21.15.154:0/3469235554 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd204039ae0 0x7fd20403bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd2000098e0 tx=0x7fd200006dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:43.325 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.326+0000 7fd20ffff700 1 -- 172.21.15.154:0/3469235554 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fd208013070 con 0x7fd2181025f0 2024-04-20T12:14:43.541 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.542+0000 7fd21d524700 1 -- 172.21.15.154:0/3469235554 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi135=x;smithi139=y;smithi154=z", "target": ["mon-mgr", ""]}) -- 0x7fd218062e90 con 0x7fd204039ae0 2024-04-20T12:14:43.548 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.548+0000 7fd20ffff700 1 -- 172.21.15.154:0/3469235554 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd218062e90 con 0x7fd204039ae0 2024-04-20T12:14:43.548 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mgr update... 2024-04-20T12:14:43.550 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.550+0000 7fd21d524700 1 -- 172.21.15.154:0/3469235554 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd204039ae0 msgr2=0x7fd20403bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:43.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.550+0000 7fd21d524700 1 --2- 172.21.15.154:0/3469235554 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd204039ae0 0x7fd20403bfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd2000098e0 tx=0x7fd200006dd0 comp rx=0 tx=0).stop 2024-04-20T12:14:43.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.550+0000 7fd21d524700 1 -- 172.21.15.154:0/3469235554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2181025f0 msgr2=0x7fd218197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:43.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.550+0000 7fd21d524700 1 --2- 172.21.15.154:0/3469235554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2181025f0 0x7fd218197e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd208000c00 tx=0x7fd208005000 comp rx=0 tx=0).stop 2024-04-20T12:14:43.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.550+0000 7fd21d524700 1 -- 172.21.15.154:0/3469235554 shutdown_connections 2024-04-20T12:14:43.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.550+0000 7fd21d524700 1 --2- 172.21.15.154:0/3469235554 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd204039ae0 0x7fd20403bfa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:43.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.550+0000 7fd21d524700 1 --2- 172.21.15.154:0/3469235554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2181987f0 0x7fd21819f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:43.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.550+0000 7fd21d524700 1 --2- 172.21.15.154:0/3469235554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2181025f0 0x7fd218197e30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:43.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.550+0000 7fd21d524700 1 --2- 172.21.15.154:0/3469235554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd218198370 0x7fd21819d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:43.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.551+0000 7fd21d524700 1 -- 172.21.15.154:0/3469235554 >> 172.21.15.154:0/3469235554 conn(0x7fd2180fdb90 msgr2=0x7fd2180fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:43.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.551+0000 7fd21d524700 1 -- 172.21.15.154:0/3469235554 shutdown_connections 2024-04-20T12:14:43.551 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:14:43.551+0000 7fd21d524700 1 -- 172.21.15.154:0/3469235554 wait complete. 2024-04-20T12:14:43.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:43 smithi135 ceph-mon[18264]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:43.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:43 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:43.985 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:43 smithi154 ceph-mon[22073]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:43.985 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:43 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:44.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:43 smithi139 ceph-mon[21834]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:44.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:43 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:44.247 DEBUG:teuthology.orchestra.run.smithi139:mgr.y> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.y.service 2024-04-20T12:14:44.250 DEBUG:teuthology.orchestra.run.smithi154:mgr.z> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.z.service 2024-04-20T12:14:44.252 INFO:tasks.cephadm:Deploying OSDs... 2024-04-20T12:14:44.252 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:14:44.253 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-04-20T12:14:44.268 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-20T12:14:44.268 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-04-20T12:14:44.322 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-20T12:14:44.322 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T12:14:44.322 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-20T12:14:44.322 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T12:14:44.322 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T12:14:44.322 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-04-20 12:13:46.677408682 +0000 2024-04-20T12:14:44.322 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-04-20 12:08:33.667885006 +0000 2024-04-20T12:14:44.322 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-04-20 12:08:33.667885006 +0000 2024-04-20T12:14:44.323 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-04-20 12:08:33.667885006 +0000 2024-04-20T12:14:44.323 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-20T12:14:44.385 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-04-20T12:14:44.385 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-04-20T12:14:44.385 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.00019636 s, 2.6 MB/s 2024-04-20T12:14:44.386 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-20T12:14:44.442 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-04-20T12:14:44.496 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-20T12:14:44.496 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T12:14:44.496 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-20T12:14:44.496 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T12:14:44.497 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T12:14:44.497 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-04-20 12:13:46.707408057 +0000 2024-04-20T12:14:44.497 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-04-20 12:08:34.011875507 +0000 2024-04-20T12:14:44.497 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-04-20 12:08:34.011875507 +0000 2024-04-20T12:14:44.497 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-04-20 12:08:34.011875507 +0000 2024-04-20T12:14:44.497 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-20T12:14:44.558 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-04-20T12:14:44.559 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-04-20T12:14:44.559 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000209224 s, 2.4 MB/s 2024-04-20T12:14:44.560 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-20T12:14:44.614 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-04-20T12:14:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-20T12:14:44.669 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T12:14:44.669 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-20T12:14:44.669 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T12:14:44.669 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T12:14:44.669 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-04-20 12:13:46.737407432 +0000 2024-04-20T12:14:44.669 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-04-20 12:08:34.346866256 +0000 2024-04-20T12:14:44.669 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-04-20 12:08:34.346866256 +0000 2024-04-20T12:14:44.670 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-04-20 12:08:34.346866256 +0000 2024-04-20T12:14:44.670 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-20T12:14:44.731 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-04-20T12:14:44.731 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-04-20T12:14:44.731 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000175038 s, 2.9 MB/s 2024-04-20T12:14:44.733 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-20T12:14:44.788 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-04-20T12:14:44.843 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-20T12:14:44.843 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T12:14:44.843 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-20T12:14:44.843 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T12:14:44.843 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T12:14:44.843 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-04-20 12:13:46.766406828 +0000 2024-04-20T12:14:44.843 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-04-20 12:08:34.675857172 +0000 2024-04-20T12:14:44.843 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-04-20 12:08:34.675857172 +0000 2024-04-20T12:14:44.843 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-04-20 12:08:34.675857172 +0000 2024-04-20T12:14:44.844 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-20T12:14:44.905 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-04-20T12:14:44.906 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-04-20T12:14:44.906 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000157735 s, 3.2 MB/s 2024-04-20T12:14:44.907 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-20T12:14:44.962 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-20T12:14:44.962 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2024-04-20T12:14:44.981 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-20T12:14:44.981 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2024-04-20T12:14:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-20T12:14:45.039 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T12:14:45.039 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-20T12:14:45.039 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T12:14:45.039 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T12:14:45.039 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-20 12:14:29.338210838 +0000 2024-04-20T12:14:45.039 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-20 12:08:55.574287705 +0000 2024-04-20T12:14:45.039 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-20 12:08:55.574287705 +0000 2024-04-20T12:14:45.040 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-20 12:08:55.574287705 +0000 2024-04-20T12:14:45.040 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-20T12:14:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:44 smithi139 ceph-mon[21834]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi135=x;smithi139=y;smithi154=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:14:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:44 smithi139 ceph-mon[21834]: Saving service mgr spec with placement smithi135=x;smithi139=y;smithi154=z;count:3 2024-04-20T12:14:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T12:14:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-20T12:14:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T12:14:45.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:45.096 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:44 smithi154 ceph-mon[22073]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi135=x;smithi139=y;smithi154=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:14:45.097 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:44 smithi154 ceph-mon[22073]: Saving service mgr spec with placement smithi135=x;smithi139=y;smithi154=z;count:3 2024-04-20T12:14:45.097 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:45.097 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:45.097 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:45.097 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:45.097 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:45.097 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:45.097 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T12:14:45.097 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-20T12:14:45.097 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T12:14:45.097 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:45.105 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-20T12:14:45.105 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-20T12:14:45.105 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000291122 s, 1.8 MB/s 2024-04-20T12:14:45.106 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-20T12:14:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:44 smithi135 ceph-mon[18264]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi135=x;smithi139=y;smithi154=z", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:14:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:44 smithi135 ceph-mon[18264]: Saving service mgr spec with placement smithi135=x;smithi139=y;smithi154=z;count:3 2024-04-20T12:14:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T12:14:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-20T12:14:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T12:14:45.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:45.164 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2024-04-20T12:14:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-20T12:14:45.221 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T12:14:45.221 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-20T12:14:45.222 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T12:14:45.222 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T12:14:45.222 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-20 12:14:29.339210816 +0000 2024-04-20T12:14:45.222 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-20 12:08:55.916280035 +0000 2024-04-20T12:14:45.222 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-20 12:08:55.916280035 +0000 2024-04-20T12:14:45.222 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-20 12:08:55.916280035 +0000 2024-04-20T12:14:45.222 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-20T12:14:45.287 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-20T12:14:45.287 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-20T12:14:45.287 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000209018 s, 2.4 MB/s 2024-04-20T12:14:45.288 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-20T12:14:45.346 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2024-04-20T12:14:45.402 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-20T12:14:45.402 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T12:14:45.402 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-20T12:14:45.402 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T12:14:45.402 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T12:14:45.402 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-20 12:14:29.339210816 +0000 2024-04-20T12:14:45.402 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-20 12:08:56.259272343 +0000 2024-04-20T12:14:45.403 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-20 12:08:56.259272343 +0000 2024-04-20T12:14:45.403 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-20 12:08:56.259272343 +0000 2024-04-20T12:14:45.403 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-20T12:14:45.467 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-20T12:14:45.467 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-20T12:14:45.467 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000244581 s, 2.1 MB/s 2024-04-20T12:14:45.468 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-20T12:14:45.525 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2024-04-20T12:14:45.580 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-20T12:14:45.580 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T12:14:45.580 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-20T12:14:45.580 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T12:14:45.580 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T12:14:45.580 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-20 12:14:29.340210794 +0000 2024-04-20T12:14:45.580 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-20 12:08:56.604264606 +0000 2024-04-20T12:14:45.580 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-20 12:08:56.604264606 +0000 2024-04-20T12:14:45.580 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-20 12:08:56.604264606 +0000 2024-04-20T12:14:45.580 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-20T12:14:45.643 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-20T12:14:45.643 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-20T12:14:45.643 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000237406 s, 2.2 MB/s 2024-04-20T12:14:45.644 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-20T12:14:45.700 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-20T12:14:45.700 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-04-20T12:14:45.715 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-20T12:14:45.715 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-04-20T12:14:45.770 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-20T12:14:45.770 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T12:14:45.770 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-20T12:14:45.770 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T12:14:45.770 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T12:14:45.770 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-20 12:14:19.117741717 +0000 2024-04-20T12:14:45.770 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-20 12:09:13.395045407 +0000 2024-04-20T12:14:45.771 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-20 12:09:13.395045407 +0000 2024-04-20T12:14:45.771 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-04-20 12:09:13.395045407 +0000 2024-04-20T12:14:45.771 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-20T12:14:45.834 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-20T12:14:45.834 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-20T12:14:45.834 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000266265 s, 1.9 MB/s 2024-04-20T12:14:45.835 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-20T12:14:45.896 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-04-20T12:14:45.951 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-20T12:14:45.952 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T12:14:45.952 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-20T12:14:45.952 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T12:14:45.952 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T12:14:45.952 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-20 12:14:19.117741717 +0000 2024-04-20T12:14:45.952 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-20 12:09:13.735035910 +0000 2024-04-20T12:14:45.952 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-20 12:09:13.735035910 +0000 2024-04-20T12:14:45.952 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-04-20 12:09:13.735035910 +0000 2024-04-20T12:14:45.952 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-20T12:14:46.012 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:45 smithi154 ceph-mon[22073]: Deploying daemon mgr.z on smithi154 2024-04-20T12:14:46.012 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:45 smithi154 ceph-mon[22073]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:46.023 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-20T12:14:46.023 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-20T12:14:46.023 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000205316 s, 2.5 MB/s 2024-04-20T12:14:46.024 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-20T12:14:46.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:45 smithi139 ceph-mon[21834]: Deploying daemon mgr.z on smithi154 2024-04-20T12:14:46.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:45 smithi139 ceph-mon[21834]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:46.086 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-04-20T12:14:46.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:45 smithi135 ceph-mon[18264]: Deploying daemon mgr.z on smithi154 2024-04-20T12:14:46.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:45 smithi135 ceph-mon[18264]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:46.141 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-20T12:14:46.141 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T12:14:46.141 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-20T12:14:46.141 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T12:14:46.141 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T12:14:46.141 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-20 12:14:45.975011638 +0000 2024-04-20T12:14:46.141 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-20 12:09:14.083026189 +0000 2024-04-20T12:14:46.141 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-20 12:09:14.083026189 +0000 2024-04-20T12:14:46.141 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-04-20 12:09:14.083026189 +0000 2024-04-20T12:14:46.142 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-20T12:14:46.203 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-20T12:14:46.204 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-20T12:14:46.204 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000233205 s, 2.2 MB/s 2024-04-20T12:14:46.205 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-20T12:14:46.263 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-04-20T12:14:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-20T12:14:46.318 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T12:14:46.318 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-20T12:14:46.318 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T12:14:46.318 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T12:14:46.318 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-20 12:14:46.154006772 +0000 2024-04-20T12:14:46.318 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-20 12:09:14.429016524 +0000 2024-04-20T12:14:46.318 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-20 12:09:14.429016524 +0000 2024-04-20T12:14:46.319 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2024-04-20 12:09:14.429016524 +0000 2024-04-20T12:14:46.319 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-20T12:14:46.380 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:46 smithi154 systemd[1]: Starting Ceph mgr.z for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:14:46.382 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-20T12:14:46.382 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-20T12:14:46.382 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000196349 s, 2.6 MB/s 2024-04-20T12:14:46.384 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-20T12:14:46.439 INFO:tasks.cephadm:Deploying osd.0 on smithi135 with /dev/vg_nvme/lv_4... 2024-04-20T12:14:46.440 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-20T12:14:46.658 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:46 smithi154 podman[23859]: 2024-04-20 12:14:46.335498093 +0000 UTC m=+0.017773735 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:14:46.658 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:46 smithi154 podman[23859]: 2024-04-20 12:14:46.456992089 +0000 UTC m=+0.139267699 container create c3d765456a4bccc8c097f366e2041eaa519f3646c4b69c8c01da25df2f40c6c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-20T12:14:46.658 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:46 smithi154 podman[23859]: 2024-04-20 12:14:46.659219568 +0000 UTC m=+0.341495179 container init c3d765456a4bccc8c097f366e2041eaa519f3646c4b69c8c01da25df2f40c6c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-20T12:14:46.677 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:14:47.001 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:46 smithi154 podman[23859]: 2024-04-20 12:14:46.66194905 +0000 UTC m=+0.344224661 container start c3d765456a4bccc8c097f366e2041eaa519f3646c4b69c8c01da25df2f40c6c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T12:14:47.001 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:46 smithi154 ceph-mgr[23923]: -- 172.21.15.154:0/2860024053 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55578f3dc5a0 con 0x55578f3b0800 2024-04-20T12:14:47.001 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:46 smithi154 bash[23859]: c3d765456a4bccc8c097f366e2041eaa519f3646c4b69c8c01da25df2f40c6c6 2024-04-20T12:14:47.001 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:46 smithi154 systemd[1]: Started Ceph mgr.z for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:14:47.002 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:46 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:46.822+0000 7f6c0d9d5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-20T12:14:47.422 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:47 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:47.015+0000 7f6c0d9d5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:14:47.423 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:47 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:47.117+0000 7f6c0d9d5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-20T12:14:47.423 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:47 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:47.422+0000 7f6c0d9d5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-20T12:14:47.751 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:47 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:47.506+0000 7f6c0d9d5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-20T12:14:47.989 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:47 smithi135 ceph-mon[18264]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:47.989 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:47 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:47.989 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:47 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:47.989 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:47 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:47.989 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:47 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T12:14:47.989 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:47 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-20T12:14:47.990 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:47 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T12:14:47.990 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:47 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:48.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:47 smithi139 ceph-mon[21834]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:48.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:47 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:48.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:47 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:48.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:47 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:48.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:47 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T12:14:48.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:47 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-20T12:14:48.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:47 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T12:14:48.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:47 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:48.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:47 smithi154 ceph-mon[22073]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:48.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:47 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:48.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:47 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:48.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:47 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:48.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:47 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T12:14:48.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:47 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-20T12:14:48.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:47 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T12:14:48.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:47 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:48.545 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-20T12:14:48.545 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-20T12:14:48.545 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-04-20T12:14:48.545 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-04-20T12:14:48.545 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113227 s, 926 MB/s 2024-04-20T12:14:48.545 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-04-20T12:14:48.991 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:48 smithi139 ceph-mon[21834]: Deploying daemon mgr.y on smithi139 2024-04-20T12:14:49.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:48 smithi154 ceph-mon[22073]: Deploying daemon mgr.y on smithi139 2024-04-20T12:14:49.001 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:48 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:48.699+0000 7f6c0d9d5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-20T12:14:49.001 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:48 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:48.869+0000 7f6c0d9d5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-20T12:14:49.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:48 smithi135 ceph-mon[18264]: Deploying daemon mgr.y on smithi139 2024-04-20T12:14:49.153 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_4 2024-04-20T12:14:49.311 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:49 smithi139 podman[23198]: 2024-04-20 12:14:49.311704612 +0000 UTC m=+0.428205571 container init e48f990b6de0df804961fa78c4a2912676e88b99a0712a68cba71d1938fcd485 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-20T12:14:49.349 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:49 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:49.046+0000 7f6c0d9d5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-20T12:14:49.349 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:49 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:49.348+0000 7f6c0d9d5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-20T12:14:49.383 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:14:49.580 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:49 smithi139 podman[23198]: 2024-04-20 12:14:49.314663728 +0000 UTC m=+0.431164689 container start e48f990b6de0df804961fa78c4a2912676e88b99a0712a68cba71d1938fcd485 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:14:49.580 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:49 smithi139 ceph-mgr[23218]: -- 172.21.15.139:0/2147712236 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563031d105a0 con 0x563031ce4c00 2024-04-20T12:14:49.580 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:49 smithi139 bash[23198]: e48f990b6de0df804961fa78c4a2912676e88b99a0712a68cba71d1938fcd485 2024-04-20T12:14:49.580 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:49 smithi139 systemd[1]: Started Ceph mgr.y for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:14:49.580 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:49 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:49.469+0000 7f1413c78200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-20T12:14:49.666 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:49 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:49.443+0000 7f6c0d9d5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-20T12:14:49.666 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:49 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:49.665+0000 7f6c0d9d5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-20T12:14:50.001 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:49 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:49.868+0000 7f6c0d9d5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:14:50.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:49 smithi154 ceph-mon[22073]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:50.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:50.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:50.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:50.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:50.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:50.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:49 smithi139 ceph-mon[21834]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:50.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:50.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:50.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:50.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:50.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:50.080 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:49 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:49.669+0000 7f1413c78200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:14:50.080 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:49 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:49.779+0000 7f1413c78200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-20T12:14:50.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:49 smithi135 ceph-mon[18264]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:50.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:50.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:50.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:50.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:50.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:50.467 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:50 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:50.126+0000 7f1413c78200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-20T12:14:50.468 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:50 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:50.221+0000 7f1413c78200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-20T12:14:50.751 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:50 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:50.519+0000 7f6c0d9d5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-20T12:14:50.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.872+0000 7f836fcca700 1 -- 172.21.15.135:0/3188517797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368100dc0 msgr2=0x7f83681011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.872+0000 7f836fcca700 1 --2- 172.21.15.135:0/3188517797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368100dc0 0x7f83681011e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f83580099c0 tx=0x7f8358009cd0 comp rx=0 tx=0).stop 2024-04-20T12:14:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.872+0000 7f836fcca700 1 -- 172.21.15.135:0/3188517797 shutdown_connections 2024-04-20T12:14:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.872+0000 7f836fcca700 1 --2- 172.21.15.135:0/3188517797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83681047e0 0x7f836810b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.872+0000 7f836fcca700 1 --2- 172.21.15.135:0/3188517797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368100dc0 0x7f83681011e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.872+0000 7f836fcca700 1 --2- 172.21.15.135:0/3188517797 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8368103e40 0x7f83681042a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.872+0000 7f836fcca700 1 -- 172.21.15.135:0/3188517797 >> 172.21.15.135:0/3188517797 conn(0x7f83680fc700 msgr2=0x7f83680feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:14:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.872+0000 7f836fcca700 1 -- 172.21.15.135:0/3188517797 shutdown_connections 2024-04-20T12:14:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.872+0000 7f836fcca700 1 -- 172.21.15.135:0/3188517797 wait complete. 2024-04-20T12:14:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.873+0000 7f836fcca700 1 Processor -- start 2024-04-20T12:14:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.873+0000 7f836fcca700 1 -- start start 2024-04-20T12:14:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.873+0000 7f836fcca700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8368100dc0 0x7f8368198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:50.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.873+0000 7f836fcca700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368103e40 0x7f83681991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.873+0000 7f836fcca700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83681047e0 0x7f83681a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.873+0000 7f836fcca700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f836810e6c0 con 0x7f8368103e40 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.873+0000 7f836fcca700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f836810e540 con 0x7f8368100dc0 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.873+0000 7f836fcca700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f836810e840 con 0x7f83681047e0 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.873+0000 7f836d265700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368103e40 0x7f83681991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.873+0000 7f836d265700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368103e40 0x7f83681991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53074/0 (socket says 172.21.15.135:53074) 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.873+0000 7f836d265700 1 -- 172.21.15.135:0/80627916 learned_addr learned my addr 172.21.15.135:0/80627916 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.873+0000 7f836da66700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8368100dc0 0x7f8368198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.873+0000 7f836e267700 1 --2- 172.21.15.135:0/80627916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83681047e0 0x7f83681a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.874+0000 7f836d265700 1 -- 172.21.15.135:0/80627916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83681047e0 msgr2=0x7f83681a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.874+0000 7f836d265700 1 --2- 172.21.15.135:0/80627916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83681047e0 0x7f83681a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.874+0000 7f836d265700 1 -- 172.21.15.135:0/80627916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8368100dc0 msgr2=0x7f8368198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.874+0000 7f836d265700 1 --2- 172.21.15.135:0/80627916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8368100dc0 0x7f8368198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.874+0000 7f836d265700 1 -- 172.21.15.135:0/80627916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83681a0930 con 0x7f8368103e40 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.874+0000 7f836d265700 1 --2- 172.21.15.135:0/80627916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368103e40 0x7f83681991f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f836400e9a0 tx=0x7f836400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:50.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.874+0000 7f835effd700 1 -- 172.21.15.135:0/80627916 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836400ca10 con 0x7f8368103e40 2024-04-20T12:14:50.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.874+0000 7f835effd700 1 -- 172.21.15.135:0/80627916 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f836400cbb0 con 0x7f8368103e40 2024-04-20T12:14:50.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.874+0000 7f836fcca700 1 -- 172.21.15.135:0/80627916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83681a0c20 con 0x7f8368103e40 2024-04-20T12:14:50.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.874+0000 7f835effd700 1 -- 172.21.15.135:0/80627916 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8364018680 con 0x7f8368103e40 2024-04-20T12:14:50.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.874+0000 7f836fcca700 1 -- 172.21.15.135:0/80627916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83681a11b0 con 0x7f8368103e40 2024-04-20T12:14:50.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.875+0000 7f835effd700 1 -- 172.21.15.135:0/80627916 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 46615+0+0 (secure 0 0 0) 0x7f8364018820 con 0x7f8368103e40 2024-04-20T12:14:50.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.875+0000 7f836fcca700 1 -- 172.21.15.135:0/80627916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8368069740 con 0x7f8368103e40 2024-04-20T12:14:50.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.875+0000 7f835effd700 1 --2- 172.21.15.135:0/80627916 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8354039890 0x7f835403bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:14:50.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.875+0000 7f835effd700 1 -- 172.21.15.135:0/80627916 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f836404cb70 con 0x7f8368103e40 2024-04-20T12:14:50.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.875+0000 7f836da66700 1 --2- 172.21.15.135:0/80627916 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8354039890 0x7f835403bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:14:50.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.876+0000 7f836da66700 1 --2- 172.21.15.135:0/80627916 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8354039890 0x7f835403bd50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8358009990 tx=0x7f8358005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:14:50.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:50.880+0000 7f835effd700 1 -- 172.21.15.135:0/80627916 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f836400fc70 con 0x7f8368103e40 2024-04-20T12:14:51.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:51.093+0000 7f836fcca700 1 -- 172.21.15.135:0/80627916 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8368062e90 con 0x7f8354039890 2024-04-20T12:14:51.251 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:50 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:50.969+0000 7f6c0d9d5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-20T12:14:51.251 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:51.065+0000 7f6c0d9d5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-20T12:14:51.751 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:51.268+0000 7f6c0d9d5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-20T12:14:51.806 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:51.467+0000 7f1413c78200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-20T12:14:51.807 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:51.635+0000 7f1413c78200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-20T12:14:51.807 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:51.806+0000 7f1413c78200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-20T12:14:52.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:51 smithi135 ceph-mon[18264]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:52.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:52.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:52.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.039 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:14:52.040 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:14:52.040 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:52.040 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T12:14:52.040 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T12:14:52.040 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:52.040 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-mon[21834]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:52.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:52.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:52.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:14:52.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:14:52.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:52.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T12:14:52.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T12:14:52.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:52.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.114 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:51.785+0000 7f6c0d9d5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-20T12:14:52.114 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:51.876+0000 7f6c0d9d5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-20T12:14:52.114 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-mon[22073]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:52.115 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.115 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.115 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.115 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.115 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:52.115 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:52.115 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.115 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:14:52.115 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:14:52.115 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:52.115 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-20T12:14:52.115 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-20T12:14:52.115 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:52.115 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:52.385 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:52 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:52.093+0000 7f1413c78200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-20T12:14:52.385 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:52 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:52.183+0000 7f1413c78200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-20T12:14:52.385 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:52 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:52.385+0000 7f1413c78200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-20T12:14:52.449 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:52 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:52.114+0000 7f6c0d9d5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-20T12:14:52.449 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:52 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:52.244+0000 7f6c0d9d5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-20T12:14:52.449 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:52 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:52.336+0000 7f6c0d9d5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-20T12:14:52.449 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:52 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:52.449+0000 7f6c0d9d5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-20T12:14:52.830 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:52 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:52.576+0000 7f1413c78200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:14:53.001 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:52 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:52.749+0000 7f6c0d9d5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-20T12:14:53.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:52 smithi154 ceph-mon[22073]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:14:53.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:52 smithi154 ceph-mon[22073]: Reconfiguring mgr.x (unknown last config time)... 2024-04-20T12:14:53.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:52 smithi154 ceph-mon[22073]: Reconfiguring daemon mgr.x on smithi135 2024-04-20T12:14:53.088 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:52 smithi135 ceph-mon[18264]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:14:53.089 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:52 smithi135 ceph-mon[18264]: Reconfiguring mgr.x (unknown last config time)... 2024-04-20T12:14:53.089 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:52 smithi135 ceph-mon[18264]: Reconfiguring daemon mgr.x on smithi135 2024-04-20T12:14:53.171 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:52 smithi139 ceph-mon[21834]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:14:53.172 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:52 smithi139 ceph-mon[21834]: Reconfiguring mgr.x (unknown last config time)... 2024-04-20T12:14:53.172 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:52 smithi139 ceph-mon[21834]: Reconfiguring daemon mgr.x on smithi135 2024-04-20T12:14:53.579 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:53.171+0000 7f1413c78200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-20T12:14:53.751 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:53 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:53.339+0000 7f6c0d9d5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-20T12:14:53.751 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:14:53 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:14:53.553+0000 7f6c0d9d5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-20T12:14:53.861 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:53.592+0000 7f1413c78200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-20T12:14:53.861 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:53.687+0000 7f1413c78200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-20T12:14:54.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:53 smithi135 ceph-mon[18264]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:54.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:54.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:54.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:54.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:54.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:54.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:54.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:53 smithi135 ceph-mon[18264]: Standby manager daemon z started 2024-04-20T12:14:54.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:53 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.154:0/1639330039' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-20T12:14:54.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:53 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.154:0/1639330039' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T12:14:54.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:53 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.154:0/1639330039' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-20T12:14:54.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:53 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.154:0/1639330039' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T12:14:54.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:53 smithi154 ceph-mon[22073]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:54.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:54.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:54.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:54.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:54.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:54.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:54.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:53 smithi154 ceph-mon[22073]: Standby manager daemon z started 2024-04-20T12:14:54.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:53 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.154:0/1639330039' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-20T12:14:54.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:53 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.154:0/1639330039' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T12:14:54.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:53 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.154:0/1639330039' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-20T12:14:54.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:53 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.154:0/1639330039' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T12:14:54.330 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:53.887+0000 7f1413c78200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-20T12:14:54.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-mon[21834]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:54.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:54.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:54.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:14:54.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:14:54.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:14:54.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:14:54.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-mon[21834]: Standby manager daemon z started 2024-04-20T12:14:54.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.154:0/1639330039' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-20T12:14:54.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.154:0/1639330039' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T12:14:54.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.154:0/1639330039' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-20T12:14:54.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:53 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.154:0/1639330039' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T12:14:54.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:54.436+0000 7f835effd700 1 -- 172.21.15.135:0/80627916 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 14) ==== 92603+0+0 (secure 0 0 0) 0x7f83640178f0 con 0x7f8368103e40 2024-04-20T12:14:54.735 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:54 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:54.404+0000 7f1413c78200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-20T12:14:54.735 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:54 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:54.495+0000 7f1413c78200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-20T12:14:55.073 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:54 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:54.735+0000 7f1413c78200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-20T12:14:55.074 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:54 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:54.866+0000 7f1413c78200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-20T12:14:55.074 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:54 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:54.959+0000 7f1413c78200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-20T12:14:55.074 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:55 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:55.073+0000 7f1413c78200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-20T12:14:55.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:55 smithi154 ceph-mon[22073]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-20T12:14:55.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:55 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-20T12:14:55.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:55 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3981487721' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57163598-6432-4dc1-b390-bcf40e339545"}]: dispatch 2024-04-20T12:14:55.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:55 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3981487721' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57163598-6432-4dc1-b390-bcf40e339545"}]': finished 2024-04-20T12:14:55.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:55 smithi154 ceph-mon[22073]: osdmap e5: 1 total, 0 up, 1 in 2024-04-20T12:14:55.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:55 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:14:55.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:55 smithi154 ceph-mon[22073]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:55.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:55 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1603156142' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:14:55.830 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:55 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:55.374+0000 7f1413c78200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-20T12:14:55.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:55 smithi139 ceph-mon[21834]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-20T12:14:55.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:55 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-20T12:14:55.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:55 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3981487721' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57163598-6432-4dc1-b390-bcf40e339545"}]: dispatch 2024-04-20T12:14:55.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:55 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3981487721' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57163598-6432-4dc1-b390-bcf40e339545"}]': finished 2024-04-20T12:14:55.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:55 smithi139 ceph-mon[21834]: osdmap e5: 1 total, 0 up, 1 in 2024-04-20T12:14:55.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:55 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:14:55.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:55 smithi139 ceph-mon[21834]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:55.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:55 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1603156142' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:14:55.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:55 smithi135 ceph-mon[18264]: mgrmap e14: x(active, since 77s), standbys: z 2024-04-20T12:14:55.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:55 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-20T12:14:55.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:55 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3981487721' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "57163598-6432-4dc1-b390-bcf40e339545"}]: dispatch 2024-04-20T12:14:55.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:55 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3981487721' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57163598-6432-4dc1-b390-bcf40e339545"}]': finished 2024-04-20T12:14:55.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:55 smithi135 ceph-mon[18264]: osdmap e5: 1 total, 0 up, 1 in 2024-04-20T12:14:55.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:55 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:14:55.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:55 smithi135 ceph-mon[18264]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:55.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:55 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1603156142' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:14:56.330 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:55 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:55.968+0000 7f1413c78200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-20T12:14:56.330 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:14:56 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:14:56.180+0000 7f1413c78200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-20T12:14:56.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:14:56.523+0000 7f835effd700 1 -- 172.21.15.135:0/80627916 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mgrmap(e 15) ==== 138591+0+0 (secure 0 0 0) 0x7f8364018b10 con 0x7f8368103e40 2024-04-20T12:14:56.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:56 smithi139 ceph-mon[21834]: Standby manager daemon y started 2024-04-20T12:14:56.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:56 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.139:0/3733452411' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-20T12:14:56.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:56 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.139:0/3733452411' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T12:14:56.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:56 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.139:0/3733452411' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-20T12:14:56.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:56 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.139:0/3733452411' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T12:14:56.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:56 smithi135 ceph-mon[18264]: Standby manager daemon y started 2024-04-20T12:14:56.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:56 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.139:0/3733452411' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-20T12:14:56.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:56 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.139:0/3733452411' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T12:14:56.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:56 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.139:0/3733452411' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-20T12:14:56.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:56 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.139:0/3733452411' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T12:14:57.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:56 smithi154 ceph-mon[22073]: Standby manager daemon y started 2024-04-20T12:14:57.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:56 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.139:0/3733452411' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-20T12:14:57.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:56 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.139:0/3733452411' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T12:14:57.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:56 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.139:0/3733452411' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-20T12:14:57.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:56 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.139:0/3733452411' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T12:14:57.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:57 smithi139 ceph-mon[21834]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-04-20T12:14:57.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:57 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-20T12:14:57.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:57 smithi139 ceph-mon[21834]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:57.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:57 smithi135 ceph-mon[18264]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-04-20T12:14:57.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:57 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-20T12:14:57.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:57 smithi135 ceph-mon[18264]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:14:58.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:57 smithi154 ceph-mon[22073]: mgrmap e15: x(active, since 79s), standbys: z, y 2024-04-20T12:14:58.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:57 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-20T12:14:58.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:57 smithi154 ceph-mon[22073]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:00.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:14:59 smithi139 ceph-mon[21834]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:00.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:14:59 smithi135 ceph-mon[18264]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:00.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:14:59 smithi154 ceph-mon[22073]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:02.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:01 smithi139 ceph-mon[21834]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:02.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-20T12:15:02.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:02.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:01 smithi135 ceph-mon[18264]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:02.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-20T12:15:02.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:02.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:01 smithi154 ceph-mon[22073]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:02.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-20T12:15:02.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:03.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:02 smithi139 ceph-mon[21834]: Deploying daemon osd.0 on smithi135 2024-04-20T12:15:03.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:02 smithi135 ceph-mon[18264]: Deploying daemon osd.0 on smithi135 2024-04-20T12:15:03.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:02 smithi154 ceph-mon[22073]: Deploying daemon osd.0 on smithi135 2024-04-20T12:15:04.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:03 smithi139 ceph-mon[21834]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:04.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:03 smithi135 ceph-mon[18264]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:04.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:03 smithi154 ceph-mon[22073]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:06.053 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:05 smithi135 ceph-mon[18264]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:06.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:05 smithi139 ceph-mon[21834]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:06.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:05 smithi154 ceph-mon[22073]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:07.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:07 smithi135 ceph-mon[18264]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:07.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:07.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:07.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:08.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:07 smithi139 ceph-mon[21834]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:07 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:07 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:07 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:07 smithi154 ceph-mon[22073]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:07 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:07 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:07 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:10.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:09 smithi139 ceph-mon[21834]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:10.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:09 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:10.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:09 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:10.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:09 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:10.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:09 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:15:10.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:09 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:10.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:09 smithi135 ceph-mon[18264]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:10.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:09 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:10.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:09 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:10.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:09 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:10.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:09 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:15:10.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:09 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:10.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:09 smithi154 ceph-mon[22073]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:10.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:09 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:10.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:09 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:10.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:09 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:10.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:09 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:15:10.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:09 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:10.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:15:10.652+0000 7f835effd700 1 -- 172.21.15.135:0/80627916 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8368062e90 con 0x7f8354039890 2024-04-20T12:15:10.653 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 0 on host 'smithi135' 2024-04-20T12:15:10.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:15:10.654+0000 7f836fcca700 1 -- 172.21.15.135:0/80627916 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8354039890 msgr2=0x7f835403bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:15:10.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:15:10.654+0000 7f836fcca700 1 --2- 172.21.15.135:0/80627916 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8354039890 0x7f835403bd50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8358009990 tx=0x7f8358005fb0 comp rx=0 tx=0).stop 2024-04-20T12:15:10.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:15:10.654+0000 7f836fcca700 1 -- 172.21.15.135:0/80627916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368103e40 msgr2=0x7f83681991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:15:10.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:15:10.654+0000 7f836fcca700 1 --2- 172.21.15.135:0/80627916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368103e40 0x7f83681991f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f836400e9a0 tx=0x7f836400ecb0 comp rx=0 tx=0).stop 2024-04-20T12:15:10.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:15:10.654+0000 7f836fcca700 1 -- 172.21.15.135:0/80627916 shutdown_connections 2024-04-20T12:15:10.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:15:10.654+0000 7f836fcca700 1 --2- 172.21.15.135:0/80627916 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8354039890 0x7f835403bd50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:10.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:15:10.654+0000 7f836fcca700 1 --2- 172.21.15.135:0/80627916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f83681047e0 0x7f83681a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:10.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:15:10.654+0000 7f836fcca700 1 --2- 172.21.15.135:0/80627916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8368100dc0 0x7f8368198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:10.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:15:10.654+0000 7f836fcca700 1 --2- 172.21.15.135:0/80627916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8368103e40 0x7f83681991f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:10.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:15:10.654+0000 7f836fcca700 1 -- 172.21.15.135:0/80627916 >> 172.21.15.135:0/80627916 conn(0x7f83680fc700 msgr2=0x7f8368107140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:15:10.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:15:10.654+0000 7f836fcca700 1 -- 172.21.15.135:0/80627916 shutdown_connections 2024-04-20T12:15:10.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:15:10.654+0000 7f836fcca700 1 -- 172.21.15.135:0/80627916 wait complete. 2024-04-20T12:15:11.278 DEBUG:teuthology.orchestra.run.smithi135:osd.0> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.0.service 2024-04-20T12:15:11.281 INFO:tasks.cephadm:Deploying osd.1 on smithi139 with /dev/vg_nvme/lv_4... 2024-04-20T12:15:11.281 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-20T12:15:11.525 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.b/config 2024-04-20T12:15:11.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:11 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:11.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:11 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:11.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:11 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:11.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:11 smithi135 ceph-mon[18264]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:11.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:11 smithi135 ceph-mon[18264]: from='osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-20T12:15:11.923 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:11 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:11.924 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:11 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:11.924 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:11 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:11.924 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:11 smithi139 ceph-mon[21834]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:11.924 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:11 smithi139 ceph-mon[21834]: from='osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-20T12:15:12.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:11 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:12.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:11 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:12.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:11 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:12.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:11 smithi154 ceph-mon[22073]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:12.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:11 smithi154 ceph-mon[22073]: from='osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-20T12:15:12.908 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:12 smithi139 ceph-mon[21834]: from='osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-20T12:15:12.908 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:12 smithi139 ceph-mon[21834]: osdmap e6: 1 total, 0 up, 1 in 2024-04-20T12:15:12.908 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:12 smithi139 ceph-mon[21834]: from='osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-20T12:15:12.908 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:12 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:15:13.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:12 smithi154 ceph-mon[22073]: from='osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-20T12:15:13.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:12 smithi154 ceph-mon[22073]: osdmap e6: 1 total, 0 up, 1 in 2024-04-20T12:15:13.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:12 smithi154 ceph-mon[22073]: from='osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-20T12:15:13.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:12 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:15:13.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:12 smithi135 ceph-mon[18264]: from='osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-20T12:15:13.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:12 smithi135 ceph-mon[18264]: osdmap e6: 1 total, 0 up, 1 in 2024-04-20T12:15:13.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:12 smithi135 ceph-mon[18264]: from='osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-20T12:15:13.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:12 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:15:13.460 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:15:13 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-0[30636]: 2024-04-20T12:15:13.133+0000 7f35eaf4f700 -1 osd.0 0 waiting for initial osdmap 2024-04-20T12:15:13.460 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:15:13 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-0[30636]: 2024-04-20T12:15:13.137+0000 7f35e2d3a700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T12:15:13.592 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-20T12:15:13.592 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-20T12:15:13.592 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2024-04-20T12:15:13.592 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2024-04-20T12:15:13.592 INFO:teuthology.orchestra.run.smithi139.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0132013 s, 794 MB/s 2024-04-20T12:15:13.592 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2024-04-20T12:15:13.822 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:13 smithi135 ceph-mon[18264]: from='osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-20T12:15:13.822 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:13 smithi135 ceph-mon[18264]: osdmap e7: 1 total, 0 up, 1 in 2024-04-20T12:15:13.822 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:15:13.822 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:15:13.822 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:13 smithi135 ceph-mon[18264]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:13.823 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:13 smithi135 ceph-mon[18264]: from='osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144]' entity='osd.0' 2024-04-20T12:15:13.891 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:13 smithi139 ceph-mon[21834]: from='osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-20T12:15:13.891 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:13 smithi139 ceph-mon[21834]: osdmap e7: 1 total, 0 up, 1 in 2024-04-20T12:15:13.891 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:13 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:15:13.892 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:13 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:15:13.892 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:13 smithi139 ceph-mon[21834]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:13.892 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:13 smithi139 ceph-mon[21834]: from='osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144]' entity='osd.0' 2024-04-20T12:15:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:13 smithi154 ceph-mon[22073]: from='osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-20T12:15:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:13 smithi154 ceph-mon[22073]: osdmap e7: 1 total, 0 up, 1 in 2024-04-20T12:15:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:13 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:15:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:13 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:15:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:13 smithi154 ceph-mon[22073]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-20T12:15:14.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:13 smithi154 ceph-mon[22073]: from='osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144]' entity='osd.0' 2024-04-20T12:15:14.172 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_4 2024-04-20T12:15:14.413 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.b/config 2024-04-20T12:15:14.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:14 smithi139 ceph-mon[21834]: purged_snaps scrub starts 2024-04-20T12:15:14.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:14 smithi139 ceph-mon[21834]: purged_snaps scrub ok 2024-04-20T12:15:14.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:14 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:15:14.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:14 smithi139 ceph-mon[21834]: osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144] boot 2024-04-20T12:15:14.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:14 smithi139 ceph-mon[21834]: osdmap e8: 1 total, 1 up, 1 in 2024-04-20T12:15:14.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:14 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:15:14.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:14 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:14.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:14 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:14.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:14 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:15:14.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:14 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:14.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:14 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:14.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:14 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:15:14.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:14 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:14 smithi154 ceph-mon[22073]: purged_snaps scrub starts 2024-04-20T12:15:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:14 smithi154 ceph-mon[22073]: purged_snaps scrub ok 2024-04-20T12:15:15.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:14 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:15:15.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:14 smithi154 ceph-mon[22073]: osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144] boot 2024-04-20T12:15:15.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:14 smithi154 ceph-mon[22073]: osdmap e8: 1 total, 1 up, 1 in 2024-04-20T12:15:15.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:14 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:15:15.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:14 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:15.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:14 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:15.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:14 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:15:15.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:14 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:15.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:14 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:15.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:14 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:15:15.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:14 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:14 smithi135 ceph-mon[18264]: purged_snaps scrub starts 2024-04-20T12:15:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:14 smithi135 ceph-mon[18264]: purged_snaps scrub ok 2024-04-20T12:15:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:14 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:15:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:14 smithi135 ceph-mon[18264]: osd.0 [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144] boot 2024-04-20T12:15:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:14 smithi135 ceph-mon[18264]: osdmap e8: 1 total, 1 up, 1 in 2024-04-20T12:15:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:14 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:15:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:14 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:15.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:14 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:15.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:14 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:15:15.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:14 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:15.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:14 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:15.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:14 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:15:15.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:14 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:15.731 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:15 smithi139 ceph-mon[21834]: Detected new or changed devices on smithi135 2024-04-20T12:15:15.731 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:15 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi135 to 17088M 2024-04-20T12:15:15.731 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:15 smithi139 ceph-mon[21834]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:15.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.952+0000 7ff6f18ac700 1 -- 172.21.15.139:0/2154628597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ec1019b0 msgr2=0x7ff6ec101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:15:15.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.952+0000 7ff6f18ac700 1 --2- 172.21.15.139:0/2154628597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ec1019b0 0x7ff6ec101dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0099c0 tx=0x7ff6dc009cd0 comp rx=0 tx=0).stop 2024-04-20T12:15:15.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.952+0000 7ff6f18ac700 1 -- 172.21.15.139:0/2154628597 shutdown_connections 2024-04-20T12:15:15.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.952+0000 7ff6f18ac700 1 --2- 172.21.15.139:0/2154628597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6ec103550 0x7ff6ec109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:15.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.952+0000 7ff6f18ac700 1 --2- 172.21.15.139:0/2154628597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ec1019b0 0x7ff6ec101dd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:15.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.952+0000 7ff6f18ac700 1 --2- 172.21.15.139:0/2154628597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ec102bb0 0x7ff6ec103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:15.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.952+0000 7ff6f18ac700 1 -- 172.21.15.139:0/2154628597 >> 172.21.15.139:0/2154628597 conn(0x7ff6ec0fcf70 msgr2=0x7ff6ec0ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:15:15.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.952+0000 7ff6f18ac700 1 -- 172.21.15.139:0/2154628597 shutdown_connections 2024-04-20T12:15:15.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.952+0000 7ff6f18ac700 1 -- 172.21.15.139:0/2154628597 wait complete. 2024-04-20T12:15:15.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.953+0000 7ff6f18ac700 1 Processor -- start 2024-04-20T12:15:15.954 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.953+0000 7ff6f18ac700 1 -- start start 2024-04-20T12:15:15.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.953+0000 7ff6f18ac700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ec1019b0 0x7ff6ec198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:15:15.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.953+0000 7ff6f18ac700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6ec102bb0 0x7ff6ec1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:15:15.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.953+0000 7ff6f18ac700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ec103550 0x7ff6ec1a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:15:15.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.953+0000 7ff6f18ac700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec10d6c0 con 0x7ff6ec102bb0 2024-04-20T12:15:15.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.953+0000 7ff6f18ac700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec10d540 con 0x7ff6ec1019b0 2024-04-20T12:15:15.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.953+0000 7ff6f18ac700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff6ec10d840 con 0x7ff6ec103550 2024-04-20T12:15:15.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.953+0000 7ff6eaffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ec1019b0 0x7ff6ec198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:15:15.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.953+0000 7ff6eaffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ec1019b0 0x7ff6ec198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:54884/0 (socket says 172.21.15.139:54884) 2024-04-20T12:15:15.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.953+0000 7ff6eaffd700 1 -- 172.21.15.139:0/4155722007 learned_addr learned my addr 172.21.15.139:0/4155722007 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-20T12:15:15.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.953+0000 7ff6ea7fc700 1 --2- 172.21.15.139:0/4155722007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6ec102bb0 0x7ff6ec1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:15:15.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.954+0000 7ff6eb7fe700 1 --2- 172.21.15.139:0/4155722007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ec103550 0x7ff6ec1a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:15:15.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.954+0000 7ff6eaffd700 1 -- 172.21.15.139:0/4155722007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ec103550 msgr2=0x7ff6ec1a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:15:15.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.954+0000 7ff6eaffd700 1 --2- 172.21.15.139:0/4155722007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ec103550 0x7ff6ec1a0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:15.955 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.954+0000 7ff6eaffd700 1 -- 172.21.15.139:0/4155722007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6ec102bb0 msgr2=0x7ff6ec1993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:15:15.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.954+0000 7ff6eaffd700 1 --2- 172.21.15.139:0/4155722007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6ec102bb0 0x7ff6ec1993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:15.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.954+0000 7ff6eaffd700 1 -- 172.21.15.139:0/4155722007 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6ec1a0af0 con 0x7ff6ec1019b0 2024-04-20T12:15:15.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.954+0000 7ff6eaffd700 1 --2- 172.21.15.139:0/4155722007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ec1019b0 0x7ff6ec198e90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0098e0 tx=0x7ff6dc0047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:15:15.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.954+0000 7ff6f08aa700 1 -- 172.21.15.139:0/4155722007 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc026070 con 0x7ff6ec1019b0 2024-04-20T12:15:15.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.954+0000 7ff6f08aa700 1 -- 172.21.15.139:0/4155722007 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6dc004210 con 0x7ff6ec1019b0 2024-04-20T12:15:15.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.954+0000 7ff6f18ac700 1 -- 172.21.15.139:0/4155722007 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6ec1a0d80 con 0x7ff6ec1019b0 2024-04-20T12:15:15.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.954+0000 7ff6f08aa700 1 -- 172.21.15.139:0/4155722007 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc021410 con 0x7ff6ec1019b0 2024-04-20T12:15:15.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.954+0000 7ff6f18ac700 1 -- 172.21.15.139:0/4155722007 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6ec1a1200 con 0x7ff6ec1019b0 2024-04-20T12:15:15.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.955+0000 7ff6f18ac700 1 -- 172.21.15.139:0/4155722007 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6ec1a1430 con 0x7ff6ec1019b0 2024-04-20T12:15:15.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.956+0000 7ff6f08aa700 1 -- 172.21.15.139:0/4155722007 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 15) ==== 138591+0+0 (secure 0 0 0) 0x7ff6dc029070 con 0x7ff6ec1019b0 2024-04-20T12:15:15.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.957+0000 7ff6f08aa700 1 --2- 172.21.15.139:0/4155722007 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff6d40a3cb0 0x7ff6d40a6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:15:15.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.957+0000 7ff6f08aa700 1 -- 172.21.15.139:0/4155722007 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7ff6dc0cfa10 con 0x7ff6ec1019b0 2024-04-20T12:15:15.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.957+0000 7ff6ea7fc700 1 --2- 172.21.15.139:0/4155722007 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff6d40a3cb0 0x7ff6d40a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:15:15.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.957+0000 7ff6ea7fc700 1 --2- 172.21.15.139:0/4155722007 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff6d40a3cb0 0x7ff6d40a6170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009a10 tx=0x7ff6e0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:15:15.959 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:15.961+0000 7ff6f08aa700 1 -- 172.21.15.139:0/4155722007 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7ff6dc030020 con 0x7ff6ec1019b0 2024-04-20T12:15:16.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:15 smithi154 ceph-mon[22073]: Detected new or changed devices on smithi135 2024-04-20T12:15:16.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:15 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi135 to 17088M 2024-04-20T12:15:16.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:15 smithi154 ceph-mon[22073]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:16.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:15 smithi135 ceph-mon[18264]: Detected new or changed devices on smithi135 2024-04-20T12:15:16.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:15 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi135 to 17088M 2024-04-20T12:15:16.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:15 smithi135 ceph-mon[18264]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:16.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:16.168+0000 7ff6f18ac700 1 -- 172.21.15.139:0/4155722007 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ff6ec06b830 con 0x7ff6d40a3cb0 2024-04-20T12:15:16.919 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:16 smithi154 ceph-mon[22073]: osdmap e9: 1 total, 1 up, 1 in 2024-04-20T12:15:16.919 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:16 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:15:16.919 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:16 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:15:16.919 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:16 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:16.979 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:16 smithi139 ceph-mon[21834]: osdmap e9: 1 total, 1 up, 1 in 2024-04-20T12:15:16.979 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:16 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:15:16.979 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:16 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:15:16.979 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:16 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:17.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:16 smithi135 ceph-mon[18264]: osdmap e9: 1 total, 1 up, 1 in 2024-04-20T12:15:17.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:16 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:15:17.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:16 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:15:17.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:16 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:17.877 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:17 smithi139 ceph-mon[21834]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:15:17.878 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:17 smithi139 ceph-mon[21834]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:18.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:17 smithi154 ceph-mon[22073]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:15:18.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:17 smithi154 ceph-mon[22073]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:18.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:17 smithi135 ceph-mon[18264]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:15:18.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:17 smithi135 ceph-mon[18264]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:19.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:18 smithi139 ceph-mon[21834]: from='client.? 172.21.15.139:0/1221106508' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c049f1ea-0ec4-4aa5-9971-8d989b8c366a"}]: dispatch 2024-04-20T12:15:19.037 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:18 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c049f1ea-0ec4-4aa5-9971-8d989b8c366a"}]: dispatch 2024-04-20T12:15:19.038 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:18 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c049f1ea-0ec4-4aa5-9971-8d989b8c366a"}]': finished 2024-04-20T12:15:19.038 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:18 smithi139 ceph-mon[21834]: osdmap e10: 2 total, 1 up, 2 in 2024-04-20T12:15:19.038 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:18 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:15:19.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:18 smithi135 ceph-mon[18264]: from='client.? 172.21.15.139:0/1221106508' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c049f1ea-0ec4-4aa5-9971-8d989b8c366a"}]: dispatch 2024-04-20T12:15:19.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:18 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c049f1ea-0ec4-4aa5-9971-8d989b8c366a"}]: dispatch 2024-04-20T12:15:19.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:18 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c049f1ea-0ec4-4aa5-9971-8d989b8c366a"}]': finished 2024-04-20T12:15:19.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:18 smithi135 ceph-mon[18264]: osdmap e10: 2 total, 1 up, 2 in 2024-04-20T12:15:19.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:18 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:15:19.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:18 smithi154 ceph-mon[22073]: from='client.? 172.21.15.139:0/1221106508' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c049f1ea-0ec4-4aa5-9971-8d989b8c366a"}]: dispatch 2024-04-20T12:15:19.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:18 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c049f1ea-0ec4-4aa5-9971-8d989b8c366a"}]: dispatch 2024-04-20T12:15:19.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:18 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c049f1ea-0ec4-4aa5-9971-8d989b8c366a"}]': finished 2024-04-20T12:15:19.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:18 smithi154 ceph-mon[22073]: osdmap e10: 2 total, 1 up, 2 in 2024-04-20T12:15:19.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:18 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:15:20.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:19 smithi139 ceph-mon[21834]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:20.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:19 smithi139 ceph-mon[21834]: from='client.? 172.21.15.139:0/4245737751' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:15:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:19 smithi135 ceph-mon[18264]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:19 smithi135 ceph-mon[18264]: from='client.? 172.21.15.139:0/4245737751' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:15:20.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:19 smithi154 ceph-mon[22073]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:20.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:19 smithi154 ceph-mon[22073]: from='client.? 172.21.15.139:0/4245737751' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:15:22.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:21 smithi139 ceph-mon[21834]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:22.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:21 smithi135 ceph-mon[18264]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:22.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:21 smithi154 ceph-mon[22073]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:24.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:23 smithi139 ceph-mon[21834]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:24.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:23 smithi135 ceph-mon[18264]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:24.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:23 smithi154 ceph-mon[22073]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:25.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:25 smithi139 ceph-mon[21834]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:25.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:25 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-20T12:15:25.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:25 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:26.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:25 smithi135 ceph-mon[18264]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:26.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:25 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-20T12:15:26.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:25 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:26.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:25 smithi154 ceph-mon[22073]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:26.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:25 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-20T12:15:26.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:25 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:26.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:26 smithi139 ceph-mon[21834]: Deploying daemon osd.1 on smithi139 2024-04-20T12:15:27.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:26 smithi135 ceph-mon[18264]: Deploying daemon osd.1 on smithi139 2024-04-20T12:15:27.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:26 smithi154 ceph-mon[22073]: Deploying daemon osd.1 on smithi139 2024-04-20T12:15:27.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:27 smithi139 ceph-mon[21834]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:28.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:27 smithi154 ceph-mon[22073]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:28.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:27 smithi135 ceph-mon[18264]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:30.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:29 smithi139 ceph-mon[21834]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:30.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:29 smithi135 ceph-mon[18264]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:30.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:29 smithi154 ceph-mon[22073]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:32.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:31 smithi139 ceph-mon[21834]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:32.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:32.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:32.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:32.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:31 smithi135 ceph-mon[18264]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:32.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:32.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:32.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:31 smithi154 ceph-mon[22073]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:34.036 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:33 smithi139 ceph-mon[21834]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:34.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:33 smithi135 ceph-mon[18264]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:34.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:33 smithi154 ceph-mon[22073]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:34.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:34.379+0000 7ff6f08aa700 1 -- 172.21.15.139:0/4155722007 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff6ec06b830 con 0x7ff6d40a3cb0 2024-04-20T12:15:34.379 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 1 on host 'smithi139' 2024-04-20T12:15:34.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:34.381+0000 7ff6f18ac700 1 -- 172.21.15.139:0/4155722007 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff6d40a3cb0 msgr2=0x7ff6d40a6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:15:34.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:34.381+0000 7ff6f18ac700 1 --2- 172.21.15.139:0/4155722007 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff6d40a3cb0 0x7ff6d40a6170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0009a10 tx=0x7ff6e0009190 comp rx=0 tx=0).stop 2024-04-20T12:15:34.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:34.381+0000 7ff6f18ac700 1 -- 172.21.15.139:0/4155722007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ec1019b0 msgr2=0x7ff6ec198e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:15:34.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:34.381+0000 7ff6f18ac700 1 --2- 172.21.15.139:0/4155722007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ec1019b0 0x7ff6ec198e90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0098e0 tx=0x7ff6dc0047b0 comp rx=0 tx=0).stop 2024-04-20T12:15:34.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:34.381+0000 7ff6f18ac700 1 -- 172.21.15.139:0/4155722007 shutdown_connections 2024-04-20T12:15:34.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:34.381+0000 7ff6f18ac700 1 --2- 172.21.15.139:0/4155722007 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff6d40a3cb0 0x7ff6d40a6170 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:34.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:34.381+0000 7ff6f18ac700 1 --2- 172.21.15.139:0/4155722007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff6ec103550 0x7ff6ec1a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:34.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:34.381+0000 7ff6f18ac700 1 --2- 172.21.15.139:0/4155722007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff6ec1019b0 0x7ff6ec198e90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:34.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:34.381+0000 7ff6f18ac700 1 --2- 172.21.15.139:0/4155722007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6ec102bb0 0x7ff6ec1993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:34.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:34.381+0000 7ff6f18ac700 1 -- 172.21.15.139:0/4155722007 >> 172.21.15.139:0/4155722007 conn(0x7ff6ec0fcf70 msgr2=0x7ff6ec06b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:15:34.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:34.382+0000 7ff6f18ac700 1 -- 172.21.15.139:0/4155722007 shutdown_connections 2024-04-20T12:15:34.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:15:34.382+0000 7ff6f18ac700 1 -- 172.21.15.139:0/4155722007 wait complete. 2024-04-20T12:15:34.993 DEBUG:teuthology.orchestra.run.smithi139:osd.1> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.1.service 2024-04-20T12:15:34.995 INFO:tasks.cephadm:Deploying osd.2 on smithi154 with /dev/vg_nvme/lv_4... 2024-04-20T12:15:34.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-20T12:15:35.241 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:15:35.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:35.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:35.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:35.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:35.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:35 smithi139 ceph-mon[21834]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:35.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:35 smithi139 ceph-mon[21834]: from='osd.1 [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-20T12:15:35.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:35 smithi139 ceph-mon[21834]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-20T12:15:35.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:35.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:35.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:35.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:35.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:35 smithi135 ceph-mon[18264]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:35.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:35 smithi135 ceph-mon[18264]: from='osd.1 [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-20T12:15:35.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:35 smithi135 ceph-mon[18264]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-20T12:15:35.662 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:35.663 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:35.663 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:35.663 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:35.663 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:35 smithi154 ceph-mon[22073]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:35.663 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:35 smithi154 ceph-mon[22073]: from='osd.1 [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-20T12:15:35.663 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:35 smithi154 ceph-mon[22073]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-20T12:15:36.499 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:36 smithi154 ceph-mon[22073]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-20T12:15:36.499 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:36 smithi154 ceph-mon[22073]: osdmap e11: 2 total, 1 up, 2 in 2024-04-20T12:15:36.499 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:15:36.499 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:36 smithi154 ceph-mon[22073]: from='osd.1 [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:15:36.499 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:36 smithi154 ceph-mon[22073]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:15:36.508 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:36 smithi139 ceph-mon[21834]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-20T12:15:36.508 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:36 smithi139 ceph-mon[21834]: osdmap e11: 2 total, 1 up, 2 in 2024-04-20T12:15:36.509 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:15:36.509 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:36 smithi139 ceph-mon[21834]: from='osd.1 [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:15:36.509 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:36 smithi139 ceph-mon[21834]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:15:36.509 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:15:36 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-1[26426]: 2024-04-20T12:15:36.460+0000 7f44fed90700 -1 osd.1 0 waiting for initial osdmap 2024-04-20T12:15:36.509 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:15:36 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-1[26426]: 2024-04-20T12:15:36.464+0000 7f44fab83700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T12:15:36.821 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:36 smithi135 ceph-mon[18264]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-20T12:15:36.821 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:36 smithi135 ceph-mon[18264]: osdmap e11: 2 total, 1 up, 2 in 2024-04-20T12:15:36.821 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:15:36.821 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:36 smithi135 ceph-mon[18264]: from='osd.1 [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:15:36.821 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:36 smithi135 ceph-mon[18264]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:15:37.068 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-20T12:15:37.068 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-20T12:15:37.068 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2024-04-20T12:15:37.068 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2024-04-20T12:15:37.069 INFO:teuthology.orchestra.run.smithi154.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113099 s, 927 MB/s 2024-04-20T12:15:37.069 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 2024-04-20T12:15:37.069 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2024-04-20T12:15:37.681 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:37 smithi154 ceph-mon[22073]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-20T12:15:37.681 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:37 smithi154 ceph-mon[22073]: osdmap e12: 2 total, 1 up, 2 in 2024-04-20T12:15:37.681 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:15:37.681 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:37 smithi154 ceph-mon[22073]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:37.682 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:15:37.708 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_4 2024-04-20T12:15:37.820 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:37 smithi139 ceph-mon[21834]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-20T12:15:37.821 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:37 smithi139 ceph-mon[21834]: osdmap e12: 2 total, 1 up, 2 in 2024-04-20T12:15:37.821 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:15:37.821 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:37 smithi139 ceph-mon[21834]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:37.821 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:15:37.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:37 smithi135 ceph-mon[18264]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-20T12:15:37.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:37 smithi135 ceph-mon[18264]: osdmap e12: 2 total, 1 up, 2 in 2024-04-20T12:15:37.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:15:37.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:37 smithi135 ceph-mon[18264]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-04-20T12:15:37.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:15:37.950 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:15:38.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: purged_snaps scrub starts 2024-04-20T12:15:38.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: purged_snaps scrub ok 2024-04-20T12:15:38.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: osd.1 [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416] boot 2024-04-20T12:15:38.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: osdmap e13: 2 total, 2 up, 2 in 2024-04-20T12:15:38.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:15:38.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: Detected new or changed devices on smithi139 2024-04-20T12:15:38.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:38.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:38.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:15:38.654 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:38.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:38.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:15:38.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:38.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:38.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:38.655 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:15:38.656 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:38.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: purged_snaps scrub starts 2024-04-20T12:15:38.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: purged_snaps scrub ok 2024-04-20T12:15:38.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: osd.1 [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416] boot 2024-04-20T12:15:38.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: osdmap e13: 2 total, 2 up, 2 in 2024-04-20T12:15:38.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:15:38.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: Detected new or changed devices on smithi139 2024-04-20T12:15:38.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:38.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:38.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:15:38.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:38.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:38.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:15:38.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:38.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:38.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:38.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:15:38.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: purged_snaps scrub starts 2024-04-20T12:15:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: purged_snaps scrub ok 2024-04-20T12:15:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: osd.1 [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416] boot 2024-04-20T12:15:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: osdmap e13: 2 total, 2 up, 2 in 2024-04-20T12:15:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:15:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: Detected new or changed devices on smithi139 2024-04-20T12:15:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:15:38.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:38.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:38.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:15:38.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:38.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:38.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:38.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:15:38.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:39.353 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.351+0000 7f1f2de37700 1 -- 172.21.15.154:0/3555363471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f28103cb0 msgr2=0x7f1f28104110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:15:39.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.351+0000 7f1f2de37700 1 --2- 172.21.15.154:0/3555363471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f28103cb0 0x7f1f28104110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009990 tx=0x7f1f1c009ca0 comp rx=0 tx=0).stop 2024-04-20T12:15:39.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.352+0000 7f1f2de37700 1 -- 172.21.15.154:0/3555363471 shutdown_connections 2024-04-20T12:15:39.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.352+0000 7f1f2de37700 1 --2- 172.21.15.154:0/3555363471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f28104650 0x7f1f2810af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:39.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.352+0000 7f1f2de37700 1 --2- 172.21.15.154:0/3555363471 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f28102ab0 0x7f1f28102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:39.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.352+0000 7f1f2de37700 1 --2- 172.21.15.154:0/3555363471 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f28103cb0 0x7f1f28104110 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:39.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.352+0000 7f1f2de37700 1 -- 172.21.15.154:0/3555363471 >> 172.21.15.154:0/3555363471 conn(0x7f1f280fe050 msgr2=0x7f1f28100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:15:39.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.352+0000 7f1f2de37700 1 -- 172.21.15.154:0/3555363471 shutdown_connections 2024-04-20T12:15:39.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.352+0000 7f1f2de37700 1 -- 172.21.15.154:0/3555363471 wait complete. 2024-04-20T12:15:39.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.352+0000 7f1f2de37700 1 Processor -- start 2024-04-20T12:15:39.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.352+0000 7f1f2de37700 1 -- start start 2024-04-20T12:15:39.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.352+0000 7f1f2de37700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f28102ab0 0x7f1f280767f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:15:39.354 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.352+0000 7f1f2de37700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f28103cb0 0x7f1f28074e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:15:39.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f2de37700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f28104650 0x7f1f28075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:15:39.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f2de37700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2810e690 con 0x7f1f28103cb0 2024-04-20T12:15:39.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f2de37700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2810e510 con 0x7f1f28104650 2024-04-20T12:15:39.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f2de37700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2810e810 con 0x7f1f28102ab0 2024-04-20T12:15:39.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f277fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f28102ab0 0x7f1f280767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:15:39.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f277fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f28102ab0 0x7f1f280767f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:38354/0 (socket says 172.21.15.154:38354) 2024-04-20T12:15:39.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f277fe700 1 -- 172.21.15.154:0/959779513 learned_addr learned my addr 172.21.15.154:0/959779513 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-20T12:15:39.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f26ffd700 1 --2- 172.21.15.154:0/959779513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f28103cb0 0x7f1f28074e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:15:39.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f27fff700 1 --2- 172.21.15.154:0/959779513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f28104650 0x7f1f28075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:15:39.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f277fe700 1 -- 172.21.15.154:0/959779513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f28104650 msgr2=0x7f1f28075380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:15:39.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f277fe700 1 --2- 172.21.15.154:0/959779513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f28104650 0x7f1f28075380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:39.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f277fe700 1 -- 172.21.15.154:0/959779513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f28103cb0 msgr2=0x7f1f28074e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:15:39.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f277fe700 1 --2- 172.21.15.154:0/959779513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f28103cb0 0x7f1f28074e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:39.355 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f277fe700 1 -- 172.21.15.154:0/959779513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f28075c30 con 0x7f1f28102ab0 2024-04-20T12:15:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f27fff700 1 --2- 172.21.15.154:0/959779513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f28104650 0x7f1f28075380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:15:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f277fe700 1 --2- 172.21.15.154:0/959779513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f28102ab0 0x7f1f280767f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800d980 tx=0x7f1f1800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:15:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f24ff9700 1 -- 172.21.15.154:0/959779513 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18017070 con 0x7f1f28102ab0 2024-04-20T12:15:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f24ff9700 1 -- 172.21.15.154:0/959779513 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f18009e10 con 0x7f1f28102ab0 2024-04-20T12:15:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f2de37700 1 -- 172.21.15.154:0/959779513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f281a2db0 con 0x7f1f28102ab0 2024-04-20T12:15:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f24ff9700 1 -- 172.21.15.154:0/959779513 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1800f620 con 0x7f1f28102ab0 2024-04-20T12:15:39.356 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.353+0000 7f1f2de37700 1 -- 172.21.15.154:0/959779513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f281a3200 con 0x7f1f28102ab0 2024-04-20T12:15:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.354+0000 7f1f2de37700 1 -- 172.21.15.154:0/959779513 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f28069740 con 0x7f1f28102ab0 2024-04-20T12:15:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.355+0000 7f1f24ff9700 1 -- 172.21.15.154:0/959779513 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 15) ==== 138591+0+0 (secure 0 0 0) 0x7f1f18009930 con 0x7f1f28102ab0 2024-04-20T12:15:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.356+0000 7f1f24ff9700 1 --2- 172.21.15.154:0/959779513 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1f100a3c30 0x7f1f100a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:15:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.356+0000 7f1f24ff9700 1 -- 172.21.15.154:0/959779513 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f1f180ce660 con 0x7f1f28102ab0 2024-04-20T12:15:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.356+0000 7f1f26ffd700 1 --2- 172.21.15.154:0/959779513 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1f100a3c30 0x7f1f100a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:15:39.357 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.356+0000 7f1f26ffd700 1 --2- 172.21.15.154:0/959779513 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1f100a3c30 0x7f1f100a60f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00b5c0 tx=0x7f1f1c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:15:39.360 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.361+0000 7f1f24ff9700 1 -- 172.21.15.154:0/959779513 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f1f1809c890 con 0x7f1f28102ab0 2024-04-20T12:15:39.570 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:39.570+0000 7f1f2de37700 1 -- 172.21.15.154:0/959779513 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1f28062e90 con 0x7f1f100a3c30 2024-04-20T12:15:39.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:39 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi139 to 17088M 2024-04-20T12:15:39.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:39 smithi154 ceph-mon[22073]: osdmap e14: 2 total, 2 up, 2 in 2024-04-20T12:15:39.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:39 smithi154 ceph-mon[22073]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:39.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:39 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi139 to 17088M 2024-04-20T12:15:39.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:39 smithi139 ceph-mon[21834]: osdmap e14: 2 total, 2 up, 2 in 2024-04-20T12:15:39.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:39 smithi139 ceph-mon[21834]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:39.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:39 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi139 to 17088M 2024-04-20T12:15:39.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:39 smithi135 ceph-mon[18264]: osdmap e14: 2 total, 2 up, 2 in 2024-04-20T12:15:39.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:39 smithi135 ceph-mon[18264]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:40.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:40 smithi154 ceph-mon[22073]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:15:40.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:40 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:15:40.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:40 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:15:40.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:40 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:40.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:40 smithi139 ceph-mon[21834]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:15:40.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:40 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:15:40.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:40 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:15:40.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:40 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:40.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:40 smithi135 ceph-mon[18264]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:15:40.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:40 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:15:40.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:40 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:15:40.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:40 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:41.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:41 smithi154 ceph-mon[22073]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:41.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:41 smithi139 ceph-mon[21834]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:41.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:41 smithi135 ceph-mon[18264]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:42.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:42 smithi154 ceph-mon[22073]: from='client.? 172.21.15.154:0/491306795' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "248b1c85-1ec2-42c9-8f11-f1a57cb258a9"}]: dispatch 2024-04-20T12:15:42.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:42 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "248b1c85-1ec2-42c9-8f11-f1a57cb258a9"}]: dispatch 2024-04-20T12:15:42.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:42 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "248b1c85-1ec2-42c9-8f11-f1a57cb258a9"}]': finished 2024-04-20T12:15:42.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:42 smithi154 ceph-mon[22073]: osdmap e15: 3 total, 2 up, 3 in 2024-04-20T12:15:42.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:42 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:15:42.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:42 smithi139 ceph-mon[21834]: from='client.? 172.21.15.154:0/491306795' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "248b1c85-1ec2-42c9-8f11-f1a57cb258a9"}]: dispatch 2024-04-20T12:15:42.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:42 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "248b1c85-1ec2-42c9-8f11-f1a57cb258a9"}]: dispatch 2024-04-20T12:15:42.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:42 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "248b1c85-1ec2-42c9-8f11-f1a57cb258a9"}]': finished 2024-04-20T12:15:42.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:42 smithi139 ceph-mon[21834]: osdmap e15: 3 total, 2 up, 3 in 2024-04-20T12:15:42.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:42 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:15:42.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:42 smithi135 ceph-mon[18264]: from='client.? 172.21.15.154:0/491306795' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "248b1c85-1ec2-42c9-8f11-f1a57cb258a9"}]: dispatch 2024-04-20T12:15:42.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:42 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "248b1c85-1ec2-42c9-8f11-f1a57cb258a9"}]: dispatch 2024-04-20T12:15:42.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:42 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "248b1c85-1ec2-42c9-8f11-f1a57cb258a9"}]': finished 2024-04-20T12:15:42.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:42 smithi135 ceph-mon[18264]: osdmap e15: 3 total, 2 up, 3 in 2024-04-20T12:15:42.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:42 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:15:43.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:43 smithi139 ceph-mon[21834]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:43.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:43 smithi139 ceph-mon[21834]: from='client.? 172.21.15.154:0/4191890461' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:15:43.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:43 smithi135 ceph-mon[18264]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:43.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:43 smithi135 ceph-mon[18264]: from='client.? 172.21.15.154:0/4191890461' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:15:44.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:43 smithi154 ceph-mon[22073]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:44.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:43 smithi154 ceph-mon[22073]: from='client.? 172.21.15.154:0/4191890461' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:15:46.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:45 smithi139 ceph-mon[21834]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:46.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:45 smithi135 ceph-mon[18264]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:46.178 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:45 smithi154 ceph-mon[22073]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:47.993 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:47 smithi154 ceph-mon[22073]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:48.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:47 smithi139 ceph-mon[21834]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:48.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:47 smithi135 ceph-mon[18264]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:50.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:49 smithi139 ceph-mon[21834]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:50.074 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-20T12:15:50.074 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:50.102 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:49 smithi154 ceph-mon[22073]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:50.102 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-20T12:15:50.102 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:50.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:49 smithi135 ceph-mon[18264]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:50.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-20T12:15:50.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:50.847 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:50 smithi154 ceph-mon[22073]: Deploying daemon osd.2 on smithi154 2024-04-20T12:15:51.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:50 smithi139 ceph-mon[21834]: Deploying daemon osd.2 on smithi154 2024-04-20T12:15:51.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:50 smithi135 ceph-mon[18264]: Deploying daemon osd.2 on smithi154 2024-04-20T12:15:52.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:51 smithi139 ceph-mon[21834]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:52.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:51 smithi135 ceph-mon[18264]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:52.145 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:51 smithi154 ceph-mon[22073]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:53.903 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:53 smithi154 ceph-mon[22073]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:54.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:53 smithi139 ceph-mon[21834]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:54.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:53 smithi135 ceph-mon[18264]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:56.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:55 smithi139 ceph-mon[21834]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:56.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:55 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:56.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:55 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:56.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:55 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:56.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:55 smithi135 ceph-mon[18264]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:56.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:55 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:56.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:55 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:56.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:55 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:56.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:55 smithi154 ceph-mon[22073]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:56.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:55 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:56.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:55 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:56.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:55 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:58.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:57 smithi139 ceph-mon[21834]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:58.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:57 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:58.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:57 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:58.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:57 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:58.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:57 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:15:58.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:57 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:58.105 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:57 smithi154 ceph-mon[22073]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:58.105 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:57 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:58.105 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:57 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:58.105 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:57 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:58.105 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:57 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:15:58.105 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:57 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:58.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:57 smithi135 ceph-mon[18264]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:58.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:57 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:58.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:57 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:58.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:57 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:15:58.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:57 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:15:58.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:57 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:58.436 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 2 on host 'smithi154' 2024-04-20T12:15:58.436 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:58.436+0000 7f1f24ff9700 1 -- 172.21.15.154:0/959779513 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1f28062e90 con 0x7f1f100a3c30 2024-04-20T12:15:58.438 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:58.439+0000 7f1f2de37700 1 -- 172.21.15.154:0/959779513 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1f100a3c30 msgr2=0x7f1f100a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:15:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:58.439+0000 7f1f2de37700 1 --2- 172.21.15.154:0/959779513 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1f100a3c30 0x7f1f100a60f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00b5c0 tx=0x7f1f1c005fd0 comp rx=0 tx=0).stop 2024-04-20T12:15:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:58.439+0000 7f1f2de37700 1 -- 172.21.15.154:0/959779513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f28102ab0 msgr2=0x7f1f280767f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:15:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:58.439+0000 7f1f2de37700 1 --2- 172.21.15.154:0/959779513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f28102ab0 0x7f1f280767f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800d980 tx=0x7f1f1800dc90 comp rx=0 tx=0).stop 2024-04-20T12:15:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:58.439+0000 7f1f2de37700 1 -- 172.21.15.154:0/959779513 shutdown_connections 2024-04-20T12:15:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:58.439+0000 7f1f2de37700 1 --2- 172.21.15.154:0/959779513 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1f100a3c30 0x7f1f100a60f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:58.439+0000 7f1f2de37700 1 --2- 172.21.15.154:0/959779513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f28104650 0x7f1f28075380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:58.439+0000 7f1f2de37700 1 --2- 172.21.15.154:0/959779513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f28102ab0 0x7f1f280767f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:58.439+0000 7f1f2de37700 1 --2- 172.21.15.154:0/959779513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f28103cb0 0x7f1f28074e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:15:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:58.439+0000 7f1f2de37700 1 -- 172.21.15.154:0/959779513 >> 172.21.15.154:0/959779513 conn(0x7f1f280fe050 msgr2=0x7f1f28106fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:15:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:58.439+0000 7f1f2de37700 1 -- 172.21.15.154:0/959779513 shutdown_connections 2024-04-20T12:15:58.439 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:15:58.439+0000 7f1f2de37700 1 -- 172.21.15.154:0/959779513 wait complete. 2024-04-20T12:15:59.080 DEBUG:teuthology.orchestra.run.smithi154:osd.2> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.2.service 2024-04-20T12:15:59.082 INFO:tasks.cephadm:Deploying osd.3 on smithi135 with /dev/vg_nvme/lv_3... 2024-04-20T12:15:59.082 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-20T12:15:59.328 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:15:59.681 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:59 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:59.681 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:59 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:59.681 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:59 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:59.682 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:59 smithi135 ceph-mon[18264]: from='osd.2 [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-20T12:15:59.682 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:59 smithi135 ceph-mon[18264]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-20T12:15:59.682 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:15:59 smithi135 ceph-mon[18264]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:59.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:59 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:59.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:59 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:59.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:59 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:59.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:59 smithi154 ceph-mon[22073]: from='osd.2 [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-20T12:15:59.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:59 smithi154 ceph-mon[22073]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-20T12:15:59.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:15:59 smithi154 ceph-mon[22073]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:15:59.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:59 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:59.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:59 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:15:59.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:59 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:15:59.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:59 smithi139 ceph-mon[21834]: from='osd.2 [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-20T12:15:59.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:59 smithi139 ceph-mon[21834]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-20T12:15:59.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:15:59 smithi139 ceph-mon[21834]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:16:00.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:00 smithi154 ceph-mon[22073]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-20T12:16:00.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:00 smithi154 ceph-mon[22073]: osdmap e16: 3 total, 2 up, 3 in 2024-04-20T12:16:00.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:00 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:16:00.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:00 smithi154 ceph-mon[22073]: from='osd.2 [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:16:00.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:00 smithi154 ceph-mon[22073]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:16:00.738 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:00 smithi135 ceph-mon[18264]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-20T12:16:00.738 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:00 smithi135 ceph-mon[18264]: osdmap e16: 3 total, 2 up, 3 in 2024-04-20T12:16:00.738 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:00 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:16:00.738 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:00 smithi135 ceph-mon[18264]: from='osd.2 [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:16:00.738 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:00 smithi135 ceph-mon[18264]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:16:00.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:00 smithi139 ceph-mon[21834]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-20T12:16:00.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:00 smithi139 ceph-mon[21834]: osdmap e16: 3 total, 2 up, 3 in 2024-04-20T12:16:00.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:00 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:16:00.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:00 smithi139 ceph-mon[21834]: from='osd.2 [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:16:00.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:00 smithi139 ceph-mon[21834]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:16:01.252 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:16:00 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-2[27191]: 2024-04-20T12:16:00.889+0000 7f89b65da700 -1 osd.2 0 waiting for initial osdmap 2024-04-20T12:16:01.252 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:16:00 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-2[27191]: 2024-04-20T12:16:00.895+0000 7f89adbc4700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T12:16:01.295 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-20T12:16:01.295 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-20T12:16:01.296 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-04-20T12:16:01.296 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-04-20T12:16:01.296 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119445 s, 878 MB/s 2024-04-20T12:16:01.296 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-04-20T12:16:01.692 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:01 smithi135 ceph-mon[18264]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-04-20T12:16:01.692 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:01 smithi135 ceph-mon[18264]: osdmap e17: 3 total, 2 up, 3 in 2024-04-20T12:16:01.692 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:16:01.692 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:16:01.692 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:01 smithi135 ceph-mon[18264]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:16:01.693 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:01 smithi135 ceph-mon[18264]: from='osd.2 ' entity='osd.2' 2024-04-20T12:16:01.747 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:01 smithi154 ceph-mon[22073]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-04-20T12:16:01.747 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:01 smithi154 ceph-mon[22073]: osdmap e17: 3 total, 2 up, 3 in 2024-04-20T12:16:01.748 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:16:01.748 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:16:01.748 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:01 smithi154 ceph-mon[22073]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:16:01.748 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:01 smithi154 ceph-mon[22073]: from='osd.2 ' entity='osd.2' 2024-04-20T12:16:01.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:01 smithi139 ceph-mon[21834]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-04-20T12:16:01.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:01 smithi139 ceph-mon[21834]: osdmap e17: 3 total, 2 up, 3 in 2024-04-20T12:16:01.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:16:01.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:16:01.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:01 smithi139 ceph-mon[21834]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-04-20T12:16:01.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:01 smithi139 ceph-mon[21834]: from='osd.2 ' entity='osd.2' 2024-04-20T12:16:01.996 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_3 2024-04-20T12:16:02.250 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:16:02.696 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:02 smithi135 ceph-mon[18264]: purged_snaps scrub starts 2024-04-20T12:16:02.696 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:02 smithi135 ceph-mon[18264]: purged_snaps scrub ok 2024-04-20T12:16:02.696 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:02 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:16:02.696 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:02 smithi135 ceph-mon[18264]: osd.2 [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084] boot 2024-04-20T12:16:02.696 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:02 smithi135 ceph-mon[18264]: osdmap e18: 3 total, 3 up, 3 in 2024-04-20T12:16:02.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:02 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:16:02.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:02 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:02.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:02 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:02.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:02 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:16:02.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:02 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:02.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:02 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:02.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:02 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:16:02.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:02 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:02.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:02 smithi154 ceph-mon[22073]: purged_snaps scrub starts 2024-04-20T12:16:02.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:02 smithi154 ceph-mon[22073]: purged_snaps scrub ok 2024-04-20T12:16:02.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:02 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:16:02.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:02 smithi154 ceph-mon[22073]: osd.2 [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084] boot 2024-04-20T12:16:02.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:02 smithi154 ceph-mon[22073]: osdmap e18: 3 total, 3 up, 3 in 2024-04-20T12:16:02.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:02 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:16:02.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:02 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:02.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:02 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:02.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:02 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:16:02.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:02 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:02.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:02 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:02.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:02 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:16:02.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:02 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:02.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:02 smithi139 ceph-mon[21834]: purged_snaps scrub starts 2024-04-20T12:16:02.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:02 smithi139 ceph-mon[21834]: purged_snaps scrub ok 2024-04-20T12:16:02.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:02 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:16:02.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:02 smithi139 ceph-mon[21834]: osd.2 [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084] boot 2024-04-20T12:16:02.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:02 smithi139 ceph-mon[21834]: osdmap e18: 3 total, 3 up, 3 in 2024-04-20T12:16:02.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:02 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:16:02.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:02 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:02.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:02 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:02.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:02 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:16:02.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:02 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:02.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:02 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:02.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:02 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:16:02.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:02 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:03.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:03 smithi135 ceph-mon[18264]: Detected new or changed devices on smithi154 2024-04-20T12:16:03.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:03 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi154 to 17088M 2024-04-20T12:16:03.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:03 smithi135 ceph-mon[18264]: pgmap v81: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:03.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-20T12:16:03.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:03 smithi154 ceph-mon[22073]: Detected new or changed devices on smithi154 2024-04-20T12:16:03.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:03 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi154 to 17088M 2024-04-20T12:16:03.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:03 smithi154 ceph-mon[22073]: pgmap v81: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:03.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:03 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-20T12:16:03.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:03 smithi139 ceph-mon[21834]: Detected new or changed devices on smithi154 2024-04-20T12:16:03.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:03 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi154 to 17088M 2024-04-20T12:16:03.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:03 smithi139 ceph-mon[21834]: pgmap v81: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:03.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:03 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-04-20T12:16:03.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.871+0000 7f9449658700 1 -- 172.21.15.135:0/1434869028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444104680 msgr2=0x7f944410af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:16:03.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.871+0000 7f9449658700 1 --2- 172.21.15.135:0/1434869028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444104680 0x7f944410af30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f943c00b0d0 tx=0x7f943c00b3e0 comp rx=0 tx=0).stop 2024-04-20T12:16:03.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.871+0000 7f9449658700 1 -- 172.21.15.135:0/1434869028 shutdown_connections 2024-04-20T12:16:03.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.871+0000 7f9449658700 1 --2- 172.21.15.135:0/1434869028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444104680 0x7f944410af30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:03.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.871+0000 7f9449658700 1 --2- 172.21.15.135:0/1434869028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9444102ae0 0x7f9444102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:03.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.871+0000 7f9449658700 1 --2- 172.21.15.135:0/1434869028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9444103ce0 0x7f9444104140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:03.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.871+0000 7f9449658700 1 -- 172.21.15.135:0/1434869028 >> 172.21.15.135:0/1434869028 conn(0x7f94440fe0a0 msgr2=0x7f94441004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:16:03.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.872+0000 7f9449658700 1 -- 172.21.15.135:0/1434869028 shutdown_connections 2024-04-20T12:16:03.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.872+0000 7f9449658700 1 -- 172.21.15.135:0/1434869028 wait complete. 2024-04-20T12:16:03.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.872+0000 7f9449658700 1 Processor -- start 2024-04-20T12:16:03.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.872+0000 7f9449658700 1 -- start start 2024-04-20T12:16:03.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.872+0000 7f9449658700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9444102ae0 0x7f9444198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:16:03.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f9449658700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9444103ce0 0x7f94441991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:16:03.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f9449658700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444104680 0x7f94441a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:16:03.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f9449658700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f944410e720 con 0x7f9444104680 2024-04-20T12:16:03.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f9449658700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f944410e5a0 con 0x7f9444103ce0 2024-04-20T12:16:03.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f9449658700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f944410e8a0 con 0x7f9444102ae0 2024-04-20T12:16:03.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f94437fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444104680 0x7f94441a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:16:03.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f94437fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444104680 0x7f94441a0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:54030/0 (socket says 172.21.15.135:54030) 2024-04-20T12:16:03.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f94437fe700 1 -- 172.21.15.135:0/1499810123 learned_addr learned my addr 172.21.15.135:0/1499810123 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:16:03.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f9442ffd700 1 --2- 172.21.15.135:0/1499810123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9444102ae0 0x7f9444198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:16:03.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f94427fc700 1 --2- 172.21.15.135:0/1499810123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9444103ce0 0x7f94441991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:16:03.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f94437fe700 1 -- 172.21.15.135:0/1499810123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9444102ae0 msgr2=0x7f9444198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:16:03.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f94437fe700 1 --2- 172.21.15.135:0/1499810123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9444102ae0 0x7f9444198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:03.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f94437fe700 1 -- 172.21.15.135:0/1499810123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9444103ce0 msgr2=0x7f94441991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:16:03.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f94437fe700 1 --2- 172.21.15.135:0/1499810123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9444103ce0 0x7f94441991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:03.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f94437fe700 1 -- 172.21.15.135:0/1499810123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94441a08f0 con 0x7f9444104680 2024-04-20T12:16:03.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f94427fc700 1 --2- 172.21.15.135:0/1499810123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9444103ce0 0x7f94441991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:16:03.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f94437fe700 1 --2- 172.21.15.135:0/1499810123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444104680 0x7f94441a0220 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f943c00d010 tx=0x7f943c007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:16:03.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f942bfff700 1 -- 172.21.15.135:0/1499810123 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c003e10 con 0x7f9444104680 2024-04-20T12:16:03.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f942bfff700 1 -- 172.21.15.135:0/1499810123 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f943c005550 con 0x7f9444104680 2024-04-20T12:16:03.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f9449658700 1 -- 172.21.15.135:0/1499810123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94441a0b80 con 0x7f9444104680 2024-04-20T12:16:03.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f942bfff700 1 -- 172.21.15.135:0/1499810123 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943c01bb90 con 0x7f9444104680 2024-04-20T12:16:03.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.873+0000 7f9449658700 1 -- 172.21.15.135:0/1499810123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94441a0fd0 con 0x7f9444104680 2024-04-20T12:16:03.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.874+0000 7f9449658700 1 -- 172.21.15.135:0/1499810123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9444069740 con 0x7f9444104680 2024-04-20T12:16:03.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.875+0000 7f942bfff700 1 -- 172.21.15.135:0/1499810123 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 15) ==== 138591+0+0 (secure 0 0 0) 0x7f943c005700 con 0x7f9444104680 2024-04-20T12:16:03.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.876+0000 7f942bfff700 1 --2- 172.21.15.135:0/1499810123 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f942c0a3bb0 0x7f942c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:16:03.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.876+0000 7f9442ffd700 1 --2- 172.21.15.135:0/1499810123 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f942c0a3bb0 0x7f942c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:16:03.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.876+0000 7f942bfff700 1 -- 172.21.15.135:0/1499810123 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3226+0+0 (secure 0 0 0) 0x7f943c00f020 con 0x7f9444104680 2024-04-20T12:16:03.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.876+0000 7f9442ffd700 1 --2- 172.21.15.135:0/1499810123 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f942c0a3bb0 0x7f942c0a6070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9444199b50 tx=0x7f9434009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:16:03.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:03.880+0000 7f942bfff700 1 -- 172.21.15.135:0/1499810123 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f943c09e4b0 con 0x7f9444104680 2024-04-20T12:16:04.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:04.089+0000 7f9449658700 1 -- 172.21.15.135:0/1499810123 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9444062e90 con 0x7f942c0a3bb0 2024-04-20T12:16:04.710 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31251]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-20T12:16:04.710 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31251]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T12:16:04.711 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31251]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T12:16:04.711 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31251]: pam_unix(sudo:session): session closed for user root 2024-04-20T12:16:04.711 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:04 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-20T12:16:04.711 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:04 smithi154 ceph-mon[22073]: osdmap e19: 3 total, 3 up, 3 in 2024-04-20T12:16:04.711 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:04 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-20T12:16:04.711 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:04 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:16:04.711 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:04 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:16:04.711 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:04 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:04.718 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:04 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-20T12:16:04.718 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:04 smithi135 ceph-mon[18264]: osdmap e19: 3 total, 3 up, 3 in 2024-04-20T12:16:04.718 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:04 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-20T12:16:04.718 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:04 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:16:04.719 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:04 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:16:04.719 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:04 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:04.719 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35001]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-20T12:16:04.719 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35001]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T12:16:04.719 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35001]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T12:16:04.719 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35001]: pam_unix(sudo:session): session closed for user root 2024-04-20T12:16:04.719 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35021]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-20T12:16:04.719 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35021]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T12:16:04.719 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35021]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T12:16:04.719 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35021]: pam_unix(sudo:session): session closed for user root 2024-04-20T12:16:04.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:04 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-04-20T12:16:04.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:04 smithi139 ceph-mon[21834]: osdmap e19: 3 total, 3 up, 3 in 2024-04-20T12:16:04.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:04 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-20T12:16:04.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:04 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:16:04.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:04 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:16:04.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:04 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:04.831 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30278]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-20T12:16:04.831 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30278]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T12:16:04.831 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30278]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T12:16:04.831 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30278]: pam_unix(sudo:session): session closed for user root 2024-04-20T12:16:04.831 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30281]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-20T12:16:04.831 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30281]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T12:16:04.831 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30281]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T12:16:04.831 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30281]: pam_unix(sudo:session): session closed for user root 2024-04-20T12:16:04.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35038]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-20T12:16:04.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35038]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T12:16:04.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35038]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T12:16:04.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35038]: pam_unix(sudo:session): session closed for user root 2024-04-20T12:16:04.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35041]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-20T12:16:04.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35041]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T12:16:04.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35041]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T12:16:04.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:04 smithi135 sudo[35041]: pam_unix(sudo:session): session closed for user root 2024-04-20T12:16:05.001 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31254]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-20T12:16:05.002 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31254]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T12:16:05.002 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31254]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T12:16:05.002 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31254]: pam_unix(sudo:session): session closed for user root 2024-04-20T12:16:05.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31257]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-20T12:16:05.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31257]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T12:16:05.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31257]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T12:16:05.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31257]: pam_unix(sudo:session): session closed for user root 2024-04-20T12:16:05.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31260]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-20T12:16:05.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31260]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T12:16:05.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31260]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T12:16:05.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:04 smithi154 sudo[31260]: pam_unix(sudo:session): session closed for user root 2024-04-20T12:16:05.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30284]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-20T12:16:05.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30284]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T12:16:05.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30284]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T12:16:05.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30284]: pam_unix(sudo:session): session closed for user root 2024-04-20T12:16:05.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30287]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-20T12:16:05.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30287]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-20T12:16:05.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30287]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-20T12:16:05.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:04 smithi139 sudo[30287]: pam_unix(sudo:session): session closed for user root 2024-04-20T12:16:05.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:16:05.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-20T12:16:05.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: osdmap e20: 3 total, 3 up, 3 in 2024-04-20T12:16:05.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:05.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:05.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:05.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:05.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-20T12:16:05.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-20T12:16:05.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:16:05.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:16:05.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:16:05.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-20T12:16:05.737 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:16:05.737 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:16:05.737 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:16:05.737 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-20T12:16:05.737 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-20T12:16:05.737 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:16:05.737 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:16:05.737 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:16:05.737 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:05 smithi135 ceph-mon[18264]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-20T12:16:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:16:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-20T12:16:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: osdmap e20: 3 total, 3 up, 3 in 2024-04-20T12:16:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-20T12:16:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-20T12:16:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:16:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:16:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:16:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-20T12:16:05.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:16:05.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:16:05.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:16:05.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-20T12:16:05.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-20T12:16:05.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:16:05.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:16:05.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:16:05.753 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:05 smithi154 ceph-mon[22073]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-20T12:16:05.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:05.757+0000 7f942bfff700 1 -- 172.21.15.135:0/1499810123 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f943c09a420 con 0x7f9444104680 2024-04-20T12:16:05.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:16:05.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-20T12:16:05.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: osdmap e20: 3 total, 3 up, 3 in 2024-04-20T12:16:05.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:05.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:05.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:05.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:05.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-20T12:16:05.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-20T12:16:05.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:16:05.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:16:05.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:16:05.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-20T12:16:05.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:16:05.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:16:05.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:16:05.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-20T12:16:05.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-20T12:16:05.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:16:05.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:16:05.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:16:05.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:05 smithi139 ceph-mon[21834]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-20T12:16:06.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:06 smithi154 ceph-mon[22073]: osdmap e21: 3 total, 3 up, 3 in 2024-04-20T12:16:06.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:06 smithi154 ceph-mon[22073]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-20T12:16:06.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:06 smithi139 ceph-mon[21834]: osdmap e21: 3 total, 3 up, 3 in 2024-04-20T12:16:06.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:06 smithi139 ceph-mon[21834]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-20T12:16:06.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:06 smithi135 ceph-mon[18264]: osdmap e21: 3 total, 3 up, 3 in 2024-04-20T12:16:06.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:06 smithi135 ceph-mon[18264]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-04-20T12:16:07.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:07 smithi135 ceph-mon[18264]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:07.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:07 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/956218654' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70d9c325-bfce-44ca-b2b6-fbe6126a820c"}]: dispatch 2024-04-20T12:16:07.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:07 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/956218654' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70d9c325-bfce-44ca-b2b6-fbe6126a820c"}]': finished 2024-04-20T12:16:07.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:07 smithi135 ceph-mon[18264]: osdmap e22: 4 total, 3 up, 4 in 2024-04-20T12:16:07.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:07.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:07 smithi154 ceph-mon[22073]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:07.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:07 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/956218654' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70d9c325-bfce-44ca-b2b6-fbe6126a820c"}]: dispatch 2024-04-20T12:16:07.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:07 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/956218654' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70d9c325-bfce-44ca-b2b6-fbe6126a820c"}]': finished 2024-04-20T12:16:07.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:07 smithi154 ceph-mon[22073]: osdmap e22: 4 total, 3 up, 4 in 2024-04-20T12:16:07.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:07 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:07.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:07 smithi139 ceph-mon[21834]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:07.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:07 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/956218654' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70d9c325-bfce-44ca-b2b6-fbe6126a820c"}]: dispatch 2024-04-20T12:16:07.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:07 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/956218654' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70d9c325-bfce-44ca-b2b6-fbe6126a820c"}]': finished 2024-04-20T12:16:07.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:07 smithi139 ceph-mon[21834]: osdmap e22: 4 total, 3 up, 4 in 2024-04-20T12:16:07.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:07 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:08.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:08 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/4143187213' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:16:08.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:08 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/4143187213' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:16:08.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:08 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/4143187213' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:16:09.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:09 smithi154 ceph-mon[22073]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:09.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:09 smithi139 ceph-mon[21834]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:09.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:09 smithi135 ceph-mon[18264]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:12.021 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:11 smithi135 ceph-mon[18264]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:12.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:11 smithi139 ceph-mon[21834]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:12.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:11 smithi154 ceph-mon[22073]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:14.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:13 smithi139 ceph-mon[21834]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:14.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:13 smithi135 ceph-mon[18264]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:14.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:13 smithi154 ceph-mon[22073]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:15.001 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:14 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-20T12:16:15.001 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:14 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:15.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:14 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-20T12:16:15.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:14 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:14 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-20T12:16:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:14 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:15.930 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:15 smithi135 ceph-mon[18264]: Deploying daemon osd.3 on smithi135 2024-04-20T12:16:15.930 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:15 smithi135 ceph-mon[18264]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:16.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:15 smithi139 ceph-mon[21834]: Deploying daemon osd.3 on smithi135 2024-04-20T12:16:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:15 smithi139 ceph-mon[21834]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:16.152 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:15 smithi154 ceph-mon[22073]: Deploying daemon osd.3 on smithi135 2024-04-20T12:16:16.152 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:15 smithi154 ceph-mon[22073]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:17 smithi139 ceph-mon[21834]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:18.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:17 smithi135 ceph-mon[18264]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:18.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:17 smithi154 ceph-mon[22073]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:20.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:19 smithi139 ceph-mon[21834]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:20.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:20.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:20.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:16:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:19 smithi135 ceph-mon[18264]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:16:20.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:19 smithi154 ceph-mon[22073]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:20.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:20.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:20.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:16:22.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:21 smithi139 ceph-mon[21834]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:22.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:21 smithi135 ceph-mon[18264]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:22.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:21 smithi154 ceph-mon[22073]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:23.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:23.493+0000 7f942bfff700 1 -- 172.21.15.135:0/1499810123 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9444062e90 con 0x7f942c0a3bb0 2024-04-20T12:16:23.493 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 3 on host 'smithi135' 2024-04-20T12:16:23.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:23.496+0000 7f9449658700 1 -- 172.21.15.135:0/1499810123 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f942c0a3bb0 msgr2=0x7f942c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:16:23.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:23.496+0000 7f9449658700 1 --2- 172.21.15.135:0/1499810123 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f942c0a3bb0 0x7f942c0a6070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9444199b50 tx=0x7f9434009260 comp rx=0 tx=0).stop 2024-04-20T12:16:23.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:23.496+0000 7f9449658700 1 -- 172.21.15.135:0/1499810123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444104680 msgr2=0x7f94441a0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:16:23.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:23.496+0000 7f9449658700 1 --2- 172.21.15.135:0/1499810123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444104680 0x7f94441a0220 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f943c00d010 tx=0x7f943c007a20 comp rx=0 tx=0).stop 2024-04-20T12:16:23.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:23.496+0000 7f9449658700 1 -- 172.21.15.135:0/1499810123 shutdown_connections 2024-04-20T12:16:23.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:23.496+0000 7f9449658700 1 --2- 172.21.15.135:0/1499810123 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f942c0a3bb0 0x7f942c0a6070 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:23.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:23.496+0000 7f9449658700 1 --2- 172.21.15.135:0/1499810123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9444104680 0x7f94441a0220 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:23.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:23.496+0000 7f9449658700 1 --2- 172.21.15.135:0/1499810123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9444102ae0 0x7f9444198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:23.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:23.496+0000 7f9449658700 1 --2- 172.21.15.135:0/1499810123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9444103ce0 0x7f94441991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:23.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:23.496+0000 7f9449658700 1 -- 172.21.15.135:0/1499810123 >> 172.21.15.135:0/1499810123 conn(0x7f94440fe0a0 msgr2=0x7f9444106f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:16:23.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:23.496+0000 7f9449658700 1 -- 172.21.15.135:0/1499810123 shutdown_connections 2024-04-20T12:16:23.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:16:23.496+0000 7f9449658700 1 -- 172.21.15.135:0/1499810123 wait complete. 2024-04-20T12:16:23.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:23 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:23.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:23 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:23.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:23 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:23.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:23 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:16:23.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:23 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:23.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:23 smithi135 ceph-mon[18264]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:23.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:23 smithi135 ceph-mon[18264]: from='osd.3 [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-20T12:16:23.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:23 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:23.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:23 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:23.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:23 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:16:23.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:23 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:23.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:23 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:23.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:23 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:23.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:23 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:16:23.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:23 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:23.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:23 smithi154 ceph-mon[22073]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:23.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:23 smithi154 ceph-mon[22073]: from='osd.3 [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-20T12:16:23.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:23 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:23.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:23 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:23.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:23 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:16:23.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:23 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:23.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:23 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:23.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:23 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:23.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:23 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:16:23.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:23 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:23.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:23 smithi139 ceph-mon[21834]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:23.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:23 smithi139 ceph-mon[21834]: from='osd.3 [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-20T12:16:23.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:23 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:23.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:23 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:23.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:23 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:16:24.205 DEBUG:teuthology.orchestra.run.smithi135:osd.3> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.3.service 2024-04-20T12:16:24.208 INFO:tasks.cephadm:Deploying osd.4 on smithi139 with /dev/vg_nvme/lv_3... 2024-04-20T12:16:24.208 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-20T12:16:24.450 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.b/config 2024-04-20T12:16:24.746 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:24 smithi135 ceph-mon[18264]: from='osd.3 [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-20T12:16:24.746 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:24 smithi135 ceph-mon[18264]: osdmap e23: 4 total, 3 up, 4 in 2024-04-20T12:16:24.746 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:24 smithi135 ceph-mon[18264]: from='osd.3 [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-20T12:16:24.746 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:24 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:24.746 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:16:24 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-3[37160]: 2024-04-20T12:16:24.514+0000 7f1cb4390700 -1 osd.3 0 waiting for initial osdmap 2024-04-20T12:16:24.747 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:16:24 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-3[37160]: 2024-04-20T12:16:24.519+0000 7f1cb0183700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T12:16:24.802 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:24 smithi139 ceph-mon[21834]: from='osd.3 [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-20T12:16:24.802 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:24 smithi139 ceph-mon[21834]: osdmap e23: 4 total, 3 up, 4 in 2024-04-20T12:16:24.802 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:24 smithi139 ceph-mon[21834]: from='osd.3 [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-20T12:16:24.802 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:24 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:25.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:24 smithi154 ceph-mon[22073]: from='osd.3 [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-20T12:16:25.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:24 smithi154 ceph-mon[22073]: osdmap e23: 4 total, 3 up, 4 in 2024-04-20T12:16:25.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:24 smithi154 ceph-mon[22073]: from='osd.3 [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-20T12:16:25.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:24 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:25.768 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:25 smithi135 ceph-mon[18264]: from='osd.3 [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-20T12:16:25.768 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:25 smithi135 ceph-mon[18264]: osdmap e24: 4 total, 3 up, 4 in 2024-04-20T12:16:25.768 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:25 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:25.768 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:25 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:25.768 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:25 smithi135 ceph-mon[18264]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:25.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:25 smithi139 ceph-mon[21834]: from='osd.3 [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-20T12:16:25.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:25 smithi139 ceph-mon[21834]: osdmap e24: 4 total, 3 up, 4 in 2024-04-20T12:16:25.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:25 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:25.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:25 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:25.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:25 smithi139 ceph-mon[21834]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:26.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:25 smithi154 ceph-mon[22073]: from='osd.3 [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-20T12:16:26.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:25 smithi154 ceph-mon[22073]: osdmap e24: 4 total, 3 up, 4 in 2024-04-20T12:16:26.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:25 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:26.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:25 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:26.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:25 smithi154 ceph-mon[22073]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-04-20T12:16:26.366 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-20T12:16:26.367 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-20T12:16:26.367 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2024-04-20T12:16:26.367 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2024-04-20T12:16:26.367 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0127525 s, 822 MB/s 2024-04-20T12:16:26.367 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2024-04-20T12:16:26.593 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:26 smithi139 ceph-mon[21834]: purged_snaps scrub starts 2024-04-20T12:16:26.594 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:26 smithi139 ceph-mon[21834]: purged_snaps scrub ok 2024-04-20T12:16:26.594 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:26 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:26.594 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:26 smithi139 ceph-mon[21834]: osd.3 [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444] boot 2024-04-20T12:16:26.594 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:26 smithi139 ceph-mon[21834]: osdmap e25: 4 total, 4 up, 4 in 2024-04-20T12:16:26.594 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:26 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:26.852 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:26 smithi154 ceph-mon[22073]: purged_snaps scrub starts 2024-04-20T12:16:26.852 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:26 smithi154 ceph-mon[22073]: purged_snaps scrub ok 2024-04-20T12:16:26.852 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:26.852 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:26 smithi154 ceph-mon[22073]: osd.3 [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444] boot 2024-04-20T12:16:26.852 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:26 smithi154 ceph-mon[22073]: osdmap e25: 4 total, 4 up, 4 in 2024-04-20T12:16:26.852 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:26.858 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:26 smithi135 ceph-mon[18264]: purged_snaps scrub starts 2024-04-20T12:16:26.858 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:26 smithi135 ceph-mon[18264]: purged_snaps scrub ok 2024-04-20T12:16:26.859 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:26.859 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:26 smithi135 ceph-mon[18264]: osd.3 [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444] boot 2024-04-20T12:16:26.859 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:26 smithi135 ceph-mon[18264]: osdmap e25: 4 total, 4 up, 4 in 2024-04-20T12:16:26.859 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:16:27.048 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_3 2024-04-20T12:16:27.292 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.b/config 2024-04-20T12:16:27.675 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:27 smithi139 ceph-mon[21834]: osdmap e26: 4 total, 4 up, 4 in 2024-04-20T12:16:27.675 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:27 smithi139 ceph-mon[21834]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:27.675 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:27.675 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:27.675 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:16:27.675 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:16:27.675 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:27.675 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:27.675 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:16:27.676 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:27.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:27 smithi154 ceph-mon[22073]: osdmap e26: 4 total, 4 up, 4 in 2024-04-20T12:16:27.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:27 smithi154 ceph-mon[22073]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:27.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:27.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:27.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:16:27.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:16:27.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:27.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:27.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:16:27.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:27.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:27 smithi135 ceph-mon[18264]: osdmap e26: 4 total, 4 up, 4 in 2024-04-20T12:16:27.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:27 smithi135 ceph-mon[18264]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:27.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:27.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:27.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:16:27.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:16:27.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:27.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:27.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:16:27.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:28.673 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:28 smithi139 ceph-mon[21834]: Detected new or changed devices on smithi135 2024-04-20T12:16:28.673 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:28 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi135 to 8544M 2024-04-20T12:16:28.673 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:28 smithi139 ceph-mon[21834]: osdmap e27: 4 total, 4 up, 4 in 2024-04-20T12:16:28.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.849+0000 7f78a79a9700 1 -- 172.21.15.139:0/2271577506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a0101cb0 msgr2=0x7f78a0102110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:16:28.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.849+0000 7f78a79a9700 1 --2- 172.21.15.139:0/2271577506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a0101cb0 0x7f78a0102110 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7890009990 tx=0x7f7890009ca0 comp rx=0 tx=0).stop 2024-04-20T12:16:28.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.849+0000 7f78a79a9700 1 -- 172.21.15.139:0/2271577506 shutdown_connections 2024-04-20T12:16:28.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.849+0000 7f78a79a9700 1 --2- 172.21.15.139:0/2271577506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78a0102650 0x7f78a0109f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:28.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.849+0000 7f78a79a9700 1 --2- 172.21.15.139:0/2271577506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a0102f70 0x7f78a0103390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:28.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.849+0000 7f78a79a9700 1 --2- 172.21.15.139:0/2271577506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a0101cb0 0x7f78a0102110 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:28.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.849+0000 7f78a79a9700 1 -- 172.21.15.139:0/2271577506 >> 172.21.15.139:0/2271577506 conn(0x7f78a00fc700 msgr2=0x7f78a00feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:16:28.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.849+0000 7f78a79a9700 1 -- 172.21.15.139:0/2271577506 shutdown_connections 2024-04-20T12:16:28.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.849+0000 7f78a79a9700 1 -- 172.21.15.139:0/2271577506 wait complete. 2024-04-20T12:16:28.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.849+0000 7f78a79a9700 1 Processor -- start 2024-04-20T12:16:28.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.849+0000 7f78a79a9700 1 -- start start 2024-04-20T12:16:28.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a79a9700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a0101cb0 0x7f78a0198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:16:28.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a79a9700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78a0102650 0x7f78a0199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:16:28.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a79a9700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a0102f70 0x7f78a01a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:16:28.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a79a9700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f78a010e720 con 0x7f78a0102650 2024-04-20T12:16:28.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a79a9700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f78a010e5a0 con 0x7f78a0101cb0 2024-04-20T12:16:28.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a79a9700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78a010e8a0 con 0x7f78a0102f70 2024-04-20T12:16:28.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a5745700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a0101cb0 0x7f78a0198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:16:28.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a5745700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a0101cb0 0x7f78a0198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:57198/0 (socket says 172.21.15.139:57198) 2024-04-20T12:16:28.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a5745700 1 -- 172.21.15.139:0/3819274099 learned_addr learned my addr 172.21.15.139:0/3819274099 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-20T12:16:28.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a4f44700 1 --2- 172.21.15.139:0/3819274099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78a0102650 0x7f78a0199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:16:28.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a5f46700 1 --2- 172.21.15.139:0/3819274099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a0102f70 0x7f78a01a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:16:28.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a5745700 1 -- 172.21.15.139:0/3819274099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a0102f70 msgr2=0x7f78a01a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:16:28.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a5745700 1 --2- 172.21.15.139:0/3819274099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a0102f70 0x7f78a01a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:28.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a5745700 1 -- 172.21.15.139:0/3819274099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78a0102650 msgr2=0x7f78a0199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:16:28.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a5745700 1 --2- 172.21.15.139:0/3819274099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78a0102650 0x7f78a0199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:28.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a5745700 1 -- 172.21.15.139:0/3819274099 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a01a0940 con 0x7f78a0101cb0 2024-04-20T12:16:28.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a5745700 1 --2- 172.21.15.139:0/3819274099 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a0101cb0 0x7f78a0198cf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f789c00d980 tx=0x7f789c00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:16:28.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78967fc700 1 -- 172.21.15.139:0/3819274099 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c017070 con 0x7f78a0101cb0 2024-04-20T12:16:28.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78967fc700 1 -- 172.21.15.139:0/3819274099 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f789c00fd70 con 0x7f78a0101cb0 2024-04-20T12:16:28.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78967fc700 1 -- 172.21.15.139:0/3819274099 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c00e3b0 con 0x7f78a0101cb0 2024-04-20T12:16:28.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a79a9700 1 -- 172.21.15.139:0/3819274099 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a01a0c30 con 0x7f78a0101cb0 2024-04-20T12:16:28.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.850+0000 7f78a79a9700 1 -- 172.21.15.139:0/3819274099 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a01a1120 con 0x7f78a0101cb0 2024-04-20T12:16:28.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.851+0000 7f78a79a9700 1 -- 172.21.15.139:0/3819274099 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78a0069740 con 0x7f78a0101cb0 2024-04-20T12:16:28.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.853+0000 7f78967fc700 1 -- 172.21.15.139:0/3819274099 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f789c00f890 con 0x7f78a0101cb0 2024-04-20T12:16:28.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.854+0000 7f78967fc700 1 --2- 172.21.15.139:0/3819274099 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f788c0a3c40 0x7f788c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:16:28.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.854+0000 7f78967fc700 1 -- 172.21.15.139:0/3819274099 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3669+0+0 (secure 0 0 0) 0x7f789c0cebd0 con 0x7f78a0101cb0 2024-04-20T12:16:28.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.854+0000 7f78a4f44700 1 --2- 172.21.15.139:0/3819274099 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f788c0a3c40 0x7f788c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:16:28.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.854+0000 7f78a4f44700 1 --2- 172.21.15.139:0/3819274099 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f788c0a3c40 0x7f788c0a6100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f789000b5c0 tx=0x7f7890005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:16:28.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:28.858+0000 7f78967fc700 1 -- 172.21.15.139:0/3819274099 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f789c010460 con 0x7f78a0101cb0 2024-04-20T12:16:28.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:28 smithi135 ceph-mon[18264]: Detected new or changed devices on smithi135 2024-04-20T12:16:28.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:28 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi135 to 8544M 2024-04-20T12:16:28.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:28 smithi135 ceph-mon[18264]: osdmap e27: 4 total, 4 up, 4 in 2024-04-20T12:16:29.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:28 smithi154 ceph-mon[22073]: Detected new or changed devices on smithi135 2024-04-20T12:16:29.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:28 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi135 to 8544M 2024-04-20T12:16:29.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:28 smithi154 ceph-mon[22073]: osdmap e27: 4 total, 4 up, 4 in 2024-04-20T12:16:29.064 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:29.064+0000 7f78a79a9700 1 -- 172.21.15.139:0/3819274099 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f78a0062e90 con 0x7f788c0a3c40 2024-04-20T12:16:29.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:29 smithi139 ceph-mon[21834]: osdmap e28: 4 total, 4 up, 4 in 2024-04-20T12:16:29.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:29 smithi139 ceph-mon[21834]: pgmap v104: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-20T12:16:29.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:29 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:16:29.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:29 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:16:29.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:29 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:29.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:29 smithi135 ceph-mon[18264]: osdmap e28: 4 total, 4 up, 4 in 2024-04-20T12:16:29.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:29 smithi135 ceph-mon[18264]: pgmap v104: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-20T12:16:29.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:29 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:16:29.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:29 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:16:29.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:29 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:30.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:29 smithi154 ceph-mon[22073]: osdmap e28: 4 total, 4 up, 4 in 2024-04-20T12:16:30.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:29 smithi154 ceph-mon[22073]: pgmap v104: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-20T12:16:30.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:29 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:16:30.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:29 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:16:30.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:29 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:30.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:30 smithi139 ceph-mon[21834]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:16:30.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:30 smithi139 ceph-mon[21834]: osdmap e29: 4 total, 4 up, 4 in 2024-04-20T12:16:30.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:30 smithi135 ceph-mon[18264]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:16:30.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:30 smithi135 ceph-mon[18264]: osdmap e29: 4 total, 4 up, 4 in 2024-04-20T12:16:31.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:30 smithi154 ceph-mon[22073]: from='client.24209 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:16:31.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:30 smithi154 ceph-mon[22073]: osdmap e29: 4 total, 4 up, 4 in 2024-04-20T12:16:31.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:31 smithi139 ceph-mon[21834]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-04-20T12:16:31.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:31 smithi135 ceph-mon[18264]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-04-20T12:16:32.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:31 smithi154 ceph-mon[22073]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-04-20T12:16:32.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:32 smithi139 ceph-mon[21834]: from='client.? 172.21.15.139:0/984542347' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73f90e0c-3a6a-4c13-8543-a3d50f08d2d5"}]: dispatch 2024-04-20T12:16:32.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:32 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73f90e0c-3a6a-4c13-8543-a3d50f08d2d5"}]: dispatch 2024-04-20T12:16:32.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:32 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73f90e0c-3a6a-4c13-8543-a3d50f08d2d5"}]': finished 2024-04-20T12:16:32.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:32 smithi139 ceph-mon[21834]: osdmap e30: 5 total, 4 up, 5 in 2024-04-20T12:16:32.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:32 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:32.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:32 smithi139 ceph-mon[21834]: from='client.? 172.21.15.139:0/396784483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:16:32.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:32 smithi135 ceph-mon[18264]: from='client.? 172.21.15.139:0/984542347' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73f90e0c-3a6a-4c13-8543-a3d50f08d2d5"}]: dispatch 2024-04-20T12:16:32.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:32 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73f90e0c-3a6a-4c13-8543-a3d50f08d2d5"}]: dispatch 2024-04-20T12:16:32.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:32 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73f90e0c-3a6a-4c13-8543-a3d50f08d2d5"}]': finished 2024-04-20T12:16:32.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:32 smithi135 ceph-mon[18264]: osdmap e30: 5 total, 4 up, 5 in 2024-04-20T12:16:32.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:32 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:32.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:32 smithi135 ceph-mon[18264]: from='client.? 172.21.15.139:0/396784483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:16:33.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:32 smithi154 ceph-mon[22073]: from='client.? 172.21.15.139:0/984542347' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73f90e0c-3a6a-4c13-8543-a3d50f08d2d5"}]: dispatch 2024-04-20T12:16:33.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:32 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "73f90e0c-3a6a-4c13-8543-a3d50f08d2d5"}]: dispatch 2024-04-20T12:16:33.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:32 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "73f90e0c-3a6a-4c13-8543-a3d50f08d2d5"}]': finished 2024-04-20T12:16:33.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:32 smithi154 ceph-mon[22073]: osdmap e30: 5 total, 4 up, 5 in 2024-04-20T12:16:33.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:32 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:33.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:32 smithi154 ceph-mon[22073]: from='client.? 172.21.15.139:0/396784483' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:16:33.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:33 smithi139 ceph-mon[21834]: pgmap v108: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-04-20T12:16:33.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:33 smithi135 ceph-mon[18264]: pgmap v108: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-04-20T12:16:34.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:33 smithi154 ceph-mon[22073]: pgmap v108: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-04-20T12:16:36.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:35 smithi139 ceph-mon[21834]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:36.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:35 smithi135 ceph-mon[18264]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:36.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:35 smithi154 ceph-mon[22073]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:37.893 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:37 smithi139 ceph-mon[21834]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:38.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:37 smithi135 ceph-mon[18264]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:38.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:37 smithi154 ceph-mon[22073]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:40.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:39 smithi139 ceph-mon[21834]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:40.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-20T12:16:40.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:40.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:39 smithi135 ceph-mon[18264]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:40.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-20T12:16:40.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:40.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:39 smithi154 ceph-mon[22073]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:40.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-20T12:16:40.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:41.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:40 smithi139 ceph-mon[21834]: Deploying daemon osd.4 on smithi139 2024-04-20T12:16:41.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:40 smithi135 ceph-mon[18264]: Deploying daemon osd.4 on smithi139 2024-04-20T12:16:41.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:40 smithi154 ceph-mon[22073]: Deploying daemon osd.4 on smithi139 2024-04-20T12:16:42.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:41 smithi139 ceph-mon[21834]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:42.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:41 smithi135 ceph-mon[18264]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:42.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:41 smithi154 ceph-mon[22073]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:44.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:43 smithi139 ceph-mon[21834]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:44.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:43 smithi135 ceph-mon[18264]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:44.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:43 smithi154 ceph-mon[22073]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:16:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:16:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:45.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:16:45.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:45.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:46.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:45 smithi139 ceph-mon[21834]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:46.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:45 smithi135 ceph-mon[18264]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:46.152 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:45 smithi154 ceph-mon[22073]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:48.065 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:47 smithi139 ceph-mon[21834]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:48.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:47 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:48.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:47 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:48.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:47 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:48.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:47 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:16:48.066 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:47 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:48.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:47 smithi135 ceph-mon[18264]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:48.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:47 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:48.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:47 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:48.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:47 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:48.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:47 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:16:48.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:47 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:48.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:47 smithi154 ceph-mon[22073]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:48.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:47 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:48.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:47 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:48.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:47 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:48.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:47 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:16:48.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:47 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:48.430 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 4 on host 'smithi139' 2024-04-20T12:16:48.430 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:48.430+0000 7f78967fc700 1 -- 172.21.15.139:0/3819274099 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f78a0062e90 con 0x7f788c0a3c40 2024-04-20T12:16:48.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:48.433+0000 7f78a79a9700 1 -- 172.21.15.139:0/3819274099 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f788c0a3c40 msgr2=0x7f788c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:16:48.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:48.433+0000 7f78a79a9700 1 --2- 172.21.15.139:0/3819274099 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f788c0a3c40 0x7f788c0a6100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f789000b5c0 tx=0x7f7890005fd0 comp rx=0 tx=0).stop 2024-04-20T12:16:48.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:48.433+0000 7f78a79a9700 1 -- 172.21.15.139:0/3819274099 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a0101cb0 msgr2=0x7f78a0198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:16:48.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:48.433+0000 7f78a79a9700 1 --2- 172.21.15.139:0/3819274099 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a0101cb0 0x7f78a0198cf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f789c00d980 tx=0x7f789c00dc90 comp rx=0 tx=0).stop 2024-04-20T12:16:48.432 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:48.433+0000 7f78a79a9700 1 -- 172.21.15.139:0/3819274099 shutdown_connections 2024-04-20T12:16:48.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:48.433+0000 7f78a79a9700 1 --2- 172.21.15.139:0/3819274099 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f788c0a3c40 0x7f788c0a6100 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:48.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:48.433+0000 7f78a79a9700 1 --2- 172.21.15.139:0/3819274099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78a0102f70 0x7f78a01a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:48.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:48.433+0000 7f78a79a9700 1 --2- 172.21.15.139:0/3819274099 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78a0101cb0 0x7f78a0198cf0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:48.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:48.433+0000 7f78a79a9700 1 --2- 172.21.15.139:0/3819274099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78a0102650 0x7f78a0199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:48.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:48.433+0000 7f78a79a9700 1 -- 172.21.15.139:0/3819274099 >> 172.21.15.139:0/3819274099 conn(0x7f78a00fc700 msgr2=0x7f78a0105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:16:48.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:48.433+0000 7f78a79a9700 1 -- 172.21.15.139:0/3819274099 shutdown_connections 2024-04-20T12:16:48.433 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:16:48.433+0000 7f78a79a9700 1 -- 172.21.15.139:0/3819274099 wait complete. 2024-04-20T12:16:49.062 DEBUG:teuthology.orchestra.run.smithi139:osd.4> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.4.service 2024-04-20T12:16:49.064 INFO:tasks.cephadm:Deploying osd.5 on smithi154 with /dev/vg_nvme/lv_3... 2024-04-20T12:16:49.064 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-20T12:16:49.308 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:16:49.706 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:49.706 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:49.706 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:16:49.706 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:49 smithi154 ceph-mon[22073]: from='osd.4 [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-20T12:16:49.706 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:49 smithi154 ceph-mon[22073]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-20T12:16:49.706 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:49 smithi154 ceph-mon[22073]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:16:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:49 smithi139 ceph-mon[21834]: from='osd.4 [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-20T12:16:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:49 smithi139 ceph-mon[21834]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-20T12:16:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:49 smithi139 ceph-mon[21834]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:49.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:49.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:49.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:16:49.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:49 smithi135 ceph-mon[18264]: from='osd.4 [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-20T12:16:49.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:49 smithi135 ceph-mon[18264]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-20T12:16:49.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:49 smithi135 ceph-mon[18264]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:50.743 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:50 smithi154 ceph-mon[22073]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-20T12:16:50.744 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:50 smithi154 ceph-mon[22073]: osdmap e31: 5 total, 4 up, 5 in 2024-04-20T12:16:50.744 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:50 smithi154 ceph-mon[22073]: from='osd.4 [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:16:50.744 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:50 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:50.744 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:50 smithi154 ceph-mon[22073]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:16:50.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:50 smithi139 ceph-mon[21834]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-20T12:16:50.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:50 smithi139 ceph-mon[21834]: osdmap e31: 5 total, 4 up, 5 in 2024-04-20T12:16:50.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:50 smithi139 ceph-mon[21834]: from='osd.4 [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:16:50.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:50 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:50.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:50 smithi139 ceph-mon[21834]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:16:50.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:50 smithi135 ceph-mon[18264]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-20T12:16:50.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:50 smithi135 ceph-mon[18264]: osdmap e31: 5 total, 4 up, 5 in 2024-04-20T12:16:50.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:50 smithi135 ceph-mon[18264]: from='osd.4 [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:16:50.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:50 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:50.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:50 smithi135 ceph-mon[18264]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:16:51.253 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:16:50 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4[33080]: 2024-04-20T12:16:50.851+0000 7fc861f31700 -1 osd.4 0 waiting for initial osdmap 2024-04-20T12:16:51.253 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:16:50 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4[33080]: 2024-04-20T12:16:50.857+0000 7fc859d1c700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T12:16:51.453 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-20T12:16:51.453 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-20T12:16:51.453 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2024-04-20T12:16:51.453 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2024-04-20T12:16:51.453 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0144246 s, 727 MB/s 2024-04-20T12:16:51.453 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2024-04-20T12:16:51.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:51 smithi139 ceph-mon[21834]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-20T12:16:51.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:51 smithi139 ceph-mon[21834]: osdmap e32: 5 total, 4 up, 5 in 2024-04-20T12:16:51.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:51.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:51.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:51 smithi139 ceph-mon[21834]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:51.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:51 smithi139 ceph-mon[21834]: from='osd.4 ' entity='osd.4' 2024-04-20T12:16:51.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:51 smithi154 ceph-mon[22073]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-20T12:16:51.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:51 smithi154 ceph-mon[22073]: osdmap e32: 5 total, 4 up, 5 in 2024-04-20T12:16:51.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:51.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:51.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:51 smithi154 ceph-mon[22073]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:51.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:51 smithi154 ceph-mon[22073]: from='osd.4 ' entity='osd.4' 2024-04-20T12:16:51.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:51 smithi135 ceph-mon[18264]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-20T12:16:51.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:51 smithi135 ceph-mon[18264]: osdmap e32: 5 total, 4 up, 5 in 2024-04-20T12:16:51.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:51.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:51.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:51 smithi135 ceph-mon[18264]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-04-20T12:16:51.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:51 smithi135 ceph-mon[18264]: from='osd.4 ' entity='osd.4' 2024-04-20T12:16:52.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_3 2024-04-20T12:16:52.325 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:16:52.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:52 smithi139 ceph-mon[21834]: purged_snaps scrub starts 2024-04-20T12:16:52.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:52 smithi139 ceph-mon[21834]: purged_snaps scrub ok 2024-04-20T12:16:52.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:52 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:52.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:52 smithi139 ceph-mon[21834]: osd.4 [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913] boot 2024-04-20T12:16:52.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:52 smithi139 ceph-mon[21834]: osdmap e33: 5 total, 5 up, 5 in 2024-04-20T12:16:52.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:52 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:52.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:52 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:52.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:52 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:52.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:52 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:16:52.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:52 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:16:52.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:52 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:52.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:52 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:52.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:52 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:16:52.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:52 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:52.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:52 smithi154 ceph-mon[22073]: purged_snaps scrub starts 2024-04-20T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:52 smithi154 ceph-mon[22073]: purged_snaps scrub ok 2024-04-20T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:52 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:52 smithi154 ceph-mon[22073]: osd.4 [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913] boot 2024-04-20T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:52 smithi154 ceph-mon[22073]: osdmap e33: 5 total, 5 up, 5 in 2024-04-20T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:52 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:52 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:52 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:52 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:52 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:52 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:52 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:52 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:16:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:52 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:52 smithi135 ceph-mon[18264]: purged_snaps scrub starts 2024-04-20T12:16:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:52 smithi135 ceph-mon[18264]: purged_snaps scrub ok 2024-04-20T12:16:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:52 smithi135 ceph-mon[18264]: osd.4 [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913] boot 2024-04-20T12:16:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:52 smithi135 ceph-mon[18264]: osdmap e33: 5 total, 5 up, 5 in 2024-04-20T12:16:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:16:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:16:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:16:52.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:52.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:52.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:16:52.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:16:53.688 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:53 smithi154 ceph-mon[22073]: Detected new or changed devices on smithi139 2024-04-20T12:16:53.688 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:53 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi139 to 8544M 2024-04-20T12:16:53.688 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:53 smithi154 ceph-mon[22073]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:16:53.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:53 smithi139 ceph-mon[21834]: Detected new or changed devices on smithi139 2024-04-20T12:16:53.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:53 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi139 to 8544M 2024-04-20T12:16:53.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:53 smithi139 ceph-mon[21834]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:16:53.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:53 smithi135 ceph-mon[18264]: Detected new or changed devices on smithi139 2024-04-20T12:16:53.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:53 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi139 to 8544M 2024-04-20T12:16:53.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:53 smithi135 ceph-mon[18264]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:16:53.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.922+0000 7fb7e6701700 1 -- 172.21.15.154:0/4008829380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e0104650 msgr2=0x7fb7e010af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:16:53.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.922+0000 7fb7e6701700 1 --2- 172.21.15.154:0/4008829380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e0104650 0x7fb7e010af00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800b0a0 tx=0x7fb7d800b3b0 comp rx=0 tx=0).stop 2024-04-20T12:16:53.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.922+0000 7fb7e6701700 1 -- 172.21.15.154:0/4008829380 shutdown_connections 2024-04-20T12:16:53.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.922+0000 7fb7e6701700 1 --2- 172.21.15.154:0/4008829380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e0104650 0x7fb7e010af00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:53.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.922+0000 7fb7e6701700 1 --2- 172.21.15.154:0/4008829380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7e0102ab0 0x7fb7e0102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:53.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.922+0000 7fb7e6701700 1 --2- 172.21.15.154:0/4008829380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7e0103cb0 0x7fb7e0104110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:53.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.922+0000 7fb7e6701700 1 -- 172.21.15.154:0/4008829380 >> 172.21.15.154:0/4008829380 conn(0x7fb7e00fe050 msgr2=0x7fb7e0100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:16:53.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.922+0000 7fb7e6701700 1 -- 172.21.15.154:0/4008829380 shutdown_connections 2024-04-20T12:16:53.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.922+0000 7fb7e6701700 1 -- 172.21.15.154:0/4008829380 wait complete. 2024-04-20T12:16:53.922 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.922+0000 7fb7e6701700 1 Processor -- start 2024-04-20T12:16:53.923 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.922+0000 7fb7e6701700 1 -- start start 2024-04-20T12:16:53.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7e6701700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e0102ab0 0x7fb7e019ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:16:53.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7e6701700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7e0103cb0 0x7fb7e019b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:16:53.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7e6701700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7e0104650 0x7fb7e01a2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:16:53.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7e6701700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e010e710 con 0x7fb7e0104650 2024-04-20T12:16:53.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7e6701700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e010e590 con 0x7fb7e0103cb0 2024-04-20T12:16:53.925 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7e6701700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e010e890 con 0x7fb7e0102ab0 2024-04-20T12:16:53.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7dffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e0102ab0 0x7fb7e019ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:16:53.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7dffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e0102ab0 0x7fb7e019ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:51116/0 (socket says 172.21.15.154:51116) 2024-04-20T12:16:53.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7dffff700 1 -- 172.21.15.154:0/451251045 learned_addr learned my addr 172.21.15.154:0/451251045 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-20T12:16:53.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7e4c9e700 1 --2- 172.21.15.154:0/451251045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7e0104650 0x7fb7e01a2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:16:53.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7df7fe700 1 --2- 172.21.15.154:0/451251045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7e0103cb0 0x7fb7e019b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:16:53.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7dffff700 1 -- 172.21.15.154:0/451251045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7e0103cb0 msgr2=0x7fb7e019b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:16:53.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7dffff700 1 --2- 172.21.15.154:0/451251045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7e0103cb0 0x7fb7e019b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:53.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7dffff700 1 -- 172.21.15.154:0/451251045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7e0104650 msgr2=0x7fb7e01a2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:16:53.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7dffff700 1 --2- 172.21.15.154:0/451251045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7e0104650 0x7fb7e01a2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:16:53.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7dffff700 1 -- 172.21.15.154:0/451251045 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e01a2aa0 con 0x7fb7e0102ab0 2024-04-20T12:16:53.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7dffff700 1 --2- 172.21.15.154:0/451251045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e0102ab0 0x7fb7e019ae40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000b530 tx=0x7fb7d000b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:16:53.926 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7dd7fa700 1 -- 172.21.15.154:0/451251045 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0015020 con 0x7fb7e0102ab0 2024-04-20T12:16:53.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7dd7fa700 1 -- 172.21.15.154:0/451251045 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7d0011d10 con 0x7fb7e0102ab0 2024-04-20T12:16:53.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7dd7fa700 1 -- 172.21.15.154:0/451251045 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d000f2e0 con 0x7fb7e0102ab0 2024-04-20T12:16:53.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7e6701700 1 -- 172.21.15.154:0/451251045 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e01a2d90 con 0x7fb7e0102ab0 2024-04-20T12:16:53.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.923+0000 7fb7e6701700 1 -- 172.21.15.154:0/451251045 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e01a3240 con 0x7fb7e0102ab0 2024-04-20T12:16:53.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.924+0000 7fb7e6701700 1 -- 172.21.15.154:0/451251045 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e0069770 con 0x7fb7e0102ab0 2024-04-20T12:16:53.927 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.926+0000 7fb7dd7fa700 1 -- 172.21.15.154:0/451251045 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fb7d0018020 con 0x7fb7e0102ab0 2024-04-20T12:16:53.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.926+0000 7fb7dd7fa700 1 --2- 172.21.15.154:0/451251045 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb7c80a3c40 0x7fb7c80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:16:53.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.926+0000 7fb7dd7fa700 1 -- 172.21.15.154:0/451251045 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7fb7d00cf0b0 con 0x7fb7e0102ab0 2024-04-20T12:16:53.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.926+0000 7fb7df7fe700 1 --2- 172.21.15.154:0/451251045 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb7c80a3c40 0x7fb7c80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:16:53.928 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.927+0000 7fb7df7fe700 1 --2- 172.21.15.154:0/451251045 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb7c80a3c40 0x7fb7c80a6100 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4005ea0 tx=0x7fb7d4005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:16:53.929 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:53.930+0000 7fb7dd7fa700 1 -- 172.21.15.154:0/451251045 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fb7e0069770 con 0x7fb7e0102ab0 2024-04-20T12:16:54.137 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:16:54.137+0000 7fb7e6701700 1 -- 172.21.15.154:0/451251045 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb7e00763a0 con 0x7fb7c80a3c40 2024-04-20T12:16:54.744 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:54 smithi154 ceph-mon[22073]: osdmap e34: 5 total, 5 up, 5 in 2024-04-20T12:16:54.744 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:54 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:16:54.744 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:54 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:16:54.745 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:54 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:54.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:54 smithi139 ceph-mon[21834]: osdmap e34: 5 total, 5 up, 5 in 2024-04-20T12:16:54.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:54 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:16:54.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:54 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:16:54.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:54 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:54.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:54 smithi135 ceph-mon[18264]: osdmap e34: 5 total, 5 up, 5 in 2024-04-20T12:16:54.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:54 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:16:54.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:54 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:16:54.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:54 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:16:55.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:55 smithi154 ceph-mon[22073]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:16:55.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:55 smithi154 ceph-mon[22073]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:16:55.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:55 smithi139 ceph-mon[21834]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:16:55.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:55 smithi139 ceph-mon[21834]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:16:55.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:55 smithi135 ceph-mon[18264]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:16:55.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:55 smithi135 ceph-mon[18264]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:16:57.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:56 smithi139 ceph-mon[21834]: from='client.? 172.21.15.154:0/4231070618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f0a8f64-2120-43e3-a452-c19a3323a645"}]: dispatch 2024-04-20T12:16:57.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:56 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f0a8f64-2120-43e3-a452-c19a3323a645"}]: dispatch 2024-04-20T12:16:57.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:56 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f0a8f64-2120-43e3-a452-c19a3323a645"}]': finished 2024-04-20T12:16:57.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:56 smithi139 ceph-mon[21834]: osdmap e35: 6 total, 5 up, 6 in 2024-04-20T12:16:57.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:56 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:16:57.109 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:56 smithi154 ceph-mon[22073]: from='client.? 172.21.15.154:0/4231070618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f0a8f64-2120-43e3-a452-c19a3323a645"}]: dispatch 2024-04-20T12:16:57.110 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:56 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f0a8f64-2120-43e3-a452-c19a3323a645"}]: dispatch 2024-04-20T12:16:57.110 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:56 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f0a8f64-2120-43e3-a452-c19a3323a645"}]': finished 2024-04-20T12:16:57.110 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:56 smithi154 ceph-mon[22073]: osdmap e35: 6 total, 5 up, 6 in 2024-04-20T12:16:57.110 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:56 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:16:57.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:56 smithi135 ceph-mon[18264]: from='client.? 172.21.15.154:0/4231070618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f0a8f64-2120-43e3-a452-c19a3323a645"}]: dispatch 2024-04-20T12:16:57.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:56 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f0a8f64-2120-43e3-a452-c19a3323a645"}]: dispatch 2024-04-20T12:16:57.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:56 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f0a8f64-2120-43e3-a452-c19a3323a645"}]': finished 2024-04-20T12:16:57.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:56 smithi135 ceph-mon[18264]: osdmap e35: 6 total, 5 up, 6 in 2024-04-20T12:16:57.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:56 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:16:58.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:57 smithi139 ceph-mon[21834]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:16:58.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:57 smithi139 ceph-mon[21834]: from='client.? 172.21.15.154:0/3744425336' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:16:58.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:57 smithi135 ceph-mon[18264]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:16:58.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:57 smithi135 ceph-mon[18264]: from='client.? 172.21.15.154:0/3744425336' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:16:58.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:57 smithi154 ceph-mon[22073]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:16:58.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:57 smithi154 ceph-mon[22073]: from='client.? 172.21.15.154:0/3744425336' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:17:00.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:16:59 smithi139 ceph-mon[21834]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:00.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:16:59 smithi135 ceph-mon[18264]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:00.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:16:59 smithi154 ceph-mon[22073]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:02.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:01 smithi139 ceph-mon[21834]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:02.101 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:01 smithi154 ceph-mon[22073]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:02.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:01 smithi135 ceph-mon[18264]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:03.895 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:03 smithi154 ceph-mon[22073]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:04.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:03 smithi139 ceph-mon[21834]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:04.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:03 smithi135 ceph-mon[18264]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:05.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:04 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-20T12:17:05.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:04 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:05.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:04 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-20T12:17:05.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:04 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:05.124 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:04 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-20T12:17:05.124 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:04 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:06.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:05 smithi154 ceph-mon[22073]: Deploying daemon osd.5 on smithi154 2024-04-20T12:17:06.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:05 smithi154 ceph-mon[22073]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:06.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:05 smithi139 ceph-mon[21834]: Deploying daemon osd.5 on smithi154 2024-04-20T12:17:06.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:05 smithi139 ceph-mon[21834]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:06.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:05 smithi135 ceph-mon[18264]: Deploying daemon osd.5 on smithi154 2024-04-20T12:17:06.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:05 smithi135 ceph-mon[18264]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:07.956 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:07 smithi154 ceph-mon[22073]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:07 smithi139 ceph-mon[21834]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:07 smithi135 ceph-mon[18264]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:10.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:09 smithi139 ceph-mon[21834]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:10.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:09 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:10.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:09 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:10.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:09 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:17:10.084 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:09 smithi154 ceph-mon[22073]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:10.084 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:09 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:10.084 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:09 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:10.084 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:09 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:17:10.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:09 smithi135 ceph-mon[18264]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:10.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:09 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:10.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:09 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:10.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:09 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:17:12.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:11 smithi139 ceph-mon[21834]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:12.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:11 smithi135 ceph-mon[18264]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:12.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:11 smithi154 ceph-mon[22073]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:13.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:17:13.005+0000 7fb7dd7fa700 1 -- 172.21.15.154:0/451251045 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb7e00763a0 con 0x7fb7c80a3c40 2024-04-20T12:17:13.005 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 5 on host 'smithi154' 2024-04-20T12:17:13.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:17:13.006+0000 7fb7e6701700 1 -- 172.21.15.154:0/451251045 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb7c80a3c40 msgr2=0x7fb7c80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:17:13.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:17:13.006+0000 7fb7e6701700 1 --2- 172.21.15.154:0/451251045 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb7c80a3c40 0x7fb7c80a6100 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4005ea0 tx=0x7fb7d4005e30 comp rx=0 tx=0).stop 2024-04-20T12:17:13.006 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:17:13.006+0000 7fb7e6701700 1 -- 172.21.15.154:0/451251045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e0102ab0 msgr2=0x7fb7e019ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:17:13.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:17:13.006+0000 7fb7e6701700 1 --2- 172.21.15.154:0/451251045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e0102ab0 0x7fb7e019ae40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000b530 tx=0x7fb7d000b840 comp rx=0 tx=0).stop 2024-04-20T12:17:13.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:17:13.006+0000 7fb7e6701700 1 -- 172.21.15.154:0/451251045 shutdown_connections 2024-04-20T12:17:13.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:17:13.006+0000 7fb7e6701700 1 --2- 172.21.15.154:0/451251045 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb7c80a3c40 0x7fb7c80a6100 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:13.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:17:13.006+0000 7fb7e6701700 1 --2- 172.21.15.154:0/451251045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7e0104650 0x7fb7e01a2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:13.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:17:13.006+0000 7fb7e6701700 1 --2- 172.21.15.154:0/451251045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb7e0102ab0 0x7fb7e019ae40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:13.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:17:13.006+0000 7fb7e6701700 1 --2- 172.21.15.154:0/451251045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb7e0103cb0 0x7fb7e019b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:13.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:17:13.006+0000 7fb7e6701700 1 -- 172.21.15.154:0/451251045 >> 172.21.15.154:0/451251045 conn(0x7fb7e00fe050 msgr2=0x7fb7e0074c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:17:13.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:17:13.007+0000 7fb7e6701700 1 -- 172.21.15.154:0/451251045 shutdown_connections 2024-04-20T12:17:13.007 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:17:13.007+0000 7fb7e6701700 1 -- 172.21.15.154:0/451251045 wait complete. 2024-04-20T12:17:13.658 DEBUG:teuthology.orchestra.run.smithi154:osd.5> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.5.service 2024-04-20T12:17:13.660 INFO:tasks.cephadm:Deploying osd.6 on smithi135 with /dev/vg_nvme/lv_2... 2024-04-20T12:17:13.660 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-20T12:17:13.911 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:17:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:13 smithi154 ceph-mon[22073]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:13 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:13 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:13 smithi154 ceph-mon[22073]: from='osd.5 [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-20T12:17:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:13 smithi154 ceph-mon[22073]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-20T12:17:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:13 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:13 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:14.034 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:13 smithi135 ceph-mon[18264]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:14.034 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:14.034 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:14.034 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:13 smithi135 ceph-mon[18264]: from='osd.5 [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-20T12:17:14.034 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:13 smithi135 ceph-mon[18264]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-20T12:17:14.034 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:14.034 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:14.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:13 smithi139 ceph-mon[21834]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:14.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:13 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:14.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:13 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:14.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:13 smithi139 ceph-mon[21834]: from='osd.5 [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-20T12:17:14.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:13 smithi139 ceph-mon[21834]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-20T12:17:14.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:13 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:14.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:13 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:14 smithi154 ceph-mon[22073]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-20T12:17:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:14 smithi154 ceph-mon[22073]: osdmap e36: 6 total, 5 up, 6 in 2024-04-20T12:17:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:14 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:17:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:14 smithi154 ceph-mon[22073]: from='osd.5 [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:17:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:14 smithi154 ceph-mon[22073]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:17:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:14 smithi154 ceph-mon[22073]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:15.291 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:14 smithi135 ceph-mon[18264]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-20T12:17:15.292 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:14 smithi135 ceph-mon[18264]: osdmap e36: 6 total, 5 up, 6 in 2024-04-20T12:17:15.292 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:14 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:17:15.292 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:14 smithi135 ceph-mon[18264]: from='osd.5 [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:17:15.292 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:14 smithi135 ceph-mon[18264]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:17:15.292 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:14 smithi135 ceph-mon[18264]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:15.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:14 smithi139 ceph-mon[21834]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-20T12:17:15.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:14 smithi139 ceph-mon[21834]: osdmap e36: 6 total, 5 up, 6 in 2024-04-20T12:17:15.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:14 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:17:15.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:14 smithi139 ceph-mon[21834]: from='osd.5 [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:17:15.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:14 smithi139 ceph-mon[21834]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:17:15.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:14 smithi139 ceph-mon[21834]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:15.596 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:17:15 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:17:15.382+0000 7f4ea57fe700 -1 osd.5 0 waiting for initial osdmap 2024-04-20T12:17:15.596 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:17:15 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:17:15.390+0000 7f4e9d5e9700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T12:17:16.064 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-20T12:17:16.064 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-20T12:17:16.064 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-04-20T12:17:16.064 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-04-20T12:17:16.064 INFO:teuthology.orchestra.run.smithi135.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115675 s, 906 MB/s 2024-04-20T12:17:16.064 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-04-20T12:17:16.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:15 smithi154 ceph-mon[22073]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-04-20T12:17:16.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:15 smithi154 ceph-mon[22073]: osdmap e37: 6 total, 5 up, 6 in 2024-04-20T12:17:16.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:15 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:17:16.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:15 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:17:16.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:15 smithi154 ceph-mon[22073]: from='osd.5 ' entity='osd.5' 2024-04-20T12:17:16.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:15 smithi139 ceph-mon[21834]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-04-20T12:17:16.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:15 smithi139 ceph-mon[21834]: osdmap e37: 6 total, 5 up, 6 in 2024-04-20T12:17:16.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:15 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:17:16.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:15 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:17:16.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:15 smithi139 ceph-mon[21834]: from='osd.5 ' entity='osd.5' 2024-04-20T12:17:16.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:15 smithi135 ceph-mon[18264]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-04-20T12:17:16.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:15 smithi135 ceph-mon[18264]: osdmap e37: 6 total, 5 up, 6 in 2024-04-20T12:17:16.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:15 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:17:16.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:15 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:17:16.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:15 smithi135 ceph-mon[18264]: from='osd.5 ' entity='osd.5' 2024-04-20T12:17:16.750 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_2 2024-04-20T12:17:17.003 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:17:17.231 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:16 smithi139 ceph-mon[21834]: purged_snaps scrub starts 2024-04-20T12:17:17.231 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:16 smithi139 ceph-mon[21834]: purged_snaps scrub ok 2024-04-20T12:17:17.231 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:16 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:17:17.231 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:16 smithi139 ceph-mon[21834]: osd.5 [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935] boot 2024-04-20T12:17:17.231 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:16 smithi139 ceph-mon[21834]: osdmap e38: 6 total, 6 up, 6 in 2024-04-20T12:17:17.231 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:16 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:17:17.231 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:16 smithi139 ceph-mon[21834]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:17.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:16 smithi154 ceph-mon[22073]: purged_snaps scrub starts 2024-04-20T12:17:17.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:16 smithi154 ceph-mon[22073]: purged_snaps scrub ok 2024-04-20T12:17:17.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:16 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:17:17.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:16 smithi154 ceph-mon[22073]: osd.5 [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935] boot 2024-04-20T12:17:17.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:16 smithi154 ceph-mon[22073]: osdmap e38: 6 total, 6 up, 6 in 2024-04-20T12:17:17.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:16 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:17:17.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:16 smithi154 ceph-mon[22073]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:17.268 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:16 smithi135 ceph-mon[18264]: purged_snaps scrub starts 2024-04-20T12:17:17.268 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:16 smithi135 ceph-mon[18264]: purged_snaps scrub ok 2024-04-20T12:17:17.268 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:16 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:17:17.268 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:16 smithi135 ceph-mon[18264]: osd.5 [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935] boot 2024-04-20T12:17:17.268 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:16 smithi135 ceph-mon[18264]: osdmap e38: 6 total, 6 up, 6 in 2024-04-20T12:17:17.268 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:16 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:17:17.269 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:16 smithi135 ceph-mon[18264]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-04-20T12:17:18.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:18 smithi135 ceph-mon[18264]: osdmap e39: 6 total, 6 up, 6 in 2024-04-20T12:17:18.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:18 smithi135 ceph-mon[18264]: Detected new or changed devices on smithi154 2024-04-20T12:17:18.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:18 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:18.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:18 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:18.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:18 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:17:18.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:18 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:17:18.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:18 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi154 to 8544M 2024-04-20T12:17:18.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:18 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:18.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:18 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:18.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:18 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:17:18.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:18 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:18.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:18 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:17:18.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:18 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:18.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:18 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:17:18.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:18 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:18.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:18 smithi139 ceph-mon[21834]: osdmap e39: 6 total, 6 up, 6 in 2024-04-20T12:17:18.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:18 smithi139 ceph-mon[21834]: Detected new or changed devices on smithi154 2024-04-20T12:17:18.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:18 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:18.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:18 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:18.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:18 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:17:18.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:18 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:17:18.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:18 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi154 to 8544M 2024-04-20T12:17:18.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:18 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:18.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:18 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:18.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:18 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:17:18.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:18 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:18.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:18 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:17:18.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:18 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:18.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:18 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:17:18.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:18 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:18.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:18 smithi154 ceph-mon[22073]: osdmap e39: 6 total, 6 up, 6 in 2024-04-20T12:17:18.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:18 smithi154 ceph-mon[22073]: Detected new or changed devices on smithi154 2024-04-20T12:17:18.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:18 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:18.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:18 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:18.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:18 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:17:18.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:18 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:17:18.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:18 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi154 to 8544M 2024-04-20T12:17:18.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:18 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:18.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:18 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:18.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:18 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:17:18.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:18 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:18.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:18 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:17:18.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:18 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:18.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:18 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:17:18.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:18 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:18.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.712+0000 7f1ab7cfa700 1 -- 172.21.15.135:0/2045372367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ab0103560 msgr2=0x7f1ab0109e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:17:18.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.712+0000 7f1ab7cfa700 1 --2- 172.21.15.135:0/2045372367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ab0103560 0x7f1ab0109e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800b0d0 tx=0x7f1aa800b3e0 comp rx=0 tx=0).stop 2024-04-20T12:17:18.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.712+0000 7f1ab7cfa700 1 -- 172.21.15.135:0/2045372367 shutdown_connections 2024-04-20T12:17:18.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.712+0000 7f1ab7cfa700 1 --2- 172.21.15.135:0/2045372367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ab0103560 0x7f1ab0109e10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:18.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.712+0000 7f1ab7cfa700 1 --2- 172.21.15.135:0/2045372367 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ab01019c0 0x7f1ab0101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:18.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.712+0000 7f1ab7cfa700 1 --2- 172.21.15.135:0/2045372367 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab0102bc0 0x7f1ab0103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:18.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.712+0000 7f1ab7cfa700 1 -- 172.21.15.135:0/2045372367 >> 172.21.15.135:0/2045372367 conn(0x7f1ab00fcf80 msgr2=0x7f1ab00ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:17:18.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.712+0000 7f1ab7cfa700 1 -- 172.21.15.135:0/2045372367 shutdown_connections 2024-04-20T12:17:18.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.712+0000 7f1ab7cfa700 1 -- 172.21.15.135:0/2045372367 wait complete. 2024-04-20T12:17:18.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.712+0000 7f1ab7cfa700 1 Processor -- start 2024-04-20T12:17:18.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.712+0000 7f1ab7cfa700 1 -- start start 2024-04-20T12:17:18.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab7cfa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ab01019c0 0x7f1ab0198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:17:18.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab7cfa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab0102bc0 0x7f1ab0199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:17:18.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab7cfa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ab0103560 0x7f1ab01a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:17:18.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab7cfa700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab010d5b0 con 0x7f1ab0103560 2024-04-20T12:17:18.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab7cfa700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab010d430 con 0x7f1ab01019c0 2024-04-20T12:17:18.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab7cfa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab010d730 con 0x7f1ab0102bc0 2024-04-20T12:17:18.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab5a96700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ab01019c0 0x7f1ab0198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:17:18.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab5a96700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ab01019c0 0x7f1ab0198ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:41792/0 (socket says 172.21.15.135:41792) 2024-04-20T12:17:18.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab5a96700 1 -- 172.21.15.135:0/2237190305 learned_addr learned my addr 172.21.15.135:0/2237190305 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:17:18.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab6297700 1 --2- 172.21.15.135:0/2237190305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ab0103560 0x7f1ab01a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:17:18.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab5295700 1 --2- 172.21.15.135:0/2237190305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab0102bc0 0x7f1ab0199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:17:18.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab5a96700 1 -- 172.21.15.135:0/2237190305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab0102bc0 msgr2=0x7f1ab0199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:17:18.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab5a96700 1 --2- 172.21.15.135:0/2237190305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab0102bc0 0x7f1ab0199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:18.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab5a96700 1 -- 172.21.15.135:0/2237190305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ab0103560 msgr2=0x7f1ab01a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:17:18.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab5a96700 1 --2- 172.21.15.135:0/2237190305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ab0103560 0x7f1ab01a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:18.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab5a96700 1 -- 172.21.15.135:0/2237190305 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab01a0930 con 0x7f1ab01019c0 2024-04-20T12:17:18.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab5295700 1 --2- 172.21.15.135:0/2237190305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab0102bc0 0x7f1ab0199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:17:18.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab5a96700 1 --2- 172.21.15.135:0/2237190305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ab01019c0 0x7f1ab0198ce0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00e970 tx=0x7f1aac00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:17:18.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1aa6ffd700 1 -- 172.21.15.135:0/2237190305 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac00cbd0 con 0x7f1ab01019c0 2024-04-20T12:17:18.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab7cfa700 1 -- 172.21.15.135:0/2237190305 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab01a0c20 con 0x7f1ab01019c0 2024-04-20T12:17:18.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1aa6ffd700 1 -- 172.21.15.135:0/2237190305 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1aac004500 con 0x7f1ab01019c0 2024-04-20T12:17:18.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1aa6ffd700 1 -- 172.21.15.135:0/2237190305 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac003e30 con 0x7f1ab01019c0 2024-04-20T12:17:18.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.713+0000 7f1ab7cfa700 1 -- 172.21.15.135:0/2237190305 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab01a11b0 con 0x7f1ab01019c0 2024-04-20T12:17:18.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.714+0000 7f1ab7cfa700 1 -- 172.21.15.135:0/2237190305 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab0069740 con 0x7f1ab01019c0 2024-04-20T12:17:18.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.716+0000 7f1aa6ffd700 1 -- 172.21.15.135:0/2237190305 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f1aac004000 con 0x7f1ab01019c0 2024-04-20T12:17:18.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.716+0000 7f1aa6ffd700 1 --2- 172.21.15.135:0/2237190305 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1a9c0a3c40 0x7f1a9c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:17:18.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.716+0000 7f1ab5295700 1 --2- 172.21.15.135:0/2237190305 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1a9c0a3c40 0x7f1a9c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:17:18.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.716+0000 7f1aa6ffd700 1 -- 172.21.15.135:0/2237190305 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4533+0+0 (secure 0 0 0) 0x7f1aac0cf9e0 con 0x7f1ab01019c0 2024-04-20T12:17:18.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.717+0000 7f1ab5295700 1 --2- 172.21.15.135:0/2237190305 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1a9c0a3c40 0x7f1a9c0a6100 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009cb0 tx=0x7f1aa0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:17:18.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.725+0000 7f1aa6ffd700 1 -- 172.21.15.135:0/2237190305 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f1aac01f340 con 0x7f1ab01019c0 2024-04-20T12:17:18.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:18.930+0000 7f1ab7cfa700 1 -- 172.21.15.135:0/2237190305 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1ab00ff0f0 con 0x7f1a9c0a3c40 2024-04-20T12:17:19.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:19 smithi139 ceph-mon[21834]: osdmap e40: 6 total, 6 up, 6 in 2024-04-20T12:17:19.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:19 smithi139 ceph-mon[21834]: osdmap e41: 6 total, 6 up, 6 in 2024-04-20T12:17:19.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:19 smithi139 ceph-mon[21834]: pgmap v142: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-04-20T12:17:19.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:17:19.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:17:19.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:19.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:19 smithi135 ceph-mon[18264]: osdmap e40: 6 total, 6 up, 6 in 2024-04-20T12:17:19.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:19 smithi135 ceph-mon[18264]: osdmap e41: 6 total, 6 up, 6 in 2024-04-20T12:17:19.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:19 smithi135 ceph-mon[18264]: pgmap v142: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-04-20T12:17:19.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:17:19.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:17:19.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:19.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:19 smithi154 ceph-mon[22073]: osdmap e40: 6 total, 6 up, 6 in 2024-04-20T12:17:19.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:19 smithi154 ceph-mon[22073]: osdmap e41: 6 total, 6 up, 6 in 2024-04-20T12:17:19.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:19 smithi154 ceph-mon[22073]: pgmap v142: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-04-20T12:17:19.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:17:19.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:17:19.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:20.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:20 smithi135 ceph-mon[18264]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:17:20.502 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:20 smithi135 ceph-mon[18264]: osdmap e42: 6 total, 6 up, 6 in 2024-04-20T12:17:20.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:20 smithi139 ceph-mon[21834]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:17:20.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:20 smithi139 ceph-mon[21834]: osdmap e42: 6 total, 6 up, 6 in 2024-04-20T12:17:20.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:20 smithi154 ceph-mon[22073]: from='client.24248 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:17:20.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:20 smithi154 ceph-mon[22073]: osdmap e42: 6 total, 6 up, 6 in 2024-04-20T12:17:21.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:21 smithi139 ceph-mon[21834]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-20T12:17:21.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:21 smithi135 ceph-mon[18264]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-20T12:17:21.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:21 smithi154 ceph-mon[22073]: pgmap v144: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-04-20T12:17:22.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:22 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3318869588' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ddd0e044-f07f-46a8-b2d2-56c0c14a1c14"}]: dispatch 2024-04-20T12:17:22.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:22 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3318869588' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddd0e044-f07f-46a8-b2d2-56c0c14a1c14"}]': finished 2024-04-20T12:17:22.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:22 smithi139 ceph-mon[21834]: osdmap e43: 7 total, 6 up, 7 in 2024-04-20T12:17:22.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:22 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:22.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:22 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3318869588' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ddd0e044-f07f-46a8-b2d2-56c0c14a1c14"}]: dispatch 2024-04-20T12:17:22.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:22 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3318869588' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddd0e044-f07f-46a8-b2d2-56c0c14a1c14"}]': finished 2024-04-20T12:17:22.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:22 smithi135 ceph-mon[18264]: osdmap e43: 7 total, 6 up, 7 in 2024-04-20T12:17:22.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:22 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:22.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:22 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3318869588' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ddd0e044-f07f-46a8-b2d2-56c0c14a1c14"}]: dispatch 2024-04-20T12:17:22.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:22 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3318869588' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddd0e044-f07f-46a8-b2d2-56c0c14a1c14"}]': finished 2024-04-20T12:17:22.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:22 smithi154 ceph-mon[22073]: osdmap e43: 7 total, 6 up, 7 in 2024-04-20T12:17:22.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:22 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:23.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:23 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3090493481' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:17:23.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:23 smithi139 ceph-mon[21834]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-04-20T12:17:23.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:23 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3090493481' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:17:23.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:23 smithi135 ceph-mon[18264]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-04-20T12:17:23.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:23 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3090493481' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:17:23.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:23 smithi154 ceph-mon[22073]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-04-20T12:17:26.031 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:25 smithi135 ceph-mon[18264]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-04-20T12:17:26.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:25 smithi139 ceph-mon[21834]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-04-20T12:17:26.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:25 smithi154 ceph-mon[22073]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-04-20T12:17:28.027 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:27 smithi135 ceph-mon[18264]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:28.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:27 smithi139 ceph-mon[21834]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:28.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:27 smithi154 ceph-mon[22073]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:30.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:29 smithi139 ceph-mon[21834]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:30.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:29 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-20T12:17:30.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:29 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:30.088 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:29 smithi135 ceph-mon[18264]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:30.088 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:29 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-20T12:17:30.088 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:29 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:30.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:29 smithi154 ceph-mon[22073]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:30.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:29 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-04-20T12:17:30.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:29 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:31.036 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:30 smithi135 ceph-mon[18264]: Deploying daemon osd.6 on smithi135 2024-04-20T12:17:31.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:30 smithi139 ceph-mon[21834]: Deploying daemon osd.6 on smithi135 2024-04-20T12:17:31.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:30 smithi154 ceph-mon[22073]: Deploying daemon osd.6 on smithi135 2024-04-20T12:17:32.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:31 smithi139 ceph-mon[21834]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:32.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:31 smithi135 ceph-mon[18264]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:31 smithi154 ceph-mon[22073]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:33.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:33 smithi135 ceph-mon[18264]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:34.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:33 smithi154 ceph-mon[22073]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:34.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:33 smithi139 ceph-mon[21834]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:35.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:35 smithi135 ceph-mon[18264]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:35.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:35.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:35.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:17:36.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:35 smithi139 ceph-mon[21834]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:36.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:36.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:36.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:17:36.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:35 smithi154 ceph-mon[22073]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:36.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:36.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:36.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:17:37.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:37 smithi135 ceph-mon[18264]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:38.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:37 smithi139 ceph-mon[21834]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:38.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:37 smithi154 ceph-mon[22073]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:38.847 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 6 on host 'smithi135' 2024-04-20T12:17:38.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:38.847+0000 7f1aa6ffd700 1 -- 172.21.15.135:0/2237190305 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1ab00ff0f0 con 0x7f1a9c0a3c40 2024-04-20T12:17:38.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:38.850+0000 7f1ab7cfa700 1 -- 172.21.15.135:0/2237190305 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1a9c0a3c40 msgr2=0x7f1a9c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:17:38.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:38.850+0000 7f1ab7cfa700 1 --2- 172.21.15.135:0/2237190305 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1a9c0a3c40 0x7f1a9c0a6100 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009cb0 tx=0x7f1aa0009260 comp rx=0 tx=0).stop 2024-04-20T12:17:38.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:38.850+0000 7f1ab7cfa700 1 -- 172.21.15.135:0/2237190305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ab01019c0 msgr2=0x7f1ab0198ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:17:38.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:38.850+0000 7f1ab7cfa700 1 --2- 172.21.15.135:0/2237190305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ab01019c0 0x7f1ab0198ce0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1aac00e970 tx=0x7f1aac00ec80 comp rx=0 tx=0).stop 2024-04-20T12:17:38.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:38.850+0000 7f1ab7cfa700 1 -- 172.21.15.135:0/2237190305 shutdown_connections 2024-04-20T12:17:38.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:38.850+0000 7f1ab7cfa700 1 --2- 172.21.15.135:0/2237190305 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1a9c0a3c40 0x7f1a9c0a6100 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:38.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:38.850+0000 7f1ab7cfa700 1 --2- 172.21.15.135:0/2237190305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ab0103560 0x7f1ab01a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:38.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:38.850+0000 7f1ab7cfa700 1 --2- 172.21.15.135:0/2237190305 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1ab01019c0 0x7f1ab0198ce0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:38.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:38.850+0000 7f1ab7cfa700 1 --2- 172.21.15.135:0/2237190305 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab0102bc0 0x7f1ab0199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:38.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:38.850+0000 7f1ab7cfa700 1 -- 172.21.15.135:0/2237190305 >> 172.21.15.135:0/2237190305 conn(0x7f1ab00fcf80 msgr2=0x7f1ab00fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:17:38.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:38.850+0000 7f1ab7cfa700 1 -- 172.21.15.135:0/2237190305 shutdown_connections 2024-04-20T12:17:38.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:17:38.850+0000 7f1ab7cfa700 1 -- 172.21.15.135:0/2237190305 wait complete. 2024-04-20T12:17:39.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:38 smithi139 ceph-mon[21834]: from='osd.6 [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-20T12:17:39.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:38 smithi135 ceph-mon[18264]: from='osd.6 [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-20T12:17:39.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:38 smithi154 ceph-mon[22073]: from='osd.6 [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-04-20T12:17:39.655 DEBUG:teuthology.orchestra.run.smithi135:osd.6> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.6.service 2024-04-20T12:17:39.657 INFO:tasks.cephadm:Deploying osd.7 on smithi139 with /dev/vg_nvme/lv_2... 2024-04-20T12:17:39.657 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-20T12:17:39.905 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.b/config 2024-04-20T12:17:39.958 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:39 smithi135 ceph-mon[18264]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:39.958 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:39 smithi135 ceph-mon[18264]: from='osd.6 [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-20T12:17:39.958 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:39 smithi135 ceph-mon[18264]: osdmap e44: 7 total, 6 up, 7 in 2024-04-20T12:17:39.958 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:39 smithi135 ceph-mon[18264]: from='osd.6 [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-20T12:17:39.959 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:39.959 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:39.959 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:39.959 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:39.959 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:39.959 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:17:39 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:17:39.804+0000 7fde3427a700 -1 osd.6 0 waiting for initial osdmap 2024-04-20T12:17:39.959 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:17:39 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:17:39.814+0000 7fde3006d700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T12:17:40.029 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:39 smithi139 ceph-mon[21834]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:40.029 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:39 smithi139 ceph-mon[21834]: from='osd.6 [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-20T12:17:40.030 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:39 smithi139 ceph-mon[21834]: osdmap e44: 7 total, 6 up, 7 in 2024-04-20T12:17:40.030 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:39 smithi139 ceph-mon[21834]: from='osd.6 [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-20T12:17:40.030 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:40.030 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:40.030 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:40.030 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:40.030 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:40.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:39 smithi154 ceph-mon[22073]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:40.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:39 smithi154 ceph-mon[22073]: from='osd.6 [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-04-20T12:17:40.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:39 smithi154 ceph-mon[22073]: osdmap e44: 7 total, 6 up, 7 in 2024-04-20T12:17:40.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:39 smithi154 ceph-mon[22073]: from='osd.6 [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-20T12:17:40.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:40.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:40.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:40.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:40.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:41.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:40 smithi139 ceph-mon[21834]: from='osd.6 [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-20T12:17:41.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:40 smithi139 ceph-mon[21834]: osdmap e45: 7 total, 6 up, 7 in 2024-04-20T12:17:41.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:40 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:41.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:40 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:41.086 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:40 smithi135 ceph-mon[18264]: from='osd.6 [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-20T12:17:41.086 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:40 smithi135 ceph-mon[18264]: osdmap e45: 7 total, 6 up, 7 in 2024-04-20T12:17:41.086 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:40 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:41.086 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:40 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:41.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:40 smithi154 ceph-mon[22073]: from='osd.6 [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-20T12:17:41.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:40 smithi154 ceph-mon[22073]: osdmap e45: 7 total, 6 up, 7 in 2024-04-20T12:17:41.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:40 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:41.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:40 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:42.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:41 smithi139 ceph-mon[21834]: purged_snaps scrub starts 2024-04-20T12:17:42.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:41 smithi139 ceph-mon[21834]: purged_snaps scrub ok 2024-04-20T12:17:42.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:41 smithi139 ceph-mon[21834]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:42.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:41 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:42.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:41 smithi139 ceph-mon[21834]: osd.6 [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966] boot 2024-04-20T12:17:42.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:41 smithi139 ceph-mon[21834]: osdmap e46: 7 total, 7 up, 7 in 2024-04-20T12:17:42.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:41 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:42.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:41 smithi135 ceph-mon[18264]: purged_snaps scrub starts 2024-04-20T12:17:42.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:41 smithi135 ceph-mon[18264]: purged_snaps scrub ok 2024-04-20T12:17:42.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:41 smithi135 ceph-mon[18264]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:42.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:41 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:42.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:41 smithi135 ceph-mon[18264]: osd.6 [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966] boot 2024-04-20T12:17:42.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:41 smithi135 ceph-mon[18264]: osdmap e46: 7 total, 7 up, 7 in 2024-04-20T12:17:42.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:41 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:42.138 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-20T12:17:42.138 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-20T12:17:42.138 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2024-04-20T12:17:42.138 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2024-04-20T12:17:42.138 INFO:teuthology.orchestra.run.smithi139.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0150132 s, 698 MB/s 2024-04-20T12:17:42.138 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2024-04-20T12:17:42.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:41 smithi154 ceph-mon[22073]: purged_snaps scrub starts 2024-04-20T12:17:42.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:41 smithi154 ceph-mon[22073]: purged_snaps scrub ok 2024-04-20T12:17:42.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:41 smithi154 ceph-mon[22073]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-04-20T12:17:42.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:41 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:42.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:41 smithi154 ceph-mon[22073]: osd.6 [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966] boot 2024-04-20T12:17:42.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:41 smithi154 ceph-mon[22073]: osdmap e46: 7 total, 7 up, 7 in 2024-04-20T12:17:42.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:41 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:17:42.815 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_2 2024-04-20T12:17:43.055 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.b/config 2024-04-20T12:17:43.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:42 smithi139 ceph-mon[21834]: osdmap e47: 7 total, 7 up, 7 in 2024-04-20T12:17:43.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:42 smithi135 ceph-mon[18264]: osdmap e47: 7 total, 7 up, 7 in 2024-04-20T12:17:43.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:42 smithi154 ceph-mon[22073]: osdmap e47: 7 total, 7 up, 7 in 2024-04-20T12:17:44.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:43 smithi139 ceph-mon[21834]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:44.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:43 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:44.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:43 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:44.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:43 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:17:44.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:43 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:17:44.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:43 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:17:44.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:43 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:44.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:43 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:44.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:43 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:17:44.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:43 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:44.077 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:43 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:17:44.078 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:43 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:44.078 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:43 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:17:44.078 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:43 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:44.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:43 smithi135 ceph-mon[18264]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:44.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:43 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:44.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:43 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:44.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:43 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:17:44.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:43 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:17:44.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:43 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:17:44.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:43 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:44.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:43 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:44.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:43 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:17:44.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:43 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:44.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:43 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:17:44.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:43 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:44.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:43 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:17:44.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:43 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:44.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:43 smithi154 ceph-mon[22073]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:44.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:43 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:44.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:43 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:44.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:43 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:17:44.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:43 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:17:44.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:43 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:17:44.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:43 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:44.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:43 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:44.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:43 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:17:44.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:43 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:44.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:43 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:17:44.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:43 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:44.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:43 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:17:44.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:43 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:17:44.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.584+0000 7f1373ef1700 1 -- 172.21.15.139:0/3311986372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f136c102ab0 msgr2=0x7f136c102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:17:44.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.584+0000 7f1373ef1700 1 --2- 172.21.15.139:0/3311986372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f136c102ab0 0x7f136c102ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f13680099c0 tx=0x7f1368009cd0 comp rx=0 tx=0).stop 2024-04-20T12:17:44.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.584+0000 7f1373ef1700 1 -- 172.21.15.139:0/3311986372 shutdown_connections 2024-04-20T12:17:44.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.584+0000 7f1373ef1700 1 --2- 172.21.15.139:0/3311986372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f136c104650 0x7f136c10af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:44.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.584+0000 7f1373ef1700 1 --2- 172.21.15.139:0/3311986372 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f136c102ab0 0x7f136c102ed0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:44.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.584+0000 7f1373ef1700 1 --2- 172.21.15.139:0/3311986372 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c103cb0 0x7f136c104110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:44.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.584+0000 7f1373ef1700 1 -- 172.21.15.139:0/3311986372 >> 172.21.15.139:0/3311986372 conn(0x7f136c0fe050 msgr2=0x7f136c100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:17:44.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.585+0000 7f1373ef1700 1 -- 172.21.15.139:0/3311986372 shutdown_connections 2024-04-20T12:17:44.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.585+0000 7f1373ef1700 1 -- 172.21.15.139:0/3311986372 wait complete. 2024-04-20T12:17:44.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.585+0000 7f1373ef1700 1 Processor -- start 2024-04-20T12:17:44.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.585+0000 7f1373ef1700 1 -- start start 2024-04-20T12:17:44.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.585+0000 7f1373ef1700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c102ab0 0x7f136c0767f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:17:44.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.585+0000 7f1373ef1700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f136c103cb0 0x7f136c074e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:17:44.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.585+0000 7f1373ef1700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f136c104650 0x7f136c075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:17:44.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.585+0000 7f1373ef1700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f136c10e670 con 0x7f136c103cb0 2024-04-20T12:17:44.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.585+0000 7f1373ef1700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f136c10e4f0 con 0x7f136c104650 2024-04-20T12:17:44.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.585+0000 7f1373ef1700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f136c10e7f0 con 0x7f136c102ab0 2024-04-20T12:17:44.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.585+0000 7f137248e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f136c104650 0x7f136c075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:17:44.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.585+0000 7f137248e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f136c104650 0x7f136c075380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:45362/0 (socket says 172.21.15.139:45362) 2024-04-20T12:17:44.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.585+0000 7f137248e700 1 -- 172.21.15.139:0/2597185047 learned_addr learned my addr 172.21.15.139:0/2597185047 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-20T12:17:44.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.585+0000 7f1371c8d700 1 --2- 172.21.15.139:0/2597185047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c102ab0 0x7f136c0767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:17:44.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.586+0000 7f137148c700 1 --2- 172.21.15.139:0/2597185047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f136c103cb0 0x7f136c074e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:17:44.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.586+0000 7f137248e700 1 -- 172.21.15.139:0/2597185047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c102ab0 msgr2=0x7f136c0767f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:17:44.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.586+0000 7f137248e700 1 --2- 172.21.15.139:0/2597185047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c102ab0 0x7f136c0767f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:44.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.586+0000 7f137248e700 1 -- 172.21.15.139:0/2597185047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f136c103cb0 msgr2=0x7f136c074e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:17:44.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.586+0000 7f137248e700 1 --2- 172.21.15.139:0/2597185047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f136c103cb0 0x7f136c074e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:17:44.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.586+0000 7f137248e700 1 -- 172.21.15.139:0/2597185047 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f136c075c30 con 0x7f136c104650 2024-04-20T12:17:44.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.586+0000 7f137248e700 1 --2- 172.21.15.139:0/2597185047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f136c104650 0x7f136c075380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f136400ada0 tx=0x7f136400c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:17:44.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.586+0000 7f1362ffd700 1 -- 172.21.15.139:0/2597185047 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1364017020 con 0x7f136c104650 2024-04-20T12:17:44.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.586+0000 7f1362ffd700 1 -- 172.21.15.139:0/2597185047 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f136400a0d0 con 0x7f136c104650 2024-04-20T12:17:44.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.586+0000 7f1373ef1700 1 -- 172.21.15.139:0/2597185047 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f136c1a2de0 con 0x7f136c104650 2024-04-20T12:17:44.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.586+0000 7f1362ffd700 1 -- 172.21.15.139:0/2597185047 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1364005480 con 0x7f136c104650 2024-04-20T12:17:44.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.586+0000 7f1373ef1700 1 -- 172.21.15.139:0/2597185047 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f136c1a3240 con 0x7f136c104650 2024-04-20T12:17:44.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.587+0000 7f1373ef1700 1 -- 172.21.15.139:0/2597185047 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f136c069740 con 0x7f136c104650 2024-04-20T12:17:44.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.588+0000 7f1362ffd700 1 -- 172.21.15.139:0/2597185047 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f1364005620 con 0x7f136c104650 2024-04-20T12:17:44.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.589+0000 7f1362ffd700 1 --2- 172.21.15.139:0/2597185047 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f13580a3cc0 0x7f13580a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:17:44.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.589+0000 7f1362ffd700 1 -- 172.21.15.139:0/2597185047 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7f13640cedd0 con 0x7f136c104650 2024-04-20T12:17:44.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.589+0000 7f1371c8d700 1 --2- 172.21.15.139:0/2597185047 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f13580a3cc0 0x7f13580a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:17:44.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.589+0000 7f1371c8d700 1 --2- 172.21.15.139:0/2597185047 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f13580a3cc0 0x7f13580a6180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1368003890 tx=0x7f1368005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:17:44.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.593+0000 7f1362ffd700 1 -- 172.21.15.139:0/2597185047 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f1364021020 con 0x7f136c104650 2024-04-20T12:17:44.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:17:44.801+0000 7f1373ef1700 1 -- 172.21.15.139:0/2597185047 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f136c062e90 con 0x7f13580a3cc0 2024-04-20T12:17:45.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:44 smithi139 ceph-mon[21834]: Detected new or changed devices on smithi135 2024-04-20T12:17:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:44 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi135 to 5696M 2024-04-20T12:17:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:17:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:17:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:44 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:44 smithi135 ceph-mon[18264]: Detected new or changed devices on smithi135 2024-04-20T12:17:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:44 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi135 to 5696M 2024-04-20T12:17:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:17:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:17:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:44 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:45.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:44 smithi154 ceph-mon[22073]: Detected new or changed devices on smithi135 2024-04-20T12:17:45.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:44 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi135 to 5696M 2024-04-20T12:17:45.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:17:45.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:17:45.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:44 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:46.028 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:45 smithi139 ceph-mon[21834]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:46.028 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:45 smithi139 ceph-mon[21834]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:17:46.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:45 smithi135 ceph-mon[18264]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:46.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:45 smithi135 ceph-mon[18264]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:17:46.152 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:45 smithi154 ceph-mon[22073]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:46.152 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:45 smithi154 ceph-mon[22073]: from='client.24257 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:17:48.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:47 smithi139 ceph-mon[21834]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:48.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:47 smithi139 ceph-mon[21834]: from='client.? 172.21.15.139:0/1998574069' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea3e9f8b-d627-413a-9146-bd3fea8948a0"}]: dispatch 2024-04-20T12:17:48.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:47 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea3e9f8b-d627-413a-9146-bd3fea8948a0"}]: dispatch 2024-04-20T12:17:48.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:47 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea3e9f8b-d627-413a-9146-bd3fea8948a0"}]': finished 2024-04-20T12:17:48.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:47 smithi139 ceph-mon[21834]: osdmap e48: 8 total, 7 up, 8 in 2024-04-20T12:17:48.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:47 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:17:48.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:47 smithi135 ceph-mon[18264]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:48.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:47 smithi135 ceph-mon[18264]: from='client.? 172.21.15.139:0/1998574069' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea3e9f8b-d627-413a-9146-bd3fea8948a0"}]: dispatch 2024-04-20T12:17:48.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:47 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea3e9f8b-d627-413a-9146-bd3fea8948a0"}]: dispatch 2024-04-20T12:17:48.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:47 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea3e9f8b-d627-413a-9146-bd3fea8948a0"}]': finished 2024-04-20T12:17:48.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:47 smithi135 ceph-mon[18264]: osdmap e48: 8 total, 7 up, 8 in 2024-04-20T12:17:48.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:47 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:17:48.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:47 smithi154 ceph-mon[22073]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:48.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:47 smithi154 ceph-mon[22073]: from='client.? 172.21.15.139:0/1998574069' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea3e9f8b-d627-413a-9146-bd3fea8948a0"}]: dispatch 2024-04-20T12:17:48.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:47 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea3e9f8b-d627-413a-9146-bd3fea8948a0"}]: dispatch 2024-04-20T12:17:48.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:47 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea3e9f8b-d627-413a-9146-bd3fea8948a0"}]': finished 2024-04-20T12:17:48.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:47 smithi154 ceph-mon[22073]: osdmap e48: 8 total, 7 up, 8 in 2024-04-20T12:17:48.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:47 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:17:49.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:48 smithi135 ceph-mon[18264]: from='client.? 172.21.15.139:0/1116720324' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:17:49.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:48 smithi154 ceph-mon[22073]: from='client.? 172.21.15.139:0/1116720324' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:17:49.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:48 smithi139 ceph-mon[21834]: from='client.? 172.21.15.139:0/1116720324' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:17:50.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:49 smithi135 ceph-mon[18264]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:50.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:49 smithi154 ceph-mon[22073]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:50.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:49 smithi139 ceph-mon[21834]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:52.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:51 smithi139 ceph-mon[21834]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:52.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:51 smithi135 ceph-mon[18264]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:52.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:51 smithi154 ceph-mon[22073]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:54.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:53 smithi139 ceph-mon[21834]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:54.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:53 smithi135 ceph-mon[18264]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:54.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:53 smithi154 ceph-mon[22073]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:55.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:54 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-20T12:17:55.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:54 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:55.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:54 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-20T12:17:55.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:54 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:55.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:54 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-04-20T12:17:55.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:54 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:17:56.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:55 smithi139 ceph-mon[21834]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:56.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:55 smithi139 ceph-mon[21834]: Deploying daemon osd.7 on smithi139 2024-04-20T12:17:56.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:55 smithi135 ceph-mon[18264]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:56.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:55 smithi135 ceph-mon[18264]: Deploying daemon osd.7 on smithi139 2024-04-20T12:17:56.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:55 smithi154 ceph-mon[22073]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:56.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:55 smithi154 ceph-mon[22073]: Deploying daemon osd.7 on smithi139 2024-04-20T12:17:58.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:57 smithi135 ceph-mon[18264]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:58.136 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:57 smithi139 ceph-mon[21834]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:17:58.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:57 smithi154 ceph-mon[22073]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:00.070 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:17:59 smithi139 ceph-mon[21834]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:00.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:17:59 smithi135 ceph-mon[18264]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:00.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:17:59 smithi154 ceph-mon[22073]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:01.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:01.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:01.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:01.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:01 smithi139 ceph-mon[21834]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:01.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:01.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:01.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:01.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:01 smithi135 ceph-mon[18264]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:01.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:01.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:01.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:01.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:01 smithi154 ceph-mon[22073]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:04.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:03 smithi139 ceph-mon[21834]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:04.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:03 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:04.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:03 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:04.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:03 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:04.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:03 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:18:04.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:03 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:04.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:03 smithi135 ceph-mon[18264]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:04.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:04.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:04.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:04.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:18:04.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:04.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:03 smithi154 ceph-mon[22073]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:04.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:03 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:04.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:03 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:04.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:03 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:04.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:03 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:18:04.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:03 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:04.318 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:18:04.318+0000 7f1362ffd700 1 -- 172.21.15.139:0/2597185047 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f136c062e90 con 0x7f13580a3cc0 2024-04-20T12:18:04.318 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 7 on host 'smithi139' 2024-04-20T12:18:04.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:18:04.320+0000 7f1373ef1700 1 -- 172.21.15.139:0/2597185047 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f13580a3cc0 msgr2=0x7f13580a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:18:04.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:18:04.320+0000 7f1373ef1700 1 --2- 172.21.15.139:0/2597185047 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f13580a3cc0 0x7f13580a6180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1368003890 tx=0x7f1368005fb0 comp rx=0 tx=0).stop 2024-04-20T12:18:04.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:18:04.320+0000 7f1373ef1700 1 -- 172.21.15.139:0/2597185047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f136c104650 msgr2=0x7f136c075380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:18:04.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:18:04.320+0000 7f1373ef1700 1 --2- 172.21.15.139:0/2597185047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f136c104650 0x7f136c075380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f136400ada0 tx=0x7f136400c330 comp rx=0 tx=0).stop 2024-04-20T12:18:04.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:18:04.320+0000 7f1373ef1700 1 -- 172.21.15.139:0/2597185047 shutdown_connections 2024-04-20T12:18:04.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:18:04.320+0000 7f1373ef1700 1 --2- 172.21.15.139:0/2597185047 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f13580a3cc0 0x7f13580a6180 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:04.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:18:04.320+0000 7f1373ef1700 1 --2- 172.21.15.139:0/2597185047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f136c104650 0x7f136c075380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:04.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:18:04.320+0000 7f1373ef1700 1 --2- 172.21.15.139:0/2597185047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f136c102ab0 0x7f136c0767f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:04.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:18:04.320+0000 7f1373ef1700 1 --2- 172.21.15.139:0/2597185047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f136c103cb0 0x7f136c074e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:04.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:18:04.320+0000 7f1373ef1700 1 -- 172.21.15.139:0/2597185047 >> 172.21.15.139:0/2597185047 conn(0x7f136c0fe050 msgr2=0x7f136c107030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:18:04.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:18:04.320+0000 7f1373ef1700 1 -- 172.21.15.139:0/2597185047 shutdown_connections 2024-04-20T12:18:04.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:18:04.320+0000 7f1373ef1700 1 -- 172.21.15.139:0/2597185047 wait complete. 2024-04-20T12:18:04.986 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:04 smithi139 ceph-mon[21834]: from='osd.7 [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-20T12:18:04.986 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:04 smithi139 ceph-mon[21834]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-20T12:18:04.986 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:04 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:04.986 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:04 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:04.986 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:04 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:05.013 DEBUG:teuthology.orchestra.run.smithi139:osd.7> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.7.service 2024-04-20T12:18:05.015 INFO:tasks.cephadm:Deploying osd.8 on smithi154 with /dev/vg_nvme/lv_2... 2024-04-20T12:18:05.015 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-20T12:18:05.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:04 smithi135 ceph-mon[18264]: from='osd.7 [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-20T12:18:05.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:04 smithi135 ceph-mon[18264]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-20T12:18:05.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:04 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:05.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:04 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:05.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:04 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:05.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:04 smithi154 ceph-mon[22073]: from='osd.7 [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-20T12:18:05.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:04 smithi154 ceph-mon[22073]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-04-20T12:18:05.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:04 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:05.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:04 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:05.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:04 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:05.260 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:18:06.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:05 smithi154 ceph-mon[22073]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:06.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:05 smithi154 ceph-mon[22073]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-20T12:18:06.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:05 smithi154 ceph-mon[22073]: osdmap e49: 8 total, 7 up, 8 in 2024-04-20T12:18:06.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:18:06.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:05 smithi154 ceph-mon[22073]: from='osd.7 [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:18:06.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:05 smithi154 ceph-mon[22073]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:18:06.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:05 smithi135 ceph-mon[18264]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:06.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:05 smithi135 ceph-mon[18264]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-20T12:18:06.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:05 smithi135 ceph-mon[18264]: osdmap e49: 8 total, 7 up, 8 in 2024-04-20T12:18:06.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:18:06.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:05 smithi135 ceph-mon[18264]: from='osd.7 [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:18:06.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:05 smithi135 ceph-mon[18264]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:18:06.275 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:05 smithi139 ceph-mon[21834]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:06.276 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:05 smithi139 ceph-mon[21834]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-04-20T12:18:06.276 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:05 smithi139 ceph-mon[21834]: osdmap e49: 8 total, 7 up, 8 in 2024-04-20T12:18:06.276 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:18:06.276 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:05 smithi139 ceph-mon[21834]: from='osd.7 [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:18:06.276 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:05 smithi139 ceph-mon[21834]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:18:06.580 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:18:06 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:18:06.274+0000 7feff9aa7700 -1 osd.7 0 waiting for initial osdmap 2024-04-20T12:18:06.580 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:18:06 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:18:06.283+0000 7feff1892700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T12:18:06.970 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:06 smithi154 ceph-mon[22073]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-20T12:18:06.970 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:06 smithi154 ceph-mon[22073]: osdmap e50: 8 total, 7 up, 8 in 2024-04-20T12:18:06.970 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:06 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:18:06.971 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:06 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:18:06.971 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:06 smithi154 ceph-mon[22073]: from='osd.7 ' entity='osd.7' 2024-04-20T12:18:07.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:06 smithi139 ceph-mon[21834]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-20T12:18:07.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:06 smithi139 ceph-mon[21834]: osdmap e50: 8 total, 7 up, 8 in 2024-04-20T12:18:07.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:06 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:18:07.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:06 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:18:07.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:06 smithi139 ceph-mon[21834]: from='osd.7 ' entity='osd.7' 2024-04-20T12:18:07.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:06 smithi135 ceph-mon[18264]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-20T12:18:07.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:06 smithi135 ceph-mon[18264]: osdmap e50: 8 total, 7 up, 8 in 2024-04-20T12:18:07.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:06 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:18:07.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:06 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:18:07.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:06 smithi135 ceph-mon[18264]: from='osd.7 ' entity='osd.7' 2024-04-20T12:18:07.718 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-20T12:18:07.719 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-20T12:18:07.719 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2024-04-20T12:18:07.719 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2024-04-20T12:18:07.719 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115162 s, 911 MB/s 2024-04-20T12:18:07.719 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2024-04-20T12:18:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:07 smithi139 ceph-mon[21834]: purged_snaps scrub starts 2024-04-20T12:18:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:07 smithi139 ceph-mon[21834]: purged_snaps scrub ok 2024-04-20T12:18:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:07 smithi139 ceph-mon[21834]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:07 smithi139 ceph-mon[21834]: osd.7 [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017] boot 2024-04-20T12:18:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:07 smithi139 ceph-mon[21834]: osdmap e51: 8 total, 8 up, 8 in 2024-04-20T12:18:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:07 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:18:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:07 smithi135 ceph-mon[18264]: purged_snaps scrub starts 2024-04-20T12:18:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:07 smithi135 ceph-mon[18264]: purged_snaps scrub ok 2024-04-20T12:18:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:07 smithi135 ceph-mon[18264]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:07 smithi135 ceph-mon[18264]: osd.7 [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017] boot 2024-04-20T12:18:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:07 smithi135 ceph-mon[18264]: osdmap e51: 8 total, 8 up, 8 in 2024-04-20T12:18:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:18:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:07 smithi154 ceph-mon[22073]: purged_snaps scrub starts 2024-04-20T12:18:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:07 smithi154 ceph-mon[22073]: purged_snaps scrub ok 2024-04-20T12:18:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:07 smithi154 ceph-mon[22073]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-04-20T12:18:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:07 smithi154 ceph-mon[22073]: osd.7 [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017] boot 2024-04-20T12:18:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:07 smithi154 ceph-mon[22073]: osdmap e51: 8 total, 8 up, 8 in 2024-04-20T12:18:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:07 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:18:08.368 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_2 2024-04-20T12:18:08.606 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:18:09.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:08 smithi154 ceph-mon[22073]: osdmap e52: 8 total, 8 up, 8 in 2024-04-20T12:18:09.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:08 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:09.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:08 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:09.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:08 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:09.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:08 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:09.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:08 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:09.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:08 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:09.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:08 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:09.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:08 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:18:09.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:08 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:08 smithi135 ceph-mon[18264]: osdmap e52: 8 total, 8 up, 8 in 2024-04-20T12:18:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:08 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:08 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:08 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:08 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:08 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:08 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:08 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:08 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:18:09.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:08 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:08 smithi139 ceph-mon[21834]: osdmap e52: 8 total, 8 up, 8 in 2024-04-20T12:18:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:08 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:08 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:08 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:08 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:08 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:08 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:08 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:08 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:18:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:08 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:10.100 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:09 smithi154 ceph-mon[22073]: Detected new or changed devices on smithi139 2024-04-20T12:18:10.101 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:09 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi139 to 5696M 2024-04-20T12:18:10.101 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:09 smithi154 ceph-mon[22073]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:10.101 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:09 smithi154 ceph-mon[22073]: osdmap e53: 8 total, 8 up, 8 in 2024-04-20T12:18:10.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:09 smithi135 ceph-mon[18264]: Detected new or changed devices on smithi139 2024-04-20T12:18:10.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:09 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi139 to 5696M 2024-04-20T12:18:10.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:09 smithi135 ceph-mon[18264]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:10.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:09 smithi135 ceph-mon[18264]: osdmap e53: 8 total, 8 up, 8 in 2024-04-20T12:18:10.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:09 smithi139 ceph-mon[21834]: Detected new or changed devices on smithi139 2024-04-20T12:18:10.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:09 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi139 to 5696M 2024-04-20T12:18:10.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:09 smithi139 ceph-mon[21834]: pgmap v178: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:10.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:09 smithi139 ceph-mon[21834]: osdmap e53: 8 total, 8 up, 8 in 2024-04-20T12:18:10.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.363+0000 7f177583f700 1 -- 172.21.15.154:0/3181677953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1770104650 msgr2=0x7f177010af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:18:10.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.363+0000 7f177583f700 1 --2- 172.21.15.154:0/3181677953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1770104650 0x7f177010af00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f176800b0a0 tx=0x7f176800b3b0 comp rx=0 tx=0).stop 2024-04-20T12:18:10.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.363+0000 7f177583f700 1 -- 172.21.15.154:0/3181677953 shutdown_connections 2024-04-20T12:18:10.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.363+0000 7f177583f700 1 --2- 172.21.15.154:0/3181677953 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1770104650 0x7f177010af00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:10.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.363+0000 7f177583f700 1 --2- 172.21.15.154:0/3181677953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1770102ab0 0x7f1770102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:10.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.363+0000 7f177583f700 1 --2- 172.21.15.154:0/3181677953 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770103cb0 0x7f1770104110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:10.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.363+0000 7f177583f700 1 -- 172.21.15.154:0/3181677953 >> 172.21.15.154:0/3181677953 conn(0x7f17700fe050 msgr2=0x7f1770100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:18:10.363 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.363+0000 7f177583f700 1 -- 172.21.15.154:0/3181677953 shutdown_connections 2024-04-20T12:18:10.364 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.363+0000 7f177583f700 1 -- 172.21.15.154:0/3181677953 wait complete. 2024-04-20T12:18:10.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f177583f700 1 Processor -- start 2024-04-20T12:18:10.365 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f177583f700 1 -- start start 2024-04-20T12:18:10.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f177583f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770102ab0 0x7f17700767f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:18:10.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f177583f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1770103cb0 0x7f1770074e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:18:10.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f177583f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1770104650 0x7f1770075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:18:10.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f177583f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f177010e680 con 0x7f1770104650 2024-04-20T12:18:10.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f177583f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f177010e500 con 0x7f1770102ab0 2024-04-20T12:18:10.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f177583f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f177010e800 con 0x7f1770103cb0 2024-04-20T12:18:10.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f17667fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1770103cb0 0x7f1770074e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:18:10.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f17667fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1770103cb0 0x7f1770074e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:56306/0 (socket says 172.21.15.154:56306) 2024-04-20T12:18:10.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f17667fc700 1 -- 172.21.15.154:0/566435006 learned_addr learned my addr 172.21.15.154:0/566435006 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-20T12:18:10.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f176effd700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770102ab0 0x7f17700767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:18:10.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f176f7fe700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1770104650 0x7f1770075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:18:10.366 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f17667fc700 1 -- 172.21.15.154:0/566435006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770102ab0 msgr2=0x7f17700767f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:18:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f17667fc700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770102ab0 0x7f17700767f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f17667fc700 1 -- 172.21.15.154:0/566435006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1770104650 msgr2=0x7f1770075380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:18:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f17667fc700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1770104650 0x7f1770075380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f17667fc700 1 -- 172.21.15.154:0/566435006 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17700758c0 con 0x7f1770103cb0 2024-04-20T12:18:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f176effd700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770102ab0 0x7f17700767f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:18:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.364+0000 7f176f7fe700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1770104650 0x7f1770075380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:18:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.365+0000 7f17667fc700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1770103cb0 0x7f1770074e40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f175800d980 tx=0x7f175800dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:18:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.365+0000 7f177483d700 1 -- 172.21.15.154:0/566435006 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1758016070 con 0x7f1770103cb0 2024-04-20T12:18:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.365+0000 7f177483d700 1 -- 172.21.15.154:0/566435006 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1758004500 con 0x7f1770103cb0 2024-04-20T12:18:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.365+0000 7f177583f700 1 -- 172.21.15.154:0/566435006 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1770075bb0 con 0x7f1770103cb0 2024-04-20T12:18:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.365+0000 7f177483d700 1 -- 172.21.15.154:0/566435006 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1758004d00 con 0x7f1770103cb0 2024-04-20T12:18:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.365+0000 7f177583f700 1 -- 172.21.15.154:0/566435006 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17701a76f0 con 0x7f1770103cb0 2024-04-20T12:18:10.367 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.366+0000 7f177583f700 1 -- 172.21.15.154:0/566435006 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1770069740 con 0x7f1770103cb0 2024-04-20T12:18:10.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.367+0000 7f177483d700 1 -- 172.21.15.154:0/566435006 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f175800bbf0 con 0x7f1770103cb0 2024-04-20T12:18:10.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.367+0000 7f177483d700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f175c0a3c40 0x7f175c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:18:10.368 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.368+0000 7f177483d700 1 -- 172.21.15.154:0/566435006 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5397+0+0 (secure 0 0 0) 0x7f17580cfba0 con 0x7f1770103cb0 2024-04-20T12:18:10.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.368+0000 7f176effd700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f175c0a3c40 0x7f175c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:18:10.369 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.368+0000 7f176effd700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f175c0a3c40 0x7f175c0a6100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1770103b10 tx=0x7f1760009670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:18:10.371 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.371+0000 7f177483d700 1 -- 172.21.15.154:0/566435006 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f175801f020 con 0x7f1770103cb0 2024-04-20T12:18:10.578 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:10.578+0000 7f177583f700 1 -- 172.21.15.154:0/566435006 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1770062e90 con 0x7f175c0a3c40 2024-04-20T12:18:11.193 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:10 smithi154 ceph-mon[22073]: osdmap e54: 8 total, 8 up, 8 in 2024-04-20T12:18:11.194 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:10 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:18:11.194 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:10 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:18:11.194 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:10 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:11.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:10 smithi139 ceph-mon[21834]: osdmap e54: 8 total, 8 up, 8 in 2024-04-20T12:18:11.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:10 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:18:11.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:10 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:18:11.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:10 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:11.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:10 smithi135 ceph-mon[18264]: osdmap e54: 8 total, 8 up, 8 in 2024-04-20T12:18:11.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:10 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:18:11.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:10 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:18:11.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:10 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:12.151 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:11 smithi154 ceph-mon[22073]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:18:12.151 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:11 smithi154 ceph-mon[22073]: pgmap v181: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:12.152 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:11 smithi154 ceph-mon[22073]: osdmap e55: 8 total, 8 up, 8 in 2024-04-20T12:18:12.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:11 smithi139 ceph-mon[21834]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:18:12.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:11 smithi139 ceph-mon[21834]: pgmap v181: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:12.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:11 smithi139 ceph-mon[21834]: osdmap e55: 8 total, 8 up, 8 in 2024-04-20T12:18:12.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:11 smithi135 ceph-mon[18264]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:18:12.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:11 smithi135 ceph-mon[18264]: pgmap v181: 1 pgs: 1 remapped; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:12.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:11 smithi135 ceph-mon[18264]: osdmap e55: 8 total, 8 up, 8 in 2024-04-20T12:18:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:13 smithi154 ceph-mon[22073]: pgmap v183: 1 pgs: 1 remapped; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:13 smithi154 ceph-mon[22073]: from='client.? 172.21.15.154:0/2894948356' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3afbaac4-d30b-401e-b363-174bb38023c2"}]: dispatch 2024-04-20T12:18:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:13 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3afbaac4-d30b-401e-b363-174bb38023c2"}]: dispatch 2024-04-20T12:18:14.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:13 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3afbaac4-d30b-401e-b363-174bb38023c2"}]': finished 2024-04-20T12:18:14.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:13 smithi154 ceph-mon[22073]: osdmap e56: 9 total, 8 up, 9 in 2024-04-20T12:18:14.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:13 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:14.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:13 smithi139 ceph-mon[21834]: pgmap v183: 1 pgs: 1 remapped; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:14.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:13 smithi139 ceph-mon[21834]: from='client.? 172.21.15.154:0/2894948356' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3afbaac4-d30b-401e-b363-174bb38023c2"}]: dispatch 2024-04-20T12:18:14.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:13 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3afbaac4-d30b-401e-b363-174bb38023c2"}]: dispatch 2024-04-20T12:18:14.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:13 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3afbaac4-d30b-401e-b363-174bb38023c2"}]': finished 2024-04-20T12:18:14.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:13 smithi139 ceph-mon[21834]: osdmap e56: 9 total, 8 up, 9 in 2024-04-20T12:18:14.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:13 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:14.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:13 smithi135 ceph-mon[18264]: pgmap v183: 1 pgs: 1 remapped; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:14.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:13 smithi135 ceph-mon[18264]: from='client.? 172.21.15.154:0/2894948356' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3afbaac4-d30b-401e-b363-174bb38023c2"}]: dispatch 2024-04-20T12:18:14.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:13 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3afbaac4-d30b-401e-b363-174bb38023c2"}]: dispatch 2024-04-20T12:18:14.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:13 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3afbaac4-d30b-401e-b363-174bb38023c2"}]': finished 2024-04-20T12:18:14.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:13 smithi135 ceph-mon[18264]: osdmap e56: 9 total, 8 up, 9 in 2024-04-20T12:18:14.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:14 smithi154 ceph-mon[22073]: from='client.? 172.21.15.154:0/47304786' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:18:15.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:14 smithi139 ceph-mon[21834]: from='client.? 172.21.15.154:0/47304786' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:18:15.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:14 smithi135 ceph-mon[18264]: from='client.? 172.21.15.154:0/47304786' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:18:16.152 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:15 smithi154 ceph-mon[22073]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:16.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:15 smithi139 ceph-mon[21834]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:16.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:15 smithi135 ceph-mon[18264]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:18.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:17 smithi154 ceph-mon[22073]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:18.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:17 smithi139 ceph-mon[21834]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:18.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:17 smithi135 ceph-mon[18264]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:20.216 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:19 smithi154 ceph-mon[22073]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:20.325 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:19 smithi139 ceph-mon[21834]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:20.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:19 smithi135 ceph-mon[18264]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:22.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:21 smithi154 ceph-mon[22073]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:22.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-20T12:18:22.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:21 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:22.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:21 smithi139 ceph-mon[21834]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:22.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:21 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-20T12:18:22.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:21 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:22.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:21 smithi135 ceph-mon[18264]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:22.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:21 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-04-20T12:18:22.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:21 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:23.154 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:22 smithi154 ceph-mon[22073]: Deploying daemon osd.8 on smithi154 2024-04-20T12:18:23.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:22 smithi139 ceph-mon[21834]: Deploying daemon osd.8 on smithi154 2024-04-20T12:18:23.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:22 smithi135 ceph-mon[18264]: Deploying daemon osd.8 on smithi154 2024-04-20T12:18:24.090 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:23 smithi154 ceph-mon[22073]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:24.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:23 smithi139 ceph-mon[21834]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:24.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:23 smithi135 ceph-mon[18264]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:25.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:24 smithi154 ceph-mon[22073]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:25.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:24 smithi139 ceph-mon[21834]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:25.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:24 smithi135 ceph-mon[18264]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:28.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:28.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:28.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:28.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:27 smithi154 ceph-mon[22073]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:28.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:28.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:28.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:28.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:27 smithi139 ceph-mon[21834]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:28.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:28.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:28.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:28.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:27 smithi135 ceph-mon[18264]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:30.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:29 smithi139 ceph-mon[21834]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:30.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:29 smithi135 ceph-mon[18264]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:30.160 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:29 smithi154 ceph-mon[22073]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:30.896 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:30.895+0000 7f177483d700 1 -- 172.21.15.154:0/566435006 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1770062e90 con 0x7f175c0a3c40 2024-04-20T12:18:30.896 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 8 on host 'smithi154' 2024-04-20T12:18:30.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:30.897+0000 7f177583f700 1 -- 172.21.15.154:0/566435006 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f175c0a3c40 msgr2=0x7f175c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:18:30.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:30.897+0000 7f177583f700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f175c0a3c40 0x7f175c0a6100 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1770103b10 tx=0x7f1760009670 comp rx=0 tx=0).stop 2024-04-20T12:18:30.897 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:30.897+0000 7f177583f700 1 -- 172.21.15.154:0/566435006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1770103cb0 msgr2=0x7f1770074e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:18:30.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:30.897+0000 7f177583f700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1770103cb0 0x7f1770074e40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f175800d980 tx=0x7f175800dd40 comp rx=0 tx=0).stop 2024-04-20T12:18:30.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:30.897+0000 7f177583f700 1 -- 172.21.15.154:0/566435006 shutdown_connections 2024-04-20T12:18:30.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:30.897+0000 7f177583f700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f175c0a3c40 0x7f175c0a6100 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:30.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:30.897+0000 7f177583f700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1770104650 0x7f1770075380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:30.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:30.897+0000 7f177583f700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1770102ab0 0x7f17700767f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:30.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:30.897+0000 7f177583f700 1 --2- 172.21.15.154:0/566435006 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1770103cb0 0x7f1770074e40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:30.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:30.897+0000 7f177583f700 1 -- 172.21.15.154:0/566435006 >> 172.21.15.154:0/566435006 conn(0x7f17700fe050 msgr2=0x7f1770106fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:18:30.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:30.897+0000 7f177583f700 1 -- 172.21.15.154:0/566435006 shutdown_connections 2024-04-20T12:18:30.898 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:18:30.897+0000 7f177583f700 1 -- 172.21.15.154:0/566435006 wait complete. 2024-04-20T12:18:31.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:31.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:31.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:31.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:18:31.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:31.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:31 smithi135 ceph-mon[18264]: from='osd.8 [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-20T12:18:31.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:31 smithi135 ceph-mon[18264]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-20T12:18:31.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:31 smithi135 ceph-mon[18264]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:31.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:31.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:31.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:31.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:31.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:31.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:31.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:18:31.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:31.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:31 smithi154 ceph-mon[22073]: from='osd.8 [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-20T12:18:31.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:31 smithi154 ceph-mon[22073]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-20T12:18:31.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:31 smithi154 ceph-mon[22073]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:31.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:31.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:31.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:31.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:31.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:31.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:31.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:18:31.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:31.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:31 smithi139 ceph-mon[21834]: from='osd.8 [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-20T12:18:31.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:31 smithi139 ceph-mon[21834]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-04-20T12:18:31.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:31 smithi139 ceph-mon[21834]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:31.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:31.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:31.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:31.607 DEBUG:teuthology.orchestra.run.smithi154:osd.8> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.8.service 2024-04-20T12:18:31.609 INFO:tasks.cephadm:Deploying osd.9 on smithi135 with /dev/vg_nvme/lv_1... 2024-04-20T12:18:31.609 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-20T12:18:31.857 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:18:32.237 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:32 smithi135 ceph-mon[18264]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-20T12:18:32.237 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:32 smithi135 ceph-mon[18264]: osdmap e57: 9 total, 8 up, 9 in 2024-04-20T12:18:32.237 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:32 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:32.237 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:32 smithi135 ceph-mon[18264]: from='osd.8 [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:18:32.237 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:32 smithi135 ceph-mon[18264]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:18:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:32 smithi154 ceph-mon[22073]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-20T12:18:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:32 smithi154 ceph-mon[22073]: osdmap e57: 9 total, 8 up, 9 in 2024-04-20T12:18:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:32 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:32 smithi154 ceph-mon[22073]: from='osd.8 [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:18:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:32 smithi154 ceph-mon[22073]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:18:32.252 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:18:32 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:18:32.125+0000 7f247eb51700 -1 osd.8 0 waiting for initial osdmap 2024-04-20T12:18:32.252 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:18:32 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:18:32.134+0000 7f247a944700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T12:18:32.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:32 smithi139 ceph-mon[21834]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-04-20T12:18:32.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:32 smithi139 ceph-mon[21834]: osdmap e57: 9 total, 8 up, 9 in 2024-04-20T12:18:32.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:32 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:32.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:32 smithi139 ceph-mon[21834]: from='osd.8 [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:18:32.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:32 smithi139 ceph-mon[21834]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:18:33.128 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:33 smithi154 ceph-mon[22073]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-04-20T12:18:33.128 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:33 smithi154 ceph-mon[22073]: osdmap e58: 9 total, 8 up, 9 in 2024-04-20T12:18:33.128 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:33 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:33.128 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:33 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:33.128 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:33 smithi154 ceph-mon[22073]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:33.305 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:33 smithi135 ceph-mon[18264]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-04-20T12:18:33.305 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:33 smithi135 ceph-mon[18264]: osdmap e58: 9 total, 8 up, 9 in 2024-04-20T12:18:33.305 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:33 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:33.306 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:33 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:33.306 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:33 smithi135 ceph-mon[18264]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:33.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:33 smithi139 ceph-mon[21834]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-04-20T12:18:33.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:33 smithi139 ceph-mon[21834]: osdmap e58: 9 total, 8 up, 9 in 2024-04-20T12:18:33.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:33 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:33.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:33 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:33.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:33 smithi139 ceph-mon[21834]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-04-20T12:18:34.011 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-20T12:18:34.012 INFO:teuthology.orchestra.run.smithi135.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-20T12:18:34.012 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10+0 records in 2024-04-20T12:18:34.012 INFO:teuthology.orchestra.run.smithi135.stderr:10+0 records out 2024-04-20T12:18:34.012 INFO:teuthology.orchestra.run.smithi135.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128006 s, 819 MB/s 2024-04-20T12:18:34.012 INFO:teuthology.orchestra.run.smithi135.stderr:--> Zapping successful for: 2024-04-20T12:18:34.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:34 smithi154 ceph-mon[22073]: purged_snaps scrub starts 2024-04-20T12:18:34.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:34 smithi154 ceph-mon[22073]: purged_snaps scrub ok 2024-04-20T12:18:34.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:34 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:34.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:34 smithi154 ceph-mon[22073]: osd.8 [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018] boot 2024-04-20T12:18:34.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:34 smithi154 ceph-mon[22073]: osdmap e59: 9 total, 9 up, 9 in 2024-04-20T12:18:34.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:34 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:34.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:34 smithi154 ceph-mon[22073]: osdmap e60: 9 total, 9 up, 9 in 2024-04-20T12:18:34.315 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:34 smithi135 ceph-mon[18264]: purged_snaps scrub starts 2024-04-20T12:18:34.315 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:34 smithi135 ceph-mon[18264]: purged_snaps scrub ok 2024-04-20T12:18:34.315 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:34 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:34.315 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:34 smithi135 ceph-mon[18264]: osd.8 [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018] boot 2024-04-20T12:18:34.315 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:34 smithi135 ceph-mon[18264]: osdmap e59: 9 total, 9 up, 9 in 2024-04-20T12:18:34.315 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:34 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:34.315 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:34 smithi135 ceph-mon[18264]: osdmap e60: 9 total, 9 up, 9 in 2024-04-20T12:18:34.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:34 smithi139 ceph-mon[21834]: purged_snaps scrub starts 2024-04-20T12:18:34.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:34 smithi139 ceph-mon[21834]: purged_snaps scrub ok 2024-04-20T12:18:34.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:34 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:34.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:34 smithi139 ceph-mon[21834]: osd.8 [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018] boot 2024-04-20T12:18:34.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:34 smithi139 ceph-mon[21834]: osdmap e59: 9 total, 9 up, 9 in 2024-04-20T12:18:34.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:34 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:18:34.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:34 smithi139 ceph-mon[21834]: osdmap e60: 9 total, 9 up, 9 in 2024-04-20T12:18:34.721 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_1 2024-04-20T12:18:34.974 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:18:35.354 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:35 smithi135 ceph-mon[18264]: osdmap e61: 9 total, 9 up, 9 in 2024-04-20T12:18:35.354 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:35 smithi135 ceph-mon[18264]: Detected new or changed devices on smithi154 2024-04-20T12:18:35.354 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:35.354 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:35 smithi135 ceph-mon[18264]: pgmap v200: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:35.354 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:35.354 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:35.354 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:35.354 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:35.354 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:35 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi154 to 5696M 2024-04-20T12:18:35.354 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:35.354 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:35.355 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:18:35.355 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:35 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:35.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:35 smithi139 ceph-mon[21834]: osdmap e61: 9 total, 9 up, 9 in 2024-04-20T12:18:35.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:35 smithi139 ceph-mon[21834]: Detected new or changed devices on smithi154 2024-04-20T12:18:35.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:35.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:35 smithi139 ceph-mon[21834]: pgmap v200: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:35.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:35.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:35.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:35.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:35.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:35 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi154 to 5696M 2024-04-20T12:18:35.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:35.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:35.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:18:35.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:35 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:35.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:35 smithi154 ceph-mon[22073]: osdmap e61: 9 total, 9 up, 9 in 2024-04-20T12:18:35.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:35 smithi154 ceph-mon[22073]: Detected new or changed devices on smithi154 2024-04-20T12:18:35.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:35.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:35 smithi154 ceph-mon[22073]: pgmap v200: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:35.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:35.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:35.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:35.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:18:35.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:35 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi154 to 5696M 2024-04-20T12:18:35.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:35.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:35.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:18:35.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:35 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:36.448 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:36 smithi135 ceph-mon[18264]: osdmap e62: 9 total, 9 up, 9 in 2024-04-20T12:18:36.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:36 smithi139 ceph-mon[21834]: osdmap e62: 9 total, 9 up, 9 in 2024-04-20T12:18:36.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.685+0000 7fc26c249700 1 -- 172.21.15.135:0/3171246892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc264103560 msgr2=0x7fc264109e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:18:36.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.685+0000 7fc26c249700 1 --2- 172.21.15.135:0/3171246892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc264103560 0x7fc264109e10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc25c00b0d0 tx=0x7fc25c00b3e0 comp rx=0 tx=0).stop 2024-04-20T12:18:36.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.685+0000 7fc26c249700 1 -- 172.21.15.135:0/3171246892 shutdown_connections 2024-04-20T12:18:36.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.685+0000 7fc26c249700 1 --2- 172.21.15.135:0/3171246892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc264103560 0x7fc264109e10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:36.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.685+0000 7fc26c249700 1 --2- 172.21.15.135:0/3171246892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2641019c0 0x7fc264101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:36.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.685+0000 7fc26c249700 1 --2- 172.21.15.135:0/3171246892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc264102bc0 0x7fc264103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:36.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.685+0000 7fc26c249700 1 -- 172.21.15.135:0/3171246892 >> 172.21.15.135:0/3171246892 conn(0x7fc2640fcf80 msgr2=0x7fc2640ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:18:36.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.685+0000 7fc26c249700 1 -- 172.21.15.135:0/3171246892 shutdown_connections 2024-04-20T12:18:36.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.685+0000 7fc26c249700 1 -- 172.21.15.135:0/3171246892 wait complete. 2024-04-20T12:18:36.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc26c249700 1 Processor -- start 2024-04-20T12:18:36.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc26c249700 1 -- start start 2024-04-20T12:18:36.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc26c249700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2641019c0 0x7fc26419ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:18:36.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc26c249700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc264102bc0 0x7fc26419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:18:36.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc26c249700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc264103560 0x7fc2641a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:18:36.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc26c249700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2641108a0 con 0x7fc264102bc0 2024-04-20T12:18:36.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc26c249700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc264110720 con 0x7fc264103560 2024-04-20T12:18:36.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc26c249700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc264110a20 con 0x7fc2641019c0 2024-04-20T12:18:36.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc2697e4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc264102bc0 0x7fc26419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:18:36.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc2697e4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc264102bc0 0x7fc26419b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59434/0 (socket says 172.21.15.135:59434) 2024-04-20T12:18:36.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc2697e4700 1 -- 172.21.15.135:0/1020259591 learned_addr learned my addr 172.21.15.135:0/1020259591 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:18:36.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc269fe5700 1 --2- 172.21.15.135:0/1020259591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2641019c0 0x7fc26419ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:18:36.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc26a7e6700 1 --2- 172.21.15.135:0/1020259591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc264103560 0x7fc2641a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:18:36.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc2697e4700 1 -- 172.21.15.135:0/1020259591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2641019c0 msgr2=0x7fc26419ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:18:36.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc2697e4700 1 --2- 172.21.15.135:0/1020259591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2641019c0 0x7fc26419ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:36.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc2697e4700 1 -- 172.21.15.135:0/1020259591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc264103560 msgr2=0x7fc2641a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:18:36.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc2697e4700 1 --2- 172.21.15.135:0/1020259591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc264103560 0x7fc2641a23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:36.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc2697e4700 1 -- 172.21.15.135:0/1020259591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2641a2a80 con 0x7fc264102bc0 2024-04-20T12:18:36.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.686+0000 7fc26a7e6700 1 --2- 172.21.15.135:0/1020259591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc264103560 0x7fc2641a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:18:36.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.687+0000 7fc2697e4700 1 --2- 172.21.15.135:0/1020259591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc264102bc0 0x7fc26419b360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc25400c9e0 tx=0x7fc25400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:18:36.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.687+0000 7fc25affd700 1 -- 172.21.15.135:0/1020259591 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254007ac0 con 0x7fc264102bc0 2024-04-20T12:18:36.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.687+0000 7fc26c249700 1 -- 172.21.15.135:0/1020259591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2641a2d70 con 0x7fc264102bc0 2024-04-20T12:18:36.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.687+0000 7fc25affd700 1 -- 172.21.15.135:0/1020259591 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc254007c60 con 0x7fc264102bc0 2024-04-20T12:18:36.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.687+0000 7fc25affd700 1 -- 172.21.15.135:0/1020259591 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254018730 con 0x7fc264102bc0 2024-04-20T12:18:36.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.687+0000 7fc26c249700 1 -- 172.21.15.135:0/1020259591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2641a3270 con 0x7fc264102bc0 2024-04-20T12:18:36.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.688+0000 7fc26c249700 1 -- 172.21.15.135:0/1020259591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc26402df90 con 0x7fc264102bc0 2024-04-20T12:18:36.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.689+0000 7fc25affd700 1 -- 172.21.15.135:0/1020259591 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fc2540188d0 con 0x7fc264102bc0 2024-04-20T12:18:36.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.689+0000 7fc25affd700 1 --2- 172.21.15.135:0/1020259591 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc2500a3c20 0x7fc2500a60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:18:36.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.689+0000 7fc269fe5700 1 --2- 172.21.15.135:0/1020259591 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc2500a3c20 0x7fc2500a60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:18:36.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.690+0000 7fc25affd700 1 -- 172.21.15.135:0/1020259591 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5829+0+0 (secure 0 0 0) 0x7fc2540cfa30 con 0x7fc264102bc0 2024-04-20T12:18:36.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.690+0000 7fc269fe5700 1 --2- 172.21.15.135:0/1020259591 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc2500a3c20 0x7fc2500a60e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc260005950 tx=0x7fc26000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:18:36.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.694+0000 7fc25affd700 1 -- 172.21.15.135:0/1020259591 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fc254014030 con 0x7fc264102bc0 2024-04-20T12:18:36.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:36 smithi154 ceph-mon[22073]: osdmap e62: 9 total, 9 up, 9 in 2024-04-20T12:18:36.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:36.906+0000 7fc26c249700 1 -- 172.21.15.135:0/1020259591 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc264062e90 con 0x7fc2500a3c20 2024-04-20T12:18:37.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:37 smithi139 ceph-mon[21834]: osdmap e63: 9 total, 9 up, 9 in 2024-04-20T12:18:37.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:37 smithi139 ceph-mon[21834]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:37.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:18:37.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:18:37.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:37.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:37 smithi135 ceph-mon[18264]: osdmap e63: 9 total, 9 up, 9 in 2024-04-20T12:18:37.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:37 smithi135 ceph-mon[18264]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:37.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:18:37.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:18:37.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:37.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:37 smithi154 ceph-mon[22073]: osdmap e63: 9 total, 9 up, 9 in 2024-04-20T12:18:37.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:37 smithi154 ceph-mon[22073]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:37.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:18:37.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:18:37.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:38.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:38 smithi139 ceph-mon[21834]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:18:38.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:38 smithi135 ceph-mon[18264]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:18:38.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:38 smithi154 ceph-mon[22073]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:18:39.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:39 smithi139 ceph-mon[21834]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-04-20T12:18:39.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:39 smithi135 ceph-mon[18264]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-04-20T12:18:39.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:39 smithi154 ceph-mon[22073]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-04-20T12:18:40.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:40 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2633807911' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4f7257b-a6c1-47df-af14-ef8a5cdab68e"}]: dispatch 2024-04-20T12:18:40.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:40 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2633807911' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4f7257b-a6c1-47df-af14-ef8a5cdab68e"}]': finished 2024-04-20T12:18:40.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:40 smithi139 ceph-mon[21834]: osdmap e64: 10 total, 9 up, 10 in 2024-04-20T12:18:40.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:40 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:18:40.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:40 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2633807911' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4f7257b-a6c1-47df-af14-ef8a5cdab68e"}]: dispatch 2024-04-20T12:18:40.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:40 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2633807911' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4f7257b-a6c1-47df-af14-ef8a5cdab68e"}]': finished 2024-04-20T12:18:40.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:40 smithi135 ceph-mon[18264]: osdmap e64: 10 total, 9 up, 10 in 2024-04-20T12:18:40.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:40 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:18:40.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:40 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2633807911' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4f7257b-a6c1-47df-af14-ef8a5cdab68e"}]: dispatch 2024-04-20T12:18:40.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:40 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2633807911' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4f7257b-a6c1-47df-af14-ef8a5cdab68e"}]': finished 2024-04-20T12:18:40.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:40 smithi154 ceph-mon[22073]: osdmap e64: 10 total, 9 up, 10 in 2024-04-20T12:18:40.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:40 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:18:41.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:41 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2379621125' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:18:41.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:41 smithi139 ceph-mon[21834]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-20T12:18:41.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:41 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2379621125' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:18:41.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:41 smithi135 ceph-mon[18264]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-20T12:18:41.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:41 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2379621125' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:18:41.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:41 smithi154 ceph-mon[22073]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-04-20T12:18:44.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:43 smithi139 ceph-mon[21834]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-04-20T12:18:44.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:43 smithi135 ceph-mon[18264]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-04-20T12:18:44.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:43 smithi154 ceph-mon[22073]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-04-20T12:18:46.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:45 smithi135 ceph-mon[18264]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-04-20T12:18:46.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:45 smithi154 ceph-mon[22073]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-04-20T12:18:46.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:45 smithi139 ceph-mon[21834]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-04-20T12:18:47.834 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:47 smithi135 ceph-mon[18264]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-20T12:18:47.834 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:47 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-20T12:18:47.834 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:47 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:48.132 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:47 smithi139 ceph-mon[21834]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-20T12:18:48.132 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:47 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-20T12:18:48.132 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:47 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:48.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:47 smithi154 ceph-mon[22073]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-20T12:18:48.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:47 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-04-20T12:18:48.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:47 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:49.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:48 smithi135 ceph-mon[18264]: Deploying daemon osd.9 on smithi135 2024-04-20T12:18:49.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:48 smithi154 ceph-mon[22073]: Deploying daemon osd.9 on smithi135 2024-04-20T12:18:49.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:48 smithi139 ceph-mon[21834]: Deploying daemon osd.9 on smithi135 2024-04-20T12:18:49.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:49 smithi135 ceph-mon[18264]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:50.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:49 smithi154 ceph-mon[22073]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:50.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:49 smithi139 ceph-mon[21834]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:52.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:51 smithi135 ceph-mon[18264]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:52.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:51 smithi154 ceph-mon[22073]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:52.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:51 smithi139 ceph-mon[21834]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:54.052 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:53 smithi135 ceph-mon[18264]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:54.052 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:54.052 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:54.052 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:54.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:53 smithi154 ceph-mon[22073]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:54.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:54.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:54.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:54.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:53 smithi139 ceph-mon[21834]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:54.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:54.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:54.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:56.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:55 smithi135 ceph-mon[18264]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:56.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:55 smithi154 ceph-mon[22073]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:56.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:55 smithi139 ceph-mon[21834]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:57.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:57.315+0000 7fc25affd700 1 -- 172.21.15.135:0/1020259591 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc264062e90 con 0x7fc2500a3c20 2024-04-20T12:18:57.316 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 9 on host 'smithi135' 2024-04-20T12:18:57.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:57.317+0000 7fc26c249700 1 -- 172.21.15.135:0/1020259591 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc2500a3c20 msgr2=0x7fc2500a60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:18:57.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:57.317+0000 7fc26c249700 1 --2- 172.21.15.135:0/1020259591 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc2500a3c20 0x7fc2500a60e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc260005950 tx=0x7fc26000a300 comp rx=0 tx=0).stop 2024-04-20T12:18:57.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:57.317+0000 7fc26c249700 1 -- 172.21.15.135:0/1020259591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc264102bc0 msgr2=0x7fc26419b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:18:57.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:57.317+0000 7fc26c249700 1 --2- 172.21.15.135:0/1020259591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc264102bc0 0x7fc26419b360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc25400c9e0 tx=0x7fc25400ccf0 comp rx=0 tx=0).stop 2024-04-20T12:18:57.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:57.318+0000 7fc26c249700 1 -- 172.21.15.135:0/1020259591 shutdown_connections 2024-04-20T12:18:57.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:57.318+0000 7fc26c249700 1 --2- 172.21.15.135:0/1020259591 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc2500a3c20 0x7fc2500a60e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:57.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:57.318+0000 7fc26c249700 1 --2- 172.21.15.135:0/1020259591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc264103560 0x7fc2641a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:57.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:57.318+0000 7fc26c249700 1 --2- 172.21.15.135:0/1020259591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2641019c0 0x7fc26419ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:57.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:57.318+0000 7fc26c249700 1 --2- 172.21.15.135:0/1020259591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc264102bc0 0x7fc26419b360 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:18:57.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:57.318+0000 7fc26c249700 1 -- 172.21.15.135:0/1020259591 >> 172.21.15.135:0/1020259591 conn(0x7fc2640fcf80 msgr2=0x7fc264105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:18:57.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:57.318+0000 7fc26c249700 1 -- 172.21.15.135:0/1020259591 shutdown_connections 2024-04-20T12:18:57.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:18:57.318+0000 7fc26c249700 1 -- 172.21.15.135:0/1020259591 wait complete. 2024-04-20T12:18:57.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:57 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:57.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:57 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:57.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:57 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:57.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:57 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:18:57.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:57 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:57.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:57 smithi135 ceph-mon[18264]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:57.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:57 smithi135 ceph-mon[18264]: from='osd.9 [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-20T12:18:57.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:57 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:57.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:57 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:57.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:57 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:57.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:57 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:57.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:57 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:57.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:57 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:57.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:57 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:18:57.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:57 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:57.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:57 smithi154 ceph-mon[22073]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:57.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:57 smithi154 ceph-mon[22073]: from='osd.9 [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-20T12:18:57.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:57 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:57.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:57 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:57.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:57 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:57.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:57 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:57.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:57 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:57.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:57 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:18:57.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:57 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:18:57.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:57 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:57.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:57 smithi139 ceph-mon[21834]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:57.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:57 smithi139 ceph-mon[21834]: from='osd.9 [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-04-20T12:18:57.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:57 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:57.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:57 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:18:57.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:57 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:18:57.971 DEBUG:teuthology.orchestra.run.smithi135:osd.9> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.9.service 2024-04-20T12:18:57.980 INFO:tasks.cephadm:Deploying osd.10 on smithi139 with /dev/vg_nvme/lv_1... 2024-04-20T12:18:57.981 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-20T12:18:58.227 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.b/config 2024-04-20T12:18:58.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:58 smithi135 ceph-mon[18264]: from='osd.9 [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-20T12:18:58.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:58 smithi135 ceph-mon[18264]: osdmap e65: 10 total, 9 up, 10 in 2024-04-20T12:18:58.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:58 smithi135 ceph-mon[18264]: from='osd.9 [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-20T12:18:58.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:58 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:18:58.614 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:18:58 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:18:58.436+0000 7f5e52ff4700 -1 osd.9 0 waiting for initial osdmap 2024-04-20T12:18:58.614 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:18:58 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:18:58.451+0000 7f5e4ede7700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T12:18:58.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:58 smithi139 ceph-mon[21834]: from='osd.9 [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-20T12:18:58.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:58 smithi139 ceph-mon[21834]: osdmap e65: 10 total, 9 up, 10 in 2024-04-20T12:18:58.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:58 smithi139 ceph-mon[21834]: from='osd.9 [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-20T12:18:58.626 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:58 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:18:58.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:58 smithi154 ceph-mon[22073]: from='osd.9 [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-04-20T12:18:58.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:58 smithi154 ceph-mon[22073]: osdmap e65: 10 total, 9 up, 10 in 2024-04-20T12:18:58.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:58 smithi154 ceph-mon[22073]: from='osd.9 [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]: dispatch 2024-04-20T12:18:58.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:58 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:18:59.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:59 smithi139 ceph-mon[21834]: from='osd.9 [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-20T12:18:59.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:59 smithi139 ceph-mon[21834]: osdmap e66: 10 total, 9 up, 10 in 2024-04-20T12:18:59.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:59 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:18:59.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:59 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:18:59.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:18:59 smithi139 ceph-mon[21834]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:59.701 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:59 smithi135 ceph-mon[18264]: from='osd.9 [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-20T12:18:59.701 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:59 smithi135 ceph-mon[18264]: osdmap e66: 10 total, 9 up, 10 in 2024-04-20T12:18:59.701 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:59 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:18:59.701 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:59 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:18:59.701 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:18:59 smithi135 ceph-mon[18264]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:18:59.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:59 smithi154 ceph-mon[22073]: from='osd.9 [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-04-20T12:18:59.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:59 smithi154 ceph-mon[22073]: osdmap e66: 10 total, 9 up, 10 in 2024-04-20T12:18:59.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:59 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:18:59.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:59 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:18:59.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:18:59 smithi154 ceph-mon[22073]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-04-20T12:19:00.186 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-20T12:19:00.187 INFO:teuthology.orchestra.run.smithi139.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-20T12:19:00.187 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10+0 records in 2024-04-20T12:19:00.187 INFO:teuthology.orchestra.run.smithi139.stderr:10+0 records out 2024-04-20T12:19:00.187 INFO:teuthology.orchestra.run.smithi139.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111839 s, 938 MB/s 2024-04-20T12:19:00.187 INFO:teuthology.orchestra.run.smithi139.stderr:--> Zapping successful for: 2024-04-20T12:19:00.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:00 smithi135 ceph-mon[18264]: purged_snaps scrub starts 2024-04-20T12:19:00.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:00 smithi135 ceph-mon[18264]: purged_snaps scrub ok 2024-04-20T12:19:00.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:00 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:19:00.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:00 smithi135 ceph-mon[18264]: osd.9 [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376] boot 2024-04-20T12:19:00.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:00 smithi135 ceph-mon[18264]: osdmap e67: 10 total, 10 up, 10 in 2024-04-20T12:19:00.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:00 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:19:00.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:00 smithi154 ceph-mon[22073]: purged_snaps scrub starts 2024-04-20T12:19:00.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:00 smithi154 ceph-mon[22073]: purged_snaps scrub ok 2024-04-20T12:19:00.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:00 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:19:00.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:00 smithi154 ceph-mon[22073]: osd.9 [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376] boot 2024-04-20T12:19:00.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:00 smithi154 ceph-mon[22073]: osdmap e67: 10 total, 10 up, 10 in 2024-04-20T12:19:00.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:00 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:19:00.822 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:00 smithi139 ceph-mon[21834]: purged_snaps scrub starts 2024-04-20T12:19:00.822 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:00 smithi139 ceph-mon[21834]: purged_snaps scrub ok 2024-04-20T12:19:00.822 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:00 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:19:00.823 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:00 smithi139 ceph-mon[21834]: osd.9 [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376] boot 2024-04-20T12:19:00.823 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:00 smithi139 ceph-mon[21834]: osdmap e67: 10 total, 10 up, 10 in 2024-04-20T12:19:00.823 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:00 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:19:00.851 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi139:vg_nvme/lv_1 2024-04-20T12:19:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.b/config 2024-04-20T12:19:01.467 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:01 smithi139 ceph-mon[21834]: osdmap e68: 10 total, 10 up, 10 in 2024-04-20T12:19:01.468 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:01 smithi139 ceph-mon[21834]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:01.468 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:01.468 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:01.468 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:01.468 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:01.468 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:01.468 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:01.468 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:01.468 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:01.468 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:19:01.468 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:01.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:01 smithi154 ceph-mon[22073]: osdmap e68: 10 total, 10 up, 10 in 2024-04-20T12:19:01.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:01 smithi154 ceph-mon[22073]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:01.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:01.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:01.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:01.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:01.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:01.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:01.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:01.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:01.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:19:01.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:01.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:01 smithi135 ceph-mon[18264]: osdmap e68: 10 total, 10 up, 10 in 2024-04-20T12:19:01.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:01 smithi135 ceph-mon[18264]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:01.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:01.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:01.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:01.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:01.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:01.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:01.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:01.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:01.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:19:01.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:02.643 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:02 smithi139 ceph-mon[21834]: Detected new or changed devices on smithi135 2024-04-20T12:19:02.643 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:02 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi135 to 4272M 2024-04-20T12:19:02.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:02 smithi154 ceph-mon[22073]: Detected new or changed devices on smithi135 2024-04-20T12:19:02.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:02 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi135 to 4272M 2024-04-20T12:19:02.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:02 smithi135 ceph-mon[18264]: Detected new or changed devices on smithi135 2024-04-20T12:19:02.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:02 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi135 to 4272M 2024-04-20T12:19:02.901 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.901+0000 7f3a46346700 1 -- 172.21.15.139:0/1077735393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a40076a00 msgr2=0x7f3a40074e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:02.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.901+0000 7f3a46346700 1 --2- 172.21.15.139:0/1077735393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a40076a00 0x7f3a40074e60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009990 tx=0x7f3a30009ca0 comp rx=0 tx=0).stop 2024-04-20T12:19:02.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.901+0000 7f3a46346700 1 -- 172.21.15.139:0/1077735393 shutdown_connections 2024-04-20T12:19:02.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.901+0000 7f3a46346700 1 --2- 172.21.15.139:0/1077735393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a4010a9e0 0x7f3a4010ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:02.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.901+0000 7f3a46346700 1 --2- 172.21.15.139:0/1077735393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a40076a00 0x7f3a40074e60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:02.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.901+0000 7f3a46346700 1 --2- 172.21.15.139:0/1077735393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a40075430 0x7f3a400758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:02.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.901+0000 7f3a46346700 1 -- 172.21.15.139:0/1077735393 >> 172.21.15.139:0/1077735393 conn(0x7f3a400fe0a0 msgr2=0x7f3a401004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:19:02.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.901+0000 7f3a46346700 1 -- 172.21.15.139:0/1077735393 shutdown_connections 2024-04-20T12:19:02.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.901+0000 7f3a46346700 1 -- 172.21.15.139:0/1077735393 wait complete. 2024-04-20T12:19:02.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.902+0000 7f3a46346700 1 Processor -- start 2024-04-20T12:19:02.902 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.902+0000 7f3a46346700 1 -- start start 2024-04-20T12:19:02.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.902+0000 7f3a46346700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a40075430 0x7f3a4019af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:02.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.902+0000 7f3a46346700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a40076a00 0x7f3a4019b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:02.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.902+0000 7f3a46346700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a4010a9e0 0x7f3a401a24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:02.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.902+0000 7f3a46346700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a40110900 con 0x7f3a4010a9e0 2024-04-20T12:19:02.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.902+0000 7f3a46346700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3a40110780 con 0x7f3a40076a00 2024-04-20T12:19:02.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.902+0000 7f3a46346700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a40110a80 con 0x7f3a40075430 2024-04-20T12:19:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.902+0000 7f3a3f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a40076a00 0x7f3a4019b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.902+0000 7f3a3f7fe700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a40076a00 0x7f3a4019b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.139:51804/0 (socket says 172.21.15.139:51804) 2024-04-20T12:19:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.902+0000 7f3a3f7fe700 1 -- 172.21.15.139:0/2390472363 learned_addr learned my addr 172.21.15.139:0/2390472363 (peer_addr_for_me v2:172.21.15.139:0/0) 2024-04-20T12:19:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.902+0000 7f3a3ffff700 1 --2- 172.21.15.139:0/2390472363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a40075430 0x7f3a4019af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.903+0000 7f3a448e3700 1 --2- 172.21.15.139:0/2390472363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a4010a9e0 0x7f3a401a24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.903+0000 7f3a3f7fe700 1 -- 172.21.15.139:0/2390472363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a40075430 msgr2=0x7f3a4019af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.903+0000 7f3a3f7fe700 1 --2- 172.21.15.139:0/2390472363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a40075430 0x7f3a4019af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.903+0000 7f3a3f7fe700 1 -- 172.21.15.139:0/2390472363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a4010a9e0 msgr2=0x7f3a401a24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.903+0000 7f3a3f7fe700 1 --2- 172.21.15.139:0/2390472363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a4010a9e0 0x7f3a401a24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.903+0000 7f3a3f7fe700 1 -- 172.21.15.139:0/2390472363 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a401a2b60 con 0x7f3a40076a00 2024-04-20T12:19:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.903+0000 7f3a3f7fe700 1 --2- 172.21.15.139:0/2390472363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a40076a00 0x7f3a4019b440 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400b530 tx=0x7f3a3400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:19:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.903+0000 7f3a3d7fa700 1 -- 172.21.15.139:0/2390472363 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a34015020 con 0x7f3a40076a00 2024-04-20T12:19:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.903+0000 7f3a3d7fa700 1 -- 172.21.15.139:0/2390472363 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a34011d10 con 0x7f3a40076a00 2024-04-20T12:19:02.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.903+0000 7f3a46346700 1 -- 172.21.15.139:0/2390472363 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a401a2e50 con 0x7f3a40076a00 2024-04-20T12:19:02.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.903+0000 7f3a3d7fa700 1 -- 172.21.15.139:0/2390472363 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3400f2e0 con 0x7f3a40076a00 2024-04-20T12:19:02.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.903+0000 7f3a46346700 1 -- 172.21.15.139:0/2390472363 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a401a3380 con 0x7f3a40076a00 2024-04-20T12:19:02.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.904+0000 7f3a46346700 1 -- 172.21.15.139:0/2390472363 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a40069740 con 0x7f3a40076a00 2024-04-20T12:19:02.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.906+0000 7f3a3d7fa700 1 -- 172.21.15.139:0/2390472363 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f3a34018020 con 0x7f3a40076a00 2024-04-20T12:19:02.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.906+0000 7f3a3d7fa700 1 --2- 172.21.15.139:0/2390472363 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3a280a3cc0 0x7f3a280a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:02.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.906+0000 7f3a3d7fa700 1 -- 172.21.15.139:0/2390472363 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6261+0+0 (secure 0 0 0) 0x7f3a340cf930 con 0x7f3a40076a00 2024-04-20T12:19:02.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.907+0000 7f3a3ffff700 1 --2- 172.21.15.139:0/2390472363 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3a280a3cc0 0x7f3a280a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:02.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.907+0000 7f3a3ffff700 1 --2- 172.21.15.139:0/2390472363 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3a280a3cc0 0x7f3a280a6180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000b5c0 tx=0x7f3a30005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:19:02.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:02.910+0000 7f3a3d7fa700 1 -- 172.21.15.139:0/2390472363 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f3a3401f020 con 0x7f3a40076a00 2024-04-20T12:19:03.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:03.114+0000 7f3a46346700 1 -- 172.21.15.139:0/2390472363 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3a40062e90 con 0x7f3a280a3cc0 2024-04-20T12:19:03.724 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:03 smithi139 ceph-mon[21834]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:03.724 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:03 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:19:03.724 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:03 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:19:03.724 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:03 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:03.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:03 smithi154 ceph-mon[22073]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:03.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:03 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:19:03.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:03 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:19:03.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:03 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:03.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:03 smithi135 ceph-mon[18264]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:03.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:19:03.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:19:03.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:03 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:04.716 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:04 smithi139 ceph-mon[21834]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:19:04.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:04 smithi154 ceph-mon[22073]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:19:04.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:04 smithi135 ceph-mon[18264]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi139:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:19:05.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:05 smithi154 ceph-mon[22073]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:05.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:05 smithi139 ceph-mon[21834]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:05.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:05 smithi135 ceph-mon[18264]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:06.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:06 smithi154 ceph-mon[22073]: from='client.? 172.21.15.139:0/390544661' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5be0ab8c-4f88-4d25-b656-d40245b76d01"}]: dispatch 2024-04-20T12:19:06.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:06 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5be0ab8c-4f88-4d25-b656-d40245b76d01"}]: dispatch 2024-04-20T12:19:06.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:06 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5be0ab8c-4f88-4d25-b656-d40245b76d01"}]': finished 2024-04-20T12:19:06.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:06 smithi154 ceph-mon[22073]: osdmap e69: 11 total, 10 up, 11 in 2024-04-20T12:19:06.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:06 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:19:06.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:06 smithi154 ceph-mon[22073]: from='client.? 172.21.15.139:0/1276779985' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:19:06.765 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:06 smithi135 ceph-mon[18264]: from='client.? 172.21.15.139:0/390544661' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5be0ab8c-4f88-4d25-b656-d40245b76d01"}]: dispatch 2024-04-20T12:19:06.765 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:06 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5be0ab8c-4f88-4d25-b656-d40245b76d01"}]: dispatch 2024-04-20T12:19:06.765 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:06 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5be0ab8c-4f88-4d25-b656-d40245b76d01"}]': finished 2024-04-20T12:19:06.765 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:06 smithi135 ceph-mon[18264]: osdmap e69: 11 total, 10 up, 11 in 2024-04-20T12:19:06.765 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:06 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:19:06.765 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:06 smithi135 ceph-mon[18264]: from='client.? 172.21.15.139:0/1276779985' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:19:06.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:06 smithi139 ceph-mon[21834]: from='client.? 172.21.15.139:0/390544661' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5be0ab8c-4f88-4d25-b656-d40245b76d01"}]: dispatch 2024-04-20T12:19:06.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:06 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5be0ab8c-4f88-4d25-b656-d40245b76d01"}]: dispatch 2024-04-20T12:19:06.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:06 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5be0ab8c-4f88-4d25-b656-d40245b76d01"}]': finished 2024-04-20T12:19:06.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:06 smithi139 ceph-mon[21834]: osdmap e69: 11 total, 10 up, 11 in 2024-04-20T12:19:06.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:06 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:19:06.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:06 smithi139 ceph-mon[21834]: from='client.? 172.21.15.139:0/1276779985' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:19:07.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:07 smithi154 ceph-mon[22073]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:07.782 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:07 smithi135 ceph-mon[18264]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:07.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:07 smithi139 ceph-mon[21834]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:10.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:09 smithi135 ceph-mon[18264]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:10.192 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:09 smithi139 ceph-mon[21834]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:10.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:09 smithi154 ceph-mon[22073]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:12.069 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:11 smithi139 ceph-mon[21834]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:12.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:11 smithi135 ceph-mon[18264]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:12.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:11 smithi154 ceph-mon[22073]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:14.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:13 smithi139 ceph-mon[21834]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:14.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:13 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-20T12:19:14.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:13 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:14.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:13 smithi135 ceph-mon[18264]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:14.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-20T12:19:14.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:14.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:13 smithi154 ceph-mon[22073]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:14.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:13 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-04-20T12:19:14.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:13 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:15.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:14 smithi139 ceph-mon[21834]: Deploying daemon osd.10 on smithi139 2024-04-20T12:19:15.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:14 smithi135 ceph-mon[18264]: Deploying daemon osd.10 on smithi139 2024-04-20T12:19:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:14 smithi154 ceph-mon[22073]: Deploying daemon osd.10 on smithi139 2024-04-20T12:19:16.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:15 smithi135 ceph-mon[18264]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:16.152 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:15 smithi154 ceph-mon[22073]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:16.182 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:15 smithi139 ceph-mon[21834]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:18.073 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:17 smithi139 ceph-mon[21834]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:18.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:17 smithi135 ceph-mon[18264]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:18.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:17 smithi154 ceph-mon[22073]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:19.890 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:19 smithi139 ceph-mon[21834]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:19.890 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:19.890 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:19.890 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:19:20.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:19 smithi135 ceph-mon[18264]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:19:20.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:19 smithi154 ceph-mon[22073]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:20.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:20.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:20.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:19:22.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:21 smithi135 ceph-mon[18264]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:22.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:21 smithi154 ceph-mon[22073]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:22.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:21 smithi139 ceph-mon[21834]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:22.681 INFO:teuthology.orchestra.run.smithi139.stdout:Created osd(s) 10 on host 'smithi139' 2024-04-20T12:19:22.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:22.680+0000 7f3a3d7fa700 1 -- 172.21.15.139:0/2390472363 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3a40062e90 con 0x7f3a280a3cc0 2024-04-20T12:19:22.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:22.683+0000 7f3a46346700 1 -- 172.21.15.139:0/2390472363 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3a280a3cc0 msgr2=0x7f3a280a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:22.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:22.683+0000 7f3a46346700 1 --2- 172.21.15.139:0/2390472363 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3a280a3cc0 0x7f3a280a6180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000b5c0 tx=0x7f3a30005fd0 comp rx=0 tx=0).stop 2024-04-20T12:19:22.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:22.683+0000 7f3a46346700 1 -- 172.21.15.139:0/2390472363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a40076a00 msgr2=0x7f3a4019b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:22.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:22.683+0000 7f3a46346700 1 --2- 172.21.15.139:0/2390472363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a40076a00 0x7f3a4019b440 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400b530 tx=0x7f3a3400b840 comp rx=0 tx=0).stop 2024-04-20T12:19:22.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:22.683+0000 7f3a46346700 1 -- 172.21.15.139:0/2390472363 shutdown_connections 2024-04-20T12:19:22.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:22.683+0000 7f3a46346700 1 --2- 172.21.15.139:0/2390472363 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3a280a3cc0 0x7f3a280a6180 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:22.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:22.683+0000 7f3a46346700 1 --2- 172.21.15.139:0/2390472363 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a4010a9e0 0x7f3a401a24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:22.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:22.683+0000 7f3a46346700 1 --2- 172.21.15.139:0/2390472363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a40075430 0x7f3a4019af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:22.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:22.683+0000 7f3a46346700 1 --2- 172.21.15.139:0/2390472363 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a40076a00 0x7f3a4019b440 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:22.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:22.683+0000 7f3a46346700 1 -- 172.21.15.139:0/2390472363 >> 172.21.15.139:0/2390472363 conn(0x7f3a400fe0a0 msgr2=0x7f3a40106930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:19:22.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:22.683+0000 7f3a46346700 1 -- 172.21.15.139:0/2390472363 shutdown_connections 2024-04-20T12:19:22.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-20T12:19:22.683+0000 7f3a46346700 1 -- 172.21.15.139:0/2390472363 wait complete. 2024-04-20T12:19:23.059 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:22 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:23.059 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:22 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:23.060 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:22 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:23.060 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:22 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:19:23.060 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:22 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:23.060 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:22 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:19:23.060 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:22 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:23.060 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:22 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:23.060 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:22 smithi139 ceph-mon[21834]: from='osd.10 [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-20T12:19:23.060 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:22 smithi139 ceph-mon[21834]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-20T12:19:23.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:22 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:23.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:22 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:23.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:22 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:23.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:22 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:19:23.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:22 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:23.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:22 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:19:23.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:22 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:23.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:22 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:23.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:22 smithi154 ceph-mon[22073]: from='osd.10 [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-20T12:19:23.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:22 smithi154 ceph-mon[22073]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-20T12:19:23.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:22 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:23.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:22 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:23.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:22 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:23.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:22 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:19:23.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:22 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:23.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:22 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:19:23.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:22 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:23.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:22 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:23.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:22 smithi135 ceph-mon[18264]: from='osd.10 [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-20T12:19:23.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:22 smithi135 ceph-mon[18264]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-04-20T12:19:23.420 DEBUG:teuthology.orchestra.run.smithi139:osd.10> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.10.service 2024-04-20T12:19:23.423 INFO:tasks.cephadm:Deploying osd.11 on smithi154 with /dev/vg_nvme/lv_1... 2024-04-20T12:19:23.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-04-20T12:19:23.669 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:19:23.931 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:23 smithi139 ceph-mon[21834]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:23.931 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:23 smithi139 ceph-mon[21834]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-20T12:19:23.931 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:23 smithi139 ceph-mon[21834]: from='osd.10 [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:19:23.931 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:23 smithi139 ceph-mon[21834]: osdmap e70: 11 total, 10 up, 11 in 2024-04-20T12:19:23.931 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:23 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:19:23.931 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:23 smithi139 ceph-mon[21834]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:19:24.072 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:23 smithi154 ceph-mon[22073]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:24.072 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:23 smithi154 ceph-mon[22073]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-20T12:19:24.072 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:23 smithi154 ceph-mon[22073]: from='osd.10 [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:19:24.072 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:23 smithi154 ceph-mon[22073]: osdmap e70: 11 total, 10 up, 11 in 2024-04-20T12:19:24.072 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:23 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:19:24.072 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:23 smithi154 ceph-mon[22073]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:19:24.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:23 smithi135 ceph-mon[18264]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:24.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:23 smithi135 ceph-mon[18264]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-04-20T12:19:24.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:23 smithi135 ceph-mon[18264]: from='osd.10 [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:19:24.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:23 smithi135 ceph-mon[18264]: osdmap e70: 11 total, 10 up, 11 in 2024-04-20T12:19:24.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:23 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:19:24.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:23 smithi135 ceph-mon[18264]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]: dispatch 2024-04-20T12:19:25.164 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:19:25 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:19:25.104+0000 7fbcd08d6700 -1 osd.10 0 waiting for initial osdmap 2024-04-20T12:19:25.165 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:19:25 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:19:25.116+0000 7fbcc86c1700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T12:19:25.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:25 smithi154 ceph-mon[22073]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-20T12:19:25.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:25 smithi154 ceph-mon[22073]: osdmap e71: 11 total, 10 up, 11 in 2024-04-20T12:19:25.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:25 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:19:25.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:25 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:19:25.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:25 smithi154 ceph-mon[22073]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:25.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:25 smithi154 ceph-mon[22073]: from='osd.10 ' entity='osd.10' 2024-04-20T12:19:25.796 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-04-20T12:19:25.796 INFO:teuthology.orchestra.run.smithi154.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-04-20T12:19:25.796 INFO:teuthology.orchestra.run.smithi154.stderr: stderr: 10+0 records in 2024-04-20T12:19:25.796 INFO:teuthology.orchestra.run.smithi154.stderr:10+0 records out 2024-04-20T12:19:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0131628 s, 797 MB/s 2024-04-20T12:19:25.797 INFO:teuthology.orchestra.run.smithi154.stderr:--> Zapping successful for: 2024-04-20T12:19:26.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:25 smithi139 ceph-mon[21834]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-20T12:19:26.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:25 smithi139 ceph-mon[21834]: osdmap e71: 11 total, 10 up, 11 in 2024-04-20T12:19:26.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:25 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:19:26.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:25 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:19:26.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:25 smithi139 ceph-mon[21834]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:26.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:25 smithi139 ceph-mon[21834]: from='osd.10 ' entity='osd.10' 2024-04-20T12:19:26.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:25 smithi135 ceph-mon[18264]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi139", "root=default"]}]': finished 2024-04-20T12:19:26.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:25 smithi135 ceph-mon[18264]: osdmap e71: 11 total, 10 up, 11 in 2024-04-20T12:19:26.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:25 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:19:26.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:25 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:19:26.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:25 smithi135 ceph-mon[18264]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-04-20T12:19:26.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:25 smithi135 ceph-mon[18264]: from='osd.10 ' entity='osd.10' 2024-04-20T12:19:26.575 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch daemon add osd smithi154:vg_nvme/lv_1 2024-04-20T12:19:26.815 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:19:26.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:26 smithi139 ceph-mon[21834]: purged_snaps scrub starts 2024-04-20T12:19:26.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:26 smithi139 ceph-mon[21834]: purged_snaps scrub ok 2024-04-20T12:19:26.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:26 smithi139 ceph-mon[21834]: osd.10 [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232] boot 2024-04-20T12:19:26.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:26 smithi139 ceph-mon[21834]: osdmap e72: 11 total, 11 up, 11 in 2024-04-20T12:19:26.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:26 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:19:26.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:26 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:26.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:26 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:26.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:26 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:26.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:26 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:26.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:26 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:26.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:26 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:26.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:26 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:26.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:26 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:26.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:26 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:19:26.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:26 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:26.938 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:26 smithi154 ceph-mon[22073]: purged_snaps scrub starts 2024-04-20T12:19:26.938 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:26 smithi154 ceph-mon[22073]: purged_snaps scrub ok 2024-04-20T12:19:26.938 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:26 smithi154 ceph-mon[22073]: osd.10 [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232] boot 2024-04-20T12:19:26.939 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:26 smithi154 ceph-mon[22073]: osdmap e72: 11 total, 11 up, 11 in 2024-04-20T12:19:26.939 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:19:26.939 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:26.939 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:26.939 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:26.940 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:26.940 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:26.940 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:26.940 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:26.940 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:26.940 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:19:26.941 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:26 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:27.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:26 smithi135 ceph-mon[18264]: purged_snaps scrub starts 2024-04-20T12:19:27.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:26 smithi135 ceph-mon[18264]: purged_snaps scrub ok 2024-04-20T12:19:27.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:26 smithi135 ceph-mon[18264]: osd.10 [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232] boot 2024-04-20T12:19:27.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:26 smithi135 ceph-mon[18264]: osdmap e72: 11 total, 11 up, 11 in 2024-04-20T12:19:27.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:19:27.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:27.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:27.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:27.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:27.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:27.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:27.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:27.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:27.116 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:19:27.116 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:26 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:27.953 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:27 smithi154 ceph-mon[22073]: Detected new or changed devices on smithi139 2024-04-20T12:19:27.953 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:27 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi139 to 4272M 2024-04-20T12:19:27.953 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:27 smithi154 ceph-mon[22073]: osdmap e73: 11 total, 11 up, 11 in 2024-04-20T12:19:27.953 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:27 smithi154 ceph-mon[22073]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-04-20T12:19:28.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:27 smithi139 ceph-mon[21834]: Detected new or changed devices on smithi139 2024-04-20T12:19:28.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:27 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi139 to 4272M 2024-04-20T12:19:28.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:27 smithi139 ceph-mon[21834]: osdmap e73: 11 total, 11 up, 11 in 2024-04-20T12:19:28.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:27 smithi139 ceph-mon[21834]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-04-20T12:19:28.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:27 smithi135 ceph-mon[18264]: Detected new or changed devices on smithi139 2024-04-20T12:19:28.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:27 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi139 to 4272M 2024-04-20T12:19:28.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:27 smithi135 ceph-mon[18264]: osdmap e73: 11 total, 11 up, 11 in 2024-04-20T12:19:28.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:27 smithi135 ceph-mon[18264]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-04-20T12:19:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.509+0000 7f775b23d700 1 -- 172.21.15.154:0/252098873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7754102380 msgr2=0x7f77541027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.509+0000 7f775b23d700 1 --2- 172.21.15.154:0/252098873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7754102380 0x7f77541027e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7740009990 tx=0x7f7740009ca0 comp rx=0 tx=0).stop 2024-04-20T12:19:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.509+0000 7f775b23d700 1 -- 172.21.15.154:0/252098873 shutdown_connections 2024-04-20T12:19:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.509+0000 7f775b23d700 1 --2- 172.21.15.154:0/252098873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7754102d20 0x7f77541095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.509+0000 7f775b23d700 1 --2- 172.21.15.154:0/252098873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7754101180 0x7f77541015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.509+0000 7f775b23d700 1 --2- 172.21.15.154:0/252098873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7754102380 0x7f77541027e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.509+0000 7f775b23d700 1 -- 172.21.15.154:0/252098873 >> 172.21.15.154:0/252098873 conn(0x7f77540fc720 msgr2=0x7f77540feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:19:28.525 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.509+0000 7f775b23d700 1 -- 172.21.15.154:0/252098873 shutdown_connections 2024-04-20T12:19:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.509+0000 7f775b23d700 1 -- 172.21.15.154:0/252098873 wait complete. 2024-04-20T12:19:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f775b23d700 1 Processor -- start 2024-04-20T12:19:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f775b23d700 1 -- start start 2024-04-20T12:19:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f775b23d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7754101180 0x7f775410ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f775b23d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7754102380 0x7f775419da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f775b23d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7754102d20 0x7f77541a0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f775b23d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f775410d6b0 con 0x7f7754102d20 2024-04-20T12:19:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f775b23d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f775410d530 con 0x7f7754101180 2024-04-20T12:19:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f775b23d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f775410d830 con 0x7f7754102380 2024-04-20T12:19:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f7753fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7754102380 0x7f775419da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f7753fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7754102380 0x7f775419da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:34304/0 (socket says 172.21.15.154:34304) 2024-04-20T12:19:28.526 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f7753fff700 1 -- 172.21.15.154:0/1341184781 learned_addr learned my addr 172.21.15.154:0/1341184781 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-20T12:19:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f7758fd9700 1 --2- 172.21.15.154:0/1341184781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7754101180 0x7f775410ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f77597da700 1 --2- 172.21.15.154:0/1341184781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7754102d20 0x7f77541a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f7753fff700 1 -- 172.21.15.154:0/1341184781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7754101180 msgr2=0x7f775410ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f7753fff700 1 --2- 172.21.15.154:0/1341184781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7754101180 0x7f775410ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f7753fff700 1 -- 172.21.15.154:0/1341184781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7754102d20 msgr2=0x7f77541a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f7753fff700 1 --2- 172.21.15.154:0/1341184781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7754102d20 0x7f77541a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f7753fff700 1 -- 172.21.15.154:0/1341184781 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77541a0920 con 0x7f7754102380 2024-04-20T12:19:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.510+0000 7f77597da700 1 --2- 172.21.15.154:0/1341184781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7754102d20 0x7f77541a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:19:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.511+0000 7f7753fff700 1 --2- 172.21.15.154:0/1341184781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7754102380 0x7f775419da10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7740005910 tx=0x7f7740005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:19:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.511+0000 7f7751ffb700 1 -- 172.21.15.154:0/1341184781 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7740027070 con 0x7f7754102380 2024-04-20T12:19:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.511+0000 7f775b23d700 1 -- 172.21.15.154:0/1341184781 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77541a0bb0 con 0x7f7754102380 2024-04-20T12:19:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.511+0000 7f7751ffb700 1 -- 172.21.15.154:0/1341184781 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7740004150 con 0x7f7754102380 2024-04-20T12:19:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.511+0000 7f7751ffb700 1 -- 172.21.15.154:0/1341184781 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774000f460 con 0x7f7754102380 2024-04-20T12:19:28.527 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.511+0000 7f775b23d700 1 -- 172.21.15.154:0/1341184781 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77541a1000 con 0x7f7754102380 2024-04-20T12:19:28.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.512+0000 7f775b23d700 1 -- 172.21.15.154:0/1341184781 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f775402df90 con 0x7f7754102380 2024-04-20T12:19:28.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.513+0000 7f7751ffb700 1 -- 172.21.15.154:0/1341184781 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f774002a070 con 0x7f7754102380 2024-04-20T12:19:28.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.513+0000 7f7751ffb700 1 --2- 172.21.15.154:0/1341184781 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f77440a3c40 0x7f77440a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:28.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.514+0000 7f7751ffb700 1 -- 172.21.15.154:0/1341184781 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6694+0+0 (secure 0 0 0) 0x7f77400d1510 con 0x7f7754102380 2024-04-20T12:19:28.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.514+0000 7f7758fd9700 1 --2- 172.21.15.154:0/1341184781 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f77440a3c40 0x7f77440a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:28.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.514+0000 7f7758fd9700 1 --2- 172.21.15.154:0/1341184781 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f77440a3c40 0x7f77440a6100 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f77541021e0 tx=0x7f774800a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:19:28.528 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.517+0000 7f7751ffb700 1 -- 172.21.15.154:0/1341184781 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f7740031020 con 0x7f7754102380 2024-04-20T12:19:28.727 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:28.727+0000 7f775b23d700 1 -- 172.21.15.154:0/1341184781 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f7754062e90 con 0x7f77440a3c40 2024-04-20T12:19:29.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:28 smithi154 ceph-mon[22073]: osdmap e74: 11 total, 11 up, 11 in 2024-04-20T12:19:29.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:28 smithi154 ceph-mon[22073]: osdmap e75: 11 total, 11 up, 11 in 2024-04-20T12:19:29.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:28 smithi139 ceph-mon[21834]: osdmap e74: 11 total, 11 up, 11 in 2024-04-20T12:19:29.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:28 smithi139 ceph-mon[21834]: osdmap e75: 11 total, 11 up, 11 in 2024-04-20T12:19:29.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:28 smithi135 ceph-mon[18264]: osdmap e74: 11 total, 11 up, 11 in 2024-04-20T12:19:29.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:28 smithi135 ceph-mon[18264]: osdmap e75: 11 total, 11 up, 11 in 2024-04-20T12:19:30.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:29 smithi154 ceph-mon[22073]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:19:30.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:29 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:19:30.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:29 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:19:30.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:29 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:30.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:29 smithi154 ceph-mon[22073]: pgmap v241: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-20T12:19:30.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:29 smithi154 ceph-mon[22073]: osdmap e76: 11 total, 11 up, 11 in 2024-04-20T12:19:30.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:29 smithi139 ceph-mon[21834]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:19:30.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:29 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:19:30.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:29 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:19:30.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:29 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:30.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:29 smithi139 ceph-mon[21834]: pgmap v241: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-20T12:19:30.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:29 smithi139 ceph-mon[21834]: osdmap e76: 11 total, 11 up, 11 in 2024-04-20T12:19:30.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:29 smithi135 ceph-mon[18264]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi154:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:19:30.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:29 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-20T12:19:30.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:29 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-20T12:19:30.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:29 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:30.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:29 smithi135 ceph-mon[18264]: pgmap v241: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-20T12:19:30.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:29 smithi135 ceph-mon[18264]: osdmap e76: 11 total, 11 up, 11 in 2024-04-20T12:19:30.919 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:30 smithi154 ceph-mon[22073]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-20T12:19:31.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:30 smithi139 ceph-mon[21834]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-20T12:19:31.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:30 smithi135 ceph-mon[18264]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-04-20T12:19:32.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:31 smithi154 ceph-mon[22073]: pgmap v243: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-20T12:19:32.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:31 smithi154 ceph-mon[22073]: from='client.? 172.21.15.154:0/2991605142' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c88673e8-c6e7-44f8-ac95-e7c00f413f93"}]: dispatch 2024-04-20T12:19:32.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:31 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c88673e8-c6e7-44f8-ac95-e7c00f413f93"}]: dispatch 2024-04-20T12:19:32.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:31 smithi154 ceph-mon[22073]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c88673e8-c6e7-44f8-ac95-e7c00f413f93"}]': finished 2024-04-20T12:19:32.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:31 smithi154 ceph-mon[22073]: osdmap e77: 12 total, 11 up, 12 in 2024-04-20T12:19:32.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:32.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:31 smithi139 ceph-mon[21834]: pgmap v243: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-20T12:19:32.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:31 smithi139 ceph-mon[21834]: from='client.? 172.21.15.154:0/2991605142' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c88673e8-c6e7-44f8-ac95-e7c00f413f93"}]: dispatch 2024-04-20T12:19:32.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:31 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c88673e8-c6e7-44f8-ac95-e7c00f413f93"}]: dispatch 2024-04-20T12:19:32.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:31 smithi139 ceph-mon[21834]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c88673e8-c6e7-44f8-ac95-e7c00f413f93"}]': finished 2024-04-20T12:19:32.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:31 smithi139 ceph-mon[21834]: osdmap e77: 12 total, 11 up, 12 in 2024-04-20T12:19:32.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:32.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:31 smithi135 ceph-mon[18264]: pgmap v243: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-20T12:19:32.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:31 smithi135 ceph-mon[18264]: from='client.? 172.21.15.154:0/2991605142' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c88673e8-c6e7-44f8-ac95-e7c00f413f93"}]: dispatch 2024-04-20T12:19:32.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:31 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c88673e8-c6e7-44f8-ac95-e7c00f413f93"}]: dispatch 2024-04-20T12:19:32.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:31 smithi135 ceph-mon[18264]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c88673e8-c6e7-44f8-ac95-e7c00f413f93"}]': finished 2024-04-20T12:19:32.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:31 smithi135 ceph-mon[18264]: osdmap e77: 12 total, 11 up, 12 in 2024-04-20T12:19:32.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:33.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:32 smithi154 ceph-mon[22073]: from='client.? 172.21.15.154:0/2675930842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:19:33.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:32 smithi139 ceph-mon[21834]: from='client.? 172.21.15.154:0/2675930842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:19:33.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:32 smithi135 ceph-mon[18264]: from='client.? 172.21.15.154:0/2675930842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-20T12:19:34.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:33 smithi154 ceph-mon[22073]: pgmap v245: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-20T12:19:34.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:33 smithi139 ceph-mon[21834]: pgmap v245: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-20T12:19:34.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:33 smithi135 ceph-mon[18264]: pgmap v245: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-04-20T12:19:35.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:34 smithi154 ceph-mon[22073]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-20T12:19:35.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:34 smithi154 ceph-mon[22073]: Cluster is now healthy 2024-04-20T12:19:35.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:34 smithi139 ceph-mon[21834]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-20T12:19:35.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:34 smithi139 ceph-mon[21834]: Cluster is now healthy 2024-04-20T12:19:35.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:34 smithi135 ceph-mon[18264]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-04-20T12:19:35.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:34 smithi135 ceph-mon[18264]: Cluster is now healthy 2024-04-20T12:19:36.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:35 smithi154 ceph-mon[22073]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-04-20T12:19:36.265 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:35 smithi135 ceph-mon[18264]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-04-20T12:19:36.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:35 smithi139 ceph-mon[21834]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-04-20T12:19:38.151 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:37 smithi154 ceph-mon[22073]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-20T12:19:38.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:37 smithi139 ceph-mon[21834]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-20T12:19:38.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:37 smithi135 ceph-mon[18264]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-20T12:19:40.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:39 smithi154 ceph-mon[22073]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-04-20T12:19:40.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-20T12:19:40.155 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:40.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:39 smithi139 ceph-mon[21834]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-04-20T12:19:40.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-20T12:19:40.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:40.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:39 smithi135 ceph-mon[18264]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-04-20T12:19:40.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-04-20T12:19:40.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:41.163 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:40 smithi154 ceph-mon[22073]: Deploying daemon osd.11 on smithi154 2024-04-20T12:19:41.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:40 smithi139 ceph-mon[21834]: Deploying daemon osd.11 on smithi154 2024-04-20T12:19:41.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:40 smithi135 ceph-mon[18264]: Deploying daemon osd.11 on smithi154 2024-04-20T12:19:42.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:41 smithi154 ceph-mon[22073]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-20T12:19:42.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:41 smithi139 ceph-mon[21834]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-20T12:19:42.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:41 smithi135 ceph-mon[18264]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-04-20T12:19:44.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:43 smithi154 ceph-mon[22073]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-04-20T12:19:44.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:43 smithi139 ceph-mon[21834]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-04-20T12:19:44.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:43 smithi135 ceph-mon[18264]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-04-20T12:19:44.949 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:44 smithi154 ceph-mon[22073]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-20T12:19:45.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:44 smithi139 ceph-mon[21834]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-20T12:19:45.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:44 smithi135 ceph-mon[18264]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-04-20T12:19:46.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:46 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:46.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:46 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:46.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:46 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:19:46.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:46 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:46.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:46 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:46.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:46 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:19:46.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:46 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:46.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:46 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:46.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:46 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:19:47.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:47 smithi135 ceph-mon[18264]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-04-20T12:19:47.699 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:47 smithi154 ceph-mon[22073]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-04-20T12:19:47.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:47 smithi139 ceph-mon[21834]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-04-20T12:19:49.444 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:49.445+0000 7f7751ffb700 1 -- 172.21.15.154:0/1341184781 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f7754062e90 con 0x7f77440a3c40 2024-04-20T12:19:49.444 INFO:teuthology.orchestra.run.smithi154.stdout:Created osd(s) 11 on host 'smithi154' 2024-04-20T12:19:49.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:49.447+0000 7f775b23d700 1 -- 172.21.15.154:0/1341184781 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f77440a3c40 msgr2=0x7f77440a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:49.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:49.447+0000 7f775b23d700 1 --2- 172.21.15.154:0/1341184781 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f77440a3c40 0x7f77440a6100 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f77541021e0 tx=0x7f774800a3b0 comp rx=0 tx=0).stop 2024-04-20T12:19:49.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:49.447+0000 7f775b23d700 1 -- 172.21.15.154:0/1341184781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7754102380 msgr2=0x7f775419da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:49.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:49.447+0000 7f775b23d700 1 --2- 172.21.15.154:0/1341184781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7754102380 0x7f775419da10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7740005910 tx=0x7f7740005f10 comp rx=0 tx=0).stop 2024-04-20T12:19:49.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:49.447+0000 7f775b23d700 1 -- 172.21.15.154:0/1341184781 shutdown_connections 2024-04-20T12:19:49.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:49.447+0000 7f775b23d700 1 --2- 172.21.15.154:0/1341184781 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f77440a3c40 0x7f77440a6100 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:49.447 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:49.447+0000 7f775b23d700 1 --2- 172.21.15.154:0/1341184781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7754102d20 0x7f77541a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:49.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:49.447+0000 7f775b23d700 1 --2- 172.21.15.154:0/1341184781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7754101180 0x7f775410ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:49.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:49.447+0000 7f775b23d700 1 --2- 172.21.15.154:0/1341184781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7754102380 0x7f775419da10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:49.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:49.447+0000 7f775b23d700 1 -- 172.21.15.154:0/1341184781 >> 172.21.15.154:0/1341184781 conn(0x7f77540fc720 msgr2=0x7f77541055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:19:49.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:49.448+0000 7f775b23d700 1 -- 172.21.15.154:0/1341184781 shutdown_connections 2024-04-20T12:19:49.448 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:19:49.448+0000 7f775b23d700 1 -- 172.21.15.154:0/1341184781 wait complete. 2024-04-20T12:19:49.746 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:49.747 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:49.747 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:49.747 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:19:49.747 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:49.747 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:49 smithi154 ceph-mon[22073]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-04-20T12:19:49.747 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:49 smithi154 ceph-mon[22073]: from='osd.11 [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-20T12:19:49.747 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:49 smithi154 ceph-mon[22073]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-20T12:19:49.747 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:49.747 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:49.747 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:49 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:19:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:19:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:49 smithi139 ceph-mon[21834]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-04-20T12:19:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:49 smithi139 ceph-mon[21834]: from='osd.11 [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-20T12:19:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:49 smithi139 ceph-mon[21834]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-20T12:19:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:49.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:49 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:19:49.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:49.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:49.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:49.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:19:49.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:49.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:49 smithi135 ceph-mon[18264]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-04-20T12:19:49.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:49 smithi135 ceph-mon[18264]: from='osd.11 [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-20T12:19:49.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:49 smithi135 ceph-mon[18264]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-04-20T12:19:49.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:49.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:49.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:49 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:19:50.056 DEBUG:teuthology.orchestra.run.smithi154:osd.11> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.11.service 2024-04-20T12:19:50.058 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-04-20T12:19:50.058 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd stat -f json 2024-04-20T12:19:50.308 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:19:50.684 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:50 smithi135 ceph-mon[18264]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-20T12:19:50.684 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:50 smithi135 ceph-mon[18264]: from='osd.11 [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:19:50.685 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:50 smithi135 ceph-mon[18264]: osdmap e78: 12 total, 11 up, 12 in 2024-04-20T12:19:50.685 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:50 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:50.685 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:50 smithi135 ceph-mon[18264]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:19:50.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:50 smithi139 ceph-mon[21834]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-20T12:19:50.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:50 smithi139 ceph-mon[21834]: from='osd.11 [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:19:50.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:50 smithi139 ceph-mon[21834]: osdmap e78: 12 total, 11 up, 12 in 2024-04-20T12:19:50.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:50 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:50.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:50 smithi139 ceph-mon[21834]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:19:50.997 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:50 smithi154 ceph-mon[22073]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-04-20T12:19:50.997 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:50 smithi154 ceph-mon[22073]: from='osd.11 [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:19:50.997 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:50 smithi154 ceph-mon[22073]: osdmap e78: 12 total, 11 up, 12 in 2024-04-20T12:19:50.997 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:50 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:50.997 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:50 smithi154 ceph-mon[22073]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]: dispatch 2024-04-20T12:19:50.998 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:19:50 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:19:50.570+0000 7f8d4e2ab700 -1 osd.11 0 waiting for initial osdmap 2024-04-20T12:19:50.998 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:19:50 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:19:50.583+0000 7f8d4a09e700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T12:19:51.651 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:51 smithi154 ceph-mon[22073]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-04-20T12:19:51.651 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:51 smithi154 ceph-mon[22073]: osdmap e79: 12 total, 11 up, 12 in 2024-04-20T12:19:51.651 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:51.651 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:51 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:51.651 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:51 smithi154 ceph-mon[22073]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-04-20T12:19:51.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:51 smithi135 ceph-mon[18264]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-04-20T12:19:51.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:51 smithi135 ceph-mon[18264]: osdmap e79: 12 total, 11 up, 12 in 2024-04-20T12:19:51.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:51.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:51 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:51.736 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:51 smithi135 ceph-mon[18264]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-04-20T12:19:51.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:51 smithi139 ceph-mon[21834]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi154", "root=default"]}]': finished 2024-04-20T12:19:51.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:51 smithi139 ceph-mon[21834]: osdmap e79: 12 total, 11 up, 12 in 2024-04-20T12:19:51.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:51.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:51 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:51.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:51 smithi139 ceph-mon[21834]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-04-20T12:19:52.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.098+0000 7f6205a1f700 1 -- 172.21.15.135:0/1762971306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6200103cc0 msgr2=0x7f6200104120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:52.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.098+0000 7f6205a1f700 1 --2- 172.21.15.135:0/1762971306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6200103cc0 0x7f6200104120 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f61e80099c0 tx=0x7f61e8009cd0 comp rx=0 tx=0).stop 2024-04-20T12:19:52.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.098+0000 7f6205a1f700 1 -- 172.21.15.135:0/1762971306 shutdown_connections 2024-04-20T12:19:52.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.098+0000 7f6205a1f700 1 --2- 172.21.15.135:0/1762971306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6200104660 0x7f620010af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:52.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.098+0000 7f6205a1f700 1 --2- 172.21.15.135:0/1762971306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6200102ac0 0x7f6200102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:52.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.098+0000 7f6205a1f700 1 --2- 172.21.15.135:0/1762971306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6200103cc0 0x7f6200104120 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:52.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.098+0000 7f6205a1f700 1 -- 172.21.15.135:0/1762971306 >> 172.21.15.135:0/1762971306 conn(0x7f62000fe060 msgr2=0x7f62001004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:19:52.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.098+0000 7f6205a1f700 1 -- 172.21.15.135:0/1762971306 shutdown_connections 2024-04-20T12:19:52.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.098+0000 7f6205a1f700 1 -- 172.21.15.135:0/1762971306 wait complete. 2024-04-20T12:19:52.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.099+0000 7f6205a1f700 1 Processor -- start 2024-04-20T12:19:52.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.099+0000 7f6205a1f700 1 -- start start 2024-04-20T12:19:52.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.099+0000 7f6205a1f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6200102ac0 0x7f6200198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:52.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.099+0000 7f6205a1f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6200103cc0 0x7f62001990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:52.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.099+0000 7f6205a1f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6200104660 0x7f62001a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:52.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.099+0000 7f6205a1f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f620010e680 con 0x7f6200103cc0 2024-04-20T12:19:52.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.099+0000 7f6205a1f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f620010e500 con 0x7f6200102ac0 2024-04-20T12:19:52.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.099+0000 7f6205a1f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f620010e800 con 0x7f6200104660 2024-04-20T12:19:52.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.099+0000 7f61fe7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6200103cc0 0x7f62001990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:52.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.099+0000 7f61fe7fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6200103cc0 0x7f62001990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33558/0 (socket says 172.21.15.135:33558) 2024-04-20T12:19:52.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.099+0000 7f61fe7fc700 1 -- 172.21.15.135:0/2008161776 learned_addr learned my addr 172.21.15.135:0/2008161776 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:19:52.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.099+0000 7f61ff7fe700 1 --2- 172.21.15.135:0/2008161776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6200104660 0x7f62001a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:52.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.099+0000 7f61feffd700 1 --2- 172.21.15.135:0/2008161776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6200102ac0 0x7f6200198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:52.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.100+0000 7f61fe7fc700 1 -- 172.21.15.135:0/2008161776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6200104660 msgr2=0x7f62001a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:52.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.100+0000 7f61fe7fc700 1 --2- 172.21.15.135:0/2008161776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6200104660 0x7f62001a0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:52.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.100+0000 7f61fe7fc700 1 -- 172.21.15.135:0/2008161776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6200102ac0 msgr2=0x7f6200198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:52.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.100+0000 7f61fe7fc700 1 --2- 172.21.15.135:0/2008161776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6200102ac0 0x7f6200198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:52.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.100+0000 7f61fe7fc700 1 -- 172.21.15.135:0/2008161776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62001a0800 con 0x7f6200103cc0 2024-04-20T12:19:52.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.100+0000 7f61fe7fc700 1 --2- 172.21.15.135:0/2008161776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6200103cc0 0x7f62001990e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f61e8000c00 tx=0x7f61e80057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:19:52.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.100+0000 7f6204a1d700 1 -- 172.21.15.135:0/2008161776 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e8027070 con 0x7f6200103cc0 2024-04-20T12:19:52.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.100+0000 7f6204a1d700 1 -- 172.21.15.135:0/2008161776 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61e8004150 con 0x7f6200103cc0 2024-04-20T12:19:52.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.100+0000 7f6205a1f700 1 -- 172.21.15.135:0/2008161776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62001a0a90 con 0x7f6200103cc0 2024-04-20T12:19:52.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.100+0000 7f6204a1d700 1 -- 172.21.15.135:0/2008161776 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e800f460 con 0x7f6200103cc0 2024-04-20T12:19:52.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.100+0000 7f6205a1f700 1 -- 172.21.15.135:0/2008161776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62001a0ee0 con 0x7f6200103cc0 2024-04-20T12:19:52.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.101+0000 7f6205a1f700 1 -- 172.21.15.135:0/2008161776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f620002df90 con 0x7f6200103cc0 2024-04-20T12:19:52.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.103+0000 7f6204a1d700 1 -- 172.21.15.135:0/2008161776 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f61e802a070 con 0x7f6200103cc0 2024-04-20T12:19:52.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.103+0000 7f6204a1d700 1 --2- 172.21.15.135:0/2008161776 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f61ec0a3c40 0x7f61ec0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:52.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.103+0000 7f61feffd700 1 --2- 172.21.15.135:0/2008161776 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f61ec0a3c40 0x7f61ec0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:52.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.103+0000 7f6204a1d700 1 -- 172.21.15.135:0/2008161776 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7127+0+0 (secure 0 0 0) 0x7f61e80d16c0 con 0x7f6200103cc0 2024-04-20T12:19:52.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.104+0000 7f61feffd700 1 --2- 172.21.15.135:0/2008161776 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f61ec0a3c40 0x7f61ec0a6100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f61f0005fd0 tx=0x7f61f0005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:19:52.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.107+0000 7f6204a1d700 1 -- 172.21.15.135:0/2008161776 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f61e8031020 con 0x7f6200103cc0 2024-04-20T12:19:52.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.306+0000 7f6205a1f700 1 -- 172.21.15.135:0/2008161776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f620002e3b0 con 0x7f6200103cc0 2024-04-20T12:19:52.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.307+0000 7f6204a1d700 1 -- 172.21.15.135:0/2008161776 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) ==== 74+0+133 (secure 0 0 0) 0x7f61e8013070 con 0x7f6200103cc0 2024-04-20T12:19:52.307 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:19:52.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.309+0000 7f6205a1f700 1 -- 172.21.15.135:0/2008161776 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f61ec0a3c40 msgr2=0x7f61ec0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:52.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.309+0000 7f6205a1f700 1 --2- 172.21.15.135:0/2008161776 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f61ec0a3c40 0x7f61ec0a6100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f61f0005fd0 tx=0x7f61f0005e50 comp rx=0 tx=0).stop 2024-04-20T12:19:52.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.309+0000 7f6205a1f700 1 -- 172.21.15.135:0/2008161776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6200103cc0 msgr2=0x7f62001990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:52.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.309+0000 7f6205a1f700 1 --2- 172.21.15.135:0/2008161776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6200103cc0 0x7f62001990e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f61e8000c00 tx=0x7f61e80057c0 comp rx=0 tx=0).stop 2024-04-20T12:19:52.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.309+0000 7f6205a1f700 1 -- 172.21.15.135:0/2008161776 shutdown_connections 2024-04-20T12:19:52.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.309+0000 7f6205a1f700 1 --2- 172.21.15.135:0/2008161776 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f61ec0a3c40 0x7f61ec0a6100 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:52.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.309+0000 7f6205a1f700 1 --2- 172.21.15.135:0/2008161776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6200104660 0x7f62001a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:52.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.309+0000 7f6205a1f700 1 --2- 172.21.15.135:0/2008161776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6200102ac0 0x7f6200198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:52.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.309+0000 7f6205a1f700 1 --2- 172.21.15.135:0/2008161776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6200103cc0 0x7f62001990e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:52.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.309+0000 7f6205a1f700 1 -- 172.21.15.135:0/2008161776 >> 172.21.15.135:0/2008161776 conn(0x7f62000fe060 msgr2=0x7f6200106ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:19:52.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.309+0000 7f6205a1f700 1 -- 172.21.15.135:0/2008161776 shutdown_connections 2024-04-20T12:19:52.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:52.309+0000 7f6205a1f700 1 -- 172.21.15.135:0/2008161776 wait complete. 2024-04-20T12:19:52.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:52 smithi154 ceph-mon[22073]: purged_snaps scrub starts 2024-04-20T12:19:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:52 smithi154 ceph-mon[22073]: purged_snaps scrub ok 2024-04-20T12:19:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:52 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:52 smithi154 ceph-mon[22073]: osd.11 [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144] boot 2024-04-20T12:19:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:52 smithi154 ceph-mon[22073]: osdmap e80: 12 total, 12 up, 12 in 2024-04-20T12:19:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:52 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:52.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:52 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2008161776' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-20T12:19:52.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:52 smithi139 ceph-mon[21834]: purged_snaps scrub starts 2024-04-20T12:19:52.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:52 smithi139 ceph-mon[21834]: purged_snaps scrub ok 2024-04-20T12:19:52.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:52 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:52.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:52 smithi139 ceph-mon[21834]: osd.11 [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144] boot 2024-04-20T12:19:52.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:52 smithi139 ceph-mon[21834]: osdmap e80: 12 total, 12 up, 12 in 2024-04-20T12:19:52.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:52 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:52.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:52 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2008161776' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-20T12:19:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:52 smithi135 ceph-mon[18264]: purged_snaps scrub starts 2024-04-20T12:19:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:52 smithi135 ceph-mon[18264]: purged_snaps scrub ok 2024-04-20T12:19:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:52 smithi135 ceph-mon[18264]: osd.11 [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144] boot 2024-04-20T12:19:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:52 smithi135 ceph-mon[18264]: osdmap e80: 12 total, 12 up, 12 in 2024-04-20T12:19:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:52 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:19:52.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:52 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2008161776' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-20T12:19:53.038 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":80,"num_osds":12,"num_up_osds":12,"osd_up_since":1713615591,"num_in_osds":12,"osd_in_since":1713615571,"num_remapped_pgs":0} 2024-04-20T12:19:53.038 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd dump --format=json 2024-04-20T12:19:53.283 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:19:53.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:53 smithi135 ceph-mon[18264]: osdmap e81: 12 total, 12 up, 12 in 2024-04-20T12:19:53.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:53 smithi135 ceph-mon[18264]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:19:53.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:53.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:53.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:53.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:53.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:53.697 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:53.698 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:53.698 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:53.698 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:19:53.698 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:53 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:54.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:53 smithi154 ceph-mon[22073]: osdmap e81: 12 total, 12 up, 12 in 2024-04-20T12:19:54.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:53 smithi154 ceph-mon[22073]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:19:54.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:54.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:54.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:54.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:54.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:54.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:54.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:54.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:54.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:19:54.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:53 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:54.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:53 smithi139 ceph-mon[21834]: osdmap e81: 12 total, 12 up, 12 in 2024-04-20T12:19:54.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:53 smithi139 ceph-mon[21834]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:19:54.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:54.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:54.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:54.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:54.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:54.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:19:54.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:54.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:19:54.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:19:54.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:53 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:19:54.738 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:54 smithi135 ceph-mon[18264]: Detected new or changed devices on smithi154 2024-04-20T12:19:54.738 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:54 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi154 to 4272M 2024-04-20T12:19:54.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.980+0000 7f828c371700 1 -- 172.21.15.135:0/1181326818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8284107950 msgr2=0x7f8284107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:54.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.980+0000 7f828c371700 1 --2- 172.21.15.135:0/1181326818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8284107950 0x7f8284107d30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8280009990 tx=0x7f8280009ca0 comp rx=0 tx=0).stop 2024-04-20T12:19:54.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.980+0000 7f828c371700 1 -- 172.21.15.135:0/1181326818 shutdown_connections 2024-04-20T12:19:54.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.980+0000 7f828c371700 1 --2- 172.21.15.135:0/1181326818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f82841023a0 0x7f828410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:54.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.980+0000 7f828c371700 1 --2- 172.21.15.135:0/1181326818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8284107950 0x7f8284107d30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:54.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.980+0000 7f828c371700 1 --2- 172.21.15.135:0/1181326818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82841019e0 0x7f8284101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:54.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.980+0000 7f828c371700 1 -- 172.21.15.135:0/1181326818 >> 172.21.15.135:0/1181326818 conn(0x7f82840779a0 msgr2=0x7f8284077db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:19:54.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.980+0000 7f828c371700 1 -- 172.21.15.135:0/1181326818 shutdown_connections 2024-04-20T12:19:54.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.980+0000 7f828c371700 1 -- 172.21.15.135:0/1181326818 wait complete. 2024-04-20T12:19:54.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.981+0000 7f828c371700 1 Processor -- start 2024-04-20T12:19:54.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.981+0000 7f828c371700 1 -- start start 2024-04-20T12:19:54.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.981+0000 7f828c371700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82841019e0 0x7f828419a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:54.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.981+0000 7f828c371700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82841023a0 0x7f828419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:54.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.981+0000 7f828c371700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8284107950 0x7f82841a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:54.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.981+0000 7f828c371700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8284111ce0 con 0x7f82841023a0 2024-04-20T12:19:54.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.981+0000 7f828c371700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8284111b60 con 0x7f8284107950 2024-04-20T12:19:54.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.981+0000 7f828c371700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8284111e60 con 0x7f82841019e0 2024-04-20T12:19:54.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.981+0000 7f828990c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82841023a0 0x7f828419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:54.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.981+0000 7f828990c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82841023a0 0x7f828419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33566/0 (socket says 172.21.15.135:33566) 2024-04-20T12:19:54.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.981+0000 7f828990c700 1 -- 172.21.15.135:0/3004096503 learned_addr learned my addr 172.21.15.135:0/3004096503 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:19:54.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.982+0000 7f828a10d700 1 --2- 172.21.15.135:0/3004096503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82841019e0 0x7f828419a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:54.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.982+0000 7f828a90e700 1 --2- 172.21.15.135:0/3004096503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8284107950 0x7f82841a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:54.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.982+0000 7f828990c700 1 -- 172.21.15.135:0/3004096503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82841019e0 msgr2=0x7f828419a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:54.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.982+0000 7f828990c700 1 --2- 172.21.15.135:0/3004096503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82841019e0 0x7f828419a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:54.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.982+0000 7f828990c700 1 -- 172.21.15.135:0/3004096503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8284107950 msgr2=0x7f82841a5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:54.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.982+0000 7f828990c700 1 --2- 172.21.15.135:0/3004096503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8284107950 0x7f82841a5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:54.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.982+0000 7f828990c700 1 -- 172.21.15.135:0/3004096503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82841a56c0 con 0x7f82841023a0 2024-04-20T12:19:54.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.982+0000 7f828990c700 1 --2- 172.21.15.135:0/3004096503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82841023a0 0x7f828419a640 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f827400b530 tx=0x7f827400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:19:54.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.982+0000 7f827b7fe700 1 -- 172.21.15.135:0/3004096503 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8274015020 con 0x7f82841023a0 2024-04-20T12:19:54.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.982+0000 7f827b7fe700 1 -- 172.21.15.135:0/3004096503 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8274011d10 con 0x7f82841023a0 2024-04-20T12:19:54.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.982+0000 7f827b7fe700 1 -- 172.21.15.135:0/3004096503 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827400f2e0 con 0x7f82841023a0 2024-04-20T12:19:54.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.982+0000 7f828c371700 1 -- 172.21.15.135:0/3004096503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82841a5890 con 0x7f82841023a0 2024-04-20T12:19:54.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.982+0000 7f828c371700 1 -- 172.21.15.135:0/3004096503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82841a5d80 con 0x7f82841023a0 2024-04-20T12:19:54.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.983+0000 7f828c371700 1 -- 172.21.15.135:0/3004096503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8284109ee0 con 0x7f82841023a0 2024-04-20T12:19:54.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.984+0000 7f827b7fe700 1 -- 172.21.15.135:0/3004096503 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f8274018020 con 0x7f82841023a0 2024-04-20T12:19:54.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.985+0000 7f827b7fe700 1 --2- 172.21.15.135:0/3004096503 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f82700a3c40 0x7f82700a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:54.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.985+0000 7f828a10d700 1 --2- 172.21.15.135:0/3004096503 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f82700a3c40 0x7f82700a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:54.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.985+0000 7f827b7fe700 1 -- 172.21.15.135:0/3004096503 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f82740cf800 con 0x7f82841023a0 2024-04-20T12:19:54.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.985+0000 7f828a10d700 1 --2- 172.21.15.135:0/3004096503 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f82700a3c40 0x7f82700a6100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f828000b5c0 tx=0x7f8280005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:19:54.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:54.989+0000 7f827b7fe700 1 -- 172.21.15.135:0/3004096503 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f827401f020 con 0x7f82841023a0 2024-04-20T12:19:55.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:54 smithi154 ceph-mon[22073]: Detected new or changed devices on smithi154 2024-04-20T12:19:55.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:54 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi154 to 4272M 2024-04-20T12:19:55.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:54 smithi139 ceph-mon[21834]: Detected new or changed devices on smithi154 2024-04-20T12:19:55.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:54 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi154 to 4272M 2024-04-20T12:19:55.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:55.187+0000 7f828c371700 1 -- 172.21.15.135:0/3004096503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82841098c0 con 0x7f82841023a0 2024-04-20T12:19:55.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:55.188+0000 7f827b7fe700 1 -- 172.21.15.135:0/3004096503 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18501 (secure 0 0 0) 0x7f827409c680 con 0x7f82841023a0 2024-04-20T12:19:55.188 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:19:55.189 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":81,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:19:52.572918+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:19:55.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:55.190+0000 7f828c371700 1 -- 172.21.15.135:0/3004096503 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f82700a3c40 msgr2=0x7f82700a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:55.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:55.190+0000 7f828c371700 1 --2- 172.21.15.135:0/3004096503 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f82700a3c40 0x7f82700a6100 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f828000b5c0 tx=0x7f8280005960 comp rx=0 tx=0).stop 2024-04-20T12:19:55.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:55.190+0000 7f828c371700 1 -- 172.21.15.135:0/3004096503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82841023a0 msgr2=0x7f828419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:55.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:55.190+0000 7f828c371700 1 --2- 172.21.15.135:0/3004096503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82841023a0 0x7f828419a640 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f827400b530 tx=0x7f827400b840 comp rx=0 tx=0).stop 2024-04-20T12:19:55.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:55.190+0000 7f828c371700 1 -- 172.21.15.135:0/3004096503 shutdown_connections 2024-04-20T12:19:55.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:55.190+0000 7f828c371700 1 --2- 172.21.15.135:0/3004096503 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f82700a3c40 0x7f82700a6100 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:55.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:55.190+0000 7f828c371700 1 --2- 172.21.15.135:0/3004096503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8284107950 0x7f82841a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:55.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:55.190+0000 7f828c371700 1 --2- 172.21.15.135:0/3004096503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f82841019e0 0x7f828419a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:55.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:55.190+0000 7f828c371700 1 --2- 172.21.15.135:0/3004096503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82841023a0 0x7f828419a640 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:55.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:55.190+0000 7f828c371700 1 -- 172.21.15.135:0/3004096503 >> 172.21.15.135:0/3004096503 conn(0x7f82840779a0 msgr2=0x7f82840ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:19:55.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:55.191+0000 7f828c371700 1 -- 172.21.15.135:0/3004096503 shutdown_connections 2024-04-20T12:19:55.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:55.191+0000 7f828c371700 1 -- 172.21.15.135:0/3004096503 wait complete. 2024-04-20T12:19:55.827 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:55 smithi135 ceph-mon[18264]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:19:55.828 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:55 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3004096503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:19:55.858 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T12:16:02.802023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T12:19:55.858 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-20T12:19:56.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:55 smithi154 ceph-mon[22073]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:19:56.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:55 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3004096503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:19:56.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:55 smithi139 ceph-mon[21834]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:19:56.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:55 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3004096503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:19:56.095 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:19:57.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.770+0000 7fd0c2ad2700 1 -- 172.21.15.135:0/3866000318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0bc103490 msgr2=0x7fd0bc10f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:57.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.770+0000 7fd0c2ad2700 1 --2- 172.21.15.135:0/3866000318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0bc103490 0x7fd0bc10f8e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd0b400b0a0 tx=0x7fd0b400b3b0 comp rx=0 tx=0).stop 2024-04-20T12:19:57.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.770+0000 7fd0c2ad2700 1 -- 172.21.15.135:0/3866000318 shutdown_connections 2024-04-20T12:19:57.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.770+0000 7fd0c2ad2700 1 --2- 172.21.15.135:0/3866000318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0bc103490 0x7fd0bc10f8e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:57.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.770+0000 7fd0c2ad2700 1 --2- 172.21.15.135:0/3866000318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0bc108a80 0x7fd0bc108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:57.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.770+0000 7fd0c2ad2700 1 --2- 172.21.15.135:0/3866000318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0bc102ad0 0x7fd0bc102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:57.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.770+0000 7fd0c2ad2700 1 -- 172.21.15.135:0/3866000318 >> 172.21.15.135:0/3866000318 conn(0x7fd0bc079bc0 msgr2=0x7fd0bc079fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:19:57.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.770+0000 7fd0c2ad2700 1 -- 172.21.15.135:0/3866000318 shutdown_connections 2024-04-20T12:19:57.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.770+0000 7fd0c2ad2700 1 -- 172.21.15.135:0/3866000318 wait complete. 2024-04-20T12:19:57.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.770+0000 7fd0c2ad2700 1 Processor -- start 2024-04-20T12:19:57.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.770+0000 7fd0c2ad2700 1 -- start start 2024-04-20T12:19:57.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0c2ad2700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0bc102ad0 0x7fd0bc19b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:57.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0c2ad2700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0bc103490 0x7fd0bc19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:57.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0c2ad2700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0bc108a80 0x7fd0bc19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:57.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0c2ad2700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc112de0 con 0x7fd0bc103490 2024-04-20T12:19:57.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0c2ad2700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc112c60 con 0x7fd0bc108a80 2024-04-20T12:19:57.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0c2ad2700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc112f60 con 0x7fd0bc102ad0 2024-04-20T12:19:57.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0bbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0bc103490 0x7fd0bc19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:57.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0bbfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0bc103490 0x7fd0bc19b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:33582/0 (socket says 172.21.15.135:33582) 2024-04-20T12:19:57.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0bbfff700 1 -- 172.21.15.135:0/1715422316 learned_addr learned my addr 172.21.15.135:0/1715422316 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:19:57.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0c106f700 1 --2- 172.21.15.135:0/1715422316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0bc108a80 0x7fd0bc19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:57.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0c086e700 1 --2- 172.21.15.135:0/1715422316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0bc102ad0 0x7fd0bc19b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:57.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0bbfff700 1 -- 172.21.15.135:0/1715422316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0bc102ad0 msgr2=0x7fd0bc19b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:57.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0bbfff700 1 --2- 172.21.15.135:0/1715422316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0bc102ad0 0x7fd0bc19b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:57.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0bbfff700 1 -- 172.21.15.135:0/1715422316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0bc108a80 msgr2=0x7fd0bc19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:57.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0bbfff700 1 --2- 172.21.15.135:0/1715422316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0bc108a80 0x7fd0bc19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:57.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0bbfff700 1 -- 172.21.15.135:0/1715422316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0bc1a03f0 con 0x7fd0bc103490 2024-04-20T12:19:57.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0bbfff700 1 --2- 172.21.15.135:0/1715422316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0bc103490 0x7fd0bc19b920 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800d950 tx=0x7fd0a800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:19:57.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.771+0000 7fd0b9ffb700 1 -- 172.21.15.135:0/1715422316 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8016070 con 0x7fd0bc103490 2024-04-20T12:19:57.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.772+0000 7fd0b9ffb700 1 -- 172.21.15.135:0/1715422316 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0a8009e20 con 0x7fd0bc103490 2024-04-20T12:19:57.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.772+0000 7fd0b9ffb700 1 -- 172.21.15.135:0/1715422316 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a800f620 con 0x7fd0bc103490 2024-04-20T12:19:57.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.772+0000 7fd0c2ad2700 1 -- 172.21.15.135:0/1715422316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0bc1a06e0 con 0x7fd0bc103490 2024-04-20T12:19:57.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.772+0000 7fd0c2ad2700 1 -- 172.21.15.135:0/1715422316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0bc1a7f60 con 0x7fd0bc103490 2024-04-20T12:19:57.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.773+0000 7fd0c2ad2700 1 -- 172.21.15.135:0/1715422316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0bc069740 con 0x7fd0bc103490 2024-04-20T12:19:57.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.775+0000 7fd0b9ffb700 1 -- 172.21.15.135:0/1715422316 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fd0a8019070 con 0x7fd0bc103490 2024-04-20T12:19:57.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.775+0000 7fd0b9ffb700 1 --2- 172.21.15.135:0/1715422316 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd0ac0a3cc0 0x7fd0ac0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:19:57.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.775+0000 7fd0c086e700 1 --2- 172.21.15.135:0/1715422316 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd0ac0a3cc0 0x7fd0ac0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:19:57.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.775+0000 7fd0b9ffb700 1 -- 172.21.15.135:0/1715422316 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd0a80cfb90 con 0x7fd0bc103490 2024-04-20T12:19:57.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.776+0000 7fd0c086e700 1 --2- 172.21.15.135:0/1715422316 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd0ac0a3cc0 0x7fd0ac0a6180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0006fd0 tx=0x7fd0b0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:19:57.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.779+0000 7fd0b9ffb700 1 -- 172.21.15.135:0/1715422316 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fd0a809ca10 con 0x7fd0bc103490 2024-04-20T12:19:57.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.977+0000 7fd0c2ad2700 1 -- 172.21.15.135:0/1715422316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd0bc1a81f0 con 0x7fd0bc103490 2024-04-20T12:19:57.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.977+0000 7fd0b9ffb700 1 -- 172.21.15.135:0/1715422316 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7fd0a809c310 con 0x7fd0bc103490 2024-04-20T12:19:57.978 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-04-20T12:19:57.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.979+0000 7fd0c2ad2700 1 -- 172.21.15.135:0/1715422316 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd0ac0a3cc0 msgr2=0x7fd0ac0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:57.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.979+0000 7fd0c2ad2700 1 --2- 172.21.15.135:0/1715422316 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd0ac0a3cc0 0x7fd0ac0a6180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0006fd0 tx=0x7fd0b0008040 comp rx=0 tx=0).stop 2024-04-20T12:19:57.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.979+0000 7fd0c2ad2700 1 -- 172.21.15.135:0/1715422316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0bc103490 msgr2=0x7fd0bc19b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:19:57.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.980+0000 7fd0c2ad2700 1 --2- 172.21.15.135:0/1715422316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0bc103490 0x7fd0bc19b920 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800d950 tx=0x7fd0a800dc60 comp rx=0 tx=0).stop 2024-04-20T12:19:57.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.980+0000 7fd0c2ad2700 1 -- 172.21.15.135:0/1715422316 shutdown_connections 2024-04-20T12:19:57.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.980+0000 7fd0c2ad2700 1 --2- 172.21.15.135:0/1715422316 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd0ac0a3cc0 0x7fd0ac0a6180 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:57.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.980+0000 7fd0c2ad2700 1 --2- 172.21.15.135:0/1715422316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0bc108a80 0x7fd0bc19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:57.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.980+0000 7fd0c2ad2700 1 --2- 172.21.15.135:0/1715422316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd0bc102ad0 0x7fd0bc19b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:57.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.980+0000 7fd0c2ad2700 1 --2- 172.21.15.135:0/1715422316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0bc103490 0x7fd0bc19b920 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:19:57.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.980+0000 7fd0c2ad2700 1 -- 172.21.15.135:0/1715422316 >> 172.21.15.135:0/1715422316 conn(0x7fd0bc079bc0 msgr2=0x7fd0bc10de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:19:57.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.980+0000 7fd0c2ad2700 1 -- 172.21.15.135:0/1715422316 shutdown_connections 2024-04-20T12:19:57.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:19:57.980+0000 7fd0c2ad2700 1 -- 172.21.15.135:0/1715422316 wait complete. 2024-04-20T12:19:58.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:57 smithi135 ceph-mon[18264]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:19:58.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:57 smithi154 ceph-mon[22073]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:19:58.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:57 smithi139 ceph-mon[21834]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:19:58.733 INFO:tasks.cephadm:Adding mds.a on smithi135 2024-04-20T12:19:58.733 INFO:tasks.cephadm:Adding mds.d on smithi135 2024-04-20T12:19:58.733 INFO:tasks.cephadm:Adding mds.g on smithi135 2024-04-20T12:19:58.733 INFO:tasks.cephadm:Adding mds.j on smithi135 2024-04-20T12:19:58.733 INFO:tasks.cephadm:Adding mds.b on smithi139 2024-04-20T12:19:58.733 INFO:tasks.cephadm:Adding mds.e on smithi139 2024-04-20T12:19:58.733 INFO:tasks.cephadm:Adding mds.h on smithi139 2024-04-20T12:19:58.733 INFO:tasks.cephadm:Adding mds.k on smithi139 2024-04-20T12:19:58.733 INFO:tasks.cephadm:Adding mds.c on smithi154 2024-04-20T12:19:58.733 INFO:tasks.cephadm:Adding mds.f on smithi154 2024-04-20T12:19:58.733 INFO:tasks.cephadm:Adding mds.i on smithi154 2024-04-20T12:19:58.733 INFO:tasks.cephadm:Adding mds.l on smithi154 2024-04-20T12:19:58.734 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph orch apply mds all '12;smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l' 2024-04-20T12:19:58.984 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:19:59.105 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:58 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1715422316' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:19:59.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:58 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1715422316' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:19:59.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:58 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1715422316' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:20:00.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:19:59 smithi135 ceph-mon[18264]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:00.133 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:19:59 smithi154 ceph-mon[22073]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:00.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:19:59 smithi139 ceph-mon[21834]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:00.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.650+0000 7fe4be093700 1 -- 172.21.15.154:0/1364213389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b81087b0 msgr2=0x7fe4b810ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:00.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.650+0000 7fe4be093700 1 --2- 172.21.15.154:0/1364213389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b81087b0 0x7fe4b810ac20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000b0a0 tx=0x7fe4b000b3b0 comp rx=0 tx=0).stop 2024-04-20T12:20:00.650 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.650+0000 7fe4be093700 1 -- 172.21.15.154:0/1364213389 shutdown_connections 2024-04-20T12:20:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.650+0000 7fe4be093700 1 --2- 172.21.15.154:0/1364213389 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b81087b0 0x7fe4b810ac20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.650+0000 7fe4be093700 1 --2- 172.21.15.154:0/1364213389 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4b8103550 0x7fe4b8105940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.650+0000 7fe4be093700 1 --2- 172.21.15.154:0/1364213389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4b8105e80 0x7fe4b8108270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.650+0000 7fe4be093700 1 -- 172.21.15.154:0/1364213389 >> 172.21.15.154:0/1364213389 conn(0x7fe4b80fcf80 msgr2=0x7fe4b80ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.650+0000 7fe4be093700 1 -- 172.21.15.154:0/1364213389 shutdown_connections 2024-04-20T12:20:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.650+0000 7fe4be093700 1 -- 172.21.15.154:0/1364213389 wait complete. 2024-04-20T12:20:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.651+0000 7fe4be093700 1 Processor -- start 2024-04-20T12:20:00.651 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.651+0000 7fe4be093700 1 -- start start 2024-04-20T12:20:00.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.651+0000 7fe4be093700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4b8103550 0x7fe4b8102eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:00.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.651+0000 7fe4be093700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b8105e80 0x7fe4b8101500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:00.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.651+0000 7fe4be093700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4b81087b0 0x7fe4b8101a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:00.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.651+0000 7fe4be093700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b810e6f0 con 0x7fe4b8103550 2024-04-20T12:20:00.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.651+0000 7fe4be093700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b810e570 con 0x7fe4b81087b0 2024-04-20T12:20:00.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.651+0000 7fe4be093700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b810e870 con 0x7fe4b8105e80 2024-04-20T12:20:00.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4b6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b8105e80 0x7fe4b8101500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:00.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4b6ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b8105e80 0x7fe4b8101500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:35576/0 (socket says 172.21.15.154:35576) 2024-04-20T12:20:00.653 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4b6ffd700 1 -- 172.21.15.154:0/1679482490 learned_addr learned my addr 172.21.15.154:0/1679482490 (peer_addr_for_me v2:172.21.15.154:0/0) 2024-04-20T12:20:00.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4b7fff700 1 --2- 172.21.15.154:0/1679482490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4b81087b0 0x7fe4b8101a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:00.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4b77fe700 1 --2- 172.21.15.154:0/1679482490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4b8103550 0x7fe4b8102eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:00.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4b6ffd700 1 -- 172.21.15.154:0/1679482490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4b81087b0 msgr2=0x7fe4b8101a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:00.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4b6ffd700 1 --2- 172.21.15.154:0/1679482490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4b81087b0 0x7fe4b8101a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:00.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4b6ffd700 1 -- 172.21.15.154:0/1679482490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4b8103550 msgr2=0x7fe4b8102eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:00.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4b6ffd700 1 --2- 172.21.15.154:0/1679482490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4b8103550 0x7fe4b8102eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:00.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4b6ffd700 1 -- 172.21.15.154:0/1679482490 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b81022f0 con 0x7fe4b8105e80 2024-04-20T12:20:00.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4b77fe700 1 --2- 172.21.15.154:0/1679482490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4b8103550 0x7fe4b8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:20:00.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4b6ffd700 1 --2- 172.21.15.154:0/1679482490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b8105e80 0x7fe4b8101500 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00c920 tx=0x7fe4ac00cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:00.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4b4ff9700 1 -- 172.21.15.154:0/1679482490 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac007b00 con 0x7fe4b8105e80 2024-04-20T12:20:00.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4b4ff9700 1 -- 172.21.15.154:0/1679482490 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4ac004d10 con 0x7fe4b8105e80 2024-04-20T12:20:00.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4b4ff9700 1 -- 172.21.15.154:0/1679482490 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac00f450 con 0x7fe4b8105e80 2024-04-20T12:20:00.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4be093700 1 -- 172.21.15.154:0/1679482490 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b81a2f00 con 0x7fe4b8105e80 2024-04-20T12:20:00.654 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.652+0000 7fe4be093700 1 -- 172.21.15.154:0/1679482490 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b81a3350 con 0x7fe4b8105e80 2024-04-20T12:20:00.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.653+0000 7fe4be093700 1 -- 172.21.15.154:0/1679482490 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b802df90 con 0x7fe4b8105e80 2024-04-20T12:20:00.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.654+0000 7fe4b4ff9700 1 -- 172.21.15.154:0/1679482490 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fe4ac004750 con 0x7fe4b8105e80 2024-04-20T12:20:00.655 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.655+0000 7fe4b4ff9700 1 --2- 172.21.15.154:0/1679482490 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe4a00a3c40 0x7fe4a00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:00.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.655+0000 7fe4b4ff9700 1 -- 172.21.15.154:0/1679482490 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fe4ac0cff40 con 0x7fe4b8105e80 2024-04-20T12:20:00.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.655+0000 7fe4b77fe700 1 --2- 172.21.15.154:0/1679482490 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe4a00a3c40 0x7fe4a00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:00.656 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.656+0000 7fe4b77fe700 1 --2- 172.21.15.154:0/1679482490 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe4a00a3c40 0x7fe4a00a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80099d0 tx=0x7fe4a8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:00.658 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.659+0000 7fe4b4ff9700 1 -- 172.21.15.154:0/1679482490 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fe4ac014030 con 0x7fe4b8105e80 2024-04-20T12:20:00.869 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.870+0000 7fe4be093700 1 -- 172.21.15.154:0/1679482490 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}) -- 0x7fe4b8062f90 con 0x7fe4a00a3c40 2024-04-20T12:20:00.876 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.877+0000 7fe4b4ff9700 1 -- 172.21.15.154:0/1679482490 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fe4b8062f90 con 0x7fe4a00a3c40 2024-04-20T12:20:00.877 INFO:teuthology.orchestra.run.smithi154.stdout:Scheduled mds.all update... 2024-04-20T12:20:00.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.879+0000 7fe4be093700 1 -- 172.21.15.154:0/1679482490 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe4a00a3c40 msgr2=0x7fe4a00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:00.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.879+0000 7fe4be093700 1 --2- 172.21.15.154:0/1679482490 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe4a00a3c40 0x7fe4a00a6100 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80099d0 tx=0x7fe4a8008040 comp rx=0 tx=0).stop 2024-04-20T12:20:00.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.879+0000 7fe4be093700 1 -- 172.21.15.154:0/1679482490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b8105e80 msgr2=0x7fe4b8101500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:00.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.879+0000 7fe4be093700 1 --2- 172.21.15.154:0/1679482490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b8105e80 0x7fe4b8101500 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00c920 tx=0x7fe4ac00cce0 comp rx=0 tx=0).stop 2024-04-20T12:20:00.879 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.879+0000 7fe4be093700 1 -- 172.21.15.154:0/1679482490 shutdown_connections 2024-04-20T12:20:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.879+0000 7fe4be093700 1 --2- 172.21.15.154:0/1679482490 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe4a00a3c40 0x7fe4a00a6100 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.879+0000 7fe4be093700 1 --2- 172.21.15.154:0/1679482490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4b81087b0 0x7fe4b8101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.879+0000 7fe4be093700 1 --2- 172.21.15.154:0/1679482490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4b8103550 0x7fe4b8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.879+0000 7fe4be093700 1 --2- 172.21.15.154:0/1679482490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4b8105e80 0x7fe4b8101500 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.879+0000 7fe4be093700 1 -- 172.21.15.154:0/1679482490 >> 172.21.15.154:0/1679482490 conn(0x7fe4b80fcf80 msgr2=0x7fe4b8103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.880+0000 7fe4be093700 1 -- 172.21.15.154:0/1679482490 shutdown_connections 2024-04-20T12:20:00.880 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-20T12:20:00.880+0000 7fe4be093700 1 -- 172.21.15.154:0/1679482490 wait complete. 2024-04-20T12:20:01.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:00 smithi135 ceph-mon[18264]: overall HEALTH_OK 2024-04-20T12:20:01.241 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:00 smithi154 ceph-mon[22073]: overall HEALTH_OK 2024-04-20T12:20:01.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:00 smithi139 ceph-mon[21834]: overall HEALTH_OK 2024-04-20T12:20:01.570 DEBUG:teuthology.orchestra.run.smithi135:mds.a> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.a.service 2024-04-20T12:20:01.574 DEBUG:teuthology.orchestra.run.smithi135:mds.d> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.d.service 2024-04-20T12:20:01.617 DEBUG:teuthology.orchestra.run.smithi135:mds.g> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.g.service 2024-04-20T12:20:01.661 DEBUG:teuthology.orchestra.run.smithi135:mds.j> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.j.service 2024-04-20T12:20:01.703 DEBUG:teuthology.orchestra.run.smithi139:mds.b> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.b.service 2024-04-20T12:20:01.706 DEBUG:teuthology.orchestra.run.smithi139:mds.e> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.e.service 2024-04-20T12:20:01.748 DEBUG:teuthology.orchestra.run.smithi139:mds.h> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.h.service 2024-04-20T12:20:01.791 DEBUG:teuthology.orchestra.run.smithi139:mds.k> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.k.service 2024-04-20T12:20:01.834 DEBUG:teuthology.orchestra.run.smithi154:mds.c> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.c.service 2024-04-20T12:20:01.837 DEBUG:teuthology.orchestra.run.smithi154:mds.f> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.f.service 2024-04-20T12:20:01.880 DEBUG:teuthology.orchestra.run.smithi154:mds.i> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.i.service 2024-04-20T12:20:01.923 DEBUG:teuthology.orchestra.run.smithi154:mds.l> sudo journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.l.service 2024-04-20T12:20:01.966 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-04-20T12:20:01.966 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:20:02.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:01 smithi139 ceph-mon[21834]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:02.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:01 smithi139 ceph-mon[21834]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:20:02.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:01 smithi139 ceph-mon[21834]: Saving service mds.all spec with placement smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-04-20T12:20:02.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:02.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:20:02.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:02.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:20:02.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:02.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:02.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:02.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:01 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:02.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.080+0000 7fd575a26640 1 -- 172.21.15.135:0/1538351691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5701009d0 msgr2=0x7fd57010a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:02.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.080+0000 7fd575a26640 1 --2- 172.21.15.135:0/1538351691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5701009d0 0x7fd57010a580 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd568009ca0 tx=0x7fd56802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.080+0000 7fd575a26640 1 -- 172.21.15.135:0/1538351691 shutdown_connections 2024-04-20T12:20:02.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.080+0000 7fd575a26640 1 --2- 172.21.15.135:0/1538351691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5701009d0 0x7fd57010a580 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.080+0000 7fd575a26640 1 --2- 172.21.15.135:0/1538351691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd570100010 0x7fd570100490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.080+0000 7fd575a26640 1 --2- 172.21.15.135:0/1538351691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5701035a0 0x7fd5701039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.080+0000 7fd575a26640 1 -- 172.21.15.135:0/1538351691 >> 172.21.15.135:0/1538351691 conn(0x7fd5700fbbd0 msgr2=0x7fd5700fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:02.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.080+0000 7fd575a26640 1 -- 172.21.15.135:0/1538351691 shutdown_connections 2024-04-20T12:20:02.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.080+0000 7fd575a26640 1 -- 172.21.15.135:0/1538351691 wait complete. 2024-04-20T12:20:02.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd575a26640 1 Processor -- start 2024-04-20T12:20:02.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd575a26640 1 -- start start 2024-04-20T12:20:02.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd575a26640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd570100010 0x7fd570198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:02.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd575a26640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5701009d0 0x7fd570198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:02.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd575a26640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5701035a0 0x7fd57019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:02.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd575a26640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd57010dc40 con 0x7fd570100010 2024-04-20T12:20:02.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd575a26640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd57010dac0 con 0x7fd5701035a0 2024-04-20T12:20:02.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd575a26640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd57010ddc0 con 0x7fd5701009d0 2024-04-20T12:20:02.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd56effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd570100010 0x7fd570198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:02.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd56effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd570100010 0x7fd570198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59322/0 (socket says 172.21.15.135:59322) 2024-04-20T12:20:02.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd56effd640 1 -- 172.21.15.135:0/3899123038 learned_addr learned my addr 172.21.15.135:0/3899123038 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:02.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd56e7fc640 1 --2- 172.21.15.135:0/3899123038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5701009d0 0x7fd570198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:02.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd56f7fe640 1 --2- 172.21.15.135:0/3899123038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5701035a0 0x7fd57019f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:02.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd56effd640 1 -- 172.21.15.135:0/3899123038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5701009d0 msgr2=0x7fd570198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:02.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd56effd640 1 --2- 172.21.15.135:0/3899123038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5701009d0 0x7fd570198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.081+0000 7fd56effd640 1 -- 172.21.15.135:0/3899123038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5701035a0 msgr2=0x7fd57019f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:02.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.082+0000 7fd56effd640 1 --2- 172.21.15.135:0/3899123038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5701035a0 0x7fd57019f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.082+0000 7fd56effd640 1 -- 172.21.15.135:0/3899123038 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57019fe50 con 0x7fd570100010 2024-04-20T12:20:02.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.082+0000 7fd56effd640 1 --2- 172.21.15.135:0/3899123038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd570100010 0x7fd570198230 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd56400d950 tx=0x7fd56400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:02.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.082+0000 7fd574a24640 1 -- 172.21.15.135:0/3899123038 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd564017020 con 0x7fd570100010 2024-04-20T12:20:02.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.082+0000 7fd574a24640 1 -- 172.21.15.135:0/3899123038 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd564009c30 con 0x7fd570100010 2024-04-20T12:20:02.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.082+0000 7fd575a26640 1 -- 172.21.15.135:0/3899123038 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5701a0140 con 0x7fd570100010 2024-04-20T12:20:02.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.082+0000 7fd574a24640 1 -- 172.21.15.135:0/3899123038 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56400f740 con 0x7fd570100010 2024-04-20T12:20:02.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.082+0000 7fd575a26640 1 -- 172.21.15.135:0/3899123038 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5701a0690 con 0x7fd570100010 2024-04-20T12:20:02.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.083+0000 7fd575a26640 1 -- 172.21.15.135:0/3899123038 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd570109460 con 0x7fd570100010 2024-04-20T12:20:02.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.084+0000 7fd574a24640 1 -- 172.21.15.135:0/3899123038 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fd56401a020 con 0x7fd570100010 2024-04-20T12:20:02.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.085+0000 7fd574a24640 1 --2- 172.21.15.135:0/3899123038 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd5580a3bb0 0x7fd5580a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:02.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.085+0000 7fd56e7fc640 1 --2- 172.21.15.135:0/3899123038 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd5580a3bb0 0x7fd5580a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:02.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.085+0000 7fd574a24640 1 -- 172.21.15.135:0/3899123038 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd5640cfbb0 con 0x7fd570100010 2024-04-20T12:20:02.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.085+0000 7fd56e7fc640 1 --2- 172.21.15.135:0/3899123038 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd5580a3bb0 0x7fd5580a6070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd570199740 tx=0x7fd560005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:02.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.088+0000 7fd574a24640 1 -- 172.21.15.135:0/3899123038 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fd564021070 con 0x7fd570100010 2024-04-20T12:20:02.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:01 smithi154 ceph-mon[22073]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:02.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:01 smithi154 ceph-mon[22073]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:20:02.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:01 smithi154 ceph-mon[22073]: Saving service mds.all spec with placement smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-04-20T12:20:02.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:02.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:20:02.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:02.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:20:02.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:02.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:02.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:02.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:01 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:02.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.271+0000 7fd575a26640 1 -- 172.21.15.135:0/3899123038 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd570062b90 con 0x7fd570100010 2024-04-20T12:20:02.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.273+0000 7fd574a24640 1 -- 172.21.15.135:0/3899123038 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18501 (secure 0 0 0) 0x7fd564009de0 con 0x7fd570100010 2024-04-20T12:20:02.273 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:02.273 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":81,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:19:52.572918+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:20:02.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.275+0000 7fd575a26640 1 -- 172.21.15.135:0/3899123038 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd5580a3bb0 msgr2=0x7fd5580a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:02.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.275+0000 7fd575a26640 1 --2- 172.21.15.135:0/3899123038 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd5580a3bb0 0x7fd5580a6070 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd570199740 tx=0x7fd560005f90 comp rx=0 tx=0).stop 2024-04-20T12:20:02.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.275+0000 7fd575a26640 1 -- 172.21.15.135:0/3899123038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd570100010 msgr2=0x7fd570198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:02.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.275+0000 7fd575a26640 1 --2- 172.21.15.135:0/3899123038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd570100010 0x7fd570198230 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd56400d950 tx=0x7fd56400de10 comp rx=0 tx=0).stop 2024-04-20T12:20:02.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.275+0000 7fd575a26640 1 -- 172.21.15.135:0/3899123038 shutdown_connections 2024-04-20T12:20:02.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.275+0000 7fd575a26640 1 --2- 172.21.15.135:0/3899123038 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd5580a3bb0 0x7fd5580a6070 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.275+0000 7fd575a26640 1 --2- 172.21.15.135:0/3899123038 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5701035a0 0x7fd57019f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.275+0000 7fd575a26640 1 --2- 172.21.15.135:0/3899123038 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5701009d0 0x7fd570198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.275+0000 7fd575a26640 1 --2- 172.21.15.135:0/3899123038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd570100010 0x7fd570198230 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.275+0000 7fd575a26640 1 -- 172.21.15.135:0/3899123038 >> 172.21.15.135:0/3899123038 conn(0x7fd5700fbbd0 msgr2=0x7fd570106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:02.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.275+0000 7fd575a26640 1 -- 172.21.15.135:0/3899123038 shutdown_connections 2024-04-20T12:20:02.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.275+0000 7fd575a26640 1 -- 172.21.15.135:0/3899123038 wait complete. 2024-04-20T12:20:02.285 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:01 smithi135 ceph-mon[18264]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:02.285 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:01 smithi135 ceph-mon[18264]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:20:02.285 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:01 smithi135 ceph-mon[18264]: Saving service mds.all spec with placement smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-04-20T12:20:02.285 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:02.285 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:20:02.285 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:02.285 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:20:02.285 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:02.285 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:02.286 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:02.286 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:01 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:02.287 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T12:16:02.802023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T12:20:02.287 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T12:20:02.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.388+0000 7fd3017bd640 1 -- 172.21.15.135:0/2903012570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2fc1031a0 msgr2=0x7fd2fc103620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:02.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.388+0000 7fd3017bd640 1 --2- 172.21.15.135:0/2903012570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2fc1031a0 0x7fd2fc103620 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009900 tx=0x7fd2f002bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:02.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.388+0000 7fd3017bd640 1 -- 172.21.15.135:0/2903012570 shutdown_connections 2024-04-20T12:20:02.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.388+0000 7fd3017bd640 1 --2- 172.21.15.135:0/2903012570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2fc103b60 0x7fd2fc10a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.388+0000 7fd3017bd640 1 --2- 172.21.15.135:0/2903012570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2fc1031a0 0x7fd2fc103620 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.388+0000 7fd3017bd640 1 --2- 172.21.15.135:0/2903012570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc101fb0 0x7fd2fc1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.388+0000 7fd3017bd640 1 -- 172.21.15.135:0/2903012570 >> 172.21.15.135:0/2903012570 conn(0x7fd2fc0fd540 msgr2=0x7fd2fc0ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:02.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.388+0000 7fd3017bd640 1 -- 172.21.15.135:0/2903012570 shutdown_connections 2024-04-20T12:20:02.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.388+0000 7fd3017bd640 1 -- 172.21.15.135:0/2903012570 wait complete. 2024-04-20T12:20:02.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.389+0000 7fd3017bd640 1 Processor -- start 2024-04-20T12:20:02.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.389+0000 7fd3017bd640 1 -- start start 2024-04-20T12:20:02.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.389+0000 7fd3017bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc101fb0 0x7fd2fc1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:02.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.389+0000 7fd3017bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2fc1031a0 0x7fd2fc198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:02.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.389+0000 7fd3017bd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2fc103b60 0x7fd2fc19f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:02.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.389+0000 7fd3017bd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc10dc40 con 0x7fd2fc1031a0 2024-04-20T12:20:02.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.389+0000 7fd3017bd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc10dac0 con 0x7fd2fc103b60 2024-04-20T12:20:02.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.389+0000 7fd3017bd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc10ddc0 con 0x7fd2fc101fb0 2024-04-20T12:20:02.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.389+0000 7fd2fa7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2fc1031a0 0x7fd2fc198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:02.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.389+0000 7fd2fa7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2fc1031a0 0x7fd2fc198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59344/0 (socket says 172.21.15.135:59344) 2024-04-20T12:20:02.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.389+0000 7fd2fa7fc640 1 -- 172.21.15.135:0/2103294683 learned_addr learned my addr 172.21.15.135:0/2103294683 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:02.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.389+0000 7fd2faffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc101fb0 0x7fd2fc1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:02.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.389+0000 7fd2fb7fe640 1 --2- 172.21.15.135:0/2103294683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2fc103b60 0x7fd2fc19f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:02.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.390+0000 7fd2fa7fc640 1 -- 172.21.15.135:0/2103294683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc101fb0 msgr2=0x7fd2fc1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:02.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.390+0000 7fd2fa7fc640 1 --2- 172.21.15.135:0/2103294683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc101fb0 0x7fd2fc1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.390+0000 7fd2fa7fc640 1 -- 172.21.15.135:0/2103294683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2fc103b60 msgr2=0x7fd2fc19f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:02.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.390+0000 7fd2fa7fc640 1 --2- 172.21.15.135:0/2103294683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2fc103b60 0x7fd2fc19f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.390+0000 7fd2fa7fc640 1 -- 172.21.15.135:0/2103294683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2fc19ff10 con 0x7fd2fc1031a0 2024-04-20T12:20:02.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.390+0000 7fd2faffd640 1 --2- 172.21.15.135:0/2103294683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc101fb0 0x7fd2fc1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:20:02.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.390+0000 7fd2fa7fc640 1 --2- 172.21.15.135:0/2103294683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2fc1031a0 0x7fd2fc198830 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009230 tx=0x7fd2f0005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:02.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.390+0000 7fd2e3fff640 1 -- 172.21.15.135:0/2103294683 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0041070 con 0x7fd2fc1031a0 2024-04-20T12:20:02.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.390+0000 7fd3017bd640 1 -- 172.21.15.135:0/2103294683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2fc1a01a0 con 0x7fd2fc1031a0 2024-04-20T12:20:02.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.390+0000 7fd2e3fff640 1 -- 172.21.15.135:0/2103294683 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd2f00044d0 con 0x7fd2fc1031a0 2024-04-20T12:20:02.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.390+0000 7fd2e3fff640 1 -- 172.21.15.135:0/2103294683 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0034440 con 0x7fd2fc1031a0 2024-04-20T12:20:02.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.390+0000 7fd3017bd640 1 -- 172.21.15.135:0/2103294683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2fc1a06e0 con 0x7fd2fc1031a0 2024-04-20T12:20:02.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.391+0000 7fd3017bd640 1 -- 172.21.15.135:0/2103294683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2fc109350 con 0x7fd2fc1031a0 2024-04-20T12:20:02.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.392+0000 7fd2e3fff640 1 -- 172.21.15.135:0/2103294683 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fd2f0044070 con 0x7fd2fc1031a0 2024-04-20T12:20:02.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.393+0000 7fd2e3fff640 1 --2- 172.21.15.135:0/2103294683 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd2e40a3bb0 0x7fd2e40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:02.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.393+0000 7fd2faffd640 1 --2- 172.21.15.135:0/2103294683 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd2e40a3bb0 0x7fd2e40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:02.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.393+0000 7fd2e3fff640 1 -- 172.21.15.135:0/2103294683 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7fd2f00f1ed0 con 0x7fd2fc1031a0 2024-04-20T12:20:02.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.393+0000 7fd2faffd640 1 --2- 172.21.15.135:0/2103294683 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd2e40a3bb0 0x7fd2e40a6070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc103000 tx=0x7fd2ec009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:02.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.397+0000 7fd2e3fff640 1 -- 172.21.15.135:0/2103294683 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fd2f00be700 con 0x7fd2fc1031a0 2024-04-20T12:20:02.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.573+0000 7fd3017bd640 1 -- 172.21.15.135:0/2103294683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd2fc02d5d0 con 0x7fd2fc1031a0 2024-04-20T12:20:02.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.573+0000 7fd2e3fff640 1 -- 172.21.15.135:0/2103294683 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7fd2f00c2a00 con 0x7fd2fc1031a0 2024-04-20T12:20:02.573 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-04-20T12:20:02.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.575+0000 7fd3017bd640 1 -- 172.21.15.135:0/2103294683 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd2e40a3bb0 msgr2=0x7fd2e40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:02.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.575+0000 7fd3017bd640 1 --2- 172.21.15.135:0/2103294683 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd2e40a3bb0 0x7fd2e40a6070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc103000 tx=0x7fd2ec009500 comp rx=0 tx=0).stop 2024-04-20T12:20:02.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.575+0000 7fd3017bd640 1 -- 172.21.15.135:0/2103294683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2fc1031a0 msgr2=0x7fd2fc198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:02.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.575+0000 7fd3017bd640 1 --2- 172.21.15.135:0/2103294683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2fc1031a0 0x7fd2fc198830 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009230 tx=0x7fd2f0005d50 comp rx=0 tx=0).stop 2024-04-20T12:20:02.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.575+0000 7fd3017bd640 1 -- 172.21.15.135:0/2103294683 shutdown_connections 2024-04-20T12:20:02.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.575+0000 7fd3017bd640 1 --2- 172.21.15.135:0/2103294683 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd2e40a3bb0 0x7fd2e40a6070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.575+0000 7fd3017bd640 1 --2- 172.21.15.135:0/2103294683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd2fc103b60 0x7fd2fc19f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.575+0000 7fd3017bd640 1 --2- 172.21.15.135:0/2103294683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd2fc1031a0 0x7fd2fc198830 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.575+0000 7fd3017bd640 1 --2- 172.21.15.135:0/2103294683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2fc101fb0 0x7fd2fc1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.575+0000 7fd3017bd640 1 -- 172.21.15.135:0/2103294683 >> 172.21.15.135:0/2103294683 conn(0x7fd2fc0fd540 msgr2=0x7fd2fc106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:02.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.575+0000 7fd3017bd640 1 -- 172.21.15.135:0/2103294683 shutdown_connections 2024-04-20T12:20:02.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.575+0000 7fd3017bd640 1 -- 172.21.15.135:0/2103294683 wait complete. 2024-04-20T12:20:02.586 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:02.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.685+0000 7f408ae7b640 1 -- 172.21.15.135:0/2434258139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4084102a00 msgr2=0x7f4084109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:02.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.685+0000 7f408ae7b640 1 --2- 172.21.15.135:0/2434258139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4084102a00 0x7f4084109320 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f407c009ca0 tx=0x7f407c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.685+0000 7f408ae7b640 1 -- 172.21.15.135:0/2434258139 shutdown_connections 2024-04-20T12:20:02.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.685+0000 7f408ae7b640 1 --2- 172.21.15.135:0/2434258139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4084102a00 0x7f4084109320 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.685+0000 7f408ae7b640 1 --2- 172.21.15.135:0/2434258139 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4084102040 0x7f40841024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.685+0000 7f408ae7b640 1 --2- 172.21.15.135:0/2434258139 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4084100e60 0x7f4084101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.685+0000 7f408ae7b640 1 -- 172.21.15.135:0/2434258139 >> 172.21.15.135:0/2434258139 conn(0x7f40840fc440 msgr2=0x7f40840fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:02.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.685+0000 7f408ae7b640 1 -- 172.21.15.135:0/2434258139 shutdown_connections 2024-04-20T12:20:02.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.685+0000 7f408ae7b640 1 -- 172.21.15.135:0/2434258139 wait complete. 2024-04-20T12:20:02.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.685+0000 7f408ae7b640 1 Processor -- start 2024-04-20T12:20:02.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.685+0000 7f408ae7b640 1 -- start start 2024-04-20T12:20:02.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.685+0000 7f408ae7b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4084100e60 0x7f408419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:02.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.685+0000 7f408ae7b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4084102040 0x7f408419a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:02.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.685+0000 7f408ae7b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4084102a00 0x7f40841a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:02.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f408ae7b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f408410cb60 con 0x7f4084102a00 2024-04-20T12:20:02.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f408ae7b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f408410c9e0 con 0x7f4084100e60 2024-04-20T12:20:02.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f408ae7b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f408410cce0 con 0x7f4084102040 2024-04-20T12:20:02.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f4083fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4084102040 0x7f408419a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:02.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f4089418640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4084102a00 0x7f40841a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:02.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f4083fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4084102040 0x7f408419a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.135:37962/0 (socket says 172.21.15.135:37962) 2024-04-20T12:20:02.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f4083fff640 1 -- 172.21.15.135:0/1865999565 learned_addr learned my addr 172.21.15.135:0/1865999565 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:02.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f4088c17640 1 --2- 172.21.15.135:0/1865999565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4084100e60 0x7f408419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:02.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f4089418640 1 -- 172.21.15.135:0/1865999565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4084102040 msgr2=0x7f408419a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:02.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f4089418640 1 --2- 172.21.15.135:0/1865999565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4084102040 0x7f408419a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f4089418640 1 -- 172.21.15.135:0/1865999565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4084100e60 msgr2=0x7f408419a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:02.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f4089418640 1 --2- 172.21.15.135:0/1865999565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4084100e60 0x7f408419a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f4089418640 1 -- 172.21.15.135:0/1865999565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40841a2060 con 0x7f4084102a00 2024-04-20T12:20:02.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f4083fff640 1 --2- 172.21.15.135:0/1865999565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4084102040 0x7f408419a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:20:02.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f4089418640 1 --2- 172.21.15.135:0/1865999565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4084102a00 0x7f40841a19f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f407c02c630 tx=0x7f407c032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:02.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f4081ffb640 1 -- 172.21.15.135:0/1865999565 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c041020 con 0x7f4084102a00 2024-04-20T12:20:02.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f408ae7b640 1 -- 172.21.15.135:0/1865999565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40841a22f0 con 0x7f4084102a00 2024-04-20T12:20:02.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f4081ffb640 1 -- 172.21.15.135:0/1865999565 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f407c034cd0 con 0x7f4084102a00 2024-04-20T12:20:02.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f4081ffb640 1 -- 172.21.15.135:0/1865999565 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c039040 con 0x7f4084102a00 2024-04-20T12:20:02.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.686+0000 7f408ae7b640 1 -- 172.21.15.135:0/1865999565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40841a27b0 con 0x7f4084102a00 2024-04-20T12:20:02.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.687+0000 7f408ae7b640 1 -- 172.21.15.135:0/1865999565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40841a2a10 con 0x7f4084102a00 2024-04-20T12:20:02.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.689+0000 7f4081ffb640 1 -- 172.21.15.135:0/1865999565 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f407c044020 con 0x7f4084102a00 2024-04-20T12:20:02.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.689+0000 7f4081ffb640 1 --2- 172.21.15.135:0/1865999565 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f40740a3bb0 0x7f40740a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:02.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.689+0000 7f4088c17640 1 --2- 172.21.15.135:0/1865999565 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f40740a3bb0 0x7f40740a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:02.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.689+0000 7f4081ffb640 1 -- 172.21.15.135:0/1865999565 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f407c0f2120 con 0x7f4084102a00 2024-04-20T12:20:02.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.689+0000 7f4088c17640 1 --2- 172.21.15.135:0/1865999565 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f40740a3bb0 0x7f40740a6070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4084101bb0 tx=0x7f4078005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:02.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.692+0000 7f4081ffb640 1 -- 172.21.15.135:0/1865999565 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f407c04b020 con 0x7f4084102a00 2024-04-20T12:20:02.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.913+0000 7f408ae7b640 1 -- 172.21.15.135:0/1865999565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40841a2da0 con 0x7f4084102a00 2024-04-20T12:20:02.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.913+0000 7f4081ffb640 1 -- 172.21.15.135:0/1865999565 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f407c0bf010 con 0x7f4084102a00 2024-04-20T12:20:02.914 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:02.914 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-20T12:20:02.914 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 1 2024-04-20T12:20:02.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.916+0000 7f408ae7b640 1 -- 172.21.15.135:0/1865999565 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f40740a3bb0 msgr2=0x7f40740a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:02.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.916+0000 7f408ae7b640 1 --2- 172.21.15.135:0/1865999565 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f40740a3bb0 0x7f40740a6070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4084101bb0 tx=0x7f4078005f90 comp rx=0 tx=0).stop 2024-04-20T12:20:02.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.916+0000 7f408ae7b640 1 -- 172.21.15.135:0/1865999565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4084102a00 msgr2=0x7f40841a19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:02.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.916+0000 7f408ae7b640 1 --2- 172.21.15.135:0/1865999565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4084102a00 0x7f40841a19f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f407c02c630 tx=0x7f407c032f20 comp rx=0 tx=0).stop 2024-04-20T12:20:02.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.916+0000 7f408ae7b640 1 -- 172.21.15.135:0/1865999565 shutdown_connections 2024-04-20T12:20:02.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.916+0000 7f408ae7b640 1 --2- 172.21.15.135:0/1865999565 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f40740a3bb0 0x7f40740a6070 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.916+0000 7f408ae7b640 1 --2- 172.21.15.135:0/1865999565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4084102a00 0x7f40841a19f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.916+0000 7f408ae7b640 1 --2- 172.21.15.135:0/1865999565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4084102040 0x7f408419a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.916+0000 7f408ae7b640 1 --2- 172.21.15.135:0/1865999565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4084100e60 0x7f408419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:02.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.916+0000 7f408ae7b640 1 -- 172.21.15.135:0/1865999565 >> 172.21.15.135:0/1865999565 conn(0x7f40840fc440 msgr2=0x7f40840fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:02.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.916+0000 7f408ae7b640 1 -- 172.21.15.135:0/1865999565 shutdown_connections 2024-04-20T12:20:02.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:02.916+0000 7f408ae7b640 1 -- 172.21.15.135:0/1865999565 wait complete. 2024-04-20T12:20:03.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:02 smithi154 ceph-mon[22073]: Deploying daemon mds.l on smithi154 2024-04-20T12:20:03.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:02 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3899123038' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:03.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:02 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2103294683' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:20:03.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:02 smithi139 ceph-mon[21834]: Deploying daemon mds.l on smithi154 2024-04-20T12:20:03.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:02 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3899123038' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:03.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:02 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2103294683' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:20:03.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:02 smithi135 ceph-mon[18264]: Deploying daemon mds.l on smithi154 2024-04-20T12:20:03.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:02 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3899123038' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:03.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:02 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2103294683' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:20:04.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:03 smithi154 ceph-mon[22073]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:04.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:03 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1865999565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:04.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:03 smithi135 ceph-mon[18264]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:04.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:03 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1865999565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:04.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:03 smithi139 ceph-mon[21834]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:04.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:03 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1865999565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:04.751 INFO:journalctl@ceph.mds.l.smithi154.stdout:Apr 20 12:20:04 smithi154 systemd[1]: Started Ceph mds.l for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:20:04.927 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:05.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.038+0000 7f808d274640 1 -- 172.21.15.135:0/3707188954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8088103c00 msgr2=0x7f808810a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:05.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.038+0000 7f808d274640 1 --2- 172.21.15.135:0/3707188954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8088103c00 0x7f808810a490 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8080009cd0 tx=0x7f808002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:05.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.038+0000 7f808d274640 1 -- 172.21.15.135:0/3707188954 shutdown_connections 2024-04-20T12:20:05.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.038+0000 7f808d274640 1 --2- 172.21.15.135:0/3707188954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8088103c00 0x7f808810a490 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:05.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.038+0000 7f808d274640 1 --2- 172.21.15.135:0/3707188954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8088103240 0x7f80881036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:05.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.038+0000 7f808d274640 1 --2- 172.21.15.135:0/3707188954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8088100270 0x7f8088100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:05.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.038+0000 7f808d274640 1 -- 172.21.15.135:0/3707188954 >> 172.21.15.135:0/3707188954 conn(0x7f80880fbba0 msgr2=0x7f80880fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:05.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.038+0000 7f808d274640 1 -- 172.21.15.135:0/3707188954 shutdown_connections 2024-04-20T12:20:05.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.038+0000 7f808d274640 1 -- 172.21.15.135:0/3707188954 wait complete. 2024-04-20T12:20:05.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f808d274640 1 Processor -- start 2024-04-20T12:20:05.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f808d274640 1 -- start start 2024-04-20T12:20:05.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f808d274640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8088100270 0x7f80881982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:05.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f808d274640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8088103240 0x7f8088198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:05.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f808d274640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8088103c00 0x7f808819f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:05.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f808d274640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f808810dc20 con 0x7f8088100270 2024-04-20T12:20:05.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f808d274640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f808810daa0 con 0x7f8088103240 2024-04-20T12:20:05.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f808d274640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f808810dda0 con 0x7f8088103c00 2024-04-20T12:20:05.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f8086ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8088100270 0x7f80881982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:05.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f8086ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8088100270 0x7f80881982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59382/0 (socket says 172.21.15.135:59382) 2024-04-20T12:20:05.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f8086ffd640 1 -- 172.21.15.135:0/3631305481 learned_addr learned my addr 172.21.15.135:0/3631305481 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f807ffff640 1 --2- 172.21.15.135:0/3631305481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8088103240 0x7f8088198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f80877fe640 1 --2- 172.21.15.135:0/3631305481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8088103c00 0x7f808819f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f8086ffd640 1 -- 172.21.15.135:0/3631305481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8088103c00 msgr2=0x7f808819f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f8086ffd640 1 --2- 172.21.15.135:0/3631305481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8088103c00 0x7f808819f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f8086ffd640 1 -- 172.21.15.135:0/3631305481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8088103240 msgr2=0x7f8088198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f8086ffd640 1 --2- 172.21.15.135:0/3631305481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8088103240 0x7f8088198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f8086ffd640 1 -- 172.21.15.135:0/3631305481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f808819fea0 con 0x7f8088100270 2024-04-20T12:20:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.039+0000 7f80877fe640 1 --2- 172.21.15.135:0/3631305481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8088103c00 0x7f808819f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:20:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.040+0000 7f8086ffd640 1 --2- 172.21.15.135:0/3631305481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8088100270 0x7f80881982d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f807800d950 tx=0x7f807800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.040+0000 7f8084ff9640 1 -- 172.21.15.135:0/3631305481 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078017020 con 0x7f8088100270 2024-04-20T12:20:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.040+0000 7f8084ff9640 1 -- 172.21.15.135:0/3631305481 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8078009c30 con 0x7f8088100270 2024-04-20T12:20:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.040+0000 7f808d274640 1 -- 172.21.15.135:0/3631305481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80881a0190 con 0x7f8088100270 2024-04-20T12:20:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.040+0000 7f8084ff9640 1 -- 172.21.15.135:0/3631305481 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807800f740 con 0x7f8088100270 2024-04-20T12:20:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.040+0000 7f808d274640 1 -- 172.21.15.135:0/3631305481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80881a0730 con 0x7f8088100270 2024-04-20T12:20:05.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.041+0000 7f808d274640 1 -- 172.21.15.135:0/3631305481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8088109440 con 0x7f8088100270 2024-04-20T12:20:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.042+0000 7f8084ff9640 1 -- 172.21.15.135:0/3631305481 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f807801a020 con 0x7f8088100270 2024-04-20T12:20:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.043+0000 7f8084ff9640 1 --2- 172.21.15.135:0/3631305481 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f80740a3c30 0x7f80740a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.043+0000 7f807ffff640 1 --2- 172.21.15.135:0/3631305481 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f80740a3c30 0x7f80740a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:05.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.043+0000 7f8084ff9640 1 -- 172.21.15.135:0/3631305481 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f80780cf8e0 con 0x7f8088100270 2024-04-20T12:20:05.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.043+0000 7f807ffff640 1 --2- 172.21.15.135:0/3631305481 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f80740a3c30 0x7f80740a60f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8088199790 tx=0x7f807000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:05.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.048+0000 7f8084ff9640 1 -- 172.21.15.135:0/3631305481 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f8078021070 con 0x7f8088100270 2024-04-20T12:20:05.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.263+0000 7f808d274640 1 -- 172.21.15.135:0/3631305481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f808802d880 con 0x7f8088100270 2024-04-20T12:20:05.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.264+0000 7f8084ff9640 1 -- 172.21.15.135:0/3631305481 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1393 (secure 0 0 0) 0x7f8078009de0 con 0x7f8088100270 2024-04-20T12:20:05.264 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:05.264 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-20T12:20:05.264 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 2 2024-04-20T12:20:05.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.266+0000 7f808d274640 1 -- 172.21.15.135:0/3631305481 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f80740a3c30 msgr2=0x7f80740a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:05.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.266+0000 7f808d274640 1 --2- 172.21.15.135:0/3631305481 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f80740a3c30 0x7f80740a60f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8088199790 tx=0x7f807000b390 comp rx=0 tx=0).stop 2024-04-20T12:20:05.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.266+0000 7f808d274640 1 -- 172.21.15.135:0/3631305481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8088100270 msgr2=0x7f80881982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:05.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.266+0000 7f808d274640 1 --2- 172.21.15.135:0/3631305481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8088100270 0x7f80881982d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f807800d950 tx=0x7f807800de10 comp rx=0 tx=0).stop 2024-04-20T12:20:05.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.266+0000 7f808d274640 1 -- 172.21.15.135:0/3631305481 shutdown_connections 2024-04-20T12:20:05.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.266+0000 7f808d274640 1 --2- 172.21.15.135:0/3631305481 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f80740a3c30 0x7f80740a60f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:05.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.266+0000 7f808d274640 1 --2- 172.21.15.135:0/3631305481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8088103c00 0x7f808819f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:05.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.266+0000 7f808d274640 1 --2- 172.21.15.135:0/3631305481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8088103240 0x7f8088198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:05.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.266+0000 7f808d274640 1 --2- 172.21.15.135:0/3631305481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8088100270 0x7f80881982d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:05.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.266+0000 7f808d274640 1 -- 172.21.15.135:0/3631305481 >> 172.21.15.135:0/3631305481 conn(0x7f80880fbba0 msgr2=0x7f8088106610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:05.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.266+0000 7f808d274640 1 -- 172.21.15.135:0/3631305481 shutdown_connections 2024-04-20T12:20:05.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:05.266+0000 7f808d274640 1 -- 172.21.15.135:0/3631305481 wait complete. 2024-04-20T12:20:05.521 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:05 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.154:6832/406581782,v1:172.21.15.154:6833/406581782] up:boot 2024-04-20T12:20:05.521 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:05 smithi139 ceph-mon[21834]: fsmap 1 up:standby 2024-04-20T12:20:05.521 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-20T12:20:05.521 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:05.521 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:05.522 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:05.522 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:05.522 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:05.522 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:05 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:05.522 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:05 smithi139 ceph-mon[21834]: Deploying daemon mds.k on smithi139 2024-04-20T12:20:05.522 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:05 smithi139 ceph-mon[21834]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:05.522 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:05 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3631305481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:05.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:05 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.154:6832/406581782,v1:172.21.15.154:6833/406581782] up:boot 2024-04-20T12:20:05.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:05 smithi135 ceph-mon[18264]: fsmap 1 up:standby 2024-04-20T12:20:05.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-20T12:20:05.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:05.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:05.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:05.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:05.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:05.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:05 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:05.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:05 smithi135 ceph-mon[18264]: Deploying daemon mds.k on smithi139 2024-04-20T12:20:05.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:05 smithi135 ceph-mon[18264]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:05.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:05 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3631305481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:05.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:05 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.154:6832/406581782,v1:172.21.15.154:6833/406581782] up:boot 2024-04-20T12:20:05.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:05 smithi154 ceph-mon[22073]: fsmap 1 up:standby 2024-04-20T12:20:05.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-20T12:20:05.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:05.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:05 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:05 smithi154 ceph-mon[22073]: Deploying daemon mds.k on smithi139 2024-04-20T12:20:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:05 smithi154 ceph-mon[22073]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:05.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:05 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3631305481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:07.080 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:20:06 smithi139 systemd[1]: Starting Ceph mds.k for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:20:07.278 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:07.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.389+0000 7ff7433b6640 1 -- 172.21.15.135:0/2353218850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c102050 msgr2=0x7ff73c1024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:07.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.389+0000 7ff7433b6640 1 --2- 172.21.15.135:0/2353218850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c102050 0x7ff73c1024d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009900 tx=0x7ff72c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:07.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.389+0000 7ff7433b6640 1 -- 172.21.15.135:0/2353218850 shutdown_connections 2024-04-20T12:20:07.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.389+0000 7ff7433b6640 1 --2- 172.21.15.135:0/2353218850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73c102a10 0x7ff73c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:07.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.389+0000 7ff7433b6640 1 --2- 172.21.15.135:0/2353218850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c102050 0x7ff73c1024d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:07.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.389+0000 7ff7433b6640 1 --2- 172.21.15.135:0/2353218850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff73c100e70 0x7ff73c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:07.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.389+0000 7ff7433b6640 1 -- 172.21.15.135:0/2353218850 >> 172.21.15.135:0/2353218850 conn(0x7ff73c0fc450 msgr2=0x7ff73c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:07.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.389+0000 7ff7433b6640 1 -- 172.21.15.135:0/2353218850 shutdown_connections 2024-04-20T12:20:07.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.389+0000 7ff7433b6640 1 -- 172.21.15.135:0/2353218850 wait complete. 2024-04-20T12:20:07.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff7433b6640 1 Processor -- start 2024-04-20T12:20:07.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff7433b6640 1 -- start start 2024-04-20T12:20:07.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff7433b6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c100e70 0x7ff73c197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:07.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff7433b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73c102050 0x7ff73c197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:07.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff7433b6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff73c102a10 0x7ff73c19e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:07.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff7433b6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff73c10cb60 con 0x7ff73c100e70 2024-04-20T12:20:07.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff7433b6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff73c10c9e0 con 0x7ff73c102a10 2024-04-20T12:20:07.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff7433b6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff73c10cce0 con 0x7ff73c102050 2024-04-20T12:20:07.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff741152640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c100e70 0x7ff73c197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:07.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff741152640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c100e70 0x7ff73c197140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59398/0 (socket says 172.21.15.135:59398) 2024-04-20T12:20:07.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff741152640 1 -- 172.21.15.135:0/2180975236 learned_addr learned my addr 172.21.15.135:0/2180975236 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:07.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff740951640 1 --2- 172.21.15.135:0/2180975236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73c102050 0x7ff73c197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:07.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff741953640 1 --2- 172.21.15.135:0/2180975236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff73c102a10 0x7ff73c19e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:07.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff741152640 1 -- 172.21.15.135:0/2180975236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73c102050 msgr2=0x7ff73c197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:07.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff741152640 1 --2- 172.21.15.135:0/2180975236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73c102050 0x7ff73c197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:07.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff741152640 1 -- 172.21.15.135:0/2180975236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff73c102a10 msgr2=0x7ff73c19e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:07.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff741152640 1 --2- 172.21.15.135:0/2180975236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff73c102a10 0x7ff73c19e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:07.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.390+0000 7ff741152640 1 -- 172.21.15.135:0/2180975236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73c19ed60 con 0x7ff73c100e70 2024-04-20T12:20:07.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.391+0000 7ff741152640 1 --2- 172.21.15.135:0/2180975236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c100e70 0x7ff73c197140 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff73800c970 tx=0x7ff73800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:07.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.391+0000 7ff7327fc640 1 -- 172.21.15.135:0/2180975236 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738007c10 con 0x7ff73c100e70 2024-04-20T12:20:07.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.391+0000 7ff7327fc640 1 -- 172.21.15.135:0/2180975236 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff738007db0 con 0x7ff73c100e70 2024-04-20T12:20:07.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.391+0000 7ff7433b6640 1 -- 172.21.15.135:0/2180975236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff73c19eff0 con 0x7ff73c100e70 2024-04-20T12:20:07.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.391+0000 7ff7327fc640 1 -- 172.21.15.135:0/2180975236 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73800f940 con 0x7ff73c100e70 2024-04-20T12:20:07.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.391+0000 7ff7433b6640 1 -- 172.21.15.135:0/2180975236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff73c19f4b0 con 0x7ff73c100e70 2024-04-20T12:20:07.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.392+0000 7ff7433b6640 1 -- 172.21.15.135:0/2180975236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff73c108140 con 0x7ff73c100e70 2024-04-20T12:20:07.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.393+0000 7ff7327fc640 1 -- 172.21.15.135:0/2180975236 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7ff73800fae0 con 0x7ff73c100e70 2024-04-20T12:20:07.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.394+0000 7ff7327fc640 1 --2- 172.21.15.135:0/2180975236 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff7280a3bb0 0x7ff7280a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:07.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.394+0000 7ff740951640 1 --2- 172.21.15.135:0/2180975236 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff7280a3bb0 0x7ff7280a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:07.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.394+0000 7ff7327fc640 1 -- 172.21.15.135:0/2180975236 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ff7380d0520 con 0x7ff73c100e70 2024-04-20T12:20:07.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.394+0000 7ff740951640 1 --2- 172.21.15.135:0/2180975236 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff7280a3bb0 0x7ff7280a6070 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff72c02c7b0 tx=0x7ff72c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:07.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.397+0000 7ff7327fc640 1 -- 172.21.15.135:0/2180975236 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7ff73809d4a0 con 0x7ff73c100e70 2024-04-20T12:20:07.397 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:20:07 smithi139 podman[51127]: 2024-04-20 12:20:07.024503071 +0000 UTC m=+0.018188031 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:20:07.397 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:20:07 smithi139 podman[51127]: 2024-04-20 12:20:07.154482605 +0000 UTC m=+0.148167564 container create 0e720c91acaea9dbc5e4c0a9c22a1d2ed6f85ed5f38685116f45327a18f5b6d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-20T12:20:07.397 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:20:07 smithi139 podman[51127]: 2024-04-20 12:20:07.398881409 +0000 UTC m=+0.392566372 container init 0e720c91acaea9dbc5e4c0a9c22a1d2ed6f85ed5f38685116f45327a18f5b6d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-k, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:20:07.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.632+0000 7ff7433b6640 1 -- 172.21.15.135:0/2180975236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff73c02d5d0 con 0x7ff73c100e70 2024-04-20T12:20:07.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.632+0000 7ff7327fc640 1 -- 172.21.15.135:0/2180975236 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1393 (secure 0 0 0) 0x7ff73809cda0 con 0x7ff73c100e70 2024-04-20T12:20:07.632 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:07.632 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-20T12:20:07.633 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 2 2024-04-20T12:20:07.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.634+0000 7ff7433b6640 1 -- 172.21.15.135:0/2180975236 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff7280a3bb0 msgr2=0x7ff7280a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:07.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.634+0000 7ff7433b6640 1 --2- 172.21.15.135:0/2180975236 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff7280a3bb0 0x7ff7280a6070 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff72c02c7b0 tx=0x7ff72c005fd0 comp rx=0 tx=0).stop 2024-04-20T12:20:07.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.634+0000 7ff7433b6640 1 -- 172.21.15.135:0/2180975236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c100e70 msgr2=0x7ff73c197140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:07.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.634+0000 7ff7433b6640 1 --2- 172.21.15.135:0/2180975236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c100e70 0x7ff73c197140 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff73800c970 tx=0x7ff73800ce30 comp rx=0 tx=0).stop 2024-04-20T12:20:07.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.635+0000 7ff7433b6640 1 -- 172.21.15.135:0/2180975236 shutdown_connections 2024-04-20T12:20:07.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.635+0000 7ff7433b6640 1 --2- 172.21.15.135:0/2180975236 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff7280a3bb0 0x7ff7280a6070 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:07.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.635+0000 7ff7433b6640 1 --2- 172.21.15.135:0/2180975236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff73c102a10 0x7ff73c19e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:07.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.635+0000 7ff7433b6640 1 --2- 172.21.15.135:0/2180975236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73c102050 0x7ff73c197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:07.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.635+0000 7ff7433b6640 1 --2- 172.21.15.135:0/2180975236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73c100e70 0x7ff73c197140 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:07.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.635+0000 7ff7433b6640 1 -- 172.21.15.135:0/2180975236 >> 172.21.15.135:0/2180975236 conn(0x7ff73c0fc450 msgr2=0x7ff73c105310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:07.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.635+0000 7ff7433b6640 1 -- 172.21.15.135:0/2180975236 shutdown_connections 2024-04-20T12:20:07.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:07.635+0000 7ff7433b6640 1 -- 172.21.15.135:0/2180975236 wait complete. 2024-04-20T12:20:07.830 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:20:07 smithi139 podman[51127]: 2024-04-20 12:20:07.401704201 +0000 UTC m=+0.395389170 container start 0e720c91acaea9dbc5e4c0a9c22a1d2ed6f85ed5f38685116f45327a18f5b6d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-20T12:20:07.830 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:20:07 smithi139 ceph-mds[51147]: -- 172.21.15.139:0/3999057894 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562458383a40 con 0x562458356800 2024-04-20T12:20:07.830 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:20:07 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-k[51143]: starting mds.k at 2024-04-20T12:20:07.830 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:20:07 smithi139 bash[51127]: 0e720c91acaea9dbc5e4c0a9c22a1d2ed6f85ed5f38685116f45327a18f5b6d9 2024-04-20T12:20:07.830 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:20:07 smithi139 systemd[1]: Started Ceph mds.k for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:20:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:07 smithi135 ceph-mon[18264]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:07 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:07 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2180975236' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:07 smithi154 ceph-mon[22073]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:07 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:07 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:08.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:07 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:08.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:07 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:08.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:07 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:08.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:07 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:08.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:07 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2180975236' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:07 smithi139 ceph-mon[21834]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:07 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:07 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:07 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:07 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:07 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:07 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:07 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2180975236' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:09.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:08 smithi139 ceph-mon[21834]: Deploying daemon mds.j on smithi135 2024-04-20T12:20:09.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:08 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.139:6832/2012805307,v1:172.21.15.139:6833/2012805307] up:boot 2024-04-20T12:20:09.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:08 smithi139 ceph-mon[21834]: fsmap 2 up:standby 2024-04-20T12:20:09.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:08 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-20T12:20:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:08 smithi135 ceph-mon[18264]: Deploying daemon mds.j on smithi135 2024-04-20T12:20:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:08 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.139:6832/2012805307,v1:172.21.15.139:6833/2012805307] up:boot 2024-04-20T12:20:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:08 smithi135 ceph-mon[18264]: fsmap 2 up:standby 2024-04-20T12:20:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:08 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-20T12:20:09.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:08 smithi154 ceph-mon[22073]: Deploying daemon mds.j on smithi135 2024-04-20T12:20:09.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:08 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.139:6832/2012805307,v1:172.21.15.139:6833/2012805307] up:boot 2024-04-20T12:20:09.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:08 smithi154 ceph-mon[22073]: fsmap 2 up:standby 2024-04-20T12:20:09.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:08 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-20T12:20:09.650 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:09.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.885+0000 7f41aecc0640 1 -- 172.21.15.135:0/3144347537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a8102a30 msgr2=0x7f41a8109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:09.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.885+0000 7f41aecc0640 1 --2- 172.21.15.135:0/3144347537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a8102a30 0x7f41a8109350 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f41a0009ca0 tx=0x7f41a002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:09.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.885+0000 7f41aecc0640 1 -- 172.21.15.135:0/3144347537 shutdown_connections 2024-04-20T12:20:09.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.885+0000 7f41aecc0640 1 --2- 172.21.15.135:0/3144347537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a8102a30 0x7f41a8109350 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:09.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.885+0000 7f41aecc0640 1 --2- 172.21.15.135:0/3144347537 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a8102070 0x7f41a81024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:09.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.885+0000 7f41aecc0640 1 --2- 172.21.15.135:0/3144347537 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41a8100e90 0x7f41a81012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:09.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.885+0000 7f41aecc0640 1 -- 172.21.15.135:0/3144347537 >> 172.21.15.135:0/3144347537 conn(0x7f41a80fc450 msgr2=0x7f41a80fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:09.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.886+0000 7f41aecc0640 1 -- 172.21.15.135:0/3144347537 shutdown_connections 2024-04-20T12:20:09.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.886+0000 7f41aecc0640 1 -- 172.21.15.135:0/3144347537 wait complete. 2024-04-20T12:20:09.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.886+0000 7f41aecc0640 1 Processor -- start 2024-04-20T12:20:09.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.886+0000 7f41aecc0640 1 -- start start 2024-04-20T12:20:09.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.886+0000 7f41aecc0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a8100e90 0x7f41a806aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:09.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.886+0000 7f41aecc0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a8102070 0x7f41a819d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:09.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.886+0000 7f41aecc0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41a8102a30 0x7f41a819f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:09.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.886+0000 7f41aecc0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f41a810cb90 con 0x7f41a8100e90 2024-04-20T12:20:09.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.886+0000 7f41aecc0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f41a810ca10 con 0x7f41a8102a30 2024-04-20T12:20:09.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.886+0000 7f41aecc0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f41a810cd10 con 0x7f41a8102070 2024-04-20T12:20:09.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.886+0000 7f41aca5c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a8100e90 0x7f41a806aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:09.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.886+0000 7f41aca5c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a8100e90 0x7f41a806aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59416/0 (socket says 172.21.15.135:59416) 2024-04-20T12:20:09.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.887+0000 7f41aca5c640 1 -- 172.21.15.135:0/974880974 learned_addr learned my addr 172.21.15.135:0/974880974 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:09.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.887+0000 7f41a7fff640 1 --2- 172.21.15.135:0/974880974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a8102070 0x7f41a819d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:09.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.887+0000 7f41ad25d640 1 --2- 172.21.15.135:0/974880974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41a8102a30 0x7f41a819f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:09.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.887+0000 7f41aca5c640 1 -- 172.21.15.135:0/974880974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a8102070 msgr2=0x7f41a819d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:09.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.887+0000 7f41aca5c640 1 --2- 172.21.15.135:0/974880974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a8102070 0x7f41a819d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:09.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.887+0000 7f41aca5c640 1 -- 172.21.15.135:0/974880974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41a8102a30 msgr2=0x7f41a819f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:09.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.887+0000 7f41aca5c640 1 --2- 172.21.15.135:0/974880974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41a8102a30 0x7f41a819f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:09.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.887+0000 7f41aca5c640 1 -- 172.21.15.135:0/974880974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a819ff50 con 0x7f41a8100e90 2024-04-20T12:20:09.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.887+0000 7f41ad25d640 1 --2- 172.21.15.135:0/974880974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41a8102a30 0x7f41a819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:20:09.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.887+0000 7f41aca5c640 1 --2- 172.21.15.135:0/974880974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a8100e90 0x7f41a806aea0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f419c00e9c0 tx=0x7f419c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:09.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.887+0000 7f41a5ffb640 1 -- 172.21.15.135:0/974880974 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c00cd80 con 0x7f41a8100e90 2024-04-20T12:20:09.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.887+0000 7f41aecc0640 1 -- 172.21.15.135:0/974880974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a81a01e0 con 0x7f41a8100e90 2024-04-20T12:20:09.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.887+0000 7f41a5ffb640 1 -- 172.21.15.135:0/974880974 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f419c0035f0 con 0x7f41a8100e90 2024-04-20T12:20:09.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.887+0000 7f41a5ffb640 1 -- 172.21.15.135:0/974880974 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c010690 con 0x7f41a8100e90 2024-04-20T12:20:09.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.887+0000 7f41aecc0640 1 -- 172.21.15.135:0/974880974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a81a0730 con 0x7f41a8100e90 2024-04-20T12:20:09.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.888+0000 7f41aecc0640 1 -- 172.21.15.135:0/974880974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a81081d0 con 0x7f41a8100e90 2024-04-20T12:20:09.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.889+0000 7f41a5ffb640 1 -- 172.21.15.135:0/974880974 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f419c0037a0 con 0x7f41a8100e90 2024-04-20T12:20:09.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.890+0000 7f41a5ffb640 1 --2- 172.21.15.135:0/974880974 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f41980a3bb0 0x7f41980a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:09.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.890+0000 7f41a5ffb640 1 -- 172.21.15.135:0/974880974 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f419c0d03f0 con 0x7f41a8100e90 2024-04-20T12:20:09.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.890+0000 7f41a7fff640 1 --2- 172.21.15.135:0/974880974 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f41980a3bb0 0x7f41980a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:09.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.891+0000 7f41a7fff640 1 --2- 172.21.15.135:0/974880974 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f41980a3bb0 0x7f41980a6070 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f41a806ac10 tx=0x7f419400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:09.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:09.895+0000 7f41a5ffb640 1 -- 172.21.15.135:0/974880974 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f419c09d270 con 0x7f41a8100e90 2024-04-20T12:20:10.050 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:09 smithi135 ceph-mon[18264]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:10.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:09 smithi139 ceph-mon[21834]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:10.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:10.121+0000 7f41aecc0640 1 -- 172.21.15.135:0/974880974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41a802d860 con 0x7f41a8100e90 2024-04-20T12:20:10.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:10.121+0000 7f41a5ffb640 1 -- 172.21.15.135:0/974880974 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7f419c09cb70 con 0x7f41a8100e90 2024-04-20T12:20:10.121 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:10.122 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-20T12:20:10.122 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 3 2024-04-20T12:20:10.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:10.123+0000 7f41aecc0640 1 -- 172.21.15.135:0/974880974 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f41980a3bb0 msgr2=0x7f41980a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:10.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:10.123+0000 7f41aecc0640 1 --2- 172.21.15.135:0/974880974 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f41980a3bb0 0x7f41980a6070 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f41a806ac10 tx=0x7f419400b390 comp rx=0 tx=0).stop 2024-04-20T12:20:10.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:10.123+0000 7f41aecc0640 1 -- 172.21.15.135:0/974880974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a8100e90 msgr2=0x7f41a806aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:10.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:10.123+0000 7f41aecc0640 1 --2- 172.21.15.135:0/974880974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a8100e90 0x7f41a806aea0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f419c00e9c0 tx=0x7f419c00ee80 comp rx=0 tx=0).stop 2024-04-20T12:20:10.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:10.124+0000 7f41aecc0640 1 -- 172.21.15.135:0/974880974 shutdown_connections 2024-04-20T12:20:10.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:10.124+0000 7f41aecc0640 1 --2- 172.21.15.135:0/974880974 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f41980a3bb0 0x7f41980a6070 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:10.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:10.124+0000 7f41aecc0640 1 --2- 172.21.15.135:0/974880974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f41a8102a30 0x7f41a819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:10.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:10.124+0000 7f41aecc0640 1 --2- 172.21.15.135:0/974880974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41a8102070 0x7f41a819d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:10.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:10.124+0000 7f41aecc0640 1 --2- 172.21.15.135:0/974880974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f41a8100e90 0x7f41a806aea0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:10.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:10.124+0000 7f41aecc0640 1 -- 172.21.15.135:0/974880974 >> 172.21.15.135:0/974880974 conn(0x7f41a80fc450 msgr2=0x7f41a81053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:10.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:10.124+0000 7f41aecc0640 1 -- 172.21.15.135:0/974880974 shutdown_connections 2024-04-20T12:20:10.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:10.124+0000 7f41aecc0640 1 -- 172.21.15.135:0/974880974 wait complete. 2024-04-20T12:20:10.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:09 smithi154 ceph-mon[22073]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:10.613 INFO:journalctl@ceph.mds.j.smithi135.stdout:Apr 20 12:20:10 smithi135 systemd[1]: Started Ceph mds.j for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:20:11.133 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:10 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/974880974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:11.133 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:10 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:11.133 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:10 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:11.133 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:10 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:11.133 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:10 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:11.133 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:10 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:11.133 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:10 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:11.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:10 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/974880974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:11.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:10 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:11.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:10 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:11.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:10 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:11.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:10 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:11.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:10 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:11.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:10 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:11.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:10 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/974880974' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:11.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:10 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:11.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:10 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:11.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:10 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:11.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:10 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:11.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:10 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:11.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:10 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:12.135 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:12.148 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:11 smithi135 ceph-mon[18264]: Deploying daemon mds.d on smithi135 2024-04-20T12:20:12.148 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:11 smithi135 ceph-mon[18264]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:12.148 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:11 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.135:6834/4052830457,v1:172.21.15.135:6835/4052830457] up:boot 2024-04-20T12:20:12.148 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:11 smithi135 ceph-mon[18264]: fsmap 3 up:standby 2024-04-20T12:20:12.148 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:11 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-20T12:20:12.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.241+0000 7f969543f640 1 -- 172.21.15.135:0/1948533496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9690102a40 msgr2=0x7f9690104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:12.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.241+0000 7f969543f640 1 --2- 172.21.15.135:0/1948533496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9690102a40 0x7f9690104e30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9680009900 tx=0x7f968002bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:12.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.241+0000 7f969543f640 1 -- 172.21.15.135:0/1948533496 shutdown_connections 2024-04-20T12:20:12.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.241+0000 7f969543f640 1 --2- 172.21.15.135:0/1948533496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9690107ca0 0x7f969010a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:12.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.241+0000 7f969543f640 1 --2- 172.21.15.135:0/1948533496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9690105370 0x7f9690107760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:12.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.241+0000 7f969543f640 1 --2- 172.21.15.135:0/1948533496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9690102a40 0x7f9690104e30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:12.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.241+0000 7f969543f640 1 -- 172.21.15.135:0/1948533496 >> 172.21.15.135:0/1948533496 conn(0x7f96900fc450 msgr2=0x7f96900fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:12.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.241+0000 7f969543f640 1 -- 172.21.15.135:0/1948533496 shutdown_connections 2024-04-20T12:20:12.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.241+0000 7f969543f640 1 -- 172.21.15.135:0/1948533496 wait complete. 2024-04-20T12:20:12.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.242+0000 7f969543f640 1 Processor -- start 2024-04-20T12:20:12.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.242+0000 7f969543f640 1 -- start start 2024-04-20T12:20:12.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.242+0000 7f969543f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9690102a40 0x7f9690198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:12.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.242+0000 7f969543f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9690105370 0x7f9690198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:12.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.242+0000 7f969543f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9690107ca0 0x7f969019f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:12.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.242+0000 7f969543f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f969010dc50 con 0x7f9690105370 2024-04-20T12:20:12.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.242+0000 7f969543f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f969010dad0 con 0x7f9690102a40 2024-04-20T12:20:12.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.242+0000 7f969543f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f969010ddd0 con 0x7f9690107ca0 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.242+0000 7f968e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9690105370 0x7f9690198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.242+0000 7f968e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9690105370 0x7f9690198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51336/0 (socket says 172.21.15.135:51336) 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.242+0000 7f968e7fc640 1 -- 172.21.15.135:0/1736361809 learned_addr learned my addr 172.21.15.135:0/1736361809 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.242+0000 7f968f7fe640 1 --2- 172.21.15.135:0/1736361809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9690107ca0 0x7f969019f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.242+0000 7f968e7fc640 1 -- 172.21.15.135:0/1736361809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9690107ca0 msgr2=0x7f969019f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.242+0000 7f968e7fc640 1 --2- 172.21.15.135:0/1736361809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9690107ca0 0x7f969019f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.243+0000 7f968effd640 1 --2- 172.21.15.135:0/1736361809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9690102a40 0x7f9690198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.243+0000 7f968e7fc640 1 -- 172.21.15.135:0/1736361809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9690102a40 msgr2=0x7f9690198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.243+0000 7f968e7fc640 1 --2- 172.21.15.135:0/1736361809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9690102a40 0x7f9690198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.243+0000 7f968e7fc640 1 -- 172.21.15.135:0/1736361809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969019ff40 con 0x7f9690105370 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.243+0000 7f968e7fc640 1 --2- 172.21.15.135:0/1736361809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9690105370 0x7f9690198860 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9684005fd0 tx=0x7f968400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.243+0000 7f9677fff640 1 -- 172.21.15.135:0/1736361809 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684017070 con 0x7f9690105370 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.243+0000 7f9677fff640 1 -- 172.21.15.135:0/1736361809 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9684009c30 con 0x7f9690105370 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.243+0000 7f9677fff640 1 -- 172.21.15.135:0/1736361809 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684010460 con 0x7f9690105370 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.243+0000 7f969543f640 1 -- 172.21.15.135:0/1736361809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96901a0230 con 0x7f9690105370 2024-04-20T12:20:12.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.243+0000 7f969543f640 1 -- 172.21.15.135:0/1736361809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96901a07d0 con 0x7f9690105370 2024-04-20T12:20:12.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.244+0000 7f969543f640 1 -- 172.21.15.135:0/1736361809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96900fdf40 con 0x7f9690105370 2024-04-20T12:20:12.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.245+0000 7f9677fff640 1 -- 172.21.15.135:0/1736361809 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f9684003e70 con 0x7f9690105370 2024-04-20T12:20:12.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.246+0000 7f9677fff640 1 --2- 172.21.15.135:0/1736361809 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f96780a3c30 0x7f96780a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:12.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.246+0000 7f968effd640 1 --2- 172.21.15.135:0/1736361809 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f96780a3c30 0x7f96780a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:12.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.246+0000 7f9677fff640 1 -- 172.21.15.135:0/1736361809 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f96840d03b0 con 0x7f9690105370 2024-04-20T12:20:12.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.246+0000 7f968effd640 1 --2- 172.21.15.135:0/1736361809 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f96780a3c30 0x7f96780a60f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9680005c20 tx=0x7f9680005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:12.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.249+0000 7f9677fff640 1 -- 172.21.15.135:0/1736361809 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f9684020030 con 0x7f9690105370 2024-04-20T12:20:12.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:11 smithi154 ceph-mon[22073]: Deploying daemon mds.d on smithi135 2024-04-20T12:20:12.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:11 smithi154 ceph-mon[22073]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:12.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:11 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.135:6834/4052830457,v1:172.21.15.135:6835/4052830457] up:boot 2024-04-20T12:20:12.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:11 smithi154 ceph-mon[22073]: fsmap 3 up:standby 2024-04-20T12:20:12.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:11 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-20T12:20:12.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:11 smithi139 ceph-mon[21834]: Deploying daemon mds.d on smithi135 2024-04-20T12:20:12.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:11 smithi139 ceph-mon[21834]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:12.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:11 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.135:6834/4052830457,v1:172.21.15.135:6835/4052830457] up:boot 2024-04-20T12:20:12.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:11 smithi139 ceph-mon[21834]: fsmap 3 up:standby 2024-04-20T12:20:12.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:11 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-20T12:20:12.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.493+0000 7f969543f640 1 -- 172.21.15.135:0/1736361809 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f969002d5d0 con 0x7f9690105370 2024-04-20T12:20:12.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.494+0000 7f9677fff640 1 -- 172.21.15.135:0/1736361809 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3049 (secure 0 0 0) 0x7f968409d2b0 con 0x7f9690105370 2024-04-20T12:20:12.494 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:12.494 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-20T12:20:12.495 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 4 2024-04-20T12:20:12.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.496+0000 7f969543f640 1 -- 172.21.15.135:0/1736361809 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f96780a3c30 msgr2=0x7f96780a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:12.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.496+0000 7f969543f640 1 --2- 172.21.15.135:0/1736361809 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f96780a3c30 0x7f96780a60f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9680005c20 tx=0x7f9680005fd0 comp rx=0 tx=0).stop 2024-04-20T12:20:12.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.496+0000 7f969543f640 1 -- 172.21.15.135:0/1736361809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9690105370 msgr2=0x7f9690198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:12.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.496+0000 7f969543f640 1 --2- 172.21.15.135:0/1736361809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9690105370 0x7f9690198860 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9684005fd0 tx=0x7f968400dde0 comp rx=0 tx=0).stop 2024-04-20T12:20:12.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.496+0000 7f969543f640 1 -- 172.21.15.135:0/1736361809 shutdown_connections 2024-04-20T12:20:12.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.496+0000 7f969543f640 1 --2- 172.21.15.135:0/1736361809 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f96780a3c30 0x7f96780a60f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:12.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.496+0000 7f969543f640 1 --2- 172.21.15.135:0/1736361809 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9690107ca0 0x7f969019f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:12.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.496+0000 7f969543f640 1 --2- 172.21.15.135:0/1736361809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9690105370 0x7f9690198860 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:12.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.496+0000 7f969543f640 1 --2- 172.21.15.135:0/1736361809 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9690102a40 0x7f9690198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:12.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.496+0000 7f969543f640 1 -- 172.21.15.135:0/1736361809 >> 172.21.15.135:0/1736361809 conn(0x7f96900fc450 msgr2=0x7f96901033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:12.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.496+0000 7f969543f640 1 -- 172.21.15.135:0/1736361809 shutdown_connections 2024-04-20T12:20:12.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:12.496+0000 7f969543f640 1 -- 172.21.15.135:0/1736361809 wait complete. 2024-04-20T12:20:13.109 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:12 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1736361809' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:13.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:12 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1736361809' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:13.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:12 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1736361809' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:13.363 INFO:journalctl@ceph.mds.d.smithi135.stdout:Apr 20 12:20:13 smithi135 systemd[1]: Started Ceph mds.d for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:20:14.179 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:13 smithi139 ceph-mon[21834]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:14.179 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:13 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:14.179 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:13 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:14.179 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:13 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:14.179 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:13 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:14.179 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:13 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:14.179 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:13 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:14.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:13 smithi154 ceph-mon[22073]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:14.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:13 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:14.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:13 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:14.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:13 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:14.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:13 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:14.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:13 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:14.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:13 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:14.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:13 smithi135 ceph-mon[18264]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:14.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:14.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:14.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:14.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:14.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:14.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:13 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:14.509 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:14.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.622+0000 7f46927b2640 1 -- 172.21.15.135:0/804505335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f468c101fb0 msgr2=0x7f468c1023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:14.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.622+0000 7f46927b2640 1 --2- 172.21.15.135:0/804505335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f468c101fb0 0x7f468c1023d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4680009900 tx=0x7f468002bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:14.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.622+0000 7f46927b2640 1 -- 172.21.15.135:0/804505335 shutdown_connections 2024-04-20T12:20:14.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.622+0000 7f46927b2640 1 --2- 172.21.15.135:0/804505335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f468c103b60 0x7f468c10a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:14.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.622+0000 7f46927b2640 1 --2- 172.21.15.135:0/804505335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f468c1031a0 0x7f468c103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:14.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.622+0000 7f46927b2640 1 --2- 172.21.15.135:0/804505335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f468c101fb0 0x7f468c1023d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:14.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.622+0000 7f46927b2640 1 -- 172.21.15.135:0/804505335 >> 172.21.15.135:0/804505335 conn(0x7f468c0fd540 msgr2=0x7f468c0ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:14.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.622+0000 7f46927b2640 1 -- 172.21.15.135:0/804505335 shutdown_connections 2024-04-20T12:20:14.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.622+0000 7f46927b2640 1 -- 172.21.15.135:0/804505335 wait complete. 2024-04-20T12:20:14.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.623+0000 7f46927b2640 1 Processor -- start 2024-04-20T12:20:14.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.623+0000 7f46927b2640 1 -- start start 2024-04-20T12:20:14.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.623+0000 7f46927b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f468c101fb0 0x7f468c075d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:14.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.623+0000 7f46927b2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f468c1031a0 0x7f468c074350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:14.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.623+0000 7f46927b2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f468c103b60 0x7f468c074890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:14.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.623+0000 7f46927b2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f468c10dc40 con 0x7f468c103b60 2024-04-20T12:20:14.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.623+0000 7f46927b2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f468c10dac0 con 0x7f468c1031a0 2024-04-20T12:20:14.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.623+0000 7f46927b2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f468c10ddc0 con 0x7f468c101fb0 2024-04-20T12:20:14.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.623+0000 7f4690d4f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f468c103b60 0x7f468c074890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:14.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.623+0000 7f468bfff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f468c101fb0 0x7f468c075d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:14.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.623+0000 7f4690d4f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f468c103b60 0x7f468c074890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51370/0 (socket says 172.21.15.135:51370) 2024-04-20T12:20:14.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.623+0000 7f4690d4f640 1 -- 172.21.15.135:0/2372309767 learned_addr learned my addr 172.21.15.135:0/2372309767 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:14.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.623+0000 7f468b7fe640 1 --2- 172.21.15.135:0/2372309767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f468c1031a0 0x7f468c074350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:14.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.624+0000 7f4690d4f640 1 -- 172.21.15.135:0/2372309767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f468c101fb0 msgr2=0x7f468c075d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:14.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.624+0000 7f4690d4f640 1 --2- 172.21.15.135:0/2372309767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f468c101fb0 0x7f468c075d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:14.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.624+0000 7f4690d4f640 1 -- 172.21.15.135:0/2372309767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f468c1031a0 msgr2=0x7f468c074350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:14.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.624+0000 7f4690d4f640 1 --2- 172.21.15.135:0/2372309767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f468c1031a0 0x7f468c074350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:14.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.624+0000 7f4690d4f640 1 -- 172.21.15.135:0/2372309767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c075120 con 0x7f468c103b60 2024-04-20T12:20:14.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.624+0000 7f468b7fe640 1 --2- 172.21.15.135:0/2372309767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f468c1031a0 0x7f468c074350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:20:14.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.624+0000 7f4690d4f640 1 --2- 172.21.15.135:0/2372309767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f468c103b60 0x7f468c074890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f468400eb10 tx=0x7f468400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:14.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.624+0000 7f46897fa640 1 -- 172.21.15.135:0/2372309767 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684004b20 con 0x7f468c103b60 2024-04-20T12:20:14.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.624+0000 7f46927b2640 1 -- 172.21.15.135:0/2372309767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f468c1a23f0 con 0x7f468c103b60 2024-04-20T12:20:14.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.624+0000 7f46897fa640 1 -- 172.21.15.135:0/2372309767 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4684004cc0 con 0x7f468c103b60 2024-04-20T12:20:14.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.624+0000 7f46897fa640 1 -- 172.21.15.135:0/2372309767 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684010760 con 0x7f468c103b60 2024-04-20T12:20:14.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.624+0000 7f46927b2640 1 -- 172.21.15.135:0/2372309767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f468c1a28f0 con 0x7f468c103b60 2024-04-20T12:20:14.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.625+0000 7f46927b2640 1 -- 172.21.15.135:0/2372309767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f468c1092d0 con 0x7f468c103b60 2024-04-20T12:20:14.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.626+0000 7f46897fa640 1 -- 172.21.15.135:0/2372309767 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f4684005020 con 0x7f468c103b60 2024-04-20T12:20:14.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.627+0000 7f46897fa640 1 --2- 172.21.15.135:0/2372309767 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f46740a3bb0 0x7f46740a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:14.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.627+0000 7f468bfff640 1 --2- 172.21.15.135:0/2372309767 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f46740a3bb0 0x7f46740a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:14.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.627+0000 7f46897fa640 1 -- 172.21.15.135:0/2372309767 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f46840d0550 con 0x7f468c103b60 2024-04-20T12:20:14.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.627+0000 7f468bfff640 1 --2- 172.21.15.135:0/2372309767 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f46740a3bb0 0x7f46740a6070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4680000c00 tx=0x7f4680005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:14.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.631+0000 7f46897fa640 1 -- 172.21.15.135:0/2372309767 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f468409d3d0 con 0x7f468c103b60 2024-04-20T12:20:14.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.846+0000 7f46927b2640 1 -- 172.21.15.135:0/2372309767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f468c062b60 con 0x7f468c103b60 2024-04-20T12:20:14.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.847+0000 7f46897fa640 1 -- 172.21.15.135:0/2372309767 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3877 (secure 0 0 0) 0x7f468409ccd0 con 0x7f468c103b60 2024-04-20T12:20:14.847 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:14.847 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-20T12:20:14.847 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 5 2024-04-20T12:20:14.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.849+0000 7f46927b2640 1 -- 172.21.15.135:0/2372309767 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f46740a3bb0 msgr2=0x7f46740a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:14.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.849+0000 7f46927b2640 1 --2- 172.21.15.135:0/2372309767 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f46740a3bb0 0x7f46740a6070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4680000c00 tx=0x7f4680005fd0 comp rx=0 tx=0).stop 2024-04-20T12:20:14.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.849+0000 7f46927b2640 1 -- 172.21.15.135:0/2372309767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f468c103b60 msgr2=0x7f468c074890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:14.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.849+0000 7f46927b2640 1 --2- 172.21.15.135:0/2372309767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f468c103b60 0x7f468c074890 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f468400eb10 tx=0x7f468400c2d0 comp rx=0 tx=0).stop 2024-04-20T12:20:14.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.849+0000 7f46927b2640 1 -- 172.21.15.135:0/2372309767 shutdown_connections 2024-04-20T12:20:14.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.849+0000 7f46927b2640 1 --2- 172.21.15.135:0/2372309767 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f46740a3bb0 0x7f46740a6070 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:14.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.849+0000 7f46927b2640 1 --2- 172.21.15.135:0/2372309767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f468c103b60 0x7f468c074890 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:14.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.849+0000 7f46927b2640 1 --2- 172.21.15.135:0/2372309767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f468c1031a0 0x7f468c074350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:14.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.849+0000 7f46927b2640 1 --2- 172.21.15.135:0/2372309767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f468c101fb0 0x7f468c075d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:14.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.849+0000 7f46927b2640 1 -- 172.21.15.135:0/2372309767 >> 172.21.15.135:0/2372309767 conn(0x7f468c0fd540 msgr2=0x7f468c1064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:14.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.849+0000 7f46927b2640 1 -- 172.21.15.135:0/2372309767 shutdown_connections 2024-04-20T12:20:14.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:14.849+0000 7f46927b2640 1 -- 172.21.15.135:0/2372309767 wait complete. 2024-04-20T12:20:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:14 smithi135 ceph-mon[18264]: Deploying daemon mds.e on smithi139 2024-04-20T12:20:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:14 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.135:6836/2239466224,v1:172.21.15.135:6837/2239466224] up:boot 2024-04-20T12:20:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:14 smithi135 ceph-mon[18264]: fsmap 4 up:standby 2024-04-20T12:20:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:14 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-20T12:20:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:14 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2372309767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:15.215 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:14 smithi139 ceph-mon[21834]: Deploying daemon mds.e on smithi139 2024-04-20T12:20:15.216 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:14 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.135:6836/2239466224,v1:172.21.15.135:6837/2239466224] up:boot 2024-04-20T12:20:15.216 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:14 smithi139 ceph-mon[21834]: fsmap 4 up:standby 2024-04-20T12:20:15.216 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:14 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-20T12:20:15.216 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:14 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2372309767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:14 smithi154 ceph-mon[22073]: Deploying daemon mds.e on smithi139 2024-04-20T12:20:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:14 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.135:6836/2239466224,v1:172.21.15.135:6837/2239466224] up:boot 2024-04-20T12:20:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:14 smithi154 ceph-mon[22073]: fsmap 4 up:standby 2024-04-20T12:20:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:14 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-20T12:20:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:14 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2372309767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:15.830 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:20:15 smithi139 systemd[1]: Starting Ceph mds.e for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:20:16.145 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:15 smithi139 ceph-mon[21834]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:16.146 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:20:15 smithi139 podman[51443]: 2024-04-20 12:20:15.794834229 +0000 UTC m=+0.017790543 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:20:16.146 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:20:15 smithi139 podman[51443]: 2024-04-20 12:20:15.902804001 +0000 UTC m=+0.125760348 container create 9ef058c9b39aa4f9616b1724b2c05b30e19e98946d157f768a4a1e1079f6d37d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-e, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-20T12:20:16.146 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:20:16 smithi139 podman[51443]: 2024-04-20 12:20:16.146814354 +0000 UTC m=+0.369770662 container init 9ef058c9b39aa4f9616b1724b2c05b30e19e98946d157f768a4a1e1079f6d37d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5) 2024-04-20T12:20:16.152 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:15 smithi154 ceph-mon[22073]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:16.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:15 smithi135 ceph-mon[18264]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:16.579 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:20:16 smithi139 podman[51443]: 2024-04-20 12:20:16.149566543 +0000 UTC m=+0.372522851 container start 9ef058c9b39aa4f9616b1724b2c05b30e19e98946d157f768a4a1e1079f6d37d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-e, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-04-20T12:20:16.580 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:20:16 smithi139 ceph-mds[51462]: -- 172.21.15.139:0/3309140939 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5624aadf1a40 con 0x5624aadc4c00 2024-04-20T12:20:16.580 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:20:16 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-e[51458]: starting mds.e at 2024-04-20T12:20:16.580 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:20:16 smithi139 bash[51443]: 9ef058c9b39aa4f9616b1724b2c05b30e19e98946d157f768a4a1e1079f6d37d 2024-04-20T12:20:16.580 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:20:16 smithi139 systemd[1]: Started Ceph mds.e for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:20:16.860 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:16.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.971+0000 7f3074d7e640 1 -- 172.21.15.135:0/2313637960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30701031a0 msgr2=0x7f3070103620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:16.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.971+0000 7f3074d7e640 1 --2- 172.21.15.135:0/2313637960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30701031a0 0x7f3070103620 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3064009900 tx=0x7f306402bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:16.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.971+0000 7f3074d7e640 1 -- 172.21.15.135:0/2313637960 shutdown_connections 2024-04-20T12:20:16.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.971+0000 7f3074d7e640 1 --2- 172.21.15.135:0/2313637960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3070103b60 0x7f307010a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.971+0000 7f3074d7e640 1 --2- 172.21.15.135:0/2313637960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30701031a0 0x7f3070103620 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.971+0000 7f3074d7e640 1 --2- 172.21.15.135:0/2313637960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3070101fb0 0x7f30701023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.971+0000 7f3074d7e640 1 -- 172.21.15.135:0/2313637960 >> 172.21.15.135:0/2313637960 conn(0x7f30700fd540 msgr2=0x7f30700ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.971+0000 7f3074d7e640 1 -- 172.21.15.135:0/2313637960 shutdown_connections 2024-04-20T12:20:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.971+0000 7f3074d7e640 1 -- 172.21.15.135:0/2313637960 wait complete. 2024-04-20T12:20:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f3074d7e640 1 Processor -- start 2024-04-20T12:20:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f3074d7e640 1 -- start start 2024-04-20T12:20:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f3074d7e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3070101fb0 0x7f3070198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f3074d7e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30701031a0 0x7f30701987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f3074d7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3070103b60 0x7f307019f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f3074d7e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f307010dc40 con 0x7f3070101fb0 2024-04-20T12:20:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f3074d7e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f307010dac0 con 0x7f30701031a0 2024-04-20T12:20:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f3074d7e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f307010ddc0 con 0x7f3070103b60 2024-04-20T12:20:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f306e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3070101fb0 0x7f3070198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f306e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3070101fb0 0x7f3070198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51396/0 (socket says 172.21.15.135:51396) 2024-04-20T12:20:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f306e59c640 1 -- 172.21.15.135:0/1925865175 learned_addr learned my addr 172.21.15.135:0/1925865175 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f306ed9d640 1 --2- 172.21.15.135:0/1925865175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3070103b60 0x7f307019f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f306dd9b640 1 --2- 172.21.15.135:0/1925865175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30701031a0 0x7f30701987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f306e59c640 1 -- 172.21.15.135:0/1925865175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3070103b60 msgr2=0x7f307019f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f306e59c640 1 --2- 172.21.15.135:0/1925865175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3070103b60 0x7f307019f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f306e59c640 1 -- 172.21.15.135:0/1925865175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30701031a0 msgr2=0x7f30701987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f306e59c640 1 --2- 172.21.15.135:0/1925865175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30701031a0 0x7f30701987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f306e59c640 1 -- 172.21.15.135:0/1925865175 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307019feb0 con 0x7f3070101fb0 2024-04-20T12:20:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f306dd9b640 1 --2- 172.21.15.135:0/1925865175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30701031a0 0x7f30701987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:20:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f306e59c640 1 --2- 172.21.15.135:0/1925865175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3070101fb0 0x7f3070198290 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f306800e9c0 tx=0x7f306800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.972+0000 7f305f7fe640 1 -- 172.21.15.135:0/1925865175 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306800cd80 con 0x7f3070101fb0 2024-04-20T12:20:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.973+0000 7f305f7fe640 1 -- 172.21.15.135:0/1925865175 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30680035f0 con 0x7f3070101fb0 2024-04-20T12:20:16.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.973+0000 7f3074d7e640 1 -- 172.21.15.135:0/1925865175 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30701a01a0 con 0x7f3070101fb0 2024-04-20T12:20:16.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.973+0000 7f305f7fe640 1 -- 172.21.15.135:0/1925865175 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3068010690 con 0x7f3070101fb0 2024-04-20T12:20:16.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.973+0000 7f3074d7e640 1 -- 172.21.15.135:0/1925865175 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30701a06c0 con 0x7f3070101fb0 2024-04-20T12:20:16.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.974+0000 7f3074d7e640 1 -- 172.21.15.135:0/1925865175 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30701092d0 con 0x7f3070101fb0 2024-04-20T12:20:16.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.975+0000 7f305f7fe640 1 -- 172.21.15.135:0/1925865175 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f30680037a0 con 0x7f3070101fb0 2024-04-20T12:20:16.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.975+0000 7f305f7fe640 1 --2- 172.21.15.135:0/1925865175 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f30580a3bb0 0x7f30580a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:16.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.975+0000 7f306dd9b640 1 --2- 172.21.15.135:0/1925865175 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f30580a3bb0 0x7f30580a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:16.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.976+0000 7f305f7fe640 1 -- 172.21.15.135:0/1925865175 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f30680d0410 con 0x7f3070101fb0 2024-04-20T12:20:16.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.976+0000 7f306dd9b640 1 --2- 172.21.15.135:0/1925865175 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f30580a3bb0 0x7f30580a6070 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3064006010 tx=0x7f306402c8a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:16.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:16.980+0000 7f305f7fe640 1 -- 172.21.15.135:0/1925865175 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f306809d290 con 0x7f3070101fb0 2024-04-20T12:20:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:17.192+0000 7f3074d7e640 1 -- 172.21.15.135:0/1925865175 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f307002d5d0 con 0x7f3070101fb0 2024-04-20T12:20:17.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:17.192+0000 7f305f7fe640 1 -- 172.21.15.135:0/1925865175 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4705 (secure 0 0 0) 0x7f306809cb90 con 0x7f3070101fb0 2024-04-20T12:20:17.192 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:17.193 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-20T12:20:17.193 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 6 2024-04-20T12:20:17.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:17.194+0000 7f3074d7e640 1 -- 172.21.15.135:0/1925865175 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f30580a3bb0 msgr2=0x7f30580a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:17.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:17.194+0000 7f3074d7e640 1 --2- 172.21.15.135:0/1925865175 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f30580a3bb0 0x7f30580a6070 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3064006010 tx=0x7f306402c8a0 comp rx=0 tx=0).stop 2024-04-20T12:20:17.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:17.194+0000 7f3074d7e640 1 -- 172.21.15.135:0/1925865175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3070101fb0 msgr2=0x7f3070198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:17.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:17.194+0000 7f3074d7e640 1 --2- 172.21.15.135:0/1925865175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3070101fb0 0x7f3070198290 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f306800e9c0 tx=0x7f306800ee80 comp rx=0 tx=0).stop 2024-04-20T12:20:17.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:17.194+0000 7f3074d7e640 1 -- 172.21.15.135:0/1925865175 shutdown_connections 2024-04-20T12:20:17.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:17.194+0000 7f3074d7e640 1 --2- 172.21.15.135:0/1925865175 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f30580a3bb0 0x7f30580a6070 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:17.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:17.194+0000 7f3074d7e640 1 --2- 172.21.15.135:0/1925865175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3070103b60 0x7f307019f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:17.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:17.194+0000 7f3074d7e640 1 --2- 172.21.15.135:0/1925865175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30701031a0 0x7f30701987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:17.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:17.194+0000 7f3074d7e640 1 --2- 172.21.15.135:0/1925865175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3070101fb0 0x7f3070198290 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:17.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:17.194+0000 7f3074d7e640 1 -- 172.21.15.135:0/1925865175 >> 172.21.15.135:0/1925865175 conn(0x7f30700fd540 msgr2=0x7f30701064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:17.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:17.194+0000 7f3074d7e640 1 -- 172.21.15.135:0/1925865175 shutdown_connections 2024-04-20T12:20:17.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:17.194+0000 7f3074d7e640 1 -- 172.21.15.135:0/1925865175 wait complete. 2024-04-20T12:20:17.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:17 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:17.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:17 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:17.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:17 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:17.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:17 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:17.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:17 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:17.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:17 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:17.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:17 smithi154 ceph-mon[22073]: Deploying daemon mds.f on smithi154 2024-04-20T12:20:17.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:17 smithi154 ceph-mon[22073]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:17.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:17 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.139:6834/1816377265,v1:172.21.15.139:6835/1816377265] up:boot 2024-04-20T12:20:17.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:17 smithi154 ceph-mon[22073]: fsmap 5 up:standby 2024-04-20T12:20:17.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:17 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-20T12:20:17.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:17 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1925865175' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:17.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:17 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:17.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:17 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:17.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:17 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:17.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:17 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:17.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:17 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:17.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:17 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:17.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:17 smithi139 ceph-mon[21834]: Deploying daemon mds.f on smithi154 2024-04-20T12:20:17.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:17 smithi139 ceph-mon[21834]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:17.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:17 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.139:6834/1816377265,v1:172.21.15.139:6835/1816377265] up:boot 2024-04-20T12:20:17.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:17 smithi139 ceph-mon[21834]: fsmap 5 up:standby 2024-04-20T12:20:17.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:17 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-20T12:20:17.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:17 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1925865175' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:17.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:17 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:17.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:17 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:17.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:17 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:17.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:17 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:17.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:17 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:17.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:17 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:17.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:17 smithi135 ceph-mon[18264]: Deploying daemon mds.f on smithi154 2024-04-20T12:20:17.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:17 smithi135 ceph-mon[18264]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:17.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:17 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.139:6834/1816377265,v1:172.21.15.139:6835/1816377265] up:boot 2024-04-20T12:20:17.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:17 smithi135 ceph-mon[18264]: fsmap 5 up:standby 2024-04-20T12:20:17.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:17 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-20T12:20:17.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:17 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1925865175' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:18.656 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:20:18 smithi154 systemd[1]: Starting Ceph mds.f for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:20:18.956 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:20:18 smithi154 podman[51981]: 2024-04-20 12:20:18.560110689 +0000 UTC m=+0.017745269 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:20:18.956 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:20:18 smithi154 podman[51981]: 2024-04-20 12:20:18.678405364 +0000 UTC m=+0.136039940 container create d93374495849afd4614a03d8b84e8b6f041ecbb6d1ba5c41949ce8a386080234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-f, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-20T12:20:18.956 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:20:18 smithi154 podman[51981]: 2024-04-20 12:20:18.956762205 +0000 UTC m=+0.414396772 container init d93374495849afd4614a03d8b84e8b6f041ecbb6d1ba5c41949ce8a386080234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-f, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T12:20:19.206 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:19.251 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:20:18 smithi154 podman[51981]: 2024-04-20 12:20:18.95938696 +0000 UTC m=+0.417021528 container start d93374495849afd4614a03d8b84e8b6f041ecbb6d1ba5c41949ce8a386080234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-f, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-20T12:20:19.251 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:20:18 smithi154 ceph-mds[52000]: -- 172.21.15.154:0/3355834794 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c2d68fa40 con 0x560c2d662c00 2024-04-20T12:20:19.251 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:20:18 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-f[51996]: starting mds.f at 2024-04-20T12:20:19.251 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:20:19 smithi154 bash[51981]: d93374495849afd4614a03d8b84e8b6f041ecbb6d1ba5c41949ce8a386080234 2024-04-20T12:20:19.251 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:20:19 smithi154 systemd[1]: Started Ceph mds.f for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:20:19.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.311+0000 7f24f30c1640 1 -- 172.21.15.135:0/18813647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24ec100ea0 msgr2=0x7f24ec1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:19.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.311+0000 7f24f30c1640 1 --2- 172.21.15.135:0/18813647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24ec100ea0 0x7f24ec1012c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f24e0009900 tx=0x7f24e002bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:19.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.311+0000 7f24f30c1640 1 -- 172.21.15.135:0/18813647 shutdown_connections 2024-04-20T12:20:19.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.311+0000 7f24f30c1640 1 --2- 172.21.15.135:0/18813647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24ec1029b0 0x7f24ec1092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:19.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.311+0000 7f24f30c1640 1 --2- 172.21.15.135:0/18813647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24ec101ff0 0x7f24ec102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:19.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.311+0000 7f24f30c1640 1 --2- 172.21.15.135:0/18813647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24ec100ea0 0x7f24ec1012c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:19.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.311+0000 7f24f30c1640 1 -- 172.21.15.135:0/18813647 >> 172.21.15.135:0/18813647 conn(0x7f24ec0fc410 msgr2=0x7f24ec0fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:19.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.311+0000 7f24f30c1640 1 -- 172.21.15.135:0/18813647 shutdown_connections 2024-04-20T12:20:19.314 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.311+0000 7f24f30c1640 1 -- 172.21.15.135:0/18813647 wait complete. 2024-04-20T12:20:19.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.312+0000 7f24f30c1640 1 Processor -- start 2024-04-20T12:20:19.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.312+0000 7f24f30c1640 1 -- start start 2024-04-20T12:20:19.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.312+0000 7f24f30c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24ec100ea0 0x7f24ec1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:19.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.312+0000 7f24f30c1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24ec101ff0 0x7f24ec197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:19.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.312+0000 7f24f30c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24ec1029b0 0x7f24ec19e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:19.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.312+0000 7f24f30c1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec10cb20 con 0x7f24ec1029b0 2024-04-20T12:20:19.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.312+0000 7f24f30c1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec10c9a0 con 0x7f24ec100ea0 2024-04-20T12:20:19.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.312+0000 7f24f30c1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec10cca0 con 0x7f24ec101ff0 2024-04-20T12:20:19.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.312+0000 7f24f165e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24ec1029b0 0x7f24ec19e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:19.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.312+0000 7f24f165e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24ec1029b0 0x7f24ec19e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51400/0 (socket says 172.21.15.135:51400) 2024-04-20T12:20:19.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.312+0000 7f24f165e640 1 -- 172.21.15.135:0/2629860260 learned_addr learned my addr 172.21.15.135:0/2629860260 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:19.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.312+0000 7f24ebfff640 1 --2- 172.21.15.135:0/2629860260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24ec101ff0 0x7f24ec197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:19.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.312+0000 7f24f0e5d640 1 --2- 172.21.15.135:0/2629860260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24ec100ea0 0x7f24ec1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:19.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.313+0000 7f24f165e640 1 -- 172.21.15.135:0/2629860260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24ec101ff0 msgr2=0x7f24ec197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:19.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.313+0000 7f24f165e640 1 --2- 172.21.15.135:0/2629860260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24ec101ff0 0x7f24ec197720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:19.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.313+0000 7f24f165e640 1 -- 172.21.15.135:0/2629860260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24ec100ea0 msgr2=0x7f24ec1971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:19.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.313+0000 7f24f165e640 1 --2- 172.21.15.135:0/2629860260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24ec100ea0 0x7f24ec1971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:19.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.313+0000 7f24f165e640 1 -- 172.21.15.135:0/2629860260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ec19ee00 con 0x7f24ec1029b0 2024-04-20T12:20:19.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.313+0000 7f24f0e5d640 1 --2- 172.21.15.135:0/2629860260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24ec100ea0 0x7f24ec1971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:20:19.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.313+0000 7f24f165e640 1 --2- 172.21.15.135:0/2629860260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24ec1029b0 0x7f24ec19e790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009fd0 tx=0x7f24e400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:19.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.313+0000 7f24e9ffb640 1 -- 172.21.15.135:0/2629860260 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4017070 con 0x7f24ec1029b0 2024-04-20T12:20:19.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.313+0000 7f24f30c1640 1 -- 172.21.15.135:0/2629860260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ec19f0f0 con 0x7f24ec1029b0 2024-04-20T12:20:19.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.313+0000 7f24e9ffb640 1 -- 172.21.15.135:0/2629860260 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24e4003e50 con 0x7f24ec1029b0 2024-04-20T12:20:19.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.313+0000 7f24e9ffb640 1 -- 172.21.15.135:0/2629860260 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e40106c0 con 0x7f24ec1029b0 2024-04-20T12:20:19.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.313+0000 7f24f30c1640 1 -- 172.21.15.135:0/2629860260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ec19f640 con 0x7f24ec1029b0 2024-04-20T12:20:19.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.314+0000 7f24f30c1640 1 -- 172.21.15.135:0/2629860260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24ec1081b0 con 0x7f24ec1029b0 2024-04-20T12:20:19.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.315+0000 7f24e9ffb640 1 -- 172.21.15.135:0/2629860260 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f24e4003970 con 0x7f24ec1029b0 2024-04-20T12:20:19.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.316+0000 7f24e9ffb640 1 --2- 172.21.15.135:0/2629860260 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f24dc0a3bb0 0x7f24dc0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:19.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.316+0000 7f24f0e5d640 1 --2- 172.21.15.135:0/2629860260 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f24dc0a3bb0 0x7f24dc0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:19.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.316+0000 7f24e9ffb640 1 -- 172.21.15.135:0/2629860260 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f24e40cfcf0 con 0x7f24ec1029b0 2024-04-20T12:20:19.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.316+0000 7f24f0e5d640 1 --2- 172.21.15.135:0/2629860260 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f24dc0a3bb0 0x7f24dc0a6070 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f24e0006010 tx=0x7f24e002c8a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:19.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.320+0000 7f24e9ffb640 1 -- 172.21.15.135:0/2629860260 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f24e40d4070 con 0x7f24ec1029b0 2024-04-20T12:20:19.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.537+0000 7f24f30c1640 1 -- 172.21.15.135:0/2629860260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24ec062b60 con 0x7f24ec1029b0 2024-04-20T12:20:19.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.538+0000 7f24e9ffb640 1 -- 172.21.15.135:0/2629860260 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4705 (secure 0 0 0) 0x7f24e409cb70 con 0x7f24ec1029b0 2024-04-20T12:20:19.538 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:19.538 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-04-20T12:20:19.538 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 6 2024-04-20T12:20:19.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.540+0000 7f24f30c1640 1 -- 172.21.15.135:0/2629860260 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f24dc0a3bb0 msgr2=0x7f24dc0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:19.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.540+0000 7f24f30c1640 1 --2- 172.21.15.135:0/2629860260 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f24dc0a3bb0 0x7f24dc0a6070 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f24e0006010 tx=0x7f24e002c8a0 comp rx=0 tx=0).stop 2024-04-20T12:20:19.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.540+0000 7f24f30c1640 1 -- 172.21.15.135:0/2629860260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24ec1029b0 msgr2=0x7f24ec19e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:19.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.540+0000 7f24f30c1640 1 --2- 172.21.15.135:0/2629860260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24ec1029b0 0x7f24ec19e790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009fd0 tx=0x7f24e400b260 comp rx=0 tx=0).stop 2024-04-20T12:20:19.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.540+0000 7f24f30c1640 1 -- 172.21.15.135:0/2629860260 shutdown_connections 2024-04-20T12:20:19.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.540+0000 7f24f30c1640 1 --2- 172.21.15.135:0/2629860260 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f24dc0a3bb0 0x7f24dc0a6070 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:19.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.540+0000 7f24f30c1640 1 --2- 172.21.15.135:0/2629860260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24ec1029b0 0x7f24ec19e790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:19.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.540+0000 7f24f30c1640 1 --2- 172.21.15.135:0/2629860260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f24ec101ff0 0x7f24ec197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:19.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.540+0000 7f24f30c1640 1 --2- 172.21.15.135:0/2629860260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f24ec100ea0 0x7f24ec1971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:19.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.540+0000 7f24f30c1640 1 -- 172.21.15.135:0/2629860260 >> 172.21.15.135:0/2629860260 conn(0x7f24ec0fc410 msgr2=0x7f24ec105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:19.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.540+0000 7f24f30c1640 1 -- 172.21.15.135:0/2629860260 shutdown_connections 2024-04-20T12:20:19.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:19.540+0000 7f24f30c1640 1 -- 172.21.15.135:0/2629860260 wait complete. 2024-04-20T12:20:20.109 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:19 smithi154 ceph-mon[22073]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:20.110 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:20.110 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:20.110 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:20.110 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:20.110 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:20.110 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:20.110 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:19 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2629860260' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:20.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:19 smithi135 ceph-mon[18264]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:20.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:20.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:19 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2629860260' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:20.161 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:19 smithi139 ceph-mon[21834]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:20.161 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:20.161 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:20.161 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:20.161 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:20.161 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:20.161 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:20.161 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:19 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2629860260' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:21.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:20 smithi135 ceph-mon[18264]: Deploying daemon mds.c on smithi154 2024-04-20T12:20:21.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:20 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] up:boot 2024-04-20T12:20:21.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:20 smithi135 ceph-mon[18264]: fsmap 6 up:standby 2024-04-20T12:20:21.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:20 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-20T12:20:21.196 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:20 smithi154 ceph-mon[22073]: Deploying daemon mds.c on smithi154 2024-04-20T12:20:21.196 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:20 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] up:boot 2024-04-20T12:20:21.196 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:20 smithi154 ceph-mon[22073]: fsmap 6 up:standby 2024-04-20T12:20:21.196 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:20 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-20T12:20:21.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:20 smithi139 ceph-mon[21834]: Deploying daemon mds.c on smithi154 2024-04-20T12:20:21.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:20 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] up:boot 2024-04-20T12:20:21.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:20 smithi139 ceph-mon[21834]: fsmap 6 up:standby 2024-04-20T12:20:21.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:20 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-20T12:20:21.502 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:20:21 smithi154 systemd[1]: Starting Ceph mds.c for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:20:21.552 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.663+0000 7f1f8fc4e640 1 -- 172.21.15.135:0/1181701701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f88101b90 msgr2=0x7f1f88102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.663+0000 7f1f8fc4e640 1 --2- 172.21.15.135:0/1181701701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f88101b90 0x7f1f88102010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009900 tx=0x7f1f8002bcd0 comp rx=0 tx=0).stop 2024-04-20T12:20:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.663+0000 7f1f8fc4e640 1 -- 172.21.15.135:0/1181701701 shutdown_connections 2024-04-20T12:20:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.663+0000 7f1f8fc4e640 1 --2- 172.21.15.135:0/1181701701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f88101b90 0x7f1f88102010 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.663+0000 7f1f8fc4e640 1 --2- 172.21.15.135:0/1181701701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f881011f0 0x7f1f88101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.663+0000 7f1f8fc4e640 1 --2- 172.21.15.135:0/1181701701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f88100890 0x7f1f88100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.663+0000 7f1f8fc4e640 1 -- 172.21.15.135:0/1181701701 >> 172.21.15.135:0/1181701701 conn(0x7f1f880fc410 msgr2=0x7f1f880fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.663+0000 7f1f8fc4e640 1 -- 172.21.15.135:0/1181701701 shutdown_connections 2024-04-20T12:20:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.663+0000 7f1f8fc4e640 1 -- 172.21.15.135:0/1181701701 wait complete. 2024-04-20T12:20:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8fc4e640 1 Processor -- start 2024-04-20T12:20:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8fc4e640 1 -- start start 2024-04-20T12:20:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8fc4e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f88100890 0x7f1f8819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8fc4e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f881011f0 0x7f1f8819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8fc4e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f88101b90 0x7f1f881a1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8fc4e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8810fe30 con 0x7f1f881011f0 2024-04-20T12:20:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8fc4e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8810fcb0 con 0x7f1f88100890 2024-04-20T12:20:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8fc4e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8810ffb0 con 0x7f1f88101b90 2024-04-20T12:20:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8d1e9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f881011f0 0x7f1f8819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8d1e9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f881011f0 0x7f1f8819a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53910/0 (socket says 172.21.15.135:53910) 2024-04-20T12:20:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8d1e9640 1 -- 172.21.15.135:0/549128433 learned_addr learned my addr 172.21.15.135:0/549128433 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8e1eb640 1 --2- 172.21.15.135:0/549128433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f88101b90 0x7f1f881a1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8d9ea640 1 --2- 172.21.15.135:0/549128433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f88100890 0x7f1f8819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8d1e9640 1 -- 172.21.15.135:0/549128433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f88101b90 msgr2=0x7f1f881a1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8d1e9640 1 --2- 172.21.15.135:0/549128433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f88101b90 0x7f1f881a1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8d1e9640 1 -- 172.21.15.135:0/549128433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f88100890 msgr2=0x7f1f8819a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8d1e9640 1 --2- 172.21.15.135:0/549128433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f88100890 0x7f1f8819a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.664+0000 7f1f8d1e9640 1 -- 172.21.15.135:0/549128433 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f881a2070 con 0x7f1f881011f0 2024-04-20T12:20:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.665+0000 7f1f8d1e9640 1 --2- 172.21.15.135:0/549128433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f881011f0 0x7f1f8819a990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800d770 tx=0x7f1f7800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.665+0000 7f1f7effd640 1 -- 172.21.15.135:0/549128433 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f78017070 con 0x7f1f881011f0 2024-04-20T12:20:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.665+0000 7f1f8fc4e640 1 -- 172.21.15.135:0/549128433 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f881a2360 con 0x7f1f881011f0 2024-04-20T12:20:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.665+0000 7f1f7effd640 1 -- 172.21.15.135:0/549128433 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f78005500 con 0x7f1f881011f0 2024-04-20T12:20:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.665+0000 7f1f7effd640 1 -- 172.21.15.135:0/549128433 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f78004e00 con 0x7f1f881011f0 2024-04-20T12:20:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.665+0000 7f1f8fc4e640 1 -- 172.21.15.135:0/549128433 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f881a28b0 con 0x7f1f881011f0 2024-04-20T12:20:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.666+0000 7f1f8fc4e640 1 -- 172.21.15.135:0/549128433 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f8810b740 con 0x7f1f881011f0 2024-04-20T12:20:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.667+0000 7f1f7effd640 1 -- 172.21.15.135:0/549128433 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f1f78004fa0 con 0x7f1f881011f0 2024-04-20T12:20:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.668+0000 7f1f7effd640 1 --2- 172.21.15.135:0/549128433 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1f740a3bb0 0x7f1f740a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.668+0000 7f1f8d9ea640 1 --2- 172.21.15.135:0/549128433 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1f740a3bb0 0x7f1f740a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.668+0000 7f1f7effd640 1 -- 172.21.15.135:0/549128433 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f1f780cfd40 con 0x7f1f881011f0 2024-04-20T12:20:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.668+0000 7f1f8d9ea640 1 --2- 172.21.15.135:0/549128433 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1f740a3bb0 0x7f1f740a6070 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1f840099a0 tx=0x7f1f84009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:21.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.671+0000 7f1f7effd640 1 -- 172.21.15.135:0/549128433 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f1f7809c570 con 0x7f1f881011f0 2024-04-20T12:20:21.861 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:20:21 smithi154 podman[52288]: 2024-04-20 12:20:21.50366116 +0000 UTC m=+0.018343970 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:20:21.861 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:20:21 smithi154 podman[52288]: 2024-04-20 12:20:21.610046586 +0000 UTC m=+0.124729390 container create d4524ec46e592b6d611e03ea06d382e58e127e51b5cdeeacaa876af2d2fbe6da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:20:21.861 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:20:21 smithi154 podman[52288]: 2024-04-20 12:20:21.846333475 +0000 UTC m=+0.361016272 container init d4524ec46e592b6d611e03ea06d382e58e127e51b5cdeeacaa876af2d2fbe6da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-c, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-20T12:20:21.861 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:20:21 smithi154 podman[52288]: 2024-04-20 12:20:21.848869198 +0000 UTC m=+0.363551996 container start d4524ec46e592b6d611e03ea06d382e58e127e51b5cdeeacaa876af2d2fbe6da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-c, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-20T12:20:21.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.887+0000 7f1f8fc4e640 1 -- 172.21.15.135:0/549128433 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f8802d5d0 con 0x7f1f881011f0 2024-04-20T12:20:21.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.887+0000 7f1f7effd640 1 -- 172.21.15.135:0/549128433 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5533 (secure 0 0 0) 0x7f1f780a0870 con 0x7f1f881011f0 2024-04-20T12:20:21.886 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:21.886 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-04-20T12:20:21.887 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 7 2024-04-20T12:20:21.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.889+0000 7f1f8fc4e640 1 -- 172.21.15.135:0/549128433 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1f740a3bb0 msgr2=0x7f1f740a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:21.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.889+0000 7f1f8fc4e640 1 --2- 172.21.15.135:0/549128433 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1f740a3bb0 0x7f1f740a6070 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1f840099a0 tx=0x7f1f84009500 comp rx=0 tx=0).stop 2024-04-20T12:20:21.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.889+0000 7f1f8fc4e640 1 -- 172.21.15.135:0/549128433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f881011f0 msgr2=0x7f1f8819a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:21.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.889+0000 7f1f8fc4e640 1 --2- 172.21.15.135:0/549128433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f881011f0 0x7f1f8819a990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1f7800d770 tx=0x7f1f7800dc30 comp rx=0 tx=0).stop 2024-04-20T12:20:21.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.889+0000 7f1f8fc4e640 1 -- 172.21.15.135:0/549128433 shutdown_connections 2024-04-20T12:20:21.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.889+0000 7f1f8fc4e640 1 --2- 172.21.15.135:0/549128433 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1f740a3bb0 0x7f1f740a6070 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:21.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.889+0000 7f1f8fc4e640 1 --2- 172.21.15.135:0/549128433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f88101b90 0x7f1f881a1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:21.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.889+0000 7f1f8fc4e640 1 --2- 172.21.15.135:0/549128433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f881011f0 0x7f1f8819a990 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:21.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.889+0000 7f1f8fc4e640 1 --2- 172.21.15.135:0/549128433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f88100890 0x7f1f8819a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:21.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.889+0000 7f1f8fc4e640 1 -- 172.21.15.135:0/549128433 >> 172.21.15.135:0/549128433 conn(0x7f1f880fc410 msgr2=0x7f1f880fdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:21.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.889+0000 7f1f8fc4e640 1 -- 172.21.15.135:0/549128433 shutdown_connections 2024-04-20T12:20:21.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:21.889+0000 7f1f8fc4e640 1 -- 172.21.15.135:0/549128433 wait complete. 2024-04-20T12:20:22.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:21 smithi135 ceph-mon[18264]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:22.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:21 smithi154 ceph-mon[22073]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:22.251 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:20:21 smithi154 ceph-mds[52306]: -- 172.21.15.154:0/112546845 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562516c9ba40 con 0x562516c6ec00 2024-04-20T12:20:22.251 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:20:21 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-c[52302]: starting mds.c at 2024-04-20T12:20:22.251 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:20:21 smithi154 bash[52288]: d4524ec46e592b6d611e03ea06d382e58e127e51b5cdeeacaa876af2d2fbe6da 2024-04-20T12:20:22.251 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:20:21 smithi154 systemd[1]: Started Ceph mds.c for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:20:22.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:21 smithi139 ceph-mon[21834]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:22.983 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:22 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/549128433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:22.983 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:22 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:22.983 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:22 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:22.983 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:22 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:22.983 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:22 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:22.983 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:22 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:22.983 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:22 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:23.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:22 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/549128433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:23.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:22 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:23.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:22 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:23.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:22 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:23.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:22 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:23.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:22 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:23.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:22 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:23.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:22 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/549128433' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:23.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:22 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:23.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:22 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:23.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:22 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:23.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:22 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:23.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:22 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:23.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:22 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:23.901 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:24.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.012+0000 7ff4680ba640 1 -- 172.21.15.135:0/1451094433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff460102a00 msgr2=0x7ff460109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:24.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.012+0000 7ff4680ba640 1 --2- 172.21.15.135:0/1451094433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff460102a00 0x7ff460109320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff458009ca0 tx=0x7ff45802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:24.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.012+0000 7ff4680ba640 1 -- 172.21.15.135:0/1451094433 shutdown_connections 2024-04-20T12:20:24.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.012+0000 7ff4680ba640 1 --2- 172.21.15.135:0/1451094433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff460102a00 0x7ff460109320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:24.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.012+0000 7ff4680ba640 1 --2- 172.21.15.135:0/1451094433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff460102040 0x7ff4601024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:24.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.012+0000 7ff4680ba640 1 --2- 172.21.15.135:0/1451094433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff460100e60 0x7ff460101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:24.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.012+0000 7ff4680ba640 1 -- 172.21.15.135:0/1451094433 >> 172.21.15.135:0/1451094433 conn(0x7ff4600fc440 msgr2=0x7ff4600fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:24.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.012+0000 7ff4680ba640 1 -- 172.21.15.135:0/1451094433 shutdown_connections 2024-04-20T12:20:24.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.012+0000 7ff4680ba640 1 -- 172.21.15.135:0/1451094433 wait complete. 2024-04-20T12:20:24.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.012+0000 7ff4680ba640 1 Processor -- start 2024-04-20T12:20:24.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.012+0000 7ff4680ba640 1 -- start start 2024-04-20T12:20:24.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff4680ba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff460100e60 0x7ff460197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:24.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff4680ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff460102040 0x7ff460197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:24.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff4680ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff460102a00 0x7ff46019e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:24.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff4680ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff46010cb50 con 0x7ff460102a00 2024-04-20T12:20:24.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff4680ba640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff46010c9d0 con 0x7ff460100e60 2024-04-20T12:20:24.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff4680ba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff46010ccd0 con 0x7ff460102040 2024-04-20T12:20:24.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff466657640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff460102a00 0x7ff46019e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:24.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff466657640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff460102a00 0x7ff46019e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53932/0 (socket says 172.21.15.135:53932) 2024-04-20T12:20:24.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff466657640 1 -- 172.21.15.135:0/4221771839 learned_addr learned my addr 172.21.15.135:0/4221771839 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:24.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff465e56640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff460100e60 0x7ff460197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:24.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff465655640 1 --2- 172.21.15.135:0/4221771839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff460102040 0x7ff460197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:24.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff466657640 1 -- 172.21.15.135:0/4221771839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff460102040 msgr2=0x7ff460197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:24.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff466657640 1 --2- 172.21.15.135:0/4221771839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff460102040 0x7ff460197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:24.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff466657640 1 -- 172.21.15.135:0/4221771839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff460100e60 msgr2=0x7ff460197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:24.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff466657640 1 --2- 172.21.15.135:0/4221771839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff460100e60 0x7ff460197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:24.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff466657640 1 -- 172.21.15.135:0/4221771839 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46019ee40 con 0x7ff460102a00 2024-04-20T12:20:24.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff465e56640 1 --2- 172.21.15.135:0/4221771839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff460100e60 0x7ff460197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:20:24.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff466657640 1 --2- 172.21.15.135:0/4221771839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff460102a00 0x7ff46019e7d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff458037040 tx=0x7ff458032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:24.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff456ffd640 1 -- 172.21.15.135:0/4221771839 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458041020 con 0x7ff460102a00 2024-04-20T12:20:24.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff456ffd640 1 -- 172.21.15.135:0/4221771839 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff458034d90 con 0x7ff460102a00 2024-04-20T12:20:24.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff456ffd640 1 -- 172.21.15.135:0/4221771839 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458039040 con 0x7ff460102a00 2024-04-20T12:20:24.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.013+0000 7ff4680ba640 1 -- 172.21.15.135:0/4221771839 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff46019f0d0 con 0x7ff460102a00 2024-04-20T12:20:24.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.014+0000 7ff4680ba640 1 -- 172.21.15.135:0/4221771839 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff46019f5c0 con 0x7ff460102a00 2024-04-20T12:20:24.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.015+0000 7ff4680ba640 1 -- 172.21.15.135:0/4221771839 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff460108130 con 0x7ff460102a00 2024-04-20T12:20:24.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.016+0000 7ff456ffd640 1 -- 172.21.15.135:0/4221771839 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7ff458044020 con 0x7ff460102a00 2024-04-20T12:20:24.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.016+0000 7ff456ffd640 1 --2- 172.21.15.135:0/4221771839 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff44c0a3bb0 0x7ff44c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:24.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.017+0000 7ff465e56640 1 --2- 172.21.15.135:0/4221771839 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff44c0a3bb0 0x7ff44c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:24.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.017+0000 7ff456ffd640 1 -- 172.21.15.135:0/4221771839 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7ff4580f18f0 con 0x7ff460102a00 2024-04-20T12:20:24.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.017+0000 7ff465e56640 1 --2- 172.21.15.135:0/4221771839 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff44c0a3bb0 0x7ff44c0a6070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff460101bb0 tx=0x7ff45c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:24.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.021+0000 7ff456ffd640 1 -- 172.21.15.135:0/4221771839 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7ff45804b070 con 0x7ff460102a00 2024-04-20T12:20:24.030 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:23 smithi139 ceph-mon[21834]: Deploying daemon mds.h on smithi139 2024-04-20T12:20:24.030 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:23 smithi139 ceph-mon[21834]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:24.030 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:23 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] up:boot 2024-04-20T12:20:24.030 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:23 smithi139 ceph-mon[21834]: fsmap 7 up:standby 2024-04-20T12:20:24.030 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:23 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-20T12:20:24.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.238+0000 7ff4680ba640 1 -- 172.21.15.135:0/4221771839 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff460062b60 con 0x7ff460102a00 2024-04-20T12:20:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.239+0000 7ff456ffd640 1 -- 172.21.15.135:0/4221771839 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6361 (secure 0 0 0) 0x7ff4580be770 con 0x7ff460102a00 2024-04-20T12:20:24.238 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:24.238 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-20T12:20:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 8 2024-04-20T12:20:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.241+0000 7ff4680ba640 1 -- 172.21.15.135:0/4221771839 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff44c0a3bb0 msgr2=0x7ff44c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.241+0000 7ff4680ba640 1 --2- 172.21.15.135:0/4221771839 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff44c0a3bb0 0x7ff44c0a6070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff460101bb0 tx=0x7ff45c005f90 comp rx=0 tx=0).stop 2024-04-20T12:20:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.241+0000 7ff4680ba640 1 -- 172.21.15.135:0/4221771839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff460102a00 msgr2=0x7ff46019e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.241+0000 7ff4680ba640 1 --2- 172.21.15.135:0/4221771839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff460102a00 0x7ff46019e7d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff458037040 tx=0x7ff458032f20 comp rx=0 tx=0).stop 2024-04-20T12:20:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.241+0000 7ff4680ba640 1 -- 172.21.15.135:0/4221771839 shutdown_connections 2024-04-20T12:20:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.241+0000 7ff4680ba640 1 --2- 172.21.15.135:0/4221771839 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff44c0a3bb0 0x7ff44c0a6070 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.241+0000 7ff4680ba640 1 --2- 172.21.15.135:0/4221771839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff460102a00 0x7ff46019e7d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.241+0000 7ff4680ba640 1 --2- 172.21.15.135:0/4221771839 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff460102040 0x7ff460197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.241+0000 7ff4680ba640 1 --2- 172.21.15.135:0/4221771839 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff460100e60 0x7ff460197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.241+0000 7ff4680ba640 1 -- 172.21.15.135:0/4221771839 >> 172.21.15.135:0/4221771839 conn(0x7ff4600fc440 msgr2=0x7ff460105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.241+0000 7ff4680ba640 1 -- 172.21.15.135:0/4221771839 shutdown_connections 2024-04-20T12:20:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:24.241+0000 7ff4680ba640 1 -- 172.21.15.135:0/4221771839 wait complete. 2024-04-20T12:20:24.250 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:23 smithi135 ceph-mon[18264]: Deploying daemon mds.h on smithi139 2024-04-20T12:20:24.250 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:23 smithi135 ceph-mon[18264]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:24.250 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:23 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] up:boot 2024-04-20T12:20:24.250 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:23 smithi135 ceph-mon[18264]: fsmap 7 up:standby 2024-04-20T12:20:24.250 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:23 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-20T12:20:24.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:23 smithi154 ceph-mon[22073]: Deploying daemon mds.h on smithi139 2024-04-20T12:20:24.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:23 smithi154 ceph-mon[22073]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:24.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:23 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] up:boot 2024-04-20T12:20:24.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:23 smithi154 ceph-mon[22073]: fsmap 7 up:standby 2024-04-20T12:20:24.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:23 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-20T12:20:24.330 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:20:24 smithi139 systemd[1]: Starting Ceph mds.h for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:20:24.692 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:20:24 smithi139 podman[51758]: 2024-04-20 12:20:24.334771004 +0000 UTC m=+0.018428610 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:20:24.692 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:20:24 smithi139 podman[51758]: 2024-04-20 12:20:24.441220278 +0000 UTC m=+0.124877910 container create 404ea5bbd28dc57860f7f8433323adb22aff492313e4509bdb36b60d978b3148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-h, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS) 2024-04-20T12:20:24.692 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:20:24 smithi139 podman[51758]: 2024-04-20 12:20:24.693732704 +0000 UTC m=+0.377390294 container init 404ea5bbd28dc57860f7f8433323adb22aff492313e4509bdb36b60d978b3148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416) 2024-04-20T12:20:25.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:24 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/4221771839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:25.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:24 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:25.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:24 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:25.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:24 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:25.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:24 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:25.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:24 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:25.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:24 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:25.080 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:20:24 smithi139 podman[51758]: 2024-04-20 12:20:24.696376516 +0000 UTC m=+0.380034107 container start 404ea5bbd28dc57860f7f8433323adb22aff492313e4509bdb36b60d978b3148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-h, org.label-schema.build-date=20240416, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:20:25.080 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:20:24 smithi139 ceph-mds[51776]: -- 172.21.15.139:0/2894000618 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f7f87d9a40 con 0x55f7f87ac800 2024-04-20T12:20:25.080 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:20:24 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-h[51772]: starting mds.h at 2024-04-20T12:20:25.081 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:20:24 smithi139 bash[51758]: 404ea5bbd28dc57860f7f8433323adb22aff492313e4509bdb36b60d978b3148 2024-04-20T12:20:25.081 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:20:24 smithi139 systemd[1]: Started Ceph mds.h for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:20:25.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:24 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/4221771839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:25.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:24 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:25.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:24 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:25.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:24 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:25.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:24 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:25.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:24 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:25.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:24 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:25.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:24 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/4221771839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:25.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:24 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:25.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:24 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:25.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:24 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:25.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:24 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:25.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:24 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:25.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:24 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:26.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:25 smithi154 ceph-mon[22073]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:26.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:25 smithi154 ceph-mon[22073]: Deploying daemon mds.i on smithi154 2024-04-20T12:20:26.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:25 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.139:6836/2426010804,v1:172.21.15.139:6837/2426010804] up:boot 2024-04-20T12:20:26.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:25 smithi154 ceph-mon[22073]: fsmap 8 up:standby 2024-04-20T12:20:26.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:25 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-20T12:20:26.254 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:26.278 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:25 smithi135 ceph-mon[18264]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:26.279 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:25 smithi135 ceph-mon[18264]: Deploying daemon mds.i on smithi154 2024-04-20T12:20:26.279 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:25 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.139:6836/2426010804,v1:172.21.15.139:6837/2426010804] up:boot 2024-04-20T12:20:26.279 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:25 smithi135 ceph-mon[18264]: fsmap 8 up:standby 2024-04-20T12:20:26.279 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:25 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-20T12:20:26.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:25 smithi139 ceph-mon[21834]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:26.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:25 smithi139 ceph-mon[21834]: Deploying daemon mds.i on smithi154 2024-04-20T12:20:26.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:25 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.139:6836/2426010804,v1:172.21.15.139:6837/2426010804] up:boot 2024-04-20T12:20:26.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:25 smithi139 ceph-mon[21834]: fsmap 8 up:standby 2024-04-20T12:20:26.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:25 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-20T12:20:26.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.365+0000 7f55920c7640 1 -- 172.21.15.135:0/1374207983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f558c101ff0 msgr2=0x7f558c102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:26.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.365+0000 7f55920c7640 1 --2- 172.21.15.135:0/1374207983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f558c101ff0 0x7f558c102470 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5580009900 tx=0x7f558002bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:26.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.365+0000 7f55920c7640 1 -- 172.21.15.135:0/1374207983 shutdown_connections 2024-04-20T12:20:26.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.365+0000 7f55920c7640 1 --2- 172.21.15.135:0/1374207983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f558c1029b0 0x7f558c1092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:26.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.365+0000 7f55920c7640 1 --2- 172.21.15.135:0/1374207983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f558c101ff0 0x7f558c102470 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:26.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.365+0000 7f55920c7640 1 --2- 172.21.15.135:0/1374207983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f558c100ea0 0x7f558c1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:26.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.365+0000 7f55920c7640 1 -- 172.21.15.135:0/1374207983 >> 172.21.15.135:0/1374207983 conn(0x7f558c0fc410 msgr2=0x7f558c0fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:26.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.365+0000 7f55920c7640 1 -- 172.21.15.135:0/1374207983 shutdown_connections 2024-04-20T12:20:26.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.365+0000 7f55920c7640 1 -- 172.21.15.135:0/1374207983 wait complete. 2024-04-20T12:20:26.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.365+0000 7f55920c7640 1 Processor -- start 2024-04-20T12:20:26.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f55920c7640 1 -- start start 2024-04-20T12:20:26.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f55920c7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f558c100ea0 0x7f558c104e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:26.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f55920c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f558c101ff0 0x7f558c103460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:26.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f55920c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f558c1029b0 0x7f558c1039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:26.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f55920c7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f558c10cb40 con 0x7f558c100ea0 2024-04-20T12:20:26.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f55920c7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f558c10c9c0 con 0x7f558c101ff0 2024-04-20T12:20:26.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f55920c7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f558c10ccc0 con 0x7f558c1029b0 2024-04-20T12:20:26.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f558b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f558c100ea0 0x7f558c104e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:26.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f558b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f558c100ea0 0x7f558c104e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53952/0 (socket says 172.21.15.135:53952) 2024-04-20T12:20:26.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f558b7fe640 1 -- 172.21.15.135:0/2676819259 learned_addr learned my addr 172.21.15.135:0/2676819259 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:26.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f558bfff640 1 --2- 172.21.15.135:0/2676819259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f558c1029b0 0x7f558c1039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:26.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f558affd640 1 --2- 172.21.15.135:0/2676819259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f558c101ff0 0x7f558c103460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:26.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f558b7fe640 1 -- 172.21.15.135:0/2676819259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f558c1029b0 msgr2=0x7f558c1039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:26.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f558b7fe640 1 --2- 172.21.15.135:0/2676819259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f558c1029b0 0x7f558c1039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:26.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f558b7fe640 1 -- 172.21.15.135:0/2676819259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f558c101ff0 msgr2=0x7f558c103460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:26.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f558b7fe640 1 --2- 172.21.15.135:0/2676819259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f558c101ff0 0x7f558c103460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:26.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f558b7fe640 1 -- 172.21.15.135:0/2676819259 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558c104230 con 0x7f558c100ea0 2024-04-20T12:20:26.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f558affd640 1 --2- 172.21.15.135:0/2676819259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f558c101ff0 0x7f558c103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:20:26.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f558b7fe640 1 --2- 172.21.15.135:0/2676819259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f558c100ea0 0x7f558c104e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f557c00c890 tx=0x7f557c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:26.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f5588ff9640 1 -- 172.21.15.135:0/2676819259 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c004220 con 0x7f558c100ea0 2024-04-20T12:20:26.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f5588ff9640 1 -- 172.21.15.135:0/2676819259 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f557c0043c0 con 0x7f558c100ea0 2024-04-20T12:20:26.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.366+0000 7f55920c7640 1 -- 172.21.15.135:0/2676819259 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558c1a2400 con 0x7f558c100ea0 2024-04-20T12:20:26.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.367+0000 7f5588ff9640 1 -- 172.21.15.135:0/2676819259 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c0049e0 con 0x7f558c100ea0 2024-04-20T12:20:26.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.367+0000 7f55920c7640 1 -- 172.21.15.135:0/2676819259 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f558c1a2950 con 0x7f558c100ea0 2024-04-20T12:20:26.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.367+0000 7f55920c7640 1 -- 172.21.15.135:0/2676819259 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f558c1a2c70 con 0x7f558c100ea0 2024-04-20T12:20:26.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.369+0000 7f5588ff9640 1 -- 172.21.15.135:0/2676819259 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f557c0079b0 con 0x7f558c100ea0 2024-04-20T12:20:26.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.369+0000 7f5588ff9640 1 --2- 172.21.15.135:0/2676819259 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f55740a3bb0 0x7f55740a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:26.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.369+0000 7f558affd640 1 --2- 172.21.15.135:0/2676819259 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f55740a3bb0 0x7f55740a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:26.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.369+0000 7f5588ff9640 1 -- 172.21.15.135:0/2676819259 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f557c0d00d0 con 0x7f558c100ea0 2024-04-20T12:20:26.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.370+0000 7f558affd640 1 --2- 172.21.15.135:0/2676819259 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f55740a3bb0 0x7f55740a6070 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5580006010 tx=0x7f5580000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:26.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.373+0000 7f5588ff9640 1 -- 172.21.15.135:0/2676819259 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f557c014030 con 0x7f558c100ea0 2024-04-20T12:20:26.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.588+0000 7f55920c7640 1 -- 172.21.15.135:0/2676819259 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f558c1a2e40 con 0x7f558c100ea0 2024-04-20T12:20:26.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.589+0000 7f5588ff9640 1 -- 172.21.15.135:0/2676819259 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7189 (secure 0 0 0) 0x7f557c09cf50 con 0x7f558c100ea0 2024-04-20T12:20:26.588 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:26.588 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-04-20T12:20:26.588 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 9 2024-04-20T12:20:26.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.591+0000 7f55920c7640 1 -- 172.21.15.135:0/2676819259 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f55740a3bb0 msgr2=0x7f55740a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:26.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.591+0000 7f55920c7640 1 --2- 172.21.15.135:0/2676819259 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f55740a3bb0 0x7f55740a6070 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5580006010 tx=0x7f5580000bc0 comp rx=0 tx=0).stop 2024-04-20T12:20:26.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.591+0000 7f55920c7640 1 -- 172.21.15.135:0/2676819259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f558c100ea0 msgr2=0x7f558c104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:26.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.591+0000 7f55920c7640 1 --2- 172.21.15.135:0/2676819259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f558c100ea0 0x7f558c104e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f557c00c890 tx=0x7f557c00cd50 comp rx=0 tx=0).stop 2024-04-20T12:20:26.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.591+0000 7f55920c7640 1 -- 172.21.15.135:0/2676819259 shutdown_connections 2024-04-20T12:20:26.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.591+0000 7f55920c7640 1 --2- 172.21.15.135:0/2676819259 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f55740a3bb0 0x7f55740a6070 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:26.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.591+0000 7f55920c7640 1 --2- 172.21.15.135:0/2676819259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f558c1029b0 0x7f558c1039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:26.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.591+0000 7f55920c7640 1 --2- 172.21.15.135:0/2676819259 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f558c101ff0 0x7f558c103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:26.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.591+0000 7f55920c7640 1 --2- 172.21.15.135:0/2676819259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f558c100ea0 0x7f558c104e20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:26.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.591+0000 7f55920c7640 1 -- 172.21.15.135:0/2676819259 >> 172.21.15.135:0/2676819259 conn(0x7f558c0fc410 msgr2=0x7f558c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:26.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.591+0000 7f55920c7640 1 -- 172.21.15.135:0/2676819259 shutdown_connections 2024-04-20T12:20:26.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:26.591+0000 7f55920c7640 1 -- 172.21.15.135:0/2676819259 wait complete. 2024-04-20T12:20:27.177 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:26 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2676819259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:27.178 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:20:26 smithi154 systemd[1]: Starting Ceph mds.i for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:20:27.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:26 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2676819259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:27.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:26 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2676819259' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:27.427 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:20:27 smithi154 podman[52590]: 2024-04-20 12:20:27.080196 +0000 UTC m=+0.017837625 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:20:27.427 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:20:27 smithi154 podman[52590]: 2024-04-20 12:20:27.199787515 +0000 UTC m=+0.137429125 container create 103e36723ff223c481357770f10911a466fb5fdb34d69a4c0d3f4bf560e479b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-04-20T12:20:27.427 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:20:27 smithi154 podman[52590]: 2024-04-20 12:20:27.402559802 +0000 UTC m=+0.340201412 container init 103e36723ff223c481357770f10911a466fb5fdb34d69a4c0d3f4bf560e479b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-20T12:20:27.427 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:20:27 smithi154 podman[52590]: 2024-04-20 12:20:27.405319206 +0000 UTC m=+0.342960826 container start 103e36723ff223c481357770f10911a466fb5fdb34d69a4c0d3f4bf560e479b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T12:20:27.751 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:20:27 smithi154 ceph-mds[52609]: -- 172.21.15.154:0/693497617 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55edf830da40 con 0x55edf82e1000 2024-04-20T12:20:27.751 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:20:27 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i[52605]: starting mds.i at 2024-04-20T12:20:27.751 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:20:27 smithi154 bash[52590]: 103e36723ff223c481357770f10911a466fb5fdb34d69a4c0d3f4bf560e479b9 2024-04-20T12:20:27.751 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:20:27 smithi154 systemd[1]: Started Ceph mds.i for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:20:28.215 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:27 smithi135 ceph-mon[18264]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:28.215 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:28.215 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:28.215 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:28.215 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:28.215 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:28.215 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:27 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:28.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:27 smithi154 ceph-mon[22073]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:28.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:28.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:28.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:28.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:28.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:28.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:27 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:28.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:27 smithi139 ceph-mon[21834]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:28.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:28.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:28.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:28.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:28.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:28.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:27 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:28.602 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:28.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.704+0000 7f377568c640 1 -- 172.21.15.135:0/2465064594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3770100ea0 msgr2=0x7f37701012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:28.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.704+0000 7f377568c640 1 --2- 172.21.15.135:0/2465064594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3770100ea0 0x7f37701012c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3760009ca0 tx=0x7f376002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:28.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.704+0000 7f377568c640 1 -- 172.21.15.135:0/2465064594 shutdown_connections 2024-04-20T12:20:28.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.704+0000 7f377568c640 1 --2- 172.21.15.135:0/2465064594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37701029b0 0x7f37701092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:28.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.704+0000 7f377568c640 1 --2- 172.21.15.135:0/2465064594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3770101ff0 0x7f3770102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:28.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.704+0000 7f377568c640 1 --2- 172.21.15.135:0/2465064594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3770100ea0 0x7f37701012c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.705+0000 7f377568c640 1 -- 172.21.15.135:0/2465064594 >> 172.21.15.135:0/2465064594 conn(0x7f37700fc410 msgr2=0x7f37700fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.705+0000 7f377568c640 1 -- 172.21.15.135:0/2465064594 shutdown_connections 2024-04-20T12:20:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.705+0000 7f377568c640 1 -- 172.21.15.135:0/2465064594 wait complete. 2024-04-20T12:20:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.705+0000 7f377568c640 1 Processor -- start 2024-04-20T12:20:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.705+0000 7f377568c640 1 -- start start 2024-04-20T12:20:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.705+0000 7f377568c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3770100ea0 0x7f3770198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.705+0000 7f377568c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3770101ff0 0x7f3770198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.705+0000 7f377568c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37701029b0 0x7f377019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.705+0000 7f377568c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f377010cc40 con 0x7f3770100ea0 2024-04-20T12:20:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.705+0000 7f377568c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f377010cac0 con 0x7f3770101ff0 2024-04-20T12:20:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.705+0000 7f377568c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f377010cdc0 con 0x7f37701029b0 2024-04-20T12:20:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f376effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3770100ea0 0x7f3770198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f376effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3770100ea0 0x7f3770198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:53964/0 (socket says 172.21.15.135:53964) 2024-04-20T12:20:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f376effd640 1 -- 172.21.15.135:0/1484455851 learned_addr learned my addr 172.21.15.135:0/1484455851 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:28.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f376e7fc640 1 --2- 172.21.15.135:0/1484455851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3770101ff0 0x7f3770198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:28.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f376f7fe640 1 --2- 172.21.15.135:0/1484455851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37701029b0 0x7f377019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:28.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f376effd640 1 -- 172.21.15.135:0/1484455851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37701029b0 msgr2=0x7f377019f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:28.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f376effd640 1 --2- 172.21.15.135:0/1484455851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37701029b0 0x7f377019f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:28.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f376effd640 1 -- 172.21.15.135:0/1484455851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3770101ff0 msgr2=0x7f3770198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:28.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f376effd640 1 --2- 172.21.15.135:0/1484455851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3770101ff0 0x7f3770198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:28.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f376effd640 1 -- 172.21.15.135:0/1484455851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37701a0020 con 0x7f3770100ea0 2024-04-20T12:20:28.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f376e7fc640 1 --2- 172.21.15.135:0/1484455851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3770101ff0 0x7f3770198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:20:28.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f376effd640 1 --2- 172.21.15.135:0/1484455851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3770100ea0 0x7f3770198400 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f37600324c0 tx=0x7f3760035d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:28.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f3757fff640 1 -- 172.21.15.135:0/1484455851 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3760039040 con 0x7f3770100ea0 2024-04-20T12:20:28.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f3757fff640 1 -- 172.21.15.135:0/1484455851 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3760044070 con 0x7f3770100ea0 2024-04-20T12:20:28.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f377568c640 1 -- 172.21.15.135:0/1484455851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37701a02b0 con 0x7f3770100ea0 2024-04-20T12:20:28.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f3757fff640 1 -- 172.21.15.135:0/1484455851 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37600044a0 con 0x7f3770100ea0 2024-04-20T12:20:28.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.706+0000 7f377568c640 1 -- 172.21.15.135:0/1484455851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37701a0820 con 0x7f3770100ea0 2024-04-20T12:20:28.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.707+0000 7f377568c640 1 -- 172.21.15.135:0/1484455851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37701a0a80 con 0x7f3770100ea0 2024-04-20T12:20:28.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.708+0000 7f3757fff640 1 -- 172.21.15.135:0/1484455851 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f3760004640 con 0x7f3770100ea0 2024-04-20T12:20:28.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.709+0000 7f3757fff640 1 --2- 172.21.15.135:0/1484455851 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f37580a3bb0 0x7f37580a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:28.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.709+0000 7f376e7fc640 1 --2- 172.21.15.135:0/1484455851 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f37580a3bb0 0x7f37580a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:28.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.709+0000 7f3757fff640 1 -- 172.21.15.135:0/1484455851 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f37600f2660 con 0x7f3770100ea0 2024-04-20T12:20:28.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.710+0000 7f376e7fc640 1 --2- 172.21.15.135:0/1484455851 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f37580a3bb0 0x7f37580a6070 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3764006fd0 tx=0x7f3764008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:28.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.714+0000 7f3757fff640 1 -- 172.21.15.135:0/1484455851 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f37600bf4e0 con 0x7f3770100ea0 2024-04-20T12:20:28.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.938+0000 7f377568c640 1 -- 172.21.15.135:0/1484455851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37701a0c50 con 0x7f3770100ea0 2024-04-20T12:20:28.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.939+0000 7f3757fff640 1 -- 172.21.15.135:0/1484455851 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8019 (secure 0 0 0) 0x7f37600bede0 con 0x7f3770100ea0 2024-04-20T12:20:28.938 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:28.938 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-20T12:20:28.938 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 10 2024-04-20T12:20:28.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.941+0000 7f377568c640 1 -- 172.21.15.135:0/1484455851 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f37580a3bb0 msgr2=0x7f37580a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:28.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.941+0000 7f377568c640 1 --2- 172.21.15.135:0/1484455851 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f37580a3bb0 0x7f37580a6070 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3764006fd0 tx=0x7f3764008040 comp rx=0 tx=0).stop 2024-04-20T12:20:28.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.941+0000 7f377568c640 1 -- 172.21.15.135:0/1484455851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3770100ea0 msgr2=0x7f3770198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:28.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.941+0000 7f377568c640 1 --2- 172.21.15.135:0/1484455851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3770100ea0 0x7f3770198400 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f37600324c0 tx=0x7f3760035d10 comp rx=0 tx=0).stop 2024-04-20T12:20:28.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.941+0000 7f377568c640 1 -- 172.21.15.135:0/1484455851 shutdown_connections 2024-04-20T12:20:28.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.941+0000 7f377568c640 1 --2- 172.21.15.135:0/1484455851 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f37580a3bb0 0x7f37580a6070 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:28.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.941+0000 7f377568c640 1 --2- 172.21.15.135:0/1484455851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37701029b0 0x7f377019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:28.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.941+0000 7f377568c640 1 --2- 172.21.15.135:0/1484455851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3770101ff0 0x7f3770198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:28.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.941+0000 7f377568c640 1 --2- 172.21.15.135:0/1484455851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3770100ea0 0x7f3770198400 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:28.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.941+0000 7f377568c640 1 -- 172.21.15.135:0/1484455851 >> 172.21.15.135:0/1484455851 conn(0x7f37700fc410 msgr2=0x7f37700690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:28.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.942+0000 7f377568c640 1 -- 172.21.15.135:0/1484455851 shutdown_connections 2024-04-20T12:20:28.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:28.942+0000 7f377568c640 1 -- 172.21.15.135:0/1484455851 wait complete. 2024-04-20T12:20:29.239 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:28 smithi135 ceph-mon[18264]: Deploying daemon mds.g on smithi135 2024-04-20T12:20:29.240 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:28 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] up:boot 2024-04-20T12:20:29.240 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:28 smithi135 ceph-mon[18264]: fsmap 9 up:standby 2024-04-20T12:20:29.240 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:28 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-20T12:20:29.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:28 smithi154 ceph-mon[22073]: Deploying daemon mds.g on smithi135 2024-04-20T12:20:29.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:28 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] up:boot 2024-04-20T12:20:29.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:28 smithi154 ceph-mon[22073]: fsmap 9 up:standby 2024-04-20T12:20:29.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:28 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-20T12:20:29.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:28 smithi139 ceph-mon[21834]: Deploying daemon mds.g on smithi135 2024-04-20T12:20:29.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:28 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] up:boot 2024-04-20T12:20:29.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:28 smithi139 ceph-mon[21834]: fsmap 9 up:standby 2024-04-20T12:20:29.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:28 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-20T12:20:29.896 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:20:29 smithi135 systemd[1]: Starting Ceph mds.g for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:20:30.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:29 smithi139 ceph-mon[21834]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:30.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:29 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1484455851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:30.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:29 smithi135 ceph-mon[18264]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:30.203 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:29 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1484455851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:30.203 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:20:30 smithi135 podman[57323]: 2024-04-20 12:20:29.953525243 +0000 UTC m=+0.018090595 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:20:30.203 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:20:30 smithi135 podman[57323]: 2024-04-20 12:20:30.075365588 +0000 UTC m=+0.139930973 container create bf7dafa5f963b5cb184914b397532b1c077f0594d41d2623895a5c7cc7271f57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-04-20T12:20:30.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:29 smithi154 ceph-mon[22073]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:30.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:29 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1484455851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:30.454 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:20:30 smithi135 podman[57323]: 2024-04-20 12:20:30.344627246 +0000 UTC m=+0.409192587 container init bf7dafa5f963b5cb184914b397532b1c077f0594d41d2623895a5c7cc7271f57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD) 2024-04-20T12:20:30.454 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:20:30 smithi135 podman[57323]: 2024-04-20 12:20:30.347216049 +0000 UTC m=+0.411781390 container start bf7dafa5f963b5cb184914b397532b1c077f0594d41d2623895a5c7cc7271f57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-g, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-20T12:20:30.454 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:20:30 smithi135 ceph-mds[57342]: -- 172.21.15.135:0/1310845515 <== mon.0 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5627269cba40 con 0x56272699ec00 2024-04-20T12:20:30.454 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:20:30 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-g[57338]: starting mds.g at 2024-04-20T12:20:30.454 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:20:30 smithi135 bash[57323]: bf7dafa5f963b5cb184914b397532b1c077f0594d41d2623895a5c7cc7271f57 2024-04-20T12:20:30.863 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:20:30 smithi135 systemd[1]: Started Ceph mds.g for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:20:30.952 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:31.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.072+0000 7f6137f24640 1 -- 172.21.15.135:0/1194924568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6130103b80 msgr2=0x7f613010a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:31.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.072+0000 7f6137f24640 1 --2- 172.21.15.135:0/1194924568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6130103b80 0x7f613010a410 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6128009ca0 tx=0x7f612802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:31.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.072+0000 7f6137f24640 1 -- 172.21.15.135:0/1194924568 shutdown_connections 2024-04-20T12:20:31.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.072+0000 7f6137f24640 1 --2- 172.21.15.135:0/1194924568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6130103b80 0x7f613010a410 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:31.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.072+0000 7f6137f24640 1 --2- 172.21.15.135:0/1194924568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61301031c0 0x7f6130103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:31.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.072+0000 7f6137f24640 1 --2- 172.21.15.135:0/1194924568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6130101fd0 0x7f61301023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:31.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.072+0000 7f6137f24640 1 -- 172.21.15.135:0/1194924568 >> 172.21.15.135:0/1194924568 conn(0x7f61300fd560 msgr2=0x7f61300ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:31.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.072+0000 7f6137f24640 1 -- 172.21.15.135:0/1194924568 shutdown_connections 2024-04-20T12:20:31.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.072+0000 7f6137f24640 1 -- 172.21.15.135:0/1194924568 wait complete. 2024-04-20T12:20:31.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.072+0000 7f6137f24640 1 Processor -- start 2024-04-20T12:20:31.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.072+0000 7f6137f24640 1 -- start start 2024-04-20T12:20:31.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.072+0000 7f6137f24640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6130101fd0 0x7f61301982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:31.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f6137f24640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61301031c0 0x7f6130198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:31.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f6137f24640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6130103b80 0x7f613019f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:31.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f6137f24640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f613010dc60 con 0x7f6130103b80 2024-04-20T12:20:31.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f6137f24640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f613010dae0 con 0x7f61301031c0 2024-04-20T12:20:31.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f6137f24640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f613010dde0 con 0x7f6130101fd0 2024-04-20T12:20:31.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f61364c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6130103b80 0x7f613019f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:31.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f61364c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6130103b80 0x7f613019f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48886/0 (socket says 172.21.15.135:48886) 2024-04-20T12:20:31.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f61364c1640 1 -- 172.21.15.135:0/3058820483 learned_addr learned my addr 172.21.15.135:0/3058820483 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:31.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f6135cc0640 1 --2- 172.21.15.135:0/3058820483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6130101fd0 0x7f61301982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:31.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f61364c1640 1 -- 172.21.15.135:0/3058820483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6130101fd0 msgr2=0x7f61301982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:31.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f61364c1640 1 --2- 172.21.15.135:0/3058820483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6130101fd0 0x7f61301982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:31.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f61354bf640 1 --2- 172.21.15.135:0/3058820483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61301031c0 0x7f6130198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:31.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f61364c1640 1 -- 172.21.15.135:0/3058820483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61301031c0 msgr2=0x7f6130198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:31.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f61364c1640 1 --2- 172.21.15.135:0/3058820483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61301031c0 0x7f6130198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:31.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f61364c1640 1 -- 172.21.15.135:0/3058820483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613019ff10 con 0x7f6130103b80 2024-04-20T12:20:31.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f61364c1640 1 --2- 172.21.15.135:0/3058820483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6130103b80 0x7f613019f8a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6128032530 tx=0x7f6128032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:31.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f6126ffd640 1 -- 172.21.15.135:0/3058820483 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128039040 con 0x7f6130103b80 2024-04-20T12:20:31.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f6137f24640 1 -- 172.21.15.135:0/3058820483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61301a01a0 con 0x7f6130103b80 2024-04-20T12:20:31.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f6126ffd640 1 -- 172.21.15.135:0/3058820483 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6128044070 con 0x7f6130103b80 2024-04-20T12:20:31.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f6126ffd640 1 -- 172.21.15.135:0/3058820483 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61280042a0 con 0x7f6130103b80 2024-04-20T12:20:31.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.073+0000 7f6137f24640 1 -- 172.21.15.135:0/3058820483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61301a06b0 con 0x7f6130103b80 2024-04-20T12:20:31.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.074+0000 7f6137f24640 1 -- 172.21.15.135:0/3058820483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6130109290 con 0x7f6130103b80 2024-04-20T12:20:31.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.075+0000 7f6126ffd640 1 -- 172.21.15.135:0/3058820483 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f6128003970 con 0x7f6130103b80 2024-04-20T12:20:31.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.076+0000 7f6126ffd640 1 --2- 172.21.15.135:0/3058820483 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f611c0a3bb0 0x7f611c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:31.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.076+0000 7f6135cc0640 1 --2- 172.21.15.135:0/3058820483 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f611c0a3bb0 0x7f611c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:31.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.076+0000 7f6126ffd640 1 -- 172.21.15.135:0/3058820483 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f61280f2490 con 0x7f6130103b80 2024-04-20T12:20:31.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.077+0000 7f6135cc0640 1 --2- 172.21.15.135:0/3058820483 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f611c0a3bb0 0x7f611c0a6070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6120005fd0 tx=0x7f6120005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:31.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.081+0000 7f6126ffd640 1 -- 172.21.15.135:0/3058820483 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f61280bf310 con 0x7f6130103b80 2024-04-20T12:20:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.306+0000 7f6137f24640 1 -- 172.21.15.135:0/3058820483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6130062b60 con 0x7f6130103b80 2024-04-20T12:20:31.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.306+0000 7f6126ffd640 1 -- 172.21.15.135:0/3058820483 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8848 (secure 0 0 0) 0x7f61280bec10 con 0x7f6130103b80 2024-04-20T12:20:31.306 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:31.307 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-20T12:20:31.307 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 11 2024-04-20T12:20:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.309+0000 7f6137f24640 1 -- 172.21.15.135:0/3058820483 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f611c0a3bb0 msgr2=0x7f611c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.309+0000 7f6137f24640 1 --2- 172.21.15.135:0/3058820483 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f611c0a3bb0 0x7f611c0a6070 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6120005fd0 tx=0x7f6120005850 comp rx=0 tx=0).stop 2024-04-20T12:20:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.309+0000 7f6137f24640 1 -- 172.21.15.135:0/3058820483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6130103b80 msgr2=0x7f613019f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.309+0000 7f6137f24640 1 --2- 172.21.15.135:0/3058820483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6130103b80 0x7f613019f8a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6128032530 tx=0x7f6128032f40 comp rx=0 tx=0).stop 2024-04-20T12:20:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.309+0000 7f6137f24640 1 -- 172.21.15.135:0/3058820483 shutdown_connections 2024-04-20T12:20:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.309+0000 7f6137f24640 1 --2- 172.21.15.135:0/3058820483 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f611c0a3bb0 0x7f611c0a6070 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.309+0000 7f6137f24640 1 --2- 172.21.15.135:0/3058820483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6130103b80 0x7f613019f8a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:31.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.309+0000 7f6137f24640 1 --2- 172.21.15.135:0/3058820483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61301031c0 0x7f6130198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:31.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.309+0000 7f6137f24640 1 --2- 172.21.15.135:0/3058820483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6130101fd0 0x7f61301982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:31.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.309+0000 7f6137f24640 1 -- 172.21.15.135:0/3058820483 >> 172.21.15.135:0/3058820483 conn(0x7f61300fd560 msgr2=0x7f6130106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:31.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.309+0000 7f6137f24640 1 -- 172.21.15.135:0/3058820483 shutdown_connections 2024-04-20T12:20:31.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:31.309+0000 7f6137f24640 1 -- 172.21.15.135:0/3058820483 wait complete. 2024-04-20T12:20:31.555 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:31.555 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:31.555 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:31.555 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:31.555 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:31.555 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:31.555 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:31 smithi135 ceph-mon[18264]: Deploying daemon mds.a on smithi135 2024-04-20T12:20:31.555 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:31 smithi135 ceph-mon[18264]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:31.556 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:31 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.135:6838/3001818614,v1:172.21.15.135:6839/3001818614] up:boot 2024-04-20T12:20:31.556 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:31 smithi135 ceph-mon[18264]: fsmap 10 up:standby 2024-04-20T12:20:31.556 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:31 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-20T12:20:31.556 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:31 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3058820483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:31.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:31.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:31.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:31.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:31.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:31.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:31.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:31 smithi139 ceph-mon[21834]: Deploying daemon mds.a on smithi135 2024-04-20T12:20:31.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:31 smithi139 ceph-mon[21834]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:31.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:31 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.135:6838/3001818614,v1:172.21.15.135:6839/3001818614] up:boot 2024-04-20T12:20:31.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:31 smithi139 ceph-mon[21834]: fsmap 10 up:standby 2024-04-20T12:20:31.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:31 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-20T12:20:31.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:31 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3058820483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:32.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:32.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:32.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:32.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:32.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:32.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:32.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:31 smithi154 ceph-mon[22073]: Deploying daemon mds.a on smithi135 2024-04-20T12:20:32.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:31 smithi154 ceph-mon[22073]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:32.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:31 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.135:6838/3001818614,v1:172.21.15.135:6839/3001818614] up:boot 2024-04-20T12:20:32.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:31 smithi154 ceph-mon[22073]: fsmap 10 up:standby 2024-04-20T12:20:32.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:31 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-20T12:20:32.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:31 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3058820483' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:32.823 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:20:32 smithi135 systemd[1]: Starting Ceph mds.a for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:20:33.114 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:20:32 smithi135 podman[57684]: 2024-04-20 12:20:32.726703331 +0000 UTC m=+0.018090812 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:20:33.114 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:20:32 smithi135 podman[57684]: 2024-04-20 12:20:32.84936556 +0000 UTC m=+0.140753041 container create afdb2f191efb5e6f433b7be40617e0c36f681925128c7d06a6a898ec6fab8935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-a, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-20T12:20:33.321 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:33.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.425+0000 7f0bc95ce640 1 -- 172.21.15.135:0/3309330790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bc4107d20 msgr2=0x7f0bc410a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:33.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.425+0000 7f0bc95ce640 1 --2- 172.21.15.135:0/3309330790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bc4107d20 0x7f0bc410a110 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009900 tx=0x7f0bb402bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:33.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.425+0000 7f0bc95ce640 1 -- 172.21.15.135:0/3309330790 shutdown_connections 2024-04-20T12:20:33.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.425+0000 7f0bc95ce640 1 --2- 172.21.15.135:0/3309330790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bc4107d20 0x7f0bc410a110 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:33.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.425+0000 7f0bc95ce640 1 --2- 172.21.15.135:0/3309330790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bc41053f0 0x7f0bc41077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:33.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.425+0000 7f0bc95ce640 1 --2- 172.21.15.135:0/3309330790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bc4102ac0 0x7f0bc4104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:33.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.425+0000 7f0bc95ce640 1 -- 172.21.15.135:0/3309330790 >> 172.21.15.135:0/3309330790 conn(0x7f0bc40fc410 msgr2=0x7f0bc40fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:33.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.425+0000 7f0bc95ce640 1 -- 172.21.15.135:0/3309330790 shutdown_connections 2024-04-20T12:20:33.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.425+0000 7f0bc95ce640 1 -- 172.21.15.135:0/3309330790 wait complete. 2024-04-20T12:20:33.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.425+0000 7f0bc95ce640 1 Processor -- start 2024-04-20T12:20:33.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.425+0000 7f0bc95ce640 1 -- start start 2024-04-20T12:20:33.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc95ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bc4102ac0 0x7f0bc41981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:33.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc95ce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bc41053f0 0x7f0bc4198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:33.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc95ce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bc4107d20 0x7f0bc419f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:33.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc95ce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc410dc50 con 0x7f0bc4102ac0 2024-04-20T12:20:33.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc95ce640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc410dad0 con 0x7f0bc41053f0 2024-04-20T12:20:33.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc95ce640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc410ddd0 con 0x7f0bc4107d20 2024-04-20T12:20:33.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bc4102ac0 0x7f0bc41981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:33.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bc4102ac0 0x7f0bc41981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48906/0 (socket says 172.21.15.135:48906) 2024-04-20T12:20:33.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc2ffd640 1 -- 172.21.15.135:0/3304239876 learned_addr learned my addr 172.21.15.135:0/3304239876 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:33.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc27fc640 1 --2- 172.21.15.135:0/3304239876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bc41053f0 0x7f0bc4198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:33.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc37fe640 1 --2- 172.21.15.135:0/3304239876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bc4107d20 0x7f0bc419f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:33.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc2ffd640 1 -- 172.21.15.135:0/3304239876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bc4107d20 msgr2=0x7f0bc419f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:33.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc2ffd640 1 --2- 172.21.15.135:0/3304239876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bc4107d20 0x7f0bc419f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:33.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc2ffd640 1 -- 172.21.15.135:0/3304239876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bc41053f0 msgr2=0x7f0bc4198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:33.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc2ffd640 1 --2- 172.21.15.135:0/3304239876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bc41053f0 0x7f0bc4198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:33.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc2ffd640 1 -- 172.21.15.135:0/3304239876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc419fe10 con 0x7f0bc4102ac0 2024-04-20T12:20:33.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc37fe640 1 --2- 172.21.15.135:0/3304239876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bc4107d20 0x7f0bc419f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:20:33.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc2ffd640 1 --2- 172.21.15.135:0/3304239876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bc4102ac0 0x7f0bc41981f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00eab0 tx=0x7f0bbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:33.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0babfff640 1 -- 172.21.15.135:0/3304239876 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc00cd80 con 0x7f0bc4102ac0 2024-04-20T12:20:33.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc95ce640 1 -- 172.21.15.135:0/3304239876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc41a0100 con 0x7f0bc4102ac0 2024-04-20T12:20:33.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0babfff640 1 -- 172.21.15.135:0/3304239876 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bbc011950 con 0x7f0bc4102ac0 2024-04-20T12:20:33.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0babfff640 1 -- 172.21.15.135:0/3304239876 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc010a10 con 0x7f0bc4102ac0 2024-04-20T12:20:33.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.426+0000 7f0bc95ce640 1 -- 172.21.15.135:0/3304239876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc41a0650 con 0x7f0bc4102ac0 2024-04-20T12:20:33.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.427+0000 7f0bc95ce640 1 -- 172.21.15.135:0/3304239876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bc40fdf00 con 0x7f0bc4102ac0 2024-04-20T12:20:33.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.428+0000 7f0babfff640 1 -- 172.21.15.135:0/3304239876 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f0bbc011b00 con 0x7f0bc4102ac0 2024-04-20T12:20:33.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.429+0000 7f0babfff640 1 --2- 172.21.15.135:0/3304239876 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0bac0a3bb0 0x7f0bac0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:33.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.429+0000 7f0bc27fc640 1 --2- 172.21.15.135:0/3304239876 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0bac0a3bb0 0x7f0bac0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:33.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.429+0000 7f0babfff640 1 -- 172.21.15.135:0/3304239876 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f0bbc0d0590 con 0x7f0bc4102ac0 2024-04-20T12:20:33.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.429+0000 7f0bc27fc640 1 --2- 172.21.15.135:0/3304239876 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0bac0a3bb0 0x7f0bac0a6070 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4199700 tx=0x7f0bb800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:33.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.433+0000 7f0babfff640 1 -- 172.21.15.135:0/3304239876 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f0bbc016030 con 0x7f0bc4102ac0 2024-04-20T12:20:33.614 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:20:33 smithi135 podman[57684]: 2024-04-20 12:20:33.162024134 +0000 UTC m=+0.453411618 container init afdb2f191efb5e6f433b7be40617e0c36f681925128c7d06a6a898ec6fab8935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux ) 2024-04-20T12:20:33.614 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:20:33 smithi135 podman[57684]: 2024-04-20 12:20:33.165216559 +0000 UTC m=+0.456604041 container start afdb2f191efb5e6f433b7be40617e0c36f681925128c7d06a6a898ec6fab8935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-a, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-20T12:20:33.614 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:20:33 smithi135 ceph-mds[57703]: -- 172.21.15.135:0/1217969169 <== mon.0 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c38e713a40 con 0x55c38e6e7000 2024-04-20T12:20:33.614 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:20:33 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-a[57699]: starting mds.a at 2024-04-20T12:20:33.614 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:20:33 smithi135 bash[57684]: afdb2f191efb5e6f433b7be40617e0c36f681925128c7d06a6a898ec6fab8935 2024-04-20T12:20:33.614 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:20:33 smithi135 systemd[1]: Started Ceph mds.a for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:20:33.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.650+0000 7f0bc95ce640 1 -- 172.21.15.135:0/3304239876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0bc402d5d0 con 0x7f0bc4102ac0 2024-04-20T12:20:33.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.651+0000 7f0babfff640 1 -- 172.21.15.135:0/3304239876 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8848 (secure 0 0 0) 0x7f0bbc09d3b0 con 0x7f0bc4102ac0 2024-04-20T12:20:33.651 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:33.651 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-20T12:20:33.652 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 11 2024-04-20T12:20:33.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.653+0000 7f0bc95ce640 1 -- 172.21.15.135:0/3304239876 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0bac0a3bb0 msgr2=0x7f0bac0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:33.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.653+0000 7f0bc95ce640 1 --2- 172.21.15.135:0/3304239876 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0bac0a3bb0 0x7f0bac0a6070 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4199700 tx=0x7f0bb800a2d0 comp rx=0 tx=0).stop 2024-04-20T12:20:33.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.653+0000 7f0bc95ce640 1 -- 172.21.15.135:0/3304239876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bc4102ac0 msgr2=0x7f0bc41981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:33.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.653+0000 7f0bc95ce640 1 --2- 172.21.15.135:0/3304239876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bc4102ac0 0x7f0bc41981f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00eab0 tx=0x7f0bbc00eeb0 comp rx=0 tx=0).stop 2024-04-20T12:20:33.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.653+0000 7f0bc95ce640 1 -- 172.21.15.135:0/3304239876 shutdown_connections 2024-04-20T12:20:33.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.653+0000 7f0bc95ce640 1 --2- 172.21.15.135:0/3304239876 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0bac0a3bb0 0x7f0bac0a6070 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:33.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.653+0000 7f0bc95ce640 1 --2- 172.21.15.135:0/3304239876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bc4107d20 0x7f0bc419f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:33.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.653+0000 7f0bc95ce640 1 --2- 172.21.15.135:0/3304239876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bc41053f0 0x7f0bc4198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:33.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.653+0000 7f0bc95ce640 1 --2- 172.21.15.135:0/3304239876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bc4102ac0 0x7f0bc41981f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:33.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.653+0000 7f0bc95ce640 1 -- 172.21.15.135:0/3304239876 >> 172.21.15.135:0/3304239876 conn(0x7f0bc40fc410 msgr2=0x7f0bc4103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:33.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.653+0000 7f0bc95ce640 1 -- 172.21.15.135:0/3304239876 shutdown_connections 2024-04-20T12:20:33.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:33.653+0000 7f0bc95ce640 1 -- 172.21.15.135:0/3304239876 wait complete. 2024-04-20T12:20:34.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:33 smithi135 ceph-mon[18264]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:34.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:33 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:34.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:33 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:34.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:33 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:34.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:33 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:34.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:33 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:34.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:33 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:34.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:33 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3304239876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:34.178 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:33 smithi139 ceph-mon[21834]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:34.178 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:33 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:34.179 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:33 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:34.179 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:33 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:34.179 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:33 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:34.179 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:33 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:34.179 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:33 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:34.179 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:33 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3304239876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:34.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:33 smithi154 ceph-mon[22073]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:34.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:33 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:34.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:33 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:34.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:33 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:34.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:33 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-20T12:20:34.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:33 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-20T12:20:34.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:33 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:34.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:33 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3304239876' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:35.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:34 smithi135 ceph-mon[18264]: Deploying daemon mds.b on smithi139 2024-04-20T12:20:35.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:34 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] up:boot 2024-04-20T12:20:35.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:34 smithi135 ceph-mon[18264]: fsmap 11 up:standby 2024-04-20T12:20:35.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:34 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-20T12:20:35.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:34 smithi139 ceph-mon[21834]: Deploying daemon mds.b on smithi139 2024-04-20T12:20:35.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:34 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] up:boot 2024-04-20T12:20:35.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:34 smithi139 ceph-mon[21834]: fsmap 11 up:standby 2024-04-20T12:20:35.126 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:34 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-20T12:20:35.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:34 smithi154 ceph-mon[22073]: Deploying daemon mds.b on smithi139 2024-04-20T12:20:35.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:34 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] up:boot 2024-04-20T12:20:35.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:34 smithi154 ceph-mon[22073]: fsmap 11 up:standby 2024-04-20T12:20:35.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:34 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-20T12:20:35.665 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:35.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.775+0000 7faa1f38f640 1 -- 172.21.15.135:0/2224682630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa18100830 msgr2=0x7faa18100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:35.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.775+0000 7faa1f38f640 1 --2- 172.21.15.135:0/2224682630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa18100830 0x7faa18100c50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faa10009900 tx=0x7faa1002bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:35.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.775+0000 7faa1f38f640 1 -- 172.21.15.135:0/2224682630 shutdown_connections 2024-04-20T12:20:35.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.775+0000 7faa1f38f640 1 --2- 172.21.15.135:0/2224682630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa18101b30 0x7faa18101fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:35.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.775+0000 7faa1f38f640 1 --2- 172.21.15.135:0/2224682630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa18101190 0x7faa181015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:35.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.775+0000 7faa1f38f640 1 --2- 172.21.15.135:0/2224682630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa18100830 0x7faa18100c50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:35.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.775+0000 7faa1f38f640 1 -- 172.21.15.135:0/2224682630 >> 172.21.15.135:0/2224682630 conn(0x7faa180fc450 msgr2=0x7faa180fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:35.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.775+0000 7faa1f38f640 1 -- 172.21.15.135:0/2224682630 shutdown_connections 2024-04-20T12:20:35.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.775+0000 7faa1f38f640 1 -- 172.21.15.135:0/2224682630 wait complete. 2024-04-20T12:20:35.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1f38f640 1 Processor -- start 2024-04-20T12:20:35.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1f38f640 1 -- start start 2024-04-20T12:20:35.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1f38f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa18100830 0x7faa1819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:35.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1f38f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa18101190 0x7faa1819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:35.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1f38f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa18101b30 0x7faa181a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:35.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1f38f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faa1810fe80 con 0x7faa18100830 2024-04-20T12:20:35.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1f38f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faa1810fd00 con 0x7faa18101b30 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1f38f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa18110000 con 0x7faa18101190 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1d12b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa18100830 0x7faa1819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1d12b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa18100830 0x7faa1819a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48928/0 (socket says 172.21.15.135:48928) 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1d12b640 1 -- 172.21.15.135:0/2338103024 learned_addr learned my addr 172.21.15.135:0/2338103024 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1d92c640 1 --2- 172.21.15.135:0/2338103024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa18101b30 0x7faa181a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1c92a640 1 --2- 172.21.15.135:0/2338103024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa18101190 0x7faa1819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1d12b640 1 -- 172.21.15.135:0/2338103024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa18101190 msgr2=0x7faa1819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1d12b640 1 --2- 172.21.15.135:0/2338103024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa18101190 0x7faa1819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1d12b640 1 -- 172.21.15.135:0/2338103024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa18101b30 msgr2=0x7faa181a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1d12b640 1 --2- 172.21.15.135:0/2338103024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa18101b30 0x7faa181a1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1d12b640 1 -- 172.21.15.135:0/2338103024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa181a2140 con 0x7faa18100830 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.776+0000 7faa1d12b640 1 --2- 172.21.15.135:0/2338103024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa18100830 0x7faa1819a520 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa10009230 tx=0x7faa10005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.777+0000 7faa167fc640 1 -- 172.21.15.135:0/2338103024 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10041070 con 0x7faa18100830 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.777+0000 7faa1f38f640 1 -- 172.21.15.135:0/2338103024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa181a23d0 con 0x7faa18100830 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.777+0000 7faa167fc640 1 -- 172.21.15.135:0/2338103024 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa100054e0 con 0x7faa18100830 2024-04-20T12:20:35.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.777+0000 7faa167fc640 1 -- 172.21.15.135:0/2338103024 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa10034440 con 0x7faa18100830 2024-04-20T12:20:35.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.777+0000 7faa1f38f640 1 -- 172.21.15.135:0/2338103024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa181a28c0 con 0x7faa18100830 2024-04-20T12:20:35.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.778+0000 7faa1f38f640 1 -- 172.21.15.135:0/2338103024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa1810b770 con 0x7faa18100830 2024-04-20T12:20:35.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.779+0000 7faa167fc640 1 -- 172.21.15.135:0/2338103024 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7faa10044070 con 0x7faa18100830 2024-04-20T12:20:35.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.779+0000 7faa167fc640 1 --2- 172.21.15.135:0/2338103024 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faa000a3bb0 0x7faa000a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:35.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.779+0000 7faa1c92a640 1 --2- 172.21.15.135:0/2338103024 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faa000a3bb0 0x7faa000a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:35.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.779+0000 7faa167fc640 1 -- 172.21.15.135:0/2338103024 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7faa100f20d0 con 0x7faa18100830 2024-04-20T12:20:35.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.780+0000 7faa1c92a640 1 --2- 172.21.15.135:0/2338103024 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faa000a3bb0 0x7faa000a6070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faa1819ba30 tx=0x7faa0c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:35.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.783+0000 7faa167fc640 1 -- 172.21.15.135:0/2338103024 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7faa100bef50 con 0x7faa18100830 2024-04-20T12:20:35.829 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:20:35 smithi139 podman[52065]: 2024-04-20 12:20:35.635339064 +0000 UTC m=+0.017791506 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:20:35.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:35.999+0000 7faa1f38f640 1 -- 172.21.15.135:0/2338103024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa1802d5d0 con 0x7faa18100830 2024-04-20T12:20:36.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:36.000+0000 7faa167fc640 1 -- 172.21.15.135:0/2338103024 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9674 (secure 0 0 0) 0x7faa100be850 con 0x7faa18100830 2024-04-20T12:20:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:36.000 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-20T12:20:36.000 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 12 2024-04-20T12:20:36.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:36.002+0000 7faa1f38f640 1 -- 172.21.15.135:0/2338103024 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faa000a3bb0 msgr2=0x7faa000a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:36.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:36.002+0000 7faa1f38f640 1 --2- 172.21.15.135:0/2338103024 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faa000a3bb0 0x7faa000a6070 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faa1819ba30 tx=0x7faa0c008040 comp rx=0 tx=0).stop 2024-04-20T12:20:36.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:36.002+0000 7faa1f38f640 1 -- 172.21.15.135:0/2338103024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa18100830 msgr2=0x7faa1819a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:36.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:36.002+0000 7faa1f38f640 1 --2- 172.21.15.135:0/2338103024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa18100830 0x7faa1819a520 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa10009230 tx=0x7faa10005dd0 comp rx=0 tx=0).stop 2024-04-20T12:20:36.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:36.002+0000 7faa1f38f640 1 -- 172.21.15.135:0/2338103024 shutdown_connections 2024-04-20T12:20:36.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:36.002+0000 7faa1f38f640 1 --2- 172.21.15.135:0/2338103024 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faa000a3bb0 0x7faa000a6070 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:36.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:36.002+0000 7faa1f38f640 1 --2- 172.21.15.135:0/2338103024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa18101b30 0x7faa181a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:36.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:36.002+0000 7faa1f38f640 1 --2- 172.21.15.135:0/2338103024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa18101190 0x7faa1819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:36.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:36.002+0000 7faa1f38f640 1 --2- 172.21.15.135:0/2338103024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa18100830 0x7faa1819a520 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:36.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:36.002+0000 7faa1f38f640 1 -- 172.21.15.135:0/2338103024 >> 172.21.15.135:0/2338103024 conn(0x7faa180fc450 msgr2=0x7faa180fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:36.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:36.002+0000 7faa1f38f640 1 -- 172.21.15.135:0/2338103024 shutdown_connections 2024-04-20T12:20:36.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:36.002+0000 7faa1f38f640 1 -- 172.21.15.135:0/2338103024 wait complete. 2024-04-20T12:20:36.012 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:35 smithi135 ceph-mon[18264]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:36.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:35 smithi154 ceph-mon[22073]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:36.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:35 smithi139 ceph-mon[21834]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:36.330 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:20:35 smithi139 podman[52065]: 2024-04-20 12:20:35.965339309 +0000 UTC m=+0.347791740 container init f04bd8e05e6630373e7d47c7c62e959252fd818457c848e28d9d9011bd812e5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_CLEAN=True) 2024-04-20T12:20:36.330 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:20:35 smithi139 podman[52065]: 2024-04-20 12:20:35.968153673 +0000 UTC m=+0.350606115 container start f04bd8e05e6630373e7d47c7c62e959252fd818457c848e28d9d9011bd812e5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-b, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-20T12:20:36.330 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:20:35 smithi139 ceph-mds[52084]: -- 172.21.15.139:0/1638706891 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fe51879a40 con 0x55fe5184c800 2024-04-20T12:20:36.330 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:20:35 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-b[52080]: starting mds.b at 2024-04-20T12:20:36.330 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:20:36 smithi139 bash[52065]: f04bd8e05e6630373e7d47c7c62e959252fd818457c848e28d9d9011bd812e5e 2024-04-20T12:20:36.330 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:20:36 smithi139 systemd[1]: Started Ceph mds.b for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:20:37.099 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:36 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2338103024' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:37.099 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.099 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.099 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.099 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.099 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.099 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:20:37.099 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:36 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2338103024' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:20:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.198 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:36 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2338103024' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:37.198 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.198 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.198 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.199 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.199 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:37.199 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:20:37.199 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:38.014 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:38.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 -- 172.21.15.135:0/2502990379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc101fc0 msgr2=0x7f1dcc1023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:38.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 --2- 172.21.15.135:0/2502990379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc101fc0 0x7f1dcc1023e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8009900 tx=0x7f1dc802bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:38.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 -- 172.21.15.135:0/2502990379 shutdown_connections 2024-04-20T12:20:38.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 --2- 172.21.15.135:0/2502990379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dcc103b70 0x7f1dcc10a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 --2- 172.21.15.135:0/2502990379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dcc1031b0 0x7f1dcc103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 --2- 172.21.15.135:0/2502990379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc101fc0 0x7f1dcc1023e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 -- 172.21.15.135:0/2502990379 >> 172.21.15.135:0/2502990379 conn(0x7f1dcc0fd510 msgr2=0x7f1dcc0ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:38.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 -- 172.21.15.135:0/2502990379 shutdown_connections 2024-04-20T12:20:38.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 -- 172.21.15.135:0/2502990379 wait complete. 2024-04-20T12:20:38.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 Processor -- start 2024-04-20T12:20:38.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 -- start start 2024-04-20T12:20:38.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dcc101fc0 0x7f1dcc075d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:38.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc1031b0 0x7f1dcc074350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dcc103b70 0x7f1dcc074890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc10dc50 con 0x7f1dcc1031b0 2024-04-20T12:20:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc10dad0 con 0x7f1dcc103b70 2024-04-20T12:20:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.117+0000 7f1dd4614640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc10ddd0 con 0x7f1dcc101fc0 2024-04-20T12:20:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dd1baf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc1031b0 0x7f1dcc074350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dd1baf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc1031b0 0x7f1dcc074350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48950/0 (socket says 172.21.15.135:48950) 2024-04-20T12:20:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dd1baf640 1 -- 172.21.15.135:0/1349970094 learned_addr learned my addr 172.21.15.135:0/1349970094 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dd2bb1640 1 --2- 172.21.15.135:0/1349970094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dcc103b70 0x7f1dcc074890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dd23b0640 1 --2- 172.21.15.135:0/1349970094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dcc101fc0 0x7f1dcc075d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dd2bb1640 1 -- 172.21.15.135:0/1349970094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dcc101fc0 msgr2=0x7f1dcc075d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dd2bb1640 1 --2- 172.21.15.135:0/1349970094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dcc101fc0 0x7f1dcc075d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dd2bb1640 1 -- 172.21.15.135:0/1349970094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc1031b0 msgr2=0x7f1dcc074350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dd2bb1640 1 --2- 172.21.15.135:0/1349970094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc1031b0 0x7f1dcc074350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dd2bb1640 1 -- 172.21.15.135:0/1349970094 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc075120 con 0x7f1dcc103b70 2024-04-20T12:20:38.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dd1baf640 1 --2- 172.21.15.135:0/1349970094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc1031b0 0x7f1dcc074350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:20:38.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dd2bb1640 1 --2- 172.21.15.135:0/1349970094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dcc103b70 0x7f1dcc074890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009fd0 tx=0x7f1dc400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:38.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dc37fe640 1 -- 172.21.15.135:0/1349970094 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400ce20 con 0x7f1dcc103b70 2024-04-20T12:20:38.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dd4614640 1 -- 172.21.15.135:0/1349970094 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dcc1a23e0 con 0x7f1dcc103b70 2024-04-20T12:20:38.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dc37fe640 1 -- 172.21.15.135:0/1349970094 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dc4005020 con 0x7f1dcc103b70 2024-04-20T12:20:38.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dc37fe640 1 -- 172.21.15.135:0/1349970094 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4010720 con 0x7f1dcc103b70 2024-04-20T12:20:38.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.118+0000 7f1dd4614640 1 -- 172.21.15.135:0/1349970094 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dcc1a28e0 con 0x7f1dcc103b70 2024-04-20T12:20:38.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.119+0000 7f1dd4614640 1 -- 172.21.15.135:0/1349970094 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dcc109360 con 0x7f1dcc103b70 2024-04-20T12:20:38.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.120+0000 7f1dc37fe640 1 -- 172.21.15.135:0/1349970094 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f1dc4005540 con 0x7f1dcc103b70 2024-04-20T12:20:38.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.121+0000 7f1dc37fe640 1 --2- 172.21.15.135:0/1349970094 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1db80a3bb0 0x7f1db80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:38.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.121+0000 7f1dd23b0640 1 --2- 172.21.15.135:0/1349970094 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1db80a3bb0 0x7f1db80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:38.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.121+0000 7f1dc37fe640 1 -- 172.21.15.135:0/1349970094 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f1dc40d0a50 con 0x7f1dcc103b70 2024-04-20T12:20:38.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.121+0000 7f1dd23b0640 1 --2- 172.21.15.135:0/1349970094 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1db80a3bb0 0x7f1db80a6070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8000c00 tx=0x7f1dc8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:38.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.125+0000 7f1dc37fe640 1 -- 172.21.15.135:0/1349970094 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f1dc409d8d0 con 0x7f1dcc103b70 2024-04-20T12:20:38.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:37 smithi154 ceph-mon[22073]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:38.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:37 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] up:boot 2024-04-20T12:20:38.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:37 smithi154 ceph-mon[22073]: fsmap 12 up:standby 2024-04-20T12:20:38.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-20T12:20:38.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:37 smithi139 ceph-mon[21834]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:38.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:37 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] up:boot 2024-04-20T12:20:38.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:37 smithi139 ceph-mon[21834]: fsmap 12 up:standby 2024-04-20T12:20:38.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-20T12:20:38.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.349+0000 7f1dd4614640 1 -- 172.21.15.135:0/1349970094 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1dcc02d5d0 con 0x7f1dcc103b70 2024-04-20T12:20:38.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.351+0000 7f1dc37fe640 1 -- 172.21.15.135:0/1349970094 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10503 (secure 0 0 0) 0x7f1dc409d1d0 con 0x7f1dcc103b70 2024-04-20T12:20:38.351 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:38.351 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-04-20T12:20:38.351 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 13 2024-04-20T12:20:38.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.353+0000 7f1dd4614640 1 -- 172.21.15.135:0/1349970094 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1db80a3bb0 msgr2=0x7f1db80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:38.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.353+0000 7f1dd4614640 1 --2- 172.21.15.135:0/1349970094 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1db80a3bb0 0x7f1db80a6070 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8000c00 tx=0x7f1dc8005fd0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.353+0000 7f1dd4614640 1 -- 172.21.15.135:0/1349970094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dcc103b70 msgr2=0x7f1dcc074890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:38.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.353+0000 7f1dd4614640 1 --2- 172.21.15.135:0/1349970094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dcc103b70 0x7f1dcc074890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009fd0 tx=0x7f1dc400ef10 comp rx=0 tx=0).stop 2024-04-20T12:20:38.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.353+0000 7f1dd4614640 1 -- 172.21.15.135:0/1349970094 shutdown_connections 2024-04-20T12:20:38.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.353+0000 7f1dd4614640 1 --2- 172.21.15.135:0/1349970094 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1db80a3bb0 0x7f1db80a6070 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.353+0000 7f1dd4614640 1 --2- 172.21.15.135:0/1349970094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1dcc103b70 0x7f1dcc074890 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.353+0000 7f1dd4614640 1 --2- 172.21.15.135:0/1349970094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dcc1031b0 0x7f1dcc074350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.353+0000 7f1dd4614640 1 --2- 172.21.15.135:0/1349970094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1dcc101fc0 0x7f1dcc075d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.353+0000 7f1dd4614640 1 -- 172.21.15.135:0/1349970094 >> 172.21.15.135:0/1349970094 conn(0x7f1dcc0fd510 msgr2=0x7f1dcc106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:38.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.353+0000 7f1dd4614640 1 -- 172.21.15.135:0/1349970094 shutdown_connections 2024-04-20T12:20:38.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.353+0000 7f1dd4614640 1 -- 172.21.15.135:0/1349970094 wait complete. 2024-04-20T12:20:38.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:37 smithi135 ceph-mon[18264]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:38.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:37 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] up:boot 2024-04-20T12:20:38.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:37 smithi135 ceph-mon[18264]: fsmap 12 up:standby 2024-04-20T12:20:38.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-20T12:20:38.365 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:20:38.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.465+0000 7f94d51d5640 1 -- 172.21.15.135:0/2945604498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d0102aa0 msgr2=0x7f94d0104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:38.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.465+0000 7f94d51d5640 1 --2- 172.21.15.135:0/2945604498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d0102aa0 0x7f94d0104e90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f94c0009900 tx=0x7f94c002bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.465+0000 7f94d51d5640 1 -- 172.21.15.135:0/2945604498 shutdown_connections 2024-04-20T12:20:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.465+0000 7f94d51d5640 1 --2- 172.21.15.135:0/2945604498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94d0107d00 0x7f94d010a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.465+0000 7f94d51d5640 1 --2- 172.21.15.135:0/2945604498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d01053d0 0x7f94d01077c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.465+0000 7f94d51d5640 1 --2- 172.21.15.135:0/2945604498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d0102aa0 0x7f94d0104e90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.465+0000 7f94d51d5640 1 -- 172.21.15.135:0/2945604498 >> 172.21.15.135:0/2945604498 conn(0x7f94d00fc410 msgr2=0x7f94d00fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.465+0000 7f94d51d5640 1 -- 172.21.15.135:0/2945604498 shutdown_connections 2024-04-20T12:20:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.465+0000 7f94d51d5640 1 -- 172.21.15.135:0/2945604498 wait complete. 2024-04-20T12:20:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94d51d5640 1 Processor -- start 2024-04-20T12:20:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94d51d5640 1 -- start start 2024-04-20T12:20:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94d51d5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94d0102aa0 0x7f94d01982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94d51d5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d01053d0 0x7f94d0198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94d51d5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d0107d00 0x7f94d019f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94d51d5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f94d010dc30 con 0x7f94d01053d0 2024-04-20T12:20:38.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94d51d5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f94d010dab0 con 0x7f94d0107d00 2024-04-20T12:20:38.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94d51d5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f94d010ddb0 con 0x7f94d0102aa0 2024-04-20T12:20:38.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94c7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d01053d0 0x7f94d0198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:38.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94c7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d01053d0 0x7f94d0198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48974/0 (socket says 172.21.15.135:48974) 2024-04-20T12:20:38.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94c7fff640 1 -- 172.21.15.135:0/3054591102 learned_addr learned my addr 172.21.15.135:0/3054591102 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:38.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94ced9d640 1 --2- 172.21.15.135:0/3054591102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94d0102aa0 0x7f94d01982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:38.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94cf59e640 1 --2- 172.21.15.135:0/3054591102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d0107d00 0x7f94d019f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:38.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94c7fff640 1 -- 172.21.15.135:0/3054591102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94d0102aa0 msgr2=0x7f94d01982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:38.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94c7fff640 1 --2- 172.21.15.135:0/3054591102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94d0102aa0 0x7f94d01982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94c7fff640 1 -- 172.21.15.135:0/3054591102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d0107d00 msgr2=0x7f94d019f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:38.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94c7fff640 1 --2- 172.21.15.135:0/3054591102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d0107d00 0x7f94d019f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.466+0000 7f94c7fff640 1 -- 172.21.15.135:0/3054591102 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d019fef0 con 0x7f94d01053d0 2024-04-20T12:20:38.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.467+0000 7f94c7fff640 1 --2- 172.21.15.135:0/3054591102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d01053d0 0x7f94d0198810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f94b8005fd0 tx=0x7f94b800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:38.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.467+0000 7f94ccd99640 1 -- 172.21.15.135:0/3054591102 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8017070 con 0x7f94d01053d0 2024-04-20T12:20:38.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.467+0000 7f94d51d5640 1 -- 172.21.15.135:0/3054591102 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d01a01e0 con 0x7f94d01053d0 2024-04-20T12:20:38.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.467+0000 7f94ccd99640 1 -- 172.21.15.135:0/3054591102 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94b8009c30 con 0x7f94d01053d0 2024-04-20T12:20:38.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.467+0000 7f94ccd99640 1 -- 172.21.15.135:0/3054591102 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8010460 con 0x7f94d01053d0 2024-04-20T12:20:38.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.467+0000 7f94d51d5640 1 -- 172.21.15.135:0/3054591102 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d01a0730 con 0x7f94d01053d0 2024-04-20T12:20:38.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.468+0000 7f94d51d5640 1 -- 172.21.15.135:0/3054591102 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d00fdf00 con 0x7f94d01053d0 2024-04-20T12:20:38.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.470+0000 7f94ccd99640 1 -- 172.21.15.135:0/3054591102 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f94b8003e70 con 0x7f94d01053d0 2024-04-20T12:20:38.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.470+0000 7f94ccd99640 1 --2- 172.21.15.135:0/3054591102 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f94bc0a3bb0 0x7f94bc0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:38.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.470+0000 7f94ccd99640 1 -- 172.21.15.135:0/3054591102 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f94b80cfbd0 con 0x7f94d01053d0 2024-04-20T12:20:38.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.470+0000 7f94ced9d640 1 --2- 172.21.15.135:0/3054591102 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f94bc0a3bb0 0x7f94bc0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:38.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.471+0000 7f94ced9d640 1 --2- 172.21.15.135:0/3054591102 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f94bc0a3bb0 0x7f94bc0a6070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f94c002c7b0 tx=0x7f94c0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:38.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.475+0000 7f94ccd99640 1 -- 172.21.15.135:0/3054591102 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f94b8020030 con 0x7f94d01053d0 2024-04-20T12:20:38.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.682+0000 7f94d51d5640 1 -- 172.21.15.135:0/3054591102 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94d002d820 con 0x7f94d01053d0 2024-04-20T12:20:38.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.683+0000 7f94ccd99640 1 -- 172.21.15.135:0/3054591102 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+18501 (secure 0 0 0) 0x7f94b809ca50 con 0x7f94d01053d0 2024-04-20T12:20:38.683 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:38.683 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":81,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:19:52.572918+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:20:38.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.685+0000 7f94d51d5640 1 -- 172.21.15.135:0/3054591102 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f94bc0a3bb0 msgr2=0x7f94bc0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:38.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.685+0000 7f94d51d5640 1 --2- 172.21.15.135:0/3054591102 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f94bc0a3bb0 0x7f94bc0a6070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f94c002c7b0 tx=0x7f94c0005fd0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.685+0000 7f94d51d5640 1 -- 172.21.15.135:0/3054591102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d01053d0 msgr2=0x7f94d0198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:38.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.685+0000 7f94d51d5640 1 --2- 172.21.15.135:0/3054591102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d01053d0 0x7f94d0198810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f94b8005fd0 tx=0x7f94b800dde0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.685+0000 7f94d51d5640 1 -- 172.21.15.135:0/3054591102 shutdown_connections 2024-04-20T12:20:38.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.685+0000 7f94d51d5640 1 --2- 172.21.15.135:0/3054591102 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f94bc0a3bb0 0x7f94bc0a6070 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.685+0000 7f94d51d5640 1 --2- 172.21.15.135:0/3054591102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f94d0107d00 0x7f94d019f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.685+0000 7f94d51d5640 1 --2- 172.21.15.135:0/3054591102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94d01053d0 0x7f94d0198810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.685+0000 7f94d51d5640 1 --2- 172.21.15.135:0/3054591102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94d0102aa0 0x7f94d01982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.685+0000 7f94d51d5640 1 -- 172.21.15.135:0/3054591102 >> 172.21.15.135:0/3054591102 conn(0x7f94d00fc410 msgr2=0x7f94d01033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:38.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.685+0000 7f94d51d5640 1 -- 172.21.15.135:0/3054591102 shutdown_connections 2024-04-20T12:20:38.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.685+0000 7f94d51d5640 1 -- 172.21.15.135:0/3054591102 wait complete. 2024-04-20T12:20:38.697 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T12:16:02.802023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T12:20:38.698 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T12:20:38.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.800+0000 7f1487469640 1 -- 172.21.15.135:0/2327626094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1480103b50 msgr2=0x7f148010a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:38.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.800+0000 7f1487469640 1 --2- 172.21.15.135:0/2327626094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1480103b50 0x7f148010a3e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1478009ca0 tx=0x7f147802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.800+0000 7f1487469640 1 -- 172.21.15.135:0/2327626094 shutdown_connections 2024-04-20T12:20:38.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.800+0000 7f1487469640 1 --2- 172.21.15.135:0/2327626094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1480103b50 0x7f148010a3e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.800+0000 7f1487469640 1 --2- 172.21.15.135:0/2327626094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1480103190 0x7f1480103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.800+0000 7f1487469640 1 --2- 172.21.15.135:0/2327626094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1480101fa0 0x7f14801023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.801+0000 7f1487469640 1 -- 172.21.15.135:0/2327626094 >> 172.21.15.135:0/2327626094 conn(0x7f14800fd510 msgr2=0x7f14800ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:38.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.801+0000 7f1487469640 1 -- 172.21.15.135:0/2327626094 shutdown_connections 2024-04-20T12:20:38.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.801+0000 7f1487469640 1 -- 172.21.15.135:0/2327626094 wait complete. 2024-04-20T12:20:38.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.801+0000 7f1487469640 1 Processor -- start 2024-04-20T12:20:38.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.801+0000 7f1487469640 1 -- start start 2024-04-20T12:20:38.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.801+0000 7f1487469640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1480101fa0 0x7f1480198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:38.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.801+0000 7f1487469640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1480103190 0x7f14801987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:38.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.801+0000 7f1487469640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1480103b50 0x7f148019f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:38.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.801+0000 7f1487469640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f148010dbf0 con 0x7f1480103190 2024-04-20T12:20:38.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.801+0000 7f1487469640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f148010da70 con 0x7f1480101fa0 2024-04-20T12:20:38.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.801+0000 7f1487469640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f148010dd70 con 0x7f1480103b50 2024-04-20T12:20:38.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.801+0000 7f1484a04640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1480103190 0x7f14801987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:38.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.801+0000 7f1484a04640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1480103190 0x7f14801987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49006/0 (socket says 172.21.15.135:49006) 2024-04-20T12:20:38.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.801+0000 7f1484a04640 1 -- 172.21.15.135:0/2518579058 learned_addr learned my addr 172.21.15.135:0/2518579058 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:38.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.801+0000 7f1485205640 1 --2- 172.21.15.135:0/2518579058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1480101fa0 0x7f1480198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:38.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.802+0000 7f1485a06640 1 --2- 172.21.15.135:0/2518579058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1480103b50 0x7f148019f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:38.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.802+0000 7f1484a04640 1 -- 172.21.15.135:0/2518579058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1480103b50 msgr2=0x7f148019f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:38.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.802+0000 7f1484a04640 1 --2- 172.21.15.135:0/2518579058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1480103b50 0x7f148019f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.802+0000 7f1484a04640 1 -- 172.21.15.135:0/2518579058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1480101fa0 msgr2=0x7f1480198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:38.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.802+0000 7f1484a04640 1 --2- 172.21.15.135:0/2518579058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1480101fa0 0x7f1480198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.802+0000 7f1484a04640 1 -- 172.21.15.135:0/2518579058 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148019fe90 con 0x7f1480103190 2024-04-20T12:20:38.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.802+0000 7f1485205640 1 --2- 172.21.15.135:0/2518579058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1480101fa0 0x7f1480198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:20:38.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.802+0000 7f1484a04640 1 --2- 172.21.15.135:0/2518579058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1480103190 0x7f14801987b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f147000c890 tx=0x7f147000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:38.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.802+0000 7f14767fc640 1 -- 172.21.15.135:0/2518579058 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1470004220 con 0x7f1480103190 2024-04-20T12:20:38.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.802+0000 7f14767fc640 1 -- 172.21.15.135:0/2518579058 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14700043c0 con 0x7f1480103190 2024-04-20T12:20:38.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.802+0000 7f1487469640 1 -- 172.21.15.135:0/2518579058 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14801a0180 con 0x7f1480103190 2024-04-20T12:20:38.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.802+0000 7f14767fc640 1 -- 172.21.15.135:0/2518579058 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14700049e0 con 0x7f1480103190 2024-04-20T12:20:38.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.802+0000 7f1487469640 1 -- 172.21.15.135:0/2518579058 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14801a06d0 con 0x7f1480103190 2024-04-20T12:20:38.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.803+0000 7f1487469640 1 -- 172.21.15.135:0/2518579058 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14801092e0 con 0x7f1480103190 2024-04-20T12:20:38.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.804+0000 7f14767fc640 1 -- 172.21.15.135:0/2518579058 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f14700079b0 con 0x7f1480103190 2024-04-20T12:20:38.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.805+0000 7f14767fc640 1 --2- 172.21.15.135:0/2518579058 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f146c0a3bb0 0x7f146c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:38.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.805+0000 7f1485205640 1 --2- 172.21.15.135:0/2518579058 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f146c0a3bb0 0x7f146c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:38.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.805+0000 7f14767fc640 1 -- 172.21.15.135:0/2518579058 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f14700cfff0 con 0x7f1480103190 2024-04-20T12:20:38.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.805+0000 7f1485205640 1 --2- 172.21.15.135:0/2518579058 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f146c0a3bb0 0x7f146c0a6070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1480102ff0 tx=0x7f147c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:38.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.809+0000 7f14767fc640 1 -- 172.21.15.135:0/2518579058 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f1470014030 con 0x7f1480103190 2024-04-20T12:20:38.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.993+0000 7f1487469640 1 -- 172.21.15.135:0/2518579058 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f148002d860 con 0x7f1480103190 2024-04-20T12:20:38.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.994+0000 7f14767fc640 1 -- 172.21.15.135:0/2518579058 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f147009ce70 con 0x7f1480103190 2024-04-20T12:20:38.994 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-04-20T12:20:38.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.996+0000 7f1487469640 1 -- 172.21.15.135:0/2518579058 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f146c0a3bb0 msgr2=0x7f146c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:38.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.996+0000 7f1487469640 1 --2- 172.21.15.135:0/2518579058 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f146c0a3bb0 0x7f146c0a6070 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1480102ff0 tx=0x7f147c005f90 comp rx=0 tx=0).stop 2024-04-20T12:20:38.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.996+0000 7f1487469640 1 -- 172.21.15.135:0/2518579058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1480103190 msgr2=0x7f14801987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:38.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.996+0000 7f1487469640 1 --2- 172.21.15.135:0/2518579058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1480103190 0x7f14801987b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f147000c890 tx=0x7f147000cd50 comp rx=0 tx=0).stop 2024-04-20T12:20:38.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.996+0000 7f1487469640 1 -- 172.21.15.135:0/2518579058 shutdown_connections 2024-04-20T12:20:38.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.996+0000 7f1487469640 1 --2- 172.21.15.135:0/2518579058 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f146c0a3bb0 0x7f146c0a6070 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.996+0000 7f1487469640 1 --2- 172.21.15.135:0/2518579058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1480103b50 0x7f148019f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.996+0000 7f1487469640 1 --2- 172.21.15.135:0/2518579058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1480103190 0x7f14801987b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.996+0000 7f1487469640 1 --2- 172.21.15.135:0/2518579058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1480101fa0 0x7f1480198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:38.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.996+0000 7f1487469640 1 -- 172.21.15.135:0/2518579058 >> 172.21.15.135:0/2518579058 conn(0x7f14800fd510 msgr2=0x7f14801064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:38.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.996+0000 7f1487469640 1 -- 172.21.15.135:0/2518579058 shutdown_connections 2024-04-20T12:20:38.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:38.996+0000 7f1487469640 1 -- 172.21.15.135:0/2518579058 wait complete. 2024-04-20T12:20:39.007 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.007 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.007 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.007 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.007 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.007 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:39.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:20:39.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:38 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:20:39.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:38 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1349970094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:39.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:38 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3054591102' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:39.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:38 smithi135 ceph-mon[18264]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:39.009 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-20T12:20:39.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.110+0000 7f113b4a5640 1 -- 172.21.15.135:0/2930105438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11341029b0 msgr2=0x7f11341092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:39.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.110+0000 7f113b4a5640 1 --2- 172.21.15.135:0/2930105438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11341029b0 0x7f11341092d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f112c009ca0 tx=0x7f112c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.110+0000 7f113b4a5640 1 -- 172.21.15.135:0/2930105438 shutdown_connections 2024-04-20T12:20:39.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.110+0000 7f113b4a5640 1 --2- 172.21.15.135:0/2930105438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11341029b0 0x7f11341092d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.110+0000 7f113b4a5640 1 --2- 172.21.15.135:0/2930105438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1134101ff0 0x7f1134102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.110+0000 7f113b4a5640 1 --2- 172.21.15.135:0/2930105438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1134100ea0 0x7f11341012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.110+0000 7f113b4a5640 1 -- 172.21.15.135:0/2930105438 >> 172.21.15.135:0/2930105438 conn(0x7f11340fc410 msgr2=0x7f11340fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.110+0000 7f113b4a5640 1 -- 172.21.15.135:0/2930105438 shutdown_connections 2024-04-20T12:20:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.110+0000 7f113b4a5640 1 -- 172.21.15.135:0/2930105438 wait complete. 2024-04-20T12:20:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.110+0000 7f113b4a5640 1 Processor -- start 2024-04-20T12:20:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.110+0000 7f113b4a5640 1 -- start start 2024-04-20T12:20:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f113b4a5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1134100ea0 0x7f1134198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f113b4a5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1134101ff0 0x7f11341987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f113b4a5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11341029b0 0x7f113419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f113b4a5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f113410cb30 con 0x7f1134100ea0 2024-04-20T12:20:39.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f113b4a5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f113410c9b0 con 0x7f1134101ff0 2024-04-20T12:20:39.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f113b4a5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f113410ccb0 con 0x7f11341029b0 2024-04-20T12:20:39.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f1139241640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1134100ea0 0x7f1134198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:39.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f1139241640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1134100ea0 0x7f1134198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49026/0 (socket says 172.21.15.135:49026) 2024-04-20T12:20:39.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f1139241640 1 -- 172.21.15.135:0/3866036263 learned_addr learned my addr 172.21.15.135:0/3866036263 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:39.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f1138a40640 1 --2- 172.21.15.135:0/3866036263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1134101ff0 0x7f11341987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:39.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f1139a42640 1 --2- 172.21.15.135:0/3866036263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11341029b0 0x7f113419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:39.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f1139241640 1 -- 172.21.15.135:0/3866036263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11341029b0 msgr2=0x7f113419f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:39.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f1139241640 1 --2- 172.21.15.135:0/3866036263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11341029b0 0x7f113419f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f1139241640 1 -- 172.21.15.135:0/3866036263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1134101ff0 msgr2=0x7f11341987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:39.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f1139241640 1 --2- 172.21.15.135:0/3866036263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1134101ff0 0x7f11341987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f1139241640 1 -- 172.21.15.135:0/3866036263 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113419fe90 con 0x7f1134100ea0 2024-04-20T12:20:39.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f1139a42640 1 --2- 172.21.15.135:0/3866036263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11341029b0 0x7f113419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:20:39.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f1139241640 1 --2- 172.21.15.135:0/3866036263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1134100ea0 0x7f1134198270 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f113000ea60 tx=0x7f113000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:39.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f112a7fc640 1 -- 172.21.15.135:0/3866036263 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113000cde0 con 0x7f1134100ea0 2024-04-20T12:20:39.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f112a7fc640 1 -- 172.21.15.135:0/3866036263 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11300035f0 con 0x7f1134100ea0 2024-04-20T12:20:39.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f113b4a5640 1 -- 172.21.15.135:0/3866036263 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11341a0180 con 0x7f1134100ea0 2024-04-20T12:20:39.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f112a7fc640 1 -- 172.21.15.135:0/3866036263 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130010670 con 0x7f1134100ea0 2024-04-20T12:20:39.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.111+0000 7f113b4a5640 1 -- 172.21.15.135:0/3866036263 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11341a0720 con 0x7f1134100ea0 2024-04-20T12:20:39.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.112+0000 7f113b4a5640 1 -- 172.21.15.135:0/3866036263 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11341a09e0 con 0x7f1134100ea0 2024-04-20T12:20:39.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.113+0000 7f112a7fc640 1 -- 172.21.15.135:0/3866036263 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f11300037a0 con 0x7f1134100ea0 2024-04-20T12:20:39.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.114+0000 7f112a7fc640 1 --2- 172.21.15.135:0/3866036263 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f11200a3c30 0x7f11200a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:39.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.114+0000 7f1138a40640 1 --2- 172.21.15.135:0/3866036263 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f11200a3c30 0x7f11200a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:39.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.114+0000 7f112a7fc640 1 -- 172.21.15.135:0/3866036263 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f11300d02a0 con 0x7f1134100ea0 2024-04-20T12:20:39.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.114+0000 7f1138a40640 1 --2- 172.21.15.135:0/3866036263 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f11200a3c30 0x7f11200a60f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1134199780 tx=0x7f112400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:39.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.118+0000 7f112a7fc640 1 -- 172.21.15.135:0/3866036263 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f113009d120 con 0x7f1134100ea0 2024-04-20T12:20:39.155 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.156 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.156 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.156 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.156 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.156 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.156 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:39.156 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:20:39.156 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.156 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:38 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:20:39.156 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:38 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1349970094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:39.156 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:38 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3054591102' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:39.156 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:38 smithi139 ceph-mon[21834]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:39.220 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.220 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.220 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.220 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.220 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.220 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.220 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:39.220 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:20:39.220 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:39.220 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:38 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:20:39.220 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:38 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1349970094' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:39.220 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:38 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3054591102' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:39.220 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:38 smithi154 ceph-mon[22073]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:39.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.299+0000 7f113b4a5640 1 -- 172.21.15.135:0/3866036263 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f11341a0c50 con 0x7f1134100ea0 2024-04-20T12:20:39.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.299+0000 7f112a7fc640 1 -- 172.21.15.135:0/3866036263 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) ==== 84+0+65 (secure 0 0 0) 0x7f113009ca20 con 0x7f1134100ea0 2024-04-20T12:20:39.299 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:39.299 INFO:teuthology.orchestra.run.smithi135.stdout:[ 2024-04-20T12:20:39.299 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:20:39.300 INFO:teuthology.orchestra.run.smithi135.stdout: "poolnum": 1, 2024-04-20T12:20:39.300 INFO:teuthology.orchestra.run.smithi135.stdout: "poolname": ".mgr" 2024-04-20T12:20:39.300 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:20:39.300 INFO:teuthology.orchestra.run.smithi135.stdout:] 2024-04-20T12:20:39.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.301+0000 7f113b4a5640 1 -- 172.21.15.135:0/3866036263 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f11200a3c30 msgr2=0x7f11200a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:39.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.301+0000 7f113b4a5640 1 --2- 172.21.15.135:0/3866036263 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f11200a3c30 0x7f11200a60f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1134199780 tx=0x7f112400b410 comp rx=0 tx=0).stop 2024-04-20T12:20:39.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.301+0000 7f113b4a5640 1 -- 172.21.15.135:0/3866036263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1134100ea0 msgr2=0x7f1134198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:39.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.301+0000 7f113b4a5640 1 --2- 172.21.15.135:0/3866036263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1134100ea0 0x7f1134198270 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f113000ea60 tx=0x7f113000ef20 comp rx=0 tx=0).stop 2024-04-20T12:20:39.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.301+0000 7f113b4a5640 1 -- 172.21.15.135:0/3866036263 shutdown_connections 2024-04-20T12:20:39.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.301+0000 7f113b4a5640 1 --2- 172.21.15.135:0/3866036263 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f11200a3c30 0x7f11200a60f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.301+0000 7f113b4a5640 1 --2- 172.21.15.135:0/3866036263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11341029b0 0x7f113419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.301+0000 7f113b4a5640 1 --2- 172.21.15.135:0/3866036263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1134101ff0 0x7f11341987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.301+0000 7f113b4a5640 1 --2- 172.21.15.135:0/3866036263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1134100ea0 0x7f1134198270 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.301+0000 7f113b4a5640 1 -- 172.21.15.135:0/3866036263 >> 172.21.15.135:0/3866036263 conn(0x7f11340fc410 msgr2=0x7f11340fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:39.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.301+0000 7f113b4a5640 1 -- 172.21.15.135:0/3866036263 shutdown_connections 2024-04-20T12:20:39.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.301+0000 7f113b4a5640 1 -- 172.21.15.135:0/3866036263 wait complete. 2024-04-20T12:20:39.312 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-20T12:20:39.312 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-20T12:20:39.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.423+0000 7f5ebfbb6640 1 -- 172.21.15.135:0/1461614434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5eb8103c00 msgr2=0x7f5eb810a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:39.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.423+0000 7f5ebfbb6640 1 --2- 172.21.15.135:0/1461614434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5eb8103c00 0x7f5eb810a490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009cd0 tx=0x7f5eb002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.424+0000 7f5ebfbb6640 1 -- 172.21.15.135:0/1461614434 shutdown_connections 2024-04-20T12:20:39.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.424+0000 7f5ebfbb6640 1 --2- 172.21.15.135:0/1461614434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5eb8103c00 0x7f5eb810a490 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.424+0000 7f5ebfbb6640 1 --2- 172.21.15.135:0/1461614434 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb8103240 0x7f5eb81036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.424+0000 7f5ebfbb6640 1 --2- 172.21.15.135:0/1461614434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb8100270 0x7f5eb8100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.424+0000 7f5ebfbb6640 1 -- 172.21.15.135:0/1461614434 >> 172.21.15.135:0/1461614434 conn(0x7f5eb80fbba0 msgr2=0x7f5eb80fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:39.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.424+0000 7f5ebfbb6640 1 -- 172.21.15.135:0/1461614434 shutdown_connections 2024-04-20T12:20:39.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.424+0000 7f5ebfbb6640 1 -- 172.21.15.135:0/1461614434 wait complete. 2024-04-20T12:20:39.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.424+0000 7f5ebfbb6640 1 Processor -- start 2024-04-20T12:20:39.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.424+0000 7f5ebfbb6640 1 -- start start 2024-04-20T12:20:39.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebfbb6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb8100270 0x7f5eb8198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:39.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebfbb6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb8103240 0x7f5eb81987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:39.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebfbb6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5eb8103c00 0x7f5eb819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:39.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebfbb6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb810dc20 con 0x7f5eb8103c00 2024-04-20T12:20:39.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebfbb6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb810daa0 con 0x7f5eb8103240 2024-04-20T12:20:39.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebfbb6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb810dda0 con 0x7f5eb8100270 2024-04-20T12:20:39.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebd151640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb8103240 0x7f5eb81987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:39.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebe153640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5eb8103c00 0x7f5eb819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:39.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebe153640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5eb8103c00 0x7f5eb819f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49052/0 (socket says 172.21.15.135:49052) 2024-04-20T12:20:39.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebd151640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb8103240 0x7f5eb81987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:42188/0 (socket says 172.21.15.135:42188) 2024-04-20T12:20:39.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebe153640 1 -- 172.21.15.135:0/2229611744 learned_addr learned my addr 172.21.15.135:0/2229611744 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:39.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebd952640 1 --2- 172.21.15.135:0/2229611744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb8100270 0x7f5eb8198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:39.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebe153640 1 -- 172.21.15.135:0/2229611744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb8100270 msgr2=0x7f5eb8198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:39.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebe153640 1 --2- 172.21.15.135:0/2229611744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb8100270 0x7f5eb8198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebe153640 1 -- 172.21.15.135:0/2229611744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb8103240 msgr2=0x7f5eb81987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:39.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebe153640 1 --2- 172.21.15.135:0/2229611744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb8103240 0x7f5eb81987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:39.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebe153640 1 -- 172.21.15.135:0/2229611744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb819fe80 con 0x7f5eb8103c00 2024-04-20T12:20:39.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebd952640 1 --2- 172.21.15.135:0/2229611744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb8100270 0x7f5eb8198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:20:39.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebd151640 1 --2- 172.21.15.135:0/2229611744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb8103240 0x7f5eb81987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:20:39.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebe153640 1 --2- 172.21.15.135:0/2229611744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5eb8103c00 0x7f5eb819f810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0005e30 tx=0x7f5eb00346f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:39.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5eaeffd640 1 -- 172.21.15.135:0/2229611744 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0041020 con 0x7f5eb8103c00 2024-04-20T12:20:39.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5eaeffd640 1 -- 172.21.15.135:0/2229611744 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5eb0032890 con 0x7f5eb8103c00 2024-04-20T12:20:39.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.425+0000 7f5ebfbb6640 1 -- 172.21.15.135:0/2229611744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb81a0110 con 0x7f5eb8103c00 2024-04-20T12:20:39.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.426+0000 7f5eaeffd640 1 -- 172.21.15.135:0/2229611744 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0039040 con 0x7f5eb8103c00 2024-04-20T12:20:39.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.426+0000 7f5ebfbb6640 1 -- 172.21.15.135:0/2229611744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eb81a0600 con 0x7f5eb8103c00 2024-04-20T12:20:39.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.426+0000 7f5ebfbb6640 1 -- 172.21.15.135:0/2229611744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb8109370 con 0x7f5eb8103c00 2024-04-20T12:20:39.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.428+0000 7f5eaeffd640 1 -- 172.21.15.135:0/2229611744 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f5eb0044020 con 0x7f5eb8103c00 2024-04-20T12:20:39.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.428+0000 7f5eaeffd640 1 --2- 172.21.15.135:0/2229611744 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ea40a3bb0 0x7f5ea40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:39.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.429+0000 7f5eaeffd640 1 -- 172.21.15.135:0/2229611744 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f5eb00f21e0 con 0x7f5eb8103c00 2024-04-20T12:20:39.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.429+0000 7f5ebd952640 1 --2- 172.21.15.135:0/2229611744 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ea40a3bb0 0x7f5ea40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:39.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.429+0000 7f5ebd952640 1 --2- 172.21.15.135:0/2229611744 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ea40a3bb0 0x7f5ea40a6070 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4005d00 tx=0x7f5eb4005c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:39.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.433+0000 7f5eaeffd640 1 -- 172.21.15.135:0/2229611744 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f5eb004b020 con 0x7f5eb8103c00 2024-04-20T12:20:39.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.651+0000 7f5ebfbb6640 1 -- 172.21.15.135:0/2229611744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f5eb802d5d0 con 0x7f5eb8103c00 2024-04-20T12:20:39.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:39.999+0000 7f5eaeffd640 1 -- 172.21.15.135:0/2229611744 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) ==== 138+0+0 (secure 0 0 0) 0x7f5eb00bf060 con 0x7f5eb8103c00 2024-04-20T12:20:39.999 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_metadata' created 2024-04-20T12:20:40.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.001+0000 7f5ebfbb6640 1 -- 172.21.15.135:0/2229611744 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ea40a3bb0 msgr2=0x7f5ea40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:40.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.001+0000 7f5ebfbb6640 1 --2- 172.21.15.135:0/2229611744 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ea40a3bb0 0x7f5ea40a6070 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4005d00 tx=0x7f5eb4005c90 comp rx=0 tx=0).stop 2024-04-20T12:20:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.001+0000 7f5ebfbb6640 1 -- 172.21.15.135:0/2229611744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5eb8103c00 msgr2=0x7f5eb819f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.001+0000 7f5ebfbb6640 1 --2- 172.21.15.135:0/2229611744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5eb8103c00 0x7f5eb819f810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0005e30 tx=0x7f5eb00346f0 comp rx=0 tx=0).stop 2024-04-20T12:20:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.001+0000 7f5ebfbb6640 1 -- 172.21.15.135:0/2229611744 shutdown_connections 2024-04-20T12:20:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.001+0000 7f5ebfbb6640 1 --2- 172.21.15.135:0/2229611744 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ea40a3bb0 0x7f5ea40a6070 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.001+0000 7f5ebfbb6640 1 --2- 172.21.15.135:0/2229611744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5eb8103c00 0x7f5eb819f810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.001+0000 7f5ebfbb6640 1 --2- 172.21.15.135:0/2229611744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5eb8103240 0x7f5eb81987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.001+0000 7f5ebfbb6640 1 --2- 172.21.15.135:0/2229611744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5eb8100270 0x7f5eb8198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.001+0000 7f5ebfbb6640 1 -- 172.21.15.135:0/2229611744 >> 172.21.15.135:0/2229611744 conn(0x7f5eb80fbba0 msgr2=0x7f5eb8106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.001+0000 7f5ebfbb6640 1 -- 172.21.15.135:0/2229611744 shutdown_connections 2024-04-20T12:20:40.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.001+0000 7f5ebfbb6640 1 -- 172.21.15.135:0/2229611744 wait complete. 2024-04-20T12:20:40.015 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-20T12:20:40.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.121+0000 7f74876a7640 1 -- 172.21.15.135:0/2277581988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7480105410 msgr2=0x7f7480107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:40.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.121+0000 7f74876a7640 1 --2- 172.21.15.135:0/2277581988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7480105410 0x7f7480107800 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7470009900 tx=0x7f747002bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:40.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.121+0000 7f74876a7640 1 -- 172.21.15.135:0/2277581988 shutdown_connections 2024-04-20T12:20:40.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.121+0000 7f74876a7640 1 --2- 172.21.15.135:0/2277581988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7480107d40 0x7f748010a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:40.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.121+0000 7f74876a7640 1 --2- 172.21.15.135:0/2277581988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7480105410 0x7f7480107800 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:40.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.121+0000 7f74876a7640 1 --2- 172.21.15.135:0/2277581988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7480102ae0 0x7f7480104ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:40.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.121+0000 7f74876a7640 1 -- 172.21.15.135:0/2277581988 >> 172.21.15.135:0/2277581988 conn(0x7f74800fc450 msgr2=0x7f74800fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:40.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.121+0000 7f74876a7640 1 -- 172.21.15.135:0/2277581988 shutdown_connections 2024-04-20T12:20:40.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.121+0000 7f74876a7640 1 -- 172.21.15.135:0/2277581988 wait complete. 2024-04-20T12:20:40.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f74876a7640 1 Processor -- start 2024-04-20T12:20:40.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f74876a7640 1 -- start start 2024-04-20T12:20:40.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f74876a7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7480102ae0 0x7f74801982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:40.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f74876a7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7480105410 0x7f74801987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:40.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f74876a7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7480107d40 0x7f748019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:40.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f74876a7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f748010dc30 con 0x7f7480102ae0 2024-04-20T12:20:40.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f74876a7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f748010dab0 con 0x7f7480107d40 2024-04-20T12:20:40.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f74876a7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f748010ddb0 con 0x7f7480105410 2024-04-20T12:20:40.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f7485443640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7480102ae0 0x7f74801982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:40.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f7485443640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7480102ae0 0x7f74801982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49070/0 (socket says 172.21.15.135:49070) 2024-04-20T12:20:40.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f7485443640 1 -- 172.21.15.135:0/718789343 learned_addr learned my addr 172.21.15.135:0/718789343 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:40.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f7484c42640 1 --2- 172.21.15.135:0/718789343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7480105410 0x7f74801987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:40.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f7485443640 1 -- 172.21.15.135:0/718789343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7480105410 msgr2=0x7f74801987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:40.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f7485c44640 1 --2- 172.21.15.135:0/718789343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7480107d40 0x7f748019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:40.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f7485443640 1 --2- 172.21.15.135:0/718789343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7480105410 0x7f74801987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:40.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f7485443640 1 -- 172.21.15.135:0/718789343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7480107d40 msgr2=0x7f748019f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:40.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f7485443640 1 --2- 172.21.15.135:0/718789343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7480107d40 0x7f748019f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:40.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f7485443640 1 -- 172.21.15.135:0/718789343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748019fed0 con 0x7f7480102ae0 2024-04-20T12:20:40.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f7484c42640 1 --2- 172.21.15.135:0/718789343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7480105410 0x7f74801987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:20:40.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f7485443640 1 --2- 172.21.15.135:0/718789343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7480102ae0 0x7f74801982b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f747c00c920 tx=0x7f747c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:40.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f74767fc640 1 -- 172.21.15.135:0/718789343 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c007c70 con 0x7f7480102ae0 2024-04-20T12:20:40.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.122+0000 7f74767fc640 1 -- 172.21.15.135:0/718789343 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f747c007e10 con 0x7f7480102ae0 2024-04-20T12:20:40.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.123+0000 7f74876a7640 1 -- 172.21.15.135:0/718789343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74801a01c0 con 0x7f7480102ae0 2024-04-20T12:20:40.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.123+0000 7f74767fc640 1 -- 172.21.15.135:0/718789343 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747c018890 con 0x7f7480102ae0 2024-04-20T12:20:40.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.123+0000 7f74876a7640 1 -- 172.21.15.135:0/718789343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74801a06e0 con 0x7f7480102ae0 2024-04-20T12:20:40.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.123+0000 7f74876a7640 1 -- 172.21.15.135:0/718789343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74800fdf40 con 0x7f7480102ae0 2024-04-20T12:20:40.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.125+0000 7f74767fc640 1 -- 172.21.15.135:0/718789343 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f747c018a50 con 0x7f7480102ae0 2024-04-20T12:20:40.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.125+0000 7f74767fc640 1 --2- 172.21.15.135:0/718789343 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f746c0a3bb0 0x7f746c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:40.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.125+0000 7f7484c42640 1 --2- 172.21.15.135:0/718789343 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f746c0a3bb0 0x7f746c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:40.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.125+0000 7f74767fc640 1 -- 172.21.15.135:0/718789343 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7497+0+0 (secure 0 0 0) 0x7f747c0d0570 con 0x7f7480102ae0 2024-04-20T12:20:40.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.126+0000 7f7484c42640 1 --2- 172.21.15.135:0/718789343 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f746c0a3bb0 0x7f746c0a6070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f747002c7b0 tx=0x7f7470005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:40.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.129+0000 7f74767fc640 1 -- 172.21.15.135:0/718789343 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f747c014030 con 0x7f7480102ae0 2024-04-20T12:20:40.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:39 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2518579058' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:20:40.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:39 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3866036263' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-20T12:20:40.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:39 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2229611744' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-20T12:20:40.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:40.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:20:40.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:39 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:40.307+0000 7f74876a7640 1 -- 172.21.15.135:0/718789343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f748002d5d0 con 0x7f7480102ae0 2024-04-20T12:20:40.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:39 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2518579058' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:20:40.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:39 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3866036263' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-20T12:20:40.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:39 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2229611744' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-20T12:20:40.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:40.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:20:40.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:39 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:39 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2518579058' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:20:40.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:39 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3866036263' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-04-20T12:20:40.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:39 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2229611744' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-04-20T12:20:40.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:40.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:20:40.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:20:40.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:39 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:20:41.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.006+0000 7f74767fc640 1 -- 172.21.15.135:0/718789343 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v83) ==== 171+0+0 (secure 0 0 0) 0x7f747c09d310 con 0x7f7480102ae0 2024-04-20T12:20:41.006 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data' created 2024-04-20T12:20:41.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.009+0000 7f74876a7640 1 -- 172.21.15.135:0/718789343 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f746c0a3bb0 msgr2=0x7f746c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:41.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.009+0000 7f74876a7640 1 --2- 172.21.15.135:0/718789343 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f746c0a3bb0 0x7f746c0a6070 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f747002c7b0 tx=0x7f7470005fd0 comp rx=0 tx=0).stop 2024-04-20T12:20:41.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.009+0000 7f74876a7640 1 -- 172.21.15.135:0/718789343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7480102ae0 msgr2=0x7f74801982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:41.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.009+0000 7f74876a7640 1 --2- 172.21.15.135:0/718789343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7480102ae0 0x7f74801982b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f747c00c920 tx=0x7f747c00cde0 comp rx=0 tx=0).stop 2024-04-20T12:20:41.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.009+0000 7f74876a7640 1 -- 172.21.15.135:0/718789343 shutdown_connections 2024-04-20T12:20:41.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.009+0000 7f74876a7640 1 --2- 172.21.15.135:0/718789343 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f746c0a3bb0 0x7f746c0a6070 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:41.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.009+0000 7f74876a7640 1 --2- 172.21.15.135:0/718789343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7480107d40 0x7f748019f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:41.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.009+0000 7f74876a7640 1 --2- 172.21.15.135:0/718789343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7480105410 0x7f74801987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:41.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.009+0000 7f74876a7640 1 --2- 172.21.15.135:0/718789343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7480102ae0 0x7f74801982b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:41.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.009+0000 7f74876a7640 1 -- 172.21.15.135:0/718789343 >> 172.21.15.135:0/718789343 conn(0x7f74800fc450 msgr2=0x7f7480103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:41.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.009+0000 7f74876a7640 1 -- 172.21.15.135:0/718789343 shutdown_connections 2024-04-20T12:20:41.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.009+0000 7f74876a7640 1 -- 172.21.15.135:0/718789343 wait complete. 2024-04-20T12:20:41.031 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-20T12:20:41.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.134+0000 7f05d71b1640 1 -- 172.21.15.135:0/2571435174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d0100ea0 msgr2=0x7f05d01012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:41.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.134+0000 7f05d71b1640 1 --2- 172.21.15.135:0/2571435174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d0100ea0 0x7f05d01012c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f05c4009900 tx=0x7f05c402bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:41.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.134+0000 7f05d71b1640 1 -- 172.21.15.135:0/2571435174 shutdown_connections 2024-04-20T12:20:41.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.134+0000 7f05d71b1640 1 --2- 172.21.15.135:0/2571435174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05d01029b0 0x7f05d01092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:41.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.134+0000 7f05d71b1640 1 --2- 172.21.15.135:0/2571435174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05d0101ff0 0x7f05d0102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:41.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.134+0000 7f05d71b1640 1 --2- 172.21.15.135:0/2571435174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d0100ea0 0x7f05d01012c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:41.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.134+0000 7f05d71b1640 1 -- 172.21.15.135:0/2571435174 >> 172.21.15.135:0/2571435174 conn(0x7f05d00fc410 msgr2=0x7f05d00fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:41.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.134+0000 7f05d71b1640 1 -- 172.21.15.135:0/2571435174 shutdown_connections 2024-04-20T12:20:41.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.134+0000 7f05d71b1640 1 -- 172.21.15.135:0/2571435174 wait complete. 2024-04-20T12:20:41.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d71b1640 1 Processor -- start 2024-04-20T12:20:41.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d71b1640 1 -- start start 2024-04-20T12:20:41.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d71b1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05d0100ea0 0x7f05d0069c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:41.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d71b1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05d0101ff0 0x7f05d019f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:41.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d71b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d01029b0 0x7f05d01a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:41.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d71b1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f05d010cb40 con 0x7f05d01029b0 2024-04-20T12:20:41.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d71b1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f05d010c9c0 con 0x7f05d0100ea0 2024-04-20T12:20:41.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d71b1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f05d010ccc0 con 0x7f05d0101ff0 2024-04-20T12:20:41.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d574e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d01029b0 0x7f05d01a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:41.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d574e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d01029b0 0x7f05d01a1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52016/0 (socket says 172.21.15.135:52016) 2024-04-20T12:20:41.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d574e640 1 -- 172.21.15.135:0/137924658 learned_addr learned my addr 172.21.15.135:0/137924658 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:41.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05cffff640 1 --2- 172.21.15.135:0/137924658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05d0101ff0 0x7f05d019f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:41.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d4f4d640 1 --2- 172.21.15.135:0/137924658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05d0100ea0 0x7f05d0069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:41.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d574e640 1 -- 172.21.15.135:0/137924658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05d0101ff0 msgr2=0x7f05d019f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:41.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d574e640 1 --2- 172.21.15.135:0/137924658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05d0101ff0 0x7f05d019f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:41.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d574e640 1 -- 172.21.15.135:0/137924658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05d0100ea0 msgr2=0x7f05d0069c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:41.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d574e640 1 --2- 172.21.15.135:0/137924658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05d0100ea0 0x7f05d0069c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:41.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.135+0000 7f05d574e640 1 -- 172.21.15.135:0/137924658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d01a2140 con 0x7f05d01029b0 2024-04-20T12:20:41.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.136+0000 7f05d574e640 1 --2- 172.21.15.135:0/137924658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d01029b0 0x7f05d01a1950 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f05c800cce0 tx=0x7f05c800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:41.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.136+0000 7f05cdffb640 1 -- 172.21.15.135:0/137924658 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c800f450 con 0x7f05d01029b0 2024-04-20T12:20:41.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.136+0000 7f05cdffb640 1 -- 172.21.15.135:0/137924658 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05c800fad0 con 0x7f05d01029b0 2024-04-20T12:20:41.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.136+0000 7f05d71b1640 1 -- 172.21.15.135:0/137924658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d01a23d0 con 0x7f05d01029b0 2024-04-20T12:20:41.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.136+0000 7f05cdffb640 1 -- 172.21.15.135:0/137924658 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c8018c10 con 0x7f05d01029b0 2024-04-20T12:20:41.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.136+0000 7f05d71b1640 1 -- 172.21.15.135:0/137924658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d01a28d0 con 0x7f05d01029b0 2024-04-20T12:20:41.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.137+0000 7f05d71b1640 1 -- 172.21.15.135:0/137924658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05d01081b0 con 0x7f05d01029b0 2024-04-20T12:20:41.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.138+0000 7f05cdffb640 1 -- 172.21.15.135:0/137924658 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f05c800f5f0 con 0x7f05d01029b0 2024-04-20T12:20:41.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.139+0000 7f05cdffb640 1 --2- 172.21.15.135:0/137924658 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f05c00a3be0 0x7f05c00a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:41.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.139+0000 7f05d4f4d640 1 --2- 172.21.15.135:0/137924658 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f05c00a3be0 0x7f05c00a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:41.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.139+0000 7f05cdffb640 1 -- 172.21.15.135:0/137924658 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7879+0+0 (secure 0 0 0) 0x7f05c80d0820 con 0x7f05d01029b0 2024-04-20T12:20:41.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.139+0000 7f05d4f4d640 1 --2- 172.21.15.135:0/137924658 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f05c00a3be0 0x7f05c00a60a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f05c4005ab0 tx=0x7f05c4004f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:41.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.143+0000 7f05cdffb640 1 -- 172.21.15.135:0/137924658 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f05c8014030 con 0x7f05d01029b0 2024-04-20T12:20:41.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:41 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2229611744' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-20T12:20:41.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:41 smithi139 ceph-mon[21834]: osdmap e82: 12 total, 12 up, 12 in 2024-04-20T12:20:41.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:41 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/718789343' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-20T12:20:41.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:41 smithi139 ceph-mon[21834]: pgmap v284: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:41.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:41 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2229611744' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-20T12:20:41.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:41 smithi135 ceph-mon[18264]: osdmap e82: 12 total, 12 up, 12 in 2024-04-20T12:20:41.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:41 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/718789343' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-20T12:20:41.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:41 smithi135 ceph-mon[18264]: pgmap v284: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:41.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:41.365+0000 7f05d71b1640 1 -- 172.21.15.135:0/137924658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f05d0062bd0 con 0x7f05d01029b0 2024-04-20T12:20:41.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:41 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2229611744' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-04-20T12:20:41.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:41 smithi154 ceph-mon[22073]: osdmap e82: 12 total, 12 up, 12 in 2024-04-20T12:20:41.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:41 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/718789343' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-04-20T12:20:41.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:41 smithi154 ceph-mon[22073]: pgmap v284: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:20:42.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.007+0000 7f05cdffb640 1 -- 172.21.15.135:0/137924658 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f05c809d3b0 con 0x7f05d01029b0 2024-04-20T12:20:42.008 INFO:teuthology.orchestra.run.smithi135.stderr:new fs with metadata pool 2 and data pool 3 2024-04-20T12:20:42.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.011+0000 7f05d71b1640 1 -- 172.21.15.135:0/137924658 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f05c00a3be0 msgr2=0x7f05c00a60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:42.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.011+0000 7f05d71b1640 1 --2- 172.21.15.135:0/137924658 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f05c00a3be0 0x7f05c00a60a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f05c4005ab0 tx=0x7f05c4004f10 comp rx=0 tx=0).stop 2024-04-20T12:20:42.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.011+0000 7f05d71b1640 1 -- 172.21.15.135:0/137924658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d01029b0 msgr2=0x7f05d01a1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:42.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.011+0000 7f05d71b1640 1 --2- 172.21.15.135:0/137924658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d01029b0 0x7f05d01a1950 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f05c800cce0 tx=0x7f05c800a620 comp rx=0 tx=0).stop 2024-04-20T12:20:42.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.011+0000 7f05d71b1640 1 -- 172.21.15.135:0/137924658 shutdown_connections 2024-04-20T12:20:42.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.011+0000 7f05d71b1640 1 --2- 172.21.15.135:0/137924658 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f05c00a3be0 0x7f05c00a60a0 secure :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f05c4005ab0 tx=0x7f05c4004f10 comp rx=0 tx=0).stop 2024-04-20T12:20:42.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.011+0000 7f05d71b1640 1 --2- 172.21.15.135:0/137924658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05d01029b0 0x7f05d01a1950 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:42.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.011+0000 7f05d71b1640 1 --2- 172.21.15.135:0/137924658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f05d0101ff0 0x7f05d019f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:42.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.011+0000 7f05d71b1640 1 --2- 172.21.15.135:0/137924658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05d0100ea0 0x7f05d0069c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:42.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.011+0000 7f05d71b1640 1 -- 172.21.15.135:0/137924658 >> 172.21.15.135:0/137924658 conn(0x7f05d00fc410 msgr2=0x7f05d0105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:42.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.011+0000 7f05d71b1640 1 -- 172.21.15.135:0/137924658 shutdown_connections 2024-04-20T12:20:42.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.011+0000 7f05d71b1640 1 -- 172.21.15.135:0/137924658 wait complete. 2024-04-20T12:20:42.033 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-20T12:20:42.034 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-20T12:20:42.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.142+0000 7fd1772c1640 1 -- 172.21.15.135:0/3519260027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170101fb0 msgr2=0x7fd1701023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:42.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.142+0000 7fd1772c1640 1 --2- 172.21.15.135:0/3519260027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170101fb0 0x7fd1701023d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd16c009900 tx=0x7fd16c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:42.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.142+0000 7fd1772c1640 1 -- 172.21.15.135:0/3519260027 shutdown_connections 2024-04-20T12:20:42.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.142+0000 7fd1772c1640 1 --2- 172.21.15.135:0/3519260027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd170103b60 0x7fd17010a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:42.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.142+0000 7fd1772c1640 1 --2- 172.21.15.135:0/3519260027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1701031a0 0x7fd170103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:42.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.142+0000 7fd1772c1640 1 --2- 172.21.15.135:0/3519260027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170101fb0 0x7fd1701023d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:42.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.142+0000 7fd1772c1640 1 -- 172.21.15.135:0/3519260027 >> 172.21.15.135:0/3519260027 conn(0x7fd1700fd540 msgr2=0x7fd1700ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:42.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.142+0000 7fd1772c1640 1 -- 172.21.15.135:0/3519260027 shutdown_connections 2024-04-20T12:20:42.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.142+0000 7fd1772c1640 1 -- 172.21.15.135:0/3519260027 wait complete. 2024-04-20T12:20:42.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd1772c1640 1 Processor -- start 2024-04-20T12:20:42.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd1772c1640 1 -- start start 2024-04-20T12:20:42.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd1772c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170101fb0 0x7fd170198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:42.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd1772c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1701031a0 0x7fd170198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:42.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd1772c1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd170103b60 0x7fd17019f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:42.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd1772c1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd17010dc80 con 0x7fd170101fb0 2024-04-20T12:20:42.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd1772c1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd17010db00 con 0x7fd1701031a0 2024-04-20T12:20:42.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd1772c1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd17010de00 con 0x7fd170103b60 2024-04-20T12:20:42.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd17505d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170101fb0 0x7fd170198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:42.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd17505d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170101fb0 0x7fd170198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52020/0 (socket says 172.21.15.135:52020) 2024-04-20T12:20:42.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd17505d640 1 -- 172.21.15.135:0/596523264 learned_addr learned my addr 172.21.15.135:0/596523264 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:42.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd17585e640 1 --2- 172.21.15.135:0/596523264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd170103b60 0x7fd17019f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:42.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd17505d640 1 -- 172.21.15.135:0/596523264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd170103b60 msgr2=0x7fd17019f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:42.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd17505d640 1 --2- 172.21.15.135:0/596523264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd170103b60 0x7fd17019f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:42.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd17505d640 1 -- 172.21.15.135:0/596523264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1701031a0 msgr2=0x7fd170198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:42.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd17505d640 1 --2- 172.21.15.135:0/596523264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1701031a0 0x7fd170198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:42.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.143+0000 7fd17505d640 1 -- 172.21.15.135:0/596523264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17019ff70 con 0x7fd170101fb0 2024-04-20T12:20:42.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.144+0000 7fd17505d640 1 --2- 172.21.15.135:0/596523264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170101fb0 0x7fd170198350 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd16c005ab0 tx=0x7fd16c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:42.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.144+0000 7fd1667fc640 1 -- 172.21.15.135:0/596523264 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c041070 con 0x7fd170101fb0 2024-04-20T12:20:42.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.144+0000 7fd1667fc640 1 -- 172.21.15.135:0/596523264 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd16c0054e0 con 0x7fd170101fb0 2024-04-20T12:20:42.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.144+0000 7fd1667fc640 1 -- 172.21.15.135:0/596523264 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c034440 con 0x7fd170101fb0 2024-04-20T12:20:42.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.144+0000 7fd1772c1640 1 -- 172.21.15.135:0/596523264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1701a0200 con 0x7fd170101fb0 2024-04-20T12:20:42.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.144+0000 7fd1772c1640 1 -- 172.21.15.135:0/596523264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1701a06f0 con 0x7fd170101fb0 2024-04-20T12:20:42.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.145+0000 7fd1772c1640 1 -- 172.21.15.135:0/596523264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd170109350 con 0x7fd170101fb0 2024-04-20T12:20:42.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.146+0000 7fd1667fc640 1 -- 172.21.15.135:0/596523264 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fd16c044070 con 0x7fd170101fb0 2024-04-20T12:20:42.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.146+0000 7fd1667fc640 1 --2- 172.21.15.135:0/596523264 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd15c0a3bb0 0x7fd15c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:42.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.146+0000 7fd17485c640 1 --2- 172.21.15.135:0/596523264 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd15c0a3bb0 0x7fd15c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:42.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.147+0000 7fd1667fc640 1 -- 172.21.15.135:0/596523264 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7979+0+0 (secure 0 0 0) 0x7fd16c0f2030 con 0x7fd170101fb0 2024-04-20T12:20:42.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.147+0000 7fd17485c640 1 --2- 172.21.15.135:0/596523264 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd15c0a3bb0 0x7fd15c0a6070 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd160005fd0 tx=0x7fd160005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:42.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.151+0000 7fd1667fc640 1 -- 172.21.15.135:0/596523264 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fd16c0beb60 con 0x7fd170101fb0 2024-04-20T12:20:42.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:42 smithi139 ceph-mon[21834]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-20T12:20:42.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:42 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/718789343' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-04-20T12:20:42.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:42 smithi139 ceph-mon[21834]: osdmap e83: 12 total, 12 up, 12 in 2024-04-20T12:20:42.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:42 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/137924658' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-20T12:20:42.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:42 smithi139 ceph-mon[21834]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-04-20T12:20:42.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:42.337+0000 7fd1772c1640 1 -- 172.21.15.135:0/596523264 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fd17002d810 con 0x7fd170101fb0 2024-04-20T12:20:42.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:42 smithi135 ceph-mon[18264]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-20T12:20:42.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:42 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/718789343' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-04-20T12:20:42.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:42 smithi135 ceph-mon[18264]: osdmap e83: 12 total, 12 up, 12 in 2024-04-20T12:20:42.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:42 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/137924658' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-20T12:20:42.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:42 smithi135 ceph-mon[18264]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-04-20T12:20:42.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:42 smithi154 ceph-mon[22073]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-20T12:20:42.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:42 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/718789343' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-04-20T12:20:42.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:42 smithi154 ceph-mon[22073]: osdmap e83: 12 total, 12 up, 12 in 2024-04-20T12:20:42.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:42 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/137924658' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-04-20T12:20:42.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:42 smithi154 ceph-mon[22073]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-04-20T12:20:43.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.023+0000 7fd1667fc640 1 -- 172.21.15.135:0/596523264 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v85) ==== 157+0+0 (secure 0 0 0) 0x7fd16c0be460 con 0x7fd170101fb0 2024-04-20T12:20:43.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.026+0000 7fd1772c1640 1 -- 172.21.15.135:0/596523264 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd15c0a3bb0 msgr2=0x7fd15c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:43.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.026+0000 7fd1772c1640 1 --2- 172.21.15.135:0/596523264 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd15c0a3bb0 0x7fd15c0a6070 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd160005fd0 tx=0x7fd160005850 comp rx=0 tx=0).stop 2024-04-20T12:20:43.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.026+0000 7fd1772c1640 1 -- 172.21.15.135:0/596523264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170101fb0 msgr2=0x7fd170198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:43.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.026+0000 7fd1772c1640 1 --2- 172.21.15.135:0/596523264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170101fb0 0x7fd170198350 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd16c005ab0 tx=0x7fd16c005dc0 comp rx=0 tx=0).stop 2024-04-20T12:20:43.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.026+0000 7fd1772c1640 1 -- 172.21.15.135:0/596523264 shutdown_connections 2024-04-20T12:20:43.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.026+0000 7fd1772c1640 1 --2- 172.21.15.135:0/596523264 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd15c0a3bb0 0x7fd15c0a6070 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:43.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.026+0000 7fd1772c1640 1 --2- 172.21.15.135:0/596523264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd170103b60 0x7fd17019f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:43.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.026+0000 7fd1772c1640 1 --2- 172.21.15.135:0/596523264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd1701031a0 0x7fd170198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:43.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.026+0000 7fd1772c1640 1 --2- 172.21.15.135:0/596523264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd170101fb0 0x7fd170198350 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:43.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.026+0000 7fd1772c1640 1 -- 172.21.15.135:0/596523264 >> 172.21.15.135:0/596523264 conn(0x7fd1700fd540 msgr2=0x7fd170106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:43.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.026+0000 7fd1772c1640 1 -- 172.21.15.135:0/596523264 shutdown_connections 2024-04-20T12:20:43.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.026+0000 7fd1772c1640 1 -- 172.21.15.135:0/596523264 wait complete. 2024-04-20T12:20:43.039 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-20T12:20:43.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.148+0000 7fc03cca8640 1 -- 172.21.15.135:0/3686415538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc038102090 msgr2=0x7fc038102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:43.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.148+0000 7fc03cca8640 1 --2- 172.21.15.135:0/3686415538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc038102090 0x7fc038102510 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc02c009900 tx=0x7fc02c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:43.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.148+0000 7fc03cca8640 1 -- 172.21.15.135:0/3686415538 shutdown_connections 2024-04-20T12:20:43.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.148+0000 7fc03cca8640 1 --2- 172.21.15.135:0/3686415538 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc038102a50 0x7fc038109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:43.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.148+0000 7fc03cca8640 1 --2- 172.21.15.135:0/3686415538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc038102090 0x7fc038102510 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:43.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.148+0000 7fc03cca8640 1 --2- 172.21.15.135:0/3686415538 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc038100f40 0x7fc038101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:43.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.148+0000 7fc03cca8640 1 -- 172.21.15.135:0/3686415538 >> 172.21.15.135:0/3686415538 conn(0x7fc0380fc4b0 msgr2=0x7fc0380fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:43.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.148+0000 7fc03cca8640 1 -- 172.21.15.135:0/3686415538 shutdown_connections 2024-04-20T12:20:43.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.148+0000 7fc03cca8640 1 -- 172.21.15.135:0/3686415538 wait complete. 2024-04-20T12:20:43.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc03cca8640 1 Processor -- start 2024-04-20T12:20:43.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc03cca8640 1 -- start start 2024-04-20T12:20:43.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc03cca8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc038100f40 0x7fc038198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:43.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc03cca8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc038102090 0x7fc038198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:43.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc03cca8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc038102a50 0x7fc03819f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:43.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc03cca8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc03810dd50 con 0x7fc038102090 2024-04-20T12:20:43.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc03cca8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc03810dbd0 con 0x7fc038102a50 2024-04-20T12:20:43.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc03cca8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc03810ded0 con 0x7fc038100f40 2024-04-20T12:20:43.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc035d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc038102090 0x7fc038198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:43.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc035d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc038102090 0x7fc038198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52040/0 (socket says 172.21.15.135:52040) 2024-04-20T12:20:43.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc035d9b640 1 -- 172.21.15.135:0/2723015483 learned_addr learned my addr 172.21.15.135:0/2723015483 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:43.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc03659c640 1 --2- 172.21.15.135:0/2723015483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc038100f40 0x7fc038198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:43.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc036d9d640 1 --2- 172.21.15.135:0/2723015483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc038102a50 0x7fc03819f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:43.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc035d9b640 1 -- 172.21.15.135:0/2723015483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc038100f40 msgr2=0x7fc038198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:43.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc035d9b640 1 --2- 172.21.15.135:0/2723015483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc038100f40 0x7fc038198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:43.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc035d9b640 1 -- 172.21.15.135:0/2723015483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc038102a50 msgr2=0x7fc03819f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:43.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc035d9b640 1 --2- 172.21.15.135:0/2723015483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc038102a50 0x7fc03819f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:43.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.149+0000 7fc035d9b640 1 -- 172.21.15.135:0/2723015483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03819ff50 con 0x7fc038102090 2024-04-20T12:20:43.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.150+0000 7fc035d9b640 1 --2- 172.21.15.135:0/2723015483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc038102090 0x7fc038198870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc02c000c00 tx=0x7fc02c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:43.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.150+0000 7fc0277fe640 1 -- 172.21.15.135:0/2723015483 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c041070 con 0x7fc038102090 2024-04-20T12:20:43.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.150+0000 7fc0277fe640 1 -- 172.21.15.135:0/2723015483 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc02c0054e0 con 0x7fc038102090 2024-04-20T12:20:43.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.150+0000 7fc03cca8640 1 -- 172.21.15.135:0/2723015483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0381a01e0 con 0x7fc038102090 2024-04-20T12:20:43.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.150+0000 7fc0277fe640 1 -- 172.21.15.135:0/2723015483 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c0346a0 con 0x7fc038102090 2024-04-20T12:20:43.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.150+0000 7fc03cca8640 1 -- 172.21.15.135:0/2723015483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0381a06d0 con 0x7fc038102090 2024-04-20T12:20:43.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.151+0000 7fc03cca8640 1 -- 172.21.15.135:0/2723015483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc038108180 con 0x7fc038102090 2024-04-20T12:20:43.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.152+0000 7fc0277fe640 1 -- 172.21.15.135:0/2723015483 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fc02c044070 con 0x7fc038102090 2024-04-20T12:20:43.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.152+0000 7fc0277fe640 1 --2- 172.21.15.135:0/2723015483 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc0200a3bb0 0x7fc0200a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:43.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.153+0000 7fc03659c640 1 --2- 172.21.15.135:0/2723015483 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc0200a3bb0 0x7fc0200a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:43.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.153+0000 7fc0277fe640 1 -- 172.21.15.135:0/2723015483 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8277+0+0 (secure 0 0 0) 0x7fc02c0f2110 con 0x7fc038102090 2024-04-20T12:20:43.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.153+0000 7fc03659c640 1 --2- 172.21.15.135:0/2723015483 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc0200a3bb0 0x7fc0200a6070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc028009990 tx=0x7fc028009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:43.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.157+0000 7fc0277fe640 1 -- 172.21.15.135:0/2723015483 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fc02c0beac0 con 0x7fc038102090 2024-04-20T12:20:43.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:43 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/137924658' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-20T12:20:43.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:43 smithi139 ceph-mon[21834]: osdmap e84: 12 total, 12 up, 12 in 2024-04-20T12:20:43.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:43 smithi139 ceph-mon[21834]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-04-20T12:20:43.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:43 smithi139 ceph-mon[21834]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-04-20T12:20:43.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:43 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/596523264' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-04-20T12:20:43.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:43 smithi139 ceph-mon[21834]: pgmap v287: 97 pgs: 25 creating+peering, 30 active+clean, 42 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-20T12:20:43.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:43.340+0000 7fc03cca8640 1 -- 172.21.15.135:0/2723015483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc03802d5d0 con 0x7fc038102090 2024-04-20T12:20:43.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:43 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/137924658' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-20T12:20:43.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:43 smithi135 ceph-mon[18264]: osdmap e84: 12 total, 12 up, 12 in 2024-04-20T12:20:43.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:43 smithi135 ceph-mon[18264]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-04-20T12:20:43.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:43 smithi135 ceph-mon[18264]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-04-20T12:20:43.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:43 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/596523264' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-04-20T12:20:43.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:43 smithi135 ceph-mon[18264]: pgmap v287: 97 pgs: 25 creating+peering, 30 active+clean, 42 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-20T12:20:43.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:43 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/137924658' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-04-20T12:20:43.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:43 smithi154 ceph-mon[22073]: osdmap e84: 12 total, 12 up, 12 in 2024-04-20T12:20:43.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:43 smithi154 ceph-mon[22073]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-04-20T12:20:43.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:43 smithi154 ceph-mon[22073]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-04-20T12:20:43.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:43 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/596523264' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-04-20T12:20:43.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:43 smithi154 ceph-mon[22073]: pgmap v287: 97 pgs: 25 creating+peering, 30 active+clean, 42 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 0 op/s 2024-04-20T12:20:44.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:44 smithi139 ceph-mon[21834]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-20T12:20:44.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:44 smithi139 ceph-mon[21834]: Cluster is now healthy 2024-04-20T12:20:44.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:44 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/596523264' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-04-20T12:20:44.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:44 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] up:active 2024-04-20T12:20:44.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:44 smithi139 ceph-mon[21834]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-20T12:20:44.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:44 smithi139 ceph-mon[21834]: osdmap e85: 12 total, 12 up, 12 in 2024-04-20T12:20:44.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:44 smithi139 ceph-mon[21834]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-20T12:20:44.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:44 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2723015483' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-20T12:20:44.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:44 smithi135 ceph-mon[18264]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-20T12:20:44.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:44 smithi135 ceph-mon[18264]: Cluster is now healthy 2024-04-20T12:20:44.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:44 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/596523264' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-04-20T12:20:44.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:44 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] up:active 2024-04-20T12:20:44.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:44 smithi135 ceph-mon[18264]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-20T12:20:44.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:44 smithi135 ceph-mon[18264]: osdmap e85: 12 total, 12 up, 12 in 2024-04-20T12:20:44.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:44 smithi135 ceph-mon[18264]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-20T12:20:44.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:44 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2723015483' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-20T12:20:44.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:44 smithi154 ceph-mon[22073]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-20T12:20:44.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:44 smithi154 ceph-mon[22073]: Cluster is now healthy 2024-04-20T12:20:44.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:44 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/596523264' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-04-20T12:20:44.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:44 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] up:active 2024-04-20T12:20:44.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:44 smithi154 ceph-mon[22073]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-20T12:20:44.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:44 smithi154 ceph-mon[22073]: osdmap e85: 12 total, 12 up, 12 in 2024-04-20T12:20:44.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:44 smithi154 ceph-mon[22073]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-20T12:20:44.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:44 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2723015483' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-04-20T12:20:45.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.302+0000 7fc0277fe640 1 -- 172.21.15.135:0/2723015483 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v87) ==== 228+0+0 (secure 0 0 0) 0x7fc02c003e20 con 0x7fc038102090 2024-04-20T12:20:45.302 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data_ec' created 2024-04-20T12:20:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.306+0000 7fc03cca8640 1 -- 172.21.15.135:0/2723015483 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc0200a3bb0 msgr2=0x7fc0200a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.306+0000 7fc03cca8640 1 --2- 172.21.15.135:0/2723015483 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc0200a3bb0 0x7fc0200a6070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc028009990 tx=0x7fc028009110 comp rx=0 tx=0).stop 2024-04-20T12:20:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.306+0000 7fc03cca8640 1 -- 172.21.15.135:0/2723015483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc038102090 msgr2=0x7fc038198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.306+0000 7fc03cca8640 1 --2- 172.21.15.135:0/2723015483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc038102090 0x7fc038198870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc02c000c00 tx=0x7fc02c004040 comp rx=0 tx=0).stop 2024-04-20T12:20:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.306+0000 7fc03cca8640 1 -- 172.21.15.135:0/2723015483 shutdown_connections 2024-04-20T12:20:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.306+0000 7fc03cca8640 1 --2- 172.21.15.135:0/2723015483 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fc0200a3bb0 0x7fc0200a6070 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.306+0000 7fc03cca8640 1 --2- 172.21.15.135:0/2723015483 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc038102a50 0x7fc03819f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.306+0000 7fc03cca8640 1 --2- 172.21.15.135:0/2723015483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc038102090 0x7fc038198870 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.306+0000 7fc03cca8640 1 --2- 172.21.15.135:0/2723015483 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc038100f40 0x7fc038198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.306+0000 7fc03cca8640 1 -- 172.21.15.135:0/2723015483 >> 172.21.15.135:0/2723015483 conn(0x7fc0380fc4b0 msgr2=0x7fc038105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.306+0000 7fc03cca8640 1 -- 172.21.15.135:0/2723015483 shutdown_connections 2024-04-20T12:20:45.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.306+0000 7fc03cca8640 1 -- 172.21.15.135:0/2723015483 wait complete. 2024-04-20T12:20:45.324 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-20T12:20:45.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.431+0000 7fb866bfd640 1 -- 172.21.15.135:0/3849298678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860103180 msgr2=0x7fb860103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:45.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.431+0000 7fb866bfd640 1 --2- 172.21.15.135:0/3849298678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860103180 0x7fb860103600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009900 tx=0x7fb84c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:45.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.431+0000 7fb866bfd640 1 -- 172.21.15.135:0/3849298678 shutdown_connections 2024-04-20T12:20:45.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.431+0000 7fb866bfd640 1 --2- 172.21.15.135:0/3849298678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb860103b40 0x7fb86010a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:45.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.431+0000 7fb866bfd640 1 --2- 172.21.15.135:0/3849298678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860103180 0x7fb860103600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:45.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.431+0000 7fb866bfd640 1 --2- 172.21.15.135:0/3849298678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb860101f90 0x7fb8601023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:45.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.431+0000 7fb866bfd640 1 -- 172.21.15.135:0/3849298678 >> 172.21.15.135:0/3849298678 conn(0x7fb8600fd520 msgr2=0x7fb8600ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:45.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.431+0000 7fb866bfd640 1 -- 172.21.15.135:0/3849298678 shutdown_connections 2024-04-20T12:20:45.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.431+0000 7fb866bfd640 1 -- 172.21.15.135:0/3849298678 wait complete. 2024-04-20T12:20:45.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb866bfd640 1 Processor -- start 2024-04-20T12:20:45.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb866bfd640 1 -- start start 2024-04-20T12:20:45.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb866bfd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb860101f90 0x7fb860198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:45.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb866bfd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860103180 0x7fb860198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:45.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb866bfd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb860103b40 0x7fb86019f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:45.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb866bfd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb86010dc20 con 0x7fb860103180 2024-04-20T12:20:45.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb866bfd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb86010daa0 con 0x7fb860103b40 2024-04-20T12:20:45.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb866bfd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb86010dda0 con 0x7fb860101f90 2024-04-20T12:20:45.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb85ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860103180 0x7fb860198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:45.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb85ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860103180 0x7fb860198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52060/0 (socket says 172.21.15.135:52060) 2024-04-20T12:20:45.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb85ffff640 1 -- 172.21.15.135:0/116121777 learned_addr learned my addr 172.21.15.135:0/116121777 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:45.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb86519a640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb860103b40 0x7fb86019f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:45.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb864999640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb860101f90 0x7fb860198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:45.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb85ffff640 1 -- 172.21.15.135:0/116121777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb860101f90 msgr2=0x7fb860198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:45.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb85ffff640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb860101f90 0x7fb860198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:45.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb85ffff640 1 -- 172.21.15.135:0/116121777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb860103b40 msgr2=0x7fb86019f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:45.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb85ffff640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb860103b40 0x7fb86019f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:45.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb85ffff640 1 -- 172.21.15.135:0/116121777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86019fe30 con 0x7fb860103180 2024-04-20T12:20:45.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb86519a640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb860103b40 0x7fb86019f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:20:45.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb864999640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb860101f90 0x7fb860198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:20:45.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.432+0000 7fb85ffff640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860103180 0x7fb860198750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009230 tx=0x7fb84c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:45.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.433+0000 7fb85dffb640 1 -- 172.21.15.135:0/116121777 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c041070 con 0x7fb860103180 2024-04-20T12:20:45.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.433+0000 7fb866bfd640 1 -- 172.21.15.135:0/116121777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8601a00c0 con 0x7fb860103180 2024-04-20T12:20:45.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.433+0000 7fb85dffb640 1 -- 172.21.15.135:0/116121777 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb84c0054e0 con 0x7fb860103180 2024-04-20T12:20:45.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.433+0000 7fb85dffb640 1 -- 172.21.15.135:0/116121777 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c034440 con 0x7fb860103180 2024-04-20T12:20:45.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.433+0000 7fb866bfd640 1 -- 172.21.15.135:0/116121777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8601a05b0 con 0x7fb860103180 2024-04-20T12:20:45.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.434+0000 7fb866bfd640 1 -- 172.21.15.135:0/116121777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb860109250 con 0x7fb860103180 2024-04-20T12:20:45.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.435+0000 7fb85dffb640 1 -- 172.21.15.135:0/116121777 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fb84c044070 con 0x7fb860103180 2024-04-20T12:20:45.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.436+0000 7fb85dffb640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb8500a3bb0 0x7fb8500a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:45.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.436+0000 7fb864999640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb8500a3bb0 0x7fb8500a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:45.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.436+0000 7fb85dffb640 1 -- 172.21.15.135:0/116121777 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8770+0+0 (secure 0 0 0) 0x7fb84c0f27a0 con 0x7fb860103180 2024-04-20T12:20:45.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.436+0000 7fb864999640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb8500a3bb0 0x7fb8500a6070 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb860102fe0 tx=0x7fb854005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:45.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.440+0000 7fb85dffb640 1 -- 172.21.15.135:0/116121777 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fb84c0bef60 con 0x7fb860103180 2024-04-20T12:20:45.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:45 smithi139 ceph-mon[21834]: osdmap e86: 12 total, 12 up, 12 in 2024-04-20T12:20:45.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:45 smithi139 ceph-mon[21834]: pgmap v290: 97 pgs: 25 creating+peering, 66 active+clean, 6 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-04-20T12:20:45.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:45 smithi135 ceph-mon[18264]: osdmap e86: 12 total, 12 up, 12 in 2024-04-20T12:20:45.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:45 smithi135 ceph-mon[18264]: pgmap v290: 97 pgs: 25 creating+peering, 66 active+clean, 6 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-04-20T12:20:45.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:45.616+0000 7fb866bfd640 1 -- 172.21.15.135:0/116121777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fb86002d5d0 con 0x7fb860103180 2024-04-20T12:20:45.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:45 smithi154 ceph-mon[22073]: osdmap e86: 12 total, 12 up, 12 in 2024-04-20T12:20:45.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:45 smithi154 ceph-mon[22073]: pgmap v290: 97 pgs: 25 creating+peering, 66 active+clean, 6 unknown; 577 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-04-20T12:20:46.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.304+0000 7fb85dffb640 1 -- 172.21.15.135:0/116121777 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v88) ==== 169+0+0 (secure 0 0 0) 0x7fb84c0be860 con 0x7fb860103180 2024-04-20T12:20:46.304 INFO:teuthology.orchestra.run.smithi135.stderr:set pool 4 allow_ec_overwrites to true 2024-04-20T12:20:46.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.307+0000 7fb866bfd640 1 -- 172.21.15.135:0/116121777 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb8500a3bb0 msgr2=0x7fb8500a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:46.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.307+0000 7fb866bfd640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb8500a3bb0 0x7fb8500a6070 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb860102fe0 tx=0x7fb854005e70 comp rx=0 tx=0).stop 2024-04-20T12:20:46.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.307+0000 7fb866bfd640 1 -- 172.21.15.135:0/116121777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860103180 msgr2=0x7fb860198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:46.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.307+0000 7fb866bfd640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860103180 0x7fb860198750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb84c009230 tx=0x7fb84c005dd0 comp rx=0 tx=0).stop 2024-04-20T12:20:46.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.308+0000 7fb866bfd640 1 -- 172.21.15.135:0/116121777 shutdown_connections 2024-04-20T12:20:46.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.308+0000 7fb866bfd640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb8500a3bb0 0x7fb8500a6070 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:46.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.308+0000 7fb866bfd640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb860103b40 0x7fb86019f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:46.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.308+0000 7fb866bfd640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb860103180 0x7fb860198750 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:46.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.308+0000 7fb866bfd640 1 --2- 172.21.15.135:0/116121777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb860101f90 0x7fb860198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:46.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.308+0000 7fb866bfd640 1 -- 172.21.15.135:0/116121777 >> 172.21.15.135:0/116121777 conn(0x7fb8600fd520 msgr2=0x7fb860106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:46.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.308+0000 7fb866bfd640 1 -- 172.21.15.135:0/116121777 shutdown_connections 2024-04-20T12:20:46.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.309+0000 7fb866bfd640 1 -- 172.21.15.135:0/116121777 wait complete. 2024-04-20T12:20:46.330 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-20T12:20:46.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 -- 172.21.15.135:0/2476841756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8c100e70 msgr2=0x7f1b8c101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:46.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 --2- 172.21.15.135:0/2476841756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8c100e70 0x7f1b8c101290 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009ca0 tx=0x7f1b8402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:46.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 -- 172.21.15.135:0/2476841756 shutdown_connections 2024-04-20T12:20:46.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 --2- 172.21.15.135:0/2476841756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b8c102a10 0x7f1b8c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:46.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 --2- 172.21.15.135:0/2476841756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b8c102050 0x7f1b8c1024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:46.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 --2- 172.21.15.135:0/2476841756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8c100e70 0x7f1b8c101290 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:46.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 -- 172.21.15.135:0/2476841756 >> 172.21.15.135:0/2476841756 conn(0x7f1b8c0fc450 msgr2=0x7f1b8c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:46.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 -- 172.21.15.135:0/2476841756 shutdown_connections 2024-04-20T12:20:46.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 -- 172.21.15.135:0/2476841756 wait complete. 2024-04-20T12:20:46.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 Processor -- start 2024-04-20T12:20:46.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 -- start start 2024-04-20T12:20:46.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b8c100e70 0x7f1b8c06b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:46.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8c102050 0x7f1b8c19d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:46.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b8c102a10 0x7f1b8c19f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:46.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c10cb50 con 0x7f1b8c102050 2024-04-20T12:20:46.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c10c9d0 con 0x7f1b8c100e70 2024-04-20T12:20:46.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.433+0000 7f1b91985640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c10ccd0 con 0x7f1b8c102a10 2024-04-20T12:20:46.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b8a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8c102050 0x7f1b8c19d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:46.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b8affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b8c100e70 0x7f1b8c06b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:46.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b8a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8c102050 0x7f1b8c19d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52078/0 (socket says 172.21.15.135:52078) 2024-04-20T12:20:46.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b8a7fc640 1 -- 172.21.15.135:0/3772770859 learned_addr learned my addr 172.21.15.135:0/3772770859 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:46.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b8b7fe640 1 --2- 172.21.15.135:0/3772770859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b8c102a10 0x7f1b8c19f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:46.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b8a7fc640 1 -- 172.21.15.135:0/3772770859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b8c102a10 msgr2=0x7f1b8c19f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:46.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b8a7fc640 1 --2- 172.21.15.135:0/3772770859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b8c102a10 0x7f1b8c19f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:46.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b8a7fc640 1 -- 172.21.15.135:0/3772770859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b8c100e70 msgr2=0x7f1b8c06b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:46.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b8a7fc640 1 --2- 172.21.15.135:0/3772770859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b8c100e70 0x7f1b8c06b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:46.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b8a7fc640 1 -- 172.21.15.135:0/3772770859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8c19ff50 con 0x7f1b8c102050 2024-04-20T12:20:46.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b8a7fc640 1 --2- 172.21.15.135:0/3772770859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8c102050 0x7f1b8c19d050 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400e9f0 tx=0x7f1b7400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:46.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b90983640 1 -- 172.21.15.135:0/3772770859 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7400cd80 con 0x7f1b8c102050 2024-04-20T12:20:46.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b91985640 1 -- 172.21.15.135:0/3772770859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8c1a0240 con 0x7f1b8c102050 2024-04-20T12:20:46.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b90983640 1 -- 172.21.15.135:0/3772770859 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b74005500 con 0x7f1b8c102050 2024-04-20T12:20:46.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b90983640 1 -- 172.21.15.135:0/3772770859 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74010690 con 0x7f1b8c102050 2024-04-20T12:20:46.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.434+0000 7f1b91985640 1 -- 172.21.15.135:0/3772770859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8c1a0740 con 0x7f1b8c102050 2024-04-20T12:20:46.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.435+0000 7f1b91985640 1 -- 172.21.15.135:0/3772770859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b8c108260 con 0x7f1b8c102050 2024-04-20T12:20:46.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.436+0000 7f1b90983640 1 -- 172.21.15.135:0/3772770859 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f1b740046c0 con 0x7f1b8c102050 2024-04-20T12:20:46.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.437+0000 7f1b90983640 1 --2- 172.21.15.135:0/3772770859 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1b780a3bb0 0x7f1b780a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:46.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.437+0000 7f1b8affd640 1 --2- 172.21.15.135:0/3772770859 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1b780a3bb0 0x7f1b780a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:46.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.437+0000 7f1b90983640 1 -- 172.21.15.135:0/3772770859 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8770+0+0 (secure 0 0 0) 0x7f1b740d0a20 con 0x7f1b8c102050 2024-04-20T12:20:46.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.437+0000 7f1b8affd640 1 --2- 172.21.15.135:0/3772770859 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1b780a3bb0 0x7f1b780a6070 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1b8402c700 tx=0x7f1b84032590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:46.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.441+0000 7f1b90983640 1 -- 172.21.15.135:0/3772770859 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f1b7409d1e0 con 0x7f1b8c102050 2024-04-20T12:20:46.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:46 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2723015483' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-20T12:20:46.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:46 smithi139 ceph-mon[21834]: osdmap e87: 12 total, 12 up, 12 in 2024-04-20T12:20:46.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:46 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/116121777' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-04-20T12:20:46.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:46 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2723015483' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-20T12:20:46.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:46 smithi135 ceph-mon[18264]: osdmap e87: 12 total, 12 up, 12 in 2024-04-20T12:20:46.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:46 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/116121777' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-04-20T12:20:46.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:46 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2723015483' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-04-20T12:20:46.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:46 smithi154 ceph-mon[22073]: osdmap e87: 12 total, 12 up, 12 in 2024-04-20T12:20:46.653 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:46 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/116121777' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-04-20T12:20:46.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:46.661+0000 7f1b91985640 1 -- 172.21.15.135:0/3772770859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f1b8c062b60 con 0x7f1b8c102050 2024-04-20T12:20:47.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.319+0000 7f1b90983640 1 -- 172.21.15.135:0/3772770859 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f1b7409cae0 con 0x7f1b8c102050 2024-04-20T12:20:47.319 INFO:teuthology.orchestra.run.smithi135.stderr:added data pool 4 to fsmap 2024-04-20T12:20:47.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.322+0000 7f1b91985640 1 -- 172.21.15.135:0/3772770859 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1b780a3bb0 msgr2=0x7f1b780a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:47.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.322+0000 7f1b91985640 1 --2- 172.21.15.135:0/3772770859 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1b780a3bb0 0x7f1b780a6070 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1b8402c700 tx=0x7f1b84032590 comp rx=0 tx=0).stop 2024-04-20T12:20:47.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.322+0000 7f1b91985640 1 -- 172.21.15.135:0/3772770859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8c102050 msgr2=0x7f1b8c19d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:47.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.322+0000 7f1b91985640 1 --2- 172.21.15.135:0/3772770859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8c102050 0x7f1b8c19d050 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400e9f0 tx=0x7f1b7400edf0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.322+0000 7f1b91985640 1 -- 172.21.15.135:0/3772770859 shutdown_connections 2024-04-20T12:20:47.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.322+0000 7f1b91985640 1 --2- 172.21.15.135:0/3772770859 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1b780a3bb0 0x7f1b780a6070 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.322+0000 7f1b91985640 1 --2- 172.21.15.135:0/3772770859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b8c102a10 0x7f1b8c19f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.322+0000 7f1b91985640 1 --2- 172.21.15.135:0/3772770859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8c102050 0x7f1b8c19d050 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.322+0000 7f1b91985640 1 --2- 172.21.15.135:0/3772770859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1b8c100e70 0x7f1b8c06b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.322+0000 7f1b91985640 1 -- 172.21.15.135:0/3772770859 >> 172.21.15.135:0/3772770859 conn(0x7f1b8c0fc450 msgr2=0x7f1b8c105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:47.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.322+0000 7f1b91985640 1 -- 172.21.15.135:0/3772770859 shutdown_connections 2024-04-20T12:20:47.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.322+0000 7f1b91985640 1 -- 172.21.15.135:0/3772770859 wait complete. 2024-04-20T12:20:47.336 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:47.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.441+0000 7f6064db6640 1 -- 172.21.15.135:0/708074455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6060100ea0 msgr2=0x7f60601012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:47.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.441+0000 7f6064db6640 1 --2- 172.21.15.135:0/708074455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6060100ea0 0x7f60601012c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6054009900 tx=0x7f605402bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:47.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.441+0000 7f6064db6640 1 -- 172.21.15.135:0/708074455 shutdown_connections 2024-04-20T12:20:47.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.441+0000 7f6064db6640 1 --2- 172.21.15.135:0/708074455 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60601029b0 0x7f60601092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.441+0000 7f6064db6640 1 --2- 172.21.15.135:0/708074455 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6060101ff0 0x7f6060102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.441+0000 7f6064db6640 1 --2- 172.21.15.135:0/708074455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6060100ea0 0x7f60601012c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.441+0000 7f6064db6640 1 -- 172.21.15.135:0/708074455 >> 172.21.15.135:0/708074455 conn(0x7f60600fc410 msgr2=0x7f60600fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:47.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.441+0000 7f6064db6640 1 -- 172.21.15.135:0/708074455 shutdown_connections 2024-04-20T12:20:47.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.441+0000 7f6064db6640 1 -- 172.21.15.135:0/708074455 wait complete. 2024-04-20T12:20:47.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f6064db6640 1 Processor -- start 2024-04-20T12:20:47.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f6064db6640 1 -- start start 2024-04-20T12:20:47.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f6064db6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6060100ea0 0x7f6060069c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:47.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f6064db6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6060101ff0 0x7f606019cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:47.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f6064db6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60601029b0 0x7f606019f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:47.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f6064db6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f606010cba0 con 0x7f6060100ea0 2024-04-20T12:20:47.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f6064db6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f606010ca20 con 0x7f60601029b0 2024-04-20T12:20:47.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f6064db6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f606010cd20 con 0x7f6060101ff0 2024-04-20T12:20:47.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f605e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6060100ea0 0x7f6060069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:47.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f605e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6060100ea0 0x7f6060069c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52096/0 (socket says 172.21.15.135:52096) 2024-04-20T12:20:47.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f605e59c640 1 -- 172.21.15.135:0/4165499397 learned_addr learned my addr 172.21.15.135:0/4165499397 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:47.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f605dd9b640 1 --2- 172.21.15.135:0/4165499397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6060101ff0 0x7f606019cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:47.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f605e59c640 1 -- 172.21.15.135:0/4165499397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6060101ff0 msgr2=0x7f606019cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:47.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f605e59c640 1 --2- 172.21.15.135:0/4165499397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6060101ff0 0x7f606019cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f605e59c640 1 -- 172.21.15.135:0/4165499397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60601029b0 msgr2=0x7f606019f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:47.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f605e59c640 1 --2- 172.21.15.135:0/4165499397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60601029b0 0x7f606019f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f605e59c640 1 -- 172.21.15.135:0/4165499397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606019fee0 con 0x7f6060100ea0 2024-04-20T12:20:47.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.442+0000 7f605e59c640 1 --2- 172.21.15.135:0/4165499397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6060100ea0 0x7f6060069c80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6054009230 tx=0x7f6054004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:47.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.443+0000 7f604f7fe640 1 -- 172.21.15.135:0/4165499397 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054041070 con 0x7f6060100ea0 2024-04-20T12:20:47.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.443+0000 7f604f7fe640 1 -- 172.21.15.135:0/4165499397 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60540054e0 con 0x7f6060100ea0 2024-04-20T12:20:47.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.443+0000 7f6064db6640 1 -- 172.21.15.135:0/4165499397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60601a0170 con 0x7f6060100ea0 2024-04-20T12:20:47.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.443+0000 7f604f7fe640 1 -- 172.21.15.135:0/4165499397 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60540346a0 con 0x7f6060100ea0 2024-04-20T12:20:47.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.443+0000 7f6064db6640 1 -- 172.21.15.135:0/4165499397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60601a0660 con 0x7f6060100ea0 2024-04-20T12:20:47.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.444+0000 7f6064db6640 1 -- 172.21.15.135:0/4165499397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6060108150 con 0x7f6060100ea0 2024-04-20T12:20:47.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.445+0000 7f604f7fe640 1 -- 172.21.15.135:0/4165499397 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f6054044070 con 0x7f6060100ea0 2024-04-20T12:20:47.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.445+0000 7f604f7fe640 1 --2- 172.21.15.135:0/4165499397 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f60480a3bb0 0x7f60480a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:47.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.446+0000 7f605dd9b640 1 --2- 172.21.15.135:0/4165499397 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f60480a3bb0 0x7f60480a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:47.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.446+0000 7f604f7fe640 1 -- 172.21.15.135:0/4165499397 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f60540f2830 con 0x7f6060100ea0 2024-04-20T12:20:47.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.446+0000 7f605dd9b640 1 --2- 172.21.15.135:0/4165499397 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f60480a3bb0 0x7f60480a6070 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f60500058c0 tx=0x7f6050005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:47.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.449+0000 7f604f7fe640 1 -- 172.21.15.135:0/4165499397 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f60540befd0 con 0x7f6060100ea0 2024-04-20T12:20:47.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:47 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/116121777' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-04-20T12:20:47.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:47 smithi139 ceph-mon[21834]: osdmap e88: 12 total, 12 up, 12 in 2024-04-20T12:20:47.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:47 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3772770859' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-04-20T12:20:47.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:47 smithi139 ceph-mon[21834]: pgmap v293: 129 pgs: 1 creating+activating, 15 creating+peering, 87 active+clean, 26 unknown; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 7 op/s 2024-04-20T12:20:47.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:47 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/116121777' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-04-20T12:20:47.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:47 smithi135 ceph-mon[18264]: osdmap e88: 12 total, 12 up, 12 in 2024-04-20T12:20:47.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:47 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3772770859' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-04-20T12:20:47.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:47 smithi135 ceph-mon[18264]: pgmap v293: 129 pgs: 1 creating+activating, 15 creating+peering, 87 active+clean, 26 unknown; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 7 op/s 2024-04-20T12:20:47.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.665+0000 7f6064db6640 1 -- 172.21.15.135:0/4165499397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f606002d5d0 con 0x7f6060100ea0 2024-04-20T12:20:47.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.666+0000 7f604f7fe640 1 -- 172.21.15.135:0/4165499397 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11839 (secure 0 0 0) 0x7f60540be8d0 con 0x7f6060100ea0 2024-04-20T12:20:47.666 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:47.667 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:20:46.663485+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24490,"qdb_cluster":[24490]},"id":1}]} 2024-04-20T12:20:47.667 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 17 2024-04-20T12:20:47.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.668+0000 7f6064db6640 1 -- 172.21.15.135:0/4165499397 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f60480a3bb0 msgr2=0x7f60480a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:47.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.668+0000 7f6064db6640 1 --2- 172.21.15.135:0/4165499397 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f60480a3bb0 0x7f60480a6070 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f60500058c0 tx=0x7f6050005850 comp rx=0 tx=0).stop 2024-04-20T12:20:47.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.668+0000 7f6064db6640 1 -- 172.21.15.135:0/4165499397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6060100ea0 msgr2=0x7f6060069c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:47.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.668+0000 7f6064db6640 1 --2- 172.21.15.135:0/4165499397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6060100ea0 0x7f6060069c80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6054009230 tx=0x7f6054004040 comp rx=0 tx=0).stop 2024-04-20T12:20:47.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.668+0000 7f6064db6640 1 -- 172.21.15.135:0/4165499397 shutdown_connections 2024-04-20T12:20:47.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.668+0000 7f6064db6640 1 --2- 172.21.15.135:0/4165499397 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f60480a3bb0 0x7f60480a6070 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.668+0000 7f6064db6640 1 --2- 172.21.15.135:0/4165499397 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60601029b0 0x7f606019f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.668+0000 7f6064db6640 1 --2- 172.21.15.135:0/4165499397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6060101ff0 0x7f606019cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.668+0000 7f6064db6640 1 --2- 172.21.15.135:0/4165499397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6060100ea0 0x7f6060069c80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.668+0000 7f6064db6640 1 -- 172.21.15.135:0/4165499397 >> 172.21.15.135:0/4165499397 conn(0x7f60600fc410 msgr2=0x7f6060105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:47.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.668+0000 7f6064db6640 1 -- 172.21.15.135:0/4165499397 shutdown_connections 2024-04-20T12:20:47.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.668+0000 7f6064db6640 1 -- 172.21.15.135:0/4165499397 wait complete. 2024-04-20T12:20:47.673 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:47 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/116121777' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-04-20T12:20:47.673 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:47 smithi154 ceph-mon[22073]: osdmap e88: 12 total, 12 up, 12 in 2024-04-20T12:20:47.673 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:47 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3772770859' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-04-20T12:20:47.673 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:47 smithi154 ceph-mon[22073]: pgmap v293: 129 pgs: 1 creating+activating, 15 creating+peering, 87 active+clean, 26 unknown; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 7 op/s 2024-04-20T12:20:47.680 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:20:47.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.778+0000 7f9531655640 1 -- 172.21.15.135:0/3337974065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f952c101ff0 msgr2=0x7f952c102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:47.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.778+0000 7f9531655640 1 --2- 172.21.15.135:0/3337974065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f952c101ff0 0x7f952c102470 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9514009900 tx=0x7f951402bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:47.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.778+0000 7f9531655640 1 -- 172.21.15.135:0/3337974065 shutdown_connections 2024-04-20T12:20:47.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.778+0000 7f9531655640 1 --2- 172.21.15.135:0/3337974065 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952c1029b0 0x7f952c1092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.778+0000 7f9531655640 1 --2- 172.21.15.135:0/3337974065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f952c101ff0 0x7f952c102470 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.778+0000 7f9531655640 1 --2- 172.21.15.135:0/3337974065 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f952c100ea0 0x7f952c1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.778+0000 7f9531655640 1 -- 172.21.15.135:0/3337974065 >> 172.21.15.135:0/3337974065 conn(0x7f952c0fc410 msgr2=0x7f952c0fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:47.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.778+0000 7f9531655640 1 -- 172.21.15.135:0/3337974065 shutdown_connections 2024-04-20T12:20:47.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.778+0000 7f9531655640 1 -- 172.21.15.135:0/3337974065 wait complete. 2024-04-20T12:20:47.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f9531655640 1 Processor -- start 2024-04-20T12:20:47.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f9531655640 1 -- start start 2024-04-20T12:20:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f9531655640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f952c100ea0 0x7f952c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f9531655640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952c101ff0 0x7f952c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f9531655640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f952c1029b0 0x7f952c19f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f9531655640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f952c10cb40 con 0x7f952c1029b0 2024-04-20T12:20:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f9531655640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f952c10c9c0 con 0x7f952c100ea0 2024-04-20T12:20:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f9531655640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f952c10ccc0 con 0x7f952c101ff0 2024-04-20T12:20:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f952b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f952c1029b0 0x7f952c19f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f952b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f952c1029b0 0x7f952c19f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52102/0 (socket says 172.21.15.135:52102) 2024-04-20T12:20:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f952b7fe640 1 -- 172.21.15.135:0/1232124178 learned_addr learned my addr 172.21.15.135:0/1232124178 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f95227fc640 1 --2- 172.21.15.135:0/1232124178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952c101ff0 0x7f952c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:47.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f952b7fe640 1 -- 172.21.15.135:0/1232124178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952c101ff0 msgr2=0x7f952c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f952b7fe640 1 --2- 172.21.15.135:0/1232124178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952c101ff0 0x7f952c198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f952b7fe640 1 -- 172.21.15.135:0/1232124178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f952c100ea0 msgr2=0x7f952c1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f952b7fe640 1 --2- 172.21.15.135:0/1232124178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f952c100ea0 0x7f952c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f952b7fe640 1 -- 172.21.15.135:0/1232124178 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c19ff00 con 0x7f952c1029b0 2024-04-20T12:20:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.779+0000 7f952b7fe640 1 --2- 172.21.15.135:0/1232124178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f952c1029b0 0x7f952c19f890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f952400eaa0 tx=0x7f952400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.780+0000 7f9528ff9640 1 -- 172.21.15.135:0/1232124178 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952400cdb0 con 0x7f952c1029b0 2024-04-20T12:20:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.780+0000 7f9531655640 1 -- 172.21.15.135:0/1232124178 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952c1a01f0 con 0x7f952c1029b0 2024-04-20T12:20:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.780+0000 7f9528ff9640 1 -- 172.21.15.135:0/1232124178 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9524005020 con 0x7f952c1029b0 2024-04-20T12:20:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.780+0000 7f9528ff9640 1 -- 172.21.15.135:0/1232124178 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95240116d0 con 0x7f952c1029b0 2024-04-20T12:20:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.780+0000 7f9531655640 1 -- 172.21.15.135:0/1232124178 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952c1a0710 con 0x7f952c1029b0 2024-04-20T12:20:47.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.781+0000 7f9531655640 1 -- 172.21.15.135:0/1232124178 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952c1a09d0 con 0x7f952c1029b0 2024-04-20T12:20:47.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.782+0000 7f9528ff9640 1 -- 172.21.15.135:0/1232124178 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f95240054d0 con 0x7f952c1029b0 2024-04-20T12:20:47.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.782+0000 7f9528ff9640 1 --2- 172.21.15.135:0/1232124178 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f95180a3bb0 0x7f95180a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:47.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.782+0000 7f952affd640 1 --2- 172.21.15.135:0/1232124178 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f95180a3bb0 0x7f95180a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:47.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.783+0000 7f9528ff9640 1 -- 172.21.15.135:0/1232124178 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7f95240d0c30 con 0x7f952c1029b0 2024-04-20T12:20:47.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.783+0000 7f952affd640 1 --2- 172.21.15.135:0/1232124178 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f95180a3bb0 0x7f95180a6070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f951c005fd0 tx=0x7f951c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:47.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.786+0000 7f9528ff9640 1 -- 172.21.15.135:0/1232124178 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f9524016030 con 0x7f952c1029b0 2024-04-20T12:20:47.933 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:20:47 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i[52605]: 2024-04-20T12:20:47.895+0000 7fd893c5c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T12:20:47.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.967+0000 7f9531655640 1 -- 172.21.15.135:0/1232124178 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f952c1a0ba0 con 0x7f952c1029b0 2024-04-20T12:20:47.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.969+0000 7f9528ff9640 1 -- 172.21.15.135:0/1232124178 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24186 (secure 0 0 0) 0x7f952409d3d0 con 0x7f952c1029b0 2024-04-20T12:20:47.970 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:47.970 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":89,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:20:46.663279+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:20:47.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.972+0000 7f9531655640 1 -- 172.21.15.135:0/1232124178 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f95180a3bb0 msgr2=0x7f95180a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:47.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.972+0000 7f9531655640 1 --2- 172.21.15.135:0/1232124178 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f95180a3bb0 0x7f95180a6070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f951c005fd0 tx=0x7f951c005850 comp rx=0 tx=0).stop 2024-04-20T12:20:47.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.972+0000 7f9531655640 1 -- 172.21.15.135:0/1232124178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f952c1029b0 msgr2=0x7f952c19f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:47.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.972+0000 7f9531655640 1 --2- 172.21.15.135:0/1232124178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f952c1029b0 0x7f952c19f890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f952400eaa0 tx=0x7f952400ef60 comp rx=0 tx=0).stop 2024-04-20T12:20:47.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.972+0000 7f9531655640 1 -- 172.21.15.135:0/1232124178 shutdown_connections 2024-04-20T12:20:47.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.972+0000 7f9531655640 1 --2- 172.21.15.135:0/1232124178 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f95180a3bb0 0x7f95180a6070 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.972+0000 7f9531655640 1 --2- 172.21.15.135:0/1232124178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f952c1029b0 0x7f952c19f890 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.972+0000 7f9531655640 1 --2- 172.21.15.135:0/1232124178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f952c101ff0 0x7f952c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.972+0000 7f9531655640 1 --2- 172.21.15.135:0/1232124178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f952c100ea0 0x7f952c1982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:47.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.972+0000 7f9531655640 1 -- 172.21.15.135:0/1232124178 >> 172.21.15.135:0/1232124178 conn(0x7f952c0fc410 msgr2=0x7f952c0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:47.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.972+0000 7f9531655640 1 -- 172.21.15.135:0/1232124178 shutdown_connections 2024-04-20T12:20:47.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:47.972+0000 7f9531655640 1 -- 172.21.15.135:0/1232124178 wait complete. 2024-04-20T12:20:47.985 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:20:48.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.085+0000 7fa8598fd640 1 -- 172.21.15.135:0/3387783045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa854105360 msgr2=0x7fa854107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:48.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.085+0000 7fa8598fd640 1 --2- 172.21.15.135:0/3387783045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa854105360 0x7fa854107750 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa848009900 tx=0x7fa84802bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:48.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.085+0000 7fa8598fd640 1 -- 172.21.15.135:0/3387783045 shutdown_connections 2024-04-20T12:20:48.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.085+0000 7fa8598fd640 1 --2- 172.21.15.135:0/3387783045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa854107c90 0x7fa85410a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.085+0000 7fa8598fd640 1 --2- 172.21.15.135:0/3387783045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa854105360 0x7fa854107750 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.085+0000 7fa8598fd640 1 --2- 172.21.15.135:0/3387783045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa854102a30 0x7fa854104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.085+0000 7fa8598fd640 1 -- 172.21.15.135:0/3387783045 >> 172.21.15.135:0/3387783045 conn(0x7fa8540fc440 msgr2=0x7fa8540fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:48.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.085+0000 7fa8598fd640 1 -- 172.21.15.135:0/3387783045 shutdown_connections 2024-04-20T12:20:48.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.085+0000 7fa8598fd640 1 -- 172.21.15.135:0/3387783045 wait complete. 2024-04-20T12:20:48.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.085+0000 7fa8598fd640 1 Processor -- start 2024-04-20T12:20:48.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8598fd640 1 -- start start 2024-04-20T12:20:48.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8598fd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa854102a30 0x7fa8541982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:48.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8598fd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa854105360 0x7fa854198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:48.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8598fd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa854107c90 0x7fa85419f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:48.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8598fd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa85410dc40 con 0x7fa854107c90 2024-04-20T12:20:48.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8598fd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa85410dac0 con 0x7fa854102a30 2024-04-20T12:20:48.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8598fd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa85410ddc0 con 0x7fa854105360 2024-04-20T12:20:48.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8537fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa854107c90 0x7fa85419f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:48.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8537fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa854107c90 0x7fa85419f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52116/0 (socket says 172.21.15.135:52116) 2024-04-20T12:20:48.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8537fe640 1 -- 172.21.15.135:0/1954244316 learned_addr learned my addr 172.21.15.135:0/1954244316 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:48.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8527fc640 1 --2- 172.21.15.135:0/1954244316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa854105360 0x7fa854198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:48.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa852ffd640 1 --2- 172.21.15.135:0/1954244316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa854102a30 0x7fa8541982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:48.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8537fe640 1 -- 172.21.15.135:0/1954244316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa854105360 msgr2=0x7fa854198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:48.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8537fe640 1 --2- 172.21.15.135:0/1954244316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa854105360 0x7fa854198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8537fe640 1 -- 172.21.15.135:0/1954244316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa854102a30 msgr2=0x7fa8541982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:48.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8537fe640 1 --2- 172.21.15.135:0/1954244316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa854102a30 0x7fa8541982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8537fe640 1 -- 172.21.15.135:0/1954244316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85419ff10 con 0x7fa854107c90 2024-04-20T12:20:48.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8537fe640 1 --2- 172.21.15.135:0/1954244316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa854107c90 0x7fa85419f8a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00eaa0 tx=0x7fa84c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:48.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.086+0000 7fa8588fb640 1 -- 172.21.15.135:0/1954244316 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c00cdb0 con 0x7fa854107c90 2024-04-20T12:20:48.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.087+0000 7fa8588fb640 1 -- 172.21.15.135:0/1954244316 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa84c005020 con 0x7fa854107c90 2024-04-20T12:20:48.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.087+0000 7fa8598fd640 1 -- 172.21.15.135:0/1954244316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8541a0200 con 0x7fa854107c90 2024-04-20T12:20:48.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.087+0000 7fa8588fb640 1 -- 172.21.15.135:0/1954244316 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c0116b0 con 0x7fa854107c90 2024-04-20T12:20:48.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.087+0000 7fa8598fd640 1 -- 172.21.15.135:0/1954244316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8541a0720 con 0x7fa854107c90 2024-04-20T12:20:48.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.087+0000 7fa8598fd640 1 -- 172.21.15.135:0/1954244316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8540fdf30 con 0x7fa854107c90 2024-04-20T12:20:48.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.089+0000 7fa8588fb640 1 -- 172.21.15.135:0/1954244316 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fa84c005560 con 0x7fa854107c90 2024-04-20T12:20:48.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.089+0000 7fa8588fb640 1 --2- 172.21.15.135:0/1954244316 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa83c0a3bb0 0x7fa83c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:48.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.089+0000 7fa852ffd640 1 --2- 172.21.15.135:0/1954244316 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa83c0a3bb0 0x7fa83c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:48.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.090+0000 7fa8588fb640 1 -- 172.21.15.135:0/1954244316 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8802+0+0 (secure 0 0 0) 0x7fa84c0d0c00 con 0x7fa854107c90 2024-04-20T12:20:48.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.090+0000 7fa852ffd640 1 --2- 172.21.15.135:0/1954244316 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa83c0a3bb0 0x7fa83c0a6070 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa844005fd0 tx=0x7fa844005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:48.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.093+0000 7fa8588fb640 1 -- 172.21.15.135:0/1954244316 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fa84c016030 con 0x7fa854107c90 2024-04-20T12:20:48.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.272+0000 7fa8598fd640 1 -- 172.21.15.135:0/1954244316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa85402d5d0 con 0x7fa854107c90 2024-04-20T12:20:48.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.273+0000 7fa8588fb640 1 -- 172.21.15.135:0/1954244316 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24186 (secure 0 0 0) 0x7fa84c09d3a0 con 0x7fa854107c90 2024-04-20T12:20:48.273 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:48.273 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":89,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:20:46.663279+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:20:48.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.275+0000 7fa8598fd640 1 -- 172.21.15.135:0/1954244316 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa83c0a3bb0 msgr2=0x7fa83c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:48.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.275+0000 7fa8598fd640 1 --2- 172.21.15.135:0/1954244316 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa83c0a3bb0 0x7fa83c0a6070 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa844005fd0 tx=0x7fa844005850 comp rx=0 tx=0).stop 2024-04-20T12:20:48.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.275+0000 7fa8598fd640 1 -- 172.21.15.135:0/1954244316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa854107c90 msgr2=0x7fa85419f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:48.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.275+0000 7fa8598fd640 1 --2- 172.21.15.135:0/1954244316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa854107c90 0x7fa85419f8a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00eaa0 tx=0x7fa84c00ef60 comp rx=0 tx=0).stop 2024-04-20T12:20:48.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.275+0000 7fa8598fd640 1 -- 172.21.15.135:0/1954244316 shutdown_connections 2024-04-20T12:20:48.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.275+0000 7fa8598fd640 1 --2- 172.21.15.135:0/1954244316 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa83c0a3bb0 0x7fa83c0a6070 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.275+0000 7fa8598fd640 1 --2- 172.21.15.135:0/1954244316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa854107c90 0x7fa85419f8a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.275+0000 7fa8598fd640 1 --2- 172.21.15.135:0/1954244316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa854105360 0x7fa854198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.275+0000 7fa8598fd640 1 --2- 172.21.15.135:0/1954244316 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa854102a30 0x7fa8541982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.275+0000 7fa8598fd640 1 -- 172.21.15.135:0/1954244316 >> 172.21.15.135:0/1954244316 conn(0x7fa8540fc440 msgr2=0x7fa8541032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:48.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.275+0000 7fa8598fd640 1 -- 172.21.15.135:0/1954244316 shutdown_connections 2024-04-20T12:20:48.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.275+0000 7fa8598fd640 1 -- 172.21.15.135:0/1954244316 wait complete. 2024-04-20T12:20:48.300 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:20:48.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.399+0000 7f2f6f78f640 1 -- 172.21.15.135:0/2497740905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f681029b0 msgr2=0x7f2f681092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:48.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.399+0000 7f2f6f78f640 1 --2- 172.21.15.135:0/2497740905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f681029b0 0x7f2f681092d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009ca0 tx=0x7f2f6002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.399+0000 7f2f6f78f640 1 -- 172.21.15.135:0/2497740905 shutdown_connections 2024-04-20T12:20:48.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.399+0000 7f2f6f78f640 1 --2- 172.21.15.135:0/2497740905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f681029b0 0x7f2f681092d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.399+0000 7f2f6f78f640 1 --2- 172.21.15.135:0/2497740905 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f68101ff0 0x7f2f68102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.399+0000 7f2f6f78f640 1 --2- 172.21.15.135:0/2497740905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f68100ea0 0x7f2f681012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.399+0000 7f2f6f78f640 1 -- 172.21.15.135:0/2497740905 >> 172.21.15.135:0/2497740905 conn(0x7f2f680fc410 msgr2=0x7f2f680fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:48.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.399+0000 7f2f6f78f640 1 -- 172.21.15.135:0/2497740905 shutdown_connections 2024-04-20T12:20:48.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.399+0000 7f2f6f78f640 1 -- 172.21.15.135:0/2497740905 wait complete. 2024-04-20T12:20:48.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6f78f640 1 Processor -- start 2024-04-20T12:20:48.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6f78f640 1 -- start start 2024-04-20T12:20:48.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6f78f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f68100ea0 0x7f2f68197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:48.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6f78f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f68101ff0 0x7f2f681976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:48.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6f78f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f681029b0 0x7f2f6819e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:48.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6f78f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6810cb50 con 0x7f2f68100ea0 2024-04-20T12:20:48.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6f78f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6810c9d0 con 0x7f2f681029b0 2024-04-20T12:20:48.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6f78f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2f6810ccd0 con 0x7f2f68101ff0 2024-04-20T12:20:48.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6d52b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f68100ea0 0x7f2f68197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:48.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6d52b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f68100ea0 0x7f2f68197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52140/0 (socket says 172.21.15.135:52140) 2024-04-20T12:20:48.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6d52b640 1 -- 172.21.15.135:0/4231789049 learned_addr learned my addr 172.21.15.135:0/4231789049 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:48.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6cd2a640 1 --2- 172.21.15.135:0/4231789049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f68101ff0 0x7f2f681976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:48.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6d52b640 1 -- 172.21.15.135:0/4231789049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f68101ff0 msgr2=0x7f2f681976a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:48.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6d52b640 1 --2- 172.21.15.135:0/4231789049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f68101ff0 0x7f2f681976a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6d52b640 1 -- 172.21.15.135:0/4231789049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f681029b0 msgr2=0x7f2f6819e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:48.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6d52b640 1 --2- 172.21.15.135:0/4231789049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f681029b0 0x7f2f6819e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6d52b640 1 -- 172.21.15.135:0/4231789049 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6819ed80 con 0x7f2f68100ea0 2024-04-20T12:20:48.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f6d52b640 1 --2- 172.21.15.135:0/4231789049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f68100ea0 0x7f2f68197160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400e9f0 tx=0x7f2f6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:48.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.400+0000 7f2f5e7fc640 1 -- 172.21.15.135:0/4231789049 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6400cd80 con 0x7f2f68100ea0 2024-04-20T12:20:48.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.401+0000 7f2f5e7fc640 1 -- 172.21.15.135:0/4231789049 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f64005500 con 0x7f2f68100ea0 2024-04-20T12:20:48.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.401+0000 7f2f6f78f640 1 -- 172.21.15.135:0/4231789049 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f6819f070 con 0x7f2f68100ea0 2024-04-20T12:20:48.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.401+0000 7f2f5e7fc640 1 -- 172.21.15.135:0/4231789049 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64010690 con 0x7f2f68100ea0 2024-04-20T12:20:48.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.401+0000 7f2f6f78f640 1 -- 172.21.15.135:0/4231789049 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f6819f570 con 0x7f2f68100ea0 2024-04-20T12:20:48.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.401+0000 7f2f6f78f640 1 -- 172.21.15.135:0/4231789049 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f68108150 con 0x7f2f68100ea0 2024-04-20T12:20:48.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.403+0000 7f2f5e7fc640 1 -- 172.21.15.135:0/4231789049 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f2f640046c0 con 0x7f2f68100ea0 2024-04-20T12:20:48.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.403+0000 7f2f5e7fc640 1 --2- 172.21.15.135:0/4231789049 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2f540a3bb0 0x7f2f540a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:48.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.403+0000 7f2f6cd2a640 1 --2- 172.21.15.135:0/4231789049 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2f540a3bb0 0x7f2f540a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:48.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.403+0000 7f2f5e7fc640 1 -- 172.21.15.135:0/4231789049 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f2f640d0cf0 con 0x7f2f68100ea0 2024-04-20T12:20:48.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.404+0000 7f2f6cd2a640 1 --2- 172.21.15.135:0/4231789049 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2f540a3bb0 0x7f2f540a6070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2f68198670 tx=0x7f2f5800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:48.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.407+0000 7f2f5e7fc640 1 -- 172.21.15.135:0/4231789049 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f2f64053ff0 con 0x7f2f68100ea0 2024-04-20T12:20:48.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:48 smithi139 ceph-mon[21834]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-20T12:20:48.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:48 smithi139 ceph-mon[21834]: osdmap e89: 12 total, 12 up, 12 in 2024-04-20T12:20:48.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:48 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3772770859' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-04-20T12:20:48.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:48 smithi139 ceph-mon[21834]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-20T12:20:48.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:48 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/4165499397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:48.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:48 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1232124178' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:48.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:48 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1954244316' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:48.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:48 smithi135 ceph-mon[18264]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-20T12:20:48.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:48 smithi135 ceph-mon[18264]: osdmap e89: 12 total, 12 up, 12 in 2024-04-20T12:20:48.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:48 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3772770859' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-04-20T12:20:48.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:48 smithi135 ceph-mon[18264]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-20T12:20:48.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:48 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/4165499397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:48.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:48 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1232124178' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:48.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:48 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1954244316' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.621+0000 7f2f6f78f640 1 -- 172.21.15.135:0/4231789049 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f6802d5d0 con 0x7f2f68100ea0 2024-04-20T12:20:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.622+0000 7f2f5e7fc640 1 -- 172.21.15.135:0/4231789049 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11839 (secure 0 0 0) 0x7f2f6409d490 con 0x7f2f68100ea0 2024-04-20T12:20:48.622 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:48.622 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14622,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14634,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24389,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24416,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24455,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24475,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:20:46.663485+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24490,"qdb_cluster":[24490]},"id":1}]} 2024-04-20T12:20:48.622 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 17 2024-04-20T12:20:48.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.624+0000 7f2f6f78f640 1 -- 172.21.15.135:0/4231789049 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2f540a3bb0 msgr2=0x7f2f540a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:48.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.624+0000 7f2f6f78f640 1 --2- 172.21.15.135:0/4231789049 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2f540a3bb0 0x7f2f540a6070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2f68198670 tx=0x7f2f5800b390 comp rx=0 tx=0).stop 2024-04-20T12:20:48.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.624+0000 7f2f6f78f640 1 -- 172.21.15.135:0/4231789049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f68100ea0 msgr2=0x7f2f68197160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:48.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.624+0000 7f2f6f78f640 1 --2- 172.21.15.135:0/4231789049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f68100ea0 0x7f2f68197160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400e9f0 tx=0x7f2f6400edf0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.624+0000 7f2f6f78f640 1 -- 172.21.15.135:0/4231789049 shutdown_connections 2024-04-20T12:20:48.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.624+0000 7f2f6f78f640 1 --2- 172.21.15.135:0/4231789049 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2f540a3bb0 0x7f2f540a6070 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.624+0000 7f2f6f78f640 1 --2- 172.21.15.135:0/4231789049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2f681029b0 0x7f2f6819e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.624+0000 7f2f6f78f640 1 --2- 172.21.15.135:0/4231789049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f68101ff0 0x7f2f681976a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.624+0000 7f2f6f78f640 1 --2- 172.21.15.135:0/4231789049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2f68100ea0 0x7f2f68197160 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.624+0000 7f2f6f78f640 1 -- 172.21.15.135:0/4231789049 >> 172.21.15.135:0/4231789049 conn(0x7f2f680fc410 msgr2=0x7f2f68105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:48.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.624+0000 7f2f6f78f640 1 -- 172.21.15.135:0/4231789049 shutdown_connections 2024-04-20T12:20:48.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.624+0000 7f2f6f78f640 1 -- 172.21.15.135:0/4231789049 wait complete. 2024-04-20T12:20:48.636 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:20:48.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.733+0000 7fa7ca175640 1 -- 172.21.15.135:0/515278400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7c4107d40 msgr2=0x7fa7c410a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:48.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.733+0000 7fa7ca175640 1 --2- 172.21.15.135:0/515278400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7c4107d40 0x7fa7c410a130 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009ca0 tx=0x7fa7bc02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.733+0000 7fa7ca175640 1 -- 172.21.15.135:0/515278400 shutdown_connections 2024-04-20T12:20:48.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.733+0000 7fa7ca175640 1 --2- 172.21.15.135:0/515278400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7c4107d40 0x7fa7c410a130 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.733+0000 7fa7ca175640 1 --2- 172.21.15.135:0/515278400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c4105410 0x7fa7c4107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.733+0000 7fa7ca175640 1 --2- 172.21.15.135:0/515278400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7c4102ae0 0x7fa7c4104ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.733+0000 7fa7ca175640 1 -- 172.21.15.135:0/515278400 >> 172.21.15.135:0/515278400 conn(0x7fa7c40fc410 msgr2=0x7fa7c40fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:48.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.733+0000 7fa7ca175640 1 -- 172.21.15.135:0/515278400 shutdown_connections 2024-04-20T12:20:48.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.733+0000 7fa7ca175640 1 -- 172.21.15.135:0/515278400 wait complete. 2024-04-20T12:20:48.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.734+0000 7fa7ca175640 1 Processor -- start 2024-04-20T12:20:48.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.734+0000 7fa7ca175640 1 -- start start 2024-04-20T12:20:48.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.734+0000 7fa7ca175640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c4102ae0 0x7fa7c4198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:48.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.734+0000 7fa7ca175640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7c4105410 0x7fa7c4198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:48.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.734+0000 7fa7ca175640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7c4107d40 0x7fa7c419f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:48.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.734+0000 7fa7ca175640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c410dc40 con 0x7fa7c4105410 2024-04-20T12:20:48.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.734+0000 7fa7ca175640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c410dac0 con 0x7fa7c4107d40 2024-04-20T12:20:48.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.734+0000 7fa7ca175640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c410ddc0 con 0x7fa7c4102ae0 2024-04-20T12:20:48.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.734+0000 7fa7c2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7c4105410 0x7fa7c4198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:48.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.734+0000 7fa7c2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7c4105410 0x7fa7c4198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52150/0 (socket says 172.21.15.135:52150) 2024-04-20T12:20:48.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.734+0000 7fa7c2ffd640 1 -- 172.21.15.135:0/1495799430 learned_addr learned my addr 172.21.15.135:0/1495799430 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:48.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.734+0000 7fa7c37fe640 1 --2- 172.21.15.135:0/1495799430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c4102ae0 0x7fa7c4198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:48.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.735+0000 7fa7c3fff640 1 --2- 172.21.15.135:0/1495799430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7c4107d40 0x7fa7c419f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:48.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.735+0000 7fa7c2ffd640 1 -- 172.21.15.135:0/1495799430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c4102ae0 msgr2=0x7fa7c4198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:48.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.735+0000 7fa7c2ffd640 1 --2- 172.21.15.135:0/1495799430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c4102ae0 0x7fa7c4198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.735+0000 7fa7c2ffd640 1 -- 172.21.15.135:0/1495799430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7c4107d40 msgr2=0x7fa7c419f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:48.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.735+0000 7fa7c2ffd640 1 --2- 172.21.15.135:0/1495799430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7c4107d40 0x7fa7c419f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.735+0000 7fa7c2ffd640 1 -- 172.21.15.135:0/1495799430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c419fe30 con 0x7fa7c4105410 2024-04-20T12:20:48.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.735+0000 7fa7c2ffd640 1 --2- 172.21.15.135:0/1495799430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7c4105410 0x7fa7c4198750 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8005fd0 tx=0x7fa7b800dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:48.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.735+0000 7fa7c0ff9640 1 -- 172.21.15.135:0/1495799430 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8017070 con 0x7fa7c4105410 2024-04-20T12:20:48.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.735+0000 7fa7c0ff9640 1 -- 172.21.15.135:0/1495799430 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7b800de50 con 0x7fa7c4105410 2024-04-20T12:20:48.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.735+0000 7fa7ca175640 1 -- 172.21.15.135:0/1495799430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c41a0120 con 0x7fa7c4105410 2024-04-20T12:20:48.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.735+0000 7fa7c0ff9640 1 -- 172.21.15.135:0/1495799430 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8003e00 con 0x7fa7c4105410 2024-04-20T12:20:48.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.735+0000 7fa7ca175640 1 -- 172.21.15.135:0/1495799430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c41a0670 con 0x7fa7c4105410 2024-04-20T12:20:48.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.736+0000 7fa7ca175640 1 -- 172.21.15.135:0/1495799430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c40fdf00 con 0x7fa7c4105410 2024-04-20T12:20:48.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.737+0000 7fa7c0ff9640 1 -- 172.21.15.135:0/1495799430 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fa7b8003fa0 con 0x7fa7c4105410 2024-04-20T12:20:48.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.738+0000 7fa7c0ff9640 1 --2- 172.21.15.135:0/1495799430 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7ac0a3bb0 0x7fa7ac0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:48.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.738+0000 7fa7c37fe640 1 --2- 172.21.15.135:0/1495799430 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7ac0a3bb0 0x7fa7ac0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:48.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.738+0000 7fa7c0ff9640 1 -- 172.21.15.135:0/1495799430 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fa7b80d02e0 con 0x7fa7c4105410 2024-04-20T12:20:48.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.738+0000 7fa7c37fe640 1 --2- 172.21.15.135:0/1495799430 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7ac0a3bb0 0x7fa7ac0a6070 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400abe0 tx=0x7fa7b400a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:48.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.742+0000 7fa7c0ff9640 1 -- 172.21.15.135:0/1495799430 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fa7b8020030 con 0x7fa7c4105410 2024-04-20T12:20:48.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:48 smithi154 ceph-mon[22073]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-20T12:20:48.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:48 smithi154 ceph-mon[22073]: osdmap e89: 12 total, 12 up, 12 in 2024-04-20T12:20:48.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:48 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3772770859' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-04-20T12:20:48.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:48 smithi154 ceph-mon[22073]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-20T12:20:48.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:48 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/4165499397' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:48.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:48 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1232124178' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:48.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:48 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1954244316' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:48.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.925+0000 7fa7ca175640 1 -- 172.21.15.135:0/1495799430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7c4062b90 con 0x7fa7c4105410 2024-04-20T12:20:48.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.927+0000 7fa7c0ff9640 1 -- 172.21.15.135:0/1495799430 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24173 (secure 0 0 0) 0x7fa7b809ca80 con 0x7fa7c4105410 2024-04-20T12:20:48.927 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:48.927 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":90,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:20:48.315252+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:20:48.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.929+0000 7fa7ca175640 1 -- 172.21.15.135:0/1495799430 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7ac0a3bb0 msgr2=0x7fa7ac0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:48.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.929+0000 7fa7ca175640 1 --2- 172.21.15.135:0/1495799430 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7ac0a3bb0 0x7fa7ac0a6070 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400abe0 tx=0x7fa7b400a2d0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.929+0000 7fa7ca175640 1 -- 172.21.15.135:0/1495799430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7c4105410 msgr2=0x7fa7c4198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:48.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.929+0000 7fa7ca175640 1 --2- 172.21.15.135:0/1495799430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7c4105410 0x7fa7c4198750 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8005fd0 tx=0x7fa7b800dd20 comp rx=0 tx=0).stop 2024-04-20T12:20:48.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.929+0000 7fa7ca175640 1 -- 172.21.15.135:0/1495799430 shutdown_connections 2024-04-20T12:20:48.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.929+0000 7fa7ca175640 1 --2- 172.21.15.135:0/1495799430 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7ac0a3bb0 0x7fa7ac0a6070 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.929+0000 7fa7ca175640 1 --2- 172.21.15.135:0/1495799430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7c4107d40 0x7fa7c419f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.929+0000 7fa7ca175640 1 --2- 172.21.15.135:0/1495799430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7c4105410 0x7fa7c4198750 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.929+0000 7fa7ca175640 1 --2- 172.21.15.135:0/1495799430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7c4102ae0 0x7fa7c4198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:48.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.929+0000 7fa7ca175640 1 -- 172.21.15.135:0/1495799430 >> 172.21.15.135:0/1495799430 conn(0x7fa7c40fc410 msgr2=0x7fa7c4103420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:48.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.929+0000 7fa7ca175640 1 -- 172.21.15.135:0/1495799430 shutdown_connections 2024-04-20T12:20:48.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:48.929+0000 7fa7ca175640 1 -- 172.21.15.135:0/1495799430 wait complete. 2024-04-20T12:20:48.940 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-20T12:20:41.367288+0000', 'modified': '2024-04-20T12:20:46.663485+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'snap_rstat': True, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24490}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.154:6839/1672287462', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 1672287462}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 1672287462}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24490, 'qdb_cluster': [24490]} 2024-04-20T12:20:48.941 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-20T12:20:48.941 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-20T12:20:49.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.041+0000 7fec96352640 1 -- 172.21.15.135:0/4140934859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec90100640 msgr2=0x7fec90100a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:49.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.041+0000 7fec96352640 1 --2- 172.21.15.135:0/4140934859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec90100640 0x7fec90100a60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fec80009900 tx=0x7fec8002bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:49.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.041+0000 7fec96352640 1 -- 172.21.15.135:0/4140934859 shutdown_connections 2024-04-20T12:20:49.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.041+0000 7fec96352640 1 --2- 172.21.15.135:0/4140934859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec901021f0 0x7fec90108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.041+0000 7fec96352640 1 --2- 172.21.15.135:0/4140934859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec90101830 0x7fec90101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.041+0000 7fec96352640 1 --2- 172.21.15.135:0/4140934859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec90100640 0x7fec90100a60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.041+0000 7fec96352640 1 -- 172.21.15.135:0/4140934859 >> 172.21.15.135:0/4140934859 conn(0x7fec900fbb90 msgr2=0x7fec900fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:49.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.041+0000 7fec96352640 1 -- 172.21.15.135:0/4140934859 shutdown_connections 2024-04-20T12:20:49.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.041+0000 7fec96352640 1 -- 172.21.15.135:0/4140934859 wait complete. 2024-04-20T12:20:49.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.041+0000 7fec96352640 1 Processor -- start 2024-04-20T12:20:49.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.041+0000 7fec96352640 1 -- start start 2024-04-20T12:20:49.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec96352640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec90100640 0x7fec9019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec96352640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec90101830 0x7fec9019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec96352640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec901021f0 0x7fec901a1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec96352640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fec9010cbb0 con 0x7fec90101830 2024-04-20T12:20:49.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec96352640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fec9010ca30 con 0x7fec90100640 2024-04-20T12:20:49.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec96352640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fec9010cd30 con 0x7fec901021f0 2024-04-20T12:20:49.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec90101830 0x7fec9019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec90101830 0x7fec9019aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52168/0 (socket says 172.21.15.135:52168) 2024-04-20T12:20:49.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec8f7fe640 1 -- 172.21.15.135:0/2697401871 learned_addr learned my addr 172.21.15.135:0/2697401871 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:49.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec948ef640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec901021f0 0x7fec901a1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec8ffff640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec90100640 0x7fec9019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec8f7fe640 1 -- 172.21.15.135:0/2697401871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec901021f0 msgr2=0x7fec901a1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:49.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec8f7fe640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec901021f0 0x7fec901a1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec8f7fe640 1 -- 172.21.15.135:0/2697401871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec90100640 msgr2=0x7fec9019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:49.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec8f7fe640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec90100640 0x7fec9019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec8f7fe640 1 -- 172.21.15.135:0/2697401871 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec901a21a0 con 0x7fec90101830 2024-04-20T12:20:49.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec8ffff640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec90100640 0x7fec9019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:20:49.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec948ef640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec901021f0 0x7fec901a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:20:49.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec8f7fe640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec90101830 0x7fec9019aac0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fec8400b4a0 tx=0x7fec8400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:49.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec8d7fa640 1 -- 172.21.15.135:0/2697401871 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84014070 con 0x7fec90101830 2024-04-20T12:20:49.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec96352640 1 -- 172.21.15.135:0/2697401871 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec901a2490 con 0x7fec90101830 2024-04-20T12:20:49.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec8d7fa640 1 -- 172.21.15.135:0/2697401871 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec84010af0 con 0x7fec90101830 2024-04-20T12:20:49.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec8d7fa640 1 -- 172.21.15.135:0/2697401871 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84017d10 con 0x7fec90101830 2024-04-20T12:20:49.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.042+0000 7fec96352640 1 -- 172.21.15.135:0/2697401871 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec901a2a30 con 0x7fec90101830 2024-04-20T12:20:49.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.045+0000 7fec8d7fa640 1 -- 172.21.15.135:0/2697401871 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fec84017070 con 0x7fec90101830 2024-04-20T12:20:49.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.045+0000 7fec99025740 1 Processor -- start 2024-04-20T12:20:49.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.045+0000 7fec99025740 1 -- start start 2024-04-20T12:20:49.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.045+0000 7fec99025740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185b7cf0 0x55c9185b8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.045+0000 7fec99025740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b86e0 0x55c9185bd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.045+0000 7fec99025740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185bd850 0x55c9185bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.045+0000 7fec99025740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c9184cb290 con 0x55c9185b7cf0 2024-04-20T12:20:49.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.045+0000 7fec99025740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c918528a40 con 0x55c9185bd850 2024-04-20T12:20:49.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.045+0000 7fec99025740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c9184e3a30 con 0x55c9185b86e0 2024-04-20T12:20:49.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec948ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185b7cf0 0x55c9185b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec948ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185b7cf0 0x55c9185b8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52172/0 (socket says 172.21.15.135:52172) 2024-04-20T12:20:49.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec948ef640 1 -- 172.21.15.135:0/686833473 learned_addr learned my addr 172.21.15.135:0/686833473 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:49.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec8d7fa640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fec780a3bb0 0x7fec780a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec8ffff640 1 --2- 172.21.15.135:0/686833473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b86e0 0x55c9185bd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec8f7fe640 1 --2- 172.21.15.135:0/686833473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185bd850 0x55c9185bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec948ef640 1 -- 172.21.15.135:0/686833473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b86e0 msgr2=0x55c9185bd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:20:49.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec948ef640 1 --2- 172.21.15.135:0/686833473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b86e0 0x55c9185bd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec948ef640 1 -- 172.21.15.135:0/686833473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185bd850 msgr2=0x55c9185bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:20:49.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec948ef640 1 --2- 172.21.15.135:0/686833473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185bd850 0x55c9185bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec948ef640 1 -- 172.21.15.135:0/686833473 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9184d6c10 con 0x55c9185b7cf0 2024-04-20T12:20:49.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec8ffff640 1 --2- 172.21.15.135:0/686833473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b86e0 0x55c9185bd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:20:49.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec8f7fe640 1 --2- 172.21.15.135:0/686833473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185bd850 0x55c9185bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:20:49.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec948ef640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fec780a3bb0 0x7fec780a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec8d7fa640 1 -- 172.21.15.135:0/2697401871 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fec840cfa70 con 0x7fec90101830 2024-04-20T12:20:49.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec948ef640 1 --2- 172.21.15.135:0/686833473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185b7cf0 0x55c9185b8110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fec88010540 tx=0x7fec88010a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9966ad81e4d57e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:49.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec767fc640 1 -- 172.21.15.135:0/686833473 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88022070 con 0x55c9185b7cf0 2024-04-20T12:20:49.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec767fc640 1 -- 172.21.15.135:0/686833473 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8800e3d0 con 0x55c9185b7cf0 2024-04-20T12:20:49.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.046+0000 7fec767fc640 1 -- 172.21.15.135:0/686833473 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8801c5d0 con 0x55c9185b7cf0 2024-04-20T12:20:49.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.047+0000 7fec99025740 1 -- 172.21.15.135:0/686833473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185b7cf0 msgr2=0x55c9185b8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.047+0000 7fec948ef640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fec780a3bb0 0x7fec780a6070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fec8801f000 tx=0x7fec8801d000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.047+0000 7fec99025740 1 --2- 172.21.15.135:0/686833473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185b7cf0 0x55c9185b8110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fec88010540 tx=0x7fec88010a00 comp rx=0 tx=0).stop 2024-04-20T12:20:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.047+0000 7fec99025740 1 -- 172.21.15.135:0/686833473 shutdown_connections 2024-04-20T12:20:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.047+0000 7fec99025740 1 --2- 172.21.15.135:0/686833473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185bd850 0x55c9185bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.047+0000 7fec99025740 1 --2- 172.21.15.135:0/686833473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b86e0 0x55c9185bd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.047+0000 7fec99025740 1 --2- 172.21.15.135:0/686833473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185b7cf0 0x55c9185b8110 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.047+0000 7fec99025740 1 -- 172.21.15.135:0/686833473 >> 172.21.15.135:0/686833473 conn(0x55c9185b3260 msgr2=0x55c9185b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.047+0000 7fec99025740 1 -- 172.21.15.135:0/686833473 shutdown_connections 2024-04-20T12:20:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.047+0000 7fec99025740 1 -- 172.21.15.135:0/686833473 wait complete. 2024-04-20T12:20:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.047+0000 7fec99025740 1 -- start start 2024-04-20T12:20:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec99025740 1 Processor -- start 2024-04-20T12:20:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec99025740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185b7cf0 0x55c9185c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec99025740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185b86e0 0x55c9185c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec99025740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185bd850 0x55c9185c9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec99025740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c918522140 con 0x55c9185b86e0 2024-04-20T12:20:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec99025740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c91851ce20 con 0x55c9185b7cf0 2024-04-20T12:20:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec99025740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c91852ad20 con 0x55c9185bd850 2024-04-20T12:20:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec99025740 10 client.0 _ll_register_callbacks cb 0x55c9185135c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:20:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185b86e0 0x55c9185c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185b86e0 0x55c9185c2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52184/0 (socket says 172.21.15.135:52184) 2024-04-20T12:20:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec8f7fe640 1 -- 172.21.15.135:0/845427145 learned_addr learned my addr 172.21.15.135:0/845427145 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec8ffff640 1 --2- 172.21.15.135:0/845427145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185b7cf0 0x55c9185c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec948ef640 1 --2- 172.21.15.135:0/845427145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185bd850 0x55c9185c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec8f7fe640 1 -- 172.21.15.135:0/845427145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185bd850 msgr2=0x55c9185c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:20:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec8f7fe640 1 --2- 172.21.15.135:0/845427145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185bd850 0x55c9185c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec8f7fe640 1 -- 172.21.15.135:0/845427145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185b7cf0 msgr2=0x55c9185c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:20:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec8f7fe640 1 --2- 172.21.15.135:0/845427145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185b7cf0 0x55c9185c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec8f7fe640 1 -- 172.21.15.135:0/845427145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9182302d0 con 0x55c9185b86e0 2024-04-20T12:20:49.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec8f7fe640 1 --2- 172.21.15.135:0/845427145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185b86e0 0x55c9185c2350 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fec840984e0 tx=0x7fec8401c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751e67f669fef122 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:20:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec6f7fe640 1 -- 172.21.15.135:0/845427145 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8401e050 con 0x55c9185b86e0 2024-04-20T12:20:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec6f7fe640 1 -- 172.21.15.135:0/845427145 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fec84099e10 con 0x55c9185b86e0 2024-04-20T12:20:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.048+0000 7fec99025740 1 -- 172.21.15.135:0/845427145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec8800e3d0 con 0x55c9185b86e0 2024-04-20T12:20:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.049+0000 7fec6f7fe640 1 -- 172.21.15.135:0/845427145 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fec8409bb10 con 0x55c9185b86e0 2024-04-20T12:20:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.049+0000 7fec99025740 10 client.14760 fetch_fsmap learned FSMap version 17 2024-04-20T12:20:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.049+0000 7fec99025740 1 -- 172.21.15.135:0/845427145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55c9182fa6b0 con 0x55c9185b86e0 2024-04-20T12:20:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.049+0000 7fec6f7fe640 1 -- 172.21.15.135:0/845427145 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8800e3d0 con 0x55c9185b86e0 2024-04-20T12:20:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.049+0000 7fec6f7fe640 1 -- 172.21.15.135:0/845427145 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 17) ==== 8343+0+0 (secure 0 0 0) 0x7fec84098180 con 0x55c9185b86e0 2024-04-20T12:20:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.049+0000 7fec99025740 10 client.14760 fetch_fsmap finished waiting for FSMap version 17 2024-04-20T12:20:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.049+0000 7fec99025740 10 client.14760 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-20T12:20:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.049+0000 7fec99025740 20 client.14760 populate_metadata read hostname 'smithi135' 2024-04-20T12:20:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.049+0000 7fec99025740 1 --2- 172.21.15.135:0/845427145 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c9185ce9d0 0x55c9185cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.049+0000 7fec99025740 4 client.14760 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:20:49.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.049+0000 7fec99025740 1 -- 172.21.15.135:0/845427145 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9184a4510 con 0x55c9185ce9d0 2024-04-20T12:20:49.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.049+0000 7fec8ffff640 1 --2- 172.21.15.135:0/845427145 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c9185ce9d0 0x55c9185cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.049+0000 7fec6f7fe640 10 client.14760 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:20:49.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.049+0000 7fec8ffff640 1 --2- 172.21.15.135:0/845427145 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c9185ce9d0 0x55c9185cfe40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1cf0feddb052ef8 server_cookie=eadf61a8b38f3743 in_seq=0 out_seq=0 2024-04-20T12:20:49.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.050+0000 7fec6f7fe640 1 -- 172.21.15.135:0/845427145 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c9184a4510 con 0x55c9185ce9d0 2024-04-20T12:20:49.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.050+0000 7fec6f7fe640 10 client.14760 handle_command_reply: tid=0 2024-04-20T12:20:49.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.050+0000 7fec99025740 1 client.14760 shutdown 2024-04-20T12:20:49.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.050+0000 7fec99025740 1 -- 172.21.15.135:0/845427145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185b86e0 msgr2=0x55c9185c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:49.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.050+0000 7fec99025740 1 --2- 172.21.15.135:0/845427145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185b86e0 0x55c9185c2350 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fec840984e0 tx=0x7fec8401c120 comp rx=0 tx=0).stop 2024-04-20T12:20:49.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.051+0000 7fec99025740 1 -- 172.21.15.135:0/845427145 shutdown_connections 2024-04-20T12:20:49.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.051+0000 7fec99025740 1 --2- 172.21.15.135:0/845427145 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c9185ce9d0 0x55c9185cfe40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.051+0000 7fec99025740 1 --2- 172.21.15.135:0/845427145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185bd850 0x55c9185c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.051+0000 7fec99025740 1 --2- 172.21.15.135:0/845427145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185b86e0 0x55c9185c2350 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.051+0000 7fec99025740 1 --2- 172.21.15.135:0/845427145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185b7cf0 0x55c9185c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.051+0000 7fec6f7fe640 0 client.14760 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:20:49.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.051+0000 7fec99025740 1 -- 172.21.15.135:0/845427145 >> 172.21.15.135:0/845427145 conn(0x55c9185b3260 msgr2=0x55c9185b2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:49.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.051+0000 7fec99025740 1 -- 172.21.15.135:0/845427145 shutdown_connections 2024-04-20T12:20:49.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.051+0000 7fec99025740 1 -- 172.21.15.135:0/845427145 wait complete. 2024-04-20T12:20:49.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.051+0000 7fec99025740 20 client.14760 trim_cache size 0 max 16384 2024-04-20T12:20:49.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec99025740 1 Processor -- start 2024-04-20T12:20:49.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec99025740 1 -- start start 2024-04-20T12:20:49.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec99025740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b7cf0 0x55c9185b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec99025740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185b86e0 0x55c9185c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec99025740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185bd850 0x55c9185cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec99025740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c9185ce180 con 0x55c9185bd850 2024-04-20T12:20:49.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec99025740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c9185ce850 con 0x55c9185b86e0 2024-04-20T12:20:49.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec99025740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c9185cef20 con 0x55c9185b7cf0 2024-04-20T12:20:49.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec948ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185bd850 0x55c9185cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec948ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185bd850 0x55c9185cd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52200/0 (socket says 172.21.15.135:52200) 2024-04-20T12:20:49.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec948ef640 1 -- 172.21.15.135:0/316184851 learned_addr learned my addr 172.21.15.135:0/316184851 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:49.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec8f7fe640 1 --2- 172.21.15.135:0/316184851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185b86e0 0x55c9185c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec8ffff640 1 --2- 172.21.15.135:0/316184851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b7cf0 0x55c9185b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec948ef640 1 -- 172.21.15.135:0/316184851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b7cf0 msgr2=0x55c9185b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:20:49.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec948ef640 1 --2- 172.21.15.135:0/316184851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b7cf0 0x55c9185b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec948ef640 1 -- 172.21.15.135:0/316184851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185b86e0 msgr2=0x55c9185c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:20:49.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec948ef640 1 --2- 172.21.15.135:0/316184851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185b86e0 0x55c9185c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec948ef640 1 -- 172.21.15.135:0/316184851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9185cf3d0 con 0x55c9185bd850 2024-04-20T12:20:49.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec948ef640 1 --2- 172.21.15.135:0/316184851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185bd850 0x55c9185cd980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55c9185b8f40 tx=0x7fec88027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508f428e987981ec server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:49.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec75ffb640 1 -- 172.21.15.135:0/316184851 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88022070 con 0x55c9185bd850 2024-04-20T12:20:49.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec75ffb640 1 -- 172.21.15.135:0/316184851 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8802a040 con 0x55c9185bd850 2024-04-20T12:20:49.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.069+0000 7fec75ffb640 1 -- 172.21.15.135:0/316184851 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8800e3d0 con 0x55c9185bd850 2024-04-20T12:20:49.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.070+0000 7fec99025740 1 -- 172.21.15.135:0/316184851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185bd850 msgr2=0x55c9185cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:49.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.070+0000 7fec99025740 1 --2- 172.21.15.135:0/316184851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185bd850 0x55c9185cd980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55c9185b8f40 tx=0x7fec88027000 comp rx=0 tx=0).stop 2024-04-20T12:20:49.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.070+0000 7fec99025740 1 -- 172.21.15.135:0/316184851 shutdown_connections 2024-04-20T12:20:49.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.070+0000 7fec99025740 1 --2- 172.21.15.135:0/316184851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185bd850 0x55c9185cd980 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.070+0000 7fec99025740 1 --2- 172.21.15.135:0/316184851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185b86e0 0x55c9185c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.070+0000 7fec99025740 1 --2- 172.21.15.135:0/316184851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b7cf0 0x55c9185b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.070+0000 7fec99025740 1 -- 172.21.15.135:0/316184851 >> 172.21.15.135:0/316184851 conn(0x55c9185b3260 msgr2=0x55c9185ae010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:49.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.070+0000 7fec99025740 1 -- 172.21.15.135:0/316184851 shutdown_connections 2024-04-20T12:20:49.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.070+0000 7fec99025740 1 -- 172.21.15.135:0/316184851 wait complete. 2024-04-20T12:20:49.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.070+0000 7fec99025740 1 -- start start 2024-04-20T12:20:49.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec99025740 1 Processor -- start 2024-04-20T12:20:49.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec99025740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185b7cf0 0x55c9185c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec99025740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b86e0 0x55c9185c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec99025740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185bd850 0x55c9185c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec99025740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c9185cfcc0 con 0x55c9185bd850 2024-04-20T12:20:49.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec99025740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c9185cf5f0 con 0x55c9185b7cf0 2024-04-20T12:20:49.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec99025740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c9185d0390 con 0x55c9185b86e0 2024-04-20T12:20:49.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec99025740 10 client.0 _ll_register_callbacks cb 0x7fec84017630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:20:49.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec948ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185bd850 0x55c9185c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec948ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185bd850 0x55c9185c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52204/0 (socket says 172.21.15.135:52204) 2024-04-20T12:20:49.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec948ef640 1 -- 172.21.15.135:0/257927890 learned_addr learned my addr 172.21.15.135:0/257927890 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:49.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec8ffff640 1 --2- 172.21.15.135:0/257927890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185b7cf0 0x55c9185c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec8f7fe640 1 --2- 172.21.15.135:0/257927890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b86e0 0x55c9185c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec948ef640 1 -- 172.21.15.135:0/257927890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b86e0 msgr2=0x55c9185c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:20:49.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec948ef640 1 --2- 172.21.15.135:0/257927890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b86e0 0x55c9185c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec948ef640 1 -- 172.21.15.135:0/257927890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185b7cf0 msgr2=0x55c9185c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:20:49.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec948ef640 1 --2- 172.21.15.135:0/257927890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185b7cf0 0x55c9185c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec948ef640 1 -- 172.21.15.135:0/257927890 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9185c8d80 con 0x55c9185bd850 2024-04-20T12:20:49.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec948ef640 1 --2- 172.21.15.135:0/257927890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185bd850 0x55c9185c8790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fec88006010 tx=0x7fec8801ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da1b4d7d04b3bac server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:49.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:20:49.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec6f7fe640 1 -- 172.21.15.135:0/257927890 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8803c070 con 0x55c9185bd850 2024-04-20T12:20:49.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec6f7fe640 1 -- 172.21.15.135:0/257927890 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fec88004a00 con 0x55c9185bd850 2024-04-20T12:20:49.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.071+0000 7fec99025740 1 -- 172.21.15.135:0/257927890 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec8802a040 con 0x55c9185bd850 2024-04-20T12:20:49.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.072+0000 7fec6f7fe640 1 -- 172.21.15.135:0/257927890 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fec88022040 con 0x55c9185bd850 2024-04-20T12:20:49.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.072+0000 7fec99025740 10 client.14766 fetch_fsmap learned FSMap version 17 2024-04-20T12:20:49.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.072+0000 7fec99025740 1 -- 172.21.15.135:0/257927890 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55c918635330 con 0x55c9185bd850 2024-04-20T12:20:49.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.072+0000 7fec6f7fe640 1 -- 172.21.15.135:0/257927890 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8802a040 con 0x55c9185bd850 2024-04-20T12:20:49.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.072+0000 7fec6f7fe640 1 -- 172.21.15.135:0/257927890 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 17) ==== 8343+0+0 (secure 0 0 0) 0x7fec8800f040 con 0x55c9185bd850 2024-04-20T12:20:49.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.072+0000 7fec99025740 10 client.14766 fetch_fsmap finished waiting for FSMap version 17 2024-04-20T12:20:49.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.072+0000 7fec99025740 10 client.14766 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-20T12:20:49.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.072+0000 7fec99025740 20 client.14766 populate_metadata read hostname 'smithi135' 2024-04-20T12:20:49.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.072+0000 7fec99025740 1 --2- 172.21.15.135:0/257927890 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c918639880 0x55c918636390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:49.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.072+0000 7fec99025740 4 client.14766 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T12:20:49.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.072+0000 7fec99025740 1 -- 172.21.15.135:0/257927890 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "status"}) -- 0x55c91852b530 con 0x55c918639880 2024-04-20T12:20:49.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.072+0000 7fec8ffff640 1 --2- 172.21.15.135:0/257927890 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c918639880 0x55c918636390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:49.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.072+0000 7fec6f7fe640 10 client.14766 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:20:49.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.072+0000 7fec8ffff640 1 --2- 172.21.15.135:0/257927890 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c918639880 0x55c918636390 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8fab11da11d0c24 server_cookie=b1d546448a9e20e7 in_seq=0 out_seq=0 2024-04-20T12:20:49.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec6f7fe640 1 -- 172.21.15.135:0/257927890 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c91852b530 con 0x55c918639880 2024-04-20T12:20:49.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec6f7fe640 10 client.14766 handle_command_reply: tid=0 2024-04-20T12:20:49.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec99025740 1 client.14766 shutdown 2024-04-20T12:20:49.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec99025740 1 -- 172.21.15.135:0/257927890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185bd850 msgr2=0x55c9185c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:49.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec99025740 1 --2- 172.21.15.135:0/257927890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185bd850 0x55c9185c8790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fec88006010 tx=0x7fec8801ef70 comp rx=0 tx=0).stop 2024-04-20T12:20:49.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec99025740 1 -- 172.21.15.135:0/257927890 shutdown_connections 2024-04-20T12:20:49.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec99025740 1 --2- 172.21.15.135:0/257927890 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c918639880 0x55c918636390 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec99025740 1 --2- 172.21.15.135:0/257927890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9185bd850 0x55c9185c8790 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec99025740 1 --2- 172.21.15.135:0/257927890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c9185b86e0 0x55c9185c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec99025740 1 --2- 172.21.15.135:0/257927890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c9185b7cf0 0x55c9185c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec6f7fe640 0 client.14766 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:20:49.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec99025740 1 -- 172.21.15.135:0/257927890 >> 172.21.15.135:0/257927890 conn(0x55c9185b3260 msgr2=0x55c9185cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:49.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec99025740 1 -- 172.21.15.135:0/257927890 shutdown_connections 2024-04-20T12:20:49.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec99025740 1 -- 172.21.15.135:0/257927890 wait complete. 2024-04-20T12:20:49.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec99025740 20 client.14766 trim_cache size 0 max 16384 2024-04-20T12:20:49.080 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:20:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "22180be8-ff0f-11ee-bc92-c7b262605968", 2024-04-20T12:20:49.080 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 0, 2024-04-20T12:20:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24490, 2024-04-20T12:20:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-04-20T12:20:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-04-20T12:20:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-04-20T12:20:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 7.0633480300000002, 2024-04-20T12:20:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 17, 2024-04-20T12:20:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 90, 2024-04-20T12:20:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 89, 2024-04-20T12:20:49.081 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 21.643432733000001 2024-04-20T12:20:49.081 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:20:49.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec96352640 1 -- 172.21.15.135:0/2697401871 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fec780a3bb0 msgr2=0x7fec780a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:49.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec96352640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fec780a3bb0 0x7fec780a6070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fec8801f000 tx=0x7fec8801d000 comp rx=0 tx=0).stop 2024-04-20T12:20:49.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec96352640 1 -- 172.21.15.135:0/2697401871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec90101830 msgr2=0x7fec9019aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:49.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.073+0000 7fec96352640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec90101830 0x7fec9019aac0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fec8400b4a0 tx=0x7fec8400b960 comp rx=0 tx=0).stop 2024-04-20T12:20:49.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.074+0000 7fec96352640 1 -- 172.21.15.135:0/2697401871 shutdown_connections 2024-04-20T12:20:49.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.074+0000 7fec96352640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fec780a3bb0 0x7fec780a6070 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.074+0000 7fec96352640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec901021f0 0x7fec901a1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.074+0000 7fec96352640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec90101830 0x7fec9019aac0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.074+0000 7fec96352640 1 --2- 172.21.15.135:0/2697401871 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fec90100640 0x7fec9019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:49.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.074+0000 7fec96352640 1 -- 172.21.15.135:0/2697401871 >> 172.21.15.135:0/2697401871 conn(0x7fec900fbb90 msgr2=0x7fec900fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:49.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.074+0000 7fec96352640 1 -- 172.21.15.135:0/2697401871 shutdown_connections 2024-04-20T12:20:49.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:49.074+0000 7fec96352640 1 -- 172.21.15.135:0/2697401871 wait complete. 2024-04-20T12:20:49.084 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-20T12:20:49.084 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-20T12:20:49.085 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph fs ls 2024-04-20T12:20:49.319 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:20:49.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:49 smithi135 ceph-mon[18264]: osdmap e90: 12 total, 12 up, 12 in 2024-04-20T12:20:49.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:49 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/4231789049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:49.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:49 smithi135 ceph-mon[18264]: pgmap v296: 129 pgs: 2 creating+activating, 4 creating+peering, 120 active+clean, 3 unknown; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-04-20T12:20:49.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:49 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1495799430' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:49.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:49 smithi154 ceph-mon[22073]: osdmap e90: 12 total, 12 up, 12 in 2024-04-20T12:20:49.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:49 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/4231789049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:49.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:49 smithi154 ceph-mon[22073]: pgmap v296: 129 pgs: 2 creating+activating, 4 creating+peering, 120 active+clean, 3 unknown; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-04-20T12:20:49.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:49 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1495799430' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:49 smithi139 ceph-mon[21834]: osdmap e90: 12 total, 12 up, 12 in 2024-04-20T12:20:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:49 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/4231789049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:20:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:49 smithi139 ceph-mon[21834]: pgmap v296: 129 pgs: 2 creating+activating, 4 creating+peering, 120 active+clean, 3 unknown; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-04-20T12:20:49.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:49 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1495799430' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:50.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:50 smithi135 ceph-mon[18264]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-20T12:20:50.654 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:50 smithi135 ceph-mon[18264]: Cluster is now healthy 2024-04-20T12:20:50.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:50 smithi154 ceph-mon[22073]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-20T12:20:50.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:50 smithi154 ceph-mon[22073]: Cluster is now healthy 2024-04-20T12:20:50.758 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:50 smithi139 ceph-mon[21834]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-04-20T12:20:50.758 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:50 smithi139 ceph-mon[21834]: Cluster is now healthy 2024-04-20T12:20:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.012+0000 7fce5ba77700 1 -- 172.21.15.135:0/3770896435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce54103b90 msgr2=0x7fce54100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.012+0000 7fce5ba77700 1 --2- 172.21.15.135:0/3770896435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce54103b90 0x7fce54100fa0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fce50009990 tx=0x7fce50009ca0 comp rx=0 tx=0).stop 2024-04-20T12:20:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.013+0000 7fce5ba77700 1 -- 172.21.15.135:0/3770896435 shutdown_connections 2024-04-20T12:20:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.013+0000 7fce5ba77700 1 --2- 172.21.15.135:0/3770896435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce5410f720 0x7fce54111b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.013+0000 7fce5ba77700 1 --2- 172.21.15.135:0/3770896435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce54103b90 0x7fce54100fa0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.013+0000 7fce5ba77700 1 --2- 172.21.15.135:0/3770896435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce541014e0 0x7fce54101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.013+0000 7fce5ba77700 1 -- 172.21.15.135:0/3770896435 >> 172.21.15.135:0/3770896435 conn(0x7fce54077f50 msgr2=0x7fce540ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.013+0000 7fce5ba77700 1 -- 172.21.15.135:0/3770896435 shutdown_connections 2024-04-20T12:20:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.013+0000 7fce5ba77700 1 -- 172.21.15.135:0/3770896435 wait complete. 2024-04-20T12:20:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.013+0000 7fce5ba77700 1 Processor -- start 2024-04-20T12:20:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.013+0000 7fce5ba77700 1 -- start start 2024-04-20T12:20:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.013+0000 7fce5ba77700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce541014e0 0x7fce5419b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.013+0000 7fce5ba77700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce54103b90 0x7fce5419bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.013+0000 7fce5ba77700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce5410f720 0x7fce5419fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.013+0000 7fce5ba77700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce541151d0 con 0x7fce541014e0 2024-04-20T12:20:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce5ba77700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fce54115050 con 0x7fce5410f720 2024-04-20T12:20:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce5ba77700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce54115350 con 0x7fce54103b90 2024-04-20T12:20:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce59813700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce541014e0 0x7fce5419b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce59813700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce541014e0 0x7fce5419b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44678/0 (socket says 172.21.15.135:44678) 2024-04-20T12:20:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce59813700 1 -- 172.21.15.135:0/3098904627 learned_addr learned my addr 172.21.15.135:0/3098904627 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce5a014700 1 --2- 172.21.15.135:0/3098904627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce5410f720 0x7fce5419fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce59012700 1 --2- 172.21.15.135:0/3098904627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce54103b90 0x7fce5419bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce59813700 1 -- 172.21.15.135:0/3098904627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce54103b90 msgr2=0x7fce5419bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce59813700 1 --2- 172.21.15.135:0/3098904627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce54103b90 0x7fce5419bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce59813700 1 -- 172.21.15.135:0/3098904627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce5410f720 msgr2=0x7fce5419fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce59813700 1 --2- 172.21.15.135:0/3098904627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce5410f720 0x7fce5419fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce59813700 1 -- 172.21.15.135:0/3098904627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce541a0610 con 0x7fce541014e0 2024-04-20T12:20:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce5a014700 1 --2- 172.21.15.135:0/3098904627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce5410f720 0x7fce5419fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:20:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce59813700 1 --2- 172.21.15.135:0/3098904627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce541014e0 0x7fce5419b600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce50000c00 tx=0x7fce5000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce4affd700 1 -- 172.21.15.135:0/3098904627 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce50027070 con 0x7fce541014e0 2024-04-20T12:20:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce5ba77700 1 -- 172.21.15.135:0/3098904627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce541a08a0 con 0x7fce541014e0 2024-04-20T12:20:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce4affd700 1 -- 172.21.15.135:0/3098904627 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce50003d70 con 0x7fce541014e0 2024-04-20T12:20:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce4affd700 1 -- 172.21.15.135:0/3098904627 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5000f460 con 0x7fce541014e0 2024-04-20T12:20:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.014+0000 7fce5ba77700 1 -- 172.21.15.135:0/3098904627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce541a8180 con 0x7fce541014e0 2024-04-20T12:20:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.015+0000 7fce5ba77700 1 -- 172.21.15.135:0/3098904627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce54069740 con 0x7fce541014e0 2024-04-20T12:20:51.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.016+0000 7fce4affd700 1 -- 172.21.15.135:0/3098904627 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fce5002a070 con 0x7fce541014e0 2024-04-20T12:20:51.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.017+0000 7fce4affd700 1 --2- 172.21.15.135:0/3098904627 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fce400a3cc0 0x7fce400a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:51.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.017+0000 7fce59012700 1 --2- 172.21.15.135:0/3098904627 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fce400a3cc0 0x7fce400a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:51.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.017+0000 7fce4affd700 1 -- 172.21.15.135:0/3098904627 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fce500d1680 con 0x7fce541014e0 2024-04-20T12:20:51.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.017+0000 7fce59012700 1 --2- 172.21.15.135:0/3098904627 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fce400a3cc0 0x7fce400a6180 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fce540ffc80 tx=0x7fce44009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:51.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.020+0000 7fce4affd700 1 -- 172.21.15.135:0/3098904627 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fce50013070 con 0x7fce541014e0 2024-04-20T12:20:51.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.261+0000 7fce5ba77700 1 -- 172.21.15.135:0/3098904627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fce5406afa0 con 0x7fce541014e0 2024-04-20T12:20:51.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.261+0000 7fce4affd700 1 -- 172.21.15.135:0/3098904627 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fce5009df70 con 0x7fce541014e0 2024-04-20T12:20:51.261 INFO:teuthology.orchestra.run.smithi135.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-20T12:20:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.264+0000 7fce5ba77700 1 -- 172.21.15.135:0/3098904627 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fce400a3cc0 msgr2=0x7fce400a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.264+0000 7fce5ba77700 1 --2- 172.21.15.135:0/3098904627 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fce400a3cc0 0x7fce400a6180 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fce540ffc80 tx=0x7fce44009260 comp rx=0 tx=0).stop 2024-04-20T12:20:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.264+0000 7fce5ba77700 1 -- 172.21.15.135:0/3098904627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce541014e0 msgr2=0x7fce5419b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.264+0000 7fce5ba77700 1 --2- 172.21.15.135:0/3098904627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce541014e0 0x7fce5419b600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce50000c00 tx=0x7fce5000bab0 comp rx=0 tx=0).stop 2024-04-20T12:20:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.264+0000 7fce5ba77700 1 -- 172.21.15.135:0/3098904627 shutdown_connections 2024-04-20T12:20:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.264+0000 7fce5ba77700 1 --2- 172.21.15.135:0/3098904627 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fce400a3cc0 0x7fce400a6180 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.264+0000 7fce5ba77700 1 --2- 172.21.15.135:0/3098904627 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce5410f720 0x7fce5419fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.264+0000 7fce5ba77700 1 --2- 172.21.15.135:0/3098904627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce541014e0 0x7fce5419b600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.264+0000 7fce5ba77700 1 --2- 172.21.15.135:0/3098904627 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce54103b90 0x7fce5419bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.264+0000 7fce5ba77700 1 -- 172.21.15.135:0/3098904627 >> 172.21.15.135:0/3098904627 conn(0x7fce54077f50 msgr2=0x7fce54110b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.264+0000 7fce5ba77700 1 -- 172.21.15.135:0/3098904627 shutdown_connections 2024-04-20T12:20:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:51.264+0000 7fce5ba77700 1 -- 172.21.15.135:0/3098904627 wait complete. 2024-04-20T12:20:51.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:51 smithi135 ceph-mon[18264]: pgmap v297: 129 pgs: 2 creating+activating, 127 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-20T12:20:51.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:51 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3098904627' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-20T12:20:51.674 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:51 smithi139 ceph-mon[21834]: pgmap v297: 129 pgs: 2 creating+activating, 127 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-20T12:20:51.674 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:51 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3098904627' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-20T12:20:51.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:51 smithi154 ceph-mon[22073]: pgmap v297: 129 pgs: 2 creating+activating, 127 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-04-20T12:20:51.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:51 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3098904627' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-20T12:20:52.011 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-20T12:20:52.012 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-20T12:20:52.012 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2024-04-20T12:20:52.012 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-20T12:20:52.012 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-20T12:20:52.012 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-20T12:20:52.012 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-20T12:20:52.012 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-20T12:20:52.012 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-20T12:20:52.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:20:52.012 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2024-04-20T12:20:52.028 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T12:20:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T12:20:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T12:20:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-04-20T12:20:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-04-20T12:20:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-04-20T12:20:52.029 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T12:20:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2024-04-20T12:20:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2024-04-20T12:20:52.029 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T12:20:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2024-04-20T12:20:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2024-04-20T12:20:52.029 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T12:20:52.029 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2024-04-20T12:20:52.029 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-20T12:20:52.030 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2024-04-20T12:20:52.030 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-20T12:20:52.030 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42281sec preferred_lft 42281sec 2024-04-20T12:20:52.030 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::cde4:bb11:2417:569c/64 scope link noprefixroute 2024-04-20T12:20:52.030 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-04-20T12:20:52.031 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-20T12:20:52.031 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T12:20:52.031 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-04-20T12:20:52.031 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2024-04-20T12:20:52.031 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2024-04-20T12:20:52.031 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2024-04-20T12:20:52.031 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-20T12:20:52.031 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-04-20T12:20:52.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T12:20:52.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:20:52.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:20:52.227 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-20T12:20:52.250 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-04-20T12:20:52.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:20:52.252 DEBUG:teuthology.orchestra.run.smithi135:> route 2024-04-20T12:20:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2024-04-20T12:20:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-20T12:20:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-20T12:20:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-20T12:20:52.327 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-20T12:20:52.327 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T12:20:52.328 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-04-20T12:20:52.328 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-20T12:20:52.328 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-20T12:20:52.328 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-20T12:20:52.328 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-04-20T12:20:52.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T12:20:52.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:20:52.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:20:52.593 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-04-20T12:20:52.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:20:52.608 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2024-04-20T12:20:52.662 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T12:20:52.662 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-04-20T12:20:52.662 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-20T12:20:52.663 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-20T12:20:52.663 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-04-20T12:20:52.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T12:20:52.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:20:52.778 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-20T12:20:52.778 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T12:20:52.778 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-04-20T12:20:52.778 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-20T12:20:52.778 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-20T12:20:52.779 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-20T12:20:52.779 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-20T12:20:52.779 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-20T12:20:52.779 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-04-20T12:20:52.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T12:20:52.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:20:52.894 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T12:20:52.895 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-04-20T12:20:52.895 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2024-04-20T12:20:52.895 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2024-04-20T12:20:52.895 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-04-20T12:20:52.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T12:20:52.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:20:52.969 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-20T12:20:52.969 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T12:20:52.969 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-20T12:20:52.993 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-20T12:20:52.994 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T12:20:52.994 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-20T12:20:53.048 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-04-20T12:20:53.113 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T12:20:53.168 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2024-04-20T12:20:53.168 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2024-04-20T12:20:53.168 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2024-04-20T12:20:53.168 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2024-04-20T12:20:53.168 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2024-04-20T12:20:53.168 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2024-04-20T12:20:53.168 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2024-04-20T12:20:53.168 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2024-04-20T12:20:53.168 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2024-04-20T12:20:53.168 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2024-04-20T12:20:53.168 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2024-04-20T12:20:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2024-04-20T12:20:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T12:20:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2024-04-20T12:20:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2024-04-20T12:20:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2024-04-20T12:20:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2024-04-20T12:20:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysusers.service 2024-04-20T12:20:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2024-04-20T12:20:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2024-04-20T12:20:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T12:20:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T12:20:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T12:20:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T12:20:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2024-04-20T12:20:53.169 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2024-04-20T12:20:53.170 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay 2024-04-20T12:20:53.170 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/c992db4c6a4a13d50f7e3adfeb723b2bc2d502cd3ccd54d80311f67a9069953e/merged 2024-04-20T12:20:53.170 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/e030c95a6f1367359bc3844a5ef10049b8d09bcd7a243b883367b908a2076cf1/merged 2024-04-20T12:20:53.170 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/0 2024-04-20T12:20:53.170 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T12:20:53.170 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/9b69caf631467c1fa4edf9f3684278e94dec11c6b5912ed112709a72f9f5c14a/merged 2024-04-20T12:20:53.170 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/d8513dc33652b07e304cc9591965fbcc7050dc1eced407a84293431fb18423ac/merged 2024-04-20T12:20:53.170 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/bccf42f9a295ebefcdba8b93f95161a2d7ea94afbcf06e5a1c67cb955b83385b/merged 2024-04-20T12:20:53.170 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/9ae76de13d888129930777081a24f32501a40c7028d323da26e20ee23c13e837/merged 2024-04-20T12:20:53.170 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/731f08a872b2a14c0c7dcda148637885c97dc124c411d7342a191359792d1af6/merged 2024-04-20T12:20:53.170 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/5693c26527ee33f3519a8074348a64406e88a6b1f995c7f485a181ad4869a57d/merged 2024-04-20T12:20:53.170 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/2d2f90c9568d4a52d06c40a8cebacad70e98258b5490086ddbde20e120a0d14b/merged 2024-04-20T12:20:53.170 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/5992eabff11350f9c60737a33e7a29e4d2471900740133dbc9503d4d179f93ea/merged 2024-04-20T12:20:53.170 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2024-04-20T12:20:53.171 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-20T12:20:53.171 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-20T12:20:53.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:20:53.171 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-04-20T12:20:53.222 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-20T12:20:53.222 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-20T12:20:53.265 DEBUG:teuthology.orchestra.run.smithi135:> sudo modprobe fuse 2024-04-20T12:20:53.288 DEBUG:teuthology.orchestra.run.smithi135:> cat /proc/self/mounts | awk '{print $2}' 2024-04-20T12:20:53.343 INFO:teuthology.orchestra.run.smithi135.stdout:/proc 2024-04-20T12:20:53.343 INFO:teuthology.orchestra.run.smithi135.stdout:/sys 2024-04-20T12:20:53.343 INFO:teuthology.orchestra.run.smithi135.stdout:/dev 2024-04-20T12:20:53.345 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/security 2024-04-20T12:20:53.345 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/shm 2024-04-20T12:20:53.345 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/pts 2024-04-20T12:20:53.345 INFO:teuthology.orchestra.run.smithi135.stdout:/run 2024-04-20T12:20:53.345 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/cgroup 2024-04-20T12:20:53.345 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/pstore 2024-04-20T12:20:53.345 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/bpf 2024-04-20T12:20:53.345 INFO:teuthology.orchestra.run.smithi135.stdout:/ 2024-04-20T12:20:53.345 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/selinux 2024-04-20T12:20:53.345 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T12:20:53.345 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/mqueue 2024-04-20T12:20:53.346 INFO:teuthology.orchestra.run.smithi135.stdout:/dev/hugepages 2024-04-20T12:20:53.346 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/debug 2024-04-20T12:20:53.346 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/tracing 2024-04-20T12:20:53.346 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysusers.service 2024-04-20T12:20:53.346 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/kernel/config 2024-04-20T12:20:53.346 INFO:teuthology.orchestra.run.smithi135.stdout:/sys/fs/fuse/connections 2024-04-20T12:20:53.346 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-sysctl.service 2024-04-20T12:20:53.346 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-20T12:20:53.346 INFO:teuthology.orchestra.run.smithi135.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-20T12:20:53.346 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/nfs/rpc_pipefs 2024-04-20T12:20:53.346 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/1000 2024-04-20T12:20:53.346 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/ceph 2024-04-20T12:20:53.346 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay 2024-04-20T12:20:53.346 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/c992db4c6a4a13d50f7e3adfeb723b2bc2d502cd3ccd54d80311f67a9069953e/merged 2024-04-20T12:20:53.346 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/e030c95a6f1367359bc3844a5ef10049b8d09bcd7a243b883367b908a2076cf1/merged 2024-04-20T12:20:53.347 INFO:teuthology.orchestra.run.smithi135.stdout:/run/user/0 2024-04-20T12:20:53.347 INFO:teuthology.orchestra.run.smithi135.stdout:/proc/sys/fs/binfmt_misc 2024-04-20T12:20:53.347 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/9b69caf631467c1fa4edf9f3684278e94dec11c6b5912ed112709a72f9f5c14a/merged 2024-04-20T12:20:53.347 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/d8513dc33652b07e304cc9591965fbcc7050dc1eced407a84293431fb18423ac/merged 2024-04-20T12:20:53.347 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/bccf42f9a295ebefcdba8b93f95161a2d7ea94afbcf06e5a1c67cb955b83385b/merged 2024-04-20T12:20:53.347 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/9ae76de13d888129930777081a24f32501a40c7028d323da26e20ee23c13e837/merged 2024-04-20T12:20:53.347 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/731f08a872b2a14c0c7dcda148637885c97dc124c411d7342a191359792d1af6/merged 2024-04-20T12:20:53.347 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/5693c26527ee33f3519a8074348a64406e88a6b1f995c7f485a181ad4869a57d/merged 2024-04-20T12:20:53.347 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/2d2f90c9568d4a52d06c40a8cebacad70e98258b5490086ddbde20e120a0d14b/merged 2024-04-20T12:20:53.347 INFO:teuthology.orchestra.run.smithi135.stdout:/var/lib/containers/storage/overlay/5992eabff11350f9c60737a33e7a29e4d2471900740133dbc9503d4d179f93ea/merged 2024-04-20T12:20:53.347 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns 2024-04-20T12:20:53.347 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-20T12:20:53.347 INFO:teuthology.orchestra.run.smithi135.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-20T12:20:53.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:20:53.348 DEBUG:teuthology.orchestra.run.smithi135:> ls /sys/fs/fuse/connections 2024-04-20T12:20:53.355 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi135.stderr:2024-04-20T12:20:53.355+0000 7f60d1638480 -1 init, newargv = 0x560abe812020 newargc=15 2024-04-20T12:20:53.355 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi135.stderr:ceph-fuse[59857]: starting ceph client 2024-04-20T12:20:53.361 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi135.stderr:ceph-fuse[59857]: starting fuse 2024-04-20T12:20:53.370 INFO:teuthology.orchestra.run.smithi135.stdout:115 2024-04-20T12:20:53.370 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [115] 2024-04-20T12:20:53.370 DEBUG:teuthology.orchestra.run.smithi135:> sudo stdin-killer -- python3 -c ' 2024-04-20T12:20:53.370 DEBUG:teuthology.orchestra.run.smithi135:> import glob 2024-04-20T12:20:53.370 DEBUG:teuthology.orchestra.run.smithi135:> import re 2024-04-20T12:20:53.370 DEBUG:teuthology.orchestra.run.smithi135:> import os 2024-04-20T12:20:53.370 DEBUG:teuthology.orchestra.run.smithi135:> import subprocess 2024-04-20T12:20:53.370 DEBUG:teuthology.orchestra.run.smithi135:> 2024-04-20T12:20:53.370 DEBUG:teuthology.orchestra.run.smithi135:> def _find_admin_socket(client_name): 2024-04-20T12:20:53.370 DEBUG:teuthology.orchestra.run.smithi135:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> files = glob.glob(asok_path) 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> # Given a non-glob path, it better be there 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> if "*" not in asok_path: 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> assert(len(files) == 1) 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> return files[0] 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> for f in files: 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> contents = proc_f.read() 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> if mountpoint in contents: 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> return f 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-20T12:20:53.371 DEBUG:teuthology.orchestra.run.smithi135:> 2024-04-20T12:20:53.372 DEBUG:teuthology.orchestra.run.smithi135:> print(_find_admin_socket("client.admin")) 2024-04-20T12:20:53.372 DEBUG:teuthology.orchestra.run.smithi135:> ' 2024-04-20T12:20:53.487 INFO:teuthology.orchestra.run.smithi135.stdout:/var/run/ceph/ceph-client.admin.59857.asok 2024-04-20T12:20:53.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:20:53.497 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.59857.asok 2024-04-20T12:20:53.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:20:53.497 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.59857.asok status 2024-04-20T12:20:53.631 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:20:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: "metadata": { 2024-04-20T12:20:53.631 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_sha1": "a8c84f5997950fd7d008204839253291d52e6eda", 2024-04-20T12:20:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 19.0.0-3133-ga8c84f59 (a8c84f5997950fd7d008204839253291d52e6eda) squid (dev)", 2024-04-20T12:20:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "entity_id": "admin", 2024-04-20T12:20:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": "smithi135", 2024-04-20T12:20:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-20T12:20:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "pid": "59857", 2024-04-20T12:20:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "root": "/" 2024-04-20T12:20:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:20:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_count": 0, 2024-04-20T12:20:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "dentry_pinned_count": 0, 2024-04-20T12:20:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 14778, 2024-04-20T12:20:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "inst": { 2024-04-20T12:20:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "name": { 2024-04-20T12:20:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "client", 2024-04-20T12:20:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: "num": 14778 2024-04-20T12:20:53.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 476459713 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": { 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "192.168.0.1:0", 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 476459713 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "inst_str": "client.14778 192.168.0.1:0/476459713", 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "addr_str": "192.168.0.1:0/476459713", 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "inode_count": 1, 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_epoch": 17, 2024-04-20T12:20:53.633 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch": 90, 2024-04-20T12:20:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_epoch_barrier": 0, 2024-04-20T12:20:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: "blocklisted": false, 2024-04-20T12:20:53.634 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs" 2024-04-20T12:20:53.634 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:20:53.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:20:53.640 DEBUG:teuthology.orchestra.run.smithi135:> stat --file-system '--printf=%T 2024-04-20T12:20:53.640 DEBUG:teuthology.orchestra.run.smithi135:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-20T12:20:53.655 INFO:teuthology.orchestra.run.smithi135.stdout:fuseblk 2024-04-20T12:20:53.655 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-20T12:20:53.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:20:53.655 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-20T12:20:53.720 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-20T12:20:53.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-20T12:20:53.829 INFO:teuthology.orchestra.run.smithi135.stdout:# file: . 2024-04-20T12:20:53.829 INFO:teuthology.orchestra.run.smithi135.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-20T12:20:53.829 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:53.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:20:53.835 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:20:53.835 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T12:20:53.851 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:20:53.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.990+0000 7fab00477640 1 -- 172.21.15.135:0/3517086033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf8105360 msgr2=0x7faaf8107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:53.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.990+0000 7fab00477640 1 --2- 172.21.15.135:0/3517086033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf8105360 0x7faaf8107750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faaf4009900 tx=0x7faaf402bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:53.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.990+0000 7fab00477640 1 -- 172.21.15.135:0/3517086033 shutdown_connections 2024-04-20T12:20:53.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.990+0000 7fab00477640 1 --2- 172.21.15.135:0/3517086033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaf8107c90 0x7faaf810a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:53.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.990+0000 7fab00477640 1 --2- 172.21.15.135:0/3517086033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf8105360 0x7faaf8107750 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:53.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.990+0000 7fab00477640 1 --2- 172.21.15.135:0/3517086033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf8102a30 0x7faaf8104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:53.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.990+0000 7fab00477640 1 -- 172.21.15.135:0/3517086033 >> 172.21.15.135:0/3517086033 conn(0x7faaf80fc440 msgr2=0x7faaf80fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:53.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.990+0000 7fab00477640 1 -- 172.21.15.135:0/3517086033 shutdown_connections 2024-04-20T12:20:53.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.990+0000 7fab00477640 1 -- 172.21.15.135:0/3517086033 wait complete. 2024-04-20T12:20:53.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.990+0000 7fab00477640 1 Processor -- start 2024-04-20T12:20:53.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7fab00477640 1 -- start start 2024-04-20T12:20:53.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7fab00477640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaf8102a30 0x7faaf8198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:53.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7fab00477640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf8105360 0x7faaf8198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:53.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7fab00477640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf8107c90 0x7faaf819f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:53.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7fab00477640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faaf810dc40 con 0x7faaf8105360 2024-04-20T12:20:53.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7fab00477640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faaf810dac0 con 0x7faaf8102a30 2024-04-20T12:20:53.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7fab00477640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faaf810ddc0 con 0x7faaf8107c90 2024-04-20T12:20:53.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7faafda12640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf8105360 0x7faaf8198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:53.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7faafda12640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf8105360 0x7faaf8198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44690/0 (socket says 172.21.15.135:44690) 2024-04-20T12:20:53.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7faafda12640 1 -- 172.21.15.135:0/3524891744 learned_addr learned my addr 172.21.15.135:0/3524891744 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:53.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7faafea14640 1 --2- 172.21.15.135:0/3524891744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf8107c90 0x7faaf819f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:53.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7faafe213640 1 --2- 172.21.15.135:0/3524891744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaf8102a30 0x7faaf8198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:53.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7faafda12640 1 -- 172.21.15.135:0/3524891744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf8107c90 msgr2=0x7faaf819f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:53.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7faafda12640 1 --2- 172.21.15.135:0/3524891744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf8107c90 0x7faaf819f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:53.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7faafda12640 1 -- 172.21.15.135:0/3524891744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaf8102a30 msgr2=0x7faaf8198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:53.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7faafda12640 1 --2- 172.21.15.135:0/3524891744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaf8102a30 0x7faaf8198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:53.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7faafda12640 1 -- 172.21.15.135:0/3524891744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf819ff20 con 0x7faaf8105360 2024-04-20T12:20:53.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7faafe213640 1 --2- 172.21.15.135:0/3524891744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaf8102a30 0x7faaf8198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:20:53.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7faafda12640 1 --2- 172.21.15.135:0/3524891744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf8105360 0x7faaf8198840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faaf4005ab0 tx=0x7faaf4005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:53.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7faaef7fe640 1 -- 172.21.15.135:0/3524891744 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf4041070 con 0x7faaf8105360 2024-04-20T12:20:53.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7faaef7fe640 1 -- 172.21.15.135:0/3524891744 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faaf40054e0 con 0x7faaf8105360 2024-04-20T12:20:53.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7fab00477640 1 -- 172.21.15.135:0/3524891744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf81a01b0 con 0x7faaf8105360 2024-04-20T12:20:53.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7faaef7fe640 1 -- 172.21.15.135:0/3524891744 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf4034440 con 0x7faaf8105360 2024-04-20T12:20:53.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.991+0000 7fab00477640 1 -- 172.21.15.135:0/3524891744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf81a06a0 con 0x7faaf8105360 2024-04-20T12:20:53.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.992+0000 7fab00477640 1 -- 172.21.15.135:0/3524891744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf80fdf30 con 0x7faaf8105360 2024-04-20T12:20:53.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.994+0000 7faaef7fe640 1 -- 172.21.15.135:0/3524891744 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7faaf4044070 con 0x7faaf8105360 2024-04-20T12:20:53.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.994+0000 7faaef7fe640 1 --2- 172.21.15.135:0/3524891744 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faae40a3bb0 0x7faae40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:53.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.994+0000 7faafe213640 1 --2- 172.21.15.135:0/3524891744 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faae40a3bb0 0x7faae40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:53.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.994+0000 7faaef7fe640 1 -- 172.21.15.135:0/3524891744 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7faaf40f2480 con 0x7faaf8105360 2024-04-20T12:20:53.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.995+0000 7faafe213640 1 --2- 172.21.15.135:0/3524891744 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faae40a3bb0 0x7faae40a6070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faae8009b40 tx=0x7faae8005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:53.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:53.998+0000 7faaef7fe640 1 -- 172.21.15.135:0/3524891744 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7faaf40bec20 con 0x7faaf8105360 2024-04-20T12:20:54.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:53 smithi135 ceph-mon[18264]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 315 B/s wr, 1 op/s 2024-04-20T12:20:54.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.177+0000 7fab00477640 1 -- 172.21.15.135:0/3524891744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faaf802d7a0 con 0x7faaf8105360 2024-04-20T12:20:54.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.178+0000 7faaef7fe640 1 -- 172.21.15.135:0/3524891744 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24173 (secure 0 0 0) 0x7faaf40be520 con 0x7faaf8105360 2024-04-20T12:20:54.178 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:54.179 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":90,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:20:48.315252+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:20:54.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.180+0000 7fab00477640 1 -- 172.21.15.135:0/3524891744 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faae40a3bb0 msgr2=0x7faae40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:54.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.180+0000 7fab00477640 1 --2- 172.21.15.135:0/3524891744 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faae40a3bb0 0x7faae40a6070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faae8009b40 tx=0x7faae8005e50 comp rx=0 tx=0).stop 2024-04-20T12:20:54.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.180+0000 7fab00477640 1 -- 172.21.15.135:0/3524891744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf8105360 msgr2=0x7faaf8198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:54.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.180+0000 7fab00477640 1 --2- 172.21.15.135:0/3524891744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf8105360 0x7faaf8198840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faaf4005ab0 tx=0x7faaf4005dc0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.180+0000 7fab00477640 1 -- 172.21.15.135:0/3524891744 shutdown_connections 2024-04-20T12:20:54.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.180+0000 7fab00477640 1 --2- 172.21.15.135:0/3524891744 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faae40a3bb0 0x7faae40a6070 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.180+0000 7fab00477640 1 --2- 172.21.15.135:0/3524891744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaf8107c90 0x7faaf819f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.180+0000 7fab00477640 1 --2- 172.21.15.135:0/3524891744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faaf8105360 0x7faaf8198840 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.180+0000 7fab00477640 1 --2- 172.21.15.135:0/3524891744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faaf8102a30 0x7faaf8198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.180+0000 7fab00477640 1 -- 172.21.15.135:0/3524891744 >> 172.21.15.135:0/3524891744 conn(0x7faaf80fc440 msgr2=0x7faaf8103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:54.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.180+0000 7fab00477640 1 -- 172.21.15.135:0/3524891744 shutdown_connections 2024-04-20T12:20:54.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.180+0000 7fab00477640 1 -- 172.21.15.135:0/3524891744 wait complete. 2024-04-20T12:20:54.191 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T12:16:02.802023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T12:20:39.656129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T12:20:40.312827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T12:20:44.307136+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T12:20:54.192 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T12:20:54.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:53 smithi154 ceph-mon[22073]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 315 B/s wr, 1 op/s 2024-04-20T12:20:54.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.293+0000 7f137871e640 1 -- 172.21.15.135:0/3553961855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13701029b0 msgr2=0x7f13701092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:54.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.293+0000 7f137871e640 1 --2- 172.21.15.135:0/3553961855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13701029b0 0x7f13701092d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1368009900 tx=0x7f136802bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:54.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.293+0000 7f137871e640 1 -- 172.21.15.135:0/3553961855 shutdown_connections 2024-04-20T12:20:54.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.293+0000 7f137871e640 1 --2- 172.21.15.135:0/3553961855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f13701029b0 0x7f13701092d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.293+0000 7f137871e640 1 --2- 172.21.15.135:0/3553961855 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1370101ff0 0x7f1370102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.293+0000 7f137871e640 1 --2- 172.21.15.135:0/3553961855 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1370100ea0 0x7f13701012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.293+0000 7f137871e640 1 -- 172.21.15.135:0/3553961855 >> 172.21.15.135:0/3553961855 conn(0x7f13700fc410 msgr2=0x7f13700fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:54.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.293+0000 7f137871e640 1 -- 172.21.15.135:0/3553961855 shutdown_connections 2024-04-20T12:20:54.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.293+0000 7f137871e640 1 -- 172.21.15.135:0/3553961855 wait complete. 2024-04-20T12:20:54.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.293+0000 7f137871e640 1 Processor -- start 2024-04-20T12:20:54.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f137871e640 1 -- start start 2024-04-20T12:20:54.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f137871e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1370100ea0 0x7f1370198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:54.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f137871e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370101ff0 0x7f1370198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:54.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f137871e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13701029b0 0x7f137019f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:54.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f137871e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f137010cb50 con 0x7f1370101ff0 2024-04-20T12:20:54.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f137871e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f137010c9d0 con 0x7f13701029b0 2024-04-20T12:20:54.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f137871e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f137010ccd0 con 0x7f1370100ea0 2024-04-20T12:20:54.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f1375cb9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370101ff0 0x7f1370198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:54.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f1375cb9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370101ff0 0x7f1370198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44716/0 (socket says 172.21.15.135:44716) 2024-04-20T12:20:54.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f1375cb9640 1 -- 172.21.15.135:0/2586589123 learned_addr learned my addr 172.21.15.135:0/2586589123 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:54.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f13764ba640 1 --2- 172.21.15.135:0/2586589123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1370100ea0 0x7f1370198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:54.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f1376cbb640 1 --2- 172.21.15.135:0/2586589123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13701029b0 0x7f137019f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:54.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f1375cb9640 1 -- 172.21.15.135:0/2586589123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1370100ea0 msgr2=0x7f1370198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:54.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f1375cb9640 1 --2- 172.21.15.135:0/2586589123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1370100ea0 0x7f1370198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f1375cb9640 1 -- 172.21.15.135:0/2586589123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13701029b0 msgr2=0x7f137019f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:54.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f1375cb9640 1 --2- 172.21.15.135:0/2586589123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13701029b0 0x7f137019f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f1375cb9640 1 -- 172.21.15.135:0/2586589123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137019fe20 con 0x7f1370101ff0 2024-04-20T12:20:54.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f1376cbb640 1 --2- 172.21.15.135:0/2586589123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13701029b0 0x7f137019f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:20:54.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f1375cb9640 1 --2- 172.21.15.135:0/2586589123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370101ff0 0x7f1370198740 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f136000c970 tx=0x7f136000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:54.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f13677fe640 1 -- 172.21.15.135:0/2586589123 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360007c10 con 0x7f1370101ff0 2024-04-20T12:20:54.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f137871e640 1 -- 172.21.15.135:0/2586589123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13701a0110 con 0x7f1370101ff0 2024-04-20T12:20:54.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f13677fe640 1 -- 172.21.15.135:0/2586589123 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1360007db0 con 0x7f1370101ff0 2024-04-20T12:20:54.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.294+0000 7f13677fe640 1 -- 172.21.15.135:0/2586589123 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136000f8a0 con 0x7f1370101ff0 2024-04-20T12:20:54.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.295+0000 7f137871e640 1 -- 172.21.15.135:0/2586589123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13701a06b0 con 0x7f1370101ff0 2024-04-20T12:20:54.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.295+0000 7f137871e640 1 -- 172.21.15.135:0/2586589123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13701a0970 con 0x7f1370101ff0 2024-04-20T12:20:54.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.297+0000 7f13677fe640 1 -- 172.21.15.135:0/2586589123 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f136000fa60 con 0x7f1370101ff0 2024-04-20T12:20:54.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.297+0000 7f13677fe640 1 --2- 172.21.15.135:0/2586589123 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f135c0a3bb0 0x7f135c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:54.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.297+0000 7f13764ba640 1 --2- 172.21.15.135:0/2586589123 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f135c0a3bb0 0x7f135c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:54.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.297+0000 7f13677fe640 1 -- 172.21.15.135:0/2586589123 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f13600d0bf0 con 0x7f1370101ff0 2024-04-20T12:20:54.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.298+0000 7f13764ba640 1 --2- 172.21.15.135:0/2586589123 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f135c0a3bb0 0x7f135c0a6070 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f136c005fd0 tx=0x7f136c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:54.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.301+0000 7f13677fe640 1 -- 172.21.15.135:0/2586589123 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f136009d4b0 con 0x7f1370101ff0 2024-04-20T12:20:54.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:53 smithi139 ceph-mon[21834]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 315 B/s wr, 1 op/s 2024-04-20T12:20:54.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.483+0000 7f137871e640 1 -- 172.21.15.135:0/2586589123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f13701a0b40 con 0x7f1370101ff0 2024-04-20T12:20:54.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.483+0000 7f13677fe640 1 -- 172.21.15.135:0/2586589123 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f136009cdb0 con 0x7f1370101ff0 2024-04-20T12:20:54.483 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-04-20T12:20:54.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.485+0000 7f137871e640 1 -- 172.21.15.135:0/2586589123 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f135c0a3bb0 msgr2=0x7f135c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:54.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.485+0000 7f137871e640 1 --2- 172.21.15.135:0/2586589123 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f135c0a3bb0 0x7f135c0a6070 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f136c005fd0 tx=0x7f136c009500 comp rx=0 tx=0).stop 2024-04-20T12:20:54.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.485+0000 7f137871e640 1 -- 172.21.15.135:0/2586589123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370101ff0 msgr2=0x7f1370198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:54.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.485+0000 7f137871e640 1 --2- 172.21.15.135:0/2586589123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370101ff0 0x7f1370198740 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f136000c970 tx=0x7f136000ce30 comp rx=0 tx=0).stop 2024-04-20T12:20:54.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.485+0000 7f137871e640 1 -- 172.21.15.135:0/2586589123 shutdown_connections 2024-04-20T12:20:54.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.485+0000 7f137871e640 1 --2- 172.21.15.135:0/2586589123 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f135c0a3bb0 0x7f135c0a6070 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.485+0000 7f137871e640 1 --2- 172.21.15.135:0/2586589123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f13701029b0 0x7f137019f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.485+0000 7f137871e640 1 --2- 172.21.15.135:0/2586589123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1370101ff0 0x7f1370198740 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.485+0000 7f137871e640 1 --2- 172.21.15.135:0/2586589123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1370100ea0 0x7f1370198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.485+0000 7f137871e640 1 -- 172.21.15.135:0/2586589123 >> 172.21.15.135:0/2586589123 conn(0x7f13700fc410 msgr2=0x7f13700fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:54.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.485+0000 7f137871e640 1 -- 172.21.15.135:0/2586589123 shutdown_connections 2024-04-20T12:20:54.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.485+0000 7f137871e640 1 -- 172.21.15.135:0/2586589123 wait complete. 2024-04-20T12:20:54.496 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T12:20:54.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.598+0000 7f1d5ae06640 1 -- 172.21.15.135:0/438366331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d541029b0 msgr2=0x7f1d541092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:54.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.598+0000 7f1d5ae06640 1 --2- 172.21.15.135:0/438366331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d541029b0 0x7f1d541092d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009ca0 tx=0x7f1d4c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.598+0000 7f1d5ae06640 1 -- 172.21.15.135:0/438366331 shutdown_connections 2024-04-20T12:20:54.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.598+0000 7f1d5ae06640 1 --2- 172.21.15.135:0/438366331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d541029b0 0x7f1d541092d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.598+0000 7f1d5ae06640 1 --2- 172.21.15.135:0/438366331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d54101ff0 0x7f1d54102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.598+0000 7f1d5ae06640 1 --2- 172.21.15.135:0/438366331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d54100ea0 0x7f1d541012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.598+0000 7f1d5ae06640 1 -- 172.21.15.135:0/438366331 >> 172.21.15.135:0/438366331 conn(0x7f1d540fc410 msgr2=0x7f1d540fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:54.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.598+0000 7f1d5ae06640 1 -- 172.21.15.135:0/438366331 shutdown_connections 2024-04-20T12:20:54.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.598+0000 7f1d5ae06640 1 -- 172.21.15.135:0/438366331 wait complete. 2024-04-20T12:20:54.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.598+0000 7f1d5ae06640 1 Processor -- start 2024-04-20T12:20:54.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d5ae06640 1 -- start start 2024-04-20T12:20:54.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d5ae06640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d54100ea0 0x7f1d54198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:54.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d5ae06640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d54101ff0 0x7f1d541987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:54.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d5ae06640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d541029b0 0x7f1d5419f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:54.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d5ae06640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5410dc90 con 0x7f1d541029b0 2024-04-20T12:20:54.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d5ae06640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5410db10 con 0x7f1d54100ea0 2024-04-20T12:20:54.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d5ae06640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5410de10 con 0x7f1d54101ff0 2024-04-20T12:20:54.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d593a3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d541029b0 0x7f1d5419f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:54.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d593a3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d541029b0 0x7f1d5419f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44730/0 (socket says 172.21.15.135:44730) 2024-04-20T12:20:54.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d593a3640 1 -- 172.21.15.135:0/517710322 learned_addr learned my addr 172.21.15.135:0/517710322 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:54.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d58ba2640 1 --2- 172.21.15.135:0/517710322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d54100ea0 0x7f1d54198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:54.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d593a3640 1 -- 172.21.15.135:0/517710322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d54101ff0 msgr2=0x7f1d541987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:54.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d593a3640 1 --2- 172.21.15.135:0/517710322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d54101ff0 0x7f1d541987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d593a3640 1 -- 172.21.15.135:0/517710322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d54100ea0 msgr2=0x7f1d54198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:54.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d593a3640 1 --2- 172.21.15.135:0/517710322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d54100ea0 0x7f1d54198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d593a3640 1 -- 172.21.15.135:0/517710322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5419feb0 con 0x7f1d541029b0 2024-04-20T12:20:54.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d58ba2640 1 --2- 172.21.15.135:0/517710322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d54100ea0 0x7f1d54198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:20:54.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d593a3640 1 --2- 172.21.15.135:0/517710322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d541029b0 0x7f1d5419f840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c02c700 tx=0x7f1d4c032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:54.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d51ffb640 1 -- 172.21.15.135:0/517710322 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c039040 con 0x7f1d541029b0 2024-04-20T12:20:54.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d51ffb640 1 -- 172.21.15.135:0/517710322 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d4c044070 con 0x7f1d541029b0 2024-04-20T12:20:54.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d5ae06640 1 -- 172.21.15.135:0/517710322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d541a0140 con 0x7f1d541029b0 2024-04-20T12:20:54.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.599+0000 7f1d51ffb640 1 -- 172.21.15.135:0/517710322 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c0042a0 con 0x7f1d541029b0 2024-04-20T12:20:54.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.600+0000 7f1d5ae06640 1 -- 172.21.15.135:0/517710322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d541a0680 con 0x7f1d541029b0 2024-04-20T12:20:54.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.600+0000 7f1d5ae06640 1 -- 172.21.15.135:0/517710322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d54108230 con 0x7f1d541029b0 2024-04-20T12:20:54.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.602+0000 7f1d51ffb640 1 -- 172.21.15.135:0/517710322 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f1d4c003970 con 0x7f1d541029b0 2024-04-20T12:20:54.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.602+0000 7f1d51ffb640 1 --2- 172.21.15.135:0/517710322 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1d440a3c30 0x7f1d440a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:54.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.602+0000 7f1d58ba2640 1 --2- 172.21.15.135:0/517710322 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1d440a3c30 0x7f1d440a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:54.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.602+0000 7f1d51ffb640 1 -- 172.21.15.135:0/517710322 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f1d4c0f2b80 con 0x7f1d541029b0 2024-04-20T12:20:54.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.603+0000 7f1d58ba2640 1 --2- 172.21.15.135:0/517710322 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1d440a3c30 0x7f1d440a60f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009b40 tx=0x7f1d48005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:54.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.607+0000 7f1d51ffb640 1 -- 172.21.15.135:0/517710322 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f1d4c0333a0 con 0x7f1d541029b0 2024-04-20T12:20:54.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.783+0000 7f1d5ae06640 1 -- 172.21.15.135:0/517710322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1d54062b60 con 0x7f1d541029b0 2024-04-20T12:20:54.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.783+0000 7f1d51ffb640 1 -- 172.21.15.135:0/517710322 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f1d4c0bf3b0 con 0x7f1d541029b0 2024-04-20T12:20:54.785 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:20:54.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.785+0000 7f1d5ae06640 1 -- 172.21.15.135:0/517710322 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1d440a3c30 msgr2=0x7f1d440a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:54.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.785+0000 7f1d5ae06640 1 --2- 172.21.15.135:0/517710322 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1d440a3c30 0x7f1d440a60f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009b40 tx=0x7f1d48005e50 comp rx=0 tx=0).stop 2024-04-20T12:20:54.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.785+0000 7f1d5ae06640 1 -- 172.21.15.135:0/517710322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d541029b0 msgr2=0x7f1d5419f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:54.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.785+0000 7f1d5ae06640 1 --2- 172.21.15.135:0/517710322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d541029b0 0x7f1d5419f840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c02c700 tx=0x7f1d4c032f20 comp rx=0 tx=0).stop 2024-04-20T12:20:54.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.785+0000 7f1d5ae06640 1 -- 172.21.15.135:0/517710322 shutdown_connections 2024-04-20T12:20:54.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.785+0000 7f1d5ae06640 1 --2- 172.21.15.135:0/517710322 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1d440a3c30 0x7f1d440a60f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.785+0000 7f1d5ae06640 1 --2- 172.21.15.135:0/517710322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d541029b0 0x7f1d5419f840 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.785+0000 7f1d5ae06640 1 --2- 172.21.15.135:0/517710322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1d54101ff0 0x7f1d541987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.785+0000 7f1d5ae06640 1 --2- 172.21.15.135:0/517710322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1d54100ea0 0x7f1d54198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.785+0000 7f1d5ae06640 1 -- 172.21.15.135:0/517710322 >> 172.21.15.135:0/517710322 conn(0x7f1d540fc410 msgr2=0x7f1d54105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:54.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.785+0000 7f1d5ae06640 1 -- 172.21.15.135:0/517710322 shutdown_connections 2024-04-20T12:20:54.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.785+0000 7f1d5ae06640 1 -- 172.21.15.135:0/517710322 wait complete. 2024-04-20T12:20:54.796 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T12:20:54.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.897+0000 7f9763323640 1 -- 172.21.15.135:0/4059927321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c107ca0 msgr2=0x7f975c10a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:54.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.897+0000 7f9763323640 1 --2- 172.21.15.135:0/4059927321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c107ca0 0x7f975c10a0f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9754009ca0 tx=0x7f975402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.897+0000 7f9763323640 1 -- 172.21.15.135:0/4059927321 shutdown_connections 2024-04-20T12:20:54.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.897+0000 7f9763323640 1 --2- 172.21.15.135:0/4059927321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c107ca0 0x7f975c10a0f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.897+0000 7f9763323640 1 --2- 172.21.15.135:0/4059927321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f975c105370 0x7f975c107760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.897+0000 7f9763323640 1 --2- 172.21.15.135:0/4059927321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f975c102a40 0x7f975c104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.897+0000 7f9763323640 1 -- 172.21.15.135:0/4059927321 >> 172.21.15.135:0/4059927321 conn(0x7f975c0fc450 msgr2=0x7f975c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:54.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.898+0000 7f9763323640 1 -- 172.21.15.135:0/4059927321 shutdown_connections 2024-04-20T12:20:54.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.898+0000 7f9763323640 1 -- 172.21.15.135:0/4059927321 wait complete. 2024-04-20T12:20:54.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.898+0000 7f9763323640 1 Processor -- start 2024-04-20T12:20:54.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.898+0000 7f9763323640 1 -- start start 2024-04-20T12:20:54.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.898+0000 7f9763323640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f975c102a40 0x7f975c1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.898+0000 7f9763323640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c105370 0x7f975c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.898+0000 7f9763323640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f975c107ca0 0x7f975c19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.898+0000 7f9763323640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f975c10dc50 con 0x7f975c105370 2024-04-20T12:20:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.898+0000 7f9763323640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f975c10dad0 con 0x7f975c107ca0 2024-04-20T12:20:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.898+0000 7f9763323640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f975c10ddd0 con 0x7f975c102a40 2024-04-20T12:20:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.898+0000 7f97608be640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c105370 0x7f975c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.898+0000 7f97608be640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c105370 0x7f975c1987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44744/0 (socket says 172.21.15.135:44744) 2024-04-20T12:20:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.898+0000 7f97608be640 1 -- 172.21.15.135:0/2589451081 learned_addr learned my addr 172.21.15.135:0/2589451081 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.898+0000 7f97610bf640 1 --2- 172.21.15.135:0/2589451081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f975c102a40 0x7f975c1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.898+0000 7f97618c0640 1 --2- 172.21.15.135:0/2589451081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f975c107ca0 0x7f975c19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.899+0000 7f97608be640 1 -- 172.21.15.135:0/2589451081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f975c102a40 msgr2=0x7f975c1982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.899+0000 7f97608be640 1 --2- 172.21.15.135:0/2589451081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f975c102a40 0x7f975c1982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.899+0000 7f97608be640 1 -- 172.21.15.135:0/2589451081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f975c107ca0 msgr2=0x7f975c19f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.899+0000 7f97608be640 1 --2- 172.21.15.135:0/2589451081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f975c107ca0 0x7f975c19f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:54.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.899+0000 7f97608be640 1 -- 172.21.15.135:0/2589451081 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c19fec0 con 0x7f975c105370 2024-04-20T12:20:54.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.899+0000 7f97608be640 1 --2- 172.21.15.135:0/2589451081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c105370 0x7f975c1987e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f974c00d740 tx=0x7f974c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:54.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.899+0000 7f97527fc640 1 -- 172.21.15.135:0/2589451081 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c017070 con 0x7f975c105370 2024-04-20T12:20:54.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.899+0000 7f97527fc640 1 -- 172.21.15.135:0/2589451081 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f974c00de50 con 0x7f975c105370 2024-04-20T12:20:54.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.899+0000 7f9763323640 1 -- 172.21.15.135:0/2589451081 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975c1a01b0 con 0x7f975c105370 2024-04-20T12:20:54.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.899+0000 7f97527fc640 1 -- 172.21.15.135:0/2589451081 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c004e00 con 0x7f975c105370 2024-04-20T12:20:54.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.899+0000 7f9763323640 1 -- 172.21.15.135:0/2589451081 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f975c1a06b0 con 0x7f975c105370 2024-04-20T12:20:54.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.900+0000 7f9763323640 1 -- 172.21.15.135:0/2589451081 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f975c0fdf40 con 0x7f975c105370 2024-04-20T12:20:54.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.901+0000 7f97527fc640 1 -- 172.21.15.135:0/2589451081 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f974c004fa0 con 0x7f975c105370 2024-04-20T12:20:54.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.902+0000 7f97527fc640 1 --2- 172.21.15.135:0/2589451081 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f97480a3bb0 0x7f97480a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:54.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.902+0000 7f97610bf640 1 --2- 172.21.15.135:0/2589451081 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f97480a3bb0 0x7f97480a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:54.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.902+0000 7f97527fc640 1 -- 172.21.15.135:0/2589451081 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f974c0cff40 con 0x7f975c105370 2024-04-20T12:20:54.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.902+0000 7f97610bf640 1 --2- 172.21.15.135:0/2589451081 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f97480a3bb0 0x7f97480a6070 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f975800bbe0 tx=0x7f975800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:54.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:54.906+0000 7f97527fc640 1 -- 172.21.15.135:0/2589451081 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f974c09c090 con 0x7f975c105370 2024-04-20T12:20:55.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.082+0000 7f9763323640 1 -- 172.21.15.135:0/2589451081 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f975c062b60 con 0x7f975c105370 2024-04-20T12:20:55.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.083+0000 7f97527fc640 1 -- 172.21.15.135:0/2589451081 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f974c0a0390 con 0x7f975c105370 2024-04-20T12:20:55.083 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-04-20T12:20:55.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.085+0000 7f9763323640 1 -- 172.21.15.135:0/2589451081 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f97480a3bb0 msgr2=0x7f97480a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:55.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.085+0000 7f9763323640 1 --2- 172.21.15.135:0/2589451081 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f97480a3bb0 0x7f97480a6070 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f975800bbe0 tx=0x7f975800b390 comp rx=0 tx=0).stop 2024-04-20T12:20:55.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.085+0000 7f9763323640 1 -- 172.21.15.135:0/2589451081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c105370 msgr2=0x7f975c1987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:55.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.085+0000 7f9763323640 1 --2- 172.21.15.135:0/2589451081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c105370 0x7f975c1987e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f974c00d740 tx=0x7f974c00dc00 comp rx=0 tx=0).stop 2024-04-20T12:20:55.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.085+0000 7f9763323640 1 -- 172.21.15.135:0/2589451081 shutdown_connections 2024-04-20T12:20:55.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.085+0000 7f9763323640 1 --2- 172.21.15.135:0/2589451081 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f97480a3bb0 0x7f97480a6070 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.085+0000 7f9763323640 1 --2- 172.21.15.135:0/2589451081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f975c107ca0 0x7f975c19f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.085+0000 7f9763323640 1 --2- 172.21.15.135:0/2589451081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f975c105370 0x7f975c1987e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.085+0000 7f9763323640 1 --2- 172.21.15.135:0/2589451081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f975c102a40 0x7f975c1982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.085+0000 7f9763323640 1 -- 172.21.15.135:0/2589451081 >> 172.21.15.135:0/2589451081 conn(0x7f975c0fc450 msgr2=0x7f975c103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:55.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.085+0000 7f9763323640 1 -- 172.21.15.135:0/2589451081 shutdown_connections 2024-04-20T12:20:55.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.085+0000 7f9763323640 1 -- 172.21.15.135:0/2589451081 wait complete. 2024-04-20T12:20:55.094 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:54 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3524891744' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:55.094 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:54 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2586589123' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:20:55.094 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:54 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/517710322' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:20:55.095 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T12:20:55.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.197+0000 7fdd3a6e4640 1 -- 172.21.15.135:0/2073542745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd34103b60 msgr2=0x7fdd3410a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:55.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.197+0000 7fdd3a6e4640 1 --2- 172.21.15.135:0/2073542745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd34103b60 0x7fdd3410a3f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c009ca0 tx=0x7fdd2c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.197+0000 7fdd3a6e4640 1 -- 172.21.15.135:0/2073542745 shutdown_connections 2024-04-20T12:20:55.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.197+0000 7fdd3a6e4640 1 --2- 172.21.15.135:0/2073542745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd34103b60 0x7fdd3410a3f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.197+0000 7fdd3a6e4640 1 --2- 172.21.15.135:0/2073542745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd341031a0 0x7fdd34103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.197+0000 7fdd3a6e4640 1 --2- 172.21.15.135:0/2073542745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdd34101fb0 0x7fdd341023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.197+0000 7fdd3a6e4640 1 -- 172.21.15.135:0/2073542745 >> 172.21.15.135:0/2073542745 conn(0x7fdd340fd540 msgr2=0x7fdd340ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:55.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.197+0000 7fdd3a6e4640 1 -- 172.21.15.135:0/2073542745 shutdown_connections 2024-04-20T12:20:55.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.197+0000 7fdd3a6e4640 1 -- 172.21.15.135:0/2073542745 wait complete. 2024-04-20T12:20:55.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.197+0000 7fdd3a6e4640 1 Processor -- start 2024-04-20T12:20:55.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.197+0000 7fdd3a6e4640 1 -- start start 2024-04-20T12:20:55.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd3a6e4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdd34101fb0 0x7fdd341982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:55.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd3a6e4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd341031a0 0x7fdd34198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:55.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd3a6e4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd34103b60 0x7fdd3419f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:55.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd3a6e4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3410dc40 con 0x7fdd341031a0 2024-04-20T12:20:55.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd3a6e4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3410dac0 con 0x7fdd34101fb0 2024-04-20T12:20:55.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd3a6e4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3410ddc0 con 0x7fdd34103b60 2024-04-20T12:20:55.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd337fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd341031a0 0x7fdd34198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:55.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd337fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd341031a0 0x7fdd34198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44772/0 (socket says 172.21.15.135:44772) 2024-04-20T12:20:55.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd337fe640 1 -- 172.21.15.135:0/1260183761 learned_addr learned my addr 172.21.15.135:0/1260183761 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:55.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd38c81640 1 --2- 172.21.15.135:0/1260183761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd34103b60 0x7fdd3419f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:55.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd33fff640 1 --2- 172.21.15.135:0/1260183761 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdd34101fb0 0x7fdd341982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:55.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd337fe640 1 -- 172.21.15.135:0/1260183761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd34103b60 msgr2=0x7fdd3419f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:55.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd337fe640 1 --2- 172.21.15.135:0/1260183761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd34103b60 0x7fdd3419f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd337fe640 1 -- 172.21.15.135:0/1260183761 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdd34101fb0 msgr2=0x7fdd341982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:55.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd337fe640 1 --2- 172.21.15.135:0/1260183761 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdd34101fb0 0x7fdd341982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd337fe640 1 -- 172.21.15.135:0/1260183761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3419fee0 con 0x7fdd341031a0 2024-04-20T12:20:55.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd337fe640 1 --2- 172.21.15.135:0/1260183761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd341031a0 0x7fdd34198800 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdd2800d770 tx=0x7fdd2800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:55.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd317fa640 1 -- 172.21.15.135:0/1260183761 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28017070 con 0x7fdd341031a0 2024-04-20T12:20:55.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd3a6e4640 1 -- 172.21.15.135:0/1260183761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd341a01d0 con 0x7fdd341031a0 2024-04-20T12:20:55.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd317fa640 1 -- 172.21.15.135:0/1260183761 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd28005500 con 0x7fdd341031a0 2024-04-20T12:20:55.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd317fa640 1 -- 172.21.15.135:0/1260183761 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28004e00 con 0x7fdd341031a0 2024-04-20T12:20:55.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.198+0000 7fdd3a6e4640 1 -- 172.21.15.135:0/1260183761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd341a06d0 con 0x7fdd341031a0 2024-04-20T12:20:55.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.200+0000 7fdd3a6e4640 1 -- 172.21.15.135:0/1260183761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd341092d0 con 0x7fdd341031a0 2024-04-20T12:20:55.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.201+0000 7fdd317fa640 1 -- 172.21.15.135:0/1260183761 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fdd28004fa0 con 0x7fdd341031a0 2024-04-20T12:20:55.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.201+0000 7fdd317fa640 1 --2- 172.21.15.135:0/1260183761 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fdd1c0a3bb0 0x7fdd1c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:55.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.201+0000 7fdd33fff640 1 --2- 172.21.15.135:0/1260183761 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fdd1c0a3bb0 0x7fdd1c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:55.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.201+0000 7fdd317fa640 1 -- 172.21.15.135:0/1260183761 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fdd280d0080 con 0x7fdd341031a0 2024-04-20T12:20:55.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.202+0000 7fdd33fff640 1 --2- 172.21.15.135:0/1260183761 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fdd1c0a3bb0 0x7fdd1c0a6070 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdd24005db0 tx=0x7fdd24005d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:55.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.206+0000 7fdd317fa640 1 -- 172.21.15.135:0/1260183761 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fdd2809c820 con 0x7fdd341031a0 2024-04-20T12:20:55.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:54 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3524891744' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:55.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:54 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2586589123' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:20:55.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:54 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/517710322' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:20:55.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:54 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3524891744' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:55.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:54 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2586589123' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:20:55.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:54 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/517710322' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:20:55.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.382+0000 7fdd3a6e4640 1 -- 172.21.15.135:0/1260183761 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fdd34062b60 con 0x7fdd341031a0 2024-04-20T12:20:55.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.383+0000 7fdd317fa640 1 -- 172.21.15.135:0/1260183761 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7fdd2809c120 con 0x7fdd341031a0 2024-04-20T12:20:55.383 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:20:55.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.385+0000 7fdd3a6e4640 1 -- 172.21.15.135:0/1260183761 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fdd1c0a3bb0 msgr2=0x7fdd1c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:55.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.385+0000 7fdd3a6e4640 1 --2- 172.21.15.135:0/1260183761 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fdd1c0a3bb0 0x7fdd1c0a6070 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdd24005db0 tx=0x7fdd24005d40 comp rx=0 tx=0).stop 2024-04-20T12:20:55.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.385+0000 7fdd3a6e4640 1 -- 172.21.15.135:0/1260183761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd341031a0 msgr2=0x7fdd34198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:55.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.385+0000 7fdd3a6e4640 1 --2- 172.21.15.135:0/1260183761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd341031a0 0x7fdd34198800 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdd2800d770 tx=0x7fdd2800dc30 comp rx=0 tx=0).stop 2024-04-20T12:20:55.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.385+0000 7fdd3a6e4640 1 -- 172.21.15.135:0/1260183761 shutdown_connections 2024-04-20T12:20:55.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.385+0000 7fdd3a6e4640 1 --2- 172.21.15.135:0/1260183761 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fdd1c0a3bb0 0x7fdd1c0a6070 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.385+0000 7fdd3a6e4640 1 --2- 172.21.15.135:0/1260183761 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd34103b60 0x7fdd3419f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.385+0000 7fdd3a6e4640 1 --2- 172.21.15.135:0/1260183761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd341031a0 0x7fdd34198800 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.385+0000 7fdd3a6e4640 1 --2- 172.21.15.135:0/1260183761 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdd34101fb0 0x7fdd341982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.385+0000 7fdd3a6e4640 1 -- 172.21.15.135:0/1260183761 >> 172.21.15.135:0/1260183761 conn(0x7fdd340fd540 msgr2=0x7fdd341064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:55.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.385+0000 7fdd3a6e4640 1 -- 172.21.15.135:0/1260183761 shutdown_connections 2024-04-20T12:20:55.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.385+0000 7fdd3a6e4640 1 -- 172.21.15.135:0/1260183761 wait complete. 2024-04-20T12:20:55.396 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T12:20:55.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.495+0000 7f389f2a8640 1 -- 172.21.15.135:0/2972805158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3898101fa0 msgr2=0x7f38981023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:55.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.495+0000 7f389f2a8640 1 --2- 172.21.15.135:0/2972805158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3898101fa0 0x7f38981023c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3894009900 tx=0x7f389402bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:55.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.495+0000 7f389f2a8640 1 -- 172.21.15.135:0/2972805158 shutdown_connections 2024-04-20T12:20:55.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.495+0000 7f389f2a8640 1 --2- 172.21.15.135:0/2972805158 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3898103b50 0x7f389810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.495+0000 7f389f2a8640 1 --2- 172.21.15.135:0/2972805158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3898103190 0x7f3898103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.495+0000 7f389f2a8640 1 --2- 172.21.15.135:0/2972805158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3898101fa0 0x7f38981023c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.495+0000 7f389f2a8640 1 -- 172.21.15.135:0/2972805158 >> 172.21.15.135:0/2972805158 conn(0x7f38980fd510 msgr2=0x7f38980ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:55.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.495+0000 7f389f2a8640 1 -- 172.21.15.135:0/2972805158 shutdown_connections 2024-04-20T12:20:55.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.495+0000 7f389f2a8640 1 -- 172.21.15.135:0/2972805158 wait complete. 2024-04-20T12:20:55.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389f2a8640 1 Processor -- start 2024-04-20T12:20:55.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389f2a8640 1 -- start start 2024-04-20T12:20:55.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389f2a8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3898101fa0 0x7f3898198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:55.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389f2a8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3898103190 0x7f38981987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:55.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389f2a8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3898103b50 0x7f389819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:55.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389f2a8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f389810dc30 con 0x7f3898103b50 2024-04-20T12:20:55.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389f2a8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f389810dab0 con 0x7f3898101fa0 2024-04-20T12:20:55.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389f2a8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f389810ddb0 con 0x7f3898103190 2024-04-20T12:20:55.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389d845640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3898103b50 0x7f389819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:55.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389d845640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3898103b50 0x7f389819f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44780/0 (socket says 172.21.15.135:44780) 2024-04-20T12:20:55.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389d845640 1 -- 172.21.15.135:0/4223736765 learned_addr learned my addr 172.21.15.135:0/4223736765 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:55.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389d044640 1 --2- 172.21.15.135:0/4223736765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3898101fa0 0x7f3898198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:55.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389d845640 1 -- 172.21.15.135:0/4223736765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3898103190 msgr2=0x7f38981987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:55.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389d845640 1 --2- 172.21.15.135:0/4223736765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3898103190 0x7f38981987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389d845640 1 -- 172.21.15.135:0/4223736765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3898101fa0 msgr2=0x7f3898198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:55.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389d845640 1 --2- 172.21.15.135:0/4223736765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3898101fa0 0x7f3898198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389d845640 1 -- 172.21.15.135:0/4223736765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389819fe80 con 0x7f3898103b50 2024-04-20T12:20:55.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389d044640 1 --2- 172.21.15.135:0/4223736765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3898101fa0 0x7f3898198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:20:55.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389d845640 1 --2- 172.21.15.135:0/4223736765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3898103b50 0x7f389819f810 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f389000eb10 tx=0x7f389000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:55.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f388e7fc640 1 -- 172.21.15.135:0/4223736765 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3890004b20 con 0x7f3898103b50 2024-04-20T12:20:55.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389f2a8640 1 -- 172.21.15.135:0/4223736765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38981a0170 con 0x7f3898103b50 2024-04-20T12:20:55.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f388e7fc640 1 -- 172.21.15.135:0/4223736765 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3890004cc0 con 0x7f3898103b50 2024-04-20T12:20:55.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f388e7fc640 1 -- 172.21.15.135:0/4223736765 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3890010760 con 0x7f3898103b50 2024-04-20T12:20:55.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.496+0000 7f389f2a8640 1 -- 172.21.15.135:0/4223736765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38981a06c0 con 0x7f3898103b50 2024-04-20T12:20:55.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.497+0000 7f389f2a8640 1 -- 172.21.15.135:0/4223736765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3898109310 con 0x7f3898103b50 2024-04-20T12:20:55.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.499+0000 7f388e7fc640 1 -- 172.21.15.135:0/4223736765 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f3890005000 con 0x7f3898103b50 2024-04-20T12:20:55.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.499+0000 7f388e7fc640 1 --2- 172.21.15.135:0/4223736765 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f38840a3bb0 0x7f38840a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:55.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.499+0000 7f389d044640 1 --2- 172.21.15.135:0/4223736765 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f38840a3bb0 0x7f38840a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:55.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.499+0000 7f388e7fc640 1 -- 172.21.15.135:0/4223736765 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f38900d0f70 con 0x7f3898103b50 2024-04-20T12:20:55.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.500+0000 7f389d044640 1 --2- 172.21.15.135:0/4223736765 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f38840a3bb0 0x7f38840a6070 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f389402c7b0 tx=0x7f3894005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:55.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.503+0000 7f388e7fc640 1 -- 172.21.15.135:0/4223736765 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f3890053ff0 con 0x7f3898103b50 2024-04-20T12:20:55.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.691+0000 7f389f2a8640 1 -- 172.21.15.135:0/4223736765 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f389802d5d0 con 0x7f3898103b50 2024-04-20T12:20:55.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.692+0000 7f388e7fc640 1 -- 172.21.15.135:0/4223736765 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+599 (secure 0 0 0) 0x7f389009d710 con 0x7f3898103b50 2024-04-20T12:20:55.692 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6800/2178168771 2024-04-21T12:13:36.719889+0000 2024-04-20T12:20:55.692 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/152375197 2024-04-21T12:13:36.719889+0000 2024-04-20T12:20:55.692 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/4252118847 2024-04-21T12:13:36.719889+0000 2024-04-20T12:20:55.692 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/3207517469 2024-04-21T12:13:10.061188+0000 2024-04-20T12:20:55.692 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6801/2178168771 2024-04-21T12:13:36.719889+0000 2024-04-20T12:20:55.692 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/2737907457 2024-04-21T12:13:10.061188+0000 2024-04-20T12:20:55.692 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6800/469891744 2024-04-21T12:13:10.061188+0000 2024-04-20T12:20:55.692 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6801/469891744 2024-04-21T12:13:10.061188+0000 2024-04-20T12:20:55.692 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/2298786540 2024-04-21T12:13:10.061188+0000 2024-04-20T12:20:55.692 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/3680323343 2024-04-21T12:13:36.719889+0000 2024-04-20T12:20:55.693 INFO:teuthology.orchestra.run.smithi135.stderr:listed 10 entries 2024-04-20T12:20:55.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.694+0000 7f389f2a8640 1 -- 172.21.15.135:0/4223736765 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f38840a3bb0 msgr2=0x7f38840a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:55.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.694+0000 7f389f2a8640 1 --2- 172.21.15.135:0/4223736765 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f38840a3bb0 0x7f38840a6070 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f389402c7b0 tx=0x7f3894005fd0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.694+0000 7f389f2a8640 1 -- 172.21.15.135:0/4223736765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3898103b50 msgr2=0x7f389819f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:55.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.694+0000 7f389f2a8640 1 --2- 172.21.15.135:0/4223736765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3898103b50 0x7f389819f810 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f389000eb10 tx=0x7f389000c2d0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.694+0000 7f389f2a8640 1 -- 172.21.15.135:0/4223736765 shutdown_connections 2024-04-20T12:20:55.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.694+0000 7f389f2a8640 1 --2- 172.21.15.135:0/4223736765 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f38840a3bb0 0x7f38840a6070 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.694+0000 7f389f2a8640 1 --2- 172.21.15.135:0/4223736765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3898103b50 0x7f389819f810 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.694+0000 7f389f2a8640 1 --2- 172.21.15.135:0/4223736765 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3898103190 0x7f38981987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.694+0000 7f389f2a8640 1 --2- 172.21.15.135:0/4223736765 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3898101fa0 0x7f3898198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.694+0000 7f389f2a8640 1 -- 172.21.15.135:0/4223736765 >> 172.21.15.135:0/4223736765 conn(0x7f38980fd510 msgr2=0x7f38981064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:55.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.694+0000 7f389f2a8640 1 -- 172.21.15.135:0/4223736765 shutdown_connections 2024-04-20T12:20:55.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.694+0000 7f389f2a8640 1 -- 172.21.15.135:0/4223736765 wait complete. 2024-04-20T12:20:55.705 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:20:55.705 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T12:20:55.721 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:20:55.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.859+0000 7f7f624d2640 1 -- 172.21.15.135:0/87419906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c107ca0 msgr2=0x7f7f5c10a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:55.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.859+0000 7f7f624d2640 1 --2- 172.21.15.135:0/87419906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c107ca0 0x7f7f5c10a0f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009ca0 tx=0x7f7f5402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.859+0000 7f7f624d2640 1 -- 172.21.15.135:0/87419906 shutdown_connections 2024-04-20T12:20:55.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.859+0000 7f7f624d2640 1 --2- 172.21.15.135:0/87419906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c107ca0 0x7f7f5c10a0f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.859+0000 7f7f624d2640 1 --2- 172.21.15.135:0/87419906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c105370 0x7f7f5c107760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.859+0000 7f7f624d2640 1 --2- 172.21.15.135:0/87419906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f5c102a40 0x7f7f5c104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.859+0000 7f7f624d2640 1 -- 172.21.15.135:0/87419906 >> 172.21.15.135:0/87419906 conn(0x7f7f5c0fc430 msgr2=0x7f7f5c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:55.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.859+0000 7f7f624d2640 1 -- 172.21.15.135:0/87419906 shutdown_connections 2024-04-20T12:20:55.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.859+0000 7f7f624d2640 1 -- 172.21.15.135:0/87419906 wait complete. 2024-04-20T12:20:55.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.859+0000 7f7f624d2640 1 Processor -- start 2024-04-20T12:20:55.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.859+0000 7f7f624d2640 1 -- start start 2024-04-20T12:20:55.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f624d2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c102a40 0x7f7f5c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:55.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f624d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c105370 0x7f7f5c19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:55.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f624d2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f5c107ca0 0x7f7f5c1a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:55.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f624d2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c10dcb0 con 0x7f7f5c102a40 2024-04-20T12:20:55.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f624d2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c10db30 con 0x7f7f5c107ca0 2024-04-20T12:20:55.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f624d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c10de30 con 0x7f7f5c105370 2024-04-20T12:20:55.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f5bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c102a40 0x7f7f5c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f5bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c102a40 0x7f7f5c19a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44798/0 (socket says 172.21.15.135:44798) 2024-04-20T12:20:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f5bfff640 1 -- 172.21.15.135:0/1326818675 learned_addr learned my addr 172.21.15.135:0/1326818675 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f60a6f640 1 --2- 172.21.15.135:0/1326818675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f5c107ca0 0x7f7f5c1a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f5bfff640 1 -- 172.21.15.135:0/1326818675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c105370 msgr2=0x7f7f5c19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f5bfff640 1 --2- 172.21.15.135:0/1326818675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c105370 0x7f7f5c19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f5bfff640 1 -- 172.21.15.135:0/1326818675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f5c107ca0 msgr2=0x7f7f5c1a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f5bfff640 1 --2- 172.21.15.135:0/1326818675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f5c107ca0 0x7f7f5c1a1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f5bfff640 1 -- 172.21.15.135:0/1326818675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5c1a2140 con 0x7f7f5c102a40 2024-04-20T12:20:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f5bfff640 1 --2- 172.21.15.135:0/1326818675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c102a40 0x7f7f5c19a520 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00d950 tx=0x7f7f4c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f597fa640 1 -- 172.21.15.135:0/1326818675 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c017070 con 0x7f7f5c102a40 2024-04-20T12:20:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f597fa640 1 -- 172.21.15.135:0/1326818675 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f4c009c30 con 0x7f7f5c102a40 2024-04-20T12:20:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f597fa640 1 -- 172.21.15.135:0/1326818675 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c00f6b0 con 0x7f7f5c102a40 2024-04-20T12:20:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f624d2640 1 -- 172.21.15.135:0/1326818675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5c1a2430 con 0x7f7f5c102a40 2024-04-20T12:20:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.860+0000 7f7f624d2640 1 -- 172.21.15.135:0/1326818675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f5c1a2980 con 0x7f7f5c102a40 2024-04-20T12:20:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.861+0000 7f7f624d2640 1 -- 172.21.15.135:0/1326818675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f5c109790 con 0x7f7f5c102a40 2024-04-20T12:20:55.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.862+0000 7f7f597fa640 1 -- 172.21.15.135:0/1326818675 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f7f4c0109d0 con 0x7f7f5c102a40 2024-04-20T12:20:55.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.863+0000 7f7f597fa640 1 --2- 172.21.15.135:0/1326818675 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7f480a3bb0 0x7f7f480a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:55.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.863+0000 7f7f5b7fe640 1 --2- 172.21.15.135:0/1326818675 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7f480a3bb0 0x7f7f480a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:55.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.863+0000 7f7f597fa640 1 -- 172.21.15.135:0/1326818675 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f7f4c0d0350 con 0x7f7f5c102a40 2024-04-20T12:20:55.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.863+0000 7f7f5b7fe640 1 --2- 172.21.15.135:0/1326818675 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7f480a3bb0 0x7f7f480a6070 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c19ba30 tx=0x7f7f44006c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:55.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:55.866+0000 7f7f597fa640 1 -- 172.21.15.135:0/1326818675 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f7f4c009de0 con 0x7f7f5c102a40 2024-04-20T12:20:56.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.045+0000 7f7f624d2640 1 -- 172.21.15.135:0/1326818675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f5c02d5d0 con 0x7f7f5c102a40 2024-04-20T12:20:56.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.046+0000 7f7f597fa640 1 -- 172.21.15.135:0/1326818675 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24173 (secure 0 0 0) 0x7f7f4c09caf0 con 0x7f7f5c102a40 2024-04-20T12:20:56.047 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:20:56.047 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":90,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:20:48.315252+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:20:56.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.049+0000 7f7f624d2640 1 -- 172.21.15.135:0/1326818675 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7f480a3bb0 msgr2=0x7f7f480a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.049+0000 7f7f624d2640 1 --2- 172.21.15.135:0/1326818675 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7f480a3bb0 0x7f7f480a6070 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c19ba30 tx=0x7f7f44006c90 comp rx=0 tx=0).stop 2024-04-20T12:20:56.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.049+0000 7f7f624d2640 1 -- 172.21.15.135:0/1326818675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c102a40 msgr2=0x7f7f5c19a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.049+0000 7f7f624d2640 1 --2- 172.21.15.135:0/1326818675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c102a40 0x7f7f5c19a520 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00d950 tx=0x7f7f4c00de10 comp rx=0 tx=0).stop 2024-04-20T12:20:56.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.049+0000 7f7f624d2640 1 -- 172.21.15.135:0/1326818675 shutdown_connections 2024-04-20T12:20:56.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.049+0000 7f7f624d2640 1 --2- 172.21.15.135:0/1326818675 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7f480a3bb0 0x7f7f480a6070 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.049+0000 7f7f624d2640 1 --2- 172.21.15.135:0/1326818675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7f5c107ca0 0x7f7f5c1a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.049+0000 7f7f624d2640 1 --2- 172.21.15.135:0/1326818675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f5c105370 0x7f7f5c19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.049+0000 7f7f624d2640 1 --2- 172.21.15.135:0/1326818675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f5c102a40 0x7f7f5c19a520 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.049+0000 7f7f624d2640 1 -- 172.21.15.135:0/1326818675 >> 172.21.15.135:0/1326818675 conn(0x7f7f5c0fc430 msgr2=0x7f7f5c102100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:56.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.049+0000 7f7f624d2640 1 -- 172.21.15.135:0/1326818675 shutdown_connections 2024-04-20T12:20:56.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.049+0000 7f7f624d2640 1 -- 172.21.15.135:0/1326818675 wait complete. 2024-04-20T12:20:56.059 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:55 smithi135 ceph-mon[18264]: pgmap v299: 129 pgs: 129 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-04-20T12:20:56.059 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:55 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2589451081' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:20:56.059 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:55 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1260183761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:20:56.059 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:55 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/4223736765' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-20T12:20:56.061 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T12:16:02.802023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T12:20:39.656129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T12:20:40.312827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T12:20:44.307136+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T12:20:56.061 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T12:20:56.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.163+0000 7f215b552640 1 -- 172.21.15.135:0/3329264283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2154101fb0 msgr2=0x7f21541023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.163+0000 7f215b552640 1 --2- 172.21.15.135:0/3329264283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2154101fb0 0x7f21541023d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2150009900 tx=0x7f215002bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:56.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.163+0000 7f215b552640 1 -- 172.21.15.135:0/3329264283 shutdown_connections 2024-04-20T12:20:56.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.163+0000 7f215b552640 1 --2- 172.21.15.135:0/3329264283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2154103b60 0x7f215410a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.163+0000 7f215b552640 1 --2- 172.21.15.135:0/3329264283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21541031a0 0x7f2154103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.163+0000 7f215b552640 1 --2- 172.21.15.135:0/3329264283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2154101fb0 0x7f21541023d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.163+0000 7f215b552640 1 -- 172.21.15.135:0/3329264283 >> 172.21.15.135:0/3329264283 conn(0x7f21540fd540 msgr2=0x7f21540ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:56.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.163+0000 7f215b552640 1 -- 172.21.15.135:0/3329264283 shutdown_connections 2024-04-20T12:20:56.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.163+0000 7f215b552640 1 -- 172.21.15.135:0/3329264283 wait complete. 2024-04-20T12:20:56.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f215b552640 1 Processor -- start 2024-04-20T12:20:56.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f215b552640 1 -- start start 2024-04-20T12:20:56.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f215b552640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2154101fb0 0x7f2154198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:56.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f215b552640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21541031a0 0x7f2154198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:56.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f215b552640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2154103b60 0x7f215419f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:56.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f215b552640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f215410dc40 con 0x7f2154103b60 2024-04-20T12:20:56.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f215b552640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f215410dac0 con 0x7f2154101fb0 2024-04-20T12:20:56.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f215b552640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f215410ddc0 con 0x7f21541031a0 2024-04-20T12:20:56.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f2159aef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2154103b60 0x7f215419f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:56.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f2159aef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2154103b60 0x7f215419f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44824/0 (socket says 172.21.15.135:44824) 2024-04-20T12:20:56.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f2159aef640 1 -- 172.21.15.135:0/4212966323 learned_addr learned my addr 172.21.15.135:0/4212966323 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:56.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f2158aed640 1 --2- 172.21.15.135:0/4212966323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21541031a0 0x7f2154198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:56.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f2159aef640 1 -- 172.21.15.135:0/4212966323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21541031a0 msgr2=0x7f2154198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f2159aef640 1 --2- 172.21.15.135:0/4212966323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21541031a0 0x7f2154198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f21592ee640 1 --2- 172.21.15.135:0/4212966323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2154101fb0 0x7f2154198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:56.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f2159aef640 1 -- 172.21.15.135:0/4212966323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2154101fb0 msgr2=0x7f2154198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f2159aef640 1 --2- 172.21.15.135:0/4212966323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2154101fb0 0x7f2154198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.164+0000 7f2159aef640 1 -- 172.21.15.135:0/4212966323 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215419ff20 con 0x7f2154103b60 2024-04-20T12:20:56.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.165+0000 7f2159aef640 1 --2- 172.21.15.135:0/4212966323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2154103b60 0x7f215419f8b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f214c00cad0 tx=0x7f214c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:56.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.165+0000 7f214a7fc640 1 -- 172.21.15.135:0/4212966323 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c00ae20 con 0x7f2154103b60 2024-04-20T12:20:56.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.165+0000 7f215b552640 1 -- 172.21.15.135:0/4212966323 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21541a0210 con 0x7f2154103b60 2024-04-20T12:20:56.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.165+0000 7f214a7fc640 1 -- 172.21.15.135:0/4212966323 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f214c005020 con 0x7f2154103b60 2024-04-20T12:20:56.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.165+0000 7f214a7fc640 1 -- 172.21.15.135:0/4212966323 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c00f6f0 con 0x7f2154103b60 2024-04-20T12:20:56.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.165+0000 7f215b552640 1 -- 172.21.15.135:0/4212966323 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21541a0710 con 0x7f2154103b60 2024-04-20T12:20:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.166+0000 7f215b552640 1 -- 172.21.15.135:0/4212966323 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21541093a0 con 0x7f2154103b60 2024-04-20T12:20:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.167+0000 7f214a7fc640 1 -- 172.21.15.135:0/4212966323 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f214c0051d0 con 0x7f2154103b60 2024-04-20T12:20:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.167+0000 7f214a7fc640 1 --2- 172.21.15.135:0/4212966323 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f21400a3bb0 0x7f21400a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.167+0000 7f21592ee640 1 --2- 172.21.15.135:0/4212966323 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f21400a3bb0 0x7f21400a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.167+0000 7f214a7fc640 1 -- 172.21.15.135:0/4212966323 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f214c0d07b0 con 0x7f2154103b60 2024-04-20T12:20:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.168+0000 7f21592ee640 1 --2- 172.21.15.135:0/4212966323 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f21400a3bb0 0x7f21400a6070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2150036040 tx=0x7f2150005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:56.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.172+0000 7f214a7fc640 1 -- 172.21.15.135:0/4212966323 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f214c014030 con 0x7f2154103b60 2024-04-20T12:20:56.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:55 smithi154 ceph-mon[22073]: pgmap v299: 129 pgs: 129 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-04-20T12:20:56.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:55 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2589451081' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:20:56.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:55 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1260183761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:20:56.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:55 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/4223736765' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-20T12:20:56.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:55 smithi139 ceph-mon[21834]: pgmap v299: 129 pgs: 129 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-04-20T12:20:56.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:55 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2589451081' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:20:56.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:55 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1260183761' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:20:56.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:55 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/4223736765' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-20T12:20:56.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.350+0000 7f215b552640 1 -- 172.21.15.135:0/4212966323 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2154062b60 con 0x7f2154103b60 2024-04-20T12:20:56.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.351+0000 7f214a7fc640 1 -- 172.21.15.135:0/4212966323 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f214c09cf50 con 0x7f2154103b60 2024-04-20T12:20:56.350 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-04-20T12:20:56.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.352+0000 7f215b552640 1 -- 172.21.15.135:0/4212966323 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f21400a3bb0 msgr2=0x7f21400a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.352+0000 7f215b552640 1 --2- 172.21.15.135:0/4212966323 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f21400a3bb0 0x7f21400a6070 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2150036040 tx=0x7f2150005fd0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.352+0000 7f215b552640 1 -- 172.21.15.135:0/4212966323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2154103b60 msgr2=0x7f215419f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.352+0000 7f215b552640 1 --2- 172.21.15.135:0/4212966323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2154103b60 0x7f215419f8b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f214c00cad0 tx=0x7f214c00cf90 comp rx=0 tx=0).stop 2024-04-20T12:20:56.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.353+0000 7f215b552640 1 -- 172.21.15.135:0/4212966323 shutdown_connections 2024-04-20T12:20:56.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.353+0000 7f215b552640 1 --2- 172.21.15.135:0/4212966323 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f21400a3bb0 0x7f21400a6070 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.353+0000 7f215b552640 1 --2- 172.21.15.135:0/4212966323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2154103b60 0x7f215419f8b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.353+0000 7f215b552640 1 --2- 172.21.15.135:0/4212966323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21541031a0 0x7f2154198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.353+0000 7f215b552640 1 --2- 172.21.15.135:0/4212966323 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2154101fb0 0x7f2154198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.353+0000 7f215b552640 1 -- 172.21.15.135:0/4212966323 >> 172.21.15.135:0/4212966323 conn(0x7f21540fd540 msgr2=0x7f2154106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:56.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.353+0000 7f215b552640 1 -- 172.21.15.135:0/4212966323 shutdown_connections 2024-04-20T12:20:56.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.353+0000 7f215b552640 1 -- 172.21.15.135:0/4212966323 wait complete. 2024-04-20T12:20:56.363 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T12:20:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.464+0000 7f988b88c640 1 -- 172.21.15.135:0/88020201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9884101b30 msgr2=0x7f98841093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.464+0000 7f988b88c640 1 --2- 172.21.15.135:0/88020201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9884101b30 0x7f98841093d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f987c009900 tx=0x7f987c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.464+0000 7f988b88c640 1 -- 172.21.15.135:0/88020201 shutdown_connections 2024-04-20T12:20:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.464+0000 7f988b88c640 1 --2- 172.21.15.135:0/88020201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9884101b30 0x7f98841093d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.464+0000 7f988b88c640 1 --2- 172.21.15.135:0/88020201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884101170 0x7f98841015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.464+0000 7f988b88c640 1 --2- 172.21.15.135:0/88020201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9884102440 0x7f9884102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.464+0000 7f988b88c640 1 -- 172.21.15.135:0/88020201 >> 172.21.15.135:0/88020201 conn(0x7f98840fbba0 msgr2=0x7f98840fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.464+0000 7f988b88c640 1 -- 172.21.15.135:0/88020201 shutdown_connections 2024-04-20T12:20:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.464+0000 7f988b88c640 1 -- 172.21.15.135:0/88020201 wait complete. 2024-04-20T12:20:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.464+0000 7f988b88c640 1 Processor -- start 2024-04-20T12:20:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f988b88c640 1 -- start start 2024-04-20T12:20:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f988b88c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884101170 0x7f9884198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f988b88c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9884101b30 0x7f98841987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f988b88c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9884102440 0x7f988419f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f988b88c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f988410dc60 con 0x7f9884101b30 2024-04-20T12:20:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f988b88c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f988410dae0 con 0x7f9884102440 2024-04-20T12:20:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f988b88c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f988410dde0 con 0x7f9884101170 2024-04-20T12:20:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f9888e27640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9884101b30 0x7f98841987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f9888e27640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9884101b30 0x7f98841987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44840/0 (socket says 172.21.15.135:44840) 2024-04-20T12:20:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f9888e27640 1 -- 172.21.15.135:0/3394465701 learned_addr learned my addr 172.21.15.135:0/3394465701 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f9889628640 1 --2- 172.21.15.135:0/3394465701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884101170 0x7f9884198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f9888e27640 1 -- 172.21.15.135:0/3394465701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884101170 msgr2=0x7f9884198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f9888e27640 1 --2- 172.21.15.135:0/3394465701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884101170 0x7f9884198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f9888e27640 1 -- 172.21.15.135:0/3394465701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9884102440 msgr2=0x7f988419f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f9889e29640 1 --2- 172.21.15.135:0/3394465701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9884102440 0x7f988419f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f9888e27640 1 --2- 172.21.15.135:0/3394465701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9884102440 0x7f988419f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f9888e27640 1 -- 172.21.15.135:0/3394465701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988419fea0 con 0x7f9884101b30 2024-04-20T12:20:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f9889e29640 1 --2- 172.21.15.135:0/3394465701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9884102440 0x7f988419f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:20:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f9888e27640 1 --2- 172.21.15.135:0/3394465701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9884101b30 0x7f98841987c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f987400e9f0 tx=0x7f987400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f987a7fc640 1 -- 172.21.15.135:0/3394465701 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987400cd80 con 0x7f9884101b30 2024-04-20T12:20:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f987a7fc640 1 -- 172.21.15.135:0/3394465701 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9874005500 con 0x7f9884101b30 2024-04-20T12:20:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f988b88c640 1 -- 172.21.15.135:0/3394465701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98841a0190 con 0x7f9884101b30 2024-04-20T12:20:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.465+0000 7f987a7fc640 1 -- 172.21.15.135:0/3394465701 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9874010690 con 0x7f9884101b30 2024-04-20T12:20:56.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.466+0000 7f988b88c640 1 -- 172.21.15.135:0/3394465701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98841a0690 con 0x7f9884101b30 2024-04-20T12:20:56.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.466+0000 7f988b88c640 1 -- 172.21.15.135:0/3394465701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98841082b0 con 0x7f9884101b30 2024-04-20T12:20:56.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.468+0000 7f987a7fc640 1 -- 172.21.15.135:0/3394465701 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f98740046c0 con 0x7f9884101b30 2024-04-20T12:20:56.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.468+0000 7f987a7fc640 1 --2- 172.21.15.135:0/3394465701 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f98700a3bb0 0x7f98700a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:56.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.468+0000 7f9889628640 1 --2- 172.21.15.135:0/3394465701 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f98700a3bb0 0x7f98700a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:56.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.468+0000 7f987a7fc640 1 -- 172.21.15.135:0/3394465701 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f98740d0db0 con 0x7f9884101b30 2024-04-20T12:20:56.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.469+0000 7f9889628640 1 --2- 172.21.15.135:0/3394465701 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f98700a3bb0 0x7f98700a6070 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f988406a360 tx=0x7f9880009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:56.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.472+0000 7f987a7fc640 1 -- 172.21.15.135:0/3394465701 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f9874053ff0 con 0x7f9884101b30 2024-04-20T12:20:56.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.651+0000 7f988b88c640 1 -- 172.21.15.135:0/3394465701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f988402d840 con 0x7f9884101b30 2024-04-20T12:20:56.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.651+0000 7f987a7fc640 1 -- 172.21.15.135:0/3394465701 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f987401f340 con 0x7f9884101b30 2024-04-20T12:20:56.651 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:20:56.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.653+0000 7f988b88c640 1 -- 172.21.15.135:0/3394465701 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f98700a3bb0 msgr2=0x7f98700a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.653+0000 7f988b88c640 1 --2- 172.21.15.135:0/3394465701 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f98700a3bb0 0x7f98700a6070 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f988406a360 tx=0x7f9880009500 comp rx=0 tx=0).stop 2024-04-20T12:20:56.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.653+0000 7f988b88c640 1 -- 172.21.15.135:0/3394465701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9884101b30 msgr2=0x7f98841987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.653+0000 7f988b88c640 1 --2- 172.21.15.135:0/3394465701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9884101b30 0x7f98841987c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f987400e9f0 tx=0x7f987400edf0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.653+0000 7f988b88c640 1 -- 172.21.15.135:0/3394465701 shutdown_connections 2024-04-20T12:20:56.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.653+0000 7f988b88c640 1 --2- 172.21.15.135:0/3394465701 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f98700a3bb0 0x7f98700a6070 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.653+0000 7f988b88c640 1 --2- 172.21.15.135:0/3394465701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9884102440 0x7f988419f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.653+0000 7f988b88c640 1 --2- 172.21.15.135:0/3394465701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9884101b30 0x7f98841987c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.653+0000 7f988b88c640 1 --2- 172.21.15.135:0/3394465701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9884101170 0x7f9884198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.653+0000 7f988b88c640 1 -- 172.21.15.135:0/3394465701 >> 172.21.15.135:0/3394465701 conn(0x7f98840fbba0 msgr2=0x7f9884105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:56.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.653+0000 7f988b88c640 1 -- 172.21.15.135:0/3394465701 shutdown_connections 2024-04-20T12:20:56.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.653+0000 7f988b88c640 1 -- 172.21.15.135:0/3394465701 wait complete. 2024-04-20T12:20:56.665 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T12:20:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.766+0000 7f16a2dad640 1 -- 172.21.15.135:0/3883972241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f169c102a10 msgr2=0x7f169c109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.766+0000 7f16a2dad640 1 --2- 172.21.15.135:0/3883972241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f169c102a10 0x7f169c109330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1694009ca0 tx=0x7f169402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.766+0000 7f16a2dad640 1 -- 172.21.15.135:0/3883972241 shutdown_connections 2024-04-20T12:20:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.766+0000 7f16a2dad640 1 --2- 172.21.15.135:0/3883972241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f169c102a10 0x7f169c109330 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.766+0000 7f16a2dad640 1 --2- 172.21.15.135:0/3883972241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f169c102050 0x7f169c1024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.766+0000 7f16a2dad640 1 --2- 172.21.15.135:0/3883972241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f169c100e70 0x7f169c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.766+0000 7f16a2dad640 1 -- 172.21.15.135:0/3883972241 >> 172.21.15.135:0/3883972241 conn(0x7f169c0fc430 msgr2=0x7f169c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:56.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.766+0000 7f16a2dad640 1 -- 172.21.15.135:0/3883972241 shutdown_connections 2024-04-20T12:20:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.766+0000 7f16a2dad640 1 -- 172.21.15.135:0/3883972241 wait complete. 2024-04-20T12:20:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.766+0000 7f16a2dad640 1 Processor -- start 2024-04-20T12:20:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a2dad640 1 -- start start 2024-04-20T12:20:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a2dad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f169c100e70 0x7f169c06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a2dad640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f169c102050 0x7f169c19cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a2dad640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f169c102a10 0x7f169c19f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a2dad640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f169c10cb70 con 0x7f169c100e70 2024-04-20T12:20:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a2dad640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f169c10c9f0 con 0x7f169c102050 2024-04-20T12:20:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a2dad640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f169c10ccf0 con 0x7f169c102a10 2024-04-20T12:20:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a0b49640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f169c100e70 0x7f169c06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a0b49640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f169c100e70 0x7f169c06b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44856/0 (socket says 172.21.15.135:44856) 2024-04-20T12:20:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a0b49640 1 -- 172.21.15.135:0/3151829735 learned_addr learned my addr 172.21.15.135:0/3151829735 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f169bfff640 1 --2- 172.21.15.135:0/3151829735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f169c102050 0x7f169c19cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a134a640 1 --2- 172.21.15.135:0/3151829735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f169c102a10 0x7f169c19f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a0b49640 1 -- 172.21.15.135:0/3151829735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f169c102a10 msgr2=0x7f169c19f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a0b49640 1 --2- 172.21.15.135:0/3151829735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f169c102a10 0x7f169c19f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a0b49640 1 -- 172.21.15.135:0/3151829735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f169c102050 msgr2=0x7f169c19cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a0b49640 1 --2- 172.21.15.135:0/3151829735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f169c102050 0x7f169c19cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a0b49640 1 -- 172.21.15.135:0/3151829735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169c19fee0 con 0x7f169c100e70 2024-04-20T12:20:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a134a640 1 --2- 172.21.15.135:0/3151829735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f169c102a10 0x7f169c19f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:20:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f16a0b49640 1 --2- 172.21.15.135:0/3151829735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f169c100e70 0x7f169c06b0d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f169000d950 tx=0x7f169000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.767+0000 7f1699ffb640 1 -- 172.21.15.135:0/3151829735 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1690017070 con 0x7f169c100e70 2024-04-20T12:20:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.768+0000 7f1699ffb640 1 -- 172.21.15.135:0/3151829735 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1690009c30 con 0x7f169c100e70 2024-04-20T12:20:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.768+0000 7f16a2dad640 1 -- 172.21.15.135:0/3151829735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169c1a0170 con 0x7f169c100e70 2024-04-20T12:20:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.768+0000 7f1699ffb640 1 -- 172.21.15.135:0/3151829735 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169000f600 con 0x7f169c100e70 2024-04-20T12:20:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.768+0000 7f16a2dad640 1 -- 172.21.15.135:0/3151829735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f169c1a0670 con 0x7f169c100e70 2024-04-20T12:20:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.769+0000 7f16a2dad640 1 -- 172.21.15.135:0/3151829735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f169c108210 con 0x7f169c100e70 2024-04-20T12:20:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.770+0000 7f1699ffb640 1 -- 172.21.15.135:0/3151829735 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f169001a070 con 0x7f169c100e70 2024-04-20T12:20:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.770+0000 7f1699ffb640 1 --2- 172.21.15.135:0/3151829735 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f168c0a3bb0 0x7f168c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:56.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.770+0000 7f1699ffb640 1 -- 172.21.15.135:0/3151829735 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f16900d0030 con 0x7f169c100e70 2024-04-20T12:20:56.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.770+0000 7f169bfff640 1 --2- 172.21.15.135:0/3151829735 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f168c0a3bb0 0x7f168c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:56.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.771+0000 7f169bfff640 1 --2- 172.21.15.135:0/3151829735 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f168c0a3bb0 0x7f168c0a6070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f169c06ae40 tx=0x7f1688005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:56.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.774+0000 7f1699ffb640 1 -- 172.21.15.135:0/3151829735 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f1690009de0 con 0x7f169c100e70 2024-04-20T12:20:56.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.956+0000 7f16a2dad640 1 -- 172.21.15.135:0/3151829735 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f169c062b60 con 0x7f169c100e70 2024-04-20T12:20:56.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.957+0000 7f1699ffb640 1 -- 172.21.15.135:0/3151829735 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f169009c7d0 con 0x7f169c100e70 2024-04-20T12:20:56.956 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-04-20T12:20:56.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.959+0000 7f16a2dad640 1 -- 172.21.15.135:0/3151829735 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f168c0a3bb0 msgr2=0x7f168c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.959+0000 7f16a2dad640 1 --2- 172.21.15.135:0/3151829735 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f168c0a3bb0 0x7f168c0a6070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f169c06ae40 tx=0x7f1688005f90 comp rx=0 tx=0).stop 2024-04-20T12:20:56.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.959+0000 7f16a2dad640 1 -- 172.21.15.135:0/3151829735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f169c100e70 msgr2=0x7f169c06b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:56.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.959+0000 7f16a2dad640 1 --2- 172.21.15.135:0/3151829735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f169c100e70 0x7f169c06b0d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f169000d950 tx=0x7f169000de10 comp rx=0 tx=0).stop 2024-04-20T12:20:56.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.959+0000 7f16a2dad640 1 -- 172.21.15.135:0/3151829735 shutdown_connections 2024-04-20T12:20:56.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.959+0000 7f16a2dad640 1 --2- 172.21.15.135:0/3151829735 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f168c0a3bb0 0x7f168c0a6070 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.959+0000 7f16a2dad640 1 --2- 172.21.15.135:0/3151829735 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f169c102a10 0x7f169c19f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.959+0000 7f16a2dad640 1 --2- 172.21.15.135:0/3151829735 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f169c102050 0x7f169c19cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.959+0000 7f16a2dad640 1 --2- 172.21.15.135:0/3151829735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f169c100e70 0x7f169c06b0d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:56.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.959+0000 7f16a2dad640 1 -- 172.21.15.135:0/3151829735 >> 172.21.15.135:0/3151829735 conn(0x7f169c0fc430 msgr2=0x7f169c1053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:56.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.959+0000 7f16a2dad640 1 -- 172.21.15.135:0/3151829735 shutdown_connections 2024-04-20T12:20:56.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:56.959+0000 7f16a2dad640 1 -- 172.21.15.135:0/3151829735 wait complete. 2024-04-20T12:20:56.968 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:56 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1326818675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:56.968 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:56 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/4212966323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:20:56.969 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:56 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3394465701' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:20:56.970 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T12:20:57.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 -- 172.21.15.135:0/1558712930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08101fb0 msgr2=0x7f7b081023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:57.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 --2- 172.21.15.135:0/1558712930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08101fb0 0x7f7b081023d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009ca0 tx=0x7f7af802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 -- 172.21.15.135:0/1558712930 shutdown_connections 2024-04-20T12:20:57.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 --2- 172.21.15.135:0/1558712930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b08103b60 0x7f7b0810a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 --2- 172.21.15.135:0/1558712930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b081031a0 0x7f7b08103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 --2- 172.21.15.135:0/1558712930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08101fb0 0x7f7b081023d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 -- 172.21.15.135:0/1558712930 >> 172.21.15.135:0/1558712930 conn(0x7f7b080fd540 msgr2=0x7f7b080ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:57.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 -- 172.21.15.135:0/1558712930 shutdown_connections 2024-04-20T12:20:57.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 -- 172.21.15.135:0/1558712930 wait complete. 2024-04-20T12:20:57.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 Processor -- start 2024-04-20T12:20:57.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 -- start start 2024-04-20T12:20:57.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08101fb0 0x7f7b0819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:57.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b081031a0 0x7f7b0819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:57.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08103b60 0x7f7b081a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:57.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0810dc40 con 0x7f7b08103b60 2024-04-20T12:20:57.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0810dac0 con 0x7f7b081031a0 2024-04-20T12:20:57.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.073+0000 7f7b0d670640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b0810ddc0 con 0x7f7b08101fb0 2024-04-20T12:20:57.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.074+0000 7f7b077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08103b60 0x7f7b081a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:57.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.074+0000 7f7b077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08103b60 0x7f7b081a1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44870/0 (socket says 172.21.15.135:44870) 2024-04-20T12:20:57.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.074+0000 7f7b077fe640 1 -- 172.21.15.135:0/2525411960 learned_addr learned my addr 172.21.15.135:0/2525411960 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:57.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.074+0000 7f7b067fc640 1 --2- 172.21.15.135:0/2525411960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b081031a0 0x7f7b0819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:57.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.074+0000 7f7b077fe640 1 -- 172.21.15.135:0/2525411960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08101fb0 msgr2=0x7f7b0819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:57.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.074+0000 7f7b077fe640 1 --2- 172.21.15.135:0/2525411960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08101fb0 0x7f7b0819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.074+0000 7f7b077fe640 1 -- 172.21.15.135:0/2525411960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b081031a0 msgr2=0x7f7b0819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:57.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.074+0000 7f7b077fe640 1 --2- 172.21.15.135:0/2525411960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b081031a0 0x7f7b0819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.074+0000 7f7b077fe640 1 -- 172.21.15.135:0/2525411960 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b081a2170 con 0x7f7b08103b60 2024-04-20T12:20:57.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.074+0000 7f7b077fe640 1 --2- 172.21.15.135:0/2525411960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08103b60 0x7f7b081a1b00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000e970 tx=0x7f7b0000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:57.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.074+0000 7f7aeffff640 1 -- 172.21.15.135:0/2525411960 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000ccc0 con 0x7f7b08103b60 2024-04-20T12:20:57.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.074+0000 7f7aeffff640 1 -- 172.21.15.135:0/2525411960 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b0000ce60 con 0x7f7b08103b60 2024-04-20T12:20:57.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.074+0000 7f7b0d670640 1 -- 172.21.15.135:0/2525411960 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b081a2460 con 0x7f7b08103b60 2024-04-20T12:20:57.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.074+0000 7f7aeffff640 1 -- 172.21.15.135:0/2525411960 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00010490 con 0x7f7b08103b60 2024-04-20T12:20:57.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.074+0000 7f7b0d670640 1 -- 172.21.15.135:0/2525411960 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b081a2960 con 0x7f7b08103b60 2024-04-20T12:20:57.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.075+0000 7f7b0d670640 1 -- 172.21.15.135:0/2525411960 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b081a2c20 con 0x7f7b08103b60 2024-04-20T12:20:57.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.076+0000 7f7aeffff640 1 -- 172.21.15.135:0/2525411960 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f7b00005000 con 0x7f7b08103b60 2024-04-20T12:20:57.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.077+0000 7f7aeffff640 1 --2- 172.21.15.135:0/2525411960 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7af00a3bb0 0x7f7af00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:57.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.077+0000 7f7b06ffd640 1 --2- 172.21.15.135:0/2525411960 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7af00a3bb0 0x7f7af00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:57.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.077+0000 7f7aeffff640 1 -- 172.21.15.135:0/2525411960 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f7b000d0dd0 con 0x7f7b08103b60 2024-04-20T12:20:57.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.077+0000 7f7b06ffd640 1 --2- 172.21.15.135:0/2525411960 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7af00a3bb0 0x7f7af00a6070 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7af8006010 tx=0x7f7af80093f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:57.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.080+0000 7f7aeffff640 1 -- 172.21.15.135:0/2525411960 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f7b00053ff0 con 0x7f7b08103b60 2024-04-20T12:20:57.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:56 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1326818675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:57.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:56 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/4212966323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:20:57.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:56 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3394465701' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:20:57.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.257+0000 7f7b0d670640 1 -- 172.21.15.135:0/2525411960 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7b081a2df0 con 0x7f7b08103b60 2024-04-20T12:20:57.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.257+0000 7f7aeffff640 1 -- 172.21.15.135:0/2525411960 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7f7b0009d570 con 0x7f7b08103b60 2024-04-20T12:20:57.257 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:20:57.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.259+0000 7f7b0d670640 1 -- 172.21.15.135:0/2525411960 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7af00a3bb0 msgr2=0x7f7af00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:57.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.259+0000 7f7b0d670640 1 --2- 172.21.15.135:0/2525411960 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7af00a3bb0 0x7f7af00a6070 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7af8006010 tx=0x7f7af80093f0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.259+0000 7f7b0d670640 1 -- 172.21.15.135:0/2525411960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08103b60 msgr2=0x7f7b081a1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:57.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.259+0000 7f7b0d670640 1 --2- 172.21.15.135:0/2525411960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08103b60 0x7f7b081a1b00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000e970 tx=0x7f7b0000ed70 comp rx=0 tx=0).stop 2024-04-20T12:20:57.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.259+0000 7f7b0d670640 1 -- 172.21.15.135:0/2525411960 shutdown_connections 2024-04-20T12:20:57.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.259+0000 7f7b0d670640 1 --2- 172.21.15.135:0/2525411960 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7af00a3bb0 0x7f7af00a6070 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.259+0000 7f7b0d670640 1 --2- 172.21.15.135:0/2525411960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08103b60 0x7f7b081a1b00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.259+0000 7f7b0d670640 1 --2- 172.21.15.135:0/2525411960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b081031a0 0x7f7b0819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.259+0000 7f7b0d670640 1 --2- 172.21.15.135:0/2525411960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08101fb0 0x7f7b0819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.259+0000 7f7b0d670640 1 -- 172.21.15.135:0/2525411960 >> 172.21.15.135:0/2525411960 conn(0x7f7b080fd540 msgr2=0x7f7b08074190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:57.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.259+0000 7f7b0d670640 1 -- 172.21.15.135:0/2525411960 shutdown_connections 2024-04-20T12:20:57.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.259+0000 7f7b0d670640 1 -- 172.21.15.135:0/2525411960 wait complete. 2024-04-20T12:20:57.270 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T12:20:57.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:56 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1326818675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:20:57.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:56 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/4212966323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:20:57.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:56 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3394465701' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:20:57.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.371+0000 7fd13fd4a640 1 -- 172.21.15.135:0/4107955913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd138101820 msgr2=0x7fd138101ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:57.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.371+0000 7fd13fd4a640 1 --2- 172.21.15.135:0/4107955913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd138101820 0x7fd138101ca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009900 tx=0x7fd12c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:20:57.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.371+0000 7fd13fd4a640 1 -- 172.21.15.135:0/4107955913 shutdown_connections 2024-04-20T12:20:57.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.371+0000 7fd13fd4a640 1 --2- 172.21.15.135:0/4107955913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd1381021e0 0x7fd138108a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.371+0000 7fd13fd4a640 1 --2- 172.21.15.135:0/4107955913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd138101820 0x7fd138101ca0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.371+0000 7fd13fd4a640 1 --2- 172.21.15.135:0/4107955913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd138100630 0x7fd138100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.371+0000 7fd13fd4a640 1 -- 172.21.15.135:0/4107955913 >> 172.21.15.135:0/4107955913 conn(0x7fd1380fbba0 msgr2=0x7fd1380fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:57.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.371+0000 7fd13fd4a640 1 -- 172.21.15.135:0/4107955913 shutdown_connections 2024-04-20T12:20:57.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.371+0000 7fd13fd4a640 1 -- 172.21.15.135:0/4107955913 wait complete. 2024-04-20T12:20:57.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.371+0000 7fd13fd4a640 1 Processor -- start 2024-04-20T12:20:57.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.371+0000 7fd13fd4a640 1 -- start start 2024-04-20T12:20:57.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13fd4a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd138100630 0x7fd1381982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:57.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13fd4a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138101820 0x7fd138198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:57.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13fd4a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1381021e0 0x7fd13819f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:57.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13fd4a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd13810c2c0 con 0x7fd1381021e0 2024-04-20T12:20:57.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13fd4a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd13810c140 con 0x7fd138100630 2024-04-20T12:20:57.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13fd4a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd13810c440 con 0x7fd138101820 2024-04-20T12:20:57.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13e2e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1381021e0 0x7fd13819f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:57.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13e2e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1381021e0 0x7fd13819f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44874/0 (socket says 172.21.15.135:44874) 2024-04-20T12:20:57.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13e2e7640 1 -- 172.21.15.135:0/1346219653 learned_addr learned my addr 172.21.15.135:0/1346219653 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:20:57.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13dae6640 1 --2- 172.21.15.135:0/1346219653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd138100630 0x7fd1381982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:57.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13d2e5640 1 --2- 172.21.15.135:0/1346219653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138101820 0x7fd138198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:57.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13e2e7640 1 -- 172.21.15.135:0/1346219653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138101820 msgr2=0x7fd138198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:57.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13e2e7640 1 --2- 172.21.15.135:0/1346219653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138101820 0x7fd138198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13e2e7640 1 -- 172.21.15.135:0/1346219653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd138100630 msgr2=0x7fd1381982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:57.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13e2e7640 1 --2- 172.21.15.135:0/1346219653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd138100630 0x7fd1381982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13e2e7640 1 -- 172.21.15.135:0/1346219653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13819ff10 con 0x7fd1381021e0 2024-04-20T12:20:57.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13e2e7640 1 --2- 172.21.15.135:0/1346219653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1381021e0 0x7fd13819f8a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd12800d750 tx=0x7fd12800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:57.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd136ffd640 1 -- 172.21.15.135:0/1346219653 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128017070 con 0x7fd1381021e0 2024-04-20T12:20:57.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd136ffd640 1 -- 172.21.15.135:0/1346219653 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd128005500 con 0x7fd1381021e0 2024-04-20T12:20:57.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13fd4a640 1 -- 172.21.15.135:0/1346219653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1381a0200 con 0x7fd1381021e0 2024-04-20T12:20:57.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd136ffd640 1 -- 172.21.15.135:0/1346219653 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128004d90 con 0x7fd1381021e0 2024-04-20T12:20:57.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.372+0000 7fd13fd4a640 1 -- 172.21.15.135:0/1346219653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1381a0720 con 0x7fd1381021e0 2024-04-20T12:20:57.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.373+0000 7fd13fd4a640 1 -- 172.21.15.135:0/1346219653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1381a0980 con 0x7fd1381021e0 2024-04-20T12:20:57.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.374+0000 7fd136ffd640 1 -- 172.21.15.135:0/1346219653 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fd128004f30 con 0x7fd1381021e0 2024-04-20T12:20:57.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.375+0000 7fd136ffd640 1 --2- 172.21.15.135:0/1346219653 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd1200a3bb0 0x7fd1200a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:20:57.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.375+0000 7fd13dae6640 1 --2- 172.21.15.135:0/1346219653 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd1200a3bb0 0x7fd1200a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:20:57.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.375+0000 7fd136ffd640 1 -- 172.21.15.135:0/1346219653 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fd1280cff50 con 0x7fd1381021e0 2024-04-20T12:20:57.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.375+0000 7fd13dae6640 1 --2- 172.21.15.135:0/1346219653 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd1200a3bb0 0x7fd1200a6070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd138101680 tx=0x7fd130009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:20:57.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.379+0000 7fd136ffd640 1 -- 172.21.15.135:0/1346219653 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fd12809c0a0 con 0x7fd1381021e0 2024-04-20T12:20:57.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.568+0000 7fd13fd4a640 1 -- 172.21.15.135:0/1346219653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd1381a0d10 con 0x7fd1381021e0 2024-04-20T12:20:57.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.568+0000 7fd136ffd640 1 -- 172.21.15.135:0/1346219653 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+599 (secure 0 0 0) 0x7fd1280bc030 con 0x7fd1381021e0 2024-04-20T12:20:57.568 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6800/2178168771 2024-04-21T12:13:36.719889+0000 2024-04-20T12:20:57.568 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/152375197 2024-04-21T12:13:36.719889+0000 2024-04-20T12:20:57.568 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/4252118847 2024-04-21T12:13:36.719889+0000 2024-04-20T12:20:57.568 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/3207517469 2024-04-21T12:13:10.061188+0000 2024-04-20T12:20:57.568 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6801/2178168771 2024-04-21T12:13:36.719889+0000 2024-04-20T12:20:57.568 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/2737907457 2024-04-21T12:13:10.061188+0000 2024-04-20T12:20:57.568 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6800/469891744 2024-04-21T12:13:10.061188+0000 2024-04-20T12:20:57.569 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6801/469891744 2024-04-21T12:13:10.061188+0000 2024-04-20T12:20:57.569 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/2298786540 2024-04-21T12:13:10.061188+0000 2024-04-20T12:20:57.569 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/3680323343 2024-04-21T12:13:36.719889+0000 2024-04-20T12:20:57.569 INFO:teuthology.orchestra.run.smithi135.stderr:listed 10 entries 2024-04-20T12:20:57.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.570+0000 7fd13fd4a640 1 -- 172.21.15.135:0/1346219653 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd1200a3bb0 msgr2=0x7fd1200a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:57.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.570+0000 7fd13fd4a640 1 --2- 172.21.15.135:0/1346219653 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd1200a3bb0 0x7fd1200a6070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd138101680 tx=0x7fd130009500 comp rx=0 tx=0).stop 2024-04-20T12:20:57.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.570+0000 7fd13fd4a640 1 -- 172.21.15.135:0/1346219653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1381021e0 msgr2=0x7fd13819f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:20:57.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.570+0000 7fd13fd4a640 1 --2- 172.21.15.135:0/1346219653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1381021e0 0x7fd13819f8a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd12800d750 tx=0x7fd12800dc10 comp rx=0 tx=0).stop 2024-04-20T12:20:57.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.570+0000 7fd13fd4a640 1 -- 172.21.15.135:0/1346219653 shutdown_connections 2024-04-20T12:20:57.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.570+0000 7fd13fd4a640 1 --2- 172.21.15.135:0/1346219653 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd1200a3bb0 0x7fd1200a6070 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.570+0000 7fd13fd4a640 1 --2- 172.21.15.135:0/1346219653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1381021e0 0x7fd13819f8a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.570+0000 7fd13fd4a640 1 --2- 172.21.15.135:0/1346219653 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd138101820 0x7fd138198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.570+0000 7fd13fd4a640 1 --2- 172.21.15.135:0/1346219653 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd138100630 0x7fd1381982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:20:57.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.570+0000 7fd13fd4a640 1 -- 172.21.15.135:0/1346219653 >> 172.21.15.135:0/1346219653 conn(0x7fd1380fbba0 msgr2=0x7fd1380fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:20:57.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.570+0000 7fd13fd4a640 1 -- 172.21.15.135:0/1346219653 shutdown_connections 2024-04-20T12:20:57.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:20:57.570+0000 7fd13fd4a640 1 -- 172.21.15.135:0/1346219653 wait complete. 2024-04-20T12:20:57.581 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi135.front.sepia.ceph.com... 2024-04-20T12:20:57.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:20:57.581 DEBUG:teuthology.orchestra.run.smithi135:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-20T12:20:57.602 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi135.stderr:ceph-fuse[59857]: fuse finished with error 0 and tester_r 0 2024-04-20T12:20:57.604 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T12:20:58.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:57 smithi154 ceph-mon[22073]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 323 B/s wr, 0 op/s 2024-04-20T12:20:58.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:57 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3151829735' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:20:58.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:57 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2525411960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:20:58.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:57 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1346219653' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-20T12:20:58.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:57 smithi139 ceph-mon[21834]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 323 B/s wr, 0 op/s 2024-04-20T12:20:58.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:57 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3151829735' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:20:58.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:57 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2525411960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:20:58.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:57 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1346219653' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-20T12:20:58.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:57 smithi135 ceph-mon[18264]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 323 B/s wr, 0 op/s 2024-04-20T12:20:58.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:57 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3151829735' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:20:58.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:57 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2525411960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:20:58.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:57 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1346219653' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-20T12:21:00.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:20:59 smithi154 ceph-mon[22073]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 292 B/s wr, 0 op/s 2024-04-20T12:21:00.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:20:59 smithi139 ceph-mon[21834]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 292 B/s wr, 0 op/s 2024-04-20T12:21:00.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:20:59 smithi135 ceph-mon[18264]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 292 B/s wr, 0 op/s 2024-04-20T12:21:02.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:01 smithi139 ceph-mon[21834]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-20T12:21:02.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:01 smithi154 ceph-mon[22073]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-20T12:21:02.269 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:01 smithi135 ceph-mon[18264]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-20T12:21:03.705 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2024-04-20T12:21:03.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:21:03.706 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-20T12:21:03.737 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:21:03.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.892+0000 7f3d7d825640 1 -- 172.21.15.135:0/2812364371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78102040 msgr2=0x7f3d781024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:03.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.892+0000 7f3d7d825640 1 --2- 172.21.15.135:0/2812364371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78102040 0x7f3d781024c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009900 tx=0x7f3d6c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:21:03.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.892+0000 7f3d7d825640 1 -- 172.21.15.135:0/2812364371 shutdown_connections 2024-04-20T12:21:03.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.892+0000 7f3d7d825640 1 --2- 172.21.15.135:0/2812364371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d78102a00 0x7f3d78109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:03.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.892+0000 7f3d7d825640 1 --2- 172.21.15.135:0/2812364371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78102040 0x7f3d781024c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:03.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.892+0000 7f3d7d825640 1 --2- 172.21.15.135:0/2812364371 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d78100e60 0x7f3d78101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:03.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.892+0000 7f3d7d825640 1 -- 172.21.15.135:0/2812364371 >> 172.21.15.135:0/2812364371 conn(0x7f3d780fc440 msgr2=0x7f3d780fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:03.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.892+0000 7f3d7d825640 1 -- 172.21.15.135:0/2812364371 shutdown_connections 2024-04-20T12:21:03.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.892+0000 7f3d7d825640 1 -- 172.21.15.135:0/2812364371 wait complete. 2024-04-20T12:21:03.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.892+0000 7f3d7d825640 1 Processor -- start 2024-04-20T12:21:03.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.892+0000 7f3d7d825640 1 -- start start 2024-04-20T12:21:03.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d7d825640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d78100e60 0x7f3d7806b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:03.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d7d825640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d78102040 0x7f3d7819cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:03.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d7d825640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78102a00 0x7f3d7819f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:03.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d7d825640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7810cba0 con 0x7f3d78102a00 2024-04-20T12:21:03.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d7d825640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7810ca20 con 0x7f3d78102040 2024-04-20T12:21:03.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d7d825640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7810cd20 con 0x7f3d78100e60 2024-04-20T12:21:03.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d777fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78102a00 0x7f3d7819f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:03.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d777fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78102a00 0x7f3d7819f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36800/0 (socket says 172.21.15.135:36800) 2024-04-20T12:21:03.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d777fe640 1 -- 172.21.15.135:0/264642449 learned_addr learned my addr 172.21.15.135:0/264642449 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:03.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d76ffd640 1 --2- 172.21.15.135:0/264642449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d78100e60 0x7f3d7806b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:03.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d767fc640 1 --2- 172.21.15.135:0/264642449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d78102040 0x7f3d7819cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:03.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d777fe640 1 -- 172.21.15.135:0/264642449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d78100e60 msgr2=0x7f3d7806b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:03.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d777fe640 1 --2- 172.21.15.135:0/264642449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d78100e60 0x7f3d7806b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:03.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d777fe640 1 -- 172.21.15.135:0/264642449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d78102040 msgr2=0x7f3d7819cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:03.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d777fe640 1 --2- 172.21.15.135:0/264642449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d78102040 0x7f3d7819cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:03.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d777fe640 1 -- 172.21.15.135:0/264642449 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7819fee0 con 0x7f3d78102a00 2024-04-20T12:21:03.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d767fc640 1 --2- 172.21.15.135:0/264642449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d78102040 0x7f3d7819cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:21:03.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d777fe640 1 --2- 172.21.15.135:0/264642449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78102a00 0x7f3d7819f620 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000eb10 tx=0x7f3d7000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:03.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d7c823640 1 -- 172.21.15.135:0/264642449 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70004b20 con 0x7f3d78102a00 2024-04-20T12:21:03.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d7c823640 1 -- 172.21.15.135:0/264642449 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d70004cc0 con 0x7f3d78102a00 2024-04-20T12:21:03.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d7d825640 1 -- 172.21.15.135:0/264642449 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d781a01d0 con 0x7f3d78102a00 2024-04-20T12:21:03.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.893+0000 7f3d7c823640 1 -- 172.21.15.135:0/264642449 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d70010760 con 0x7f3d78102a00 2024-04-20T12:21:03.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.894+0000 7f3d7d825640 1 -- 172.21.15.135:0/264642449 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d781a0720 con 0x7f3d78102a00 2024-04-20T12:21:03.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.894+0000 7f3d7d825640 1 -- 172.21.15.135:0/264642449 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d781081a0 con 0x7f3d78102a00 2024-04-20T12:21:03.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.895+0000 7f3d7c823640 1 -- 172.21.15.135:0/264642449 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f3d70005020 con 0x7f3d78102a00 2024-04-20T12:21:03.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.896+0000 7f3d7c823640 1 --2- 172.21.15.135:0/264642449 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3d600a3bb0 0x7f3d600a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:03.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.896+0000 7f3d76ffd640 1 --2- 172.21.15.135:0/264642449 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3d600a3bb0 0x7f3d600a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:03.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.897+0000 7f3d7c823640 1 -- 172.21.15.135:0/264642449 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f3d700d0de0 con 0x7f3d78102a00 2024-04-20T12:21:03.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.897+0000 7f3d76ffd640 1 --2- 172.21.15.135:0/264642449 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3d600a3bb0 0x7f3d600a6070 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3d68005d00 tx=0x7f3d68005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:03.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:03.901+0000 7f3d7c823640 1 -- 172.21.15.135:0/264642449 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f3d7009d580 con 0x7f3d78102a00 2024-04-20T12:21:04.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.078+0000 7f3d7d825640 1 -- 172.21.15.135:0/264642449 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d78062b60 con 0x7f3d78102a00 2024-04-20T12:21:04.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.080+0000 7f3d7c823640 1 -- 172.21.15.135:0/264642449 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24173 (secure 0 0 0) 0x7f3d7009ce80 con 0x7f3d78102a00 2024-04-20T12:21:04.080 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:21:04.080 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":90,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:20:48.315252+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:21:04.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.082+0000 7f3d7d825640 1 -- 172.21.15.135:0/264642449 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3d600a3bb0 msgr2=0x7f3d600a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:04.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.082+0000 7f3d7d825640 1 --2- 172.21.15.135:0/264642449 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3d600a3bb0 0x7f3d600a6070 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3d68005d00 tx=0x7f3d68005c50 comp rx=0 tx=0).stop 2024-04-20T12:21:04.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.082+0000 7f3d7d825640 1 -- 172.21.15.135:0/264642449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78102a00 msgr2=0x7f3d7819f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:04.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.082+0000 7f3d7d825640 1 --2- 172.21.15.135:0/264642449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78102a00 0x7f3d7819f620 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000eb10 tx=0x7f3d7000c2d0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.082+0000 7f3d7d825640 1 -- 172.21.15.135:0/264642449 shutdown_connections 2024-04-20T12:21:04.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.082+0000 7f3d7d825640 1 --2- 172.21.15.135:0/264642449 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3d600a3bb0 0x7f3d600a6070 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.082+0000 7f3d7d825640 1 --2- 172.21.15.135:0/264642449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d78102a00 0x7f3d7819f620 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.082+0000 7f3d7d825640 1 --2- 172.21.15.135:0/264642449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d78102040 0x7f3d7819cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.082+0000 7f3d7d825640 1 --2- 172.21.15.135:0/264642449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d78100e60 0x7f3d7806b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.082+0000 7f3d7d825640 1 -- 172.21.15.135:0/264642449 >> 172.21.15.135:0/264642449 conn(0x7f3d780fc440 msgr2=0x7f3d78105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:04.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.082+0000 7f3d7d825640 1 -- 172.21.15.135:0/264642449 shutdown_connections 2024-04-20T12:21:04.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.082+0000 7f3d7d825640 1 -- 172.21.15.135:0/264642449 wait complete. 2024-04-20T12:21:04.091 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:03 smithi135 ceph-mon[18264]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-20T12:21:04.093 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:21:04.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.192+0000 7f4f49304640 1 -- 172.21.15.135:0/3208395942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f44101170 msgr2=0x7f4f441015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:04.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.192+0000 7f4f49304640 1 --2- 172.21.15.135:0/3208395942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f44101170 0x7f4f441015f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009900 tx=0x7f4f3802bc30 comp rx=0 tx=0).stop 2024-04-20T12:21:04.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.192+0000 7f4f49304640 1 -- 172.21.15.135:0/3208395942 shutdown_connections 2024-04-20T12:21:04.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.192+0000 7f4f49304640 1 --2- 172.21.15.135:0/3208395942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f44101b30 0x7f4f441093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.192+0000 7f4f49304640 1 --2- 172.21.15.135:0/3208395942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f44101170 0x7f4f441015f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.192+0000 7f4f49304640 1 --2- 172.21.15.135:0/3208395942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f44102520 0x7f4f44102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.192+0000 7f4f49304640 1 -- 172.21.15.135:0/3208395942 >> 172.21.15.135:0/3208395942 conn(0x7f4f440fbc40 msgr2=0x7f4f440fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:04.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.192+0000 7f4f49304640 1 -- 172.21.15.135:0/3208395942 shutdown_connections 2024-04-20T12:21:04.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.192+0000 7f4f49304640 1 -- 172.21.15.135:0/3208395942 wait complete. 2024-04-20T12:21:04.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.192+0000 7f4f49304640 1 Processor -- start 2024-04-20T12:21:04.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.192+0000 7f4f49304640 1 -- start start 2024-04-20T12:21:04.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f49304640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f44101170 0x7f4f441982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:04.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f49304640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f44101b30 0x7f4f44198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:04.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f49304640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f44102520 0x7f4f4419f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:04.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f49304640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4410cc10 con 0x7f4f44102520 2024-04-20T12:21:04.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f49304640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4410ca90 con 0x7f4f44101b30 2024-04-20T12:21:04.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f49304640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4410cd90 con 0x7f4f44101170 2024-04-20T12:21:04.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f437fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f44102520 0x7f4f4419f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:04.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f437fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f44102520 0x7f4f4419f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36826/0 (socket says 172.21.15.135:36826) 2024-04-20T12:21:04.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f437fe640 1 -- 172.21.15.135:0/1748875575 learned_addr learned my addr 172.21.15.135:0/1748875575 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:04.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f427fc640 1 --2- 172.21.15.135:0/1748875575 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f44101b30 0x7f4f44198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:04.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f42ffd640 1 --2- 172.21.15.135:0/1748875575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f44101170 0x7f4f441982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:04.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f437fe640 1 -- 172.21.15.135:0/1748875575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f44101170 msgr2=0x7f4f441982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:04.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f437fe640 1 --2- 172.21.15.135:0/1748875575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f44101170 0x7f4f441982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f437fe640 1 -- 172.21.15.135:0/1748875575 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f44101b30 msgr2=0x7f4f44198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:04.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f437fe640 1 --2- 172.21.15.135:0/1748875575 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f44101b30 0x7f4f44198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f437fe640 1 -- 172.21.15.135:0/1748875575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4419ff10 con 0x7f4f44102520 2024-04-20T12:21:04.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f42ffd640 1 --2- 172.21.15.135:0/1748875575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f44101170 0x7f4f441982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:21:04.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f437fe640 1 --2- 172.21.15.135:0/1748875575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f44102520 0x7f4f4419f8a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400cce0 tx=0x7f4f3400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:04.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f2bfff640 1 -- 172.21.15.135:0/1748875575 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400f450 con 0x7f4f44102520 2024-04-20T12:21:04.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f2bfff640 1 -- 172.21.15.135:0/1748875575 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f3400fad0 con 0x7f4f44102520 2024-04-20T12:21:04.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f49304640 1 -- 172.21.15.135:0/1748875575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f441a0200 con 0x7f4f44102520 2024-04-20T12:21:04.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f2bfff640 1 -- 172.21.15.135:0/1748875575 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34018c10 con 0x7f4f44102520 2024-04-20T12:21:04.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.193+0000 7f4f49304640 1 -- 172.21.15.135:0/1748875575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f441a06d0 con 0x7f4f44102520 2024-04-20T12:21:04.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.194+0000 7f4f49304640 1 -- 172.21.15.135:0/1748875575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f441a0990 con 0x7f4f44102520 2024-04-20T12:21:04.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.196+0000 7f4f2bfff640 1 -- 172.21.15.135:0/1748875575 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f4f3400f5f0 con 0x7f4f44102520 2024-04-20T12:21:04.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.197+0000 7f4f2bfff640 1 --2- 172.21.15.135:0/1748875575 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f2c0a3bb0 0x7f4f2c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:04.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.197+0000 7f4f42ffd640 1 --2- 172.21.15.135:0/1748875575 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f2c0a3bb0 0x7f4f2c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:04.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.197+0000 7f4f2bfff640 1 -- 172.21.15.135:0/1748875575 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f4f340d0d80 con 0x7f4f44102520 2024-04-20T12:21:04.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.197+0000 7f4f42ffd640 1 --2- 172.21.15.135:0/1748875575 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f2c0a3bb0 0x7f4f2c0a6070 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0058c0 tx=0x7f4f3c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:04.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.200+0000 7f4f2bfff640 1 -- 172.21.15.135:0/1748875575 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f4f34014030 con 0x7f4f44102520 2024-04-20T12:21:04.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:03 smithi154 ceph-mon[22073]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-20T12:21:04.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:03 smithi139 ceph-mon[21834]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-20T12:21:04.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.378+0000 7f4f49304640 1 -- 172.21.15.135:0/1748875575 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f441a0c00 con 0x7f4f44102520 2024-04-20T12:21:04.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.380+0000 7f4f2bfff640 1 -- 172.21.15.135:0/1748875575 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24173 (secure 0 0 0) 0x7f4f3409d5b0 con 0x7f4f44102520 2024-04-20T12:21:04.380 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:21:04.380 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":90,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:20:48.315252+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:21:04.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.382+0000 7f4f49304640 1 -- 172.21.15.135:0/1748875575 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f2c0a3bb0 msgr2=0x7f4f2c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:04.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.382+0000 7f4f49304640 1 --2- 172.21.15.135:0/1748875575 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f2c0a3bb0 0x7f4f2c0a6070 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0058c0 tx=0x7f4f3c005850 comp rx=0 tx=0).stop 2024-04-20T12:21:04.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.382+0000 7f4f49304640 1 -- 172.21.15.135:0/1748875575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f44102520 msgr2=0x7f4f4419f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:04.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.382+0000 7f4f49304640 1 --2- 172.21.15.135:0/1748875575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f44102520 0x7f4f4419f8a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400cce0 tx=0x7f4f3400a620 comp rx=0 tx=0).stop 2024-04-20T12:21:04.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.382+0000 7f4f49304640 1 -- 172.21.15.135:0/1748875575 shutdown_connections 2024-04-20T12:21:04.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.382+0000 7f4f49304640 1 --2- 172.21.15.135:0/1748875575 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f2c0a3bb0 0x7f4f2c0a6070 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.382+0000 7f4f49304640 1 --2- 172.21.15.135:0/1748875575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f44102520 0x7f4f4419f8a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.382+0000 7f4f49304640 1 --2- 172.21.15.135:0/1748875575 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f44101b30 0x7f4f44198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.382+0000 7f4f49304640 1 --2- 172.21.15.135:0/1748875575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f44101170 0x7f4f441982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.382+0000 7f4f49304640 1 -- 172.21.15.135:0/1748875575 >> 172.21.15.135:0/1748875575 conn(0x7f4f440fbc40 msgr2=0x7f4f440fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:04.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.382+0000 7f4f49304640 1 -- 172.21.15.135:0/1748875575 shutdown_connections 2024-04-20T12:21:04.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.382+0000 7f4f49304640 1 -- 172.21.15.135:0/1748875575 wait complete. 2024-04-20T12:21:04.394 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-20T12:21:04.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.495+0000 7f239f2fd640 1 -- 172.21.15.135:0/3889365386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2398102050 msgr2=0x7f23981024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:04.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.495+0000 7f239f2fd640 1 --2- 172.21.15.135:0/3889365386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2398102050 0x7f23981024d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2388009900 tx=0x7f238802bc30 comp rx=0 tx=0).stop 2024-04-20T12:21:04.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.495+0000 7f239f2fd640 1 -- 172.21.15.135:0/3889365386 shutdown_connections 2024-04-20T12:21:04.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.495+0000 7f239f2fd640 1 --2- 172.21.15.135:0/3889365386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2398102a10 0x7f2398109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.495+0000 7f239f2fd640 1 --2- 172.21.15.135:0/3889365386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2398102050 0x7f23981024d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.495+0000 7f239f2fd640 1 --2- 172.21.15.135:0/3889365386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2398100e70 0x7f2398101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.495+0000 7f239f2fd640 1 -- 172.21.15.135:0/3889365386 >> 172.21.15.135:0/3889365386 conn(0x7f23980fc430 msgr2=0x7f23980fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:04.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.495+0000 7f239f2fd640 1 -- 172.21.15.135:0/3889365386 shutdown_connections 2024-04-20T12:21:04.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.495+0000 7f239f2fd640 1 -- 172.21.15.135:0/3889365386 wait complete. 2024-04-20T12:21:04.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239f2fd640 1 Processor -- start 2024-04-20T12:21:04.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239f2fd640 1 -- start start 2024-04-20T12:21:04.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239f2fd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2398100e70 0x7f23981971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:04.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239f2fd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2398102050 0x7f2398197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:04.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239f2fd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2398102a10 0x7f239819e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:04.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239f2fd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f239810cb50 con 0x7f2398102a10 2024-04-20T12:21:04.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239f2fd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f239810c9d0 con 0x7f2398102050 2024-04-20T12:21:04.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239f2fd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f239810ccd0 con 0x7f2398100e70 2024-04-20T12:21:04.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239d89a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2398102a10 0x7f239819e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:04.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239d89a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2398102a10 0x7f239819e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36846/0 (socket says 172.21.15.135:36846) 2024-04-20T12:21:04.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239d89a640 1 -- 172.21.15.135:0/2815525519 learned_addr learned my addr 172.21.15.135:0/2815525519 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:04.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239d099640 1 --2- 172.21.15.135:0/2815525519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2398100e70 0x7f23981971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:04.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239d89a640 1 -- 172.21.15.135:0/2815525519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2398100e70 msgr2=0x7f23981971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:04.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239d89a640 1 --2- 172.21.15.135:0/2815525519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2398100e70 0x7f23981971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239d89a640 1 -- 172.21.15.135:0/2815525519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2398102050 msgr2=0x7f2398197710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:04.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239d89a640 1 --2- 172.21.15.135:0/2815525519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2398102050 0x7f2398197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239d89a640 1 -- 172.21.15.135:0/2815525519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239819edf0 con 0x7f2398102a10 2024-04-20T12:21:04.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.496+0000 7f239d89a640 1 --2- 172.21.15.135:0/2815525519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2398102a10 0x7f239819e780 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2390009fd0 tx=0x7f239000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:04.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.497+0000 7f238e7fc640 1 -- 172.21.15.135:0/2815525519 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2390017070 con 0x7f2398102a10 2024-04-20T12:21:04.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.497+0000 7f238e7fc640 1 -- 172.21.15.135:0/2815525519 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2390003e50 con 0x7f2398102a10 2024-04-20T12:21:04.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.497+0000 7f239f2fd640 1 -- 172.21.15.135:0/2815525519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f239819f0e0 con 0x7f2398102a10 2024-04-20T12:21:04.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.497+0000 7f238e7fc640 1 -- 172.21.15.135:0/2815525519 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23900106c0 con 0x7f2398102a10 2024-04-20T12:21:04.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.497+0000 7f239f2fd640 1 -- 172.21.15.135:0/2815525519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f239819f5e0 con 0x7f2398102a10 2024-04-20T12:21:04.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.497+0000 7f239f2fd640 1 -- 172.21.15.135:0/2815525519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2398108290 con 0x7f2398102a10 2024-04-20T12:21:04.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.499+0000 7f238e7fc640 1 -- 172.21.15.135:0/2815525519 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f2390003970 con 0x7f2398102a10 2024-04-20T12:21:04.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.499+0000 7f238e7fc640 1 --2- 172.21.15.135:0/2815525519 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f23840a3bb0 0x7f23840a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:04.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.499+0000 7f239d099640 1 --2- 172.21.15.135:0/2815525519 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f23840a3bb0 0x7f23840a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:04.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.499+0000 7f238e7fc640 1 -- 172.21.15.135:0/2815525519 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f23900d0440 con 0x7f2398102a10 2024-04-20T12:21:04.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.500+0000 7f239d099640 1 --2- 172.21.15.135:0/2815525519 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f23840a3bb0 0x7f23840a6070 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2398101bc0 tx=0x7f2394005c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:04.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.503+0000 7f238e7fc640 1 -- 172.21.15.135:0/2815525519 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f239009cbe0 con 0x7f2398102a10 2024-04-20T12:21:04.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.716+0000 7f239f2fd640 1 -- 172.21.15.135:0/2815525519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f239802d750 con 0x7f2398102a10 2024-04-20T12:21:04.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.895+0000 7f238e7fc640 1 -- 172.21.15.135:0/2815525519 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f239009c4e0 con 0x7f2398102a10 2024-04-20T12:21:04.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.898+0000 7f239f2fd640 1 -- 172.21.15.135:0/2815525519 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f23840a3bb0 msgr2=0x7f23840a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:04.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.898+0000 7f239f2fd640 1 --2- 172.21.15.135:0/2815525519 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f23840a3bb0 0x7f23840a6070 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2398101bc0 tx=0x7f2394005c60 comp rx=0 tx=0).stop 2024-04-20T12:21:04.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.898+0000 7f239f2fd640 1 -- 172.21.15.135:0/2815525519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2398102a10 msgr2=0x7f239819e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:04.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.898+0000 7f239f2fd640 1 --2- 172.21.15.135:0/2815525519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2398102a10 0x7f239819e780 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2390009fd0 tx=0x7f239000b260 comp rx=0 tx=0).stop 2024-04-20T12:21:04.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.898+0000 7f239f2fd640 1 -- 172.21.15.135:0/2815525519 shutdown_connections 2024-04-20T12:21:04.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.898+0000 7f239f2fd640 1 --2- 172.21.15.135:0/2815525519 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f23840a3bb0 0x7f23840a6070 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.898+0000 7f239f2fd640 1 --2- 172.21.15.135:0/2815525519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2398102a10 0x7f239819e780 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.898+0000 7f239f2fd640 1 --2- 172.21.15.135:0/2815525519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2398102050 0x7f2398197710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.898+0000 7f239f2fd640 1 --2- 172.21.15.135:0/2815525519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2398100e70 0x7f23981971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:04.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.898+0000 7f239f2fd640 1 -- 172.21.15.135:0/2815525519 >> 172.21.15.135:0/2815525519 conn(0x7f23980fc430 msgr2=0x7f2398105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:04.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.898+0000 7f239f2fd640 1 -- 172.21.15.135:0/2815525519 shutdown_connections 2024-04-20T12:21:04.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:04.898+0000 7f239f2fd640 1 -- 172.21.15.135:0/2815525519 wait complete. 2024-04-20T12:21:04.909 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-04-20T12:21:04.909 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-20T12:21:05.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.010+0000 7fcfa01d5640 1 -- 172.21.15.135:0/2854367391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf981029b0 msgr2=0x7fcf981092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:05.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.010+0000 7fcfa01d5640 1 --2- 172.21.15.135:0/2854367391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf981029b0 0x7fcf981092d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009ca0 tx=0x7fcf8802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:21:05.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcfa01d5640 1 -- 172.21.15.135:0/2854367391 shutdown_connections 2024-04-20T12:21:05.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcfa01d5640 1 --2- 172.21.15.135:0/2854367391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf981029b0 0x7fcf981092d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcfa01d5640 1 --2- 172.21.15.135:0/2854367391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf98101ff0 0x7fcf98102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcfa01d5640 1 --2- 172.21.15.135:0/2854367391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf98100ea0 0x7fcf981012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcfa01d5640 1 -- 172.21.15.135:0/2854367391 >> 172.21.15.135:0/2854367391 conn(0x7fcf980fc410 msgr2=0x7fcf980fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcfa01d5640 1 -- 172.21.15.135:0/2854367391 shutdown_connections 2024-04-20T12:21:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcfa01d5640 1 -- 172.21.15.135:0/2854367391 wait complete. 2024-04-20T12:21:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcfa01d5640 1 Processor -- start 2024-04-20T12:21:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcfa01d5640 1 -- start start 2024-04-20T12:21:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcfa01d5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf98100ea0 0x7fcf98069c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcfa01d5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf98101ff0 0x7fcf9819cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcfa01d5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf981029b0 0x7fcf9819f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcfa01d5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9810cb40 con 0x7fcf98100ea0 2024-04-20T12:21:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcfa01d5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9810c9c0 con 0x7fcf981029b0 2024-04-20T12:21:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcfa01d5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9810ccc0 con 0x7fcf98101ff0 2024-04-20T12:21:05.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcf9df71640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf98100ea0 0x7fcf98069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcf9df71640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf98100ea0 0x7fcf98069c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36858/0 (socket says 172.21.15.135:36858) 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.011+0000 7fcf9df71640 1 -- 172.21.15.135:0/1253052776 learned_addr learned my addr 172.21.15.135:0/1253052776 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.012+0000 7fcf9e772640 1 --2- 172.21.15.135:0/1253052776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf981029b0 0x7fcf9819f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.012+0000 7fcf9d770640 1 --2- 172.21.15.135:0/1253052776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf98101ff0 0x7fcf9819cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.012+0000 7fcf9df71640 1 -- 172.21.15.135:0/1253052776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf98101ff0 msgr2=0x7fcf9819cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.012+0000 7fcf9df71640 1 --2- 172.21.15.135:0/1253052776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf98101ff0 0x7fcf9819cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.012+0000 7fcf9df71640 1 -- 172.21.15.135:0/1253052776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf981029b0 msgr2=0x7fcf9819f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.012+0000 7fcf9df71640 1 --2- 172.21.15.135:0/1253052776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf981029b0 0x7fcf9819f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.012+0000 7fcf9df71640 1 -- 172.21.15.135:0/1253052776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9819fe20 con 0x7fcf98100ea0 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.012+0000 7fcf9e772640 1 --2- 172.21.15.135:0/1253052776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf981029b0 0x7fcf9819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.012+0000 7fcf9df71640 1 --2- 172.21.15.135:0/1253052776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf98100ea0 0x7fcf98069c80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000c920 tx=0x7fcf9000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.012+0000 7fcf96ffd640 1 -- 172.21.15.135:0/1253052776 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf90007c70 con 0x7fcf98100ea0 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.012+0000 7fcf96ffd640 1 -- 172.21.15.135:0/1253052776 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf90007e10 con 0x7fcf98100ea0 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.012+0000 7fcfa01d5640 1 -- 172.21.15.135:0/1253052776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf981a0110 con 0x7fcf98100ea0 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.012+0000 7fcf96ffd640 1 -- 172.21.15.135:0/1253052776 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf90018890 con 0x7fcf98100ea0 2024-04-20T12:21:05.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.012+0000 7fcfa01d5640 1 -- 172.21.15.135:0/1253052776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf981a0660 con 0x7fcf98100ea0 2024-04-20T12:21:05.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.013+0000 7fcfa01d5640 1 -- 172.21.15.135:0/1253052776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf98108150 con 0x7fcf98100ea0 2024-04-20T12:21:05.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.014+0000 7fcf96ffd640 1 -- 172.21.15.135:0/1253052776 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fcf90018a70 con 0x7fcf98100ea0 2024-04-20T12:21:05.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.015+0000 7fcf96ffd640 1 --2- 172.21.15.135:0/1253052776 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fcf800a3bb0 0x7fcf800a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:05.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.015+0000 7fcf9d770640 1 --2- 172.21.15.135:0/1253052776 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fcf800a3bb0 0x7fcf800a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:05.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.015+0000 7fcf96ffd640 1 -- 172.21.15.135:0/1253052776 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fcf900d0830 con 0x7fcf98100ea0 2024-04-20T12:21:05.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.015+0000 7fcf9d770640 1 --2- 172.21.15.135:0/1253052776 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fcf800a3bb0 0x7fcf800a6070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcf980699f0 tx=0x7fcf8c00a4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:05.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.019+0000 7fcf96ffd640 1 -- 172.21.15.135:0/1253052776 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fcf90014030 con 0x7fcf98100ea0 2024-04-20T12:21:05.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.237+0000 7fcfa01d5640 1 -- 172.21.15.135:0/1253052776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fcf98062b90 con 0x7fcf98100ea0 2024-04-20T12:21:05.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:04 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/264642449' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:21:05.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:04 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1748875575' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:21:05.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:04 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2815525519' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-20T12:21:05.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:04 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/264642449' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:21:05.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:04 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1748875575' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:21:05.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:04 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2815525519' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-20T12:21:05.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:04 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/264642449' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:21:05.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:04 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1748875575' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:21:05.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:04 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2815525519' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-04-20T12:21:05.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.897+0000 7fcf96ffd640 1 -- 172.21.15.135:0/1253052776 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7fcf9000de20 con 0x7fcf98100ea0 2024-04-20T12:21:05.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.899+0000 7fcfa01d5640 1 -- 172.21.15.135:0/1253052776 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fcf800a3bb0 msgr2=0x7fcf800a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:05.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.899+0000 7fcfa01d5640 1 --2- 172.21.15.135:0/1253052776 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fcf800a3bb0 0x7fcf800a6070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcf980699f0 tx=0x7fcf8c00a4c0 comp rx=0 tx=0).stop 2024-04-20T12:21:05.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.899+0000 7fcfa01d5640 1 -- 172.21.15.135:0/1253052776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf98100ea0 msgr2=0x7fcf98069c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:05.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.899+0000 7fcfa01d5640 1 --2- 172.21.15.135:0/1253052776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf98100ea0 0x7fcf98069c80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000c920 tx=0x7fcf9000cde0 comp rx=0 tx=0).stop 2024-04-20T12:21:05.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.899+0000 7fcfa01d5640 1 -- 172.21.15.135:0/1253052776 shutdown_connections 2024-04-20T12:21:05.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.899+0000 7fcfa01d5640 1 --2- 172.21.15.135:0/1253052776 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fcf800a3bb0 0x7fcf800a6070 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:05.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.899+0000 7fcfa01d5640 1 --2- 172.21.15.135:0/1253052776 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf981029b0 0x7fcf9819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:05.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.899+0000 7fcfa01d5640 1 --2- 172.21.15.135:0/1253052776 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf98101ff0 0x7fcf9819cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:05.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.899+0000 7fcfa01d5640 1 --2- 172.21.15.135:0/1253052776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf98100ea0 0x7fcf98069c80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:05.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.899+0000 7fcfa01d5640 1 -- 172.21.15.135:0/1253052776 >> 172.21.15.135:0/1253052776 conn(0x7fcf980fc410 msgr2=0x7fcf98105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:05.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.899+0000 7fcfa01d5640 1 -- 172.21.15.135:0/1253052776 shutdown_connections 2024-04-20T12:21:05.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:05.899+0000 7fcfa01d5640 1 -- 172.21.15.135:0/1253052776 wait complete. 2024-04-20T12:21:05.914 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-04-20T12:21:06.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.017+0000 7ffab89b6640 1 -- 172.21.15.135:0/1708813496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffab4102a80 msgr2=0x7ffab4104e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:06.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.017+0000 7ffab89b6640 1 --2- 172.21.15.135:0/1708813496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffab4102a80 0x7ffab4104e70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009900 tx=0x7ffaa802bc30 comp rx=0 tx=0).stop 2024-04-20T12:21:06.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.017+0000 7ffab89b6640 1 -- 172.21.15.135:0/1708813496 shutdown_connections 2024-04-20T12:21:06.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.017+0000 7ffab89b6640 1 --2- 172.21.15.135:0/1708813496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffab4107ce0 0x7ffab410a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:06.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.017+0000 7ffab89b6640 1 --2- 172.21.15.135:0/1708813496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffab41053b0 0x7ffab41077a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:06.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.017+0000 7ffab89b6640 1 --2- 172.21.15.135:0/1708813496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffab4102a80 0x7ffab4104e70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:06.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.017+0000 7ffab89b6640 1 -- 172.21.15.135:0/1708813496 >> 172.21.15.135:0/1708813496 conn(0x7ffab40fc410 msgr2=0x7ffab40fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:06.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.017+0000 7ffab89b6640 1 -- 172.21.15.135:0/1708813496 shutdown_connections 2024-04-20T12:21:06.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.017+0000 7ffab89b6640 1 -- 172.21.15.135:0/1708813496 wait complete. 2024-04-20T12:21:06.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab89b6640 1 Processor -- start 2024-04-20T12:21:06.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab89b6640 1 -- start start 2024-04-20T12:21:06.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab89b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffab4102a80 0x7ffab4198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:06.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab89b6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffab41053b0 0x7ffab41987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:06.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab89b6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffab4107ce0 0x7ffab419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:06.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab89b6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffab410dc30 con 0x7ffab41053b0 2024-04-20T12:21:06.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab89b6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ffab410dab0 con 0x7ffab4107ce0 2024-04-20T12:21:06.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab89b6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffab410ddb0 con 0x7ffab4102a80 2024-04-20T12:21:06.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab1d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffab41053b0 0x7ffab41987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:06.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab1d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffab41053b0 0x7ffab41987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36888/0 (socket says 172.21.15.135:36888) 2024-04-20T12:21:06.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab1d9b640 1 -- 172.21.15.135:0/1942705154 learned_addr learned my addr 172.21.15.135:0/1942705154 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:06.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab2d9d640 1 --2- 172.21.15.135:0/1942705154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffab4107ce0 0x7ffab419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:06.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab1d9b640 1 -- 172.21.15.135:0/1942705154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffab4102a80 msgr2=0x7ffab4198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:06.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab1d9b640 1 --2- 172.21.15.135:0/1942705154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffab4102a80 0x7ffab4198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:06.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab1d9b640 1 -- 172.21.15.135:0/1942705154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffab4107ce0 msgr2=0x7ffab419f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:06.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab1d9b640 1 --2- 172.21.15.135:0/1942705154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffab4107ce0 0x7ffab419f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:06.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab1d9b640 1 -- 172.21.15.135:0/1942705154 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab419fe90 con 0x7ffab41053b0 2024-04-20T12:21:06.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab2d9d640 1 --2- 172.21.15.135:0/1942705154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffab4107ce0 0x7ffab419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:21:06.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffab1d9b640 1 --2- 172.21.15.135:0/1942705154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffab41053b0 0x7ffab41987b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400c970 tx=0x7ffaa400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:06.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.018+0000 7ffaa37fe640 1 -- 172.21.15.135:0/1942705154 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4014070 con 0x7ffab41053b0 2024-04-20T12:21:06.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.019+0000 7ffaa37fe640 1 -- 172.21.15.135:0/1942705154 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaa4004440 con 0x7ffab41053b0 2024-04-20T12:21:06.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.019+0000 7ffaa37fe640 1 -- 172.21.15.135:0/1942705154 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400f450 con 0x7ffab41053b0 2024-04-20T12:21:06.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.019+0000 7ffab89b6640 1 -- 172.21.15.135:0/1942705154 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab41a0180 con 0x7ffab41053b0 2024-04-20T12:21:06.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.019+0000 7ffab89b6640 1 -- 172.21.15.135:0/1942705154 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab41a0680 con 0x7ffab41053b0 2024-04-20T12:21:06.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.020+0000 7ffab89b6640 1 -- 172.21.15.135:0/1942705154 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab40fdf00 con 0x7ffab41053b0 2024-04-20T12:21:06.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.021+0000 7ffaa37fe640 1 -- 172.21.15.135:0/1942705154 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7ffaa4017070 con 0x7ffab41053b0 2024-04-20T12:21:06.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.021+0000 7ffaa37fe640 1 --2- 172.21.15.135:0/1942705154 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ffa9c0a3c30 0x7ffa9c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:06.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.021+0000 7ffab259c640 1 --2- 172.21.15.135:0/1942705154 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ffa9c0a3c30 0x7ffa9c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:06.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.021+0000 7ffaa37fe640 1 -- 172.21.15.135:0/1942705154 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7ffaa40d04c0 con 0x7ffab41053b0 2024-04-20T12:21:06.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.022+0000 7ffab259c640 1 --2- 172.21.15.135:0/1942705154 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ffa9c0a3c30 0x7ffa9c0a60f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8005c20 tx=0x7ffaa8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:06.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.026+0000 7ffaa37fe640 1 -- 172.21.15.135:0/1942705154 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7ffaa401e020 con 0x7ffab41053b0 2024-04-20T12:21:06.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.245+0000 7ffab89b6640 1 -- 172.21.15.135:0/1942705154 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7ffab402d5d0 con 0x7ffab41053b0 2024-04-20T12:21:06.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:05 smithi154 ceph-mon[22073]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-20T12:21:06.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:05 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2815525519' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-20T12:21:06.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:05 smithi154 ceph-mon[22073]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-20T12:21:06.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:05 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1253052776' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-20T12:21:06.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:05 smithi139 ceph-mon[21834]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-20T12:21:06.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:05 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2815525519' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-20T12:21:06.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:05 smithi139 ceph-mon[21834]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-20T12:21:06.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:05 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1253052776' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-20T12:21:06.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:05 smithi135 ceph-mon[18264]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-04-20T12:21:06.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:05 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2815525519' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-04-20T12:21:06.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:05 smithi135 ceph-mon[18264]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-20T12:21:06.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:05 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1253052776' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-04-20T12:21:06.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.903+0000 7ffaa37fe640 1 -- 172.21.15.135:0/1942705154 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7ffaa409cc60 con 0x7ffab41053b0 2024-04-20T12:21:06.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.907+0000 7ffab89b6640 1 -- 172.21.15.135:0/1942705154 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ffa9c0a3c30 msgr2=0x7ffa9c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:06.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.907+0000 7ffab89b6640 1 --2- 172.21.15.135:0/1942705154 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ffa9c0a3c30 0x7ffa9c0a60f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8005c20 tx=0x7ffaa8000bc0 comp rx=0 tx=0).stop 2024-04-20T12:21:06.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.907+0000 7ffab89b6640 1 -- 172.21.15.135:0/1942705154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffab41053b0 msgr2=0x7ffab41987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:06.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.907+0000 7ffab89b6640 1 --2- 172.21.15.135:0/1942705154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffab41053b0 0x7ffab41987b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400c970 tx=0x7ffaa400ce30 comp rx=0 tx=0).stop 2024-04-20T12:21:06.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.907+0000 7ffab89b6640 1 -- 172.21.15.135:0/1942705154 shutdown_connections 2024-04-20T12:21:06.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.907+0000 7ffab89b6640 1 --2- 172.21.15.135:0/1942705154 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ffa9c0a3c30 0x7ffa9c0a60f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:06.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.907+0000 7ffab89b6640 1 --2- 172.21.15.135:0/1942705154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffab4107ce0 0x7ffab419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:06.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.907+0000 7ffab89b6640 1 --2- 172.21.15.135:0/1942705154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffab41053b0 0x7ffab41987b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:06.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.907+0000 7ffab89b6640 1 --2- 172.21.15.135:0/1942705154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffab4102a80 0x7ffab4198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:06.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.907+0000 7ffab89b6640 1 -- 172.21.15.135:0/1942705154 >> 172.21.15.135:0/1942705154 conn(0x7ffab40fc410 msgr2=0x7ffab4103340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:06.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.907+0000 7ffab89b6640 1 -- 172.21.15.135:0/1942705154 shutdown_connections 2024-04-20T12:21:06.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:06.907+0000 7ffab89b6640 1 -- 172.21.15.135:0/1942705154 wait complete. 2024-04-20T12:21:06.924 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-20T12:21:07.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.028+0000 7f8caa952640 1 -- 172.21.15.135:0/3109096860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ca4103c00 msgr2=0x7f8ca410a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:07.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.028+0000 7f8caa952640 1 --2- 172.21.15.135:0/3109096860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ca4103c00 0x7f8ca410a490 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009cd0 tx=0x7f8c9c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:21:07.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.028+0000 7f8caa952640 1 -- 172.21.15.135:0/3109096860 shutdown_connections 2024-04-20T12:21:07.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.028+0000 7f8caa952640 1 --2- 172.21.15.135:0/3109096860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ca4103c00 0x7f8ca410a490 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:07.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.028+0000 7f8caa952640 1 --2- 172.21.15.135:0/3109096860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca4103240 0x7f8ca41036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:07.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.028+0000 7f8caa952640 1 --2- 172.21.15.135:0/3109096860 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ca4100270 0x7f8ca4100690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:07.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.028+0000 7f8caa952640 1 -- 172.21.15.135:0/3109096860 >> 172.21.15.135:0/3109096860 conn(0x7f8ca40fbba0 msgr2=0x7f8ca40fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:07.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.028+0000 7f8caa952640 1 -- 172.21.15.135:0/3109096860 shutdown_connections 2024-04-20T12:21:07.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.028+0000 7f8caa952640 1 -- 172.21.15.135:0/3109096860 wait complete. 2024-04-20T12:21:07.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8caa952640 1 Processor -- start 2024-04-20T12:21:07.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8caa952640 1 -- start start 2024-04-20T12:21:07.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8caa952640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca4100270 0x7f8ca4198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:07.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8caa952640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ca4103240 0x7f8ca4198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:07.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8caa952640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ca4103c00 0x7f8ca419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:07.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8caa952640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca410dc60 con 0x7f8ca4103240 2024-04-20T12:21:07.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8caa952640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca410dae0 con 0x7f8ca4103c00 2024-04-20T12:21:07.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8caa952640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca410dde0 con 0x7f8ca4100270 2024-04-20T12:21:07.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8ca37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ca4103240 0x7f8ca4198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:07.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8ca37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ca4103240 0x7f8ca4198760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36906/0 (socket says 172.21.15.135:36906) 2024-04-20T12:21:07.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8ca37fe640 1 -- 172.21.15.135:0/267695593 learned_addr learned my addr 172.21.15.135:0/267695593 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:07.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8ca3fff640 1 --2- 172.21.15.135:0/267695593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca4100270 0x7f8ca4198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:07.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8ca37fe640 1 -- 172.21.15.135:0/267695593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca4100270 msgr2=0x7f8ca4198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:07.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8ca37fe640 1 --2- 172.21.15.135:0/267695593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca4100270 0x7f8ca4198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:07.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8ca37fe640 1 -- 172.21.15.135:0/267695593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ca4103c00 msgr2=0x7f8ca419f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:07.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8ca37fe640 1 --2- 172.21.15.135:0/267695593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ca4103c00 0x7f8ca419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:07.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8ca37fe640 1 -- 172.21.15.135:0/267695593 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca419fe40 con 0x7f8ca4103240 2024-04-20T12:21:07.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.029+0000 7f8ca37fe640 1 --2- 172.21.15.135:0/267695593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ca4103240 0x7f8ca4198760 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800e9f0 tx=0x7f8c9800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:07.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.030+0000 7f8ca17fa640 1 -- 172.21.15.135:0/267695593 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800cd80 con 0x7f8ca4103240 2024-04-20T12:21:07.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.030+0000 7f8ca17fa640 1 -- 172.21.15.135:0/267695593 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c98005500 con 0x7f8ca4103240 2024-04-20T12:21:07.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.030+0000 7f8caa952640 1 -- 172.21.15.135:0/267695593 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca41a0130 con 0x7f8ca4103240 2024-04-20T12:21:07.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.030+0000 7f8ca17fa640 1 -- 172.21.15.135:0/267695593 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98010690 con 0x7f8ca4103240 2024-04-20T12:21:07.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.030+0000 7f8caa952640 1 -- 172.21.15.135:0/267695593 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca41a0630 con 0x7f8ca4103240 2024-04-20T12:21:07.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.031+0000 7f8caa952640 1 -- 172.21.15.135:0/267695593 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ca41092a0 con 0x7f8ca4103240 2024-04-20T12:21:07.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.032+0000 7f8ca17fa640 1 -- 172.21.15.135:0/267695593 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f8c980046c0 con 0x7f8ca4103240 2024-04-20T12:21:07.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.032+0000 7f8ca17fa640 1 --2- 172.21.15.135:0/267695593 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8c8c0a3bb0 0x7f8c8c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:07.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.033+0000 7f8ca3fff640 1 --2- 172.21.15.135:0/267695593 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8c8c0a3bb0 0x7f8c8c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:07.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.033+0000 7f8ca17fa640 1 -- 172.21.15.135:0/267695593 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f8c980d0af0 con 0x7f8ca4103240 2024-04-20T12:21:07.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.033+0000 7f8ca3fff640 1 --2- 172.21.15.135:0/267695593 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8c8c0a3bb0 0x7f8c8c0a6070 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8ca406a3e0 tx=0x7f8c94005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:07.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.037+0000 7f8ca17fa640 1 -- 172.21.15.135:0/267695593 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f8c9809d290 con 0x7f8ca4103240 2024-04-20T12:21:07.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:06 smithi154 ceph-mon[22073]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-20T12:21:07.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:06 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1253052776' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-20T12:21:07.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:06 smithi154 ceph-mon[22073]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-20T12:21:07.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:06 smithi154 ceph-mon[22073]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-20T12:21:07.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:06 smithi154 ceph-mon[22073]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-04-20T12:21:07.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:06 smithi154 ceph-mon[22073]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-04-20T12:21:07.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:06 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1942705154' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-20T12:21:07.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.253+0000 7f8caa952640 1 -- 172.21.15.135:0/267695593 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f8ca4062b60 con 0x7f8ca4103240 2024-04-20T12:21:07.265 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:06 smithi135 ceph-mon[18264]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-20T12:21:07.265 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:06 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1253052776' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-20T12:21:07.265 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:06 smithi135 ceph-mon[18264]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-20T12:21:07.265 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:06 smithi135 ceph-mon[18264]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-20T12:21:07.265 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:06 smithi135 ceph-mon[18264]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-04-20T12:21:07.265 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:06 smithi135 ceph-mon[18264]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-04-20T12:21:07.265 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:06 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1942705154' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-20T12:21:07.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:06 smithi139 ceph-mon[21834]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-20T12:21:07.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:06 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1253052776' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-04-20T12:21:07.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:06 smithi139 ceph-mon[21834]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-04-20T12:21:07.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:06 smithi139 ceph-mon[21834]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-04-20T12:21:07.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:06 smithi139 ceph-mon[21834]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-04-20T12:21:07.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:06 smithi139 ceph-mon[21834]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-04-20T12:21:07.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:06 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1942705154' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-20T12:21:07.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.910+0000 7f8ca17fa640 1 -- 172.21.15.135:0/267695593 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7f8c9809cb90 con 0x7f8ca4103240 2024-04-20T12:21:07.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.913+0000 7f8caa952640 1 -- 172.21.15.135:0/267695593 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8c8c0a3bb0 msgr2=0x7f8c8c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:07.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.913+0000 7f8caa952640 1 --2- 172.21.15.135:0/267695593 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8c8c0a3bb0 0x7f8c8c0a6070 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8ca406a3e0 tx=0x7f8c94005f90 comp rx=0 tx=0).stop 2024-04-20T12:21:07.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.913+0000 7f8caa952640 1 -- 172.21.15.135:0/267695593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ca4103240 msgr2=0x7f8ca4198760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:07.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.913+0000 7f8caa952640 1 --2- 172.21.15.135:0/267695593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ca4103240 0x7f8ca4198760 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800e9f0 tx=0x7f8c9800edf0 comp rx=0 tx=0).stop 2024-04-20T12:21:07.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.913+0000 7f8caa952640 1 -- 172.21.15.135:0/267695593 shutdown_connections 2024-04-20T12:21:07.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.913+0000 7f8caa952640 1 --2- 172.21.15.135:0/267695593 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8c8c0a3bb0 0x7f8c8c0a6070 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:07.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.913+0000 7f8caa952640 1 --2- 172.21.15.135:0/267695593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ca4103c00 0x7f8ca419f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:07.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.913+0000 7f8caa952640 1 --2- 172.21.15.135:0/267695593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ca4103240 0x7f8ca4198760 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:07.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.913+0000 7f8caa952640 1 --2- 172.21.15.135:0/267695593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ca4100270 0x7f8ca4198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:07.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.913+0000 7f8caa952640 1 -- 172.21.15.135:0/267695593 >> 172.21.15.135:0/267695593 conn(0x7f8ca40fbba0 msgr2=0x7f8ca4106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:07.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.913+0000 7f8caa952640 1 -- 172.21.15.135:0/267695593 shutdown_connections 2024-04-20T12:21:07.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:07.913+0000 7f8caa952640 1 -- 172.21.15.135:0/267695593 wait complete. 2024-04-20T12:21:07.933 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-04-20T12:21:07.933 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-04-20T12:21:08.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.042+0000 7f72b51fb640 1 -- 172.21.15.135:0/2200450364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b0101ff0 msgr2=0x7f72b0102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:08.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.042+0000 7f72b51fb640 1 --2- 172.21.15.135:0/2200450364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b0101ff0 0x7f72b0102470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009900 tx=0x7f72a402bc30 comp rx=0 tx=0).stop 2024-04-20T12:21:08.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.042+0000 7f72b51fb640 1 -- 172.21.15.135:0/2200450364 shutdown_connections 2024-04-20T12:21:08.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.042+0000 7f72b51fb640 1 --2- 172.21.15.135:0/2200450364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72b01029b0 0x7f72b01092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.042+0000 7f72b51fb640 1 --2- 172.21.15.135:0/2200450364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b0101ff0 0x7f72b0102470 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.042+0000 7f72b51fb640 1 --2- 172.21.15.135:0/2200450364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72b0100ea0 0x7f72b01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.042+0000 7f72b51fb640 1 -- 172.21.15.135:0/2200450364 >> 172.21.15.135:0/2200450364 conn(0x7f72b00fc410 msgr2=0x7f72b00fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:08.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.042+0000 7f72b51fb640 1 -- 172.21.15.135:0/2200450364 shutdown_connections 2024-04-20T12:21:08.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.042+0000 7f72b51fb640 1 -- 172.21.15.135:0/2200450364 wait complete. 2024-04-20T12:21:08.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.043+0000 7f72b51fb640 1 Processor -- start 2024-04-20T12:21:08.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.043+0000 7f72b51fb640 1 -- start start 2024-04-20T12:21:08.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.043+0000 7f72b51fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b0100ea0 0x7f72b0197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:08.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72b51fb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72b0101ff0 0x7f72b0197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:08.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72b51fb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72b01029b0 0x7f72b019e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:08.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72b51fb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f72b010cb50 con 0x7f72b0100ea0 2024-04-20T12:21:08.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72b51fb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f72b010c9d0 con 0x7f72b0101ff0 2024-04-20T12:21:08.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72b51fb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72b010ccd0 con 0x7f72b01029b0 2024-04-20T12:21:08.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72aed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b0100ea0 0x7f72b0197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:08.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72aed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b0100ea0 0x7f72b0197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36930/0 (socket says 172.21.15.135:36930) 2024-04-20T12:21:08.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72aed9d640 1 -- 172.21.15.135:0/3764941497 learned_addr learned my addr 172.21.15.135:0/3764941497 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:08.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72af59e640 1 --2- 172.21.15.135:0/3764941497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72b01029b0 0x7f72b019e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:08.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72ae59c640 1 --2- 172.21.15.135:0/3764941497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72b0101ff0 0x7f72b0197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:08.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72aed9d640 1 -- 172.21.15.135:0/3764941497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72b01029b0 msgr2=0x7f72b019e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:08.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72aed9d640 1 --2- 172.21.15.135:0/3764941497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72b01029b0 0x7f72b019e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72aed9d640 1 -- 172.21.15.135:0/3764941497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72b0101ff0 msgr2=0x7f72b0197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:08.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72aed9d640 1 --2- 172.21.15.135:0/3764941497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72b0101ff0 0x7f72b0197790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72aed9d640 1 -- 172.21.15.135:0/3764941497 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b019ee70 con 0x7f72b0100ea0 2024-04-20T12:21:08.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72aed9d640 1 --2- 172.21.15.135:0/3764941497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b0100ea0 0x7f72b0197250 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f72a000e9f0 tx=0x7f72a000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:08.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f7297fff640 1 -- 172.21.15.135:0/3764941497 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a000cd80 con 0x7f72b0100ea0 2024-04-20T12:21:08.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72b51fb640 1 -- 172.21.15.135:0/3764941497 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b019f160 con 0x7f72b0100ea0 2024-04-20T12:21:08.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f7297fff640 1 -- 172.21.15.135:0/3764941497 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a0005500 con 0x7f72b0100ea0 2024-04-20T12:21:08.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f7297fff640 1 -- 172.21.15.135:0/3764941497 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0010690 con 0x7f72b0100ea0 2024-04-20T12:21:08.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.044+0000 7f72b51fb640 1 -- 172.21.15.135:0/3764941497 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b019f630 con 0x7f72b0100ea0 2024-04-20T12:21:08.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.045+0000 7f72b51fb640 1 -- 172.21.15.135:0/3764941497 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b0108280 con 0x7f72b0100ea0 2024-04-20T12:21:08.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.047+0000 7f7297fff640 1 -- 172.21.15.135:0/3764941497 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f72a00046c0 con 0x7f72b0100ea0 2024-04-20T12:21:08.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.047+0000 7f7297fff640 1 --2- 172.21.15.135:0/3764941497 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f72980a3bb0 0x7f72980a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:08.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.047+0000 7f72ae59c640 1 --2- 172.21.15.135:0/3764941497 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f72980a3bb0 0x7f72980a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:08.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.047+0000 7f7297fff640 1 -- 172.21.15.135:0/3764941497 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f72a00d0af0 con 0x7f72b0100ea0 2024-04-20T12:21:08.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.048+0000 7f72ae59c640 1 --2- 172.21.15.135:0/3764941497 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f72980a3bb0 0x7f72980a6070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f72a402c7b0 tx=0x7f72a4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:08.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.052+0000 7f7297fff640 1 -- 172.21.15.135:0/3764941497 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f72a009d290 con 0x7f72b0100ea0 2024-04-20T12:21:08.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:07 smithi135 ceph-mon[18264]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-04-20T12:21:08.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:07 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1942705154' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-20T12:21:08.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:07 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] up:active 2024-04-20T12:21:08.207 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:07 smithi135 ceph-mon[18264]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-20T12:21:08.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:07 smithi135 ceph-mon[18264]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-04-20T12:21:08.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:07 smithi135 ceph-mon[18264]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-04-20T12:21:08.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:07 smithi135 ceph-mon[18264]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-20T12:21:08.208 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:07 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/267695593' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-20T12:21:08.251 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:21:07 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i[52605]: 2024-04-20T12:21:07.896+0000 7fd893c5c700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-20T12:21:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:07 smithi154 ceph-mon[22073]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-04-20T12:21:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:07 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1942705154' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-20T12:21:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:07 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] up:active 2024-04-20T12:21:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:07 smithi154 ceph-mon[22073]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-20T12:21:08.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:07 smithi154 ceph-mon[22073]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-04-20T12:21:08.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:07 smithi154 ceph-mon[22073]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-04-20T12:21:08.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:07 smithi154 ceph-mon[22073]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-20T12:21:08.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:07 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/267695593' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-20T12:21:08.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.264+0000 7f72b51fb640 1 -- 172.21.15.135:0/3764941497 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f72b00623a0 con 0x7f72980a3bb0 2024-04-20T12:21:08.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.320+0000 7f7297fff640 1 -- 172.21.15.135:0/3764941497 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f72b00623a0 con 0x7f72980a3bb0 2024-04-20T12:21:08.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.322+0000 7f72b51fb640 1 -- 172.21.15.135:0/3764941497 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f72980a3bb0 msgr2=0x7f72980a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:08.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.322+0000 7f72b51fb640 1 --2- 172.21.15.135:0/3764941497 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f72980a3bb0 0x7f72980a6070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f72a402c7b0 tx=0x7f72a4005fd0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.322+0000 7f72b51fb640 1 -- 172.21.15.135:0/3764941497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b0100ea0 msgr2=0x7f72b0197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:08.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.322+0000 7f72b51fb640 1 --2- 172.21.15.135:0/3764941497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b0100ea0 0x7f72b0197250 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f72a000e9f0 tx=0x7f72a000edf0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.322+0000 7f72b51fb640 1 -- 172.21.15.135:0/3764941497 shutdown_connections 2024-04-20T12:21:08.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.322+0000 7f72b51fb640 1 --2- 172.21.15.135:0/3764941497 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f72980a3bb0 0x7f72980a6070 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.322+0000 7f72b51fb640 1 --2- 172.21.15.135:0/3764941497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72b01029b0 0x7f72b019e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.322+0000 7f72b51fb640 1 --2- 172.21.15.135:0/3764941497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72b0101ff0 0x7f72b0197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.322+0000 7f72b51fb640 1 --2- 172.21.15.135:0/3764941497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72b0100ea0 0x7f72b0197250 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.322+0000 7f72b51fb640 1 -- 172.21.15.135:0/3764941497 >> 172.21.15.135:0/3764941497 conn(0x7f72b00fc410 msgr2=0x7f72b0105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:08.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.322+0000 7f72b51fb640 1 -- 172.21.15.135:0/3764941497 shutdown_connections 2024-04-20T12:21:08.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.322+0000 7f72b51fb640 1 -- 172.21.15.135:0/3764941497 wait complete. 2024-04-20T12:21:08.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:07 smithi139 ceph-mon[21834]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-04-20T12:21:08.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:07 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1942705154' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-20T12:21:08.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:07 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] up:active 2024-04-20T12:21:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:07 smithi139 ceph-mon[21834]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-04-20T12:21:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:07 smithi139 ceph-mon[21834]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-04-20T12:21:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:07 smithi139 ceph-mon[21834]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-04-20T12:21:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:07 smithi139 ceph-mon[21834]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-04-20T12:21:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:07 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/267695593' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-04-20T12:21:08.333 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-04-20T12:21:08.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.438+0000 7fa2d67e6640 1 -- 172.21.15.135:0/1238817010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d0102aa0 msgr2=0x7fa2d0104e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:08.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.438+0000 7fa2d67e6640 1 --2- 172.21.15.135:0/1238817010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d0102aa0 0x7fa2d0104e90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0009900 tx=0x7fa2c002bc30 comp rx=0 tx=0).stop 2024-04-20T12:21:08.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.438+0000 7fa2d67e6640 1 -- 172.21.15.135:0/1238817010 shutdown_connections 2024-04-20T12:21:08.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.439+0000 7fa2d67e6640 1 --2- 172.21.15.135:0/1238817010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d0107d00 0x7fa2d010a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.439+0000 7fa2d67e6640 1 --2- 172.21.15.135:0/1238817010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2d01053d0 0x7fa2d01077c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.439+0000 7fa2d67e6640 1 --2- 172.21.15.135:0/1238817010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d0102aa0 0x7fa2d0104e90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.439+0000 7fa2d67e6640 1 -- 172.21.15.135:0/1238817010 >> 172.21.15.135:0/1238817010 conn(0x7fa2d00fc450 msgr2=0x7fa2d00fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.439+0000 7fa2d67e6640 1 -- 172.21.15.135:0/1238817010 shutdown_connections 2024-04-20T12:21:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.439+0000 7fa2d67e6640 1 -- 172.21.15.135:0/1238817010 wait complete. 2024-04-20T12:21:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.439+0000 7fa2d67e6640 1 Processor -- start 2024-04-20T12:21:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.439+0000 7fa2d67e6640 1 -- start start 2024-04-20T12:21:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.439+0000 7fa2d67e6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d0102aa0 0x7fa2d019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.439+0000 7fa2d67e6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2d01053d0 0x7fa2d019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.439+0000 7fa2d67e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d0107d00 0x7fa2d01a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2d67e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d010dc50 con 0x7fa2d0107d00 2024-04-20T12:21:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2d67e6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d010dad0 con 0x7fa2d0102aa0 2024-04-20T12:21:08.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2d67e6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d010ddd0 con 0x7fa2d01053d0 2024-04-20T12:21:08.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2d4d83640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d0107d00 0x7fa2d01a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:08.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2d4d83640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d0107d00 0x7fa2d01a1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36978/0 (socket says 172.21.15.135:36978) 2024-04-20T12:21:08.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2d4d83640 1 -- 172.21.15.135:0/962299807 learned_addr learned my addr 172.21.15.135:0/962299807 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:08.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2cf7fe640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2d01053d0 0x7fa2d019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:08.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2cffff640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d0102aa0 0x7fa2d019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:08.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2d4d83640 1 -- 172.21.15.135:0/962299807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2d01053d0 msgr2=0x7fa2d019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:08.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2d4d83640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2d01053d0 0x7fa2d019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2d4d83640 1 -- 172.21.15.135:0/962299807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d0102aa0 msgr2=0x7fa2d019a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:08.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2d4d83640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d0102aa0 0x7fa2d019a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2d4d83640 1 -- 172.21.15.135:0/962299807 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d01a2190 con 0x7fa2d0107d00 2024-04-20T12:21:08.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2cf7fe640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2d01053d0 0x7fa2d019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:21:08.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2cffff640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d0102aa0 0x7fa2d019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:21:08.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2d4d83640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d0107d00 0x7fa2d01a1b20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800eaa0 tx=0x7fa2c800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:08.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2cd7fa640 1 -- 172.21.15.135:0/962299807 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c800cdb0 con 0x7fa2d0107d00 2024-04-20T12:21:08.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2d67e6640 1 -- 172.21.15.135:0/962299807 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d01a2480 con 0x7fa2d0107d00 2024-04-20T12:21:08.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2d67e6640 1 -- 172.21.15.135:0/962299807 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d01a29d0 con 0x7fa2d0107d00 2024-04-20T12:21:08.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2cd7fa640 1 -- 172.21.15.135:0/962299807 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2c8005020 con 0x7fa2d0107d00 2024-04-20T12:21:08.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.440+0000 7fa2cd7fa640 1 -- 172.21.15.135:0/962299807 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80116b0 con 0x7fa2d0107d00 2024-04-20T12:21:08.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.441+0000 7fa2d67e6640 1 -- 172.21.15.135:0/962299807 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2bc0052c0 con 0x7fa2d0107d00 2024-04-20T12:21:08.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.443+0000 7fa2cd7fa640 1 -- 172.21.15.135:0/962299807 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7fa2c8004a40 con 0x7fa2d0107d00 2024-04-20T12:21:08.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.444+0000 7fa2cd7fa640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa2b80a3bb0 0x7fa2b80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:08.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.444+0000 7fa2cffff640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa2b80a3bb0 0x7fa2b80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:08.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.444+0000 7fa2cd7fa640 1 -- 172.21.15.135:0/962299807 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fa2c80d0b70 con 0x7fa2d0107d00 2024-04-20T12:21:08.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.445+0000 7fa2cffff640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa2b80a3bb0 0x7fa2b80a6070 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0000c00 tx=0x7fa2c00095f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:08.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.448+0000 7fa2cd7fa640 1 -- 172.21.15.135:0/962299807 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fa2c8016030 con 0x7fa2d0107d00 2024-04-20T12:21:08.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:21:08.269+0000 7f9cd07d8700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:21:08.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:21:08.269+0000 7f9cd07d8700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:21:08.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:21:08.269+0000 7f9cd07d8700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:21:08.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:21:08.269+0000 7f9cd07d8700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:21:08.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:21:08.269+0000 7f9cd07d8700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:21:08.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.660+0000 7fa2d67e6640 1 -- 172.21.15.135:0/962299807 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa2bc000bf0 con 0x7fa2b80a3bb0 2024-04-20T12:21:08.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.686+0000 7fa2cd7fa640 1 -- 172.21.15.135:0/962299807 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa2bc000bf0 con 0x7fa2b80a3bb0 2024-04-20T12:21:08.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.688+0000 7fa2d67e6640 1 -- 172.21.15.135:0/962299807 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa2b80a3bb0 msgr2=0x7fa2b80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:08.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.688+0000 7fa2d67e6640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa2b80a3bb0 0x7fa2b80a6070 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0000c00 tx=0x7fa2c00095f0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.688+0000 7fa2d67e6640 1 -- 172.21.15.135:0/962299807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d0107d00 msgr2=0x7fa2d01a1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:08.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.688+0000 7fa2d67e6640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d0107d00 0x7fa2d01a1b20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800eaa0 tx=0x7fa2c800ef60 comp rx=0 tx=0).stop 2024-04-20T12:21:08.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.688+0000 7fa2d67e6640 1 -- 172.21.15.135:0/962299807 shutdown_connections 2024-04-20T12:21:08.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.688+0000 7fa2d67e6640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa2b80a3bb0 0x7fa2b80a6070 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.688+0000 7fa2d67e6640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d0107d00 0x7fa2d01a1b20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.688+0000 7fa2d67e6640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2d01053d0 0x7fa2d019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.688+0000 7fa2d67e6640 1 --2- 172.21.15.135:0/962299807 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2d0102aa0 0x7fa2d019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.688+0000 7fa2d67e6640 1 -- 172.21.15.135:0/962299807 >> 172.21.15.135:0/962299807 conn(0x7fa2d00fc450 msgr2=0x7fa2d01022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:08.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.689+0000 7fa2d67e6640 1 -- 172.21.15.135:0/962299807 shutdown_connections 2024-04-20T12:21:08.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.689+0000 7fa2d67e6640 1 -- 172.21.15.135:0/962299807 wait complete. 2024-04-20T12:21:08.700 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-04-20T12:21:08.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.805+0000 7efe1544e640 1 -- 172.21.15.135:0/2005183416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe10100ea0 msgr2=0x7efe101012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:08.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.805+0000 7efe1544e640 1 --2- 172.21.15.135:0/2005183416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe10100ea0 0x7efe101012c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efe08009900 tx=0x7efe0802bc30 comp rx=0 tx=0).stop 2024-04-20T12:21:08.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.805+0000 7efe1544e640 1 -- 172.21.15.135:0/2005183416 shutdown_connections 2024-04-20T12:21:08.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.805+0000 7efe1544e640 1 --2- 172.21.15.135:0/2005183416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe101029b0 0x7efe101092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.805+0000 7efe1544e640 1 --2- 172.21.15.135:0/2005183416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe10101ff0 0x7efe10102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.805+0000 7efe1544e640 1 --2- 172.21.15.135:0/2005183416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe10100ea0 0x7efe101012c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.805+0000 7efe1544e640 1 -- 172.21.15.135:0/2005183416 >> 172.21.15.135:0/2005183416 conn(0x7efe100fc410 msgr2=0x7efe100fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:08.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.805+0000 7efe1544e640 1 -- 172.21.15.135:0/2005183416 shutdown_connections 2024-04-20T12:21:08.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.805+0000 7efe1544e640 1 -- 172.21.15.135:0/2005183416 wait complete. 2024-04-20T12:21:08.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.805+0000 7efe1544e640 1 Processor -- start 2024-04-20T12:21:08.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe1544e640 1 -- start start 2024-04-20T12:21:08.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe1544e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe10100ea0 0x7efe10069c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:08.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe1544e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe10101ff0 0x7efe1019d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:08.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe1544e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe101029b0 0x7efe1019f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:08.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe1544e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efe1010cb20 con 0x7efe10101ff0 2024-04-20T12:21:08.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe1544e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efe1010c9a0 con 0x7efe10100ea0 2024-04-20T12:21:08.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe1544e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe1010cca0 con 0x7efe101029b0 2024-04-20T12:21:08.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe0e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe10101ff0 0x7efe1019d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:08.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe0e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe10101ff0 0x7efe1019d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36982/0 (socket says 172.21.15.135:36982) 2024-04-20T12:21:08.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe0e7fc640 1 -- 172.21.15.135:0/3426539303 learned_addr learned my addr 172.21.15.135:0/3426539303 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:08.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe0f7fe640 1 --2- 172.21.15.135:0/3426539303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe101029b0 0x7efe1019f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:08.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe0effd640 1 --2- 172.21.15.135:0/3426539303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe10100ea0 0x7efe10069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:08.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe0e7fc640 1 -- 172.21.15.135:0/3426539303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe101029b0 msgr2=0x7efe1019f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:08.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe0e7fc640 1 --2- 172.21.15.135:0/3426539303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe101029b0 0x7efe1019f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe0e7fc640 1 -- 172.21.15.135:0/3426539303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe10100ea0 msgr2=0x7efe10069c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:08.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe0e7fc640 1 --2- 172.21.15.135:0/3426539303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe10100ea0 0x7efe10069c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:08.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe0e7fc640 1 -- 172.21.15.135:0/3426539303 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1019ff70 con 0x7efe10101ff0 2024-04-20T12:21:08.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe0effd640 1 --2- 172.21.15.135:0/3426539303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe10100ea0 0x7efe10069c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:21:08.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.806+0000 7efe0e7fc640 1 --2- 172.21.15.135:0/3426539303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe10101ff0 0x7efe1019d040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efe0400d950 tx=0x7efe0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:08.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.807+0000 7efdf7fff640 1 -- 172.21.15.135:0/3426539303 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe04017020 con 0x7efe10101ff0 2024-04-20T12:21:08.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.807+0000 7efe1544e640 1 -- 172.21.15.135:0/3426539303 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe101a0200 con 0x7efe10101ff0 2024-04-20T12:21:08.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.807+0000 7efdf7fff640 1 -- 172.21.15.135:0/3426539303 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe04009c30 con 0x7efe10101ff0 2024-04-20T12:21:08.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.807+0000 7efe1544e640 1 -- 172.21.15.135:0/3426539303 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe101a07a0 con 0x7efe10101ff0 2024-04-20T12:21:08.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.807+0000 7efdf7fff640 1 -- 172.21.15.135:0/3426539303 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0400f6b0 con 0x7efe10101ff0 2024-04-20T12:21:08.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.808+0000 7efe1544e640 1 -- 172.21.15.135:0/3426539303 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe10108280 con 0x7efe10101ff0 2024-04-20T12:21:08.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.809+0000 7efdf7fff640 1 -- 172.21.15.135:0/3426539303 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7efe0401a020 con 0x7efe10101ff0 2024-04-20T12:21:08.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.809+0000 7efdf7fff640 1 --2- 172.21.15.135:0/3426539303 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efdf80a3bb0 0x7efdf80a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:08.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.810+0000 7efe0effd640 1 --2- 172.21.15.135:0/3426539303 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efdf80a3bb0 0x7efdf80a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:08.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.810+0000 7efdf7fff640 1 -- 172.21.15.135:0/3426539303 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7efe040d0a30 con 0x7efe10101ff0 2024-04-20T12:21:08.811 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.810+0000 7efe0effd640 1 --2- 172.21.15.135:0/3426539303 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efdf80a3bb0 0x7efdf80a6070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efe080096c0 tx=0x7efe08000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:08.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:08.817+0000 7efdf7fff640 1 -- 172.21.15.135:0/3426539303 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7efe04021020 con 0x7efe10101ff0 2024-04-20T12:21:09.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.032+0000 7efe1544e640 1 -- 172.21.15.135:0/3426539303 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7efe10062430 con 0x7efdf80a3bb0 2024-04-20T12:21:09.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.037+0000 7efdf7fff640 1 -- 172.21.15.135:0/3426539303 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7efe10062430 con 0x7efdf80a3bb0 2024-04-20T12:21:09.037 INFO:teuthology.orchestra.run.smithi135.stdout:/volumes/qa/sv_0/aa72bbbd-1320-48ba-a32f-ac7b76a658fc 2024-04-20T12:21:09.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.039+0000 7efe1544e640 1 -- 172.21.15.135:0/3426539303 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efdf80a3bb0 msgr2=0x7efdf80a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:09.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.039+0000 7efe1544e640 1 --2- 172.21.15.135:0/3426539303 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efdf80a3bb0 0x7efdf80a6070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efe080096c0 tx=0x7efe08000bc0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.039+0000 7efe1544e640 1 -- 172.21.15.135:0/3426539303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe10101ff0 msgr2=0x7efe1019d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:09.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.039+0000 7efe1544e640 1 --2- 172.21.15.135:0/3426539303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe10101ff0 0x7efe1019d040 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efe0400d950 tx=0x7efe0400de10 comp rx=0 tx=0).stop 2024-04-20T12:21:09.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.039+0000 7efe1544e640 1 -- 172.21.15.135:0/3426539303 shutdown_connections 2024-04-20T12:21:09.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.039+0000 7efe1544e640 1 --2- 172.21.15.135:0/3426539303 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efdf80a3bb0 0x7efdf80a6070 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.039+0000 7efe1544e640 1 --2- 172.21.15.135:0/3426539303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe101029b0 0x7efe1019f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.039+0000 7efe1544e640 1 --2- 172.21.15.135:0/3426539303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe10101ff0 0x7efe1019d040 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.039+0000 7efe1544e640 1 --2- 172.21.15.135:0/3426539303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe10100ea0 0x7efe10069c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.039+0000 7efe1544e640 1 -- 172.21.15.135:0/3426539303 >> 172.21.15.135:0/3426539303 conn(0x7efe100fc410 msgr2=0x7efe10105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:09.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.039+0000 7efe1544e640 1 -- 172.21.15.135:0/3426539303 shutdown_connections 2024-04-20T12:21:09.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.039+0000 7efe1544e640 1 -- 172.21.15.135:0/3426539303 wait complete. 2024-04-20T12:21:09.049 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/267695593' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-20T12:21:09.049 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] up:active 2024-04-20T12:21:09.049 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-mon[18264]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-20T12:21:09.049 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-mon[18264]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-04-20T12:21:09.049 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-mon[18264]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-04-20T12:21:09.049 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-mon[18264]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-04-20T12:21:09.049 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] up:active 2024-04-20T12:21:09.050 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-mon[18264]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-20T12:21:09.050 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-mon[18264]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-20T12:21:09.050 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-mon[18264]: Cluster is now healthy 2024-04-20T12:21:09.050 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-mon[18264]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 4 up:standby-replay 4 up:standby 2024-04-20T12:21:09.050 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-mon[18264]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-04-20T12:21:09.050 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:08 smithi135 ceph-mon[18264]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-04-20T12:21:09.051 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-04-20T12:21:09.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.156+0000 7f5eda481640 1 -- 172.21.15.135:0/1895440813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ed4101ff0 msgr2=0x7f5ed4102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:09.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.156+0000 7f5eda481640 1 --2- 172.21.15.135:0/1895440813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ed4101ff0 0x7f5ed4102470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8009900 tx=0x7f5ec802bc30 comp rx=0 tx=0).stop 2024-04-20T12:21:09.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.156+0000 7f5eda481640 1 -- 172.21.15.135:0/1895440813 shutdown_connections 2024-04-20T12:21:09.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.156+0000 7f5eda481640 1 --2- 172.21.15.135:0/1895440813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ed41029b0 0x7f5ed41092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.156+0000 7f5eda481640 1 --2- 172.21.15.135:0/1895440813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ed4101ff0 0x7f5ed4102470 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.156+0000 7f5eda481640 1 --2- 172.21.15.135:0/1895440813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed4100ea0 0x7f5ed41012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.156+0000 7f5eda481640 1 -- 172.21.15.135:0/1895440813 >> 172.21.15.135:0/1895440813 conn(0x7f5ed40fc410 msgr2=0x7f5ed40fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:09.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.156+0000 7f5eda481640 1 -- 172.21.15.135:0/1895440813 shutdown_connections 2024-04-20T12:21:09.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.156+0000 7f5eda481640 1 -- 172.21.15.135:0/1895440813 wait complete. 2024-04-20T12:21:09.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5eda481640 1 Processor -- start 2024-04-20T12:21:09.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5eda481640 1 -- start start 2024-04-20T12:21:09.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5eda481640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ed4100ea0 0x7f5ed4104e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:09.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5eda481640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed4101ff0 0x7f5ed4103460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:09.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5eda481640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ed41029b0 0x7f5ed41039a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:09.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5eda481640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed410cb50 con 0x7f5ed41029b0 2024-04-20T12:21:09.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5eda481640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed410c9d0 con 0x7f5ed4100ea0 2024-04-20T12:21:09.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5eda481640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed410ccd0 con 0x7f5ed4101ff0 2024-04-20T12:21:09.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5ed8a1e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ed41029b0 0x7f5ed41039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:09.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5ed8a1e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ed41029b0 0x7f5ed41039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36994/0 (socket says 172.21.15.135:36994) 2024-04-20T12:21:09.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5ed8a1e640 1 -- 172.21.15.135:0/1401077406 learned_addr learned my addr 172.21.15.135:0/1401077406 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:09.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5ed37fe640 1 --2- 172.21.15.135:0/1401077406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed4101ff0 0x7f5ed4103460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:09.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5ed3fff640 1 --2- 172.21.15.135:0/1401077406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ed4100ea0 0x7f5ed4104e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:09.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5ed8a1e640 1 -- 172.21.15.135:0/1401077406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed4101ff0 msgr2=0x7f5ed4103460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:09.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5ed8a1e640 1 --2- 172.21.15.135:0/1401077406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed4101ff0 0x7f5ed4103460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5ed8a1e640 1 -- 172.21.15.135:0/1401077406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ed4100ea0 msgr2=0x7f5ed4104e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:09.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5ed8a1e640 1 --2- 172.21.15.135:0/1401077406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ed4100ea0 0x7f5ed4104e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5ed8a1e640 1 -- 172.21.15.135:0/1401077406 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed4104230 con 0x7f5ed41029b0 2024-04-20T12:21:09.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.157+0000 7f5ed37fe640 1 --2- 172.21.15.135:0/1401077406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed4101ff0 0x7f5ed4103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:21:09.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.158+0000 7f5ed8a1e640 1 --2- 172.21.15.135:0/1401077406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ed41029b0 0x7f5ed41039a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00eaa0 tx=0x7f5ecc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:09.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.158+0000 7f5ed17fa640 1 -- 172.21.15.135:0/1401077406 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc00cdb0 con 0x7f5ed41029b0 2024-04-20T12:21:09.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.158+0000 7f5ed17fa640 1 -- 172.21.15.135:0/1401077406 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ecc005020 con 0x7f5ed41029b0 2024-04-20T12:21:09.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.158+0000 7f5eda481640 1 -- 172.21.15.135:0/1401077406 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed41a2440 con 0x7f5ed41029b0 2024-04-20T12:21:09.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.158+0000 7f5ed17fa640 1 -- 172.21.15.135:0/1401077406 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0116b0 con 0x7f5ed41029b0 2024-04-20T12:21:09.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.158+0000 7f5eda481640 1 -- 172.21.15.135:0/1401077406 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed41a2910 con 0x7f5ed41029b0 2024-04-20T12:21:09.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.159+0000 7f5eda481640 1 -- 172.21.15.135:0/1401077406 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed4068d80 con 0x7f5ed41029b0 2024-04-20T12:21:09.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.160+0000 7f5ed17fa640 1 -- 172.21.15.135:0/1401077406 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 138647+0+0 (secure 0 0 0) 0x7f5ecc005560 con 0x7f5ed41029b0 2024-04-20T12:21:09.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.160+0000 7f5ed17fa640 1 --2- 172.21.15.135:0/1401077406 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ebc0a3bb0 0x7f5ebc0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:09.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.161+0000 7f5ed3fff640 1 --2- 172.21.15.135:0/1401077406 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ebc0a3bb0 0x7f5ebc0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:09.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.161+0000 7f5ed17fa640 1 -- 172.21.15.135:0/1401077406 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f5ecc0d0be0 con 0x7f5ed41029b0 2024-04-20T12:21:09.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.161+0000 7f5ed3fff640 1 --2- 172.21.15.135:0/1401077406 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ebc0a3bb0 0x7f5ebc0a6070 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009bd0 tx=0x7f5ec4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:09.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.168+0000 7f5ed17fa640 1 -- 172.21.15.135:0/1401077406 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f5ecc016030 con 0x7f5ed41029b0 2024-04-20T12:21:09.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:08 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/267695593' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-20T12:21:09.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:08 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] up:active 2024-04-20T12:21:09.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:08 smithi154 ceph-mon[22073]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-20T12:21:09.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:08 smithi154 ceph-mon[22073]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-04-20T12:21:09.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:08 smithi154 ceph-mon[22073]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-04-20T12:21:09.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:08 smithi154 ceph-mon[22073]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-04-20T12:21:09.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:08 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] up:active 2024-04-20T12:21:09.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:08 smithi154 ceph-mon[22073]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-20T12:21:09.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:08 smithi154 ceph-mon[22073]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-20T12:21:09.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:08 smithi154 ceph-mon[22073]: Cluster is now healthy 2024-04-20T12:21:09.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:08 smithi154 ceph-mon[22073]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 4 up:standby-replay 4 up:standby 2024-04-20T12:21:09.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:08 smithi154 ceph-mon[22073]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-04-20T12:21:09.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:08 smithi154 ceph-mon[22073]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-04-20T12:21:09.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.325+0000 7f5ed17fa640 1 -- 172.21.15.135:0/1401077406 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f5ecc0993a0 con 0x7f5ed41029b0 2024-04-20T12:21:09.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:08 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/267695593' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-04-20T12:21:09.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:08 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] up:active 2024-04-20T12:21:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:08 smithi139 ceph-mon[21834]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-04-20T12:21:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:08 smithi139 ceph-mon[21834]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-04-20T12:21:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:08 smithi139 ceph-mon[21834]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-04-20T12:21:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:08 smithi139 ceph-mon[21834]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-04-20T12:21:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:08 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] up:active 2024-04-20T12:21:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:08 smithi139 ceph-mon[21834]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-04-20T12:21:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:08 smithi139 ceph-mon[21834]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-20T12:21:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:08 smithi139 ceph-mon[21834]: Cluster is now healthy 2024-04-20T12:21:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:08 smithi139 ceph-mon[21834]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=f=up:active} 4 up:standby-replay 4 up:standby 2024-04-20T12:21:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:08 smithi139 ceph-mon[21834]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-04-20T12:21:09.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:08 smithi139 ceph-mon[21834]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-04-20T12:21:09.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.382+0000 7f5eda481640 1 -- 172.21.15.135:0/1401077406 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5ed40fe620 con 0x7f5ebc0a3bb0 2024-04-20T12:21:09.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.409+0000 7f5ed17fa640 1 -- 172.21.15.135:0/1401077406 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5ed40fe620 con 0x7f5ebc0a3bb0 2024-04-20T12:21:09.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.411+0000 7f5eda481640 1 -- 172.21.15.135:0/1401077406 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ebc0a3bb0 msgr2=0x7f5ebc0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:09.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.411+0000 7f5eda481640 1 --2- 172.21.15.135:0/1401077406 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ebc0a3bb0 0x7f5ebc0a6070 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009bd0 tx=0x7f5ec4005f90 comp rx=0 tx=0).stop 2024-04-20T12:21:09.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.411+0000 7f5eda481640 1 -- 172.21.15.135:0/1401077406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ed41029b0 msgr2=0x7f5ed41039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:09.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.411+0000 7f5eda481640 1 --2- 172.21.15.135:0/1401077406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ed41029b0 0x7f5ed41039a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc00eaa0 tx=0x7f5ecc00ef60 comp rx=0 tx=0).stop 2024-04-20T12:21:09.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.411+0000 7f5eda481640 1 -- 172.21.15.135:0/1401077406 shutdown_connections 2024-04-20T12:21:09.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.411+0000 7f5eda481640 1 --2- 172.21.15.135:0/1401077406 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5ebc0a3bb0 0x7f5ebc0a6070 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.411+0000 7f5eda481640 1 --2- 172.21.15.135:0/1401077406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ed41029b0 0x7f5ed41039a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.411+0000 7f5eda481640 1 --2- 172.21.15.135:0/1401077406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ed4101ff0 0x7f5ed4103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.411+0000 7f5eda481640 1 --2- 172.21.15.135:0/1401077406 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ed4100ea0 0x7f5ed4104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.411+0000 7f5eda481640 1 -- 172.21.15.135:0/1401077406 >> 172.21.15.135:0/1401077406 conn(0x7f5ed40fc410 msgr2=0x7f5ed40fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:09.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.411+0000 7f5eda481640 1 -- 172.21.15.135:0/1401077406 shutdown_connections 2024-04-20T12:21:09.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.411+0000 7f5eda481640 1 -- 172.21.15.135:0/1401077406 wait complete. 2024-04-20T12:21:09.421 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-04-20T12:21:09.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.524+0000 7f7006a6d640 1 -- 172.21.15.135:0/3337191955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7000102a20 msgr2=0x7f7000104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:09.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.524+0000 7f7006a6d640 1 --2- 172.21.15.135:0/3337191955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7000102a20 0x7f7000104e10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009900 tx=0x7f6ff402bc30 comp rx=0 tx=0).stop 2024-04-20T12:21:09.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7006a6d640 1 -- 172.21.15.135:0/3337191955 shutdown_connections 2024-04-20T12:21:09.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7006a6d640 1 --2- 172.21.15.135:0/3337191955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7000107c80 0x7f700010a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7006a6d640 1 --2- 172.21.15.135:0/3337191955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7000105350 0x7f7000107740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7006a6d640 1 --2- 172.21.15.135:0/3337191955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7000102a20 0x7f7000104e10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7006a6d640 1 -- 172.21.15.135:0/3337191955 >> 172.21.15.135:0/3337191955 conn(0x7f70000fc410 msgr2=0x7f70000fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:09.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7006a6d640 1 -- 172.21.15.135:0/3337191955 shutdown_connections 2024-04-20T12:21:09.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7006a6d640 1 -- 172.21.15.135:0/3337191955 wait complete. 2024-04-20T12:21:09.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7006a6d640 1 Processor -- start 2024-04-20T12:21:09.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7006a6d640 1 -- start start 2024-04-20T12:21:09.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7006a6d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7000102a20 0x7f7000198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:09.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7006a6d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7000105350 0x7f7000198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:09.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7006a6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7000107c80 0x7f700019f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:09.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7006a6d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f700010dc30 con 0x7f7000102a20 2024-04-20T12:21:09.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7006a6d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f700010dab0 con 0x7f7000105350 2024-04-20T12:21:09.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7006a6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f700010ddb0 con 0x7f7000107c80 2024-04-20T12:21:09.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7004809640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7000102a20 0x7f7000198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:09.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7004809640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7000102a20 0x7f7000198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37012/0 (socket says 172.21.15.135:37012) 2024-04-20T12:21:09.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f7004809640 1 -- 172.21.15.135:0/2255648092 learned_addr learned my addr 172.21.15.135:0/2255648092 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:09.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f6ffffff640 1 --2- 172.21.15.135:0/2255648092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7000105350 0x7f7000198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:09.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.525+0000 7f700500a640 1 --2- 172.21.15.135:0/2255648092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7000107c80 0x7f700019f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:09.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.526+0000 7f7004809640 1 -- 172.21.15.135:0/2255648092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7000107c80 msgr2=0x7f700019f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:09.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.526+0000 7f7004809640 1 --2- 172.21.15.135:0/2255648092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7000107c80 0x7f700019f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.526+0000 7f7004809640 1 -- 172.21.15.135:0/2255648092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7000105350 msgr2=0x7f7000198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:09.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.526+0000 7f7004809640 1 --2- 172.21.15.135:0/2255648092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7000105350 0x7f7000198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.526+0000 7f7004809640 1 -- 172.21.15.135:0/2255648092 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700019ff20 con 0x7f7000102a20 2024-04-20T12:21:09.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.526+0000 7f6ffffff640 1 --2- 172.21.15.135:0/2255648092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7000105350 0x7f7000198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:21:09.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.526+0000 7f7004809640 1 --2- 172.21.15.135:0/2255648092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7000102a20 0x7f7000198300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009230 tx=0x7f6ff402c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:09.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.526+0000 7f6ffdffb640 1 -- 172.21.15.135:0/2255648092 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4041070 con 0x7f7000102a20 2024-04-20T12:21:09.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.526+0000 7f6ffdffb640 1 -- 172.21.15.135:0/2255648092 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ff4004450 con 0x7f7000102a20 2024-04-20T12:21:09.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.526+0000 7f7006a6d640 1 -- 172.21.15.135:0/2255648092 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70001a01b0 con 0x7f7000102a20 2024-04-20T12:21:09.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.526+0000 7f6ffdffb640 1 -- 172.21.15.135:0/2255648092 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4003e20 con 0x7f7000102a20 2024-04-20T12:21:09.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.526+0000 7f7006a6d640 1 -- 172.21.15.135:0/2255648092 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70001a06a0 con 0x7f7000102a20 2024-04-20T12:21:09.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.527+0000 7f7006a6d640 1 -- 172.21.15.135:0/2255648092 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70000fdf00 con 0x7f7000102a20 2024-04-20T12:21:09.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.528+0000 7f6ffdffb640 1 -- 172.21.15.135:0/2255648092 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f6ff4044070 con 0x7f7000102a20 2024-04-20T12:21:09.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.529+0000 7f6ffdffb640 1 --2- 172.21.15.135:0/2255648092 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6ff00a3c40 0x7f6ff00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:09.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.529+0000 7f6ffffff640 1 --2- 172.21.15.135:0/2255648092 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6ff00a3c40 0x7f6ff00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:09.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.529+0000 7f6ffdffb640 1 -- 172.21.15.135:0/2255648092 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f6ff40f21e0 con 0x7f7000102a20 2024-04-20T12:21:09.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.529+0000 7f6ffffff640 1 --2- 172.21.15.135:0/2255648092 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6ff00a3c40 0x7f6ff00a6100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7000199810 tx=0x7f6fec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:09.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.533+0000 7f6ffdffb640 1 -- 172.21.15.135:0/2255648092 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f6ff40be2e0 con 0x7f7000102a20 2024-04-20T12:21:09.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.738+0000 7f7006a6d640 1 -- 172.21.15.135:0/2255648092 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f7000062430 con 0x7f6ff00a3c40 2024-04-20T12:21:09.741 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.743+0000 7f6ffdffb640 1 -- 172.21.15.135:0/2255648092 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f7000062430 con 0x7f6ff00a3c40 2024-04-20T12:21:09.742 INFO:teuthology.orchestra.run.smithi135.stdout:/volumes/qa/sv_1/71264f8e-9bf4-4c1b-9dcb-f6e832f02fc4 2024-04-20T12:21:09.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.745+0000 7f7006a6d640 1 -- 172.21.15.135:0/2255648092 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6ff00a3c40 msgr2=0x7f6ff00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:09.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.745+0000 7f7006a6d640 1 --2- 172.21.15.135:0/2255648092 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6ff00a3c40 0x7f6ff00a6100 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7000199810 tx=0x7f6fec005f90 comp rx=0 tx=0).stop 2024-04-20T12:21:09.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.745+0000 7f7006a6d640 1 -- 172.21.15.135:0/2255648092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7000102a20 msgr2=0x7f7000198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:09.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.745+0000 7f7006a6d640 1 --2- 172.21.15.135:0/2255648092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7000102a20 0x7f7000198300 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009230 tx=0x7f6ff402c650 comp rx=0 tx=0).stop 2024-04-20T12:21:09.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.745+0000 7f7006a6d640 1 -- 172.21.15.135:0/2255648092 shutdown_connections 2024-04-20T12:21:09.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.745+0000 7f7006a6d640 1 --2- 172.21.15.135:0/2255648092 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f6ff00a3c40 0x7f6ff00a6100 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.745+0000 7f7006a6d640 1 --2- 172.21.15.135:0/2255648092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7000107c80 0x7f700019f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.745+0000 7f7006a6d640 1 --2- 172.21.15.135:0/2255648092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7000105350 0x7f7000198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.745+0000 7f7006a6d640 1 --2- 172.21.15.135:0/2255648092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7000102a20 0x7f7000198300 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.745+0000 7f7006a6d640 1 -- 172.21.15.135:0/2255648092 >> 172.21.15.135:0/2255648092 conn(0x7f70000fc410 msgr2=0x7f70001034c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:09.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.745+0000 7f7006a6d640 1 -- 172.21.15.135:0/2255648092 shutdown_connections 2024-04-20T12:21:09.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.745+0000 7f7006a6d640 1 -- 172.21.15.135:0/2255648092 wait complete. 2024-04-20T12:21:09.755 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:21:09.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.854+0000 7f8cb5069640 1 -- 172.21.15.135:0/4169114055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0101fb0 msgr2=0x7f8cb01023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:09.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.854+0000 7f8cb5069640 1 --2- 172.21.15.135:0/4169114055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0101fb0 0x7f8cb01023d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009ca0 tx=0x7f8ca802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.854+0000 7f8cb5069640 1 -- 172.21.15.135:0/4169114055 shutdown_connections 2024-04-20T12:21:09.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.854+0000 7f8cb5069640 1 --2- 172.21.15.135:0/4169114055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb0103b60 0x7f8cb010a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.854+0000 7f8cb5069640 1 --2- 172.21.15.135:0/4169114055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8cb01031a0 0x7f8cb0103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.854+0000 7f8cb5069640 1 --2- 172.21.15.135:0/4169114055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0101fb0 0x7f8cb01023d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.854+0000 7f8cb5069640 1 -- 172.21.15.135:0/4169114055 >> 172.21.15.135:0/4169114055 conn(0x7f8cb00fd540 msgr2=0x7f8cb00ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.854+0000 7f8cb5069640 1 -- 172.21.15.135:0/4169114055 shutdown_connections 2024-04-20T12:21:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.854+0000 7f8cb5069640 1 -- 172.21.15.135:0/4169114055 wait complete. 2024-04-20T12:21:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8cb5069640 1 Processor -- start 2024-04-20T12:21:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8cb5069640 1 -- start start 2024-04-20T12:21:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8cb5069640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb0101fb0 0x7f8cb01982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8cb5069640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8cb01031a0 0x7f8cb0198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8cb5069640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0103b60 0x7f8cb019f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8cb5069640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb010dc40 con 0x7f8cb0103b60 2024-04-20T12:21:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8cb5069640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb010dac0 con 0x7f8cb01031a0 2024-04-20T12:21:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8cb5069640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb010ddc0 con 0x7f8cb0101fb0 2024-04-20T12:21:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8caf59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0103b60 0x7f8cb019f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8caf59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0103b60 0x7f8cb019f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37032/0 (socket says 172.21.15.135:37032) 2024-04-20T12:21:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8caf59e640 1 -- 172.21.15.135:0/3139699798 learned_addr learned my addr 172.21.15.135:0/3139699798 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:09.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8caed9d640 1 --2- 172.21.15.135:0/3139699798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb0101fb0 0x7f8cb01982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:09.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8cae59c640 1 --2- 172.21.15.135:0/3139699798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8cb01031a0 0x7f8cb0198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:09.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8caf59e640 1 -- 172.21.15.135:0/3139699798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb0101fb0 msgr2=0x7f8cb01982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:09.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8caf59e640 1 --2- 172.21.15.135:0/3139699798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb0101fb0 0x7f8cb01982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8caf59e640 1 -- 172.21.15.135:0/3139699798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8cb01031a0 msgr2=0x7f8cb0198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:09.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8caf59e640 1 --2- 172.21.15.135:0/3139699798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8cb01031a0 0x7f8cb0198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:09.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8caf59e640 1 -- 172.21.15.135:0/3139699798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb019fef0 con 0x7f8cb0103b60 2024-04-20T12:21:09.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.855+0000 7f8caed9d640 1 --2- 172.21.15.135:0/3139699798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb0101fb0 0x7f8cb01982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:21:09.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.856+0000 7f8caf59e640 1 --2- 172.21.15.135:0/3139699798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0103b60 0x7f8cb019f880 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000e970 tx=0x7f8ca000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:09.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.856+0000 7f8c97fff640 1 -- 172.21.15.135:0/3139699798 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000ccc0 con 0x7f8cb0103b60 2024-04-20T12:21:09.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.856+0000 7f8cb5069640 1 -- 172.21.15.135:0/3139699798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb01a01e0 con 0x7f8cb0103b60 2024-04-20T12:21:09.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.856+0000 7f8c97fff640 1 -- 172.21.15.135:0/3139699798 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ca000ce60 con 0x7f8cb0103b60 2024-04-20T12:21:09.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.856+0000 7f8c97fff640 1 -- 172.21.15.135:0/3139699798 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0010450 con 0x7f8cb0103b60 2024-04-20T12:21:09.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.856+0000 7f8cb5069640 1 -- 172.21.15.135:0/3139699798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb01a0730 con 0x7f8cb0103b60 2024-04-20T12:21:09.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.857+0000 7f8cb5069640 1 -- 172.21.15.135:0/3139699798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb01092d0 con 0x7f8cb0103b60 2024-04-20T12:21:09.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.858+0000 7f8c97fff640 1 -- 172.21.15.135:0/3139699798 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f8ca0005020 con 0x7f8cb0103b60 2024-04-20T12:21:09.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.858+0000 7f8c97fff640 1 --2- 172.21.15.135:0/3139699798 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8c980a3c40 0x7f8c980a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:09.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.859+0000 7f8caed9d640 1 --2- 172.21.15.135:0/3139699798 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8c980a3c40 0x7f8c980a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:09.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.859+0000 7f8c97fff640 1 -- 172.21.15.135:0/3139699798 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f8ca00d0bf0 con 0x7f8cb0103b60 2024-04-20T12:21:09.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.859+0000 7f8caed9d640 1 --2- 172.21.15.135:0/3139699798 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8c980a3c40 0x7f8c980a6100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8ca802c700 tx=0x7f8ca8032590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:09.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:09.863+0000 7f8c97fff640 1 -- 172.21.15.135:0/3139699798 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f8ca009d230 con 0x7f8cb0103b60 2024-04-20T12:21:10.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.080+0000 7f8cb5069640 1 -- 172.21.15.135:0/3139699798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8cb0062b60 con 0x7f8cb0103b60 2024-04-20T12:21:10.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.080+0000 7f8c97fff640 1 -- 172.21.15.135:0/3139699798 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f8ca009cb30 con 0x7f8cb0103b60 2024-04-20T12:21:10.079 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:21:10.080 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:21:09.311388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24490,24476,14634,24457,24475]},"id":1}]} 2024-04-20T12:21:10.080 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 28 2024-04-20T12:21:10.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.082+0000 7f8cb5069640 1 -- 172.21.15.135:0/3139699798 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8c980a3c40 msgr2=0x7f8c980a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:10.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.082+0000 7f8cb5069640 1 --2- 172.21.15.135:0/3139699798 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8c980a3c40 0x7f8c980a6100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8ca802c700 tx=0x7f8ca8032590 comp rx=0 tx=0).stop 2024-04-20T12:21:10.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.082+0000 7f8cb5069640 1 -- 172.21.15.135:0/3139699798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0103b60 msgr2=0x7f8cb019f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:10.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.082+0000 7f8cb5069640 1 --2- 172.21.15.135:0/3139699798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0103b60 0x7f8cb019f880 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000e970 tx=0x7f8ca000ed70 comp rx=0 tx=0).stop 2024-04-20T12:21:10.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.083+0000 7f8cb5069640 1 -- 172.21.15.135:0/3139699798 shutdown_connections 2024-04-20T12:21:10.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.083+0000 7f8cb5069640 1 --2- 172.21.15.135:0/3139699798 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8c980a3c40 0x7f8c980a6100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.083+0000 7f8cb5069640 1 --2- 172.21.15.135:0/3139699798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb0103b60 0x7f8cb019f880 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.083+0000 7f8cb5069640 1 --2- 172.21.15.135:0/3139699798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8cb01031a0 0x7f8cb0198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.083+0000 7f8cb5069640 1 --2- 172.21.15.135:0/3139699798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb0101fb0 0x7f8cb01982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.083+0000 7f8cb5069640 1 -- 172.21.15.135:0/3139699798 >> 172.21.15.135:0/3139699798 conn(0x7f8cb00fd540 msgr2=0x7f8cb01064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:10.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.083+0000 7f8cb5069640 1 -- 172.21.15.135:0/3139699798 shutdown_connections 2024-04-20T12:21:10.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.083+0000 7f8cb5069640 1 -- 172.21.15.135:0/3139699798 wait complete. 2024-04-20T12:21:10.091 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:09 smithi135 ceph-mon[18264]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:21:10.092 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:09 smithi135 ceph-mon[18264]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:21:10.092 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:09 smithi135 ceph-mon[18264]: pgmap v306: 129 pgs: 129 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-20T12:21:10.092 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:09 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] up:active 2024-04-20T12:21:10.092 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:09 smithi135 ceph-mon[18264]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-20T12:21:10.092 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:09 smithi135 ceph-mon[18264]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-20T12:21:10.092 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:09 smithi135 ceph-mon[18264]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-20T12:21:10.093 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:21:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.191+0000 7ff2868f2640 1 -- 172.21.15.135:0/2860119043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff280100e70 msgr2=0x7ff280101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.191+0000 7ff2868f2640 1 --2- 172.21.15.135:0/2860119043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff280100e70 0x7ff280101290 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff270009900 tx=0x7ff27002bc30 comp rx=0 tx=0).stop 2024-04-20T12:21:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.191+0000 7ff2868f2640 1 -- 172.21.15.135:0/2860119043 shutdown_connections 2024-04-20T12:21:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.191+0000 7ff2868f2640 1 --2- 172.21.15.135:0/2860119043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff280102a10 0x7ff280109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.191+0000 7ff2868f2640 1 --2- 172.21.15.135:0/2860119043 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff280102050 0x7ff2801024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.191+0000 7ff2868f2640 1 --2- 172.21.15.135:0/2860119043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff280100e70 0x7ff280101290 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.191+0000 7ff2868f2640 1 -- 172.21.15.135:0/2860119043 >> 172.21.15.135:0/2860119043 conn(0x7ff2800fc450 msgr2=0x7ff2800fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:10.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.191+0000 7ff2868f2640 1 -- 172.21.15.135:0/2860119043 shutdown_connections 2024-04-20T12:21:10.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.191+0000 7ff2868f2640 1 -- 172.21.15.135:0/2860119043 wait complete. 2024-04-20T12:21:10.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.192+0000 7ff2868f2640 1 Processor -- start 2024-04-20T12:21:10.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.192+0000 7ff2868f2640 1 -- start start 2024-04-20T12:21:10.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.192+0000 7ff2868f2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff280100e70 0x7ff2801971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:10.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.192+0000 7ff2868f2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff280102050 0x7ff2801976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:10.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.192+0000 7ff2868f2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff280102a10 0x7ff28019e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:10.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.192+0000 7ff2868f2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff28010cb50 con 0x7ff280100e70 2024-04-20T12:21:10.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.192+0000 7ff2868f2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff28010c9d0 con 0x7ff280102a10 2024-04-20T12:21:10.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.192+0000 7ff2868f2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff28010ccd0 con 0x7ff280102050 2024-04-20T12:21:10.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.192+0000 7ff27ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff280100e70 0x7ff2801971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:10.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.192+0000 7ff27ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff280100e70 0x7ff2801971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37046/0 (socket says 172.21.15.135:37046) 2024-04-20T12:21:10.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.192+0000 7ff27ffff640 1 -- 172.21.15.135:0/1531000876 learned_addr learned my addr 172.21.15.135:0/1531000876 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:10.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.192+0000 7ff27f7fe640 1 --2- 172.21.15.135:0/1531000876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff280102050 0x7ff2801976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:10.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.192+0000 7ff284e8f640 1 --2- 172.21.15.135:0/1531000876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff280102a10 0x7ff28019e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:10.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.193+0000 7ff27ffff640 1 -- 172.21.15.135:0/1531000876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff280102050 msgr2=0x7ff2801976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:10.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.193+0000 7ff27ffff640 1 --2- 172.21.15.135:0/1531000876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff280102050 0x7ff2801976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.193+0000 7ff27ffff640 1 -- 172.21.15.135:0/1531000876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff280102a10 msgr2=0x7ff28019e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:10.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.193+0000 7ff27ffff640 1 --2- 172.21.15.135:0/1531000876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff280102a10 0x7ff28019e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.193+0000 7ff27ffff640 1 -- 172.21.15.135:0/1531000876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff28019edc0 con 0x7ff280100e70 2024-04-20T12:21:10.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.193+0000 7ff27f7fe640 1 --2- 172.21.15.135:0/1531000876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff280102050 0x7ff2801976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:21:10.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.193+0000 7ff27ffff640 1 --2- 172.21.15.135:0/1531000876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff280100e70 0x7ff2801971a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff270000c00 tx=0x7ff270005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:10.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.193+0000 7ff27d7fa640 1 -- 172.21.15.135:0/1531000876 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270041070 con 0x7ff280100e70 2024-04-20T12:21:10.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.193+0000 7ff2868f2640 1 -- 172.21.15.135:0/1531000876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff28019f050 con 0x7ff280100e70 2024-04-20T12:21:10.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.193+0000 7ff27d7fa640 1 -- 172.21.15.135:0/1531000876 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2700044d0 con 0x7ff280100e70 2024-04-20T12:21:10.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.193+0000 7ff27d7fa640 1 -- 172.21.15.135:0/1531000876 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270034440 con 0x7ff280100e70 2024-04-20T12:21:10.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.193+0000 7ff2868f2640 1 -- 172.21.15.135:0/1531000876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff28019f540 con 0x7ff280100e70 2024-04-20T12:21:10.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.194+0000 7ff2868f2640 1 -- 172.21.15.135:0/1531000876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff280108290 con 0x7ff280100e70 2024-04-20T12:21:10.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.195+0000 7ff27d7fa640 1 -- 172.21.15.135:0/1531000876 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7ff270044070 con 0x7ff280100e70 2024-04-20T12:21:10.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.195+0000 7ff27d7fa640 1 --2- 172.21.15.135:0/1531000876 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff2680a3c40 0x7ff2680a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:10.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.196+0000 7ff27d7fa640 1 -- 172.21.15.135:0/1531000876 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7ff2700f23d0 con 0x7ff280100e70 2024-04-20T12:21:10.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.196+0000 7ff27f7fe640 1 --2- 172.21.15.135:0/1531000876 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff2680a3c40 0x7ff2680a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:10.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.196+0000 7ff27f7fe640 1 --2- 172.21.15.135:0/1531000876 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff2680a3c40 0x7ff2680a6100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff2801986b0 tx=0x7ff27400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:10.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.199+0000 7ff27d7fa640 1 -- 172.21.15.135:0/1531000876 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7ff2700be4d0 con 0x7ff280100e70 2024-04-20T12:21:10.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:09 smithi154 ceph-mon[22073]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:21:10.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:09 smithi154 ceph-mon[22073]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:21:10.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:09 smithi154 ceph-mon[22073]: pgmap v306: 129 pgs: 129 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-20T12:21:10.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:09 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] up:active 2024-04-20T12:21:10.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:09 smithi154 ceph-mon[22073]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-20T12:21:10.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:09 smithi154 ceph-mon[22073]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-20T12:21:10.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:09 smithi154 ceph-mon[22073]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-20T12:21:10.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:09 smithi139 ceph-mon[21834]: from='client.14892 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:21:10.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:09 smithi139 ceph-mon[21834]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:21:10.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:09 smithi139 ceph-mon[21834]: pgmap v306: 129 pgs: 129 active+clean; 584 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-04-20T12:21:10.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:09 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] up:active 2024-04-20T12:21:10.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:09 smithi139 ceph-mon[21834]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-04-20T12:21:10.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:09 smithi139 ceph-mon[21834]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-04-20T12:21:10.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:09 smithi139 ceph-mon[21834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-20T12:21:10.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.382+0000 7ff2868f2640 1 -- 172.21.15.135:0/1531000876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff28002d7a0 con 0x7ff280100e70 2024-04-20T12:21:10.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.384+0000 7ff27d7fa640 1 -- 172.21.15.135:0/1531000876 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24173 (secure 0 0 0) 0x7ff2700c27d0 con 0x7ff280100e70 2024-04-20T12:21:10.383 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:21:10.383 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":90,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:20:48.315252+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:21:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.386+0000 7ff2868f2640 1 -- 172.21.15.135:0/1531000876 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff2680a3c40 msgr2=0x7ff2680a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.386+0000 7ff2868f2640 1 --2- 172.21.15.135:0/1531000876 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff2680a3c40 0x7ff2680a6100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff2801986b0 tx=0x7ff27400b390 comp rx=0 tx=0).stop 2024-04-20T12:21:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.386+0000 7ff2868f2640 1 -- 172.21.15.135:0/1531000876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff280100e70 msgr2=0x7ff2801971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.386+0000 7ff2868f2640 1 --2- 172.21.15.135:0/1531000876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff280100e70 0x7ff2801971a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff270000c00 tx=0x7ff270005d50 comp rx=0 tx=0).stop 2024-04-20T12:21:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.386+0000 7ff2868f2640 1 -- 172.21.15.135:0/1531000876 shutdown_connections 2024-04-20T12:21:10.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.386+0000 7ff2868f2640 1 --2- 172.21.15.135:0/1531000876 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff2680a3c40 0x7ff2680a6100 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.386+0000 7ff2868f2640 1 --2- 172.21.15.135:0/1531000876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff280102a10 0x7ff28019e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.386+0000 7ff2868f2640 1 --2- 172.21.15.135:0/1531000876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff280102050 0x7ff2801976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.386+0000 7ff2868f2640 1 --2- 172.21.15.135:0/1531000876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff280100e70 0x7ff2801971a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.386+0000 7ff2868f2640 1 -- 172.21.15.135:0/1531000876 >> 172.21.15.135:0/1531000876 conn(0x7ff2800fc450 msgr2=0x7ff280105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:10.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.386+0000 7ff2868f2640 1 -- 172.21.15.135:0/1531000876 shutdown_connections 2024-04-20T12:21:10.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.386+0000 7ff2868f2640 1 -- 172.21.15.135:0/1531000876 wait complete. 2024-04-20T12:21:10.396 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-20T12:21:10.396 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T12:21:10.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.495+0000 7f21a41ef640 1 -- 172.21.15.135:0/2936512812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f219c107c90 msgr2=0x7f219c10a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:10.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.495+0000 7f21a41ef640 1 --2- 172.21.15.135:0/2936512812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f219c107c90 0x7f219c10a0e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2194009ca0 tx=0x7f219402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.495+0000 7f21a41ef640 1 -- 172.21.15.135:0/2936512812 shutdown_connections 2024-04-20T12:21:10.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.495+0000 7f21a41ef640 1 --2- 172.21.15.135:0/2936512812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f219c107c90 0x7f219c10a0e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.495+0000 7f21a41ef640 1 --2- 172.21.15.135:0/2936512812 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f219c105360 0x7f219c107750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.495+0000 7f21a41ef640 1 --2- 172.21.15.135:0/2936512812 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f219c102a30 0x7f219c104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.495+0000 7f21a41ef640 1 -- 172.21.15.135:0/2936512812 >> 172.21.15.135:0/2936512812 conn(0x7f219c0fc440 msgr2=0x7f219c0fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:10.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.496+0000 7f21a41ef640 1 -- 172.21.15.135:0/2936512812 shutdown_connections 2024-04-20T12:21:10.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.496+0000 7f21a41ef640 1 -- 172.21.15.135:0/2936512812 wait complete. 2024-04-20T12:21:10.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.496+0000 7f21a41ef640 1 Processor -- start 2024-04-20T12:21:10.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.496+0000 7f21a41ef640 1 -- start start 2024-04-20T12:21:10.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.496+0000 7f21a41ef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f219c102a30 0x7f219c1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:10.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.496+0000 7f21a41ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f219c105360 0x7f219c1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:10.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.496+0000 7f21a41ef640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f219c107c90 0x7f219c19f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:10.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.496+0000 7f21a41ef640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f219c10dc40 con 0x7f219c105360 2024-04-20T12:21:10.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.496+0000 7f21a41ef640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f219c10dac0 con 0x7f219c107c90 2024-04-20T12:21:10.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.496+0000 7f21a41ef640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f219c10ddc0 con 0x7f219c102a30 2024-04-20T12:21:10.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.496+0000 7f21a178a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f219c105360 0x7f219c1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:10.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.496+0000 7f21a178a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f219c105360 0x7f219c1987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37064/0 (socket says 172.21.15.135:37064) 2024-04-20T12:21:10.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.496+0000 7f21a1f8b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f219c102a30 0x7f219c1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:10.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.496+0000 7f21a178a640 1 -- 172.21.15.135:0/277979936 learned_addr learned my addr 172.21.15.135:0/277979936 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:10.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.497+0000 7f21a278c640 1 --2- 172.21.15.135:0/277979936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f219c107c90 0x7f219c19f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:10.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.497+0000 7f21a178a640 1 -- 172.21.15.135:0/277979936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f219c102a30 msgr2=0x7f219c1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:10.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.497+0000 7f21a178a640 1 --2- 172.21.15.135:0/277979936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f219c102a30 0x7f219c1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.497+0000 7f21a178a640 1 -- 172.21.15.135:0/277979936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f219c107c90 msgr2=0x7f219c19f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:10.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.497+0000 7f21a178a640 1 --2- 172.21.15.135:0/277979936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f219c107c90 0x7f219c19f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.497+0000 7f21a178a640 1 -- 172.21.15.135:0/277979936 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c19fed0 con 0x7f219c105360 2024-04-20T12:21:10.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.497+0000 7f21a278c640 1 --2- 172.21.15.135:0/277979936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f219c107c90 0x7f219c19f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:21:10.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.497+0000 7f21a1f8b640 1 --2- 172.21.15.135:0/277979936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f219c102a30 0x7f219c1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:21:10.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.497+0000 7f21a178a640 1 --2- 172.21.15.135:0/277979936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f219c105360 0x7f219c1987f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f218c00d770 tx=0x7f218c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:10.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.497+0000 7f2192ffd640 1 -- 172.21.15.135:0/277979936 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c017070 con 0x7f219c105360 2024-04-20T12:21:10.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.497+0000 7f2192ffd640 1 -- 172.21.15.135:0/277979936 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f218c009c30 con 0x7f219c105360 2024-04-20T12:21:10.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.497+0000 7f21a41ef640 1 -- 172.21.15.135:0/277979936 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219c1a01c0 con 0x7f219c105360 2024-04-20T12:21:10.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.497+0000 7f2192ffd640 1 -- 172.21.15.135:0/277979936 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c00f620 con 0x7f219c105360 2024-04-20T12:21:10.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.497+0000 7f21a41ef640 1 -- 172.21.15.135:0/277979936 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f219c1a0710 con 0x7f219c105360 2024-04-20T12:21:10.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.498+0000 7f21a41ef640 1 -- 172.21.15.135:0/277979936 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f219c0fdf30 con 0x7f219c105360 2024-04-20T12:21:10.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.499+0000 7f2192ffd640 1 -- 172.21.15.135:0/277979936 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f218c01a070 con 0x7f219c105360 2024-04-20T12:21:10.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.499+0000 7f2192ffd640 1 --2- 172.21.15.135:0/277979936 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f21880a3c40 0x7f21880a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:10.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.500+0000 7f21a1f8b640 1 --2- 172.21.15.135:0/277979936 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f21880a3c40 0x7f21880a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:10.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.500+0000 7f2192ffd640 1 -- 172.21.15.135:0/277979936 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f218c0d02e0 con 0x7f219c105360 2024-04-20T12:21:10.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.500+0000 7f21a1f8b640 1 --2- 172.21.15.135:0/277979936 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f21880a3c40 0x7f21880a6100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2198005fd0 tx=0x7f219800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:10.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.504+0000 7f2192ffd640 1 -- 172.21.15.135:0/277979936 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f218c009de0 con 0x7f219c105360 2024-04-20T12:21:10.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.679+0000 7f21a41ef640 1 -- 172.21.15.135:0/277979936 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f219c0623a0 con 0x7f21880a3c40 2024-04-20T12:21:10.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.689+0000 7f2192ffd640 1 -- 172.21.15.135:0/277979936 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340546 (secure 0 0 0) 0x7f219c0623a0 con 0x7f21880a3c40 2024-04-20T12:21:10.692 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:21:10.694 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-04-20T12:21:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.693+0000 7f21a41ef640 1 -- 172.21.15.135:0/277979936 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f21880a3c40 msgr2=0x7f21880a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.693+0000 7f21a41ef640 1 --2- 172.21.15.135:0/277979936 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f21880a3c40 0x7f21880a6100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2198005fd0 tx=0x7f219800b390 comp rx=0 tx=0).stop 2024-04-20T12:21:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.693+0000 7f21a41ef640 1 -- 172.21.15.135:0/277979936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f219c105360 msgr2=0x7f219c1987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.693+0000 7f21a41ef640 1 --2- 172.21.15.135:0/277979936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f219c105360 0x7f219c1987f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f218c00d770 tx=0x7f218c00dc30 comp rx=0 tx=0).stop 2024-04-20T12:21:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.693+0000 7f21a41ef640 1 -- 172.21.15.135:0/277979936 shutdown_connections 2024-04-20T12:21:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.693+0000 7f21a41ef640 1 --2- 172.21.15.135:0/277979936 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f21880a3c40 0x7f21880a6100 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.693+0000 7f21a41ef640 1 --2- 172.21.15.135:0/277979936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f219c107c90 0x7f219c19f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.693+0000 7f21a41ef640 1 --2- 172.21.15.135:0/277979936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f219c105360 0x7f219c1987f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.693+0000 7f21a41ef640 1 --2- 172.21.15.135:0/277979936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f219c102a30 0x7f219c1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.693+0000 7f21a41ef640 1 -- 172.21.15.135:0/277979936 >> 172.21.15.135:0/277979936 conn(0x7f219c0fc440 msgr2=0x7f219c103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:10.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.693+0000 7f21a41ef640 1 -- 172.21.15.135:0/277979936 shutdown_connections 2024-04-20T12:21:10.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.693+0000 7f21a41ef640 1 -- 172.21.15.135:0/277979936 wait complete. 2024-04-20T12:21:10.703 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-04-20T12:21:08.807877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597506,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":269,"num_write_kb":2970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365068,"kb_used_data":11724,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576756,"statfs":{"total":1151940427776,"available":1151566598144,"internally_reserved":0,"allocated":12005376,"data_stored":7636548,"data_compressed":317964,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2639,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003691"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839727+0000","last_change":"2024-04-20T12:20:42.031660+0000","last_active":"2024-04-20T12:20:48.839727+0000","last_peered":"2024-04-20T12:20:48.839727+0000","last_clean":"2024-04-20T12:20:48.839727+0000","last_became_active":"2024-04-20T12:20:42.031334+0000","last_became_peered":"2024-04-20T12:20:42.031334+0000","last_unstale":"2024-04-20T12:20:48.839727+0000","last_undegraded":"2024-04-20T12:20:48.839727+0000","last_fullsized":"2024-04-20T12:20:48.839727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:27.971885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838234+0000","last_change":"2024-04-20T12:20:42.039049+0000","last_active":"2024-04-20T12:20:48.838234+0000","last_peered":"2024-04-20T12:20:48.838234+0000","last_clean":"2024-04-20T12:20:48.838234+0000","last_became_active":"2024-04-20T12:20:42.037960+0000","last_became_peered":"2024-04-20T12:20:42.037960+0000","last_unstale":"2024-04-20T12:20:48.838234+0000","last_undegraded":"2024-04-20T12:20:48.838234+0000","last_fullsized":"2024-04-20T12:20:48.838234+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:45:44.482154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837917+0000","last_change":"2024-04-20T12:20:42.036915+0000","last_active":"2024-04-20T12:20:48.837917+0000","last_peered":"2024-04-20T12:20:48.837917+0000","last_clean":"2024-04-20T12:20:48.837917+0000","last_became_active":"2024-04-20T12:20:42.036282+0000","last_became_peered":"2024-04-20T12:20:42.036282+0000","last_unstale":"2024-04-20T12:20:48.837917+0000","last_undegraded":"2024-04-20T12:20:48.837917+0000","last_fullsized":"2024-04-20T12:20:48.837917+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:04:55.865977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.840200+0000","last_change":"2024-04-20T12:20:42.036653+0000","last_active":"2024-04-20T12:20:48.840200+0000","last_peered":"2024-04-20T12:20:48.840200+0000","last_clean":"2024-04-20T12:20:48.840200+0000","last_became_active":"2024-04-20T12:20:42.036112+0000","last_became_peered":"2024-04-20T12:20:42.036112+0000","last_unstale":"2024-04-20T12:20:48.840200+0000","last_undegraded":"2024-04-20T12:20:48.840200+0000","last_fullsized":"2024-04-20T12:20:48.840200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:05:50.728127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837777+0000","last_change":"2024-04-20T12:20:42.031271+0000","last_active":"2024-04-20T12:20:48.837777+0000","last_peered":"2024-04-20T12:20:48.837777+0000","last_clean":"2024-04-20T12:20:48.837777+0000","last_became_active":"2024-04-20T12:20:42.030930+0000","last_became_peered":"2024-04-20T12:20:42.030930+0000","last_unstale":"2024-04-20T12:20:48.837777+0000","last_undegraded":"2024-04-20T12:20:48.837777+0000","last_fullsized":"2024-04-20T12:20:48.837777+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:30:53.523203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838678+0000","last_change":"2024-04-20T12:20:42.037556+0000","last_active":"2024-04-20T12:20:48.838678+0000","last_peered":"2024-04-20T12:20:48.838678+0000","last_clean":"2024-04-20T12:20:48.838678+0000","last_became_active":"2024-04-20T12:20:42.037140+0000","last_became_peered":"2024-04-20T12:20:42.037140+0000","last_unstale":"2024-04-20T12:20:48.838678+0000","last_undegraded":"2024-04-20T12:20:48.838678+0000","last_fullsized":"2024-04-20T12:20:48.838678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:41:50.827641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320724+0000","last_change":"2024-04-20T12:20:42.042004+0000","last_active":"2024-04-20T12:20:48.320724+0000","last_peered":"2024-04-20T12:20:48.320724+0000","last_clean":"2024-04-20T12:20:48.320724+0000","last_became_active":"2024-04-20T12:20:42.041663+0000","last_became_peered":"2024-04-20T12:20:42.041663+0000","last_unstale":"2024-04-20T12:20:48.320724+0000","last_undegraded":"2024-04-20T12:20:48.320724+0000","last_fullsized":"2024-04-20T12:20:48.320724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:00.196652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838454+0000","last_change":"2024-04-20T12:20:42.043250+0000","last_active":"2024-04-20T12:20:48.838454+0000","last_peered":"2024-04-20T12:20:48.838454+0000","last_clean":"2024-04-20T12:20:48.838454+0000","last_became_active":"2024-04-20T12:20:42.042678+0000","last_became_peered":"2024-04-20T12:20:42.042678+0000","last_unstale":"2024-04-20T12:20:48.838454+0000","last_undegraded":"2024-04-20T12:20:48.838454+0000","last_fullsized":"2024-04-20T12:20:48.838454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:28:36.825718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839447+0000","last_change":"2024-04-20T12:20:42.026370+0000","last_active":"2024-04-20T12:20:48.839447+0000","last_peered":"2024-04-20T12:20:48.839447+0000","last_clean":"2024-04-20T12:20:48.839447+0000","last_became_active":"2024-04-20T12:20:42.026010+0000","last_became_peered":"2024-04-20T12:20:42.026010+0000","last_unstale":"2024-04-20T12:20:48.839447+0000","last_undegraded":"2024-04-20T12:20:48.839447+0000","last_fullsized":"2024-04-20T12:20:48.839447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:13.526130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839765+0000","last_change":"2024-04-20T12:20:42.036724+0000","last_active":"2024-04-20T12:20:48.839765+0000","last_peered":"2024-04-20T12:20:48.839765+0000","last_clean":"2024-04-20T12:20:48.839765+0000","last_became_active":"2024-04-20T12:20:42.036380+0000","last_became_peered":"2024-04-20T12:20:42.036380+0000","last_unstale":"2024-04-20T12:20:48.839765+0000","last_undegraded":"2024-04-20T12:20:48.839765+0000","last_fullsized":"2024-04-20T12:20:48.839765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:45:19.950895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.321318+0000","last_change":"2024-04-20T12:20:42.032408+0000","last_active":"2024-04-20T12:20:48.321318+0000","last_peered":"2024-04-20T12:20:48.321318+0000","last_clean":"2024-04-20T12:20:48.321318+0000","last_became_active":"2024-04-20T12:20:42.032035+0000","last_became_peered":"2024-04-20T12:20:42.032035+0000","last_unstale":"2024-04-20T12:20:48.321318+0000","last_undegraded":"2024-04-20T12:20:48.321318+0000","last_fullsized":"2024-04-20T12:20:48.321318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:03.702299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.840098+0000","last_change":"2024-04-20T12:20:42.040299+0000","last_active":"2024-04-20T12:20:48.840098+0000","last_peered":"2024-04-20T12:20:48.840098+0000","last_clean":"2024-04-20T12:20:48.840098+0000","last_became_active":"2024-04-20T12:20:42.039891+0000","last_became_peered":"2024-04-20T12:20:42.039891+0000","last_unstale":"2024-04-20T12:20:48.840098+0000","last_undegraded":"2024-04-20T12:20:48.840098+0000","last_fullsized":"2024-04-20T12:20:48.840098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:16:31.701459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320292+0000","last_change":"2024-04-20T12:20:42.032551+0000","last_active":"2024-04-20T12:20:48.320292+0000","last_peered":"2024-04-20T12:20:48.320292+0000","last_clean":"2024-04-20T12:20:48.320292+0000","last_became_active":"2024-04-20T12:20:42.032247+0000","last_became_peered":"2024-04-20T12:20:42.032247+0000","last_unstale":"2024-04-20T12:20:48.320292+0000","last_undegraded":"2024-04-20T12:20:48.320292+0000","last_fullsized":"2024-04-20T12:20:48.320292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:02:22.181110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837706+0000","last_change":"2024-04-20T12:20:42.042662+0000","last_active":"2024-04-20T12:20:48.837706+0000","last_peered":"2024-04-20T12:20:48.837706+0000","last_clean":"2024-04-20T12:20:48.837706+0000","last_became_active":"2024-04-20T12:20:42.042351+0000","last_became_peered":"2024-04-20T12:20:42.042351+0000","last_unstale":"2024-04-20T12:20:48.837706+0000","last_undegraded":"2024-04-20T12:20:48.837706+0000","last_fullsized":"2024-04-20T12:20:48.837706+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:15:21.632339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837815+0000","last_change":"2024-04-20T12:20:42.033402+0000","last_active":"2024-04-20T12:20:48.837815+0000","last_peered":"2024-04-20T12:20:48.837815+0000","last_clean":"2024-04-20T12:20:48.837815+0000","last_became_active":"2024-04-20T12:20:42.032996+0000","last_became_peered":"2024-04-20T12:20:42.032996+0000","last_unstale":"2024-04-20T12:20:48.837815+0000","last_undegraded":"2024-04-20T12:20:48.837815+0000","last_fullsized":"2024-04-20T12:20:48.837815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:45.487051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838538+0000","last_change":"2024-04-20T12:20:42.033836+0000","last_active":"2024-04-20T12:20:48.838538+0000","last_peered":"2024-04-20T12:20:48.838538+0000","last_clean":"2024-04-20T12:20:48.838538+0000","last_became_active":"2024-04-20T12:20:42.033497+0000","last_became_peered":"2024-04-20T12:20:42.033497+0000","last_unstale":"2024-04-20T12:20:48.838538+0000","last_undegraded":"2024-04-20T12:20:48.838538+0000","last_fullsized":"2024-04-20T12:20:48.838538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:25:16.428158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839559+0000","last_change":"2024-04-20T12:20:42.030284+0000","last_active":"2024-04-20T12:20:48.839559+0000","last_peered":"2024-04-20T12:20:48.839559+0000","last_clean":"2024-04-20T12:20:48.839559+0000","last_became_active":"2024-04-20T12:20:42.029899+0000","last_became_peered":"2024-04-20T12:20:42.029899+0000","last_unstale":"2024-04-20T12:20:48.839559+0000","last_undegraded":"2024-04-20T12:20:48.839559+0000","last_fullsized":"2024-04-20T12:20:48.839559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:39:14.371947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.797241+0000","last_change":"2024-04-20T12:20:42.028298+0000","last_active":"2024-04-20T12:20:48.797241+0000","last_peered":"2024-04-20T12:20:48.797241+0000","last_clean":"2024-04-20T12:20:48.797241+0000","last_became_active":"2024-04-20T12:20:42.027814+0000","last_became_peered":"2024-04-20T12:20:42.027814+0000","last_unstale":"2024-04-20T12:20:48.797241+0000","last_undegraded":"2024-04-20T12:20:48.797241+0000","last_fullsized":"2024-04-20T12:20:48.797241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:44:39.903424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838687+0000","last_change":"2024-04-20T12:20:42.043697+0000","last_active":"2024-04-20T12:20:48.838687+0000","last_peered":"2024-04-20T12:20:48.838687+0000","last_clean":"2024-04-20T12:20:48.838687+0000","last_became_active":"2024-04-20T12:20:42.043322+0000","last_became_peered":"2024-04-20T12:20:42.043322+0000","last_unstale":"2024-04-20T12:20:48.838687+0000","last_undegraded":"2024-04-20T12:20:48.838687+0000","last_fullsized":"2024-04-20T12:20:48.838687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:08:35.148726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839094+0000","last_change":"2024-04-20T12:20:46.326298+0000","last_active":"2024-04-20T12:20:48.839094+0000","last_peered":"2024-04-20T12:20:48.839094+0000","last_clean":"2024-04-20T12:20:48.839094+0000","last_became_active":"2024-04-20T12:20:46.325893+0000","last_became_peered":"2024-04-20T12:20:46.325893+0000","last_unstale":"2024-04-20T12:20:48.839094+0000","last_undegraded":"2024-04-20T12:20:48.839094+0000","last_fullsized":"2024-04-20T12:20:48.839094+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:17.076871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'4","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.797300+0000","last_change":"2024-04-20T12:20:41.027834+0000","last_active":"2024-04-20T12:20:48.797300+0000","last_peered":"2024-04-20T12:20:48.797300+0000","last_clean":"2024-04-20T12:20:48.797300+0000","last_became_active":"2024-04-20T12:20:41.027541+0000","last_became_peered":"2024-04-20T12:20:41.027541+0000","last_unstale":"2024-04-20T12:20:48.797300+0000","last_undegraded":"2024-04-20T12:20:48.797300+0000","last_fullsized":"2024-04-20T12:20:48.797300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:30.454875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838692+0000","last_change":"2024-04-20T12:20:42.043315+0000","last_active":"2024-04-20T12:20:48.838692+0000","last_peered":"2024-04-20T12:20:48.838692+0000","last_clean":"2024-04-20T12:20:48.838692+0000","last_became_active":"2024-04-20T12:20:42.042920+0000","last_became_peered":"2024-04-20T12:20:42.042920+0000","last_unstale":"2024-04-20T12:20:48.838692+0000","last_undegraded":"2024-04-20T12:20:48.838692+0000","last_fullsized":"2024-04-20T12:20:48.838692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:52.353023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839553+0000","last_change":"2024-04-20T12:20:46.327004+0000","last_active":"2024-04-20T12:20:48.839553+0000","last_peered":"2024-04-20T12:20:48.839553+0000","last_clean":"2024-04-20T12:20:48.839553+0000","last_became_active":"2024-04-20T12:20:46.326433+0000","last_became_peered":"2024-04-20T12:20:46.326433+0000","last_unstale":"2024-04-20T12:20:48.839553+0000","last_undegraded":"2024-04-20T12:20:48.839553+0000","last_fullsized":"2024-04-20T12:20:48.839553+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:58:05.864093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838881+0000","last_change":"2024-04-20T12:20:41.032149+0000","last_active":"2024-04-20T12:20:48.838881+0000","last_peered":"2024-04-20T12:20:48.838881+0000","last_clean":"2024-04-20T12:20:48.838881+0000","last_became_active":"2024-04-20T12:20:41.031708+0000","last_became_peered":"2024-04-20T12:20:41.031708+0000","last_unstale":"2024-04-20T12:20:48.838881+0000","last_undegraded":"2024-04-20T12:20:48.838881+0000","last_fullsized":"2024-04-20T12:20:48.838881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:55.167376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837942+0000","last_change":"2024-04-20T12:20:42.040462+0000","last_active":"2024-04-20T12:20:48.837942+0000","last_peered":"2024-04-20T12:20:48.837942+0000","last_clean":"2024-04-20T12:20:48.837942+0000","last_became_active":"2024-04-20T12:20:42.040098+0000","last_became_peered":"2024-04-20T12:20:42.040098+0000","last_unstale":"2024-04-20T12:20:48.837942+0000","last_undegraded":"2024-04-20T12:20:48.837942+0000","last_fullsized":"2024-04-20T12:20:48.837942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:16.091488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839882+0000","last_change":"2024-04-20T12:20:46.327205+0000","last_active":"2024-04-20T12:20:48.839882+0000","last_peered":"2024-04-20T12:20:48.839882+0000","last_clean":"2024-04-20T12:20:48.839882+0000","last_became_active":"2024-04-20T12:20:46.326511+0000","last_became_peered":"2024-04-20T12:20:46.326511+0000","last_unstale":"2024-04-20T12:20:48.839882+0000","last_undegraded":"2024-04-20T12:20:48.839882+0000","last_fullsized":"2024-04-20T12:20:48.839882+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:45:11.351139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'2","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838336+0000","last_change":"2024-04-20T12:20:41.028671+0000","last_active":"2024-04-20T12:20:48.838336+0000","last_peered":"2024-04-20T12:20:48.838336+0000","last_clean":"2024-04-20T12:20:48.838336+0000","last_became_active":"2024-04-20T12:20:41.028286+0000","last_became_peered":"2024-04-20T12:20:41.028286+0000","last_unstale":"2024-04-20T12:20:48.838336+0000","last_undegraded":"2024-04-20T12:20:48.838336+0000","last_fullsized":"2024-04-20T12:20:48.838336+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:53:54.164030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838704+0000","last_change":"2024-04-20T12:20:42.029785+0000","last_active":"2024-04-20T12:20:48.838704+0000","last_peered":"2024-04-20T12:20:48.838704+0000","last_clean":"2024-04-20T12:20:48.838704+0000","last_became_active":"2024-04-20T12:20:42.029377+0000","last_became_peered":"2024-04-20T12:20:42.029377+0000","last_unstale":"2024-04-20T12:20:48.838704+0000","last_undegraded":"2024-04-20T12:20:48.838704+0000","last_fullsized":"2024-04-20T12:20:48.838704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:22:52.429274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838480+0000","last_change":"2024-04-20T12:20:46.326552+0000","last_active":"2024-04-20T12:20:48.838480+0000","last_peered":"2024-04-20T12:20:48.838480+0000","last_clean":"2024-04-20T12:20:48.838480+0000","last_became_active":"2024-04-20T12:20:46.325573+0000","last_became_peered":"2024-04-20T12:20:46.325573+0000","last_unstale":"2024-04-20T12:20:48.838480+0000","last_undegraded":"2024-04-20T12:20:48.838480+0000","last_fullsized":"2024-04-20T12:20:48.838480+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:26:01.218141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838270+0000","last_change":"2024-04-20T12:20:41.023884+0000","last_active":"2024-04-20T12:20:48.838270+0000","last_peered":"2024-04-20T12:20:48.838270+0000","last_clean":"2024-04-20T12:20:48.838270+0000","last_became_active":"2024-04-20T12:20:41.023496+0000","last_became_peered":"2024-04-20T12:20:41.023496+0000","last_unstale":"2024-04-20T12:20:48.838270+0000","last_undegraded":"2024-04-20T12:20:48.838270+0000","last_fullsized":"2024-04-20T12:20:48.838270+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:08.824928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.324040+0000","last_change":"2024-04-20T12:20:42.023385+0000","last_active":"2024-04-20T12:20:48.324040+0000","last_peered":"2024-04-20T12:20:48.324040+0000","last_clean":"2024-04-20T12:20:48.324040+0000","last_became_active":"2024-04-20T12:20:42.023074+0000","last_became_peered":"2024-04-20T12:20:42.023074+0000","last_unstale":"2024-04-20T12:20:48.324040+0000","last_undegraded":"2024-04-20T12:20:48.324040+0000","last_fullsized":"2024-04-20T12:20:48.324040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:31.567048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838500+0000","last_change":"2024-04-20T12:20:46.324508+0000","last_active":"2024-04-20T12:20:48.838500+0000","last_peered":"2024-04-20T12:20:48.838500+0000","last_clean":"2024-04-20T12:20:48.838500+0000","last_became_active":"2024-04-20T12:20:46.324014+0000","last_became_peered":"2024-04-20T12:20:46.324014+0000","last_unstale":"2024-04-20T12:20:48.838500+0000","last_undegraded":"2024-04-20T12:20:48.838500+0000","last_fullsized":"2024-04-20T12:20:48.838500+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:17.765152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:05.915273+0000","last_change":"2024-04-20T12:20:41.027476+0000","last_active":"2024-04-20T12:21:05.915273+0000","last_peered":"2024-04-20T12:21:05.915273+0000","last_clean":"2024-04-20T12:21:05.915273+0000","last_became_active":"2024-04-20T12:20:41.027144+0000","last_became_peered":"2024-04-20T12:20:41.027144+0000","last_unstale":"2024-04-20T12:21:05.915273+0000","last_undegraded":"2024-04-20T12:21:05.915273+0000","last_fullsized":"2024-04-20T12:21:05.915273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:30:13.386447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838137+0000","last_change":"2024-04-20T12:20:42.047403+0000","last_active":"2024-04-20T12:20:48.838137+0000","last_peered":"2024-04-20T12:20:48.838137+0000","last_clean":"2024-04-20T12:20:48.838137+0000","last_became_active":"2024-04-20T12:20:42.046240+0000","last_became_peered":"2024-04-20T12:20:42.046240+0000","last_unstale":"2024-04-20T12:20:48.838137+0000","last_undegraded":"2024-04-20T12:20:48.838137+0000","last_fullsized":"2024-04-20T12:20:48.838137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:21:40.410666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838672+0000","last_change":"2024-04-20T12:20:46.326908+0000","last_active":"2024-04-20T12:20:48.838672+0000","last_peered":"2024-04-20T12:20:48.838672+0000","last_clean":"2024-04-20T12:20:48.838672+0000","last_became_active":"2024-04-20T12:20:46.326525+0000","last_became_peered":"2024-04-20T12:20:46.326525+0000","last_unstale":"2024-04-20T12:20:48.838672+0000","last_undegraded":"2024-04-20T12:20:48.838672+0000","last_fullsized":"2024-04-20T12:20:48.838672+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:30:25.132976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838550+0000","last_change":"2024-04-20T12:20:41.027532+0000","last_active":"2024-04-20T12:20:48.838550+0000","last_peered":"2024-04-20T12:20:48.838550+0000","last_clean":"2024-04-20T12:20:48.838550+0000","last_became_active":"2024-04-20T12:20:41.027090+0000","last_became_peered":"2024-04-20T12:20:41.027090+0000","last_unstale":"2024-04-20T12:20:48.838550+0000","last_undegraded":"2024-04-20T12:20:48.838550+0000","last_fullsized":"2024-04-20T12:20:48.838550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:40:10.450305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323840+0000","last_change":"2024-04-20T12:20:42.029043+0000","last_active":"2024-04-20T12:20:48.323840+0000","last_peered":"2024-04-20T12:20:48.323840+0000","last_clean":"2024-04-20T12:20:48.323840+0000","last_became_active":"2024-04-20T12:20:42.028702+0000","last_became_peered":"2024-04-20T12:20:42.028702+0000","last_unstale":"2024-04-20T12:20:48.323840+0000","last_undegraded":"2024-04-20T12:20:48.323840+0000","last_fullsized":"2024-04-20T12:20:48.323840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:24:24.437419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839617+0000","last_change":"2024-04-20T12:20:46.318633+0000","last_active":"2024-04-20T12:20:48.839617+0000","last_peered":"2024-04-20T12:20:48.839617+0000","last_clean":"2024-04-20T12:20:48.839617+0000","last_became_active":"2024-04-20T12:20:46.318215+0000","last_became_peered":"2024-04-20T12:20:46.318215+0000","last_unstale":"2024-04-20T12:20:48.839617+0000","last_undegraded":"2024-04-20T12:20:48.839617+0000","last_fullsized":"2024-04-20T12:20:48.839617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:07:31.241287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320140+0000","last_change":"2024-04-20T12:20:41.027009+0000","last_active":"2024-04-20T12:20:48.320140+0000","last_peered":"2024-04-20T12:20:48.320140+0000","last_clean":"2024-04-20T12:20:48.320140+0000","last_became_active":"2024-04-20T12:20:41.026683+0000","last_became_peered":"2024-04-20T12:20:41.026683+0000","last_unstale":"2024-04-20T12:20:48.320140+0000","last_undegraded":"2024-04-20T12:20:48.320140+0000","last_fullsized":"2024-04-20T12:20:48.320140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:56:35.955635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838807+0000","last_change":"2024-04-20T12:20:42.030833+0000","last_active":"2024-04-20T12:20:48.838807+0000","last_peered":"2024-04-20T12:20:48.838807+0000","last_clean":"2024-04-20T12:20:48.838807+0000","last_became_active":"2024-04-20T12:20:42.030470+0000","last_became_peered":"2024-04-20T12:20:42.030470+0000","last_unstale":"2024-04-20T12:20:48.838807+0000","last_undegraded":"2024-04-20T12:20:48.838807+0000","last_fullsized":"2024-04-20T12:20:48.838807+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:20:07.381222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838238+0000","last_change":"2024-04-20T12:20:46.327091+0000","last_active":"2024-04-20T12:20:48.838238+0000","last_peered":"2024-04-20T12:20:48.838238+0000","last_clean":"2024-04-20T12:20:48.838238+0000","last_became_active":"2024-04-20T12:20:46.326663+0000","last_became_peered":"2024-04-20T12:20:46.326663+0000","last_unstale":"2024-04-20T12:20:48.838238+0000","last_undegraded":"2024-04-20T12:20:48.838238+0000","last_fullsized":"2024-04-20T12:20:48.838238+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:37:31.968946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323367+0000","last_change":"2024-04-20T12:20:41.028908+0000","last_active":"2024-04-20T12:20:48.323367+0000","last_peered":"2024-04-20T12:20:48.323367+0000","last_clean":"2024-04-20T12:20:48.323367+0000","last_became_active":"2024-04-20T12:20:41.028570+0000","last_became_peered":"2024-04-20T12:20:41.028570+0000","last_unstale":"2024-04-20T12:20:48.323367+0000","last_undegraded":"2024-04-20T12:20:48.323367+0000","last_fullsized":"2024-04-20T12:20:48.323367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:39:27.309249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.796813+0000","last_change":"2024-04-20T12:20:42.028802+0000","last_active":"2024-04-20T12:20:48.796813+0000","last_peered":"2024-04-20T12:20:48.796813+0000","last_clean":"2024-04-20T12:20:48.796813+0000","last_became_active":"2024-04-20T12:20:42.028458+0000","last_became_peered":"2024-04-20T12:20:42.028458+0000","last_unstale":"2024-04-20T12:20:48.796813+0000","last_undegraded":"2024-04-20T12:20:48.796813+0000","last_fullsized":"2024-04-20T12:20:48.796813+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:59:28.284954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839295+0000","last_change":"2024-04-20T12:20:46.331055+0000","last_active":"2024-04-20T12:20:48.839295+0000","last_peered":"2024-04-20T12:20:48.839295+0000","last_clean":"2024-04-20T12:20:48.839295+0000","last_became_active":"2024-04-20T12:20:46.330181+0000","last_became_peered":"2024-04-20T12:20:46.330181+0000","last_unstale":"2024-04-20T12:20:48.839295+0000","last_undegraded":"2024-04-20T12:20:48.839295+0000","last_fullsized":"2024-04-20T12:20:48.839295+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:27.430141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839096+0000","last_change":"2024-04-20T12:20:41.025859+0000","last_active":"2024-04-20T12:20:48.839096+0000","last_peered":"2024-04-20T12:20:48.839096+0000","last_clean":"2024-04-20T12:20:48.839096+0000","last_became_active":"2024-04-20T12:20:41.025443+0000","last_became_peered":"2024-04-20T12:20:41.025443+0000","last_unstale":"2024-04-20T12:20:48.839096+0000","last_undegraded":"2024-04-20T12:20:48.839096+0000","last_fullsized":"2024-04-20T12:20:48.839096+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:11:28.100797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839659+0000","last_change":"2024-04-20T12:20:42.028510+0000","last_active":"2024-04-20T12:20:48.839659+0000","last_peered":"2024-04-20T12:20:48.839659+0000","last_clean":"2024-04-20T12:20:48.839659+0000","last_became_active":"2024-04-20T12:20:42.028176+0000","last_became_peered":"2024-04-20T12:20:42.028176+0000","last_unstale":"2024-04-20T12:20:48.839659+0000","last_undegraded":"2024-04-20T12:20:48.839659+0000","last_fullsized":"2024-04-20T12:20:48.839659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:49:44.606154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.796792+0000","last_change":"2024-04-20T12:20:46.327813+0000","last_active":"2024-04-20T12:20:48.796792+0000","last_peered":"2024-04-20T12:20:48.796792+0000","last_clean":"2024-04-20T12:20:48.796792+0000","last_became_active":"2024-04-20T12:20:46.327446+0000","last_became_peered":"2024-04-20T12:20:46.327446+0000","last_unstale":"2024-04-20T12:20:48.796792+0000","last_undegraded":"2024-04-20T12:20:48.796792+0000","last_fullsized":"2024-04-20T12:20:48.796792+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:30:23.990693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:05.913644+0000","last_change":"2024-04-20T12:20:41.027748+0000","last_active":"2024-04-20T12:21:05.913644+0000","last_peered":"2024-04-20T12:21:05.913644+0000","last_clean":"2024-04-20T12:21:05.913644+0000","last_became_active":"2024-04-20T12:20:41.027400+0000","last_became_peered":"2024-04-20T12:20:41.027400+0000","last_unstale":"2024-04-20T12:21:05.913644+0000","last_undegraded":"2024-04-20T12:21:05.913644+0000","last_fullsized":"2024-04-20T12:21:05.913644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:27:50.008057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838287+0000","last_change":"2024-04-20T12:20:42.036738+0000","last_active":"2024-04-20T12:20:48.838287+0000","last_peered":"2024-04-20T12:20:48.838287+0000","last_clean":"2024-04-20T12:20:48.838287+0000","last_became_active":"2024-04-20T12:20:42.036300+0000","last_became_peered":"2024-04-20T12:20:42.036300+0000","last_unstale":"2024-04-20T12:20:48.838287+0000","last_undegraded":"2024-04-20T12:20:48.838287+0000","last_fullsized":"2024-04-20T12:20:48.838287+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:51:58.487061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.840192+0000","last_change":"2024-04-20T12:20:46.326239+0000","last_active":"2024-04-20T12:20:48.840192+0000","last_peered":"2024-04-20T12:20:48.840192+0000","last_clean":"2024-04-20T12:20:48.840192+0000","last_became_active":"2024-04-20T12:20:46.325830+0000","last_became_peered":"2024-04-20T12:20:46.325830+0000","last_unstale":"2024-04-20T12:20:48.840192+0000","last_undegraded":"2024-04-20T12:20:48.840192+0000","last_fullsized":"2024-04-20T12:20:48.840192+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:07.311396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.324036+0000","last_change":"2024-04-20T12:20:41.024662+0000","last_active":"2024-04-20T12:20:48.324036+0000","last_peered":"2024-04-20T12:20:48.324036+0000","last_clean":"2024-04-20T12:20:48.324036+0000","last_became_active":"2024-04-20T12:20:41.024327+0000","last_became_peered":"2024-04-20T12:20:41.024327+0000","last_unstale":"2024-04-20T12:20:48.324036+0000","last_undegraded":"2024-04-20T12:20:48.324036+0000","last_fullsized":"2024-04-20T12:20:48.324036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:07.079126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838877+0000","last_change":"2024-04-20T12:20:42.031910+0000","last_active":"2024-04-20T12:20:48.838877+0000","last_peered":"2024-04-20T12:20:48.838877+0000","last_clean":"2024-04-20T12:20:48.838877+0000","last_became_active":"2024-04-20T12:20:42.031600+0000","last_became_peered":"2024-04-20T12:20:42.031600+0000","last_unstale":"2024-04-20T12:20:48.838877+0000","last_undegraded":"2024-04-20T12:20:48.838877+0000","last_fullsized":"2024-04-20T12:20:48.838877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:23:56.448246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.796892+0000","last_change":"2024-04-20T12:20:46.326094+0000","last_active":"2024-04-20T12:20:48.796892+0000","last_peered":"2024-04-20T12:20:48.796892+0000","last_clean":"2024-04-20T12:20:48.796892+0000","last_became_active":"2024-04-20T12:20:46.325685+0000","last_became_peered":"2024-04-20T12:20:46.325685+0000","last_unstale":"2024-04-20T12:20:48.796892+0000","last_undegraded":"2024-04-20T12:20:48.796892+0000","last_fullsized":"2024-04-20T12:20:48.796892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:37:32.203338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'10","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:57.607414+0000","last_change":"2024-04-20T12:20:41.024722+0000","last_active":"2024-04-20T12:20:57.607414+0000","last_peered":"2024-04-20T12:20:57.607414+0000","last_clean":"2024-04-20T12:20:57.607414+0000","last_became_active":"2024-04-20T12:20:41.024150+0000","last_became_peered":"2024-04-20T12:20:41.024150+0000","last_unstale":"2024-04-20T12:20:57.607414+0000","last_undegraded":"2024-04-20T12:20:57.607414+0000","last_fullsized":"2024-04-20T12:20:57.607414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:14:49.622937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838067+0000","last_change":"2024-04-20T12:20:42.037589+0000","last_active":"2024-04-20T12:20:48.838067+0000","last_peered":"2024-04-20T12:20:48.838067+0000","last_clean":"2024-04-20T12:20:48.838067+0000","last_became_active":"2024-04-20T12:20:42.037256+0000","last_became_peered":"2024-04-20T12:20:42.037256+0000","last_unstale":"2024-04-20T12:20:48.838067+0000","last_undegraded":"2024-04-20T12:20:48.838067+0000","last_fullsized":"2024-04-20T12:20:48.838067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:25.966289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.324267+0000","last_change":"2024-04-20T12:20:46.326476+0000","last_active":"2024-04-20T12:20:48.324267+0000","last_peered":"2024-04-20T12:20:48.324267+0000","last_clean":"2024-04-20T12:20:48.324267+0000","last_became_active":"2024-04-20T12:20:46.326085+0000","last_became_peered":"2024-04-20T12:20:46.326085+0000","last_unstale":"2024-04-20T12:20:48.324267+0000","last_undegraded":"2024-04-20T12:20:48.324267+0000","last_fullsized":"2024-04-20T12:20:48.324267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:34:15.608820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:06.922713+0000","last_change":"2024-04-20T12:20:41.028360+0000","last_active":"2024-04-20T12:21:06.922713+0000","last_peered":"2024-04-20T12:21:06.922713+0000","last_clean":"2024-04-20T12:21:06.922713+0000","last_became_active":"2024-04-20T12:20:41.028057+0000","last_became_peered":"2024-04-20T12:20:41.028057+0000","last_unstale":"2024-04-20T12:21:06.922713+0000","last_undegraded":"2024-04-20T12:21:06.922713+0000","last_fullsized":"2024-04-20T12:21:06.922713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:30:49.699051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320279+0000","last_change":"2024-04-20T12:20:42.028944+0000","last_active":"2024-04-20T12:20:48.320279+0000","last_peered":"2024-04-20T12:20:48.320279+0000","last_clean":"2024-04-20T12:20:48.320279+0000","last_became_active":"2024-04-20T12:20:42.028615+0000","last_became_peered":"2024-04-20T12:20:42.028615+0000","last_unstale":"2024-04-20T12:20:48.320279+0000","last_undegraded":"2024-04-20T12:20:48.320279+0000","last_fullsized":"2024-04-20T12:20:48.320279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:01.904181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839278+0000","last_change":"2024-04-20T12:20:46.328605+0000","last_active":"2024-04-20T12:20:48.839278+0000","last_peered":"2024-04-20T12:20:48.839278+0000","last_clean":"2024-04-20T12:20:48.839278+0000","last_became_active":"2024-04-20T12:20:46.328091+0000","last_became_peered":"2024-04-20T12:20:46.328091+0000","last_unstale":"2024-04-20T12:20:48.839278+0000","last_undegraded":"2024-04-20T12:20:48.839278+0000","last_fullsized":"2024-04-20T12:20:48.839278+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:21:12.908696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:05.915063+0000","last_change":"2024-04-20T12:20:41.028149+0000","last_active":"2024-04-20T12:21:05.915063+0000","last_peered":"2024-04-20T12:21:05.915063+0000","last_clean":"2024-04-20T12:21:05.915063+0000","last_became_active":"2024-04-20T12:20:41.027784+0000","last_became_peered":"2024-04-20T12:20:41.027784+0000","last_unstale":"2024-04-20T12:21:05.915063+0000","last_undegraded":"2024-04-20T12:21:05.915063+0000","last_fullsized":"2024-04-20T12:21:05.915063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:45:31.227275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320904+0000","last_change":"2024-04-20T12:20:42.030961+0000","last_active":"2024-04-20T12:20:48.320904+0000","last_peered":"2024-04-20T12:20:48.320904+0000","last_clean":"2024-04-20T12:20:48.320904+0000","last_became_active":"2024-04-20T12:20:42.030597+0000","last_became_peered":"2024-04-20T12:20:42.030597+0000","last_unstale":"2024-04-20T12:20:48.320904+0000","last_undegraded":"2024-04-20T12:20:48.320904+0000","last_fullsized":"2024-04-20T12:20:48.320904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:59:29.679840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.797004+0000","last_change":"2024-04-20T12:20:46.327034+0000","last_active":"2024-04-20T12:20:48.797004+0000","last_peered":"2024-04-20T12:20:48.797004+0000","last_clean":"2024-04-20T12:20:48.797004+0000","last_became_active":"2024-04-20T12:20:46.325107+0000","last_became_peered":"2024-04-20T12:20:46.325107+0000","last_unstale":"2024-04-20T12:20:48.797004+0000","last_undegraded":"2024-04-20T12:20:48.797004+0000","last_fullsized":"2024-04-20T12:20:48.797004+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:44:04.924677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:06.923557+0000","last_change":"2024-04-20T12:20:41.020878+0000","last_active":"2024-04-20T12:21:06.923557+0000","last_peered":"2024-04-20T12:21:06.923557+0000","last_clean":"2024-04-20T12:21:06.923557+0000","last_became_active":"2024-04-20T12:20:41.020503+0000","last_became_peered":"2024-04-20T12:20:41.020503+0000","last_unstale":"2024-04-20T12:21:06.923557+0000","last_undegraded":"2024-04-20T12:21:06.923557+0000","last_fullsized":"2024-04-20T12:21:06.923557+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:59:00.555136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320747+0000","last_change":"2024-04-20T12:20:42.039699+0000","last_active":"2024-04-20T12:20:48.320747+0000","last_peered":"2024-04-20T12:20:48.320747+0000","last_clean":"2024-04-20T12:20:48.320747+0000","last_became_active":"2024-04-20T12:20:42.039384+0000","last_became_peered":"2024-04-20T12:20:42.039384+0000","last_unstale":"2024-04-20T12:20:48.320747+0000","last_undegraded":"2024-04-20T12:20:48.320747+0000","last_fullsized":"2024-04-20T12:20:48.320747+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:45:41.056018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320651+0000","last_change":"2024-04-20T12:20:46.333294+0000","last_active":"2024-04-20T12:20:48.320651+0000","last_peered":"2024-04-20T12:20:48.320651+0000","last_clean":"2024-04-20T12:20:48.320651+0000","last_became_active":"2024-04-20T12:20:46.332887+0000","last_became_peered":"2024-04-20T12:20:46.332887+0000","last_unstale":"2024-04-20T12:20:48.320651+0000","last_undegraded":"2024-04-20T12:20:48.320651+0000","last_fullsized":"2024-04-20T12:20:48.320651+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:10.686220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"84'8","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837743+0000","last_change":"2024-04-20T12:20:41.027313+0000","last_active":"2024-04-20T12:20:48.837743+0000","last_peered":"2024-04-20T12:20:48.837743+0000","last_clean":"2024-04-20T12:20:48.837743+0000","last_became_active":"2024-04-20T12:20:41.026980+0000","last_became_peered":"2024-04-20T12:20:41.026980+0000","last_unstale":"2024-04-20T12:20:48.837743+0000","last_undegraded":"2024-04-20T12:20:48.837743+0000","last_fullsized":"2024-04-20T12:20:48.837743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:12.692075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323434+0000","last_change":"2024-04-20T12:20:42.027807+0000","last_active":"2024-04-20T12:20:48.323434+0000","last_peered":"2024-04-20T12:20:48.323434+0000","last_clean":"2024-04-20T12:20:48.323434+0000","last_became_active":"2024-04-20T12:20:42.027468+0000","last_became_peered":"2024-04-20T12:20:42.027468+0000","last_unstale":"2024-04-20T12:20:48.323434+0000","last_undegraded":"2024-04-20T12:20:48.323434+0000","last_fullsized":"2024-04-20T12:20:48.323434+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:51.924249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323446+0000","last_change":"2024-04-20T12:20:46.324164+0000","last_active":"2024-04-20T12:20:48.323446+0000","last_peered":"2024-04-20T12:20:48.323446+0000","last_clean":"2024-04-20T12:20:48.323446+0000","last_became_active":"2024-04-20T12:20:46.323651+0000","last_became_peered":"2024-04-20T12:20:46.323651+0000","last_unstale":"2024-04-20T12:20:48.323446+0000","last_undegraded":"2024-04-20T12:20:48.323446+0000","last_fullsized":"2024-04-20T12:20:48.323446+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:07:54.429586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838013+0000","last_change":"2024-04-20T12:20:41.023999+0000","last_active":"2024-04-20T12:20:48.838013+0000","last_peered":"2024-04-20T12:20:48.838013+0000","last_clean":"2024-04-20T12:20:48.838013+0000","last_became_active":"2024-04-20T12:20:41.023440+0000","last_became_peered":"2024-04-20T12:20:41.023440+0000","last_unstale":"2024-04-20T12:20:48.838013+0000","last_undegraded":"2024-04-20T12:20:48.838013+0000","last_fullsized":"2024-04-20T12:20:48.838013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:13:18.493395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839453+0000","last_change":"2024-04-20T12:20:42.036718+0000","last_active":"2024-04-20T12:20:48.839453+0000","last_peered":"2024-04-20T12:20:48.839453+0000","last_clean":"2024-04-20T12:20:48.839453+0000","last_became_active":"2024-04-20T12:20:42.036305+0000","last_became_peered":"2024-04-20T12:20:42.036305+0000","last_unstale":"2024-04-20T12:20:48.839453+0000","last_undegraded":"2024-04-20T12:20:48.839453+0000","last_fullsized":"2024-04-20T12:20:48.839453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:14.462345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838087+0000","last_change":"2024-04-20T12:20:46.930437+0000","last_active":"2024-04-20T12:20:48.838087+0000","last_peered":"2024-04-20T12:20:48.838087+0000","last_clean":"2024-04-20T12:20:48.838087+0000","last_became_active":"2024-04-20T12:20:46.929882+0000","last_became_peered":"2024-04-20T12:20:46.929882+0000","last_unstale":"2024-04-20T12:20:48.838087+0000","last_undegraded":"2024-04-20T12:20:48.838087+0000","last_fullsized":"2024-04-20T12:20:48.838087+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:56.540256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.797063+0000","last_change":"2024-04-20T12:20:41.023584+0000","last_active":"2024-04-20T12:20:48.797063+0000","last_peered":"2024-04-20T12:20:48.797063+0000","last_clean":"2024-04-20T12:20:48.797063+0000","last_became_active":"2024-04-20T12:20:41.023249+0000","last_became_peered":"2024-04-20T12:20:41.023249+0000","last_unstale":"2024-04-20T12:20:48.797063+0000","last_undegraded":"2024-04-20T12:20:48.797063+0000","last_fullsized":"2024-04-20T12:20:48.797063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:18:06.704703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839017+0000","last_change":"2024-04-20T12:20:42.041424+0000","last_active":"2024-04-20T12:20:48.839017+0000","last_peered":"2024-04-20T12:20:48.839017+0000","last_clean":"2024-04-20T12:20:48.839017+0000","last_became_active":"2024-04-20T12:20:42.040231+0000","last_became_peered":"2024-04-20T12:20:42.040231+0000","last_unstale":"2024-04-20T12:20:48.839017+0000","last_undegraded":"2024-04-20T12:20:48.839017+0000","last_fullsized":"2024-04-20T12:20:48.839017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:29.523746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320503+0000","last_change":"2024-04-20T12:20:46.326852+0000","last_active":"2024-04-20T12:20:48.320503+0000","last_peered":"2024-04-20T12:20:48.320503+0000","last_clean":"2024-04-20T12:20:48.320503+0000","last_became_active":"2024-04-20T12:20:46.326398+0000","last_became_peered":"2024-04-20T12:20:46.326398+0000","last_unstale":"2024-04-20T12:20:48.320503+0000","last_undegraded":"2024-04-20T12:20:48.320503+0000","last_fullsized":"2024-04-20T12:20:48.320503+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:00:33.076429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320866+0000","last_change":"2024-04-20T12:20:41.032542+0000","last_active":"2024-04-20T12:20:48.320866+0000","last_peered":"2024-04-20T12:20:48.320866+0000","last_clean":"2024-04-20T12:20:48.320866+0000","last_became_active":"2024-04-20T12:20:41.032048+0000","last_became_peered":"2024-04-20T12:20:41.032048+0000","last_unstale":"2024-04-20T12:20:48.320866+0000","last_undegraded":"2024-04-20T12:20:48.320866+0000","last_fullsized":"2024-04-20T12:20:48.320866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:16:35.515446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838894+0000","last_change":"2024-04-20T12:20:42.034006+0000","last_active":"2024-04-20T12:20:48.838894+0000","last_peered":"2024-04-20T12:20:48.838894+0000","last_clean":"2024-04-20T12:20:48.838894+0000","last_became_active":"2024-04-20T12:20:42.033639+0000","last_became_peered":"2024-04-20T12:20:42.033639+0000","last_unstale":"2024-04-20T12:20:48.838894+0000","last_undegraded":"2024-04-20T12:20:48.838894+0000","last_fullsized":"2024-04-20T12:20:48.838894+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:39:27.435103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320778+0000","last_change":"2024-04-20T12:20:46.930253+0000","last_active":"2024-04-20T12:20:48.320778+0000","last_peered":"2024-04-20T12:20:48.320778+0000","last_clean":"2024-04-20T12:20:48.320778+0000","last_became_active":"2024-04-20T12:20:46.929806+0000","last_became_peered":"2024-04-20T12:20:46.929806+0000","last_unstale":"2024-04-20T12:20:48.320778+0000","last_undegraded":"2024-04-20T12:20:48.320778+0000","last_fullsized":"2024-04-20T12:20:48.320778+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:23:55.085024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323424+0000","last_change":"2024-04-20T12:20:42.031231+0000","last_active":"2024-04-20T12:20:48.323424+0000","last_peered":"2024-04-20T12:20:48.323424+0000","last_clean":"2024-04-20T12:20:48.323424+0000","last_became_active":"2024-04-20T12:20:42.030920+0000","last_became_peered":"2024-04-20T12:20:42.030920+0000","last_unstale":"2024-04-20T12:20:48.323424+0000","last_undegraded":"2024-04-20T12:20:48.323424+0000","last_fullsized":"2024-04-20T12:20:48.323424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:14.631696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320088+0000","last_change":"2024-04-20T12:20:41.030703+0000","last_active":"2024-04-20T12:20:48.320088+0000","last_peered":"2024-04-20T12:20:48.320088+0000","last_clean":"2024-04-20T12:20:48.320088+0000","last_became_active":"2024-04-20T12:20:41.030400+0000","last_became_peered":"2024-04-20T12:20:41.030400+0000","last_unstale":"2024-04-20T12:20:48.320088+0000","last_undegraded":"2024-04-20T12:20:48.320088+0000","last_fullsized":"2024-04-20T12:20:48.320088+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:46:07.845022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.321181+0000","last_change":"2024-04-20T12:20:46.322872+0000","last_active":"2024-04-20T12:20:48.321181+0000","last_peered":"2024-04-20T12:20:48.321181+0000","last_clean":"2024-04-20T12:20:48.321181+0000","last_became_active":"2024-04-20T12:20:46.322440+0000","last_became_peered":"2024-04-20T12:20:46.322440+0000","last_unstale":"2024-04-20T12:20:48.321181+0000","last_undegraded":"2024-04-20T12:20:48.321181+0000","last_fullsized":"2024-04-20T12:20:48.321181+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:24:02.010584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838057+0000","last_change":"2024-04-20T12:20:42.041895+0000","last_active":"2024-04-20T12:20:48.838057+0000","last_peered":"2024-04-20T12:20:48.838057+0000","last_clean":"2024-04-20T12:20:48.838057+0000","last_became_active":"2024-04-20T12:20:42.040451+0000","last_became_peered":"2024-04-20T12:20:42.040451+0000","last_unstale":"2024-04-20T12:20:48.838057+0000","last_undegraded":"2024-04-20T12:20:48.838057+0000","last_fullsized":"2024-04-20T12:20:48.838057+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:17.711581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:05.913932+0000","last_change":"2024-04-20T12:20:41.020656+0000","last_active":"2024-04-20T12:21:05.913932+0000","last_peered":"2024-04-20T12:21:05.913932+0000","last_clean":"2024-04-20T12:21:05.913932+0000","last_became_active":"2024-04-20T12:20:41.020226+0000","last_became_peered":"2024-04-20T12:20:41.020226+0000","last_unstale":"2024-04-20T12:21:05.913932+0000","last_undegraded":"2024-04-20T12:21:05.913932+0000","last_fullsized":"2024-04-20T12:21:05.913932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:21:03.446920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":359,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320583+0000","last_change":"2024-04-20T12:19:29.284050+0000","last_active":"2024-04-20T12:20:48.320583+0000","last_peered":"2024-04-20T12:20:48.320583+0000","last_clean":"2024-04-20T12:20:48.320583+0000","last_became_active":"2024-04-20T12:19:29.283508+0000","last_became_peered":"2024-04-20T12:19:29.283508+0000","last_unstale":"2024-04-20T12:20:48.320583+0000","last_undegraded":"2024-04-20T12:20:48.320583+0000","last_fullsized":"2024-04-20T12:20:48.320583+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:16:03.444995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:16:03.444995+0000","last_clean_scrub_stamp":"2024-04-20T12:16:03.444995+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:28:39.268704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323689+0000","last_change":"2024-04-20T12:20:46.931207+0000","last_active":"2024-04-20T12:20:48.323689+0000","last_peered":"2024-04-20T12:20:48.323689+0000","last_clean":"2024-04-20T12:20:48.323689+0000","last_became_active":"2024-04-20T12:20:46.930733+0000","last_became_peered":"2024-04-20T12:20:46.930733+0000","last_unstale":"2024-04-20T12:20:48.323689+0000","last_undegraded":"2024-04-20T12:20:48.323689+0000","last_fullsized":"2024-04-20T12:20:48.323689+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:09:53.281163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320083+0000","last_change":"2024-04-20T12:20:42.030739+0000","last_active":"2024-04-20T12:20:48.320083+0000","last_peered":"2024-04-20T12:20:48.320083+0000","last_clean":"2024-04-20T12:20:48.320083+0000","last_became_active":"2024-04-20T12:20:42.030440+0000","last_became_peered":"2024-04-20T12:20:42.030440+0000","last_unstale":"2024-04-20T12:20:48.320083+0000","last_undegraded":"2024-04-20T12:20:48.320083+0000","last_fullsized":"2024-04-20T12:20:48.320083+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:44:39.311317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:06.922716+0000","last_change":"2024-04-20T12:20:41.029967+0000","last_active":"2024-04-20T12:21:06.922716+0000","last_peered":"2024-04-20T12:21:06.922716+0000","last_clean":"2024-04-20T12:21:06.922716+0000","last_became_active":"2024-04-20T12:20:41.029618+0000","last_became_peered":"2024-04-20T12:20:41.029618+0000","last_unstale":"2024-04-20T12:21:06.922716+0000","last_undegraded":"2024-04-20T12:21:06.922716+0000","last_fullsized":"2024-04-20T12:21:06.922716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:48.762751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839241+0000","last_change":"2024-04-20T12:20:46.327782+0000","last_active":"2024-04-20T12:20:48.839241+0000","last_peered":"2024-04-20T12:20:48.839241+0000","last_clean":"2024-04-20T12:20:48.839241+0000","last_became_active":"2024-04-20T12:20:46.325462+0000","last_became_peered":"2024-04-20T12:20:46.325462+0000","last_unstale":"2024-04-20T12:20:48.839241+0000","last_undegraded":"2024-04-20T12:20:48.839241+0000","last_fullsized":"2024-04-20T12:20:48.839241+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:41.792496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838168+0000","last_change":"2024-04-20T12:20:41.025454+0000","last_active":"2024-04-20T12:20:48.838168+0000","last_peered":"2024-04-20T12:20:48.838168+0000","last_clean":"2024-04-20T12:20:48.838168+0000","last_became_active":"2024-04-20T12:20:41.025121+0000","last_became_peered":"2024-04-20T12:20:41.025121+0000","last_unstale":"2024-04-20T12:20:48.838168+0000","last_undegraded":"2024-04-20T12:20:48.838168+0000","last_fullsized":"2024-04-20T12:20:48.838168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:57:14.662567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320633+0000","last_change":"2024-04-20T12:20:42.038483+0000","last_active":"2024-04-20T12:20:48.320633+0000","last_peered":"2024-04-20T12:20:48.320633+0000","last_clean":"2024-04-20T12:20:48.320633+0000","last_became_active":"2024-04-20T12:20:42.037626+0000","last_became_peered":"2024-04-20T12:20:42.037626+0000","last_unstale":"2024-04-20T12:20:48.320633+0000","last_undegraded":"2024-04-20T12:20:48.320633+0000","last_fullsized":"2024-04-20T12:20:48.320633+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:11:27.520320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838674+0000","last_change":"2024-04-20T12:20:46.930331+0000","last_active":"2024-04-20T12:20:48.838674+0000","last_peered":"2024-04-20T12:20:48.838674+0000","last_clean":"2024-04-20T12:20:48.838674+0000","last_became_active":"2024-04-20T12:20:46.929816+0000","last_became_peered":"2024-04-20T12:20:46.929816+0000","last_unstale":"2024-04-20T12:20:48.838674+0000","last_undegraded":"2024-04-20T12:20:48.838674+0000","last_fullsized":"2024-04-20T12:20:48.838674+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:42:18.148443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.797165+0000","last_change":"2024-04-20T12:20:41.022365+0000","last_active":"2024-04-20T12:20:48.797165+0000","last_peered":"2024-04-20T12:20:48.797165+0000","last_clean":"2024-04-20T12:20:48.797165+0000","last_became_active":"2024-04-20T12:20:41.022028+0000","last_became_peered":"2024-04-20T12:20:41.022028+0000","last_unstale":"2024-04-20T12:20:48.797165+0000","last_undegraded":"2024-04-20T12:20:48.797165+0000","last_fullsized":"2024-04-20T12:20:48.797165+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:16.436008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839375+0000","last_change":"2024-04-20T12:20:42.031833+0000","last_active":"2024-04-20T12:20:48.839375+0000","last_peered":"2024-04-20T12:20:48.839375+0000","last_clean":"2024-04-20T12:20:48.839375+0000","last_became_active":"2024-04-20T12:20:42.031535+0000","last_became_peered":"2024-04-20T12:20:42.031535+0000","last_unstale":"2024-04-20T12:20:48.839375+0000","last_undegraded":"2024-04-20T12:20:48.839375+0000","last_fullsized":"2024-04-20T12:20:48.839375+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:39:38.955662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838816+0000","last_change":"2024-04-20T12:20:46.319218+0000","last_active":"2024-04-20T12:20:48.838816+0000","last_peered":"2024-04-20T12:20:48.838816+0000","last_clean":"2024-04-20T12:20:48.838816+0000","last_became_active":"2024-04-20T12:20:46.318822+0000","last_became_peered":"2024-04-20T12:20:46.318822+0000","last_unstale":"2024-04-20T12:20:48.838816+0000","last_undegraded":"2024-04-20T12:20:48.838816+0000","last_fullsized":"2024-04-20T12:20:48.838816+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:19:16.907942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:05.912266+0000","last_change":"2024-04-20T12:20:41.035984+0000","last_active":"2024-04-20T12:21:05.912266+0000","last_peered":"2024-04-20T12:21:05.912266+0000","last_clean":"2024-04-20T12:21:05.912266+0000","last_became_active":"2024-04-20T12:20:41.035594+0000","last_became_peered":"2024-04-20T12:20:41.035594+0000","last_unstale":"2024-04-20T12:21:05.912266+0000","last_undegraded":"2024-04-20T12:21:05.912266+0000","last_fullsized":"2024-04-20T12:21:05.912266+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:15.549551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838129+0000","last_change":"2024-04-20T12:20:42.032156+0000","last_active":"2024-04-20T12:20:48.838129+0000","last_peered":"2024-04-20T12:20:48.838129+0000","last_clean":"2024-04-20T12:20:48.838129+0000","last_became_active":"2024-04-20T12:20:42.031779+0000","last_became_peered":"2024-04-20T12:20:42.031779+0000","last_unstale":"2024-04-20T12:20:48.838129+0000","last_undegraded":"2024-04-20T12:20:48.838129+0000","last_fullsized":"2024-04-20T12:20:48.838129+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:43:48.156406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839843+0000","last_change":"2024-04-20T12:20:46.931229+0000","last_active":"2024-04-20T12:20:48.839843+0000","last_peered":"2024-04-20T12:20:48.839843+0000","last_clean":"2024-04-20T12:20:48.839843+0000","last_became_active":"2024-04-20T12:20:46.930677+0000","last_became_peered":"2024-04-20T12:20:46.930677+0000","last_unstale":"2024-04-20T12:20:48.839843+0000","last_undegraded":"2024-04-20T12:20:48.839843+0000","last_fullsized":"2024-04-20T12:20:48.839843+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:54.933944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:05.912431+0000","last_change":"2024-04-20T12:20:41.023789+0000","last_active":"2024-04-20T12:21:05.912431+0000","last_peered":"2024-04-20T12:21:05.912431+0000","last_clean":"2024-04-20T12:21:05.912431+0000","last_became_active":"2024-04-20T12:20:41.023329+0000","last_became_peered":"2024-04-20T12:20:41.023329+0000","last_unstale":"2024-04-20T12:21:05.912431+0000","last_undegraded":"2024-04-20T12:21:05.912431+0000","last_fullsized":"2024-04-20T12:21:05.912431+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:02:17.634230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837772+0000","last_change":"2024-04-20T12:20:42.028708+0000","last_active":"2024-04-20T12:20:48.837772+0000","last_peered":"2024-04-20T12:20:48.837772+0000","last_clean":"2024-04-20T12:20:48.837772+0000","last_became_active":"2024-04-20T12:20:42.028358+0000","last_became_peered":"2024-04-20T12:20:42.028358+0000","last_unstale":"2024-04-20T12:20:48.837772+0000","last_undegraded":"2024-04-20T12:20:48.837772+0000","last_fullsized":"2024-04-20T12:20:48.837772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:21:58.583709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.797336+0000","last_change":"2024-04-20T12:20:46.329173+0000","last_active":"2024-04-20T12:20:48.797336+0000","last_peered":"2024-04-20T12:20:48.797336+0000","last_clean":"2024-04-20T12:20:48.797336+0000","last_became_active":"2024-04-20T12:20:46.328771+0000","last_became_peered":"2024-04-20T12:20:46.328771+0000","last_unstale":"2024-04-20T12:20:48.797336+0000","last_undegraded":"2024-04-20T12:20:48.797336+0000","last_fullsized":"2024-04-20T12:20:48.797336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:43:57.796849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:05.913353+0000","last_change":"2024-04-20T12:20:41.030389+0000","last_active":"2024-04-20T12:21:05.913353+0000","last_peered":"2024-04-20T12:21:05.913353+0000","last_clean":"2024-04-20T12:21:05.913353+0000","last_became_active":"2024-04-20T12:20:41.029864+0000","last_became_peered":"2024-04-20T12:20:41.029864+0000","last_unstale":"2024-04-20T12:21:05.913353+0000","last_undegraded":"2024-04-20T12:21:05.913353+0000","last_fullsized":"2024-04-20T12:21:05.913353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:01:13.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838858+0000","last_change":"2024-04-20T12:20:42.032322+0000","last_active":"2024-04-20T12:20:48.838858+0000","last_peered":"2024-04-20T12:20:48.838858+0000","last_clean":"2024-04-20T12:20:48.838858+0000","last_became_active":"2024-04-20T12:20:42.031973+0000","last_became_peered":"2024-04-20T12:20:42.031973+0000","last_unstale":"2024-04-20T12:20:48.838858+0000","last_undegraded":"2024-04-20T12:20:48.838858+0000","last_fullsized":"2024-04-20T12:20:48.838858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:44:17.135478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839839+0000","last_change":"2024-04-20T12:20:46.321909+0000","last_active":"2024-04-20T12:20:48.839839+0000","last_peered":"2024-04-20T12:20:48.839839+0000","last_clean":"2024-04-20T12:20:48.839839+0000","last_became_active":"2024-04-20T12:20:46.321273+0000","last_became_peered":"2024-04-20T12:20:46.321273+0000","last_unstale":"2024-04-20T12:20:48.839839+0000","last_undegraded":"2024-04-20T12:20:48.839839+0000","last_fullsized":"2024-04-20T12:20:48.839839+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:58:18.429052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838212+0000","last_change":"2024-04-20T12:20:41.030400+0000","last_active":"2024-04-20T12:20:48.838212+0000","last_peered":"2024-04-20T12:20:48.838212+0000","last_clean":"2024-04-20T12:20:48.838212+0000","last_became_active":"2024-04-20T12:20:41.030049+0000","last_became_peered":"2024-04-20T12:20:41.030049+0000","last_unstale":"2024-04-20T12:20:48.838212+0000","last_undegraded":"2024-04-20T12:20:48.838212+0000","last_fullsized":"2024-04-20T12:20:48.838212+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:25:31.789054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839141+0000","last_change":"2024-04-20T12:20:42.037258+0000","last_active":"2024-04-20T12:20:48.839141+0000","last_peered":"2024-04-20T12:20:48.839141+0000","last_clean":"2024-04-20T12:20:48.839141+0000","last_became_active":"2024-04-20T12:20:42.036755+0000","last_became_peered":"2024-04-20T12:20:42.036755+0000","last_unstale":"2024-04-20T12:20:48.839141+0000","last_undegraded":"2024-04-20T12:20:48.839141+0000","last_fullsized":"2024-04-20T12:20:48.839141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:23:17.093038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839993+0000","last_change":"2024-04-20T12:20:46.929829+0000","last_active":"2024-04-20T12:20:48.839993+0000","last_peered":"2024-04-20T12:20:48.839993+0000","last_clean":"2024-04-20T12:20:48.839993+0000","last_became_active":"2024-04-20T12:20:46.929296+0000","last_became_peered":"2024-04-20T12:20:46.929296+0000","last_unstale":"2024-04-20T12:20:48.839993+0000","last_undegraded":"2024-04-20T12:20:48.839993+0000","last_fullsized":"2024-04-20T12:20:48.839993+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:30.700141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"84'2","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837893+0000","last_change":"2024-04-20T12:20:41.027753+0000","last_active":"2024-04-20T12:20:48.837893+0000","last_peered":"2024-04-20T12:20:48.837893+0000","last_clean":"2024-04-20T12:20:48.837893+0000","last_became_active":"2024-04-20T12:20:41.027360+0000","last_became_peered":"2024-04-20T12:20:41.027360+0000","last_unstale":"2024-04-20T12:20:48.837893+0000","last_undegraded":"2024-04-20T12:20:48.837893+0000","last_fullsized":"2024-04-20T12:20:48.837893+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:30:59.710541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320879+0000","last_change":"2024-04-20T12:20:42.029409+0000","last_active":"2024-04-20T12:20:48.320879+0000","last_peered":"2024-04-20T12:20:48.320879+0000","last_clean":"2024-04-20T12:20:48.320879+0000","last_became_active":"2024-04-20T12:20:42.029062+0000","last_became_peered":"2024-04-20T12:20:42.029062+0000","last_unstale":"2024-04-20T12:20:48.320879+0000","last_undegraded":"2024-04-20T12:20:48.320879+0000","last_fullsized":"2024-04-20T12:20:48.320879+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:47:33.412087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838967+0000","last_change":"2024-04-20T12:20:46.326605+0000","last_active":"2024-04-20T12:20:48.838967+0000","last_peered":"2024-04-20T12:20:48.838967+0000","last_clean":"2024-04-20T12:20:48.838967+0000","last_became_active":"2024-04-20T12:20:46.326162+0000","last_became_peered":"2024-04-20T12:20:46.326162+0000","last_unstale":"2024-04-20T12:20:48.838967+0000","last_undegraded":"2024-04-20T12:20:48.838967+0000","last_fullsized":"2024-04-20T12:20:48.838967+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:44:37.344357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:06.924021+0000","last_change":"2024-04-20T12:20:41.035324+0000","last_active":"2024-04-20T12:21:06.924021+0000","last_peered":"2024-04-20T12:21:06.924021+0000","last_clean":"2024-04-20T12:21:06.924021+0000","last_became_active":"2024-04-20T12:20:41.034996+0000","last_became_peered":"2024-04-20T12:20:41.034996+0000","last_unstale":"2024-04-20T12:21:06.924021+0000","last_undegraded":"2024-04-20T12:21:06.924021+0000","last_fullsized":"2024-04-20T12:21:06.924021+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:33.788405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.321332+0000","last_change":"2024-04-20T12:20:42.028803+0000","last_active":"2024-04-20T12:20:48.321332+0000","last_peered":"2024-04-20T12:20:48.321332+0000","last_clean":"2024-04-20T12:20:48.321332+0000","last_became_active":"2024-04-20T12:20:42.028316+0000","last_became_peered":"2024-04-20T12:20:42.028316+0000","last_unstale":"2024-04-20T12:20:48.321332+0000","last_undegraded":"2024-04-20T12:20:48.321332+0000","last_fullsized":"2024-04-20T12:20:48.321332+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:09.000315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838376+0000","last_change":"2024-04-20T12:20:46.328502+0000","last_active":"2024-04-20T12:20:48.838376+0000","last_peered":"2024-04-20T12:20:48.838376+0000","last_clean":"2024-04-20T12:20:48.838376+0000","last_became_active":"2024-04-20T12:20:46.328106+0000","last_became_peered":"2024-04-20T12:20:46.328106+0000","last_unstale":"2024-04-20T12:20:48.838376+0000","last_undegraded":"2024-04-20T12:20:48.838376+0000","last_fullsized":"2024-04-20T12:20:48.838376+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:06:30.041621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.324096+0000","last_change":"2024-04-20T12:20:41.023918+0000","last_active":"2024-04-20T12:20:48.324096+0000","last_peered":"2024-04-20T12:20:48.324096+0000","last_clean":"2024-04-20T12:20:48.324096+0000","last_became_active":"2024-04-20T12:20:41.023088+0000","last_became_peered":"2024-04-20T12:20:41.023088+0000","last_unstale":"2024-04-20T12:20:48.324096+0000","last_undegraded":"2024-04-20T12:20:48.324096+0000","last_fullsized":"2024-04-20T12:20:48.324096+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:15:03.220660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.321077+0000","last_change":"2024-04-20T12:20:42.038981+0000","last_active":"2024-04-20T12:20:48.321077+0000","last_peered":"2024-04-20T12:20:48.321077+0000","last_clean":"2024-04-20T12:20:48.321077+0000","last_became_active":"2024-04-20T12:20:42.038656+0000","last_became_peered":"2024-04-20T12:20:42.038656+0000","last_unstale":"2024-04-20T12:20:48.321077+0000","last_undegraded":"2024-04-20T12:20:48.321077+0000","last_fullsized":"2024-04-20T12:20:48.321077+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:51:08.446546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323308+0000","last_change":"2024-04-20T12:20:46.323446+0000","last_active":"2024-04-20T12:20:48.323308+0000","last_peered":"2024-04-20T12:20:48.323308+0000","last_clean":"2024-04-20T12:20:48.323308+0000","last_became_active":"2024-04-20T12:20:46.322259+0000","last_became_peered":"2024-04-20T12:20:46.322259+0000","last_unstale":"2024-04-20T12:20:48.323308+0000","last_undegraded":"2024-04-20T12:20:48.323308+0000","last_fullsized":"2024-04-20T12:20:48.323308+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:01:11.833469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320649+0000","last_change":"2024-04-20T12:20:41.029995+0000","last_active":"2024-04-20T12:20:48.320649+0000","last_peered":"2024-04-20T12:20:48.320649+0000","last_clean":"2024-04-20T12:20:48.320649+0000","last_became_active":"2024-04-20T12:20:41.029650+0000","last_became_peered":"2024-04-20T12:20:41.029650+0000","last_unstale":"2024-04-20T12:20:48.320649+0000","last_undegraded":"2024-04-20T12:20:48.320649+0000","last_fullsized":"2024-04-20T12:20:48.320649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:24:54.522855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.321335+0000","last_change":"2024-04-20T12:20:42.030357+0000","last_active":"2024-04-20T12:20:48.321335+0000","last_peered":"2024-04-20T12:20:48.321335+0000","last_clean":"2024-04-20T12:20:48.321335+0000","last_became_active":"2024-04-20T12:20:42.029966+0000","last_became_peered":"2024-04-20T12:20:42.029966+0000","last_unstale":"2024-04-20T12:20:48.321335+0000","last_undegraded":"2024-04-20T12:20:48.321335+0000","last_fullsized":"2024-04-20T12:20:48.321335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:35:09.487965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838955+0000","last_change":"2024-04-20T12:20:42.036914+0000","last_active":"2024-04-20T12:20:48.838955+0000","last_peered":"2024-04-20T12:20:48.838955+0000","last_clean":"2024-04-20T12:20:48.838955+0000","last_became_active":"2024-04-20T12:20:42.036434+0000","last_became_peered":"2024-04-20T12:20:42.036434+0000","last_unstale":"2024-04-20T12:20:48.838955+0000","last_undegraded":"2024-04-20T12:20:48.838955+0000","last_fullsized":"2024-04-20T12:20:48.838955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.552096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838976+0000","last_change":"2024-04-20T12:20:42.040424+0000","last_active":"2024-04-20T12:20:48.838976+0000","last_peered":"2024-04-20T12:20:48.838976+0000","last_clean":"2024-04-20T12:20:48.838976+0000","last_became_active":"2024-04-20T12:20:42.040095+0000","last_became_peered":"2024-04-20T12:20:42.040095+0000","last_unstale":"2024-04-20T12:20:48.838976+0000","last_undegraded":"2024-04-20T12:20:48.838976+0000","last_fullsized":"2024-04-20T12:20:48.838976+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:24.669083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838062+0000","last_change":"2024-04-20T12:20:42.037764+0000","last_active":"2024-04-20T12:20:48.838062+0000","last_peered":"2024-04-20T12:20:48.838062+0000","last_clean":"2024-04-20T12:20:48.838062+0000","last_became_active":"2024-04-20T12:20:42.037389+0000","last_became_peered":"2024-04-20T12:20:42.037389+0000","last_unstale":"2024-04-20T12:20:48.838062+0000","last_undegraded":"2024-04-20T12:20:48.838062+0000","last_fullsized":"2024-04-20T12:20:48.838062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:20.284714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837963+0000","last_change":"2024-04-20T12:20:42.027546+0000","last_active":"2024-04-20T12:20:48.837963+0000","last_peered":"2024-04-20T12:20:48.837963+0000","last_clean":"2024-04-20T12:20:48.837963+0000","last_became_active":"2024-04-20T12:20:42.027229+0000","last_became_peered":"2024-04-20T12:20:42.027229+0000","last_unstale":"2024-04-20T12:20:48.837963+0000","last_undegraded":"2024-04-20T12:20:48.837963+0000","last_fullsized":"2024-04-20T12:20:48.837963+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:22.649256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320549+0000","last_change":"2024-04-20T12:20:42.024971+0000","last_active":"2024-04-20T12:20:48.320549+0000","last_peered":"2024-04-20T12:20:48.320549+0000","last_clean":"2024-04-20T12:20:48.320549+0000","last_became_active":"2024-04-20T12:20:42.024607+0000","last_became_peered":"2024-04-20T12:20:42.024607+0000","last_unstale":"2024-04-20T12:20:48.320549+0000","last_undegraded":"2024-04-20T12:20:48.320549+0000","last_fullsized":"2024-04-20T12:20:48.320549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:15:56.160140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839634+0000","last_change":"2024-04-20T12:20:42.036699+0000","last_active":"2024-04-20T12:20:48.839634+0000","last_peered":"2024-04-20T12:20:48.839634+0000","last_clean":"2024-04-20T12:20:48.839634+0000","last_became_active":"2024-04-20T12:20:42.036355+0000","last_became_peered":"2024-04-20T12:20:42.036355+0000","last_unstale":"2024-04-20T12:20:48.839634+0000","last_undegraded":"2024-04-20T12:20:48.839634+0000","last_fullsized":"2024-04-20T12:20:48.839634+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:14:40.276148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838432+0000","last_change":"2024-04-20T12:20:42.034906+0000","last_active":"2024-04-20T12:20:48.838432+0000","last_peered":"2024-04-20T12:20:48.838432+0000","last_clean":"2024-04-20T12:20:48.838432+0000","last_became_active":"2024-04-20T12:20:42.034572+0000","last_became_peered":"2024-04-20T12:20:42.034572+0000","last_unstale":"2024-04-20T12:20:48.838432+0000","last_undegraded":"2024-04-20T12:20:48.838432+0000","last_fullsized":"2024-04-20T12:20:48.838432+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:54.166032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839472+0000","last_change":"2024-04-20T12:20:42.041180+0000","last_active":"2024-04-20T12:20:48.839472+0000","last_peered":"2024-04-20T12:20:48.839472+0000","last_clean":"2024-04-20T12:20:48.839472+0000","last_became_active":"2024-04-20T12:20:42.040648+0000","last_became_peered":"2024-04-20T12:20:42.040648+0000","last_unstale":"2024-04-20T12:20:48.839472+0000","last_undegraded":"2024-04-20T12:20:48.839472+0000","last_fullsized":"2024-04-20T12:20:48.839472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:55:38.855441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323420+0000","last_change":"2024-04-20T12:20:42.030153+0000","last_active":"2024-04-20T12:20:48.323420+0000","last_peered":"2024-04-20T12:20:48.323420+0000","last_clean":"2024-04-20T12:20:48.323420+0000","last_became_active":"2024-04-20T12:20:42.029796+0000","last_became_peered":"2024-04-20T12:20:42.029796+0000","last_unstale":"2024-04-20T12:20:48.323420+0000","last_undegraded":"2024-04-20T12:20:48.323420+0000","last_fullsized":"2024-04-20T12:20:48.323420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:50.676958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839068+0000","last_change":"2024-04-20T12:20:42.039864+0000","last_active":"2024-04-20T12:20:48.839068+0000","last_peered":"2024-04-20T12:20:48.839068+0000","last_clean":"2024-04-20T12:20:48.839068+0000","last_became_active":"2024-04-20T12:20:42.036624+0000","last_became_peered":"2024-04-20T12:20:42.036624+0000","last_unstale":"2024-04-20T12:20:48.839068+0000","last_undegraded":"2024-04-20T12:20:48.839068+0000","last_fullsized":"2024-04-20T12:20:48.839068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:13.271749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839182+0000","last_change":"2024-04-20T12:20:42.033628+0000","last_active":"2024-04-20T12:20:48.839182+0000","last_peered":"2024-04-20T12:20:48.839182+0000","last_clean":"2024-04-20T12:20:48.839182+0000","last_became_active":"2024-04-20T12:20:42.033296+0000","last_became_peered":"2024-04-20T12:20:42.033296+0000","last_unstale":"2024-04-20T12:20:48.839182+0000","last_undegraded":"2024-04-20T12:20:48.839182+0000","last_fullsized":"2024-04-20T12:20:48.839182+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:16:16.029327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320358+0000","last_change":"2024-04-20T12:20:42.024730+0000","last_active":"2024-04-20T12:20:48.320358+0000","last_peered":"2024-04-20T12:20:48.320358+0000","last_clean":"2024-04-20T12:20:48.320358+0000","last_became_active":"2024-04-20T12:20:42.024400+0000","last_became_peered":"2024-04-20T12:20:42.024400+0000","last_unstale":"2024-04-20T12:20:48.320358+0000","last_undegraded":"2024-04-20T12:20:48.320358+0000","last_fullsized":"2024-04-20T12:20:48.320358+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:27:41.514880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839359+0000","last_change":"2024-04-20T12:20:42.033623+0000","last_active":"2024-04-20T12:20:48.839359+0000","last_peered":"2024-04-20T12:20:48.839359+0000","last_clean":"2024-04-20T12:20:48.839359+0000","last_became_active":"2024-04-20T12:20:42.033105+0000","last_became_peered":"2024-04-20T12:20:42.033105+0000","last_unstale":"2024-04-20T12:20:48.839359+0000","last_undegraded":"2024-04-20T12:20:48.839359+0000","last_fullsized":"2024-04-20T12:20:48.839359+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:01.121977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":279778,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7138,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":27386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383698,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":487204,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645334,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1048576,"data_stored":1081026,"data_compressed":53188,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808860,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":487204,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070497,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":983040,"data_stored":487226,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332135,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1040384,"data_stored":1078782,"data_compressed":53188,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495659,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":486622,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":498816,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":486712,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":999424,"data_stored":491120,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":983040,"data_stored":486726,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920822,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":978944,"data_stored":486644,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757297,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":1078466,"data_compressed":53188,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33946,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33946,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33946,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":12194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T12:21:10.710 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T12:21:10.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.842+0000 7f8135dbd640 1 -- 172.21.15.135:0/221501651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8130103d60 msgr2=0x7f813010a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:10.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.842+0000 7f8135dbd640 1 --2- 172.21.15.135:0/221501651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8130103d60 0x7f813010a5f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8128009cd0 tx=0x7f812802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.842+0000 7f8135dbd640 1 -- 172.21.15.135:0/221501651 shutdown_connections 2024-04-20T12:21:10.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.842+0000 7f8135dbd640 1 --2- 172.21.15.135:0/221501651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8130103d60 0x7f813010a5f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.842+0000 7f8135dbd640 1 --2- 172.21.15.135:0/221501651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81301033a0 0x7f8130103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.842+0000 7f8135dbd640 1 --2- 172.21.15.135:0/221501651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8130100330 0x7f8130100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.842+0000 7f8135dbd640 1 -- 172.21.15.135:0/221501651 >> 172.21.15.135:0/221501651 conn(0x7f81300fbc40 msgr2=0x7f81300fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:10.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.842+0000 7f8135dbd640 1 -- 172.21.15.135:0/221501651 shutdown_connections 2024-04-20T12:21:10.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.842+0000 7f8135dbd640 1 -- 172.21.15.135:0/221501651 wait complete. 2024-04-20T12:21:10.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.842+0000 7f8135dbd640 1 Processor -- start 2024-04-20T12:21:10.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.842+0000 7f8135dbd640 1 -- start start 2024-04-20T12:21:10.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f8135dbd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8130100330 0x7f81301982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:10.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f8135dbd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81301033a0 0x7f81301987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:10.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f8135dbd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8130103d60 0x7f813019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:10.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f8135dbd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f813010dcf0 con 0x7f8130103d60 2024-04-20T12:21:10.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f8135dbd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f813010db70 con 0x7f81301033a0 2024-04-20T12:21:10.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f8135dbd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f813010de70 con 0x7f8130100330 2024-04-20T12:21:10.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f812ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8130103d60 0x7f813019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:10.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f812ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8130103d60 0x7f813019f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43568/0 (socket says 172.21.15.135:43568) 2024-04-20T12:21:10.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f812ffff640 1 -- 172.21.15.135:0/3197390608 learned_addr learned my addr 172.21.15.135:0/3197390608 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:10.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f812effd640 1 --2- 172.21.15.135:0/3197390608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81301033a0 0x7f81301987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:10.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f812f7fe640 1 --2- 172.21.15.135:0/3197390608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8130100330 0x7f81301982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:10.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f812ffff640 1 -- 172.21.15.135:0/3197390608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8130100330 msgr2=0x7f81301982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:10.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f812ffff640 1 --2- 172.21.15.135:0/3197390608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8130100330 0x7f81301982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f812ffff640 1 -- 172.21.15.135:0/3197390608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81301033a0 msgr2=0x7f81301987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:10.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f812ffff640 1 --2- 172.21.15.135:0/3197390608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81301033a0 0x7f81301987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:10.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f812ffff640 1 -- 172.21.15.135:0/3197390608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813019fed0 con 0x7f8130103d60 2024-04-20T12:21:10.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f812ffff640 1 --2- 172.21.15.135:0/3197390608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8130103d60 0x7f813019f860 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8128005e30 tx=0x7f8128032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:10.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f812cff9640 1 -- 172.21.15.135:0/3197390608 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128039040 con 0x7f8130103d60 2024-04-20T12:21:10.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f8135dbd640 1 -- 172.21.15.135:0/3197390608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81301a0160 con 0x7f8130103d60 2024-04-20T12:21:10.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f812cff9640 1 -- 172.21.15.135:0/3197390608 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8128044070 con 0x7f8130103d60 2024-04-20T12:21:10.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f812cff9640 1 -- 172.21.15.135:0/3197390608 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81280042a0 con 0x7f8130103d60 2024-04-20T12:21:10.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.843+0000 7f8135dbd640 1 -- 172.21.15.135:0/3197390608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81301a06a0 con 0x7f8130103d60 2024-04-20T12:21:10.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.844+0000 7f8135dbd640 1 -- 172.21.15.135:0/3197390608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8130109400 con 0x7f8130103d60 2024-04-20T12:21:10.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.845+0000 7f812cff9640 1 -- 172.21.15.135:0/3197390608 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f8128003970 con 0x7f8130103d60 2024-04-20T12:21:10.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.846+0000 7f812cff9640 1 --2- 172.21.15.135:0/3197390608 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f81180a3c40 0x7f81180a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:10.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.846+0000 7f812f7fe640 1 --2- 172.21.15.135:0/3197390608 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f81180a3c40 0x7f81180a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:10.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.846+0000 7f812cff9640 1 -- 172.21.15.135:0/3197390608 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f81280f3150 con 0x7f8130103d60 2024-04-20T12:21:10.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.846+0000 7f812f7fe640 1 --2- 172.21.15.135:0/3197390608 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f81180a3c40 0x7f81180a6100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8120005fd0 tx=0x7f8120005ce0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:10.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:10.850+0000 7f812cff9640 1 -- 172.21.15.135:0/3197390608 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f81280bf8a0 con 0x7f8130103d60 2024-04-20T12:21:11.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:11.029+0000 7f8135dbd640 1 -- 172.21.15.135:0/3197390608 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81300623a0 con 0x7f81180a3c40 2024-04-20T12:21:11.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:11.038+0000 7f812cff9640 1 -- 172.21.15.135:0/3197390608 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340622 (secure 0 0 0) 0x7f81300623a0 con 0x7f81180a3c40 2024-04-20T12:21:11.041 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:21:11.042 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-04-20T12:21:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:11.042+0000 7f8135dbd640 1 -- 172.21.15.135:0/3197390608 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f81180a3c40 msgr2=0x7f81180a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:11.042+0000 7f8135dbd640 1 --2- 172.21.15.135:0/3197390608 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f81180a3c40 0x7f81180a6100 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8120005fd0 tx=0x7f8120005ce0 comp rx=0 tx=0).stop 2024-04-20T12:21:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:11.042+0000 7f8135dbd640 1 -- 172.21.15.135:0/3197390608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8130103d60 msgr2=0x7f813019f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:11.042+0000 7f8135dbd640 1 --2- 172.21.15.135:0/3197390608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8130103d60 0x7f813019f860 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8128005e30 tx=0x7f8128032f40 comp rx=0 tx=0).stop 2024-04-20T12:21:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:11.042+0000 7f8135dbd640 1 -- 172.21.15.135:0/3197390608 shutdown_connections 2024-04-20T12:21:11.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:11.042+0000 7f8135dbd640 1 --2- 172.21.15.135:0/3197390608 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f81180a3c40 0x7f81180a6100 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:11.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:11.042+0000 7f8135dbd640 1 --2- 172.21.15.135:0/3197390608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8130103d60 0x7f813019f860 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:11.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:11.042+0000 7f8135dbd640 1 --2- 172.21.15.135:0/3197390608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81301033a0 0x7f81301987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:11.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:11.042+0000 7f8135dbd640 1 --2- 172.21.15.135:0/3197390608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8130100330 0x7f81301982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:11.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:11.042+0000 7f8135dbd640 1 -- 172.21.15.135:0/3197390608 >> 172.21.15.135:0/3197390608 conn(0x7f81300fbc40 msgr2=0x7f81301065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:11.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:11.042+0000 7f8135dbd640 1 -- 172.21.15.135:0/3197390608 shutdown_connections 2024-04-20T12:21:11.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:11.042+0000 7f8135dbd640 1 -- 172.21.15.135:0/3197390608 wait complete. 2024-04-20T12:21:11.051 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:10 smithi135 ceph-mon[18264]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:21:11.051 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:10 smithi135 ceph-mon[18264]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:21:11.051 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:10 smithi135 ceph-mon[18264]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:21:11.051 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:10 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3139699798' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:21:11.051 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:10 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1531000876' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:21:11.052 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-04-20T12:21:10.808578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":635211,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":162,"num_read_kb":179,"num_write":356,"num_write_kb":3026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365212,"kb_used_data":11892,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576612,"statfs":{"total":1151940427776,"available":1151566450688,"internally_reserved":0,"allocated":12177408,"data_stored":7686435,"data_compressed":317964,"data_compressed_allocated":430080,"data_compressed_original":2359296,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40344,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":26,"num_read_kb":60,"num_write":128,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003945"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839727+0000","last_change":"2024-04-20T12:20:42.031660+0000","last_active":"2024-04-20T12:20:48.839727+0000","last_peered":"2024-04-20T12:20:48.839727+0000","last_clean":"2024-04-20T12:20:48.839727+0000","last_became_active":"2024-04-20T12:20:42.031334+0000","last_became_peered":"2024-04-20T12:20:42.031334+0000","last_unstale":"2024-04-20T12:20:48.839727+0000","last_undegraded":"2024-04-20T12:20:48.839727+0000","last_fullsized":"2024-04-20T12:20:48.839727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:27.971885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838234+0000","last_change":"2024-04-20T12:20:42.039049+0000","last_active":"2024-04-20T12:20:48.838234+0000","last_peered":"2024-04-20T12:20:48.838234+0000","last_clean":"2024-04-20T12:20:48.838234+0000","last_became_active":"2024-04-20T12:20:42.037960+0000","last_became_peered":"2024-04-20T12:20:42.037960+0000","last_unstale":"2024-04-20T12:20:48.838234+0000","last_undegraded":"2024-04-20T12:20:48.838234+0000","last_fullsized":"2024-04-20T12:20:48.838234+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:45:44.482154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837917+0000","last_change":"2024-04-20T12:20:42.036915+0000","last_active":"2024-04-20T12:20:48.837917+0000","last_peered":"2024-04-20T12:20:48.837917+0000","last_clean":"2024-04-20T12:20:48.837917+0000","last_became_active":"2024-04-20T12:20:42.036282+0000","last_became_peered":"2024-04-20T12:20:42.036282+0000","last_unstale":"2024-04-20T12:20:48.837917+0000","last_undegraded":"2024-04-20T12:20:48.837917+0000","last_fullsized":"2024-04-20T12:20:48.837917+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:04:55.865977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.840200+0000","last_change":"2024-04-20T12:20:42.036653+0000","last_active":"2024-04-20T12:20:48.840200+0000","last_peered":"2024-04-20T12:20:48.840200+0000","last_clean":"2024-04-20T12:20:48.840200+0000","last_became_active":"2024-04-20T12:20:42.036112+0000","last_became_peered":"2024-04-20T12:20:42.036112+0000","last_unstale":"2024-04-20T12:20:48.840200+0000","last_undegraded":"2024-04-20T12:20:48.840200+0000","last_fullsized":"2024-04-20T12:20:48.840200+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:05:50.728127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837777+0000","last_change":"2024-04-20T12:20:42.031271+0000","last_active":"2024-04-20T12:20:48.837777+0000","last_peered":"2024-04-20T12:20:48.837777+0000","last_clean":"2024-04-20T12:20:48.837777+0000","last_became_active":"2024-04-20T12:20:42.030930+0000","last_became_peered":"2024-04-20T12:20:42.030930+0000","last_unstale":"2024-04-20T12:20:48.837777+0000","last_undegraded":"2024-04-20T12:20:48.837777+0000","last_fullsized":"2024-04-20T12:20:48.837777+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:30:53.523203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838678+0000","last_change":"2024-04-20T12:20:42.037556+0000","last_active":"2024-04-20T12:20:48.838678+0000","last_peered":"2024-04-20T12:20:48.838678+0000","last_clean":"2024-04-20T12:20:48.838678+0000","last_became_active":"2024-04-20T12:20:42.037140+0000","last_became_peered":"2024-04-20T12:20:42.037140+0000","last_unstale":"2024-04-20T12:20:48.838678+0000","last_undegraded":"2024-04-20T12:20:48.838678+0000","last_fullsized":"2024-04-20T12:20:48.838678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:41:50.827641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320724+0000","last_change":"2024-04-20T12:20:42.042004+0000","last_active":"2024-04-20T12:20:48.320724+0000","last_peered":"2024-04-20T12:20:48.320724+0000","last_clean":"2024-04-20T12:20:48.320724+0000","last_became_active":"2024-04-20T12:20:42.041663+0000","last_became_peered":"2024-04-20T12:20:42.041663+0000","last_unstale":"2024-04-20T12:20:48.320724+0000","last_undegraded":"2024-04-20T12:20:48.320724+0000","last_fullsized":"2024-04-20T12:20:48.320724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:00.196652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838454+0000","last_change":"2024-04-20T12:20:42.043250+0000","last_active":"2024-04-20T12:20:48.838454+0000","last_peered":"2024-04-20T12:20:48.838454+0000","last_clean":"2024-04-20T12:20:48.838454+0000","last_became_active":"2024-04-20T12:20:42.042678+0000","last_became_peered":"2024-04-20T12:20:42.042678+0000","last_unstale":"2024-04-20T12:20:48.838454+0000","last_undegraded":"2024-04-20T12:20:48.838454+0000","last_fullsized":"2024-04-20T12:20:48.838454+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:28:36.825718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839447+0000","last_change":"2024-04-20T12:20:42.026370+0000","last_active":"2024-04-20T12:20:48.839447+0000","last_peered":"2024-04-20T12:20:48.839447+0000","last_clean":"2024-04-20T12:20:48.839447+0000","last_became_active":"2024-04-20T12:20:42.026010+0000","last_became_peered":"2024-04-20T12:20:42.026010+0000","last_unstale":"2024-04-20T12:20:48.839447+0000","last_undegraded":"2024-04-20T12:20:48.839447+0000","last_fullsized":"2024-04-20T12:20:48.839447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:13.526130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839765+0000","last_change":"2024-04-20T12:20:42.036724+0000","last_active":"2024-04-20T12:20:48.839765+0000","last_peered":"2024-04-20T12:20:48.839765+0000","last_clean":"2024-04-20T12:20:48.839765+0000","last_became_active":"2024-04-20T12:20:42.036380+0000","last_became_peered":"2024-04-20T12:20:42.036380+0000","last_unstale":"2024-04-20T12:20:48.839765+0000","last_undegraded":"2024-04-20T12:20:48.839765+0000","last_fullsized":"2024-04-20T12:20:48.839765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:45:19.950895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.321318+0000","last_change":"2024-04-20T12:20:42.032408+0000","last_active":"2024-04-20T12:20:48.321318+0000","last_peered":"2024-04-20T12:20:48.321318+0000","last_clean":"2024-04-20T12:20:48.321318+0000","last_became_active":"2024-04-20T12:20:42.032035+0000","last_became_peered":"2024-04-20T12:20:42.032035+0000","last_unstale":"2024-04-20T12:20:48.321318+0000","last_undegraded":"2024-04-20T12:20:48.321318+0000","last_fullsized":"2024-04-20T12:20:48.321318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:03.702299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.840098+0000","last_change":"2024-04-20T12:20:42.040299+0000","last_active":"2024-04-20T12:20:48.840098+0000","last_peered":"2024-04-20T12:20:48.840098+0000","last_clean":"2024-04-20T12:20:48.840098+0000","last_became_active":"2024-04-20T12:20:42.039891+0000","last_became_peered":"2024-04-20T12:20:42.039891+0000","last_unstale":"2024-04-20T12:20:48.840098+0000","last_undegraded":"2024-04-20T12:20:48.840098+0000","last_fullsized":"2024-04-20T12:20:48.840098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:16:31.701459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320292+0000","last_change":"2024-04-20T12:20:42.032551+0000","last_active":"2024-04-20T12:20:48.320292+0000","last_peered":"2024-04-20T12:20:48.320292+0000","last_clean":"2024-04-20T12:20:48.320292+0000","last_became_active":"2024-04-20T12:20:42.032247+0000","last_became_peered":"2024-04-20T12:20:42.032247+0000","last_unstale":"2024-04-20T12:20:48.320292+0000","last_undegraded":"2024-04-20T12:20:48.320292+0000","last_fullsized":"2024-04-20T12:20:48.320292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:02:22.181110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837706+0000","last_change":"2024-04-20T12:20:42.042662+0000","last_active":"2024-04-20T12:20:48.837706+0000","last_peered":"2024-04-20T12:20:48.837706+0000","last_clean":"2024-04-20T12:20:48.837706+0000","last_became_active":"2024-04-20T12:20:42.042351+0000","last_became_peered":"2024-04-20T12:20:42.042351+0000","last_unstale":"2024-04-20T12:20:48.837706+0000","last_undegraded":"2024-04-20T12:20:48.837706+0000","last_fullsized":"2024-04-20T12:20:48.837706+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:15:21.632339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837815+0000","last_change":"2024-04-20T12:20:42.033402+0000","last_active":"2024-04-20T12:20:48.837815+0000","last_peered":"2024-04-20T12:20:48.837815+0000","last_clean":"2024-04-20T12:20:48.837815+0000","last_became_active":"2024-04-20T12:20:42.032996+0000","last_became_peered":"2024-04-20T12:20:42.032996+0000","last_unstale":"2024-04-20T12:20:48.837815+0000","last_undegraded":"2024-04-20T12:20:48.837815+0000","last_fullsized":"2024-04-20T12:20:48.837815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:45.487051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838538+0000","last_change":"2024-04-20T12:20:42.033836+0000","last_active":"2024-04-20T12:20:48.838538+0000","last_peered":"2024-04-20T12:20:48.838538+0000","last_clean":"2024-04-20T12:20:48.838538+0000","last_became_active":"2024-04-20T12:20:42.033497+0000","last_became_peered":"2024-04-20T12:20:42.033497+0000","last_unstale":"2024-04-20T12:20:48.838538+0000","last_undegraded":"2024-04-20T12:20:48.838538+0000","last_fullsized":"2024-04-20T12:20:48.838538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:25:16.428158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839559+0000","last_change":"2024-04-20T12:20:42.030284+0000","last_active":"2024-04-20T12:20:48.839559+0000","last_peered":"2024-04-20T12:20:48.839559+0000","last_clean":"2024-04-20T12:20:48.839559+0000","last_became_active":"2024-04-20T12:20:42.029899+0000","last_became_peered":"2024-04-20T12:20:42.029899+0000","last_unstale":"2024-04-20T12:20:48.839559+0000","last_undegraded":"2024-04-20T12:20:48.839559+0000","last_fullsized":"2024-04-20T12:20:48.839559+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:39:14.371947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.797241+0000","last_change":"2024-04-20T12:20:42.028298+0000","last_active":"2024-04-20T12:20:48.797241+0000","last_peered":"2024-04-20T12:20:48.797241+0000","last_clean":"2024-04-20T12:20:48.797241+0000","last_became_active":"2024-04-20T12:20:42.027814+0000","last_became_peered":"2024-04-20T12:20:42.027814+0000","last_unstale":"2024-04-20T12:20:48.797241+0000","last_undegraded":"2024-04-20T12:20:48.797241+0000","last_fullsized":"2024-04-20T12:20:48.797241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:44:39.903424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838687+0000","last_change":"2024-04-20T12:20:42.043697+0000","last_active":"2024-04-20T12:20:48.838687+0000","last_peered":"2024-04-20T12:20:48.838687+0000","last_clean":"2024-04-20T12:20:48.838687+0000","last_became_active":"2024-04-20T12:20:42.043322+0000","last_became_peered":"2024-04-20T12:20:42.043322+0000","last_unstale":"2024-04-20T12:20:48.838687+0000","last_undegraded":"2024-04-20T12:20:48.838687+0000","last_fullsized":"2024-04-20T12:20:48.838687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:08:35.148726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839094+0000","last_change":"2024-04-20T12:20:46.326298+0000","last_active":"2024-04-20T12:20:48.839094+0000","last_peered":"2024-04-20T12:20:48.839094+0000","last_clean":"2024-04-20T12:20:48.839094+0000","last_became_active":"2024-04-20T12:20:46.325893+0000","last_became_peered":"2024-04-20T12:20:46.325893+0000","last_unstale":"2024-04-20T12:20:48.839094+0000","last_undegraded":"2024-04-20T12:20:48.839094+0000","last_fullsized":"2024-04-20T12:20:48.839094+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:17.076871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'13","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:09.330112+0000","last_change":"2024-04-20T12:20:41.027834+0000","last_active":"2024-04-20T12:21:09.330112+0000","last_peered":"2024-04-20T12:21:09.330112+0000","last_clean":"2024-04-20T12:21:09.330112+0000","last_became_active":"2024-04-20T12:20:41.027541+0000","last_became_peered":"2024-04-20T12:20:41.027541+0000","last_unstale":"2024-04-20T12:21:09.330112+0000","last_undegraded":"2024-04-20T12:21:09.330112+0000","last_fullsized":"2024-04-20T12:21:09.330112+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:30.454875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838692+0000","last_change":"2024-04-20T12:20:42.043315+0000","last_active":"2024-04-20T12:20:48.838692+0000","last_peered":"2024-04-20T12:20:48.838692+0000","last_clean":"2024-04-20T12:20:48.838692+0000","last_became_active":"2024-04-20T12:20:42.042920+0000","last_became_peered":"2024-04-20T12:20:42.042920+0000","last_unstale":"2024-04-20T12:20:48.838692+0000","last_undegraded":"2024-04-20T12:20:48.838692+0000","last_fullsized":"2024-04-20T12:20:48.838692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:52.353023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839553+0000","last_change":"2024-04-20T12:20:46.327004+0000","last_active":"2024-04-20T12:20:48.839553+0000","last_peered":"2024-04-20T12:20:48.839553+0000","last_clean":"2024-04-20T12:20:48.839553+0000","last_became_active":"2024-04-20T12:20:46.326433+0000","last_became_peered":"2024-04-20T12:20:46.326433+0000","last_unstale":"2024-04-20T12:20:48.839553+0000","last_undegraded":"2024-04-20T12:20:48.839553+0000","last_fullsized":"2024-04-20T12:20:48.839553+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:58:05.864093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838881+0000","last_change":"2024-04-20T12:20:41.032149+0000","last_active":"2024-04-20T12:20:48.838881+0000","last_peered":"2024-04-20T12:20:48.838881+0000","last_clean":"2024-04-20T12:20:48.838881+0000","last_became_active":"2024-04-20T12:20:41.031708+0000","last_became_peered":"2024-04-20T12:20:41.031708+0000","last_unstale":"2024-04-20T12:20:48.838881+0000","last_undegraded":"2024-04-20T12:20:48.838881+0000","last_fullsized":"2024-04-20T12:20:48.838881+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:55.167376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837942+0000","last_change":"2024-04-20T12:20:42.040462+0000","last_active":"2024-04-20T12:20:48.837942+0000","last_peered":"2024-04-20T12:20:48.837942+0000","last_clean":"2024-04-20T12:20:48.837942+0000","last_became_active":"2024-04-20T12:20:42.040098+0000","last_became_peered":"2024-04-20T12:20:42.040098+0000","last_unstale":"2024-04-20T12:20:48.837942+0000","last_undegraded":"2024-04-20T12:20:48.837942+0000","last_fullsized":"2024-04-20T12:20:48.837942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:16.091488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839882+0000","last_change":"2024-04-20T12:20:46.327205+0000","last_active":"2024-04-20T12:20:48.839882+0000","last_peered":"2024-04-20T12:20:48.839882+0000","last_clean":"2024-04-20T12:20:48.839882+0000","last_became_active":"2024-04-20T12:20:46.326511+0000","last_became_peered":"2024-04-20T12:20:46.326511+0000","last_unstale":"2024-04-20T12:20:48.839882+0000","last_undegraded":"2024-04-20T12:20:48.839882+0000","last_fullsized":"2024-04-20T12:20:48.839882+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:45:11.351139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'11","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:08.317419+0000","last_change":"2024-04-20T12:20:41.028671+0000","last_active":"2024-04-20T12:21:08.317419+0000","last_peered":"2024-04-20T12:21:08.317419+0000","last_clean":"2024-04-20T12:21:08.317419+0000","last_became_active":"2024-04-20T12:20:41.028286+0000","last_became_peered":"2024-04-20T12:20:41.028286+0000","last_unstale":"2024-04-20T12:21:08.317419+0000","last_undegraded":"2024-04-20T12:21:08.317419+0000","last_fullsized":"2024-04-20T12:21:08.317419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:53:54.164030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838704+0000","last_change":"2024-04-20T12:20:42.029785+0000","last_active":"2024-04-20T12:20:48.838704+0000","last_peered":"2024-04-20T12:20:48.838704+0000","last_clean":"2024-04-20T12:20:48.838704+0000","last_became_active":"2024-04-20T12:20:42.029377+0000","last_became_peered":"2024-04-20T12:20:42.029377+0000","last_unstale":"2024-04-20T12:20:48.838704+0000","last_undegraded":"2024-04-20T12:20:48.838704+0000","last_fullsized":"2024-04-20T12:20:48.838704+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:22:52.429274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838480+0000","last_change":"2024-04-20T12:20:46.326552+0000","last_active":"2024-04-20T12:20:48.838480+0000","last_peered":"2024-04-20T12:20:48.838480+0000","last_clean":"2024-04-20T12:20:48.838480+0000","last_became_active":"2024-04-20T12:20:46.325573+0000","last_became_peered":"2024-04-20T12:20:46.325573+0000","last_unstale":"2024-04-20T12:20:48.838480+0000","last_undegraded":"2024-04-20T12:20:48.838480+0000","last_fullsized":"2024-04-20T12:20:48.838480+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:26:01.218141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:08.317111+0000","last_change":"2024-04-20T12:20:41.023884+0000","last_active":"2024-04-20T12:21:08.317111+0000","last_peered":"2024-04-20T12:21:08.317111+0000","last_clean":"2024-04-20T12:21:08.317111+0000","last_became_active":"2024-04-20T12:20:41.023496+0000","last_became_peered":"2024-04-20T12:20:41.023496+0000","last_unstale":"2024-04-20T12:21:08.317111+0000","last_undegraded":"2024-04-20T12:21:08.317111+0000","last_fullsized":"2024-04-20T12:21:08.317111+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:08.824928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.324040+0000","last_change":"2024-04-20T12:20:42.023385+0000","last_active":"2024-04-20T12:20:48.324040+0000","last_peered":"2024-04-20T12:20:48.324040+0000","last_clean":"2024-04-20T12:20:48.324040+0000","last_became_active":"2024-04-20T12:20:42.023074+0000","last_became_peered":"2024-04-20T12:20:42.023074+0000","last_unstale":"2024-04-20T12:20:48.324040+0000","last_undegraded":"2024-04-20T12:20:48.324040+0000","last_fullsized":"2024-04-20T12:20:48.324040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:31.567048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838500+0000","last_change":"2024-04-20T12:20:46.324508+0000","last_active":"2024-04-20T12:20:48.838500+0000","last_peered":"2024-04-20T12:20:48.838500+0000","last_clean":"2024-04-20T12:20:48.838500+0000","last_became_active":"2024-04-20T12:20:46.324014+0000","last_became_peered":"2024-04-20T12:20:46.324014+0000","last_unstale":"2024-04-20T12:20:48.838500+0000","last_undegraded":"2024-04-20T12:20:48.838500+0000","last_fullsized":"2024-04-20T12:20:48.838500+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:17.765152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:05.915273+0000","last_change":"2024-04-20T12:20:41.027476+0000","last_active":"2024-04-20T12:21:05.915273+0000","last_peered":"2024-04-20T12:21:05.915273+0000","last_clean":"2024-04-20T12:21:05.915273+0000","last_became_active":"2024-04-20T12:20:41.027144+0000","last_became_peered":"2024-04-20T12:20:41.027144+0000","last_unstale":"2024-04-20T12:21:05.915273+0000","last_undegraded":"2024-04-20T12:21:05.915273+0000","last_fullsized":"2024-04-20T12:21:05.915273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:30:13.386447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838137+0000","last_change":"2024-04-20T12:20:42.047403+0000","last_active":"2024-04-20T12:20:48.838137+0000","last_peered":"2024-04-20T12:20:48.838137+0000","last_clean":"2024-04-20T12:20:48.838137+0000","last_became_active":"2024-04-20T12:20:42.046240+0000","last_became_peered":"2024-04-20T12:20:42.046240+0000","last_unstale":"2024-04-20T12:20:48.838137+0000","last_undegraded":"2024-04-20T12:20:48.838137+0000","last_fullsized":"2024-04-20T12:20:48.838137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:21:40.410666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838672+0000","last_change":"2024-04-20T12:20:46.326908+0000","last_active":"2024-04-20T12:20:48.838672+0000","last_peered":"2024-04-20T12:20:48.838672+0000","last_clean":"2024-04-20T12:20:48.838672+0000","last_became_active":"2024-04-20T12:20:46.326525+0000","last_became_peered":"2024-04-20T12:20:46.326525+0000","last_unstale":"2024-04-20T12:20:48.838672+0000","last_undegraded":"2024-04-20T12:20:48.838672+0000","last_fullsized":"2024-04-20T12:20:48.838672+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:30:25.132976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:07.926136+0000","last_change":"2024-04-20T12:20:41.027532+0000","last_active":"2024-04-20T12:21:07.926136+0000","last_peered":"2024-04-20T12:21:07.926136+0000","last_clean":"2024-04-20T12:21:07.926136+0000","last_became_active":"2024-04-20T12:20:41.027090+0000","last_became_peered":"2024-04-20T12:20:41.027090+0000","last_unstale":"2024-04-20T12:21:07.926136+0000","last_undegraded":"2024-04-20T12:21:07.926136+0000","last_fullsized":"2024-04-20T12:21:07.926136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:40:10.450305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323840+0000","last_change":"2024-04-20T12:20:42.029043+0000","last_active":"2024-04-20T12:20:48.323840+0000","last_peered":"2024-04-20T12:20:48.323840+0000","last_clean":"2024-04-20T12:20:48.323840+0000","last_became_active":"2024-04-20T12:20:42.028702+0000","last_became_peered":"2024-04-20T12:20:42.028702+0000","last_unstale":"2024-04-20T12:20:48.323840+0000","last_undegraded":"2024-04-20T12:20:48.323840+0000","last_fullsized":"2024-04-20T12:20:48.323840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:24:24.437419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839617+0000","last_change":"2024-04-20T12:20:46.318633+0000","last_active":"2024-04-20T12:20:48.839617+0000","last_peered":"2024-04-20T12:20:48.839617+0000","last_clean":"2024-04-20T12:20:48.839617+0000","last_became_active":"2024-04-20T12:20:46.318215+0000","last_became_peered":"2024-04-20T12:20:46.318215+0000","last_unstale":"2024-04-20T12:20:48.839617+0000","last_undegraded":"2024-04-20T12:20:48.839617+0000","last_fullsized":"2024-04-20T12:20:48.839617+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:07:31.241287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320140+0000","last_change":"2024-04-20T12:20:41.027009+0000","last_active":"2024-04-20T12:20:48.320140+0000","last_peered":"2024-04-20T12:20:48.320140+0000","last_clean":"2024-04-20T12:20:48.320140+0000","last_became_active":"2024-04-20T12:20:41.026683+0000","last_became_peered":"2024-04-20T12:20:41.026683+0000","last_unstale":"2024-04-20T12:20:48.320140+0000","last_undegraded":"2024-04-20T12:20:48.320140+0000","last_fullsized":"2024-04-20T12:20:48.320140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:56:35.955635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838807+0000","last_change":"2024-04-20T12:20:42.030833+0000","last_active":"2024-04-20T12:20:48.838807+0000","last_peered":"2024-04-20T12:20:48.838807+0000","last_clean":"2024-04-20T12:20:48.838807+0000","last_became_active":"2024-04-20T12:20:42.030470+0000","last_became_peered":"2024-04-20T12:20:42.030470+0000","last_unstale":"2024-04-20T12:20:48.838807+0000","last_undegraded":"2024-04-20T12:20:48.838807+0000","last_fullsized":"2024-04-20T12:20:48.838807+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:20:07.381222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838238+0000","last_change":"2024-04-20T12:20:46.327091+0000","last_active":"2024-04-20T12:20:48.838238+0000","last_peered":"2024-04-20T12:20:48.838238+0000","last_clean":"2024-04-20T12:20:48.838238+0000","last_became_active":"2024-04-20T12:20:46.326663+0000","last_became_peered":"2024-04-20T12:20:46.326663+0000","last_unstale":"2024-04-20T12:20:48.838238+0000","last_undegraded":"2024-04-20T12:20:48.838238+0000","last_fullsized":"2024-04-20T12:20:48.838238+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:37:31.968946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323367+0000","last_change":"2024-04-20T12:20:41.028908+0000","last_active":"2024-04-20T12:20:48.323367+0000","last_peered":"2024-04-20T12:20:48.323367+0000","last_clean":"2024-04-20T12:20:48.323367+0000","last_became_active":"2024-04-20T12:20:41.028570+0000","last_became_peered":"2024-04-20T12:20:41.028570+0000","last_unstale":"2024-04-20T12:20:48.323367+0000","last_undegraded":"2024-04-20T12:20:48.323367+0000","last_fullsized":"2024-04-20T12:20:48.323367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:39:27.309249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.796813+0000","last_change":"2024-04-20T12:20:42.028802+0000","last_active":"2024-04-20T12:20:48.796813+0000","last_peered":"2024-04-20T12:20:48.796813+0000","last_clean":"2024-04-20T12:20:48.796813+0000","last_became_active":"2024-04-20T12:20:42.028458+0000","last_became_peered":"2024-04-20T12:20:42.028458+0000","last_unstale":"2024-04-20T12:20:48.796813+0000","last_undegraded":"2024-04-20T12:20:48.796813+0000","last_fullsized":"2024-04-20T12:20:48.796813+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:59:28.284954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839295+0000","last_change":"2024-04-20T12:20:46.331055+0000","last_active":"2024-04-20T12:20:48.839295+0000","last_peered":"2024-04-20T12:20:48.839295+0000","last_clean":"2024-04-20T12:20:48.839295+0000","last_became_active":"2024-04-20T12:20:46.330181+0000","last_became_peered":"2024-04-20T12:20:46.330181+0000","last_unstale":"2024-04-20T12:20:48.839295+0000","last_undegraded":"2024-04-20T12:20:48.839295+0000","last_fullsized":"2024-04-20T12:20:48.839295+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:27.430141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:10.315487+0000","last_change":"2024-04-20T12:20:41.025859+0000","last_active":"2024-04-20T12:21:10.315487+0000","last_peered":"2024-04-20T12:21:10.315487+0000","last_clean":"2024-04-20T12:21:10.315487+0000","last_became_active":"2024-04-20T12:20:41.025443+0000","last_became_peered":"2024-04-20T12:20:41.025443+0000","last_unstale":"2024-04-20T12:21:10.315487+0000","last_undegraded":"2024-04-20T12:21:10.315487+0000","last_fullsized":"2024-04-20T12:21:10.315487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:11:28.100797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839659+0000","last_change":"2024-04-20T12:20:42.028510+0000","last_active":"2024-04-20T12:20:48.839659+0000","last_peered":"2024-04-20T12:20:48.839659+0000","last_clean":"2024-04-20T12:20:48.839659+0000","last_became_active":"2024-04-20T12:20:42.028176+0000","last_became_peered":"2024-04-20T12:20:42.028176+0000","last_unstale":"2024-04-20T12:20:48.839659+0000","last_undegraded":"2024-04-20T12:20:48.839659+0000","last_fullsized":"2024-04-20T12:20:48.839659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:49:44.606154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.796792+0000","last_change":"2024-04-20T12:20:46.327813+0000","last_active":"2024-04-20T12:20:48.796792+0000","last_peered":"2024-04-20T12:20:48.796792+0000","last_clean":"2024-04-20T12:20:48.796792+0000","last_became_active":"2024-04-20T12:20:46.327446+0000","last_became_peered":"2024-04-20T12:20:46.327446+0000","last_unstale":"2024-04-20T12:20:48.796792+0000","last_undegraded":"2024-04-20T12:20:48.796792+0000","last_fullsized":"2024-04-20T12:20:48.796792+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:30:23.990693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:05.913644+0000","last_change":"2024-04-20T12:20:41.027748+0000","last_active":"2024-04-20T12:21:05.913644+0000","last_peered":"2024-04-20T12:21:05.913644+0000","last_clean":"2024-04-20T12:21:05.913644+0000","last_became_active":"2024-04-20T12:20:41.027400+0000","last_became_peered":"2024-04-20T12:20:41.027400+0000","last_unstale":"2024-04-20T12:21:05.913644+0000","last_undegraded":"2024-04-20T12:21:05.913644+0000","last_fullsized":"2024-04-20T12:21:05.913644+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:27:50.008057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838287+0000","last_change":"2024-04-20T12:20:42.036738+0000","last_active":"2024-04-20T12:20:48.838287+0000","last_peered":"2024-04-20T12:20:48.838287+0000","last_clean":"2024-04-20T12:20:48.838287+0000","last_became_active":"2024-04-20T12:20:42.036300+0000","last_became_peered":"2024-04-20T12:20:42.036300+0000","last_unstale":"2024-04-20T12:20:48.838287+0000","last_undegraded":"2024-04-20T12:20:48.838287+0000","last_fullsized":"2024-04-20T12:20:48.838287+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:51:58.487061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.840192+0000","last_change":"2024-04-20T12:20:46.326239+0000","last_active":"2024-04-20T12:20:48.840192+0000","last_peered":"2024-04-20T12:20:48.840192+0000","last_clean":"2024-04-20T12:20:48.840192+0000","last_became_active":"2024-04-20T12:20:46.325830+0000","last_became_peered":"2024-04-20T12:20:46.325830+0000","last_unstale":"2024-04-20T12:20:48.840192+0000","last_undegraded":"2024-04-20T12:20:48.840192+0000","last_fullsized":"2024-04-20T12:20:48.840192+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:07.311396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.324036+0000","last_change":"2024-04-20T12:20:41.024662+0000","last_active":"2024-04-20T12:20:48.324036+0000","last_peered":"2024-04-20T12:20:48.324036+0000","last_clean":"2024-04-20T12:20:48.324036+0000","last_became_active":"2024-04-20T12:20:41.024327+0000","last_became_peered":"2024-04-20T12:20:41.024327+0000","last_unstale":"2024-04-20T12:20:48.324036+0000","last_undegraded":"2024-04-20T12:20:48.324036+0000","last_fullsized":"2024-04-20T12:20:48.324036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:07.079126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838877+0000","last_change":"2024-04-20T12:20:42.031910+0000","last_active":"2024-04-20T12:20:48.838877+0000","last_peered":"2024-04-20T12:20:48.838877+0000","last_clean":"2024-04-20T12:20:48.838877+0000","last_became_active":"2024-04-20T12:20:42.031600+0000","last_became_peered":"2024-04-20T12:20:42.031600+0000","last_unstale":"2024-04-20T12:20:48.838877+0000","last_undegraded":"2024-04-20T12:20:48.838877+0000","last_fullsized":"2024-04-20T12:20:48.838877+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:23:56.448246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.796892+0000","last_change":"2024-04-20T12:20:46.326094+0000","last_active":"2024-04-20T12:20:48.796892+0000","last_peered":"2024-04-20T12:20:48.796892+0000","last_clean":"2024-04-20T12:20:48.796892+0000","last_became_active":"2024-04-20T12:20:46.325685+0000","last_became_peered":"2024-04-20T12:20:46.325685+0000","last_unstale":"2024-04-20T12:20:48.796892+0000","last_undegraded":"2024-04-20T12:20:48.796892+0000","last_fullsized":"2024-04-20T12:20:48.796892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:37:32.203338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'25","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:10.326908+0000","last_change":"2024-04-20T12:20:41.024722+0000","last_active":"2024-04-20T12:21:10.326908+0000","last_peered":"2024-04-20T12:21:10.326908+0000","last_clean":"2024-04-20T12:21:10.326908+0000","last_became_active":"2024-04-20T12:20:41.024150+0000","last_became_peered":"2024-04-20T12:20:41.024150+0000","last_unstale":"2024-04-20T12:21:10.326908+0000","last_undegraded":"2024-04-20T12:21:10.326908+0000","last_fullsized":"2024-04-20T12:21:10.326908+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:14:49.622937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40471,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":10,"num_read_kb":44,"num_write":27,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838067+0000","last_change":"2024-04-20T12:20:42.037589+0000","last_active":"2024-04-20T12:20:48.838067+0000","last_peered":"2024-04-20T12:20:48.838067+0000","last_clean":"2024-04-20T12:20:48.838067+0000","last_became_active":"2024-04-20T12:20:42.037256+0000","last_became_peered":"2024-04-20T12:20:42.037256+0000","last_unstale":"2024-04-20T12:20:48.838067+0000","last_undegraded":"2024-04-20T12:20:48.838067+0000","last_fullsized":"2024-04-20T12:20:48.838067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:25.966289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.324267+0000","last_change":"2024-04-20T12:20:46.326476+0000","last_active":"2024-04-20T12:20:48.324267+0000","last_peered":"2024-04-20T12:20:48.324267+0000","last_clean":"2024-04-20T12:20:48.324267+0000","last_became_active":"2024-04-20T12:20:46.326085+0000","last_became_peered":"2024-04-20T12:20:46.326085+0000","last_unstale":"2024-04-20T12:20:48.324267+0000","last_undegraded":"2024-04-20T12:20:48.324267+0000","last_fullsized":"2024-04-20T12:20:48.324267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:34:15.608820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:06.922713+0000","last_change":"2024-04-20T12:20:41.028360+0000","last_active":"2024-04-20T12:21:06.922713+0000","last_peered":"2024-04-20T12:21:06.922713+0000","last_clean":"2024-04-20T12:21:06.922713+0000","last_became_active":"2024-04-20T12:20:41.028057+0000","last_became_peered":"2024-04-20T12:20:41.028057+0000","last_unstale":"2024-04-20T12:21:06.922713+0000","last_undegraded":"2024-04-20T12:21:06.922713+0000","last_fullsized":"2024-04-20T12:21:06.922713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:30:49.699051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320279+0000","last_change":"2024-04-20T12:20:42.028944+0000","last_active":"2024-04-20T12:20:48.320279+0000","last_peered":"2024-04-20T12:20:48.320279+0000","last_clean":"2024-04-20T12:20:48.320279+0000","last_became_active":"2024-04-20T12:20:42.028615+0000","last_became_peered":"2024-04-20T12:20:42.028615+0000","last_unstale":"2024-04-20T12:20:48.320279+0000","last_undegraded":"2024-04-20T12:20:48.320279+0000","last_fullsized":"2024-04-20T12:20:48.320279+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:01.904181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839278+0000","last_change":"2024-04-20T12:20:46.328605+0000","last_active":"2024-04-20T12:20:48.839278+0000","last_peered":"2024-04-20T12:20:48.839278+0000","last_clean":"2024-04-20T12:20:48.839278+0000","last_became_active":"2024-04-20T12:20:46.328091+0000","last_became_peered":"2024-04-20T12:20:46.328091+0000","last_unstale":"2024-04-20T12:20:48.839278+0000","last_undegraded":"2024-04-20T12:20:48.839278+0000","last_fullsized":"2024-04-20T12:20:48.839278+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:21:12.908696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:05.915063+0000","last_change":"2024-04-20T12:20:41.028149+0000","last_active":"2024-04-20T12:21:05.915063+0000","last_peered":"2024-04-20T12:21:05.915063+0000","last_clean":"2024-04-20T12:21:05.915063+0000","last_became_active":"2024-04-20T12:20:41.027784+0000","last_became_peered":"2024-04-20T12:20:41.027784+0000","last_unstale":"2024-04-20T12:21:05.915063+0000","last_undegraded":"2024-04-20T12:21:05.915063+0000","last_fullsized":"2024-04-20T12:21:05.915063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:45:31.227275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320904+0000","last_change":"2024-04-20T12:20:42.030961+0000","last_active":"2024-04-20T12:20:48.320904+0000","last_peered":"2024-04-20T12:20:48.320904+0000","last_clean":"2024-04-20T12:20:48.320904+0000","last_became_active":"2024-04-20T12:20:42.030597+0000","last_became_peered":"2024-04-20T12:20:42.030597+0000","last_unstale":"2024-04-20T12:20:48.320904+0000","last_undegraded":"2024-04-20T12:20:48.320904+0000","last_fullsized":"2024-04-20T12:20:48.320904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:59:29.679840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.797004+0000","last_change":"2024-04-20T12:20:46.327034+0000","last_active":"2024-04-20T12:20:48.797004+0000","last_peered":"2024-04-20T12:20:48.797004+0000","last_clean":"2024-04-20T12:20:48.797004+0000","last_became_active":"2024-04-20T12:20:46.325107+0000","last_became_peered":"2024-04-20T12:20:46.325107+0000","last_unstale":"2024-04-20T12:20:48.797004+0000","last_undegraded":"2024-04-20T12:20:48.797004+0000","last_fullsized":"2024-04-20T12:20:48.797004+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:44:04.924677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:06.923557+0000","last_change":"2024-04-20T12:20:41.020878+0000","last_active":"2024-04-20T12:21:06.923557+0000","last_peered":"2024-04-20T12:21:06.923557+0000","last_clean":"2024-04-20T12:21:06.923557+0000","last_became_active":"2024-04-20T12:20:41.020503+0000","last_became_peered":"2024-04-20T12:20:41.020503+0000","last_unstale":"2024-04-20T12:21:06.923557+0000","last_undegraded":"2024-04-20T12:21:06.923557+0000","last_fullsized":"2024-04-20T12:21:06.923557+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:59:00.555136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320747+0000","last_change":"2024-04-20T12:20:42.039699+0000","last_active":"2024-04-20T12:20:48.320747+0000","last_peered":"2024-04-20T12:20:48.320747+0000","last_clean":"2024-04-20T12:20:48.320747+0000","last_became_active":"2024-04-20T12:20:42.039384+0000","last_became_peered":"2024-04-20T12:20:42.039384+0000","last_unstale":"2024-04-20T12:20:48.320747+0000","last_undegraded":"2024-04-20T12:20:48.320747+0000","last_fullsized":"2024-04-20T12:20:48.320747+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:45:41.056018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320651+0000","last_change":"2024-04-20T12:20:46.333294+0000","last_active":"2024-04-20T12:20:48.320651+0000","last_peered":"2024-04-20T12:20:48.320651+0000","last_clean":"2024-04-20T12:20:48.320651+0000","last_became_active":"2024-04-20T12:20:46.332887+0000","last_became_peered":"2024-04-20T12:20:46.332887+0000","last_unstale":"2024-04-20T12:20:48.320651+0000","last_undegraded":"2024-04-20T12:20:48.320651+0000","last_fullsized":"2024-04-20T12:20:48.320651+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:10.686220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:08.306194+0000","last_change":"2024-04-20T12:20:41.027313+0000","last_active":"2024-04-20T12:21:08.306194+0000","last_peered":"2024-04-20T12:21:08.306194+0000","last_clean":"2024-04-20T12:21:08.306194+0000","last_became_active":"2024-04-20T12:20:41.026980+0000","last_became_peered":"2024-04-20T12:20:41.026980+0000","last_unstale":"2024-04-20T12:21:08.306194+0000","last_undegraded":"2024-04-20T12:21:08.306194+0000","last_fullsized":"2024-04-20T12:21:08.306194+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:12.692075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323434+0000","last_change":"2024-04-20T12:20:42.027807+0000","last_active":"2024-04-20T12:20:48.323434+0000","last_peered":"2024-04-20T12:20:48.323434+0000","last_clean":"2024-04-20T12:20:48.323434+0000","last_became_active":"2024-04-20T12:20:42.027468+0000","last_became_peered":"2024-04-20T12:20:42.027468+0000","last_unstale":"2024-04-20T12:20:48.323434+0000","last_undegraded":"2024-04-20T12:20:48.323434+0000","last_fullsized":"2024-04-20T12:20:48.323434+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:51.924249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323446+0000","last_change":"2024-04-20T12:20:46.324164+0000","last_active":"2024-04-20T12:20:48.323446+0000","last_peered":"2024-04-20T12:20:48.323446+0000","last_clean":"2024-04-20T12:20:48.323446+0000","last_became_active":"2024-04-20T12:20:46.323651+0000","last_became_peered":"2024-04-20T12:20:46.323651+0000","last_unstale":"2024-04-20T12:20:48.323446+0000","last_undegraded":"2024-04-20T12:20:48.323446+0000","last_fullsized":"2024-04-20T12:20:48.323446+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:07:54.429586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:07.917102+0000","last_change":"2024-04-20T12:20:41.023999+0000","last_active":"2024-04-20T12:21:07.917102+0000","last_peered":"2024-04-20T12:21:07.917102+0000","last_clean":"2024-04-20T12:21:07.917102+0000","last_became_active":"2024-04-20T12:20:41.023440+0000","last_became_peered":"2024-04-20T12:20:41.023440+0000","last_unstale":"2024-04-20T12:21:07.917102+0000","last_undegraded":"2024-04-20T12:21:07.917102+0000","last_fullsized":"2024-04-20T12:21:07.917102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:13:18.493395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839453+0000","last_change":"2024-04-20T12:20:42.036718+0000","last_active":"2024-04-20T12:20:48.839453+0000","last_peered":"2024-04-20T12:20:48.839453+0000","last_clean":"2024-04-20T12:20:48.839453+0000","last_became_active":"2024-04-20T12:20:42.036305+0000","last_became_peered":"2024-04-20T12:20:42.036305+0000","last_unstale":"2024-04-20T12:20:48.839453+0000","last_undegraded":"2024-04-20T12:20:48.839453+0000","last_fullsized":"2024-04-20T12:20:48.839453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:14.462345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838087+0000","last_change":"2024-04-20T12:20:46.930437+0000","last_active":"2024-04-20T12:20:48.838087+0000","last_peered":"2024-04-20T12:20:48.838087+0000","last_clean":"2024-04-20T12:20:48.838087+0000","last_became_active":"2024-04-20T12:20:46.929882+0000","last_became_peered":"2024-04-20T12:20:46.929882+0000","last_unstale":"2024-04-20T12:20:48.838087+0000","last_undegraded":"2024-04-20T12:20:48.838087+0000","last_fullsized":"2024-04-20T12:20:48.838087+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:56.540256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.797136+0000","last_change":"2024-04-20T12:20:41.023584+0000","last_active":"2024-04-20T12:20:48.797136+0000","last_peered":"2024-04-20T12:20:48.797136+0000","last_clean":"2024-04-20T12:20:48.797136+0000","last_became_active":"2024-04-20T12:20:41.023249+0000","last_became_peered":"2024-04-20T12:20:41.023249+0000","last_unstale":"2024-04-20T12:20:48.797136+0000","last_undegraded":"2024-04-20T12:20:48.797136+0000","last_fullsized":"2024-04-20T12:20:48.797136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:18:06.704703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839017+0000","last_change":"2024-04-20T12:20:42.041424+0000","last_active":"2024-04-20T12:20:48.839017+0000","last_peered":"2024-04-20T12:20:48.839017+0000","last_clean":"2024-04-20T12:20:48.839017+0000","last_became_active":"2024-04-20T12:20:42.040231+0000","last_became_peered":"2024-04-20T12:20:42.040231+0000","last_unstale":"2024-04-20T12:20:48.839017+0000","last_undegraded":"2024-04-20T12:20:48.839017+0000","last_fullsized":"2024-04-20T12:20:48.839017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:29.523746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320503+0000","last_change":"2024-04-20T12:20:46.326852+0000","last_active":"2024-04-20T12:20:48.320503+0000","last_peered":"2024-04-20T12:20:48.320503+0000","last_clean":"2024-04-20T12:20:48.320503+0000","last_became_active":"2024-04-20T12:20:46.326398+0000","last_became_peered":"2024-04-20T12:20:46.326398+0000","last_unstale":"2024-04-20T12:20:48.320503+0000","last_undegraded":"2024-04-20T12:20:48.320503+0000","last_fullsized":"2024-04-20T12:20:48.320503+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:00:33.076429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320866+0000","last_change":"2024-04-20T12:20:41.032542+0000","last_active":"2024-04-20T12:20:48.320866+0000","last_peered":"2024-04-20T12:20:48.320866+0000","last_clean":"2024-04-20T12:20:48.320866+0000","last_became_active":"2024-04-20T12:20:41.032048+0000","last_became_peered":"2024-04-20T12:20:41.032048+0000","last_unstale":"2024-04-20T12:20:48.320866+0000","last_undegraded":"2024-04-20T12:20:48.320866+0000","last_fullsized":"2024-04-20T12:20:48.320866+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:16:35.515446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838894+0000","last_change":"2024-04-20T12:20:42.034006+0000","last_active":"2024-04-20T12:20:48.838894+0000","last_peered":"2024-04-20T12:20:48.838894+0000","last_clean":"2024-04-20T12:20:48.838894+0000","last_became_active":"2024-04-20T12:20:42.033639+0000","last_became_peered":"2024-04-20T12:20:42.033639+0000","last_unstale":"2024-04-20T12:20:48.838894+0000","last_undegraded":"2024-04-20T12:20:48.838894+0000","last_fullsized":"2024-04-20T12:20:48.838894+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:39:27.435103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320778+0000","last_change":"2024-04-20T12:20:46.930253+0000","last_active":"2024-04-20T12:20:48.320778+0000","last_peered":"2024-04-20T12:20:48.320778+0000","last_clean":"2024-04-20T12:20:48.320778+0000","last_became_active":"2024-04-20T12:20:46.929806+0000","last_became_peered":"2024-04-20T12:20:46.929806+0000","last_unstale":"2024-04-20T12:20:48.320778+0000","last_undegraded":"2024-04-20T12:20:48.320778+0000","last_fullsized":"2024-04-20T12:20:48.320778+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:23:55.085024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323424+0000","last_change":"2024-04-20T12:20:42.031231+0000","last_active":"2024-04-20T12:20:48.323424+0000","last_peered":"2024-04-20T12:20:48.323424+0000","last_clean":"2024-04-20T12:20:48.323424+0000","last_became_active":"2024-04-20T12:20:42.030920+0000","last_became_peered":"2024-04-20T12:20:42.030920+0000","last_unstale":"2024-04-20T12:20:48.323424+0000","last_undegraded":"2024-04-20T12:20:48.323424+0000","last_fullsized":"2024-04-20T12:20:48.323424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:14.631696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320088+0000","last_change":"2024-04-20T12:20:41.030703+0000","last_active":"2024-04-20T12:20:48.320088+0000","last_peered":"2024-04-20T12:20:48.320088+0000","last_clean":"2024-04-20T12:20:48.320088+0000","last_became_active":"2024-04-20T12:20:41.030400+0000","last_became_peered":"2024-04-20T12:20:41.030400+0000","last_unstale":"2024-04-20T12:20:48.320088+0000","last_undegraded":"2024-04-20T12:20:48.320088+0000","last_fullsized":"2024-04-20T12:20:48.320088+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:46:07.845022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.321181+0000","last_change":"2024-04-20T12:20:46.322872+0000","last_active":"2024-04-20T12:20:48.321181+0000","last_peered":"2024-04-20T12:20:48.321181+0000","last_clean":"2024-04-20T12:20:48.321181+0000","last_became_active":"2024-04-20T12:20:46.322440+0000","last_became_peered":"2024-04-20T12:20:46.322440+0000","last_unstale":"2024-04-20T12:20:48.321181+0000","last_undegraded":"2024-04-20T12:20:48.321181+0000","last_fullsized":"2024-04-20T12:20:48.321181+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:24:02.010584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838057+0000","last_change":"2024-04-20T12:20:42.041895+0000","last_active":"2024-04-20T12:20:48.838057+0000","last_peered":"2024-04-20T12:20:48.838057+0000","last_clean":"2024-04-20T12:20:48.838057+0000","last_became_active":"2024-04-20T12:20:42.040451+0000","last_became_peered":"2024-04-20T12:20:42.040451+0000","last_unstale":"2024-04-20T12:20:48.838057+0000","last_undegraded":"2024-04-20T12:20:48.838057+0000","last_fullsized":"2024-04-20T12:20:48.838057+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:17.711581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:05.913932+0000","last_change":"2024-04-20T12:20:41.020656+0000","last_active":"2024-04-20T12:21:05.913932+0000","last_peered":"2024-04-20T12:21:05.913932+0000","last_clean":"2024-04-20T12:21:05.913932+0000","last_became_active":"2024-04-20T12:20:41.020226+0000","last_became_peered":"2024-04-20T12:20:41.020226+0000","last_unstale":"2024-04-20T12:21:05.913932+0000","last_undegraded":"2024-04-20T12:21:05.913932+0000","last_fullsized":"2024-04-20T12:21:05.913932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:21:03.446920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":359,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320583+0000","last_change":"2024-04-20T12:19:29.284050+0000","last_active":"2024-04-20T12:20:48.320583+0000","last_peered":"2024-04-20T12:20:48.320583+0000","last_clean":"2024-04-20T12:20:48.320583+0000","last_became_active":"2024-04-20T12:19:29.283508+0000","last_became_peered":"2024-04-20T12:19:29.283508+0000","last_unstale":"2024-04-20T12:20:48.320583+0000","last_undegraded":"2024-04-20T12:20:48.320583+0000","last_fullsized":"2024-04-20T12:20:48.320583+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:16:03.444995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:16:03.444995+0000","last_clean_scrub_stamp":"2024-04-20T12:16:03.444995+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:28:39.268704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323689+0000","last_change":"2024-04-20T12:20:46.931207+0000","last_active":"2024-04-20T12:20:48.323689+0000","last_peered":"2024-04-20T12:20:48.323689+0000","last_clean":"2024-04-20T12:20:48.323689+0000","last_became_active":"2024-04-20T12:20:46.930733+0000","last_became_peered":"2024-04-20T12:20:46.930733+0000","last_unstale":"2024-04-20T12:20:48.323689+0000","last_undegraded":"2024-04-20T12:20:48.323689+0000","last_fullsized":"2024-04-20T12:20:48.323689+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:09:53.281163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320083+0000","last_change":"2024-04-20T12:20:42.030739+0000","last_active":"2024-04-20T12:20:48.320083+0000","last_peered":"2024-04-20T12:20:48.320083+0000","last_clean":"2024-04-20T12:20:48.320083+0000","last_became_active":"2024-04-20T12:20:42.030440+0000","last_became_peered":"2024-04-20T12:20:42.030440+0000","last_unstale":"2024-04-20T12:20:48.320083+0000","last_undegraded":"2024-04-20T12:20:48.320083+0000","last_fullsized":"2024-04-20T12:20:48.320083+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:44:39.311317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:06.922716+0000","last_change":"2024-04-20T12:20:41.029967+0000","last_active":"2024-04-20T12:21:06.922716+0000","last_peered":"2024-04-20T12:21:06.922716+0000","last_clean":"2024-04-20T12:21:06.922716+0000","last_became_active":"2024-04-20T12:20:41.029618+0000","last_became_peered":"2024-04-20T12:20:41.029618+0000","last_unstale":"2024-04-20T12:21:06.922716+0000","last_undegraded":"2024-04-20T12:21:06.922716+0000","last_fullsized":"2024-04-20T12:21:06.922716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:48.762751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839241+0000","last_change":"2024-04-20T12:20:46.327782+0000","last_active":"2024-04-20T12:20:48.839241+0000","last_peered":"2024-04-20T12:20:48.839241+0000","last_clean":"2024-04-20T12:20:48.839241+0000","last_became_active":"2024-04-20T12:20:46.325462+0000","last_became_peered":"2024-04-20T12:20:46.325462+0000","last_unstale":"2024-04-20T12:20:48.839241+0000","last_undegraded":"2024-04-20T12:20:48.839241+0000","last_fullsized":"2024-04-20T12:20:48.839241+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:41.792496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:08.309444+0000","last_change":"2024-04-20T12:20:41.025454+0000","last_active":"2024-04-20T12:21:08.309444+0000","last_peered":"2024-04-20T12:21:08.309444+0000","last_clean":"2024-04-20T12:21:08.309444+0000","last_became_active":"2024-04-20T12:20:41.025121+0000","last_became_peered":"2024-04-20T12:20:41.025121+0000","last_unstale":"2024-04-20T12:21:08.309444+0000","last_undegraded":"2024-04-20T12:21:08.309444+0000","last_fullsized":"2024-04-20T12:21:08.309444+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:57:14.662567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320633+0000","last_change":"2024-04-20T12:20:42.038483+0000","last_active":"2024-04-20T12:20:48.320633+0000","last_peered":"2024-04-20T12:20:48.320633+0000","last_clean":"2024-04-20T12:20:48.320633+0000","last_became_active":"2024-04-20T12:20:42.037626+0000","last_became_peered":"2024-04-20T12:20:42.037626+0000","last_unstale":"2024-04-20T12:20:48.320633+0000","last_undegraded":"2024-04-20T12:20:48.320633+0000","last_fullsized":"2024-04-20T12:20:48.320633+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:11:27.520320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838674+0000","last_change":"2024-04-20T12:20:46.930331+0000","last_active":"2024-04-20T12:20:48.838674+0000","last_peered":"2024-04-20T12:20:48.838674+0000","last_clean":"2024-04-20T12:20:48.838674+0000","last_became_active":"2024-04-20T12:20:46.929816+0000","last_became_peered":"2024-04-20T12:20:46.929816+0000","last_unstale":"2024-04-20T12:20:48.838674+0000","last_undegraded":"2024-04-20T12:20:48.838674+0000","last_fullsized":"2024-04-20T12:20:48.838674+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:42:18.148443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'9","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:09.019780+0000","last_change":"2024-04-20T12:20:41.022365+0000","last_active":"2024-04-20T12:21:09.019780+0000","last_peered":"2024-04-20T12:21:09.019780+0000","last_clean":"2024-04-20T12:21:09.019780+0000","last_became_active":"2024-04-20T12:20:41.022028+0000","last_became_peered":"2024-04-20T12:20:41.022028+0000","last_unstale":"2024-04-20T12:21:09.019780+0000","last_undegraded":"2024-04-20T12:21:09.019780+0000","last_fullsized":"2024-04-20T12:21:09.019780+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:16.436008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839375+0000","last_change":"2024-04-20T12:20:42.031833+0000","last_active":"2024-04-20T12:20:48.839375+0000","last_peered":"2024-04-20T12:20:48.839375+0000","last_clean":"2024-04-20T12:20:48.839375+0000","last_became_active":"2024-04-20T12:20:42.031535+0000","last_became_peered":"2024-04-20T12:20:42.031535+0000","last_unstale":"2024-04-20T12:20:48.839375+0000","last_undegraded":"2024-04-20T12:20:48.839375+0000","last_fullsized":"2024-04-20T12:20:48.839375+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:39:38.955662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838816+0000","last_change":"2024-04-20T12:20:46.319218+0000","last_active":"2024-04-20T12:20:48.838816+0000","last_peered":"2024-04-20T12:20:48.838816+0000","last_clean":"2024-04-20T12:20:48.838816+0000","last_became_active":"2024-04-20T12:20:46.318822+0000","last_became_peered":"2024-04-20T12:20:46.318822+0000","last_unstale":"2024-04-20T12:20:48.838816+0000","last_undegraded":"2024-04-20T12:20:48.838816+0000","last_fullsized":"2024-04-20T12:20:48.838816+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:19:16.907942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:05.912266+0000","last_change":"2024-04-20T12:20:41.035984+0000","last_active":"2024-04-20T12:21:05.912266+0000","last_peered":"2024-04-20T12:21:05.912266+0000","last_clean":"2024-04-20T12:21:05.912266+0000","last_became_active":"2024-04-20T12:20:41.035594+0000","last_became_peered":"2024-04-20T12:20:41.035594+0000","last_unstale":"2024-04-20T12:21:05.912266+0000","last_undegraded":"2024-04-20T12:21:05.912266+0000","last_fullsized":"2024-04-20T12:21:05.912266+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:15.549551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838129+0000","last_change":"2024-04-20T12:20:42.032156+0000","last_active":"2024-04-20T12:20:48.838129+0000","last_peered":"2024-04-20T12:20:48.838129+0000","last_clean":"2024-04-20T12:20:48.838129+0000","last_became_active":"2024-04-20T12:20:42.031779+0000","last_became_peered":"2024-04-20T12:20:42.031779+0000","last_unstale":"2024-04-20T12:20:48.838129+0000","last_undegraded":"2024-04-20T12:20:48.838129+0000","last_fullsized":"2024-04-20T12:20:48.838129+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:43:48.156406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839843+0000","last_change":"2024-04-20T12:20:46.931229+0000","last_active":"2024-04-20T12:20:48.839843+0000","last_peered":"2024-04-20T12:20:48.839843+0000","last_clean":"2024-04-20T12:20:48.839843+0000","last_became_active":"2024-04-20T12:20:46.930677+0000","last_became_peered":"2024-04-20T12:20:46.930677+0000","last_unstale":"2024-04-20T12:20:48.839843+0000","last_undegraded":"2024-04-20T12:20:48.839843+0000","last_fullsized":"2024-04-20T12:20:48.839843+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:54.933944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:05.912431+0000","last_change":"2024-04-20T12:20:41.023789+0000","last_active":"2024-04-20T12:21:05.912431+0000","last_peered":"2024-04-20T12:21:05.912431+0000","last_clean":"2024-04-20T12:21:05.912431+0000","last_became_active":"2024-04-20T12:20:41.023329+0000","last_became_peered":"2024-04-20T12:20:41.023329+0000","last_unstale":"2024-04-20T12:21:05.912431+0000","last_undegraded":"2024-04-20T12:21:05.912431+0000","last_fullsized":"2024-04-20T12:21:05.912431+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:02:17.634230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837772+0000","last_change":"2024-04-20T12:20:42.028708+0000","last_active":"2024-04-20T12:20:48.837772+0000","last_peered":"2024-04-20T12:20:48.837772+0000","last_clean":"2024-04-20T12:20:48.837772+0000","last_became_active":"2024-04-20T12:20:42.028358+0000","last_became_peered":"2024-04-20T12:20:42.028358+0000","last_unstale":"2024-04-20T12:20:48.837772+0000","last_undegraded":"2024-04-20T12:20:48.837772+0000","last_fullsized":"2024-04-20T12:20:48.837772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:21:58.583709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.797336+0000","last_change":"2024-04-20T12:20:46.329173+0000","last_active":"2024-04-20T12:20:48.797336+0000","last_peered":"2024-04-20T12:20:48.797336+0000","last_clean":"2024-04-20T12:20:48.797336+0000","last_became_active":"2024-04-20T12:20:46.328771+0000","last_became_peered":"2024-04-20T12:20:46.328771+0000","last_unstale":"2024-04-20T12:20:48.797336+0000","last_undegraded":"2024-04-20T12:20:48.797336+0000","last_fullsized":"2024-04-20T12:20:48.797336+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:43:57.796849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:05.913353+0000","last_change":"2024-04-20T12:20:41.030389+0000","last_active":"2024-04-20T12:21:05.913353+0000","last_peered":"2024-04-20T12:21:05.913353+0000","last_clean":"2024-04-20T12:21:05.913353+0000","last_became_active":"2024-04-20T12:20:41.029864+0000","last_became_peered":"2024-04-20T12:20:41.029864+0000","last_unstale":"2024-04-20T12:21:05.913353+0000","last_undegraded":"2024-04-20T12:21:05.913353+0000","last_fullsized":"2024-04-20T12:21:05.913353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:01:13.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838858+0000","last_change":"2024-04-20T12:20:42.032322+0000","last_active":"2024-04-20T12:20:48.838858+0000","last_peered":"2024-04-20T12:20:48.838858+0000","last_clean":"2024-04-20T12:20:48.838858+0000","last_became_active":"2024-04-20T12:20:42.031973+0000","last_became_peered":"2024-04-20T12:20:42.031973+0000","last_unstale":"2024-04-20T12:20:48.838858+0000","last_undegraded":"2024-04-20T12:20:48.838858+0000","last_fullsized":"2024-04-20T12:20:48.838858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:44:17.135478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839839+0000","last_change":"2024-04-20T12:20:46.321909+0000","last_active":"2024-04-20T12:20:48.839839+0000","last_peered":"2024-04-20T12:20:48.839839+0000","last_clean":"2024-04-20T12:20:48.839839+0000","last_became_active":"2024-04-20T12:20:46.321273+0000","last_became_peered":"2024-04-20T12:20:46.321273+0000","last_unstale":"2024-04-20T12:20:48.839839+0000","last_undegraded":"2024-04-20T12:20:48.839839+0000","last_fullsized":"2024-04-20T12:20:48.839839+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:58:18.429052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838212+0000","last_change":"2024-04-20T12:20:41.030400+0000","last_active":"2024-04-20T12:20:48.838212+0000","last_peered":"2024-04-20T12:20:48.838212+0000","last_clean":"2024-04-20T12:20:48.838212+0000","last_became_active":"2024-04-20T12:20:41.030049+0000","last_became_peered":"2024-04-20T12:20:41.030049+0000","last_unstale":"2024-04-20T12:20:48.838212+0000","last_undegraded":"2024-04-20T12:20:48.838212+0000","last_fullsized":"2024-04-20T12:20:48.838212+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:25:31.789054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839141+0000","last_change":"2024-04-20T12:20:42.037258+0000","last_active":"2024-04-20T12:20:48.839141+0000","last_peered":"2024-04-20T12:20:48.839141+0000","last_clean":"2024-04-20T12:20:48.839141+0000","last_became_active":"2024-04-20T12:20:42.036755+0000","last_became_peered":"2024-04-20T12:20:42.036755+0000","last_unstale":"2024-04-20T12:20:48.839141+0000","last_undegraded":"2024-04-20T12:20:48.839141+0000","last_fullsized":"2024-04-20T12:20:48.839141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:23:17.093038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839993+0000","last_change":"2024-04-20T12:20:46.929829+0000","last_active":"2024-04-20T12:20:48.839993+0000","last_peered":"2024-04-20T12:20:48.839993+0000","last_clean":"2024-04-20T12:20:48.839993+0000","last_became_active":"2024-04-20T12:20:46.929296+0000","last_became_peered":"2024-04-20T12:20:46.929296+0000","last_unstale":"2024-04-20T12:20:48.839993+0000","last_undegraded":"2024-04-20T12:20:48.839993+0000","last_fullsized":"2024-04-20T12:20:48.839993+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:30.700141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:05.913771+0000","last_change":"2024-04-20T12:20:41.027753+0000","last_active":"2024-04-20T12:21:05.913771+0000","last_peered":"2024-04-20T12:21:05.913771+0000","last_clean":"2024-04-20T12:21:05.913771+0000","last_became_active":"2024-04-20T12:20:41.027360+0000","last_became_peered":"2024-04-20T12:20:41.027360+0000","last_unstale":"2024-04-20T12:21:05.913771+0000","last_undegraded":"2024-04-20T12:21:05.913771+0000","last_fullsized":"2024-04-20T12:21:05.913771+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:30:59.710541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320879+0000","last_change":"2024-04-20T12:20:42.029409+0000","last_active":"2024-04-20T12:20:48.320879+0000","last_peered":"2024-04-20T12:20:48.320879+0000","last_clean":"2024-04-20T12:20:48.320879+0000","last_became_active":"2024-04-20T12:20:42.029062+0000","last_became_peered":"2024-04-20T12:20:42.029062+0000","last_unstale":"2024-04-20T12:20:48.320879+0000","last_undegraded":"2024-04-20T12:20:48.320879+0000","last_fullsized":"2024-04-20T12:20:48.320879+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:47:33.412087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838967+0000","last_change":"2024-04-20T12:20:46.326605+0000","last_active":"2024-04-20T12:20:48.838967+0000","last_peered":"2024-04-20T12:20:48.838967+0000","last_clean":"2024-04-20T12:20:48.838967+0000","last_became_active":"2024-04-20T12:20:46.326162+0000","last_became_peered":"2024-04-20T12:20:46.326162+0000","last_unstale":"2024-04-20T12:20:48.838967+0000","last_undegraded":"2024-04-20T12:20:48.838967+0000","last_fullsized":"2024-04-20T12:20:48.838967+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:44:37.344357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:21:06.924021+0000","last_change":"2024-04-20T12:20:41.035324+0000","last_active":"2024-04-20T12:21:06.924021+0000","last_peered":"2024-04-20T12:21:06.924021+0000","last_clean":"2024-04-20T12:21:06.924021+0000","last_became_active":"2024-04-20T12:20:41.034996+0000","last_became_peered":"2024-04-20T12:20:41.034996+0000","last_unstale":"2024-04-20T12:21:06.924021+0000","last_undegraded":"2024-04-20T12:21:06.924021+0000","last_fullsized":"2024-04-20T12:21:06.924021+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:33.788405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.321332+0000","last_change":"2024-04-20T12:20:42.028803+0000","last_active":"2024-04-20T12:20:48.321332+0000","last_peered":"2024-04-20T12:20:48.321332+0000","last_clean":"2024-04-20T12:20:48.321332+0000","last_became_active":"2024-04-20T12:20:42.028316+0000","last_became_peered":"2024-04-20T12:20:42.028316+0000","last_unstale":"2024-04-20T12:20:48.321332+0000","last_undegraded":"2024-04-20T12:20:48.321332+0000","last_fullsized":"2024-04-20T12:20:48.321332+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:09.000315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838376+0000","last_change":"2024-04-20T12:20:46.328502+0000","last_active":"2024-04-20T12:20:48.838376+0000","last_peered":"2024-04-20T12:20:48.838376+0000","last_clean":"2024-04-20T12:20:48.838376+0000","last_became_active":"2024-04-20T12:20:46.328106+0000","last_became_peered":"2024-04-20T12:20:46.328106+0000","last_unstale":"2024-04-20T12:20:48.838376+0000","last_undegraded":"2024-04-20T12:20:48.838376+0000","last_fullsized":"2024-04-20T12:20:48.838376+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:06:30.041621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.324096+0000","last_change":"2024-04-20T12:20:41.023918+0000","last_active":"2024-04-20T12:20:48.324096+0000","last_peered":"2024-04-20T12:20:48.324096+0000","last_clean":"2024-04-20T12:20:48.324096+0000","last_became_active":"2024-04-20T12:20:41.023088+0000","last_became_peered":"2024-04-20T12:20:41.023088+0000","last_unstale":"2024-04-20T12:20:48.324096+0000","last_undegraded":"2024-04-20T12:20:48.324096+0000","last_fullsized":"2024-04-20T12:20:48.324096+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:15:03.220660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.321077+0000","last_change":"2024-04-20T12:20:42.038981+0000","last_active":"2024-04-20T12:20:48.321077+0000","last_peered":"2024-04-20T12:20:48.321077+0000","last_clean":"2024-04-20T12:20:48.321077+0000","last_became_active":"2024-04-20T12:20:42.038656+0000","last_became_peered":"2024-04-20T12:20:42.038656+0000","last_unstale":"2024-04-20T12:20:48.321077+0000","last_undegraded":"2024-04-20T12:20:48.321077+0000","last_fullsized":"2024-04-20T12:20:48.321077+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:51:08.446546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323308+0000","last_change":"2024-04-20T12:20:46.323446+0000","last_active":"2024-04-20T12:20:48.323308+0000","last_peered":"2024-04-20T12:20:48.323308+0000","last_clean":"2024-04-20T12:20:48.323308+0000","last_became_active":"2024-04-20T12:20:46.322259+0000","last_became_peered":"2024-04-20T12:20:46.322259+0000","last_unstale":"2024-04-20T12:20:48.323308+0000","last_undegraded":"2024-04-20T12:20:48.323308+0000","last_fullsized":"2024-04-20T12:20:48.323308+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:01:11.833469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320649+0000","last_change":"2024-04-20T12:20:41.029995+0000","last_active":"2024-04-20T12:20:48.320649+0000","last_peered":"2024-04-20T12:20:48.320649+0000","last_clean":"2024-04-20T12:20:48.320649+0000","last_became_active":"2024-04-20T12:20:41.029650+0000","last_became_peered":"2024-04-20T12:20:41.029650+0000","last_unstale":"2024-04-20T12:20:48.320649+0000","last_undegraded":"2024-04-20T12:20:48.320649+0000","last_fullsized":"2024-04-20T12:20:48.320649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:24:54.522855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.321335+0000","last_change":"2024-04-20T12:20:42.030357+0000","last_active":"2024-04-20T12:20:48.321335+0000","last_peered":"2024-04-20T12:20:48.321335+0000","last_clean":"2024-04-20T12:20:48.321335+0000","last_became_active":"2024-04-20T12:20:42.029966+0000","last_became_peered":"2024-04-20T12:20:42.029966+0000","last_unstale":"2024-04-20T12:20:48.321335+0000","last_undegraded":"2024-04-20T12:20:48.321335+0000","last_fullsized":"2024-04-20T12:20:48.321335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:35:09.487965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838955+0000","last_change":"2024-04-20T12:20:42.036914+0000","last_active":"2024-04-20T12:20:48.838955+0000","last_peered":"2024-04-20T12:20:48.838955+0000","last_clean":"2024-04-20T12:20:48.838955+0000","last_became_active":"2024-04-20T12:20:42.036434+0000","last_became_peered":"2024-04-20T12:20:42.036434+0000","last_unstale":"2024-04-20T12:20:48.838955+0000","last_undegraded":"2024-04-20T12:20:48.838955+0000","last_fullsized":"2024-04-20T12:20:48.838955+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.552096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838976+0000","last_change":"2024-04-20T12:20:42.040424+0000","last_active":"2024-04-20T12:20:48.838976+0000","last_peered":"2024-04-20T12:20:48.838976+0000","last_clean":"2024-04-20T12:20:48.838976+0000","last_became_active":"2024-04-20T12:20:42.040095+0000","last_became_peered":"2024-04-20T12:20:42.040095+0000","last_unstale":"2024-04-20T12:20:48.838976+0000","last_undegraded":"2024-04-20T12:20:48.838976+0000","last_fullsized":"2024-04-20T12:20:48.838976+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:24.669083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838062+0000","last_change":"2024-04-20T12:20:42.037764+0000","last_active":"2024-04-20T12:20:48.838062+0000","last_peered":"2024-04-20T12:20:48.838062+0000","last_clean":"2024-04-20T12:20:48.838062+0000","last_became_active":"2024-04-20T12:20:42.037389+0000","last_became_peered":"2024-04-20T12:20:42.037389+0000","last_unstale":"2024-04-20T12:20:48.838062+0000","last_undegraded":"2024-04-20T12:20:48.838062+0000","last_fullsized":"2024-04-20T12:20:48.838062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:20.284714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.837963+0000","last_change":"2024-04-20T12:20:42.027546+0000","last_active":"2024-04-20T12:20:48.837963+0000","last_peered":"2024-04-20T12:20:48.837963+0000","last_clean":"2024-04-20T12:20:48.837963+0000","last_became_active":"2024-04-20T12:20:42.027229+0000","last_became_peered":"2024-04-20T12:20:42.027229+0000","last_unstale":"2024-04-20T12:20:48.837963+0000","last_undegraded":"2024-04-20T12:20:48.837963+0000","last_fullsized":"2024-04-20T12:20:48.837963+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:22.649256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320549+0000","last_change":"2024-04-20T12:20:42.024971+0000","last_active":"2024-04-20T12:20:48.320549+0000","last_peered":"2024-04-20T12:20:48.320549+0000","last_clean":"2024-04-20T12:20:48.320549+0000","last_became_active":"2024-04-20T12:20:42.024607+0000","last_became_peered":"2024-04-20T12:20:42.024607+0000","last_unstale":"2024-04-20T12:20:48.320549+0000","last_undegraded":"2024-04-20T12:20:48.320549+0000","last_fullsized":"2024-04-20T12:20:48.320549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:15:56.160140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839634+0000","last_change":"2024-04-20T12:20:42.036699+0000","last_active":"2024-04-20T12:20:48.839634+0000","last_peered":"2024-04-20T12:20:48.839634+0000","last_clean":"2024-04-20T12:20:48.839634+0000","last_became_active":"2024-04-20T12:20:42.036355+0000","last_became_peered":"2024-04-20T12:20:42.036355+0000","last_unstale":"2024-04-20T12:20:48.839634+0000","last_undegraded":"2024-04-20T12:20:48.839634+0000","last_fullsized":"2024-04-20T12:20:48.839634+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:14:40.276148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.838432+0000","last_change":"2024-04-20T12:20:42.034906+0000","last_active":"2024-04-20T12:20:48.838432+0000","last_peered":"2024-04-20T12:20:48.838432+0000","last_clean":"2024-04-20T12:20:48.838432+0000","last_became_active":"2024-04-20T12:20:42.034572+0000","last_became_peered":"2024-04-20T12:20:42.034572+0000","last_unstale":"2024-04-20T12:20:48.838432+0000","last_undegraded":"2024-04-20T12:20:48.838432+0000","last_fullsized":"2024-04-20T12:20:48.838432+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:54.166032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839472+0000","last_change":"2024-04-20T12:20:42.041180+0000","last_active":"2024-04-20T12:20:48.839472+0000","last_peered":"2024-04-20T12:20:48.839472+0000","last_clean":"2024-04-20T12:20:48.839472+0000","last_became_active":"2024-04-20T12:20:42.040648+0000","last_became_peered":"2024-04-20T12:20:42.040648+0000","last_unstale":"2024-04-20T12:20:48.839472+0000","last_undegraded":"2024-04-20T12:20:48.839472+0000","last_fullsized":"2024-04-20T12:20:48.839472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:55:38.855441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.323420+0000","last_change":"2024-04-20T12:20:42.030153+0000","last_active":"2024-04-20T12:20:48.323420+0000","last_peered":"2024-04-20T12:20:48.323420+0000","last_clean":"2024-04-20T12:20:48.323420+0000","last_became_active":"2024-04-20T12:20:42.029796+0000","last_became_peered":"2024-04-20T12:20:42.029796+0000","last_unstale":"2024-04-20T12:20:48.323420+0000","last_undegraded":"2024-04-20T12:20:48.323420+0000","last_fullsized":"2024-04-20T12:20:48.323420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:50.676958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839068+0000","last_change":"2024-04-20T12:20:42.039864+0000","last_active":"2024-04-20T12:20:48.839068+0000","last_peered":"2024-04-20T12:20:48.839068+0000","last_clean":"2024-04-20T12:20:48.839068+0000","last_became_active":"2024-04-20T12:20:42.036624+0000","last_became_peered":"2024-04-20T12:20:42.036624+0000","last_unstale":"2024-04-20T12:20:48.839068+0000","last_undegraded":"2024-04-20T12:20:48.839068+0000","last_fullsized":"2024-04-20T12:20:48.839068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:13.271749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839182+0000","last_change":"2024-04-20T12:20:42.033628+0000","last_active":"2024-04-20T12:20:48.839182+0000","last_peered":"2024-04-20T12:20:48.839182+0000","last_clean":"2024-04-20T12:20:48.839182+0000","last_became_active":"2024-04-20T12:20:42.033296+0000","last_became_peered":"2024-04-20T12:20:42.033296+0000","last_unstale":"2024-04-20T12:20:48.839182+0000","last_undegraded":"2024-04-20T12:20:48.839182+0000","last_fullsized":"2024-04-20T12:20:48.839182+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:16:16.029327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.320358+0000","last_change":"2024-04-20T12:20:42.024730+0000","last_active":"2024-04-20T12:20:48.320358+0000","last_peered":"2024-04-20T12:20:48.320358+0000","last_clean":"2024-04-20T12:20:48.320358+0000","last_became_active":"2024-04-20T12:20:42.024400+0000","last_became_peered":"2024-04-20T12:20:42.024400+0000","last_unstale":"2024-04-20T12:20:48.320358+0000","last_undegraded":"2024-04-20T12:20:48.320358+0000","last_fullsized":"2024-04-20T12:20:48.320358+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:27:41.514880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-20T12:20:48.839359+0000","last_change":"2024-04-20T12:20:42.033623+0000","last_active":"2024-04-20T12:20:48.839359+0000","last_peered":"2024-04-20T12:20:48.839359+0000","last_clean":"2024-04-20T12:20:48.839359+0000","last_became_active":"2024-04-20T12:20:42.033105+0000","last_became_peered":"2024-04-20T12:20:42.033105+0000","last_unstale":"2024-04-20T12:20:48.839359+0000","last_undegraded":"2024-04-20T12:20:48.839359+0000","last_fullsized":"2024-04-20T12:20:48.839359+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:01.121977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":279778,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44843,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":26,"num_read_kb":60,"num_write":175,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":348160,"data_stored":69081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383698,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":487204,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645335,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32268,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712884,"statfs":{"total":95995035648,"available":95961993216,"internally_reserved":0,"allocated":1118208,"data_stored":1119197,"data_compressed":53188,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":495936,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070498,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":488122,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332135,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1040384,"data_stored":1078782,"data_compressed":53188,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495659,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":486622,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":498816,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1015808,"data_stored":488800,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":999424,"data_stored":491120,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":983040,"data_stored":486726,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920822,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":978944,"data_stored":486644,"data_compressed":17600,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757297,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":1078466,"data_compressed":53188,"data_compressed_allocated":69632,"data_compressed_original":638976,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33946,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33946,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33946,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":12194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":42207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T12:21:11.057 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-20T12:21:11.057 INFO:tasks.cephadm:Setting up client nodes... 2024-04-20T12:21:11.057 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-20T12:21:11.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:10 smithi154 ceph-mon[22073]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:21:11.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:10 smithi154 ceph-mon[22073]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:21:11.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:10 smithi154 ceph-mon[22073]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:21:11.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:10 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3139699798' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:21:11.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:10 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1531000876' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:21:11.329 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:11.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:10 smithi139 ceph-mon[21834]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:21:11.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:10 smithi139 ceph-mon[21834]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:21:11.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:10 smithi139 ceph-mon[21834]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:21:11.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:10 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3139699798' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:21:11.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:10 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1531000876' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:21:12.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:11 smithi135 ceph-mon[18264]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:21:12.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:11 smithi135 ceph-mon[18264]: pgmap v307: 129 pgs: 129 active+clean; 620 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2024-04-20T12:21:12.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:11 smithi135 ceph-mon[18264]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:21:12.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:11 smithi154 ceph-mon[22073]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:21:12.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:11 smithi154 ceph-mon[22073]: pgmap v307: 129 pgs: 129 active+clean; 620 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2024-04-20T12:21:12.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:11 smithi154 ceph-mon[22073]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:21:12.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:11 smithi139 ceph-mon[21834]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:21:12.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:11 smithi139 ceph-mon[21834]: pgmap v307: 129 pgs: 129 active+clean; 620 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2024-04-20T12:21:12.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:11 smithi139 ceph-mon[21834]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:21:13.041 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:12 smithi135 ceph-mon[18264]: pgmap v308: 129 pgs: 129 active+clean; 622 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.5 KiB/s wr, 19 op/s 2024-04-20T12:21:13.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.078+0000 7f36a16c3700 1 -- 172.21.15.135:0/1545376730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f369c103630 msgr2=0x7f369c105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:13.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.078+0000 7f36a16c3700 1 --2- 172.21.15.135:0/1545376730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f369c103630 0x7f369c105a20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3690009990 tx=0x7f3690009ca0 comp rx=0 tx=0).stop 2024-04-20T12:21:13.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.078+0000 7f36a16c3700 1 -- 172.21.15.135:0/1545376730 shutdown_connections 2024-04-20T12:21:13.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.078+0000 7f36a16c3700 1 --2- 172.21.15.135:0/1545376730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f369c108890 0x7f369c10ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:13.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.078+0000 7f36a16c3700 1 --2- 172.21.15.135:0/1545376730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f369c103630 0x7f369c105a20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:13.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.078+0000 7f36a16c3700 1 --2- 172.21.15.135:0/1545376730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c105f60 0x7f369c108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:13.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.078+0000 7f36a16c3700 1 -- 172.21.15.135:0/1545376730 >> 172.21.15.135:0/1545376730 conn(0x7f369c0fcfa0 msgr2=0x7f369c0ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:13.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.078+0000 7f36a16c3700 1 -- 172.21.15.135:0/1545376730 shutdown_connections 2024-04-20T12:21:13.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.078+0000 7f36a16c3700 1 -- 172.21.15.135:0/1545376730 wait complete. 2024-04-20T12:21:13.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.079+0000 7f36a16c3700 1 Processor -- start 2024-04-20T12:21:13.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.079+0000 7f36a16c3700 1 -- start start 2024-04-20T12:21:13.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.079+0000 7f36a16c3700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f369c103630 0x7f369c198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:13.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.079+0000 7f36a16c3700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f369c105f60 0x7f369c199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:13.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.079+0000 7f36a16c3700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c108890 0x7f369c1a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:13.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.079+0000 7f36a16c3700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f369c10e700 con 0x7f369c103630 2024-04-20T12:21:13.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.079+0000 7f36a16c3700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f369c10e580 con 0x7f369c105f60 2024-04-20T12:21:13.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.079+0000 7f36a16c3700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f369c10e880 con 0x7f369c108890 2024-04-20T12:21:13.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.079+0000 7f369affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f369c103630 0x7f369c198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:13.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.079+0000 7f369affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f369c103630 0x7f369c198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43580/0 (socket says 172.21.15.135:43580) 2024-04-20T12:21:13.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.079+0000 7f369affd700 1 -- 172.21.15.135:0/3019109385 learned_addr learned my addr 172.21.15.135:0/3019109385 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:13.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.079+0000 7f369a7fc700 1 --2- 172.21.15.135:0/3019109385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f369c105f60 0x7f369c199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:13.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.080+0000 7f369b7fe700 1 --2- 172.21.15.135:0/3019109385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c108890 0x7f369c1a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:13.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.080+0000 7f369affd700 1 -- 172.21.15.135:0/3019109385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c108890 msgr2=0x7f369c1a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:13.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.080+0000 7f369affd700 1 --2- 172.21.15.135:0/3019109385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c108890 0x7f369c1a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:13.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.080+0000 7f369affd700 1 -- 172.21.15.135:0/3019109385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f369c105f60 msgr2=0x7f369c199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:13.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.080+0000 7f369affd700 1 --2- 172.21.15.135:0/3019109385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f369c105f60 0x7f369c199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:13.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.080+0000 7f369affd700 1 -- 172.21.15.135:0/3019109385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c1a0830 con 0x7f369c103630 2024-04-20T12:21:13.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.080+0000 7f369a7fc700 1 --2- 172.21.15.135:0/3019109385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f369c105f60 0x7f369c199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:21:13.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.080+0000 7f369affd700 1 --2- 172.21.15.135:0/3019109385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f369c103630 0x7f369c198bd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f36900047b0 tx=0x7f3690003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:13.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.080+0000 7f3683fff700 1 -- 172.21.15.135:0/3019109385 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690027070 con 0x7f369c103630 2024-04-20T12:21:13.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.080+0000 7f36a16c3700 1 -- 172.21.15.135:0/3019109385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f369c1a0ac0 con 0x7f369c103630 2024-04-20T12:21:13.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.080+0000 7f3683fff700 1 -- 172.21.15.135:0/3019109385 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3690022470 con 0x7f369c103630 2024-04-20T12:21:13.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.080+0000 7f3683fff700 1 -- 172.21.15.135:0/3019109385 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369000f6c0 con 0x7f369c103630 2024-04-20T12:21:13.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.080+0000 7f36a16c3700 1 -- 172.21.15.135:0/3019109385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f369c1a0fa0 con 0x7f369c103630 2024-04-20T12:21:13.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.081+0000 7f36a16c3700 1 -- 172.21.15.135:0/3019109385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f369c050f90 con 0x7f369c103630 2024-04-20T12:21:13.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.082+0000 7f3683fff700 1 -- 172.21.15.135:0/3019109385 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f369002a070 con 0x7f369c103630 2024-04-20T12:21:13.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.082+0000 7f3683fff700 1 --2- 172.21.15.135:0/3019109385 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f36840a3d80 0x7f36840a6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:13.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.083+0000 7f369a7fc700 1 --2- 172.21.15.135:0/3019109385 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f36840a3d80 0x7f36840a6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:13.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.083+0000 7f3683fff700 1 -- 172.21.15.135:0/3019109385 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f36900d1920 con 0x7f369c103630 2024-04-20T12:21:13.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.083+0000 7f369a7fc700 1 --2- 172.21.15.135:0/3019109385 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f36840a3d80 0x7f36840a6240 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f368c0099d0 tx=0x7f368c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:13.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.087+0000 7f3683fff700 1 -- 172.21.15.135:0/3019109385 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f369005eff0 con 0x7f369c103630 2024-04-20T12:21:13.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:12 smithi154 ceph-mon[22073]: pgmap v308: 129 pgs: 129 active+clean; 622 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.5 KiB/s wr, 19 op/s 2024-04-20T12:21:13.252 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:21:12 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i[52605]: 2024-04-20T12:21:12.897+0000 7fd893c5c700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-04-20T12:21:13.252 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:21:12 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i[52605]: 2024-04-20T12:21:12.897+0000 7fd893c5c700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-04-20T12:21:13.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:12 smithi139 ceph-mon[21834]: pgmap v308: 129 pgs: 129 active+clean; 622 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.5 KiB/s wr, 19 op/s 2024-04-20T12:21:13.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.368+0000 7f36a16c3700 1 -- 172.21.15.135:0/3019109385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f369c02df90 con 0x7f369c103630 2024-04-20T12:21:13.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.370+0000 7f3683fff700 1 -- 172.21.15.135:0/3019109385 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f3690013070 con 0x7f369c103630 2024-04-20T12:21:13.369 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2024-04-20T12:21:13.369 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQA5syNmZcz7FRAAM8vJVqeuaIJQEZ5oFH3vCg== 2024-04-20T12:21:13.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.372+0000 7f36a16c3700 1 -- 172.21.15.135:0/3019109385 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f36840a3d80 msgr2=0x7f36840a6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:13.371 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.372+0000 7f36a16c3700 1 --2- 172.21.15.135:0/3019109385 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f36840a3d80 0x7f36840a6240 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f368c0099d0 tx=0x7f368c008040 comp rx=0 tx=0).stop 2024-04-20T12:21:13.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.372+0000 7f36a16c3700 1 -- 172.21.15.135:0/3019109385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f369c103630 msgr2=0x7f369c198bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:13.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.372+0000 7f36a16c3700 1 --2- 172.21.15.135:0/3019109385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f369c103630 0x7f369c198bd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f36900047b0 tx=0x7f3690003680 comp rx=0 tx=0).stop 2024-04-20T12:21:13.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.372+0000 7f36a16c3700 1 -- 172.21.15.135:0/3019109385 shutdown_connections 2024-04-20T12:21:13.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.372+0000 7f36a16c3700 1 --2- 172.21.15.135:0/3019109385 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f36840a3d80 0x7f36840a6240 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:13.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.373+0000 7f36a16c3700 1 --2- 172.21.15.135:0/3019109385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f369c108890 0x7f369c1a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:13.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.373+0000 7f36a16c3700 1 --2- 172.21.15.135:0/3019109385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f369c103630 0x7f369c198bd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:13.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.373+0000 7f36a16c3700 1 --2- 172.21.15.135:0/3019109385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f369c105f60 0x7f369c199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:13.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.373+0000 7f36a16c3700 1 -- 172.21.15.135:0/3019109385 >> 172.21.15.135:0/3019109385 conn(0x7f369c0fcfa0 msgr2=0x7f369c103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:13.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.373+0000 7f36a16c3700 1 -- 172.21.15.135:0/3019109385 shutdown_connections 2024-04-20T12:21:13.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:13.373+0000 7f36a16c3700 1 -- 172.21.15.135:0/3019109385 wait complete. 2024-04-20T12:21:14.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:13 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3019109385' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-20T12:21:14.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:13 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3019109385' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-20T12:21:14.150 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:21:14.150 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-20T12:21:14.151 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-20T12:21:14.188 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-20T12:21:14.188 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-20T12:21:14.189 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph mgr dump --format=json 2024-04-20T12:21:14.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:13 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3019109385' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-20T12:21:14.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:13 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3019109385' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-20T12:21:14.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:13 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3019109385' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-20T12:21:14.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:13 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3019109385' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-20T12:21:14.470 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:14 smithi135 ceph-mon[18264]: pgmap v309: 129 pgs: 129 active+clean; 623 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.7 KiB/s wr, 20 op/s 2024-04-20T12:21:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:14 smithi154 ceph-mon[22073]: pgmap v309: 129 pgs: 129 active+clean; 623 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.7 KiB/s wr, 20 op/s 2024-04-20T12:21:15.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:14 smithi139 ceph-mon[21834]: pgmap v309: 129 pgs: 129 active+clean; 623 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.7 KiB/s wr, 20 op/s 2024-04-20T12:21:16.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.192+0000 7f52070ab700 1 -- 172.21.15.135:0/2521036788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5200074c80 msgr2=0x7f5200075060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:16.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.192+0000 7f52070ab700 1 --2- 172.21.15.135:0/2521036788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5200074c80 0x7f5200075060 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009990 tx=0x7f51f4009ca0 comp rx=0 tx=0).stop 2024-04-20T12:21:16.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.192+0000 7f52070ab700 1 -- 172.21.15.135:0/2521036788 shutdown_connections 2024-04-20T12:21:16.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.192+0000 7f52070ab700 1 --2- 172.21.15.135:0/2521036788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f520010f450 0x7f5200111840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:16.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.192+0000 7f52070ab700 1 --2- 172.21.15.135:0/2521036788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5200074c80 0x7f5200075060 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:16.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.192+0000 7f52070ab700 1 --2- 172.21.15.135:0/2521036788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f52000755a0 0x7f520010ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:16.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.192+0000 7f52070ab700 1 -- 172.21.15.135:0/2521036788 >> 172.21.15.135:0/2521036788 conn(0x7f5200079bb0 msgr2=0x7f5200079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:16.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.192+0000 7f52070ab700 1 -- 172.21.15.135:0/2521036788 shutdown_connections 2024-04-20T12:21:16.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.192+0000 7f52070ab700 1 -- 172.21.15.135:0/2521036788 wait complete. 2024-04-20T12:21:16.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.192+0000 7f52070ab700 1 Processor -- start 2024-04-20T12:21:16.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.192+0000 7f52070ab700 1 -- start start 2024-04-20T12:21:16.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f52070ab700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5200074c80 0x7f520019b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:16.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f52070ab700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52000755a0 0x7f520019b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:16.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f52070ab700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f520010f450 0x7f520019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:16.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f52070ab700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5200114f80 con 0x7f5200074c80 2024-04-20T12:21:16.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f52070ab700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5200114e00 con 0x7f520010f450 2024-04-20T12:21:16.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f52070ab700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5200115100 con 0x7f52000755a0 2024-04-20T12:21:16.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f5204e47700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5200074c80 0x7f520019b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:16.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f5204e47700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5200074c80 0x7f520019b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43604/0 (socket says 172.21.15.135:43604) 2024-04-20T12:21:16.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f5204e47700 1 -- 172.21.15.135:0/4141722322 learned_addr learned my addr 172.21.15.135:0/4141722322 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:16.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f51fffff700 1 --2- 172.21.15.135:0/4141722322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52000755a0 0x7f520019b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:16.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f5205648700 1 --2- 172.21.15.135:0/4141722322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f520010f450 0x7f520019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:16.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f5204e47700 1 -- 172.21.15.135:0/4141722322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52000755a0 msgr2=0x7f520019b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:16.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f5204e47700 1 --2- 172.21.15.135:0/4141722322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52000755a0 0x7f520019b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:16.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f5204e47700 1 -- 172.21.15.135:0/4141722322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f520010f450 msgr2=0x7f520019fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:16.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f5204e47700 1 --2- 172.21.15.135:0/4141722322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f520010f450 0x7f520019fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:16.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f5204e47700 1 -- 172.21.15.135:0/4141722322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52001a0400 con 0x7f5200074c80 2024-04-20T12:21:16.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f5205648700 1 --2- 172.21.15.135:0/4141722322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f520010f450 0x7f520019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:21:16.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f5204e47700 1 --2- 172.21.15.135:0/4141722322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5200074c80 0x7f520019b3f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f51f4000c00 tx=0x7f51f40047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:16.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.193+0000 7f51fdffb700 1 -- 172.21.15.135:0/4141722322 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f4027070 con 0x7f5200074c80 2024-04-20T12:21:16.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.194+0000 7f52070ab700 1 -- 172.21.15.135:0/4141722322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52001a0690 con 0x7f5200074c80 2024-04-20T12:21:16.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.194+0000 7f51fdffb700 1 -- 172.21.15.135:0/4141722322 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51f4003780 con 0x7f5200074c80 2024-04-20T12:21:16.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.194+0000 7f51fdffb700 1 -- 172.21.15.135:0/4141722322 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f4022dd0 con 0x7f5200074c80 2024-04-20T12:21:16.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.194+0000 7f52070ab700 1 -- 172.21.15.135:0/4141722322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52001a7f70 con 0x7f5200074c80 2024-04-20T12:21:16.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.195+0000 7f52070ab700 1 -- 172.21.15.135:0/4141722322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5200069740 con 0x7f5200074c80 2024-04-20T12:21:16.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.196+0000 7f51fdffb700 1 -- 172.21.15.135:0/4141722322 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f51f402a070 con 0x7f5200074c80 2024-04-20T12:21:16.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.196+0000 7f51fdffb700 1 --2- 172.21.15.135:0/4141722322 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f51f00a3cd0 0x7f51f00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:16.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.196+0000 7f51fffff700 1 --2- 172.21.15.135:0/4141722322 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f51f00a3cd0 0x7f51f00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:16.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.196+0000 7f51fdffb700 1 -- 172.21.15.135:0/4141722322 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f51f40d1460 con 0x7f5200074c80 2024-04-20T12:21:16.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.197+0000 7f51fffff700 1 --2- 172.21.15.135:0/4141722322 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f51f00a3cd0 0x7f51f00a6190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f52001110a0 tx=0x7f51ec0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:16.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.201+0000 7f51fdffb700 1 -- 172.21.15.135:0/4141722322 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f51f4013070 con 0x7f5200074c80 2024-04-20T12:21:16.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.461+0000 7f52070ab700 1 -- 172.21.15.135:0/4141722322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f520002df90 con 0x7f5200074c80 2024-04-20T12:21:16.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.466+0000 7f51fdffb700 1 -- 172.21.15.135:0/4141722322 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+265006 (secure 0 0 0) 0x7f51f409dbc0 con 0x7f5200074c80 2024-04-20T12:21:16.468 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:21:16.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.469+0000 7f52070ab700 1 -- 172.21.15.135:0/4141722322 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f51f00a3cd0 msgr2=0x7f51f00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:16.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.469+0000 7f52070ab700 1 --2- 172.21.15.135:0/4141722322 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f51f00a3cd0 0x7f51f00a6190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f52001110a0 tx=0x7f51ec0073d0 comp rx=0 tx=0).stop 2024-04-20T12:21:16.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.469+0000 7f52070ab700 1 -- 172.21.15.135:0/4141722322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5200074c80 msgr2=0x7f520019b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:16.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.469+0000 7f52070ab700 1 --2- 172.21.15.135:0/4141722322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5200074c80 0x7f520019b3f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f51f4000c00 tx=0x7f51f40047b0 comp rx=0 tx=0).stop 2024-04-20T12:21:16.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.469+0000 7f52070ab700 1 -- 172.21.15.135:0/4141722322 shutdown_connections 2024-04-20T12:21:16.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.469+0000 7f52070ab700 1 --2- 172.21.15.135:0/4141722322 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f51f00a3cd0 0x7f51f00a6190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:16.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.469+0000 7f52070ab700 1 --2- 172.21.15.135:0/4141722322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f520010f450 0x7f520019fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:16.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.469+0000 7f52070ab700 1 --2- 172.21.15.135:0/4141722322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5200074c80 0x7f520019b3f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:16.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.469+0000 7f52070ab700 1 --2- 172.21.15.135:0/4141722322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f52000755a0 0x7f520019b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:16.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.469+0000 7f52070ab700 1 -- 172.21.15.135:0/4141722322 >> 172.21.15.135:0/4141722322 conn(0x7f5200079bb0 msgr2=0x7f52000ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:16.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.469+0000 7f52070ab700 1 -- 172.21.15.135:0/4141722322 shutdown_connections 2024-04-20T12:21:16.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:16.469+0000 7f52070ab700 1 -- 172.21.15.135:0/4141722322 wait complete. 2024-04-20T12:21:16.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:16 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/4141722322' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-20T12:21:16.837 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:16 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/4141722322' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-20T12:21:17.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:16 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/4141722322' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-20T12:21:17.338 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":3831149339},{"type":"v1","addr":"172.21.15.135:6801","nonce":3831149339}]},"active_addr":"172.21.15.135:6801/3831149339","active_change":"2024-04-20T12:13:36.720005+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.135:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":1087722944}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":669936771}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2052292307}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":4276159294}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":3836720428}]}]} 2024-04-20T12:21:17.343 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-20T12:21:17.343 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-20T12:21:17.343 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd dump --format=json 2024-04-20T12:21:17.585 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:17.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:17 smithi135 ceph-mon[18264]: pgmap v310: 129 pgs: 129 active+clean; 628 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 8.2 KiB/s wr, 23 op/s 2024-04-20T12:21:17.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:17 smithi139 ceph-mon[21834]: pgmap v310: 129 pgs: 129 active+clean; 628 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 8.2 KiB/s wr, 23 op/s 2024-04-20T12:21:18.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:17 smithi154 ceph-mon[22073]: pgmap v310: 129 pgs: 129 active+clean; 628 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 8.2 KiB/s wr, 23 op/s 2024-04-20T12:21:19.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.459+0000 7f80ca912700 1 -- 172.21.15.135:0/2821998393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80c41019e0 msgr2=0x7f80c4101e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:19.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.459+0000 7f80ca912700 1 --2- 172.21.15.135:0/2821998393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80c41019e0 0x7f80c4101e60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009990 tx=0x7f80b8009ca0 comp rx=0 tx=0).stop 2024-04-20T12:21:19.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.459+0000 7f80ca912700 1 -- 172.21.15.135:0/2821998393 shutdown_connections 2024-04-20T12:21:19.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.459+0000 7f80ca912700 1 --2- 172.21.15.135:0/2821998393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c41023a0 0x7f80c410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:19.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.459+0000 7f80ca912700 1 --2- 172.21.15.135:0/2821998393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c4107950 0x7f80c4107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:19.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.459+0000 7f80ca912700 1 --2- 172.21.15.135:0/2821998393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80c41019e0 0x7f80c4101e60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:19.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.459+0000 7f80ca912700 1 -- 172.21.15.135:0/2821998393 >> 172.21.15.135:0/2821998393 conn(0x7f80c40779a0 msgr2=0x7f80c4077db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:19.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.459+0000 7f80ca912700 1 -- 172.21.15.135:0/2821998393 shutdown_connections 2024-04-20T12:21:19.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.459+0000 7f80ca912700 1 -- 172.21.15.135:0/2821998393 wait complete. 2024-04-20T12:21:19.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.460+0000 7f80ca912700 1 Processor -- start 2024-04-20T12:21:19.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.460+0000 7f80ca912700 1 -- start start 2024-04-20T12:21:19.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.460+0000 7f80ca912700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c41019e0 0x7f80c410f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:19.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.460+0000 7f80ca912700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c41023a0 0x7f80c410f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:19.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.460+0000 7f80ca912700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80c4107950 0x7f80c410fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:19.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.460+0000 7f80ca912700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4112dc0 con 0x7f80c4107950 2024-04-20T12:21:19.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.460+0000 7f80ca912700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4112c40 con 0x7f80c41019e0 2024-04-20T12:21:19.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.460+0000 7f80ca912700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f80c4112f40 con 0x7f80c41023a0 2024-04-20T12:21:19.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.460+0000 7f80c8eaf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80c4107950 0x7f80c410fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:19.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.460+0000 7f80c8eaf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80c4107950 0x7f80c410fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43628/0 (socket says 172.21.15.135:43628) 2024-04-20T12:21:19.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.460+0000 7f80c8eaf700 1 -- 172.21.15.135:0/2049149757 learned_addr learned my addr 172.21.15.135:0/2049149757 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:19.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.460+0000 7f80c37fe700 1 --2- 172.21.15.135:0/2049149757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c41023a0 0x7f80c410f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:19.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.461+0000 7f80c3fff700 1 --2- 172.21.15.135:0/2049149757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c41019e0 0x7f80c410f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:19.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.461+0000 7f80c8eaf700 1 -- 172.21.15.135:0/2049149757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c41023a0 msgr2=0x7f80c410f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:19.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.461+0000 7f80c8eaf700 1 --2- 172.21.15.135:0/2049149757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c41023a0 0x7f80c410f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:19.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.461+0000 7f80c8eaf700 1 -- 172.21.15.135:0/2049149757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c41019e0 msgr2=0x7f80c410f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:19.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.461+0000 7f80c8eaf700 1 --2- 172.21.15.135:0/2049149757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c41019e0 0x7f80c410f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:19.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.461+0000 7f80c8eaf700 1 -- 172.21.15.135:0/2049149757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c41a7690 con 0x7f80c4107950 2024-04-20T12:21:19.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.461+0000 7f80c8eaf700 1 --2- 172.21.15.135:0/2049149757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80c4107950 0x7f80c410fbb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f80bc007d70 tx=0x7f80bc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:19.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.461+0000 7f80c17fa700 1 -- 172.21.15.135:0/2049149757 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc016020 con 0x7f80c4107950 2024-04-20T12:21:19.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.461+0000 7f80ca912700 1 -- 172.21.15.135:0/2049149757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c41a7980 con 0x7f80c4107950 2024-04-20T12:21:19.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.461+0000 7f80c17fa700 1 -- 172.21.15.135:0/2049149757 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80bc00ac90 con 0x7f80c4107950 2024-04-20T12:21:19.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.461+0000 7f80c17fa700 1 -- 172.21.15.135:0/2049149757 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0115c0 con 0x7f80c4107950 2024-04-20T12:21:19.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.461+0000 7f80ca912700 1 -- 172.21.15.135:0/2049149757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c41a7e90 con 0x7f80c4107950 2024-04-20T12:21:19.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.462+0000 7f80ca912700 1 -- 172.21.15.135:0/2049149757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c4069740 con 0x7f80c4107950 2024-04-20T12:21:19.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.463+0000 7f80c17fa700 1 -- 172.21.15.135:0/2049149757 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f80bc019020 con 0x7f80c4107950 2024-04-20T12:21:19.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.464+0000 7f80c17fa700 1 --2- 172.21.15.135:0/2049149757 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f80ac0a3cd0 0x7f80ac0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:19.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.464+0000 7f80c3fff700 1 --2- 172.21.15.135:0/2049149757 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f80ac0a3cd0 0x7f80ac0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:19.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.464+0000 7f80c17fa700 1 -- 172.21.15.135:0/2049149757 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f80bc0d0a40 con 0x7f80c4107950 2024-04-20T12:21:19.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.464+0000 7f80c3fff700 1 --2- 172.21.15.135:0/2049149757 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f80ac0a3cd0 0x7f80ac0a6190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f80b4007b60 tx=0x7f80b40073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:19.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.467+0000 7f80c17fa700 1 -- 172.21.15.135:0/2049149757 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f80bc020020 con 0x7f80c4107950 2024-04-20T12:21:19.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.670+0000 7f80ca912700 1 -- 172.21.15.135:0/2049149757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80c402df90 con 0x7f80c4107950 2024-04-20T12:21:19.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.671+0000 7f80c17fa700 1 -- 172.21.15.135:0/2049149757 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24173 (secure 0 0 0) 0x7f80bc09d190 con 0x7f80c4107950 2024-04-20T12:21:19.672 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:21:19.672 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":90,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:20:48.315252+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:21:19.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.673+0000 7f80ca912700 1 -- 172.21.15.135:0/2049149757 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f80ac0a3cd0 msgr2=0x7f80ac0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:19.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.673+0000 7f80ca912700 1 --2- 172.21.15.135:0/2049149757 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f80ac0a3cd0 0x7f80ac0a6190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f80b4007b60 tx=0x7f80b40073d0 comp rx=0 tx=0).stop 2024-04-20T12:21:19.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.673+0000 7f80ca912700 1 -- 172.21.15.135:0/2049149757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80c4107950 msgr2=0x7f80c410fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:19.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.673+0000 7f80ca912700 1 --2- 172.21.15.135:0/2049149757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80c4107950 0x7f80c410fbb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f80bc007d70 tx=0x7f80bc00a340 comp rx=0 tx=0).stop 2024-04-20T12:21:19.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.674+0000 7f80ca912700 1 -- 172.21.15.135:0/2049149757 shutdown_connections 2024-04-20T12:21:19.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.674+0000 7f80ca912700 1 --2- 172.21.15.135:0/2049149757 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f80ac0a3cd0 0x7f80ac0a6190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:19.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.674+0000 7f80ca912700 1 --2- 172.21.15.135:0/2049149757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80c4107950 0x7f80c410fbb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:19.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.674+0000 7f80ca912700 1 --2- 172.21.15.135:0/2049149757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f80c41019e0 0x7f80c410f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:19.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.674+0000 7f80ca912700 1 --2- 172.21.15.135:0/2049149757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f80c41023a0 0x7f80c410f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:19.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.674+0000 7f80ca912700 1 -- 172.21.15.135:0/2049149757 >> 172.21.15.135:0/2049149757 conn(0x7f80c40779a0 msgr2=0x7f80c40ff990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:19.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.674+0000 7f80ca912700 1 -- 172.21.15.135:0/2049149757 shutdown_connections 2024-04-20T12:21:19.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:19.674+0000 7f80ca912700 1 -- 172.21.15.135:0/2049149757 wait complete. 2024-04-20T12:21:20.006 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:19 smithi135 ceph-mon[18264]: pgmap v311: 129 pgs: 129 active+clean; 628 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.2 KiB/s wr, 24 op/s 2024-04-20T12:21:20.006 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:19 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2049149757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:21:20.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:19 smithi154 ceph-mon[22073]: pgmap v311: 129 pgs: 129 active+clean; 628 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.2 KiB/s wr, 24 op/s 2024-04-20T12:21:20.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:19 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2049149757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:21:20.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:19 smithi139 ceph-mon[21834]: pgmap v311: 129 pgs: 129 active+clean; 628 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.2 KiB/s wr, 24 op/s 2024-04-20T12:21:20.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:19 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2049149757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:21:20.452 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-20T12:21:20.453 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd dump --format=json 2024-04-20T12:21:20.690 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:22.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:21 smithi135 ceph-mon[18264]: pgmap v312: 129 pgs: 129 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 KiB/s wr, 24 op/s 2024-04-20T12:21:22.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:21 smithi154 ceph-mon[22073]: pgmap v312: 129 pgs: 129 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 KiB/s wr, 24 op/s 2024-04-20T12:21:22.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:21 smithi139 ceph-mon[21834]: pgmap v312: 129 pgs: 129 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.5 KiB/s wr, 24 op/s 2024-04-20T12:21:22.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.411+0000 7efdf4130700 1 -- 172.21.15.135:0/3266937663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec102310 msgr2=0x7efdec10e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:22.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.411+0000 7efdf4130700 1 --2- 172.21.15.135:0/3266937663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec102310 0x7efdec10e800 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efde8009990 tx=0x7efde8009ca0 comp rx=0 tx=0).stop 2024-04-20T12:21:22.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.411+0000 7efdf4130700 1 -- 172.21.15.135:0/3266937663 shutdown_connections 2024-04-20T12:21:22.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.411+0000 7efdf4130700 1 --2- 172.21.15.135:0/3266937663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec102310 0x7efdec10e800 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:22.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.411+0000 7efdf4130700 1 --2- 172.21.15.135:0/3266937663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdec1079a0 0x7efdec107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:22.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.411+0000 7efdf4130700 1 --2- 172.21.15.135:0/3266937663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdec101950 0x7efdec101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:22.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.411+0000 7efdf4130700 1 -- 172.21.15.135:0/3266937663 >> 172.21.15.135:0/3266937663 conn(0x7efdec078900 msgr2=0x7efdec078d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:22.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.411+0000 7efdf4130700 1 -- 172.21.15.135:0/3266937663 shutdown_connections 2024-04-20T12:21:22.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.411+0000 7efdf4130700 1 -- 172.21.15.135:0/3266937663 wait complete. 2024-04-20T12:21:22.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.412+0000 7efdf4130700 1 Processor -- start 2024-04-20T12:21:22.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.412+0000 7efdf4130700 1 -- start start 2024-04-20T12:21:22.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.412+0000 7efdf4130700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdec101950 0x7efdec199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:22.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.412+0000 7efdf4130700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec102310 0x7efdec1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:22.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.412+0000 7efdf4130700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdec1079a0 0x7efdec19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:22.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.412+0000 7efdf4130700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efdec111d30 con 0x7efdec102310 2024-04-20T12:21:22.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.412+0000 7efdf4130700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efdec111bb0 con 0x7efdec1079a0 2024-04-20T12:21:22.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.412+0000 7efdf4130700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efdec111eb0 con 0x7efdec101950 2024-04-20T12:21:22.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.412+0000 7efdf16cb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec102310 0x7efdec1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:22.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.412+0000 7efdf16cb700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec102310 0x7efdec1998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37256/0 (socket says 172.21.15.135:37256) 2024-04-20T12:21:22.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.412+0000 7efdf16cb700 1 -- 172.21.15.135:0/376642692 learned_addr learned my addr 172.21.15.135:0/376642692 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:22.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.412+0000 7efdf1ecc700 1 --2- 172.21.15.135:0/376642692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdec101950 0x7efdec199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:22.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.413+0000 7efdf26cd700 1 --2- 172.21.15.135:0/376642692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdec1079a0 0x7efdec19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:22.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.413+0000 7efdf16cb700 1 -- 172.21.15.135:0/376642692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdec101950 msgr2=0x7efdec199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:22.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.413+0000 7efdf16cb700 1 --2- 172.21.15.135:0/376642692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdec101950 0x7efdec199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:22.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.413+0000 7efdf16cb700 1 -- 172.21.15.135:0/376642692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdec1079a0 msgr2=0x7efdec19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:22.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.413+0000 7efdf16cb700 1 --2- 172.21.15.135:0/376642692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdec1079a0 0x7efdec19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:22.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.413+0000 7efdf16cb700 1 -- 172.21.15.135:0/376642692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdec19e340 con 0x7efdec102310 2024-04-20T12:21:22.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.413+0000 7efdf26cd700 1 --2- 172.21.15.135:0/376642692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdec1079a0 0x7efdec19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:21:22.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.413+0000 7efdf16cb700 1 --2- 172.21.15.135:0/376642692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec102310 0x7efdec1998c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efddc00b530 tx=0x7efddc00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:22.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.413+0000 7efde2ffd700 1 -- 172.21.15.135:0/376642692 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc015020 con 0x7efdec102310 2024-04-20T12:21:22.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.413+0000 7efdf4130700 1 -- 172.21.15.135:0/376642692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdec19e630 con 0x7efdec102310 2024-04-20T12:21:22.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.413+0000 7efde2ffd700 1 -- 172.21.15.135:0/376642692 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efddc011d10 con 0x7efdec102310 2024-04-20T12:21:22.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.413+0000 7efde2ffd700 1 -- 172.21.15.135:0/376642692 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc010e50 con 0x7efdec102310 2024-04-20T12:21:22.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.413+0000 7efdf4130700 1 -- 172.21.15.135:0/376642692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdec1a5eb0 con 0x7efdec102310 2024-04-20T12:21:22.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.414+0000 7efdf4130700 1 -- 172.21.15.135:0/376642692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdec069740 con 0x7efdec102310 2024-04-20T12:21:22.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.415+0000 7efde2ffd700 1 -- 172.21.15.135:0/376642692 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7efddc018020 con 0x7efdec102310 2024-04-20T12:21:22.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.416+0000 7efde2ffd700 1 --2- 172.21.15.135:0/376642692 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efdd80a3e70 0x7efdd80a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:22.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.416+0000 7efdf1ecc700 1 --2- 172.21.15.135:0/376642692 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efdd80a3e70 0x7efdd80a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:22.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.416+0000 7efde2ffd700 1 -- 172.21.15.135:0/376642692 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7efddc0d04e0 con 0x7efdec102310 2024-04-20T12:21:22.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.416+0000 7efdf1ecc700 1 --2- 172.21.15.135:0/376642692 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efdd80a3e70 0x7efdd80a6330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efde4009f20 tx=0x7efde40094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:22.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.419+0000 7efde2ffd700 1 -- 172.21.15.135:0/376642692 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7efddc01f020 con 0x7efdec102310 2024-04-20T12:21:22.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.619+0000 7efdf4130700 1 -- 172.21.15.135:0/376642692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efdec02df90 con 0x7efdec102310 2024-04-20T12:21:22.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.620+0000 7efde2ffd700 1 -- 172.21.15.135:0/376642692 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24173 (secure 0 0 0) 0x7efddc09cc30 con 0x7efdec102310 2024-04-20T12:21:22.620 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:21:22.621 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":90,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:20:48.315252+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:21:22.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.623+0000 7efdf4130700 1 -- 172.21.15.135:0/376642692 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efdd80a3e70 msgr2=0x7efdd80a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:22.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.623+0000 7efdf4130700 1 --2- 172.21.15.135:0/376642692 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efdd80a3e70 0x7efdd80a6330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7efde4009f20 tx=0x7efde40094f0 comp rx=0 tx=0).stop 2024-04-20T12:21:22.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.623+0000 7efdf4130700 1 -- 172.21.15.135:0/376642692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec102310 msgr2=0x7efdec1998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:22.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.623+0000 7efdf4130700 1 --2- 172.21.15.135:0/376642692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec102310 0x7efdec1998c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efddc00b530 tx=0x7efddc00b8f0 comp rx=0 tx=0).stop 2024-04-20T12:21:22.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.623+0000 7efdf4130700 1 -- 172.21.15.135:0/376642692 shutdown_connections 2024-04-20T12:21:22.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.623+0000 7efdf4130700 1 --2- 172.21.15.135:0/376642692 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efdd80a3e70 0x7efdd80a6330 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:22.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.623+0000 7efdf4130700 1 --2- 172.21.15.135:0/376642692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efdec1079a0 0x7efdec19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:22.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.623+0000 7efdf4130700 1 --2- 172.21.15.135:0/376642692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efdec101950 0x7efdec199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:22.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.623+0000 7efdf4130700 1 --2- 172.21.15.135:0/376642692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec102310 0x7efdec1998c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:22.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.623+0000 7efdf4130700 1 -- 172.21.15.135:0/376642692 >> 172.21.15.135:0/376642692 conn(0x7efdec078900 msgr2=0x7efdec06ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:22.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.623+0000 7efdf4130700 1 -- 172.21.15.135:0/376642692 shutdown_connections 2024-04-20T12:21:22.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:22.623+0000 7efdf4130700 1 -- 172.21.15.135:0/376642692 wait complete. 2024-04-20T12:21:23.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:22 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/376642692' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:21:23.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:22 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/376642692' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:21:23.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:22 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/376642692' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:21:23.426 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-20T12:21:23.427 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-20T12:21:23.427 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-20T12:21:23.427 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-20T12:21:23.428 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-20T12:21:23.428 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-20T12:21:23.429 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-04-20T12:21:23.429 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-04-20T12:21:23.430 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-04-20T12:21:23.430 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-04-20T12:21:23.430 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-04-20T12:21:23.431 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-04-20T12:21:24.073 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:24.244 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:23 smithi135 ceph-mon[18264]: pgmap v313: 129 pgs: 129 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.8 KiB/s wr, 16 op/s 2024-04-20T12:21:24.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:23 smithi154 ceph-mon[22073]: pgmap v313: 129 pgs: 129 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.8 KiB/s wr, 16 op/s 2024-04-20T12:21:24.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:23 smithi139 ceph-mon[21834]: pgmap v313: 129 pgs: 129 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.8 KiB/s wr, 16 op/s 2024-04-20T12:21:25.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.966+0000 7fe8e4353700 1 -- 172.21.15.135:0/1160410813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc1079d0 msgr2=0x7fe8dc107db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:25.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.966+0000 7fe8e4353700 1 --2- 172.21.15.135:0/1160410813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc1079d0 0x7fe8dc107db0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe8d80099c0 tx=0x7fe8d8009cd0 comp rx=0 tx=0).stop 2024-04-20T12:21:25.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.966+0000 7fe8e4353700 1 -- 172.21.15.135:0/1160410813 shutdown_connections 2024-04-20T12:21:25.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.966+0000 7fe8e4353700 1 --2- 172.21.15.135:0/1160410813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8dc102340 0x7fe8dc10e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.966+0000 7fe8e4353700 1 --2- 172.21.15.135:0/1160410813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc1079d0 0x7fe8dc107db0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.966+0000 7fe8e4353700 1 --2- 172.21.15.135:0/1160410813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8dc101980 0x7fe8dc101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.967+0000 7fe8e4353700 1 -- 172.21.15.135:0/1160410813 >> 172.21.15.135:0/1160410813 conn(0x7fe8dc078990 msgr2=0x7fe8dc078da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.967+0000 7fe8e4353700 1 -- 172.21.15.135:0/1160410813 shutdown_connections 2024-04-20T12:21:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.967+0000 7fe8e4353700 1 -- 172.21.15.135:0/1160410813 wait complete. 2024-04-20T12:21:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.967+0000 7fe8e4353700 1 Processor -- start 2024-04-20T12:21:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.967+0000 7fe8e4353700 1 -- start start 2024-04-20T12:21:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.967+0000 7fe8e4353700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8dc101980 0x7fe8dc19a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.967+0000 7fe8e4353700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8dc102340 0x7fe8dc19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.967+0000 7fe8e4353700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc1079d0 0x7fe8dc1a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.967+0000 7fe8e4353700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc111d10 con 0x7fe8dc1079d0 2024-04-20T12:21:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.967+0000 7fe8e4353700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc111b90 con 0x7fe8dc101980 2024-04-20T12:21:25.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.967+0000 7fe8e4353700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc111e90 con 0x7fe8dc102340 2024-04-20T12:21:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8e28f0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc1079d0 0x7fe8dc1a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8e28f0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc1079d0 0x7fe8dc1a5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37284/0 (socket says 172.21.15.135:37284) 2024-04-20T12:21:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8e28f0700 1 -- 172.21.15.135:0/3129826084 learned_addr learned my addr 172.21.15.135:0/3129826084 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8e20ef700 1 --2- 172.21.15.135:0/3129826084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8dc101980 0x7fe8dc19a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8e18ee700 1 --2- 172.21.15.135:0/3129826084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8dc102340 0x7fe8dc19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8e28f0700 1 -- 172.21.15.135:0/3129826084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8dc102340 msgr2=0x7fe8dc19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8e28f0700 1 --2- 172.21.15.135:0/3129826084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe8dc102340 0x7fe8dc19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8e28f0700 1 -- 172.21.15.135:0/3129826084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8dc101980 msgr2=0x7fe8dc19a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8e28f0700 1 --2- 172.21.15.135:0/3129826084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe8dc101980 0x7fe8dc19a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8e28f0700 1 -- 172.21.15.135:0/3129826084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc197ee0 con 0x7fe8dc1079d0 2024-04-20T12:21:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8e28f0700 1 --2- 172.21.15.135:0/3129826084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc1079d0 0x7fe8dc1a5170 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400b970 tx=0x7fe8d400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8d37fe700 1 -- 172.21.15.135:0/3129826084 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400d860 con 0x7fe8dc1079d0 2024-04-20T12:21:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8d37fe700 1 -- 172.21.15.135:0/3129826084 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8d400e430 con 0x7fe8dc1079d0 2024-04-20T12:21:25.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8e4353700 1 -- 172.21.15.135:0/3129826084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8dc1981d0 con 0x7fe8dc1079d0 2024-04-20T12:21:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8d37fe700 1 -- 172.21.15.135:0/3129826084 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4017660 con 0x7fe8dc1079d0 2024-04-20T12:21:25.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.968+0000 7fe8e4353700 1 -- 172.21.15.135:0/3129826084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8dc198710 con 0x7fe8dc1079d0 2024-04-20T12:21:25.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.969+0000 7fe8e4353700 1 -- 172.21.15.135:0/3129826084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8dc063120 con 0x7fe8dc1079d0 2024-04-20T12:21:25.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.970+0000 7fe8d37fe700 1 -- 172.21.15.135:0/3129826084 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fe8d400e5e0 con 0x7fe8dc1079d0 2024-04-20T12:21:25.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.971+0000 7fe8d37fe700 1 --2- 172.21.15.135:0/3129826084 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe8c80a3cd0 0x7fe8c80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:25.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.971+0000 7fe8e20ef700 1 --2- 172.21.15.135:0/3129826084 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe8c80a3cd0 0x7fe8c80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:25.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.971+0000 7fe8d37fe700 1 -- 172.21.15.135:0/3129826084 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7fe8d40d07c0 con 0x7fe8dc1079d0 2024-04-20T12:21:25.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.971+0000 7fe8d37fe700 1 --2- 172.21.15.135:0/3129826084 >> [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913] conn(0x7fe8c80ae990 0x7fe8c80b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:25.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.971+0000 7fe8d37fe700 1 -- 172.21.15.135:0/3129826084 --> [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8d4019e50 con 0x7fe8c80ae990 2024-04-20T12:21:25.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.971+0000 7fe8d37fe700 1 -- 172.21.15.135:0/3129826084 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fe8d40d0c10 con 0x7fe8dc1079d0 2024-04-20T12:21:25.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.971+0000 7fe8e20ef700 1 --2- 172.21.15.135:0/3129826084 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe8c80a3cd0 0x7fe8c80a6190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8000c00 tx=0x7fe8d8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:25.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.972+0000 7fe8e18ee700 1 --2- 172.21.15.135:0/3129826084 >> [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913] conn(0x7fe8c80ae990 0x7fe8c80b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:25.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.972+0000 7fe8e18ee700 1 --2- 172.21.15.135:0/3129826084 >> [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913] conn(0x7fe8c80ae990 0x7fe8c80b0dd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:25.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.973+0000 7fe8d37fe700 1 -- 172.21.15.135:0/3129826084 <== osd.4 v2:172.21.15.139:6808/450289913 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe8d4019e50 con 0x7fe8c80ae990 2024-04-20T12:21:25.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.990+0000 7fe8e4353700 1 -- 172.21.15.135:0/3129826084 --> [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe8dc0635a0 con 0x7fe8c80ae990 2024-04-20T12:21:25.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.991+0000 7fe8d37fe700 1 -- 172.21.15.135:0/3129826084 <== osd.4 v2:172.21.15.139:6808/450289913 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe8dc0635a0 con 0x7fe8c80ae990 2024-04-20T12:21:25.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.991+0000 7fe8e4353700 1 -- 172.21.15.135:0/3129826084 >> [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913] conn(0x7fe8c80ae990 msgr2=0x7fe8c80b0dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:25.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.991+0000 7fe8e4353700 1 --2- 172.21.15.135:0/3129826084 >> [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913] conn(0x7fe8c80ae990 0x7fe8c80b0dd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:25.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.991+0000 7fe8e4353700 1 -- 172.21.15.135:0/3129826084 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe8c80a3cd0 msgr2=0x7fe8c80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:25.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.991+0000 7fe8e4353700 1 --2- 172.21.15.135:0/3129826084 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe8c80a3cd0 0x7fe8c80a6190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8000c00 tx=0x7fe8d8005fb0 comp rx=0 tx=0).stop 2024-04-20T12:21:25.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.991+0000 7fe8e4353700 1 -- 172.21.15.135:0/3129826084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc1079d0 msgr2=0x7fe8dc1a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:25.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.991+0000 7fe8e4353700 1 --2- 172.21.15.135:0/3129826084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8dc1079d0 0x7fe8dc1a5170 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400b970 tx=0x7fe8d400bc80 comp rx=0 tx=0).stop 2024-04-20T12:21:25.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.991+0000 7fe8e28f0700 1 -- 172.21.15.135:0/3129826084 reap_dead start 2024-04-20T12:21:25.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.991+0000 7fe8e4353700 1 -- 172.21.15.135:0/3129826084 shutdown_connections 2024-04-20T12:21:25.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.991+0000 7fe8e4353700 1 -- 172.21.15.135:0/3129826084 >> 172.21.15.135:0/3129826084 conn(0x7fe8dc078990 msgr2=0x7fe8dc0ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:25.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.991+0000 7fe8e4353700 1 -- 172.21.15.135:0/3129826084 shutdown_connections 2024-04-20T12:21:25.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:25.991+0000 7fe8e4353700 1 -- 172.21.15.135:0/3129826084 wait complete. 2024-04-20T12:21:26.009 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:26.009 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:26.010 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:26.011 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:26.241 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:26.243 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:26.243 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:26.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:25 smithi154 ceph-mon[22073]: pgmap v314: 129 pgs: 129 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-04-20T12:21:26.270 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:26.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:25 smithi139 ceph-mon[21834]: pgmap v314: 129 pgs: 129 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-04-20T12:21:26.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:25 smithi135 ceph-mon[18264]: pgmap v314: 129 pgs: 129 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-04-20T12:21:26.804 INFO:teuthology.orchestra.run.smithi135.stdout:141733920826 2024-04-20T12:21:26.804 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-20T12:21:27.962 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:27 smithi135 ceph-mon[18264]: pgmap v315: 129 pgs: 129 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-04-20T12:21:28.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:27 smithi154 ceph-mon[22073]: pgmap v315: 129 pgs: 129 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-04-20T12:21:28.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:27 smithi139 ceph-mon[21834]: pgmap v315: 129 pgs: 129 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-04-20T12:21:30.045 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:29 smithi135 ceph-mon[18264]: pgmap v316: 129 pgs: 129 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-04-20T12:21:30.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:29 smithi154 ceph-mon[22073]: pgmap v316: 129 pgs: 129 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-04-20T12:21:30.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:29 smithi139 ceph-mon[21834]: pgmap v316: 129 pgs: 129 active+clean; 640 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 11 op/s 2024-04-20T12:21:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:31 smithi154 ceph-mon[22073]: pgmap v317: 129 pgs: 129 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-04-20T12:21:32.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:31 smithi139 ceph-mon[21834]: pgmap v317: 129 pgs: 129 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-04-20T12:21:32.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:31 smithi135 ceph-mon[18264]: pgmap v317: 129 pgs: 129 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-04-20T12:21:34.066 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:33 smithi135 ceph-mon[18264]: pgmap v318: 129 pgs: 129 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 10 op/s 2024-04-20T12:21:34.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:33 smithi154 ceph-mon[22073]: pgmap v318: 129 pgs: 129 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 10 op/s 2024-04-20T12:21:34.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:33 smithi139 ceph-mon[21834]: pgmap v318: 129 pgs: 129 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 10 op/s 2024-04-20T12:21:36.050 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:35 smithi135 ceph-mon[18264]: pgmap v319: 129 pgs: 129 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 8 op/s 2024-04-20T12:21:36.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.320+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1054864824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb4107970 msgr2=0x7f8cb406aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:36.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.320+0000 7f8cbb1a4700 1 --2- 172.21.15.135:0/1054864824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb4107970 0x7f8cb406aff0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009990 tx=0x7f8ca8009ca0 comp rx=0 tx=0).stop 2024-04-20T12:21:36.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.321+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1054864824 shutdown_connections 2024-04-20T12:21:36.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.321+0000 7f8cbb1a4700 1 --2- 172.21.15.135:0/1054864824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8cb4105480 0x7f8cb4105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:36.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.321+0000 7f8cbb1a4700 1 --2- 172.21.15.135:0/1054864824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb4107970 0x7f8cb406aff0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:36.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.321+0000 7f8cbb1a4700 1 --2- 172.21.15.135:0/1054864824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb406b530 0x7f8cb406b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:36.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.321+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1054864824 >> 172.21.15.135:0/1054864824 conn(0x7f8cb40788c0 msgr2=0x7f8cb4078cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:36.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.321+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1054864824 shutdown_connections 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.321+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1054864824 wait complete. 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.321+0000 7f8cbb1a4700 1 Processor -- start 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.321+0000 7f8cbb1a4700 1 -- start start 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.321+0000 7f8cbb1a4700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8cb406b530 0x7f8cb41a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.321+0000 7f8cbb1a4700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb4105480 0x7f8cb41a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.321+0000 7f8cbb1a4700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb4107970 0x7f8cb419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.321+0000 7f8cbb1a4700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4119380 con 0x7f8cb4105480 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.321+0000 7f8cbb1a4700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4119200 con 0x7f8cb406b530 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.321+0000 7f8cbb1a4700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4119500 con 0x7f8cb4107970 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cb3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb4105480 0x7f8cb41a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cb3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb4105480 0x7f8cb41a5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48382/0 (socket says 172.21.15.135:48382) 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cb3fff700 1 -- 172.21.15.135:0/1454050638 learned_addr learned my addr 172.21.15.135:0/1454050638 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cb8f40700 1 --2- 172.21.15.135:0/1454050638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8cb406b530 0x7f8cb41a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cb9741700 1 --2- 172.21.15.135:0/1454050638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb4107970 0x7f8cb419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cb3fff700 1 -- 172.21.15.135:0/1454050638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb4107970 msgr2=0x7f8cb419f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:36.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cb3fff700 1 --2- 172.21.15.135:0/1454050638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb4107970 0x7f8cb419f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:36.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cb3fff700 1 -- 172.21.15.135:0/1454050638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8cb406b530 msgr2=0x7f8cb41a5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:36.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cb3fff700 1 --2- 172.21.15.135:0/1454050638 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8cb406b530 0x7f8cb41a5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:36.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cb3fff700 1 -- 172.21.15.135:0/1454050638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb419fd60 con 0x7f8cb4105480 2024-04-20T12:21:36.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cb9741700 1 --2- 172.21.15.135:0/1454050638 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8cb4107970 0x7f8cb419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:21:36.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cb3fff700 1 --2- 172.21.15.135:0/1454050638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb4105480 0x7f8cb41a5980 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000d950 tx=0x7f8ca000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:36.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cb1ffb700 1 -- 172.21.15.135:0/1454050638 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0016070 con 0x7f8cb4105480 2024-04-20T12:21:36.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cb1ffb700 1 -- 172.21.15.135:0/1454050638 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ca0009e20 con 0x7f8cb4105480 2024-04-20T12:21:36.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1454050638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb41a0050 con 0x7f8cb4105480 2024-04-20T12:21:36.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cb1ffb700 1 -- 172.21.15.135:0/1454050638 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000f620 con 0x7f8cb4105480 2024-04-20T12:21:36.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.322+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1454050638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb41ac310 con 0x7f8cb4105480 2024-04-20T12:21:36.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.323+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1454050638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8cb4101390 con 0x7f8cb4105480 2024-04-20T12:21:36.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.325+0000 7f8cb1ffb700 1 -- 172.21.15.135:0/1454050638 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f8ca0019070 con 0x7f8cb4105480 2024-04-20T12:21:36.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.325+0000 7f8cb1ffb700 1 --2- 172.21.15.135:0/1454050638 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8ca40a3cd0 0x7f8ca40a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:36.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.325+0000 7f8cb8f40700 1 --2- 172.21.15.135:0/1454050638 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8ca40a3cd0 0x7f8ca40a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:36.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.325+0000 7f8cb1ffb700 1 -- 172.21.15.135:0/1454050638 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8802+0+0 (secure 0 0 0) 0x7f8ca00d08b0 con 0x7f8cb4105480 2024-04-20T12:21:36.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.325+0000 7f8cb1ffb700 1 --2- 172.21.15.135:0/1454050638 >> [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444] conn(0x7f8ca40ae990 0x7f8ca40b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:36.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.325+0000 7f8cb1ffb700 1 -- 172.21.15.135:0/1454050638 --> [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ca0013ec0 con 0x7f8ca40ae990 2024-04-20T12:21:36.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.325+0000 7f8cb1ffb700 1 -- 172.21.15.135:0/1454050638 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f8ca00d0d00 con 0x7f8cb4105480 2024-04-20T12:21:36.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.325+0000 7f8cb9741700 1 --2- 172.21.15.135:0/1454050638 >> [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444] conn(0x7f8ca40ae990 0x7f8ca40b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:36.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.326+0000 7f8cb8f40700 1 --2- 172.21.15.135:0/1454050638 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8ca40a3cd0 0x7f8ca40a6190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800b5c0 tx=0x7f8ca8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:36.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.326+0000 7f8cb9741700 1 --2- 172.21.15.135:0/1454050638 >> [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444] conn(0x7f8ca40ae990 0x7f8ca40b0dd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:36.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.326+0000 7f8cb1ffb700 1 -- 172.21.15.135:0/1454050638 <== osd.3 v2:172.21.15.135:6810/3478243444 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ca0013ec0 con 0x7f8ca40ae990 2024-04-20T12:21:36.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.342+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1454050638 --> [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8cb4101f60 con 0x7f8ca40ae990 2024-04-20T12:21:36.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.343+0000 7f8cb1ffb700 1 -- 172.21.15.135:0/1454050638 <== osd.3 v2:172.21.15.135:6810/3478243444 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8cb4101f60 con 0x7f8ca40ae990 2024-04-20T12:21:36.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.343+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1454050638 >> [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444] conn(0x7f8ca40ae990 msgr2=0x7f8ca40b0dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:36.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.343+0000 7f8cbb1a4700 1 --2- 172.21.15.135:0/1454050638 >> [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444] conn(0x7f8ca40ae990 0x7f8ca40b0dd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:36.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.343+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1454050638 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8ca40a3cd0 msgr2=0x7f8ca40a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:36.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.343+0000 7f8cbb1a4700 1 --2- 172.21.15.135:0/1454050638 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8ca40a3cd0 0x7f8ca40a6190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800b5c0 tx=0x7f8ca8005960 comp rx=0 tx=0).stop 2024-04-20T12:21:36.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.343+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1454050638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb4105480 msgr2=0x7f8cb41a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:36.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.343+0000 7f8cbb1a4700 1 --2- 172.21.15.135:0/1454050638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cb4105480 0x7f8cb41a5980 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000d950 tx=0x7f8ca000dc60 comp rx=0 tx=0).stop 2024-04-20T12:21:36.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.343+0000 7f8cb9741700 1 -- 172.21.15.135:0/1454050638 reap_dead start 2024-04-20T12:21:36.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.343+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1454050638 shutdown_connections 2024-04-20T12:21:36.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.343+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1454050638 >> 172.21.15.135:0/1454050638 conn(0x7f8cb40788c0 msgr2=0x7f8cb4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:36.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.343+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1454050638 shutdown_connections 2024-04-20T12:21:36.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:35.343+0000 7f8cbb1a4700 1 -- 172.21.15.135:0/1454050638 wait complete. 2024-04-20T12:21:36.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:35 smithi154 ceph-mon[22073]: pgmap v319: 129 pgs: 129 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 8 op/s 2024-04-20T12:21:36.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:35 smithi139 ceph-mon[21834]: pgmap v319: 129 pgs: 129 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 8 op/s 2024-04-20T12:21:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]: dispatch 2024-04-20T12:21:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-04-20T12:21:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-04-20T12:21:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-04-20T12:21:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-04-20T12:21:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-04-20T12:21:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-04-20T12:21:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-04-20T12:21:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-04-20T12:21:37.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]: dispatch 2024-04-20T12:21:37.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-04-20T12:21:37.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-04-20T12:21:37.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-04-20T12:21:37.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-04-20T12:21:37.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-04-20T12:21:37.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-04-20T12:21:37.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-04-20T12:21:37.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-04-20T12:21:37.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]: dispatch 2024-04-20T12:21:37.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-04-20T12:21:37.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-04-20T12:21:37.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-04-20T12:21:37.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-04-20T12:21:37.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-04-20T12:21:37.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-04-20T12:21:37.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-04-20T12:21:37.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]: dispatch 2024-04-20T12:21:37.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.684+0000 7f02240d6700 1 -- 172.21.15.135:0/4000184272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f021c107990 msgr2=0x7f021c107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:37.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.684+0000 7f02240d6700 1 --2- 172.21.15.135:0/4000184272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f021c107990 0x7f021c107d70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0218009990 tx=0x7f0218009ca0 comp rx=0 tx=0).stop 2024-04-20T12:21:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.684+0000 7f02240d6700 1 -- 172.21.15.135:0/4000184272 shutdown_connections 2024-04-20T12:21:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.684+0000 7f02240d6700 1 --2- 172.21.15.135:0/4000184272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f021c102300 0x7f021c10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.684+0000 7f02240d6700 1 --2- 172.21.15.135:0/4000184272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f021c107990 0x7f021c107d70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.684+0000 7f02240d6700 1 --2- 172.21.15.135:0/4000184272 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c101940 0x7f021c101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.684+0000 7f02240d6700 1 -- 172.21.15.135:0/4000184272 >> 172.21.15.135:0/4000184272 conn(0x7f021c0788c0 msgr2=0x7f021c078cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.685+0000 7f02240d6700 1 -- 172.21.15.135:0/4000184272 shutdown_connections 2024-04-20T12:21:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.685+0000 7f02240d6700 1 -- 172.21.15.135:0/4000184272 wait complete. 2024-04-20T12:21:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.685+0000 7f02240d6700 1 Processor -- start 2024-04-20T12:21:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.685+0000 7f02240d6700 1 -- start start 2024-04-20T12:21:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.685+0000 7f02240d6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f021c101940 0x7f021c198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.685+0000 7f02240d6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f021c102300 0x7f021c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f02240d6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c107990 0x7f021c19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f02240d6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f021c111c30 con 0x7f021c102300 2024-04-20T12:21:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f02240d6700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f021c111ab0 con 0x7f021c107990 2024-04-20T12:21:37.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f02240d6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f021c111db0 con 0x7f021c101940 2024-04-20T12:21:37.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f0221671700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f021c102300 0x7f021c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:37.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f0221671700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f021c102300 0x7f021c198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48394/0 (socket says 172.21.15.135:48394) 2024-04-20T12:21:37.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f0221671700 1 -- 172.21.15.135:0/1420867841 learned_addr learned my addr 172.21.15.135:0/1420867841 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:37.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f0221e72700 1 --2- 172.21.15.135:0/1420867841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f021c101940 0x7f021c198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:37.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f0222673700 1 --2- 172.21.15.135:0/1420867841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c107990 0x7f021c19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:37.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f0221e72700 1 -- 172.21.15.135:0/1420867841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c107990 msgr2=0x7f021c19c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:37.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f0221e72700 1 --2- 172.21.15.135:0/1420867841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f021c107990 0x7f021c19c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:37.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f0221e72700 1 -- 172.21.15.135:0/1420867841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f021c102300 msgr2=0x7f021c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:37.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f0221e72700 1 --2- 172.21.15.135:0/1420867841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f021c102300 0x7f021c198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:37.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f0221e72700 1 -- 172.21.15.135:0/1420867841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f021c19d010 con 0x7f021c101940 2024-04-20T12:21:37.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f0221671700 1 --2- 172.21.15.135:0/1420867841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f021c102300 0x7f021c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:21:37.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.686+0000 7f0221e72700 1 --2- 172.21.15.135:0/1420867841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f021c101940 0x7f021c198000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0218006010 tx=0x7f02180038b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:37.689 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.687+0000 7f0212ffd700 1 -- 172.21.15.135:0/1420867841 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0218027070 con 0x7f021c101940 2024-04-20T12:21:37.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.687+0000 7f02240d6700 1 -- 172.21.15.135:0/1420867841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f021c19d2a0 con 0x7f021c101940 2024-04-20T12:21:37.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.687+0000 7f02240d6700 1 -- 172.21.15.135:0/1420867841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f021c06afc0 con 0x7f021c101940 2024-04-20T12:21:37.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.687+0000 7f0212ffd700 1 -- 172.21.15.135:0/1420867841 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0218004050 con 0x7f021c101940 2024-04-20T12:21:37.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.687+0000 7f0212ffd700 1 -- 172.21.15.135:0/1420867841 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0218022c90 con 0x7f021c101940 2024-04-20T12:21:37.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.688+0000 7f02240d6700 1 -- 172.21.15.135:0/1420867841 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0200001030 con 0x7f021c101940 2024-04-20T12:21:37.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.689+0000 7f0212ffd700 1 -- 172.21.15.135:0/1420867841 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f021802a070 con 0x7f021c101940 2024-04-20T12:21:37.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.690+0000 7f0212ffd700 1 --2- 172.21.15.135:0/1420867841 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02080a3d50 0x7f02080a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:37.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.690+0000 7f0212ffd700 1 -- 172.21.15.135:0/1420867841 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9071+0+0 (secure 0 0 0) 0x7f02180d1d50 con 0x7f021c101940 2024-04-20T12:21:37.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.690+0000 7f0221671700 1 --2- 172.21.15.135:0/1420867841 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02080a3d50 0x7f02080a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:37.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.690+0000 7f0212ffd700 1 --2- 172.21.15.135:0/1420867841 >> [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144] conn(0x7f02080aee30 0x7f02080b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:37.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.690+0000 7f0212ffd700 1 -- 172.21.15.135:0/1420867841 --> [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0218015ec0 con 0x7f02080aee30 2024-04-20T12:21:37.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.690+0000 7f0212ffd700 1 -- 172.21.15.135:0/1420867841 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f02180d21a0 con 0x7f021c101940 2024-04-20T12:21:37.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.691+0000 7f0221671700 1 --2- 172.21.15.135:0/1420867841 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02080a3d50 0x7f02080a6210 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f020c00cfd0 tx=0x7f020c00e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:37.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.691+0000 7f0222673700 1 --2- 172.21.15.135:0/1420867841 >> [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144] conn(0x7f02080aee30 0x7f02080b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:37.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.691+0000 7f0222673700 1 --2- 172.21.15.135:0/1420867841 >> [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144] conn(0x7f02080aee30 0x7f02080b12d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:37.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.692+0000 7f0212ffd700 1 -- 172.21.15.135:0/1420867841 <== osd.11 v2:172.21.15.154:6824/4024362144 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0218015ec0 con 0x7f02080aee30 2024-04-20T12:21:37.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.708+0000 7f02240d6700 1 -- 172.21.15.135:0/1420867841 --> [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0200002e60 con 0x7f02080aee30 2024-04-20T12:21:37.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.709+0000 7f0212ffd700 1 -- 172.21.15.135:0/1420867841 <== osd.11 v2:172.21.15.154:6824/4024362144 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0200002e60 con 0x7f02080aee30 2024-04-20T12:21:37.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.709+0000 7f02240d6700 1 -- 172.21.15.135:0/1420867841 >> [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144] conn(0x7f02080aee30 msgr2=0x7f02080b12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:37.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.709+0000 7f02240d6700 1 --2- 172.21.15.135:0/1420867841 >> [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144] conn(0x7f02080aee30 0x7f02080b12d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:37.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.709+0000 7f02240d6700 1 -- 172.21.15.135:0/1420867841 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02080a3d50 msgr2=0x7f02080a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:37.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.709+0000 7f02240d6700 1 --2- 172.21.15.135:0/1420867841 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02080a3d50 0x7f02080a6210 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f020c00cfd0 tx=0x7f020c00e040 comp rx=0 tx=0).stop 2024-04-20T12:21:37.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.709+0000 7f02240d6700 1 -- 172.21.15.135:0/1420867841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f021c101940 msgr2=0x7f021c198000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:37.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.709+0000 7f02240d6700 1 --2- 172.21.15.135:0/1420867841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f021c101940 0x7f021c198000 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0218006010 tx=0x7f02180038b0 comp rx=0 tx=0).stop 2024-04-20T12:21:37.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.709+0000 7f0222673700 1 -- 172.21.15.135:0/1420867841 reap_dead start 2024-04-20T12:21:37.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.709+0000 7f02240d6700 1 -- 172.21.15.135:0/1420867841 shutdown_connections 2024-04-20T12:21:37.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.709+0000 7f02240d6700 1 -- 172.21.15.135:0/1420867841 >> 172.21.15.135:0/1420867841 conn(0x7f021c0788c0 msgr2=0x7f021c1004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:37.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.709+0000 7f02240d6700 1 -- 172.21.15.135:0/1420867841 shutdown_connections 2024-04-20T12:21:37.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:37.709+0000 7f02240d6700 1 -- 172.21.15.135:0/1420867841 wait complete. 2024-04-20T12:21:38.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:37 smithi135 ceph-mon[18264]: pgmap v320: 129 pgs: 129 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-04-20T12:21:38.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]': finished 2024-04-20T12:21:38.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-04-20T12:21:38.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-04-20T12:21:38.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-04-20T12:21:38.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-04-20T12:21:38.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-04-20T12:21:38.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-04-20T12:21:38.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-04-20T12:21:38.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-04-20T12:21:38.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:37 smithi135 ceph-mon[18264]: osdmap e91: 12 total, 12 up, 12 in 2024-04-20T12:21:38.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:37 smithi154 ceph-mon[22073]: pgmap v320: 129 pgs: 129 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-04-20T12:21:38.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]': finished 2024-04-20T12:21:38.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-04-20T12:21:38.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-04-20T12:21:38.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-04-20T12:21:38.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-04-20T12:21:38.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-04-20T12:21:38.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-04-20T12:21:38.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-04-20T12:21:38.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-04-20T12:21:38.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:37 smithi154 ceph-mon[22073]: osdmap e91: 12 total, 12 up, 12 in 2024-04-20T12:21:38.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:37 smithi139 ceph-mon[21834]: pgmap v320: 129 pgs: 129 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-04-20T12:21:38.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11, 8, 1]}]': finished 2024-04-20T12:21:38.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-04-20T12:21:38.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-04-20T12:21:38.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-04-20T12:21:38.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-04-20T12:21:38.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-04-20T12:21:38.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-04-20T12:21:38.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-04-20T12:21:38.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [9, 10]}]': finished 2024-04-20T12:21:38.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:37 smithi139 ceph-mon[21834]: osdmap e91: 12 total, 12 up, 12 in 2024-04-20T12:21:38.458 INFO:teuthology.orchestra.run.smithi135.stdout:343597383705 2024-04-20T12:21:38.458 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-04-20T12:21:39.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:38 smithi135 ceph-mon[18264]: osdmap e92: 12 total, 12 up, 12 in 2024-04-20T12:21:39.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:38 smithi154 ceph-mon[22073]: osdmap e92: 12 total, 12 up, 12 in 2024-04-20T12:21:39.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:38 smithi139 ceph-mon[21834]: osdmap e92: 12 total, 12 up, 12 in 2024-04-20T12:21:39.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.390+0000 7f7df6239700 1 -- 172.21.15.135:0/2098854480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7df0101980 msgr2=0x7f7df0101e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:39.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.390+0000 7f7df6239700 1 --2- 172.21.15.135:0/2098854480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7df0101980 0x7f7df0101e00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7de4009990 tx=0x7f7de4009ca0 comp rx=0 tx=0).stop 2024-04-20T12:21:39.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.390+0000 7f7df6239700 1 -- 172.21.15.135:0/2098854480 shutdown_connections 2024-04-20T12:21:39.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.390+0000 7f7df6239700 1 --2- 172.21.15.135:0/2098854480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df0102340 0x7f7df010e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:39.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.390+0000 7f7df6239700 1 --2- 172.21.15.135:0/2098854480 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7df0107930 0x7f7df0107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:39.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.390+0000 7f7df6239700 1 --2- 172.21.15.135:0/2098854480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7df0101980 0x7f7df0101e00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:39.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.390+0000 7f7df6239700 1 -- 172.21.15.135:0/2098854480 >> 172.21.15.135:0/2098854480 conn(0x7f7df0078920 msgr2=0x7f7df0078d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:39.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.390+0000 7f7df6239700 1 -- 172.21.15.135:0/2098854480 shutdown_connections 2024-04-20T12:21:39.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.390+0000 7f7df6239700 1 -- 172.21.15.135:0/2098854480 wait complete. 2024-04-20T12:21:39.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.390+0000 7f7df6239700 1 Processor -- start 2024-04-20T12:21:39.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7df6239700 1 -- start start 2024-04-20T12:21:39.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7df6239700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7df0101980 0x7f7df019a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:39.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7df6239700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df0102340 0x7f7df019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:39.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7df6239700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7df0107930 0x7f7df01a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:39.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7df6239700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7df0111cc0 con 0x7f7df0101980 2024-04-20T12:21:39.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7df6239700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7df0111b40 con 0x7f7df0107930 2024-04-20T12:21:39.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7df6239700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7df0111e40 con 0x7f7df0102340 2024-04-20T12:21:39.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7def7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7df0101980 0x7f7df019a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:39.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7def7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7df0101980 0x7f7df019a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48418/0 (socket says 172.21.15.135:48418) 2024-04-20T12:21:39.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7def7fe700 1 -- 172.21.15.135:0/2195618232 learned_addr learned my addr 172.21.15.135:0/2195618232 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:39.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7deeffd700 1 --2- 172.21.15.135:0/2195618232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df0102340 0x7f7df019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:39.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7def7fe700 1 -- 172.21.15.135:0/2195618232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df0102340 msgr2=0x7f7df019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:39.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7def7fe700 1 --2- 172.21.15.135:0/2195618232 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7df0102340 0x7f7df019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:39.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7deffff700 1 --2- 172.21.15.135:0/2195618232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7df0107930 0x7f7df01a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:39.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7def7fe700 1 -- 172.21.15.135:0/2195618232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7df0107930 msgr2=0x7f7df01a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:39.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7def7fe700 1 --2- 172.21.15.135:0/2195618232 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7df0107930 0x7f7df01a5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:39.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7def7fe700 1 -- 172.21.15.135:0/2195618232 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df01a5660 con 0x7f7df0101980 2024-04-20T12:21:39.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.391+0000 7f7def7fe700 1 --2- 172.21.15.135:0/2195618232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7df0101980 0x7f7df019a0a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7de000d950 tx=0x7f7de000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:39.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.392+0000 7f7decff9700 1 -- 172.21.15.135:0/2195618232 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de0016070 con 0x7f7df0101980 2024-04-20T12:21:39.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.392+0000 7f7decff9700 1 -- 172.21.15.135:0/2195618232 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7de0009b40 con 0x7f7df0101980 2024-04-20T12:21:39.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.392+0000 7f7df6239700 1 -- 172.21.15.135:0/2195618232 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df01a5890 con 0x7f7df0101980 2024-04-20T12:21:39.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.392+0000 7f7decff9700 1 -- 172.21.15.135:0/2195618232 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de000f620 con 0x7f7df0101980 2024-04-20T12:21:39.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.392+0000 7f7df6239700 1 -- 172.21.15.135:0/2195618232 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df01a5da0 con 0x7f7df0101980 2024-04-20T12:21:39.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.392+0000 7f7df6239700 1 -- 172.21.15.135:0/2195618232 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7df00630e0 con 0x7f7df0101980 2024-04-20T12:21:39.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.394+0000 7f7decff9700 1 -- 172.21.15.135:0/2195618232 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f7de0019070 con 0x7f7df0101980 2024-04-20T12:21:39.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.394+0000 7f7decff9700 1 --2- 172.21.15.135:0/2195618232 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7dd80a3cd0 0x7f7dd80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:39.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.394+0000 7f7deeffd700 1 --2- 172.21.15.135:0/2195618232 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7dd80a3cd0 0x7f7dd80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:39.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.394+0000 7f7decff9700 1 -- 172.21.15.135:0/2195618232 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f7de00d0840 con 0x7f7df0101980 2024-04-20T12:21:39.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.395+0000 7f7decff9700 1 --2- 172.21.15.135:0/2195618232 >> [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084] conn(0x7f7dd80aedb0 0x7f7dd80b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:39.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.395+0000 7f7decff9700 1 -- 172.21.15.135:0/2195618232 --> [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7de0014e80 con 0x7f7dd80aedb0 2024-04-20T12:21:39.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.395+0000 7f7decff9700 1 -- 172.21.15.135:0/2195618232 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f7de00d0c90 con 0x7f7df0101980 2024-04-20T12:21:39.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.395+0000 7f7deeffd700 1 --2- 172.21.15.135:0/2195618232 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7dd80a3cd0 0x7f7dd80a6190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7de4006010 tx=0x7f7de400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:39.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.395+0000 7f7deffff700 1 --2- 172.21.15.135:0/2195618232 >> [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084] conn(0x7f7dd80aedb0 0x7f7dd80b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:39.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.395+0000 7f7deffff700 1 --2- 172.21.15.135:0/2195618232 >> [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084] conn(0x7f7dd80aedb0 0x7f7dd80b1250 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:39.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.396+0000 7f7decff9700 1 -- 172.21.15.135:0/2195618232 <== osd.2 v2:172.21.15.154:6800/4166169084 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7de0014e80 con 0x7f7dd80aedb0 2024-04-20T12:21:39.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.412+0000 7f7df6239700 1 -- 172.21.15.135:0/2195618232 --> [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7df0063560 con 0x7f7dd80aedb0 2024-04-20T12:21:39.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.413+0000 7f7decff9700 1 -- 172.21.15.135:0/2195618232 <== osd.2 v2:172.21.15.154:6800/4166169084 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7df0063560 con 0x7f7dd80aedb0 2024-04-20T12:21:39.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.413+0000 7f7df6239700 1 -- 172.21.15.135:0/2195618232 >> [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084] conn(0x7f7dd80aedb0 msgr2=0x7f7dd80b1250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:39.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.413+0000 7f7df6239700 1 --2- 172.21.15.135:0/2195618232 >> [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084] conn(0x7f7dd80aedb0 0x7f7dd80b1250 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:39.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.413+0000 7f7df6239700 1 -- 172.21.15.135:0/2195618232 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7dd80a3cd0 msgr2=0x7f7dd80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:39.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.413+0000 7f7df6239700 1 --2- 172.21.15.135:0/2195618232 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7dd80a3cd0 0x7f7dd80a6190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7de4006010 tx=0x7f7de400b540 comp rx=0 tx=0).stop 2024-04-20T12:21:39.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.413+0000 7f7df6239700 1 -- 172.21.15.135:0/2195618232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7df0101980 msgr2=0x7f7df019a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:39.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.413+0000 7f7df6239700 1 --2- 172.21.15.135:0/2195618232 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7df0101980 0x7f7df019a0a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7de000d950 tx=0x7f7de000dd10 comp rx=0 tx=0).stop 2024-04-20T12:21:39.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.413+0000 7f7deffff700 1 -- 172.21.15.135:0/2195618232 reap_dead start 2024-04-20T12:21:39.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.413+0000 7f7df6239700 1 -- 172.21.15.135:0/2195618232 shutdown_connections 2024-04-20T12:21:39.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.413+0000 7f7df6239700 1 -- 172.21.15.135:0/2195618232 >> 172.21.15.135:0/2195618232 conn(0x7f7df0078920 msgr2=0x7f7df00ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:39.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.413+0000 7f7df6239700 1 -- 172.21.15.135:0/2195618232 shutdown_connections 2024-04-20T12:21:39.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:39.413+0000 7f7df6239700 1 -- 172.21.15.135:0/2195618232 wait complete. 2024-04-20T12:21:40.167 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:39 smithi135 ceph-mon[18264]: pgmap v323: 129 pgs: 4 peering, 125 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-04-20T12:21:40.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:39 smithi154 ceph-mon[22073]: pgmap v323: 129 pgs: 4 peering, 125 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-04-20T12:21:40.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:39 smithi139 ceph-mon[21834]: pgmap v323: 129 pgs: 4 peering, 125 active+clean; 643 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-04-20T12:21:40.990 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:40 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:21:41.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:40 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:21:41.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:40 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:21:41.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.220+0000 7f3e63833700 1 -- 172.21.15.135:0/2277460341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c1069a0 msgr2=0x7f3e5c106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:41.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.220+0000 7f3e63833700 1 --2- 172.21.15.135:0/2277460341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c1069a0 0x7f3e5c106d80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3e5400b0a0 tx=0x7f3e5400b3b0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.220+0000 7f3e63833700 1 -- 172.21.15.135:0/2277460341 shutdown_connections 2024-04-20T12:21:41.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.220+0000 7f3e63833700 1 --2- 172.21.15.135:0/2277460341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e5c1026f0 0x7f3e5c10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.220+0000 7f3e63833700 1 --2- 172.21.15.135:0/2277460341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c1069a0 0x7f3e5c106d80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.220+0000 7f3e63833700 1 --2- 172.21.15.135:0/2277460341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e5c101d30 0x7f3e5c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.220+0000 7f3e63833700 1 -- 172.21.15.135:0/2277460341 >> 172.21.15.135:0/2277460341 conn(0x7f3e5c078900 msgr2=0x7f3e5c078d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:41.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.220+0000 7f3e63833700 1 -- 172.21.15.135:0/2277460341 shutdown_connections 2024-04-20T12:21:41.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.220+0000 7f3e63833700 1 -- 172.21.15.135:0/2277460341 wait complete. 2024-04-20T12:21:41.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e63833700 1 Processor -- start 2024-04-20T12:21:41.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e63833700 1 -- start start 2024-04-20T12:21:41.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e63833700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e5c101d30 0x7f3e5c198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:41.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e63833700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c1026f0 0x7f3e5c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:41.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e63833700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e5c1069a0 0x7f3e5c19c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:41.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e63833700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c111c50 con 0x7f3e5c1026f0 2024-04-20T12:21:41.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e63833700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c111ad0 con 0x7f3e5c101d30 2024-04-20T12:21:41.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e63833700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c111dd0 con 0x7f3e5c1069a0 2024-04-20T12:21:41.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e60dce700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c1026f0 0x7f3e5c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:41.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e60dce700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c1026f0 0x7f3e5c1985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43214/0 (socket says 172.21.15.135:43214) 2024-04-20T12:21:41.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e60dce700 1 -- 172.21.15.135:0/3035758939 learned_addr learned my addr 172.21.15.135:0/3035758939 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:41.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e615cf700 1 --2- 172.21.15.135:0/3035758939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e5c101d30 0x7f3e5c198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:41.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e61dd0700 1 --2- 172.21.15.135:0/3035758939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e5c1069a0 0x7f3e5c19c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e60dce700 1 -- 172.21.15.135:0/3035758939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e5c1069a0 msgr2=0x7f3e5c19c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e60dce700 1 --2- 172.21.15.135:0/3035758939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e5c1069a0 0x7f3e5c19c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e60dce700 1 -- 172.21.15.135:0/3035758939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e5c101d30 msgr2=0x7f3e5c198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e60dce700 1 --2- 172.21.15.135:0/3035758939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e5c101d30 0x7f3e5c198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e60dce700 1 -- 172.21.15.135:0/3035758939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c19d070 con 0x7f3e5c1026f0 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e60dce700 1 --2- 172.21.15.135:0/3035758939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c1026f0 0x7f3e5c1985a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00d980 tx=0x7f3e4c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.221+0000 7f3e527fc700 1 -- 172.21.15.135:0/3035758939 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c017070 con 0x7f3e5c1026f0 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.222+0000 7f3e63833700 1 -- 172.21.15.135:0/3035758939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e5c19d360 con 0x7f3e5c1026f0 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.222+0000 7f3e527fc700 1 -- 172.21.15.135:0/3035758939 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e4c005020 con 0x7f3e5c1026f0 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.222+0000 7f3e527fc700 1 -- 172.21.15.135:0/3035758939 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c00fbf0 con 0x7f3e5c1026f0 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.222+0000 7f3e63833700 1 -- 172.21.15.135:0/3035758939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e5c1a4be0 con 0x7f3e5c1026f0 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.222+0000 7f3e63833700 1 -- 172.21.15.135:0/3035758939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e5c0631e0 con 0x7f3e5c1026f0 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.224+0000 7f3e527fc700 1 -- 172.21.15.135:0/3035758939 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f3e4c0051d0 con 0x7f3e5c1026f0 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.224+0000 7f3e527fc700 1 --2- 172.21.15.135:0/3035758939 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3e480a3cd0 0x7f3e480a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.224+0000 7f3e615cf700 1 --2- 172.21.15.135:0/3035758939 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3e480a3cd0 0x7f3e480a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:41.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.224+0000 7f3e527fc700 1 -- 172.21.15.135:0/3035758939 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f3e4c0d0c20 con 0x7f3e5c1026f0 2024-04-20T12:21:41.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.224+0000 7f3e527fc700 1 --2- 172.21.15.135:0/3035758939 >> [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935] conn(0x7f3e480aedb0 0x7f3e480b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:41.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.224+0000 7f3e527fc700 1 -- 172.21.15.135:0/3035758939 --> [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e480b1920 con 0x7f3e480aedb0 2024-04-20T12:21:41.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.224+0000 7f3e527fc700 1 -- 172.21.15.135:0/3035758939 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f3e4c0d1070 con 0x7f3e5c1026f0 2024-04-20T12:21:41.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.225+0000 7f3e615cf700 1 --2- 172.21.15.135:0/3035758939 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3e480a3cd0 0x7f3e480a6190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009e60 tx=0x7f3e5400b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:41.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.225+0000 7f3e61dd0700 1 --2- 172.21.15.135:0/3035758939 >> [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935] conn(0x7f3e480aedb0 0x7f3e480b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:41.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.225+0000 7f3e61dd0700 1 --2- 172.21.15.135:0/3035758939 >> [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935] conn(0x7f3e480aedb0 0x7f3e480b1250 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:41.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.226+0000 7f3e527fc700 1 -- 172.21.15.135:0/3035758939 <== osd.5 v2:172.21.15.154:6808/512519935 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e480b1920 con 0x7f3e480aedb0 2024-04-20T12:21:41.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.243+0000 7f3e63833700 1 -- 172.21.15.135:0/3035758939 --> [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3e5c063660 con 0x7f3e480aedb0 2024-04-20T12:21:41.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.257+0000 7f3e527fc700 1 -- 172.21.15.135:0/3035758939 <== osd.5 v2:172.21.15.154:6808/512519935 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3e5c063660 con 0x7f3e480aedb0 2024-04-20T12:21:41.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.257+0000 7f3e63833700 1 -- 172.21.15.135:0/3035758939 >> [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935] conn(0x7f3e480aedb0 msgr2=0x7f3e480b1250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:41.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.257+0000 7f3e63833700 1 --2- 172.21.15.135:0/3035758939 >> [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935] conn(0x7f3e480aedb0 0x7f3e480b1250 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.258+0000 7f3e63833700 1 -- 172.21.15.135:0/3035758939 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3e480a3cd0 msgr2=0x7f3e480a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:41.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.258+0000 7f3e63833700 1 --2- 172.21.15.135:0/3035758939 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3e480a3cd0 0x7f3e480a6190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009e60 tx=0x7f3e5400b7b0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.258+0000 7f3e63833700 1 -- 172.21.15.135:0/3035758939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c1026f0 msgr2=0x7f3e5c1985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:41.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.258+0000 7f3e63833700 1 --2- 172.21.15.135:0/3035758939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c1026f0 0x7f3e5c1985a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00d980 tx=0x7f3e4c00dc90 comp rx=0 tx=0).stop 2024-04-20T12:21:41.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.258+0000 7f3e61dd0700 1 -- 172.21.15.135:0/3035758939 reap_dead start 2024-04-20T12:21:41.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.258+0000 7f3e63833700 1 -- 172.21.15.135:0/3035758939 shutdown_connections 2024-04-20T12:21:41.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.258+0000 7f3e63833700 1 -- 172.21.15.135:0/3035758939 >> 172.21.15.135:0/3035758939 conn(0x7f3e5c078900 msgr2=0x7f3e5c0ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:41.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.258+0000 7f3e63833700 1 -- 172.21.15.135:0/3035758939 shutdown_connections 2024-04-20T12:21:41.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.258+0000 7f3e63833700 1 -- 172.21.15.135:0/3035758939 wait complete. 2024-04-20T12:21:41.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.966+0000 7f3c27afa700 1 -- 172.21.15.135:0/1834749667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c20107930 msgr2=0x7f3c20107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:41.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.966+0000 7f3c27afa700 1 --2- 172.21.15.135:0/1834749667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c20107930 0x7f3c20107d10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3c10009990 tx=0x7f3c10009ca0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.966+0000 7f3c27afa700 1 -- 172.21.15.135:0/1834749667 shutdown_connections 2024-04-20T12:21:41.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.966+0000 7f3c27afa700 1 --2- 172.21.15.135:0/1834749667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c20102340 0x7f3c2010e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.966+0000 7f3c27afa700 1 --2- 172.21.15.135:0/1834749667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c20107930 0x7f3c20107d10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.966+0000 7f3c27afa700 1 --2- 172.21.15.135:0/1834749667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c20101980 0x7f3c20101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.966+0000 7f3c27afa700 1 -- 172.21.15.135:0/1834749667 >> 172.21.15.135:0/1834749667 conn(0x7f3c20078920 msgr2=0x7f3c20078d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:41.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.967+0000 7f3c27afa700 1 -- 172.21.15.135:0/1834749667 shutdown_connections 2024-04-20T12:21:41.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.967+0000 7f3c27afa700 1 -- 172.21.15.135:0/1834749667 wait complete. 2024-04-20T12:21:41.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.967+0000 7f3c27afa700 1 Processor -- start 2024-04-20T12:21:41.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.967+0000 7f3c27afa700 1 -- start start 2024-04-20T12:21:41.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.967+0000 7f3c27afa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c20101980 0x7f3c20199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:41.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.967+0000 7f3c27afa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c20102340 0x7f3c201997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:41.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.967+0000 7f3c27afa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c20107930 0x7f3c2019db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:41.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.967+0000 7f3c27afa700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3c20111ce0 con 0x7f3c20101980 2024-04-20T12:21:41.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.967+0000 7f3c27afa700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3c20111b60 con 0x7f3c20107930 2024-04-20T12:21:41.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.967+0000 7f3c27afa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c20111e60 con 0x7f3c20102340 2024-04-20T12:21:41.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.967+0000 7f3c25896700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c20101980 0x7f3c20199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:41.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.967+0000 7f3c25896700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c20101980 0x7f3c20199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43222/0 (socket says 172.21.15.135:43222) 2024-04-20T12:21:41.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.967+0000 7f3c25896700 1 -- 172.21.15.135:0/4228623759 learned_addr learned my addr 172.21.15.135:0/4228623759 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:41.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.968+0000 7f3c26097700 1 --2- 172.21.15.135:0/4228623759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c20107930 0x7f3c2019db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:41.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.968+0000 7f3c25095700 1 --2- 172.21.15.135:0/4228623759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c20102340 0x7f3c201997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:41.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.968+0000 7f3c25896700 1 -- 172.21.15.135:0/4228623759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c20102340 msgr2=0x7f3c201997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:41.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.968+0000 7f3c25896700 1 --2- 172.21.15.135:0/4228623759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c20102340 0x7f3c201997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.968+0000 7f3c25896700 1 -- 172.21.15.135:0/4228623759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c20107930 msgr2=0x7f3c2019db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:41.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.968+0000 7f3c25896700 1 --2- 172.21.15.135:0/4228623759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c20107930 0x7f3c2019db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.968+0000 7f3c25896700 1 -- 172.21.15.135:0/4228623759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2019e290 con 0x7f3c20101980 2024-04-20T12:21:41.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.968+0000 7f3c25896700 1 --2- 172.21.15.135:0/4228623759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c20101980 0x7f3c20199280 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3c10005910 tx=0x7f3c1000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:41.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.968+0000 7f3c16ffd700 1 -- 172.21.15.135:0/4228623759 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10027070 con 0x7f3c20101980 2024-04-20T12:21:41.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.968+0000 7f3c27afa700 1 -- 172.21.15.135:0/4228623759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2019e520 con 0x7f3c20101980 2024-04-20T12:21:41.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.968+0000 7f3c16ffd700 1 -- 172.21.15.135:0/4228623759 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c10004650 con 0x7f3c20101980 2024-04-20T12:21:41.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.968+0000 7f3c16ffd700 1 -- 172.21.15.135:0/4228623759 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1000f460 con 0x7f3c20101980 2024-04-20T12:21:41.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.968+0000 7f3c27afa700 1 -- 172.21.15.135:0/4228623759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c201a5e00 con 0x7f3c20101980 2024-04-20T12:21:41.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.969+0000 7f3c27afa700 1 -- 172.21.15.135:0/4228623759 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c2006b4b0 con 0x7f3c20101980 2024-04-20T12:21:41.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.970+0000 7f3c16ffd700 1 -- 172.21.15.135:0/4228623759 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f3c1002a070 con 0x7f3c20101980 2024-04-20T12:21:41.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.971+0000 7f3c16ffd700 1 --2- 172.21.15.135:0/4228623759 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3c0c0a3cd0 0x7f3c0c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:41.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.971+0000 7f3c25095700 1 --2- 172.21.15.135:0/4228623759 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3c0c0a3cd0 0x7f3c0c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:41.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.971+0000 7f3c16ffd700 1 -- 172.21.15.135:0/4228623759 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f3c100d1ea0 con 0x7f3c20101980 2024-04-20T12:21:41.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.971+0000 7f3c16ffd700 1 --2- 172.21.15.135:0/4228623759 >> [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416] conn(0x7f3c0c0aedb0 0x7f3c0c0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:41.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.971+0000 7f3c16ffd700 1 -- 172.21.15.135:0/4228623759 --> [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c1002de50 con 0x7f3c0c0aedb0 2024-04-20T12:21:41.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.971+0000 7f3c16ffd700 1 -- 172.21.15.135:0/4228623759 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f3c100d22f0 con 0x7f3c20101980 2024-04-20T12:21:41.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.972+0000 7f3c25095700 1 --2- 172.21.15.135:0/4228623759 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3c0c0a3cd0 0x7f3c0c0a6190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3c2006c280 tx=0x7f3c1c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:41.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.972+0000 7f3c26097700 1 --2- 172.21.15.135:0/4228623759 >> [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416] conn(0x7f3c0c0aedb0 0x7f3c0c0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:41.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.972+0000 7f3c26097700 1 --2- 172.21.15.135:0/4228623759 >> [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416] conn(0x7f3c0c0aedb0 0x7f3c0c0b1250 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:41.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.973+0000 7f3c16ffd700 1 -- 172.21.15.135:0/4228623759 <== osd.1 v2:172.21.15.139:6800/4149997416 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3c1002de50 con 0x7f3c0c0aedb0 2024-04-20T12:21:41.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.989+0000 7f3c27afa700 1 -- 172.21.15.135:0/4228623759 --> [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3c20103070 con 0x7f3c0c0aedb0 2024-04-20T12:21:41.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.990+0000 7f3c16ffd700 1 -- 172.21.15.135:0/4228623759 <== osd.1 v2:172.21.15.139:6800/4149997416 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3c20103070 con 0x7f3c0c0aedb0 2024-04-20T12:21:41.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.990+0000 7f3c27afa700 1 -- 172.21.15.135:0/4228623759 >> [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416] conn(0x7f3c0c0aedb0 msgr2=0x7f3c0c0b1250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:41.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.990+0000 7f3c27afa700 1 --2- 172.21.15.135:0/4228623759 >> [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416] conn(0x7f3c0c0aedb0 0x7f3c0c0b1250 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.990+0000 7f3c27afa700 1 -- 172.21.15.135:0/4228623759 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3c0c0a3cd0 msgr2=0x7f3c0c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:41.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.990+0000 7f3c27afa700 1 --2- 172.21.15.135:0/4228623759 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3c0c0a3cd0 0x7f3c0c0a6190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3c2006c280 tx=0x7f3c1c009260 comp rx=0 tx=0).stop 2024-04-20T12:21:41.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.990+0000 7f3c27afa700 1 -- 172.21.15.135:0/4228623759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c20101980 msgr2=0x7f3c20199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:41.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.990+0000 7f3c27afa700 1 --2- 172.21.15.135:0/4228623759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c20101980 0x7f3c20199280 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3c10005910 tx=0x7f3c1000bab0 comp rx=0 tx=0).stop 2024-04-20T12:21:41.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.990+0000 7f3c26097700 1 -- 172.21.15.135:0/4228623759 reap_dead start 2024-04-20T12:21:41.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.990+0000 7f3c27afa700 1 -- 172.21.15.135:0/4228623759 shutdown_connections 2024-04-20T12:21:41.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.990+0000 7f3c27afa700 1 -- 172.21.15.135:0/4228623759 >> 172.21.15.135:0/4228623759 conn(0x7f3c20078920 msgr2=0x7f3c201057a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:41.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.990+0000 7f3c27afa700 1 -- 172.21.15.135:0/4228623759 shutdown_connections 2024-04-20T12:21:41.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:41.990+0000 7f3c27afa700 1 -- 172.21.15.135:0/4228623759 wait complete. 2024-04-20T12:21:42.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:41 smithi154 ceph-mon[22073]: pgmap v324: 129 pgs: 4 peering, 125 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 383 B/s wr, 9 op/s 2024-04-20T12:21:42.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:41 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:21:42.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:41 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:21:42.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:41 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:21:42.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:41 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:21:42.297 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:41 smithi135 ceph-mon[18264]: pgmap v324: 129 pgs: 4 peering, 125 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 383 B/s wr, 9 op/s 2024-04-20T12:21:42.298 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:41 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:21:42.298 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:41 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:21:42.298 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:41 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:21:42.298 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:41 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:21:42.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:41 smithi139 ceph-mon[21834]: pgmap v324: 129 pgs: 4 peering, 125 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 383 B/s wr, 9 op/s 2024-04-20T12:21:42.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:41 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:21:42.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:41 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:21:42.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:41 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:21:42.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:41 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:21:42.673 INFO:teuthology.orchestra.run.smithi135.stdout:107374182465 2024-04-20T12:21:42.673 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-20T12:21:43.081 INFO:teuthology.orchestra.run.smithi135.stdout:55834574923 2024-04-20T12:21:43.082 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-20T12:21:43.186 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:42 smithi135 ceph-mon[18264]: pgmap v325: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 383 B/s wr, 10 op/s; 77 B/s, 1 keys/s, 1 objects/s recovering 2024-04-20T12:21:43.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:42 smithi154 ceph-mon[22073]: pgmap v325: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 383 B/s wr, 10 op/s; 77 B/s, 1 keys/s, 1 objects/s recovering 2024-04-20T12:21:43.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:42 smithi139 ceph-mon[21834]: pgmap v325: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 383 B/s wr, 10 op/s; 77 B/s, 1 keys/s, 1 objects/s recovering 2024-04-20T12:21:43.869 INFO:teuthology.orchestra.run.smithi135.stdout:163208757304 2024-04-20T12:21:43.869 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-20T12:21:44.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.654+0000 7f3a2237a700 1 -- 172.21.15.135:0/76653482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a1c108a40 msgr2=0x7f3a1c108e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:44.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.654+0000 7f3a2237a700 1 --2- 172.21.15.135:0/76653482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a1c108a40 0x7f3a1c108e20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009990 tx=0x7f3a0c009ca0 comp rx=0 tx=0).stop 2024-04-20T12:21:44.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.654+0000 7f3a2237a700 1 -- 172.21.15.135:0/76653482 shutdown_connections 2024-04-20T12:21:44.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.654+0000 7f3a2237a700 1 --2- 172.21.15.135:0/76653482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a1c06bb60 0x7f3a1c10f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:44.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.654+0000 7f3a2237a700 1 --2- 172.21.15.135:0/76653482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a1c108a40 0x7f3a1c108e20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:44.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.654+0000 7f3a2237a700 1 --2- 172.21.15.135:0/76653482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a1c06b1c0 0x7f3a1c06b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:44.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.654+0000 7f3a2237a700 1 -- 172.21.15.135:0/76653482 >> 172.21.15.135:0/76653482 conn(0x7f3a1c0779c0 msgr2=0x7f3a1c077dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:44.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.654+0000 7f3a2237a700 1 -- 172.21.15.135:0/76653482 shutdown_connections 2024-04-20T12:21:44.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.654+0000 7f3a2237a700 1 -- 172.21.15.135:0/76653482 wait complete. 2024-04-20T12:21:44.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.655+0000 7f3a2237a700 1 Processor -- start 2024-04-20T12:21:44.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.655+0000 7f3a2237a700 1 -- start start 2024-04-20T12:21:44.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.655+0000 7f3a2237a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a1c06b1c0 0x7f3a1c199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:44.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.655+0000 7f3a2237a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a1c06bb60 0x7f3a1c1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:44.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.655+0000 7f3a2237a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a1c108a40 0x7f3a1c19dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:44.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.655+0000 7f3a2237a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c112e10 con 0x7f3a1c108a40 2024-04-20T12:21:44.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.655+0000 7f3a2237a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c112c90 con 0x7f3a1c06bb60 2024-04-20T12:21:44.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.655+0000 7f3a2237a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c112f90 con 0x7f3a1c06b1c0 2024-04-20T12:21:44.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.655+0000 7f3a20917700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a1c108a40 0x7f3a1c19dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:44.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.655+0000 7f3a20917700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a1c108a40 0x7f3a1c19dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43260/0 (socket says 172.21.15.135:43260) 2024-04-20T12:21:44.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.655+0000 7f3a20917700 1 -- 172.21.15.135:0/972317335 learned_addr learned my addr 172.21.15.135:0/972317335 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:44.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.655+0000 7f3a1bfff700 1 --2- 172.21.15.135:0/972317335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a1c06b1c0 0x7f3a1c199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:44.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.656+0000 7f3a1b7fe700 1 --2- 172.21.15.135:0/972317335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a1c06bb60 0x7f3a1c1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:44.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.656+0000 7f3a20917700 1 -- 172.21.15.135:0/972317335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a1c06b1c0 msgr2=0x7f3a1c199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:44.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.656+0000 7f3a20917700 1 --2- 172.21.15.135:0/972317335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a1c06b1c0 0x7f3a1c199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:44.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.656+0000 7f3a20917700 1 -- 172.21.15.135:0/972317335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a1c06bb60 msgr2=0x7f3a1c1998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:44.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.656+0000 7f3a20917700 1 --2- 172.21.15.135:0/972317335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a1c06bb60 0x7f3a1c1998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:44.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.656+0000 7f3a20917700 1 -- 172.21.15.135:0/972317335 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1c19e390 con 0x7f3a1c108a40 2024-04-20T12:21:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.656+0000 7f3a1b7fe700 1 --2- 172.21.15.135:0/972317335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a1c06bb60 0x7f3a1c1998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:21:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.656+0000 7f3a20917700 1 --2- 172.21.15.135:0/972317335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a1c108a40 0x7f3a1c19dc50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400b970 tx=0x7f3a1400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.656+0000 7f3a197fa700 1 -- 172.21.15.135:0/972317335 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14019070 con 0x7f3a1c108a40 2024-04-20T12:21:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.656+0000 7f3a2237a700 1 -- 172.21.15.135:0/972317335 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1c19e680 con 0x7f3a1c108a40 2024-04-20T12:21:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.656+0000 7f3a197fa700 1 -- 172.21.15.135:0/972317335 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a1400ce10 con 0x7f3a1c108a40 2024-04-20T12:21:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.656+0000 7f3a197fa700 1 -- 172.21.15.135:0/972317335 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a14007370 con 0x7f3a1c108a40 2024-04-20T12:21:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.656+0000 7f3a2237a700 1 -- 172.21.15.135:0/972317335 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a1c1a5f00 con 0x7f3a1c108a40 2024-04-20T12:21:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.657+0000 7f3a2237a700 1 -- 172.21.15.135:0/972317335 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3a1c063160 con 0x7f3a1c108a40 2024-04-20T12:21:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.658+0000 7f3a197fa700 1 -- 172.21.15.135:0/972317335 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f3a1401c070 con 0x7f3a1c108a40 2024-04-20T12:21:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.659+0000 7f3a197fa700 1 --2- 172.21.15.135:0/972317335 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3a040a3cd0 0x7f3a040a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.659+0000 7f3a1bfff700 1 --2- 172.21.15.135:0/972317335 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3a040a3cd0 0x7f3a040a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.659+0000 7f3a197fa700 1 -- 172.21.15.135:0/972317335 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f3a140d0340 con 0x7f3a1c108a40 2024-04-20T12:21:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.659+0000 7f3a197fa700 1 --2- 172.21.15.135:0/972317335 >> [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144] conn(0x7f3a040aedb0 0x7f3a040b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.659+0000 7f3a197fa700 1 -- 172.21.15.135:0/972317335 --> [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a040b1920 con 0x7f3a040aedb0 2024-04-20T12:21:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.659+0000 7f3a197fa700 1 -- 172.21.15.135:0/972317335 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f3a140d0790 con 0x7f3a1c108a40 2024-04-20T12:21:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.659+0000 7f3a1b7fe700 1 --2- 172.21.15.135:0/972317335 >> [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144] conn(0x7f3a040aedb0 0x7f3a040b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.659+0000 7f3a1bfff700 1 --2- 172.21.15.135:0/972317335 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3a040a3cd0 0x7f3a040a6190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00b5c0 tx=0x7f3a0c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.659+0000 7f3a1b7fe700 1 --2- 172.21.15.135:0/972317335 >> [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144] conn(0x7f3a040aedb0 0x7f3a040b1250 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.660+0000 7f3a197fa700 1 -- 172.21.15.135:0/972317335 <== osd.0 v2:172.21.15.135:6802/231033144 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3a040b1920 con 0x7f3a040aedb0 2024-04-20T12:21:44.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.676+0000 7f3a2237a700 1 -- 172.21.15.135:0/972317335 --> [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3a1c0635e0 con 0x7f3a040aedb0 2024-04-20T12:21:44.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.677+0000 7f3a197fa700 1 -- 172.21.15.135:0/972317335 <== osd.0 v2:172.21.15.135:6802/231033144 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3a1c0635e0 con 0x7f3a040aedb0 2024-04-20T12:21:44.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.677+0000 7f3a2237a700 1 -- 172.21.15.135:0/972317335 >> [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144] conn(0x7f3a040aedb0 msgr2=0x7f3a040b1250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:44.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.677+0000 7f3a2237a700 1 --2- 172.21.15.135:0/972317335 >> [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144] conn(0x7f3a040aedb0 0x7f3a040b1250 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:44.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.677+0000 7f3a2237a700 1 -- 172.21.15.135:0/972317335 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3a040a3cd0 msgr2=0x7f3a040a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:44.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.677+0000 7f3a2237a700 1 --2- 172.21.15.135:0/972317335 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3a040a3cd0 0x7f3a040a6190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00b5c0 tx=0x7f3a0c005960 comp rx=0 tx=0).stop 2024-04-20T12:21:44.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.677+0000 7f3a2237a700 1 -- 172.21.15.135:0/972317335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a1c108a40 msgr2=0x7f3a1c19dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:44.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.677+0000 7f3a2237a700 1 --2- 172.21.15.135:0/972317335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a1c108a40 0x7f3a1c19dc50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3a1400b970 tx=0x7f3a1400bc80 comp rx=0 tx=0).stop 2024-04-20T12:21:44.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.677+0000 7f3a20917700 1 -- 172.21.15.135:0/972317335 reap_dead start 2024-04-20T12:21:44.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.677+0000 7f3a2237a700 1 -- 172.21.15.135:0/972317335 shutdown_connections 2024-04-20T12:21:44.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.677+0000 7f3a2237a700 1 -- 172.21.15.135:0/972317335 >> 172.21.15.135:0/972317335 conn(0x7f3a1c0779c0 msgr2=0x7f3a1c0ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:44.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.677+0000 7f3a2237a700 1 -- 172.21.15.135:0/972317335 shutdown_connections 2024-04-20T12:21:44.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:44.677+0000 7f3a2237a700 1 -- 172.21.15.135:0/972317335 wait complete. 2024-04-20T12:21:45.436 INFO:teuthology.orchestra.run.smithi135.stdout:77309411399 2024-04-20T12:21:45.436 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-20T12:21:45.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.536+0000 7fb78f483700 1 -- 172.21.15.135:0/1664763845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb788106400 msgr2=0x7fb78810dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:45.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.536+0000 7fb78f483700 1 --2- 172.21.15.135:0/1664763845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb788106400 0x7fb78810dfd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb78000b0d0 tx=0x7fb78000b3e0 comp rx=0 tx=0).stop 2024-04-20T12:21:45.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.536+0000 7fb78f483700 1 -- 172.21.15.135:0/1664763845 shutdown_connections 2024-04-20T12:21:45.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.536+0000 7fb78f483700 1 --2- 172.21.15.135:0/1664763845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb788106400 0x7fb78810dfd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:45.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.536+0000 7fb78f483700 1 --2- 172.21.15.135:0/1664763845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb788101370 0x7fb788101750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:45.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.536+0000 7fb78f483700 1 --2- 172.21.15.135:0/1664763845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb788101d20 0x7fb788105d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:45.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.537+0000 7fb78f483700 1 -- 172.21.15.135:0/1664763845 >> 172.21.15.135:0/1664763845 conn(0x7fb788077fc0 msgr2=0x7fb7880ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:45.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.537+0000 7fb78f483700 1 -- 172.21.15.135:0/1664763845 shutdown_connections 2024-04-20T12:21:45.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.537+0000 7fb78f483700 1 -- 172.21.15.135:0/1664763845 wait complete. 2024-04-20T12:21:45.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.537+0000 7fb78f483700 1 Processor -- start 2024-04-20T12:21:45.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.537+0000 7fb78f483700 1 -- start start 2024-04-20T12:21:45.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.537+0000 7fb78f483700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb788101370 0x7fb78806dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:45.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.537+0000 7fb78f483700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb788101d20 0x7fb78806e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:45.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.537+0000 7fb78f483700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb788106400 0x7fb78806e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:45.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.537+0000 7fb78f483700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb788111460 con 0x7fb788101d20 2024-04-20T12:21:45.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.537+0000 7fb78f483700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881112e0 con 0x7fb788101370 2024-04-20T12:21:45.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.537+0000 7fb78f483700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881115e0 con 0x7fb788106400 2024-04-20T12:21:45.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.538+0000 7fb78ca1e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb788101d20 0x7fb78806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:45.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.538+0000 7fb78ca1e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb788101d20 0x7fb78806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43232/0 (socket says 172.21.15.135:43232) 2024-04-20T12:21:45.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.538+0000 7fb78ca1e700 1 -- 172.21.15.135:0/4179508754 learned_addr learned my addr 172.21.15.135:0/4179508754 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:45.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.538+0000 7fb78d21f700 1 --2- 172.21.15.135:0/4179508754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb788101370 0x7fb78806dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:45.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.538+0000 7fb78da20700 1 --2- 172.21.15.135:0/4179508754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb788106400 0x7fb78806e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:45.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.538+0000 7fb78ca1e700 1 -- 172.21.15.135:0/4179508754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb788106400 msgr2=0x7fb78806e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:45.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.538+0000 7fb78ca1e700 1 --2- 172.21.15.135:0/4179508754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb788106400 0x7fb78806e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:45.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.538+0000 7fb78ca1e700 1 -- 172.21.15.135:0/4179508754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb788101370 msgr2=0x7fb78806dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:45.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.538+0000 7fb78ca1e700 1 --2- 172.21.15.135:0/4179508754 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb788101370 0x7fb78806dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:45.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.538+0000 7fb78ca1e700 1 -- 172.21.15.135:0/4179508754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7880727e0 con 0x7fb788101d20 2024-04-20T12:21:45.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.538+0000 7fb78ca1e700 1 --2- 172.21.15.135:0/4179508754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb788101d20 0x7fb78806e000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb77800d950 tx=0x7fb77800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:45.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.538+0000 7fb77e7fc700 1 -- 172.21.15.135:0/4179508754 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb778016070 con 0x7fb788101d20 2024-04-20T12:21:45.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.539+0000 7fb77e7fc700 1 -- 172.21.15.135:0/4179508754 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb778004d10 con 0x7fb788101d20 2024-04-20T12:21:45.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.539+0000 7fb78f483700 1 -- 172.21.15.135:0/4179508754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb788072ad0 con 0x7fb788101d20 2024-04-20T12:21:45.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.539+0000 7fb77e7fc700 1 -- 172.21.15.135:0/4179508754 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7780055e0 con 0x7fb788101d20 2024-04-20T12:21:45.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.539+0000 7fb78f483700 1 -- 172.21.15.135:0/4179508754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb788073010 con 0x7fb788101d20 2024-04-20T12:21:45.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.539+0000 7fb78f483700 1 -- 172.21.15.135:0/4179508754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb788102800 con 0x7fb788101d20 2024-04-20T12:21:45.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.541+0000 7fb77e7fc700 1 -- 172.21.15.135:0/4179508754 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fb778004750 con 0x7fb788101d20 2024-04-20T12:21:45.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.541+0000 7fb77e7fc700 1 --2- 172.21.15.135:0/4179508754 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb7740a3cd0 0x7fb7740a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:45.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.542+0000 7fb78d21f700 1 --2- 172.21.15.135:0/4179508754 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb7740a3cd0 0x7fb7740a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:45.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.542+0000 7fb77e7fc700 1 -- 172.21.15.135:0/4179508754 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fb7780d0d80 con 0x7fb788101d20 2024-04-20T12:21:45.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.542+0000 7fb77e7fc700 1 --2- 172.21.15.135:0/4179508754 >> [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018] conn(0x7fb7740aedb0 0x7fb7740b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:45.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.542+0000 7fb77e7fc700 1 -- 172.21.15.135:0/4179508754 --> [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb778015ec0 con 0x7fb7740aedb0 2024-04-20T12:21:45.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.542+0000 7fb77e7fc700 1 -- 172.21.15.135:0/4179508754 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fb7780d1130 con 0x7fb788101d20 2024-04-20T12:21:45.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.542+0000 7fb78d21f700 1 --2- 172.21.15.135:0/4179508754 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb7740a3cd0 0x7fb7740a6190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb784009a10 tx=0x7fb784009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:45.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.542+0000 7fb78da20700 1 --2- 172.21.15.135:0/4179508754 >> [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018] conn(0x7fb7740aedb0 0x7fb7740b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:45.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.543+0000 7fb78da20700 1 --2- 172.21.15.135:0/4179508754 >> [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018] conn(0x7fb7740aedb0 0x7fb7740b1250 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:45.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.543+0000 7fb77e7fc700 1 -- 172.21.15.135:0/4179508754 <== osd.8 v2:172.21.15.154:6816/2723868018 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb778015ec0 con 0x7fb7740aedb0 2024-04-20T12:21:45.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.559+0000 7fb78f483700 1 -- 172.21.15.135:0/4179508754 --> [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb78806a170 con 0x7fb7740aedb0 2024-04-20T12:21:45.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.560+0000 7fb77e7fc700 1 -- 172.21.15.135:0/4179508754 <== osd.8 v2:172.21.15.154:6816/2723868018 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb78806a170 con 0x7fb7740aedb0 2024-04-20T12:21:45.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.560+0000 7fb78f483700 1 -- 172.21.15.135:0/4179508754 >> [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018] conn(0x7fb7740aedb0 msgr2=0x7fb7740b1250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:45.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.560+0000 7fb78f483700 1 --2- 172.21.15.135:0/4179508754 >> [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018] conn(0x7fb7740aedb0 0x7fb7740b1250 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:45.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.560+0000 7fb78f483700 1 -- 172.21.15.135:0/4179508754 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb7740a3cd0 msgr2=0x7fb7740a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:45.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.560+0000 7fb78f483700 1 --2- 172.21.15.135:0/4179508754 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb7740a3cd0 0x7fb7740a6190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb784009a10 tx=0x7fb784009190 comp rx=0 tx=0).stop 2024-04-20T12:21:45.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.560+0000 7fb78f483700 1 -- 172.21.15.135:0/4179508754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb788101d20 msgr2=0x7fb78806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:45.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.560+0000 7fb78f483700 1 --2- 172.21.15.135:0/4179508754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb788101d20 0x7fb78806e000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb77800d950 tx=0x7fb77800dc60 comp rx=0 tx=0).stop 2024-04-20T12:21:45.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.560+0000 7fb78da20700 1 -- 172.21.15.135:0/4179508754 reap_dead start 2024-04-20T12:21:45.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.560+0000 7fb78f483700 1 -- 172.21.15.135:0/4179508754 shutdown_connections 2024-04-20T12:21:45.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.560+0000 7fb78f483700 1 -- 172.21.15.135:0/4179508754 >> 172.21.15.135:0/4179508754 conn(0x7fb788077fc0 msgr2=0x7fb788104bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:45.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.561+0000 7fb78f483700 1 -- 172.21.15.135:0/4179508754 shutdown_connections 2024-04-20T12:21:45.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:43.561+0000 7fb78f483700 1 -- 172.21.15.135:0/4179508754 wait complete. 2024-04-20T12:21:46.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:45 smithi135 ceph-mon[18264]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 383 B/s wr, 8 op/s; 77 B/s, 1 keys/s, 1 objects/s recovering 2024-04-20T12:21:46.191 INFO:teuthology.orchestra.run.smithi135.stdout:253403070505 2024-04-20T12:21:46.192 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-04-20T12:21:46.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:45 smithi154 ceph-mon[22073]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 383 B/s wr, 8 op/s; 77 B/s, 1 keys/s, 1 objects/s recovering 2024-04-20T12:21:46.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:45 smithi139 ceph-mon[21834]: pgmap v326: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 383 B/s wr, 8 op/s; 77 B/s, 1 keys/s, 1 objects/s recovering 2024-04-20T12:21:46.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.462+0000 7f93d518e700 1 -- 172.21.15.135:0/3313478432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d0107950 msgr2=0x7f93d0107d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:46.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.462+0000 7f93d518e700 1 --2- 172.21.15.135:0/3313478432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d0107950 0x7f93d0107d30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009990 tx=0x7f93c0009ca0 comp rx=0 tx=0).stop 2024-04-20T12:21:46.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.462+0000 7f93d518e700 1 -- 172.21.15.135:0/3313478432 shutdown_connections 2024-04-20T12:21:46.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.462+0000 7f93d518e700 1 --2- 172.21.15.135:0/3313478432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d01023a0 0x7f93d010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:46.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.462+0000 7f93d518e700 1 --2- 172.21.15.135:0/3313478432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d0107950 0x7f93d0107d30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:46.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.462+0000 7f93d518e700 1 --2- 172.21.15.135:0/3313478432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93d01019e0 0x7f93d0101e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:46.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.462+0000 7f93d518e700 1 -- 172.21.15.135:0/3313478432 >> 172.21.15.135:0/3313478432 conn(0x7f93d00779a0 msgr2=0x7f93d0077db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:46.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.462+0000 7f93d518e700 1 -- 172.21.15.135:0/3313478432 shutdown_connections 2024-04-20T12:21:46.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.462+0000 7f93d518e700 1 -- 172.21.15.135:0/3313478432 wait complete. 2024-04-20T12:21:46.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.463+0000 7f93d518e700 1 Processor -- start 2024-04-20T12:21:46.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.463+0000 7f93d518e700 1 -- start start 2024-04-20T12:21:46.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.463+0000 7f93d518e700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d01019e0 0x7f93d0198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:46.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.463+0000 7f93d518e700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93d01023a0 0x7f93d0198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:46.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.463+0000 7f93d518e700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d0107950 0x7f93d019cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:46.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.463+0000 7f93d518e700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93d0111d40 con 0x7f93d01019e0 2024-04-20T12:21:46.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.463+0000 7f93d518e700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f93d0111bc0 con 0x7f93d01023a0 2024-04-20T12:21:46.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.463+0000 7f93d518e700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f93d0111ec0 con 0x7f93d0107950 2024-04-20T12:21:46.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.463+0000 7f93ced9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d01019e0 0x7f93d0198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:46.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.463+0000 7f93ced9d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d01019e0 0x7f93d0198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43274/0 (socket says 172.21.15.135:43274) 2024-04-20T12:21:46.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.464+0000 7f93ced9d700 1 -- 172.21.15.135:0/4098292683 learned_addr learned my addr 172.21.15.135:0/4098292683 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:46.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.464+0000 7f93ce59c700 1 --2- 172.21.15.135:0/4098292683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93d01023a0 0x7f93d0198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:46.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.464+0000 7f93cf59e700 1 --2- 172.21.15.135:0/4098292683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d0107950 0x7f93d019cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:46.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.464+0000 7f93ced9d700 1 -- 172.21.15.135:0/4098292683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d0107950 msgr2=0x7f93d019cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:46.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.464+0000 7f93ced9d700 1 --2- 172.21.15.135:0/4098292683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f93d0107950 0x7f93d019cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:46.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.464+0000 7f93ced9d700 1 -- 172.21.15.135:0/4098292683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93d01023a0 msgr2=0x7f93d0198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:46.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.464+0000 7f93ced9d700 1 --2- 172.21.15.135:0/4098292683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f93d01023a0 0x7f93d0198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:46.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.464+0000 7f93ced9d700 1 -- 172.21.15.135:0/4098292683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d019d240 con 0x7f93d01019e0 2024-04-20T12:21:46.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.464+0000 7f93ced9d700 1 --2- 172.21.15.135:0/4098292683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d01019e0 0x7f93d0198230 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f93c0000c00 tx=0x7f93c0003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:46.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.464+0000 7f93b7fff700 1 -- 172.21.15.135:0/4098292683 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0027070 con 0x7f93d01019e0 2024-04-20T12:21:46.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.464+0000 7f93d518e700 1 -- 172.21.15.135:0/4098292683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d019d4d0 con 0x7f93d01019e0 2024-04-20T12:21:46.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.464+0000 7f93b7fff700 1 -- 172.21.15.135:0/4098292683 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93c0004190 con 0x7f93d01019e0 2024-04-20T12:21:46.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.464+0000 7f93b7fff700 1 -- 172.21.15.135:0/4098292683 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c000f460 con 0x7f93d01019e0 2024-04-20T12:21:46.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.464+0000 7f93d518e700 1 -- 172.21.15.135:0/4098292683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d01a4db0 con 0x7f93d01019e0 2024-04-20T12:21:46.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.465+0000 7f93d518e700 1 -- 172.21.15.135:0/4098292683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f93bc001030 con 0x7f93d01019e0 2024-04-20T12:21:46.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.466+0000 7f93b7fff700 1 -- 172.21.15.135:0/4098292683 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f93c002a070 con 0x7f93d01019e0 2024-04-20T12:21:46.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.467+0000 7f93b7fff700 1 --2- 172.21.15.135:0/4098292683 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f93b80a3cd0 0x7f93b80a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:46.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.467+0000 7f93ce59c700 1 --2- 172.21.15.135:0/4098292683 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f93b80a3cd0 0x7f93b80a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:46.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.467+0000 7f93b7fff700 1 -- 172.21.15.135:0/4098292683 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f93c00d21d0 con 0x7f93d01019e0 2024-04-20T12:21:46.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.467+0000 7f93b7fff700 1 --2- 172.21.15.135:0/4098292683 >> [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966] conn(0x7f93b80aedb0 0x7f93b80b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:46.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.467+0000 7f93b7fff700 1 -- 172.21.15.135:0/4098292683 --> [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93b80b1920 con 0x7f93b80aedb0 2024-04-20T12:21:46.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.467+0000 7f93b7fff700 1 -- 172.21.15.135:0/4098292683 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f93c00d2620 con 0x7f93d01019e0 2024-04-20T12:21:46.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.467+0000 7f93cf59e700 1 --2- 172.21.15.135:0/4098292683 >> [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966] conn(0x7f93b80aedb0 0x7f93b80b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:46.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.467+0000 7f93ce59c700 1 --2- 172.21.15.135:0/4098292683 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f93b80a3cd0 0x7f93b80a6190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f93c4006fd0 tx=0x7f93c4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:46.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.468+0000 7f93cf59e700 1 --2- 172.21.15.135:0/4098292683 >> [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966] conn(0x7f93b80aedb0 0x7f93b80b1250 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:46.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.468+0000 7f93b7fff700 1 -- 172.21.15.135:0/4098292683 <== osd.6 v2:172.21.15.135:6818/2765424966 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93b80b1920 con 0x7f93b80aedb0 2024-04-20T12:21:46.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.486+0000 7f93d518e700 1 -- 172.21.15.135:0/4098292683 --> [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f93bc002e60 con 0x7f93b80aedb0 2024-04-20T12:21:46.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.486+0000 7f93b7fff700 1 -- 172.21.15.135:0/4098292683 <== osd.6 v2:172.21.15.135:6818/2765424966 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f93bc002e60 con 0x7f93b80aedb0 2024-04-20T12:21:46.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.486+0000 7f93d518e700 1 -- 172.21.15.135:0/4098292683 >> [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966] conn(0x7f93b80aedb0 msgr2=0x7f93b80b1250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:46.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.486+0000 7f93d518e700 1 --2- 172.21.15.135:0/4098292683 >> [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966] conn(0x7f93b80aedb0 0x7f93b80b1250 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:46.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.487+0000 7f93d518e700 1 -- 172.21.15.135:0/4098292683 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f93b80a3cd0 msgr2=0x7f93b80a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:46.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.487+0000 7f93d518e700 1 --2- 172.21.15.135:0/4098292683 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f93b80a3cd0 0x7f93b80a6190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f93c4006fd0 tx=0x7f93c4008040 comp rx=0 tx=0).stop 2024-04-20T12:21:46.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.487+0000 7f93d518e700 1 -- 172.21.15.135:0/4098292683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d01019e0 msgr2=0x7f93d0198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:46.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.487+0000 7f93d518e700 1 --2- 172.21.15.135:0/4098292683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93d01019e0 0x7f93d0198230 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f93c0000c00 tx=0x7f93c0003730 comp rx=0 tx=0).stop 2024-04-20T12:21:46.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.487+0000 7f93cf59e700 1 -- 172.21.15.135:0/4098292683 reap_dead start 2024-04-20T12:21:46.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.487+0000 7f93d518e700 1 -- 172.21.15.135:0/4098292683 shutdown_connections 2024-04-20T12:21:46.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.487+0000 7f93d518e700 1 -- 172.21.15.135:0/4098292683 >> 172.21.15.135:0/4098292683 conn(0x7f93d00779a0 msgr2=0x7f93d00ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:46.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.487+0000 7f93d518e700 1 -- 172.21.15.135:0/4098292683 shutdown_connections 2024-04-20T12:21:46.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:46.487+0000 7f93d518e700 1 -- 172.21.15.135:0/4098292683 wait complete. 2024-04-20T12:21:47.292 INFO:teuthology.orchestra.run.smithi135.stdout:34359738449 2024-04-20T12:21:47.293 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-20T12:21:47.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.588+0000 7fb8dfd12700 1 -- 172.21.15.135:0/4195089054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8d8107930 msgr2=0x7fb8d8107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:47.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.588+0000 7fb8dfd12700 1 --2- 172.21.15.135:0/4195089054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8d8107930 0x7fb8d8107d10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009990 tx=0x7fb8d4009ca0 comp rx=0 tx=0).stop 2024-04-20T12:21:47.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.588+0000 7fb8dfd12700 1 -- 172.21.15.135:0/4195089054 shutdown_connections 2024-04-20T12:21:47.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.588+0000 7fb8dfd12700 1 --2- 172.21.15.135:0/4195089054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8d8102340 0x7fb8d810e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:47.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.588+0000 7fb8dfd12700 1 --2- 172.21.15.135:0/4195089054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8d8107930 0x7fb8d8107d10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:47.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.588+0000 7fb8dfd12700 1 --2- 172.21.15.135:0/4195089054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8d8101980 0x7fb8d8101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:47.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.588+0000 7fb8dfd12700 1 -- 172.21.15.135:0/4195089054 >> 172.21.15.135:0/4195089054 conn(0x7fb8d8078920 msgr2=0x7fb8d8078d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:47.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.588+0000 7fb8dfd12700 1 -- 172.21.15.135:0/4195089054 shutdown_connections 2024-04-20T12:21:47.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.588+0000 7fb8dfd12700 1 -- 172.21.15.135:0/4195089054 wait complete. 2024-04-20T12:21:47.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8dfd12700 1 Processor -- start 2024-04-20T12:21:47.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8dfd12700 1 -- start start 2024-04-20T12:21:47.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8dfd12700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8d8101980 0x7fb8d8198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:47.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8dfd12700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8d8102340 0x7fb8d81986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:47.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8dfd12700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8d8107930 0x7fb8d819ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:47.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8dfd12700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d8111c90 con 0x7fb8d8101980 2024-04-20T12:21:47.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8dfd12700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d8111b10 con 0x7fb8d8102340 2024-04-20T12:21:47.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8dfd12700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d8111e10 con 0x7fb8d8107930 2024-04-20T12:21:47.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8ddaae700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8d8101980 0x7fb8d8198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:47.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8ddaae700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8d8101980 0x7fb8d8198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43302/0 (socket says 172.21.15.135:43302) 2024-04-20T12:21:47.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8ddaae700 1 -- 172.21.15.135:0/857508843 learned_addr learned my addr 172.21.15.135:0/857508843 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:47.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8de2af700 1 --2- 172.21.15.135:0/857508843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8d8107930 0x7fb8d819ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:47.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8ddaae700 1 -- 172.21.15.135:0/857508843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8d8107930 msgr2=0x7fb8d819ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:47.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8dd2ad700 1 --2- 172.21.15.135:0/857508843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8d8102340 0x7fb8d81986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:47.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8ddaae700 1 --2- 172.21.15.135:0/857508843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb8d8107930 0x7fb8d819ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:47.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8ddaae700 1 -- 172.21.15.135:0/857508843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8d8102340 msgr2=0x7fb8d81986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:47.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8ddaae700 1 --2- 172.21.15.135:0/857508843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb8d8102340 0x7fb8d81986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:47.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.589+0000 7fb8ddaae700 1 -- 172.21.15.135:0/857508843 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d819d140 con 0x7fb8d8101980 2024-04-20T12:21:47.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.590+0000 7fb8ddaae700 1 --2- 172.21.15.135:0/857508843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8d8101980 0x7fb8d8198180 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4000c00 tx=0x7fb8d40047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:47.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.590+0000 7fb8ceffd700 1 -- 172.21.15.135:0/857508843 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d4027070 con 0x7fb8d8101980 2024-04-20T12:21:47.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.590+0000 7fb8ceffd700 1 -- 172.21.15.135:0/857508843 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8d4004050 con 0x7fb8d8101980 2024-04-20T12:21:47.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.590+0000 7fb8ceffd700 1 -- 172.21.15.135:0/857508843 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d400f460 con 0x7fb8d8101980 2024-04-20T12:21:47.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.590+0000 7fb8dfd12700 1 -- 172.21.15.135:0/857508843 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d819d3d0 con 0x7fb8d8101980 2024-04-20T12:21:47.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.590+0000 7fb8dfd12700 1 -- 172.21.15.135:0/857508843 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d806b1a0 con 0x7fb8d8101980 2024-04-20T12:21:47.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.591+0000 7fb8dfd12700 1 -- 172.21.15.135:0/857508843 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb8d806b7d0 con 0x7fb8d8101980 2024-04-20T12:21:47.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.592+0000 7fb8ceffd700 1 -- 172.21.15.135:0/857508843 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fb8d402a070 con 0x7fb8d8101980 2024-04-20T12:21:47.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.592+0000 7fb8ceffd700 1 --2- 172.21.15.135:0/857508843 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb8c40a3d50 0x7fb8c40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:47.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.593+0000 7fb8dd2ad700 1 --2- 172.21.15.135:0/857508843 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb8c40a3d50 0x7fb8c40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:47.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.593+0000 7fb8ceffd700 1 -- 172.21.15.135:0/857508843 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fb8d40d1f10 con 0x7fb8d8101980 2024-04-20T12:21:47.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.593+0000 7fb8ceffd700 1 --2- 172.21.15.135:0/857508843 >> [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232] conn(0x7fb8c40aee30 0x7fb8c40b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:47.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.593+0000 7fb8ceffd700 1 -- 172.21.15.135:0/857508843 --> [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8d40043d0 con 0x7fb8c40aee30 2024-04-20T12:21:47.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.593+0000 7fb8ceffd700 1 -- 172.21.15.135:0/857508843 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fb8d40d2360 con 0x7fb8d8101980 2024-04-20T12:21:47.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.593+0000 7fb8dd2ad700 1 --2- 172.21.15.135:0/857508843 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb8c40a3d50 0x7fb8c40a6210 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8005950 tx=0x7fb8c80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:47.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.593+0000 7fb8de2af700 1 --2- 172.21.15.135:0/857508843 >> [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232] conn(0x7fb8c40aee30 0x7fb8c40b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:47.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.594+0000 7fb8de2af700 1 --2- 172.21.15.135:0/857508843 >> [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232] conn(0x7fb8c40aee30 0x7fb8c40b12d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:47.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.594+0000 7fb8ceffd700 1 -- 172.21.15.135:0/857508843 <== osd.10 v2:172.21.15.139:6824/367683232 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb8d40043d0 con 0x7fb8c40aee30 2024-04-20T12:21:47.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.610+0000 7fb8dfd12700 1 -- 172.21.15.135:0/857508843 --> [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb8d806bbd0 con 0x7fb8c40aee30 2024-04-20T12:21:47.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.611+0000 7fb8ceffd700 1 -- 172.21.15.135:0/857508843 <== osd.10 v2:172.21.15.139:6824/367683232 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb8d806bbd0 con 0x7fb8c40aee30 2024-04-20T12:21:47.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.611+0000 7fb8dfd12700 1 -- 172.21.15.135:0/857508843 >> [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232] conn(0x7fb8c40aee30 msgr2=0x7fb8c40b12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:47.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.611+0000 7fb8dfd12700 1 --2- 172.21.15.135:0/857508843 >> [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232] conn(0x7fb8c40aee30 0x7fb8c40b12d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:47.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.611+0000 7fb8dfd12700 1 -- 172.21.15.135:0/857508843 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb8c40a3d50 msgr2=0x7fb8c40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:47.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.611+0000 7fb8dfd12700 1 --2- 172.21.15.135:0/857508843 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb8c40a3d50 0x7fb8c40a6210 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8005950 tx=0x7fb8c80058e0 comp rx=0 tx=0).stop 2024-04-20T12:21:47.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.611+0000 7fb8dfd12700 1 -- 172.21.15.135:0/857508843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8d8101980 msgr2=0x7fb8d8198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:47.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.611+0000 7fb8dfd12700 1 --2- 172.21.15.135:0/857508843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8d8101980 0x7fb8d8198180 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4000c00 tx=0x7fb8d40047b0 comp rx=0 tx=0).stop 2024-04-20T12:21:47.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.611+0000 7fb8de2af700 1 -- 172.21.15.135:0/857508843 reap_dead start 2024-04-20T12:21:47.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.611+0000 7fb8dfd12700 1 -- 172.21.15.135:0/857508843 shutdown_connections 2024-04-20T12:21:47.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.611+0000 7fb8dfd12700 1 -- 172.21.15.135:0/857508843 >> 172.21.15.135:0/857508843 conn(0x7fb8d8078920 msgr2=0x7fb8d80ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:47.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.612+0000 7fb8dfd12700 1 -- 172.21.15.135:0/857508843 shutdown_connections 2024-04-20T12:21:47.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:47.612+0000 7fb8dfd12700 1 -- 172.21.15.135:0/857508843 wait complete. 2024-04-20T12:21:48.149 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:47 smithi135 ceph-mon[18264]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 309 B/s wr, 9 op/s; 62 B/s, 1 keys/s, 1 objects/s recovering 2024-04-20T12:21:48.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:47 smithi154 ceph-mon[22073]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 309 B/s wr, 9 op/s; 62 B/s, 1 keys/s, 1 objects/s recovering 2024-04-20T12:21:48.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:47 smithi139 ceph-mon[21834]: pgmap v327: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 309 B/s wr, 9 op/s; 62 B/s, 1 keys/s, 1 objects/s recovering 2024-04-20T12:21:48.452 INFO:teuthology.orchestra.run.smithi135.stdout:309237645343 2024-04-20T12:21:48.453 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-04-20T12:21:49.118 INFO:teuthology.orchestra.run.smithi135.stdout:197568495667 2024-04-20T12:21:49.119 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-04-20T12:21:49.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.148+0000 7f2eaa19a700 1 -- 172.21.15.135:0/301144067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea4103460 msgr2=0x7f2ea410f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:49.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.148+0000 7f2eaa19a700 1 --2- 172.21.15.135:0/301144067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea4103460 0x7f2ea410f8c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00b0a0 tx=0x7f2e9c00b3b0 comp rx=0 tx=0).stop 2024-04-20T12:21:49.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.148+0000 7f2eaa19a700 1 -- 172.21.15.135:0/301144067 shutdown_connections 2024-04-20T12:21:49.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.148+0000 7f2eaa19a700 1 --2- 172.21.15.135:0/301144067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea4103460 0x7f2ea410f8c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:49.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.148+0000 7f2eaa19a700 1 --2- 172.21.15.135:0/301144067 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ea4108a60 0x7f2ea4108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:49.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.148+0000 7f2eaa19a700 1 --2- 172.21.15.135:0/301144067 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea4102aa0 0x7f2ea4102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:49.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.148+0000 7f2eaa19a700 1 -- 172.21.15.135:0/301144067 >> 172.21.15.135:0/301144067 conn(0x7f2ea4079bb0 msgr2=0x7f2ea4079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:49.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.148+0000 7f2eaa19a700 1 -- 172.21.15.135:0/301144067 shutdown_connections 2024-04-20T12:21:49.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.148+0000 7f2eaa19a700 1 -- 172.21.15.135:0/301144067 wait complete. 2024-04-20T12:21:49.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.149+0000 7f2eaa19a700 1 Processor -- start 2024-04-20T12:21:49.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.149+0000 7f2eaa19a700 1 -- start start 2024-04-20T12:21:49.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.149+0000 7f2eaa19a700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ea4102aa0 0x7f2ea4074d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:49.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2eaa19a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea4103460 0x7f2ea4075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:49.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2eaa19a700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea4108a60 0x7f2ea40757d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:49.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2eaa19a700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4112d80 con 0x7f2ea4108a60 2024-04-20T12:21:49.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2eaa19a700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4112c00 con 0x7f2ea4102aa0 2024-04-20T12:21:49.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2eaa19a700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4112f00 con 0x7f2ea4103460 2024-04-20T12:21:49.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2ea3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea4108a60 0x7f2ea40757d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:49.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2ea3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea4108a60 0x7f2ea40757d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43322/0 (socket says 172.21.15.135:43322) 2024-04-20T12:21:49.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2ea3fff700 1 -- 172.21.15.135:0/1230767374 learned_addr learned my addr 172.21.15.135:0/1230767374 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:49.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2ea37fe700 1 --2- 172.21.15.135:0/1230767374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ea4102aa0 0x7f2ea4074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:49.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2ea2ffd700 1 --2- 172.21.15.135:0/1230767374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea4103460 0x7f2ea4075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:49.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2ea3fff700 1 -- 172.21.15.135:0/1230767374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea4103460 msgr2=0x7f2ea4075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:49.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2ea3fff700 1 --2- 172.21.15.135:0/1230767374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea4103460 0x7f2ea4075290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:49.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2ea3fff700 1 -- 172.21.15.135:0/1230767374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ea4102aa0 msgr2=0x7f2ea4074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:49.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2ea3fff700 1 --2- 172.21.15.135:0/1230767374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ea4102aa0 0x7f2ea4074d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:49.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2ea3fff700 1 -- 172.21.15.135:0/1230767374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea41a76e0 con 0x7f2ea4108a60 2024-04-20T12:21:49.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2ea3fff700 1 --2- 172.21.15.135:0/1230767374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea4108a60 0x7f2ea40757d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00b780 tx=0x7f2e9c004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:49.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2ea0ff9700 1 -- 172.21.15.135:0/1230767374 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c021070 con 0x7f2ea4108a60 2024-04-20T12:21:49.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2eaa19a700 1 -- 172.21.15.135:0/1230767374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea41a7970 con 0x7f2ea4108a60 2024-04-20T12:21:49.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2ea0ff9700 1 -- 172.21.15.135:0/1230767374 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e9c007b80 con 0x7f2ea4108a60 2024-04-20T12:21:49.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2ea0ff9700 1 -- 172.21.15.135:0/1230767374 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0052a0 con 0x7f2ea4108a60 2024-04-20T12:21:49.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.150+0000 7f2eaa19a700 1 -- 172.21.15.135:0/1230767374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea41a7eb0 con 0x7f2ea4108a60 2024-04-20T12:21:49.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.152+0000 7f2eaa19a700 1 -- 172.21.15.135:0/1230767374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2ea4063120 con 0x7f2ea4108a60 2024-04-20T12:21:49.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.152+0000 7f2ea0ff9700 1 -- 172.21.15.135:0/1230767374 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f2e9c024070 con 0x7f2ea4108a60 2024-04-20T12:21:49.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.153+0000 7f2ea0ff9700 1 --2- 172.21.15.135:0/1230767374 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2e8c0a3cd0 0x7f2e8c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:49.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.153+0000 7f2ea37fe700 1 --2- 172.21.15.135:0/1230767374 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2e8c0a3cd0 0x7f2e8c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:49.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.153+0000 7f2ea0ff9700 1 -- 172.21.15.135:0/1230767374 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f2e9c0d1880 con 0x7f2ea4108a60 2024-04-20T12:21:49.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.153+0000 7f2ea0ff9700 1 --2- 172.21.15.135:0/1230767374 >> [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376] conn(0x7f2e8c0aedb0 0x7f2e8c0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:49.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.153+0000 7f2ea0ff9700 1 -- 172.21.15.135:0/1230767374 --> [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e9c01fe80 con 0x7f2e8c0aedb0 2024-04-20T12:21:49.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.153+0000 7f2ea0ff9700 1 -- 172.21.15.135:0/1230767374 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f2e9c0d62c0 con 0x7f2ea4108a60 2024-04-20T12:21:49.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.153+0000 7f2ea37fe700 1 --2- 172.21.15.135:0/1230767374 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2e8c0a3cd0 0x7f2e8c0a6190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2e94005950 tx=0x7f2e9400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:49.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.153+0000 7f2ea2ffd700 1 --2- 172.21.15.135:0/1230767374 >> [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376] conn(0x7f2e8c0aedb0 0x7f2e8c0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:49.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.154+0000 7f2ea2ffd700 1 --2- 172.21.15.135:0/1230767374 >> [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376] conn(0x7f2e8c0aedb0 0x7f2e8c0b1250 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:49.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.154+0000 7f2ea0ff9700 1 -- 172.21.15.135:0/1230767374 <== osd.9 v2:172.21.15.135:6826/3054405376 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2e9c01fe80 con 0x7f2e8c0aedb0 2024-04-20T12:21:49.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.171+0000 7f2eaa19a700 1 -- 172.21.15.135:0/1230767374 --> [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2ea40635a0 con 0x7f2e8c0aedb0 2024-04-20T12:21:49.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.171+0000 7f2ea0ff9700 1 -- 172.21.15.135:0/1230767374 <== osd.9 v2:172.21.15.135:6826/3054405376 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2ea40635a0 con 0x7f2e8c0aedb0 2024-04-20T12:21:49.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.171+0000 7f2eaa19a700 1 -- 172.21.15.135:0/1230767374 >> [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376] conn(0x7f2e8c0aedb0 msgr2=0x7f2e8c0b1250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:49.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.171+0000 7f2eaa19a700 1 --2- 172.21.15.135:0/1230767374 >> [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376] conn(0x7f2e8c0aedb0 0x7f2e8c0b1250 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:49.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.171+0000 7f2eaa19a700 1 -- 172.21.15.135:0/1230767374 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2e8c0a3cd0 msgr2=0x7f2e8c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:49.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.171+0000 7f2eaa19a700 1 --2- 172.21.15.135:0/1230767374 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2e8c0a3cd0 0x7f2e8c0a6190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2e94005950 tx=0x7f2e9400b410 comp rx=0 tx=0).stop 2024-04-20T12:21:49.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.171+0000 7f2eaa19a700 1 -- 172.21.15.135:0/1230767374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea4108a60 msgr2=0x7f2ea40757d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:49.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.171+0000 7f2eaa19a700 1 --2- 172.21.15.135:0/1230767374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ea4108a60 0x7f2ea40757d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00b780 tx=0x7f2e9c004d00 comp rx=0 tx=0).stop 2024-04-20T12:21:49.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.171+0000 7f2ea3fff700 1 -- 172.21.15.135:0/1230767374 reap_dead start 2024-04-20T12:21:49.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.171+0000 7f2eaa19a700 1 -- 172.21.15.135:0/1230767374 shutdown_connections 2024-04-20T12:21:49.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.171+0000 7f2eaa19a700 1 -- 172.21.15.135:0/1230767374 >> 172.21.15.135:0/1230767374 conn(0x7f2ea4079bb0 msgr2=0x7f2ea4101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:49.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.172+0000 7f2eaa19a700 1 -- 172.21.15.135:0/1230767374 shutdown_connections 2024-04-20T12:21:49.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:48.172+0000 7f2eaa19a700 1 -- 172.21.15.135:0/1230767374 wait complete. 2024-04-20T12:21:49.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.980+0000 7f9ebacd7700 1 -- 172.21.15.135:0/1981362526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9eb41034c0 msgr2=0x7f9eb410f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:49.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.980+0000 7f9ebacd7700 1 --2- 172.21.15.135:0/1981362526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9eb41034c0 0x7f9eb410f8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009990 tx=0x7f9ea4009ca0 comp rx=0 tx=0).stop 2024-04-20T12:21:49.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.980+0000 7f9ebacd7700 1 -- 172.21.15.135:0/1981362526 shutdown_connections 2024-04-20T12:21:49.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.980+0000 7f9ebacd7700 1 --2- 172.21.15.135:0/1981362526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9eb41034c0 0x7f9eb410f8f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:49.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.980+0000 7f9ebacd7700 1 --2- 172.21.15.135:0/1981362526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9eb4108a90 0x7f9eb4108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:49.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.980+0000 7f9ebacd7700 1 --2- 172.21.15.135:0/1981362526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9eb4102b00 0x7f9eb4102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:49.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.980+0000 7f9ebacd7700 1 -- 172.21.15.135:0/1981362526 >> 172.21.15.135:0/1981362526 conn(0x7f9eb4079ae0 msgr2=0x7f9eb4079ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:49.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.980+0000 7f9ebacd7700 1 -- 172.21.15.135:0/1981362526 shutdown_connections 2024-04-20T12:21:49.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.980+0000 7f9ebacd7700 1 -- 172.21.15.135:0/1981362526 wait complete. 2024-04-20T12:21:49.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9ebacd7700 1 Processor -- start 2024-04-20T12:21:49.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9ebacd7700 1 -- start start 2024-04-20T12:21:49.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9ebacd7700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9eb4102b00 0x7f9eb4074d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:49.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9ebacd7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9eb41034c0 0x7f9eb4075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:49.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9ebacd7700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9eb4108a90 0x7f9eb40757d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:49.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9ebacd7700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb4112d70 con 0x7f9eb41034c0 2024-04-20T12:21:49.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9ebacd7700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb4112bf0 con 0x7f9eb4102b00 2024-04-20T12:21:49.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9ebacd7700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb4112ef0 con 0x7f9eb4108a90 2024-04-20T12:21:49.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9eb3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9eb41034c0 0x7f9eb4075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:49.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9eb3fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9eb41034c0 0x7f9eb4075290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43344/0 (socket says 172.21.15.135:43344) 2024-04-20T12:21:49.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9eb3fff700 1 -- 172.21.15.135:0/2867249501 learned_addr learned my addr 172.21.15.135:0/2867249501 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:49.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9eb8a73700 1 --2- 172.21.15.135:0/2867249501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9eb4102b00 0x7f9eb4074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:49.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9eb9274700 1 --2- 172.21.15.135:0/2867249501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9eb4108a90 0x7f9eb40757d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:49.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9eb3fff700 1 -- 172.21.15.135:0/2867249501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9eb4108a90 msgr2=0x7f9eb40757d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:49.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9eb3fff700 1 --2- 172.21.15.135:0/2867249501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9eb4108a90 0x7f9eb40757d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:49.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9eb3fff700 1 -- 172.21.15.135:0/2867249501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9eb4102b00 msgr2=0x7f9eb4074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:49.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9eb3fff700 1 --2- 172.21.15.135:0/2867249501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9eb4102b00 0x7f9eb4074d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:49.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9eb3fff700 1 -- 172.21.15.135:0/2867249501 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb41a7650 con 0x7f9eb41034c0 2024-04-20T12:21:49.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.981+0000 7f9eb9274700 1 --2- 172.21.15.135:0/2867249501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9eb4108a90 0x7f9eb40757d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:21:49.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.982+0000 7f9eb3fff700 1 --2- 172.21.15.135:0/2867249501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9eb41034c0 0x7f9eb4075290 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00c9b0 tx=0x7f9e9c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:49.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.982+0000 7f9eb1ffb700 1 -- 172.21.15.135:0/2867249501 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c007b00 con 0x7f9eb41034c0 2024-04-20T12:21:49.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.982+0000 7f9ebacd7700 1 -- 172.21.15.135:0/2867249501 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb41a7940 con 0x7f9eb41034c0 2024-04-20T12:21:49.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.982+0000 7f9eb1ffb700 1 -- 172.21.15.135:0/2867249501 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e9c007ca0 con 0x7f9eb41034c0 2024-04-20T12:21:49.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.982+0000 7f9eb1ffb700 1 -- 172.21.15.135:0/2867249501 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c018730 con 0x7f9eb41034c0 2024-04-20T12:21:49.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.982+0000 7f9ebacd7700 1 -- 172.21.15.135:0/2867249501 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb41a7ed0 con 0x7f9eb41034c0 2024-04-20T12:21:49.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.983+0000 7f9ebacd7700 1 -- 172.21.15.135:0/2867249501 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9eb4063120 con 0x7f9eb41034c0 2024-04-20T12:21:49.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.984+0000 7f9eb1ffb700 1 -- 172.21.15.135:0/2867249501 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f9e9c0188d0 con 0x7f9eb41034c0 2024-04-20T12:21:49.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.984+0000 7f9eb1ffb700 1 --2- 172.21.15.135:0/2867249501 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9ea00a3cd0 0x7f9ea00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:49.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.985+0000 7f9eb8a73700 1 --2- 172.21.15.135:0/2867249501 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9ea00a3cd0 0x7f9ea00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:49.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.985+0000 7f9eb1ffb700 1 -- 172.21.15.135:0/2867249501 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f9e9c0d0cf0 con 0x7f9eb41034c0 2024-04-20T12:21:49.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.985+0000 7f9eb1ffb700 1 --2- 172.21.15.135:0/2867249501 >> [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017] conn(0x7f9ea00aedb0 0x7f9ea00b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:49.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.985+0000 7f9eb1ffb700 1 -- 172.21.15.135:0/2867249501 --> [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ea00b1920 con 0x7f9ea00aedb0 2024-04-20T12:21:49.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.985+0000 7f9eb1ffb700 1 -- 172.21.15.135:0/2867249501 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f9e9c0d1140 con 0x7f9eb41034c0 2024-04-20T12:21:49.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.985+0000 7f9eb8a73700 1 --2- 172.21.15.135:0/2867249501 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9ea00a3cd0 0x7f9ea00a6190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009550 tx=0x7f9eac0091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:49.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.985+0000 7f9eb9274700 1 --2- 172.21.15.135:0/2867249501 >> [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017] conn(0x7f9ea00aedb0 0x7f9ea00b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:49.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.986+0000 7f9eb9274700 1 --2- 172.21.15.135:0/2867249501 >> [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017] conn(0x7f9ea00aedb0 0x7f9ea00b1250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:49.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:49.986+0000 7f9eb1ffb700 1 -- 172.21.15.135:0/2867249501 <== osd.7 v2:172.21.15.139:6816/3279788017 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ea00b1920 con 0x7f9ea00aedb0 2024-04-20T12:21:50.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:50.002+0000 7f9ebacd7700 1 -- 172.21.15.135:0/2867249501 --> [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9eb4063520 con 0x7f9ea00aedb0 2024-04-20T12:21:50.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:50.003+0000 7f9eb1ffb700 1 -- 172.21.15.135:0/2867249501 <== osd.7 v2:172.21.15.139:6816/3279788017 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9eb4063520 con 0x7f9ea00aedb0 2024-04-20T12:21:50.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:50.003+0000 7f9ebacd7700 1 -- 172.21.15.135:0/2867249501 >> [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017] conn(0x7f9ea00aedb0 msgr2=0x7f9ea00b1250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:50.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:50.003+0000 7f9ebacd7700 1 --2- 172.21.15.135:0/2867249501 >> [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017] conn(0x7f9ea00aedb0 0x7f9ea00b1250 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:50.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:50.003+0000 7f9ebacd7700 1 -- 172.21.15.135:0/2867249501 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9ea00a3cd0 msgr2=0x7f9ea00a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:50.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:50.003+0000 7f9ebacd7700 1 --2- 172.21.15.135:0/2867249501 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9ea00a3cd0 0x7f9ea00a6190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009550 tx=0x7f9eac0091b0 comp rx=0 tx=0).stop 2024-04-20T12:21:50.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:50.003+0000 7f9ebacd7700 1 -- 172.21.15.135:0/2867249501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9eb41034c0 msgr2=0x7f9eb4075290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:50.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:50.003+0000 7f9ebacd7700 1 --2- 172.21.15.135:0/2867249501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9eb41034c0 0x7f9eb4075290 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00c9b0 tx=0x7f9e9c00ccc0 comp rx=0 tx=0).stop 2024-04-20T12:21:50.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:50.003+0000 7f9eb9274700 1 -- 172.21.15.135:0/2867249501 reap_dead start 2024-04-20T12:21:50.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:50.003+0000 7f9ebacd7700 1 -- 172.21.15.135:0/2867249501 shutdown_connections 2024-04-20T12:21:50.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:50.003+0000 7f9ebacd7700 1 -- 172.21.15.135:0/2867249501 >> 172.21.15.135:0/2867249501 conn(0x7f9eb4079ae0 msgr2=0x7f9eb4101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:50.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:50.004+0000 7f9ebacd7700 1 -- 172.21.15.135:0/2867249501 shutdown_connections 2024-04-20T12:21:50.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:50.004+0000 7f9ebacd7700 1 -- 172.21.15.135:0/2867249501 wait complete. 2024-04-20T12:21:50.132 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:49 smithi139 ceph-mon[21834]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 281 B/s wr, 10 op/s; 56 B/s, 0 keys/s, 1 objects/s recovering 2024-04-20T12:21:50.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:49 smithi154 ceph-mon[22073]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 281 B/s wr, 10 op/s; 56 B/s, 0 keys/s, 1 objects/s recovering 2024-04-20T12:21:50.322 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:49 smithi135 ceph-mon[18264]: pgmap v328: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 281 B/s wr, 10 op/s; 56 B/s, 0 keys/s, 1 objects/s recovering 2024-04-20T12:21:50.641 INFO:teuthology.orchestra.run.smithi135.stdout:287762808869 2024-04-20T12:21:50.641 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-04-20T12:21:50.685 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:51.108 INFO:teuthology.orchestra.run.smithi135.stdout:219043332144 2024-04-20T12:21:51.108 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-04-20T12:21:51.119 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:51.154 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:51.168 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:51.195 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:51.195 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:51.195 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:52.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:51 smithi135 ceph-mon[18264]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 10 op/s; 51 B/s, 0 keys/s, 0 objects/s recovering 2024-04-20T12:21:52.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:51 smithi154 ceph-mon[22073]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 10 op/s; 51 B/s, 0 keys/s, 0 objects/s recovering 2024-04-20T12:21:52.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:51 smithi139 ceph-mon[21834]: pgmap v329: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 255 B/s wr, 10 op/s; 51 B/s, 0 keys/s, 0 objects/s recovering 2024-04-20T12:21:54.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:53 smithi135 ceph-mon[18264]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 51 B/s, 0 keys/s, 0 objects/s recovering 2024-04-20T12:21:54.179 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:21:54.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:53 smithi154 ceph-mon[22073]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 51 B/s, 0 keys/s, 0 objects/s recovering 2024-04-20T12:21:54.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:53 smithi139 ceph-mon[21834]: pgmap v330: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 51 B/s, 0 keys/s, 0 objects/s recovering 2024-04-20T12:21:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.011+0000 7fa42b6f6700 1 -- 172.21.15.135:0/4085995402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa424101950 msgr2=0x7fa424101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.011+0000 7fa42b6f6700 1 --2- 172.21.15.135:0/4085995402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa424101950 0x7fa424101dd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa414009990 tx=0x7fa414009ca0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.011+0000 7fa42b6f6700 1 -- 172.21.15.135:0/4085995402 shutdown_connections 2024-04-20T12:21:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.011+0000 7fa42b6f6700 1 --2- 172.21.15.135:0/4085995402 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa424102310 0x7fa42410e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.011+0000 7fa42b6f6700 1 --2- 172.21.15.135:0/4085995402 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4241079a0 0x7fa424107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.011+0000 7fa42b6f6700 1 --2- 172.21.15.135:0/4085995402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa424101950 0x7fa424101dd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.011+0000 7fa42b6f6700 1 -- 172.21.15.135:0/4085995402 >> 172.21.15.135:0/4085995402 conn(0x7fa424078900 msgr2=0x7fa424078d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.011+0000 7fa42b6f6700 1 -- 172.21.15.135:0/4085995402 shutdown_connections 2024-04-20T12:21:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.011+0000 7fa42b6f6700 1 -- 172.21.15.135:0/4085995402 wait complete. 2024-04-20T12:21:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa42b6f6700 1 Processor -- start 2024-04-20T12:21:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa42b6f6700 1 -- start start 2024-04-20T12:21:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa42b6f6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa424101950 0x7fa424198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa42b6f6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa424102310 0x7fa424198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa42b6f6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4241079a0 0x7fa42419ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa42b6f6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa424111cc0 con 0x7fa424101950 2024-04-20T12:21:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa42b6f6700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa424111b40 con 0x7fa424102310 2024-04-20T12:21:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa42b6f6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa424111e40 con 0x7fa4241079a0 2024-04-20T12:21:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa429492700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa424101950 0x7fa424198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa429492700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa424101950 0x7fa424198150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39548/0 (socket says 172.21.15.135:39548) 2024-04-20T12:21:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa429492700 1 -- 172.21.15.135:0/1794385187 learned_addr learned my addr 172.21.15.135:0/1794385187 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa429c93700 1 --2- 172.21.15.135:0/1794385187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4241079a0 0x7fa42419ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa428c91700 1 --2- 172.21.15.135:0/1794385187 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa424102310 0x7fa424198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa429492700 1 -- 172.21.15.135:0/1794385187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4241079a0 msgr2=0x7fa42419ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa429492700 1 --2- 172.21.15.135:0/1794385187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4241079a0 0x7fa42419ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa429492700 1 -- 172.21.15.135:0/1794385187 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa424102310 msgr2=0x7fa424198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa429492700 1 --2- 172.21.15.135:0/1794385187 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa424102310 0x7fa424198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa429492700 1 -- 172.21.15.135:0/1794385187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42419d160 con 0x7fa424101950 2024-04-20T12:21:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.012+0000 7fa429c93700 1 --2- 172.21.15.135:0/1794385187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4241079a0 0x7fa42419ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:21:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.013+0000 7fa429492700 1 --2- 172.21.15.135:0/1794385187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa424101950 0x7fa424198150 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa42000b530 tx=0x7fa42000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.013+0000 7fa41a7fc700 1 -- 172.21.15.135:0/1794385187 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420015020 con 0x7fa424101950 2024-04-20T12:21:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.013+0000 7fa41a7fc700 1 -- 172.21.15.135:0/1794385187 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa420011d10 con 0x7fa424101950 2024-04-20T12:21:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.013+0000 7fa42b6f6700 1 -- 172.21.15.135:0/1794385187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42419d450 con 0x7fa424101950 2024-04-20T12:21:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.013+0000 7fa41a7fc700 1 -- 172.21.15.135:0/1794385187 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420010e50 con 0x7fa424101950 2024-04-20T12:21:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.013+0000 7fa42b6f6700 1 -- 172.21.15.135:0/1794385187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa42406a730 con 0x7fa424101950 2024-04-20T12:21:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.014+0000 7fa42b6f6700 1 -- 172.21.15.135:0/1794385187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa424069740 con 0x7fa424101950 2024-04-20T12:21:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.015+0000 7fa41a7fc700 1 -- 172.21.15.135:0/1794385187 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fa420018020 con 0x7fa424101950 2024-04-20T12:21:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.015+0000 7fa41a7fc700 1 --2- 172.21.15.135:0/1794385187 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa4100a3e70 0x7fa4100a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.016+0000 7fa428c91700 1 --2- 172.21.15.135:0/1794385187 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa4100a3e70 0x7fa4100a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.016+0000 7fa41a7fc700 1 -- 172.21.15.135:0/1794385187 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fa4200d0010 con 0x7fa424101950 2024-04-20T12:21:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.016+0000 7fa428c91700 1 --2- 172.21.15.135:0/1794385187 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa4100a3e70 0x7fa4100a6330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa414006010 tx=0x7fa41400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:56.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.020+0000 7fa41a7fc700 1 -- 172.21.15.135:0/1794385187 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fa42001f020 con 0x7fa424101950 2024-04-20T12:21:56.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:55 smithi135 ceph-mon[18264]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:21:56.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.220+0000 7fe72b585700 1 -- 172.21.15.135:0/1499552808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe724101940 msgr2=0x7fe724101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:56.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.221+0000 7fe72b585700 1 --2- 172.21.15.135:0/1499552808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe724101940 0x7fe724101dc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe714009990 tx=0x7fe714009ca0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.221+0000 7fe72b585700 1 -- 172.21.15.135:0/1499552808 shutdown_connections 2024-04-20T12:21:56.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.221+0000 7fe72b585700 1 --2- 172.21.15.135:0/1499552808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe724102300 0x7fe72410e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.221+0000 7fe72b585700 1 --2- 172.21.15.135:0/1499552808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe724107990 0x7fe724107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.221+0000 7fe72b585700 1 --2- 172.21.15.135:0/1499552808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe724101940 0x7fe724101dc0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.221+0000 7fe72b585700 1 -- 172.21.15.135:0/1499552808 >> 172.21.15.135:0/1499552808 conn(0x7fe7240788c0 msgr2=0x7fe724078cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:56.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.221+0000 7fe72b585700 1 -- 172.21.15.135:0/1499552808 shutdown_connections 2024-04-20T12:21:56.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.221+0000 7fe72b585700 1 -- 172.21.15.135:0/1499552808 wait complete. 2024-04-20T12:21:56.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.221+0000 7fe72b585700 1 Processor -- start 2024-04-20T12:21:56.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.221+0000 7fe72b585700 1 -- start start 2024-04-20T12:21:56.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe72b585700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe724101940 0x7fe724199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:56.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe72b585700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe724102300 0x7fe724199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:56.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe72b585700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe724107990 0x7fe72419db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:56.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe72b585700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe724111c30 con 0x7fe724102300 2024-04-20T12:21:56.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe72b585700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe724111ab0 con 0x7fe724107990 2024-04-20T12:21:56.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe72b585700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe724111db0 con 0x7fe724101940 2024-04-20T12:21:56.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe728b20700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe724102300 0x7fe724199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:56.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe728b20700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe724102300 0x7fe724199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39564/0 (socket says 172.21.15.135:39564) 2024-04-20T12:21:56.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe728b20700 1 -- 172.21.15.135:0/1893439519 learned_addr learned my addr 172.21.15.135:0/1893439519 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:21:56.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe729321700 1 --2- 172.21.15.135:0/1893439519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe724101940 0x7fe724199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:56.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe729b22700 1 --2- 172.21.15.135:0/1893439519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe724107990 0x7fe72419db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:56.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe728b20700 1 -- 172.21.15.135:0/1893439519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe724101940 msgr2=0x7fe724199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:56.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe728b20700 1 --2- 172.21.15.135:0/1893439519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe724101940 0x7fe724199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe728b20700 1 -- 172.21.15.135:0/1893439519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe724107990 msgr2=0x7fe72419db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:56.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe728b20700 1 --2- 172.21.15.135:0/1893439519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe724107990 0x7fe72419db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe728b20700 1 -- 172.21.15.135:0/1893439519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72419e260 con 0x7fe724102300 2024-04-20T12:21:56.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe728b20700 1 --2- 172.21.15.135:0/1893439519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe724102300 0x7fe724199790 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe7140038b0 tx=0x7fe714009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:56.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe71a7fc700 1 -- 172.21.15.135:0/1893439519 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe714027070 con 0x7fe724102300 2024-04-20T12:21:56.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe72b585700 1 -- 172.21.15.135:0/1893439519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe72419e4f0 con 0x7fe724102300 2024-04-20T12:21:56.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe71a7fc700 1 -- 172.21.15.135:0/1893439519 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe714004050 con 0x7fe724102300 2024-04-20T12:21:56.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe71a7fc700 1 -- 172.21.15.135:0/1893439519 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe714022cd0 con 0x7fe724102300 2024-04-20T12:21:56.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.222+0000 7fe72b585700 1 -- 172.21.15.135:0/1893439519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7241a5dd0 con 0x7fe724102300 2024-04-20T12:21:56.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.223+0000 7fe72b585700 1 -- 172.21.15.135:0/1893439519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe724069740 con 0x7fe724102300 2024-04-20T12:21:56.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.224+0000 7fe71a7fc700 1 -- 172.21.15.135:0/1893439519 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fe71402a070 con 0x7fe724102300 2024-04-20T12:21:56.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.225+0000 7fe71a7fc700 1 --2- 172.21.15.135:0/1893439519 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe7100a3cd0 0x7fe7100a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:21:56.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.225+0000 7fe729321700 1 --2- 172.21.15.135:0/1893439519 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe7100a3cd0 0x7fe7100a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:21:56.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.225+0000 7fe71a7fc700 1 -- 172.21.15.135:0/1893439519 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fe7140d16e0 con 0x7fe724102300 2024-04-20T12:21:56.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.225+0000 7fe729321700 1 --2- 172.21.15.135:0/1893439519 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe7100a3cd0 0x7fe7100a6190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe720005950 tx=0x7fe72000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:21:56.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.229+0000 7fa42b6f6700 1 -- 172.21.15.135:0/1794385187 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa42406b1c0 con 0x7fa424101950 2024-04-20T12:21:56.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.230+0000 7fe71a7fc700 1 -- 172.21.15.135:0/1893439519 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fe71405eff0 con 0x7fe724102300 2024-04-20T12:21:56.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.230+0000 7fa41a7fc700 1 -- 172.21.15.135:0/1794385187 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa42009c660 con 0x7fa424101950 2024-04-20T12:21:56.232 INFO:teuthology.orchestra.run.smithi135.stdout:141733920832 2024-04-20T12:21:56.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.232+0000 7fa42b6f6700 1 -- 172.21.15.135:0/1794385187 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa4100a3e70 msgr2=0x7fa4100a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:56.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.232+0000 7fa42b6f6700 1 --2- 172.21.15.135:0/1794385187 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa4100a3e70 0x7fa4100a6330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa414006010 tx=0x7fa41400b540 comp rx=0 tx=0).stop 2024-04-20T12:21:56.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.232+0000 7fa42b6f6700 1 -- 172.21.15.135:0/1794385187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa424101950 msgr2=0x7fa424198150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:56.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.232+0000 7fa42b6f6700 1 --2- 172.21.15.135:0/1794385187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa424101950 0x7fa424198150 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa42000b530 tx=0x7fa42000b8f0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.232+0000 7fa42b6f6700 1 -- 172.21.15.135:0/1794385187 shutdown_connections 2024-04-20T12:21:56.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.232+0000 7fa42b6f6700 1 --2- 172.21.15.135:0/1794385187 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa4100a3e70 0x7fa4100a6330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.232+0000 7fa42b6f6700 1 --2- 172.21.15.135:0/1794385187 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4241079a0 0x7fa42419ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.232+0000 7fa42b6f6700 1 --2- 172.21.15.135:0/1794385187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa424101950 0x7fa424198150 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.232+0000 7fa42b6f6700 1 --2- 172.21.15.135:0/1794385187 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa424102310 0x7fa424198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.232+0000 7fa42b6f6700 1 -- 172.21.15.135:0/1794385187 >> 172.21.15.135:0/1794385187 conn(0x7fa424078900 msgr2=0x7fa4240ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:56.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.232+0000 7fa42b6f6700 1 -- 172.21.15.135:0/1794385187 shutdown_connections 2024-04-20T12:21:56.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.232+0000 7fa42b6f6700 1 -- 172.21.15.135:0/1794385187 wait complete. 2024-04-20T12:21:56.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:55 smithi154 ceph-mon[22073]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:21:56.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:55 smithi139 ceph-mon[21834]: pgmap v331: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:21:56.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.438+0000 7fe72b585700 1 -- 172.21.15.135:0/1893439519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe72402df90 con 0x7fe724102300 2024-04-20T12:21:56.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.439+0000 7fe71a7fc700 1 -- 172.21.15.135:0/1893439519 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe714013070 con 0x7fe724102300 2024-04-20T12:21:56.439 INFO:teuthology.orchestra.run.smithi135.stdout:163208757307 2024-04-20T12:21:56.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.442+0000 7fe72b585700 1 -- 172.21.15.135:0/1893439519 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe7100a3cd0 msgr2=0x7fe7100a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:56.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.442+0000 7fe72b585700 1 --2- 172.21.15.135:0/1893439519 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe7100a3cd0 0x7fe7100a6190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe720005950 tx=0x7fe72000b410 comp rx=0 tx=0).stop 2024-04-20T12:21:56.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.442+0000 7fe72b585700 1 -- 172.21.15.135:0/1893439519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe724102300 msgr2=0x7fe724199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:21:56.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.442+0000 7fe72b585700 1 --2- 172.21.15.135:0/1893439519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe724102300 0x7fe724199790 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe7140038b0 tx=0x7fe714009f50 comp rx=0 tx=0).stop 2024-04-20T12:21:56.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.442+0000 7fe72b585700 1 -- 172.21.15.135:0/1893439519 shutdown_connections 2024-04-20T12:21:56.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.442+0000 7fe72b585700 1 --2- 172.21.15.135:0/1893439519 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe7100a3cd0 0x7fe7100a6190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.442+0000 7fe72b585700 1 --2- 172.21.15.135:0/1893439519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe724107990 0x7fe72419db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.442+0000 7fe72b585700 1 --2- 172.21.15.135:0/1893439519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe724101940 0x7fe724199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.442+0000 7fe72b585700 1 --2- 172.21.15.135:0/1893439519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe724102300 0x7fe724199790 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:21:56.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.442+0000 7fe72b585700 1 -- 172.21.15.135:0/1893439519 >> 172.21.15.135:0/1893439519 conn(0x7fe7240788c0 msgr2=0x7fe72406b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:21:56.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.442+0000 7fe72b585700 1 -- 172.21.15.135:0/1893439519 shutdown_connections 2024-04-20T12:21:56.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:21:56.442+0000 7fe72b585700 1 -- 172.21.15.135:0/1893439519 wait complete. 2024-04-20T12:21:57.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:56 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1794385187' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-20T12:21:57.151 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:56 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1893439519' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-20T12:21:57.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:56 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1794385187' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-20T12:21:57.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:56 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1893439519' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-20T12:21:57.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:56 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1794385187' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-20T12:21:57.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:56 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1893439519' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-20T12:21:58.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:57 smithi135 ceph-mon[18264]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:21:58.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:57 smithi154 ceph-mon[22073]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:21:58.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:57 smithi139 ceph-mon[21834]: pgmap v332: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:21:59.937 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:21:59 smithi135 ceph-mon[18264]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-20T12:22:00.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:21:59 smithi154 ceph-mon[22073]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-20T12:22:00.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:21:59 smithi139 ceph-mon[21834]: pgmap v333: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-20T12:22:01.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.035+0000 7f023e086700 1 -- 172.21.15.135:0/2871432936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0238101950 msgr2=0x7f0238101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:01.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.035+0000 7f023e086700 1 --2- 172.21.15.135:0/2871432936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0238101950 0x7f0238101dd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f022c009990 tx=0x7f022c009ca0 comp rx=0 tx=0).stop 2024-04-20T12:22:01.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.035+0000 7f023e086700 1 -- 172.21.15.135:0/2871432936 shutdown_connections 2024-04-20T12:22:01.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.035+0000 7f023e086700 1 --2- 172.21.15.135:0/2871432936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0238102310 0x7f023810e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:01.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.035+0000 7f023e086700 1 --2- 172.21.15.135:0/2871432936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02381079a0 0x7f0238107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:01.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.035+0000 7f023e086700 1 --2- 172.21.15.135:0/2871432936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0238101950 0x7f0238101dd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:01.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.035+0000 7f023e086700 1 -- 172.21.15.135:0/2871432936 >> 172.21.15.135:0/2871432936 conn(0x7f0238078900 msgr2=0x7f0238078d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:01.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.035+0000 7f023e086700 1 -- 172.21.15.135:0/2871432936 shutdown_connections 2024-04-20T12:22:01.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.035+0000 7f023e086700 1 -- 172.21.15.135:0/2871432936 wait complete. 2024-04-20T12:22:01.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.036+0000 7f023e086700 1 Processor -- start 2024-04-20T12:22:01.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.036+0000 7f023e086700 1 -- start start 2024-04-20T12:22:01.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.036+0000 7f023e086700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0238101950 0x7f02381992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:01.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.036+0000 7f023e086700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0238102310 0x7f02381997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:01.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.036+0000 7f023e086700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02381079a0 0x7f023819db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:01.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.036+0000 7f023e086700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0238111c50 con 0x7f0238102310 2024-04-20T12:22:01.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.036+0000 7f023e086700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0238111ad0 con 0x7f02381079a0 2024-04-20T12:22:01.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.036+0000 7f023e086700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0238111dd0 con 0x7f0238101950 2024-04-20T12:22:01.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.036+0000 7f0236ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0238102310 0x7f02381997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:01.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.037+0000 7f0236ffd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0238102310 0x7f02381997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58848/0 (socket says 172.21.15.135:58848) 2024-04-20T12:22:01.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.037+0000 7f02377fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0238101950 0x7f02381992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:01.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.037+0000 7f0236ffd700 1 -- 172.21.15.135:0/3078697829 learned_addr learned my addr 172.21.15.135:0/3078697829 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:01.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.037+0000 7f0237fff700 1 --2- 172.21.15.135:0/3078697829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02381079a0 0x7f023819db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:01.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.037+0000 7f0236ffd700 1 -- 172.21.15.135:0/3078697829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0238101950 msgr2=0x7f02381992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:01.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.037+0000 7f0236ffd700 1 --2- 172.21.15.135:0/3078697829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0238101950 0x7f02381992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:01.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.037+0000 7f0236ffd700 1 -- 172.21.15.135:0/3078697829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02381079a0 msgr2=0x7f023819db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:01.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.037+0000 7f0236ffd700 1 --2- 172.21.15.135:0/3078697829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02381079a0 0x7f023819db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:01.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.037+0000 7f0236ffd700 1 -- 172.21.15.135:0/3078697829 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023819e260 con 0x7f0238102310 2024-04-20T12:22:01.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.037+0000 7f0236ffd700 1 --2- 172.21.15.135:0/3078697829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0238102310 0x7f02381997e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f022c000c00 tx=0x7f022c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:01.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.037+0000 7f0234ff9700 1 -- 172.21.15.135:0/3078697829 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c027070 con 0x7f0238102310 2024-04-20T12:22:01.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.037+0000 7f023e086700 1 -- 172.21.15.135:0/3078697829 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023819e4f0 con 0x7f0238102310 2024-04-20T12:22:01.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.037+0000 7f0234ff9700 1 -- 172.21.15.135:0/3078697829 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f022c003e40 con 0x7f0238102310 2024-04-20T12:22:01.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.037+0000 7f0234ff9700 1 -- 172.21.15.135:0/3078697829 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c022d10 con 0x7f0238102310 2024-04-20T12:22:01.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.037+0000 7f023e086700 1 -- 172.21.15.135:0/3078697829 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02381a5dd0 con 0x7f0238102310 2024-04-20T12:22:01.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.038+0000 7f023e086700 1 -- 172.21.15.135:0/3078697829 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0238069740 con 0x7f0238102310 2024-04-20T12:22:01.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.039+0000 7f0234ff9700 1 -- 172.21.15.135:0/3078697829 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f022c02a070 con 0x7f0238102310 2024-04-20T12:22:01.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.040+0000 7f0234ff9700 1 --2- 172.21.15.135:0/3078697829 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02200a3cd0 0x7f02200a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:01.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.040+0000 7f02377fe700 1 --2- 172.21.15.135:0/3078697829 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02200a3cd0 0x7f02200a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:01.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.040+0000 7f0234ff9700 1 -- 172.21.15.135:0/3078697829 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f022c0d1db0 con 0x7f0238102310 2024-04-20T12:22:01.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.040+0000 7f02377fe700 1 --2- 172.21.15.135:0/3078697829 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02200a3cd0 0x7f02200a6190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0228005950 tx=0x7f022800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:01.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.044+0000 7f0234ff9700 1 -- 172.21.15.135:0/3078697829 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f022c031070 con 0x7f0238102310 2024-04-20T12:22:01.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.256+0000 7f023e086700 1 -- 172.21.15.135:0/3078697829 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f023802df90 con 0x7f0238102310 2024-04-20T12:22:01.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.256+0000 7f0234ff9700 1 -- 172.21.15.135:0/3078697829 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f022c013070 con 0x7f0238102310 2024-04-20T12:22:01.256 INFO:teuthology.orchestra.run.smithi135.stdout:253403070509 2024-04-20T12:22:01.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.259+0000 7f023e086700 1 -- 172.21.15.135:0/3078697829 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02200a3cd0 msgr2=0x7f02200a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:01.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.259+0000 7f023e086700 1 --2- 172.21.15.135:0/3078697829 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02200a3cd0 0x7f02200a6190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0228005950 tx=0x7f022800b410 comp rx=0 tx=0).stop 2024-04-20T12:22:01.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.259+0000 7f023e086700 1 -- 172.21.15.135:0/3078697829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0238102310 msgr2=0x7f02381997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:01.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.259+0000 7f023e086700 1 --2- 172.21.15.135:0/3078697829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0238102310 0x7f02381997e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f022c000c00 tx=0x7f022c0047b0 comp rx=0 tx=0).stop 2024-04-20T12:22:01.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.259+0000 7f023e086700 1 -- 172.21.15.135:0/3078697829 shutdown_connections 2024-04-20T12:22:01.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.259+0000 7f023e086700 1 --2- 172.21.15.135:0/3078697829 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02200a3cd0 0x7f02200a6190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:01.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.259+0000 7f023e086700 1 --2- 172.21.15.135:0/3078697829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f02381079a0 0x7f023819db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:01.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.259+0000 7f023e086700 1 --2- 172.21.15.135:0/3078697829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0238101950 0x7f02381992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:01.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.259+0000 7f023e086700 1 --2- 172.21.15.135:0/3078697829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0238102310 0x7f02381997e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:01.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.259+0000 7f023e086700 1 -- 172.21.15.135:0/3078697829 >> 172.21.15.135:0/3078697829 conn(0x7f0238078900 msgr2=0x7f023806ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:01.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.259+0000 7f023e086700 1 -- 172.21.15.135:0/3078697829 shutdown_connections 2024-04-20T12:22:01.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:01.259+0000 7f023e086700 1 -- 172.21.15.135:0/3078697829 wait complete. 2024-04-20T12:22:01.993 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:22:01.993 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:22:02.192 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:01 smithi135 ceph-mon[18264]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:22:02.192 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:01 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3078697829' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-20T12:22:02.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:01 smithi154 ceph-mon[22073]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:22:02.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:01 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3078697829' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-20T12:22:02.299 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:22:02.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.302+0000 7f0b13212700 1 -- 172.21.15.135:0/268360431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b0c06aff0 msgr2=0x7f0b0c06b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:02.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.302+0000 7f0b13212700 1 --2- 172.21.15.135:0/268360431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b0c06aff0 0x7f0b0c06b450 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009990 tx=0x7f0afc009ca0 comp rx=0 tx=0).stop 2024-04-20T12:22:02.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.302+0000 7f0b13212700 1 -- 172.21.15.135:0/268360431 shutdown_connections 2024-04-20T12:22:02.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.302+0000 7f0b13212700 1 --2- 172.21.15.135:0/268360431 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b0c06b990 0x7f0b0c10f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:02.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.302+0000 7f0b13212700 1 --2- 172.21.15.135:0/268360431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b0c108a30 0x7f0b0c108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:02.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.302+0000 7f0b13212700 1 --2- 172.21.15.135:0/268360431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b0c06aff0 0x7f0b0c06b450 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:02.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.302+0000 7f0b13212700 1 -- 172.21.15.135:0/268360431 >> 172.21.15.135:0/268360431 conn(0x7f0b0c0788c0 msgr2=0x7f0b0c078cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:02.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.302+0000 7f0b13212700 1 -- 172.21.15.135:0/268360431 shutdown_connections 2024-04-20T12:22:02.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.302+0000 7f0b13212700 1 -- 172.21.15.135:0/268360431 wait complete. 2024-04-20T12:22:02.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b13212700 1 Processor -- start 2024-04-20T12:22:02.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b13212700 1 -- start start 2024-04-20T12:22:02.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b13212700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b0c06aff0 0x7f0b0c101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:02.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b13212700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b0c06b990 0x7f0b0c101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:02.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b13212700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b0c108a30 0x7f0b0c102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:02.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b13212700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c112d90 con 0x7f0b0c108a30 2024-04-20T12:22:02.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b13212700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c112c10 con 0x7f0b0c06aff0 2024-04-20T12:22:02.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b13212700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0c112f10 con 0x7f0b0c06b990 2024-04-20T12:22:02.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b117af700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b0c108a30 0x7f0b0c102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:02.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b117af700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b0c108a30 0x7f0b0c102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58878/0 (socket says 172.21.15.135:58878) 2024-04-20T12:22:02.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b117af700 1 -- 172.21.15.135:0/230390200 learned_addr learned my addr 172.21.15.135:0/230390200 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:02.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b0bfff700 1 --2- 172.21.15.135:0/230390200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b0c06b990 0x7f0b0c101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:02.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b10fae700 1 --2- 172.21.15.135:0/230390200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b0c06aff0 0x7f0b0c101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:02.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b117af700 1 -- 172.21.15.135:0/230390200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b0c06b990 msgr2=0x7f0b0c101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:02.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b117af700 1 --2- 172.21.15.135:0/230390200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b0c06b990 0x7f0b0c101f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:02.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b117af700 1 -- 172.21.15.135:0/230390200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b0c06aff0 msgr2=0x7f0b0c101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:02.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b117af700 1 --2- 172.21.15.135:0/230390200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b0c06aff0 0x7f0b0c101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:02.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b117af700 1 -- 172.21.15.135:0/230390200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0c1a7810 con 0x7f0b0c108a30 2024-04-20T12:22:02.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.303+0000 7f0b10fae700 1 --2- 172.21.15.135:0/230390200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b0c06aff0 0x7f0b0c101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:02.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.304+0000 7f0b117af700 1 --2- 172.21.15.135:0/230390200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b0c108a30 0x7f0b0c102490 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000c970 tx=0x7f0b0000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:02.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.304+0000 7f0b09ffb700 1 -- 172.21.15.135:0/230390200 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0000ce60 con 0x7f0b0c108a30 2024-04-20T12:22:02.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.304+0000 7f0b13212700 1 -- 172.21.15.135:0/230390200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b0c1a7b00 con 0x7f0b0c108a30 2024-04-20T12:22:02.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.304+0000 7f0b09ffb700 1 -- 172.21.15.135:0/230390200 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b00004830 con 0x7f0b0c108a30 2024-04-20T12:22:02.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.304+0000 7f0b09ffb700 1 -- 172.21.15.135:0/230390200 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b000055a0 con 0x7f0b0c108a30 2024-04-20T12:22:02.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.305+0000 7f0b13212700 1 -- 172.21.15.135:0/230390200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b0c1a8040 con 0x7f0b0c108a30 2024-04-20T12:22:02.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.306+0000 7f0b13212700 1 -- 172.21.15.135:0/230390200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b0c069740 con 0x7f0b0c108a30 2024-04-20T12:22:02.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.306+0000 7f0b09ffb700 1 -- 172.21.15.135:0/230390200 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f0b000049e0 con 0x7f0b0c108a30 2024-04-20T12:22:02.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.307+0000 7f0b09ffb700 1 --2- 172.21.15.135:0/230390200 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0af40a3cd0 0x7f0af40a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:02.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.308+0000 7f0b09ffb700 1 -- 172.21.15.135:0/230390200 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f0b000d0120 con 0x7f0b0c108a30 2024-04-20T12:22:02.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.308+0000 7f0b10fae700 1 --2- 172.21.15.135:0/230390200 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0af40a3cd0 0x7f0af40a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:02.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.308+0000 7f0b10fae700 1 --2- 172.21.15.135:0/230390200 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0af40a3cd0 0x7f0af40a6190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009d50 tx=0x7f0b04009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:02.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.312+0000 7f0b09ffb700 1 -- 172.21.15.135:0/230390200 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f0b00014030 con 0x7f0b0c108a30 2024-04-20T12:22:02.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:01 smithi139 ceph-mon[21834]: pgmap v334: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:22:02.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:01 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3078697829' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-04-20T12:22:02.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.531+0000 7f0b13212700 1 -- 172.21.15.135:0/230390200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f0b0c102f40 con 0x7f0b0c108a30 2024-04-20T12:22:02.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.532+0000 7f0b09ffb700 1 -- 172.21.15.135:0/230390200 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f0b0009c660 con 0x7f0b0c108a30 2024-04-20T12:22:02.531 INFO:teuthology.orchestra.run.smithi135.stdout:309237645346 2024-04-20T12:22:02.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.534+0000 7f0b13212700 1 -- 172.21.15.135:0/230390200 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0af40a3cd0 msgr2=0x7f0af40a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:02.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.534+0000 7f0b13212700 1 --2- 172.21.15.135:0/230390200 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0af40a3cd0 0x7f0af40a6190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009d50 tx=0x7f0b04009040 comp rx=0 tx=0).stop 2024-04-20T12:22:02.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.534+0000 7f0b13212700 1 -- 172.21.15.135:0/230390200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b0c108a30 msgr2=0x7f0b0c102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:02.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.534+0000 7f0b13212700 1 --2- 172.21.15.135:0/230390200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b0c108a30 0x7f0b0c102490 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0b0000c970 tx=0x7f0b0000cc80 comp rx=0 tx=0).stop 2024-04-20T12:22:02.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.534+0000 7f0b13212700 1 -- 172.21.15.135:0/230390200 shutdown_connections 2024-04-20T12:22:02.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.534+0000 7f0b13212700 1 --2- 172.21.15.135:0/230390200 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0af40a3cd0 0x7f0af40a6190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:02.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.534+0000 7f0b13212700 1 --2- 172.21.15.135:0/230390200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b0c108a30 0x7f0b0c102490 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:02.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.534+0000 7f0b13212700 1 --2- 172.21.15.135:0/230390200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0b0c06aff0 0x7f0b0c101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:02.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.534+0000 7f0b13212700 1 --2- 172.21.15.135:0/230390200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0b0c06b990 0x7f0b0c101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:02.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.534+0000 7f0b13212700 1 -- 172.21.15.135:0/230390200 >> 172.21.15.135:0/230390200 conn(0x7f0b0c0788c0 msgr2=0x7f0b0c0ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:02.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.534+0000 7f0b13212700 1 -- 172.21.15.135:0/230390200 shutdown_connections 2024-04-20T12:22:02.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.534+0000 7f0b13212700 1 -- 172.21.15.135:0/230390200 wait complete. 2024-04-20T12:22:02.887 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:22:02.921 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757304 got 163208757307 for osd.5 2024-04-20T12:22:02.921 DEBUG:teuthology.parallel:result is None 2024-04-20T12:22:03.142 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:02 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/996369014' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-20T12:22:03.142 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:02 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/230390200' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-20T12:22:03.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:02 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/996369014' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-20T12:22:03.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:02 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/230390200' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-20T12:22:03.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:02 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/996369014' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-04-20T12:22:03.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:02 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/230390200' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-04-20T12:22:03.951 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:03 smithi135 ceph-mon[18264]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-20T12:22:03.983 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645343 got 309237645346 for osd.10 2024-04-20T12:22:03.983 DEBUG:teuthology.parallel:result is None 2024-04-20T12:22:04.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:03 smithi154 ceph-mon[22073]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-20T12:22:04.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:03 smithi139 ceph-mon[21834]: pgmap v335: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-20T12:22:05.441 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920826 got 141733920832 for osd.4 2024-04-20T12:22:05.441 DEBUG:teuthology.parallel:result is None 2024-04-20T12:22:05.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.195+0000 7f177304c700 1 -- 172.21.15.135:0/1119236997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f176c102310 msgr2=0x7f176c10e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:05.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.195+0000 7f177304c700 1 --2- 172.21.15.135:0/1119236997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f176c102310 0x7f176c10e800 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f176400b0a0 tx=0x7f176400b3b0 comp rx=0 tx=0).stop 2024-04-20T12:22:05.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.195+0000 7f177304c700 1 -- 172.21.15.135:0/1119236997 shutdown_connections 2024-04-20T12:22:05.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.195+0000 7f177304c700 1 --2- 172.21.15.135:0/1119236997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f176c102310 0x7f176c10e800 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:05.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.195+0000 7f177304c700 1 --2- 172.21.15.135:0/1119236997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f176c1079a0 0x7f176c107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:05.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.195+0000 7f177304c700 1 --2- 172.21.15.135:0/1119236997 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f176c101950 0x7f176c101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:05.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.195+0000 7f177304c700 1 -- 172.21.15.135:0/1119236997 >> 172.21.15.135:0/1119236997 conn(0x7f176c078900 msgr2=0x7f176c078d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:05.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.195+0000 7f177304c700 1 -- 172.21.15.135:0/1119236997 shutdown_connections 2024-04-20T12:22:05.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.195+0000 7f177304c700 1 -- 172.21.15.135:0/1119236997 wait complete. 2024-04-20T12:22:05.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f177304c700 1 Processor -- start 2024-04-20T12:22:05.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f177304c700 1 -- start start 2024-04-20T12:22:05.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f177304c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f176c101950 0x7f176c19b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:05.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f177304c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f176c102310 0x7f176c19b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:05.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f177304c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f176c1079a0 0x7f176c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:05.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f177304c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f176c114fc0 con 0x7f176c102310 2024-04-20T12:22:05.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f177304c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f176c114e40 con 0x7f176c1079a0 2024-04-20T12:22:05.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f177304c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f176c115140 con 0x7f176c101950 2024-04-20T12:22:05.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f176bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f176c102310 0x7f176c19b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:05.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f176bfff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f176c102310 0x7f176c19b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58854/0 (socket says 172.21.15.135:58854) 2024-04-20T12:22:05.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f176bfff700 1 -- 172.21.15.135:0/996369014 learned_addr learned my addr 172.21.15.135:0/996369014 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:05.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f17715e9700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f176c1079a0 0x7f176c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:05.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f1770de8700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f176c101950 0x7f176c19b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:05.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f176bfff700 1 -- 172.21.15.135:0/996369014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f176c101950 msgr2=0x7f176c19b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:05.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f176bfff700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f176c101950 0x7f176c19b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:05.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f176bfff700 1 -- 172.21.15.135:0/996369014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f176c1079a0 msgr2=0x7f176c19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:05.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f176bfff700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f176c1079a0 0x7f176c19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:05.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f176bfff700 1 -- 172.21.15.135:0/996369014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176c1a0400 con 0x7f176c102310 2024-04-20T12:22:05.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f1770de8700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f176c101950 0x7f176c19b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:05.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.196+0000 7f17715e9700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f176c1079a0 0x7f176c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:05.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.197+0000 7f176bfff700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f176c102310 0x7f176c19b930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f175800c920 tx=0x7f175800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:05.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.197+0000 7f1769ffb700 1 -- 172.21.15.135:0/996369014 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1758007b00 con 0x7f176c102310 2024-04-20T12:22:05.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.197+0000 7f177304c700 1 -- 172.21.15.135:0/996369014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f176c1a06f0 con 0x7f176c102310 2024-04-20T12:22:05.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.197+0000 7f1769ffb700 1 -- 172.21.15.135:0/996369014 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1758004d10 con 0x7f176c102310 2024-04-20T12:22:05.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.197+0000 7f1769ffb700 1 -- 172.21.15.135:0/996369014 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17580056e0 con 0x7f176c102310 2024-04-20T12:22:05.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.197+0000 7f177304c700 1 -- 172.21.15.135:0/996369014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f176c1a7f70 con 0x7f176c102310 2024-04-20T12:22:05.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.198+0000 7f177304c700 1 -- 172.21.15.135:0/996369014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f176c069740 con 0x7f176c102310 2024-04-20T12:22:05.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.199+0000 7f1769ffb700 1 -- 172.21.15.135:0/996369014 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f1758007ca0 con 0x7f176c102310 2024-04-20T12:22:05.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.200+0000 7f1769ffb700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f175c0a3cd0 0x7f175c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:05.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.200+0000 7f1769ffb700 1 -- 172.21.15.135:0/996369014 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f17580d0550 con 0x7f176c102310 2024-04-20T12:22:05.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.200+0000 7f1770de8700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f175c0a3cd0 0x7f175c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:05.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.200+0000 7f1770de8700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f175c0a3cd0 0x7f175c0a6190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1760007900 tx=0x7f1760008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:05.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.206+0000 7f1769ffb700 1 -- 172.21.15.135:0/996369014 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f1758014030 con 0x7f176c102310 2024-04-20T12:22:05.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.417+0000 7f177304c700 1 -- 172.21.15.135:0/996369014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f176c19c750 con 0x7f176c102310 2024-04-20T12:22:05.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.417+0000 7f1769ffb700 1 -- 172.21.15.135:0/996369014 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f175809ca90 con 0x7f176c102310 2024-04-20T12:22:05.626 INFO:teuthology.orchestra.run.smithi135.stdout:287762808872 2024-04-20T12:22:05.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.419+0000 7f177304c700 1 -- 172.21.15.135:0/996369014 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f175c0a3cd0 msgr2=0x7f175c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:05.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.419+0000 7f177304c700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f175c0a3cd0 0x7f175c0a6190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1760007900 tx=0x7f1760008040 comp rx=0 tx=0).stop 2024-04-20T12:22:05.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.419+0000 7f177304c700 1 -- 172.21.15.135:0/996369014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f176c102310 msgr2=0x7f176c19b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:05.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.419+0000 7f177304c700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f176c102310 0x7f176c19b930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f175800c920 tx=0x7f175800cce0 comp rx=0 tx=0).stop 2024-04-20T12:22:05.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.419+0000 7f177304c700 1 -- 172.21.15.135:0/996369014 shutdown_connections 2024-04-20T12:22:05.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.419+0000 7f177304c700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f175c0a3cd0 0x7f175c0a6190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:05.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.419+0000 7f177304c700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f176c1079a0 0x7f176c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:05.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.419+0000 7f177304c700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f176c101950 0x7f176c19b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:05.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.419+0000 7f177304c700 1 --2- 172.21.15.135:0/996369014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f176c102310 0x7f176c19b930 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:05.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.419+0000 7f177304c700 1 -- 172.21.15.135:0/996369014 >> 172.21.15.135:0/996369014 conn(0x7f176c078900 msgr2=0x7f176c0ff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:05.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.419+0000 7f177304c700 1 -- 172.21.15.135:0/996369014 shutdown_connections 2024-04-20T12:22:05.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:02.419+0000 7f177304c700 1 -- 172.21.15.135:0/996369014 wait complete. 2024-04-20T12:22:06.201 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:05 smithi135 ceph-mon[18264]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:22:06.231 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808869 got 287762808872 for osd.9 2024-04-20T12:22:06.231 DEBUG:teuthology.parallel:result is None 2024-04-20T12:22:06.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:05 smithi154 ceph-mon[22073]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:22:06.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:05 smithi139 ceph-mon[21834]: pgmap v336: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:22:06.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.989+0000 7fdb0ab34700 1 -- 172.21.15.135:0/3245421192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb04101040 msgr2=0x7fdb041014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:06.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.989+0000 7fdb0ab34700 1 --2- 172.21.15.135:0/3245421192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb04101040 0x7fdb041014a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009990 tx=0x7fdaf0009ca0 comp rx=0 tx=0).stop 2024-04-20T12:22:06.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.990+0000 7fdb0ab34700 1 -- 172.21.15.135:0/3245421192 shutdown_connections 2024-04-20T12:22:06.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.990+0000 7fdb0ab34700 1 --2- 172.21.15.135:0/3245421192 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb041019e0 0x7fdb0410f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:06.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.990+0000 7fdb0ab34700 1 --2- 172.21.15.135:0/3245421192 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb04108ae0 0x7fdb04108ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:06.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.990+0000 7fdb0ab34700 1 --2- 172.21.15.135:0/3245421192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb04101040 0x7fdb041014a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:06.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.990+0000 7fdb0ab34700 1 -- 172.21.15.135:0/3245421192 >> 172.21.15.135:0/3245421192 conn(0x7fdb04077fc0 msgr2=0x7fdb040ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:06.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.990+0000 7fdb0ab34700 1 -- 172.21.15.135:0/3245421192 shutdown_connections 2024-04-20T12:22:06.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.990+0000 7fdb0ab34700 1 -- 172.21.15.135:0/3245421192 wait complete. 2024-04-20T12:22:06.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.990+0000 7fdb0ab34700 1 Processor -- start 2024-04-20T12:22:06.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.990+0000 7fdb0ab34700 1 -- start start 2024-04-20T12:22:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.990+0000 7fdb0ab34700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb04101040 0x7fdb04199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.990+0000 7fdb0ab34700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb041019e0 0x7fdb041997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.990+0000 7fdb0ab34700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb04108ae0 0x7fdb0419db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.990+0000 7fdb0ab34700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdb04112de0 con 0x7fdb04101040 2024-04-20T12:22:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb0ab34700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdb04112c60 con 0x7fdb04108ae0 2024-04-20T12:22:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb0ab34700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdb04112f60 con 0x7fdb041019e0 2024-04-20T12:22:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb088d0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb04101040 0x7fdb04199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb088d0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb04101040 0x7fdb04199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58916/0 (socket says 172.21.15.135:58916) 2024-04-20T12:22:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb088d0700 1 -- 172.21.15.135:0/799905301 learned_addr learned my addr 172.21.15.135:0/799905301 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb090d1700 1 --2- 172.21.15.135:0/799905301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb04108ae0 0x7fdb0419db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb03fff700 1 --2- 172.21.15.135:0/799905301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb041019e0 0x7fdb041997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb088d0700 1 -- 172.21.15.135:0/799905301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb041019e0 msgr2=0x7fdb041997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb088d0700 1 --2- 172.21.15.135:0/799905301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb041019e0 0x7fdb041997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb088d0700 1 -- 172.21.15.135:0/799905301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb04108ae0 msgr2=0x7fdb0419db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb088d0700 1 --2- 172.21.15.135:0/799905301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb04108ae0 0x7fdb0419db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb088d0700 1 -- 172.21.15.135:0/799905301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0419e250 con 0x7fdb04101040 2024-04-20T12:22:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb03fff700 1 --2- 172.21.15.135:0/799905301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb041019e0 0x7fdb041997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb088d0700 1 --2- 172.21.15.135:0/799905301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb04101040 0x7fdb04199290 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800d950 tx=0x7fdaf800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb01ffb700 1 -- 172.21.15.135:0/799905301 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf8016070 con 0x7fdb04101040 2024-04-20T12:22:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb01ffb700 1 -- 172.21.15.135:0/799905301 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdaf8009e20 con 0x7fdb04101040 2024-04-20T12:22:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb0ab34700 1 -- 172.21.15.135:0/799905301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0419e540 con 0x7fdb04101040 2024-04-20T12:22:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.991+0000 7fdb01ffb700 1 -- 172.21.15.135:0/799905301 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf800f620 con 0x7fdb04101040 2024-04-20T12:22:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.992+0000 7fdb0ab34700 1 -- 172.21.15.135:0/799905301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb041a5dc0 con 0x7fdb04101040 2024-04-20T12:22:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.993+0000 7fdb0ab34700 1 -- 172.21.15.135:0/799905301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb04104360 con 0x7fdb04101040 2024-04-20T12:22:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.994+0000 7fdb01ffb700 1 -- 172.21.15.135:0/799905301 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fdaf8019070 con 0x7fdb04101040 2024-04-20T12:22:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.994+0000 7fdb01ffb700 1 --2- 172.21.15.135:0/799905301 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fdaf40a3cd0 0x7fdaf40a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.994+0000 7fdb03fff700 1 --2- 172.21.15.135:0/799905301 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fdaf40a3cd0 0x7fdaf40a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.994+0000 7fdb01ffb700 1 -- 172.21.15.135:0/799905301 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fdaf80d0820 con 0x7fdb04101040 2024-04-20T12:22:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.995+0000 7fdb03fff700 1 --2- 172.21.15.135:0/799905301 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fdaf40a3cd0 0x7fdaf40a6190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0006010 tx=0x7fdaf000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:06.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.999+0000 7fdb01ffb700 1 -- 172.21.15.135:0/799905301 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fdaf809cd60 con 0x7fdb04101040 2024-04-20T12:22:07.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.887+0000 7f6311478700 1 -- 172.21.15.135:0/1564146819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630c06a760 msgr2=0x7f630c06abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:07.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.887+0000 7f6311478700 1 --2- 172.21.15.135:0/1564146819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630c06a760 0x7f630c06abc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f62fc009990 tx=0x7f62fc009ca0 comp rx=0 tx=0).stop 2024-04-20T12:22:07.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.887+0000 7f6311478700 1 -- 172.21.15.135:0/1564146819 shutdown_connections 2024-04-20T12:22:07.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.887+0000 7f6311478700 1 --2- 172.21.15.135:0/1564146819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f630c06b100 0x7f630c10f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:07.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.887+0000 7f6311478700 1 --2- 172.21.15.135:0/1564146819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630c108a40 0x7f630c108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:07.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.887+0000 7f6311478700 1 --2- 172.21.15.135:0/1564146819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630c06a760 0x7f630c06abc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:07.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.887+0000 7f6311478700 1 -- 172.21.15.135:0/1564146819 >> 172.21.15.135:0/1564146819 conn(0x7f630c078900 msgr2=0x7f630c078d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:07.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.887+0000 7f6311478700 1 -- 172.21.15.135:0/1564146819 shutdown_connections 2024-04-20T12:22:07.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.887+0000 7f6311478700 1 -- 172.21.15.135:0/1564146819 wait complete. 2024-04-20T12:22:07.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.888+0000 7f6311478700 1 Processor -- start 2024-04-20T12:22:07.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.888+0000 7f6311478700 1 -- start start 2024-04-20T12:22:07.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f6311478700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630c06a760 0x7f630c19b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:07.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f6311478700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f630c06b100 0x7f630c19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:07.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f6311478700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630c108a40 0x7f630c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:07.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f6311478700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f630c112d30 con 0x7f630c06a760 2024-04-20T12:22:07.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f6311478700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f630c112bb0 con 0x7f630c06b100 2024-04-20T12:22:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f6311478700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f630c112eb0 con 0x7f630c108a40 2024-04-20T12:22:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f630affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630c06a760 0x7f630c19b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f630affd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630c06a760 0x7f630c19b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58898/0 (socket says 172.21.15.135:58898) 2024-04-20T12:22:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f630affd700 1 -- 172.21.15.135:0/444359368 learned_addr learned my addr 172.21.15.135:0/444359368 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f630a7fc700 1 --2- 172.21.15.135:0/444359368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f630c06b100 0x7f630c19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f630b7fe700 1 --2- 172.21.15.135:0/444359368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630c108a40 0x7f630c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f630affd700 1 -- 172.21.15.135:0/444359368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630c108a40 msgr2=0x7f630c19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f630affd700 1 --2- 172.21.15.135:0/444359368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630c108a40 0x7f630c19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f630affd700 1 -- 172.21.15.135:0/444359368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f630c06b100 msgr2=0x7f630c19b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f630affd700 1 --2- 172.21.15.135:0/444359368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f630c06b100 0x7f630c19b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.889+0000 7f630affd700 1 -- 172.21.15.135:0/444359368 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630c1a0420 con 0x7f630c06a760 2024-04-20T12:22:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.890+0000 7f630affd700 1 --2- 172.21.15.135:0/444359368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630c06a760 0x7f630c19b410 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f630000d980 tx=0x7f630000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.890+0000 7f62f3fff700 1 -- 172.21.15.135:0/444359368 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300017070 con 0x7f630c06a760 2024-04-20T12:22:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.890+0000 7f6311478700 1 -- 172.21.15.135:0/444359368 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f630c1a0710 con 0x7f630c06a760 2024-04-20T12:22:07.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.890+0000 7f6311478700 1 -- 172.21.15.135:0/444359368 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f630c1a7f90 con 0x7f630c06a760 2024-04-20T12:22:07.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.890+0000 7f62f3fff700 1 -- 172.21.15.135:0/444359368 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6300005020 con 0x7f630c06a760 2024-04-20T12:22:07.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.890+0000 7f62f3fff700 1 -- 172.21.15.135:0/444359368 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630000fbf0 con 0x7f630c06a760 2024-04-20T12:22:07.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.891+0000 7f6311478700 1 -- 172.21.15.135:0/444359368 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f630c104180 con 0x7f630c06a760 2024-04-20T12:22:07.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.892+0000 7f62f3fff700 1 -- 172.21.15.135:0/444359368 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f63000051d0 con 0x7f630c06a760 2024-04-20T12:22:07.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.893+0000 7f62f3fff700 1 --2- 172.21.15.135:0/444359368 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f62f40a3d50 0x7f62f40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:07.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.893+0000 7f630a7fc700 1 --2- 172.21.15.135:0/444359368 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f62f40a3d50 0x7f62f40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:07.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.893+0000 7f62f3fff700 1 -- 172.21.15.135:0/444359368 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f63000d0a00 con 0x7f630c06a760 2024-04-20T12:22:07.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.893+0000 7f630a7fc700 1 --2- 172.21.15.135:0/444359368 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f62f40a3d50 0x7f62f40a6210 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00b5c0 tx=0x7f62fc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:07.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:06.896+0000 7f62f3fff700 1 -- 172.21.15.135:0/444359368 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f6300020020 con 0x7f630c06a760 2024-04-20T12:22:07.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.127+0000 7f6311478700 1 -- 172.21.15.135:0/444359368 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f630c02df90 con 0x7f630c06a760 2024-04-20T12:22:07.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.128+0000 7f62f3fff700 1 -- 172.21.15.135:0/444359368 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f630009cf60 con 0x7f630c06a760 2024-04-20T12:22:07.127 INFO:teuthology.orchestra.run.smithi135.stdout:55834574928 2024-04-20T12:22:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.130+0000 7f6311478700 1 -- 172.21.15.135:0/444359368 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f62f40a3d50 msgr2=0x7f62f40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.130+0000 7f6311478700 1 --2- 172.21.15.135:0/444359368 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f62f40a3d50 0x7f62f40a6210 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f62fc00b5c0 tx=0x7f62fc005960 comp rx=0 tx=0).stop 2024-04-20T12:22:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.130+0000 7f6311478700 1 -- 172.21.15.135:0/444359368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630c06a760 msgr2=0x7f630c19b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.130+0000 7f6311478700 1 --2- 172.21.15.135:0/444359368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630c06a760 0x7f630c19b410 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f630000d980 tx=0x7f630000dc90 comp rx=0 tx=0).stop 2024-04-20T12:22:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.130+0000 7f6311478700 1 -- 172.21.15.135:0/444359368 shutdown_connections 2024-04-20T12:22:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.130+0000 7f6311478700 1 --2- 172.21.15.135:0/444359368 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f62f40a3d50 0x7f62f40a6210 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.130+0000 7f6311478700 1 --2- 172.21.15.135:0/444359368 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630c108a40 0x7f630c19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.130+0000 7f6311478700 1 --2- 172.21.15.135:0/444359368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f630c06a760 0x7f630c19b410 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.130+0000 7f6311478700 1 --2- 172.21.15.135:0/444359368 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f630c06b100 0x7f630c19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.130+0000 7f6311478700 1 -- 172.21.15.135:0/444359368 >> 172.21.15.135:0/444359368 conn(0x7f630c078900 msgr2=0x7f630c10df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.130+0000 7f6311478700 1 -- 172.21.15.135:0/444359368 shutdown_connections 2024-04-20T12:22:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.130+0000 7f6311478700 1 -- 172.21.15.135:0/444359368 wait complete. 2024-04-20T12:22:07.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.226+0000 7fdb0ab34700 1 -- 172.21.15.135:0/799905301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fdb0402df90 con 0x7fdb04101040 2024-04-20T12:22:07.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.227+0000 7fdb01ffb700 1 -- 172.21.15.135:0/799905301 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdaf809c660 con 0x7fdb04101040 2024-04-20T12:22:07.226 INFO:teuthology.orchestra.run.smithi135.stdout:77309411404 2024-04-20T12:22:07.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.229+0000 7fdb0ab34700 1 -- 172.21.15.135:0/799905301 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fdaf40a3cd0 msgr2=0x7fdaf40a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:07.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.229+0000 7fdb0ab34700 1 --2- 172.21.15.135:0/799905301 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fdaf40a3cd0 0x7fdaf40a6190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0006010 tx=0x7fdaf000b540 comp rx=0 tx=0).stop 2024-04-20T12:22:07.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.229+0000 7fdb0ab34700 1 -- 172.21.15.135:0/799905301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb04101040 msgr2=0x7fdb04199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:07.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.229+0000 7fdb0ab34700 1 --2- 172.21.15.135:0/799905301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb04101040 0x7fdb04199290 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdaf800d950 tx=0x7fdaf800dc60 comp rx=0 tx=0).stop 2024-04-20T12:22:07.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.229+0000 7fdb0ab34700 1 -- 172.21.15.135:0/799905301 shutdown_connections 2024-04-20T12:22:07.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.229+0000 7fdb0ab34700 1 --2- 172.21.15.135:0/799905301 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fdaf40a3cd0 0x7fdaf40a6190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:07.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.229+0000 7fdb0ab34700 1 --2- 172.21.15.135:0/799905301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdb04108ae0 0x7fdb0419db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:07.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.229+0000 7fdb0ab34700 1 --2- 172.21.15.135:0/799905301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb04101040 0x7fdb04199290 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:07.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.229+0000 7fdb0ab34700 1 --2- 172.21.15.135:0/799905301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdb041019e0 0x7fdb041997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:07.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.229+0000 7fdb0ab34700 1 -- 172.21.15.135:0/799905301 >> 172.21.15.135:0/799905301 conn(0x7fdb04077fc0 msgr2=0x7fdb040ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:07.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.229+0000 7fdb0ab34700 1 -- 172.21.15.135:0/799905301 shutdown_connections 2024-04-20T12:22:07.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:07.229+0000 7fdb0ab34700 1 -- 172.21.15.135:0/799905301 wait complete. 2024-04-20T12:22:08.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:07 smithi135 ceph-mon[18264]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:22:08.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:07 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/444359368' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-20T12:22:08.008 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:07 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/799905301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-20T12:22:08.042 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070505 got 253403070509 for osd.8 2024-04-20T12:22:08.042 DEBUG:teuthology.parallel:result is None 2024-04-20T12:22:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:07 smithi154 ceph-mon[22073]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:22:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:07 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/444359368' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-20T12:22:08.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:07 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/799905301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-20T12:22:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:07 smithi139 ceph-mon[21834]: pgmap v337: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:22:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:07 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/444359368' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-20T12:22:08.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:07 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/799905301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-20T12:22:10.186 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:09 smithi135 ceph-mon[18264]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-04-20T12:22:10.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:09 smithi154 ceph-mon[22073]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-04-20T12:22:10.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:09 smithi139 ceph-mon[21834]: pgmap v338: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-04-20T12:22:10.513 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574923 got 55834574928 for osd.1 2024-04-20T12:22:10.513 DEBUG:teuthology.parallel:result is None 2024-04-20T12:22:10.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.188+0000 7f589f333700 1 -- 172.21.15.135:0/2802478350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58981034c0 msgr2=0x7f589810f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:10.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.188+0000 7f589f333700 1 --2- 172.21.15.135:0/2802478350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58981034c0 0x7f589810f8f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f589000b0a0 tx=0x7f589000b3b0 comp rx=0 tx=0).stop 2024-04-20T12:22:10.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.188+0000 7f589f333700 1 -- 172.21.15.135:0/2802478350 shutdown_connections 2024-04-20T12:22:10.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.188+0000 7f589f333700 1 --2- 172.21.15.135:0/2802478350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f58981034c0 0x7f589810f8f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:10.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.188+0000 7f589f333700 1 --2- 172.21.15.135:0/2802478350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5898108a90 0x7f5898108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:10.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.188+0000 7f589f333700 1 --2- 172.21.15.135:0/2802478350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5898102b00 0x7f5898102f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:10.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.188+0000 7f589f333700 1 -- 172.21.15.135:0/2802478350 >> 172.21.15.135:0/2802478350 conn(0x7f5898079ae0 msgr2=0x7f5898079ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:10.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.188+0000 7f589f333700 1 -- 172.21.15.135:0/2802478350 shutdown_connections 2024-04-20T12:22:10.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.188+0000 7f589f333700 1 -- 172.21.15.135:0/2802478350 wait complete. 2024-04-20T12:22:10.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.188+0000 7f589f333700 1 Processor -- start 2024-04-20T12:22:10.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.188+0000 7f589f333700 1 -- start start 2024-04-20T12:22:10.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589f333700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5898102b00 0x7f5898074d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:10.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589f333700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58981034c0 0x7f5898075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:10.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589f333700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5898108a90 0x7f58980757d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:10.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589f333700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5898112db0 con 0x7f5898108a90 2024-04-20T12:22:10.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589f333700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5898112c30 con 0x7f58981034c0 2024-04-20T12:22:10.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589f333700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5898112f30 con 0x7f5898102b00 2024-04-20T12:22:10.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589d8d0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5898108a90 0x7f58980757d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:10.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589d8d0700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5898108a90 0x7f58980757d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:58936/0 (socket says 172.21.15.135:58936) 2024-04-20T12:22:10.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589d8d0700 1 -- 172.21.15.135:0/2758864845 learned_addr learned my addr 172.21.15.135:0/2758864845 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:10.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589d0cf700 1 --2- 172.21.15.135:0/2758864845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5898102b00 0x7f5898074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:10.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589d8d0700 1 -- 172.21.15.135:0/2758864845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5898102b00 msgr2=0x7f5898074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:10.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589c8ce700 1 --2- 172.21.15.135:0/2758864845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58981034c0 0x7f5898075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:10.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589d8d0700 1 --2- 172.21.15.135:0/2758864845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5898102b00 0x7f5898074d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:10.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589d8d0700 1 -- 172.21.15.135:0/2758864845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58981034c0 msgr2=0x7f5898075290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:10.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589d8d0700 1 --2- 172.21.15.135:0/2758864845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58981034c0 0x7f5898075290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:10.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589d8d0700 1 -- 172.21.15.135:0/2758864845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58981aba90 con 0x7f5898108a90 2024-04-20T12:22:10.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589d8d0700 1 --2- 172.21.15.135:0/2758864845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5898108a90 0x7f58980757d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f58900062a0 tx=0x7f5890004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:10.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f588e7fc700 1 -- 172.21.15.135:0/2758864845 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890021070 con 0x7f5898108a90 2024-04-20T12:22:10.606 INFO:teuthology.orchestra.run.smithi135.stdout:219043332148 2024-04-20T12:22:10.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589f333700 1 -- 172.21.15.135:0/2758864845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58981abd20 con 0x7f5898108a90 2024-04-20T12:22:10.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f588e7fc700 1 -- 172.21.15.135:0/2758864845 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5890007c80 con 0x7f5898108a90 2024-04-20T12:22:10.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f588e7fc700 1 -- 172.21.15.135:0/2758864845 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589001d450 con 0x7f5898108a90 2024-04-20T12:22:10.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.189+0000 7f589f333700 1 -- 172.21.15.135:0/2758864845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58981ac250 con 0x7f5898108a90 2024-04-20T12:22:10.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.190+0000 7f589f333700 1 -- 172.21.15.135:0/2758864845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58981041c0 con 0x7f5898108a90 2024-04-20T12:22:10.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.191+0000 7f588e7fc700 1 -- 172.21.15.135:0/2758864845 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f5890004020 con 0x7f5898108a90 2024-04-20T12:22:10.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.192+0000 7f588e7fc700 1 --2- 172.21.15.135:0/2758864845 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f58840a3cd0 0x7f58840a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:10.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.192+0000 7f589d0cf700 1 --2- 172.21.15.135:0/2758864845 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f58840a3cd0 0x7f58840a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:10.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.192+0000 7f588e7fc700 1 -- 172.21.15.135:0/2758864845 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f589000f020 con 0x7f5898108a90 2024-04-20T12:22:10.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.192+0000 7f589d0cf700 1 --2- 172.21.15.135:0/2758864845 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f58840a3cd0 0x7f58840a6190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5894005fd0 tx=0x7f5894005ce0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:10.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.197+0000 7f588e7fc700 1 -- 172.21.15.135:0/2758864845 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f589002a020 con 0x7f5898108a90 2024-04-20T12:22:10.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.403+0000 7f589f333700 1 -- 172.21.15.135:0/2758864845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f58981ac540 con 0x7f5898108a90 2024-04-20T12:22:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.403+0000 7f588e7fc700 1 -- 172.21.15.135:0/2758864845 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f589009e4d0 con 0x7f5898108a90 2024-04-20T12:22:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.405+0000 7f589f333700 1 -- 172.21.15.135:0/2758864845 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f58840a3cd0 msgr2=0x7f58840a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.405+0000 7f589f333700 1 --2- 172.21.15.135:0/2758864845 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f58840a3cd0 0x7f58840a6190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5894005fd0 tx=0x7f5894005ce0 comp rx=0 tx=0).stop 2024-04-20T12:22:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.405+0000 7f589f333700 1 -- 172.21.15.135:0/2758864845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5898108a90 msgr2=0x7f58980757d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.405+0000 7f589f333700 1 --2- 172.21.15.135:0/2758864845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5898108a90 0x7f58980757d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f58900062a0 tx=0x7f5890004e20 comp rx=0 tx=0).stop 2024-04-20T12:22:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.405+0000 7f589f333700 1 -- 172.21.15.135:0/2758864845 shutdown_connections 2024-04-20T12:22:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.405+0000 7f589f333700 1 --2- 172.21.15.135:0/2758864845 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f58840a3cd0 0x7f58840a6190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.405+0000 7f589f333700 1 --2- 172.21.15.135:0/2758864845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5898108a90 0x7f58980757d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:10.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.405+0000 7f589f333700 1 --2- 172.21.15.135:0/2758864845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5898102b00 0x7f5898074d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:10.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.405+0000 7f589f333700 1 --2- 172.21.15.135:0/2758864845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f58981034c0 0x7f5898075290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:10.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.405+0000 7f589f333700 1 -- 172.21.15.135:0/2758864845 >> 172.21.15.135:0/2758864845 conn(0x7f5898079ae0 msgr2=0x7f58981014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:10.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.405+0000 7f589f333700 1 -- 172.21.15.135:0/2758864845 shutdown_connections 2024-04-20T12:22:10.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:10.405+0000 7f589f333700 1 -- 172.21.15.135:0/2758864845 wait complete. 2024-04-20T12:22:11.200 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:10 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2758864845' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-20T12:22:11.228 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332144 got 219043332148 for osd.7 2024-04-20T12:22:11.228 DEBUG:teuthology.parallel:result is None 2024-04-20T12:22:11.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:10 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2758864845' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-20T12:22:11.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:10 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2758864845' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-04-20T12:22:11.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.841+0000 7fe338221700 1 -- 172.21.15.135:0/524554440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe330101040 msgr2=0x7fe3301014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:11.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.841+0000 7fe338221700 1 --2- 172.21.15.135:0/524554440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe330101040 0x7fe3301014a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe320009990 tx=0x7fe320009ca0 comp rx=0 tx=0).stop 2024-04-20T12:22:11.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.841+0000 7fe338221700 1 -- 172.21.15.135:0/524554440 shutdown_connections 2024-04-20T12:22:11.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.841+0000 7fe338221700 1 --2- 172.21.15.135:0/524554440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3301019e0 0x7fe33010f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:11.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.841+0000 7fe338221700 1 --2- 172.21.15.135:0/524554440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe330108ae0 0x7fe330108ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:11.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.841+0000 7fe338221700 1 --2- 172.21.15.135:0/524554440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe330101040 0x7fe3301014a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:11.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.841+0000 7fe338221700 1 -- 172.21.15.135:0/524554440 >> 172.21.15.135:0/524554440 conn(0x7fe330077fc0 msgr2=0x7fe3300ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:11.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.841+0000 7fe338221700 1 -- 172.21.15.135:0/524554440 shutdown_connections 2024-04-20T12:22:11.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.841+0000 7fe338221700 1 -- 172.21.15.135:0/524554440 wait complete. 2024-04-20T12:22:11.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.841+0000 7fe338221700 1 Processor -- start 2024-04-20T12:22:11.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.841+0000 7fe338221700 1 -- start start 2024-04-20T12:22:11.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe338221700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe330101040 0x7fe330102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:11.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe338221700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3301019e0 0x7fe330102760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:11.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe338221700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe330108ae0 0x7fe330102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:11.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe338221700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe330112db0 con 0x7fe330108ae0 2024-04-20T12:22:11.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe338221700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe330112c30 con 0x7fe330101040 2024-04-20T12:22:11.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe338221700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe330112f30 con 0x7fe3301019e0 2024-04-20T12:22:11.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe3367be700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe330108ae0 0x7fe330102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:11.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe3367be700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe330108ae0 0x7fe330102ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38994/0 (socket says 172.21.15.135:38994) 2024-04-20T12:22:11.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe3367be700 1 -- 172.21.15.135:0/2290421704 learned_addr learned my addr 172.21.15.135:0/2290421704 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:11.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe3357bc700 1 --2- 172.21.15.135:0/2290421704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3301019e0 0x7fe330102760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:11.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe335fbd700 1 --2- 172.21.15.135:0/2290421704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe330101040 0x7fe330102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:11.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe3367be700 1 -- 172.21.15.135:0/2290421704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3301019e0 msgr2=0x7fe330102760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:11.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe3367be700 1 --2- 172.21.15.135:0/2290421704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3301019e0 0x7fe330102760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:11.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe3367be700 1 -- 172.21.15.135:0/2290421704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe330101040 msgr2=0x7fe330102220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:11.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe3367be700 1 --2- 172.21.15.135:0/2290421704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe330101040 0x7fe330102220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:11.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.842+0000 7fe3367be700 1 -- 172.21.15.135:0/2290421704 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3301a7760 con 0x7fe330108ae0 2024-04-20T12:22:11.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.843+0000 7fe3367be700 1 --2- 172.21.15.135:0/2290421704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe330108ae0 0x7fe330102ca0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe32800ef30 tx=0x7fe32800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:11.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.843+0000 7fe326ffd700 1 -- 172.21.15.135:0/2290421704 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3280092e0 con 0x7fe330108ae0 2024-04-20T12:22:11.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.843+0000 7fe338221700 1 -- 172.21.15.135:0/2290421704 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3301a79f0 con 0x7fe330108ae0 2024-04-20T12:22:11.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.843+0000 7fe326ffd700 1 -- 172.21.15.135:0/2290421704 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe328004bb0 con 0x7fe330108ae0 2024-04-20T12:22:11.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.843+0000 7fe338221700 1 -- 172.21.15.135:0/2290421704 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3301a7f30 con 0x7fe330108ae0 2024-04-20T12:22:11.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.843+0000 7fe326ffd700 1 -- 172.21.15.135:0/2290421704 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328004280 con 0x7fe330108ae0 2024-04-20T12:22:11.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.845+0000 7fe338221700 1 -- 172.21.15.135:0/2290421704 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe314005330 con 0x7fe330108ae0 2024-04-20T12:22:11.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.846+0000 7fe326ffd700 1 -- 172.21.15.135:0/2290421704 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fe32801b030 con 0x7fe330108ae0 2024-04-20T12:22:11.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.847+0000 7fe326ffd700 1 --2- 172.21.15.135:0/2290421704 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe31c0a3d50 0x7fe31c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:11.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.847+0000 7fe335fbd700 1 --2- 172.21.15.135:0/2290421704 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe31c0a3d50 0x7fe31c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:11.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.847+0000 7fe326ffd700 1 -- 172.21.15.135:0/2290421704 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fe3280d01d0 con 0x7fe330108ae0 2024-04-20T12:22:11.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.847+0000 7fe335fbd700 1 --2- 172.21.15.135:0/2290421704 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe31c0a3d50 0x7fe31c0a6210 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0045b0 tx=0x7fe32c00b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:11.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:11.852+0000 7fe326ffd700 1 -- 172.21.15.135:0/2290421704 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fe328022020 con 0x7fe330108ae0 2024-04-20T12:22:12.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:12.058+0000 7fe338221700 1 -- 172.21.15.135:0/2290421704 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fe3140058f0 con 0x7fe330108ae0 2024-04-20T12:22:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:12.059+0000 7fe326ffd700 1 -- 172.21.15.135:0/2290421704 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe328010040 con 0x7fe330108ae0 2024-04-20T12:22:12.059 INFO:teuthology.orchestra.run.smithi135.stdout:343597383711 2024-04-20T12:22:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:12.061+0000 7fe338221700 1 -- 172.21.15.135:0/2290421704 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe31c0a3d50 msgr2=0x7fe31c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:12.061+0000 7fe338221700 1 --2- 172.21.15.135:0/2290421704 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe31c0a3d50 0x7fe31c0a6210 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0045b0 tx=0x7fe32c00b3c0 comp rx=0 tx=0).stop 2024-04-20T12:22:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:12.061+0000 7fe338221700 1 -- 172.21.15.135:0/2290421704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe330108ae0 msgr2=0x7fe330102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:12.061+0000 7fe338221700 1 --2- 172.21.15.135:0/2290421704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe330108ae0 0x7fe330102ca0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe32800ef30 tx=0x7fe32800c3a0 comp rx=0 tx=0).stop 2024-04-20T12:22:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:12.061+0000 7fe338221700 1 -- 172.21.15.135:0/2290421704 shutdown_connections 2024-04-20T12:22:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:12.061+0000 7fe338221700 1 --2- 172.21.15.135:0/2290421704 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe31c0a3d50 0x7fe31c0a6210 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:12.061+0000 7fe338221700 1 --2- 172.21.15.135:0/2290421704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe330108ae0 0x7fe330102ca0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:12.061+0000 7fe338221700 1 --2- 172.21.15.135:0/2290421704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe330101040 0x7fe330102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:12.061+0000 7fe338221700 1 --2- 172.21.15.135:0/2290421704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3301019e0 0x7fe330102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:12.061+0000 7fe338221700 1 -- 172.21.15.135:0/2290421704 >> 172.21.15.135:0/2290421704 conn(0x7fe330077fc0 msgr2=0x7fe3300ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:12.061+0000 7fe338221700 1 -- 172.21.15.135:0/2290421704 shutdown_connections 2024-04-20T12:22:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:12.061+0000 7fe338221700 1 -- 172.21.15.135:0/2290421704 wait complete. 2024-04-20T12:22:12.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:11 smithi154 ceph-mon[22073]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:22:12.267 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:11 smithi135 ceph-mon[18264]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:22:12.295 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411399 got 77309411404 for osd.2 2024-04-20T12:22:12.295 DEBUG:teuthology.parallel:result is None 2024-04-20T12:22:12.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:11 smithi139 ceph-mon[21834]: pgmap v339: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:22:13.200 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:12 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2290421704' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-20T12:22:13.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:12 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2290421704' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-20T12:22:13.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:12 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2290421704' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-04-20T12:22:13.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.560+0000 7f047be11700 1 -- 172.21.15.135:0/1236702044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04741034d0 msgr2=0x7f047410f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:13.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.560+0000 7f047be11700 1 --2- 172.21.15.135:0/1236702044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04741034d0 0x7f047410f8f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f046400b0a0 tx=0x7f046400b3b0 comp rx=0 tx=0).stop 2024-04-20T12:22:13.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.560+0000 7f047be11700 1 -- 172.21.15.135:0/1236702044 shutdown_connections 2024-04-20T12:22:13.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.560+0000 7f047be11700 1 --2- 172.21.15.135:0/1236702044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04741034d0 0x7f047410f8f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:13.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.560+0000 7f047be11700 1 --2- 172.21.15.135:0/1236702044 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0474108a20 0x7f0474108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:13.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.560+0000 7f047be11700 1 --2- 172.21.15.135:0/1236702044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0474102b10 0x7f0474102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:13.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.560+0000 7f047be11700 1 -- 172.21.15.135:0/1236702044 >> 172.21.15.135:0/1236702044 conn(0x7f0474079c10 msgr2=0x7f047407a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:13.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.560+0000 7f047be11700 1 -- 172.21.15.135:0/1236702044 shutdown_connections 2024-04-20T12:22:13.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.560+0000 7f047be11700 1 -- 172.21.15.135:0/1236702044 wait complete. 2024-04-20T12:22:13.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.561+0000 7f047be11700 1 Processor -- start 2024-04-20T12:22:13.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.561+0000 7f047be11700 1 -- start start 2024-04-20T12:22:13.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.561+0000 7f047be11700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0474102b10 0x7f0474074d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:13.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.561+0000 7f047be11700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04741034d0 0x7f0474075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:13.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.561+0000 7f047be11700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0474108a20 0x7f04740757d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:13.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.561+0000 7f047be11700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0474112d70 con 0x7f04741034d0 2024-04-20T12:22:13.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.561+0000 7f047be11700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0474112bf0 con 0x7f0474108a20 2024-04-20T12:22:13.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.561+0000 7f047be11700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0474112ef0 con 0x7f0474102b10 2024-04-20T12:22:13.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.561+0000 7f04793ac700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04741034d0 0x7f0474075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:13.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.561+0000 7f04793ac700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04741034d0 0x7f0474075290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39010/0 (socket says 172.21.15.135:39010) 2024-04-20T12:22:13.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.561+0000 7f04793ac700 1 -- 172.21.15.135:0/3993939351 learned_addr learned my addr 172.21.15.135:0/3993939351 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:13.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.561+0000 7f0479bad700 1 --2- 172.21.15.135:0/3993939351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0474102b10 0x7f0474074d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:13.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.562+0000 7f047a3ae700 1 --2- 172.21.15.135:0/3993939351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0474108a20 0x7f04740757d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:13.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.562+0000 7f04793ac700 1 -- 172.21.15.135:0/3993939351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0474102b10 msgr2=0x7f0474074d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:13.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.562+0000 7f04793ac700 1 --2- 172.21.15.135:0/3993939351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0474102b10 0x7f0474074d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:13.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.562+0000 7f04793ac700 1 -- 172.21.15.135:0/3993939351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0474108a20 msgr2=0x7f04740757d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:13.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.562+0000 7f04793ac700 1 --2- 172.21.15.135:0/3993939351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0474108a20 0x7f04740757d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:13.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.562+0000 7f04793ac700 1 -- 172.21.15.135:0/3993939351 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04741a7640 con 0x7f04741034d0 2024-04-20T12:22:13.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.562+0000 7f04793ac700 1 --2- 172.21.15.135:0/3993939351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04741034d0 0x7f0474075290 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f046800d980 tx=0x7f046800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:13.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.562+0000 7f0472ffd700 1 -- 172.21.15.135:0/3993939351 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0468017070 con 0x7f04741034d0 2024-04-20T12:22:13.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.562+0000 7f0472ffd700 1 -- 172.21.15.135:0/3993939351 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0468005020 con 0x7f04741034d0 2024-04-20T12:22:13.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.562+0000 7f047be11700 1 -- 172.21.15.135:0/3993939351 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04741a7930 con 0x7f04741034d0 2024-04-20T12:22:13.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.562+0000 7f0472ffd700 1 -- 172.21.15.135:0/3993939351 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046800fbf0 con 0x7f04741034d0 2024-04-20T12:22:13.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.562+0000 7f047be11700 1 -- 172.21.15.135:0/3993939351 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04741a7e20 con 0x7f04741034d0 2024-04-20T12:22:13.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.563+0000 7f047be11700 1 -- 172.21.15.135:0/3993939351 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0474069740 con 0x7f04741034d0 2024-04-20T12:22:13.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.564+0000 7f0472ffd700 1 -- 172.21.15.135:0/3993939351 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f04680051d0 con 0x7f04741034d0 2024-04-20T12:22:13.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.565+0000 7f0472ffd700 1 --2- 172.21.15.135:0/3993939351 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f045c0a3cd0 0x7f045c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:13.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.565+0000 7f0479bad700 1 --2- 172.21.15.135:0/3993939351 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f045c0a3cd0 0x7f045c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:13.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.565+0000 7f0472ffd700 1 -- 172.21.15.135:0/3993939351 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f04680d06e0 con 0x7f04741034d0 2024-04-20T12:22:13.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.565+0000 7f0479bad700 1 --2- 172.21.15.135:0/3993939351 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f045c0a3cd0 0x7f045c0a6190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f046c00abd0 tx=0x7f046c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:13.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.570+0000 7f0472ffd700 1 -- 172.21.15.135:0/3993939351 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f0468020020 con 0x7f04741034d0 2024-04-20T12:22:13.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.771+0000 7f047be11700 1 -- 172.21.15.135:0/3993939351 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f047402e150 con 0x7f04741034d0 2024-04-20T12:22:13.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.771+0000 7f0472ffd700 1 -- 172.21.15.135:0/3993939351 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f046809cc20 con 0x7f04741034d0 2024-04-20T12:22:13.771 INFO:teuthology.orchestra.run.smithi135.stdout:34359738455 2024-04-20T12:22:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.773+0000 7f047be11700 1 -- 172.21.15.135:0/3993939351 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f045c0a3cd0 msgr2=0x7f045c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.773+0000 7f047be11700 1 --2- 172.21.15.135:0/3993939351 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f045c0a3cd0 0x7f045c0a6190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f046c00abd0 tx=0x7f046c00a380 comp rx=0 tx=0).stop 2024-04-20T12:22:13.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.773+0000 7f047be11700 1 -- 172.21.15.135:0/3993939351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04741034d0 msgr2=0x7f0474075290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:13.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.773+0000 7f047be11700 1 --2- 172.21.15.135:0/3993939351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04741034d0 0x7f0474075290 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f046800d980 tx=0x7f046800dc90 comp rx=0 tx=0).stop 2024-04-20T12:22:13.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.773+0000 7f047be11700 1 -- 172.21.15.135:0/3993939351 shutdown_connections 2024-04-20T12:22:13.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.773+0000 7f047be11700 1 --2- 172.21.15.135:0/3993939351 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f045c0a3cd0 0x7f045c0a6190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:13.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.773+0000 7f047be11700 1 --2- 172.21.15.135:0/3993939351 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0474108a20 0x7f04740757d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:13.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.773+0000 7f047be11700 1 --2- 172.21.15.135:0/3993939351 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0474102b10 0x7f0474074d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:13.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.773+0000 7f047be11700 1 --2- 172.21.15.135:0/3993939351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f04741034d0 0x7f0474075290 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:13.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.773+0000 7f047be11700 1 -- 172.21.15.135:0/3993939351 >> 172.21.15.135:0/3993939351 conn(0x7f0474079c10 msgr2=0x7f0474100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:13.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.774+0000 7f047be11700 1 -- 172.21.15.135:0/3993939351 shutdown_connections 2024-04-20T12:22:13.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:13.774+0000 7f047be11700 1 -- 172.21.15.135:0/3993939351 wait complete. 2024-04-20T12:22:14.103 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:13 smithi135 ceph-mon[18264]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-20T12:22:14.103 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:13 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3993939351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-20T12:22:14.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:13 smithi154 ceph-mon[22073]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-20T12:22:14.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:13 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3993939351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-20T12:22:14.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:13 smithi139 ceph-mon[21834]: pgmap v340: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-20T12:22:14.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:13 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3993939351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-20T12:22:14.860 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383705 got 343597383711 for osd.11 2024-04-20T12:22:14.860 DEBUG:teuthology.parallel:result is None 2024-04-20T12:22:15.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.827+0000 7f936617d700 1 -- 172.21.15.135:0/167093016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9360107b30 msgr2=0x7f9360107f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:15.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.827+0000 7f936617d700 1 --2- 172.21.15.135:0/167093016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9360107b30 0x7f9360107f10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9350009990 tx=0x7f9350009ca0 comp rx=0 tx=0).stop 2024-04-20T12:22:15.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.827+0000 7f936617d700 1 -- 172.21.15.135:0/167093016 shutdown_connections 2024-04-20T12:22:15.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.827+0000 7f936617d700 1 --2- 172.21.15.135:0/167093016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9360101dd0 0x7f936010f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:15.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.827+0000 7f936617d700 1 --2- 172.21.15.135:0/167093016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9360107b30 0x7f9360107f10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:15.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.827+0000 7f936617d700 1 --2- 172.21.15.135:0/167093016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9360101410 0x7f9360101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:15.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.827+0000 7f936617d700 1 -- 172.21.15.135:0/167093016 >> 172.21.15.135:0/167093016 conn(0x7f9360076c70 msgr2=0x7f9360077080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:15.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.827+0000 7f936617d700 1 -- 172.21.15.135:0/167093016 shutdown_connections 2024-04-20T12:22:15.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.827+0000 7f936617d700 1 -- 172.21.15.135:0/167093016 wait complete. 2024-04-20T12:22:15.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.827+0000 7f936617d700 1 Processor -- start 2024-04-20T12:22:15.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.827+0000 7f936617d700 1 -- start start 2024-04-20T12:22:15.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f936617d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9360101410 0x7f9360199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:15.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f936617d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9360101dd0 0x7f9360199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:15.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f936617d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9360107b30 0x7f936019da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:15.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f936617d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9360112dd0 con 0x7f9360101410 2024-04-20T12:22:15.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f936617d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9360112c50 con 0x7f9360101dd0 2024-04-20T12:22:15.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f936617d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9360112f50 con 0x7f9360107b30 2024-04-20T12:22:15.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f935f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9360101410 0x7f9360199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:15.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f935f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9360101410 0x7f9360199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39034/0 (socket says 172.21.15.135:39034) 2024-04-20T12:22:15.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f935f7fe700 1 -- 172.21.15.135:0/791027016 learned_addr learned my addr 172.21.15.135:0/791027016 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:15.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f935effd700 1 --2- 172.21.15.135:0/791027016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9360101dd0 0x7f9360199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:15.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f935ffff700 1 --2- 172.21.15.135:0/791027016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9360107b30 0x7f936019da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:15.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f935f7fe700 1 -- 172.21.15.135:0/791027016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9360107b30 msgr2=0x7f936019da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:15.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f935f7fe700 1 --2- 172.21.15.135:0/791027016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9360107b30 0x7f936019da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:15.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f935f7fe700 1 -- 172.21.15.135:0/791027016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9360101dd0 msgr2=0x7f9360199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:15.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f935f7fe700 1 --2- 172.21.15.135:0/791027016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9360101dd0 0x7f9360199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:15.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f935f7fe700 1 -- 172.21.15.135:0/791027016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936019e150 con 0x7f9360101410 2024-04-20T12:22:15.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f935f7fe700 1 --2- 172.21.15.135:0/791027016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9360101410 0x7f9360199140 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9350000c00 tx=0x7f9350003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:15.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f935cff9700 1 -- 172.21.15.135:0/791027016 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350027070 con 0x7f9360101410 2024-04-20T12:22:15.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f936617d700 1 -- 172.21.15.135:0/791027016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f936019e3e0 con 0x7f9360101410 2024-04-20T12:22:15.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.828+0000 7f935cff9700 1 -- 172.21.15.135:0/791027016 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9350004110 con 0x7f9360101410 2024-04-20T12:22:15.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.829+0000 7f935cff9700 1 -- 172.21.15.135:0/791027016 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935000f460 con 0x7f9360101410 2024-04-20T12:22:15.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.829+0000 7f936617d700 1 -- 172.21.15.135:0/791027016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93601a5cc0 con 0x7f9360101410 2024-04-20T12:22:15.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.829+0000 7f936617d700 1 -- 172.21.15.135:0/791027016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f936006ac40 con 0x7f9360101410 2024-04-20T12:22:15.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.831+0000 7f935cff9700 1 -- 172.21.15.135:0/791027016 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f935002a070 con 0x7f9360101410 2024-04-20T12:22:15.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.831+0000 7f935cff9700 1 --2- 172.21.15.135:0/791027016 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f934c0a3cd0 0x7f934c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:15.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.832+0000 7f935effd700 1 --2- 172.21.15.135:0/791027016 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f934c0a3cd0 0x7f934c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:15.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.832+0000 7f935cff9700 1 -- 172.21.15.135:0/791027016 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f93500d1c80 con 0x7f9360101410 2024-04-20T12:22:15.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.832+0000 7f935effd700 1 --2- 172.21.15.135:0/791027016 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f934c0a3cd0 0x7f934c0a6190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9360077120 tx=0x7f934800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:15.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:15.835+0000 7f935cff9700 1 -- 172.21.15.135:0/791027016 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f9350031070 con 0x7f9360101410 2024-04-20T12:22:16.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:16.040+0000 7f936617d700 1 -- 172.21.15.135:0/791027016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9360069740 con 0x7f9360101410 2024-04-20T12:22:16.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:16.041+0000 7f935cff9700 1 -- 172.21.15.135:0/791027016 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9360069740 con 0x7f9360101410 2024-04-20T12:22:16.041 INFO:teuthology.orchestra.run.smithi135.stdout:197568495673 2024-04-20T12:22:16.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:16.043+0000 7f936617d700 1 -- 172.21.15.135:0/791027016 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f934c0a3cd0 msgr2=0x7f934c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:16.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:16.043+0000 7f936617d700 1 --2- 172.21.15.135:0/791027016 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f934c0a3cd0 0x7f934c0a6190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9360077120 tx=0x7f934800a300 comp rx=0 tx=0).stop 2024-04-20T12:22:16.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:16.043+0000 7f936617d700 1 -- 172.21.15.135:0/791027016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9360101410 msgr2=0x7f9360199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:16.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:16.043+0000 7f936617d700 1 --2- 172.21.15.135:0/791027016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9360101410 0x7f9360199140 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9350000c00 tx=0x7f9350003680 comp rx=0 tx=0).stop 2024-04-20T12:22:16.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:16.043+0000 7f936617d700 1 -- 172.21.15.135:0/791027016 shutdown_connections 2024-04-20T12:22:16.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:16.043+0000 7f936617d700 1 --2- 172.21.15.135:0/791027016 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f934c0a3cd0 0x7f934c0a6190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:16.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:16.043+0000 7f936617d700 1 --2- 172.21.15.135:0/791027016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9360107b30 0x7f936019da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:16.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:16.043+0000 7f936617d700 1 --2- 172.21.15.135:0/791027016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9360101410 0x7f9360199140 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:16.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:16.043+0000 7f936617d700 1 --2- 172.21.15.135:0/791027016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9360101dd0 0x7f9360199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:16.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:16.043+0000 7f936617d700 1 -- 172.21.15.135:0/791027016 >> 172.21.15.135:0/791027016 conn(0x7f9360076c70 msgr2=0x7f93600ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:16.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:16.043+0000 7f936617d700 1 -- 172.21.15.135:0/791027016 shutdown_connections 2024-04-20T12:22:16.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:16.043+0000 7f936617d700 1 -- 172.21.15.135:0/791027016 wait complete. 2024-04-20T12:22:16.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:15 smithi135 ceph-mon[18264]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:22:16.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:15 smithi154 ceph-mon[22073]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:22:16.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:15 smithi139 ceph-mon[21834]: pgmap v341: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:22:16.383 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738449 got 34359738455 for osd.0 2024-04-20T12:22:16.384 DEBUG:teuthology.parallel:result is None 2024-04-20T12:22:17.010 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:16 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/791027016' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-20T12:22:17.010 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:16 smithi135 ceph-mon[18264]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:22:17.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:16 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/791027016' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-20T12:22:17.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:16 smithi154 ceph-mon[22073]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:22:17.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:16 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/791027016' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-04-20T12:22:17.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:16 smithi139 ceph-mon[21834]: pgmap v342: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:22:17.571 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495667 got 197568495673 for osd.6 2024-04-20T12:22:17.572 DEBUG:teuthology.parallel:result is None 2024-04-20T12:22:18.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.122+0000 7f7429763700 1 -- 172.21.15.135:0/2692616383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f742406b990 msgr2=0x7f742410f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:18.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.122+0000 7f7429763700 1 --2- 172.21.15.135:0/2692616383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f742406b990 0x7f742410f900 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7414009990 tx=0x7f7414009ca0 comp rx=0 tx=0).stop 2024-04-20T12:22:18.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.122+0000 7f7429763700 1 -- 172.21.15.135:0/2692616383 shutdown_connections 2024-04-20T12:22:18.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.122+0000 7f7429763700 1 --2- 172.21.15.135:0/2692616383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f742406b990 0x7f742410f900 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:18.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.122+0000 7f7429763700 1 --2- 172.21.15.135:0/2692616383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7424108a30 0x7f7424108e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:18.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.122+0000 7f7429763700 1 --2- 172.21.15.135:0/2692616383 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f742406aff0 0x7f742406b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:18.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.122+0000 7f7429763700 1 -- 172.21.15.135:0/2692616383 >> 172.21.15.135:0/2692616383 conn(0x7f74240788c0 msgr2=0x7f7424078cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:18.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.122+0000 7f7429763700 1 -- 172.21.15.135:0/2692616383 shutdown_connections 2024-04-20T12:22:18.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.122+0000 7f7429763700 1 -- 172.21.15.135:0/2692616383 wait complete. 2024-04-20T12:22:18.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.123+0000 7f7429763700 1 Processor -- start 2024-04-20T12:22:18.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.123+0000 7f7429763700 1 -- start start 2024-04-20T12:22:18.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.123+0000 7f7429763700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f742406aff0 0x7f7424101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:18.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.123+0000 7f7429763700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f742406b990 0x7f7424101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:18.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.123+0000 7f7429763700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7424108a30 0x7f7424102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:18.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.123+0000 7f7429763700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7424112d20 con 0x7f742406b990 2024-04-20T12:22:18.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.123+0000 7f7429763700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7424112ba0 con 0x7f7424108a30 2024-04-20T12:22:18.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.123+0000 7f7429763700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7424112ea0 con 0x7f742406aff0 2024-04-20T12:22:18.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.123+0000 7f74227fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f742406b990 0x7f7424101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:18.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.124+0000 7f7422ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f742406aff0 0x7f7424101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:18.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.124+0000 7f74227fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f742406b990 0x7f7424101f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39054/0 (socket says 172.21.15.135:39054) 2024-04-20T12:22:18.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.124+0000 7f74227fc700 1 -- 172.21.15.135:0/767776992 learned_addr learned my addr 172.21.15.135:0/767776992 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:18.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.124+0000 7f74237fe700 1 --2- 172.21.15.135:0/767776992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7424108a30 0x7f7424102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:18.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.124+0000 7f74227fc700 1 -- 172.21.15.135:0/767776992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f742406aff0 msgr2=0x7f7424101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:18.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.124+0000 7f74227fc700 1 --2- 172.21.15.135:0/767776992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f742406aff0 0x7f7424101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:18.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.124+0000 7f74227fc700 1 -- 172.21.15.135:0/767776992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7424108a30 msgr2=0x7f7424102490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:18.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.124+0000 7f74227fc700 1 --2- 172.21.15.135:0/767776992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7424108a30 0x7f7424102490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:18.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.124+0000 7f74227fc700 1 -- 172.21.15.135:0/767776992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74241a7650 con 0x7f742406b990 2024-04-20T12:22:18.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.124+0000 7f74227fc700 1 --2- 172.21.15.135:0/767776992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f742406b990 0x7f7424101f50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f741800c9b0 tx=0x7f741800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:18.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.124+0000 7f740bfff700 1 -- 172.21.15.135:0/767776992 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418007b00 con 0x7f742406b990 2024-04-20T12:22:18.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.124+0000 7f740bfff700 1 -- 172.21.15.135:0/767776992 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f741800ce50 con 0x7f742406b990 2024-04-20T12:22:18.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.124+0000 7f7429763700 1 -- 172.21.15.135:0/767776992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74241a7940 con 0x7f742406b990 2024-04-20T12:22:18.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.124+0000 7f740bfff700 1 -- 172.21.15.135:0/767776992 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418018660 con 0x7f742406b990 2024-04-20T12:22:18.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.124+0000 7f7429763700 1 -- 172.21.15.135:0/767776992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74241a7e80 con 0x7f742406b990 2024-04-20T12:22:18.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.125+0000 7f7429763700 1 -- 172.21.15.135:0/767776992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7424069740 con 0x7f742406b990 2024-04-20T12:22:18.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.126+0000 7f740bfff700 1 -- 172.21.15.135:0/767776992 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f741800f450 con 0x7f742406b990 2024-04-20T12:22:18.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.127+0000 7f740bfff700 1 --2- 172.21.15.135:0/767776992 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f740c0a3cd0 0x7f740c0a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:18.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.127+0000 7f7422ffd700 1 --2- 172.21.15.135:0/767776992 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f740c0a3cd0 0x7f740c0a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:18.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.127+0000 7f740bfff700 1 -- 172.21.15.135:0/767776992 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f74180d07f0 con 0x7f742406b990 2024-04-20T12:22:18.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.127+0000 7f7422ffd700 1 --2- 172.21.15.135:0/767776992 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f740c0a3cd0 0x7f740c0a6190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f741c007fd0 tx=0x7f741c00c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:18.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.131+0000 7f740bfff700 1 -- 172.21.15.135:0/767776992 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f7418014030 con 0x7f742406b990 2024-04-20T12:22:18.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.341+0000 7f7429763700 1 -- 172.21.15.135:0/767776992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f742402df90 con 0x7f742406b990 2024-04-20T12:22:18.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.342+0000 7f740bfff700 1 -- 172.21.15.135:0/767776992 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f741809cd30 con 0x7f742406b990 2024-04-20T12:22:18.342 INFO:teuthology.orchestra.run.smithi135.stdout:107374182474 2024-04-20T12:22:18.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.344+0000 7f7429763700 1 -- 172.21.15.135:0/767776992 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f740c0a3cd0 msgr2=0x7f740c0a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:18.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.344+0000 7f7429763700 1 --2- 172.21.15.135:0/767776992 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f740c0a3cd0 0x7f740c0a6190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f741c007fd0 tx=0x7f741c00c040 comp rx=0 tx=0).stop 2024-04-20T12:22:18.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.344+0000 7f7429763700 1 -- 172.21.15.135:0/767776992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f742406b990 msgr2=0x7f7424101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:18.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.344+0000 7f7429763700 1 --2- 172.21.15.135:0/767776992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f742406b990 0x7f7424101f50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f741800c9b0 tx=0x7f741800ccc0 comp rx=0 tx=0).stop 2024-04-20T12:22:18.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.344+0000 7f7429763700 1 -- 172.21.15.135:0/767776992 shutdown_connections 2024-04-20T12:22:18.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.344+0000 7f7429763700 1 --2- 172.21.15.135:0/767776992 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f740c0a3cd0 0x7f740c0a6190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:18.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.344+0000 7f7429763700 1 --2- 172.21.15.135:0/767776992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7424108a30 0x7f7424102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:18.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.344+0000 7f7429763700 1 --2- 172.21.15.135:0/767776992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f742406aff0 0x7f7424101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.344+0000 7f7429763700 1 --2- 172.21.15.135:0/767776992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f742406b990 0x7f7424101f50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.344+0000 7f7429763700 1 -- 172.21.15.135:0/767776992 >> 172.21.15.135:0/767776992 conn(0x7f74240788c0 msgr2=0x7f74240ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.344+0000 7f7429763700 1 -- 172.21.15.135:0/767776992 shutdown_connections 2024-04-20T12:22:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:18.344+0000 7f7429763700 1 -- 172.21.15.135:0/767776992 wait complete. 2024-04-20T12:22:19.052 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182465 got 107374182474 for osd.3 2024-04-20T12:22:19.052 DEBUG:teuthology.parallel:result is None 2024-04-20T12:22:19.052 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-20T12:22:19.052 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph pg dump --format=json 2024-04-20T12:22:19.302 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:22:19.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:22:19.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:22:19.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:19 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/767776992' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-20T12:22:19.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:19 smithi135 ceph-mon[18264]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-04-20T12:22:19.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:22:19.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:22:19.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:19 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:22:19.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:22:19.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:22:19.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:19 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/767776992' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-20T12:22:19.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:19 smithi139 ceph-mon[21834]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-04-20T12:22:19.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:22:19.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:22:19.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:19 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:22:19.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:22:19.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:22:19.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:19 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/767776992' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-20T12:22:19.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:19 smithi154 ceph-mon[22073]: pgmap v343: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-04-20T12:22:19.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:22:19.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:22:19.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:19 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' 2024-04-20T12:22:21.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.211+0000 7f4ab3541700 1 -- 172.21.15.135:0/2758514271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac101dd0 msgr2=0x7f4aac10f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:21.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.211+0000 7f4ab3541700 1 --2- 172.21.15.135:0/2758514271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac101dd0 0x7f4aac10f840 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400b0a0 tx=0x7f4aa400b3b0 comp rx=0 tx=0).stop 2024-04-20T12:22:21.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.211+0000 7f4ab3541700 1 -- 172.21.15.135:0/2758514271 shutdown_connections 2024-04-20T12:22:21.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.211+0000 7f4ab3541700 1 --2- 172.21.15.135:0/2758514271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac101dd0 0x7f4aac10f840 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:21.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.211+0000 7f4ab3541700 1 --2- 172.21.15.135:0/2758514271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac107b30 0x7f4aac107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:21.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.211+0000 7f4ab3541700 1 --2- 172.21.15.135:0/2758514271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aac101410 0x7f4aac101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:21.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.211+0000 7f4ab3541700 1 -- 172.21.15.135:0/2758514271 >> 172.21.15.135:0/2758514271 conn(0x7f4aac076c70 msgr2=0x7f4aac077080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:21.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.211+0000 7f4ab3541700 1 -- 172.21.15.135:0/2758514271 shutdown_connections 2024-04-20T12:22:21.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.211+0000 7f4ab3541700 1 -- 172.21.15.135:0/2758514271 wait complete. 2024-04-20T12:22:21.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.212+0000 7f4ab3541700 1 Processor -- start 2024-04-20T12:22:21.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.212+0000 7f4ab3541700 1 -- start start 2024-04-20T12:22:21.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.212+0000 7f4ab3541700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac101410 0x7f4aac199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:21.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.212+0000 7f4ab3541700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aac101dd0 0x7f4aac199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:21.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.212+0000 7f4ab3541700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac107b30 0x7f4aac19da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:21.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.212+0000 7f4ab3541700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac112db0 con 0x7f4aac101410 2024-04-20T12:22:21.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.212+0000 7f4ab3541700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac112c30 con 0x7f4aac101dd0 2024-04-20T12:22:21.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.212+0000 7f4ab3541700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac112f30 con 0x7f4aac107b30 2024-04-20T12:22:21.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.212+0000 7f4ab12dd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac101410 0x7f4aac199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:21.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.212+0000 7f4ab12dd700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac101410 0x7f4aac199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35634/0 (socket says 172.21.15.135:35634) 2024-04-20T12:22:21.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.212+0000 7f4ab12dd700 1 -- 172.21.15.135:0/3288238450 learned_addr learned my addr 172.21.15.135:0/3288238450 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:21.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.212+0000 7f4ab0adc700 1 --2- 172.21.15.135:0/3288238450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aac101dd0 0x7f4aac199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:21.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.212+0000 7f4ab1ade700 1 --2- 172.21.15.135:0/3288238450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac107b30 0x7f4aac19da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:21.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.212+0000 7f4ab12dd700 1 -- 172.21.15.135:0/3288238450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac107b30 msgr2=0x7f4aac19da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:21.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.212+0000 7f4ab12dd700 1 --2- 172.21.15.135:0/3288238450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac107b30 0x7f4aac19da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:21.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.213+0000 7f4ab12dd700 1 -- 172.21.15.135:0/3288238450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aac101dd0 msgr2=0x7f4aac199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:21.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.213+0000 7f4ab12dd700 1 --2- 172.21.15.135:0/3288238450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aac101dd0 0x7f4aac199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:21.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.213+0000 7f4ab12dd700 1 -- 172.21.15.135:0/3288238450 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac19e150 con 0x7f4aac101410 2024-04-20T12:22:21.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.213+0000 7f4ab12dd700 1 --2- 172.21.15.135:0/3288238450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac101410 0x7f4aac199140 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800d980 tx=0x7f4aa800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:21.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.213+0000 7f4aa27fc700 1 -- 172.21.15.135:0/3288238450 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8016070 con 0x7f4aac101410 2024-04-20T12:22:21.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.213+0000 7f4aa27fc700 1 -- 172.21.15.135:0/3288238450 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4aa800fd70 con 0x7f4aac101410 2024-04-20T12:22:21.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.213+0000 7f4aa27fc700 1 -- 172.21.15.135:0/3288238450 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8019360 con 0x7f4aac101410 2024-04-20T12:22:21.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.213+0000 7f4ab3541700 1 -- 172.21.15.135:0/3288238450 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aac19e440 con 0x7f4aac101410 2024-04-20T12:22:21.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.213+0000 7f4ab3541700 1 -- 172.21.15.135:0/3288238450 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aac1a5cc0 con 0x7f4aac101410 2024-04-20T12:22:21.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.214+0000 7f4ab3541700 1 -- 172.21.15.135:0/3288238450 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aac069740 con 0x7f4aac101410 2024-04-20T12:22:21.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.215+0000 7f4aa27fc700 1 -- 172.21.15.135:0/3288238450 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f4aa8019070 con 0x7f4aac101410 2024-04-20T12:22:21.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.216+0000 7f4aa27fc700 1 --2- 172.21.15.135:0/3288238450 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4a980a3d50 0x7f4a980a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:21.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.216+0000 7f4ab0adc700 1 --2- 172.21.15.135:0/3288238450 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4a980a3d50 0x7f4a980a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:21.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.216+0000 7f4aa27fc700 1 -- 172.21.15.135:0/3288238450 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f4aa80d07b0 con 0x7f4aac101410 2024-04-20T12:22:21.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.216+0000 7f4ab0adc700 1 --2- 172.21.15.135:0/3288238450 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4a980a3d50 0x7f4a980a6210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4aac077190 tx=0x7f4a9c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:21.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.219+0000 7f4aa27fc700 1 -- 172.21.15.135:0/3288238450 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f4aa809ccf0 con 0x7f4aac101410 2024-04-20T12:22:21.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.414+0000 7f4ab3541700 1 -- 172.21.15.135:0/3288238450 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4aac062e90 con 0x7f4a980a3d50 2024-04-20T12:22:21.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.423+0000 7f4aa27fc700 1 -- 172.21.15.135:0/3288238450 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340735 (secure 0 0 0) 0x7f4aac062e90 con 0x7f4a980a3d50 2024-04-20T12:22:21.428 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:21.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.426+0000 7f4ab3541700 1 -- 172.21.15.135:0/3288238450 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4a980a3d50 msgr2=0x7f4a980a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:21.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.426+0000 7f4ab3541700 1 --2- 172.21.15.135:0/3288238450 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4a980a3d50 0x7f4a980a6210 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4aac077190 tx=0x7f4a9c00b410 comp rx=0 tx=0).stop 2024-04-20T12:22:21.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.426+0000 7f4ab3541700 1 -- 172.21.15.135:0/3288238450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac101410 msgr2=0x7f4aac199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:21.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.426+0000 7f4ab3541700 1 --2- 172.21.15.135:0/3288238450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac101410 0x7f4aac199140 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800d980 tx=0x7f4aa800dc90 comp rx=0 tx=0).stop 2024-04-20T12:22:21.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.427+0000 7f4ab3541700 1 -- 172.21.15.135:0/3288238450 shutdown_connections 2024-04-20T12:22:21.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.427+0000 7f4ab3541700 1 --2- 172.21.15.135:0/3288238450 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4a980a3d50 0x7f4a980a6210 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:21.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.427+0000 7f4ab3541700 1 --2- 172.21.15.135:0/3288238450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4aac107b30 0x7f4aac19da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:21.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.427+0000 7f4ab3541700 1 --2- 172.21.15.135:0/3288238450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac101410 0x7f4aac199140 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:21.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.427+0000 7f4ab3541700 1 --2- 172.21.15.135:0/3288238450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4aac101dd0 0x7f4aac199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:21.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.427+0000 7f4ab3541700 1 -- 172.21.15.135:0/3288238450 >> 172.21.15.135:0/3288238450 conn(0x7f4aac076c70 msgr2=0x7f4aac0ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:21.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.427+0000 7f4ab3541700 1 -- 172.21.15.135:0/3288238450 shutdown_connections 2024-04-20T12:22:21.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:21.427+0000 7f4ab3541700 1 -- 172.21.15.135:0/3288238450 wait complete. 2024-04-20T12:22:21.432 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-04-20T12:22:22.082 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:21 smithi135 ceph-mon[18264]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:22:22.112 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":344,"stamp":"2024-04-20T12:22:20.829164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660380,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":874,"num_read_kb":573,"num_write":423,"num_write_kb":3079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181358,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365828,"kb_used_data":12440,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575996,"statfs":{"total":1151940427776,"available":1151565819904,"internally_reserved":0,"allocated":12738560,"data_stored":8078978,"data_compressed":394302,"data_compressed_allocated":540672,"data_compressed_original":2580480,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003492"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907076+0000","last_change":"2024-04-20T12:20:42.031660+0000","last_active":"2024-04-20T12:21:37.907076+0000","last_peered":"2024-04-20T12:21:37.907076+0000","last_clean":"2024-04-20T12:21:37.907076+0000","last_became_active":"2024-04-20T12:20:42.031334+0000","last_became_peered":"2024-04-20T12:20:42.031334+0000","last_unstale":"2024-04-20T12:21:37.907076+0000","last_undegraded":"2024-04-20T12:21:37.907076+0000","last_fullsized":"2024-04-20T12:21:37.907076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:27.971885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907915+0000","last_change":"2024-04-20T12:20:42.039049+0000","last_active":"2024-04-20T12:21:37.907915+0000","last_peered":"2024-04-20T12:21:37.907915+0000","last_clean":"2024-04-20T12:21:37.907915+0000","last_became_active":"2024-04-20T12:20:42.037960+0000","last_became_peered":"2024-04-20T12:20:42.037960+0000","last_unstale":"2024-04-20T12:21:37.907915+0000","last_undegraded":"2024-04-20T12:21:37.907915+0000","last_fullsized":"2024-04-20T12:21:37.907915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:45:44.482154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907413+0000","last_change":"2024-04-20T12:20:42.036915+0000","last_active":"2024-04-20T12:21:37.907413+0000","last_peered":"2024-04-20T12:21:37.907413+0000","last_clean":"2024-04-20T12:21:37.907413+0000","last_became_active":"2024-04-20T12:20:42.036282+0000","last_became_peered":"2024-04-20T12:20:42.036282+0000","last_unstale":"2024-04-20T12:21:37.907413+0000","last_undegraded":"2024-04-20T12:21:37.907413+0000","last_fullsized":"2024-04-20T12:21:37.907413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:04:55.865977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904662+0000","last_change":"2024-04-20T12:20:42.036653+0000","last_active":"2024-04-20T12:21:37.904662+0000","last_peered":"2024-04-20T12:21:37.904662+0000","last_clean":"2024-04-20T12:21:37.904662+0000","last_became_active":"2024-04-20T12:20:42.036112+0000","last_became_peered":"2024-04-20T12:20:42.036112+0000","last_unstale":"2024-04-20T12:21:37.904662+0000","last_undegraded":"2024-04-20T12:21:37.904662+0000","last_fullsized":"2024-04-20T12:21:37.904662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:05:50.728127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904100+0000","last_change":"2024-04-20T12:20:42.031271+0000","last_active":"2024-04-20T12:21:37.904100+0000","last_peered":"2024-04-20T12:21:37.904100+0000","last_clean":"2024-04-20T12:21:37.904100+0000","last_became_active":"2024-04-20T12:20:42.030930+0000","last_became_peered":"2024-04-20T12:20:42.030930+0000","last_unstale":"2024-04-20T12:21:37.904100+0000","last_undegraded":"2024-04-20T12:21:37.904100+0000","last_fullsized":"2024-04-20T12:21:37.904100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:30:53.523203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907075+0000","last_change":"2024-04-20T12:20:42.037556+0000","last_active":"2024-04-20T12:21:37.907075+0000","last_peered":"2024-04-20T12:21:37.907075+0000","last_clean":"2024-04-20T12:21:37.907075+0000","last_became_active":"2024-04-20T12:20:42.037140+0000","last_became_peered":"2024-04-20T12:20:42.037140+0000","last_unstale":"2024-04-20T12:21:37.907075+0000","last_undegraded":"2024-04-20T12:21:37.907075+0000","last_fullsized":"2024-04-20T12:21:37.907075+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:41:50.827641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909529+0000","last_change":"2024-04-20T12:20:42.042004+0000","last_active":"2024-04-20T12:21:37.909529+0000","last_peered":"2024-04-20T12:21:37.909529+0000","last_clean":"2024-04-20T12:21:37.909529+0000","last_became_active":"2024-04-20T12:20:42.041663+0000","last_became_peered":"2024-04-20T12:20:42.041663+0000","last_unstale":"2024-04-20T12:21:37.909529+0000","last_undegraded":"2024-04-20T12:21:37.909529+0000","last_fullsized":"2024-04-20T12:21:37.909529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:00.196652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910022+0000","last_change":"2024-04-20T12:20:42.043250+0000","last_active":"2024-04-20T12:21:37.910022+0000","last_peered":"2024-04-20T12:21:37.910022+0000","last_clean":"2024-04-20T12:21:37.910022+0000","last_became_active":"2024-04-20T12:20:42.042678+0000","last_became_peered":"2024-04-20T12:20:42.042678+0000","last_unstale":"2024-04-20T12:21:37.910022+0000","last_undegraded":"2024-04-20T12:21:37.910022+0000","last_fullsized":"2024-04-20T12:21:37.910022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:28:36.825718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940944+0000","last_change":"2024-04-20T12:20:42.026370+0000","last_active":"2024-04-20T12:21:37.940944+0000","last_peered":"2024-04-20T12:21:37.940944+0000","last_clean":"2024-04-20T12:21:37.940944+0000","last_became_active":"2024-04-20T12:20:42.026010+0000","last_became_peered":"2024-04-20T12:20:42.026010+0000","last_unstale":"2024-04-20T12:21:37.940944+0000","last_undegraded":"2024-04-20T12:21:37.940944+0000","last_fullsized":"2024-04-20T12:21:37.940944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:13.526130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.912184+0000","last_change":"2024-04-20T12:21:37.912184+0000","last_active":"2024-04-20T12:21:37.912184+0000","last_peered":"2024-04-20T12:21:37.912184+0000","last_clean":"2024-04-20T12:21:37.912184+0000","last_became_active":"2024-04-20T12:21:37.911745+0000","last_became_peered":"2024-04-20T12:21:37.911745+0000","last_unstale":"2024-04-20T12:21:37.912184+0000","last_undegraded":"2024-04-20T12:21:37.912184+0000","last_fullsized":"2024-04-20T12:21:37.912184+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:39:26.296420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909997+0000","last_change":"2024-04-20T12:20:42.032408+0000","last_active":"2024-04-20T12:21:37.909997+0000","last_peered":"2024-04-20T12:21:37.909997+0000","last_clean":"2024-04-20T12:21:37.909997+0000","last_became_active":"2024-04-20T12:20:42.032035+0000","last_became_peered":"2024-04-20T12:20:42.032035+0000","last_unstale":"2024-04-20T12:21:37.909997+0000","last_undegraded":"2024-04-20T12:21:37.909997+0000","last_fullsized":"2024-04-20T12:21:37.909997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:03.702299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904784+0000","last_change":"2024-04-20T12:20:42.040299+0000","last_active":"2024-04-20T12:21:37.904784+0000","last_peered":"2024-04-20T12:21:37.904784+0000","last_clean":"2024-04-20T12:21:37.904784+0000","last_became_active":"2024-04-20T12:20:42.039891+0000","last_became_peered":"2024-04-20T12:20:42.039891+0000","last_unstale":"2024-04-20T12:21:37.904784+0000","last_undegraded":"2024-04-20T12:21:37.904784+0000","last_fullsized":"2024-04-20T12:21:37.904784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:16:31.701459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909599+0000","last_change":"2024-04-20T12:20:42.032551+0000","last_active":"2024-04-20T12:21:37.909599+0000","last_peered":"2024-04-20T12:21:37.909599+0000","last_clean":"2024-04-20T12:21:37.909599+0000","last_became_active":"2024-04-20T12:20:42.032247+0000","last_became_peered":"2024-04-20T12:20:42.032247+0000","last_unstale":"2024-04-20T12:21:37.909599+0000","last_undegraded":"2024-04-20T12:21:37.909599+0000","last_fullsized":"2024-04-20T12:21:37.909599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:02:22.181110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906931+0000","last_change":"2024-04-20T12:20:42.042662+0000","last_active":"2024-04-20T12:21:37.906931+0000","last_peered":"2024-04-20T12:21:37.906931+0000","last_clean":"2024-04-20T12:21:37.906931+0000","last_became_active":"2024-04-20T12:20:42.042351+0000","last_became_peered":"2024-04-20T12:20:42.042351+0000","last_unstale":"2024-04-20T12:21:37.906931+0000","last_undegraded":"2024-04-20T12:21:37.906931+0000","last_fullsized":"2024-04-20T12:21:37.906931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:15:21.632339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906762+0000","last_change":"2024-04-20T12:20:42.033402+0000","last_active":"2024-04-20T12:21:37.906762+0000","last_peered":"2024-04-20T12:21:37.906762+0000","last_clean":"2024-04-20T12:21:37.906762+0000","last_became_active":"2024-04-20T12:20:42.032996+0000","last_became_peered":"2024-04-20T12:20:42.032996+0000","last_unstale":"2024-04-20T12:21:37.906762+0000","last_undegraded":"2024-04-20T12:21:37.906762+0000","last_fullsized":"2024-04-20T12:21:37.906762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:45.487051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940290+0000","last_change":"2024-04-20T12:20:42.033836+0000","last_active":"2024-04-20T12:21:37.940290+0000","last_peered":"2024-04-20T12:21:37.940290+0000","last_clean":"2024-04-20T12:21:37.940290+0000","last_became_active":"2024-04-20T12:20:42.033497+0000","last_became_peered":"2024-04-20T12:20:42.033497+0000","last_unstale":"2024-04-20T12:21:37.940290+0000","last_undegraded":"2024-04-20T12:21:37.940290+0000","last_fullsized":"2024-04-20T12:21:37.940290+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:25:16.428158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906767+0000","last_change":"2024-04-20T12:20:42.030284+0000","last_active":"2024-04-20T12:21:37.906767+0000","last_peered":"2024-04-20T12:21:37.906767+0000","last_clean":"2024-04-20T12:21:37.906767+0000","last_became_active":"2024-04-20T12:20:42.029899+0000","last_became_peered":"2024-04-20T12:20:42.029899+0000","last_unstale":"2024-04-20T12:21:37.906767+0000","last_undegraded":"2024-04-20T12:21:37.906767+0000","last_fullsized":"2024-04-20T12:21:37.906767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:39:14.371947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906459+0000","last_change":"2024-04-20T12:20:42.028298+0000","last_active":"2024-04-20T12:21:37.906459+0000","last_peered":"2024-04-20T12:21:37.906459+0000","last_clean":"2024-04-20T12:21:37.906459+0000","last_became_active":"2024-04-20T12:20:42.027814+0000","last_became_peered":"2024-04-20T12:20:42.027814+0000","last_unstale":"2024-04-20T12:21:37.906459+0000","last_undegraded":"2024-04-20T12:21:37.906459+0000","last_fullsized":"2024-04-20T12:21:37.906459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:44:39.903424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.914463+0000","last_change":"2024-04-20T12:20:42.043697+0000","last_active":"2024-04-20T12:21:37.914463+0000","last_peered":"2024-04-20T12:21:37.914463+0000","last_clean":"2024-04-20T12:21:37.914463+0000","last_became_active":"2024-04-20T12:20:42.043322+0000","last_became_peered":"2024-04-20T12:20:42.043322+0000","last_unstale":"2024-04-20T12:21:37.914463+0000","last_undegraded":"2024-04-20T12:21:37.914463+0000","last_fullsized":"2024-04-20T12:21:37.914463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:08:35.148726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.911218+0000","last_change":"2024-04-20T12:20:46.326298+0000","last_active":"2024-04-20T12:21:37.911218+0000","last_peered":"2024-04-20T12:21:37.911218+0000","last_clean":"2024-04-20T12:21:37.911218+0000","last_became_active":"2024-04-20T12:20:46.325893+0000","last_became_peered":"2024-04-20T12:20:46.325893+0000","last_unstale":"2024-04-20T12:21:37.911218+0000","last_undegraded":"2024-04-20T12:21:37.911218+0000","last_fullsized":"2024-04-20T12:21:37.911218+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:17.076871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'13","reported_seq":115,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:19.446164+0000","last_change":"2024-04-20T12:20:41.027834+0000","last_active":"2024-04-20T12:22:19.446164+0000","last_peered":"2024-04-20T12:22:19.446164+0000","last_clean":"2024-04-20T12:22:19.446164+0000","last_became_active":"2024-04-20T12:20:41.027541+0000","last_became_peered":"2024-04-20T12:20:41.027541+0000","last_unstale":"2024-04-20T12:22:19.446164+0000","last_undegraded":"2024-04-20T12:22:19.446164+0000","last_fullsized":"2024-04-20T12:22:19.446164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:30.454875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910600+0000","last_change":"2024-04-20T12:20:42.043315+0000","last_active":"2024-04-20T12:21:37.910600+0000","last_peered":"2024-04-20T12:21:37.910600+0000","last_clean":"2024-04-20T12:21:37.910600+0000","last_became_active":"2024-04-20T12:20:42.042920+0000","last_became_peered":"2024-04-20T12:20:42.042920+0000","last_unstale":"2024-04-20T12:21:37.910600+0000","last_undegraded":"2024-04-20T12:21:37.910600+0000","last_fullsized":"2024-04-20T12:21:37.910600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:52.353023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904092+0000","last_change":"2024-04-20T12:20:46.327004+0000","last_active":"2024-04-20T12:21:37.904092+0000","last_peered":"2024-04-20T12:21:37.904092+0000","last_clean":"2024-04-20T12:21:37.904092+0000","last_became_active":"2024-04-20T12:20:46.326433+0000","last_became_peered":"2024-04-20T12:20:46.326433+0000","last_unstale":"2024-04-20T12:21:37.904092+0000","last_undegraded":"2024-04-20T12:21:37.904092+0000","last_fullsized":"2024-04-20T12:21:37.904092+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:58:05.864093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910704+0000","last_change":"2024-04-20T12:20:41.032149+0000","last_active":"2024-04-20T12:21:37.910704+0000","last_peered":"2024-04-20T12:21:37.910704+0000","last_clean":"2024-04-20T12:21:37.910704+0000","last_became_active":"2024-04-20T12:20:41.031708+0000","last_became_peered":"2024-04-20T12:20:41.031708+0000","last_unstale":"2024-04-20T12:21:37.910704+0000","last_undegraded":"2024-04-20T12:21:37.910704+0000","last_fullsized":"2024-04-20T12:21:37.910704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:55.167376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907419+0000","last_change":"2024-04-20T12:20:42.040462+0000","last_active":"2024-04-20T12:21:37.907419+0000","last_peered":"2024-04-20T12:21:37.907419+0000","last_clean":"2024-04-20T12:21:37.907419+0000","last_became_active":"2024-04-20T12:20:42.040098+0000","last_became_peered":"2024-04-20T12:20:42.040098+0000","last_unstale":"2024-04-20T12:21:37.907419+0000","last_undegraded":"2024-04-20T12:21:37.907419+0000","last_fullsized":"2024-04-20T12:21:37.907419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:16.091488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904081+0000","last_change":"2024-04-20T12:20:46.327205+0000","last_active":"2024-04-20T12:21:37.904081+0000","last_peered":"2024-04-20T12:21:37.904081+0000","last_clean":"2024-04-20T12:21:37.904081+0000","last_became_active":"2024-04-20T12:20:46.326511+0000","last_became_peered":"2024-04-20T12:20:46.326511+0000","last_unstale":"2024-04-20T12:21:37.904081+0000","last_undegraded":"2024-04-20T12:21:37.904081+0000","last_fullsized":"2024-04-20T12:21:37.904081+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:45:11.351139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.924962+0000","last_change":"2024-04-20T12:21:37.924962+0000","last_active":"2024-04-20T12:21:37.924962+0000","last_peered":"2024-04-20T12:21:37.924962+0000","last_clean":"2024-04-20T12:21:37.924962+0000","last_became_active":"2024-04-20T12:21:37.914275+0000","last_became_peered":"2024-04-20T12:21:37.914275+0000","last_unstale":"2024-04-20T12:21:37.924962+0000","last_undegraded":"2024-04-20T12:21:37.924962+0000","last_fullsized":"2024-04-20T12:21:37.924962+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:05.894889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940731+0000","last_change":"2024-04-20T12:20:42.029785+0000","last_active":"2024-04-20T12:21:37.940731+0000","last_peered":"2024-04-20T12:21:37.940731+0000","last_clean":"2024-04-20T12:21:37.940731+0000","last_became_active":"2024-04-20T12:20:42.029377+0000","last_became_peered":"2024-04-20T12:20:42.029377+0000","last_unstale":"2024-04-20T12:21:37.940731+0000","last_undegraded":"2024-04-20T12:21:37.940731+0000","last_fullsized":"2024-04-20T12:21:37.940731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:22:52.429274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904032+0000","last_change":"2024-04-20T12:20:46.326552+0000","last_active":"2024-04-20T12:21:37.904032+0000","last_peered":"2024-04-20T12:21:37.904032+0000","last_clean":"2024-04-20T12:21:37.904032+0000","last_became_active":"2024-04-20T12:20:46.325573+0000","last_became_peered":"2024-04-20T12:20:46.325573+0000","last_unstale":"2024-04-20T12:21:37.904032+0000","last_undegraded":"2024-04-20T12:21:37.904032+0000","last_fullsized":"2024-04-20T12:21:37.904032+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:26:01.218141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904380+0000","last_change":"2024-04-20T12:20:41.023884+0000","last_active":"2024-04-20T12:21:37.904380+0000","last_peered":"2024-04-20T12:21:37.904380+0000","last_clean":"2024-04-20T12:21:37.904380+0000","last_became_active":"2024-04-20T12:20:41.023496+0000","last_became_peered":"2024-04-20T12:20:41.023496+0000","last_unstale":"2024-04-20T12:21:37.904380+0000","last_undegraded":"2024-04-20T12:21:37.904380+0000","last_fullsized":"2024-04-20T12:21:37.904380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:08.824928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.941972+0000","last_change":"2024-04-20T12:21:37.941552+0000","last_active":"2024-04-20T12:21:37.941972+0000","last_peered":"2024-04-20T12:21:37.941972+0000","last_clean":"2024-04-20T12:21:37.941972+0000","last_became_active":"2024-04-20T12:21:37.941228+0000","last_became_peered":"2024-04-20T12:21:37.941228+0000","last_unstale":"2024-04-20T12:21:37.941972+0000","last_undegraded":"2024-04-20T12:21:37.941972+0000","last_fullsized":"2024-04-20T12:21:37.941972+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:33.915039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.914213+0000","last_change":"2024-04-20T12:20:46.324508+0000","last_active":"2024-04-20T12:21:37.914213+0000","last_peered":"2024-04-20T12:21:37.914213+0000","last_clean":"2024-04-20T12:21:37.914213+0000","last_became_active":"2024-04-20T12:20:46.324014+0000","last_became_peered":"2024-04-20T12:20:46.324014+0000","last_unstale":"2024-04-20T12:21:37.914213+0000","last_undegraded":"2024-04-20T12:21:37.914213+0000","last_fullsized":"2024-04-20T12:21:37.914213+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:17.765152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":117,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:15.969274+0000","last_change":"2024-04-20T12:21:37.927225+0000","last_active":"2024-04-20T12:22:15.969274+0000","last_peered":"2024-04-20T12:22:15.969274+0000","last_clean":"2024-04-20T12:22:15.969274+0000","last_became_active":"2024-04-20T12:21:37.911437+0000","last_became_peered":"2024-04-20T12:21:37.911437+0000","last_unstale":"2024-04-20T12:22:15.969274+0000","last_undegraded":"2024-04-20T12:22:15.969274+0000","last_fullsized":"2024-04-20T12:22:15.969274+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:08:14.576145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904114+0000","last_change":"2024-04-20T12:20:42.047403+0000","last_active":"2024-04-20T12:21:37.904114+0000","last_peered":"2024-04-20T12:21:37.904114+0000","last_clean":"2024-04-20T12:21:37.904114+0000","last_became_active":"2024-04-20T12:20:42.046240+0000","last_became_peered":"2024-04-20T12:20:42.046240+0000","last_unstale":"2024-04-20T12:21:37.904114+0000","last_undegraded":"2024-04-20T12:21:37.904114+0000","last_fullsized":"2024-04-20T12:21:37.904114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:21:40.410666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.914217+0000","last_change":"2024-04-20T12:20:46.326908+0000","last_active":"2024-04-20T12:21:37.914217+0000","last_peered":"2024-04-20T12:21:37.914217+0000","last_clean":"2024-04-20T12:21:37.914217+0000","last_became_active":"2024-04-20T12:20:46.326525+0000","last_became_peered":"2024-04-20T12:20:46.326525+0000","last_unstale":"2024-04-20T12:21:37.914217+0000","last_undegraded":"2024-04-20T12:21:37.914217+0000","last_fullsized":"2024-04-20T12:21:37.914217+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:30:25.132976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907074+0000","last_change":"2024-04-20T12:20:41.027532+0000","last_active":"2024-04-20T12:21:37.907074+0000","last_peered":"2024-04-20T12:21:37.907074+0000","last_clean":"2024-04-20T12:21:37.907074+0000","last_became_active":"2024-04-20T12:20:41.027090+0000","last_became_peered":"2024-04-20T12:20:41.027090+0000","last_unstale":"2024-04-20T12:21:37.907074+0000","last_undegraded":"2024-04-20T12:21:37.907074+0000","last_fullsized":"2024-04-20T12:21:37.907074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:40:10.450305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.912691+0000","last_change":"2024-04-20T12:21:37.912691+0000","last_active":"2024-04-20T12:21:37.912691+0000","last_peered":"2024-04-20T12:21:37.912691+0000","last_clean":"2024-04-20T12:21:37.912691+0000","last_became_active":"2024-04-20T12:21:37.912295+0000","last_became_peered":"2024-04-20T12:21:37.912295+0000","last_unstale":"2024-04-20T12:21:37.912691+0000","last_undegraded":"2024-04-20T12:21:37.912691+0000","last_fullsized":"2024-04-20T12:21:37.912691+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:48:04.501944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906576+0000","last_change":"2024-04-20T12:20:46.318633+0000","last_active":"2024-04-20T12:21:37.906576+0000","last_peered":"2024-04-20T12:21:37.906576+0000","last_clean":"2024-04-20T12:21:37.906576+0000","last_became_active":"2024-04-20T12:20:46.318215+0000","last_became_peered":"2024-04-20T12:20:46.318215+0000","last_unstale":"2024-04-20T12:21:37.906576+0000","last_undegraded":"2024-04-20T12:21:37.906576+0000","last_fullsized":"2024-04-20T12:21:37.906576+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:07:31.241287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909172+0000","last_change":"2024-04-20T12:20:41.027009+0000","last_active":"2024-04-20T12:21:37.909172+0000","last_peered":"2024-04-20T12:21:37.909172+0000","last_clean":"2024-04-20T12:21:37.909172+0000","last_became_active":"2024-04-20T12:20:41.026683+0000","last_became_peered":"2024-04-20T12:20:41.026683+0000","last_unstale":"2024-04-20T12:21:37.909172+0000","last_undegraded":"2024-04-20T12:21:37.909172+0000","last_fullsized":"2024-04-20T12:21:37.909172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:56:35.955635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910274+0000","last_change":"2024-04-20T12:20:42.030833+0000","last_active":"2024-04-20T12:21:37.910274+0000","last_peered":"2024-04-20T12:21:37.910274+0000","last_clean":"2024-04-20T12:21:37.910274+0000","last_became_active":"2024-04-20T12:20:42.030470+0000","last_became_peered":"2024-04-20T12:20:42.030470+0000","last_unstale":"2024-04-20T12:21:37.910274+0000","last_undegraded":"2024-04-20T12:21:37.910274+0000","last_fullsized":"2024-04-20T12:21:37.910274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:20:07.381222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907739+0000","last_change":"2024-04-20T12:20:46.327091+0000","last_active":"2024-04-20T12:21:37.907739+0000","last_peered":"2024-04-20T12:21:37.907739+0000","last_clean":"2024-04-20T12:21:37.907739+0000","last_became_active":"2024-04-20T12:20:46.326663+0000","last_became_peered":"2024-04-20T12:20:46.326663+0000","last_unstale":"2024-04-20T12:21:37.907739+0000","last_undegraded":"2024-04-20T12:21:37.907739+0000","last_fullsized":"2024-04-20T12:21:37.907739+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:37:31.968946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907108+0000","last_change":"2024-04-20T12:20:41.028908+0000","last_active":"2024-04-20T12:21:37.907108+0000","last_peered":"2024-04-20T12:21:37.907108+0000","last_clean":"2024-04-20T12:21:37.907108+0000","last_became_active":"2024-04-20T12:20:41.028570+0000","last_became_peered":"2024-04-20T12:20:41.028570+0000","last_unstale":"2024-04-20T12:21:37.907108+0000","last_undegraded":"2024-04-20T12:21:37.907108+0000","last_fullsized":"2024-04-20T12:21:37.907108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:39:27.309249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906063+0000","last_change":"2024-04-20T12:20:42.028802+0000","last_active":"2024-04-20T12:21:37.906063+0000","last_peered":"2024-04-20T12:21:37.906063+0000","last_clean":"2024-04-20T12:21:37.906063+0000","last_became_active":"2024-04-20T12:20:42.028458+0000","last_became_peered":"2024-04-20T12:20:42.028458+0000","last_unstale":"2024-04-20T12:21:37.906063+0000","last_undegraded":"2024-04-20T12:21:37.906063+0000","last_fullsized":"2024-04-20T12:21:37.906063+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:59:28.284954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910390+0000","last_change":"2024-04-20T12:20:46.331055+0000","last_active":"2024-04-20T12:21:37.910390+0000","last_peered":"2024-04-20T12:21:37.910390+0000","last_clean":"2024-04-20T12:21:37.910390+0000","last_became_active":"2024-04-20T12:20:46.330181+0000","last_became_peered":"2024-04-20T12:20:46.330181+0000","last_unstale":"2024-04-20T12:21:37.910390+0000","last_undegraded":"2024-04-20T12:21:37.910390+0000","last_fullsized":"2024-04-20T12:21:37.910390+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:27.430141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":178,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:19.974362+0000","last_change":"2024-04-20T12:20:41.025859+0000","last_active":"2024-04-20T12:22:19.974362+0000","last_peered":"2024-04-20T12:22:19.974362+0000","last_clean":"2024-04-20T12:22:19.974362+0000","last_became_active":"2024-04-20T12:20:41.025443+0000","last_became_peered":"2024-04-20T12:20:41.025443+0000","last_unstale":"2024-04-20T12:22:19.974362+0000","last_undegraded":"2024-04-20T12:22:19.974362+0000","last_fullsized":"2024-04-20T12:22:19.974362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:11:28.100797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":145,"num_read_kb":145,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940948+0000","last_change":"2024-04-20T12:20:42.028510+0000","last_active":"2024-04-20T12:21:37.940948+0000","last_peered":"2024-04-20T12:21:37.940948+0000","last_clean":"2024-04-20T12:21:37.940948+0000","last_became_active":"2024-04-20T12:20:42.028176+0000","last_became_peered":"2024-04-20T12:20:42.028176+0000","last_unstale":"2024-04-20T12:21:37.940948+0000","last_undegraded":"2024-04-20T12:21:37.940948+0000","last_fullsized":"2024-04-20T12:21:37.940948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:49:44.606154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.905678+0000","last_change":"2024-04-20T12:20:46.327813+0000","last_active":"2024-04-20T12:21:37.905678+0000","last_peered":"2024-04-20T12:21:37.905678+0000","last_clean":"2024-04-20T12:21:37.905678+0000","last_became_active":"2024-04-20T12:20:46.327446+0000","last_became_peered":"2024-04-20T12:20:46.327446+0000","last_unstale":"2024-04-20T12:21:37.905678+0000","last_undegraded":"2024-04-20T12:21:37.905678+0000","last_fullsized":"2024-04-20T12:21:37.905678+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:30:23.990693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909984+0000","last_change":"2024-04-20T12:20:41.027748+0000","last_active":"2024-04-20T12:21:37.909984+0000","last_peered":"2024-04-20T12:21:37.909984+0000","last_clean":"2024-04-20T12:21:37.909984+0000","last_became_active":"2024-04-20T12:20:41.027400+0000","last_became_peered":"2024-04-20T12:20:41.027400+0000","last_unstale":"2024-04-20T12:21:37.909984+0000","last_undegraded":"2024-04-20T12:21:37.909984+0000","last_fullsized":"2024-04-20T12:21:37.909984+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:27:50.008057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.912851+0000","last_change":"2024-04-20T12:21:37.912851+0000","last_active":"2024-04-20T12:21:37.912851+0000","last_peered":"2024-04-20T12:21:37.912851+0000","last_clean":"2024-04-20T12:21:37.912851+0000","last_became_active":"2024-04-20T12:21:37.912487+0000","last_became_peered":"2024-04-20T12:21:37.912487+0000","last_unstale":"2024-04-20T12:21:37.912851+0000","last_undegraded":"2024-04-20T12:21:37.912851+0000","last_fullsized":"2024-04-20T12:21:37.912851+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:09:49.568654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904405+0000","last_change":"2024-04-20T12:20:46.326239+0000","last_active":"2024-04-20T12:21:37.904405+0000","last_peered":"2024-04-20T12:21:37.904405+0000","last_clean":"2024-04-20T12:21:37.904405+0000","last_became_active":"2024-04-20T12:20:46.325830+0000","last_became_peered":"2024-04-20T12:20:46.325830+0000","last_unstale":"2024-04-20T12:21:37.904405+0000","last_undegraded":"2024-04-20T12:21:37.904405+0000","last_fullsized":"2024-04-20T12:21:37.904405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:07.311396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.908086+0000","last_change":"2024-04-20T12:20:41.024662+0000","last_active":"2024-04-20T12:21:37.908086+0000","last_peered":"2024-04-20T12:21:37.908086+0000","last_clean":"2024-04-20T12:21:37.908086+0000","last_became_active":"2024-04-20T12:20:41.024327+0000","last_became_peered":"2024-04-20T12:20:41.024327+0000","last_unstale":"2024-04-20T12:21:37.908086+0000","last_undegraded":"2024-04-20T12:21:37.908086+0000","last_fullsized":"2024-04-20T12:21:37.908086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:07.079126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940889+0000","last_change":"2024-04-20T12:20:42.031910+0000","last_active":"2024-04-20T12:21:37.940889+0000","last_peered":"2024-04-20T12:21:37.940889+0000","last_clean":"2024-04-20T12:21:37.940889+0000","last_became_active":"2024-04-20T12:20:42.031600+0000","last_became_peered":"2024-04-20T12:20:42.031600+0000","last_unstale":"2024-04-20T12:21:37.940889+0000","last_undegraded":"2024-04-20T12:21:37.940889+0000","last_fullsized":"2024-04-20T12:21:37.940889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:23:56.448246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.912445+0000","last_change":"2024-04-20T12:21:37.911484+0000","last_active":"2024-04-20T12:21:37.912445+0000","last_peered":"2024-04-20T12:21:37.912445+0000","last_clean":"2024-04-20T12:21:37.912445+0000","last_became_active":"2024-04-20T12:21:37.911069+0000","last_became_peered":"2024-04-20T12:21:37.911069+0000","last_unstale":"2024-04-20T12:21:37.912445+0000","last_undegraded":"2024-04-20T12:21:37.912445+0000","last_fullsized":"2024-04-20T12:21:37.912445+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:58:54.938004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"91'35","reported_seq":216,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:19.974385+0000","last_change":"2024-04-20T12:20:41.024722+0000","last_active":"2024-04-20T12:22:19.974385+0000","last_peered":"2024-04-20T12:22:19.974385+0000","last_clean":"2024-04-20T12:22:19.974385+0000","last_became_active":"2024-04-20T12:20:41.024150+0000","last_became_peered":"2024-04-20T12:20:41.024150+0000","last_unstale":"2024-04-20T12:22:19.974385+0000","last_undegraded":"2024-04-20T12:22:19.974385+0000","last_fullsized":"2024-04-20T12:22:19.974385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:14:49.622937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63356,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":138,"num_write":37,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904665+0000","last_change":"2024-04-20T12:20:42.037589+0000","last_active":"2024-04-20T12:21:37.904665+0000","last_peered":"2024-04-20T12:21:37.904665+0000","last_clean":"2024-04-20T12:21:37.904665+0000","last_became_active":"2024-04-20T12:20:42.037256+0000","last_became_peered":"2024-04-20T12:20:42.037256+0000","last_unstale":"2024-04-20T12:21:37.904665+0000","last_undegraded":"2024-04-20T12:21:37.904665+0000","last_fullsized":"2024-04-20T12:21:37.904665+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:25.966289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910589+0000","last_change":"2024-04-20T12:20:46.326476+0000","last_active":"2024-04-20T12:21:37.910589+0000","last_peered":"2024-04-20T12:21:37.910589+0000","last_clean":"2024-04-20T12:21:37.910589+0000","last_became_active":"2024-04-20T12:20:46.326085+0000","last_became_peered":"2024-04-20T12:20:46.326085+0000","last_unstale":"2024-04-20T12:21:37.910589+0000","last_undegraded":"2024-04-20T12:21:37.910589+0000","last_fullsized":"2024-04-20T12:21:37.910589+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:34:15.608820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.914101+0000","last_change":"2024-04-20T12:20:41.028360+0000","last_active":"2024-04-20T12:21:37.914101+0000","last_peered":"2024-04-20T12:21:37.914101+0000","last_clean":"2024-04-20T12:21:37.914101+0000","last_became_active":"2024-04-20T12:20:41.028057+0000","last_became_peered":"2024-04-20T12:20:41.028057+0000","last_unstale":"2024-04-20T12:21:37.914101+0000","last_undegraded":"2024-04-20T12:21:37.914101+0000","last_fullsized":"2024-04-20T12:21:37.914101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:30:49.699051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.912138+0000","last_change":"2024-04-20T12:21:37.912138+0000","last_active":"2024-04-20T12:21:37.912138+0000","last_peered":"2024-04-20T12:21:37.912138+0000","last_clean":"2024-04-20T12:21:37.912138+0000","last_became_active":"2024-04-20T12:21:37.911774+0000","last_became_peered":"2024-04-20T12:21:37.911774+0000","last_unstale":"2024-04-20T12:21:37.912138+0000","last_undegraded":"2024-04-20T12:21:37.912138+0000","last_fullsized":"2024-04-20T12:21:37.912138+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:41:34.250785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906252+0000","last_change":"2024-04-20T12:20:46.328605+0000","last_active":"2024-04-20T12:21:37.906252+0000","last_peered":"2024-04-20T12:21:37.906252+0000","last_clean":"2024-04-20T12:21:37.906252+0000","last_became_active":"2024-04-20T12:20:46.328091+0000","last_became_peered":"2024-04-20T12:20:46.328091+0000","last_unstale":"2024-04-20T12:21:37.906252+0000","last_undegraded":"2024-04-20T12:21:37.906252+0000","last_fullsized":"2024-04-20T12:21:37.906252+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:21:12.908696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909172+0000","last_change":"2024-04-20T12:20:41.028149+0000","last_active":"2024-04-20T12:21:37.909172+0000","last_peered":"2024-04-20T12:21:37.909172+0000","last_clean":"2024-04-20T12:21:37.909172+0000","last_became_active":"2024-04-20T12:20:41.027784+0000","last_became_peered":"2024-04-20T12:20:41.027784+0000","last_unstale":"2024-04-20T12:21:37.909172+0000","last_undegraded":"2024-04-20T12:21:37.909172+0000","last_fullsized":"2024-04-20T12:21:37.909172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:45:31.227275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909583+0000","last_change":"2024-04-20T12:20:42.030961+0000","last_active":"2024-04-20T12:21:37.909583+0000","last_peered":"2024-04-20T12:21:37.909583+0000","last_clean":"2024-04-20T12:21:37.909583+0000","last_became_active":"2024-04-20T12:20:42.030597+0000","last_became_peered":"2024-04-20T12:20:42.030597+0000","last_unstale":"2024-04-20T12:21:37.909583+0000","last_undegraded":"2024-04-20T12:21:37.909583+0000","last_fullsized":"2024-04-20T12:21:37.909583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:59:29.679840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.908482+0000","last_change":"2024-04-20T12:20:46.327034+0000","last_active":"2024-04-20T12:21:37.908482+0000","last_peered":"2024-04-20T12:21:37.908482+0000","last_clean":"2024-04-20T12:21:37.908482+0000","last_became_active":"2024-04-20T12:20:46.325107+0000","last_became_peered":"2024-04-20T12:20:46.325107+0000","last_unstale":"2024-04-20T12:21:37.908482+0000","last_undegraded":"2024-04-20T12:21:37.908482+0000","last_fullsized":"2024-04-20T12:21:37.908482+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:44:04.924677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":106,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:16.420513+0000","last_change":"2024-04-20T12:20:41.020878+0000","last_active":"2024-04-20T12:22:16.420513+0000","last_peered":"2024-04-20T12:22:16.420513+0000","last_clean":"2024-04-20T12:22:16.420513+0000","last_became_active":"2024-04-20T12:20:41.020503+0000","last_became_peered":"2024-04-20T12:20:41.020503+0000","last_unstale":"2024-04-20T12:22:16.420513+0000","last_undegraded":"2024-04-20T12:22:16.420513+0000","last_fullsized":"2024-04-20T12:22:16.420513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:59:00.555136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":73,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909672+0000","last_change":"2024-04-20T12:20:42.039699+0000","last_active":"2024-04-20T12:21:37.909672+0000","last_peered":"2024-04-20T12:21:37.909672+0000","last_clean":"2024-04-20T12:21:37.909672+0000","last_became_active":"2024-04-20T12:20:42.039384+0000","last_became_peered":"2024-04-20T12:20:42.039384+0000","last_unstale":"2024-04-20T12:21:37.909672+0000","last_undegraded":"2024-04-20T12:21:37.909672+0000","last_fullsized":"2024-04-20T12:21:37.909672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:45:41.056018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910073+0000","last_change":"2024-04-20T12:20:46.333294+0000","last_active":"2024-04-20T12:21:37.910073+0000","last_peered":"2024-04-20T12:21:37.910073+0000","last_clean":"2024-04-20T12:21:37.910073+0000","last_became_active":"2024-04-20T12:20:46.332887+0000","last_became_peered":"2024-04-20T12:20:46.332887+0000","last_unstale":"2024-04-20T12:21:37.910073+0000","last_undegraded":"2024-04-20T12:21:37.910073+0000","last_fullsized":"2024-04-20T12:21:37.910073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:10.686220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.903970+0000","last_change":"2024-04-20T12:20:41.027313+0000","last_active":"2024-04-20T12:21:37.903970+0000","last_peered":"2024-04-20T12:21:37.903970+0000","last_clean":"2024-04-20T12:21:37.903970+0000","last_became_active":"2024-04-20T12:20:41.026980+0000","last_became_peered":"2024-04-20T12:20:41.026980+0000","last_unstale":"2024-04-20T12:21:37.903970+0000","last_undegraded":"2024-04-20T12:21:37.903970+0000","last_fullsized":"2024-04-20T12:21:37.903970+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:12.692075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909186+0000","last_change":"2024-04-20T12:20:42.027807+0000","last_active":"2024-04-20T12:21:37.909186+0000","last_peered":"2024-04-20T12:21:37.909186+0000","last_clean":"2024-04-20T12:21:37.909186+0000","last_became_active":"2024-04-20T12:20:42.027468+0000","last_became_peered":"2024-04-20T12:20:42.027468+0000","last_unstale":"2024-04-20T12:21:37.909186+0000","last_undegraded":"2024-04-20T12:21:37.909186+0000","last_fullsized":"2024-04-20T12:21:37.909186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:51.924249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909061+0000","last_change":"2024-04-20T12:20:46.324164+0000","last_active":"2024-04-20T12:21:37.909061+0000","last_peered":"2024-04-20T12:21:37.909061+0000","last_clean":"2024-04-20T12:21:37.909061+0000","last_became_active":"2024-04-20T12:20:46.323651+0000","last_became_peered":"2024-04-20T12:20:46.323651+0000","last_unstale":"2024-04-20T12:21:37.909061+0000","last_undegraded":"2024-04-20T12:21:37.909061+0000","last_fullsized":"2024-04-20T12:21:37.909061+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:07:54.429586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904503+0000","last_change":"2024-04-20T12:20:41.023999+0000","last_active":"2024-04-20T12:21:37.904503+0000","last_peered":"2024-04-20T12:21:37.904503+0000","last_clean":"2024-04-20T12:21:37.904503+0000","last_became_active":"2024-04-20T12:20:41.023440+0000","last_became_peered":"2024-04-20T12:20:41.023440+0000","last_unstale":"2024-04-20T12:21:37.904503+0000","last_undegraded":"2024-04-20T12:21:37.904503+0000","last_fullsized":"2024-04-20T12:21:37.904503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:13:18.493395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907327+0000","last_change":"2024-04-20T12:20:42.036718+0000","last_active":"2024-04-20T12:21:37.907327+0000","last_peered":"2024-04-20T12:21:37.907327+0000","last_clean":"2024-04-20T12:21:37.907327+0000","last_became_active":"2024-04-20T12:20:42.036305+0000","last_became_peered":"2024-04-20T12:20:42.036305+0000","last_unstale":"2024-04-20T12:21:37.907327+0000","last_undegraded":"2024-04-20T12:21:37.907327+0000","last_fullsized":"2024-04-20T12:21:37.907327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:14.462345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904102+0000","last_change":"2024-04-20T12:20:46.930437+0000","last_active":"2024-04-20T12:21:37.904102+0000","last_peered":"2024-04-20T12:21:37.904102+0000","last_clean":"2024-04-20T12:21:37.904102+0000","last_became_active":"2024-04-20T12:20:46.929882+0000","last_became_peered":"2024-04-20T12:20:46.929882+0000","last_unstale":"2024-04-20T12:21:37.904102+0000","last_undegraded":"2024-04-20T12:21:37.904102+0000","last_fullsized":"2024-04-20T12:21:37.904102+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:56.540256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906489+0000","last_change":"2024-04-20T12:20:41.023584+0000","last_active":"2024-04-20T12:21:37.906489+0000","last_peered":"2024-04-20T12:21:37.906489+0000","last_clean":"2024-04-20T12:21:37.906489+0000","last_became_active":"2024-04-20T12:20:41.023249+0000","last_became_peered":"2024-04-20T12:20:41.023249+0000","last_unstale":"2024-04-20T12:21:37.906489+0000","last_undegraded":"2024-04-20T12:21:37.906489+0000","last_fullsized":"2024-04-20T12:21:37.906489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:18:06.704703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907189+0000","last_change":"2024-04-20T12:20:42.041424+0000","last_active":"2024-04-20T12:21:37.907189+0000","last_peered":"2024-04-20T12:21:37.907189+0000","last_clean":"2024-04-20T12:21:37.907189+0000","last_became_active":"2024-04-20T12:20:42.040231+0000","last_became_peered":"2024-04-20T12:20:42.040231+0000","last_unstale":"2024-04-20T12:21:37.907189+0000","last_undegraded":"2024-04-20T12:21:37.907189+0000","last_fullsized":"2024-04-20T12:21:37.907189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:29.523746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909584+0000","last_change":"2024-04-20T12:20:46.326852+0000","last_active":"2024-04-20T12:21:37.909584+0000","last_peered":"2024-04-20T12:21:37.909584+0000","last_clean":"2024-04-20T12:21:37.909584+0000","last_became_active":"2024-04-20T12:20:46.326398+0000","last_became_peered":"2024-04-20T12:20:46.326398+0000","last_unstale":"2024-04-20T12:21:37.909584+0000","last_undegraded":"2024-04-20T12:21:37.909584+0000","last_fullsized":"2024-04-20T12:21:37.909584+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:00:33.076429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'5","reported_seq":104,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:16.443349+0000","last_change":"2024-04-20T12:20:41.032542+0000","last_active":"2024-04-20T12:22:16.443349+0000","last_peered":"2024-04-20T12:22:16.443349+0000","last_clean":"2024-04-20T12:22:16.443349+0000","last_became_active":"2024-04-20T12:20:41.032048+0000","last_became_peered":"2024-04-20T12:20:41.032048+0000","last_unstale":"2024-04-20T12:22:16.443349+0000","last_undegraded":"2024-04-20T12:22:16.443349+0000","last_fullsized":"2024-04-20T12:22:16.443349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:16:35.515446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906653+0000","last_change":"2024-04-20T12:20:42.034006+0000","last_active":"2024-04-20T12:21:37.906653+0000","last_peered":"2024-04-20T12:21:37.906653+0000","last_clean":"2024-04-20T12:21:37.906653+0000","last_became_active":"2024-04-20T12:20:42.033639+0000","last_became_peered":"2024-04-20T12:20:42.033639+0000","last_unstale":"2024-04-20T12:21:37.906653+0000","last_undegraded":"2024-04-20T12:21:37.906653+0000","last_fullsized":"2024-04-20T12:21:37.906653+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:39:27.435103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910350+0000","last_change":"2024-04-20T12:20:46.930253+0000","last_active":"2024-04-20T12:21:37.910350+0000","last_peered":"2024-04-20T12:21:37.910350+0000","last_clean":"2024-04-20T12:21:37.910350+0000","last_became_active":"2024-04-20T12:20:46.929806+0000","last_became_peered":"2024-04-20T12:20:46.929806+0000","last_unstale":"2024-04-20T12:21:37.910350+0000","last_undegraded":"2024-04-20T12:21:37.910350+0000","last_fullsized":"2024-04-20T12:21:37.910350+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:23:55.085024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907353+0000","last_change":"2024-04-20T12:20:42.031231+0000","last_active":"2024-04-20T12:21:37.907353+0000","last_peered":"2024-04-20T12:21:37.907353+0000","last_clean":"2024-04-20T12:21:37.907353+0000","last_became_active":"2024-04-20T12:20:42.030920+0000","last_became_peered":"2024-04-20T12:20:42.030920+0000","last_unstale":"2024-04-20T12:21:37.907353+0000","last_undegraded":"2024-04-20T12:21:37.907353+0000","last_fullsized":"2024-04-20T12:21:37.907353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:14.631696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":104,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:15.417600+0000","last_change":"2024-04-20T12:20:41.030703+0000","last_active":"2024-04-20T12:22:15.417600+0000","last_peered":"2024-04-20T12:22:15.417600+0000","last_clean":"2024-04-20T12:22:15.417600+0000","last_became_active":"2024-04-20T12:20:41.030400+0000","last_became_peered":"2024-04-20T12:20:41.030400+0000","last_unstale":"2024-04-20T12:22:15.417600+0000","last_undegraded":"2024-04-20T12:22:15.417600+0000","last_fullsized":"2024-04-20T12:22:15.417600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:46:07.845022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909841+0000","last_change":"2024-04-20T12:20:46.322872+0000","last_active":"2024-04-20T12:21:37.909841+0000","last_peered":"2024-04-20T12:21:37.909841+0000","last_clean":"2024-04-20T12:21:37.909841+0000","last_became_active":"2024-04-20T12:20:46.322440+0000","last_became_peered":"2024-04-20T12:20:46.322440+0000","last_unstale":"2024-04-20T12:21:37.909841+0000","last_undegraded":"2024-04-20T12:21:37.909841+0000","last_fullsized":"2024-04-20T12:21:37.909841+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:24:02.010584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910170+0000","last_change":"2024-04-20T12:20:42.041895+0000","last_active":"2024-04-20T12:21:37.910170+0000","last_peered":"2024-04-20T12:21:37.910170+0000","last_clean":"2024-04-20T12:21:37.910170+0000","last_became_active":"2024-04-20T12:20:42.040451+0000","last_became_peered":"2024-04-20T12:20:42.040451+0000","last_unstale":"2024-04-20T12:21:37.910170+0000","last_undegraded":"2024-04-20T12:21:37.910170+0000","last_fullsized":"2024-04-20T12:21:37.910170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:17.711581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904222+0000","last_change":"2024-04-20T12:20:41.020656+0000","last_active":"2024-04-20T12:21:37.904222+0000","last_peered":"2024-04-20T12:21:37.904222+0000","last_clean":"2024-04-20T12:21:37.904222+0000","last_became_active":"2024-04-20T12:20:41.020226+0000","last_became_peered":"2024-04-20T12:20:41.020226+0000","last_unstale":"2024-04-20T12:21:37.904222+0000","last_undegraded":"2024-04-20T12:21:37.904222+0000","last_fullsized":"2024-04-20T12:21:37.904222+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:21:03.446920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":364,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909443+0000","last_change":"2024-04-20T12:19:29.284050+0000","last_active":"2024-04-20T12:21:37.909443+0000","last_peered":"2024-04-20T12:21:37.909443+0000","last_clean":"2024-04-20T12:21:37.909443+0000","last_became_active":"2024-04-20T12:19:29.283508+0000","last_became_peered":"2024-04-20T12:19:29.283508+0000","last_unstale":"2024-04-20T12:21:37.909443+0000","last_undegraded":"2024-04-20T12:21:37.909443+0000","last_fullsized":"2024-04-20T12:21:37.909443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:16:03.444995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:16:03.444995+0000","last_clean_scrub_stamp":"2024-04-20T12:16:03.444995+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:28:39.268704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.908249+0000","last_change":"2024-04-20T12:20:46.931207+0000","last_active":"2024-04-20T12:21:37.908249+0000","last_peered":"2024-04-20T12:21:37.908249+0000","last_clean":"2024-04-20T12:21:37.908249+0000","last_became_active":"2024-04-20T12:20:46.930733+0000","last_became_peered":"2024-04-20T12:20:46.930733+0000","last_unstale":"2024-04-20T12:21:37.908249+0000","last_undegraded":"2024-04-20T12:21:37.908249+0000","last_fullsized":"2024-04-20T12:21:37.908249+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:09:53.281163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.908941+0000","last_change":"2024-04-20T12:20:42.030739+0000","last_active":"2024-04-20T12:21:37.908941+0000","last_peered":"2024-04-20T12:21:37.908941+0000","last_clean":"2024-04-20T12:21:37.908941+0000","last_became_active":"2024-04-20T12:20:42.030440+0000","last_became_peered":"2024-04-20T12:20:42.030440+0000","last_unstale":"2024-04-20T12:21:37.908941+0000","last_undegraded":"2024-04-20T12:21:37.908941+0000","last_fullsized":"2024-04-20T12:21:37.908941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:44:39.311317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909661+0000","last_change":"2024-04-20T12:20:41.029967+0000","last_active":"2024-04-20T12:21:37.909661+0000","last_peered":"2024-04-20T12:21:37.909661+0000","last_clean":"2024-04-20T12:21:37.909661+0000","last_became_active":"2024-04-20T12:20:41.029618+0000","last_became_peered":"2024-04-20T12:20:41.029618+0000","last_unstale":"2024-04-20T12:21:37.909661+0000","last_undegraded":"2024-04-20T12:21:37.909661+0000","last_fullsized":"2024-04-20T12:21:37.909661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:48.762751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906212+0000","last_change":"2024-04-20T12:20:46.327782+0000","last_active":"2024-04-20T12:21:37.906212+0000","last_peered":"2024-04-20T12:21:37.906212+0000","last_clean":"2024-04-20T12:21:37.906212+0000","last_became_active":"2024-04-20T12:20:46.325462+0000","last_became_peered":"2024-04-20T12:20:46.325462+0000","last_unstale":"2024-04-20T12:21:37.906212+0000","last_undegraded":"2024-04-20T12:21:37.906212+0000","last_fullsized":"2024-04-20T12:21:37.906212+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:41.792496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904715+0000","last_change":"2024-04-20T12:20:41.025454+0000","last_active":"2024-04-20T12:21:37.904715+0000","last_peered":"2024-04-20T12:21:37.904715+0000","last_clean":"2024-04-20T12:21:37.904715+0000","last_became_active":"2024-04-20T12:20:41.025121+0000","last_became_peered":"2024-04-20T12:20:41.025121+0000","last_unstale":"2024-04-20T12:21:37.904715+0000","last_undegraded":"2024-04-20T12:21:37.904715+0000","last_fullsized":"2024-04-20T12:21:37.904715+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:57:14.662567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910258+0000","last_change":"2024-04-20T12:20:42.038483+0000","last_active":"2024-04-20T12:21:37.910258+0000","last_peered":"2024-04-20T12:21:37.910258+0000","last_clean":"2024-04-20T12:21:37.910258+0000","last_became_active":"2024-04-20T12:20:42.037626+0000","last_became_peered":"2024-04-20T12:20:42.037626+0000","last_unstale":"2024-04-20T12:21:37.910258+0000","last_undegraded":"2024-04-20T12:21:37.910258+0000","last_fullsized":"2024-04-20T12:21:37.910258+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:11:27.520320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910166+0000","last_change":"2024-04-20T12:20:46.930331+0000","last_active":"2024-04-20T12:21:37.910166+0000","last_peered":"2024-04-20T12:21:37.910166+0000","last_clean":"2024-04-20T12:21:37.910166+0000","last_became_active":"2024-04-20T12:20:46.929816+0000","last_became_peered":"2024-04-20T12:20:46.929816+0000","last_unstale":"2024-04-20T12:21:37.910166+0000","last_undegraded":"2024-04-20T12:21:37.910166+0000","last_fullsized":"2024-04-20T12:21:37.910166+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:42:18.148443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'12","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907000+0000","last_change":"2024-04-20T12:20:41.022365+0000","last_active":"2024-04-20T12:21:37.907000+0000","last_peered":"2024-04-20T12:21:37.907000+0000","last_clean":"2024-04-20T12:21:37.907000+0000","last_became_active":"2024-04-20T12:20:41.022028+0000","last_became_peered":"2024-04-20T12:20:41.022028+0000","last_unstale":"2024-04-20T12:21:37.907000+0000","last_undegraded":"2024-04-20T12:21:37.907000+0000","last_fullsized":"2024-04-20T12:21:37.907000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:16.436008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910767+0000","last_change":"2024-04-20T12:20:42.031833+0000","last_active":"2024-04-20T12:21:37.910767+0000","last_peered":"2024-04-20T12:21:37.910767+0000","last_clean":"2024-04-20T12:21:37.910767+0000","last_became_active":"2024-04-20T12:20:42.031535+0000","last_became_peered":"2024-04-20T12:20:42.031535+0000","last_unstale":"2024-04-20T12:21:37.910767+0000","last_undegraded":"2024-04-20T12:21:37.910767+0000","last_fullsized":"2024-04-20T12:21:37.910767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:39:38.955662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910899+0000","last_change":"2024-04-20T12:20:46.319218+0000","last_active":"2024-04-20T12:21:37.910899+0000","last_peered":"2024-04-20T12:21:37.910899+0000","last_clean":"2024-04-20T12:21:37.910899+0000","last_became_active":"2024-04-20T12:20:46.318822+0000","last_became_peered":"2024-04-20T12:20:46.318822+0000","last_unstale":"2024-04-20T12:21:37.910899+0000","last_undegraded":"2024-04-20T12:21:37.910899+0000","last_fullsized":"2024-04-20T12:21:37.910899+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:19:16.907942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904931+0000","last_change":"2024-04-20T12:20:41.035984+0000","last_active":"2024-04-20T12:21:37.904931+0000","last_peered":"2024-04-20T12:21:37.904931+0000","last_clean":"2024-04-20T12:21:37.904931+0000","last_became_active":"2024-04-20T12:20:41.035594+0000","last_became_peered":"2024-04-20T12:20:41.035594+0000","last_unstale":"2024-04-20T12:21:37.904931+0000","last_undegraded":"2024-04-20T12:21:37.904931+0000","last_fullsized":"2024-04-20T12:21:37.904931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:15.549551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907833+0000","last_change":"2024-04-20T12:20:42.032156+0000","last_active":"2024-04-20T12:21:37.907833+0000","last_peered":"2024-04-20T12:21:37.907833+0000","last_clean":"2024-04-20T12:21:37.907833+0000","last_became_active":"2024-04-20T12:20:42.031779+0000","last_became_peered":"2024-04-20T12:20:42.031779+0000","last_unstale":"2024-04-20T12:21:37.907833+0000","last_undegraded":"2024-04-20T12:21:37.907833+0000","last_fullsized":"2024-04-20T12:21:37.907833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:43:48.156406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904461+0000","last_change":"2024-04-20T12:20:46.931229+0000","last_active":"2024-04-20T12:21:37.904461+0000","last_peered":"2024-04-20T12:21:37.904461+0000","last_clean":"2024-04-20T12:21:37.904461+0000","last_became_active":"2024-04-20T12:20:46.930677+0000","last_became_peered":"2024-04-20T12:20:46.930677+0000","last_unstale":"2024-04-20T12:21:37.904461+0000","last_undegraded":"2024-04-20T12:21:37.904461+0000","last_fullsized":"2024-04-20T12:21:37.904461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:54.933944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940295+0000","last_change":"2024-04-20T12:20:41.023789+0000","last_active":"2024-04-20T12:21:37.940295+0000","last_peered":"2024-04-20T12:21:37.940295+0000","last_clean":"2024-04-20T12:21:37.940295+0000","last_became_active":"2024-04-20T12:20:41.023329+0000","last_became_peered":"2024-04-20T12:20:41.023329+0000","last_unstale":"2024-04-20T12:21:37.940295+0000","last_undegraded":"2024-04-20T12:21:37.940295+0000","last_fullsized":"2024-04-20T12:21:37.940295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:02:17.634230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.903970+0000","last_change":"2024-04-20T12:20:42.028708+0000","last_active":"2024-04-20T12:21:37.903970+0000","last_peered":"2024-04-20T12:21:37.903970+0000","last_clean":"2024-04-20T12:21:37.903970+0000","last_became_active":"2024-04-20T12:20:42.028358+0000","last_became_peered":"2024-04-20T12:20:42.028358+0000","last_unstale":"2024-04-20T12:21:37.903970+0000","last_undegraded":"2024-04-20T12:21:37.903970+0000","last_fullsized":"2024-04-20T12:21:37.903970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:21:58.583709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.908257+0000","last_change":"2024-04-20T12:20:46.329173+0000","last_active":"2024-04-20T12:21:37.908257+0000","last_peered":"2024-04-20T12:21:37.908257+0000","last_clean":"2024-04-20T12:21:37.908257+0000","last_became_active":"2024-04-20T12:20:46.328771+0000","last_became_peered":"2024-04-20T12:20:46.328771+0000","last_unstale":"2024-04-20T12:21:37.908257+0000","last_undegraded":"2024-04-20T12:21:37.908257+0000","last_fullsized":"2024-04-20T12:21:37.908257+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:43:57.796849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909730+0000","last_change":"2024-04-20T12:20:41.030389+0000","last_active":"2024-04-20T12:21:37.909730+0000","last_peered":"2024-04-20T12:21:37.909730+0000","last_clean":"2024-04-20T12:21:37.909730+0000","last_became_active":"2024-04-20T12:20:41.029864+0000","last_became_peered":"2024-04-20T12:20:41.029864+0000","last_unstale":"2024-04-20T12:21:37.909730+0000","last_undegraded":"2024-04-20T12:21:37.909730+0000","last_fullsized":"2024-04-20T12:21:37.909730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:01:13.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906349+0000","last_change":"2024-04-20T12:20:42.032322+0000","last_active":"2024-04-20T12:21:37.906349+0000","last_peered":"2024-04-20T12:21:37.906349+0000","last_clean":"2024-04-20T12:21:37.906349+0000","last_became_active":"2024-04-20T12:20:42.031973+0000","last_became_peered":"2024-04-20T12:20:42.031973+0000","last_unstale":"2024-04-20T12:21:37.906349+0000","last_undegraded":"2024-04-20T12:21:37.906349+0000","last_fullsized":"2024-04-20T12:21:37.906349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:44:17.135478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904410+0000","last_change":"2024-04-20T12:20:46.321909+0000","last_active":"2024-04-20T12:21:37.904410+0000","last_peered":"2024-04-20T12:21:37.904410+0000","last_clean":"2024-04-20T12:21:37.904410+0000","last_became_active":"2024-04-20T12:20:46.321273+0000","last_became_peered":"2024-04-20T12:20:46.321273+0000","last_unstale":"2024-04-20T12:21:37.904410+0000","last_undegraded":"2024-04-20T12:21:37.904410+0000","last_fullsized":"2024-04-20T12:21:37.904410+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:58:18.429052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.947242+0000","last_change":"2024-04-20T12:21:37.947242+0000","last_active":"2024-04-20T12:21:37.947242+0000","last_peered":"2024-04-20T12:21:37.947242+0000","last_clean":"2024-04-20T12:21:37.947242+0000","last_became_active":"2024-04-20T12:21:37.941542+0000","last_became_peered":"2024-04-20T12:21:37.941542+0000","last_unstale":"2024-04-20T12:21:37.947242+0000","last_undegraded":"2024-04-20T12:21:37.947242+0000","last_fullsized":"2024-04-20T12:21:37.947242+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:48:04.916848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910399+0000","last_change":"2024-04-20T12:20:42.037258+0000","last_active":"2024-04-20T12:21:37.910399+0000","last_peered":"2024-04-20T12:21:37.910399+0000","last_clean":"2024-04-20T12:21:37.910399+0000","last_became_active":"2024-04-20T12:20:42.036755+0000","last_became_peered":"2024-04-20T12:20:42.036755+0000","last_unstale":"2024-04-20T12:21:37.910399+0000","last_undegraded":"2024-04-20T12:21:37.910399+0000","last_fullsized":"2024-04-20T12:21:37.910399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:23:17.093038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904463+0000","last_change":"2024-04-20T12:20:46.929829+0000","last_active":"2024-04-20T12:21:37.904463+0000","last_peered":"2024-04-20T12:21:37.904463+0000","last_clean":"2024-04-20T12:21:37.904463+0000","last_became_active":"2024-04-20T12:20:46.929296+0000","last_became_peered":"2024-04-20T12:20:46.929296+0000","last_unstale":"2024-04-20T12:21:37.904463+0000","last_undegraded":"2024-04-20T12:21:37.904463+0000","last_fullsized":"2024-04-20T12:21:37.904463+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:30.700141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904160+0000","last_change":"2024-04-20T12:20:41.027753+0000","last_active":"2024-04-20T12:21:37.904160+0000","last_peered":"2024-04-20T12:21:37.904160+0000","last_clean":"2024-04-20T12:21:37.904160+0000","last_became_active":"2024-04-20T12:20:41.027360+0000","last_became_peered":"2024-04-20T12:20:41.027360+0000","last_unstale":"2024-04-20T12:21:37.904160+0000","last_undegraded":"2024-04-20T12:21:37.904160+0000","last_fullsized":"2024-04-20T12:21:37.904160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:30:59.710541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909576+0000","last_change":"2024-04-20T12:20:42.029409+0000","last_active":"2024-04-20T12:21:37.909576+0000","last_peered":"2024-04-20T12:21:37.909576+0000","last_clean":"2024-04-20T12:21:37.909576+0000","last_became_active":"2024-04-20T12:20:42.029062+0000","last_became_peered":"2024-04-20T12:20:42.029062+0000","last_unstale":"2024-04-20T12:21:37.909576+0000","last_undegraded":"2024-04-20T12:21:37.909576+0000","last_fullsized":"2024-04-20T12:21:37.909576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:47:33.412087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940368+0000","last_change":"2024-04-20T12:20:46.326605+0000","last_active":"2024-04-20T12:21:37.940368+0000","last_peered":"2024-04-20T12:21:37.940368+0000","last_clean":"2024-04-20T12:21:37.940368+0000","last_became_active":"2024-04-20T12:20:46.326162+0000","last_became_peered":"2024-04-20T12:20:46.326162+0000","last_unstale":"2024-04-20T12:21:37.940368+0000","last_undegraded":"2024-04-20T12:21:37.940368+0000","last_fullsized":"2024-04-20T12:21:37.940368+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:44:37.344357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":106,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:16.410002+0000","last_change":"2024-04-20T12:20:41.035324+0000","last_active":"2024-04-20T12:22:16.410002+0000","last_peered":"2024-04-20T12:22:16.410002+0000","last_clean":"2024-04-20T12:22:16.410002+0000","last_became_active":"2024-04-20T12:20:41.034996+0000","last_became_peered":"2024-04-20T12:20:41.034996+0000","last_unstale":"2024-04-20T12:22:16.410002+0000","last_undegraded":"2024-04-20T12:22:16.410002+0000","last_fullsized":"2024-04-20T12:22:16.410002+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:33.788405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910006+0000","last_change":"2024-04-20T12:20:42.028803+0000","last_active":"2024-04-20T12:21:37.910006+0000","last_peered":"2024-04-20T12:21:37.910006+0000","last_clean":"2024-04-20T12:21:37.910006+0000","last_became_active":"2024-04-20T12:20:42.028316+0000","last_became_peered":"2024-04-20T12:20:42.028316+0000","last_unstale":"2024-04-20T12:21:37.910006+0000","last_undegraded":"2024-04-20T12:21:37.910006+0000","last_fullsized":"2024-04-20T12:21:37.910006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:09.000315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907027+0000","last_change":"2024-04-20T12:20:46.328502+0000","last_active":"2024-04-20T12:21:37.907027+0000","last_peered":"2024-04-20T12:21:37.907027+0000","last_clean":"2024-04-20T12:21:37.907027+0000","last_became_active":"2024-04-20T12:20:46.328106+0000","last_became_peered":"2024-04-20T12:20:46.328106+0000","last_unstale":"2024-04-20T12:21:37.907027+0000","last_undegraded":"2024-04-20T12:21:37.907027+0000","last_fullsized":"2024-04-20T12:21:37.907027+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:06:30.041621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910291+0000","last_change":"2024-04-20T12:20:41.023918+0000","last_active":"2024-04-20T12:21:37.910291+0000","last_peered":"2024-04-20T12:21:37.910291+0000","last_clean":"2024-04-20T12:21:37.910291+0000","last_became_active":"2024-04-20T12:20:41.023088+0000","last_became_peered":"2024-04-20T12:20:41.023088+0000","last_unstale":"2024-04-20T12:21:37.910291+0000","last_undegraded":"2024-04-20T12:21:37.910291+0000","last_fullsized":"2024-04-20T12:21:37.910291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:15:03.220660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909764+0000","last_change":"2024-04-20T12:20:42.038981+0000","last_active":"2024-04-20T12:21:37.909764+0000","last_peered":"2024-04-20T12:21:37.909764+0000","last_clean":"2024-04-20T12:21:37.909764+0000","last_became_active":"2024-04-20T12:20:42.038656+0000","last_became_peered":"2024-04-20T12:20:42.038656+0000","last_unstale":"2024-04-20T12:21:37.909764+0000","last_undegraded":"2024-04-20T12:21:37.909764+0000","last_fullsized":"2024-04-20T12:21:37.909764+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:51:08.446546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906836+0000","last_change":"2024-04-20T12:20:46.323446+0000","last_active":"2024-04-20T12:21:37.906836+0000","last_peered":"2024-04-20T12:21:37.906836+0000","last_clean":"2024-04-20T12:21:37.906836+0000","last_became_active":"2024-04-20T12:20:46.322259+0000","last_became_peered":"2024-04-20T12:20:46.322259+0000","last_unstale":"2024-04-20T12:21:37.906836+0000","last_undegraded":"2024-04-20T12:21:37.906836+0000","last_fullsized":"2024-04-20T12:21:37.906836+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:01:11.833469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910110+0000","last_change":"2024-04-20T12:20:41.029995+0000","last_active":"2024-04-20T12:21:37.910110+0000","last_peered":"2024-04-20T12:21:37.910110+0000","last_clean":"2024-04-20T12:21:37.910110+0000","last_became_active":"2024-04-20T12:20:41.029650+0000","last_became_peered":"2024-04-20T12:20:41.029650+0000","last_unstale":"2024-04-20T12:21:37.910110+0000","last_undegraded":"2024-04-20T12:21:37.910110+0000","last_fullsized":"2024-04-20T12:21:37.910110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:24:54.522855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910343+0000","last_change":"2024-04-20T12:20:42.030357+0000","last_active":"2024-04-20T12:21:37.910343+0000","last_peered":"2024-04-20T12:21:37.910343+0000","last_clean":"2024-04-20T12:21:37.910343+0000","last_became_active":"2024-04-20T12:20:42.029966+0000","last_became_peered":"2024-04-20T12:20:42.029966+0000","last_unstale":"2024-04-20T12:21:37.910343+0000","last_undegraded":"2024-04-20T12:21:37.910343+0000","last_fullsized":"2024-04-20T12:21:37.910343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:35:09.487965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906475+0000","last_change":"2024-04-20T12:20:42.036914+0000","last_active":"2024-04-20T12:21:37.906475+0000","last_peered":"2024-04-20T12:21:37.906475+0000","last_clean":"2024-04-20T12:21:37.906475+0000","last_became_active":"2024-04-20T12:20:42.036434+0000","last_became_peered":"2024-04-20T12:20:42.036434+0000","last_unstale":"2024-04-20T12:21:37.906475+0000","last_undegraded":"2024-04-20T12:21:37.906475+0000","last_fullsized":"2024-04-20T12:21:37.906475+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.552096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.911269+0000","last_change":"2024-04-20T12:20:42.040424+0000","last_active":"2024-04-20T12:21:37.911269+0000","last_peered":"2024-04-20T12:21:37.911269+0000","last_clean":"2024-04-20T12:21:37.911269+0000","last_became_active":"2024-04-20T12:20:42.040095+0000","last_became_peered":"2024-04-20T12:20:42.040095+0000","last_unstale":"2024-04-20T12:21:37.911269+0000","last_undegraded":"2024-04-20T12:21:37.911269+0000","last_fullsized":"2024-04-20T12:21:37.911269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:24.669083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.913663+0000","last_change":"2024-04-20T12:20:42.037764+0000","last_active":"2024-04-20T12:21:37.913663+0000","last_peered":"2024-04-20T12:21:37.913663+0000","last_clean":"2024-04-20T12:21:37.913663+0000","last_became_active":"2024-04-20T12:20:42.037389+0000","last_became_peered":"2024-04-20T12:20:42.037389+0000","last_unstale":"2024-04-20T12:21:37.913663+0000","last_undegraded":"2024-04-20T12:21:37.913663+0000","last_fullsized":"2024-04-20T12:21:37.913663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:20.284714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907264+0000","last_change":"2024-04-20T12:20:42.027546+0000","last_active":"2024-04-20T12:21:37.907264+0000","last_peered":"2024-04-20T12:21:37.907264+0000","last_clean":"2024-04-20T12:21:37.907264+0000","last_became_active":"2024-04-20T12:20:42.027229+0000","last_became_peered":"2024-04-20T12:20:42.027229+0000","last_unstale":"2024-04-20T12:21:37.907264+0000","last_undegraded":"2024-04-20T12:21:37.907264+0000","last_fullsized":"2024-04-20T12:21:37.907264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:22.649256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909742+0000","last_change":"2024-04-20T12:20:42.024971+0000","last_active":"2024-04-20T12:21:37.909742+0000","last_peered":"2024-04-20T12:21:37.909742+0000","last_clean":"2024-04-20T12:21:37.909742+0000","last_became_active":"2024-04-20T12:20:42.024607+0000","last_became_peered":"2024-04-20T12:20:42.024607+0000","last_unstale":"2024-04-20T12:21:37.909742+0000","last_undegraded":"2024-04-20T12:21:37.909742+0000","last_fullsized":"2024-04-20T12:21:37.909742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:15:56.160140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907005+0000","last_change":"2024-04-20T12:20:42.036699+0000","last_active":"2024-04-20T12:21:37.907005+0000","last_peered":"2024-04-20T12:21:37.907005+0000","last_clean":"2024-04-20T12:21:37.907005+0000","last_became_active":"2024-04-20T12:20:42.036355+0000","last_became_peered":"2024-04-20T12:20:42.036355+0000","last_unstale":"2024-04-20T12:21:37.907005+0000","last_undegraded":"2024-04-20T12:21:37.907005+0000","last_fullsized":"2024-04-20T12:21:37.907005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:14:40.276148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.915082+0000","last_change":"2024-04-20T12:20:42.034906+0000","last_active":"2024-04-20T12:21:37.915082+0000","last_peered":"2024-04-20T12:21:37.915082+0000","last_clean":"2024-04-20T12:21:37.915082+0000","last_became_active":"2024-04-20T12:20:42.034572+0000","last_became_peered":"2024-04-20T12:20:42.034572+0000","last_unstale":"2024-04-20T12:21:37.915082+0000","last_undegraded":"2024-04-20T12:21:37.915082+0000","last_fullsized":"2024-04-20T12:21:37.915082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:54.166032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910859+0000","last_change":"2024-04-20T12:20:42.041180+0000","last_active":"2024-04-20T12:21:37.910859+0000","last_peered":"2024-04-20T12:21:37.910859+0000","last_clean":"2024-04-20T12:21:37.910859+0000","last_became_active":"2024-04-20T12:20:42.040648+0000","last_became_peered":"2024-04-20T12:20:42.040648+0000","last_unstale":"2024-04-20T12:21:37.910859+0000","last_undegraded":"2024-04-20T12:21:37.910859+0000","last_fullsized":"2024-04-20T12:21:37.910859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:55:38.855441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907241+0000","last_change":"2024-04-20T12:20:42.030153+0000","last_active":"2024-04-20T12:21:37.907241+0000","last_peered":"2024-04-20T12:21:37.907241+0000","last_clean":"2024-04-20T12:21:37.907241+0000","last_became_active":"2024-04-20T12:20:42.029796+0000","last_became_peered":"2024-04-20T12:20:42.029796+0000","last_unstale":"2024-04-20T12:21:37.907241+0000","last_undegraded":"2024-04-20T12:21:37.907241+0000","last_fullsized":"2024-04-20T12:21:37.907241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:50.676958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910232+0000","last_change":"2024-04-20T12:20:42.039864+0000","last_active":"2024-04-20T12:21:37.910232+0000","last_peered":"2024-04-20T12:21:37.910232+0000","last_clean":"2024-04-20T12:21:37.910232+0000","last_became_active":"2024-04-20T12:20:42.036624+0000","last_became_peered":"2024-04-20T12:20:42.036624+0000","last_unstale":"2024-04-20T12:21:37.910232+0000","last_undegraded":"2024-04-20T12:21:37.910232+0000","last_fullsized":"2024-04-20T12:21:37.910232+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:13.271749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940688+0000","last_change":"2024-04-20T12:20:42.033628+0000","last_active":"2024-04-20T12:21:37.940688+0000","last_peered":"2024-04-20T12:21:37.940688+0000","last_clean":"2024-04-20T12:21:37.940688+0000","last_became_active":"2024-04-20T12:20:42.033296+0000","last_became_peered":"2024-04-20T12:20:42.033296+0000","last_unstale":"2024-04-20T12:21:37.940688+0000","last_undegraded":"2024-04-20T12:21:37.940688+0000","last_fullsized":"2024-04-20T12:21:37.940688+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:16:16.029327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909483+0000","last_change":"2024-04-20T12:20:42.024730+0000","last_active":"2024-04-20T12:21:37.909483+0000","last_peered":"2024-04-20T12:21:37.909483+0000","last_clean":"2024-04-20T12:21:37.909483+0000","last_became_active":"2024-04-20T12:20:42.024400+0000","last_became_peered":"2024-04-20T12:20:42.024400+0000","last_unstale":"2024-04-20T12:21:37.909483+0000","last_undegraded":"2024-04-20T12:21:37.909483+0000","last_fullsized":"2024-04-20T12:21:37.909483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:27:41.514880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906643+0000","last_change":"2024-04-20T12:20:42.033623+0000","last_active":"2024-04-20T12:21:37.906643+0000","last_peered":"2024-04-20T12:21:37.906643+0000","last_clean":"2024-04-20T12:21:37.906643+0000","last_became_active":"2024-04-20T12:20:42.033105+0000","last_became_peered":"2024-04-20T12:20:42.033105+0000","last_unstale":"2024-04-20T12:21:37.906643+0000","last_undegraded":"2024-04-20T12:21:37.906643+0000","last_fullsized":"2024-04-20T12:21:37.906643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:01.121977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":279778,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69778,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":738,"num_read_kb":454,"num_write":240,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":622,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":209334,"data_compressed":4842,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383713,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":510769,"data_compressed":23558,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645350,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712836,"statfs":{"total":95995035648,"available":95961944064,"internally_reserved":0,"allocated":1163264,"data_stored":1160941,"data_compressed":60760,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808876,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":514795,"data_compressed":23558,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070513,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":511077,"data_compressed":23558,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332150,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1089536,"data_stored":1107183,"data_compressed":59146,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495674,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":506203,"data_compressed":23558,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":570589,"data_compressed":25172,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1040384,"data_stored":507659,"data_compressed":23558,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1093632,"data_stored":570187,"data_compressed":25172,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":505911,"data_compressed":23558,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920837,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":510899,"data_compressed":23558,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757312,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1097728,"data_stored":1102765,"data_compressed":59146,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33946,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33946,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33946,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":65108,"data_compressed":1614,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64706,"data_compressed":1614,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":65092,"data_compressed":1614,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T12:22:22.117 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph pg dump --format=json 2024-04-20T12:22:22.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:21 smithi154 ceph-mon[22073]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:22:22.282 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:21 smithi139 ceph-mon[21834]: pgmap v344: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:22:22.357 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:22:23.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:22 smithi135 ceph-mon[18264]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:22:23.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:22 smithi154 ceph-mon[22073]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:22:23.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:22 smithi139 ceph-mon[21834]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:22:24.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.052+0000 7fa3e0900700 1 -- 172.21.15.135:0/1162934045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc103460 msgr2=0x7fa3dc10f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.052+0000 7fa3e0900700 1 --2- 172.21.15.135:0/1162934045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc103460 0x7fa3dc10f8c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400b0a0 tx=0x7fa3d400b3b0 comp rx=0 tx=0).stop 2024-04-20T12:22:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.053+0000 7fa3e0900700 1 -- 172.21.15.135:0/1162934045 shutdown_connections 2024-04-20T12:22:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.053+0000 7fa3e0900700 1 --2- 172.21.15.135:0/1162934045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc103460 0x7fa3dc10f8c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.053+0000 7fa3e0900700 1 --2- 172.21.15.135:0/1162934045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3dc108a60 0x7fa3dc108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.053+0000 7fa3e0900700 1 --2- 172.21.15.135:0/1162934045 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3dc102aa0 0x7fa3dc102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.053+0000 7fa3e0900700 1 -- 172.21.15.135:0/1162934045 >> 172.21.15.135:0/1162934045 conn(0x7fa3dc079bb0 msgr2=0x7fa3dc079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.053+0000 7fa3e0900700 1 -- 172.21.15.135:0/1162934045 shutdown_connections 2024-04-20T12:22:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.053+0000 7fa3e0900700 1 -- 172.21.15.135:0/1162934045 wait complete. 2024-04-20T12:22:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.053+0000 7fa3e0900700 1 Processor -- start 2024-04-20T12:22:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.053+0000 7fa3e0900700 1 -- start start 2024-04-20T12:22:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3e0900700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3dc102aa0 0x7fa3dc19b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3e0900700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc103460 0x7fa3dc19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3e0900700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3dc108a60 0x7fa3dc19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:24.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3e0900700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc112d40 con 0x7fa3dc103460 2024-04-20T12:22:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3e0900700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc112bc0 con 0x7fa3dc108a60 2024-04-20T12:22:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3e0900700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc112ec0 con 0x7fa3dc102aa0 2024-04-20T12:22:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3d9d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc103460 0x7fa3dc19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3d9d9b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc103460 0x7fa3dc19b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35650/0 (socket says 172.21.15.135:35650) 2024-04-20T12:22:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3d9d9b700 1 -- 172.21.15.135:0/2068779173 learned_addr learned my addr 172.21.15.135:0/2068779173 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3dad9d700 1 --2- 172.21.15.135:0/2068779173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3dc108a60 0x7fa3dc19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3da59c700 1 --2- 172.21.15.135:0/2068779173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3dc102aa0 0x7fa3dc19b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3d9d9b700 1 -- 172.21.15.135:0/2068779173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3dc102aa0 msgr2=0x7fa3dc19b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3d9d9b700 1 --2- 172.21.15.135:0/2068779173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3dc102aa0 0x7fa3dc19b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3d9d9b700 1 -- 172.21.15.135:0/2068779173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3dc108a60 msgr2=0x7fa3dc19fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3d9d9b700 1 --2- 172.21.15.135:0/2068779173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3dc108a60 0x7fa3dc19fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3d9d9b700 1 -- 172.21.15.135:0/2068779173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3dc1a02f0 con 0x7fa3dc103460 2024-04-20T12:22:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3d9d9b700 1 --2- 172.21.15.135:0/2068779173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc103460 0x7fa3dc19b820 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00d980 tx=0x7fa3cc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:24.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3cb7fe700 1 -- 172.21.15.135:0/2068779173 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc016070 con 0x7fa3dc103460 2024-04-20T12:22:24.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3cb7fe700 1 -- 172.21.15.135:0/2068779173 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3cc004d10 con 0x7fa3dc103460 2024-04-20T12:22:24.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.054+0000 7fa3e0900700 1 -- 172.21.15.135:0/2068779173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3dc1a05e0 con 0x7fa3dc103460 2024-04-20T12:22:24.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.055+0000 7fa3cb7fe700 1 -- 172.21.15.135:0/2068779173 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0055f0 con 0x7fa3dc103460 2024-04-20T12:22:24.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.055+0000 7fa3e0900700 1 -- 172.21.15.135:0/2068779173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3dc1a7e60 con 0x7fa3dc103460 2024-04-20T12:22:24.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.055+0000 7fa3e0900700 1 -- 172.21.15.135:0/2068779173 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3dc069740 con 0x7fa3dc103460 2024-04-20T12:22:24.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.057+0000 7fa3cb7fe700 1 -- 172.21.15.135:0/2068779173 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fa3cc004750 con 0x7fa3dc103460 2024-04-20T12:22:24.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.057+0000 7fa3cb7fe700 1 --2- 172.21.15.135:0/2068779173 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa3c40a3d50 0x7fa3c40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:24.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.057+0000 7fa3da59c700 1 --2- 172.21.15.135:0/2068779173 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa3c40a3d50 0x7fa3c40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:24.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.057+0000 7fa3cb7fe700 1 -- 172.21.15.135:0/2068779173 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fa3cc0d0b90 con 0x7fa3dc103460 2024-04-20T12:22:24.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.058+0000 7fa3da59c700 1 --2- 172.21.15.135:0/2068779173 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa3c40a3d50 0x7fa3c40a6210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0005fd0 tx=0x7fa3d000af20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:24.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.061+0000 7fa3cb7fe700 1 -- 172.21.15.135:0/2068779173 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fa3cc01f020 con 0x7fa3dc103460 2024-04-20T12:22:24.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:23 smithi135 ceph-mon[18264]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-20T12:22:24.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:23 smithi154 ceph-mon[22073]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-20T12:22:24.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.257+0000 7fa3e0900700 1 -- 172.21.15.135:0/2068779173 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3dc0763a0 con 0x7fa3c40a3d50 2024-04-20T12:22:24.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.266+0000 7fa3cb7fe700 1 -- 172.21.15.135:0/2068779173 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340735 (secure 0 0 0) 0x7fa3dc0763a0 con 0x7fa3c40a3d50 2024-04-20T12:22:24.269 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:24.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.269+0000 7fa3e0900700 1 -- 172.21.15.135:0/2068779173 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa3c40a3d50 msgr2=0x7fa3c40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:24.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.269+0000 7fa3e0900700 1 --2- 172.21.15.135:0/2068779173 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa3c40a3d50 0x7fa3c40a6210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0005fd0 tx=0x7fa3d000af20 comp rx=0 tx=0).stop 2024-04-20T12:22:24.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.269+0000 7fa3e0900700 1 -- 172.21.15.135:0/2068779173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc103460 msgr2=0x7fa3dc19b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:24.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.269+0000 7fa3e0900700 1 --2- 172.21.15.135:0/2068779173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc103460 0x7fa3dc19b820 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc00d980 tx=0x7fa3cc00dc90 comp rx=0 tx=0).stop 2024-04-20T12:22:24.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.269+0000 7fa3e0900700 1 -- 172.21.15.135:0/2068779173 shutdown_connections 2024-04-20T12:22:24.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.269+0000 7fa3e0900700 1 --2- 172.21.15.135:0/2068779173 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa3c40a3d50 0x7fa3c40a6210 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:24.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.269+0000 7fa3e0900700 1 --2- 172.21.15.135:0/2068779173 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa3dc108a60 0x7fa3dc19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:24.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.269+0000 7fa3e0900700 1 --2- 172.21.15.135:0/2068779173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3dc102aa0 0x7fa3dc19b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:24.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.269+0000 7fa3e0900700 1 --2- 172.21.15.135:0/2068779173 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa3dc103460 0x7fa3dc19b820 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:24.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.269+0000 7fa3e0900700 1 -- 172.21.15.135:0/2068779173 >> 172.21.15.135:0/2068779173 conn(0x7fa3dc079bb0 msgr2=0x7fa3dc074c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:24.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.269+0000 7fa3e0900700 1 -- 172.21.15.135:0/2068779173 shutdown_connections 2024-04-20T12:22:24.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:24.269+0000 7fa3e0900700 1 -- 172.21.15.135:0/2068779173 wait complete. 2024-04-20T12:22:24.273 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-04-20T12:22:24.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:23 smithi139 ceph-mon[21834]: pgmap v345: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-20T12:22:24.961 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-04-20T12:22:22.829747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660380,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":894,"num_read_kb":578,"num_write":423,"num_write_kb":3079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181358,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365828,"kb_used_data":12440,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575996,"statfs":{"total":1151940427776,"available":1151565819904,"internally_reserved":0,"allocated":12738560,"data_stored":8078978,"data_compressed":394302,"data_compressed_allocated":540672,"data_compressed_original":2580480,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003447"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907076+0000","last_change":"2024-04-20T12:20:42.031660+0000","last_active":"2024-04-20T12:21:37.907076+0000","last_peered":"2024-04-20T12:21:37.907076+0000","last_clean":"2024-04-20T12:21:37.907076+0000","last_became_active":"2024-04-20T12:20:42.031334+0000","last_became_peered":"2024-04-20T12:20:42.031334+0000","last_unstale":"2024-04-20T12:21:37.907076+0000","last_undegraded":"2024-04-20T12:21:37.907076+0000","last_fullsized":"2024-04-20T12:21:37.907076+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:27.971885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907915+0000","last_change":"2024-04-20T12:20:42.039049+0000","last_active":"2024-04-20T12:21:37.907915+0000","last_peered":"2024-04-20T12:21:37.907915+0000","last_clean":"2024-04-20T12:21:37.907915+0000","last_became_active":"2024-04-20T12:20:42.037960+0000","last_became_peered":"2024-04-20T12:20:42.037960+0000","last_unstale":"2024-04-20T12:21:37.907915+0000","last_undegraded":"2024-04-20T12:21:37.907915+0000","last_fullsized":"2024-04-20T12:21:37.907915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:45:44.482154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907413+0000","last_change":"2024-04-20T12:20:42.036915+0000","last_active":"2024-04-20T12:21:37.907413+0000","last_peered":"2024-04-20T12:21:37.907413+0000","last_clean":"2024-04-20T12:21:37.907413+0000","last_became_active":"2024-04-20T12:20:42.036282+0000","last_became_peered":"2024-04-20T12:20:42.036282+0000","last_unstale":"2024-04-20T12:21:37.907413+0000","last_undegraded":"2024-04-20T12:21:37.907413+0000","last_fullsized":"2024-04-20T12:21:37.907413+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:04:55.865977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904662+0000","last_change":"2024-04-20T12:20:42.036653+0000","last_active":"2024-04-20T12:21:37.904662+0000","last_peered":"2024-04-20T12:21:37.904662+0000","last_clean":"2024-04-20T12:21:37.904662+0000","last_became_active":"2024-04-20T12:20:42.036112+0000","last_became_peered":"2024-04-20T12:20:42.036112+0000","last_unstale":"2024-04-20T12:21:37.904662+0000","last_undegraded":"2024-04-20T12:21:37.904662+0000","last_fullsized":"2024-04-20T12:21:37.904662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:05:50.728127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904100+0000","last_change":"2024-04-20T12:20:42.031271+0000","last_active":"2024-04-20T12:21:37.904100+0000","last_peered":"2024-04-20T12:21:37.904100+0000","last_clean":"2024-04-20T12:21:37.904100+0000","last_became_active":"2024-04-20T12:20:42.030930+0000","last_became_peered":"2024-04-20T12:20:42.030930+0000","last_unstale":"2024-04-20T12:21:37.904100+0000","last_undegraded":"2024-04-20T12:21:37.904100+0000","last_fullsized":"2024-04-20T12:21:37.904100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:30:53.523203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907075+0000","last_change":"2024-04-20T12:20:42.037556+0000","last_active":"2024-04-20T12:21:37.907075+0000","last_peered":"2024-04-20T12:21:37.907075+0000","last_clean":"2024-04-20T12:21:37.907075+0000","last_became_active":"2024-04-20T12:20:42.037140+0000","last_became_peered":"2024-04-20T12:20:42.037140+0000","last_unstale":"2024-04-20T12:21:37.907075+0000","last_undegraded":"2024-04-20T12:21:37.907075+0000","last_fullsized":"2024-04-20T12:21:37.907075+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:41:50.827641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909529+0000","last_change":"2024-04-20T12:20:42.042004+0000","last_active":"2024-04-20T12:21:37.909529+0000","last_peered":"2024-04-20T12:21:37.909529+0000","last_clean":"2024-04-20T12:21:37.909529+0000","last_became_active":"2024-04-20T12:20:42.041663+0000","last_became_peered":"2024-04-20T12:20:42.041663+0000","last_unstale":"2024-04-20T12:21:37.909529+0000","last_undegraded":"2024-04-20T12:21:37.909529+0000","last_fullsized":"2024-04-20T12:21:37.909529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:00.196652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910022+0000","last_change":"2024-04-20T12:20:42.043250+0000","last_active":"2024-04-20T12:21:37.910022+0000","last_peered":"2024-04-20T12:21:37.910022+0000","last_clean":"2024-04-20T12:21:37.910022+0000","last_became_active":"2024-04-20T12:20:42.042678+0000","last_became_peered":"2024-04-20T12:20:42.042678+0000","last_unstale":"2024-04-20T12:21:37.910022+0000","last_undegraded":"2024-04-20T12:21:37.910022+0000","last_fullsized":"2024-04-20T12:21:37.910022+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:28:36.825718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940944+0000","last_change":"2024-04-20T12:20:42.026370+0000","last_active":"2024-04-20T12:21:37.940944+0000","last_peered":"2024-04-20T12:21:37.940944+0000","last_clean":"2024-04-20T12:21:37.940944+0000","last_became_active":"2024-04-20T12:20:42.026010+0000","last_became_peered":"2024-04-20T12:20:42.026010+0000","last_unstale":"2024-04-20T12:21:37.940944+0000","last_undegraded":"2024-04-20T12:21:37.940944+0000","last_fullsized":"2024-04-20T12:21:37.940944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:13.526130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.912184+0000","last_change":"2024-04-20T12:21:37.912184+0000","last_active":"2024-04-20T12:21:37.912184+0000","last_peered":"2024-04-20T12:21:37.912184+0000","last_clean":"2024-04-20T12:21:37.912184+0000","last_became_active":"2024-04-20T12:21:37.911745+0000","last_became_peered":"2024-04-20T12:21:37.911745+0000","last_unstale":"2024-04-20T12:21:37.912184+0000","last_undegraded":"2024-04-20T12:21:37.912184+0000","last_fullsized":"2024-04-20T12:21:37.912184+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:39:26.296420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909997+0000","last_change":"2024-04-20T12:20:42.032408+0000","last_active":"2024-04-20T12:21:37.909997+0000","last_peered":"2024-04-20T12:21:37.909997+0000","last_clean":"2024-04-20T12:21:37.909997+0000","last_became_active":"2024-04-20T12:20:42.032035+0000","last_became_peered":"2024-04-20T12:20:42.032035+0000","last_unstale":"2024-04-20T12:21:37.909997+0000","last_undegraded":"2024-04-20T12:21:37.909997+0000","last_fullsized":"2024-04-20T12:21:37.909997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:03.702299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904784+0000","last_change":"2024-04-20T12:20:42.040299+0000","last_active":"2024-04-20T12:21:37.904784+0000","last_peered":"2024-04-20T12:21:37.904784+0000","last_clean":"2024-04-20T12:21:37.904784+0000","last_became_active":"2024-04-20T12:20:42.039891+0000","last_became_peered":"2024-04-20T12:20:42.039891+0000","last_unstale":"2024-04-20T12:21:37.904784+0000","last_undegraded":"2024-04-20T12:21:37.904784+0000","last_fullsized":"2024-04-20T12:21:37.904784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:16:31.701459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909599+0000","last_change":"2024-04-20T12:20:42.032551+0000","last_active":"2024-04-20T12:21:37.909599+0000","last_peered":"2024-04-20T12:21:37.909599+0000","last_clean":"2024-04-20T12:21:37.909599+0000","last_became_active":"2024-04-20T12:20:42.032247+0000","last_became_peered":"2024-04-20T12:20:42.032247+0000","last_unstale":"2024-04-20T12:21:37.909599+0000","last_undegraded":"2024-04-20T12:21:37.909599+0000","last_fullsized":"2024-04-20T12:21:37.909599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:02:22.181110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906931+0000","last_change":"2024-04-20T12:20:42.042662+0000","last_active":"2024-04-20T12:21:37.906931+0000","last_peered":"2024-04-20T12:21:37.906931+0000","last_clean":"2024-04-20T12:21:37.906931+0000","last_became_active":"2024-04-20T12:20:42.042351+0000","last_became_peered":"2024-04-20T12:20:42.042351+0000","last_unstale":"2024-04-20T12:21:37.906931+0000","last_undegraded":"2024-04-20T12:21:37.906931+0000","last_fullsized":"2024-04-20T12:21:37.906931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:15:21.632339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906762+0000","last_change":"2024-04-20T12:20:42.033402+0000","last_active":"2024-04-20T12:21:37.906762+0000","last_peered":"2024-04-20T12:21:37.906762+0000","last_clean":"2024-04-20T12:21:37.906762+0000","last_became_active":"2024-04-20T12:20:42.032996+0000","last_became_peered":"2024-04-20T12:20:42.032996+0000","last_unstale":"2024-04-20T12:21:37.906762+0000","last_undegraded":"2024-04-20T12:21:37.906762+0000","last_fullsized":"2024-04-20T12:21:37.906762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:45.487051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940290+0000","last_change":"2024-04-20T12:20:42.033836+0000","last_active":"2024-04-20T12:21:37.940290+0000","last_peered":"2024-04-20T12:21:37.940290+0000","last_clean":"2024-04-20T12:21:37.940290+0000","last_became_active":"2024-04-20T12:20:42.033497+0000","last_became_peered":"2024-04-20T12:20:42.033497+0000","last_unstale":"2024-04-20T12:21:37.940290+0000","last_undegraded":"2024-04-20T12:21:37.940290+0000","last_fullsized":"2024-04-20T12:21:37.940290+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:25:16.428158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906767+0000","last_change":"2024-04-20T12:20:42.030284+0000","last_active":"2024-04-20T12:21:37.906767+0000","last_peered":"2024-04-20T12:21:37.906767+0000","last_clean":"2024-04-20T12:21:37.906767+0000","last_became_active":"2024-04-20T12:20:42.029899+0000","last_became_peered":"2024-04-20T12:20:42.029899+0000","last_unstale":"2024-04-20T12:21:37.906767+0000","last_undegraded":"2024-04-20T12:21:37.906767+0000","last_fullsized":"2024-04-20T12:21:37.906767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:39:14.371947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906459+0000","last_change":"2024-04-20T12:20:42.028298+0000","last_active":"2024-04-20T12:21:37.906459+0000","last_peered":"2024-04-20T12:21:37.906459+0000","last_clean":"2024-04-20T12:21:37.906459+0000","last_became_active":"2024-04-20T12:20:42.027814+0000","last_became_peered":"2024-04-20T12:20:42.027814+0000","last_unstale":"2024-04-20T12:21:37.906459+0000","last_undegraded":"2024-04-20T12:21:37.906459+0000","last_fullsized":"2024-04-20T12:21:37.906459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:44:39.903424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.914463+0000","last_change":"2024-04-20T12:20:42.043697+0000","last_active":"2024-04-20T12:21:37.914463+0000","last_peered":"2024-04-20T12:21:37.914463+0000","last_clean":"2024-04-20T12:21:37.914463+0000","last_became_active":"2024-04-20T12:20:42.043322+0000","last_became_peered":"2024-04-20T12:20:42.043322+0000","last_unstale":"2024-04-20T12:21:37.914463+0000","last_undegraded":"2024-04-20T12:21:37.914463+0000","last_fullsized":"2024-04-20T12:21:37.914463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:08:35.148726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.911218+0000","last_change":"2024-04-20T12:20:46.326298+0000","last_active":"2024-04-20T12:21:37.911218+0000","last_peered":"2024-04-20T12:21:37.911218+0000","last_clean":"2024-04-20T12:21:37.911218+0000","last_became_active":"2024-04-20T12:20:46.325893+0000","last_became_peered":"2024-04-20T12:20:46.325893+0000","last_unstale":"2024-04-20T12:21:37.911218+0000","last_undegraded":"2024-04-20T12:21:37.911218+0000","last_fullsized":"2024-04-20T12:21:37.911218+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:17.076871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'13","reported_seq":115,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:19.446164+0000","last_change":"2024-04-20T12:20:41.027834+0000","last_active":"2024-04-20T12:22:19.446164+0000","last_peered":"2024-04-20T12:22:19.446164+0000","last_clean":"2024-04-20T12:22:19.446164+0000","last_became_active":"2024-04-20T12:20:41.027541+0000","last_became_peered":"2024-04-20T12:20:41.027541+0000","last_unstale":"2024-04-20T12:22:19.446164+0000","last_undegraded":"2024-04-20T12:22:19.446164+0000","last_fullsized":"2024-04-20T12:22:19.446164+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:30.454875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910600+0000","last_change":"2024-04-20T12:20:42.043315+0000","last_active":"2024-04-20T12:21:37.910600+0000","last_peered":"2024-04-20T12:21:37.910600+0000","last_clean":"2024-04-20T12:21:37.910600+0000","last_became_active":"2024-04-20T12:20:42.042920+0000","last_became_peered":"2024-04-20T12:20:42.042920+0000","last_unstale":"2024-04-20T12:21:37.910600+0000","last_undegraded":"2024-04-20T12:21:37.910600+0000","last_fullsized":"2024-04-20T12:21:37.910600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:52.353023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904092+0000","last_change":"2024-04-20T12:20:46.327004+0000","last_active":"2024-04-20T12:21:37.904092+0000","last_peered":"2024-04-20T12:21:37.904092+0000","last_clean":"2024-04-20T12:21:37.904092+0000","last_became_active":"2024-04-20T12:20:46.326433+0000","last_became_peered":"2024-04-20T12:20:46.326433+0000","last_unstale":"2024-04-20T12:21:37.904092+0000","last_undegraded":"2024-04-20T12:21:37.904092+0000","last_fullsized":"2024-04-20T12:21:37.904092+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:58:05.864093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910704+0000","last_change":"2024-04-20T12:20:41.032149+0000","last_active":"2024-04-20T12:21:37.910704+0000","last_peered":"2024-04-20T12:21:37.910704+0000","last_clean":"2024-04-20T12:21:37.910704+0000","last_became_active":"2024-04-20T12:20:41.031708+0000","last_became_peered":"2024-04-20T12:20:41.031708+0000","last_unstale":"2024-04-20T12:21:37.910704+0000","last_undegraded":"2024-04-20T12:21:37.910704+0000","last_fullsized":"2024-04-20T12:21:37.910704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:55.167376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907419+0000","last_change":"2024-04-20T12:20:42.040462+0000","last_active":"2024-04-20T12:21:37.907419+0000","last_peered":"2024-04-20T12:21:37.907419+0000","last_clean":"2024-04-20T12:21:37.907419+0000","last_became_active":"2024-04-20T12:20:42.040098+0000","last_became_peered":"2024-04-20T12:20:42.040098+0000","last_unstale":"2024-04-20T12:21:37.907419+0000","last_undegraded":"2024-04-20T12:21:37.907419+0000","last_fullsized":"2024-04-20T12:21:37.907419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:16.091488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904081+0000","last_change":"2024-04-20T12:20:46.327205+0000","last_active":"2024-04-20T12:21:37.904081+0000","last_peered":"2024-04-20T12:21:37.904081+0000","last_clean":"2024-04-20T12:21:37.904081+0000","last_became_active":"2024-04-20T12:20:46.326511+0000","last_became_peered":"2024-04-20T12:20:46.326511+0000","last_unstale":"2024-04-20T12:21:37.904081+0000","last_undegraded":"2024-04-20T12:21:37.904081+0000","last_fullsized":"2024-04-20T12:21:37.904081+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:45:11.351139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.924962+0000","last_change":"2024-04-20T12:21:37.924962+0000","last_active":"2024-04-20T12:21:37.924962+0000","last_peered":"2024-04-20T12:21:37.924962+0000","last_clean":"2024-04-20T12:21:37.924962+0000","last_became_active":"2024-04-20T12:21:37.914275+0000","last_became_peered":"2024-04-20T12:21:37.914275+0000","last_unstale":"2024-04-20T12:21:37.924962+0000","last_undegraded":"2024-04-20T12:21:37.924962+0000","last_fullsized":"2024-04-20T12:21:37.924962+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:05.894889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940731+0000","last_change":"2024-04-20T12:20:42.029785+0000","last_active":"2024-04-20T12:21:37.940731+0000","last_peered":"2024-04-20T12:21:37.940731+0000","last_clean":"2024-04-20T12:21:37.940731+0000","last_became_active":"2024-04-20T12:20:42.029377+0000","last_became_peered":"2024-04-20T12:20:42.029377+0000","last_unstale":"2024-04-20T12:21:37.940731+0000","last_undegraded":"2024-04-20T12:21:37.940731+0000","last_fullsized":"2024-04-20T12:21:37.940731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:22:52.429274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904032+0000","last_change":"2024-04-20T12:20:46.326552+0000","last_active":"2024-04-20T12:21:37.904032+0000","last_peered":"2024-04-20T12:21:37.904032+0000","last_clean":"2024-04-20T12:21:37.904032+0000","last_became_active":"2024-04-20T12:20:46.325573+0000","last_became_peered":"2024-04-20T12:20:46.325573+0000","last_unstale":"2024-04-20T12:21:37.904032+0000","last_undegraded":"2024-04-20T12:21:37.904032+0000","last_fullsized":"2024-04-20T12:21:37.904032+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:26:01.218141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904380+0000","last_change":"2024-04-20T12:20:41.023884+0000","last_active":"2024-04-20T12:21:37.904380+0000","last_peered":"2024-04-20T12:21:37.904380+0000","last_clean":"2024-04-20T12:21:37.904380+0000","last_became_active":"2024-04-20T12:20:41.023496+0000","last_became_peered":"2024-04-20T12:20:41.023496+0000","last_unstale":"2024-04-20T12:21:37.904380+0000","last_undegraded":"2024-04-20T12:21:37.904380+0000","last_fullsized":"2024-04-20T12:21:37.904380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:08.824928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.941972+0000","last_change":"2024-04-20T12:21:37.941552+0000","last_active":"2024-04-20T12:21:37.941972+0000","last_peered":"2024-04-20T12:21:37.941972+0000","last_clean":"2024-04-20T12:21:37.941972+0000","last_became_active":"2024-04-20T12:21:37.941228+0000","last_became_peered":"2024-04-20T12:21:37.941228+0000","last_unstale":"2024-04-20T12:21:37.941972+0000","last_undegraded":"2024-04-20T12:21:37.941972+0000","last_fullsized":"2024-04-20T12:21:37.941972+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:33.915039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.914213+0000","last_change":"2024-04-20T12:20:46.324508+0000","last_active":"2024-04-20T12:21:37.914213+0000","last_peered":"2024-04-20T12:21:37.914213+0000","last_clean":"2024-04-20T12:21:37.914213+0000","last_became_active":"2024-04-20T12:20:46.324014+0000","last_became_peered":"2024-04-20T12:20:46.324014+0000","last_unstale":"2024-04-20T12:21:37.914213+0000","last_undegraded":"2024-04-20T12:21:37.914213+0000","last_fullsized":"2024-04-20T12:21:37.914213+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:17.765152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":122,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:20.976609+0000","last_change":"2024-04-20T12:21:37.927225+0000","last_active":"2024-04-20T12:22:20.976609+0000","last_peered":"2024-04-20T12:22:20.976609+0000","last_clean":"2024-04-20T12:22:20.976609+0000","last_became_active":"2024-04-20T12:21:37.911437+0000","last_became_peered":"2024-04-20T12:21:37.911437+0000","last_unstale":"2024-04-20T12:22:20.976609+0000","last_undegraded":"2024-04-20T12:22:20.976609+0000","last_fullsized":"2024-04-20T12:22:20.976609+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:08:14.576145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904114+0000","last_change":"2024-04-20T12:20:42.047403+0000","last_active":"2024-04-20T12:21:37.904114+0000","last_peered":"2024-04-20T12:21:37.904114+0000","last_clean":"2024-04-20T12:21:37.904114+0000","last_became_active":"2024-04-20T12:20:42.046240+0000","last_became_peered":"2024-04-20T12:20:42.046240+0000","last_unstale":"2024-04-20T12:21:37.904114+0000","last_undegraded":"2024-04-20T12:21:37.904114+0000","last_fullsized":"2024-04-20T12:21:37.904114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:21:40.410666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.914217+0000","last_change":"2024-04-20T12:20:46.326908+0000","last_active":"2024-04-20T12:21:37.914217+0000","last_peered":"2024-04-20T12:21:37.914217+0000","last_clean":"2024-04-20T12:21:37.914217+0000","last_became_active":"2024-04-20T12:20:46.326525+0000","last_became_peered":"2024-04-20T12:20:46.326525+0000","last_unstale":"2024-04-20T12:21:37.914217+0000","last_undegraded":"2024-04-20T12:21:37.914217+0000","last_fullsized":"2024-04-20T12:21:37.914217+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:30:25.132976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907074+0000","last_change":"2024-04-20T12:20:41.027532+0000","last_active":"2024-04-20T12:21:37.907074+0000","last_peered":"2024-04-20T12:21:37.907074+0000","last_clean":"2024-04-20T12:21:37.907074+0000","last_became_active":"2024-04-20T12:20:41.027090+0000","last_became_peered":"2024-04-20T12:20:41.027090+0000","last_unstale":"2024-04-20T12:21:37.907074+0000","last_undegraded":"2024-04-20T12:21:37.907074+0000","last_fullsized":"2024-04-20T12:21:37.907074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:40:10.450305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.912691+0000","last_change":"2024-04-20T12:21:37.912691+0000","last_active":"2024-04-20T12:21:37.912691+0000","last_peered":"2024-04-20T12:21:37.912691+0000","last_clean":"2024-04-20T12:21:37.912691+0000","last_became_active":"2024-04-20T12:21:37.912295+0000","last_became_peered":"2024-04-20T12:21:37.912295+0000","last_unstale":"2024-04-20T12:21:37.912691+0000","last_undegraded":"2024-04-20T12:21:37.912691+0000","last_fullsized":"2024-04-20T12:21:37.912691+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:48:04.501944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906576+0000","last_change":"2024-04-20T12:20:46.318633+0000","last_active":"2024-04-20T12:21:37.906576+0000","last_peered":"2024-04-20T12:21:37.906576+0000","last_clean":"2024-04-20T12:21:37.906576+0000","last_became_active":"2024-04-20T12:20:46.318215+0000","last_became_peered":"2024-04-20T12:20:46.318215+0000","last_unstale":"2024-04-20T12:21:37.906576+0000","last_undegraded":"2024-04-20T12:21:37.906576+0000","last_fullsized":"2024-04-20T12:21:37.906576+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:07:31.241287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909172+0000","last_change":"2024-04-20T12:20:41.027009+0000","last_active":"2024-04-20T12:21:37.909172+0000","last_peered":"2024-04-20T12:21:37.909172+0000","last_clean":"2024-04-20T12:21:37.909172+0000","last_became_active":"2024-04-20T12:20:41.026683+0000","last_became_peered":"2024-04-20T12:20:41.026683+0000","last_unstale":"2024-04-20T12:21:37.909172+0000","last_undegraded":"2024-04-20T12:21:37.909172+0000","last_fullsized":"2024-04-20T12:21:37.909172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:56:35.955635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910274+0000","last_change":"2024-04-20T12:20:42.030833+0000","last_active":"2024-04-20T12:21:37.910274+0000","last_peered":"2024-04-20T12:21:37.910274+0000","last_clean":"2024-04-20T12:21:37.910274+0000","last_became_active":"2024-04-20T12:20:42.030470+0000","last_became_peered":"2024-04-20T12:20:42.030470+0000","last_unstale":"2024-04-20T12:21:37.910274+0000","last_undegraded":"2024-04-20T12:21:37.910274+0000","last_fullsized":"2024-04-20T12:21:37.910274+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:20:07.381222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907739+0000","last_change":"2024-04-20T12:20:46.327091+0000","last_active":"2024-04-20T12:21:37.907739+0000","last_peered":"2024-04-20T12:21:37.907739+0000","last_clean":"2024-04-20T12:21:37.907739+0000","last_became_active":"2024-04-20T12:20:46.326663+0000","last_became_peered":"2024-04-20T12:20:46.326663+0000","last_unstale":"2024-04-20T12:21:37.907739+0000","last_undegraded":"2024-04-20T12:21:37.907739+0000","last_fullsized":"2024-04-20T12:21:37.907739+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:37:31.968946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907108+0000","last_change":"2024-04-20T12:20:41.028908+0000","last_active":"2024-04-20T12:21:37.907108+0000","last_peered":"2024-04-20T12:21:37.907108+0000","last_clean":"2024-04-20T12:21:37.907108+0000","last_became_active":"2024-04-20T12:20:41.028570+0000","last_became_peered":"2024-04-20T12:20:41.028570+0000","last_unstale":"2024-04-20T12:21:37.907108+0000","last_undegraded":"2024-04-20T12:21:37.907108+0000","last_fullsized":"2024-04-20T12:21:37.907108+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:39:27.309249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906063+0000","last_change":"2024-04-20T12:20:42.028802+0000","last_active":"2024-04-20T12:21:37.906063+0000","last_peered":"2024-04-20T12:21:37.906063+0000","last_clean":"2024-04-20T12:21:37.906063+0000","last_became_active":"2024-04-20T12:20:42.028458+0000","last_became_peered":"2024-04-20T12:20:42.028458+0000","last_unstale":"2024-04-20T12:21:37.906063+0000","last_undegraded":"2024-04-20T12:21:37.906063+0000","last_fullsized":"2024-04-20T12:21:37.906063+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:59:28.284954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910390+0000","last_change":"2024-04-20T12:20:46.331055+0000","last_active":"2024-04-20T12:21:37.910390+0000","last_peered":"2024-04-20T12:21:37.910390+0000","last_clean":"2024-04-20T12:21:37.910390+0000","last_became_active":"2024-04-20T12:20:46.330181+0000","last_became_peered":"2024-04-20T12:20:46.330181+0000","last_unstale":"2024-04-20T12:21:37.910390+0000","last_undegraded":"2024-04-20T12:21:37.910390+0000","last_fullsized":"2024-04-20T12:21:37.910390+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:27.430141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'4","reported_seq":178,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:19.974362+0000","last_change":"2024-04-20T12:20:41.025859+0000","last_active":"2024-04-20T12:22:19.974362+0000","last_peered":"2024-04-20T12:22:19.974362+0000","last_clean":"2024-04-20T12:22:19.974362+0000","last_became_active":"2024-04-20T12:20:41.025443+0000","last_became_peered":"2024-04-20T12:20:41.025443+0000","last_unstale":"2024-04-20T12:22:19.974362+0000","last_undegraded":"2024-04-20T12:22:19.974362+0000","last_fullsized":"2024-04-20T12:22:19.974362+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:11:28.100797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":145,"num_read_kb":145,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940948+0000","last_change":"2024-04-20T12:20:42.028510+0000","last_active":"2024-04-20T12:21:37.940948+0000","last_peered":"2024-04-20T12:21:37.940948+0000","last_clean":"2024-04-20T12:21:37.940948+0000","last_became_active":"2024-04-20T12:20:42.028176+0000","last_became_peered":"2024-04-20T12:20:42.028176+0000","last_unstale":"2024-04-20T12:21:37.940948+0000","last_undegraded":"2024-04-20T12:21:37.940948+0000","last_fullsized":"2024-04-20T12:21:37.940948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:49:44.606154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.905678+0000","last_change":"2024-04-20T12:20:46.327813+0000","last_active":"2024-04-20T12:21:37.905678+0000","last_peered":"2024-04-20T12:21:37.905678+0000","last_clean":"2024-04-20T12:21:37.905678+0000","last_became_active":"2024-04-20T12:20:46.327446+0000","last_became_peered":"2024-04-20T12:20:46.327446+0000","last_unstale":"2024-04-20T12:21:37.905678+0000","last_undegraded":"2024-04-20T12:21:37.905678+0000","last_fullsized":"2024-04-20T12:21:37.905678+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:30:23.990693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909984+0000","last_change":"2024-04-20T12:20:41.027748+0000","last_active":"2024-04-20T12:21:37.909984+0000","last_peered":"2024-04-20T12:21:37.909984+0000","last_clean":"2024-04-20T12:21:37.909984+0000","last_became_active":"2024-04-20T12:20:41.027400+0000","last_became_peered":"2024-04-20T12:20:41.027400+0000","last_unstale":"2024-04-20T12:21:37.909984+0000","last_undegraded":"2024-04-20T12:21:37.909984+0000","last_fullsized":"2024-04-20T12:21:37.909984+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:27:50.008057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.912851+0000","last_change":"2024-04-20T12:21:37.912851+0000","last_active":"2024-04-20T12:21:37.912851+0000","last_peered":"2024-04-20T12:21:37.912851+0000","last_clean":"2024-04-20T12:21:37.912851+0000","last_became_active":"2024-04-20T12:21:37.912487+0000","last_became_peered":"2024-04-20T12:21:37.912487+0000","last_unstale":"2024-04-20T12:21:37.912851+0000","last_undegraded":"2024-04-20T12:21:37.912851+0000","last_fullsized":"2024-04-20T12:21:37.912851+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:09:49.568654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904405+0000","last_change":"2024-04-20T12:20:46.326239+0000","last_active":"2024-04-20T12:21:37.904405+0000","last_peered":"2024-04-20T12:21:37.904405+0000","last_clean":"2024-04-20T12:21:37.904405+0000","last_became_active":"2024-04-20T12:20:46.325830+0000","last_became_peered":"2024-04-20T12:20:46.325830+0000","last_unstale":"2024-04-20T12:21:37.904405+0000","last_undegraded":"2024-04-20T12:21:37.904405+0000","last_fullsized":"2024-04-20T12:21:37.904405+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:07.311396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.908086+0000","last_change":"2024-04-20T12:20:41.024662+0000","last_active":"2024-04-20T12:21:37.908086+0000","last_peered":"2024-04-20T12:21:37.908086+0000","last_clean":"2024-04-20T12:21:37.908086+0000","last_became_active":"2024-04-20T12:20:41.024327+0000","last_became_peered":"2024-04-20T12:20:41.024327+0000","last_unstale":"2024-04-20T12:21:37.908086+0000","last_undegraded":"2024-04-20T12:21:37.908086+0000","last_fullsized":"2024-04-20T12:21:37.908086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:07.079126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940889+0000","last_change":"2024-04-20T12:20:42.031910+0000","last_active":"2024-04-20T12:21:37.940889+0000","last_peered":"2024-04-20T12:21:37.940889+0000","last_clean":"2024-04-20T12:21:37.940889+0000","last_became_active":"2024-04-20T12:20:42.031600+0000","last_became_peered":"2024-04-20T12:20:42.031600+0000","last_unstale":"2024-04-20T12:21:37.940889+0000","last_undegraded":"2024-04-20T12:21:37.940889+0000","last_fullsized":"2024-04-20T12:21:37.940889+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:23:56.448246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.912445+0000","last_change":"2024-04-20T12:21:37.911484+0000","last_active":"2024-04-20T12:21:37.912445+0000","last_peered":"2024-04-20T12:21:37.912445+0000","last_clean":"2024-04-20T12:21:37.912445+0000","last_became_active":"2024-04-20T12:21:37.911069+0000","last_became_peered":"2024-04-20T12:21:37.911069+0000","last_unstale":"2024-04-20T12:21:37.912445+0000","last_undegraded":"2024-04-20T12:21:37.912445+0000","last_fullsized":"2024-04-20T12:21:37.912445+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:58:54.938004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"91'35","reported_seq":216,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:19.974385+0000","last_change":"2024-04-20T12:20:41.024722+0000","last_active":"2024-04-20T12:22:19.974385+0000","last_peered":"2024-04-20T12:22:19.974385+0000","last_clean":"2024-04-20T12:22:19.974385+0000","last_became_active":"2024-04-20T12:20:41.024150+0000","last_became_peered":"2024-04-20T12:20:41.024150+0000","last_unstale":"2024-04-20T12:22:19.974385+0000","last_undegraded":"2024-04-20T12:22:19.974385+0000","last_fullsized":"2024-04-20T12:22:19.974385+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:14:49.622937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63356,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":152,"num_read_kb":138,"num_write":37,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904665+0000","last_change":"2024-04-20T12:20:42.037589+0000","last_active":"2024-04-20T12:21:37.904665+0000","last_peered":"2024-04-20T12:21:37.904665+0000","last_clean":"2024-04-20T12:21:37.904665+0000","last_became_active":"2024-04-20T12:20:42.037256+0000","last_became_peered":"2024-04-20T12:20:42.037256+0000","last_unstale":"2024-04-20T12:21:37.904665+0000","last_undegraded":"2024-04-20T12:21:37.904665+0000","last_fullsized":"2024-04-20T12:21:37.904665+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:25.966289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910589+0000","last_change":"2024-04-20T12:20:46.326476+0000","last_active":"2024-04-20T12:21:37.910589+0000","last_peered":"2024-04-20T12:21:37.910589+0000","last_clean":"2024-04-20T12:21:37.910589+0000","last_became_active":"2024-04-20T12:20:46.326085+0000","last_became_peered":"2024-04-20T12:20:46.326085+0000","last_unstale":"2024-04-20T12:21:37.910589+0000","last_undegraded":"2024-04-20T12:21:37.910589+0000","last_fullsized":"2024-04-20T12:21:37.910589+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:34:15.608820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.914101+0000","last_change":"2024-04-20T12:20:41.028360+0000","last_active":"2024-04-20T12:21:37.914101+0000","last_peered":"2024-04-20T12:21:37.914101+0000","last_clean":"2024-04-20T12:21:37.914101+0000","last_became_active":"2024-04-20T12:20:41.028057+0000","last_became_peered":"2024-04-20T12:20:41.028057+0000","last_unstale":"2024-04-20T12:21:37.914101+0000","last_undegraded":"2024-04-20T12:21:37.914101+0000","last_fullsized":"2024-04-20T12:21:37.914101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:30:49.699051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.912138+0000","last_change":"2024-04-20T12:21:37.912138+0000","last_active":"2024-04-20T12:21:37.912138+0000","last_peered":"2024-04-20T12:21:37.912138+0000","last_clean":"2024-04-20T12:21:37.912138+0000","last_became_active":"2024-04-20T12:21:37.911774+0000","last_became_peered":"2024-04-20T12:21:37.911774+0000","last_unstale":"2024-04-20T12:21:37.912138+0000","last_undegraded":"2024-04-20T12:21:37.912138+0000","last_fullsized":"2024-04-20T12:21:37.912138+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:41:34.250785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906252+0000","last_change":"2024-04-20T12:20:46.328605+0000","last_active":"2024-04-20T12:21:37.906252+0000","last_peered":"2024-04-20T12:21:37.906252+0000","last_clean":"2024-04-20T12:21:37.906252+0000","last_became_active":"2024-04-20T12:20:46.328091+0000","last_became_peered":"2024-04-20T12:20:46.328091+0000","last_unstale":"2024-04-20T12:21:37.906252+0000","last_undegraded":"2024-04-20T12:21:37.906252+0000","last_fullsized":"2024-04-20T12:21:37.906252+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:21:12.908696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909172+0000","last_change":"2024-04-20T12:20:41.028149+0000","last_active":"2024-04-20T12:21:37.909172+0000","last_peered":"2024-04-20T12:21:37.909172+0000","last_clean":"2024-04-20T12:21:37.909172+0000","last_became_active":"2024-04-20T12:20:41.027784+0000","last_became_peered":"2024-04-20T12:20:41.027784+0000","last_unstale":"2024-04-20T12:21:37.909172+0000","last_undegraded":"2024-04-20T12:21:37.909172+0000","last_fullsized":"2024-04-20T12:21:37.909172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:45:31.227275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909583+0000","last_change":"2024-04-20T12:20:42.030961+0000","last_active":"2024-04-20T12:21:37.909583+0000","last_peered":"2024-04-20T12:21:37.909583+0000","last_clean":"2024-04-20T12:21:37.909583+0000","last_became_active":"2024-04-20T12:20:42.030597+0000","last_became_peered":"2024-04-20T12:20:42.030597+0000","last_unstale":"2024-04-20T12:21:37.909583+0000","last_undegraded":"2024-04-20T12:21:37.909583+0000","last_fullsized":"2024-04-20T12:21:37.909583+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:59:29.679840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.908482+0000","last_change":"2024-04-20T12:20:46.327034+0000","last_active":"2024-04-20T12:21:37.908482+0000","last_peered":"2024-04-20T12:21:37.908482+0000","last_clean":"2024-04-20T12:21:37.908482+0000","last_became_active":"2024-04-20T12:20:46.325107+0000","last_became_peered":"2024-04-20T12:20:46.325107+0000","last_unstale":"2024-04-20T12:21:37.908482+0000","last_undegraded":"2024-04-20T12:21:37.908482+0000","last_fullsized":"2024-04-20T12:21:37.908482+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:44:04.924677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'5","reported_seq":111,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:21.430623+0000","last_change":"2024-04-20T12:20:41.020878+0000","last_active":"2024-04-20T12:22:21.430623+0000","last_peered":"2024-04-20T12:22:21.430623+0000","last_clean":"2024-04-20T12:22:21.430623+0000","last_became_active":"2024-04-20T12:20:41.020503+0000","last_became_peered":"2024-04-20T12:20:41.020503+0000","last_unstale":"2024-04-20T12:22:21.430623+0000","last_undegraded":"2024-04-20T12:22:21.430623+0000","last_fullsized":"2024-04-20T12:22:21.430623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:59:00.555136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909672+0000","last_change":"2024-04-20T12:20:42.039699+0000","last_active":"2024-04-20T12:21:37.909672+0000","last_peered":"2024-04-20T12:21:37.909672+0000","last_clean":"2024-04-20T12:21:37.909672+0000","last_became_active":"2024-04-20T12:20:42.039384+0000","last_became_peered":"2024-04-20T12:20:42.039384+0000","last_unstale":"2024-04-20T12:21:37.909672+0000","last_undegraded":"2024-04-20T12:21:37.909672+0000","last_fullsized":"2024-04-20T12:21:37.909672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:45:41.056018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910073+0000","last_change":"2024-04-20T12:20:46.333294+0000","last_active":"2024-04-20T12:21:37.910073+0000","last_peered":"2024-04-20T12:21:37.910073+0000","last_clean":"2024-04-20T12:21:37.910073+0000","last_became_active":"2024-04-20T12:20:46.332887+0000","last_became_peered":"2024-04-20T12:20:46.332887+0000","last_unstale":"2024-04-20T12:21:37.910073+0000","last_undegraded":"2024-04-20T12:21:37.910073+0000","last_fullsized":"2024-04-20T12:21:37.910073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:10.686220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.903970+0000","last_change":"2024-04-20T12:20:41.027313+0000","last_active":"2024-04-20T12:21:37.903970+0000","last_peered":"2024-04-20T12:21:37.903970+0000","last_clean":"2024-04-20T12:21:37.903970+0000","last_became_active":"2024-04-20T12:20:41.026980+0000","last_became_peered":"2024-04-20T12:20:41.026980+0000","last_unstale":"2024-04-20T12:21:37.903970+0000","last_undegraded":"2024-04-20T12:21:37.903970+0000","last_fullsized":"2024-04-20T12:21:37.903970+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:12.692075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909186+0000","last_change":"2024-04-20T12:20:42.027807+0000","last_active":"2024-04-20T12:21:37.909186+0000","last_peered":"2024-04-20T12:21:37.909186+0000","last_clean":"2024-04-20T12:21:37.909186+0000","last_became_active":"2024-04-20T12:20:42.027468+0000","last_became_peered":"2024-04-20T12:20:42.027468+0000","last_unstale":"2024-04-20T12:21:37.909186+0000","last_undegraded":"2024-04-20T12:21:37.909186+0000","last_fullsized":"2024-04-20T12:21:37.909186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:51.924249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909061+0000","last_change":"2024-04-20T12:20:46.324164+0000","last_active":"2024-04-20T12:21:37.909061+0000","last_peered":"2024-04-20T12:21:37.909061+0000","last_clean":"2024-04-20T12:21:37.909061+0000","last_became_active":"2024-04-20T12:20:46.323651+0000","last_became_peered":"2024-04-20T12:20:46.323651+0000","last_unstale":"2024-04-20T12:21:37.909061+0000","last_undegraded":"2024-04-20T12:21:37.909061+0000","last_fullsized":"2024-04-20T12:21:37.909061+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:07:54.429586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904503+0000","last_change":"2024-04-20T12:20:41.023999+0000","last_active":"2024-04-20T12:21:37.904503+0000","last_peered":"2024-04-20T12:21:37.904503+0000","last_clean":"2024-04-20T12:21:37.904503+0000","last_became_active":"2024-04-20T12:20:41.023440+0000","last_became_peered":"2024-04-20T12:20:41.023440+0000","last_unstale":"2024-04-20T12:21:37.904503+0000","last_undegraded":"2024-04-20T12:21:37.904503+0000","last_fullsized":"2024-04-20T12:21:37.904503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:13:18.493395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907327+0000","last_change":"2024-04-20T12:20:42.036718+0000","last_active":"2024-04-20T12:21:37.907327+0000","last_peered":"2024-04-20T12:21:37.907327+0000","last_clean":"2024-04-20T12:21:37.907327+0000","last_became_active":"2024-04-20T12:20:42.036305+0000","last_became_peered":"2024-04-20T12:20:42.036305+0000","last_unstale":"2024-04-20T12:21:37.907327+0000","last_undegraded":"2024-04-20T12:21:37.907327+0000","last_fullsized":"2024-04-20T12:21:37.907327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:14.462345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904102+0000","last_change":"2024-04-20T12:20:46.930437+0000","last_active":"2024-04-20T12:21:37.904102+0000","last_peered":"2024-04-20T12:21:37.904102+0000","last_clean":"2024-04-20T12:21:37.904102+0000","last_became_active":"2024-04-20T12:20:46.929882+0000","last_became_peered":"2024-04-20T12:20:46.929882+0000","last_unstale":"2024-04-20T12:21:37.904102+0000","last_undegraded":"2024-04-20T12:21:37.904102+0000","last_fullsized":"2024-04-20T12:21:37.904102+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:56.540256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906489+0000","last_change":"2024-04-20T12:20:41.023584+0000","last_active":"2024-04-20T12:21:37.906489+0000","last_peered":"2024-04-20T12:21:37.906489+0000","last_clean":"2024-04-20T12:21:37.906489+0000","last_became_active":"2024-04-20T12:20:41.023249+0000","last_became_peered":"2024-04-20T12:20:41.023249+0000","last_unstale":"2024-04-20T12:21:37.906489+0000","last_undegraded":"2024-04-20T12:21:37.906489+0000","last_fullsized":"2024-04-20T12:21:37.906489+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:18:06.704703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907189+0000","last_change":"2024-04-20T12:20:42.041424+0000","last_active":"2024-04-20T12:21:37.907189+0000","last_peered":"2024-04-20T12:21:37.907189+0000","last_clean":"2024-04-20T12:21:37.907189+0000","last_became_active":"2024-04-20T12:20:42.040231+0000","last_became_peered":"2024-04-20T12:20:42.040231+0000","last_unstale":"2024-04-20T12:21:37.907189+0000","last_undegraded":"2024-04-20T12:21:37.907189+0000","last_fullsized":"2024-04-20T12:21:37.907189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:29.523746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909584+0000","last_change":"2024-04-20T12:20:46.326852+0000","last_active":"2024-04-20T12:21:37.909584+0000","last_peered":"2024-04-20T12:21:37.909584+0000","last_clean":"2024-04-20T12:21:37.909584+0000","last_became_active":"2024-04-20T12:20:46.326398+0000","last_became_peered":"2024-04-20T12:20:46.326398+0000","last_unstale":"2024-04-20T12:21:37.909584+0000","last_undegraded":"2024-04-20T12:21:37.909584+0000","last_fullsized":"2024-04-20T12:21:37.909584+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:00:33.076429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'5","reported_seq":104,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:16.443349+0000","last_change":"2024-04-20T12:20:41.032542+0000","last_active":"2024-04-20T12:22:16.443349+0000","last_peered":"2024-04-20T12:22:16.443349+0000","last_clean":"2024-04-20T12:22:16.443349+0000","last_became_active":"2024-04-20T12:20:41.032048+0000","last_became_peered":"2024-04-20T12:20:41.032048+0000","last_unstale":"2024-04-20T12:22:16.443349+0000","last_undegraded":"2024-04-20T12:22:16.443349+0000","last_fullsized":"2024-04-20T12:22:16.443349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:16:35.515446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906653+0000","last_change":"2024-04-20T12:20:42.034006+0000","last_active":"2024-04-20T12:21:37.906653+0000","last_peered":"2024-04-20T12:21:37.906653+0000","last_clean":"2024-04-20T12:21:37.906653+0000","last_became_active":"2024-04-20T12:20:42.033639+0000","last_became_peered":"2024-04-20T12:20:42.033639+0000","last_unstale":"2024-04-20T12:21:37.906653+0000","last_undegraded":"2024-04-20T12:21:37.906653+0000","last_fullsized":"2024-04-20T12:21:37.906653+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:39:27.435103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910350+0000","last_change":"2024-04-20T12:20:46.930253+0000","last_active":"2024-04-20T12:21:37.910350+0000","last_peered":"2024-04-20T12:21:37.910350+0000","last_clean":"2024-04-20T12:21:37.910350+0000","last_became_active":"2024-04-20T12:20:46.929806+0000","last_became_peered":"2024-04-20T12:20:46.929806+0000","last_unstale":"2024-04-20T12:21:37.910350+0000","last_undegraded":"2024-04-20T12:21:37.910350+0000","last_fullsized":"2024-04-20T12:21:37.910350+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:23:55.085024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907353+0000","last_change":"2024-04-20T12:20:42.031231+0000","last_active":"2024-04-20T12:21:37.907353+0000","last_peered":"2024-04-20T12:21:37.907353+0000","last_clean":"2024-04-20T12:21:37.907353+0000","last_became_active":"2024-04-20T12:20:42.030920+0000","last_became_peered":"2024-04-20T12:20:42.030920+0000","last_unstale":"2024-04-20T12:21:37.907353+0000","last_undegraded":"2024-04-20T12:21:37.907353+0000","last_fullsized":"2024-04-20T12:21:37.907353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:14.631696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":109,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:20.427905+0000","last_change":"2024-04-20T12:20:41.030703+0000","last_active":"2024-04-20T12:22:20.427905+0000","last_peered":"2024-04-20T12:22:20.427905+0000","last_clean":"2024-04-20T12:22:20.427905+0000","last_became_active":"2024-04-20T12:20:41.030400+0000","last_became_peered":"2024-04-20T12:20:41.030400+0000","last_unstale":"2024-04-20T12:22:20.427905+0000","last_undegraded":"2024-04-20T12:22:20.427905+0000","last_fullsized":"2024-04-20T12:22:20.427905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:46:07.845022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":75,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909841+0000","last_change":"2024-04-20T12:20:46.322872+0000","last_active":"2024-04-20T12:21:37.909841+0000","last_peered":"2024-04-20T12:21:37.909841+0000","last_clean":"2024-04-20T12:21:37.909841+0000","last_became_active":"2024-04-20T12:20:46.322440+0000","last_became_peered":"2024-04-20T12:20:46.322440+0000","last_unstale":"2024-04-20T12:21:37.909841+0000","last_undegraded":"2024-04-20T12:21:37.909841+0000","last_fullsized":"2024-04-20T12:21:37.909841+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:24:02.010584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910170+0000","last_change":"2024-04-20T12:20:42.041895+0000","last_active":"2024-04-20T12:21:37.910170+0000","last_peered":"2024-04-20T12:21:37.910170+0000","last_clean":"2024-04-20T12:21:37.910170+0000","last_became_active":"2024-04-20T12:20:42.040451+0000","last_became_peered":"2024-04-20T12:20:42.040451+0000","last_unstale":"2024-04-20T12:21:37.910170+0000","last_undegraded":"2024-04-20T12:21:37.910170+0000","last_fullsized":"2024-04-20T12:21:37.910170+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:17.711581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904222+0000","last_change":"2024-04-20T12:20:41.020656+0000","last_active":"2024-04-20T12:21:37.904222+0000","last_peered":"2024-04-20T12:21:37.904222+0000","last_clean":"2024-04-20T12:21:37.904222+0000","last_became_active":"2024-04-20T12:20:41.020226+0000","last_became_peered":"2024-04-20T12:20:41.020226+0000","last_unstale":"2024-04-20T12:21:37.904222+0000","last_undegraded":"2024-04-20T12:21:37.904222+0000","last_fullsized":"2024-04-20T12:21:37.904222+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:21:03.446920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":364,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909443+0000","last_change":"2024-04-20T12:19:29.284050+0000","last_active":"2024-04-20T12:21:37.909443+0000","last_peered":"2024-04-20T12:21:37.909443+0000","last_clean":"2024-04-20T12:21:37.909443+0000","last_became_active":"2024-04-20T12:19:29.283508+0000","last_became_peered":"2024-04-20T12:19:29.283508+0000","last_unstale":"2024-04-20T12:21:37.909443+0000","last_undegraded":"2024-04-20T12:21:37.909443+0000","last_fullsized":"2024-04-20T12:21:37.909443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:16:03.444995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:16:03.444995+0000","last_clean_scrub_stamp":"2024-04-20T12:16:03.444995+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:28:39.268704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.908249+0000","last_change":"2024-04-20T12:20:46.931207+0000","last_active":"2024-04-20T12:21:37.908249+0000","last_peered":"2024-04-20T12:21:37.908249+0000","last_clean":"2024-04-20T12:21:37.908249+0000","last_became_active":"2024-04-20T12:20:46.930733+0000","last_became_peered":"2024-04-20T12:20:46.930733+0000","last_unstale":"2024-04-20T12:21:37.908249+0000","last_undegraded":"2024-04-20T12:21:37.908249+0000","last_fullsized":"2024-04-20T12:21:37.908249+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:09:53.281163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.908941+0000","last_change":"2024-04-20T12:20:42.030739+0000","last_active":"2024-04-20T12:21:37.908941+0000","last_peered":"2024-04-20T12:21:37.908941+0000","last_clean":"2024-04-20T12:21:37.908941+0000","last_became_active":"2024-04-20T12:20:42.030440+0000","last_became_peered":"2024-04-20T12:20:42.030440+0000","last_unstale":"2024-04-20T12:21:37.908941+0000","last_undegraded":"2024-04-20T12:21:37.908941+0000","last_fullsized":"2024-04-20T12:21:37.908941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:44:39.311317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909661+0000","last_change":"2024-04-20T12:20:41.029967+0000","last_active":"2024-04-20T12:21:37.909661+0000","last_peered":"2024-04-20T12:21:37.909661+0000","last_clean":"2024-04-20T12:21:37.909661+0000","last_became_active":"2024-04-20T12:20:41.029618+0000","last_became_peered":"2024-04-20T12:20:41.029618+0000","last_unstale":"2024-04-20T12:21:37.909661+0000","last_undegraded":"2024-04-20T12:21:37.909661+0000","last_fullsized":"2024-04-20T12:21:37.909661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:48.762751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906212+0000","last_change":"2024-04-20T12:20:46.327782+0000","last_active":"2024-04-20T12:21:37.906212+0000","last_peered":"2024-04-20T12:21:37.906212+0000","last_clean":"2024-04-20T12:21:37.906212+0000","last_became_active":"2024-04-20T12:20:46.325462+0000","last_became_peered":"2024-04-20T12:20:46.325462+0000","last_unstale":"2024-04-20T12:21:37.906212+0000","last_undegraded":"2024-04-20T12:21:37.906212+0000","last_fullsized":"2024-04-20T12:21:37.906212+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:41.792496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904715+0000","last_change":"2024-04-20T12:20:41.025454+0000","last_active":"2024-04-20T12:21:37.904715+0000","last_peered":"2024-04-20T12:21:37.904715+0000","last_clean":"2024-04-20T12:21:37.904715+0000","last_became_active":"2024-04-20T12:20:41.025121+0000","last_became_peered":"2024-04-20T12:20:41.025121+0000","last_unstale":"2024-04-20T12:21:37.904715+0000","last_undegraded":"2024-04-20T12:21:37.904715+0000","last_fullsized":"2024-04-20T12:21:37.904715+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:57:14.662567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910258+0000","last_change":"2024-04-20T12:20:42.038483+0000","last_active":"2024-04-20T12:21:37.910258+0000","last_peered":"2024-04-20T12:21:37.910258+0000","last_clean":"2024-04-20T12:21:37.910258+0000","last_became_active":"2024-04-20T12:20:42.037626+0000","last_became_peered":"2024-04-20T12:20:42.037626+0000","last_unstale":"2024-04-20T12:21:37.910258+0000","last_undegraded":"2024-04-20T12:21:37.910258+0000","last_fullsized":"2024-04-20T12:21:37.910258+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:11:27.520320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910166+0000","last_change":"2024-04-20T12:20:46.930331+0000","last_active":"2024-04-20T12:21:37.910166+0000","last_peered":"2024-04-20T12:21:37.910166+0000","last_clean":"2024-04-20T12:21:37.910166+0000","last_became_active":"2024-04-20T12:20:46.929816+0000","last_became_peered":"2024-04-20T12:20:46.929816+0000","last_unstale":"2024-04-20T12:21:37.910166+0000","last_undegraded":"2024-04-20T12:21:37.910166+0000","last_fullsized":"2024-04-20T12:21:37.910166+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:42:18.148443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'12","reported_seq":41,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907000+0000","last_change":"2024-04-20T12:20:41.022365+0000","last_active":"2024-04-20T12:21:37.907000+0000","last_peered":"2024-04-20T12:21:37.907000+0000","last_clean":"2024-04-20T12:21:37.907000+0000","last_became_active":"2024-04-20T12:20:41.022028+0000","last_became_peered":"2024-04-20T12:20:41.022028+0000","last_unstale":"2024-04-20T12:21:37.907000+0000","last_undegraded":"2024-04-20T12:21:37.907000+0000","last_fullsized":"2024-04-20T12:21:37.907000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:16.436008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910767+0000","last_change":"2024-04-20T12:20:42.031833+0000","last_active":"2024-04-20T12:21:37.910767+0000","last_peered":"2024-04-20T12:21:37.910767+0000","last_clean":"2024-04-20T12:21:37.910767+0000","last_became_active":"2024-04-20T12:20:42.031535+0000","last_became_peered":"2024-04-20T12:20:42.031535+0000","last_unstale":"2024-04-20T12:21:37.910767+0000","last_undegraded":"2024-04-20T12:21:37.910767+0000","last_fullsized":"2024-04-20T12:21:37.910767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:39:38.955662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910899+0000","last_change":"2024-04-20T12:20:46.319218+0000","last_active":"2024-04-20T12:21:37.910899+0000","last_peered":"2024-04-20T12:21:37.910899+0000","last_clean":"2024-04-20T12:21:37.910899+0000","last_became_active":"2024-04-20T12:20:46.318822+0000","last_became_peered":"2024-04-20T12:20:46.318822+0000","last_unstale":"2024-04-20T12:21:37.910899+0000","last_undegraded":"2024-04-20T12:21:37.910899+0000","last_fullsized":"2024-04-20T12:21:37.910899+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:19:16.907942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904931+0000","last_change":"2024-04-20T12:20:41.035984+0000","last_active":"2024-04-20T12:21:37.904931+0000","last_peered":"2024-04-20T12:21:37.904931+0000","last_clean":"2024-04-20T12:21:37.904931+0000","last_became_active":"2024-04-20T12:20:41.035594+0000","last_became_peered":"2024-04-20T12:20:41.035594+0000","last_unstale":"2024-04-20T12:21:37.904931+0000","last_undegraded":"2024-04-20T12:21:37.904931+0000","last_fullsized":"2024-04-20T12:21:37.904931+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:15.549551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907833+0000","last_change":"2024-04-20T12:20:42.032156+0000","last_active":"2024-04-20T12:21:37.907833+0000","last_peered":"2024-04-20T12:21:37.907833+0000","last_clean":"2024-04-20T12:21:37.907833+0000","last_became_active":"2024-04-20T12:20:42.031779+0000","last_became_peered":"2024-04-20T12:20:42.031779+0000","last_unstale":"2024-04-20T12:21:37.907833+0000","last_undegraded":"2024-04-20T12:21:37.907833+0000","last_fullsized":"2024-04-20T12:21:37.907833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:43:48.156406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904461+0000","last_change":"2024-04-20T12:20:46.931229+0000","last_active":"2024-04-20T12:21:37.904461+0000","last_peered":"2024-04-20T12:21:37.904461+0000","last_clean":"2024-04-20T12:21:37.904461+0000","last_became_active":"2024-04-20T12:20:46.930677+0000","last_became_peered":"2024-04-20T12:20:46.930677+0000","last_unstale":"2024-04-20T12:21:37.904461+0000","last_undegraded":"2024-04-20T12:21:37.904461+0000","last_fullsized":"2024-04-20T12:21:37.904461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:54.933944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":31,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940295+0000","last_change":"2024-04-20T12:20:41.023789+0000","last_active":"2024-04-20T12:21:37.940295+0000","last_peered":"2024-04-20T12:21:37.940295+0000","last_clean":"2024-04-20T12:21:37.940295+0000","last_became_active":"2024-04-20T12:20:41.023329+0000","last_became_peered":"2024-04-20T12:20:41.023329+0000","last_unstale":"2024-04-20T12:21:37.940295+0000","last_undegraded":"2024-04-20T12:21:37.940295+0000","last_fullsized":"2024-04-20T12:21:37.940295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:02:17.634230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.903970+0000","last_change":"2024-04-20T12:20:42.028708+0000","last_active":"2024-04-20T12:21:37.903970+0000","last_peered":"2024-04-20T12:21:37.903970+0000","last_clean":"2024-04-20T12:21:37.903970+0000","last_became_active":"2024-04-20T12:20:42.028358+0000","last_became_peered":"2024-04-20T12:20:42.028358+0000","last_unstale":"2024-04-20T12:21:37.903970+0000","last_undegraded":"2024-04-20T12:21:37.903970+0000","last_fullsized":"2024-04-20T12:21:37.903970+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:21:58.583709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.908257+0000","last_change":"2024-04-20T12:20:46.329173+0000","last_active":"2024-04-20T12:21:37.908257+0000","last_peered":"2024-04-20T12:21:37.908257+0000","last_clean":"2024-04-20T12:21:37.908257+0000","last_became_active":"2024-04-20T12:20:46.328771+0000","last_became_peered":"2024-04-20T12:20:46.328771+0000","last_unstale":"2024-04-20T12:21:37.908257+0000","last_undegraded":"2024-04-20T12:21:37.908257+0000","last_fullsized":"2024-04-20T12:21:37.908257+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:43:57.796849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909730+0000","last_change":"2024-04-20T12:20:41.030389+0000","last_active":"2024-04-20T12:21:37.909730+0000","last_peered":"2024-04-20T12:21:37.909730+0000","last_clean":"2024-04-20T12:21:37.909730+0000","last_became_active":"2024-04-20T12:20:41.029864+0000","last_became_peered":"2024-04-20T12:20:41.029864+0000","last_unstale":"2024-04-20T12:21:37.909730+0000","last_undegraded":"2024-04-20T12:21:37.909730+0000","last_fullsized":"2024-04-20T12:21:37.909730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:01:13.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906349+0000","last_change":"2024-04-20T12:20:42.032322+0000","last_active":"2024-04-20T12:21:37.906349+0000","last_peered":"2024-04-20T12:21:37.906349+0000","last_clean":"2024-04-20T12:21:37.906349+0000","last_became_active":"2024-04-20T12:20:42.031973+0000","last_became_peered":"2024-04-20T12:20:42.031973+0000","last_unstale":"2024-04-20T12:21:37.906349+0000","last_undegraded":"2024-04-20T12:21:37.906349+0000","last_fullsized":"2024-04-20T12:21:37.906349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:44:17.135478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904410+0000","last_change":"2024-04-20T12:20:46.321909+0000","last_active":"2024-04-20T12:21:37.904410+0000","last_peered":"2024-04-20T12:21:37.904410+0000","last_clean":"2024-04-20T12:21:37.904410+0000","last_became_active":"2024-04-20T12:20:46.321273+0000","last_became_peered":"2024-04-20T12:20:46.321273+0000","last_unstale":"2024-04-20T12:21:37.904410+0000","last_undegraded":"2024-04-20T12:21:37.904410+0000","last_fullsized":"2024-04-20T12:21:37.904410+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:58:18.429052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'3","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.947242+0000","last_change":"2024-04-20T12:21:37.947242+0000","last_active":"2024-04-20T12:21:37.947242+0000","last_peered":"2024-04-20T12:21:37.947242+0000","last_clean":"2024-04-20T12:21:37.947242+0000","last_became_active":"2024-04-20T12:21:37.941542+0000","last_became_peered":"2024-04-20T12:21:37.941542+0000","last_unstale":"2024-04-20T12:21:37.947242+0000","last_undegraded":"2024-04-20T12:21:37.947242+0000","last_fullsized":"2024-04-20T12:21:37.947242+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:48:04.916848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910399+0000","last_change":"2024-04-20T12:20:42.037258+0000","last_active":"2024-04-20T12:21:37.910399+0000","last_peered":"2024-04-20T12:21:37.910399+0000","last_clean":"2024-04-20T12:21:37.910399+0000","last_became_active":"2024-04-20T12:20:42.036755+0000","last_became_peered":"2024-04-20T12:20:42.036755+0000","last_unstale":"2024-04-20T12:21:37.910399+0000","last_undegraded":"2024-04-20T12:21:37.910399+0000","last_fullsized":"2024-04-20T12:21:37.910399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:23:17.093038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904463+0000","last_change":"2024-04-20T12:20:46.929829+0000","last_active":"2024-04-20T12:21:37.904463+0000","last_peered":"2024-04-20T12:21:37.904463+0000","last_clean":"2024-04-20T12:21:37.904463+0000","last_became_active":"2024-04-20T12:20:46.929296+0000","last_became_peered":"2024-04-20T12:20:46.929296+0000","last_unstale":"2024-04-20T12:21:37.904463+0000","last_undegraded":"2024-04-20T12:21:37.904463+0000","last_fullsized":"2024-04-20T12:21:37.904463+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:30.700141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.904160+0000","last_change":"2024-04-20T12:20:41.027753+0000","last_active":"2024-04-20T12:21:37.904160+0000","last_peered":"2024-04-20T12:21:37.904160+0000","last_clean":"2024-04-20T12:21:37.904160+0000","last_became_active":"2024-04-20T12:20:41.027360+0000","last_became_peered":"2024-04-20T12:20:41.027360+0000","last_unstale":"2024-04-20T12:21:37.904160+0000","last_undegraded":"2024-04-20T12:21:37.904160+0000","last_fullsized":"2024-04-20T12:21:37.904160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:30:59.710541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909576+0000","last_change":"2024-04-20T12:20:42.029409+0000","last_active":"2024-04-20T12:21:37.909576+0000","last_peered":"2024-04-20T12:21:37.909576+0000","last_clean":"2024-04-20T12:21:37.909576+0000","last_became_active":"2024-04-20T12:20:42.029062+0000","last_became_peered":"2024-04-20T12:20:42.029062+0000","last_unstale":"2024-04-20T12:21:37.909576+0000","last_undegraded":"2024-04-20T12:21:37.909576+0000","last_fullsized":"2024-04-20T12:21:37.909576+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:47:33.412087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940368+0000","last_change":"2024-04-20T12:20:46.326605+0000","last_active":"2024-04-20T12:21:37.940368+0000","last_peered":"2024-04-20T12:21:37.940368+0000","last_clean":"2024-04-20T12:21:37.940368+0000","last_became_active":"2024-04-20T12:20:46.326162+0000","last_became_peered":"2024-04-20T12:20:46.326162+0000","last_unstale":"2024-04-20T12:21:37.940368+0000","last_undegraded":"2024-04-20T12:21:37.940368+0000","last_fullsized":"2024-04-20T12:21:37.940368+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:44:37.344357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'5","reported_seq":111,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:22:21.418005+0000","last_change":"2024-04-20T12:20:41.035324+0000","last_active":"2024-04-20T12:22:21.418005+0000","last_peered":"2024-04-20T12:22:21.418005+0000","last_clean":"2024-04-20T12:22:21.418005+0000","last_became_active":"2024-04-20T12:20:41.034996+0000","last_became_peered":"2024-04-20T12:20:41.034996+0000","last_unstale":"2024-04-20T12:22:21.418005+0000","last_undegraded":"2024-04-20T12:22:21.418005+0000","last_fullsized":"2024-04-20T12:22:21.418005+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:33.788405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910006+0000","last_change":"2024-04-20T12:20:42.028803+0000","last_active":"2024-04-20T12:21:37.910006+0000","last_peered":"2024-04-20T12:21:37.910006+0000","last_clean":"2024-04-20T12:21:37.910006+0000","last_became_active":"2024-04-20T12:20:42.028316+0000","last_became_peered":"2024-04-20T12:20:42.028316+0000","last_unstale":"2024-04-20T12:21:37.910006+0000","last_undegraded":"2024-04-20T12:21:37.910006+0000","last_fullsized":"2024-04-20T12:21:37.910006+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:09.000315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907027+0000","last_change":"2024-04-20T12:20:46.328502+0000","last_active":"2024-04-20T12:21:37.907027+0000","last_peered":"2024-04-20T12:21:37.907027+0000","last_clean":"2024-04-20T12:21:37.907027+0000","last_became_active":"2024-04-20T12:20:46.328106+0000","last_became_peered":"2024-04-20T12:20:46.328106+0000","last_unstale":"2024-04-20T12:21:37.907027+0000","last_undegraded":"2024-04-20T12:21:37.907027+0000","last_fullsized":"2024-04-20T12:21:37.907027+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:06:30.041621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"90'3","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910291+0000","last_change":"2024-04-20T12:20:41.023918+0000","last_active":"2024-04-20T12:21:37.910291+0000","last_peered":"2024-04-20T12:21:37.910291+0000","last_clean":"2024-04-20T12:21:37.910291+0000","last_became_active":"2024-04-20T12:20:41.023088+0000","last_became_peered":"2024-04-20T12:20:41.023088+0000","last_unstale":"2024-04-20T12:21:37.910291+0000","last_undegraded":"2024-04-20T12:21:37.910291+0000","last_fullsized":"2024-04-20T12:21:37.910291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:15:03.220660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909764+0000","last_change":"2024-04-20T12:20:42.038981+0000","last_active":"2024-04-20T12:21:37.909764+0000","last_peered":"2024-04-20T12:21:37.909764+0000","last_clean":"2024-04-20T12:21:37.909764+0000","last_became_active":"2024-04-20T12:20:42.038656+0000","last_became_peered":"2024-04-20T12:20:42.038656+0000","last_unstale":"2024-04-20T12:21:37.909764+0000","last_undegraded":"2024-04-20T12:21:37.909764+0000","last_fullsized":"2024-04-20T12:21:37.909764+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:51:08.446546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906836+0000","last_change":"2024-04-20T12:20:46.323446+0000","last_active":"2024-04-20T12:21:37.906836+0000","last_peered":"2024-04-20T12:21:37.906836+0000","last_clean":"2024-04-20T12:21:37.906836+0000","last_became_active":"2024-04-20T12:20:46.322259+0000","last_became_peered":"2024-04-20T12:20:46.322259+0000","last_unstale":"2024-04-20T12:21:37.906836+0000","last_undegraded":"2024-04-20T12:21:37.906836+0000","last_fullsized":"2024-04-20T12:21:37.906836+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:01:11.833469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":34,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910110+0000","last_change":"2024-04-20T12:20:41.029995+0000","last_active":"2024-04-20T12:21:37.910110+0000","last_peered":"2024-04-20T12:21:37.910110+0000","last_clean":"2024-04-20T12:21:37.910110+0000","last_became_active":"2024-04-20T12:20:41.029650+0000","last_became_peered":"2024-04-20T12:20:41.029650+0000","last_unstale":"2024-04-20T12:21:37.910110+0000","last_undegraded":"2024-04-20T12:21:37.910110+0000","last_fullsized":"2024-04-20T12:21:37.910110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:24:54.522855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910343+0000","last_change":"2024-04-20T12:20:42.030357+0000","last_active":"2024-04-20T12:21:37.910343+0000","last_peered":"2024-04-20T12:21:37.910343+0000","last_clean":"2024-04-20T12:21:37.910343+0000","last_became_active":"2024-04-20T12:20:42.029966+0000","last_became_peered":"2024-04-20T12:20:42.029966+0000","last_unstale":"2024-04-20T12:21:37.910343+0000","last_undegraded":"2024-04-20T12:21:37.910343+0000","last_fullsized":"2024-04-20T12:21:37.910343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:35:09.487965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906475+0000","last_change":"2024-04-20T12:20:42.036914+0000","last_active":"2024-04-20T12:21:37.906475+0000","last_peered":"2024-04-20T12:21:37.906475+0000","last_clean":"2024-04-20T12:21:37.906475+0000","last_became_active":"2024-04-20T12:20:42.036434+0000","last_became_peered":"2024-04-20T12:20:42.036434+0000","last_unstale":"2024-04-20T12:21:37.906475+0000","last_undegraded":"2024-04-20T12:21:37.906475+0000","last_fullsized":"2024-04-20T12:21:37.906475+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.552096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.911269+0000","last_change":"2024-04-20T12:20:42.040424+0000","last_active":"2024-04-20T12:21:37.911269+0000","last_peered":"2024-04-20T12:21:37.911269+0000","last_clean":"2024-04-20T12:21:37.911269+0000","last_became_active":"2024-04-20T12:20:42.040095+0000","last_became_peered":"2024-04-20T12:20:42.040095+0000","last_unstale":"2024-04-20T12:21:37.911269+0000","last_undegraded":"2024-04-20T12:21:37.911269+0000","last_fullsized":"2024-04-20T12:21:37.911269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:24.669083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.913663+0000","last_change":"2024-04-20T12:20:42.037764+0000","last_active":"2024-04-20T12:21:37.913663+0000","last_peered":"2024-04-20T12:21:37.913663+0000","last_clean":"2024-04-20T12:21:37.913663+0000","last_became_active":"2024-04-20T12:20:42.037389+0000","last_became_peered":"2024-04-20T12:20:42.037389+0000","last_unstale":"2024-04-20T12:21:37.913663+0000","last_undegraded":"2024-04-20T12:21:37.913663+0000","last_fullsized":"2024-04-20T12:21:37.913663+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:20.284714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907264+0000","last_change":"2024-04-20T12:20:42.027546+0000","last_active":"2024-04-20T12:21:37.907264+0000","last_peered":"2024-04-20T12:21:37.907264+0000","last_clean":"2024-04-20T12:21:37.907264+0000","last_became_active":"2024-04-20T12:20:42.027229+0000","last_became_peered":"2024-04-20T12:20:42.027229+0000","last_unstale":"2024-04-20T12:21:37.907264+0000","last_undegraded":"2024-04-20T12:21:37.907264+0000","last_fullsized":"2024-04-20T12:21:37.907264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:22.649256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909742+0000","last_change":"2024-04-20T12:20:42.024971+0000","last_active":"2024-04-20T12:21:37.909742+0000","last_peered":"2024-04-20T12:21:37.909742+0000","last_clean":"2024-04-20T12:21:37.909742+0000","last_became_active":"2024-04-20T12:20:42.024607+0000","last_became_peered":"2024-04-20T12:20:42.024607+0000","last_unstale":"2024-04-20T12:21:37.909742+0000","last_undegraded":"2024-04-20T12:21:37.909742+0000","last_fullsized":"2024-04-20T12:21:37.909742+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:15:56.160140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907005+0000","last_change":"2024-04-20T12:20:42.036699+0000","last_active":"2024-04-20T12:21:37.907005+0000","last_peered":"2024-04-20T12:21:37.907005+0000","last_clean":"2024-04-20T12:21:37.907005+0000","last_became_active":"2024-04-20T12:20:42.036355+0000","last_became_peered":"2024-04-20T12:20:42.036355+0000","last_unstale":"2024-04-20T12:21:37.907005+0000","last_undegraded":"2024-04-20T12:21:37.907005+0000","last_fullsized":"2024-04-20T12:21:37.907005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:14:40.276148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.915082+0000","last_change":"2024-04-20T12:20:42.034906+0000","last_active":"2024-04-20T12:21:37.915082+0000","last_peered":"2024-04-20T12:21:37.915082+0000","last_clean":"2024-04-20T12:21:37.915082+0000","last_became_active":"2024-04-20T12:20:42.034572+0000","last_became_peered":"2024-04-20T12:20:42.034572+0000","last_unstale":"2024-04-20T12:21:37.915082+0000","last_undegraded":"2024-04-20T12:21:37.915082+0000","last_fullsized":"2024-04-20T12:21:37.915082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:54.166032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910859+0000","last_change":"2024-04-20T12:20:42.041180+0000","last_active":"2024-04-20T12:21:37.910859+0000","last_peered":"2024-04-20T12:21:37.910859+0000","last_clean":"2024-04-20T12:21:37.910859+0000","last_became_active":"2024-04-20T12:20:42.040648+0000","last_became_peered":"2024-04-20T12:20:42.040648+0000","last_unstale":"2024-04-20T12:21:37.910859+0000","last_undegraded":"2024-04-20T12:21:37.910859+0000","last_fullsized":"2024-04-20T12:21:37.910859+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:55:38.855441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.907241+0000","last_change":"2024-04-20T12:20:42.030153+0000","last_active":"2024-04-20T12:21:37.907241+0000","last_peered":"2024-04-20T12:21:37.907241+0000","last_clean":"2024-04-20T12:21:37.907241+0000","last_became_active":"2024-04-20T12:20:42.029796+0000","last_became_peered":"2024-04-20T12:20:42.029796+0000","last_unstale":"2024-04-20T12:21:37.907241+0000","last_undegraded":"2024-04-20T12:21:37.907241+0000","last_fullsized":"2024-04-20T12:21:37.907241+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:50.676958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.910232+0000","last_change":"2024-04-20T12:20:42.039864+0000","last_active":"2024-04-20T12:21:37.910232+0000","last_peered":"2024-04-20T12:21:37.910232+0000","last_clean":"2024-04-20T12:21:37.910232+0000","last_became_active":"2024-04-20T12:20:42.036624+0000","last_became_peered":"2024-04-20T12:20:42.036624+0000","last_unstale":"2024-04-20T12:21:37.910232+0000","last_undegraded":"2024-04-20T12:21:37.910232+0000","last_fullsized":"2024-04-20T12:21:37.910232+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:13.271749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.940688+0000","last_change":"2024-04-20T12:20:42.033628+0000","last_active":"2024-04-20T12:21:37.940688+0000","last_peered":"2024-04-20T12:21:37.940688+0000","last_clean":"2024-04-20T12:21:37.940688+0000","last_became_active":"2024-04-20T12:20:42.033296+0000","last_became_peered":"2024-04-20T12:20:42.033296+0000","last_unstale":"2024-04-20T12:21:37.940688+0000","last_undegraded":"2024-04-20T12:21:37.940688+0000","last_fullsized":"2024-04-20T12:21:37.940688+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:16:16.029327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":27,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.909483+0000","last_change":"2024-04-20T12:20:42.024730+0000","last_active":"2024-04-20T12:21:37.909483+0000","last_peered":"2024-04-20T12:21:37.909483+0000","last_clean":"2024-04-20T12:21:37.909483+0000","last_became_active":"2024-04-20T12:20:42.024400+0000","last_became_peered":"2024-04-20T12:20:42.024400+0000","last_unstale":"2024-04-20T12:21:37.909483+0000","last_undegraded":"2024-04-20T12:21:37.909483+0000","last_fullsized":"2024-04-20T12:21:37.909483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:27:41.514880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-04-20T12:21:37.906643+0000","last_change":"2024-04-20T12:20:42.033623+0000","last_active":"2024-04-20T12:21:37.906643+0000","last_peered":"2024-04-20T12:21:37.906643+0000","last_clean":"2024-04-20T12:21:37.906643+0000","last_became_active":"2024-04-20T12:20:42.033105+0000","last_became_peered":"2024-04-20T12:20:42.033105+0000","last_unstale":"2024-04-20T12:21:37.906643+0000","last_undegraded":"2024-04-20T12:21:37.906643+0000","last_fullsized":"2024-04-20T12:21:37.906643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:01.121977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":279778,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69778,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":758,"num_read_kb":459,"num_write":240,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":622,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":209334,"data_compressed":4842,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383714,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1015808,"data_stored":510769,"data_compressed":23558,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645350,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32316,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712836,"statfs":{"total":95995035648,"available":95961944064,"internally_reserved":0,"allocated":1163264,"data_stored":1160941,"data_compressed":60760,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808876,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":514795,"data_compressed":23558,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070513,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":511077,"data_compressed":23558,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332150,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32248,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712904,"statfs":{"total":95995035648,"available":95962013696,"internally_reserved":0,"allocated":1089536,"data_stored":1107183,"data_compressed":59146,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495675,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":506203,"data_compressed":23558,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717072,"statfs":{"total":95995035648,"available":95966281728,"internally_reserved":0,"allocated":1081344,"data_stored":570589,"data_compressed":25172,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1040384,"data_stored":507659,"data_compressed":23558,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1093632,"data_stored":570187,"data_compressed":25172,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":505911,"data_compressed":23558,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920838,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":510899,"data_compressed":23558,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757313,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1097728,"data_stored":1102765,"data_compressed":59146,"data_compressed_allocated":77824,"data_compressed_original":655360,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33946,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33946,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33946,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":65108,"data_compressed":1614,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64706,"data_compressed":1614,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":65092,"data_compressed":1614,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T12:22:24.966 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-20T12:22:24.967 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-20T12:22:24.967 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-20T12:22:24.967 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph health --format=json 2024-04-20T12:22:25.208 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:22:26.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:25 smithi154 ceph-mon[22073]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:22:26.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:25 smithi154 ceph-mon[22073]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:22:26.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:25 smithi139 ceph-mon[21834]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:22:26.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:25 smithi139 ceph-mon[21834]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:22:26.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:25 smithi135 ceph-mon[18264]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:22:26.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:25 smithi135 ceph-mon[18264]: pgmap v346: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:22:27.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.069+0000 7fa7df512700 1 -- 172.21.15.135:0/283338364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7d81019e0 msgr2=0x7fa7d810f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:27.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.069+0000 7fa7df512700 1 --2- 172.21.15.135:0/283338364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7d81019e0 0x7fa7d810f920 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009990 tx=0x7fa7d4009ca0 comp rx=0 tx=0).stop 2024-04-20T12:22:27.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.069+0000 7fa7df512700 1 -- 172.21.15.135:0/283338364 shutdown_connections 2024-04-20T12:22:27.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.069+0000 7fa7df512700 1 --2- 172.21.15.135:0/283338364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7d81019e0 0x7fa7d810f920 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:27.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.069+0000 7fa7df512700 1 --2- 172.21.15.135:0/283338364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d8108ae0 0x7fa7d8108ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:27.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.069+0000 7fa7df512700 1 --2- 172.21.15.135:0/283338364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7d8101040 0x7fa7d81014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:27.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.069+0000 7fa7df512700 1 -- 172.21.15.135:0/283338364 >> 172.21.15.135:0/283338364 conn(0x7fa7d8077fc0 msgr2=0x7fa7d80ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:27.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.069+0000 7fa7df512700 1 -- 172.21.15.135:0/283338364 shutdown_connections 2024-04-20T12:22:27.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.069+0000 7fa7df512700 1 -- 172.21.15.135:0/283338364 wait complete. 2024-04-20T12:22:27.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.070+0000 7fa7df512700 1 Processor -- start 2024-04-20T12:22:27.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.070+0000 7fa7df512700 1 -- start start 2024-04-20T12:22:27.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.070+0000 7fa7df512700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7d8101040 0x7fa7d8102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:27.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.070+0000 7fa7df512700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d81019e0 0x7fa7d8102760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:27.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.070+0000 7fa7df512700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7d8108ae0 0x7fa7d8102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:27.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.070+0000 7fa7df512700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d8112d80 con 0x7fa7d8108ae0 2024-04-20T12:22:27.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.070+0000 7fa7df512700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d8112c00 con 0x7fa7d8101040 2024-04-20T12:22:27.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.070+0000 7fa7df512700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d8112f00 con 0x7fa7d81019e0 2024-04-20T12:22:27.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.070+0000 7fa7ddaaf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7d8108ae0 0x7fa7d8102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:27.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.070+0000 7fa7ddaaf700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7d8108ae0 0x7fa7d8102ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35672/0 (socket says 172.21.15.135:35672) 2024-04-20T12:22:27.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.070+0000 7fa7ddaaf700 1 -- 172.21.15.135:0/139217679 learned_addr learned my addr 172.21.15.135:0/139217679 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:27.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.070+0000 7fa7dd2ae700 1 --2- 172.21.15.135:0/139217679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7d8101040 0x7fa7d8102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:27.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.070+0000 7fa7dcaad700 1 --2- 172.21.15.135:0/139217679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d81019e0 0x7fa7d8102760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:27.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.071+0000 7fa7ddaaf700 1 -- 172.21.15.135:0/139217679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d81019e0 msgr2=0x7fa7d8102760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:27.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.071+0000 7fa7ddaaf700 1 --2- 172.21.15.135:0/139217679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d81019e0 0x7fa7d8102760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:27.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.071+0000 7fa7ddaaf700 1 -- 172.21.15.135:0/139217679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7d8101040 msgr2=0x7fa7d8102220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:27.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.071+0000 7fa7ddaaf700 1 --2- 172.21.15.135:0/139217679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7d8101040 0x7fa7d8102220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:27.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.071+0000 7fa7ddaaf700 1 -- 172.21.15.135:0/139217679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d81a76d0 con 0x7fa7d8108ae0 2024-04-20T12:22:27.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.071+0000 7fa7ddaaf700 1 --2- 172.21.15.135:0/139217679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7d8108ae0 0x7fa7d8102ca0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40047b0 tx=0x7fa7d4005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:27.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.071+0000 7fa7ce7fc700 1 -- 172.21.15.135:0/139217679 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4026070 con 0x7fa7d8108ae0 2024-04-20T12:22:27.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.071+0000 7fa7ce7fc700 1 -- 172.21.15.135:0/139217679 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7d4004cc0 con 0x7fa7d8108ae0 2024-04-20T12:22:27.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.071+0000 7fa7ce7fc700 1 -- 172.21.15.135:0/139217679 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4003ba0 con 0x7fa7d8108ae0 2024-04-20T12:22:27.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.071+0000 7fa7df512700 1 -- 172.21.15.135:0/139217679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d81a7960 con 0x7fa7d8108ae0 2024-04-20T12:22:27.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.071+0000 7fa7df512700 1 -- 172.21.15.135:0/139217679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d81a7d60 con 0x7fa7d8108ae0 2024-04-20T12:22:27.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.072+0000 7fa7df512700 1 -- 172.21.15.135:0/139217679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d8069740 con 0x7fa7d8108ae0 2024-04-20T12:22:27.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.073+0000 7fa7ce7fc700 1 -- 172.21.15.135:0/139217679 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fa7d4029070 con 0x7fa7d8108ae0 2024-04-20T12:22:27.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.074+0000 7fa7ce7fc700 1 --2- 172.21.15.135:0/139217679 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7c40a3d50 0x7fa7c40a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:27.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.074+0000 7fa7dd2ae700 1 --2- 172.21.15.135:0/139217679 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7c40a3d50 0x7fa7c40a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:27.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.074+0000 7fa7ce7fc700 1 -- 172.21.15.135:0/139217679 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fa7d40d1420 con 0x7fa7d8108ae0 2024-04-20T12:22:27.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.074+0000 7fa7dd2ae700 1 --2- 172.21.15.135:0/139217679 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7c40a3d50 0x7fa7c40a6210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0007fd0 tx=0x7fa7d000c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:27.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.077+0000 7fa7ce7fc700 1 -- 172.21.15.135:0/139217679 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fa7d4030020 con 0x7fa7d8108ae0 2024-04-20T12:22:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.319+0000 7fa7df512700 1 -- 172.21.15.135:0/139217679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa7d802dfc0 con 0x7fa7d8108ae0 2024-04-20T12:22:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.320+0000 7fa7ce7fc700 1 -- 172.21.15.135:0/139217679 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa7d4013070 con 0x7fa7d8108ae0 2024-04-20T12:22:27.320 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:27.320 INFO:teuthology.orchestra.run.smithi135.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-20T12:22:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.322+0000 7fa7df512700 1 -- 172.21.15.135:0/139217679 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7c40a3d50 msgr2=0x7fa7c40a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.322+0000 7fa7df512700 1 --2- 172.21.15.135:0/139217679 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7c40a3d50 0x7fa7c40a6210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0007fd0 tx=0x7fa7d000c040 comp rx=0 tx=0).stop 2024-04-20T12:22:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.322+0000 7fa7df512700 1 -- 172.21.15.135:0/139217679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7d8108ae0 msgr2=0x7fa7d8102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.322+0000 7fa7df512700 1 --2- 172.21.15.135:0/139217679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7d8108ae0 0x7fa7d8102ca0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40047b0 tx=0x7fa7d4005e80 comp rx=0 tx=0).stop 2024-04-20T12:22:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.322+0000 7fa7df512700 1 -- 172.21.15.135:0/139217679 shutdown_connections 2024-04-20T12:22:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.322+0000 7fa7df512700 1 --2- 172.21.15.135:0/139217679 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7c40a3d50 0x7fa7c40a6210 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.322+0000 7fa7df512700 1 --2- 172.21.15.135:0/139217679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7d8108ae0 0x7fa7d8102ca0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.322+0000 7fa7df512700 1 --2- 172.21.15.135:0/139217679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7d8101040 0x7fa7d8102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.322+0000 7fa7df512700 1 --2- 172.21.15.135:0/139217679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7d81019e0 0x7fa7d8102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.322+0000 7fa7df512700 1 -- 172.21.15.135:0/139217679 >> 172.21.15.135:0/139217679 conn(0x7fa7d8077fc0 msgr2=0x7fa7d80ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.322+0000 7fa7df512700 1 -- 172.21.15.135:0/139217679 shutdown_connections 2024-04-20T12:22:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:27.322+0000 7fa7df512700 1 -- 172.21.15.135:0/139217679 wait complete. 2024-04-20T12:22:28.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:27 smithi135 ceph-mon[18264]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:22:28.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:27 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/139217679' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-20T12:22:28.162 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-20T12:22:28.163 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:22:28.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:27 smithi154 ceph-mon[22073]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:22:28.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:27 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/139217679' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-20T12:22:28.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.265+0000 7f3d2dc81640 1 -- 172.21.15.135:0/3531334724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d28105360 msgr2=0x7f3d28107750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:28.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.265+0000 7f3d2dc81640 1 --2- 172.21.15.135:0/3531334724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d28105360 0x7f3d28107750 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c009900 tx=0x7f3d1c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:28.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.265+0000 7f3d2dc81640 1 -- 172.21.15.135:0/3531334724 shutdown_connections 2024-04-20T12:22:28.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.265+0000 7f3d2dc81640 1 --2- 172.21.15.135:0/3531334724 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d28107c90 0x7f3d2810a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.265+0000 7f3d2dc81640 1 --2- 172.21.15.135:0/3531334724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d28105360 0x7f3d28107750 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.265+0000 7f3d2dc81640 1 --2- 172.21.15.135:0/3531334724 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d28102a30 0x7f3d28104e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.265+0000 7f3d2dc81640 1 -- 172.21.15.135:0/3531334724 >> 172.21.15.135:0/3531334724 conn(0x7f3d280fc440 msgr2=0x7f3d280fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:28.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.265+0000 7f3d2dc81640 1 -- 172.21.15.135:0/3531334724 shutdown_connections 2024-04-20T12:22:28.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.265+0000 7f3d2dc81640 1 -- 172.21.15.135:0/3531334724 wait complete. 2024-04-20T12:22:28.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.266+0000 7f3d2dc81640 1 Processor -- start 2024-04-20T12:22:28.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.266+0000 7f3d2dc81640 1 -- start start 2024-04-20T12:22:28.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.266+0000 7f3d2dc81640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d28102a30 0x7f3d281982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:28.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.266+0000 7f3d2dc81640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d28105360 0x7f3d28198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:28.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.266+0000 7f3d2dc81640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d28107c90 0x7f3d2819f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:28.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.266+0000 7f3d2dc81640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2810dc40 con 0x7f3d28105360 2024-04-20T12:22:28.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.266+0000 7f3d2dc81640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2810dac0 con 0x7f3d28107c90 2024-04-20T12:22:28.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.266+0000 7f3d2dc81640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2810ddc0 con 0x7f3d28102a30 2024-04-20T12:22:28.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.266+0000 7f3d26ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d28105360 0x7f3d28198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:28.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.266+0000 7f3d26ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d28105360 0x7f3d28198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35690/0 (socket says 172.21.15.135:35690) 2024-04-20T12:22:28.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.266+0000 7f3d26ffd640 1 -- 172.21.15.135:0/704491084 learned_addr learned my addr 172.21.15.135:0/704491084 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:28.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.266+0000 7f3d277fe640 1 --2- 172.21.15.135:0/704491084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d28102a30 0x7f3d281982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:28.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.267+0000 7f3d27fff640 1 --2- 172.21.15.135:0/704491084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d28107c90 0x7f3d2819f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:28.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.267+0000 7f3d26ffd640 1 -- 172.21.15.135:0/704491084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d28102a30 msgr2=0x7f3d281982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:28.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.267+0000 7f3d26ffd640 1 --2- 172.21.15.135:0/704491084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d28102a30 0x7f3d281982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.267+0000 7f3d26ffd640 1 -- 172.21.15.135:0/704491084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d28107c90 msgr2=0x7f3d2819f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:28.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.267+0000 7f3d26ffd640 1 --2- 172.21.15.135:0/704491084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d28107c90 0x7f3d2819f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.267+0000 7f3d26ffd640 1 -- 172.21.15.135:0/704491084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2819fef0 con 0x7f3d28105360 2024-04-20T12:22:28.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.267+0000 7f3d26ffd640 1 --2- 172.21.15.135:0/704491084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d28105360 0x7f3d28198810 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c005ab0 tx=0x7f3d1c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:28.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.267+0000 7f3d24ff9640 1 -- 172.21.15.135:0/704491084 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c041070 con 0x7f3d28105360 2024-04-20T12:22:28.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.267+0000 7f3d24ff9640 1 -- 172.21.15.135:0/704491084 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d1c0054e0 con 0x7f3d28105360 2024-04-20T12:22:28.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.267+0000 7f3d24ff9640 1 -- 172.21.15.135:0/704491084 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c034440 con 0x7f3d28105360 2024-04-20T12:22:28.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.267+0000 7f3d2dc81640 1 -- 172.21.15.135:0/704491084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d281a0180 con 0x7f3d28105360 2024-04-20T12:22:28.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.267+0000 7f3d2dc81640 1 -- 172.21.15.135:0/704491084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d281a0620 con 0x7f3d28105360 2024-04-20T12:22:28.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.268+0000 7f3d2dc81640 1 -- 172.21.15.135:0/704491084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d280fdf30 con 0x7f3d28105360 2024-04-20T12:22:28.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.269+0000 7f3d24ff9640 1 -- 172.21.15.135:0/704491084 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f3d1c044070 con 0x7f3d28105360 2024-04-20T12:22:28.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.270+0000 7f3d24ff9640 1 --2- 172.21.15.135:0/704491084 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3d100a3c40 0x7f3d100a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:28.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.270+0000 7f3d277fe640 1 --2- 172.21.15.135:0/704491084 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3d100a3c40 0x7f3d100a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:28.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.270+0000 7f3d24ff9640 1 -- 172.21.15.135:0/704491084 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f3d1c0f23e0 con 0x7f3d28105360 2024-04-20T12:22:28.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.270+0000 7f3d277fe640 1 --2- 172.21.15.135:0/704491084 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3d100a3c40 0x7f3d100a6100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3d18005fd0 tx=0x7f3d1800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:28.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.274+0000 7f3d24ff9640 1 -- 172.21.15.135:0/704491084 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f3d1c0bea30 con 0x7f3d28105360 2024-04-20T12:22:28.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:27 smithi139 ceph-mon[21834]: pgmap v347: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-04-20T12:22:28.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:27 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/139217679' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-20T12:22:28.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.454+0000 7f3d2dc81640 1 -- 172.21.15.135:0/704491084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d2802d7f0 con 0x7f3d28105360 2024-04-20T12:22:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.456+0000 7f3d24ff9640 1 -- 172.21.15.135:0/704491084 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24674 (secure 0 0 0) 0x7f3d1c0be330 con 0x7f3d28105360 2024-04-20T12:22:28.456 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:28.456 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":92,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:21:37.896877+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:22:28.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.458+0000 7f3d2dc81640 1 -- 172.21.15.135:0/704491084 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3d100a3c40 msgr2=0x7f3d100a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:28.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.458+0000 7f3d2dc81640 1 --2- 172.21.15.135:0/704491084 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3d100a3c40 0x7f3d100a6100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3d18005fd0 tx=0x7f3d1800b390 comp rx=0 tx=0).stop 2024-04-20T12:22:28.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.458+0000 7f3d2dc81640 1 -- 172.21.15.135:0/704491084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d28105360 msgr2=0x7f3d28198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:28.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.458+0000 7f3d2dc81640 1 --2- 172.21.15.135:0/704491084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d28105360 0x7f3d28198810 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c005ab0 tx=0x7f3d1c005dc0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.458+0000 7f3d2dc81640 1 -- 172.21.15.135:0/704491084 shutdown_connections 2024-04-20T12:22:28.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.458+0000 7f3d2dc81640 1 --2- 172.21.15.135:0/704491084 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f3d100a3c40 0x7f3d100a6100 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.458+0000 7f3d2dc81640 1 --2- 172.21.15.135:0/704491084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3d28107c90 0x7f3d2819f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.458+0000 7f3d2dc81640 1 --2- 172.21.15.135:0/704491084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d28105360 0x7f3d28198810 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.458+0000 7f3d2dc81640 1 --2- 172.21.15.135:0/704491084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d28102a30 0x7f3d281982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.458+0000 7f3d2dc81640 1 -- 172.21.15.135:0/704491084 >> 172.21.15.135:0/704491084 conn(0x7f3d280fc440 msgr2=0x7f3d281032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:28.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.458+0000 7f3d2dc81640 1 -- 172.21.15.135:0/704491084 shutdown_connections 2024-04-20T12:22:28.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.458+0000 7f3d2dc81640 1 -- 172.21.15.135:0/704491084 wait complete. 2024-04-20T12:22:28.470 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T12:16:02.802023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T12:20:39.656129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T12:20:40.312827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T12:20:44.307136+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T12:22:28.471 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T12:22:28.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.574+0000 7f2b88723640 1 -- 172.21.15.135:0/2712072766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b80101ff0 msgr2=0x7f2b80102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:28.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.574+0000 7f2b88723640 1 --2- 172.21.15.135:0/2712072766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b80101ff0 0x7f2b80102470 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009900 tx=0x7f2b7002bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:28.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.574+0000 7f2b88723640 1 -- 172.21.15.135:0/2712072766 shutdown_connections 2024-04-20T12:22:28.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.574+0000 7f2b88723640 1 --2- 172.21.15.135:0/2712072766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b801029b0 0x7f2b801092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.574+0000 7f2b88723640 1 --2- 172.21.15.135:0/2712072766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b80101ff0 0x7f2b80102470 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.574+0000 7f2b88723640 1 --2- 172.21.15.135:0/2712072766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b80100ea0 0x7f2b801012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.574+0000 7f2b88723640 1 -- 172.21.15.135:0/2712072766 >> 172.21.15.135:0/2712072766 conn(0x7f2b800fc410 msgr2=0x7f2b800fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:28.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.574+0000 7f2b88723640 1 -- 172.21.15.135:0/2712072766 shutdown_connections 2024-04-20T12:22:28.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.574+0000 7f2b88723640 1 -- 172.21.15.135:0/2712072766 wait complete. 2024-04-20T12:22:28.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b88723640 1 Processor -- start 2024-04-20T12:22:28.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b88723640 1 -- start start 2024-04-20T12:22:28.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b88723640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b80100ea0 0x7f2b80198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:28.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b88723640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b80101ff0 0x7f2b801987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:28.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b88723640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b801029b0 0x7f2b8019f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:28.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b88723640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8010cb40 con 0x7f2b80101ff0 2024-04-20T12:22:28.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b88723640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8010c9c0 con 0x7f2b80100ea0 2024-04-20T12:22:28.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b88723640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8010ccc0 con 0x7f2b801029b0 2024-04-20T12:22:28.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b85cbe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b80101ff0 0x7f2b801987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:28.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b85cbe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b80101ff0 0x7f2b801987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35720/0 (socket says 172.21.15.135:35720) 2024-04-20T12:22:28.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b85cbe640 1 -- 172.21.15.135:0/1456691120 learned_addr learned my addr 172.21.15.135:0/1456691120 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:28.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b86cc0640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b801029b0 0x7f2b8019f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:28.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b864bf640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b80100ea0 0x7f2b80198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:28.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b85cbe640 1 -- 172.21.15.135:0/1456691120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b801029b0 msgr2=0x7f2b8019f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:28.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b85cbe640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b801029b0 0x7f2b8019f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b85cbe640 1 -- 172.21.15.135:0/1456691120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b80100ea0 msgr2=0x7f2b80198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:28.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b85cbe640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b80100ea0 0x7f2b80198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b85cbe640 1 -- 172.21.15.135:0/1456691120 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8019feb0 con 0x7f2b80101ff0 2024-04-20T12:22:28.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b86cc0640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b801029b0 0x7f2b8019f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:28.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.575+0000 7f2b864bf640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b80100ea0 0x7f2b80198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:28.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.576+0000 7f2b85cbe640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b80101ff0 0x7f2b801987d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2b70005ab0 tx=0x7f2b70005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:28.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.576+0000 7f2b777fe640 1 -- 172.21.15.135:0/1456691120 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70041070 con 0x7f2b80101ff0 2024-04-20T12:22:28.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.576+0000 7f2b777fe640 1 -- 172.21.15.135:0/1456691120 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b700054e0 con 0x7f2b80101ff0 2024-04-20T12:22:28.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.576+0000 7f2b88723640 1 -- 172.21.15.135:0/1456691120 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b801a0140 con 0x7f2b80101ff0 2024-04-20T12:22:28.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.576+0000 7f2b777fe640 1 -- 172.21.15.135:0/1456691120 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70034440 con 0x7f2b80101ff0 2024-04-20T12:22:28.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.576+0000 7f2b88723640 1 -- 172.21.15.135:0/1456691120 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b801a0630 con 0x7f2b80101ff0 2024-04-20T12:22:28.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.577+0000 7f2b88723640 1 -- 172.21.15.135:0/1456691120 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b801a0890 con 0x7f2b80101ff0 2024-04-20T12:22:28.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.578+0000 7f2b777fe640 1 -- 172.21.15.135:0/1456691120 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f2b70044070 con 0x7f2b80101ff0 2024-04-20T12:22:28.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.578+0000 7f2b777fe640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2b6c0a3c40 0x7f2b6c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:28.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.579+0000 7f2b864bf640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2b6c0a3c40 0x7f2b6c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:28.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.579+0000 7f2b777fe640 1 -- 172.21.15.135:0/1456691120 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f2b700f26b0 con 0x7f2b80101ff0 2024-04-20T12:22:28.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.579+0000 7f2b864bf640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2b6c0a3c40 0x7f2b6c0a6100 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00baa0 tx=0x7f2b7c005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:28.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.582+0000 7f2b777fe640 1 -- 172.21.15.135:0/1456691120 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f2b700bed00 con 0x7f2b80101ff0 2024-04-20T12:22:28.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.759+0000 7f2b88723640 1 -- 172.21.15.135:0/1456691120 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2b801a0a60 con 0x7f2b80101ff0 2024-04-20T12:22:28.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.760+0000 7f2b777fe640 1 -- 172.21.15.135:0/1456691120 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7f2b700be600 con 0x7f2b80101ff0 2024-04-20T12:22:28.760 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-04-20T12:22:28.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.762+0000 7f2b88723640 1 -- 172.21.15.135:0/1456691120 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2b6c0a3c40 msgr2=0x7f2b6c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:28.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.762+0000 7f2b88723640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2b6c0a3c40 0x7f2b6c0a6100 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c00baa0 tx=0x7f2b7c005d90 comp rx=0 tx=0).stop 2024-04-20T12:22:28.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.762+0000 7f2b88723640 1 -- 172.21.15.135:0/1456691120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b80101ff0 msgr2=0x7f2b801987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:28.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.762+0000 7f2b88723640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b80101ff0 0x7f2b801987d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2b70005ab0 tx=0x7f2b70005dc0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.762+0000 7f2b88723640 1 -- 172.21.15.135:0/1456691120 shutdown_connections 2024-04-20T12:22:28.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.762+0000 7f2b88723640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f2b6c0a3c40 0x7f2b6c0a6100 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.762+0000 7f2b88723640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b801029b0 0x7f2b8019f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.762+0000 7f2b88723640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b80101ff0 0x7f2b801987d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.762+0000 7f2b88723640 1 --2- 172.21.15.135:0/1456691120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2b80100ea0 0x7f2b80198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.762+0000 7f2b88723640 1 -- 172.21.15.135:0/1456691120 >> 172.21.15.135:0/1456691120 conn(0x7f2b800fc410 msgr2=0x7f2b8006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:28.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.762+0000 7f2b88723640 1 -- 172.21.15.135:0/1456691120 shutdown_connections 2024-04-20T12:22:28.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.762+0000 7f2b88723640 1 -- 172.21.15.135:0/1456691120 wait complete. 2024-04-20T12:22:28.773 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T12:22:28.877 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.874+0000 7f8ec0b75640 1 -- 172.21.15.135:0/2204997573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ebc101fb0 msgr2=0x7f8ebc1023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:28.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.874+0000 7f8ec0b75640 1 --2- 172.21.15.135:0/2204997573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ebc101fb0 0x7f8ebc1023d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009900 tx=0x7f8eac02bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:28.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.874+0000 7f8ec0b75640 1 -- 172.21.15.135:0/2204997573 shutdown_connections 2024-04-20T12:22:28.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.874+0000 7f8ec0b75640 1 --2- 172.21.15.135:0/2204997573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ebc103b60 0x7f8ebc10a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.874+0000 7f8ec0b75640 1 --2- 172.21.15.135:0/2204997573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ebc1031a0 0x7f8ebc103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.874+0000 7f8ec0b75640 1 --2- 172.21.15.135:0/2204997573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ebc101fb0 0x7f8ebc1023d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.874+0000 7f8ec0b75640 1 -- 172.21.15.135:0/2204997573 >> 172.21.15.135:0/2204997573 conn(0x7f8ebc0fd540 msgr2=0x7f8ebc0ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:28.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.874+0000 7f8ec0b75640 1 -- 172.21.15.135:0/2204997573 shutdown_connections 2024-04-20T12:22:28.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.874+0000 7f8ec0b75640 1 -- 172.21.15.135:0/2204997573 wait complete. 2024-04-20T12:22:28.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8ec0b75640 1 Processor -- start 2024-04-20T12:22:28.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8ec0b75640 1 -- start start 2024-04-20T12:22:28.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8ec0b75640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ebc101fb0 0x7f8ebc1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:28.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8ec0b75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ebc1031a0 0x7f8ebc1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:28.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8ec0b75640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ebc103b60 0x7f8ebc19f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:28.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8ec0b75640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc10dc80 con 0x7f8ebc101fb0 2024-04-20T12:22:28.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8ec0b75640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc10db00 con 0x7f8ebc103b60 2024-04-20T12:22:28.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8ec0b75640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc10de00 con 0x7f8ebc1031a0 2024-04-20T12:22:28.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8eba59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ebc101fb0 0x7f8ebc1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:28.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8eba59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ebc101fb0 0x7f8ebc1983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35734/0 (socket says 172.21.15.135:35734) 2024-04-20T12:22:28.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8eba59c640 1 -- 172.21.15.135:0/2163496988 learned_addr learned my addr 172.21.15.135:0/2163496988 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:28.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8ebad9d640 1 --2- 172.21.15.135:0/2163496988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ebc103b60 0x7f8ebc19f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:28.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8eb3fff640 1 --2- 172.21.15.135:0/2163496988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ebc1031a0 0x7f8ebc1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:28.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8eba59c640 1 -- 172.21.15.135:0/2163496988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ebc1031a0 msgr2=0x7f8ebc1988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:28.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8eba59c640 1 --2- 172.21.15.135:0/2163496988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ebc1031a0 0x7f8ebc1988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8eba59c640 1 -- 172.21.15.135:0/2163496988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ebc103b60 msgr2=0x7f8ebc19f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:28.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8eba59c640 1 --2- 172.21.15.135:0/2163496988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ebc103b60 0x7f8ebc19f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:28.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.875+0000 7f8eba59c640 1 -- 172.21.15.135:0/2163496988 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ebc19ffc0 con 0x7f8ebc101fb0 2024-04-20T12:22:28.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.876+0000 7f8eba59c640 1 --2- 172.21.15.135:0/2163496988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ebc101fb0 0x7f8ebc1983a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8eac000c00 tx=0x7f8eac004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:28.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.876+0000 7f8eb37fe640 1 -- 172.21.15.135:0/2163496988 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac041070 con 0x7f8ebc101fb0 2024-04-20T12:22:28.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.876+0000 7f8eb37fe640 1 -- 172.21.15.135:0/2163496988 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8eac0054e0 con 0x7f8ebc101fb0 2024-04-20T12:22:28.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.876+0000 7f8ec0b75640 1 -- 172.21.15.135:0/2163496988 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ebc1a0250 con 0x7f8ebc101fb0 2024-04-20T12:22:28.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.876+0000 7f8eb37fe640 1 -- 172.21.15.135:0/2163496988 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0346a0 con 0x7f8ebc101fb0 2024-04-20T12:22:28.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.876+0000 7f8ec0b75640 1 -- 172.21.15.135:0/2163496988 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ebc1a0740 con 0x7f8ebc101fb0 2024-04-20T12:22:28.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.877+0000 7f8ec0b75640 1 -- 172.21.15.135:0/2163496988 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ebc1093f0 con 0x7f8ebc101fb0 2024-04-20T12:22:28.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.878+0000 7f8eb37fe640 1 -- 172.21.15.135:0/2163496988 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f8eac044070 con 0x7f8ebc101fb0 2024-04-20T12:22:28.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.878+0000 7f8eb37fe640 1 --2- 172.21.15.135:0/2163496988 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8ea80a3c40 0x7f8ea80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:28.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.878+0000 7f8eb3fff640 1 --2- 172.21.15.135:0/2163496988 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8ea80a3c40 0x7f8ea80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:28.881 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.878+0000 7f8eb37fe640 1 -- 172.21.15.135:0/2163496988 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f8eac0f2600 con 0x7f8ebc101fb0 2024-04-20T12:22:28.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.879+0000 7f8eb3fff640 1 --2- 172.21.15.135:0/2163496988 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8ea80a3c40 0x7f8ea80a6100 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc1998b0 tx=0x7f8ea4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:28.882 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:28.883+0000 7f8eb37fe640 1 -- 172.21.15.135:0/2163496988 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f8eac0bec50 con 0x7f8ebc101fb0 2024-04-20T12:22:29.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.063+0000 7f8ec0b75640 1 -- 172.21.15.135:0/2163496988 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8ebc062b60 con 0x7f8ebc101fb0 2024-04-20T12:22:29.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.063+0000 7f8eb37fe640 1 -- 172.21.15.135:0/2163496988 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) ==== 104+0+11 (secure 0 0 0) 0x7f8eac003e20 con 0x7f8ebc101fb0 2024-04-20T12:22:29.063 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:22:29.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.065+0000 7f8ec0b75640 1 -- 172.21.15.135:0/2163496988 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8ea80a3c40 msgr2=0x7f8ea80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:29.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.065+0000 7f8ec0b75640 1 --2- 172.21.15.135:0/2163496988 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8ea80a3c40 0x7f8ea80a6100 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc1998b0 tx=0x7f8ea4008040 comp rx=0 tx=0).stop 2024-04-20T12:22:29.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.065+0000 7f8ec0b75640 1 -- 172.21.15.135:0/2163496988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ebc101fb0 msgr2=0x7f8ebc1983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:29.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.065+0000 7f8ec0b75640 1 --2- 172.21.15.135:0/2163496988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ebc101fb0 0x7f8ebc1983a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8eac000c00 tx=0x7f8eac004040 comp rx=0 tx=0).stop 2024-04-20T12:22:29.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.065+0000 7f8ec0b75640 1 -- 172.21.15.135:0/2163496988 shutdown_connections 2024-04-20T12:22:29.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.065+0000 7f8ec0b75640 1 --2- 172.21.15.135:0/2163496988 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8ea80a3c40 0x7f8ea80a6100 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.065+0000 7f8ec0b75640 1 --2- 172.21.15.135:0/2163496988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ebc103b60 0x7f8ebc19f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.065+0000 7f8ec0b75640 1 --2- 172.21.15.135:0/2163496988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ebc1031a0 0x7f8ebc1988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.066+0000 7f8ec0b75640 1 --2- 172.21.15.135:0/2163496988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ebc101fb0 0x7f8ebc1983a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.066+0000 7f8ec0b75640 1 -- 172.21.15.135:0/2163496988 >> 172.21.15.135:0/2163496988 conn(0x7f8ebc0fd540 msgr2=0x7f8ebc1065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:29.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.066+0000 7f8ec0b75640 1 -- 172.21.15.135:0/2163496988 shutdown_connections 2024-04-20T12:22:29.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.066+0000 7f8ec0b75640 1 -- 172.21.15.135:0/2163496988 wait complete. 2024-04-20T12:22:29.076 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:28 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/704491084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:29.076 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:28 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1456691120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:22:29.077 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T12:22:29.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.178+0000 7f5836fdb640 1 -- 172.21.15.135:0/1462178534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5830102a20 msgr2=0x7f5830104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:29.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.178+0000 7f5836fdb640 1 --2- 172.21.15.135:0/1462178534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5830102a20 0x7f5830104e10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5820009900 tx=0x7f582002bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:29.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.178+0000 7f5836fdb640 1 -- 172.21.15.135:0/1462178534 shutdown_connections 2024-04-20T12:22:29.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.178+0000 7f5836fdb640 1 --2- 172.21.15.135:0/1462178534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5830107c80 0x7f583010a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.178+0000 7f5836fdb640 1 --2- 172.21.15.135:0/1462178534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5830105350 0x7f5830107740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.178+0000 7f5836fdb640 1 --2- 172.21.15.135:0/1462178534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5830102a20 0x7f5830104e10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.178+0000 7f5836fdb640 1 -- 172.21.15.135:0/1462178534 >> 172.21.15.135:0/1462178534 conn(0x7f58300fc410 msgr2=0x7f58300fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:29.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.178+0000 7f5836fdb640 1 -- 172.21.15.135:0/1462178534 shutdown_connections 2024-04-20T12:22:29.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.178+0000 7f5836fdb640 1 -- 172.21.15.135:0/1462178534 wait complete. 2024-04-20T12:22:29.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.179+0000 7f5836fdb640 1 Processor -- start 2024-04-20T12:22:29.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.179+0000 7f5836fdb640 1 -- start start 2024-04-20T12:22:29.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.179+0000 7f5836fdb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5830102a20 0x7f5830198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:29.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.179+0000 7f5836fdb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5830105350 0x7f5830198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:29.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.179+0000 7f5836fdb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5830107c80 0x7f583019f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:29.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.179+0000 7f5836fdb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f583010dc30 con 0x7f5830102a20 2024-04-20T12:22:29.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.179+0000 7f5836fdb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f583010dab0 con 0x7f5830105350 2024-04-20T12:22:29.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.179+0000 7f5836fdb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f583010ddb0 con 0x7f5830107c80 2024-04-20T12:22:29.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.179+0000 7f5834d77640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5830102a20 0x7f5830198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:29.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.179+0000 7f5834d77640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5830102a20 0x7f5830198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35754/0 (socket says 172.21.15.135:35754) 2024-04-20T12:22:29.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.179+0000 7f5834d77640 1 -- 172.21.15.135:0/1778022205 learned_addr learned my addr 172.21.15.135:0/1778022205 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:29.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.179+0000 7f5835578640 1 --2- 172.21.15.135:0/1778022205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5830107c80 0x7f583019f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:29.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.179+0000 7f582ffff640 1 --2- 172.21.15.135:0/1778022205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5830105350 0x7f5830198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:29.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.180+0000 7f5834d77640 1 -- 172.21.15.135:0/1778022205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5830107c80 msgr2=0x7f583019f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:29.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.180+0000 7f5834d77640 1 --2- 172.21.15.135:0/1778022205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5830107c80 0x7f583019f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.180+0000 7f5834d77640 1 -- 172.21.15.135:0/1778022205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5830105350 msgr2=0x7f5830198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:29.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.180+0000 7f5834d77640 1 --2- 172.21.15.135:0/1778022205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5830105350 0x7f5830198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.180+0000 7f5834d77640 1 -- 172.21.15.135:0/1778022205 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f583019ff60 con 0x7f5830102a20 2024-04-20T12:22:29.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.180+0000 7f5834d77640 1 --2- 172.21.15.135:0/1778022205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5830102a20 0x7f5830198340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5820009230 tx=0x7f5820005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:29.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.180+0000 7f582dffb640 1 -- 172.21.15.135:0/1778022205 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820041070 con 0x7f5830102a20 2024-04-20T12:22:29.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.180+0000 7f5836fdb640 1 -- 172.21.15.135:0/1778022205 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58301a01f0 con 0x7f5830102a20 2024-04-20T12:22:29.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.180+0000 7f582dffb640 1 -- 172.21.15.135:0/1778022205 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58200054e0 con 0x7f5830102a20 2024-04-20T12:22:29.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.180+0000 7f582dffb640 1 -- 172.21.15.135:0/1778022205 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820034440 con 0x7f5830102a20 2024-04-20T12:22:29.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.180+0000 7f5836fdb640 1 -- 172.21.15.135:0/1778022205 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58301a06e0 con 0x7f5830102a20 2024-04-20T12:22:29.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.181+0000 7f5836fdb640 1 -- 172.21.15.135:0/1778022205 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58300fdf00 con 0x7f5830102a20 2024-04-20T12:22:29.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.182+0000 7f582dffb640 1 -- 172.21.15.135:0/1778022205 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f5820044070 con 0x7f5830102a20 2024-04-20T12:22:29.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.183+0000 7f582dffb640 1 --2- 172.21.15.135:0/1778022205 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f58180a3c40 0x7f58180a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:29.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.183+0000 7f582ffff640 1 --2- 172.21.15.135:0/1778022205 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f58180a3c40 0x7f58180a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:29.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.183+0000 7f582dffb640 1 -- 172.21.15.135:0/1778022205 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f58200f27e0 con 0x7f5830102a20 2024-04-20T12:22:29.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.183+0000 7f582ffff640 1 --2- 172.21.15.135:0/1778022205 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f58180a3c40 0x7f58180a6100 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5830199850 tx=0x7f582400a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:29.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.187+0000 7f582dffb640 1 -- 172.21.15.135:0/1778022205 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f58200be7e0 con 0x7f5830102a20 2024-04-20T12:22:29.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:28 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/704491084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:29.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:28 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1456691120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:22:29.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:28 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/704491084' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:29.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:28 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1456691120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:22:29.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.366+0000 7f5836fdb640 1 -- 172.21.15.135:0/1778022205 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f583002d760 con 0x7f5830102a20 2024-04-20T12:22:29.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.367+0000 7f582dffb640 1 -- 172.21.15.135:0/1778022205 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) ==== 100+0+11 (secure 0 0 0) 0x7f58200c2ae0 con 0x7f5830102a20 2024-04-20T12:22:29.367 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-04-20T12:22:29.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.369+0000 7f5836fdb640 1 -- 172.21.15.135:0/1778022205 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f58180a3c40 msgr2=0x7f58180a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:29.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.369+0000 7f5836fdb640 1 --2- 172.21.15.135:0/1778022205 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f58180a3c40 0x7f58180a6100 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5830199850 tx=0x7f582400a250 comp rx=0 tx=0).stop 2024-04-20T12:22:29.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.369+0000 7f5836fdb640 1 -- 172.21.15.135:0/1778022205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5830102a20 msgr2=0x7f5830198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:29.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.369+0000 7f5836fdb640 1 --2- 172.21.15.135:0/1778022205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5830102a20 0x7f5830198340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5820009230 tx=0x7f5820005dd0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.369+0000 7f5836fdb640 1 -- 172.21.15.135:0/1778022205 shutdown_connections 2024-04-20T12:22:29.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.369+0000 7f5836fdb640 1 --2- 172.21.15.135:0/1778022205 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f58180a3c40 0x7f58180a6100 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.369+0000 7f5836fdb640 1 --2- 172.21.15.135:0/1778022205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5830107c80 0x7f583019f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.369+0000 7f5836fdb640 1 --2- 172.21.15.135:0/1778022205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5830105350 0x7f5830198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.369+0000 7f5836fdb640 1 --2- 172.21.15.135:0/1778022205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5830102a20 0x7f5830198340 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.369+0000 7f5836fdb640 1 -- 172.21.15.135:0/1778022205 >> 172.21.15.135:0/1778022205 conn(0x7f58300fc410 msgr2=0x7f5830103480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:29.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.369+0000 7f5836fdb640 1 -- 172.21.15.135:0/1778022205 shutdown_connections 2024-04-20T12:22:29.370 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.369+0000 7f5836fdb640 1 -- 172.21.15.135:0/1778022205 wait complete. 2024-04-20T12:22:29.380 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T12:22:29.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.481+0000 7ff3314f2640 1 -- 172.21.15.135:0/1150933306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff32c102a10 msgr2=0x7ff32c109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:29.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.481+0000 7ff3314f2640 1 --2- 172.21.15.135:0/1150933306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff32c102a10 0x7ff32c109330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff324009ca0 tx=0x7ff32402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.481+0000 7ff3314f2640 1 -- 172.21.15.135:0/1150933306 shutdown_connections 2024-04-20T12:22:29.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.481+0000 7ff3314f2640 1 --2- 172.21.15.135:0/1150933306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff32c102a10 0x7ff32c109330 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.481+0000 7ff3314f2640 1 --2- 172.21.15.135:0/1150933306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff32c102050 0x7ff32c1024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.481+0000 7ff3314f2640 1 --2- 172.21.15.135:0/1150933306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff32c100e70 0x7ff32c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.481+0000 7ff3314f2640 1 -- 172.21.15.135:0/1150933306 >> 172.21.15.135:0/1150933306 conn(0x7ff32c0fc430 msgr2=0x7ff32c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:29.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.481+0000 7ff3314f2640 1 -- 172.21.15.135:0/1150933306 shutdown_connections 2024-04-20T12:22:29.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.481+0000 7ff3314f2640 1 -- 172.21.15.135:0/1150933306 wait complete. 2024-04-20T12:22:29.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.481+0000 7ff3314f2640 1 Processor -- start 2024-04-20T12:22:29.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff3314f2640 1 -- start start 2024-04-20T12:22:29.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff3314f2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff32c100e70 0x7ff32c06b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:29.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff3314f2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff32c102050 0x7ff32c19cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:29.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff3314f2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff32c102a10 0x7ff32c19f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:29.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff3314f2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c10cb70 con 0x7ff32c100e70 2024-04-20T12:22:29.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff3314f2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c10c9f0 con 0x7ff32c102050 2024-04-20T12:22:29.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff3314f2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c10ccf0 con 0x7ff32c102a10 2024-04-20T12:22:29.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff32affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff32c100e70 0x7ff32c06b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:29.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff32affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff32c100e70 0x7ff32c06b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35766/0 (socket says 172.21.15.135:35766) 2024-04-20T12:22:29.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff32affd640 1 -- 172.21.15.135:0/463614918 learned_addr learned my addr 172.21.15.135:0/463614918 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:29.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff32a7fc640 1 --2- 172.21.15.135:0/463614918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff32c102050 0x7ff32c19cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:29.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff32b7fe640 1 --2- 172.21.15.135:0/463614918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff32c102a10 0x7ff32c19f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:29.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff32affd640 1 -- 172.21.15.135:0/463614918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff32c102a10 msgr2=0x7ff32c19f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:29.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff32affd640 1 --2- 172.21.15.135:0/463614918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff32c102a10 0x7ff32c19f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff32affd640 1 -- 172.21.15.135:0/463614918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff32c102050 msgr2=0x7ff32c19cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:29.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff32affd640 1 --2- 172.21.15.135:0/463614918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff32c102050 0x7ff32c19cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff32affd640 1 -- 172.21.15.135:0/463614918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c19feb0 con 0x7ff32c100e70 2024-04-20T12:22:29.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.482+0000 7ff32affd640 1 --2- 172.21.15.135:0/463614918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff32c100e70 0x7ff32c06b150 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00c970 tx=0x7ff31c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:29.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.483+0000 7ff313fff640 1 -- 172.21.15.135:0/463614918 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c004220 con 0x7ff32c100e70 2024-04-20T12:22:29.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.483+0000 7ff3314f2640 1 -- 172.21.15.135:0/463614918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff32c1a01a0 con 0x7ff32c100e70 2024-04-20T12:22:29.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.483+0000 7ff313fff640 1 -- 172.21.15.135:0/463614918 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff31c0043c0 con 0x7ff32c100e70 2024-04-20T12:22:29.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.483+0000 7ff313fff640 1 -- 172.21.15.135:0/463614918 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c004a00 con 0x7ff32c100e70 2024-04-20T12:22:29.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.483+0000 7ff3314f2640 1 -- 172.21.15.135:0/463614918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff32c1a06f0 con 0x7ff32c100e70 2024-04-20T12:22:29.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.484+0000 7ff3314f2640 1 -- 172.21.15.135:0/463614918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3180052c0 con 0x7ff32c100e70 2024-04-20T12:22:29.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.485+0000 7ff313fff640 1 -- 172.21.15.135:0/463614918 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7ff31c0079b0 con 0x7ff32c100e70 2024-04-20T12:22:29.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.485+0000 7ff313fff640 1 --2- 172.21.15.135:0/463614918 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff3140a3c40 0x7ff3140a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:29.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.486+0000 7ff32a7fc640 1 --2- 172.21.15.135:0/463614918 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff3140a3c40 0x7ff3140a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:29.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.486+0000 7ff313fff640 1 -- 172.21.15.135:0/463614918 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7ff31c0d0550 con 0x7ff32c100e70 2024-04-20T12:22:29.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.486+0000 7ff32a7fc640 1 --2- 172.21.15.135:0/463614918 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff3140a3c40 0x7ff3140a6100 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff32c06aec0 tx=0x7ff32000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:29.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.490+0000 7ff313fff640 1 -- 172.21.15.135:0/463614918 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7ff31c014030 con 0x7ff32c100e70 2024-04-20T12:22:29.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.666+0000 7ff3314f2640 1 -- 172.21.15.135:0/463614918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff318005880 con 0x7ff32c100e70 2024-04-20T12:22:29.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.666+0000 7ff313fff640 1 -- 172.21.15.135:0/463614918 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) ==== 103+0+11 (secure 0 0 0) 0x7ff31c09ca90 con 0x7ff32c100e70 2024-04-20T12:22:29.666 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:22:29.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.668+0000 7ff3314f2640 1 -- 172.21.15.135:0/463614918 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff3140a3c40 msgr2=0x7ff3140a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:29.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.668+0000 7ff3314f2640 1 --2- 172.21.15.135:0/463614918 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff3140a3c40 0x7ff3140a6100 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff32c06aec0 tx=0x7ff32000b390 comp rx=0 tx=0).stop 2024-04-20T12:22:29.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.668+0000 7ff3314f2640 1 -- 172.21.15.135:0/463614918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff32c100e70 msgr2=0x7ff32c06b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:29.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.668+0000 7ff3314f2640 1 --2- 172.21.15.135:0/463614918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff32c100e70 0x7ff32c06b150 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00c970 tx=0x7ff31c00ce30 comp rx=0 tx=0).stop 2024-04-20T12:22:29.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.668+0000 7ff3314f2640 1 -- 172.21.15.135:0/463614918 shutdown_connections 2024-04-20T12:22:29.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.668+0000 7ff3314f2640 1 --2- 172.21.15.135:0/463614918 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff3140a3c40 0x7ff3140a6100 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.668+0000 7ff3314f2640 1 --2- 172.21.15.135:0/463614918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff32c102a10 0x7ff32c19f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.668+0000 7ff3314f2640 1 --2- 172.21.15.135:0/463614918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff32c102050 0x7ff32c19cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.668+0000 7ff3314f2640 1 --2- 172.21.15.135:0/463614918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff32c100e70 0x7ff32c06b150 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.668+0000 7ff3314f2640 1 -- 172.21.15.135:0/463614918 >> 172.21.15.135:0/463614918 conn(0x7ff32c0fc430 msgr2=0x7ff32c1053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:29.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.668+0000 7ff3314f2640 1 -- 172.21.15.135:0/463614918 shutdown_connections 2024-04-20T12:22:29.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.668+0000 7ff3314f2640 1 -- 172.21.15.135:0/463614918 wait complete. 2024-04-20T12:22:29.680 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:22:29.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.778+0000 7fb91d274640 1 -- 172.21.15.135:0/2381556822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918100ea0 msgr2=0x7fb9181012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:29.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.778+0000 7fb91d274640 1 --2- 172.21.15.135:0/2381556822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918100ea0 0x7fb9181012c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb908009ca0 tx=0x7fb90802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.778+0000 7fb91d274640 1 -- 172.21.15.135:0/2381556822 shutdown_connections 2024-04-20T12:22:29.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.778+0000 7fb91d274640 1 --2- 172.21.15.135:0/2381556822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9181029b0 0x7fb9181092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.778+0000 7fb91d274640 1 --2- 172.21.15.135:0/2381556822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb918101ff0 0x7fb918102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.778+0000 7fb91d274640 1 --2- 172.21.15.135:0/2381556822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918100ea0 0x7fb9181012c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.778+0000 7fb91d274640 1 -- 172.21.15.135:0/2381556822 >> 172.21.15.135:0/2381556822 conn(0x7fb9180fc410 msgr2=0x7fb9180fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:29.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.779+0000 7fb91d274640 1 -- 172.21.15.135:0/2381556822 shutdown_connections 2024-04-20T12:22:29.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.779+0000 7fb91d274640 1 -- 172.21.15.135:0/2381556822 wait complete. 2024-04-20T12:22:29.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.779+0000 7fb91d274640 1 Processor -- start 2024-04-20T12:22:29.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.779+0000 7fb91d274640 1 -- start start 2024-04-20T12:22:29.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.779+0000 7fb91d274640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918100ea0 0x7fb918198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:29.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.779+0000 7fb91d274640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb918101ff0 0x7fb918198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:29.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.779+0000 7fb91d274640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9181029b0 0x7fb91819f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:29.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.779+0000 7fb91d274640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb91810cb40 con 0x7fb918100ea0 2024-04-20T12:22:29.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.779+0000 7fb91d274640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb91810c9c0 con 0x7fb918101ff0 2024-04-20T12:22:29.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.779+0000 7fb91d274640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb91810ccc0 con 0x7fb9181029b0 2024-04-20T12:22:29.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb916ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918100ea0 0x7fb918198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:29.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb916ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918100ea0 0x7fb918198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35784/0 (socket says 172.21.15.135:35784) 2024-04-20T12:22:29.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb916ffd640 1 -- 172.21.15.135:0/3176148864 learned_addr learned my addr 172.21.15.135:0/3176148864 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:29.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb9177fe640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9181029b0 0x7fb91819f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:29.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb9167fc640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb918101ff0 0x7fb918198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:29.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb916ffd640 1 -- 172.21.15.135:0/3176148864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9181029b0 msgr2=0x7fb91819f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:29.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb916ffd640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9181029b0 0x7fb91819f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb916ffd640 1 -- 172.21.15.135:0/3176148864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb918101ff0 msgr2=0x7fb918198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:29.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb916ffd640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb918101ff0 0x7fb918198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:29.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb916ffd640 1 -- 172.21.15.135:0/3176148864 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91819ff10 con 0x7fb918100ea0 2024-04-20T12:22:29.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb9177fe640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9181029b0 0x7fb91819f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:29.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb9167fc640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb918101ff0 0x7fb918198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:29.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb916ffd640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918100ea0 0x7fb918198340 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb9080324c0 tx=0x7fb908032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:29.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb8fffff640 1 -- 172.21.15.135:0/3176148864 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908039040 con 0x7fb918100ea0 2024-04-20T12:22:29.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb91d274640 1 -- 172.21.15.135:0/3176148864 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9181a01a0 con 0x7fb918100ea0 2024-04-20T12:22:29.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb8fffff640 1 -- 172.21.15.135:0/3176148864 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb908035c20 con 0x7fb918100ea0 2024-04-20T12:22:29.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb8fffff640 1 -- 172.21.15.135:0/3176148864 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908004310 con 0x7fb918100ea0 2024-04-20T12:22:29.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.780+0000 7fb91d274640 1 -- 172.21.15.135:0/3176148864 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9181a0690 con 0x7fb918100ea0 2024-04-20T12:22:29.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.781+0000 7fb91d274640 1 -- 172.21.15.135:0/3176148864 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9181a09b0 con 0x7fb918100ea0 2024-04-20T12:22:29.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.783+0000 7fb8fffff640 1 -- 172.21.15.135:0/3176148864 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fb908046030 con 0x7fb918100ea0 2024-04-20T12:22:29.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.783+0000 7fb8fffff640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb9000a3c40 0x7fb9000a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:29.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.783+0000 7fb9167fc640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb9000a3c40 0x7fb9000a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:29.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.784+0000 7fb8fffff640 1 -- 172.21.15.135:0/3176148864 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fb9080f2890 con 0x7fb918100ea0 2024-04-20T12:22:29.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.784+0000 7fb9167fc640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb9000a3c40 0x7fb9000a6100 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0058c0 tx=0x7fb90c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:29.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:29.787+0000 7fb8fffff640 1 -- 172.21.15.135:0/3176148864 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fb90804d060 con 0x7fb918100ea0 2024-04-20T12:22:30.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.003+0000 7fb91d274640 1 -- 172.21.15.135:0/3176148864 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9181a0b80 con 0x7fb918100ea0 2024-04-20T12:22:30.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.003+0000 7fb8fffff640 1 -- 172.21.15.135:0/3176148864 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7fb9080bef70 con 0x7fb918100ea0 2024-04-20T12:22:30.003 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:30.003 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:21:09.311388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24490,24476,14634,24457,24475]},"id":1}]} 2024-04-20T12:22:30.004 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 28 2024-04-20T12:22:30.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.005+0000 7fb91d274640 1 -- 172.21.15.135:0/3176148864 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb9000a3c40 msgr2=0x7fb9000a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.005+0000 7fb91d274640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb9000a3c40 0x7fb9000a6100 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0058c0 tx=0x7fb90c005850 comp rx=0 tx=0).stop 2024-04-20T12:22:30.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.005+0000 7fb91d274640 1 -- 172.21.15.135:0/3176148864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918100ea0 msgr2=0x7fb918198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.005+0000 7fb91d274640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918100ea0 0x7fb918198340 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb9080324c0 tx=0x7fb908032f40 comp rx=0 tx=0).stop 2024-04-20T12:22:30.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.005+0000 7fb91d274640 1 -- 172.21.15.135:0/3176148864 shutdown_connections 2024-04-20T12:22:30.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.005+0000 7fb91d274640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fb9000a3c40 0x7fb9000a6100 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.005+0000 7fb91d274640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb9181029b0 0x7fb91819f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.005+0000 7fb91d274640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb918101ff0 0x7fb918198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.005+0000 7fb91d274640 1 --2- 172.21.15.135:0/3176148864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb918100ea0 0x7fb918198340 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.005+0000 7fb91d274640 1 -- 172.21.15.135:0/3176148864 >> 172.21.15.135:0/3176148864 conn(0x7fb9180fc410 msgr2=0x7fb9180fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:30.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.006+0000 7fb91d274640 1 -- 172.21.15.135:0/3176148864 shutdown_connections 2024-04-20T12:22:30.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.006+0000 7fb91d274640 1 -- 172.21.15.135:0/3176148864 wait complete. 2024-04-20T12:22:30.016 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:29 smithi135 ceph-mon[18264]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-04-20T12:22:30.016 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:29 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2163496988' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:22:30.016 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:29 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1778022205' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:22:30.016 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:29 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/463614918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:22:30.017 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:22:30.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.115+0000 7fe1bde06640 1 -- 172.21.15.135:0/4056091499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b8100ea0 msgr2=0x7fe1b81012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.115+0000 7fe1bde06640 1 --2- 172.21.15.135:0/4056091499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b8100ea0 0x7fe1b81012c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009ca0 tx=0x7fe1a802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.115+0000 7fe1bde06640 1 -- 172.21.15.135:0/4056091499 shutdown_connections 2024-04-20T12:22:30.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.115+0000 7fe1bde06640 1 --2- 172.21.15.135:0/4056091499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1b81029b0 0x7fe1b81092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.115+0000 7fe1bde06640 1 --2- 172.21.15.135:0/4056091499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b8101ff0 0x7fe1b8102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.116+0000 7fe1bde06640 1 --2- 172.21.15.135:0/4056091499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b8100ea0 0x7fe1b81012c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.116+0000 7fe1bde06640 1 -- 172.21.15.135:0/4056091499 >> 172.21.15.135:0/4056091499 conn(0x7fe1b80fc410 msgr2=0x7fe1b80fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:30.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.116+0000 7fe1bde06640 1 -- 172.21.15.135:0/4056091499 shutdown_connections 2024-04-20T12:22:30.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.116+0000 7fe1bde06640 1 -- 172.21.15.135:0/4056091499 wait complete. 2024-04-20T12:22:30.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.116+0000 7fe1bde06640 1 Processor -- start 2024-04-20T12:22:30.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.116+0000 7fe1bde06640 1 -- start start 2024-04-20T12:22:30.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.116+0000 7fe1bde06640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1b8100ea0 0x7fe1b8197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:30.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.116+0000 7fe1bde06640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b8101ff0 0x7fe1b8197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:30.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.116+0000 7fe1bde06640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b81029b0 0x7fe1b819e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:30.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.116+0000 7fe1bde06640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b810cb20 con 0x7fe1b81029b0 2024-04-20T12:22:30.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.116+0000 7fe1bde06640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b810c9a0 con 0x7fe1b8100ea0 2024-04-20T12:22:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.116+0000 7fe1bde06640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b810cca0 con 0x7fe1b8101ff0 2024-04-20T12:22:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b81029b0 0x7fe1b819e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1b77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1b8100ea0 0x7fe1b8197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b81029b0 0x7fe1b819e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35804/0 (socket says 172.21.15.135:35804) 2024-04-20T12:22:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1b7fff640 1 -- 172.21.15.135:0/3624124183 learned_addr learned my addr 172.21.15.135:0/3624124183 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1b6ffd640 1 --2- 172.21.15.135:0/3624124183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b8101ff0 0x7fe1b8197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1b7fff640 1 -- 172.21.15.135:0/3624124183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b8101ff0 msgr2=0x7fe1b8197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1b7fff640 1 --2- 172.21.15.135:0/3624124183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b8101ff0 0x7fe1b8197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1b7fff640 1 -- 172.21.15.135:0/3624124183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1b8100ea0 msgr2=0x7fe1b8197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1b7fff640 1 --2- 172.21.15.135:0/3624124183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1b8100ea0 0x7fe1b8197140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1b7fff640 1 -- 172.21.15.135:0/3624124183 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b819ed60 con 0x7fe1b81029b0 2024-04-20T12:22:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1b6ffd640 1 --2- 172.21.15.135:0/3624124183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b8101ff0 0x7fe1b8197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1b7fff640 1 --2- 172.21.15.135:0/3624124183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b81029b0 0x7fe1b819e6f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000d750 tx=0x7fe1b000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1b4ff9640 1 -- 172.21.15.135:0/3624124183 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0017070 con 0x7fe1b81029b0 2024-04-20T12:22:30.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1b4ff9640 1 -- 172.21.15.135:0/3624124183 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1b0005500 con 0x7fe1b81029b0 2024-04-20T12:22:30.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1bde06640 1 -- 172.21.15.135:0/3624124183 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b819eff0 con 0x7fe1b81029b0 2024-04-20T12:22:30.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1b4ff9640 1 -- 172.21.15.135:0/3624124183 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0004d90 con 0x7fe1b81029b0 2024-04-20T12:22:30.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.117+0000 7fe1bde06640 1 -- 172.21.15.135:0/3624124183 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b819f4c0 con 0x7fe1b81029b0 2024-04-20T12:22:30.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.118+0000 7fe1bde06640 1 -- 172.21.15.135:0/3624124183 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1b8108150 con 0x7fe1b81029b0 2024-04-20T12:22:30.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.119+0000 7fe1b4ff9640 1 -- 172.21.15.135:0/3624124183 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fe1b0004f30 con 0x7fe1b81029b0 2024-04-20T12:22:30.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.120+0000 7fe1b4ff9640 1 --2- 172.21.15.135:0/3624124183 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe1a40a3c40 0x7fe1a40a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:30.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.120+0000 7fe1b77fe640 1 --2- 172.21.15.135:0/3624124183 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe1a40a3c40 0x7fe1a40a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:30.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.120+0000 7fe1b4ff9640 1 -- 172.21.15.135:0/3624124183 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fe1b00d02b0 con 0x7fe1b81029b0 2024-04-20T12:22:30.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.120+0000 7fe1b77fe640 1 --2- 172.21.15.135:0/3624124183 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe1a40a3c40 0x7fe1a40a6100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8006010 tx=0x7fe1a8032590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:30.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.125+0000 7fe1b4ff9640 1 -- 172.21.15.135:0/3624124183 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fe1b009c7f0 con 0x7fe1b81029b0 2024-04-20T12:22:30.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:29 smithi154 ceph-mon[22073]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-04-20T12:22:30.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:29 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2163496988' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:22:30.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:29 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1778022205' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:22:30.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:29 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/463614918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:22:30.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.304+0000 7fe1bde06640 1 -- 172.21.15.135:0/3624124183 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1b802d820 con 0x7fe1b81029b0 2024-04-20T12:22:30.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.306+0000 7fe1b4ff9640 1 -- 172.21.15.135:0/3624124183 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24674 (secure 0 0 0) 0x7fe1b009c0f0 con 0x7fe1b81029b0 2024-04-20T12:22:30.306 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:30.306 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":92,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:21:37.896877+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:22:30.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.308+0000 7fe1bde06640 1 -- 172.21.15.135:0/3624124183 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe1a40a3c40 msgr2=0x7fe1a40a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.308+0000 7fe1bde06640 1 --2- 172.21.15.135:0/3624124183 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe1a40a3c40 0x7fe1a40a6100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8006010 tx=0x7fe1a8032590 comp rx=0 tx=0).stop 2024-04-20T12:22:30.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.308+0000 7fe1bde06640 1 -- 172.21.15.135:0/3624124183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b81029b0 msgr2=0x7fe1b819e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.308+0000 7fe1bde06640 1 --2- 172.21.15.135:0/3624124183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b81029b0 0x7fe1b819e6f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000d750 tx=0x7fe1b000dc10 comp rx=0 tx=0).stop 2024-04-20T12:22:30.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.308+0000 7fe1bde06640 1 -- 172.21.15.135:0/3624124183 shutdown_connections 2024-04-20T12:22:30.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.308+0000 7fe1bde06640 1 --2- 172.21.15.135:0/3624124183 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe1a40a3c40 0x7fe1a40a6100 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.308+0000 7fe1bde06640 1 --2- 172.21.15.135:0/3624124183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1b81029b0 0x7fe1b819e6f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.308+0000 7fe1bde06640 1 --2- 172.21.15.135:0/3624124183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1b8101ff0 0x7fe1b8197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.308+0000 7fe1bde06640 1 --2- 172.21.15.135:0/3624124183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1b8100ea0 0x7fe1b8197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.308+0000 7fe1bde06640 1 -- 172.21.15.135:0/3624124183 >> 172.21.15.135:0/3624124183 conn(0x7fe1b80fc410 msgr2=0x7fe1b8105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:30.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.308+0000 7fe1bde06640 1 -- 172.21.15.135:0/3624124183 shutdown_connections 2024-04-20T12:22:30.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.308+0000 7fe1bde06640 1 -- 172.21.15.135:0/3624124183 wait complete. 2024-04-20T12:22:30.319 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T12:16:02.802023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T12:20:39.656129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T12:20:40.312827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T12:20:44.307136+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T12:22:30.320 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T12:22:30.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:29 smithi139 ceph-mon[21834]: pgmap v348: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-04-20T12:22:30.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:29 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2163496988' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:22:30.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:29 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1778022205' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:22:30.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:29 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/463614918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:22:30.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.422+0000 7fe39e922640 1 -- 172.21.15.135:0/3073659781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe398101ff0 msgr2=0x7fe398102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.422+0000 7fe39e922640 1 --2- 172.21.15.135:0/3073659781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe398101ff0 0x7fe398102470 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009900 tx=0x7fe38c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:30.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.422+0000 7fe39e922640 1 -- 172.21.15.135:0/3073659781 shutdown_connections 2024-04-20T12:22:30.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.422+0000 7fe39e922640 1 --2- 172.21.15.135:0/3073659781 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3981029b0 0x7fe3981092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.422+0000 7fe39e922640 1 --2- 172.21.15.135:0/3073659781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe398101ff0 0x7fe398102470 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.422+0000 7fe39e922640 1 --2- 172.21.15.135:0/3073659781 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe398100ea0 0x7fe3981012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.422+0000 7fe39e922640 1 -- 172.21.15.135:0/3073659781 >> 172.21.15.135:0/3073659781 conn(0x7fe3980fc450 msgr2=0x7fe3980fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:30.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.422+0000 7fe39e922640 1 -- 172.21.15.135:0/3073659781 shutdown_connections 2024-04-20T12:22:30.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.422+0000 7fe39e922640 1 -- 172.21.15.135:0/3073659781 wait complete. 2024-04-20T12:22:30.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe39e922640 1 Processor -- start 2024-04-20T12:22:30.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe39e922640 1 -- start start 2024-04-20T12:22:30.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe39e922640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe398100ea0 0x7fe39806b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:30.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe39e922640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe398101ff0 0x7fe39819d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:30.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe39e922640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3981029b0 0x7fe39819f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:30.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe39e922640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe39810cb30 con 0x7fe398101ff0 2024-04-20T12:22:30.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe39e922640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe39810c9b0 con 0x7fe3981029b0 2024-04-20T12:22:30.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe39e922640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe39810ccb0 con 0x7fe398100ea0 2024-04-20T12:22:30.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe3977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe398101ff0 0x7fe39819d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:30.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe3977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe398101ff0 0x7fe39819d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35822/0 (socket says 172.21.15.135:35822) 2024-04-20T12:22:30.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe3977fe640 1 -- 172.21.15.135:0/1731602913 learned_addr learned my addr 172.21.15.135:0/1731602913 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:30.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe397fff640 1 --2- 172.21.15.135:0/1731602913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe398100ea0 0x7fe39806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:30.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe39cebf640 1 --2- 172.21.15.135:0/1731602913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3981029b0 0x7fe39819f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:30.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe3977fe640 1 -- 172.21.15.135:0/1731602913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe398100ea0 msgr2=0x7fe39806b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe3977fe640 1 --2- 172.21.15.135:0/1731602913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe398100ea0 0x7fe39806b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe3977fe640 1 -- 172.21.15.135:0/1731602913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3981029b0 msgr2=0x7fe39819f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe3977fe640 1 --2- 172.21.15.135:0/1731602913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3981029b0 0x7fe39819f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe3977fe640 1 -- 172.21.15.135:0/1731602913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39819ff50 con 0x7fe398101ff0 2024-04-20T12:22:30.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.423+0000 7fe3977fe640 1 --2- 172.21.15.135:0/1731602913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe398101ff0 0x7fe39819d020 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe38c005ab0 tx=0x7fe38c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:30.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.424+0000 7fe3957fa640 1 -- 172.21.15.135:0/1731602913 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c041070 con 0x7fe398101ff0 2024-04-20T12:22:30.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.424+0000 7fe39e922640 1 -- 172.21.15.135:0/1731602913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3981a0180 con 0x7fe398101ff0 2024-04-20T12:22:30.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.424+0000 7fe39e922640 1 -- 172.21.15.135:0/1731602913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3981a06c0 con 0x7fe398101ff0 2024-04-20T12:22:30.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.424+0000 7fe3957fa640 1 -- 172.21.15.135:0/1731602913 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe38c0054e0 con 0x7fe398101ff0 2024-04-20T12:22:30.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.424+0000 7fe3957fa640 1 -- 172.21.15.135:0/1731602913 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c04b060 con 0x7fe398101ff0 2024-04-20T12:22:30.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.425+0000 7fe39e922640 1 -- 172.21.15.135:0/1731602913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3840052c0 con 0x7fe398101ff0 2024-04-20T12:22:30.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.426+0000 7fe3957fa640 1 -- 172.21.15.135:0/1731602913 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fe38c044070 con 0x7fe398101ff0 2024-04-20T12:22:30.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.426+0000 7fe3957fa640 1 --2- 172.21.15.135:0/1731602913 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe3800a3c40 0x7fe3800a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:30.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.426+0000 7fe3957fa640 1 -- 172.21.15.135:0/1731602913 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fe38c0f1fe0 con 0x7fe398101ff0 2024-04-20T12:22:30.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.426+0000 7fe397fff640 1 --2- 172.21.15.135:0/1731602913 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe3800a3c40 0x7fe3800a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:30.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.427+0000 7fe397fff640 1 --2- 172.21.15.135:0/1731602913 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe3800a3c40 0x7fe3800a6100 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe38800bbe0 tx=0x7fe38800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:30.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.431+0000 7fe3957fa640 1 -- 172.21.15.135:0/1731602913 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fe38c0be630 con 0x7fe398101ff0 2024-04-20T12:22:30.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.611+0000 7fe39e922640 1 -- 172.21.15.135:0/1731602913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe384005880 con 0x7fe398101ff0 2024-04-20T12:22:30.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.612+0000 7fe3957fa640 1 -- 172.21.15.135:0/1731602913 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7fe38c0bdf30 con 0x7fe398101ff0 2024-04-20T12:22:30.611 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-04-20T12:22:30.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.614+0000 7fe39e922640 1 -- 172.21.15.135:0/1731602913 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe3800a3c40 msgr2=0x7fe3800a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.614+0000 7fe39e922640 1 --2- 172.21.15.135:0/1731602913 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe3800a3c40 0x7fe3800a6100 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe38800bbe0 tx=0x7fe38800b390 comp rx=0 tx=0).stop 2024-04-20T12:22:30.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.614+0000 7fe39e922640 1 -- 172.21.15.135:0/1731602913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe398101ff0 msgr2=0x7fe39819d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.614+0000 7fe39e922640 1 --2- 172.21.15.135:0/1731602913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe398101ff0 0x7fe39819d020 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe38c005ab0 tx=0x7fe38c005dc0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.614+0000 7fe39e922640 1 -- 172.21.15.135:0/1731602913 shutdown_connections 2024-04-20T12:22:30.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.614+0000 7fe39e922640 1 --2- 172.21.15.135:0/1731602913 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe3800a3c40 0x7fe3800a6100 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.614+0000 7fe39e922640 1 --2- 172.21.15.135:0/1731602913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3981029b0 0x7fe39819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.614+0000 7fe39e922640 1 --2- 172.21.15.135:0/1731602913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe398101ff0 0x7fe39819d020 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.614+0000 7fe39e922640 1 --2- 172.21.15.135:0/1731602913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe398100ea0 0x7fe39806b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.614+0000 7fe39e922640 1 -- 172.21.15.135:0/1731602913 >> 172.21.15.135:0/1731602913 conn(0x7fe3980fc450 msgr2=0x7fe3981053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:30.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.614+0000 7fe39e922640 1 -- 172.21.15.135:0/1731602913 shutdown_connections 2024-04-20T12:22:30.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.614+0000 7fe39e922640 1 -- 172.21.15.135:0/1731602913 wait complete. 2024-04-20T12:22:30.625 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T12:22:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.726+0000 7f1680cba640 1 -- 172.21.15.135:0/1436972592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f167c107d40 msgr2=0x7f167c10a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.726+0000 7f1680cba640 1 --2- 172.21.15.135:0/1436972592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f167c107d40 0x7f167c10a130 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1674009ca0 tx=0x7f167402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.726+0000 7f1680cba640 1 -- 172.21.15.135:0/1436972592 shutdown_connections 2024-04-20T12:22:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.726+0000 7f1680cba640 1 --2- 172.21.15.135:0/1436972592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f167c107d40 0x7f167c10a130 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.726+0000 7f1680cba640 1 --2- 172.21.15.135:0/1436972592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f167c105410 0x7f167c107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.726+0000 7f1680cba640 1 --2- 172.21.15.135:0/1436972592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f167c102ae0 0x7f167c104ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.726+0000 7f1680cba640 1 -- 172.21.15.135:0/1436972592 >> 172.21.15.135:0/1436972592 conn(0x7f167c0fc430 msgr2=0x7f167c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.726+0000 7f1680cba640 1 -- 172.21.15.135:0/1436972592 shutdown_connections 2024-04-20T12:22:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.726+0000 7f1680cba640 1 -- 172.21.15.135:0/1436972592 wait complete. 2024-04-20T12:22:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.726+0000 7f1680cba640 1 Processor -- start 2024-04-20T12:22:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f1680cba640 1 -- start start 2024-04-20T12:22:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f1680cba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f167c102ae0 0x7f167c198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f1680cba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f167c105410 0x7f167c198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f1680cba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f167c107d40 0x7f167c19f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f1680cba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f167c10dcb0 con 0x7f167c102ae0 2024-04-20T12:22:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f1680cba640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f167c10db30 con 0x7f167c105410 2024-04-20T12:22:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f1680cba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f167c10de30 con 0x7f167c107d40 2024-04-20T12:22:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f167a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f167c102ae0 0x7f167c198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f167a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f167c102ae0 0x7f167c198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40956/0 (socket says 172.21.15.135:40956) 2024-04-20T12:22:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f167a59c640 1 -- 172.21.15.135:0/3977958740 learned_addr learned my addr 172.21.15.135:0/3977958740 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f1679d9b640 1 --2- 172.21.15.135:0/3977958740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f167c105410 0x7f167c198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f167ad9d640 1 --2- 172.21.15.135:0/3977958740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f167c107d40 0x7f167c19f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f167a59c640 1 -- 172.21.15.135:0/3977958740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f167c107d40 msgr2=0x7f167c19f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f167a59c640 1 --2- 172.21.15.135:0/3977958740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f167c107d40 0x7f167c19f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f167a59c640 1 -- 172.21.15.135:0/3977958740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f167c105410 msgr2=0x7f167c198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f167a59c640 1 --2- 172.21.15.135:0/3977958740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f167c105410 0x7f167c198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f167a59c640 1 -- 172.21.15.135:0/3977958740 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f167c19ff40 con 0x7f167c102ae0 2024-04-20T12:22:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f167a59c640 1 --2- 172.21.15.135:0/3977958740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f167c102ae0 0x7f167c198320 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f166c00b4a0 tx=0x7f166c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f166b7fe640 1 -- 172.21.15.135:0/3977958740 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c014070 con 0x7f167c102ae0 2024-04-20T12:22:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f1680cba640 1 -- 172.21.15.135:0/3977958740 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f167c1a0230 con 0x7f167c102ae0 2024-04-20T12:22:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f166b7fe640 1 -- 172.21.15.135:0/3977958740 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f166c010af0 con 0x7f167c102ae0 2024-04-20T12:22:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f166b7fe640 1 -- 172.21.15.135:0/3977958740 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166c017d10 con 0x7f167c102ae0 2024-04-20T12:22:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.727+0000 7f1680cba640 1 -- 172.21.15.135:0/3977958740 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f167c1a0780 con 0x7f167c102ae0 2024-04-20T12:22:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.728+0000 7f1680cba640 1 -- 172.21.15.135:0/3977958740 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f167c0fdf20 con 0x7f167c102ae0 2024-04-20T12:22:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.729+0000 7f166b7fe640 1 -- 172.21.15.135:0/3977958740 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f166c017070 con 0x7f167c102ae0 2024-04-20T12:22:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.730+0000 7f166b7fe640 1 --2- 172.21.15.135:0/3977958740 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f16640a3c40 0x7f16640a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.730+0000 7f1679d9b640 1 --2- 172.21.15.135:0/3977958740 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f16640a3c40 0x7f16640a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.730+0000 7f166b7fe640 1 -- 172.21.15.135:0/3977958740 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f166c0cfbf0 con 0x7f167c102ae0 2024-04-20T12:22:30.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.730+0000 7f1679d9b640 1 --2- 172.21.15.135:0/3977958740 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f16640a3c40 0x7f16640a6100 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f167c199830 tx=0x7f167000a4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.734+0000 7f166b7fe640 1 -- 172.21.15.135:0/3977958740 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f166c09c240 con 0x7f167c102ae0 2024-04-20T12:22:30.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.910+0000 7f1680cba640 1 -- 172.21.15.135:0/3977958740 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f167c062b60 con 0x7f167c102ae0 2024-04-20T12:22:30.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.911+0000 7f166b7fe640 1 -- 172.21.15.135:0/3977958740 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) ==== 104+0+11 (secure 0 0 0) 0x7f166c09bb40 con 0x7f167c102ae0 2024-04-20T12:22:30.911 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:22:30.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.913+0000 7f1680cba640 1 -- 172.21.15.135:0/3977958740 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f16640a3c40 msgr2=0x7f16640a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.913+0000 7f1680cba640 1 --2- 172.21.15.135:0/3977958740 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f16640a3c40 0x7f16640a6100 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f167c199830 tx=0x7f167000a4c0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.913+0000 7f1680cba640 1 -- 172.21.15.135:0/3977958740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f167c102ae0 msgr2=0x7f167c198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:30.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.913+0000 7f1680cba640 1 --2- 172.21.15.135:0/3977958740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f167c102ae0 0x7f167c198320 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f166c00b4a0 tx=0x7f166c00b960 comp rx=0 tx=0).stop 2024-04-20T12:22:30.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.913+0000 7f1680cba640 1 -- 172.21.15.135:0/3977958740 shutdown_connections 2024-04-20T12:22:30.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.913+0000 7f1680cba640 1 --2- 172.21.15.135:0/3977958740 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f16640a3c40 0x7f16640a6100 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.913+0000 7f1680cba640 1 --2- 172.21.15.135:0/3977958740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f167c107d40 0x7f167c19f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.913+0000 7f1680cba640 1 --2- 172.21.15.135:0/3977958740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f167c105410 0x7f167c198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.913+0000 7f1680cba640 1 --2- 172.21.15.135:0/3977958740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f167c102ae0 0x7f167c198320 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:30.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.913+0000 7f1680cba640 1 -- 172.21.15.135:0/3977958740 >> 172.21.15.135:0/3977958740 conn(0x7f167c0fc430 msgr2=0x7f167c1033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:30.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.913+0000 7f1680cba640 1 -- 172.21.15.135:0/3977958740 shutdown_connections 2024-04-20T12:22:30.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:30.913+0000 7f1680cba640 1 -- 172.21.15.135:0/3977958740 wait complete. 2024-04-20T12:22:30.924 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T12:22:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.026+0000 7faef62d2640 1 -- 172.21.15.135:0/2116819401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faef01031a0 msgr2=0x7faef0103620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.026+0000 7faef62d2640 1 --2- 172.21.15.135:0/2116819401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faef01031a0 0x7faef0103620 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7faee4009900 tx=0x7faee402bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:31.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.026+0000 7faef62d2640 1 -- 172.21.15.135:0/2116819401 shutdown_connections 2024-04-20T12:22:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.026+0000 7faef62d2640 1 --2- 172.21.15.135:0/2116819401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faef0103b60 0x7faef010a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.026+0000 7faef62d2640 1 --2- 172.21.15.135:0/2116819401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faef01031a0 0x7faef0103620 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.026+0000 7faef62d2640 1 --2- 172.21.15.135:0/2116819401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef0101fb0 0x7faef01023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.026+0000 7faef62d2640 1 -- 172.21.15.135:0/2116819401 >> 172.21.15.135:0/2116819401 conn(0x7faef00fd540 msgr2=0x7faef00ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.026+0000 7faef62d2640 1 -- 172.21.15.135:0/2116819401 shutdown_connections 2024-04-20T12:22:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.026+0000 7faef62d2640 1 -- 172.21.15.135:0/2116819401 wait complete. 2024-04-20T12:22:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.026+0000 7faef62d2640 1 Processor -- start 2024-04-20T12:22:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faef62d2640 1 -- start start 2024-04-20T12:22:31.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faef62d2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faef0101fb0 0x7faef0198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faef62d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faef01031a0 0x7faef0198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faef62d2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef0103b60 0x7faef019f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faef62d2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faef010dc90 con 0x7faef0101fb0 2024-04-20T12:22:31.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faef62d2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faef010db10 con 0x7faef0103b60 2024-04-20T12:22:31.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faef62d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faef010de10 con 0x7faef01031a0 2024-04-20T12:22:31.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faeeffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faef0101fb0 0x7faef0198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:31.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faeeffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faef0101fb0 0x7faef0198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40970/0 (socket says 172.21.15.135:40970) 2024-04-20T12:22:31.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faeeffff640 1 -- 172.21.15.135:0/2549540709 learned_addr learned my addr 172.21.15.135:0/2549540709 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:31.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faef486f640 1 --2- 172.21.15.135:0/2549540709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef0103b60 0x7faef019f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:31.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faeeffff640 1 -- 172.21.15.135:0/2549540709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faef01031a0 msgr2=0x7faef0198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faeeffff640 1 --2- 172.21.15.135:0/2549540709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faef01031a0 0x7faef0198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faeeffff640 1 -- 172.21.15.135:0/2549540709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef0103b60 msgr2=0x7faef019f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faeeffff640 1 --2- 172.21.15.135:0/2549540709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef0103b60 0x7faef019f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faeeffff640 1 -- 172.21.15.135:0/2549540709 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef019ff30 con 0x7faef0101fb0 2024-04-20T12:22:31.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faef486f640 1 --2- 172.21.15.135:0/2549540709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef0103b60 0x7faef019f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:31.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faeeffff640 1 --2- 172.21.15.135:0/2549540709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faef0101fb0 0x7faef0198310 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7faee000d950 tx=0x7faee000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:31.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.027+0000 7faeed7fa640 1 -- 172.21.15.135:0/2549540709 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee0017020 con 0x7faef0101fb0 2024-04-20T12:22:31.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.028+0000 7faeed7fa640 1 -- 172.21.15.135:0/2549540709 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faee0009c30 con 0x7faef0101fb0 2024-04-20T12:22:31.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.028+0000 7faef62d2640 1 -- 172.21.15.135:0/2549540709 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef01a0220 con 0x7faef0101fb0 2024-04-20T12:22:31.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.028+0000 7faeed7fa640 1 -- 172.21.15.135:0/2549540709 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee000f720 con 0x7faef0101fb0 2024-04-20T12:22:31.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.028+0000 7faef62d2640 1 -- 172.21.15.135:0/2549540709 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef01a0770 con 0x7faef0101fb0 2024-04-20T12:22:31.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.029+0000 7faef62d2640 1 -- 172.21.15.135:0/2549540709 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faef01092d0 con 0x7faef0101fb0 2024-04-20T12:22:31.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.030+0000 7faeed7fa640 1 -- 172.21.15.135:0/2549540709 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7faee001a020 con 0x7faef0101fb0 2024-04-20T12:22:31.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.031+0000 7faeed7fa640 1 --2- 172.21.15.135:0/2549540709 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faed80a3c40 0x7faed80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.031+0000 7faeef7fe640 1 --2- 172.21.15.135:0/2549540709 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faed80a3c40 0x7faed80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:31.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.031+0000 7faeed7fa640 1 -- 172.21.15.135:0/2549540709 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7faee00d0d10 con 0x7faef0101fb0 2024-04-20T12:22:31.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.031+0000 7faeef7fe640 1 --2- 172.21.15.135:0/2549540709 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faed80a3c40 0x7faed80a6100 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faee4036040 tx=0x7faee4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:31.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.034+0000 7faeed7fa640 1 -- 172.21.15.135:0/2549540709 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7faee0021020 con 0x7faef0101fb0 2024-04-20T12:22:31.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.210+0000 7faef62d2640 1 -- 172.21.15.135:0/2549540709 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faef002d860 con 0x7faef0101fb0 2024-04-20T12:22:31.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.211+0000 7faeed7fa640 1 -- 172.21.15.135:0/2549540709 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) ==== 100+0+11 (secure 0 0 0) 0x7faee0009de0 con 0x7faef0101fb0 2024-04-20T12:22:31.211 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-04-20T12:22:31.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.212+0000 7faef62d2640 1 -- 172.21.15.135:0/2549540709 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faed80a3c40 msgr2=0x7faed80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.212+0000 7faef62d2640 1 --2- 172.21.15.135:0/2549540709 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faed80a3c40 0x7faed80a6100 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faee4036040 tx=0x7faee4000bc0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.212+0000 7faef62d2640 1 -- 172.21.15.135:0/2549540709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faef0101fb0 msgr2=0x7faef0198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.212+0000 7faef62d2640 1 --2- 172.21.15.135:0/2549540709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faef0101fb0 0x7faef0198310 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7faee000d950 tx=0x7faee000de10 comp rx=0 tx=0).stop 2024-04-20T12:22:31.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.213+0000 7faef62d2640 1 -- 172.21.15.135:0/2549540709 shutdown_connections 2024-04-20T12:22:31.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.213+0000 7faef62d2640 1 --2- 172.21.15.135:0/2549540709 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7faed80a3c40 0x7faed80a6100 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.213+0000 7faef62d2640 1 --2- 172.21.15.135:0/2549540709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faef0103b60 0x7faef019f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.213+0000 7faef62d2640 1 --2- 172.21.15.135:0/2549540709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faef01031a0 0x7faef0198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.213+0000 7faef62d2640 1 --2- 172.21.15.135:0/2549540709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faef0101fb0 0x7faef0198310 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.213+0000 7faef62d2640 1 -- 172.21.15.135:0/2549540709 >> 172.21.15.135:0/2549540709 conn(0x7faef00fd540 msgr2=0x7faef01064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:31.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.213+0000 7faef62d2640 1 -- 172.21.15.135:0/2549540709 shutdown_connections 2024-04-20T12:22:31.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.213+0000 7faef62d2640 1 -- 172.21.15.135:0/2549540709 wait complete. 2024-04-20T12:22:31.223 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:30 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3176148864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:22:31.223 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:30 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3624124183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:31.223 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:30 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1731602913' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:22:31.224 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T12:22:31.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:30 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3176148864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:22:31.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:30 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3624124183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:31.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:30 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1731602913' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:22:31.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:30 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3176148864' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:22:31.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:30 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3624124183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:31.331 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:30 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1731602913' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:22:31.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.326+0000 7f12c2dd5640 1 -- 172.21.15.135:0/694545737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12bc1029b0 msgr2=0x7f12bc1092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.326+0000 7f12c2dd5640 1 --2- 172.21.15.135:0/694545737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12bc1029b0 0x7f12bc1092d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009ca0 tx=0x7f12b402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.326+0000 7f12c2dd5640 1 -- 172.21.15.135:0/694545737 shutdown_connections 2024-04-20T12:22:31.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.326+0000 7f12c2dd5640 1 --2- 172.21.15.135:0/694545737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12bc1029b0 0x7f12bc1092d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.326+0000 7f12c2dd5640 1 --2- 172.21.15.135:0/694545737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12bc101ff0 0x7f12bc102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.326+0000 7f12c2dd5640 1 --2- 172.21.15.135:0/694545737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12bc100ea0 0x7f12bc1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.326+0000 7f12c2dd5640 1 -- 172.21.15.135:0/694545737 >> 172.21.15.135:0/694545737 conn(0x7f12bc0fc450 msgr2=0x7f12bc0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:31.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.326+0000 7f12c2dd5640 1 -- 172.21.15.135:0/694545737 shutdown_connections 2024-04-20T12:22:31.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.326+0000 7f12c2dd5640 1 -- 172.21.15.135:0/694545737 wait complete. 2024-04-20T12:22:31.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.326+0000 7f12c2dd5640 1 Processor -- start 2024-04-20T12:22:31.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.326+0000 7f12c2dd5640 1 -- start start 2024-04-20T12:22:31.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12c2dd5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12bc100ea0 0x7f12bc06b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12c2dd5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12bc101ff0 0x7f12bc19cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12c2dd5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12bc1029b0 0x7f12bc19f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12c2dd5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc10cba0 con 0x7f12bc101ff0 2024-04-20T12:22:31.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12c2dd5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc10ca20 con 0x7f12bc100ea0 2024-04-20T12:22:31.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12c2dd5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc10cd20 con 0x7f12bc1029b0 2024-04-20T12:22:31.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12bbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12bc101ff0 0x7f12bc19cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:31.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12bbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12bc101ff0 0x7f12bc19cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40982/0 (socket says 172.21.15.135:40982) 2024-04-20T12:22:31.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12bbfff640 1 -- 172.21.15.135:0/2916937174 learned_addr learned my addr 172.21.15.135:0/2916937174 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:31.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12c0b71640 1 --2- 172.21.15.135:0/2916937174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12bc100ea0 0x7f12bc06b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:31.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12c1372640 1 --2- 172.21.15.135:0/2916937174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12bc1029b0 0x7f12bc19f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:31.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12bbfff640 1 -- 172.21.15.135:0/2916937174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12bc1029b0 msgr2=0x7f12bc19f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12bbfff640 1 --2- 172.21.15.135:0/2916937174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12bc1029b0 0x7f12bc19f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12bbfff640 1 -- 172.21.15.135:0/2916937174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12bc100ea0 msgr2=0x7f12bc06b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12bbfff640 1 --2- 172.21.15.135:0/2916937174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12bc100ea0 0x7f12bc06b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12bbfff640 1 -- 172.21.15.135:0/2916937174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12bc19fe90 con 0x7f12bc101ff0 2024-04-20T12:22:31.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12bbfff640 1 --2- 172.21.15.135:0/2916937174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12bc101ff0 0x7f12bc19cf90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f12a800c970 tx=0x7f12a800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:31.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12b9ffb640 1 -- 172.21.15.135:0/2916937174 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8007b50 con 0x7f12bc101ff0 2024-04-20T12:22:31.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12c2dd5640 1 -- 172.21.15.135:0/2916937174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12bc1a0180 con 0x7f12bc101ff0 2024-04-20T12:22:31.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12b9ffb640 1 -- 172.21.15.135:0/2916937174 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12a8007cf0 con 0x7f12bc101ff0 2024-04-20T12:22:31.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.327+0000 7f12b9ffb640 1 -- 172.21.15.135:0/2916937174 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a800f7d0 con 0x7f12bc101ff0 2024-04-20T12:22:31.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.328+0000 7f12c2dd5640 1 -- 172.21.15.135:0/2916937174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12bc1a06d0 con 0x7f12bc101ff0 2024-04-20T12:22:31.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.329+0000 7f12c2dd5640 1 -- 172.21.15.135:0/2916937174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12bc108150 con 0x7f12bc101ff0 2024-04-20T12:22:31.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.330+0000 7f12b9ffb640 1 -- 172.21.15.135:0/2916937174 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f12a8018480 con 0x7f12bc101ff0 2024-04-20T12:22:31.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.330+0000 7f12b9ffb640 1 --2- 172.21.15.135:0/2916937174 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f12ac0a3c40 0x7f12ac0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.330+0000 7f12c0b71640 1 --2- 172.21.15.135:0/2916937174 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f12ac0a3c40 0x7f12ac0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:31.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.330+0000 7f12b9ffb640 1 -- 172.21.15.135:0/2916937174 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f12a80d0e90 con 0x7f12bc101ff0 2024-04-20T12:22:31.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.331+0000 7f12c0b71640 1 --2- 172.21.15.135:0/2916937174 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f12ac0a3c40 0x7f12ac0a6100 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009990 tx=0x7f12b0009110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:31.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.334+0000 7f12b9ffb640 1 -- 172.21.15.135:0/2916937174 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f12a809d4f0 con 0x7f12bc101ff0 2024-04-20T12:22:31.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.512+0000 7f12c2dd5640 1 -- 172.21.15.135:0/2916937174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f12bc02d820 con 0x7f12bc101ff0 2024-04-20T12:22:31.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.513+0000 7f12b9ffb640 1 -- 172.21.15.135:0/2916937174 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) ==== 103+0+11 (secure 0 0 0) 0x7f12a809cdf0 con 0x7f12bc101ff0 2024-04-20T12:22:31.513 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:22:31.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.515+0000 7f12c2dd5640 1 -- 172.21.15.135:0/2916937174 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f12ac0a3c40 msgr2=0x7f12ac0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.515+0000 7f12c2dd5640 1 --2- 172.21.15.135:0/2916937174 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f12ac0a3c40 0x7f12ac0a6100 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f12b0009990 tx=0x7f12b0009110 comp rx=0 tx=0).stop 2024-04-20T12:22:31.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.515+0000 7f12c2dd5640 1 -- 172.21.15.135:0/2916937174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12bc101ff0 msgr2=0x7f12bc19cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.515+0000 7f12c2dd5640 1 --2- 172.21.15.135:0/2916937174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12bc101ff0 0x7f12bc19cf90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f12a800c970 tx=0x7f12a800cd70 comp rx=0 tx=0).stop 2024-04-20T12:22:31.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.515+0000 7f12c2dd5640 1 -- 172.21.15.135:0/2916937174 shutdown_connections 2024-04-20T12:22:31.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.515+0000 7f12c2dd5640 1 --2- 172.21.15.135:0/2916937174 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f12ac0a3c40 0x7f12ac0a6100 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.515+0000 7f12c2dd5640 1 --2- 172.21.15.135:0/2916937174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12bc1029b0 0x7f12bc19f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.515+0000 7f12c2dd5640 1 --2- 172.21.15.135:0/2916937174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12bc101ff0 0x7f12bc19cf90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.515+0000 7f12c2dd5640 1 --2- 172.21.15.135:0/2916937174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12bc100ea0 0x7f12bc06b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.515+0000 7f12c2dd5640 1 -- 172.21.15.135:0/2916937174 >> 172.21.15.135:0/2916937174 conn(0x7f12bc0fc450 msgr2=0x7f12bc105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:31.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.515+0000 7f12c2dd5640 1 -- 172.21.15.135:0/2916937174 shutdown_connections 2024-04-20T12:22:31.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.515+0000 7f12c2dd5640 1 -- 172.21.15.135:0/2916937174 wait complete. 2024-04-20T12:22:31.527 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:22:31.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.625+0000 7f65c1998640 1 -- 172.21.15.135:0/1931645089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc102a30 msgr2=0x7f65bc109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.625+0000 7f65c1998640 1 --2- 172.21.15.135:0/1931645089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc102a30 0x7f65bc109350 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009900 tx=0x7f65ac02bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:31.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.625+0000 7f65c1998640 1 -- 172.21.15.135:0/1931645089 shutdown_connections 2024-04-20T12:22:31.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.625+0000 7f65c1998640 1 --2- 172.21.15.135:0/1931645089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc102a30 0x7f65bc109350 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.625+0000 7f65c1998640 1 --2- 172.21.15.135:0/1931645089 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65bc102070 0x7f65bc1024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.625+0000 7f65c1998640 1 --2- 172.21.15.135:0/1931645089 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65bc100f20 0x7f65bc101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.625+0000 7f65c1998640 1 -- 172.21.15.135:0/1931645089 >> 172.21.15.135:0/1931645089 conn(0x7f65bc0fc4b0 msgr2=0x7f65bc0fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:31.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.625+0000 7f65c1998640 1 -- 172.21.15.135:0/1931645089 shutdown_connections 2024-04-20T12:22:31.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.625+0000 7f65c1998640 1 -- 172.21.15.135:0/1931645089 wait complete. 2024-04-20T12:22:31.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.625+0000 7f65c1998640 1 Processor -- start 2024-04-20T12:22:31.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.625+0000 7f65c1998640 1 -- start start 2024-04-20T12:22:31.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65c1998640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65bc100f20 0x7f65bc1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65c1998640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65bc102070 0x7f65bc1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65c1998640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc102a30 0x7f65bc19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65c1998640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc10cb60 con 0x7f65bc102a30 2024-04-20T12:22:31.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65c1998640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc10c9e0 con 0x7f65bc102070 2024-04-20T12:22:31.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65c1998640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc10cce0 con 0x7f65bc100f20 2024-04-20T12:22:31.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65bb7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc102a30 0x7f65bc19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:31.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65bb7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc102a30 0x7f65bc19f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41008/0 (socket says 172.21.15.135:41008) 2024-04-20T12:22:31.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65bb7fe640 1 -- 172.21.15.135:0/1231544658 learned_addr learned my addr 172.21.15.135:0/1231544658 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:31.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65baffd640 1 --2- 172.21.15.135:0/1231544658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65bc100f20 0x7f65bc1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:31.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65ba7fc640 1 --2- 172.21.15.135:0/1231544658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65bc102070 0x7f65bc1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:31.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65bb7fe640 1 -- 172.21.15.135:0/1231544658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65bc100f20 msgr2=0x7f65bc1982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65bb7fe640 1 --2- 172.21.15.135:0/1231544658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65bc100f20 0x7f65bc1982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65bb7fe640 1 -- 172.21.15.135:0/1231544658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65bc102070 msgr2=0x7f65bc1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65bb7fe640 1 --2- 172.21.15.135:0/1231544658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65bc102070 0x7f65bc1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65bb7fe640 1 -- 172.21.15.135:0/1231544658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65bc19fec0 con 0x7f65bc102a30 2024-04-20T12:22:31.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65bb7fe640 1 --2- 172.21.15.135:0/1231544658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc102a30 0x7f65bc19f850 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f65ac02ce70 tx=0x7f65ac005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:31.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65c0996640 1 -- 172.21.15.135:0/1231544658 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac041070 con 0x7f65bc102a30 2024-04-20T12:22:31.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65c0996640 1 -- 172.21.15.135:0/1231544658 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65ac0054e0 con 0x7f65bc102a30 2024-04-20T12:22:31.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65c1998640 1 -- 172.21.15.135:0/1231544658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65bc1a0150 con 0x7f65bc102a30 2024-04-20T12:22:31.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65c0996640 1 -- 172.21.15.135:0/1231544658 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0344a0 con 0x7f65bc102a30 2024-04-20T12:22:31.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.626+0000 7f65c1998640 1 -- 172.21.15.135:0/1231544658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65bc1a0690 con 0x7f65bc102a30 2024-04-20T12:22:31.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.627+0000 7f65c1998640 1 -- 172.21.15.135:0/1231544658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65bc1a09b0 con 0x7f65bc102a30 2024-04-20T12:22:31.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.629+0000 7f65c0996640 1 -- 172.21.15.135:0/1231544658 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f65ac044070 con 0x7f65bc102a30 2024-04-20T12:22:31.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.629+0000 7f65c0996640 1 --2- 172.21.15.135:0/1231544658 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f65a40a3cc0 0x7f65a40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.629+0000 7f65baffd640 1 --2- 172.21.15.135:0/1231544658 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f65a40a3cc0 0x7f65a40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:31.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.630+0000 7f65c0996640 1 -- 172.21.15.135:0/1231544658 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f65ac0f28d0 con 0x7f65bc102a30 2024-04-20T12:22:31.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.630+0000 7f65baffd640 1 --2- 172.21.15.135:0/1231544658 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f65a40a3cc0 0x7f65a40a6180 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f65b4005fd0 tx=0x7f65b4009870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:31.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.633+0000 7f65c0996640 1 -- 172.21.15.135:0/1231544658 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f65ac0bef00 con 0x7f65bc102a30 2024-04-20T12:22:31.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.847+0000 7f65c1998640 1 -- 172.21.15.135:0/1231544658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65bc1a0b80 con 0x7f65bc102a30 2024-04-20T12:22:31.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.848+0000 7f65c0996640 1 -- 172.21.15.135:0/1231544658 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f65ac0be800 con 0x7f65bc102a30 2024-04-20T12:22:31.848 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:31.848 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:21:09.311388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24490,24476,14634,24457,24475]},"id":1}]} 2024-04-20T12:22:31.848 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 28 2024-04-20T12:22:31.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.850+0000 7f65c1998640 1 -- 172.21.15.135:0/1231544658 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f65a40a3cc0 msgr2=0x7f65a40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.850+0000 7f65c1998640 1 --2- 172.21.15.135:0/1231544658 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f65a40a3cc0 0x7f65a40a6180 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f65b4005fd0 tx=0x7f65b4009870 comp rx=0 tx=0).stop 2024-04-20T12:22:31.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.850+0000 7f65c1998640 1 -- 172.21.15.135:0/1231544658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc102a30 msgr2=0x7f65bc19f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.850+0000 7f65c1998640 1 --2- 172.21.15.135:0/1231544658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc102a30 0x7f65bc19f850 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f65ac02ce70 tx=0x7f65ac005e40 comp rx=0 tx=0).stop 2024-04-20T12:22:31.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.850+0000 7f65c1998640 1 -- 172.21.15.135:0/1231544658 shutdown_connections 2024-04-20T12:22:31.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.850+0000 7f65c1998640 1 --2- 172.21.15.135:0/1231544658 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f65a40a3cc0 0x7f65a40a6180 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.850+0000 7f65c1998640 1 --2- 172.21.15.135:0/1231544658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65bc102a30 0x7f65bc19f850 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.850+0000 7f65c1998640 1 --2- 172.21.15.135:0/1231544658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65bc102070 0x7f65bc1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.850+0000 7f65c1998640 1 --2- 172.21.15.135:0/1231544658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f65bc100f20 0x7f65bc1982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.850+0000 7f65c1998640 1 -- 172.21.15.135:0/1231544658 >> 172.21.15.135:0/1231544658 conn(0x7f65bc0fc4b0 msgr2=0x7f65bc0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:31.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.850+0000 7f65c1998640 1 -- 172.21.15.135:0/1231544658 shutdown_connections 2024-04-20T12:22:31.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.850+0000 7f65c1998640 1 -- 172.21.15.135:0/1231544658 wait complete. 2024-04-20T12:22:31.861 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:22:31.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.960+0000 7f030c0a8640 1 -- 172.21.15.135:0/585317241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0304101ff0 msgr2=0x7f0304102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.960+0000 7f030c0a8640 1 --2- 172.21.15.135:0/585317241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0304101ff0 0x7f0304102470 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009900 tx=0x7f02f402bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.960+0000 7f030c0a8640 1 -- 172.21.15.135:0/585317241 shutdown_connections 2024-04-20T12:22:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.960+0000 7f030c0a8640 1 --2- 172.21.15.135:0/585317241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03041029b0 0x7f03041092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.960+0000 7f030c0a8640 1 --2- 172.21.15.135:0/585317241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0304101ff0 0x7f0304102470 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.960+0000 7f030c0a8640 1 --2- 172.21.15.135:0/585317241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0304100ea0 0x7f03041012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.960+0000 7f030c0a8640 1 -- 172.21.15.135:0/585317241 >> 172.21.15.135:0/585317241 conn(0x7f03040fc410 msgr2=0x7f03040fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.960+0000 7f030c0a8640 1 -- 172.21.15.135:0/585317241 shutdown_connections 2024-04-20T12:22:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.960+0000 7f030c0a8640 1 -- 172.21.15.135:0/585317241 wait complete. 2024-04-20T12:22:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f030c0a8640 1 Processor -- start 2024-04-20T12:22:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f030c0a8640 1 -- start start 2024-04-20T12:22:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f030c0a8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0304100ea0 0x7f0304069c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f030c0a8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0304101ff0 0x7f030419cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f030c0a8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03041029b0 0x7f030419f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f030c0a8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f030410cb30 con 0x7f0304100ea0 2024-04-20T12:22:31.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f030c0a8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f030410c9b0 con 0x7f03041029b0 2024-04-20T12:22:31.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f030c0a8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f030410ccb0 con 0x7f0304101ff0 2024-04-20T12:22:31.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f0309e44640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0304100ea0 0x7f0304069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:31.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f0309e44640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0304100ea0 0x7f0304069c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41020/0 (socket says 172.21.15.135:41020) 2024-04-20T12:22:31.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f0309e44640 1 -- 172.21.15.135:0/1967223212 learned_addr learned my addr 172.21.15.135:0/1967223212 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:31.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f030a645640 1 --2- 172.21.15.135:0/1967223212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03041029b0 0x7f030419f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:31.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f0309643640 1 --2- 172.21.15.135:0/1967223212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0304101ff0 0x7f030419cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:31.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f0309e44640 1 -- 172.21.15.135:0/1967223212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0304101ff0 msgr2=0x7f030419cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f0309e44640 1 --2- 172.21.15.135:0/1967223212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0304101ff0 0x7f030419cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f0309e44640 1 -- 172.21.15.135:0/1967223212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03041029b0 msgr2=0x7f030419f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:31.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.961+0000 7f0309e44640 1 --2- 172.21.15.135:0/1967223212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03041029b0 0x7f030419f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:31.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.962+0000 7f0309e44640 1 -- 172.21.15.135:0/1967223212 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030419fec0 con 0x7f0304100ea0 2024-04-20T12:22:31.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.962+0000 7f0309643640 1 --2- 172.21.15.135:0/1967223212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0304101ff0 0x7f030419cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:31.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.962+0000 7f0309e44640 1 --2- 172.21.15.135:0/1967223212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0304100ea0 0x7f0304069c60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00cce0 tx=0x7f02fc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:31.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.962+0000 7f02faffd640 1 -- 172.21.15.135:0/1967223212 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc00f650 con 0x7f0304100ea0 2024-04-20T12:22:31.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.962+0000 7f030c0a8640 1 -- 172.21.15.135:0/1967223212 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03041a0150 con 0x7f0304100ea0 2024-04-20T12:22:31.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.962+0000 7f02faffd640 1 -- 172.21.15.135:0/1967223212 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02fc00fcd0 con 0x7f0304100ea0 2024-04-20T12:22:31.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.962+0000 7f02faffd640 1 -- 172.21.15.135:0/1967223212 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc018c70 con 0x7f0304100ea0 2024-04-20T12:22:31.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.962+0000 7f030c0a8640 1 -- 172.21.15.135:0/1967223212 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03041a06a0 con 0x7f0304100ea0 2024-04-20T12:22:31.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.963+0000 7f030c0a8640 1 -- 172.21.15.135:0/1967223212 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0304108150 con 0x7f0304100ea0 2024-04-20T12:22:31.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.964+0000 7f02faffd640 1 -- 172.21.15.135:0/1967223212 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f02fc00f7f0 con 0x7f0304100ea0 2024-04-20T12:22:31.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.965+0000 7f02faffd640 1 --2- 172.21.15.135:0/1967223212 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02f00a3c40 0x7f02f00a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:31.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.965+0000 7f0309643640 1 --2- 172.21.15.135:0/1967223212 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02f00a3c40 0x7f02f00a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:31.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.965+0000 7f02faffd640 1 -- 172.21.15.135:0/1967223212 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f02fc0d0e30 con 0x7f0304100ea0 2024-04-20T12:22:31.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.965+0000 7f0309643640 1 --2- 172.21.15.135:0/1967223212 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02f00a3c40 0x7f02f00a6100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f02f4006010 tx=0x7f02f4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:31.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:31.969+0000 7f02faffd640 1 -- 172.21.15.135:0/1967223212 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f02fc014030 con 0x7f0304100ea0 2024-04-20T12:22:32.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:31 smithi135 ceph-mon[18264]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-04-20T12:22:32.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:31 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3977958740' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:22:32.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:31 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2549540709' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:22:32.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:31 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2916937174' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:22:32.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:31 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1231544658' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:22:32.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.148+0000 7f030c0a8640 1 -- 172.21.15.135:0/1967223212 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f030402d840 con 0x7f0304100ea0 2024-04-20T12:22:32.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.149+0000 7f02faffd640 1 -- 172.21.15.135:0/1967223212 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24674 (secure 0 0 0) 0x7f02fc09d370 con 0x7f0304100ea0 2024-04-20T12:22:32.150 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:32.150 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":92,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:21:37.896877+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:22:32.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.152+0000 7f030c0a8640 1 -- 172.21.15.135:0/1967223212 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02f00a3c40 msgr2=0x7f02f00a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.152+0000 7f030c0a8640 1 --2- 172.21.15.135:0/1967223212 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02f00a3c40 0x7f02f00a6100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f02f4006010 tx=0x7f02f4000bc0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.152+0000 7f030c0a8640 1 -- 172.21.15.135:0/1967223212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0304100ea0 msgr2=0x7f0304069c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.152+0000 7f030c0a8640 1 --2- 172.21.15.135:0/1967223212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0304100ea0 0x7f0304069c60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00cce0 tx=0x7f02fc00a620 comp rx=0 tx=0).stop 2024-04-20T12:22:32.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.152+0000 7f030c0a8640 1 -- 172.21.15.135:0/1967223212 shutdown_connections 2024-04-20T12:22:32.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.152+0000 7f030c0a8640 1 --2- 172.21.15.135:0/1967223212 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f02f00a3c40 0x7f02f00a6100 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.152+0000 7f030c0a8640 1 --2- 172.21.15.135:0/1967223212 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03041029b0 0x7f030419f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.152+0000 7f030c0a8640 1 --2- 172.21.15.135:0/1967223212 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0304101ff0 0x7f030419cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.152+0000 7f030c0a8640 1 --2- 172.21.15.135:0/1967223212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0304100ea0 0x7f0304069c60 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.152+0000 7f030c0a8640 1 -- 172.21.15.135:0/1967223212 >> 172.21.15.135:0/1967223212 conn(0x7f03040fc410 msgr2=0x7f0304105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.152+0000 7f030c0a8640 1 -- 172.21.15.135:0/1967223212 shutdown_connections 2024-04-20T12:22:32.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.152+0000 7f030c0a8640 1 -- 172.21.15.135:0/1967223212 wait complete. 2024-04-20T12:22:32.163 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:22:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:31 smithi154 ceph-mon[22073]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-04-20T12:22:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:31 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3977958740' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:22:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:31 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2549540709' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:22:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:31 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2916937174' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:22:32.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:31 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1231544658' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:22:32.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.261+0000 7f547906d640 1 -- 172.21.15.135:0/2496737271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5474101fb0 msgr2=0x7f54741023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.261+0000 7f547906d640 1 --2- 172.21.15.135:0/2496737271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5474101fb0 0x7f54741023d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f546c009ca0 tx=0x7f546c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.261+0000 7f547906d640 1 -- 172.21.15.135:0/2496737271 shutdown_connections 2024-04-20T12:22:32.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.261+0000 7f547906d640 1 --2- 172.21.15.135:0/2496737271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5474103b60 0x7f547410a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.261+0000 7f547906d640 1 --2- 172.21.15.135:0/2496737271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f54741031a0 0x7f5474103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.261+0000 7f547906d640 1 --2- 172.21.15.135:0/2496737271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5474101fb0 0x7f54741023d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.261+0000 7f547906d640 1 -- 172.21.15.135:0/2496737271 >> 172.21.15.135:0/2496737271 conn(0x7f54740fd540 msgr2=0x7f54740ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.261+0000 7f547906d640 1 -- 172.21.15.135:0/2496737271 shutdown_connections 2024-04-20T12:22:32.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.261+0000 7f547906d640 1 -- 172.21.15.135:0/2496737271 wait complete. 2024-04-20T12:22:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.262+0000 7f547906d640 1 Processor -- start 2024-04-20T12:22:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.262+0000 7f547906d640 1 -- start start 2024-04-20T12:22:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.262+0000 7f547906d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5474101fb0 0x7f54741982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.262+0000 7f547906d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54741031a0 0x7f5474198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.262+0000 7f547906d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5474103b60 0x7f547419f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.262+0000 7f547906d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f547410dc40 con 0x7f5474101fb0 2024-04-20T12:22:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.262+0000 7f547906d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f547410dac0 con 0x7f54741031a0 2024-04-20T12:22:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.262+0000 7f547906d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f547410ddc0 con 0x7f5474103b60 2024-04-20T12:22:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f5472d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5474101fb0 0x7f54741982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f5472d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5474101fb0 0x7f54741982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41040/0 (socket says 172.21.15.135:41040) 2024-04-20T12:22:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f5472d9d640 1 -- 172.21.15.135:0/3391074995 learned_addr learned my addr 172.21.15.135:0/3391074995 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f547359e640 1 --2- 172.21.15.135:0/3391074995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5474103b60 0x7f547419f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f547259c640 1 --2- 172.21.15.135:0/3391074995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54741031a0 0x7f5474198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f5472d9d640 1 -- 172.21.15.135:0/3391074995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5474103b60 msgr2=0x7f547419f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f5472d9d640 1 --2- 172.21.15.135:0/3391074995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5474103b60 0x7f547419f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f5472d9d640 1 -- 172.21.15.135:0/3391074995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54741031a0 msgr2=0x7f5474198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f5472d9d640 1 --2- 172.21.15.135:0/3391074995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54741031a0 0x7f5474198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f5472d9d640 1 -- 172.21.15.135:0/3391074995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547419fee0 con 0x7f5474101fb0 2024-04-20T12:22:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f547259c640 1 --2- 172.21.15.135:0/3391074995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54741031a0 0x7f5474198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:32.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f5472d9d640 1 --2- 172.21.15.135:0/3391074995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5474101fb0 0x7f54741982c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f546c0324c0 tx=0x7f546c032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f546bfff640 1 -- 172.21.15.135:0/3391074995 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c039040 con 0x7f5474101fb0 2024-04-20T12:22:32.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f546bfff640 1 -- 172.21.15.135:0/3391074995 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f546c044070 con 0x7f5474101fb0 2024-04-20T12:22:32.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f547906d640 1 -- 172.21.15.135:0/3391074995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54741a0170 con 0x7f5474101fb0 2024-04-20T12:22:32.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f546bfff640 1 -- 172.21.15.135:0/3391074995 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c0042a0 con 0x7f5474101fb0 2024-04-20T12:22:32.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.263+0000 7f547906d640 1 -- 172.21.15.135:0/3391074995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54741a0660 con 0x7f5474101fb0 2024-04-20T12:22:32.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.264+0000 7f547906d640 1 -- 172.21.15.135:0/3391074995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54741092d0 con 0x7f5474101fb0 2024-04-20T12:22:32.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.265+0000 7f546bfff640 1 -- 172.21.15.135:0/3391074995 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f546c003970 con 0x7f5474101fb0 2024-04-20T12:22:32.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.266+0000 7f546bfff640 1 --2- 172.21.15.135:0/3391074995 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f54600a3c40 0x7f54600a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.266+0000 7f547259c640 1 --2- 172.21.15.135:0/3391074995 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f54600a3c40 0x7f54600a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.266+0000 7f546bfff640 1 -- 172.21.15.135:0/3391074995 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f546c0f2ce0 con 0x7f5474101fb0 2024-04-20T12:22:32.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.266+0000 7f547259c640 1 --2- 172.21.15.135:0/3391074995 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f54600a3c40 0x7f54600a6100 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f54741997d0 tx=0x7f545c005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.270+0000 7f546bfff640 1 -- 172.21.15.135:0/3391074995 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f546c03e3a0 con 0x7f5474101fb0 2024-04-20T12:22:32.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:31 smithi139 ceph-mon[21834]: pgmap v349: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-04-20T12:22:32.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:31 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3977958740' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:22:32.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:31 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2549540709' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:22:32.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:31 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2916937174' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:22:32.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:31 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1231544658' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:22:32.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.489+0000 7f547906d640 1 -- 172.21.15.135:0/3391074995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f547402d5d0 con 0x7f5474101fb0 2024-04-20T12:22:32.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.490+0000 7f546bfff640 1 -- 172.21.15.135:0/3391074995 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f546c0bf3c0 con 0x7f5474101fb0 2024-04-20T12:22:32.490 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:32.490 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:21:09.311388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24490,24476,14634,24457,24475]},"id":1}]} 2024-04-20T12:22:32.490 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 28 2024-04-20T12:22:32.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.492+0000 7f547906d640 1 -- 172.21.15.135:0/3391074995 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f54600a3c40 msgr2=0x7f54600a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.492+0000 7f547906d640 1 --2- 172.21.15.135:0/3391074995 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f54600a3c40 0x7f54600a6100 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f54741997d0 tx=0x7f545c005e50 comp rx=0 tx=0).stop 2024-04-20T12:22:32.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.492+0000 7f547906d640 1 -- 172.21.15.135:0/3391074995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5474101fb0 msgr2=0x7f54741982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.492+0000 7f547906d640 1 --2- 172.21.15.135:0/3391074995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5474101fb0 0x7f54741982c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f546c0324c0 tx=0x7f546c032f20 comp rx=0 tx=0).stop 2024-04-20T12:22:32.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.492+0000 7f547906d640 1 -- 172.21.15.135:0/3391074995 shutdown_connections 2024-04-20T12:22:32.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.492+0000 7f547906d640 1 --2- 172.21.15.135:0/3391074995 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f54600a3c40 0x7f54600a6100 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.492+0000 7f547906d640 1 --2- 172.21.15.135:0/3391074995 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5474103b60 0x7f547419f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.492+0000 7f547906d640 1 --2- 172.21.15.135:0/3391074995 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f54741031a0 0x7f5474198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.492+0000 7f547906d640 1 --2- 172.21.15.135:0/3391074995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5474101fb0 0x7f54741982c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.492+0000 7f547906d640 1 -- 172.21.15.135:0/3391074995 >> 172.21.15.135:0/3391074995 conn(0x7f54740fd540 msgr2=0x7f54741064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.492+0000 7f547906d640 1 -- 172.21.15.135:0/3391074995 shutdown_connections 2024-04-20T12:22:32.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.492+0000 7f547906d640 1 -- 172.21.15.135:0/3391074995 wait complete. 2024-04-20T12:22:32.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-20T12:20:41.367288+0000', 'modified': '2024-04-20T12:21:09.311388+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'snap_rstat': True, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24490, 'mds_1': 24476, 'mds_2': 24475, 'mds_3': 24457, 'mds_4': 14634}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14622': {'gid': 14622, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6839/3001818614', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 3001818614}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 3001818614}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14634': {'gid': 14634, 'name': 'a', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.135:6841/212699479', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6840', 'nonce': 212699479}, {'type': 'v1', 'addr': '172.21.15.135:6841', 'nonce': 212699479}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24389': {'gid': 24389, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6833/2012805307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6832', 'nonce': 2012805307}, {'type': 'v1', 'addr': '172.21.15.139:6833', 'nonce': 2012805307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24409': {'gid': 24409, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/406581782', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 406581782}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 406581782}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6835/1816377265', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6834', 'nonce': 1816377265}, {'type': 'v1', 'addr': '172.21.15.139:6835', 'nonce': 1816377265}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24455': {'gid': 24455, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6837/2426010804', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6836', 'nonce': 2426010804}, {'type': 'v1', 'addr': '172.21.15.139:6837', 'nonce': 2426010804}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'f', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.154:6835/1522201664', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 1522201664}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 1522201664}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.154:6837/2792228805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 2792228805}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 2792228805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'b', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.139:6839/3819947532', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6838', 'nonce': 3819947532}, {'type': 'v1', 'addr': '172.21.15.139:6839', 'nonce': 3819947532}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.154:6839/1672287462', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 1672287462}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 1672287462}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24490, 'qdb_cluster': [24490, 24476, 14634, 24457, 24475]} 2024-04-20T12:22:32.503 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-20T12:22:32.504 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-20T12:22:32.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.603+0000 7efd46b6d640 1 -- 172.21.15.135:0/3296658611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd40101fb0 msgr2=0x7efd401023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.603+0000 7efd46b6d640 1 --2- 172.21.15.135:0/3296658611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd40101fb0 0x7efd401023d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efd34009900 tx=0x7efd3402bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:32.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.603+0000 7efd46b6d640 1 -- 172.21.15.135:0/3296658611 shutdown_connections 2024-04-20T12:22:32.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.603+0000 7efd46b6d640 1 --2- 172.21.15.135:0/3296658611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd40103b60 0x7efd4010a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.603+0000 7efd46b6d640 1 --2- 172.21.15.135:0/3296658611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd401031a0 0x7efd40103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.603+0000 7efd46b6d640 1 --2- 172.21.15.135:0/3296658611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd40101fb0 0x7efd401023d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.603+0000 7efd46b6d640 1 -- 172.21.15.135:0/3296658611 >> 172.21.15.135:0/3296658611 conn(0x7efd400fd540 msgr2=0x7efd400ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.603+0000 7efd46b6d640 1 -- 172.21.15.135:0/3296658611 shutdown_connections 2024-04-20T12:22:32.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.603+0000 7efd46b6d640 1 -- 172.21.15.135:0/3296658611 wait complete. 2024-04-20T12:22:32.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd46b6d640 1 Processor -- start 2024-04-20T12:22:32.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd46b6d640 1 -- start start 2024-04-20T12:22:32.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd46b6d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd40101fb0 0x7efd40075d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd46b6d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd401031a0 0x7efd40074350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd46b6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd40103b60 0x7efd40074890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd46b6d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd4010dc40 con 0x7efd40101fb0 2024-04-20T12:22:32.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd46b6d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efd4010dac0 con 0x7efd401031a0 2024-04-20T12:22:32.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd46b6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd4010ddc0 con 0x7efd40103b60 2024-04-20T12:22:32.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd44909640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd40101fb0 0x7efd40075d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd44909640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd40101fb0 0x7efd40075d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41052/0 (socket says 172.21.15.135:41052) 2024-04-20T12:22:32.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd44909640 1 -- 172.21.15.135:0/902963329 learned_addr learned my addr 172.21.15.135:0/902963329 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd3ffff640 1 --2- 172.21.15.135:0/902963329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd401031a0 0x7efd40074350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd44909640 1 -- 172.21.15.135:0/902963329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd40103b60 msgr2=0x7efd40074890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd44909640 1 --2- 172.21.15.135:0/902963329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd40103b60 0x7efd40074890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd44909640 1 -- 172.21.15.135:0/902963329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd401031a0 msgr2=0x7efd40074350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd44909640 1 --2- 172.21.15.135:0/902963329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd401031a0 0x7efd40074350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd44909640 1 -- 172.21.15.135:0/902963329 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd40075120 con 0x7efd40101fb0 2024-04-20T12:22:32.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd3ffff640 1 --2- 172.21.15.135:0/902963329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd401031a0 0x7efd40074350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:32.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd44909640 1 --2- 172.21.15.135:0/902963329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd40101fb0 0x7efd40075d10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efd34005ab0 tx=0x7efd34005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd3dffb640 1 -- 172.21.15.135:0/902963329 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd34041070 con 0x7efd40101fb0 2024-04-20T12:22:32.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd3dffb640 1 -- 172.21.15.135:0/902963329 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd340054e0 con 0x7efd40101fb0 2024-04-20T12:22:32.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.604+0000 7efd46b6d640 1 -- 172.21.15.135:0/902963329 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd401a2380 con 0x7efd40101fb0 2024-04-20T12:22:32.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.605+0000 7efd3dffb640 1 -- 172.21.15.135:0/902963329 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd34034440 con 0x7efd40101fb0 2024-04-20T12:22:32.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.605+0000 7efd46b6d640 1 -- 172.21.15.135:0/902963329 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd401a2920 con 0x7efd40101fb0 2024-04-20T12:22:32.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.607+0000 7efd3dffb640 1 -- 172.21.15.135:0/902963329 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7efd34044070 con 0x7efd40101fb0 2024-04-20T12:22:32.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.607+0000 7efd49835740 1 Processor -- start 2024-04-20T12:22:32.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.607+0000 7efd49835740 1 -- start start 2024-04-20T12:22:32.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.607+0000 7efd49835740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 0x56380fd71110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.607+0000 7efd49835740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd716e0 0x56380fd761e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.607+0000 7efd49835740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd76850 0x56380fd78ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.607+0000 7efd49835740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56380fc84290 con 0x56380fd76850 2024-04-20T12:22:32.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.607+0000 7efd49835740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56380fce1a40 con 0x56380fd716e0 2024-04-20T12:22:32.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.607+0000 7efd49835740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56380fc9ca30 con 0x56380fd70cf0 2024-04-20T12:22:32.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd3dffb640 1 --2- 172.21.15.135:0/902963329 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efd300a3cc0 0x7efd300a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd3ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd76850 0x56380fd78ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd3ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd76850 0x56380fd78ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41062/0 (socket says 172.21.15.135:41062) 2024-04-20T12:22:32.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd3ffff640 1 -- 172.21.15.135:0/2985833393 learned_addr learned my addr 172.21.15.135:0/2985833393 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd44909640 1 --2- 172.21.15.135:0/2985833393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd716e0 0x56380fd761e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd4510a640 1 --2- 172.21.15.135:0/2985833393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 0x56380fd71110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd4510a640 1 --2- 172.21.15.135:0/902963329 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efd300a3cc0 0x7efd300a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd3dffb640 1 -- 172.21.15.135:0/902963329 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7efd340f2420 con 0x7efd40101fb0 2024-04-20T12:22:32.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd3ffff640 1 -- 172.21.15.135:0/2985833393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 msgr2=0x56380fd71110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd3ffff640 1 --2- 172.21.15.135:0/2985833393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 0x56380fd71110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd3ffff640 1 -- 172.21.15.135:0/2985833393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd716e0 msgr2=0x56380fd761e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd3ffff640 1 --2- 172.21.15.135:0/2985833393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd716e0 0x56380fd761e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd3ffff640 1 -- 172.21.15.135:0/2985833393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56380fc8fc10 con 0x56380fd76850 2024-04-20T12:22:32.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd3ffff640 1 --2- 172.21.15.135:0/2985833393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd76850 0x56380fd78ce0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00bd30 tx=0x7efd2c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62e73bdceab2b85 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd4510a640 1 --2- 172.21.15.135:0/902963329 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efd300a3cc0 0x7efd300a6180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efd38009270 tx=0x7efd38005bd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd2affd640 1 -- 172.21.15.135:0/2985833393 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c015070 con 0x56380fd76850 2024-04-20T12:22:32.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd2affd640 1 -- 172.21.15.135:0/2985833393 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd2c00be20 con 0x56380fd76850 2024-04-20T12:22:32.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.608+0000 7efd2affd640 1 -- 172.21.15.135:0/2985833393 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c011aa0 con 0x56380fd76850 2024-04-20T12:22:32.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.609+0000 7efd49835740 1 -- 172.21.15.135:0/2985833393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd76850 msgr2=0x56380fd78ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.609+0000 7efd49835740 1 --2- 172.21.15.135:0/2985833393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd76850 0x56380fd78ce0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00bd30 tx=0x7efd2c00f730 comp rx=0 tx=0).stop 2024-04-20T12:22:32.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.609+0000 7efd49835740 1 -- 172.21.15.135:0/2985833393 shutdown_connections 2024-04-20T12:22:32.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.609+0000 7efd49835740 1 --2- 172.21.15.135:0/2985833393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd76850 0x56380fd78ce0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.609+0000 7efd49835740 1 --2- 172.21.15.135:0/2985833393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd716e0 0x56380fd761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.609+0000 7efd49835740 1 --2- 172.21.15.135:0/2985833393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 0x56380fd71110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.609+0000 7efd49835740 1 -- 172.21.15.135:0/2985833393 >> 172.21.15.135:0/2985833393 conn(0x56380fd6c260 msgr2=0x56380fd6c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.609+0000 7efd49835740 1 -- 172.21.15.135:0/2985833393 shutdown_connections 2024-04-20T12:22:32.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.609+0000 7efd49835740 1 -- 172.21.15.135:0/2985833393 wait complete. 2024-04-20T12:22:32.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.609+0000 7efd49835740 1 -- start start 2024-04-20T12:22:32.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.609+0000 7efd49835740 1 Processor -- start 2024-04-20T12:22:32.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd49835740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 0x56380fd7aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd49835740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd716e0 0x56380fd7b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd49835740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd76850 0x56380fd82450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd49835740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56380fcdb140 con 0x56380fd76850 2024-04-20T12:22:32.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd49835740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56380fcd5e20 con 0x56380fd716e0 2024-04-20T12:22:32.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd49835740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56380fce3d20 con 0x56380fd70cf0 2024-04-20T12:22:32.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd49835740 10 client.0 _ll_register_callbacks cb 0x56380fccc5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:32.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd4510a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd76850 0x56380fd82450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd4510a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd76850 0x56380fd82450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41070/0 (socket says 172.21.15.135:41070) 2024-04-20T12:22:32.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd4510a640 1 -- 172.21.15.135:0/3493517219 learned_addr learned my addr 172.21.15.135:0/3493517219 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd3ffff640 1 --2- 172.21.15.135:0/3493517219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd716e0 0x56380fd7b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd4510a640 1 -- 172.21.15.135:0/3493517219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 msgr2=0x56380fd7aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd44909640 1 --2- 172.21.15.135:0/3493517219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 0x56380fd7aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd4510a640 1 --2- 172.21.15.135:0/3493517219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 0x56380fd7aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd4510a640 1 -- 172.21.15.135:0/3493517219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd716e0 msgr2=0x56380fd7b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd4510a640 1 --2- 172.21.15.135:0/3493517219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd716e0 0x56380fd7b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd4510a640 1 -- 172.21.15.135:0/3493517219 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56380f9e92d0 con 0x56380fd76850 2024-04-20T12:22:32.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd3ffff640 1 --2- 172.21.15.135:0/3493517219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd716e0 0x56380fd7b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:32.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd44909640 1 --2- 172.21.15.135:0/3493517219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 0x56380fd7aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:32.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd4510a640 1 --2- 172.21.15.135:0/3493517219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd76850 0x56380fd82450 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7efd3800fba0 tx=0x7efd38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ea494ffb3eced5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:32.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.610+0000 7efd1ffff640 1 -- 172.21.15.135:0/3493517219 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd38004d20 con 0x56380fd76850 2024-04-20T12:22:32.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.611+0000 7efd1ffff640 1 -- 172.21.15.135:0/3493517219 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7efd38011960 con 0x56380fd76850 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.611+0000 7efd49835740 1 -- 172.21.15.135:0/3493517219 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd2c00be20 con 0x56380fd76850 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.611+0000 7efd1ffff640 1 -- 172.21.15.135:0/3493517219 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd3800fe10 con 0x56380fd76850 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.611+0000 7efd49835740 10 client.15228 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.611+0000 7efd49835740 1 -- 172.21.15.135:0/3493517219 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56380fab36b0 con 0x56380fd76850 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.611+0000 7efd1ffff640 1 -- 172.21.15.135:0/3493517219 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd2c00be20 con 0x56380fd76850 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.611+0000 7efd1ffff640 1 -- 172.21.15.135:0/3493517219 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7efd38005800 con 0x56380fd76850 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.611+0000 7efd49835740 10 client.15228 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.611+0000 7efd49835740 10 client.15228 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.611+0000 7efd49835740 20 client.15228 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.611+0000 7efd49835740 1 --2- 172.21.15.135:0/3493517219 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x56380fd87c70 0x56380fd890e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.611+0000 7efd49835740 4 client.15228 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.611+0000 7efd49835740 1 -- 172.21.15.135:0/3493517219 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56380fc5d510 con 0x56380fd87c70 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.611+0000 7efd44909640 1 --2- 172.21.15.135:0/3493517219 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x56380fd87c70 0x56380fd890e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd44909640 1 --2- 172.21.15.135:0/3493517219 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x56380fd87c70 0x56380fd890e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7f8738138eca3cd7 server_cookie=47fad56529b5aea0 in_seq=0 out_seq=0 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd1ffff640 10 client.15228 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:22:32.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd1ffff640 1 -- 172.21.15.135:0/3493517219 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56380fc5d510 con 0x56380fd87c70 2024-04-20T12:22:32.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd1ffff640 10 client.15228 handle_command_reply: tid=0 2024-04-20T12:22:32.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd49835740 1 client.15228 shutdown 2024-04-20T12:22:32.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd49835740 1 -- 172.21.15.135:0/3493517219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd76850 msgr2=0x56380fd82450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd49835740 1 --2- 172.21.15.135:0/3493517219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd76850 0x56380fd82450 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7efd3800fba0 tx=0x7efd38004a40 comp rx=0 tx=0).stop 2024-04-20T12:22:32.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd49835740 1 -- 172.21.15.135:0/3493517219 shutdown_connections 2024-04-20T12:22:32.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd49835740 1 --2- 172.21.15.135:0/3493517219 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x56380fd87c70 0x56380fd890e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd49835740 1 --2- 172.21.15.135:0/3493517219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd76850 0x56380fd82450 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd49835740 1 --2- 172.21.15.135:0/3493517219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd716e0 0x56380fd7b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd49835740 1 --2- 172.21.15.135:0/3493517219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 0x56380fd7aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd1ffff640 0 client.15228 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:22:32.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd49835740 1 -- 172.21.15.135:0/3493517219 >> 172.21.15.135:0/3493517219 conn(0x56380fd6c260 msgr2=0x56380fd6b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd49835740 1 -- 172.21.15.135:0/3493517219 shutdown_connections 2024-04-20T12:22:32.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.612+0000 7efd49835740 1 -- 172.21.15.135:0/3493517219 wait complete. 2024-04-20T12:22:32.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.613+0000 7efd49835740 20 client.15228 trim_cache size 0 max 16384 2024-04-20T12:22:32.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.630+0000 7efd49835740 1 Processor -- start 2024-04-20T12:22:32.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.630+0000 7efd49835740 1 -- start start 2024-04-20T12:22:32.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.630+0000 7efd49835740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd70cf0 0x56380fd6c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.630+0000 7efd49835740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd716e0 0x56380fd82410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.630+0000 7efd49835740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd76850 0x56380fd7aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.630+0000 7efd49835740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56380fd87420 con 0x56380fd716e0 2024-04-20T12:22:32.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.630+0000 7efd49835740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56380fd87af0 con 0x56380fd70cf0 2024-04-20T12:22:32.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.630+0000 7efd49835740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56380fd881c0 con 0x56380fd76850 2024-04-20T12:22:32.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.630+0000 7efd3ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd716e0 0x56380fd82410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.630+0000 7efd3ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd716e0 0x56380fd82410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41072/0 (socket says 172.21.15.135:41072) 2024-04-20T12:22:32.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.630+0000 7efd3ffff640 1 -- 172.21.15.135:0/3938420946 learned_addr learned my addr 172.21.15.135:0/3938420946 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.631+0000 7efd3ffff640 1 -- 172.21.15.135:0/3938420946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd76850 msgr2=0x56380fd7aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.631+0000 7efd4510a640 1 --2- 172.21.15.135:0/3938420946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd76850 0x56380fd7aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.631+0000 7efd44909640 1 --2- 172.21.15.135:0/3938420946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd70cf0 0x56380fd6c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.631+0000 7efd3ffff640 1 --2- 172.21.15.135:0/3938420946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd76850 0x56380fd7aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.631+0000 7efd3ffff640 1 -- 172.21.15.135:0/3938420946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd70cf0 msgr2=0x56380fd6c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.631+0000 7efd3ffff640 1 --2- 172.21.15.135:0/3938420946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd70cf0 0x56380fd6c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.631+0000 7efd3ffff640 1 -- 172.21.15.135:0/3938420946 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56380fd75e80 con 0x56380fd716e0 2024-04-20T12:22:32.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.631+0000 7efd4510a640 1 --2- 172.21.15.135:0/3938420946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd76850 0x56380fd7aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:32.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.631+0000 7efd44909640 1 --2- 172.21.15.135:0/3938420946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd70cf0 0x56380fd6c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:32.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.631+0000 7efd3ffff640 1 --2- 172.21.15.135:0/3938420946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd716e0 0x56380fd82410 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00bd30 tx=0x7efd2c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd6fb4636ba1831 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.631+0000 7efd2a7fc640 1 -- 172.21.15.135:0/3938420946 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c015040 con 0x56380fd716e0 2024-04-20T12:22:32.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.631+0000 7efd2a7fc640 1 -- 172.21.15.135:0/3938420946 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd2c005520 con 0x56380fd716e0 2024-04-20T12:22:32.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.631+0000 7efd2a7fc640 1 -- 172.21.15.135:0/3938420946 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c004b40 con 0x56380fd716e0 2024-04-20T12:22:32.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 -- 172.21.15.135:0/3938420946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd716e0 msgr2=0x56380fd82410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 --2- 172.21.15.135:0/3938420946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd716e0 0x56380fd82410 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efd2c00bd30 tx=0x7efd2c00be20 comp rx=0 tx=0).stop 2024-04-20T12:22:32.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 -- 172.21.15.135:0/3938420946 shutdown_connections 2024-04-20T12:22:32.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 --2- 172.21.15.135:0/3938420946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd76850 0x56380fd7aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 --2- 172.21.15.135:0/3938420946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd716e0 0x56380fd82410 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 --2- 172.21.15.135:0/3938420946 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd70cf0 0x56380fd6c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 -- 172.21.15.135:0/3938420946 >> 172.21.15.135:0/3938420946 conn(0x56380fd6c260 msgr2=0x56380fd79a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 -- 172.21.15.135:0/3938420946 shutdown_connections 2024-04-20T12:22:32.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 -- 172.21.15.135:0/3938420946 wait complete. 2024-04-20T12:22:32.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 -- start start 2024-04-20T12:22:32.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 Processor -- start 2024-04-20T12:22:32.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 0x56380fd7dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd716e0 0x56380fd7e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd76850 0x56380fd81250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56380fd88f60 con 0x56380fd716e0 2024-04-20T12:22:32.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56380fd88890 con 0x56380fd76850 2024-04-20T12:22:32.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56380fd89630 con 0x56380fd70cf0 2024-04-20T12:22:32.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd49835740 10 client.0 _ll_register_callbacks cb 0x7efd38009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:32.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd3ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd716e0 0x56380fd7e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd3ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd716e0 0x56380fd7e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41074/0 (socket says 172.21.15.135:41074) 2024-04-20T12:22:32.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.632+0000 7efd3ffff640 1 -- 172.21.15.135:0/3907510301 learned_addr learned my addr 172.21.15.135:0/3907510301 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd44909640 1 --2- 172.21.15.135:0/3907510301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 0x56380fd7dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd4510a640 1 --2- 172.21.15.135:0/3907510301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd76850 0x56380fd81250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd3ffff640 1 -- 172.21.15.135:0/3907510301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 msgr2=0x56380fd7dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd3ffff640 1 --2- 172.21.15.135:0/3907510301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 0x56380fd7dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd3ffff640 1 -- 172.21.15.135:0/3907510301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd76850 msgr2=0x56380fd81250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd3ffff640 1 --2- 172.21.15.135:0/3907510301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd76850 0x56380fd81250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd3ffff640 1 -- 172.21.15.135:0/3907510301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56380fd81840 con 0x56380fd716e0 2024-04-20T12:22:32.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd4510a640 1 --2- 172.21.15.135:0/3907510301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd76850 0x56380fd81250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:32.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd3ffff640 1 --2- 172.21.15.135:0/3907510301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd716e0 0x56380fd7e280 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0057a0 tx=0x7efd2c01b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09180ea5f09b388 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd1ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:32.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd1ffff640 1 -- 172.21.15.135:0/3907510301 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2c029040 con 0x56380fd716e0 2024-04-20T12:22:32.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd1ffff640 1 -- 172.21.15.135:0/3907510301 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7efd2c004230 con 0x56380fd716e0 2024-04-20T12:22:32.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd49835740 1 -- 172.21.15.135:0/3907510301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd2c005520 con 0x56380fd716e0 2024-04-20T12:22:32.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd1ffff640 1 -- 172.21.15.135:0/3907510301 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd2c03b050 con 0x56380fd716e0 2024-04-20T12:22:32.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd49835740 10 client.15234 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:32.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd49835740 1 -- 172.21.15.135:0/3907510301 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56380fdedda0 con 0x56380fd716e0 2024-04-20T12:22:32.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.633+0000 7efd1ffff640 1 -- 172.21.15.135:0/3907510301 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd2c005520 con 0x56380fd716e0 2024-04-20T12:22:32.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd1ffff640 1 -- 172.21.15.135:0/3907510301 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7efd2c02c070 con 0x56380fd716e0 2024-04-20T12:22:32.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd49835740 10 client.15234 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:32.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd49835740 10 client.15234 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-20T12:22:32.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd49835740 20 client.15234 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:32.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd49835740 1 --2- 172.21.15.135:0/3907510301 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x56380fdf2340 0x56380fdf1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd49835740 4 client.15234 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T12:22:32.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd49835740 1 -- 172.21.15.135:0/3907510301 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "status"}) -- 0x56380fce4530 con 0x56380fdf2340 2024-04-20T12:22:32.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd44909640 1 --2- 172.21.15.135:0/3907510301 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x56380fdf2340 0x56380fdf1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd1ffff640 10 client.15234 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:22:32.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd44909640 1 --2- 172.21.15.135:0/3907510301 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x56380fdf2340 0x56380fdf1050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a9da6323d9decfd3 server_cookie=f6fd35dcf7c5785e in_seq=0 out_seq=0 2024-04-20T12:22:32.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd1ffff640 1 -- 172.21.15.135:0/3907510301 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56380fce4530 con 0x56380fdf2340 2024-04-20T12:22:32.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd1ffff640 10 client.15234 handle_command_reply: tid=0 2024-04-20T12:22:32.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd49835740 1 client.15234 shutdown 2024-04-20T12:22:32.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd49835740 1 -- 172.21.15.135:0/3907510301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd716e0 msgr2=0x56380fd7e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd49835740 1 --2- 172.21.15.135:0/3907510301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd716e0 0x56380fd7e280 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0057a0 tx=0x7efd2c01b720 comp rx=0 tx=0).stop 2024-04-20T12:22:32.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd49835740 1 -- 172.21.15.135:0/3907510301 shutdown_connections 2024-04-20T12:22:32.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd49835740 1 --2- 172.21.15.135:0/3907510301 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x56380fdf2340 0x56380fdf1050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd49835740 1 --2- 172.21.15.135:0/3907510301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56380fd76850 0x56380fd81250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd49835740 1 --2- 172.21.15.135:0/3907510301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56380fd716e0 0x56380fd7e280 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd1ffff640 0 client.15234 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:22:32.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd49835740 1 --2- 172.21.15.135:0/3907510301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56380fd70cf0 0x56380fd7dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.634+0000 7efd49835740 1 -- 172.21.15.135:0/3907510301 >> 172.21.15.135:0/3907510301 conn(0x56380fd6c260 msgr2=0x56380fd72bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.635+0000 7efd49835740 1 -- 172.21.15.135:0/3907510301 shutdown_connections 2024-04-20T12:22:32.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.635+0000 7efd49835740 1 -- 172.21.15.135:0/3907510301 wait complete. 2024-04-20T12:22:32.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.635+0000 7efd49835740 20 client.15234 trim_cache size 0 max 16384 2024-04-20T12:22:32.642 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:22:32.642 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "22180be8-ff0f-11ee-bc92-c7b262605968", 2024-04-20T12:22:32.642 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 4, 2024-04-20T12:22:32.642 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 14634, 2024-04-20T12:22:32.642 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-04-20T12:22:32.643 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-04-20T12:22:32.643 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-04-20T12:22:32.643 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 84.32823295, 2024-04-20T12:22:32.643 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 28, 2024-04-20T12:22:32.643 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 92, 2024-04-20T12:22:32.643 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 90, 2024-04-20T12:22:32.643 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 119.44482927999999 2024-04-20T12:22:32.643 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:22:32.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.635+0000 7efd46b6d640 1 -- 172.21.15.135:0/902963329 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efd300a3cc0 msgr2=0x7efd300a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.635+0000 7efd46b6d640 1 --2- 172.21.15.135:0/902963329 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efd300a3cc0 0x7efd300a6180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efd38009270 tx=0x7efd38005bd0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.635+0000 7efd46b6d640 1 -- 172.21.15.135:0/902963329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd40101fb0 msgr2=0x7efd40075d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.635+0000 7efd46b6d640 1 --2- 172.21.15.135:0/902963329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd40101fb0 0x7efd40075d10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efd34005ab0 tx=0x7efd34005dc0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.635+0000 7efd46b6d640 1 -- 172.21.15.135:0/902963329 shutdown_connections 2024-04-20T12:22:32.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.635+0000 7efd46b6d640 1 --2- 172.21.15.135:0/902963329 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7efd300a3cc0 0x7efd300a6180 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.635+0000 7efd46b6d640 1 --2- 172.21.15.135:0/902963329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd40103b60 0x7efd40074890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.635+0000 7efd46b6d640 1 --2- 172.21.15.135:0/902963329 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd401031a0 0x7efd40074350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.635+0000 7efd46b6d640 1 --2- 172.21.15.135:0/902963329 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd40101fb0 0x7efd40075d10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.635+0000 7efd46b6d640 1 -- 172.21.15.135:0/902963329 >> 172.21.15.135:0/902963329 conn(0x7efd400fd540 msgr2=0x7efd40106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.635+0000 7efd46b6d640 1 -- 172.21.15.135:0/902963329 shutdown_connections 2024-04-20T12:22:32.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.635+0000 7efd46b6d640 1 -- 172.21.15.135:0/902963329 wait complete. 2024-04-20T12:22:32.646 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-20T12:22:32.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.745+0000 7fe726443640 1 -- 172.21.15.135:0/3919984865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7201053d0 msgr2=0x7fe7201077c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.745+0000 7fe726443640 1 --2- 172.21.15.135:0/3919984865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7201053d0 0x7fe7201077c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe714009900 tx=0x7fe71402bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:32.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.745+0000 7fe726443640 1 -- 172.21.15.135:0/3919984865 shutdown_connections 2024-04-20T12:22:32.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.745+0000 7fe726443640 1 --2- 172.21.15.135:0/3919984865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe720107d00 0x7fe72010a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.745+0000 7fe726443640 1 --2- 172.21.15.135:0/3919984865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7201053d0 0x7fe7201077c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.745+0000 7fe726443640 1 --2- 172.21.15.135:0/3919984865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe720102aa0 0x7fe720104e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.745+0000 7fe726443640 1 -- 172.21.15.135:0/3919984865 >> 172.21.15.135:0/3919984865 conn(0x7fe7200fc450 msgr2=0x7fe7200fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.745+0000 7fe726443640 1 -- 172.21.15.135:0/3919984865 shutdown_connections 2024-04-20T12:22:32.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.745+0000 7fe726443640 1 -- 172.21.15.135:0/3919984865 wait complete. 2024-04-20T12:22:32.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe726443640 1 Processor -- start 2024-04-20T12:22:32.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe726443640 1 -- start start 2024-04-20T12:22:32.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe726443640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe720102aa0 0x7fe720198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe726443640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7201053d0 0x7fe7201988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe726443640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe720107d00 0x7fe72019f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe726443640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe72010dc90 con 0x7fe7201053d0 2024-04-20T12:22:32.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe726443640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe72010db10 con 0x7fe720102aa0 2024-04-20T12:22:32.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe726443640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe72010de10 con 0x7fe720107d00 2024-04-20T12:22:32.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe71f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7201053d0 0x7fe7201988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe71f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7201053d0 0x7fe7201988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41090/0 (socket says 172.21.15.135:41090) 2024-04-20T12:22:32.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe71f7fe640 1 -- 172.21.15.135:0/1398361613 learned_addr learned my addr 172.21.15.135:0/1398361613 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe71ffff640 1 --2- 172.21.15.135:0/1398361613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe720102aa0 0x7fe720198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe7249e0640 1 --2- 172.21.15.135:0/1398361613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe720107d00 0x7fe72019f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe71f7fe640 1 -- 172.21.15.135:0/1398361613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe720107d00 msgr2=0x7fe72019f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe71f7fe640 1 --2- 172.21.15.135:0/1398361613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe720107d00 0x7fe72019f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe71f7fe640 1 -- 172.21.15.135:0/1398361613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe720102aa0 msgr2=0x7fe720198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe71f7fe640 1 --2- 172.21.15.135:0/1398361613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe720102aa0 0x7fe720198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe71f7fe640 1 -- 172.21.15.135:0/1398361613 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72019ffb0 con 0x7fe7201053d0 2024-04-20T12:22:32.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.746+0000 7fe7249e0640 1 --2- 172.21.15.135:0/1398361613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe720107d00 0x7fe72019f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:32.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.747+0000 7fe71f7fe640 1 --2- 172.21.15.135:0/1398361613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7201053d0 0x7fe7201988d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe714005ab0 tx=0x7fe714005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.747+0000 7fe71d7fa640 1 -- 172.21.15.135:0/1398361613 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe714041070 con 0x7fe7201053d0 2024-04-20T12:22:32.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.747+0000 7fe726443640 1 -- 172.21.15.135:0/1398361613 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7201a0240 con 0x7fe7201053d0 2024-04-20T12:22:32.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.747+0000 7fe71d7fa640 1 -- 172.21.15.135:0/1398361613 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7140054e0 con 0x7fe7201053d0 2024-04-20T12:22:32.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.747+0000 7fe71d7fa640 1 -- 172.21.15.135:0/1398361613 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe714034440 con 0x7fe7201053d0 2024-04-20T12:22:32.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.747+0000 7fe726443640 1 -- 172.21.15.135:0/1398361613 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7201a0780 con 0x7fe7201053d0 2024-04-20T12:22:32.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.749+0000 7fe71d7fa640 1 -- 172.21.15.135:0/1398361613 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fe714044070 con 0x7fe7201053d0 2024-04-20T12:22:32.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.749+0000 7fe729035740 1 Processor -- start 2024-04-20T12:22:32.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.749+0000 7fe729035740 1 -- start start 2024-04-20T12:22:32.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe729035740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bccf0 0x55a7348bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe729035740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348bd6e0 0x55a7348c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe729035740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348c2850 0x55a7348c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe729035740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a7347d0290 con 0x55a7348bccf0 2024-04-20T12:22:32.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe729035740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a73482da40 con 0x55a7348bd6e0 2024-04-20T12:22:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe729035740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a7347e8a30 con 0x55a7348c2850 2024-04-20T12:22:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe71d7fa640 1 --2- 172.21.15.135:0/1398361613 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe7080a3c40 0x7fe7080a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe7249e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bccf0 0x55a7348bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe7249e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bccf0 0x55a7348bd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41098/0 (socket says 172.21.15.135:41098) 2024-04-20T12:22:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe7249e0640 1 -- 172.21.15.135:0/3340476183 learned_addr learned my addr 172.21.15.135:0/3340476183 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe71f7fe640 1 --2- 172.21.15.135:0/3340476183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348c2850 0x55a7348c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe7249e0640 1 --2- 172.21.15.135:0/1398361613 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe7080a3c40 0x7fe7080a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe71ffff640 1 --2- 172.21.15.135:0/3340476183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348bd6e0 0x55a7348c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe71d7fa640 1 -- 172.21.15.135:0/1398361613 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fe7140f24b0 con 0x7fe7201053d0 2024-04-20T12:22:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe7249e0640 1 -- 172.21.15.135:0/3340476183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348c2850 msgr2=0x55a7348c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe7249e0640 1 --2- 172.21.15.135:0/3340476183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348c2850 0x55a7348c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe7249e0640 1 -- 172.21.15.135:0/3340476183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348bd6e0 msgr2=0x55a7348c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe7249e0640 1 --2- 172.21.15.135:0/3340476183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348bd6e0 0x55a7348c21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe7249e0640 1 -- 172.21.15.135:0/3340476183 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7347dbc10 con 0x55a7348bccf0 2024-04-20T12:22:32.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe71ffff640 1 --2- 172.21.15.135:0/3340476183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348bd6e0 0x55a7348c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe7249e0640 1 --2- 172.21.15.135:0/3340476183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bccf0 0x55a7348bd110 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe718013950 tx=0x7fe718013d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66271964094d33ef server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe7067fc640 1 -- 172.21.15.135:0/3340476183 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe718013420 con 0x55a7348bccf0 2024-04-20T12:22:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.750+0000 7fe7067fc640 1 -- 172.21.15.135:0/3340476183 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe718011b80 con 0x55a7348bccf0 2024-04-20T12:22:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.751+0000 7fe7067fc640 1 -- 172.21.15.135:0/3340476183 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe718005020 con 0x55a7348bccf0 2024-04-20T12:22:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.751+0000 7fe7249e0640 1 --2- 172.21.15.135:0/1398361613 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe7080a3c40 0x7fe7080a6100 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe718020000 tx=0x7fe71801f000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.751+0000 7fe729035740 1 -- 172.21.15.135:0/3340476183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bccf0 msgr2=0x55a7348bd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.751+0000 7fe729035740 1 --2- 172.21.15.135:0/3340476183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bccf0 0x55a7348bd110 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe718013950 tx=0x7fe718013d50 comp rx=0 tx=0).stop 2024-04-20T12:22:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.751+0000 7fe729035740 1 -- 172.21.15.135:0/3340476183 shutdown_connections 2024-04-20T12:22:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.751+0000 7fe729035740 1 --2- 172.21.15.135:0/3340476183 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348c2850 0x55a7348c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.751+0000 7fe729035740 1 --2- 172.21.15.135:0/3340476183 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348bd6e0 0x55a7348c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.751+0000 7fe729035740 1 --2- 172.21.15.135:0/3340476183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bccf0 0x55a7348bd110 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.751+0000 7fe729035740 1 -- 172.21.15.135:0/3340476183 >> 172.21.15.135:0/3340476183 conn(0x55a7348b8260 msgr2=0x55a7348b8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.751+0000 7fe729035740 1 -- 172.21.15.135:0/3340476183 shutdown_connections 2024-04-20T12:22:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.751+0000 7fe729035740 1 -- 172.21.15.135:0/3340476183 wait complete. 2024-04-20T12:22:32.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.751+0000 7fe729035740 1 -- start start 2024-04-20T12:22:32.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe729035740 1 Processor -- start 2024-04-20T12:22:32.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe729035740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bccf0 0x55a7348c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe729035740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348bd6e0 0x55a7348c7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe729035740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348c2850 0x55a7348ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe729035740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a734827140 con 0x55a7348bccf0 2024-04-20T12:22:32.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe729035740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a734821e20 con 0x55a7348bd6e0 2024-04-20T12:22:32.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe729035740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a73482fd20 con 0x55a7348c2850 2024-04-20T12:22:32.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe729035740 10 client.0 _ll_register_callbacks cb 0x55a7348185c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:32.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe71ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bccf0 0x55a7348c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe71ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bccf0 0x55a7348c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41102/0 (socket says 172.21.15.135:41102) 2024-04-20T12:22:32.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe71ffff640 1 -- 172.21.15.135:0/2162339617 learned_addr learned my addr 172.21.15.135:0/2162339617 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe71ffff640 1 -- 172.21.15.135:0/2162339617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348c2850 msgr2=0x55a7348ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe71ffff640 1 --2- 172.21.15.135:0/2162339617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348c2850 0x55a7348ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe71ffff640 1 -- 172.21.15.135:0/2162339617 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348bd6e0 msgr2=0x55a7348c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe71f7fe640 1 --2- 172.21.15.135:0/2162339617 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348bd6e0 0x55a7348c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe71ffff640 1 --2- 172.21.15.135:0/2162339617 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348bd6e0 0x55a7348c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.752+0000 7fe71ffff640 1 -- 172.21.15.135:0/2162339617 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7345352d0 con 0x55a7348bccf0 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe71ffff640 1 --2- 172.21.15.135:0/2162339617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bccf0 0x55a7348c6f30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe710009e80 tx=0x7fe710011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72beea48dd485d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe6ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe6ff7fe640 1 -- 172.21.15.135:0/2162339617 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710019070 con 0x55a7348bccf0 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe6ff7fe640 1 -- 172.21.15.135:0/2162339617 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fe710015660 con 0x55a7348bccf0 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe729035740 1 -- 172.21.15.135:0/2162339617 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe718011b80 con 0x55a7348bccf0 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe6ff7fe640 1 -- 172.21.15.135:0/2162339617 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe710025050 con 0x55a7348bccf0 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe729035740 10 client.15246 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe729035740 1 -- 172.21.15.135:0/2162339617 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a7345ff6b0 con 0x55a7348bccf0 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe6ff7fe640 1 -- 172.21.15.135:0/2162339617 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe718011b80 con 0x55a7348bccf0 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe6ff7fe640 1 -- 172.21.15.135:0/2162339617 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7fe710014a90 con 0x55a7348bccf0 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe729035740 10 client.15246 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:32.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe729035740 10 client.15246 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-20T12:22:32.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe729035740 20 client.15246 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:32.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe729035740 1 --2- 172.21.15.135:0/2162339617 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55a7348d3cc0 0x55a7348d5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe729035740 4 client.15246 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:22:32.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.753+0000 7fe729035740 1 -- 172.21.15.135:0/2162339617 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7347a9510 con 0x55a7348d3cc0 2024-04-20T12:22:32.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.754+0000 7fe71f7fe640 1 --2- 172.21.15.135:0/2162339617 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55a7348d3cc0 0x55a7348d5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.754+0000 7fe6ff7fe640 10 client.15246 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:22:32.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.754+0000 7fe71f7fe640 1 --2- 172.21.15.135:0/2162339617 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55a7348d3cc0 0x55a7348d5130 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9ef51eba6196c001 server_cookie=b90a694d50e7e3e6 in_seq=0 out_seq=0 2024-04-20T12:22:32.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.755+0000 7fe6ff7fe640 1 -- 172.21.15.135:0/2162339617 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a7347a9510 con 0x55a7348d3cc0 2024-04-20T12:22:32.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.755+0000 7fe6ff7fe640 10 client.15246 handle_command_reply: tid=0 2024-04-20T12:22:32.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.755+0000 7fe729035740 1 client.15246 shutdown 2024-04-20T12:22:32.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.755+0000 7fe729035740 1 -- 172.21.15.135:0/2162339617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bccf0 msgr2=0x55a7348c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.755+0000 7fe729035740 1 --2- 172.21.15.135:0/2162339617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bccf0 0x55a7348c6f30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe710009e80 tx=0x7fe710011630 comp rx=0 tx=0).stop 2024-04-20T12:22:32.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.755+0000 7fe729035740 1 -- 172.21.15.135:0/2162339617 shutdown_connections 2024-04-20T12:22:32.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.755+0000 7fe729035740 1 --2- 172.21.15.135:0/2162339617 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55a7348d3cc0 0x55a7348d5130 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.755+0000 7fe729035740 1 --2- 172.21.15.135:0/2162339617 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348c2850 0x55a7348ce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.755+0000 7fe729035740 1 --2- 172.21.15.135:0/2162339617 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348bd6e0 0x55a7348c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.755+0000 7fe6ff7fe640 0 client.15246 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:22:32.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.755+0000 7fe729035740 1 --2- 172.21.15.135:0/2162339617 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bccf0 0x55a7348c6f30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.755+0000 7fe729035740 1 -- 172.21.15.135:0/2162339617 >> 172.21.15.135:0/2162339617 conn(0x55a7348b8260 msgr2=0x55a7348b73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.755+0000 7fe729035740 1 -- 172.21.15.135:0/2162339617 shutdown_connections 2024-04-20T12:22:32.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.755+0000 7fe729035740 1 -- 172.21.15.135:0/2162339617 wait complete. 2024-04-20T12:22:32.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.755+0000 7fe729035740 20 client.15246 trim_cache size 0 max 16384 2024-04-20T12:22:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe729035740 1 Processor -- start 2024-04-20T12:22:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe729035740 1 -- start start 2024-04-20T12:22:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe729035740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348bccf0 0x55a7348c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe729035740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bd6e0 0x55a7348c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe729035740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348c2850 0x55a7348beb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe729035740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a7348d3470 con 0x55a7348bd6e0 2024-04-20T12:22:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe729035740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a7348d3b40 con 0x55a7348bccf0 2024-04-20T12:22:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe729035740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a7348d4210 con 0x55a7348c2850 2024-04-20T12:22:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe71f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bd6e0 0x55a7348c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe71f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bd6e0 0x55a7348c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41112/0 (socket says 172.21.15.135:41112) 2024-04-20T12:22:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe71f7fe640 1 -- 172.21.15.135:0/224346558 learned_addr learned my addr 172.21.15.135:0/224346558 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe71f7fe640 1 -- 172.21.15.135:0/224346558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348c2850 msgr2=0x55a7348beb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe71f7fe640 1 --2- 172.21.15.135:0/224346558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348c2850 0x55a7348beb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe71f7fe640 1 -- 172.21.15.135:0/224346558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348bccf0 msgr2=0x55a7348c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe71f7fe640 1 --2- 172.21.15.135:0/224346558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348bccf0 0x55a7348c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe71f7fe640 1 -- 172.21.15.135:0/224346558 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7348c8060 con 0x55a7348bd6e0 2024-04-20T12:22:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.773+0000 7fe71f7fe640 1 --2- 172.21.15.135:0/224346558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bd6e0 0x55a7348c5fc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe71404c000 tx=0x7fe714090f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eeff2549a5fa816 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.774+0000 7fe705ffb640 1 -- 172.21.15.135:0/224346558 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71404b040 con 0x55a7348bd6e0 2024-04-20T12:22:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.774+0000 7fe705ffb640 1 -- 172.21.15.135:0/224346558 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe714088f60 con 0x55a7348bd6e0 2024-04-20T12:22:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.774+0000 7fe705ffb640 1 -- 172.21.15.135:0/224346558 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7140c7070 con 0x55a7348bd6e0 2024-04-20T12:22:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.774+0000 7fe729035740 1 -- 172.21.15.135:0/224346558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bd6e0 msgr2=0x55a7348c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.774+0000 7fe729035740 1 --2- 172.21.15.135:0/224346558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bd6e0 0x55a7348c5fc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe71404c000 tx=0x7fe714090f40 comp rx=0 tx=0).stop 2024-04-20T12:22:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.774+0000 7fe729035740 1 -- 172.21.15.135:0/224346558 shutdown_connections 2024-04-20T12:22:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.774+0000 7fe729035740 1 --2- 172.21.15.135:0/224346558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348c2850 0x55a7348beb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.774+0000 7fe729035740 1 --2- 172.21.15.135:0/224346558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bd6e0 0x55a7348c5fc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.774+0000 7fe729035740 1 --2- 172.21.15.135:0/224346558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348bccf0 0x55a7348c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.774+0000 7fe729035740 1 -- 172.21.15.135:0/224346558 >> 172.21.15.135:0/224346558 conn(0x55a7348b8260 msgr2=0x55a7348b8640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.774+0000 7fe729035740 1 -- 172.21.15.135:0/224346558 shutdown_connections 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.774+0000 7fe729035740 1 -- 172.21.15.135:0/224346558 wait complete. 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe729035740 1 -- start start 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe729035740 1 Processor -- start 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe729035740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348bccf0 0x55a7348cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe729035740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bd6e0 0x55a7348cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe729035740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348c2850 0x55a73493c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe729035740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a7348d4fb0 con 0x55a7348bd6e0 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe729035740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a7348d48e0 con 0x55a7348c2850 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe729035740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a7348d5680 con 0x55a7348bccf0 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe729035740 10 client.0 _ll_register_callbacks cb 0x7fe7100093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe71f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bd6e0 0x55a7348cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe71f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bd6e0 0x55a7348cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41116/0 (socket says 172.21.15.135:41116) 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe71f7fe640 1 -- 172.21.15.135:0/1470776103 learned_addr learned my addr 172.21.15.135:0/1470776103 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe71f7fe640 1 -- 172.21.15.135:0/1470776103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348bccf0 msgr2=0x55a7348cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe71f7fe640 1 --2- 172.21.15.135:0/1470776103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348bccf0 0x55a7348cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe71f7fe640 1 -- 172.21.15.135:0/1470776103 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348c2850 msgr2=0x55a73493c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe71f7fe640 1 --2- 172.21.15.135:0/1470776103 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348c2850 0x55a73493c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe71f7fe640 1 -- 172.21.15.135:0/1470776103 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a73493c760 con 0x55a7348bd6e0 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe71f7fe640 1 --2- 172.21.15.135:0/1470776103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bd6e0 0x55a7348cdf60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe7140efcb0 tx=0x7fe7140bde30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed30694b55e3d7c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.775+0000 7fe6ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.776+0000 7fe6ff7fe640 1 -- 172.21.15.135:0/1470776103 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71404b040 con 0x55a7348bd6e0 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.776+0000 7fe6ff7fe640 1 -- 172.21.15.135:0/1470776103 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fe7140f2240 con 0x55a7348bd6e0 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.776+0000 7fe729035740 1 -- 172.21.15.135:0/1470776103 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe714088f60 con 0x55a7348bd6e0 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.776+0000 7fe6ff7fe640 1 -- 172.21.15.135:0/1470776103 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe7140beb00 con 0x55a7348bd6e0 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.776+0000 7fe729035740 10 client.15252 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.776+0000 7fe729035740 1 -- 172.21.15.135:0/1470776103 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a73493da60 con 0x55a7348bd6e0 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.776+0000 7fe6ff7fe640 1 -- 172.21.15.135:0/1470776103 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe714088f60 con 0x55a7348bd6e0 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.776+0000 7fe6ff7fe640 1 -- 172.21.15.135:0/1470776103 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7fe714003710 con 0x55a7348bd6e0 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.776+0000 7fe729035740 10 client.15252 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.776+0000 7fe729035740 10 client.15252 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-20T12:22:32.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.776+0000 7fe729035740 20 client.15252 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.776+0000 7fe729035740 1 --2- 172.21.15.135:0/1470776103 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55a734942520 0x55a734941230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.776+0000 7fe729035740 4 client.15252 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T12:22:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.776+0000 7fe729035740 1 -- 172.21.15.135:0/1470776103 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "status"}) -- 0x55a734830530 con 0x55a734942520 2024-04-20T12:22:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.776+0000 7fe71ffff640 1 --2- 172.21.15.135:0/1470776103 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55a734942520 0x55a734941230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe71ffff640 1 --2- 172.21.15.135:0/1470776103 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55a734942520 0x55a734941230 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=da40706b102ab04a server_cookie=3da9ddd43f9e9f7a in_seq=0 out_seq=0 2024-04-20T12:22:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe6ff7fe640 10 client.15252 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:22:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe6ff7fe640 1 -- 172.21.15.135:0/1470776103 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a734830530 con 0x55a734942520 2024-04-20T12:22:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe6ff7fe640 10 client.15252 handle_command_reply: tid=0 2024-04-20T12:22:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe729035740 1 client.15252 shutdown 2024-04-20T12:22:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe729035740 1 -- 172.21.15.135:0/1470776103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bd6e0 msgr2=0x55a7348cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe729035740 1 --2- 172.21.15.135:0/1470776103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bd6e0 0x55a7348cdf60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe7140efcb0 tx=0x7fe7140bde30 comp rx=0 tx=0).stop 2024-04-20T12:22:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe729035740 1 -- 172.21.15.135:0/1470776103 shutdown_connections 2024-04-20T12:22:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe729035740 1 --2- 172.21.15.135:0/1470776103 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55a734942520 0x55a734941230 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe729035740 1 --2- 172.21.15.135:0/1470776103 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a7348c2850 0x55a73493c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe729035740 1 --2- 172.21.15.135:0/1470776103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a7348bd6e0 0x55a7348cdf60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe6ff7fe640 0 client.15252 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:22:32.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe729035740 1 --2- 172.21.15.135:0/1470776103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a7348bccf0 0x55a7348cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe729035740 1 -- 172.21.15.135:0/1470776103 >> 172.21.15.135:0/1470776103 conn(0x55a7348b8260 msgr2=0x55a7348c5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe729035740 1 -- 172.21.15.135:0/1470776103 shutdown_connections 2024-04-20T12:22:32.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe729035740 1 -- 172.21.15.135:0/1470776103 wait complete. 2024-04-20T12:22:32.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.777+0000 7fe729035740 20 client.15252 trim_cache size 0 max 16384 2024-04-20T12:22:32.783 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:22:32.783 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "22180be8-ff0f-11ee-bc92-c7b262605968", 2024-04-20T12:22:32.783 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 3, 2024-04-20T12:22:32.783 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24457, 2024-04-20T12:22:32.783 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-04-20T12:22:32.784 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-04-20T12:22:32.784 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-04-20T12:22:32.784 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 84.860836621000004, 2024-04-20T12:22:32.784 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 28, 2024-04-20T12:22:32.784 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 92, 2024-04-20T12:22:32.784 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 90, 2024-04-20T12:22:32.784 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 133.793461506 2024-04-20T12:22:32.784 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:22:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.778+0000 7fe726443640 1 -- 172.21.15.135:0/1398361613 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe7080a3c40 msgr2=0x7fe7080a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.778+0000 7fe726443640 1 --2- 172.21.15.135:0/1398361613 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe7080a3c40 0x7fe7080a6100 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe718020000 tx=0x7fe71801f000 comp rx=0 tx=0).stop 2024-04-20T12:22:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.778+0000 7fe726443640 1 -- 172.21.15.135:0/1398361613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7201053d0 msgr2=0x7fe7201988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.778+0000 7fe726443640 1 --2- 172.21.15.135:0/1398361613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7201053d0 0x7fe7201988d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe714005ab0 tx=0x7fe714005dc0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.778+0000 7fe726443640 1 -- 172.21.15.135:0/1398361613 shutdown_connections 2024-04-20T12:22:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.778+0000 7fe726443640 1 --2- 172.21.15.135:0/1398361613 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe7080a3c40 0x7fe7080a6100 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.778+0000 7fe726443640 1 --2- 172.21.15.135:0/1398361613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe720107d00 0x7fe72019f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.778+0000 7fe726443640 1 --2- 172.21.15.135:0/1398361613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7201053d0 0x7fe7201988d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.778+0000 7fe726443640 1 --2- 172.21.15.135:0/1398361613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe720102aa0 0x7fe720198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.778+0000 7fe726443640 1 -- 172.21.15.135:0/1398361613 >> 172.21.15.135:0/1398361613 conn(0x7fe7200fc450 msgr2=0x7fe7201034c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.778+0000 7fe726443640 1 -- 172.21.15.135:0/1398361613 shutdown_connections 2024-04-20T12:22:32.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.778+0000 7fe726443640 1 -- 172.21.15.135:0/1398361613 wait complete. 2024-04-20T12:22:32.789 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-20T12:22:32.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.888+0000 7f7d2c14a640 1 -- 172.21.15.135:0/711569100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d24101ff0 msgr2=0x7f7d24102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.888+0000 7f7d2c14a640 1 --2- 172.21.15.135:0/711569100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d24101ff0 0x7f7d24102470 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009900 tx=0x7f7d2002bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:32.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.888+0000 7f7d2c14a640 1 -- 172.21.15.135:0/711569100 shutdown_connections 2024-04-20T12:22:32.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.888+0000 7f7d2c14a640 1 --2- 172.21.15.135:0/711569100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d241029b0 0x7f7d241092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.888+0000 7f7d2c14a640 1 --2- 172.21.15.135:0/711569100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d24101ff0 0x7f7d24102470 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.888+0000 7f7d2c14a640 1 --2- 172.21.15.135:0/711569100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d24100ea0 0x7f7d241012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.888+0000 7f7d2c14a640 1 -- 172.21.15.135:0/711569100 >> 172.21.15.135:0/711569100 conn(0x7f7d240fc410 msgr2=0x7f7d240fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.888+0000 7f7d2c14a640 1 -- 172.21.15.135:0/711569100 shutdown_connections 2024-04-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.888+0000 7f7d2c14a640 1 -- 172.21.15.135:0/711569100 wait complete. 2024-04-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.888+0000 7f7d2c14a640 1 Processor -- start 2024-04-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.888+0000 7f7d2c14a640 1 -- start start 2024-04-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d2c14a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d24100ea0 0x7f7d2406b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d2c14a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d24101ff0 0x7f7d2419cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d2c14a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d241029b0 0x7f7d2419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d2c14a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2410cb40 con 0x7f7d24100ea0 2024-04-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d2c14a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2410c9c0 con 0x7f7d24101ff0 2024-04-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d2c14a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7d2410ccc0 con 0x7f7d241029b0 2024-04-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d29ee6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d24100ea0 0x7f7d2406b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d29ee6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d24100ea0 0x7f7d2406b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41128/0 (socket says 172.21.15.135:41128) 2024-04-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d29ee6640 1 -- 172.21.15.135:0/1198981302 learned_addr learned my addr 172.21.15.135:0/1198981302 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d296e5640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d24101ff0 0x7f7d2419cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d2a6e7640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d241029b0 0x7f7d2419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d29ee6640 1 -- 172.21.15.135:0/1198981302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d241029b0 msgr2=0x7f7d2419f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d29ee6640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d241029b0 0x7f7d2419f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d29ee6640 1 -- 172.21.15.135:0/1198981302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d24101ff0 msgr2=0x7f7d2419cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d29ee6640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d24101ff0 0x7f7d2419cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d29ee6640 1 -- 172.21.15.135:0/1198981302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d2419fec0 con 0x7f7d24100ea0 2024-04-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d296e5640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d24101ff0 0x7f7d2419cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d2a6e7640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d241029b0 0x7f7d2419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d29ee6640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d24100ea0 0x7f7d2406b130 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400c920 tx=0x7f7d1400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d1affd640 1 -- 172.21.15.135:0/1198981302 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d14007c70 con 0x7f7d24100ea0 2024-04-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d2c14a640 1 -- 172.21.15.135:0/1198981302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d241a01b0 con 0x7f7d24100ea0 2024-04-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d1affd640 1 -- 172.21.15.135:0/1198981302 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d14007e10 con 0x7f7d24100ea0 2024-04-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d1affd640 1 -- 172.21.15.135:0/1198981302 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d14018890 con 0x7f7d24100ea0 2024-04-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.889+0000 7f7d2c14a640 1 -- 172.21.15.135:0/1198981302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d241a06d0 con 0x7f7d24100ea0 2024-04-20T12:22:32.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.892+0000 7f7d1affd640 1 -- 172.21.15.135:0/1198981302 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f7d14018a70 con 0x7f7d24100ea0 2024-04-20T12:22:32.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.892+0000 7f7d2ee0f740 1 Processor -- start 2024-04-20T12:22:32.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.892+0000 7f7d2ee0f740 1 -- start start 2024-04-20T12:22:32.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.892+0000 7f7d2ee0f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed2a0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.892+0000 7f7d2ee0f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a06e0 0x55a8ed2a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.892+0000 7f7d2ee0f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a5850 0x55a8ed2a7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.892+0000 7f7d2ee0f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a8ed1b3290 con 0x55a8ed29fcf0 2024-04-20T12:22:32.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.892+0000 7f7d2ee0f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a8ed210a40 con 0x55a8ed2a06e0 2024-04-20T12:22:32.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.892+0000 7f7d2ee0f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a8ed1cba30 con 0x55a8ed2a5850 2024-04-20T12:22:32.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.892+0000 7f7d1affd640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7d100a3c40 0x7f7d100a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.892+0000 7f7d2a6e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed2a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.892+0000 7f7d2a6e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed2a0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41130/0 (socket says 172.21.15.135:41130) 2024-04-20T12:22:32.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.892+0000 7f7d2a6e7640 1 -- 172.21.15.135:0/2657290035 learned_addr learned my addr 172.21.15.135:0/2657290035 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.893+0000 7f7d2a6e7640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7d100a3c40 0x7f7d100a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.893+0000 7f7d1affd640 1 -- 172.21.15.135:0/1198981302 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f7d140d0ac0 con 0x7f7d24100ea0 2024-04-20T12:22:32.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.893+0000 7f7d296e5640 1 --2- 172.21.15.135:0/2657290035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a5850 0x55a8ed2a7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.893+0000 7f7d29ee6640 1 --2- 172.21.15.135:0/2657290035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a06e0 0x55a8ed2a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.893+0000 7f7d2a6e7640 1 -- 172.21.15.135:0/2657290035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a5850 msgr2=0x55a8ed2a7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.893+0000 7f7d2a6e7640 1 --2- 172.21.15.135:0/2657290035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a5850 0x55a8ed2a7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.893+0000 7f7d2a6e7640 1 -- 172.21.15.135:0/2657290035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a06e0 msgr2=0x55a8ed2a51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.893+0000 7f7d2a6e7640 1 --2- 172.21.15.135:0/2657290035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a06e0 0x55a8ed2a51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.893+0000 7f7d2a6e7640 1 -- 172.21.15.135:0/2657290035 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ed1bec10 con 0x55a8ed29fcf0 2024-04-20T12:22:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.893+0000 7f7d2a6e7640 1 --2- 172.21.15.135:0/2657290035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed2a0110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c013e90 tx=0x7f7d1c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6101dac1ff1119 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.893+0000 7f7d2a6e7640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7d100a3c40 0x7f7d100a6100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c010ca0 tx=0x7f7d1c01b000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.893+0000 7f7d0ffff640 1 -- 172.21.15.135:0/2657290035 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c00be20 con 0x55a8ed29fcf0 2024-04-20T12:22:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.893+0000 7f7d0ffff640 1 -- 172.21.15.135:0/2657290035 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d1c00ac30 con 0x55a8ed29fcf0 2024-04-20T12:22:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.893+0000 7f7d0ffff640 1 -- 172.21.15.135:0/2657290035 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c004020 con 0x55a8ed29fcf0 2024-04-20T12:22:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.894+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/2657290035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 msgr2=0x55a8ed2a0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.894+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/2657290035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed2a0110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c013e90 tx=0x7f7d1c0107a0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.894+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/2657290035 shutdown_connections 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.894+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/2657290035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a5850 0x55a8ed2a7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.894+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/2657290035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a06e0 0x55a8ed2a51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.894+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/2657290035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed2a0110 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.894+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/2657290035 >> 172.21.15.135:0/2657290035 conn(0x55a8ed29b260 msgr2=0x55a8ed29b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.894+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/2657290035 shutdown_connections 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.894+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/2657290035 wait complete. 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.894+0000 7f7d2ee0f740 1 -- start start 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.894+0000 7f7d2ee0f740 1 Processor -- start 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d2ee0f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed2a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d2ee0f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a06e0 0x55a8ed2aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d2ee0f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a5850 0x55a8ed2b1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d2ee0f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a8ed20a140 con 0x55a8ed29fcf0 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d2ee0f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a8ed204e20 con 0x55a8ed2a5850 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d2ee0f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a8ed212d20 con 0x55a8ed2a06e0 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d2ee0f740 10 client.0 _ll_register_callbacks cb 0x55a8ed1fb5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:32.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d29ee6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed2a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d29ee6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed2a9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41142/0 (socket says 172.21.15.135:41142) 2024-04-20T12:22:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d29ee6640 1 -- 172.21.15.135:0/191978274 learned_addr learned my addr 172.21.15.135:0/191978274 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d2a6e7640 1 --2- 172.21.15.135:0/191978274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a5850 0x55a8ed2b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d296e5640 1 --2- 172.21.15.135:0/191978274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a06e0 0x55a8ed2aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d29ee6640 1 -- 172.21.15.135:0/191978274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a06e0 msgr2=0x55a8ed2aa3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d29ee6640 1 --2- 172.21.15.135:0/191978274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a06e0 0x55a8ed2aa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d29ee6640 1 -- 172.21.15.135:0/191978274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a5850 msgr2=0x55a8ed2b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d29ee6640 1 --2- 172.21.15.135:0/191978274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a5850 0x55a8ed2b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d29ee6640 1 -- 172.21.15.135:0/191978274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ecf182d0 con 0x55a8ed29fcf0 2024-04-20T12:22:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d2a6e7640 1 --2- 172.21.15.135:0/191978274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a5850 0x55a8ed2b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d29ee6640 1 --2- 172.21.15.135:0/191978274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed2a9e80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7d14007590 tx=0x7f7d1406b300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6020e8e420b1a8c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d0d7fa640 1 -- 172.21.15.135:0/191978274 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1400de20 con 0x55a8ed29fcf0 2024-04-20T12:22:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d0d7fa640 1 -- 172.21.15.135:0/191978274 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f7d1400fb30 con 0x55a8ed29fcf0 2024-04-20T12:22:32.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.895+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/191978274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a8ed18c510 con 0x55a8ed29fcf0 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.896+0000 7f7d0d7fa640 1 -- 172.21.15.135:0/191978274 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7d14067460 con 0x55a8ed29fcf0 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.896+0000 7f7d2ee0f740 10 client.15264 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.896+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/191978274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a8ecfe26b0 con 0x55a8ed29fcf0 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.896+0000 7f7d0d7fa640 1 -- 172.21.15.135:0/191978274 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a8ed18c510 con 0x55a8ed29fcf0 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.896+0000 7f7d0d7fa640 1 -- 172.21.15.135:0/191978274 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7f7d14066fc0 con 0x55a8ed29fcf0 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.896+0000 7f7d2ee0f740 10 client.15264 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.896+0000 7f7d2ee0f740 10 client.15264 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.896+0000 7f7d2ee0f740 20 client.15264 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.896+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/191978274 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a8ed2b6ad0 0x55a8ed2b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.896+0000 7f7d2ee0f740 4 client.15264 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.896+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/191978274 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8ed213530 con 0x55a8ed2b6ad0 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.896+0000 7f7d296e5640 1 --2- 172.21.15.135:0/191978274 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a8ed2b6ad0 0x55a8ed2b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.897+0000 7f7d296e5640 1 --2- 172.21.15.135:0/191978274 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a8ed2b6ad0 0x55a8ed2b7f40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=585ca40df2bbf748 server_cookie=62e0f4bdb24564f2 in_seq=0 out_seq=0 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.897+0000 7f7d0d7fa640 10 client.15264 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.897+0000 7f7d0d7fa640 1 -- 172.21.15.135:0/191978274 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a8ed213530 con 0x55a8ed2b6ad0 2024-04-20T12:22:32.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.897+0000 7f7d0d7fa640 10 client.15264 handle_command_reply: tid=0 2024-04-20T12:22:32.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.897+0000 7f7d2ee0f740 1 client.15264 shutdown 2024-04-20T12:22:32.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.897+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/191978274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 msgr2=0x55a8ed2a9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.897+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/191978274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed2a9e80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7d14007590 tx=0x7f7d1406b300 comp rx=0 tx=0).stop 2024-04-20T12:22:32.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.898+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/191978274 shutdown_connections 2024-04-20T12:22:32.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.898+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/191978274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a5850 0x55a8ed2b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.898+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/191978274 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a8ed2b6ad0 0x55a8ed2b7f40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.898+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/191978274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a06e0 0x55a8ed2aa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.898+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/191978274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed2a9e80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.898+0000 7f7d0d7fa640 0 client.15264 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:22:32.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.898+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/191978274 >> 172.21.15.135:0/191978274 conn(0x55a8ed29b260 msgr2=0x55a8ed29a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.898+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/191978274 shutdown_connections 2024-04-20T12:22:32.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.898+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/191978274 wait complete. 2024-04-20T12:22:32.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.898+0000 7f7d2ee0f740 20 client.15264 trim_cache size 0 max 16384 2024-04-20T12:22:32.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.916+0000 7f7d2ee0f740 1 Processor -- start 2024-04-20T12:22:32.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.916+0000 7f7d2ee0f740 1 -- start start 2024-04-20T12:22:32.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d2ee0f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed29b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d2ee0f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a06e0 0x55a8ed2a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d2ee0f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a5850 0x55a8ed2a2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d2ee0f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a8ed2b6280 con 0x55a8ed29fcf0 2024-04-20T12:22:32.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d2ee0f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a8ed2b6950 con 0x55a8ed2a06e0 2024-04-20T12:22:32.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d2ee0f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a8ed2b7020 con 0x55a8ed2a5850 2024-04-20T12:22:32.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d29ee6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed29b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d296e5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a06e0 0x55a8ed2a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d29ee6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed29b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41158/0 (socket says 172.21.15.135:41158) 2024-04-20T12:22:32.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d2a6e7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a5850 0x55a8ed2a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d29ee6640 1 -- 172.21.15.135:0/1674540049 learned_addr learned my addr 172.21.15.135:0/1674540049 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d29ee6640 1 -- 172.21.15.135:0/1674540049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a5850 msgr2=0x55a8ed2a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d29ee6640 1 --2- 172.21.15.135:0/1674540049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a5850 0x55a8ed2a2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d29ee6640 1 -- 172.21.15.135:0/1674540049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a06e0 msgr2=0x55a8ed2a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d29ee6640 1 --2- 172.21.15.135:0/1674540049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a06e0 0x55a8ed2a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d29ee6640 1 -- 172.21.15.135:0/1674540049 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ed2b74d0 con 0x55a8ed29fcf0 2024-04-20T12:22:32.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d296e5640 1 --2- 172.21.15.135:0/1674540049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a06e0 0x55a8ed2a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:22:32.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d29ee6640 1 --2- 172.21.15.135:0/1674540049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed29b640 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7d1409c600 tx=0x7f7d1400ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607d95dca7fed275 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d0f7fe640 1 -- 172.21.15.135:0/1674540049 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1409c900 con 0x55a8ed29fcf0 2024-04-20T12:22:32.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d0f7fe640 1 -- 172.21.15.135:0/1674540049 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d140a0cb0 con 0x55a8ed29fcf0 2024-04-20T12:22:32.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.917+0000 7f7d0f7fe640 1 -- 172.21.15.135:0/1674540049 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d14087100 con 0x55a8ed29fcf0 2024-04-20T12:22:32.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.918+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/1674540049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 msgr2=0x55a8ed29b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.918+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/1674540049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed29b640 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7d1409c600 tx=0x7f7d1400ff30 comp rx=0 tx=0).stop 2024-04-20T12:22:32.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.918+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/1674540049 shutdown_connections 2024-04-20T12:22:32.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.918+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/1674540049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a5850 0x55a8ed2a2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.918+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/1674540049 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed2a06e0 0x55a8ed2a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.918+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/1674540049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed29fcf0 0x55a8ed29b640 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.918+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/1674540049 >> 172.21.15.135:0/1674540049 conn(0x55a8ed29b260 msgr2=0x55a8ed2b5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.918+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/1674540049 shutdown_connections 2024-04-20T12:22:32.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.918+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/1674540049 wait complete. 2024-04-20T12:22:32.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.918+0000 7f7d2ee0f740 1 -- start start 2024-04-20T12:22:32.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2ee0f740 1 Processor -- start 2024-04-20T12:22:32.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2ee0f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed29fcf0 0x55a8ed31aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2ee0f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a06e0 0x55a8ed31cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2ee0f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed2a5850 0x55a8ed31f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2ee0f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a8ed2b7dc0 con 0x55a8ed2a5850 2024-04-20T12:22:32.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2ee0f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a8ed2b76f0 con 0x55a8ed29fcf0 2024-04-20T12:22:32.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2ee0f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a8ed2b8490 con 0x55a8ed2a06e0 2024-04-20T12:22:32.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2ee0f740 10 client.0 _ll_register_callbacks cb 0x7f7d1400fe30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:32.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2a6e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed2a5850 0x55a8ed31f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2a6e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed2a5850 0x55a8ed31f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41174/0 (socket says 172.21.15.135:41174) 2024-04-20T12:22:32.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2a6e7640 1 -- 172.21.15.135:0/1104012983 learned_addr learned my addr 172.21.15.135:0/1104012983 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:32.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d296e5640 1 --2- 172.21.15.135:0/1104012983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a06e0 0x55a8ed31cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d29ee6640 1 --2- 172.21.15.135:0/1104012983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed29fcf0 0x55a8ed31aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2a6e7640 1 -- 172.21.15.135:0/1104012983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a06e0 msgr2=0x55a8ed31cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2a6e7640 1 --2- 172.21.15.135:0/1104012983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a06e0 0x55a8ed31cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2a6e7640 1 -- 172.21.15.135:0/1104012983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed29fcf0 msgr2=0x55a8ed31aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:32.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2a6e7640 1 --2- 172.21.15.135:0/1104012983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed29fcf0 0x55a8ed31aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2a6e7640 1 -- 172.21.15.135:0/1104012983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ed31fd40 con 0x55a8ed2a5850 2024-04-20T12:22:32.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d2a6e7640 1 --2- 172.21.15.135:0/1104012983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed2a5850 0x55a8ed31f510 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c013e90 tx=0x7f7d1c00a960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccf0b9f06ce87d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:32.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.919+0000 7f7d0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:32.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.920+0000 7f7d0d7fa640 1 -- 172.21.15.135:0/1104012983 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0039f0 con 0x55a8ed2a5850 2024-04-20T12:22:32.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.920+0000 7f7d0d7fa640 1 -- 172.21.15.135:0/1104012983 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f7d1c013260 con 0x55a8ed2a5850 2024-04-20T12:22:32.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.920+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/1104012983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d140a0cb0 con 0x55a8ed2a5850 2024-04-20T12:22:32.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.920+0000 7f7d0d7fa640 1 -- 172.21.15.135:0/1104012983 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7d1c004a00 con 0x55a8ed2a5850 2024-04-20T12:22:32.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.920+0000 7f7d2ee0f740 10 client.15270 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:32.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.920+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/1104012983 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a8ed321040 con 0x55a8ed2a5850 2024-04-20T12:22:32.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.920+0000 7f7d0d7fa640 1 -- 172.21.15.135:0/1104012983 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d140a0cb0 con 0x55a8ed2a5850 2024-04-20T12:22:32.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.920+0000 7f7d0d7fa640 1 -- 172.21.15.135:0/1104012983 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7f7d1c01c070 con 0x55a8ed2a5850 2024-04-20T12:22:32.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.920+0000 7f7d2ee0f740 10 client.15270 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:32.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.920+0000 7f7d2ee0f740 10 client.15270 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-20T12:22:32.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.920+0000 7f7d2ee0f740 20 client.15270 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:32.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.920+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/1104012983 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a8ed3258d0 0x55a8ed3245e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:32.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.920+0000 7f7d2ee0f740 4 client.15270 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T12:22:32.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.920+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/1104012983 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "status"}) -- 0x55a8ed20d3a0 con 0x55a8ed3258d0 2024-04-20T12:22:32.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.920+0000 7f7d29ee6640 1 --2- 172.21.15.135:0/1104012983 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a8ed3258d0 0x55a8ed3245e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:32.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d29ee6640 1 --2- 172.21.15.135:0/1104012983 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a8ed3258d0 0x55a8ed3245e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=90179fcc3d9bf450 server_cookie=f517116d26999e0b in_seq=0 out_seq=0 2024-04-20T12:22:32.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d0d7fa640 10 client.15270 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:22:32.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d0d7fa640 1 -- 172.21.15.135:0/1104012983 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a8ed20d3a0 con 0x55a8ed3258d0 2024-04-20T12:22:32.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d0d7fa640 10 client.15270 handle_command_reply: tid=0 2024-04-20T12:22:32.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d2ee0f740 1 client.15270 shutdown 2024-04-20T12:22:32.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/1104012983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed2a5850 msgr2=0x55a8ed31f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/1104012983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed2a5850 0x55a8ed31f510 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c013e90 tx=0x7f7d1c00a960 comp rx=0 tx=0).stop 2024-04-20T12:22:32.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/1104012983 shutdown_connections 2024-04-20T12:22:32.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/1104012983 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a8ed2a5850 0x55a8ed31f510 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/1104012983 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a8ed3258d0 0x55a8ed3245e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/1104012983 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a8ed2a06e0 0x55a8ed31cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d2ee0f740 1 --2- 172.21.15.135:0/1104012983 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a8ed29fcf0 0x55a8ed31aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d0d7fa640 0 client.15270 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:22:32.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/1104012983 >> 172.21.15.135:0/1104012983 conn(0x55a8ed29b260 msgr2=0x55a8ed29b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/1104012983 shutdown_connections 2024-04-20T12:22:32.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d2ee0f740 1 -- 172.21.15.135:0/1104012983 wait complete. 2024-04-20T12:22:32.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.921+0000 7f7d2ee0f740 20 client.15270 trim_cache size 0 max 16384 2024-04-20T12:22:32.928 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:22:32.928 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "22180be8-ff0f-11ee-bc92-c7b262605968", 2024-04-20T12:22:32.928 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 2, 2024-04-20T12:22:32.928 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24475, 2024-04-20T12:22:32.928 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-04-20T12:22:32.928 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-04-20T12:22:32.929 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-04-20T12:22:32.929 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 86.009466071000006, 2024-04-20T12:22:32.929 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 28, 2024-04-20T12:22:32.929 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 92, 2024-04-20T12:22:32.929 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 90, 2024-04-20T12:22:32.929 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 131.046558602 2024-04-20T12:22:32.929 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:22:32.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.922+0000 7f7d2c14a640 1 -- 172.21.15.135:0/1198981302 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7d100a3c40 msgr2=0x7f7d100a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.922+0000 7f7d2c14a640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7d100a3c40 0x7f7d100a6100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c010ca0 tx=0x7f7d1c01b000 comp rx=0 tx=0).stop 2024-04-20T12:22:32.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.922+0000 7f7d2c14a640 1 -- 172.21.15.135:0/1198981302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d24100ea0 msgr2=0x7f7d2406b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:32.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.922+0000 7f7d2c14a640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d24100ea0 0x7f7d2406b130 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400c920 tx=0x7f7d1400cde0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.922+0000 7f7d2c14a640 1 -- 172.21.15.135:0/1198981302 shutdown_connections 2024-04-20T12:22:32.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.922+0000 7f7d2c14a640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7d100a3c40 0x7f7d100a6100 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.922+0000 7f7d2c14a640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d241029b0 0x7f7d2419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.922+0000 7f7d2c14a640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d24101ff0 0x7f7d2419cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.922+0000 7f7d2c14a640 1 --2- 172.21.15.135:0/1198981302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d24100ea0 0x7f7d2406b130 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:32.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.922+0000 7f7d2c14a640 1 -- 172.21.15.135:0/1198981302 >> 172.21.15.135:0/1198981302 conn(0x7f7d240fc410 msgr2=0x7f7d24105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:32.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.922+0000 7f7d2c14a640 1 -- 172.21.15.135:0/1198981302 shutdown_connections 2024-04-20T12:22:32.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:32.922+0000 7f7d2c14a640 1 -- 172.21.15.135:0/1198981302 wait complete. 2024-04-20T12:22:32.933 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-20T12:22:33.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.032+0000 7f7e98c81640 1 -- 172.21.15.135:0/1308969416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e94105350 msgr2=0x7f7e94107740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.032+0000 7f7e98c81640 1 --2- 172.21.15.135:0/1308969416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e94105350 0x7f7e94107740 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009900 tx=0x7f7e8802bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:33.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.032+0000 7f7e98c81640 1 -- 172.21.15.135:0/1308969416 shutdown_connections 2024-04-20T12:22:33.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.032+0000 7f7e98c81640 1 --2- 172.21.15.135:0/1308969416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e94107c80 0x7f7e9410a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.032+0000 7f7e98c81640 1 --2- 172.21.15.135:0/1308969416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e94105350 0x7f7e94107740 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.032+0000 7f7e98c81640 1 --2- 172.21.15.135:0/1308969416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e94102a20 0x7f7e94104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.032+0000 7f7e98c81640 1 -- 172.21.15.135:0/1308969416 >> 172.21.15.135:0/1308969416 conn(0x7f7e940fc410 msgr2=0x7f7e940fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:33.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.032+0000 7f7e98c81640 1 -- 172.21.15.135:0/1308969416 shutdown_connections 2024-04-20T12:22:33.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.032+0000 7f7e98c81640 1 -- 172.21.15.135:0/1308969416 wait complete. 2024-04-20T12:22:33.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e98c81640 1 Processor -- start 2024-04-20T12:22:33.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e98c81640 1 -- start start 2024-04-20T12:22:33.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e98c81640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e94102a20 0x7f7e94198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e98c81640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e94105350 0x7f7e94198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e98c81640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e94107c80 0x7f7e9419f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e98c81640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9410dc30 con 0x7f7e94107c80 2024-04-20T12:22:33.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e98c81640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9410dab0 con 0x7f7e94102a20 2024-04-20T12:22:33.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e98c81640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7e9410ddb0 con 0x7f7e94105350 2024-04-20T12:22:33.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e92d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e94107c80 0x7f7e9419f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e92d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e94107c80 0x7f7e9419f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41190/0 (socket says 172.21.15.135:41190) 2024-04-20T12:22:33.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e92d9d640 1 -- 172.21.15.135:0/2773836176 learned_addr learned my addr 172.21.15.135:0/2773836176 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:33.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e91d9b640 1 --2- 172.21.15.135:0/2773836176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e94105350 0x7f7e94198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e9259c640 1 --2- 172.21.15.135:0/2773836176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e94102a20 0x7f7e94198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e92d9d640 1 -- 172.21.15.135:0/2773836176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e94105350 msgr2=0x7f7e94198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e92d9d640 1 --2- 172.21.15.135:0/2773836176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e94105350 0x7f7e94198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e92d9d640 1 -- 172.21.15.135:0/2773836176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e94102a20 msgr2=0x7f7e94198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e92d9d640 1 --2- 172.21.15.135:0/2773836176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e94102a20 0x7f7e94198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e92d9d640 1 -- 172.21.15.135:0/2773836176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e9419ff60 con 0x7f7e94107c80 2024-04-20T12:22:33.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e92d9d640 1 --2- 172.21.15.135:0/2773836176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e94107c80 0x7f7e9419f8f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00eb10 tx=0x7f7e8c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:33.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.033+0000 7f7e837fe640 1 -- 172.21.15.135:0/2773836176 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c004b20 con 0x7f7e94107c80 2024-04-20T12:22:33.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.034+0000 7f7e98c81640 1 -- 172.21.15.135:0/2773836176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e941a0250 con 0x7f7e94107c80 2024-04-20T12:22:33.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.034+0000 7f7e837fe640 1 -- 172.21.15.135:0/2773836176 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e8c004cc0 con 0x7f7e94107c80 2024-04-20T12:22:33.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.034+0000 7f7e837fe640 1 -- 172.21.15.135:0/2773836176 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c010760 con 0x7f7e94107c80 2024-04-20T12:22:33.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.034+0000 7f7e98c81640 1 -- 172.21.15.135:0/2773836176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e941a0770 con 0x7f7e94107c80 2024-04-20T12:22:33.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.036+0000 7f7e837fe640 1 -- 172.21.15.135:0/2773836176 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f7e8c005020 con 0x7f7e94107c80 2024-04-20T12:22:33.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.036+0000 7f7e9b874740 1 Processor -- start 2024-04-20T12:22:33.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.036+0000 7f7e9b874740 1 -- start start 2024-04-20T12:22:33.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.036+0000 7f7e9b874740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf14cf0 0x55a3bcf15110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.036+0000 7f7e9b874740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf156e0 0x55a3bcf1a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.036+0000 7f7e9b874740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf1a850 0x55a3bcf1cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.036+0000 7f7e9b874740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a3bce28290 con 0x55a3bcf156e0 2024-04-20T12:22:33.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.036+0000 7f7e9b874740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a3bce85a40 con 0x55a3bcf14cf0 2024-04-20T12:22:33.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.036+0000 7f7e9b874740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a3bce40a30 con 0x55a3bcf1a850 2024-04-20T12:22:33.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.036+0000 7f7e9259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf156e0 0x55a3bcf1a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.036+0000 7f7e9259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf156e0 0x55a3bcf1a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41206/0 (socket says 172.21.15.135:41206) 2024-04-20T12:22:33.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.036+0000 7f7e9259c640 1 -- 172.21.15.135:0/1832311606 learned_addr learned my addr 172.21.15.135:0/1832311606 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:33.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.037+0000 7f7e91d9b640 1 --2- 172.21.15.135:0/1832311606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf14cf0 0x55a3bcf15110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.037+0000 7f7e91d9b640 1 --2- 172.21.15.135:0/1832311606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf1a850 0x55a3bcf1cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.037+0000 7f7e9259c640 1 -- 172.21.15.135:0/1832311606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf1a850 msgr2=0x55a3bcf1cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.037+0000 7f7e9259c640 1 --2- 172.21.15.135:0/1832311606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf1a850 0x55a3bcf1cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.037+0000 7f7e9259c640 1 -- 172.21.15.135:0/1832311606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf14cf0 msgr2=0x55a3bcf15110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.037+0000 7f7e9259c640 1 --2- 172.21.15.135:0/1832311606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf14cf0 0x55a3bcf15110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.037+0000 7f7e837fe640 1 --2- 172.21.15.135:0/2773836176 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7e7c0a3c40 0x7f7e7c0a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.037+0000 7f7e9259c640 1 -- 172.21.15.135:0/1832311606 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3bce33c10 con 0x55a3bcf156e0 2024-04-20T12:22:33.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.037+0000 7f7e92d9d640 1 --2- 172.21.15.135:0/2773836176 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7e7c0a3c40 0x7f7e7c0a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.037+0000 7f7e9259c640 1 --2- 172.21.15.135:0/1832311606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf156e0 0x55a3bcf1a1e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009c90 tx=0x7f7e840117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874193eca7a91e25 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:33.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.037+0000 7f7e837fe640 1 -- 172.21.15.135:0/2773836176 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f7e8c0d0ef0 con 0x7f7e94107c80 2024-04-20T12:22:33.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.037+0000 7f7e80ff9640 1 -- 172.21.15.135:0/1832311606 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84012450 con 0x55a3bcf156e0 2024-04-20T12:22:33.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.037+0000 7f7e80ff9640 1 -- 172.21.15.135:0/1832311606 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e84012ad0 con 0x55a3bcf156e0 2024-04-20T12:22:33.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.037+0000 7f7e80ff9640 1 -- 172.21.15.135:0/1832311606 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8400fc30 con 0x55a3bcf156e0 2024-04-20T12:22:33.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.038+0000 7f7e9b874740 1 -- 172.21.15.135:0/1832311606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf156e0 msgr2=0x55a3bcf1a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.038+0000 7f7e92d9d640 1 --2- 172.21.15.135:0/2773836176 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7e7c0a3c40 0x7f7e7c0a6100 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c099190 tx=0x7f7e8c06e7c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:33.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.038+0000 7f7e9b874740 1 --2- 172.21.15.135:0/1832311606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf156e0 0x55a3bcf1a1e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009c90 tx=0x7f7e840117b0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.038+0000 7f7e9b874740 1 -- 172.21.15.135:0/1832311606 shutdown_connections 2024-04-20T12:22:33.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.038+0000 7f7e9b874740 1 --2- 172.21.15.135:0/1832311606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf1a850 0x55a3bcf1cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.038+0000 7f7e9b874740 1 --2- 172.21.15.135:0/1832311606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf156e0 0x55a3bcf1a1e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.038+0000 7f7e9b874740 1 --2- 172.21.15.135:0/1832311606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf14cf0 0x55a3bcf15110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.038+0000 7f7e9b874740 1 -- 172.21.15.135:0/1832311606 >> 172.21.15.135:0/1832311606 conn(0x55a3bcf10260 msgr2=0x55a3bcf10660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:33.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.038+0000 7f7e9b874740 1 -- 172.21.15.135:0/1832311606 shutdown_connections 2024-04-20T12:22:33.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.038+0000 7f7e9b874740 1 -- 172.21.15.135:0/1832311606 wait complete. 2024-04-20T12:22:33.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.038+0000 7f7e9b874740 1 -- start start 2024-04-20T12:22:33.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.038+0000 7f7e9b874740 1 Processor -- start 2024-04-20T12:22:33.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e9b874740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf14cf0 0x55a3bcf1ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e9b874740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf156e0 0x55a3bcf1f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.050 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e9b874740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf26400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e9b874740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a3bce7f140 con 0x55a3bcf1a850 2024-04-20T12:22:33.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e9b874740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a3bce79e20 con 0x55a3bcf14cf0 2024-04-20T12:22:33.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e9b874740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a3bce87d20 con 0x55a3bcf156e0 2024-04-20T12:22:33.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e9b874740 10 client.0 _ll_register_callbacks cb 0x55a3bce705c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:33.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e91d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf26400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e91d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf26400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41222/0 (socket says 172.21.15.135:41222) 2024-04-20T12:22:33.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e91d9b640 1 -- 172.21.15.135:0/451554928 learned_addr learned my addr 172.21.15.135:0/451554928 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:33.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e9259c640 1 --2- 172.21.15.135:0/451554928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf156e0 0x55a3bcf1f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e91d9b640 1 --2- 172.21.15.135:0/451554928 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf14cf0 0x55a3bcf1ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e91d9b640 1 -- 172.21.15.135:0/451554928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf156e0 msgr2=0x55a3bcf1f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e91d9b640 1 --2- 172.21.15.135:0/451554928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf156e0 0x55a3bcf1f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e91d9b640 1 -- 172.21.15.135:0/451554928 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf14cf0 msgr2=0x55a3bcf1ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e91d9b640 1 --2- 172.21.15.135:0/451554928 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf14cf0 0x55a3bcf1ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e91d9b640 1 -- 172.21.15.135:0/451554928 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3bcb8d2d0 con 0x55a3bcf1a850 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e91d9b640 1 --2- 172.21.15.135:0/451554928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf26400 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7e8802c7b0 tx=0x7f7e88005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586a5b197b5dc329 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e79ffb640 1 -- 172.21.15.135:0/451554928 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88005500 con 0x55a3bcf1a850 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e79ffb640 1 -- 172.21.15.135:0/451554928 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f7e880046c0 con 0x55a3bcf1a850 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.039+0000 7f7e9b874740 1 -- 172.21.15.135:0/451554928 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e84012ad0 con 0x55a3bcf1a850 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.040+0000 7f7e79ffb640 1 -- 172.21.15.135:0/451554928 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e88053050 con 0x55a3bcf1a850 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.040+0000 7f7e9b874740 10 client.15282 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.040+0000 7f7e9b874740 1 -- 172.21.15.135:0/451554928 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a3bcc576b0 con 0x55a3bcf1a850 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.040+0000 7f7e79ffb640 1 -- 172.21.15.135:0/451554928 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e84012ad0 con 0x55a3bcf1a850 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.040+0000 7f7e79ffb640 1 -- 172.21.15.135:0/451554928 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7f7e88034920 con 0x55a3bcf1a850 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.040+0000 7f7e9b874740 10 client.15282 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.040+0000 7f7e9b874740 10 client.15282 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.040+0000 7f7e9b874740 20 client.15282 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.040+0000 7f7e9b874740 1 --2- 172.21.15.135:0/451554928 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55a3bcf2baa0 0x55a3bcf2cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.040+0000 7f7e9b874740 4 client.15282 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:22:33.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.040+0000 7f7e9b874740 1 -- 172.21.15.135:0/451554928 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3bce01510 con 0x55a3bcf2baa0 2024-04-20T12:22:33.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.040+0000 7f7e9259c640 1 --2- 172.21.15.135:0/451554928 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55a3bcf2baa0 0x55a3bcf2cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.041+0000 7f7e79ffb640 10 client.15282 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:22:33.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.041+0000 7f7e9259c640 1 --2- 172.21.15.135:0/451554928 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55a3bcf2baa0 0x55a3bcf2cf10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d8738a17b113a174 server_cookie=fb77904f5f6c398f in_seq=0 out_seq=0 2024-04-20T12:22:33.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.042+0000 7f7e79ffb640 1 -- 172.21.15.135:0/451554928 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a3bce01510 con 0x55a3bcf2baa0 2024-04-20T12:22:33.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.042+0000 7f7e79ffb640 10 client.15282 handle_command_reply: tid=0 2024-04-20T12:22:33.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.042+0000 7f7e9b874740 1 client.15282 shutdown 2024-04-20T12:22:33.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.042+0000 7f7e9b874740 1 -- 172.21.15.135:0/451554928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 msgr2=0x55a3bcf26400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.042+0000 7f7e9b874740 1 --2- 172.21.15.135:0/451554928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf26400 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7e8802c7b0 tx=0x7f7e88005b70 comp rx=0 tx=0).stop 2024-04-20T12:22:33.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.042+0000 7f7e9b874740 1 -- 172.21.15.135:0/451554928 shutdown_connections 2024-04-20T12:22:33.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.042+0000 7f7e9b874740 1 --2- 172.21.15.135:0/451554928 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55a3bcf2baa0 0x55a3bcf2cf10 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.042+0000 7f7e9b874740 1 --2- 172.21.15.135:0/451554928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf26400 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.042+0000 7f7e79ffb640 0 client.15282 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:22:33.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.042+0000 7f7e9b874740 1 --2- 172.21.15.135:0/451554928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf156e0 0x55a3bcf1f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.042+0000 7f7e9b874740 1 --2- 172.21.15.135:0/451554928 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf14cf0 0x55a3bcf1ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.042+0000 7f7e9b874740 1 -- 172.21.15.135:0/451554928 >> 172.21.15.135:0/451554928 conn(0x55a3bcf10260 msgr2=0x55a3bcf0f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:33.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.042+0000 7f7e9b874740 1 -- 172.21.15.135:0/451554928 shutdown_connections 2024-04-20T12:22:33.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.042+0000 7f7e9b874740 1 -- 172.21.15.135:0/451554928 wait complete. 2024-04-20T12:22:33.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.042+0000 7f7e9b874740 20 client.15282 trim_cache size 0 max 16384 2024-04-20T12:22:33.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e9b874740 1 Processor -- start 2024-04-20T12:22:33.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e9b874740 1 -- start start 2024-04-20T12:22:33.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e9b874740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf14cf0 0x55a3bcf10640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e9b874740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf156e0 0x55a3bcf26320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e9b874740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf1ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e9b874740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a3bcf2b250 con 0x55a3bcf1a850 2024-04-20T12:22:33.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e9b874740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a3bcf2b920 con 0x55a3bcf156e0 2024-04-20T12:22:33.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e9b874740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a3bcf2bff0 con 0x55a3bcf14cf0 2024-04-20T12:22:33.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e91d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf1ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e91d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf1ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41232/0 (socket says 172.21.15.135:41232) 2024-04-20T12:22:33.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e91d9b640 1 -- 172.21.15.135:0/1177973137 learned_addr learned my addr 172.21.15.135:0/1177973137 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:33.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e91d9b640 1 -- 172.21.15.135:0/1177973137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf14cf0 msgr2=0x55a3bcf10640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e91d9b640 1 --2- 172.21.15.135:0/1177973137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf14cf0 0x55a3bcf10640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e91d9b640 1 -- 172.21.15.135:0/1177973137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf156e0 msgr2=0x55a3bcf26320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e91d9b640 1 --2- 172.21.15.135:0/1177973137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf156e0 0x55a3bcf26320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e91d9b640 1 -- 172.21.15.135:0/1177973137 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3bcf19e30 con 0x55a3bcf1a850 2024-04-20T12:22:33.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.060+0000 7f7e91d9b640 1 --2- 172.21.15.135:0/1177973137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf1ea90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7e8802c420 tx=0x7f7e88005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cad98809f3a848c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:33.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.061+0000 7f7e7bfff640 1 -- 172.21.15.135:0/1177973137 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88005850 con 0x55a3bcf1a850 2024-04-20T12:22:33.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.061+0000 7f7e7bfff640 1 -- 172.21.15.135:0/1177973137 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e88005500 con 0x55a3bcf1a850 2024-04-20T12:22:33.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.061+0000 7f7e7bfff640 1 -- 172.21.15.135:0/1177973137 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88004b20 con 0x55a3bcf1a850 2024-04-20T12:22:33.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.061+0000 7f7e9b874740 1 -- 172.21.15.135:0/1177973137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 msgr2=0x55a3bcf1ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.061+0000 7f7e9b874740 1 --2- 172.21.15.135:0/1177973137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf1ea90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7e8802c420 tx=0x7f7e88005fd0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.061+0000 7f7e9b874740 1 -- 172.21.15.135:0/1177973137 shutdown_connections 2024-04-20T12:22:33.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.061+0000 7f7e9b874740 1 --2- 172.21.15.135:0/1177973137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf1ea90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.061+0000 7f7e9b874740 1 --2- 172.21.15.135:0/1177973137 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf156e0 0x55a3bcf26320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.061+0000 7f7e9b874740 1 --2- 172.21.15.135:0/1177973137 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf14cf0 0x55a3bcf10640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.061+0000 7f7e9b874740 1 -- 172.21.15.135:0/1177973137 >> 172.21.15.135:0/1177973137 conn(0x55a3bcf10260 msgr2=0x55a3bcf2aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:33.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.061+0000 7f7e9b874740 1 -- 172.21.15.135:0/1177973137 shutdown_connections 2024-04-20T12:22:33.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.061+0000 7f7e9b874740 1 -- 172.21.15.135:0/1177973137 wait complete. 2024-04-20T12:22:33.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.061+0000 7f7e9b874740 1 -- start start 2024-04-20T12:22:33.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e9b874740 1 Processor -- start 2024-04-20T12:22:33.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e9b874740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf14cf0 0x55a3bcf24310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e9b874740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf156e0 0x55a3bcf8da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e9b874740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf8ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e9b874740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a3bcf2cd90 con 0x55a3bcf1a850 2024-04-20T12:22:33.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e9b874740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a3bcf2c6c0 con 0x55a3bcf156e0 2024-04-20T12:22:33.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e9b874740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a3bcf2d460 con 0x55a3bcf14cf0 2024-04-20T12:22:33.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e9b874740 10 client.0 _ll_register_callbacks cb 0x7f7e84005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:33.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e91d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf8ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e91d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf8ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41244/0 (socket says 172.21.15.135:41244) 2024-04-20T12:22:33.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e91d9b640 1 -- 172.21.15.135:0/448326675 learned_addr learned my addr 172.21.15.135:0/448326675 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:33.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e91d9b640 1 --2- 172.21.15.135:0/448326675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf14cf0 0x55a3bcf24310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e9259c640 1 --2- 172.21.15.135:0/448326675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf156e0 0x55a3bcf8da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e91d9b640 1 -- 172.21.15.135:0/448326675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf14cf0 msgr2=0x55a3bcf24310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e91d9b640 1 --2- 172.21.15.135:0/448326675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf14cf0 0x55a3bcf24310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e91d9b640 1 -- 172.21.15.135:0/448326675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf156e0 msgr2=0x55a3bcf8da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e91d9b640 1 --2- 172.21.15.135:0/448326675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf156e0 0x55a3bcf8da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e91d9b640 1 -- 172.21.15.135:0/448326675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3bcf90760 con 0x55a3bcf1a850 2024-04-20T12:22:33.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e9259c640 1 --2- 172.21.15.135:0/448326675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf156e0 0x55a3bcf8da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:33.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:33.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e91d9b640 1 --2- 172.21.15.135:0/448326675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf8ff80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009610 tx=0x7f7e8802ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee959cb7869d7ee server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:33.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e79ffb640 1 -- 172.21.15.135:0/448326675 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e88005850 con 0x55a3bcf1a850 2024-04-20T12:22:33.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e79ffb640 1 -- 172.21.15.135:0/448326675 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f7e88004ab0 con 0x55a3bcf1a850 2024-04-20T12:22:33.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.062+0000 7f7e9b874740 1 -- 172.21.15.135:0/448326675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e88005500 con 0x55a3bcf1a850 2024-04-20T12:22:33.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.063+0000 7f7e79ffb640 1 -- 172.21.15.135:0/448326675 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e88034440 con 0x55a3bcf1a850 2024-04-20T12:22:33.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.063+0000 7f7e9b874740 10 client.15288 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:33.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.063+0000 7f7e9b874740 1 -- 172.21.15.135:0/448326675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a3bcf91a40 con 0x55a3bcf1a850 2024-04-20T12:22:33.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.063+0000 7f7e79ffb640 1 -- 172.21.15.135:0/448326675 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e88005500 con 0x55a3bcf1a850 2024-04-20T12:22:33.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.063+0000 7f7e79ffb640 1 -- 172.21.15.135:0/448326675 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7f7e8804c8d0 con 0x55a3bcf1a850 2024-04-20T12:22:33.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.063+0000 7f7e9b874740 10 client.15288 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:33.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.063+0000 7f7e9b874740 10 client.15288 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-20T12:22:33.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.063+0000 7f7e9b874740 20 client.15288 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:33.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.063+0000 7f7e9b874740 1 --2- 172.21.15.135:0/448326675 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55a3bcf962c0 0x55a3bcf94fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.063+0000 7f7e9b874740 4 client.15288 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T12:22:33.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.063+0000 7f7e9b874740 1 -- 172.21.15.135:0/448326675 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "status"}) -- 0x55a3bce88530 con 0x55a3bcf962c0 2024-04-20T12:22:33.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.063+0000 7f7e9259c640 1 --2- 172.21.15.135:0/448326675 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55a3bcf962c0 0x55a3bcf94fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e79ffb640 10 client.15288 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:22:33.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e9259c640 1 --2- 172.21.15.135:0/448326675 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55a3bcf962c0 0x55a3bcf94fd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5903cfa2ae5bd006 server_cookie=c817f8cb1b41296a in_seq=0 out_seq=0 2024-04-20T12:22:33.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e79ffb640 1 -- 172.21.15.135:0/448326675 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a3bce88530 con 0x55a3bcf962c0 2024-04-20T12:22:33.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e79ffb640 10 client.15288 handle_command_reply: tid=0 2024-04-20T12:22:33.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e9b874740 1 client.15288 shutdown 2024-04-20T12:22:33.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e9b874740 1 -- 172.21.15.135:0/448326675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 msgr2=0x55a3bcf8ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e9b874740 1 --2- 172.21.15.135:0/448326675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf8ff80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009610 tx=0x7f7e8802ce50 comp rx=0 tx=0).stop 2024-04-20T12:22:33.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e9b874740 1 -- 172.21.15.135:0/448326675 shutdown_connections 2024-04-20T12:22:33.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e9b874740 1 --2- 172.21.15.135:0/448326675 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55a3bcf962c0 0x55a3bcf94fd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e9b874740 1 --2- 172.21.15.135:0/448326675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a3bcf1a850 0x55a3bcf8ff80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e79ffb640 0 client.15288 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:22:33.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e9b874740 1 --2- 172.21.15.135:0/448326675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a3bcf156e0 0x55a3bcf8da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e9b874740 1 --2- 172.21.15.135:0/448326675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a3bcf14cf0 0x55a3bcf24310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e9b874740 1 -- 172.21.15.135:0/448326675 >> 172.21.15.135:0/448326675 conn(0x55a3bcf10260 msgr2=0x55a3bcf10640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:33.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e9b874740 1 -- 172.21.15.135:0/448326675 shutdown_connections 2024-04-20T12:22:33.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e9b874740 1 -- 172.21.15.135:0/448326675 wait complete. 2024-04-20T12:22:33.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.064+0000 7f7e9b874740 20 client.15288 trim_cache size 0 max 16384 2024-04-20T12:22:33.072 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:22:33.072 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "22180be8-ff0f-11ee-bc92-c7b262605968", 2024-04-20T12:22:33.072 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 1, 2024-04-20T12:22:33.072 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24476, 2024-04-20T12:22:33.072 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-04-20T12:22:33.072 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-04-20T12:22:33.072 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-04-20T12:22:33.072 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 87.161020739999998, 2024-04-20T12:22:33.072 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 28, 2024-04-20T12:22:33.072 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 92, 2024-04-20T12:22:33.072 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 90, 2024-04-20T12:22:33.073 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 117.071619244 2024-04-20T12:22:33.073 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:22:33.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.065+0000 7f7e98c81640 1 -- 172.21.15.135:0/2773836176 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7e7c0a3c40 msgr2=0x7f7e7c0a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.065+0000 7f7e98c81640 1 --2- 172.21.15.135:0/2773836176 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7e7c0a3c40 0x7f7e7c0a6100 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c099190 tx=0x7f7e8c06e7c0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.065+0000 7f7e98c81640 1 -- 172.21.15.135:0/2773836176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e94107c80 msgr2=0x7f7e9419f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.065+0000 7f7e98c81640 1 --2- 172.21.15.135:0/2773836176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e94107c80 0x7f7e9419f8f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00eb10 tx=0x7f7e8c00c2d0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.065+0000 7f7e98c81640 1 -- 172.21.15.135:0/2773836176 shutdown_connections 2024-04-20T12:22:33.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.065+0000 7f7e98c81640 1 --2- 172.21.15.135:0/2773836176 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f7e7c0a3c40 0x7f7e7c0a6100 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.065+0000 7f7e98c81640 1 --2- 172.21.15.135:0/2773836176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7e94107c80 0x7f7e9419f8f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.065+0000 7f7e98c81640 1 --2- 172.21.15.135:0/2773836176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7e94105350 0x7f7e94198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.065+0000 7f7e98c81640 1 --2- 172.21.15.135:0/2773836176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7e94102a20 0x7f7e94198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.065+0000 7f7e98c81640 1 -- 172.21.15.135:0/2773836176 >> 172.21.15.135:0/2773836176 conn(0x7f7e940fc410 msgr2=0x7f7e941035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:33.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.065+0000 7f7e98c81640 1 -- 172.21.15.135:0/2773836176 shutdown_connections 2024-04-20T12:22:33.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.065+0000 7f7e98c81640 1 -- 172.21.15.135:0/2773836176 wait complete. 2024-04-20T12:22:33.075 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:32 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1967223212' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:33.075 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:32 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3391074995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:22:33.076 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-20T12:22:33.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.174+0000 7fd5c6985640 1 -- 172.21.15.135:0/1183833168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c01029b0 msgr2=0x7fd5c01092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.174+0000 7fd5c6985640 1 --2- 172.21.15.135:0/1183833168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c01029b0 0x7fd5c01092d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009ca0 tx=0x7fd5b802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.174+0000 7fd5c6985640 1 -- 172.21.15.135:0/1183833168 shutdown_connections 2024-04-20T12:22:33.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.174+0000 7fd5c6985640 1 --2- 172.21.15.135:0/1183833168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c01029b0 0x7fd5c01092d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.174+0000 7fd5c6985640 1 --2- 172.21.15.135:0/1183833168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5c0101ff0 0x7fd5c0102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.174+0000 7fd5c6985640 1 --2- 172.21.15.135:0/1183833168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5c0100ea0 0x7fd5c01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.174+0000 7fd5c6985640 1 -- 172.21.15.135:0/1183833168 >> 172.21.15.135:0/1183833168 conn(0x7fd5c00fc410 msgr2=0x7fd5c00fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:33.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.174+0000 7fd5c6985640 1 -- 172.21.15.135:0/1183833168 shutdown_connections 2024-04-20T12:22:33.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.174+0000 7fd5c6985640 1 -- 172.21.15.135:0/1183833168 wait complete. 2024-04-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.174+0000 7fd5c6985640 1 Processor -- start 2024-04-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.174+0000 7fd5c6985640 1 -- start start 2024-04-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5c6985640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c0100ea0 0x7fd5c01982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5c6985640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5c0101ff0 0x7fd5c01987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5c6985640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5c01029b0 0x7fd5c019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5c6985640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c010cb30 con 0x7fd5c0100ea0 2024-04-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5c6985640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c010c9b0 con 0x7fd5c0101ff0 2024-04-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5c6985640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c010ccb0 con 0x7fd5c01029b0 2024-04-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5bffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c0100ea0 0x7fd5c01982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5bffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c0100ea0 0x7fd5c01982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41252/0 (socket says 172.21.15.135:41252) 2024-04-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5bffff640 1 -- 172.21.15.135:0/3336717767 learned_addr learned my addr 172.21.15.135:0/3336717767 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:33.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5bf7fe640 1 --2- 172.21.15.135:0/3336717767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5c0101ff0 0x7fd5c01987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5c4f22640 1 --2- 172.21.15.135:0/3336717767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5c01029b0 0x7fd5c019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5bffff640 1 -- 172.21.15.135:0/3336717767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5c01029b0 msgr2=0x7fd5c019f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5bffff640 1 --2- 172.21.15.135:0/3336717767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5c01029b0 0x7fd5c019f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5bffff640 1 -- 172.21.15.135:0/3336717767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5c0101ff0 msgr2=0x7fd5c01987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5bffff640 1 --2- 172.21.15.135:0/3336717767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5c0101ff0 0x7fd5c01987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5bffff640 1 -- 172.21.15.135:0/3336717767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c019fed0 con 0x7fd5c0100ea0 2024-04-20T12:22:33.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5bf7fe640 1 --2- 172.21.15.135:0/3336717767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5c0101ff0 0x7fd5c01987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:33.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5bffff640 1 --2- 172.21.15.135:0/3336717767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c0100ea0 0x7fd5c01982b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000d950 tx=0x7fd5b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:33.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.175+0000 7fd5bd7fa640 1 -- 172.21.15.135:0/3336717767 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0017030 con 0x7fd5c0100ea0 2024-04-20T12:22:33.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.176+0000 7fd5c6985640 1 -- 172.21.15.135:0/3336717767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c01a01c0 con 0x7fd5c0100ea0 2024-04-20T12:22:33.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.176+0000 7fd5bd7fa640 1 -- 172.21.15.135:0/3336717767 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5b0004020 con 0x7fd5c0100ea0 2024-04-20T12:22:33.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.176+0000 7fd5bd7fa640 1 -- 172.21.15.135:0/3336717767 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00047a0 con 0x7fd5c0100ea0 2024-04-20T12:22:33.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.176+0000 7fd5c6985640 1 -- 172.21.15.135:0/3336717767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c01a0710 con 0x7fd5c0100ea0 2024-04-20T12:22:33.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.178+0000 7fd5bd7fa640 1 -- 172.21.15.135:0/3336717767 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7fd5b00041d0 con 0x7fd5c0100ea0 2024-04-20T12:22:33.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.178+0000 7fd5c9572740 1 Processor -- start 2024-04-20T12:22:33.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5c9572740 1 -- start start 2024-04-20T12:22:33.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5c9572740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 0x55efc08db110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5c9572740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08e01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5c9572740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08e0850 0x55efc08e2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5c9572740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55efc07ee290 con 0x55efc08db6e0 2024-04-20T12:22:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5c9572740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55efc084ba40 con 0x55efc08dacf0 2024-04-20T12:22:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5c9572740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55efc0806a30 con 0x55efc08e0850 2024-04-20T12:22:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5bffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08e01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5bffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08e01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41260/0 (socket says 172.21.15.135:41260) 2024-04-20T12:22:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5bffff640 1 -- 172.21.15.135:0/4237546899 learned_addr learned my addr 172.21.15.135:0/4237546899 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5c4f22640 1 --2- 172.21.15.135:0/4237546899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 0x55efc08db110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5bf7fe640 1 --2- 172.21.15.135:0/4237546899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08e0850 0x55efc08e2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5bd7fa640 1 --2- 172.21.15.135:0/3336717767 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd5a80a3c40 0x7fd5a80a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5bffff640 1 -- 172.21.15.135:0/4237546899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08e0850 msgr2=0x55efc08e2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5bffff640 1 --2- 172.21.15.135:0/4237546899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08e0850 0x55efc08e2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5bffff640 1 -- 172.21.15.135:0/4237546899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 msgr2=0x55efc08db110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5bffff640 1 --2- 172.21.15.135:0/4237546899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 0x55efc08db110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5bffff640 1 -- 172.21.15.135:0/4237546899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efc07f9c10 con 0x55efc08db6e0 2024-04-20T12:22:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5c4f22640 1 --2- 172.21.15.135:0/4237546899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 0x55efc08db110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5c4f22640 1 --2- 172.21.15.135:0/3336717767 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd5a80a3c40 0x7fd5a80a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5bd7fa640 1 -- 172.21.15.135:0/3336717767 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fd5b00d0440 con 0x7fd5c0100ea0 2024-04-20T12:22:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.179+0000 7fd5bffff640 1 --2- 172.21.15.135:0/4237546899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08e01e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00cd9f0 tx=0x7fd5b0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fcf57894bfa23 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.180+0000 7fd5c4f22640 1 --2- 172.21.15.135:0/3336717767 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd5a80a3c40 0x7fd5a80a6100 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80324c0 tx=0x7fd5b80095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.180+0000 7fd5a67fc640 1 -- 172.21.15.135:0/4237546899 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b009c050 con 0x55efc08db6e0 2024-04-20T12:22:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.180+0000 7fd5a67fc640 1 -- 172.21.15.135:0/4237546899 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5b00488f0 con 0x55efc08db6e0 2024-04-20T12:22:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.180+0000 7fd5a67fc640 1 -- 172.21.15.135:0/4237546899 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b009bbe0 con 0x55efc08db6e0 2024-04-20T12:22:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.180+0000 7fd5c9572740 1 -- 172.21.15.135:0/4237546899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 msgr2=0x55efc08e01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.180+0000 7fd5c9572740 1 --2- 172.21.15.135:0/4237546899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08e01e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00cd9f0 tx=0x7fd5b0021000 comp rx=0 tx=0).stop 2024-04-20T12:22:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.180+0000 7fd5c9572740 1 -- 172.21.15.135:0/4237546899 shutdown_connections 2024-04-20T12:22:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.180+0000 7fd5c9572740 1 --2- 172.21.15.135:0/4237546899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08e0850 0x55efc08e2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.180+0000 7fd5c9572740 1 --2- 172.21.15.135:0/4237546899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08e01e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.180+0000 7fd5c9572740 1 --2- 172.21.15.135:0/4237546899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 0x55efc08db110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.180+0000 7fd5c9572740 1 -- 172.21.15.135:0/4237546899 >> 172.21.15.135:0/4237546899 conn(0x55efc08d6260 msgr2=0x55efc08d6660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.180+0000 7fd5c9572740 1 -- 172.21.15.135:0/4237546899 shutdown_connections 2024-04-20T12:22:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.180+0000 7fd5c9572740 1 -- 172.21.15.135:0/4237546899 wait complete. 2024-04-20T12:22:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.181+0000 7fd5c9572740 1 -- start start 2024-04-20T12:22:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.181+0000 7fd5c9572740 1 Processor -- start 2024-04-20T12:22:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.181+0000 7fd5c9572740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 0x55efc08e4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.181+0000 7fd5c9572740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08e53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.181+0000 7fd5c9572740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08e0850 0x55efc08ec420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.181+0000 7fd5c9572740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55efc0845140 con 0x55efc08db6e0 2024-04-20T12:22:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.181+0000 7fd5c9572740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55efc083fe20 con 0x55efc08dacf0 2024-04-20T12:22:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.181+0000 7fd5c9572740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55efc084dd20 con 0x55efc08e0850 2024-04-20T12:22:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.181+0000 7fd5c9572740 10 client.0 _ll_register_callbacks cb 0x55efc08365c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:33.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.181+0000 7fd5bf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08e53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.181+0000 7fd5bf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08e53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41264/0 (socket says 172.21.15.135:41264) 2024-04-20T12:22:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.181+0000 7fd5bf7fe640 1 -- 172.21.15.135:0/3438935421 learned_addr learned my addr 172.21.15.135:0/3438935421 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.181+0000 7fd5c4f22640 1 --2- 172.21.15.135:0/3438935421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08e0850 0x55efc08ec420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd5bffff640 1 --2- 172.21.15.135:0/3438935421 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 0x55efc08e4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd5bf7fe640 1 -- 172.21.15.135:0/3438935421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08e0850 msgr2=0x55efc08ec420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd5bf7fe640 1 --2- 172.21.15.135:0/3438935421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08e0850 0x55efc08ec420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd5bf7fe640 1 -- 172.21.15.135:0/3438935421 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 msgr2=0x55efc08e4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd5bf7fe640 1 --2- 172.21.15.135:0/3438935421 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 0x55efc08e4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd5bf7fe640 1 -- 172.21.15.135:0/3438935421 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efc05532d0 con 0x55efc08db6e0 2024-04-20T12:22:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd5c4f22640 1 --2- 172.21.15.135:0/3438935421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08e0850 0x55efc08ec420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd5bf7fe640 1 --2- 172.21.15.135:0/3438935421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08e53e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400bec0 tx=0x7fd5b4012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdf6408e6c5e4b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd59f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd59f7fe640 1 -- 172.21.15.135:0/3438935421 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4004220 con 0x55efc08db6e0 2024-04-20T12:22:33.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd59f7fe640 1 -- 172.21.15.135:0/3438935421 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fd5b40043c0 con 0x55efc08db6e0 2024-04-20T12:22:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd5c9572740 1 -- 172.21.15.135:0/3438935421 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55efc07c7510 con 0x55efc08db6e0 2024-04-20T12:22:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd59f7fe640 1 -- 172.21.15.135:0/3438935421 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd5b4024050 con 0x55efc08db6e0 2024-04-20T12:22:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd5c9572740 10 client.15300 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd5c9572740 1 -- 172.21.15.135:0/3438935421 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55efc061d6b0 con 0x55efc08db6e0 2024-04-20T12:22:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd59f7fe640 1 -- 172.21.15.135:0/3438935421 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55efc07c7510 con 0x55efc08db6e0 2024-04-20T12:22:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd59f7fe640 1 -- 172.21.15.135:0/3438935421 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7fd5b4019030 con 0x55efc08db6e0 2024-04-20T12:22:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd5c9572740 10 client.15300 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd5c9572740 10 client.15300 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-20T12:22:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.182+0000 7fd5c9572740 20 client.15300 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.183+0000 7fd5c9572740 1 --2- 172.21.15.135:0/3438935421 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55efc08f1c40 0x55efc08f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.183+0000 7fd5c9572740 4 client.15300 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:22:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.183+0000 7fd5c9572740 1 -- 172.21.15.135:0/3438935421 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efc084e530 con 0x55efc08f1c40 2024-04-20T12:22:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.183+0000 7fd5bffff640 1 --2- 172.21.15.135:0/3438935421 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55efc08f1c40 0x55efc08f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.183+0000 7fd59f7fe640 10 client.15300 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:22:33.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.183+0000 7fd5bffff640 1 --2- 172.21.15.135:0/3438935421 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55efc08f1c40 0x55efc08f30b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12a9811f221284c1 server_cookie=2e5758d417b4dc1d in_seq=0 out_seq=0 2024-04-20T12:22:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.184+0000 7fd59f7fe640 1 -- 172.21.15.135:0/3438935421 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55efc084e530 con 0x55efc08f1c40 2024-04-20T12:22:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.184+0000 7fd59f7fe640 10 client.15300 handle_command_reply: tid=0 2024-04-20T12:22:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.184+0000 7fd5c9572740 1 client.15300 shutdown 2024-04-20T12:22:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.184+0000 7fd5c9572740 1 -- 172.21.15.135:0/3438935421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 msgr2=0x55efc08e53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.184+0000 7fd5c9572740 1 --2- 172.21.15.135:0/3438935421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08e53e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400bec0 tx=0x7fd5b4012820 comp rx=0 tx=0).stop 2024-04-20T12:22:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.184+0000 7fd5c9572740 1 -- 172.21.15.135:0/3438935421 shutdown_connections 2024-04-20T12:22:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.184+0000 7fd5c9572740 1 --2- 172.21.15.135:0/3438935421 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55efc08f1c40 0x55efc08f30b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.184+0000 7fd5c9572740 1 --2- 172.21.15.135:0/3438935421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08e0850 0x55efc08ec420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.184+0000 7fd5c9572740 1 --2- 172.21.15.135:0/3438935421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08e53e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.184+0000 7fd5c9572740 1 --2- 172.21.15.135:0/3438935421 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 0x55efc08e4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.184+0000 7fd59f7fe640 0 client.15300 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:22:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.184+0000 7fd5c9572740 1 -- 172.21.15.135:0/3438935421 >> 172.21.15.135:0/3438935421 conn(0x55efc08d6260 msgr2=0x55efc08d53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.184+0000 7fd5c9572740 1 -- 172.21.15.135:0/3438935421 shutdown_connections 2024-04-20T12:22:33.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.184+0000 7fd5c9572740 1 -- 172.21.15.135:0/3438935421 wait complete. 2024-04-20T12:22:33.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.185+0000 7fd5c9572740 20 client.15300 trim_cache size 0 max 16384 2024-04-20T12:22:33.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.202+0000 7fd5c9572740 1 Processor -- start 2024-04-20T12:22:33.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.202+0000 7fd5c9572740 1 -- start start 2024-04-20T12:22:33.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.202+0000 7fd5c9572740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08dacf0 0x55efc08e39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.202+0000 7fd5c9572740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08db6e0 0x55efc08e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.202+0000 7fd5c9572740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08e0850 0x55efc08dcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.202+0000 7fd5c9572740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55efc08f13f0 con 0x55efc08e0850 2024-04-20T12:22:33.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.202+0000 7fd5c9572740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55efc08f1ac0 con 0x55efc08db6e0 2024-04-20T12:22:33.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.202+0000 7fd5c9572740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55efc08f2190 con 0x55efc08dacf0 2024-04-20T12:22:33.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.202+0000 7fd5c4f22640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08e0850 0x55efc08dcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.203+0000 7fd5c4f22640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08e0850 0x55efc08dcbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41270/0 (socket says 172.21.15.135:41270) 2024-04-20T12:22:33.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.203+0000 7fd5c4f22640 1 -- 172.21.15.135:0/3753317503 learned_addr learned my addr 172.21.15.135:0/3753317503 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:33.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.203+0000 7fd5bf7fe640 1 --2- 172.21.15.135:0/3753317503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08db6e0 0x55efc08e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.203+0000 7fd5bffff640 1 --2- 172.21.15.135:0/3753317503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08dacf0 0x55efc08e39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.203+0000 7fd5c4f22640 1 -- 172.21.15.135:0/3753317503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08dacf0 msgr2=0x55efc08e39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.203+0000 7fd5c4f22640 1 --2- 172.21.15.135:0/3753317503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08dacf0 0x55efc08e39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.203+0000 7fd5c4f22640 1 -- 172.21.15.135:0/3753317503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08db6e0 msgr2=0x55efc08e3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.203+0000 7fd5c4f22640 1 --2- 172.21.15.135:0/3753317503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08db6e0 0x55efc08e3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.203+0000 7fd5c4f22640 1 -- 172.21.15.135:0/3753317503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efc08dbac0 con 0x55efc08e0850 2024-04-20T12:22:33.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.203+0000 7fd5c4f22640 1 --2- 172.21.15.135:0/3753317503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08e0850 0x55efc08dcbe0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80325f0 tx=0x7fd5b803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d050dda298cd9ea4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:33.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.203+0000 7fd5a5ffb640 1 -- 172.21.15.135:0/3753317503 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8050070 con 0x55efc08e0850 2024-04-20T12:22:33.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.203+0000 7fd5a5ffb640 1 -- 172.21.15.135:0/3753317503 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5b8044040 con 0x55efc08e0850 2024-04-20T12:22:33.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.203+0000 7fd5a5ffb640 1 -- 172.21.15.135:0/3753317503 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8039030 con 0x55efc08e0850 2024-04-20T12:22:33.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 -- 172.21.15.135:0/3753317503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08e0850 msgr2=0x55efc08dcbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 --2- 172.21.15.135:0/3753317503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08e0850 0x55efc08dcbe0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80325f0 tx=0x7fd5b803f000 comp rx=0 tx=0).stop 2024-04-20T12:22:33.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 -- 172.21.15.135:0/3753317503 shutdown_connections 2024-04-20T12:22:33.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 --2- 172.21.15.135:0/3753317503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08e0850 0x55efc08dcbe0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 --2- 172.21.15.135:0/3753317503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08db6e0 0x55efc08e3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 --2- 172.21.15.135:0/3753317503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08dacf0 0x55efc08e39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 -- 172.21.15.135:0/3753317503 >> 172.21.15.135:0/3753317503 conn(0x55efc08d6260 msgr2=0x55efc08d6640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:33.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 -- 172.21.15.135:0/3753317503 shutdown_connections 2024-04-20T12:22:33.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 -- 172.21.15.135:0/3753317503 wait complete. 2024-04-20T12:22:33.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 -- start start 2024-04-20T12:22:33.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 Processor -- start 2024-04-20T12:22:33.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 0x55efc08eb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08ebd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08e0850 0x55efc0959ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55efc08f2f30 con 0x55efc08db6e0 2024-04-20T12:22:33.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55efc08f2860 con 0x55efc08dacf0 2024-04-20T12:22:33.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55efc08f3600 con 0x55efc08e0850 2024-04-20T12:22:33.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5c9572740 10 client.0 _ll_register_callbacks cb 0x7fd5b400bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:33.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5bf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08ebd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5bf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08ebd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41276/0 (socket says 172.21.15.135:41276) 2024-04-20T12:22:33.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.204+0000 7fd5bf7fe640 1 -- 172.21.15.135:0/4005777145 learned_addr learned my addr 172.21.15.135:0/4005777145 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:33.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.205+0000 7fd5bf7fe640 1 -- 172.21.15.135:0/4005777145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08e0850 msgr2=0x55efc0959ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.205+0000 7fd5bf7fe640 1 --2- 172.21.15.135:0/4005777145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08e0850 0x55efc0959ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.205+0000 7fd5bf7fe640 1 -- 172.21.15.135:0/4005777145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 msgr2=0x55efc08eb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:33.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.205+0000 7fd5bffff640 1 --2- 172.21.15.135:0/4005777145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 0x55efc08eb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.205+0000 7fd5bf7fe640 1 --2- 172.21.15.135:0/4005777145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 0x55efc08eb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.205+0000 7fd5bf7fe640 1 -- 172.21.15.135:0/4005777145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efc095a4f0 con 0x55efc08db6e0 2024-04-20T12:22:33.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.205+0000 7fd5bf7fe640 1 --2- 172.21.15.135:0/4005777145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08ebd10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4000c00 tx=0x7fd5b4010b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3784610749eb9eea server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:33.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.205+0000 7fd59f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:33.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.205+0000 7fd59f7fe640 1 -- 172.21.15.135:0/4005777145 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4000e60 con 0x55efc08db6e0 2024-04-20T12:22:33.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.205+0000 7fd59f7fe640 1 -- 172.21.15.135:0/4005777145 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7fd5b4028400 con 0x55efc08db6e0 2024-04-20T12:22:33.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.205+0000 7fd5c9572740 1 -- 172.21.15.135:0/4005777145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5b8044040 con 0x55efc08db6e0 2024-04-20T12:22:33.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.205+0000 7fd59f7fe640 1 -- 172.21.15.135:0/4005777145 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd5b4037050 con 0x55efc08db6e0 2024-04-20T12:22:33.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.205+0000 7fd5c9572740 10 client.15306 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:33.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.205+0000 7fd5c9572740 1 -- 172.21.15.135:0/4005777145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55efc095b860 con 0x55efc08db6e0 2024-04-20T12:22:33.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.205+0000 7fd59f7fe640 1 -- 172.21.15.135:0/4005777145 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5b8044040 con 0x55efc08db6e0 2024-04-20T12:22:33.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.206+0000 7fd59f7fe640 1 -- 172.21.15.135:0/4005777145 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7fd5b4019070 con 0x55efc08db6e0 2024-04-20T12:22:33.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.206+0000 7fd5c9572740 10 client.15306 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:33.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.206+0000 7fd5c9572740 10 client.15306 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-20T12:22:33.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.206+0000 7fd5c9572740 20 client.15306 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:33.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.206+0000 7fd5c9572740 1 --2- 172.21.15.135:0/4005777145 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55efc09604d0 0x55efc095f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:33.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.206+0000 7fd5c9572740 4 client.15306 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T12:22:33.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.206+0000 7fd5c9572740 1 -- 172.21.15.135:0/4005777145 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "status"}) -- 0x55efc08483a0 con 0x55efc09604d0 2024-04-20T12:22:33.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.206+0000 7fd5bffff640 1 --2- 172.21.15.135:0/4005777145 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55efc09604d0 0x55efc095f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:33.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.206+0000 7fd59f7fe640 10 client.15306 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:22:33.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.206+0000 7fd5bffff640 1 --2- 172.21.15.135:0/4005777145 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55efc09604d0 0x55efc095f1e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a00e0610712aa1fd server_cookie=3b006aa044afb3b7 in_seq=0 out_seq=0 2024-04-20T12:22:33.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd59f7fe640 1 -- 172.21.15.135:0/4005777145 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55efc08483a0 con 0x55efc09604d0 2024-04-20T12:22:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd59f7fe640 10 client.15306 handle_command_reply: tid=0 2024-04-20T12:22:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c9572740 1 client.15306 shutdown 2024-04-20T12:22:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c9572740 1 -- 172.21.15.135:0/4005777145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 msgr2=0x55efc08ebd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c9572740 1 --2- 172.21.15.135:0/4005777145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08ebd10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4000c00 tx=0x7fd5b4010b00 comp rx=0 tx=0).stop 2024-04-20T12:22:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c9572740 1 -- 172.21.15.135:0/4005777145 shutdown_connections 2024-04-20T12:22:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c9572740 1 --2- 172.21.15.135:0/4005777145 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55efc09604d0 0x55efc095f1e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c9572740 1 --2- 172.21.15.135:0/4005777145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55efc08e0850 0x55efc0959ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c9572740 1 --2- 172.21.15.135:0/4005777145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55efc08db6e0 0x55efc08ebd10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c9572740 1 --2- 172.21.15.135:0/4005777145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55efc08dacf0 0x55efc08eb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd59f7fe640 0 client.15306 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:22:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c9572740 1 -- 172.21.15.135:0/4005777145 >> 172.21.15.135:0/4005777145 conn(0x55efc08d6260 msgr2=0x55efc08e39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c9572740 1 -- 172.21.15.135:0/4005777145 shutdown_connections 2024-04-20T12:22:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c9572740 1 -- 172.21.15.135:0/4005777145 wait complete. 2024-04-20T12:22:33.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c9572740 20 client.15306 trim_cache size 0 max 16384 2024-04-20T12:22:33.214 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:22:33.214 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "22180be8-ff0f-11ee-bc92-c7b262605968", 2024-04-20T12:22:33.214 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 0, 2024-04-20T12:22:33.214 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24490, 2024-04-20T12:22:33.214 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-04-20T12:22:33.214 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-04-20T12:22:33.214 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-04-20T12:22:33.214 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 111.197337851, 2024-04-20T12:22:33.214 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 28, 2024-04-20T12:22:33.214 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 92, 2024-04-20T12:22:33.214 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 90, 2024-04-20T12:22:33.215 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 125.777424182 2024-04-20T12:22:33.215 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:22:33.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c6985640 1 -- 172.21.15.135:0/3336717767 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd5a80a3c40 msgr2=0x7fd5a80a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c6985640 1 --2- 172.21.15.135:0/3336717767 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd5a80a3c40 0x7fd5a80a6100 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80324c0 tx=0x7fd5b80095c0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c6985640 1 -- 172.21.15.135:0/3336717767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c0100ea0 msgr2=0x7fd5c01982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:33.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.207+0000 7fd5c6985640 1 --2- 172.21.15.135:0/3336717767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c0100ea0 0x7fd5c01982b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000d950 tx=0x7fd5b000de10 comp rx=0 tx=0).stop 2024-04-20T12:22:33.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.208+0000 7fd5c6985640 1 -- 172.21.15.135:0/3336717767 shutdown_connections 2024-04-20T12:22:33.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.208+0000 7fd5c6985640 1 --2- 172.21.15.135:0/3336717767 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd5a80a3c40 0x7fd5a80a6100 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.208+0000 7fd5c6985640 1 --2- 172.21.15.135:0/3336717767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5c01029b0 0x7fd5c019f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.208+0000 7fd5c6985640 1 --2- 172.21.15.135:0/3336717767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd5c0101ff0 0x7fd5c01987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.208+0000 7fd5c6985640 1 --2- 172.21.15.135:0/3336717767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd5c0100ea0 0x7fd5c01982b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:33.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.208+0000 7fd5c6985640 1 -- 172.21.15.135:0/3336717767 >> 172.21.15.135:0/3336717767 conn(0x7fd5c00fc410 msgr2=0x7fd5c00690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:33.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.208+0000 7fd5c6985640 1 -- 172.21.15.135:0/3336717767 shutdown_connections 2024-04-20T12:22:33.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:33.208+0000 7fd5c6985640 1 -- 172.21.15.135:0/3336717767 wait complete. 2024-04-20T12:22:33.218 INFO:tasks.cephadm:Setup complete, yielding 2024-04-20T12:22:33.219 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-20T12:22:33.230 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-04-20T12:22:33.230 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- bash -c 'ceph orch status' 2024-04-20T12:22:33.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:32 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1967223212' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:33.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:32 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3391074995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:22:33.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:32 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1967223212' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:33.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:32 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3391074995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:22:33.477 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:22:34.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:33 smithi154 ceph-mon[22073]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-20T12:22:34.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:33 smithi139 ceph-mon[21834]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-20T12:22:34.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:33 smithi135 ceph-mon[18264]: pgmap v350: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-04-20T12:22:35.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.290+0000 7f352594d700 1 -- 172.21.15.135:0/3844572407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3520102aa0 msgr2=0x7f3520102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:35.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.290+0000 7f352594d700 1 --2- 172.21.15.135:0/3844572407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3520102aa0 0x7f3520102ec0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f35100099c0 tx=0x7f3510009cd0 comp rx=0 tx=0).stop 2024-04-20T12:22:35.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.291+0000 7f352594d700 1 -- 172.21.15.135:0/3844572407 shutdown_connections 2024-04-20T12:22:35.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.291+0000 7f352594d700 1 --2- 172.21.15.135:0/3844572407 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3520104640 0x7f352010aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:35.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.291+0000 7f352594d700 1 --2- 172.21.15.135:0/3844572407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3520102aa0 0x7f3520102ec0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:35.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.291+0000 7f352594d700 1 --2- 172.21.15.135:0/3844572407 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520103ca0 0x7f3520104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:35.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.291+0000 7f352594d700 1 -- 172.21.15.135:0/3844572407 >> 172.21.15.135:0/3844572407 conn(0x7f35200fe040 msgr2=0x7f3520100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:35.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.291+0000 7f352594d700 1 -- 172.21.15.135:0/3844572407 shutdown_connections 2024-04-20T12:22:35.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.291+0000 7f352594d700 1 -- 172.21.15.135:0/3844572407 wait complete. 2024-04-20T12:22:35.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.291+0000 7f352594d700 1 Processor -- start 2024-04-20T12:22:35.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.291+0000 7f352594d700 1 -- start start 2024-04-20T12:22:35.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f352594d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520102aa0 0x7f3520198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:35.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f352594d700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3520103ca0 0x7f3520199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:35.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f352594d700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3520104640 0x7f35201a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:35.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f352594d700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f352010e730 con 0x7f3520104640 2024-04-20T12:22:35.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f352594d700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f352010e5b0 con 0x7f3520103ca0 2024-04-20T12:22:35.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f352594d700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f352010e8b0 con 0x7f3520102aa0 2024-04-20T12:22:35.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f351f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3520104640 0x7f35201a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:35.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f351f7fe700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3520104640 0x7f35201a0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41290/0 (socket says 172.21.15.135:41290) 2024-04-20T12:22:35.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f351f7fe700 1 -- 172.21.15.135:0/533707330 learned_addr learned my addr 172.21.15.135:0/533707330 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:35.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f351e7fc700 1 --2- 172.21.15.135:0/533707330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3520103ca0 0x7f3520199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:35.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f351effd700 1 --2- 172.21.15.135:0/533707330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520102aa0 0x7f3520198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:35.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f351f7fe700 1 -- 172.21.15.135:0/533707330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520102aa0 msgr2=0x7f3520198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:35.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f351f7fe700 1 --2- 172.21.15.135:0/533707330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520102aa0 0x7f3520198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:35.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f351f7fe700 1 -- 172.21.15.135:0/533707330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3520103ca0 msgr2=0x7f3520199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:35.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f351f7fe700 1 --2- 172.21.15.135:0/533707330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3520103ca0 0x7f3520199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:35.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f351f7fe700 1 -- 172.21.15.135:0/533707330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35201a0960 con 0x7f3520104640 2024-04-20T12:22:35.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f351f7fe700 1 --2- 172.21.15.135:0/533707330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3520104640 0x7f35201a0290 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3518007d70 tx=0x7f351800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:35.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f352494b700 1 -- 172.21.15.135:0/533707330 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3518016020 con 0x7f3520104640 2024-04-20T12:22:35.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f352494b700 1 -- 172.21.15.135:0/533707330 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f351800ac90 con 0x7f3520104640 2024-04-20T12:22:35.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f352594d700 1 -- 172.21.15.135:0/533707330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35201a0c50 con 0x7f3520104640 2024-04-20T12:22:35.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f352494b700 1 -- 172.21.15.135:0/533707330 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35180115c0 con 0x7f3520104640 2024-04-20T12:22:35.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.292+0000 7f352594d700 1 -- 172.21.15.135:0/533707330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35201a1190 con 0x7f3520104640 2024-04-20T12:22:35.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.293+0000 7f352594d700 1 -- 172.21.15.135:0/533707330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3520069740 con 0x7f3520104640 2024-04-20T12:22:35.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.295+0000 7f352494b700 1 -- 172.21.15.135:0/533707330 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 138698+0+0 (secure 0 0 0) 0x7f3518019020 con 0x7f3520104640 2024-04-20T12:22:35.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.295+0000 7f352494b700 1 --2- 172.21.15.135:0/533707330 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f35080a3cd0 0x7f35080a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:35.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.295+0000 7f351effd700 1 --2- 172.21.15.135:0/533707330 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f35080a3cd0 0x7f35080a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:35.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.295+0000 7f352494b700 1 -- 172.21.15.135:0/533707330 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9071+0+0 (secure 0 0 0) 0x7f35180d0ac0 con 0x7f3520104640 2024-04-20T12:22:35.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.296+0000 7f351effd700 1 --2- 172.21.15.135:0/533707330 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f35080a3cd0 0x7f35080a6190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f352019a1f0 tx=0x7f3510005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:35.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.299+0000 7f352494b700 1 -- 172.21.15.135:0/533707330 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f3518020020 con 0x7f3520104640 2024-04-20T12:22:35.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.516+0000 7f352594d700 1 -- 172.21.15.135:0/533707330 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f3520062e90 con 0x7f35080a3cd0 2024-04-20T12:22:35.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.517+0000 7f352494b700 1 -- 172.21.15.135:0/533707330 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f3520062e90 con 0x7f35080a3cd0 2024-04-20T12:22:35.517 INFO:teuthology.orchestra.run.smithi135.stdout:Backend: cephadm 2024-04-20T12:22:35.517 INFO:teuthology.orchestra.run.smithi135.stdout:Available: Yes 2024-04-20T12:22:35.517 INFO:teuthology.orchestra.run.smithi135.stdout:Paused: No 2024-04-20T12:22:35.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.520+0000 7f352594d700 1 -- 172.21.15.135:0/533707330 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f35080a3cd0 msgr2=0x7f35080a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:35.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.520+0000 7f352594d700 1 --2- 172.21.15.135:0/533707330 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f35080a3cd0 0x7f35080a6190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f352019a1f0 tx=0x7f3510005fb0 comp rx=0 tx=0).stop 2024-04-20T12:22:35.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.520+0000 7f352594d700 1 -- 172.21.15.135:0/533707330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3520104640 msgr2=0x7f35201a0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:35.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.520+0000 7f352594d700 1 --2- 172.21.15.135:0/533707330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3520104640 0x7f35201a0290 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3518007d70 tx=0x7f351800a340 comp rx=0 tx=0).stop 2024-04-20T12:22:35.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.520+0000 7f352594d700 1 -- 172.21.15.135:0/533707330 shutdown_connections 2024-04-20T12:22:35.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.520+0000 7f352594d700 1 --2- 172.21.15.135:0/533707330 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f35080a3cd0 0x7f35080a6190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:35.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.520+0000 7f352594d700 1 --2- 172.21.15.135:0/533707330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3520104640 0x7f35201a0290 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:35.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.520+0000 7f352594d700 1 --2- 172.21.15.135:0/533707330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3520102aa0 0x7f3520198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:35.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.520+0000 7f352594d700 1 --2- 172.21.15.135:0/533707330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3520103ca0 0x7f3520199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:35.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.520+0000 7f352594d700 1 -- 172.21.15.135:0/533707330 >> 172.21.15.135:0/533707330 conn(0x7f35200fe040 msgr2=0x7f3520106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:35.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.520+0000 7f352594d700 1 -- 172.21.15.135:0/533707330 shutdown_connections 2024-04-20T12:22:35.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:35.520+0000 7f352594d700 1 -- 172.21.15.135:0/533707330 wait complete. 2024-04-20T12:22:36.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:35 smithi135 ceph-mon[18264]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:22:36.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:35 smithi154 ceph-mon[22073]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:22:36.252 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-20T12:22:36.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:35 smithi139 ceph-mon[21834]: pgmap v351: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:22:36.496 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:22:37.253 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:36 smithi154 ceph-mon[22073]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:22:37.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-04-20T12:22:37.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-04-20T12:22:37.254 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:36 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-04-20T12:22:37.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:36 smithi139 ceph-mon[21834]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:22:37.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-04-20T12:22:37.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-04-20T12:22:37.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:36 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-04-20T12:22:37.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:36 smithi135 ceph-mon[18264]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:22:37.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-04-20T12:22:37.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-04-20T12:22:37.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:36 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-04-20T12:22:38.056 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:37 smithi135 ceph-mon[18264]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-04-20T12:22:38.056 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-04-20T12:22:38.056 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-04-20T12:22:38.056 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:37 smithi135 ceph-mon[18264]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-04-20T12:22:38.056 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:37 smithi135 ceph-mon[18264]: osdmap e93: 12 total, 12 up, 12 in 2024-04-20T12:22:38.056 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:37 smithi135 ceph-mon[18264]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-20T12:22:38.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:37 smithi154 ceph-mon[22073]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-04-20T12:22:38.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-04-20T12:22:38.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-04-20T12:22:38.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:37 smithi154 ceph-mon[22073]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-04-20T12:22:38.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:37 smithi154 ceph-mon[22073]: osdmap e93: 12 total, 12 up, 12 in 2024-04-20T12:22:38.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:37 smithi154 ceph-mon[22073]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-20T12:22:38.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.296+0000 7f0d1aaaa700 1 -- 172.21.15.135:0/963137554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d141025d0 msgr2=0x7f0d14109e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:38.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.296+0000 7f0d1aaaa700 1 --2- 172.21.15.135:0/963137554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d141025d0 0x7f0d14109e70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00b0a0 tx=0x7f0d0c00b3b0 comp rx=0 tx=0).stop 2024-04-20T12:22:38.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.296+0000 7f0d1aaaa700 1 -- 172.21.15.135:0/963137554 shutdown_connections 2024-04-20T12:22:38.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.296+0000 7f0d1aaaa700 1 --2- 172.21.15.135:0/963137554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d141025d0 0x7f0d14109e70 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:38.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.296+0000 7f0d1aaaa700 1 --2- 172.21.15.135:0/963137554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d14102fb0 0x7f0d141033d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:38.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.296+0000 7f0d1aaaa700 1 --2- 172.21.15.135:0/963137554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d14101c10 0x7f0d14102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:38.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.296+0000 7f0d1aaaa700 1 -- 172.21.15.135:0/963137554 >> 172.21.15.135:0/963137554 conn(0x7f0d140fc6e0 msgr2=0x7f0d140feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:38.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.296+0000 7f0d1aaaa700 1 -- 172.21.15.135:0/963137554 shutdown_connections 2024-04-20T12:22:38.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.296+0000 7f0d1aaaa700 1 -- 172.21.15.135:0/963137554 wait complete. 2024-04-20T12:22:38.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d1aaaa700 1 Processor -- start 2024-04-20T12:22:38.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d1aaaa700 1 -- start start 2024-04-20T12:22:38.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d1aaaa700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d14101c10 0x7f0d14101680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:38.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d1aaaa700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d141025d0 0x7f0d1419d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d1aaaa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d14102fb0 0x7f0d1419fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d1aaaa700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1410d550 con 0x7f0d14102fb0 2024-04-20T12:22:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d1aaaa700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1410d3d0 con 0x7f0d14101c10 2024-04-20T12:22:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d1aaaa700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1410d6d0 con 0x7f0d141025d0 2024-04-20T12:22:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d19047700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d14102fb0 0x7f0d1419fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d19047700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d14102fb0 0x7f0d1419fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41300/0 (socket says 172.21.15.135:41300) 2024-04-20T12:22:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d19047700 1 -- 172.21.15.135:0/2785491526 learned_addr learned my addr 172.21.15.135:0/2785491526 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d18846700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d14101c10 0x7f0d14101680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d13fff700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d141025d0 0x7f0d1419d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d19047700 1 -- 172.21.15.135:0/2785491526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d141025d0 msgr2=0x7f0d1419d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d19047700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d141025d0 0x7f0d1419d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d19047700 1 -- 172.21.15.135:0/2785491526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d14101c10 msgr2=0x7f0d14101680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d19047700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d14101c10 0x7f0d14101680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:38.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d19047700 1 -- 172.21.15.135:0/2785491526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d141a0740 con 0x7f0d14102fb0 2024-04-20T12:22:38.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d18846700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d14101c10 0x7f0d14101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:38.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.297+0000 7f0d13fff700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d141025d0 0x7f0d1419d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:38.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.298+0000 7f0d19047700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d14102fb0 0x7f0d1419fe70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c007f00 tx=0x7f0d0c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:38.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.298+0000 7f0d11ffb700 1 -- 172.21.15.135:0/2785491526 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c021030 con 0x7f0d14102fb0 2024-04-20T12:22:38.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.298+0000 7f0d11ffb700 1 -- 172.21.15.135:0/2785491526 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d0c007bb0 con 0x7f0d14102fb0 2024-04-20T12:22:38.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.298+0000 7f0d1aaaa700 1 -- 172.21.15.135:0/2785491526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d141a09d0 con 0x7f0d14102fb0 2024-04-20T12:22:38.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.298+0000 7f0d11ffb700 1 -- 172.21.15.135:0/2785491526 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c01d470 con 0x7f0d14102fb0 2024-04-20T12:22:38.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.298+0000 7f0d1aaaa700 1 -- 172.21.15.135:0/2785491526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d141a0ed0 con 0x7f0d14102fb0 2024-04-20T12:22:38.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.299+0000 7f0d1aaaa700 1 -- 172.21.15.135:0/2785491526 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d14069740 con 0x7f0d14102fb0 2024-04-20T12:22:38.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.300+0000 7f0d11ffb700 1 -- 172.21.15.135:0/2785491526 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f0d0c024070 con 0x7f0d14102fb0 2024-04-20T12:22:38.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.301+0000 7f0d11ffb700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0d040a3cc0 0x7f0d040a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:38.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.301+0000 7f0d18846700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0d040a3cc0 0x7f0d040a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:38.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.301+0000 7f0d11ffb700 1 -- 172.21.15.135:0/2785491526 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f0d0c00f020 con 0x7f0d14102fb0 2024-04-20T12:22:38.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.302+0000 7f0d18846700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0d040a3cc0 0x7f0d040a6180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0d1406a510 tx=0x7f0d0800a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:38.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.305+0000 7f0d11ffb700 1 -- 172.21.15.135:0/2785491526 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f0d0c09dcb0 con 0x7f0d14102fb0 2024-04-20T12:22:38.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:37 smithi139 ceph-mon[21834]: pgmap v352: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-04-20T12:22:38.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-04-20T12:22:38.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-04-20T12:22:38.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:37 smithi139 ceph-mon[21834]: from='mgr.14152 172.21.15.135:0/3396020504' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-04-20T12:22:38.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:37 smithi139 ceph-mon[21834]: osdmap e93: 12 total, 12 up, 12 in 2024-04-20T12:22:38.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:37 smithi139 ceph-mon[21834]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-04-20T12:22:38.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.524+0000 7f0d1aaaa700 1 -- 172.21.15.135:0/2785491526 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0d14062e90 con 0x7f0d040a3cc0 2024-04-20T12:22:38.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.550+0000 7f0d11ffb700 1 -- 172.21.15.135:0/2785491526 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4092 (secure 0 0 0) 0x7f0d14062e90 con 0x7f0d040a3cc0 2024-04-20T12:22:38.550 INFO:teuthology.orchestra.run.smithi135.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-20T12:22:38.550 INFO:teuthology.orchestra.run.smithi135.stdout:mds.a smithi135 running (2m) 20s ago 2m 16.5M - 19.0.0-3133-ga8c84f59 76bc6b91b726 afdb2f191efb 2024-04-20T12:22:38.550 INFO:teuthology.orchestra.run.smithi135.stdout:mds.b smithi139 running (2m) 56s ago 2m 17.1M - 19.0.0-3133-ga8c84f59 76bc6b91b726 f04bd8e05e66 2024-04-20T12:22:38.550 INFO:teuthology.orchestra.run.smithi135.stdout:mds.c smithi154 running (2m) 56s ago 2m 18.9M - 19.0.0-3133-ga8c84f59 76bc6b91b726 d4524ec46e59 2024-04-20T12:22:38.550 INFO:teuthology.orchestra.run.smithi135.stdout:mds.d smithi135 running (2m) 20s ago 2m 14.0M - 19.0.0-3133-ga8c84f59 76bc6b91b726 c701bfef1c3c 2024-04-20T12:22:38.550 INFO:teuthology.orchestra.run.smithi135.stdout:mds.e smithi139 running (2m) 56s ago 2m 18.3M - 19.0.0-3133-ga8c84f59 76bc6b91b726 9ef058c9b39a 2024-04-20T12:22:38.550 INFO:teuthology.orchestra.run.smithi135.stdout:mds.f smithi154 running (2m) 56s ago 2m 18.9M - 19.0.0-3133-ga8c84f59 76bc6b91b726 d93374495849 2024-04-20T12:22:38.550 INFO:teuthology.orchestra.run.smithi135.stdout:mds.g smithi135 running (2m) 20s ago 2m 18.6M - 19.0.0-3133-ga8c84f59 76bc6b91b726 bf7dafa5f963 2024-04-20T12:22:38.551 INFO:teuthology.orchestra.run.smithi135.stdout:mds.h smithi139 running (2m) 56s ago 2m 19.6M - 19.0.0-3133-ga8c84f59 76bc6b91b726 404ea5bbd28d 2024-04-20T12:22:38.551 INFO:teuthology.orchestra.run.smithi135.stdout:mds.i smithi154 running (2m) 56s ago 2m 25.6M - 19.0.0-3133-ga8c84f59 76bc6b91b726 103e36723ff2 2024-04-20T12:22:38.551 INFO:teuthology.orchestra.run.smithi135.stdout:mds.j smithi135 running (2m) 20s ago 2m 16.2M - 19.0.0-3133-ga8c84f59 76bc6b91b726 4b2f8d378929 2024-04-20T12:22:38.551 INFO:teuthology.orchestra.run.smithi135.stdout:mds.k smithi139 running (2m) 56s ago 2m 16.0M - 19.0.0-3133-ga8c84f59 76bc6b91b726 0e720c91acae 2024-04-20T12:22:38.551 INFO:teuthology.orchestra.run.smithi135.stdout:mds.l smithi154 running (2m) 56s ago 2m 18.4M - 19.0.0-3133-ga8c84f59 76bc6b91b726 08e3d48f573b 2024-04-20T12:22:38.551 INFO:teuthology.orchestra.run.smithi135.stdout:mgr.x smithi135 *:9283,8765 running (9m) 20s ago 9m 515M - 19.0.0-3133-ga8c84f59 76bc6b91b726 9b7af0bd19de 2024-04-20T12:22:38.551 INFO:teuthology.orchestra.run.smithi135.stdout:mgr.y smithi139 *:8443,8765 running (7m) 56s ago 7m 451M - 19.0.0-3133-ga8c84f59 76bc6b91b726 e48f990b6de0 2024-04-20T12:22:38.551 INFO:teuthology.orchestra.run.smithi135.stdout:mgr.z smithi154 *:8443,8765 running (7m) 56s ago 7m 454M - 19.0.0-3133-ga8c84f59 76bc6b91b726 c3d765456a4b 2024-04-20T12:22:38.551 INFO:teuthology.orchestra.run.smithi135.stdout:mon.a smithi135 running (9m) 20s ago 9m 49.9M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 a65046714468 2024-04-20T12:22:38.551 INFO:teuthology.orchestra.run.smithi135.stdout:mon.b smithi139 running (8m) 56s ago 8m 40.7M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 e3d498ced670 2024-04-20T12:22:38.551 INFO:teuthology.orchestra.run.smithi135.stdout:mon.c smithi154 running (8m) 56s ago 8m 42.9M 2048M 19.0.0-3133-ga8c84f59 76bc6b91b726 efa34d747380 2024-04-20T12:22:38.551 INFO:teuthology.orchestra.run.smithi135.stdout:osd.0 smithi135 running (7m) 20s ago 7m 59.8M 4272M 19.0.0-3133-ga8c84f59 76bc6b91b726 bc8997c53f43 2024-04-20T12:22:38.552 INFO:teuthology.orchestra.run.smithi135.stdout:osd.1 smithi139 running (7m) 56s ago 7m 46.2M 4272M 19.0.0-3133-ga8c84f59 76bc6b91b726 7ac513334d58 2024-04-20T12:22:38.552 INFO:teuthology.orchestra.run.smithi135.stdout:osd.2 smithi154 running (6m) 56s ago 6m 62.1M 4272M 19.0.0-3133-ga8c84f59 76bc6b91b726 46180f48b57b 2024-04-20T12:22:38.552 INFO:teuthology.orchestra.run.smithi135.stdout:osd.3 smithi135 running (6m) 20s ago 6m 46.7M 4272M 19.0.0-3133-ga8c84f59 76bc6b91b726 5b65a4c893dd 2024-04-20T12:22:38.552 INFO:teuthology.orchestra.run.smithi135.stdout:osd.4 smithi139 running (5m) 56s ago 5m 54.0M 4272M 19.0.0-3133-ga8c84f59 76bc6b91b726 676b4eb81c2b 2024-04-20T12:22:38.552 INFO:teuthology.orchestra.run.smithi135.stdout:osd.5 smithi154 running (5m) 56s ago 5m 58.4M 4272M 19.0.0-3133-ga8c84f59 76bc6b91b726 6b4491bd02d0 2024-04-20T12:22:38.552 INFO:teuthology.orchestra.run.smithi135.stdout:osd.6 smithi135 running (5m) 20s ago 5m 42.9M 4272M 19.0.0-3133-ga8c84f59 76bc6b91b726 d9c0a89420b7 2024-04-20T12:22:38.552 INFO:teuthology.orchestra.run.smithi135.stdout:osd.7 smithi139 running (4m) 56s ago 4m 55.6M 4272M 19.0.0-3133-ga8c84f59 76bc6b91b726 78eee9b9fa04 2024-04-20T12:22:38.552 INFO:teuthology.orchestra.run.smithi135.stdout:osd.8 smithi154 running (4m) 56s ago 4m 42.2M 4272M 19.0.0-3133-ga8c84f59 76bc6b91b726 a5ee2f2e77e4 2024-04-20T12:22:38.552 INFO:teuthology.orchestra.run.smithi135.stdout:osd.9 smithi135 running (3m) 20s ago 3m 42.7M 4272M 19.0.0-3133-ga8c84f59 76bc6b91b726 8806bdff5bc5 2024-04-20T12:22:38.552 INFO:teuthology.orchestra.run.smithi135.stdout:osd.10 smithi139 running (3m) 56s ago 3m 54.0M 4272M 19.0.0-3133-ga8c84f59 76bc6b91b726 09d71cd33187 2024-04-20T12:22:38.552 INFO:teuthology.orchestra.run.smithi135.stdout:osd.11 smithi154 running (2m) 56s ago 2m 41.9M 4272M 19.0.0-3133-ga8c84f59 76bc6b91b726 f7d7e0cc9f72 2024-04-20T12:22:38.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.552+0000 7f0d1aaaa700 1 -- 172.21.15.135:0/2785491526 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0d040a3cc0 msgr2=0x7f0d040a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:38.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.552+0000 7f0d1aaaa700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0d040a3cc0 0x7f0d040a6180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0d1406a510 tx=0x7f0d0800a680 comp rx=0 tx=0).stop 2024-04-20T12:22:38.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.552+0000 7f0d1aaaa700 1 -- 172.21.15.135:0/2785491526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d14102fb0 msgr2=0x7f0d1419fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:38.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.552+0000 7f0d1aaaa700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d14102fb0 0x7f0d1419fe70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c007f00 tx=0x7f0d0c00bf10 comp rx=0 tx=0).stop 2024-04-20T12:22:38.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.552+0000 7f0d1aaaa700 1 -- 172.21.15.135:0/2785491526 shutdown_connections 2024-04-20T12:22:38.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.552+0000 7f0d1aaaa700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f0d040a3cc0 0x7f0d040a6180 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:38.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.552+0000 7f0d1aaaa700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0d14102fb0 0x7f0d1419fe70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:38.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.552+0000 7f0d1aaaa700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0d14101c10 0x7f0d14101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:38.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.552+0000 7f0d1aaaa700 1 --2- 172.21.15.135:0/2785491526 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d141025d0 0x7f0d1419d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:38.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.552+0000 7f0d1aaaa700 1 -- 172.21.15.135:0/2785491526 >> 172.21.15.135:0/2785491526 conn(0x7f0d140fc6e0 msgr2=0x7f0d14105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:38.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.553+0000 7f0d1aaaa700 1 -- 172.21.15.135:0/2785491526 shutdown_connections 2024-04-20T12:22:38.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:38.553+0000 7f0d1aaaa700 1 -- 172.21.15.135:0/2785491526 wait complete. 2024-04-20T12:22:39.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:38 smithi154 ceph-mon[22073]: osdmap e94: 12 total, 12 up, 12 in 2024-04-20T12:22:39.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:38 smithi154 ceph-mon[22073]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:22:39.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:38 smithi154 ceph-mon[22073]: pgmap v355: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-04-20T12:22:39.300 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:38 smithi135 ceph-mon[18264]: osdmap e94: 12 total, 12 up, 12 in 2024-04-20T12:22:39.300 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:38 smithi135 ceph-mon[18264]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:22:39.300 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:38 smithi135 ceph-mon[18264]: pgmap v355: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-04-20T12:22:39.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:38 smithi139 ceph-mon[21834]: osdmap e94: 12 total, 12 up, 12 in 2024-04-20T12:22:39.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:38 smithi139 ceph-mon[21834]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:22:39.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:38 smithi139 ceph-mon[21834]: pgmap v355: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-04-20T12:22:39.415 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-20T12:22:39.654 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:22:40.042 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:39 smithi135 ceph-mon[18264]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-20T12:22:40.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:39 smithi154 ceph-mon[22073]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-20T12:22:40.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:39 smithi139 ceph-mon[21834]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-04-20T12:22:41.241 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:40 smithi135 ceph-mon[18264]: pgmap v356: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 383 B/s wr, 10 op/s 2024-04-20T12:22:41.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:40 smithi154 ceph-mon[22073]: pgmap v356: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 383 B/s wr, 10 op/s 2024-04-20T12:22:41.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:40 smithi139 ceph-mon[21834]: pgmap v356: 129 pgs: 2 peering, 127 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 383 B/s wr, 10 op/s 2024-04-20T12:22:41.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.494+0000 7fa7ffa1c700 1 -- 172.21.15.135:0/4281969524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f81019b0 msgr2=0x7fa7f8101dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:41.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.494+0000 7fa7ffa1c700 1 --2- 172.21.15.135:0/4281969524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f81019b0 0x7fa7f8101dd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa7f40099c0 tx=0x7fa7f4009cd0 comp rx=0 tx=0).stop 2024-04-20T12:22:41.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.494+0000 7fa7ffa1c700 1 -- 172.21.15.135:0/4281969524 shutdown_connections 2024-04-20T12:22:41.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.494+0000 7fa7ffa1c700 1 --2- 172.21.15.135:0/4281969524 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7f8103550 0x7fa7f8109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:41.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.494+0000 7fa7ffa1c700 1 --2- 172.21.15.135:0/4281969524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f81019b0 0x7fa7f8101dd0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:41.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.494+0000 7fa7ffa1c700 1 --2- 172.21.15.135:0/4281969524 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7f8102bb0 0x7fa7f8103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:41.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.494+0000 7fa7ffa1c700 1 -- 172.21.15.135:0/4281969524 >> 172.21.15.135:0/4281969524 conn(0x7fa7f80fcf50 msgr2=0x7fa7f80ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:41.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.494+0000 7fa7ffa1c700 1 -- 172.21.15.135:0/4281969524 shutdown_connections 2024-04-20T12:22:41.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.494+0000 7fa7ffa1c700 1 -- 172.21.15.135:0/4281969524 wait complete. 2024-04-20T12:22:41.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.495+0000 7fa7ffa1c700 1 Processor -- start 2024-04-20T12:22:41.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.495+0000 7fa7ffa1c700 1 -- start start 2024-04-20T12:22:41.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.495+0000 7fa7ffa1c700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7f81019b0 0x7fa7f8197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:41.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.495+0000 7fa7ffa1c700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f8102bb0 0x7fa7f81981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:41.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.495+0000 7fa7ffa1c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7f8103550 0x7fa7f819f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:41.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.495+0000 7fa7ffa1c700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f810d590 con 0x7fa7f8102bb0 2024-04-20T12:22:41.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.495+0000 7fa7ffa1c700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f810d410 con 0x7fa7f81019b0 2024-04-20T12:22:41.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.495+0000 7fa7ffa1c700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f810d710 con 0x7fa7f8103550 2024-04-20T12:22:41.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.495+0000 7fa7fcfb7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f8102bb0 0x7fa7f81981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:41.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.495+0000 7fa7fcfb7700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f8102bb0 0x7fa7f81981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51246/0 (socket says 172.21.15.135:51246) 2024-04-20T12:22:41.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.495+0000 7fa7fcfb7700 1 -- 172.21.15.135:0/3316825214 learned_addr learned my addr 172.21.15.135:0/3316825214 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:41.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.495+0000 7fa7fd7b8700 1 --2- 172.21.15.135:0/3316825214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7f81019b0 0x7fa7f8197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:41.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.495+0000 7fa7fdfb9700 1 --2- 172.21.15.135:0/3316825214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7f8103550 0x7fa7f819f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:41.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.495+0000 7fa7fcfb7700 1 -- 172.21.15.135:0/3316825214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7f8103550 msgr2=0x7fa7f819f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:41.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.495+0000 7fa7fcfb7700 1 --2- 172.21.15.135:0/3316825214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7f8103550 0x7fa7f819f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:41.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.496+0000 7fa7fcfb7700 1 -- 172.21.15.135:0/3316825214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7f81019b0 msgr2=0x7fa7f8197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:41.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.496+0000 7fa7fcfb7700 1 --2- 172.21.15.135:0/3316825214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7f81019b0 0x7fa7f8197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:41.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.496+0000 7fa7fcfb7700 1 -- 172.21.15.135:0/3316825214 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f819f880 con 0x7fa7f8102bb0 2024-04-20T12:22:41.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.496+0000 7fa7fcfb7700 1 --2- 172.21.15.135:0/3316825214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f8102bb0 0x7fa7f81981c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800d980 tx=0x7fa7e800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:41.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.496+0000 7fa7ee7fc700 1 -- 172.21.15.135:0/3316825214 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8016070 con 0x7fa7f8102bb0 2024-04-20T12:22:41.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.496+0000 7fa7ee7fc700 1 -- 172.21.15.135:0/3316825214 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7e8004d10 con 0x7fa7f8102bb0 2024-04-20T12:22:41.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.496+0000 7fa7ee7fc700 1 -- 172.21.15.135:0/3316825214 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8005670 con 0x7fa7f8102bb0 2024-04-20T12:22:41.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.496+0000 7fa7ffa1c700 1 -- 172.21.15.135:0/3316825214 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f819fb70 con 0x7fa7f8102bb0 2024-04-20T12:22:41.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.496+0000 7fa7ffa1c700 1 -- 172.21.15.135:0/3316825214 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f81a0100 con 0x7fa7f8102bb0 2024-04-20T12:22:41.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.497+0000 7fa7ffa1c700 1 -- 172.21.15.135:0/3316825214 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f8069740 con 0x7fa7f8102bb0 2024-04-20T12:22:41.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.498+0000 7fa7ee7fc700 1 -- 172.21.15.135:0/3316825214 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fa7e8004750 con 0x7fa7f8102bb0 2024-04-20T12:22:41.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.499+0000 7fa7ee7fc700 1 --2- 172.21.15.135:0/3316825214 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7e40a3cc0 0x7fa7e40a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:41.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.499+0000 7fa7fd7b8700 1 --2- 172.21.15.135:0/3316825214 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7e40a3cc0 0x7fa7e40a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:41.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.499+0000 7fa7ee7fc700 1 -- 172.21.15.135:0/3316825214 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7fa7e80d0a70 con 0x7fa7f8102bb0 2024-04-20T12:22:41.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.499+0000 7fa7fd7b8700 1 --2- 172.21.15.135:0/3316825214 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7e40a3cc0 0x7fa7e40a6180 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009990 tx=0x7fa7f4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:41.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.502+0000 7fa7ee7fc700 1 -- 172.21.15.135:0/3316825214 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fa7e801f020 con 0x7fa7f8102bb0 2024-04-20T12:22:41.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.708+0000 7fa7ffa1c700 1 -- 172.21.15.135:0/3316825214 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fa7f8062e90 con 0x7fa7e40a3cc0 2024-04-20T12:22:41.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.714+0000 7fa7ee7fc700 1 -- 172.21.15.135:0/3316825214 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fa7f8062e90 con 0x7fa7e40a3cc0 2024-04-20T12:22:41.714 INFO:teuthology.orchestra.run.smithi135.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-20T12:22:41.714 INFO:teuthology.orchestra.run.smithi135.stdout:mds.all 12/12 60s ago 2m smithi135=a;smithi135=d;smithi135=g;smithi135=j;smithi139=b;smithi139=e;smithi139=h;smithi139=k;smithi154=c;smithi154=f;smithi154=i;smithi154=l;count:12 2024-04-20T12:22:41.715 INFO:teuthology.orchestra.run.smithi135.stdout:mgr 3/3 60s ago 7m smithi135=x;smithi139=y;smithi154=z;count:3 2024-04-20T12:22:41.715 INFO:teuthology.orchestra.run.smithi135.stdout:mon 3/3 60s ago 8m smithi135:172.21.15.135=a;smithi139:172.21.15.139=b;smithi154:172.21.15.154=c;count:3 2024-04-20T12:22:41.715 INFO:teuthology.orchestra.run.smithi135.stdout:osd 12 60s ago - 2024-04-20T12:22:41.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.717+0000 7fa7ffa1c700 1 -- 172.21.15.135:0/3316825214 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7e40a3cc0 msgr2=0x7fa7e40a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:41.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.717+0000 7fa7ffa1c700 1 --2- 172.21.15.135:0/3316825214 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7e40a3cc0 0x7fa7e40a6180 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009990 tx=0x7fa7f4005fb0 comp rx=0 tx=0).stop 2024-04-20T12:22:41.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.717+0000 7fa7ffa1c700 1 -- 172.21.15.135:0/3316825214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f8102bb0 msgr2=0x7fa7f81981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:41.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.717+0000 7fa7ffa1c700 1 --2- 172.21.15.135:0/3316825214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f8102bb0 0x7fa7f81981c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800d980 tx=0x7fa7e800dc90 comp rx=0 tx=0).stop 2024-04-20T12:22:41.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.717+0000 7fa7ffa1c700 1 -- 172.21.15.135:0/3316825214 shutdown_connections 2024-04-20T12:22:41.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.717+0000 7fa7ffa1c700 1 --2- 172.21.15.135:0/3316825214 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa7e40a3cc0 0x7fa7e40a6180 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:41.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.717+0000 7fa7ffa1c700 1 --2- 172.21.15.135:0/3316825214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa7f8103550 0x7fa7f819f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:41.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.717+0000 7fa7ffa1c700 1 --2- 172.21.15.135:0/3316825214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa7f81019b0 0x7fa7f8197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:41.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.717+0000 7fa7ffa1c700 1 --2- 172.21.15.135:0/3316825214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7f8102bb0 0x7fa7f81981c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:41.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.717+0000 7fa7ffa1c700 1 -- 172.21.15.135:0/3316825214 >> 172.21.15.135:0/3316825214 conn(0x7fa7f80fcf50 msgr2=0x7fa7f8105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:41.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.717+0000 7fa7ffa1c700 1 -- 172.21.15.135:0/3316825214 shutdown_connections 2024-04-20T12:22:41.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:41.717+0000 7fa7ffa1c700 1 -- 172.21.15.135:0/3316825214 wait complete. 2024-04-20T12:22:42.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:41 smithi154 ceph-mon[22073]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:22:42.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:41 smithi139 ceph-mon[21834]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:22:42.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:41 smithi135 ceph-mon[18264]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:22:42.502 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-20T12:22:42.741 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:22:43.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:42 smithi135 ceph-mon[18264]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 383 B/s wr, 12 op/s 2024-04-20T12:22:43.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:42 smithi154 ceph-mon[22073]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 383 B/s wr, 12 op/s 2024-04-20T12:22:43.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:42 smithi139 ceph-mon[21834]: pgmap v357: 129 pgs: 129 active+clean; 645 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 383 B/s wr, 12 op/s 2024-04-20T12:22:44.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:43 smithi154 ceph-mon[22073]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-20T12:22:44.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:43 smithi154 ceph-mon[22073]: Cluster is now healthy 2024-04-20T12:22:44.254 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:43 smithi135 ceph-mon[18264]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-20T12:22:44.254 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:43 smithi135 ceph-mon[18264]: Cluster is now healthy 2024-04-20T12:22:44.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:43 smithi139 ceph-mon[21834]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-04-20T12:22:44.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:43 smithi139 ceph-mon[21834]: Cluster is now healthy 2024-04-20T12:22:44.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.517+0000 7f524e20b700 1 -- 172.21.15.135:0/3039062334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5248108860 msgr2=0x7f524810ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:44.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.517+0000 7f524e20b700 1 --2- 172.21.15.135:0/3039062334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5248108860 0x7f524810ac50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f524000b0a0 tx=0x7f524000b3b0 comp rx=0 tx=0).stop 2024-04-20T12:22:44.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.517+0000 7f524e20b700 1 -- 172.21.15.135:0/3039062334 shutdown_connections 2024-04-20T12:22:44.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.517+0000 7f524e20b700 1 --2- 172.21.15.135:0/3039062334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5248108860 0x7f524810ac50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:44.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.517+0000 7f524e20b700 1 --2- 172.21.15.135:0/3039062334 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5248103600 0x7f52481059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:44.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.517+0000 7f524e20b700 1 --2- 172.21.15.135:0/3039062334 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5248105f30 0x7f5248108320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:44.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.517+0000 7f524e20b700 1 -- 172.21.15.135:0/3039062334 >> 172.21.15.135:0/3039062334 conn(0x7f52480fcfb0 msgr2=0x7f52480ff3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:44.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.517+0000 7f524e20b700 1 -- 172.21.15.135:0/3039062334 shutdown_connections 2024-04-20T12:22:44.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.517+0000 7f524e20b700 1 -- 172.21.15.135:0/3039062334 wait complete. 2024-04-20T12:22:44.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.518+0000 7f524e20b700 1 Processor -- start 2024-04-20T12:22:44.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.518+0000 7f524e20b700 1 -- start start 2024-04-20T12:22:44.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.518+0000 7f524e20b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5248103600 0x7f5248198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:44.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.518+0000 7f524e20b700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5248105f30 0x7f52481991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:44.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.518+0000 7f524e20b700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5248108860 0x7f52481a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:44.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f524e20b700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f524810e6a0 con 0x7f5248108860 2024-04-20T12:22:44.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f524e20b700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f524810e520 con 0x7f5248105f30 2024-04-20T12:22:44.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f524e20b700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f524810e820 con 0x7f5248103600 2024-04-20T12:22:44.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f5247fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5248108860 0x7f52481a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:44.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f5247fff700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5248108860 0x7f52481a0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51258/0 (socket says 172.21.15.135:51258) 2024-04-20T12:22:44.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f5247fff700 1 -- 172.21.15.135:0/1115033106 learned_addr learned my addr 172.21.15.135:0/1115033106 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:44.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f5246ffd700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5248105f30 0x7f52481991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:44.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f52477fe700 1 --2- 172.21.15.135:0/1115033106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5248103600 0x7f5248198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:44.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f5247fff700 1 -- 172.21.15.135:0/1115033106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5248103600 msgr2=0x7f5248198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:44.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f5247fff700 1 --2- 172.21.15.135:0/1115033106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5248103600 0x7f5248198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:44.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f5247fff700 1 -- 172.21.15.135:0/1115033106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5248105f30 msgr2=0x7f52481991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:44.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f5247fff700 1 --2- 172.21.15.135:0/1115033106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5248105f30 0x7f52481991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:44.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f5247fff700 1 -- 172.21.15.135:0/1115033106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52481a08f0 con 0x7f5248108860 2024-04-20T12:22:44.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f5246ffd700 1 --2- 172.21.15.135:0/1115033106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5248105f30 0x7f52481991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:22:44.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f5247fff700 1 --2- 172.21.15.135:0/1115033106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5248108860 0x7f52481a0220 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5240007f00 tx=0x7f5240004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:44.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f5244ff9700 1 -- 172.21.15.135:0/1115033106 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240021070 con 0x7f5248108860 2024-04-20T12:22:44.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f5244ff9700 1 -- 172.21.15.135:0/1115033106 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5240007c40 con 0x7f5248108860 2024-04-20T12:22:44.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.519+0000 7f5244ff9700 1 -- 172.21.15.135:0/1115033106 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240005400 con 0x7f5248108860 2024-04-20T12:22:44.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.520+0000 7f524e20b700 1 -- 172.21.15.135:0/1115033106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52481a0b80 con 0x7f5248108860 2024-04-20T12:22:44.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.520+0000 7f524e20b700 1 -- 172.21.15.135:0/1115033106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52481a0fe0 con 0x7f5248108860 2024-04-20T12:22:44.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.521+0000 7f524e20b700 1 -- 172.21.15.135:0/1115033106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5248069740 con 0x7f5248108860 2024-04-20T12:22:44.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.522+0000 7f5244ff9700 1 -- 172.21.15.135:0/1115033106 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f5240024070 con 0x7f5248108860 2024-04-20T12:22:44.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.522+0000 7f5244ff9700 1 --2- 172.21.15.135:0/1115033106 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f52300a3c40 0x7f52300a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:44.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.522+0000 7f52477fe700 1 --2- 172.21.15.135:0/1115033106 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f52300a3c40 0x7f52300a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:44.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.522+0000 7f5244ff9700 1 -- 172.21.15.135:0/1115033106 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f524000f020 con 0x7f5248108860 2024-04-20T12:22:44.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.523+0000 7f52477fe700 1 --2- 172.21.15.135:0/1115033106 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f52300a3c40 0x7f52300a6100 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5238005950 tx=0x7f523800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:44.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.528+0000 7f5244ff9700 1 -- 172.21.15.135:0/1115033106 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f524002b020 con 0x7f5248108860 2024-04-20T12:22:44.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.729+0000 7f524e20b700 1 -- 172.21.15.135:0/1115033106 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f5248062e90 con 0x7f52300a3c40 2024-04-20T12:22:44.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.730+0000 7f5244ff9700 1 -- 172.21.15.135:0/1115033106 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f5248062e90 con 0x7f52300a3c40 2024-04-20T12:22:44.730 INFO:teuthology.orchestra.run.smithi135.stdout:HOST ADDR LABELS STATUS 2024-04-20T12:22:44.730 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135 172.21.15.135 2024-04-20T12:22:44.730 INFO:teuthology.orchestra.run.smithi135.stdout:smithi139 172.21.15.139 2024-04-20T12:22:44.730 INFO:teuthology.orchestra.run.smithi135.stdout:smithi154 172.21.15.154 2024-04-20T12:22:44.731 INFO:teuthology.orchestra.run.smithi135.stdout:3 hosts in cluster 2024-04-20T12:22:44.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.733+0000 7f524e20b700 1 -- 172.21.15.135:0/1115033106 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f52300a3c40 msgr2=0x7f52300a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:44.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.733+0000 7f524e20b700 1 --2- 172.21.15.135:0/1115033106 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f52300a3c40 0x7f52300a6100 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5238005950 tx=0x7f523800a300 comp rx=0 tx=0).stop 2024-04-20T12:22:44.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.733+0000 7f524e20b700 1 -- 172.21.15.135:0/1115033106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5248108860 msgr2=0x7f52481a0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:44.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.733+0000 7f524e20b700 1 --2- 172.21.15.135:0/1115033106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5248108860 0x7f52481a0220 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5240007f00 tx=0x7f5240004d70 comp rx=0 tx=0).stop 2024-04-20T12:22:44.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.733+0000 7f524e20b700 1 -- 172.21.15.135:0/1115033106 shutdown_connections 2024-04-20T12:22:44.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.733+0000 7f524e20b700 1 --2- 172.21.15.135:0/1115033106 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f52300a3c40 0x7f52300a6100 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:44.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.733+0000 7f524e20b700 1 --2- 172.21.15.135:0/1115033106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5248108860 0x7f52481a0220 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:44.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.733+0000 7f524e20b700 1 --2- 172.21.15.135:0/1115033106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5248103600 0x7f5248198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:44.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.733+0000 7f524e20b700 1 --2- 172.21.15.135:0/1115033106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5248105f30 0x7f52481991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:44.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.733+0000 7f524e20b700 1 -- 172.21.15.135:0/1115033106 >> 172.21.15.135:0/1115033106 conn(0x7f52480fcfb0 msgr2=0x7f5248103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:44.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.733+0000 7f524e20b700 1 -- 172.21.15.135:0/1115033106 shutdown_connections 2024-04-20T12:22:44.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:44.733+0000 7f524e20b700 1 -- 172.21.15.135:0/1115033106 wait complete. 2024-04-20T12:22:45.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:44 smithi154 ceph-mon[22073]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:22:45.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:44 smithi154 ceph-mon[22073]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 9 op/s 2024-04-20T12:22:45.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:44 smithi139 ceph-mon[21834]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:22:45.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:44 smithi139 ceph-mon[21834]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 9 op/s 2024-04-20T12:22:45.349 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:44 smithi135 ceph-mon[18264]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:22:45.349 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:44 smithi135 ceph-mon[18264]: pgmap v358: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 9 op/s 2024-04-20T12:22:45.376 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-20T12:22:45.614 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:22:47.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.306+0000 7ffaa735f700 1 -- 172.21.15.135:0/1078944281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaa0102ab0 msgr2=0x7ffaa0102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:47.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.306+0000 7ffaa735f700 1 --2- 172.21.15.135:0/1078944281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaa0102ab0 0x7ffaa0102ed0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ffa900099c0 tx=0x7ffa90009cd0 comp rx=0 tx=0).stop 2024-04-20T12:22:47.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.306+0000 7ffaa735f700 1 -- 172.21.15.135:0/1078944281 shutdown_connections 2024-04-20T12:22:47.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.306+0000 7ffaa735f700 1 --2- 172.21.15.135:0/1078944281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffaa0104650 0x7ffaa010af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:47.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.306+0000 7ffaa735f700 1 --2- 172.21.15.135:0/1078944281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaa0102ab0 0x7ffaa0102ed0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:47.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.306+0000 7ffaa735f700 1 --2- 172.21.15.135:0/1078944281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa0103cb0 0x7ffaa0104110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:47.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.306+0000 7ffaa735f700 1 -- 172.21.15.135:0/1078944281 >> 172.21.15.135:0/1078944281 conn(0x7ffaa00fe050 msgr2=0x7ffaa0100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:47.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.306+0000 7ffaa735f700 1 -- 172.21.15.135:0/1078944281 shutdown_connections 2024-04-20T12:22:47.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.306+0000 7ffaa735f700 1 -- 172.21.15.135:0/1078944281 wait complete. 2024-04-20T12:22:47.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa735f700 1 Processor -- start 2024-04-20T12:22:47.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa735f700 1 -- start start 2024-04-20T12:22:47.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa735f700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa0102ab0 0x7ffaa00767f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:47.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa735f700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaa0103cb0 0x7ffaa0074e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:47.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa735f700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffaa0104650 0x7ffaa0075380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:47.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa735f700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa010e6f0 con 0x7ffaa0103cb0 2024-04-20T12:22:47.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa735f700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa010e570 con 0x7ffaa0104650 2024-04-20T12:22:47.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa735f700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa010e870 con 0x7ffaa0102ab0 2024-04-20T12:22:47.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa48fa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaa0103cb0 0x7ffaa0074e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:47.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa48fa700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaa0103cb0 0x7ffaa0074e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51272/0 (socket says 172.21.15.135:51272) 2024-04-20T12:22:47.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa48fa700 1 -- 172.21.15.135:0/1592173657 learned_addr learned my addr 172.21.15.135:0/1592173657 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:47.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa58fc700 1 --2- 172.21.15.135:0/1592173657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffaa0104650 0x7ffaa0075380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:47.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa50fb700 1 --2- 172.21.15.135:0/1592173657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa0102ab0 0x7ffaa00767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:47.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa48fa700 1 -- 172.21.15.135:0/1592173657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa0102ab0 msgr2=0x7ffaa00767f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:47.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa48fa700 1 --2- 172.21.15.135:0/1592173657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa0102ab0 0x7ffaa00767f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:47.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa48fa700 1 -- 172.21.15.135:0/1592173657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffaa0104650 msgr2=0x7ffaa0075380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:47.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa48fa700 1 --2- 172.21.15.135:0/1592173657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffaa0104650 0x7ffaa0075380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:47.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.307+0000 7ffaa48fa700 1 -- 172.21.15.135:0/1592173657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa0075c30 con 0x7ffaa0103cb0 2024-04-20T12:22:47.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.308+0000 7ffaa48fa700 1 --2- 172.21.15.135:0/1592173657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaa0103cb0 0x7ffaa0074e40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00b530 tx=0x7ffa9c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:47.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.308+0000 7ffa967fc700 1 -- 172.21.15.135:0/1592173657 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c015020 con 0x7ffaa0103cb0 2024-04-20T12:22:47.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.308+0000 7ffa967fc700 1 -- 172.21.15.135:0/1592173657 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa9c011d10 con 0x7ffaa0103cb0 2024-04-20T12:22:47.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.308+0000 7ffaa735f700 1 -- 172.21.15.135:0/1592173657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa01a2e60 con 0x7ffaa0103cb0 2024-04-20T12:22:47.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.308+0000 7ffa967fc700 1 -- 172.21.15.135:0/1592173657 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00f2e0 con 0x7ffaa0103cb0 2024-04-20T12:22:47.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.308+0000 7ffaa735f700 1 -- 172.21.15.135:0/1592173657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa01a3340 con 0x7ffaa0103cb0 2024-04-20T12:22:47.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.309+0000 7ffaa735f700 1 -- 172.21.15.135:0/1592173657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa0069740 con 0x7ffaa0103cb0 2024-04-20T12:22:47.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.310+0000 7ffa967fc700 1 -- 172.21.15.135:0/1592173657 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ffa9c018020 con 0x7ffaa0103cb0 2024-04-20T12:22:47.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.310+0000 7ffa967fc700 1 --2- 172.21.15.135:0/1592173657 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ffa8c0a3cc0 0x7ffa8c0a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:47.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.311+0000 7ffaa50fb700 1 --2- 172.21.15.135:0/1592173657 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ffa8c0a3cc0 0x7ffa8c0a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:47.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.311+0000 7ffa967fc700 1 -- 172.21.15.135:0/1592173657 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7ffa9c0cffd0 con 0x7ffaa0103cb0 2024-04-20T12:22:47.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.311+0000 7ffaa50fb700 1 --2- 172.21.15.135:0/1592173657 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ffa8c0a3cc0 0x7ffa8c0a6180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000b580 tx=0x7ffa90005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:47.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.315+0000 7ffa967fc700 1 -- 172.21.15.135:0/1592173657 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7ffa9c01f020 con 0x7ffaa0103cb0 2024-04-20T12:22:47.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.525+0000 7ffaa735f700 1 -- 172.21.15.135:0/1592173657 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7ffaa0062e90 con 0x7ffa8c0a3cc0 2024-04-20T12:22:47.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.527+0000 7ffa967fc700 1 -- 172.21.15.135:0/1592173657 <== mgr.14152 v2:172.21.15.135:6800/3831149339 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7ffaa0062e90 con 0x7ffa8c0a3cc0 2024-04-20T12:22:47.526 INFO:teuthology.orchestra.run.smithi135.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-20T12:22:47.526 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620401BA400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-20T12:22:47.526 INFO:teuthology.orchestra.run.smithi135.stdout:smithi139 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500N6400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-04-20T12:22:47.526 INFO:teuthology.orchestra.run.smithi135.stdout:smithi154 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233003B400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-04-20T12:22:47.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.529+0000 7ffaa735f700 1 -- 172.21.15.135:0/1592173657 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ffa8c0a3cc0 msgr2=0x7ffa8c0a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:47.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.529+0000 7ffaa735f700 1 --2- 172.21.15.135:0/1592173657 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ffa8c0a3cc0 0x7ffa8c0a6180 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000b580 tx=0x7ffa90005fb0 comp rx=0 tx=0).stop 2024-04-20T12:22:47.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.529+0000 7ffaa735f700 1 -- 172.21.15.135:0/1592173657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaa0103cb0 msgr2=0x7ffaa0074e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:47.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.529+0000 7ffaa735f700 1 --2- 172.21.15.135:0/1592173657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaa0103cb0 0x7ffaa0074e40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00b530 tx=0x7ffa9c00b840 comp rx=0 tx=0).stop 2024-04-20T12:22:47.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.529+0000 7ffaa735f700 1 -- 172.21.15.135:0/1592173657 shutdown_connections 2024-04-20T12:22:47.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.529+0000 7ffaa735f700 1 --2- 172.21.15.135:0/1592173657 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ffa8c0a3cc0 0x7ffa8c0a6180 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:47.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.529+0000 7ffaa735f700 1 --2- 172.21.15.135:0/1592173657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ffaa0104650 0x7ffaa0075380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:47.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.529+0000 7ffaa735f700 1 --2- 172.21.15.135:0/1592173657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffaa0102ab0 0x7ffaa00767f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:47.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.529+0000 7ffaa735f700 1 --2- 172.21.15.135:0/1592173657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffaa0103cb0 0x7ffaa0074e40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:47.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.529+0000 7ffaa735f700 1 -- 172.21.15.135:0/1592173657 >> 172.21.15.135:0/1592173657 conn(0x7ffaa00fe050 msgr2=0x7ffaa0106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:47.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.529+0000 7ffaa735f700 1 -- 172.21.15.135:0/1592173657 shutdown_connections 2024-04-20T12:22:47.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:47.529+0000 7ffaa735f700 1 -- 172.21.15.135:0/1592173657 wait complete. 2024-04-20T12:22:48.194 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:47 smithi135 ceph-mon[18264]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 309 B/s wr, 10 op/s 2024-04-20T12:22:48.221 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-20T12:22:48.231 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-04-20T12:22:48.231 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-20T12:22:48.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:47 smithi154 ceph-mon[22073]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 309 B/s wr, 10 op/s 2024-04-20T12:22:48.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:47 smithi139 ceph-mon[21834]: pgmap v359: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 309 B/s wr, 10 op/s 2024-04-20T12:22:48.473 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:22:49.151 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:48 smithi154 ceph-mon[22073]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:22:49.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:48 smithi139 ceph-mon[21834]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:22:49.337 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:48 smithi135 ceph-mon[18264]: from='client.15336 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:22:50.211 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:49 smithi135 ceph-mon[18264]: pgmap v360: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 281 B/s wr, 9 op/s 2024-04-20T12:22:50.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.212+0000 7f9e903ed700 1 -- 172.21.15.135:0/2078383954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e88105ed0 msgr2=0x7f9e881082c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:50.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.212+0000 7f9e903ed700 1 --2- 172.21.15.135:0/2078383954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e88105ed0 0x7f9e881082c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009990 tx=0x7f9e7c009ca0 comp rx=0 tx=0).stop 2024-04-20T12:22:50.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.213+0000 7f9e903ed700 1 -- 172.21.15.135:0/2078383954 shutdown_connections 2024-04-20T12:22:50.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.213+0000 7f9e903ed700 1 --2- 172.21.15.135:0/2078383954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e88108800 0x7f9e8810ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:50.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.213+0000 7f9e903ed700 1 --2- 172.21.15.135:0/2078383954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e881035a0 0x7f9e88105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:50.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.213+0000 7f9e903ed700 1 --2- 172.21.15.135:0/2078383954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e88105ed0 0x7f9e881082c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:50.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.213+0000 7f9e903ed700 1 -- 172.21.15.135:0/2078383954 >> 172.21.15.135:0/2078383954 conn(0x7f9e880fcf50 msgr2=0x7f9e880ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:50.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.213+0000 7f9e903ed700 1 -- 172.21.15.135:0/2078383954 shutdown_connections 2024-04-20T12:22:50.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.213+0000 7f9e903ed700 1 -- 172.21.15.135:0/2078383954 wait complete. 2024-04-20T12:22:50.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.213+0000 7f9e903ed700 1 Processor -- start 2024-04-20T12:22:50.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.213+0000 7f9e903ed700 1 -- start start 2024-04-20T12:22:50.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e903ed700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e881035a0 0x7f9e88198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:50.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e903ed700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e88105ed0 0x7f9e881992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:50.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e903ed700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e88108800 0x7f9e881a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:50.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e903ed700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8810e720 con 0x7f9e881035a0 2024-04-20T12:22:50.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e903ed700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8810e5a0 con 0x7f9e88108800 2024-04-20T12:22:50.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e903ed700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8810e8a0 con 0x7f9e88105ed0 2024-04-20T12:22:50.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e8e189700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e881035a0 0x7f9e88198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:50.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e8e189700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e881035a0 0x7f9e88198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51294/0 (socket says 172.21.15.135:51294) 2024-04-20T12:22:50.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e8e189700 1 -- 172.21.15.135:0/1923068546 learned_addr learned my addr 172.21.15.135:0/1923068546 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:50.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e8e98a700 1 --2- 172.21.15.135:0/1923068546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e88108800 0x7f9e881a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:50.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e8d988700 1 --2- 172.21.15.135:0/1923068546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e88105ed0 0x7f9e881992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:50.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e8e189700 1 -- 172.21.15.135:0/1923068546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e88105ed0 msgr2=0x7f9e881992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:50.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e8e189700 1 --2- 172.21.15.135:0/1923068546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e88105ed0 0x7f9e881992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:50.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e8e189700 1 -- 172.21.15.135:0/1923068546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e88108800 msgr2=0x7f9e881a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:50.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e8e189700 1 --2- 172.21.15.135:0/1923068546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e88108800 0x7f9e881a0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:50.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e8e189700 1 -- 172.21.15.135:0/1923068546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e881a0a00 con 0x7f9e881035a0 2024-04-20T12:22:50.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e8e189700 1 --2- 172.21.15.135:0/1923068546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e881035a0 0x7f9e88198db0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000ba50 tx=0x7f9e8000bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:50.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e877fe700 1 -- 172.21.15.135:0/1923068546 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80019070 con 0x7f9e881035a0 2024-04-20T12:22:50.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e903ed700 1 -- 172.21.15.135:0/1923068546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e881a0cf0 con 0x7f9e881035a0 2024-04-20T12:22:50.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e877fe700 1 -- 172.21.15.135:0/1923068546 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e8000ce10 con 0x7f9e881035a0 2024-04-20T12:22:50.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.214+0000 7f9e877fe700 1 -- 172.21.15.135:0/1923068546 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80007390 con 0x7f9e881035a0 2024-04-20T12:22:50.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.215+0000 7f9e903ed700 1 -- 172.21.15.135:0/1923068546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e881a1180 con 0x7f9e881035a0 2024-04-20T12:22:50.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.215+0000 7f9e903ed700 1 -- 172.21.15.135:0/1923068546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e88069740 con 0x7f9e881035a0 2024-04-20T12:22:50.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.217+0000 7f9e877fe700 1 -- 172.21.15.135:0/1923068546 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f9e8001c070 con 0x7f9e881035a0 2024-04-20T12:22:50.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.218+0000 7f9e877fe700 1 --2- 172.21.15.135:0/1923068546 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9e700a3c40 0x7f9e700a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:50.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.218+0000 7f9e8d988700 1 --2- 172.21.15.135:0/1923068546 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9e700a3c40 0x7f9e700a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:50.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.218+0000 7f9e877fe700 1 -- 172.21.15.135:0/1923068546 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f9e800cfd00 con 0x7f9e881035a0 2024-04-20T12:22:50.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.218+0000 7f9e8d988700 1 --2- 172.21.15.135:0/1923068546 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9e700a3c40 0x7f9e700a6100 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00b5c0 tx=0x7f9e7c003960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:50.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.221+0000 7f9e877fe700 1 -- 172.21.15.135:0/1923068546 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f9e8009c340 con 0x7f9e881035a0 2024-04-20T12:22:50.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:49 smithi154 ceph-mon[22073]: pgmap v360: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 281 B/s wr, 9 op/s 2024-04-20T12:22:50.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:49 smithi139 ceph-mon[21834]: pgmap v360: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 281 B/s wr, 9 op/s 2024-04-20T12:22:50.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.464+0000 7f9e903ed700 1 -- 172.21.15.135:0/1923068546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9e8802e1a0 con 0x7f9e881035a0 2024-04-20T12:22:50.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.464+0000 7f9e877fe700 1 -- 172.21.15.135:0/1923068546 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3120 (secure 0 0 0) 0x7f9e8009bc40 con 0x7f9e881035a0 2024-04-20T12:22:50.463 INFO:teuthology.orchestra.run.smithi135.stdout:e28 2024-04-20T12:22:50.463 INFO:teuthology.orchestra.run.smithi135.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-20T12:22:50.463 INFO:teuthology.orchestra.run.smithi135.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-20T12:22:50.463 INFO:teuthology.orchestra.run.smithi135.stdout:legacy client fscid: 1 2024-04-20T12:22:50.464 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:50.464 INFO:teuthology.orchestra.run.smithi135.stdout:Filesystem 'cephfs' (1) 2024-04-20T12:22:50.464 INFO:teuthology.orchestra.run.smithi135.stdout:fs_name cephfs 2024-04-20T12:22:50.464 INFO:teuthology.orchestra.run.smithi135.stdout:epoch 28 2024-04-20T12:22:50.464 INFO:teuthology.orchestra.run.smithi135.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-20T12:22:50.464 INFO:teuthology.orchestra.run.smithi135.stdout:created 2024-04-20T12:20:41.367288+0000 2024-04-20T12:22:50.464 INFO:teuthology.orchestra.run.smithi135.stdout:modified 2024-04-20T12:21:09.311388+0000 2024-04-20T12:22:50.464 INFO:teuthology.orchestra.run.smithi135.stdout:tableserver 0 2024-04-20T12:22:50.464 INFO:teuthology.orchestra.run.smithi135.stdout:root 0 2024-04-20T12:22:50.464 INFO:teuthology.orchestra.run.smithi135.stdout:session_timeout 300 2024-04-20T12:22:50.464 INFO:teuthology.orchestra.run.smithi135.stdout:session_autoclose 300 2024-04-20T12:22:50.464 INFO:teuthology.orchestra.run.smithi135.stdout:max_file_size 1099511627776 2024-04-20T12:22:50.464 INFO:teuthology.orchestra.run.smithi135.stdout:max_xattr_size 65536 2024-04-20T12:22:50.464 INFO:teuthology.orchestra.run.smithi135.stdout:required_client_features {} 2024-04-20T12:22:50.465 INFO:teuthology.orchestra.run.smithi135.stdout:last_failure 0 2024-04-20T12:22:50.465 INFO:teuthology.orchestra.run.smithi135.stdout:last_failure_osd_epoch 0 2024-04-20T12:22:50.465 INFO:teuthology.orchestra.run.smithi135.stdout:snap_rstat 1 2024-04-20T12:22:50.465 INFO:teuthology.orchestra.run.smithi135.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-20T12:22:50.465 INFO:teuthology.orchestra.run.smithi135.stdout:max_mds 5 2024-04-20T12:22:50.465 INFO:teuthology.orchestra.run.smithi135.stdout:in 0,1,2,3,4 2024-04-20T12:22:50.465 INFO:teuthology.orchestra.run.smithi135.stdout:up {0=24490,1=24476,2=24475,3=24457,4=14634} 2024-04-20T12:22:50.465 INFO:teuthology.orchestra.run.smithi135.stdout:failed 2024-04-20T12:22:50.465 INFO:teuthology.orchestra.run.smithi135.stdout:damaged 2024-04-20T12:22:50.465 INFO:teuthology.orchestra.run.smithi135.stdout:stopped 2024-04-20T12:22:50.465 INFO:teuthology.orchestra.run.smithi135.stdout:data_pools [3,4] 2024-04-20T12:22:50.465 INFO:teuthology.orchestra.run.smithi135.stdout:metadata_pool 2 2024-04-20T12:22:50.465 INFO:teuthology.orchestra.run.smithi135.stdout:inline_data disabled 2024-04-20T12:22:50.465 INFO:teuthology.orchestra.run.smithi135.stdout:balancer 2024-04-20T12:22:50.466 INFO:teuthology.orchestra.run.smithi135.stdout:bal_rank_mask -1 2024-04-20T12:22:50.466 INFO:teuthology.orchestra.run.smithi135.stdout:standby_count_wanted 0 2024-04-20T12:22:50.466 INFO:teuthology.orchestra.run.smithi135.stdout:qdb_cluster leader: 24490 members: 24490,24476,14634,24457,24475 2024-04-20T12:22:50.466 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.i{0:24490} state up:active seq 5 addr [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T12:22:50.466 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.h{0:24455} state up:standby-replay seq 1 addr [v2:172.21.15.139:6836/2426010804,v1:172.21.15.139:6837/2426010804] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T12:22:50.466 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.b{1:24476} state up:active seq 9 addr [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T12:22:50.466 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.e{1:24416} state up:standby-replay seq 1 addr [v2:172.21.15.139:6834/1816377265,v1:172.21.15.139:6835/1816377265] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T12:22:50.466 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.c{2:24475} state up:active seq 13 addr [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T12:22:50.466 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.l{2:24409} state up:standby-replay seq 1 addr [v2:172.21.15.154:6832/406581782,v1:172.21.15.154:6833/406581782] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T12:22:50.466 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.f{3:24457} state up:active seq 14 addr [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T12:22:50.466 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.k{3:24389} state up:standby-replay seq 1 addr [v2:172.21.15.139:6832/2012805307,v1:172.21.15.139:6833/2012805307] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T12:22:50.466 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.a{4:14634} state up:active seq 10 addr [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T12:22:50.467 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.g{4:14622} state up:standby-replay seq 1 addr [v2:172.21.15.135:6838/3001818614,v1:172.21.15.135:6839/3001818614] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T12:22:50.467 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:50.467 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:50.467 INFO:teuthology.orchestra.run.smithi135.stdout:Standby daemons: 2024-04-20T12:22:50.467 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:50.467 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.j{-1:14535} state up:standby seq 1 addr [v2:172.21.15.135:6834/4052830457,v1:172.21.15.135:6835/4052830457] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T12:22:50.467 INFO:teuthology.orchestra.run.smithi135.stdout:[mds.d{-1:14547} state up:standby seq 1 addr [v2:172.21.15.135:6836/2239466224,v1:172.21.15.135:6837/2239466224] compat {c=[1],r=[1],i=[1fff]}] 2024-04-20T12:22:50.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.466+0000 7f9e903ed700 1 -- 172.21.15.135:0/1923068546 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9e700a3c40 msgr2=0x7f9e700a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:50.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.466+0000 7f9e903ed700 1 --2- 172.21.15.135:0/1923068546 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9e700a3c40 0x7f9e700a6100 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00b5c0 tx=0x7f9e7c003960 comp rx=0 tx=0).stop 2024-04-20T12:22:50.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.466+0000 7f9e903ed700 1 -- 172.21.15.135:0/1923068546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e881035a0 msgr2=0x7f9e88198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:50.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.466+0000 7f9e903ed700 1 --2- 172.21.15.135:0/1923068546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e881035a0 0x7f9e88198db0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000ba50 tx=0x7f9e8000bd60 comp rx=0 tx=0).stop 2024-04-20T12:22:50.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.466+0000 7f9e903ed700 1 -- 172.21.15.135:0/1923068546 shutdown_connections 2024-04-20T12:22:50.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.466+0000 7f9e903ed700 1 --2- 172.21.15.135:0/1923068546 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9e700a3c40 0x7f9e700a6100 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:50.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.466+0000 7f9e903ed700 1 --2- 172.21.15.135:0/1923068546 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e88108800 0x7f9e881a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:50.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.466+0000 7f9e903ed700 1 --2- 172.21.15.135:0/1923068546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e881035a0 0x7f9e88198db0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:50.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.466+0000 7f9e903ed700 1 --2- 172.21.15.135:0/1923068546 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e88105ed0 0x7f9e881992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:50.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.466+0000 7f9e903ed700 1 -- 172.21.15.135:0/1923068546 >> 172.21.15.135:0/1923068546 conn(0x7f9e880fcf50 msgr2=0x7f9e88104060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:50.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.466+0000 7f9e903ed700 1 -- 172.21.15.135:0/1923068546 shutdown_connections 2024-04-20T12:22:50.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:50.466+0000 7f9e903ed700 1 -- 172.21.15.135:0/1923068546 wait complete. 2024-04-20T12:22:50.469 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 28 2024-04-20T12:22:51.067 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:50 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1923068546' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T12:22:51.095 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- bash -c 'ceph osd dump' 2024-04-20T12:22:51.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:50 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1923068546' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T12:22:51.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:50 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1923068546' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-20T12:22:51.332 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:22:52.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:51 smithi135 ceph-mon[18264]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-20T12:22:52.231 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:51 smithi139 ceph-mon[21834]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-20T12:22:52.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:51 smithi154 ceph-mon[22073]: pgmap v361: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 10 op/s 2024-04-20T12:22:53.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.067+0000 7f4f6d6f8700 1 -- 172.21.15.135:0/3685469004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68103540 msgr2=0x7f4f68109df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:53.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.067+0000 7f4f6d6f8700 1 --2- 172.21.15.135:0/3685469004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68103540 0x7f4f68109df0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000b0a0 tx=0x7f4f6000b3b0 comp rx=0 tx=0).stop 2024-04-20T12:22:53.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.067+0000 7f4f6d6f8700 1 -- 172.21.15.135:0/3685469004 shutdown_connections 2024-04-20T12:22:53.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.067+0000 7f4f6d6f8700 1 --2- 172.21.15.135:0/3685469004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68103540 0x7f4f68109df0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:53.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.067+0000 7f4f6d6f8700 1 --2- 172.21.15.135:0/3685469004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f681019a0 0x7f4f68101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:53.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.067+0000 7f4f6d6f8700 1 --2- 172.21.15.135:0/3685469004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f68102ba0 0x7f4f68103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:53.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.067+0000 7f4f6d6f8700 1 -- 172.21.15.135:0/3685469004 >> 172.21.15.135:0/3685469004 conn(0x7f4f680fcf40 msgr2=0x7f4f680ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:53.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.067+0000 7f4f6d6f8700 1 -- 172.21.15.135:0/3685469004 shutdown_connections 2024-04-20T12:22:53.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.067+0000 7f4f6d6f8700 1 -- 172.21.15.135:0/3685469004 wait complete. 2024-04-20T12:22:53.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.067+0000 7f4f6d6f8700 1 Processor -- start 2024-04-20T12:22:53.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.067+0000 7f4f6d6f8700 1 -- start start 2024-04-20T12:22:53.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f6d6f8700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f681019a0 0x7f4f68198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:53.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f6d6f8700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68102ba0 0x7f4f68199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:53.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f6d6f8700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f68103540 0x7f4f681a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:53.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f6d6f8700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6810e710 con 0x7f4f68102ba0 2024-04-20T12:22:53.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f6d6f8700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6810e590 con 0x7f4f68103540 2024-04-20T12:22:53.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f6d6f8700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6810e890 con 0x7f4f681019a0 2024-04-20T12:22:53.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f667fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68102ba0 0x7f4f68199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:53.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f667fc700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68102ba0 0x7f4f68199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41146/0 (socket says 172.21.15.135:41146) 2024-04-20T12:22:53.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f667fc700 1 -- 172.21.15.135:0/3497721932 learned_addr learned my addr 172.21.15.135:0/3497721932 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:53.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f677fe700 1 --2- 172.21.15.135:0/3497721932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f68103540 0x7f4f681a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:53.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f66ffd700 1 --2- 172.21.15.135:0/3497721932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f681019a0 0x7f4f68198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:53.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f667fc700 1 -- 172.21.15.135:0/3497721932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f681019a0 msgr2=0x7f4f68198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:53.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f667fc700 1 --2- 172.21.15.135:0/3497721932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f681019a0 0x7f4f68198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:53.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f667fc700 1 -- 172.21.15.135:0/3497721932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f68103540 msgr2=0x7f4f681a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:53.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f667fc700 1 --2- 172.21.15.135:0/3497721932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f68103540 0x7f4f681a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:53.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f667fc700 1 -- 172.21.15.135:0/3497721932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f681a0880 con 0x7f4f68102ba0 2024-04-20T12:22:53.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f667fc700 1 --2- 172.21.15.135:0/3497721932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68102ba0 0x7f4f68199170 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00c920 tx=0x7f4f5c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:53.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f4ffff700 1 -- 172.21.15.135:0/3497721932 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c004a30 con 0x7f4f68102ba0 2024-04-20T12:22:53.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.068+0000 7f4f6d6f8700 1 -- 172.21.15.135:0/3497721932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f681a0b70 con 0x7f4f68102ba0 2024-04-20T12:22:53.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.069+0000 7f4f4ffff700 1 -- 172.21.15.135:0/3497721932 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f5c005500 con 0x7f4f68102ba0 2024-04-20T12:22:53.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.069+0000 7f4f4ffff700 1 -- 172.21.15.135:0/3497721932 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c007d00 con 0x7f4f68102ba0 2024-04-20T12:22:53.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.069+0000 7f4f6d6f8700 1 -- 172.21.15.135:0/3497721932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f681a1100 con 0x7f4f68102ba0 2024-04-20T12:22:53.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.069+0000 7f4f6d6f8700 1 -- 172.21.15.135:0/3497721932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f68069740 con 0x7f4f68102ba0 2024-04-20T12:22:53.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.071+0000 7f4f4ffff700 1 -- 172.21.15.135:0/3497721932 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f4f5c005000 con 0x7f4f68102ba0 2024-04-20T12:22:53.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.071+0000 7f4f4ffff700 1 --2- 172.21.15.135:0/3497721932 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f500a3c40 0x7f4f500a6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:53.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.071+0000 7f4f66ffd700 1 --2- 172.21.15.135:0/3497721932 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f500a3c40 0x7f4f500a6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:53.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.071+0000 7f4f4ffff700 1 -- 172.21.15.135:0/3497721932 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f4f5c0d06c0 con 0x7f4f68102ba0 2024-04-20T12:22:53.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.072+0000 7f4f66ffd700 1 --2- 172.21.15.135:0/3497721932 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f500a3c40 0x7f4f500a6100 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4f58005950 tx=0x7f4f5800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:53.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.075+0000 7f4f4ffff700 1 -- 172.21.15.135:0/3497721932 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f4f5c014030 con 0x7f4f68102ba0 2024-04-20T12:22:53.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.274+0000 7f4f6d6f8700 1 -- 172.21.15.135:0/3497721932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f4f6802e060 con 0x7f4f68102ba0 2024-04-20T12:22:53.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.275+0000 7f4f4ffff700 1 -- 172.21.15.135:0/3497721932 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v94) ==== 56+0+5681 (secure 0 0 0) 0x7f4f5c09cd00 con 0x7f4f68102ba0 2024-04-20T12:22:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:epoch 94 2024-04-20T12:22:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:fsid 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:22:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:created 2024-04-20T12:12:43.366193+0000 2024-04-20T12:22:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:modified 2024-04-20T12:22:37.927600+0000 2024-04-20T12:22:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-20T12:22:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:crush_version 27 2024-04-20T12:22:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:full_ratio 0.95 2024-04-20T12:22:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:backfillfull_ratio 0.9 2024-04-20T12:22:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:nearfull_ratio 0.85 2024-04-20T12:22:53.274 INFO:teuthology.orchestra.run.smithi135.stdout:require_min_compat_client luminous 2024-04-20T12:22:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:min_compat_client luminous 2024-04-20T12:22:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:require_osd_release squid 2024-04-20T12:22:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:stretch_mode_enabled false 2024-04-20T12:22:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-04-20T12:22:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-04-20T12:22:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-04-20T12:22:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 90 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-04-20T12:22:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:max_osd 12 2024-04-20T12:22:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:osd.0 up in weight 1 up_from 8 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6802/231033144,v1:172.21.15.135:6803/231033144] [v2:172.21.15.135:6804/231033144,v1:172.21.15.135:6805/231033144] exists,up 57163598-6432-4dc1-b390-bcf40e339545 2024-04-20T12:22:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:osd.1 up in weight 1 up_from 13 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6800/4149997416,v1:172.21.15.139:6801/4149997416] [v2:172.21.15.139:6802/4149997416,v1:172.21.15.139:6803/4149997416] exists,up c049f1ea-0ec4-4aa5-9971-8d989b8c366a 2024-04-20T12:22:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:osd.2 up in weight 1 up_from 18 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/4166169084,v1:172.21.15.154:6801/4166169084] [v2:172.21.15.154:6802/4166169084,v1:172.21.15.154:6803/4166169084] exists,up 248b1c85-1ec2-42c9-8f11-f1a57cb258a9 2024-04-20T12:22:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:osd.3 up in weight 1 up_from 25 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6810/3478243444,v1:172.21.15.135:6811/3478243444] [v2:172.21.15.135:6812/3478243444,v1:172.21.15.135:6813/3478243444] exists,up 70d9c325-bfce-44ca-b2b6-fbe6126a820c 2024-04-20T12:22:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:osd.4 up in weight 1 up_from 33 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6808/450289913,v1:172.21.15.139:6809/450289913] [v2:172.21.15.139:6810/450289913,v1:172.21.15.139:6811/450289913] exists,up 73f90e0c-3a6a-4c13-8543-a3d50f08d2d5 2024-04-20T12:22:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:osd.5 up in weight 1 up_from 38 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6808/512519935,v1:172.21.15.154:6809/512519935] [v2:172.21.15.154:6810/512519935,v1:172.21.15.154:6811/512519935] exists,up 5f0a8f64-2120-43e3-a452-c19a3323a645 2024-04-20T12:22:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:osd.6 up in weight 1 up_from 46 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6818/2765424966,v1:172.21.15.135:6819/2765424966] [v2:172.21.15.135:6820/2765424966,v1:172.21.15.135:6821/2765424966] exists,up ddd0e044-f07f-46a8-b2d2-56c0c14a1c14 2024-04-20T12:22:53.276 INFO:teuthology.orchestra.run.smithi135.stdout:osd.7 up in weight 1 up_from 51 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6816/3279788017,v1:172.21.15.139:6817/3279788017] [v2:172.21.15.139:6818/3279788017,v1:172.21.15.139:6819/3279788017] exists,up ea3e9f8b-d627-413a-9146-bd3fea8948a0 2024-04-20T12:22:53.276 INFO:teuthology.orchestra.run.smithi135.stdout:osd.8 up in weight 1 up_from 59 up_thru 93 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6816/2723868018,v1:172.21.15.154:6817/2723868018] [v2:172.21.15.154:6818/2723868018,v1:172.21.15.154:6819/2723868018] exists,up 3afbaac4-d30b-401e-b363-174bb38023c2 2024-04-20T12:22:53.276 INFO:teuthology.orchestra.run.smithi135.stdout:osd.9 up in weight 1 up_from 67 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6826/3054405376,v1:172.21.15.135:6827/3054405376] [v2:172.21.15.135:6828/3054405376,v1:172.21.15.135:6829/3054405376] exists,up e4f7257b-a6c1-47df-af14-ef8a5cdab68e 2024-04-20T12:22:53.276 INFO:teuthology.orchestra.run.smithi135.stdout:osd.10 up in weight 1 up_from 72 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.139:6824/367683232,v1:172.21.15.139:6825/367683232] [v2:172.21.15.139:6826/367683232,v1:172.21.15.139:6827/367683232] exists,up 5be0ab8c-4f88-4d25-b656-d40245b76d01 2024-04-20T12:22:53.276 INFO:teuthology.orchestra.run.smithi135.stdout:osd.11 up in weight 1 up_from 80 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6824/4024362144,v1:172.21.15.154:6825/4024362144] [v2:172.21.15.154:6826/4024362144,v1:172.21.15.154:6827/4024362144] exists,up c88673e8-c6e7-44f8-ac95-e7c00f413f93 2024-04-20T12:22:53.276 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 2.a [2,11,8,1] 2024-04-20T12:22:53.276 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 2.1b [2,4] 2024-04-20T12:22:53.276 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 2.1d [8,11] 2024-04-20T12:22:53.276 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.12 [3,9] 2024-04-20T12:22:53.276 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.17 [4,8] 2024-04-20T12:22:53.276 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.1b [4,6] 2024-04-20T12:22:53.276 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.1d [5,9] 2024-04-20T12:22:53.276 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 3.36 [4,9] 2024-04-20T12:22:53.276 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 4.6 [5,8] 2024-04-20T12:22:53.276 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 4.12 [9,10] 2024-04-20T12:22:53.277 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 4.1b [9,8] 2024-04-20T12:22:53.277 INFO:teuthology.orchestra.run.smithi135.stdout:pg_upmap_items 4.1c [9,8] 2024-04-20T12:22:53.277 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:6800/2178168771 expires 2024-04-21T12:13:36.719889+0000 2024-04-20T12:22:53.277 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/152375197 expires 2024-04-21T12:13:36.719889+0000 2024-04-20T12:22:53.277 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/4252118847 expires 2024-04-21T12:13:36.719889+0000 2024-04-20T12:22:53.277 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/3207517469 expires 2024-04-21T12:13:10.061188+0000 2024-04-20T12:22:53.277 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:6801/2178168771 expires 2024-04-21T12:13:36.719889+0000 2024-04-20T12:22:53.277 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/2737907457 expires 2024-04-21T12:13:10.061188+0000 2024-04-20T12:22:53.277 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:6800/469891744 expires 2024-04-21T12:13:10.061188+0000 2024-04-20T12:22:53.277 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:6801/469891744 expires 2024-04-21T12:13:10.061188+0000 2024-04-20T12:22:53.277 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/2298786540 expires 2024-04-21T12:13:10.061188+0000 2024-04-20T12:22:53.277 INFO:teuthology.orchestra.run.smithi135.stdout:blocklist 172.21.15.135:0/3680323343 expires 2024-04-21T12:13:36.719889+0000 2024-04-20T12:22:53.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.277+0000 7f4f6d6f8700 1 -- 172.21.15.135:0/3497721932 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f500a3c40 msgr2=0x7f4f500a6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:53.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.277+0000 7f4f6d6f8700 1 --2- 172.21.15.135:0/3497721932 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f500a3c40 0x7f4f500a6100 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4f58005950 tx=0x7f4f5800a300 comp rx=0 tx=0).stop 2024-04-20T12:22:53.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.277+0000 7f4f6d6f8700 1 -- 172.21.15.135:0/3497721932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68102ba0 msgr2=0x7f4f68199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:53.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.277+0000 7f4f6d6f8700 1 --2- 172.21.15.135:0/3497721932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68102ba0 0x7f4f68199170 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00c920 tx=0x7f4f5c00cc30 comp rx=0 tx=0).stop 2024-04-20T12:22:53.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.277+0000 7f4f6d6f8700 1 -- 172.21.15.135:0/3497721932 shutdown_connections 2024-04-20T12:22:53.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.277+0000 7f4f6d6f8700 1 --2- 172.21.15.135:0/3497721932 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f4f500a3c40 0x7f4f500a6100 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:53.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.277+0000 7f4f6d6f8700 1 --2- 172.21.15.135:0/3497721932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f68103540 0x7f4f681a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:53.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.277+0000 7f4f6d6f8700 1 --2- 172.21.15.135:0/3497721932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f681019a0 0x7f4f68198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:53.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.277+0000 7f4f6d6f8700 1 --2- 172.21.15.135:0/3497721932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f68102ba0 0x7f4f68199170 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:53.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.277+0000 7f4f6d6f8700 1 -- 172.21.15.135:0/3497721932 >> 172.21.15.135:0/3497721932 conn(0x7f4f680fcf40 msgr2=0x7f4f68105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:53.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.277+0000 7f4f6d6f8700 1 -- 172.21.15.135:0/3497721932 shutdown_connections 2024-04-20T12:22:53.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:53.277+0000 7f4f6d6f8700 1 -- 172.21.15.135:0/3497721932 wait complete. 2024-04-20T12:22:54.008 INFO:teuthology.run_tasks:Running task fs.ready... 2024-04-20T12:22:54.020 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:22:54.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.130+0000 7f907e132640 1 -- 172.21.15.135:0/2448307860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9078101ff0 msgr2=0x7f9078102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:54.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.130+0000 7f907e132640 1 --2- 172.21.15.135:0/2448307860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9078101ff0 0x7f9078102470 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9060009900 tx=0x7f906002bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:54.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.130+0000 7f907e132640 1 -- 172.21.15.135:0/2448307860 shutdown_connections 2024-04-20T12:22:54.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.130+0000 7f907e132640 1 --2- 172.21.15.135:0/2448307860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90781029b0 0x7f90781092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.130+0000 7f907e132640 1 --2- 172.21.15.135:0/2448307860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9078101ff0 0x7f9078102470 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.130+0000 7f907e132640 1 --2- 172.21.15.135:0/2448307860 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9078100ea0 0x7f90781012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.130+0000 7f907e132640 1 -- 172.21.15.135:0/2448307860 >> 172.21.15.135:0/2448307860 conn(0x7f90780fc410 msgr2=0x7f90780fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:54.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.130+0000 7f907e132640 1 -- 172.21.15.135:0/2448307860 shutdown_connections 2024-04-20T12:22:54.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.130+0000 7f907e132640 1 -- 172.21.15.135:0/2448307860 wait complete. 2024-04-20T12:22:54.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.130+0000 7f907e132640 1 Processor -- start 2024-04-20T12:22:54.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f907e132640 1 -- start start 2024-04-20T12:22:54.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f907e132640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9078100ea0 0x7f9078069c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:54.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f907e132640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9078101ff0 0x7f907819d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:54.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f907e132640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90781029b0 0x7f907819f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:54.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f907e132640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f907810cb40 con 0x7f9078100ea0 2024-04-20T12:22:54.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f907e132640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f907810c9c0 con 0x7f9078101ff0 2024-04-20T12:22:54.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f907e132640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f907810ccc0 con 0x7f90781029b0 2024-04-20T12:22:54.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f90777fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9078100ea0 0x7f9078069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:54.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f90777fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9078100ea0 0x7f9078069c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41162/0 (socket says 172.21.15.135:41162) 2024-04-20T12:22:54.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f90777fe640 1 -- 172.21.15.135:0/736779585 learned_addr learned my addr 172.21.15.135:0/736779585 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:54.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f906effd640 1 --2- 172.21.15.135:0/736779585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9078101ff0 0x7f907819d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:54.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f9077fff640 1 --2- 172.21.15.135:0/736779585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90781029b0 0x7f907819f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:54.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f90777fe640 1 -- 172.21.15.135:0/736779585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90781029b0 msgr2=0x7f907819f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:54.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f90777fe640 1 --2- 172.21.15.135:0/736779585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90781029b0 0x7f907819f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f90777fe640 1 -- 172.21.15.135:0/736779585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9078101ff0 msgr2=0x7f907819d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:54.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f90777fe640 1 --2- 172.21.15.135:0/736779585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9078101ff0 0x7f907819d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f90777fe640 1 -- 172.21.15.135:0/736779585 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907819ff30 con 0x7f9078100ea0 2024-04-20T12:22:54.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.131+0000 7f90777fe640 1 --2- 172.21.15.135:0/736779585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9078100ea0 0x7f9078069c60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f906800e9f0 tx=0x7f906800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:54.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.132+0000 7f90757fa640 1 -- 172.21.15.135:0/736779585 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906800cd80 con 0x7f9078100ea0 2024-04-20T12:22:54.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.132+0000 7f907e132640 1 -- 172.21.15.135:0/736779585 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90781a01c0 con 0x7f9078100ea0 2024-04-20T12:22:54.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.132+0000 7f90757fa640 1 -- 172.21.15.135:0/736779585 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9068010910 con 0x7f9078100ea0 2024-04-20T12:22:54.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.132+0000 7f90757fa640 1 -- 172.21.15.135:0/736779585 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90680188f0 con 0x7f9078100ea0 2024-04-20T12:22:54.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.132+0000 7f907e132640 1 -- 172.21.15.135:0/736779585 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90781a06e0 con 0x7f9078100ea0 2024-04-20T12:22:54.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.133+0000 7f907e132640 1 -- 172.21.15.135:0/736779585 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90781081b0 con 0x7f9078100ea0 2024-04-20T12:22:54.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.134+0000 7f90757fa640 1 -- 172.21.15.135:0/736779585 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f9068010ac0 con 0x7f9078100ea0 2024-04-20T12:22:54.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.134+0000 7f90757fa640 1 --2- 172.21.15.135:0/736779585 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f90640a3bb0 0x7f90640a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:54.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.134+0000 7f906effd640 1 --2- 172.21.15.135:0/736779585 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f90640a3bb0 0x7f90640a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:54.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.134+0000 7f90757fa640 1 -- 172.21.15.135:0/736779585 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f90680d0c90 con 0x7f9078100ea0 2024-04-20T12:22:54.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.135+0000 7f906effd640 1 --2- 172.21.15.135:0/736779585 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f90640a3bb0 0x7f90640a6070 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f906002c7b0 tx=0x7f9060005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:54.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.139+0000 7f90757fa640 1 -- 172.21.15.135:0/736779585 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f906809d2d0 con 0x7f9078100ea0 2024-04-20T12:22:54.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:53 smithi154 ceph-mon[22073]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-20T12:22:54.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:53 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3497721932' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-20T12:22:54.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.319+0000 7f907e132640 1 -- 172.21.15.135:0/736779585 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9078062b90 con 0x7f9078100ea0 2024-04-20T12:22:54.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.321+0000 7f90757fa640 1 -- 172.21.15.135:0/736779585 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24814 (secure 0 0 0) 0x7f906809cbd0 con 0x7f9078100ea0 2024-04-20T12:22:54.320 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:54.320 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":94,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:22:37.927600+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:22:54.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.323+0000 7f907e132640 1 -- 172.21.15.135:0/736779585 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f90640a3bb0 msgr2=0x7f90640a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:54.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.323+0000 7f907e132640 1 --2- 172.21.15.135:0/736779585 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f90640a3bb0 0x7f90640a6070 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f906002c7b0 tx=0x7f9060005fd0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.323+0000 7f907e132640 1 -- 172.21.15.135:0/736779585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9078100ea0 msgr2=0x7f9078069c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:54.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.323+0000 7f907e132640 1 --2- 172.21.15.135:0/736779585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9078100ea0 0x7f9078069c60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f906800e9f0 tx=0x7f906800eeb0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.323+0000 7f907e132640 1 -- 172.21.15.135:0/736779585 shutdown_connections 2024-04-20T12:22:54.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.323+0000 7f907e132640 1 --2- 172.21.15.135:0/736779585 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f90640a3bb0 0x7f90640a6070 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.323+0000 7f907e132640 1 --2- 172.21.15.135:0/736779585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f90781029b0 0x7f907819f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.323+0000 7f907e132640 1 --2- 172.21.15.135:0/736779585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9078101ff0 0x7f907819d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.323+0000 7f907e132640 1 --2- 172.21.15.135:0/736779585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9078100ea0 0x7f9078069c60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.323+0000 7f907e132640 1 -- 172.21.15.135:0/736779585 >> 172.21.15.135:0/736779585 conn(0x7f90780fc410 msgr2=0x7f9078105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:54.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.323+0000 7f907e132640 1 -- 172.21.15.135:0/736779585 shutdown_connections 2024-04-20T12:22:54.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.323+0000 7f907e132640 1 -- 172.21.15.135:0/736779585 wait complete. 2024-04-20T12:22:54.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:53 smithi139 ceph-mon[21834]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-20T12:22:54.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:53 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3497721932' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-20T12:22:54.333 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:53 smithi135 ceph-mon[18264]: pgmap v362: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-20T12:22:54.333 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:53 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3497721932' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-04-20T12:22:54.335 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T12:16:02.802023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T12:20:39.656129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T12:20:40.312827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T12:20:44.307136+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T12:22:54.335 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T12:22:54.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.437+0000 7f1a3c23f640 1 -- 172.21.15.135:0/3404727704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a34101b10 msgr2=0x7f1a341093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:54.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.437+0000 7f1a3c23f640 1 --2- 172.21.15.135:0/3404727704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a34101b10 0x7f1a341093b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009cd0 tx=0x7f1a2c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.438+0000 7f1a3c23f640 1 -- 172.21.15.135:0/3404727704 shutdown_connections 2024-04-20T12:22:54.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.438+0000 7f1a3c23f640 1 --2- 172.21.15.135:0/3404727704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a34101b10 0x7f1a341093b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.438+0000 7f1a3c23f640 1 --2- 172.21.15.135:0/3404727704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a34101150 0x7f1a341015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.438+0000 7f1a3c23f640 1 --2- 172.21.15.135:0/3404727704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a341024b0 0x7f1a341028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.438+0000 7f1a3c23f640 1 -- 172.21.15.135:0/3404727704 >> 172.21.15.135:0/3404727704 conn(0x7f1a340fbba0 msgr2=0x7f1a340fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:54.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.438+0000 7f1a3c23f640 1 -- 172.21.15.135:0/3404727704 shutdown_connections 2024-04-20T12:22:54.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.438+0000 7f1a3c23f640 1 -- 172.21.15.135:0/3404727704 wait complete. 2024-04-20T12:22:54.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.438+0000 7f1a3c23f640 1 Processor -- start 2024-04-20T12:22:54.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.438+0000 7f1a3c23f640 1 -- start start 2024-04-20T12:22:54.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.438+0000 7f1a3c23f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a34101150 0x7f1a34100bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:54.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.438+0000 7f1a3c23f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a34101b10 0x7f1a3419cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:54.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.438+0000 7f1a3c23f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a341024b0 0x7f1a3419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:54.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.438+0000 7f1a3c23f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3410cb30 con 0x7f1a34101150 2024-04-20T12:22:54.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.438+0000 7f1a3c23f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3410c9b0 con 0x7f1a341024b0 2024-04-20T12:22:54.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.438+0000 7f1a3c23f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3410ccb0 con 0x7f1a34101b10 2024-04-20T12:22:54.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a39fdb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a34101150 0x7f1a34100bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:54.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a39fdb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a34101150 0x7f1a34100bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41184/0 (socket says 172.21.15.135:41184) 2024-04-20T12:22:54.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a39fdb640 1 -- 172.21.15.135:0/3602598320 learned_addr learned my addr 172.21.15.135:0/3602598320 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:54.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a397da640 1 --2- 172.21.15.135:0/3602598320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a34101b10 0x7f1a3419cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:54.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a3a7dc640 1 --2- 172.21.15.135:0/3602598320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a341024b0 0x7f1a3419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:54.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a39fdb640 1 -- 172.21.15.135:0/3602598320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a34101b10 msgr2=0x7f1a3419cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:54.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a39fdb640 1 --2- 172.21.15.135:0/3602598320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a34101b10 0x7f1a3419cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a39fdb640 1 -- 172.21.15.135:0/3602598320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a341024b0 msgr2=0x7f1a3419f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:54.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a39fdb640 1 --2- 172.21.15.135:0/3602598320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a341024b0 0x7f1a3419f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a39fdb640 1 -- 172.21.15.135:0/3602598320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3419fe90 con 0x7f1a34101150 2024-04-20T12:22:54.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a39fdb640 1 --2- 172.21.15.135:0/3602598320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a34101150 0x7f1a34100bb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400c970 tx=0x7f1a2400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:54.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a2affd640 1 -- 172.21.15.135:0/3602598320 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24004220 con 0x7f1a34101150 2024-04-20T12:22:54.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a2affd640 1 -- 172.21.15.135:0/3602598320 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a240043c0 con 0x7f1a34101150 2024-04-20T12:22:54.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a3c23f640 1 -- 172.21.15.135:0/3602598320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a341a0120 con 0x7f1a34101150 2024-04-20T12:22:54.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a2affd640 1 -- 172.21.15.135:0/3602598320 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400f450 con 0x7f1a34101150 2024-04-20T12:22:54.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.439+0000 7f1a3c23f640 1 -- 172.21.15.135:0/3602598320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a341a0670 con 0x7f1a34101150 2024-04-20T12:22:54.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.440+0000 7f1a3c23f640 1 -- 172.21.15.135:0/3602598320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a34108290 con 0x7f1a34101150 2024-04-20T12:22:54.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.441+0000 7f1a2affd640 1 -- 172.21.15.135:0/3602598320 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f1a240079b0 con 0x7f1a34101150 2024-04-20T12:22:54.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.442+0000 7f1a2affd640 1 --2- 172.21.15.135:0/3602598320 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1a200a3bb0 0x7f1a200a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:54.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.442+0000 7f1a2affd640 1 -- 172.21.15.135:0/3602598320 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f1a240d0460 con 0x7f1a34101150 2024-04-20T12:22:54.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.442+0000 7f1a397da640 1 --2- 172.21.15.135:0/3602598320 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1a200a3bb0 0x7f1a200a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:54.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.442+0000 7f1a397da640 1 --2- 172.21.15.135:0/3602598320 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1a200a3bb0 0x7f1a200a6070 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1a34100920 tx=0x7f1a3000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:54.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.446+0000 7f1a2affd640 1 -- 172.21.15.135:0/3602598320 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f1a24014030 con 0x7f1a34101150 2024-04-20T12:22:54.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.626+0000 7f1a3c23f640 1 -- 172.21.15.135:0/3602598320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1a34062b90 con 0x7f1a34101150 2024-04-20T12:22:54.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.626+0000 7f1a2affd640 1 -- 172.21.15.135:0/3602598320 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7f1a2409caa0 con 0x7f1a34101150 2024-04-20T12:22:54.625 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-04-20T12:22:54.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.629+0000 7f1a3c23f640 1 -- 172.21.15.135:0/3602598320 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1a200a3bb0 msgr2=0x7f1a200a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:54.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.629+0000 7f1a3c23f640 1 --2- 172.21.15.135:0/3602598320 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1a200a3bb0 0x7f1a200a6070 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1a34100920 tx=0x7f1a3000a2d0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.629+0000 7f1a3c23f640 1 -- 172.21.15.135:0/3602598320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a34101150 msgr2=0x7f1a34100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:54.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.629+0000 7f1a3c23f640 1 --2- 172.21.15.135:0/3602598320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a34101150 0x7f1a34100bb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400c970 tx=0x7f1a2400cd70 comp rx=0 tx=0).stop 2024-04-20T12:22:54.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.629+0000 7f1a3c23f640 1 -- 172.21.15.135:0/3602598320 shutdown_connections 2024-04-20T12:22:54.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.629+0000 7f1a3c23f640 1 --2- 172.21.15.135:0/3602598320 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f1a200a3bb0 0x7f1a200a6070 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.629+0000 7f1a3c23f640 1 --2- 172.21.15.135:0/3602598320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a341024b0 0x7f1a3419f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.629+0000 7f1a3c23f640 1 --2- 172.21.15.135:0/3602598320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a34101b10 0x7f1a3419cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.629+0000 7f1a3c23f640 1 --2- 172.21.15.135:0/3602598320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a34101150 0x7f1a34100bb0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.629+0000 7f1a3c23f640 1 -- 172.21.15.135:0/3602598320 >> 172.21.15.135:0/3602598320 conn(0x7f1a340fbba0 msgr2=0x7f1a34105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:54.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.629+0000 7f1a3c23f640 1 -- 172.21.15.135:0/3602598320 shutdown_connections 2024-04-20T12:22:54.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.629+0000 7f1a3c23f640 1 -- 172.21.15.135:0/3602598320 wait complete. 2024-04-20T12:22:54.639 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T12:22:54.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.741+0000 7f3541e3f640 1 -- 172.21.15.135:0/3440832569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f353c101b30 msgr2=0x7f353c1093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:54.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.741+0000 7f3541e3f640 1 --2- 172.21.15.135:0/3440832569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f353c101b30 0x7f353c1093d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3534009ca0 tx=0x7f353402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.741+0000 7f3541e3f640 1 -- 172.21.15.135:0/3440832569 shutdown_connections 2024-04-20T12:22:54.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.741+0000 7f3541e3f640 1 --2- 172.21.15.135:0/3440832569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f353c101b30 0x7f353c1093d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.741+0000 7f3541e3f640 1 --2- 172.21.15.135:0/3440832569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f353c101170 0x7f353c1015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.741+0000 7f3541e3f640 1 --2- 172.21.15.135:0/3440832569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f353c102440 0x7f353c102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.741+0000 7f3541e3f640 1 -- 172.21.15.135:0/3440832569 >> 172.21.15.135:0/3440832569 conn(0x7f353c0fbba0 msgr2=0x7f353c0fdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:54.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.741+0000 7f3541e3f640 1 -- 172.21.15.135:0/3440832569 shutdown_connections 2024-04-20T12:22:54.742 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.741+0000 7f3541e3f640 1 -- 172.21.15.135:0/3440832569 wait complete. 2024-04-20T12:22:54.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.741+0000 7f3541e3f640 1 Processor -- start 2024-04-20T12:22:54.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f3541e3f640 1 -- start start 2024-04-20T12:22:54.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f3541e3f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f353c101170 0x7f353c197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:54.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f3541e3f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f353c101b30 0x7f353c197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:54.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f3541e3f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f353c102440 0x7f353c19e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:54.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f3541e3f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f353c10cb40 con 0x7f353c102440 2024-04-20T12:22:54.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f3541e3f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f353c10c9c0 con 0x7f353c101170 2024-04-20T12:22:54.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f3541e3f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f353c10ccc0 con 0x7f353c101b30 2024-04-20T12:22:54.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f353bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f353c102440 0x7f353c19e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:54.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f353bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f353c102440 0x7f353c19e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41200/0 (socket says 172.21.15.135:41200) 2024-04-20T12:22:54.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f353bfff640 1 -- 172.21.15.135:0/3546768819 learned_addr learned my addr 172.21.15.135:0/3546768819 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:54.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f353b7fe640 1 --2- 172.21.15.135:0/3546768819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f353c101170 0x7f353c197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:54.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f353affd640 1 --2- 172.21.15.135:0/3546768819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f353c101b30 0x7f353c197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:54.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f353bfff640 1 -- 172.21.15.135:0/3546768819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f353c101b30 msgr2=0x7f353c197660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:54.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f353bfff640 1 --2- 172.21.15.135:0/3546768819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f353c101b30 0x7f353c197660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f353bfff640 1 -- 172.21.15.135:0/3546768819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f353c101170 msgr2=0x7f353c197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:54.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f353bfff640 1 --2- 172.21.15.135:0/3546768819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f353c101170 0x7f353c197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f353bfff640 1 -- 172.21.15.135:0/3546768819 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353c19ed40 con 0x7f353c102440 2024-04-20T12:22:54.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f353affd640 1 --2- 172.21.15.135:0/3546768819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f353c101b30 0x7f353c197660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:54.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f353bfff640 1 --2- 172.21.15.135:0/3546768819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f353c102440 0x7f353c19e6d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3534037040 tx=0x7f3534032f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:54.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f3538ff9640 1 -- 172.21.15.135:0/3546768819 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3534032690 con 0x7f353c102440 2024-04-20T12:22:54.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.742+0000 7f3538ff9640 1 -- 172.21.15.135:0/3546768819 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3534032830 con 0x7f353c102440 2024-04-20T12:22:54.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.743+0000 7f3538ff9640 1 -- 172.21.15.135:0/3546768819 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35340042a0 con 0x7f353c102440 2024-04-20T12:22:54.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.743+0000 7f3541e3f640 1 -- 172.21.15.135:0/3546768819 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353c100060 con 0x7f353c102440 2024-04-20T12:22:54.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.743+0000 7f3541e3f640 1 -- 172.21.15.135:0/3546768819 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353c100550 con 0x7f353c102440 2024-04-20T12:22:54.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.744+0000 7f3541e3f640 1 -- 172.21.15.135:0/3546768819 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f353c0691d0 con 0x7f353c102440 2024-04-20T12:22:54.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.745+0000 7f3538ff9640 1 -- 172.21.15.135:0/3546768819 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f3534004440 con 0x7f353c102440 2024-04-20T12:22:54.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.745+0000 7f3538ff9640 1 --2- 172.21.15.135:0/3546768819 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f35240a3bb0 0x7f35240a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:54.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.745+0000 7f353b7fe640 1 --2- 172.21.15.135:0/3546768819 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f35240a3bb0 0x7f35240a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:54.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.745+0000 7f3538ff9640 1 -- 172.21.15.135:0/3546768819 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f35340f46c0 con 0x7f353c102440 2024-04-20T12:22:54.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.746+0000 7f353b7fe640 1 --2- 172.21.15.135:0/3546768819 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f35240a3bb0 0x7f35240a6070 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f353c06a300 tx=0x7f352c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:54.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.749+0000 7f3538ff9640 1 -- 172.21.15.135:0/3546768819 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f35340c0d00 con 0x7f353c102440 2024-04-20T12:22:54.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.928+0000 7f3541e3f640 1 -- 172.21.15.135:0/3546768819 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f353c108310 con 0x7f353c102440 2024-04-20T12:22:54.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.928+0000 7f3538ff9640 1 -- 172.21.15.135:0/3546768819 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) ==== 104+0+11 (secure 0 0 0) 0x7f35340c0600 con 0x7f353c102440 2024-04-20T12:22:54.927 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:22:54.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.930+0000 7f3541e3f640 1 -- 172.21.15.135:0/3546768819 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f35240a3bb0 msgr2=0x7f35240a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:54.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.930+0000 7f3541e3f640 1 --2- 172.21.15.135:0/3546768819 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f35240a3bb0 0x7f35240a6070 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f353c06a300 tx=0x7f352c005f90 comp rx=0 tx=0).stop 2024-04-20T12:22:54.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.930+0000 7f3541e3f640 1 -- 172.21.15.135:0/3546768819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f353c102440 msgr2=0x7f353c19e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:54.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.930+0000 7f3541e3f640 1 --2- 172.21.15.135:0/3546768819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f353c102440 0x7f353c19e6d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3534037040 tx=0x7f3534032f00 comp rx=0 tx=0).stop 2024-04-20T12:22:54.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.930+0000 7f3541e3f640 1 -- 172.21.15.135:0/3546768819 shutdown_connections 2024-04-20T12:22:54.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.930+0000 7f3541e3f640 1 --2- 172.21.15.135:0/3546768819 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f35240a3bb0 0x7f35240a6070 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.930+0000 7f3541e3f640 1 --2- 172.21.15.135:0/3546768819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f353c102440 0x7f353c19e6d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.930+0000 7f3541e3f640 1 --2- 172.21.15.135:0/3546768819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f353c101b30 0x7f353c197660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.930+0000 7f3541e3f640 1 --2- 172.21.15.135:0/3546768819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f353c101170 0x7f353c197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:54.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.930+0000 7f3541e3f640 1 -- 172.21.15.135:0/3546768819 >> 172.21.15.135:0/3546768819 conn(0x7f353c0fbba0 msgr2=0x7f353c105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:54.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.930+0000 7f3541e3f640 1 -- 172.21.15.135:0/3546768819 shutdown_connections 2024-04-20T12:22:54.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:54.930+0000 7f3541e3f640 1 -- 172.21.15.135:0/3546768819 wait complete. 2024-04-20T12:22:54.941 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T12:22:55.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.042+0000 7ff336e77640 1 -- 172.21.15.135:0/3651737848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff330102a10 msgr2=0x7ff330109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.042+0000 7ff336e77640 1 --2- 172.21.15.135:0/3651737848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff330102a10 0x7ff330109330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff318009900 tx=0x7ff31802bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:55.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.042+0000 7ff336e77640 1 -- 172.21.15.135:0/3651737848 shutdown_connections 2024-04-20T12:22:55.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.042+0000 7ff336e77640 1 --2- 172.21.15.135:0/3651737848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff330102a10 0x7ff330109330 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.042+0000 7ff336e77640 1 --2- 172.21.15.135:0/3651737848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff330102050 0x7ff3301024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.042+0000 7ff336e77640 1 --2- 172.21.15.135:0/3651737848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff330100e70 0x7ff330101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.042+0000 7ff336e77640 1 -- 172.21.15.135:0/3651737848 >> 172.21.15.135:0/3651737848 conn(0x7ff3300fc450 msgr2=0x7ff3300fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:55.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.042+0000 7ff336e77640 1 -- 172.21.15.135:0/3651737848 shutdown_connections 2024-04-20T12:22:55.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.042+0000 7ff336e77640 1 -- 172.21.15.135:0/3651737848 wait complete. 2024-04-20T12:22:55.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.043+0000 7ff336e77640 1 Processor -- start 2024-04-20T12:22:55.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.043+0000 7ff336e77640 1 -- start start 2024-04-20T12:22:55.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.043+0000 7ff336e77640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff330100e70 0x7ff33019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.043+0000 7ff336e77640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff330102050 0x7ff33019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.043+0000 7ff336e77640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff330102a10 0x7ff3301a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.043+0000 7ff336e77640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff33010dc90 con 0x7ff330102050 2024-04-20T12:22:55.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.043+0000 7ff336e77640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff33010db10 con 0x7ff330100e70 2024-04-20T12:22:55.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.043+0000 7ff336e77640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff33010de10 con 0x7ff330102a10 2024-04-20T12:22:55.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.043+0000 7ff32ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff330102050 0x7ff33019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.043+0000 7ff32ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff330102050 0x7ff33019a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41220/0 (socket says 172.21.15.135:41220) 2024-04-20T12:22:55.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.043+0000 7ff32ffff640 1 -- 172.21.15.135:0/369324898 learned_addr learned my addr 172.21.15.135:0/369324898 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:55.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.043+0000 7ff334c13640 1 --2- 172.21.15.135:0/369324898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff330100e70 0x7ff33019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.043+0000 7ff335414640 1 --2- 172.21.15.135:0/369324898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff330102a10 0x7ff3301a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.044+0000 7ff32ffff640 1 -- 172.21.15.135:0/369324898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff330102a10 msgr2=0x7ff3301a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.044+0000 7ff32ffff640 1 --2- 172.21.15.135:0/369324898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff330102a10 0x7ff3301a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.044+0000 7ff32ffff640 1 -- 172.21.15.135:0/369324898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff330100e70 msgr2=0x7ff33019a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.044+0000 7ff32ffff640 1 --2- 172.21.15.135:0/369324898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff330100e70 0x7ff33019a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.044+0000 7ff32ffff640 1 -- 172.21.15.135:0/369324898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3301a2090 con 0x7ff330102050 2024-04-20T12:22:55.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.044+0000 7ff32ffff640 1 --2- 172.21.15.135:0/369324898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff330102050 0x7ff33019a9b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff32000cce0 tx=0x7ff32000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:55.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.044+0000 7ff32dffb640 1 -- 172.21.15.135:0/369324898 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320004b20 con 0x7ff330102050 2024-04-20T12:22:55.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.044+0000 7ff336e77640 1 -- 172.21.15.135:0/369324898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3301a2380 con 0x7ff330102050 2024-04-20T12:22:55.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.044+0000 7ff32dffb640 1 -- 172.21.15.135:0/369324898 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff320004cc0 con 0x7ff330102050 2024-04-20T12:22:55.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.044+0000 7ff32dffb640 1 -- 172.21.15.135:0/369324898 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32000f8c0 con 0x7ff330102050 2024-04-20T12:22:55.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.044+0000 7ff336e77640 1 -- 172.21.15.135:0/369324898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3301a28d0 con 0x7ff330102050 2024-04-20T12:22:55.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.045+0000 7ff336e77640 1 -- 172.21.15.135:0/369324898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3301a2b90 con 0x7ff330102050 2024-04-20T12:22:55.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.046+0000 7ff32dffb640 1 -- 172.21.15.135:0/369324898 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ff32000fa60 con 0x7ff330102050 2024-04-20T12:22:55.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.046+0000 7ff32dffb640 1 --2- 172.21.15.135:0/369324898 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff31c0a3bb0 0x7ff31c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.047+0000 7ff334c13640 1 --2- 172.21.15.135:0/369324898 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff31c0a3bb0 0x7ff31c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.047+0000 7ff32dffb640 1 -- 172.21.15.135:0/369324898 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7ff3200d07e0 con 0x7ff330102050 2024-04-20T12:22:55.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.047+0000 7ff334c13640 1 --2- 172.21.15.135:0/369324898 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff31c0a3bb0 0x7ff31c0a6070 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff330101bc0 tx=0x7ff32800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:55.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.051+0000 7ff32dffb640 1 -- 172.21.15.135:0/369324898 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7ff320014030 con 0x7ff330102050 2024-04-20T12:22:55.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.228+0000 7ff336e77640 1 -- 172.21.15.135:0/369324898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff3301a2d60 con 0x7ff330102050 2024-04-20T12:22:55.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.229+0000 7ff32dffb640 1 -- 172.21.15.135:0/369324898 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) ==== 100+0+11 (secure 0 0 0) 0x7ff32009c7d0 con 0x7ff330102050 2024-04-20T12:22:55.228 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-04-20T12:22:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.231+0000 7ff336e77640 1 -- 172.21.15.135:0/369324898 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff31c0a3bb0 msgr2=0x7ff31c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.231+0000 7ff336e77640 1 --2- 172.21.15.135:0/369324898 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff31c0a3bb0 0x7ff31c0a6070 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff330101bc0 tx=0x7ff32800b390 comp rx=0 tx=0).stop 2024-04-20T12:22:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.231+0000 7ff336e77640 1 -- 172.21.15.135:0/369324898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff330102050 msgr2=0x7ff33019a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.231+0000 7ff336e77640 1 --2- 172.21.15.135:0/369324898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff330102050 0x7ff33019a9b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff32000cce0 tx=0x7ff32000a620 comp rx=0 tx=0).stop 2024-04-20T12:22:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.231+0000 7ff336e77640 1 -- 172.21.15.135:0/369324898 shutdown_connections 2024-04-20T12:22:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.231+0000 7ff336e77640 1 --2- 172.21.15.135:0/369324898 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff31c0a3bb0 0x7ff31c0a6070 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.231+0000 7ff336e77640 1 --2- 172.21.15.135:0/369324898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff330102a10 0x7ff3301a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.231+0000 7ff336e77640 1 --2- 172.21.15.135:0/369324898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff330102050 0x7ff33019a9b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.231+0000 7ff336e77640 1 --2- 172.21.15.135:0/369324898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff330100e70 0x7ff33019a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.231+0000 7ff336e77640 1 -- 172.21.15.135:0/369324898 >> 172.21.15.135:0/369324898 conn(0x7ff3300fc450 msgr2=0x7ff330109cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:55.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.231+0000 7ff336e77640 1 -- 172.21.15.135:0/369324898 shutdown_connections 2024-04-20T12:22:55.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.231+0000 7ff336e77640 1 -- 172.21.15.135:0/369324898 wait complete. 2024-04-20T12:22:55.239 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:54 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/736779585' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:55.240 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:54 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3602598320' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:22:55.241 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T12:22:55.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:54 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/736779585' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:55.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:54 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3602598320' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:22:55.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:54 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/736779585' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:55.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:54 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3602598320' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:22:55.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.344+0000 7fa24065c640 1 -- 172.21.15.135:0/2592503481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa238103b60 msgr2=0x7fa23810a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.344+0000 7fa24065c640 1 --2- 172.21.15.135:0/2592503481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa238103b60 0x7fa23810a3f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa230009ca0 tx=0x7fa23002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.344+0000 7fa24065c640 1 -- 172.21.15.135:0/2592503481 shutdown_connections 2024-04-20T12:22:55.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.344+0000 7fa24065c640 1 --2- 172.21.15.135:0/2592503481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa238103b60 0x7fa23810a3f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.344+0000 7fa24065c640 1 --2- 172.21.15.135:0/2592503481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2381031a0 0x7fa238103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.344+0000 7fa24065c640 1 --2- 172.21.15.135:0/2592503481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa238101fb0 0x7fa2381023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.344+0000 7fa24065c640 1 -- 172.21.15.135:0/2592503481 >> 172.21.15.135:0/2592503481 conn(0x7fa2380fd540 msgr2=0x7fa2380ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:55.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.344+0000 7fa24065c640 1 -- 172.21.15.135:0/2592503481 shutdown_connections 2024-04-20T12:22:55.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.344+0000 7fa24065c640 1 -- 172.21.15.135:0/2592503481 wait complete. 2024-04-20T12:22:55.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa24065c640 1 Processor -- start 2024-04-20T12:22:55.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa24065c640 1 -- start start 2024-04-20T12:22:55.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa24065c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa238101fb0 0x7fa238198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa24065c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2381031a0 0x7fa2381987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa24065c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa238103b60 0x7fa23819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa24065c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa23810dc40 con 0x7fa238103b60 2024-04-20T12:22:55.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa24065c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa23810dac0 con 0x7fa2381031a0 2024-04-20T12:22:55.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa24065c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa23810ddc0 con 0x7fa238101fb0 2024-04-20T12:22:55.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa23ebf9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa238103b60 0x7fa23819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa23ebf9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa238103b60 0x7fa23819f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41248/0 (socket says 172.21.15.135:41248) 2024-04-20T12:22:55.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa23ebf9640 1 -- 172.21.15.135:0/1591482219 learned_addr learned my addr 172.21.15.135:0/1591482219 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:55.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa23dbf7640 1 --2- 172.21.15.135:0/1591482219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2381031a0 0x7fa2381987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa23e3f8640 1 --2- 172.21.15.135:0/1591482219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa238101fb0 0x7fa238198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa23ebf9640 1 -- 172.21.15.135:0/1591482219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa238101fb0 msgr2=0x7fa238198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa23ebf9640 1 --2- 172.21.15.135:0/1591482219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa238101fb0 0x7fa238198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa23ebf9640 1 -- 172.21.15.135:0/1591482219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2381031a0 msgr2=0x7fa2381987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa23ebf9640 1 --2- 172.21.15.135:0/1591482219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2381031a0 0x7fa2381987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.345+0000 7fa23ebf9640 1 -- 172.21.15.135:0/1591482219 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23819fe80 con 0x7fa238103b60 2024-04-20T12:22:55.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.346+0000 7fa23ebf9640 1 --2- 172.21.15.135:0/1591482219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa238103b60 0x7fa23819f810 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa230037040 tx=0x7fa230032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:55.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.346+0000 7fa22f7fe640 1 -- 172.21.15.135:0/1591482219 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230041020 con 0x7fa238103b60 2024-04-20T12:22:55.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.346+0000 7fa22f7fe640 1 -- 172.21.15.135:0/1591482219 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa230034cd0 con 0x7fa238103b60 2024-04-20T12:22:55.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.346+0000 7fa24065c640 1 -- 172.21.15.135:0/1591482219 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2381a0110 con 0x7fa238103b60 2024-04-20T12:22:55.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.346+0000 7fa22f7fe640 1 -- 172.21.15.135:0/1591482219 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa230039040 con 0x7fa238103b60 2024-04-20T12:22:55.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.346+0000 7fa24065c640 1 -- 172.21.15.135:0/1591482219 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2381a0600 con 0x7fa238103b60 2024-04-20T12:22:55.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.347+0000 7fa24065c640 1 -- 172.21.15.135:0/1591482219 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2381092d0 con 0x7fa238103b60 2024-04-20T12:22:55.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.348+0000 7fa22f7fe640 1 -- 172.21.15.135:0/1591482219 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fa230044020 con 0x7fa238103b60 2024-04-20T12:22:55.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.348+0000 7fa22f7fe640 1 --2- 172.21.15.135:0/1591482219 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa2240a3bb0 0x7fa2240a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.349+0000 7fa23e3f8640 1 --2- 172.21.15.135:0/1591482219 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa2240a3bb0 0x7fa2240a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.349+0000 7fa22f7fe640 1 -- 172.21.15.135:0/1591482219 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7fa2300f25c0 con 0x7fa238103b60 2024-04-20T12:22:55.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.349+0000 7fa23e3f8640 1 --2- 172.21.15.135:0/1591482219 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa2240a3bb0 0x7fa2240a6070 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa238103000 tx=0x7fa234005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:55.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.353+0000 7fa22f7fe640 1 -- 172.21.15.135:0/1591482219 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fa23004b020 con 0x7fa238103b60 2024-04-20T12:22:55.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.529+0000 7fa24065c640 1 -- 172.21.15.135:0/1591482219 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa238062b60 con 0x7fa238103b60 2024-04-20T12:22:55.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.529+0000 7fa22f7fe640 1 -- 172.21.15.135:0/1591482219 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) ==== 103+0+11 (secure 0 0 0) 0x7fa2300bec90 con 0x7fa238103b60 2024-04-20T12:22:55.529 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:22:55.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.531+0000 7fa24065c640 1 -- 172.21.15.135:0/1591482219 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa2240a3bb0 msgr2=0x7fa2240a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.531+0000 7fa24065c640 1 --2- 172.21.15.135:0/1591482219 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa2240a3bb0 0x7fa2240a6070 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa238103000 tx=0x7fa234005f90 comp rx=0 tx=0).stop 2024-04-20T12:22:55.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.531+0000 7fa24065c640 1 -- 172.21.15.135:0/1591482219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa238103b60 msgr2=0x7fa23819f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.531+0000 7fa24065c640 1 --2- 172.21.15.135:0/1591482219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa238103b60 0x7fa23819f810 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa230037040 tx=0x7fa230032f40 comp rx=0 tx=0).stop 2024-04-20T12:22:55.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.531+0000 7fa24065c640 1 -- 172.21.15.135:0/1591482219 shutdown_connections 2024-04-20T12:22:55.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.531+0000 7fa24065c640 1 --2- 172.21.15.135:0/1591482219 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa2240a3bb0 0x7fa2240a6070 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.531+0000 7fa24065c640 1 --2- 172.21.15.135:0/1591482219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa238103b60 0x7fa23819f810 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.531+0000 7fa24065c640 1 --2- 172.21.15.135:0/1591482219 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa2381031a0 0x7fa2381987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.531+0000 7fa24065c640 1 --2- 172.21.15.135:0/1591482219 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa238101fb0 0x7fa238198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.531+0000 7fa24065c640 1 -- 172.21.15.135:0/1591482219 >> 172.21.15.135:0/1591482219 conn(0x7fa2380fd540 msgr2=0x7fa2381064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:55.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.531+0000 7fa24065c640 1 -- 172.21.15.135:0/1591482219 shutdown_connections 2024-04-20T12:22:55.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.531+0000 7fa24065c640 1 -- 172.21.15.135:0/1591482219 wait complete. 2024-04-20T12:22:55.542 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:22:55.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.640+0000 7f8e594b3640 1 -- 172.21.15.135:0/3948850126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e54102a40 msgr2=0x7f8e54104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.640+0000 7f8e594b3640 1 --2- 172.21.15.135:0/3948850126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e54102a40 0x7f8e54104e30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8e44009900 tx=0x7f8e4402bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:55.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.640+0000 7f8e594b3640 1 -- 172.21.15.135:0/3948850126 shutdown_connections 2024-04-20T12:22:55.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.640+0000 7f8e594b3640 1 --2- 172.21.15.135:0/3948850126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e54107ca0 0x7f8e5410a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.640+0000 7f8e594b3640 1 --2- 172.21.15.135:0/3948850126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e54105370 0x7f8e54107760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.640+0000 7f8e594b3640 1 --2- 172.21.15.135:0/3948850126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e54102a40 0x7f8e54104e30 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.640+0000 7f8e594b3640 1 -- 172.21.15.135:0/3948850126 >> 172.21.15.135:0/3948850126 conn(0x7f8e540fc450 msgr2=0x7f8e540fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:55.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.640+0000 7f8e594b3640 1 -- 172.21.15.135:0/3948850126 shutdown_connections 2024-04-20T12:22:55.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.640+0000 7f8e594b3640 1 -- 172.21.15.135:0/3948850126 wait complete. 2024-04-20T12:22:55.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.641+0000 7f8e594b3640 1 Processor -- start 2024-04-20T12:22:55.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.641+0000 7f8e594b3640 1 -- start start 2024-04-20T12:22:55.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.641+0000 7f8e594b3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e54102a40 0x7f8e541023b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.641+0000 7f8e594b3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e54105370 0x7f8e541009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.641+0000 7f8e594b3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e54107ca0 0x7f8e54100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.641+0000 7f8e594b3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5410dc50 con 0x7f8e54102a40 2024-04-20T12:22:55.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.641+0000 7f8e594b3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5410dad0 con 0x7f8e54107ca0 2024-04-20T12:22:55.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.641+0000 7f8e594b3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5410ddd0 con 0x7f8e54105370 2024-04-20T12:22:55.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.641+0000 7f8e52ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e54102a40 0x7f8e541023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.641+0000 7f8e52ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e54102a40 0x7f8e541023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41268/0 (socket says 172.21.15.135:41268) 2024-04-20T12:22:55.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.641+0000 7f8e52ffd640 1 -- 172.21.15.135:0/1479323518 learned_addr learned my addr 172.21.15.135:0/1479323518 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:55.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.641+0000 7f8e527fc640 1 --2- 172.21.15.135:0/1479323518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e54105370 0x7f8e541009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.641+0000 7f8e537fe640 1 --2- 172.21.15.135:0/1479323518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e54107ca0 0x7f8e54100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.642+0000 7f8e52ffd640 1 -- 172.21.15.135:0/1479323518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e54105370 msgr2=0x7f8e541009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.642+0000 7f8e52ffd640 1 --2- 172.21.15.135:0/1479323518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e54105370 0x7f8e541009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.642+0000 7f8e52ffd640 1 -- 172.21.15.135:0/1479323518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e54107ca0 msgr2=0x7f8e54100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.642+0000 7f8e52ffd640 1 --2- 172.21.15.135:0/1479323518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e54107ca0 0x7f8e54100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.642+0000 7f8e52ffd640 1 -- 172.21.15.135:0/1479323518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e541017c0 con 0x7f8e54102a40 2024-04-20T12:22:55.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.642+0000 7f8e52ffd640 1 --2- 172.21.15.135:0/1479323518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e54102a40 0x7f8e541023b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8e44009230 tx=0x7f8e44005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:55.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.642+0000 7f8e3bfff640 1 -- 172.21.15.135:0/1479323518 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e44041070 con 0x7f8e54102a40 2024-04-20T12:22:55.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.642+0000 7f8e594b3640 1 -- 172.21.15.135:0/1479323518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e541a23e0 con 0x7f8e54102a40 2024-04-20T12:22:55.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.642+0000 7f8e3bfff640 1 -- 172.21.15.135:0/1479323518 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e440044d0 con 0x7f8e54102a40 2024-04-20T12:22:55.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.642+0000 7f8e3bfff640 1 -- 172.21.15.135:0/1479323518 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e44034440 con 0x7f8e54102a40 2024-04-20T12:22:55.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.642+0000 7f8e594b3640 1 -- 172.21.15.135:0/1479323518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e541a2930 con 0x7f8e54102a40 2024-04-20T12:22:55.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.643+0000 7f8e594b3640 1 -- 172.21.15.135:0/1479323518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e540fdf40 con 0x7f8e54102a40 2024-04-20T12:22:55.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.644+0000 7f8e3bfff640 1 -- 172.21.15.135:0/1479323518 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f8e44044070 con 0x7f8e54102a40 2024-04-20T12:22:55.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.645+0000 7f8e3bfff640 1 --2- 172.21.15.135:0/1479323518 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8e3c0a3bb0 0x7f8e3c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.645+0000 7f8e527fc640 1 --2- 172.21.15.135:0/1479323518 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8e3c0a3bb0 0x7f8e3c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.645+0000 7f8e3bfff640 1 -- 172.21.15.135:0/1479323518 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f8e440f2770 con 0x7f8e54102a40 2024-04-20T12:22:55.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.645+0000 7f8e527fc640 1 --2- 172.21.15.135:0/1479323518 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8e3c0a3bb0 0x7f8e3c0a6070 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8e54102120 tx=0x7f8e48005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:55.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.648+0000 7f8e3bfff640 1 -- 172.21.15.135:0/1479323518 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f8e440bedb0 con 0x7f8e54102a40 2024-04-20T12:22:55.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.862+0000 7f8e594b3640 1 -- 172.21.15.135:0/1479323518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e5402d5d0 con 0x7f8e54102a40 2024-04-20T12:22:55.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.862+0000 7f8e3bfff640 1 -- 172.21.15.135:0/1479323518 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f8e440a90c0 con 0x7f8e54102a40 2024-04-20T12:22:55.862 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:55.862 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:21:09.311388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24490,24476,14634,24457,24475]},"id":1}]} 2024-04-20T12:22:55.863 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 28 2024-04-20T12:22:55.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.864+0000 7f8e594b3640 1 -- 172.21.15.135:0/1479323518 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8e3c0a3bb0 msgr2=0x7f8e3c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.864+0000 7f8e594b3640 1 --2- 172.21.15.135:0/1479323518 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8e3c0a3bb0 0x7f8e3c0a6070 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8e54102120 tx=0x7f8e48005f90 comp rx=0 tx=0).stop 2024-04-20T12:22:55.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.864+0000 7f8e594b3640 1 -- 172.21.15.135:0/1479323518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e54102a40 msgr2=0x7f8e541023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.864+0000 7f8e594b3640 1 --2- 172.21.15.135:0/1479323518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e54102a40 0x7f8e541023b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8e44009230 tx=0x7f8e44005d50 comp rx=0 tx=0).stop 2024-04-20T12:22:55.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.865+0000 7f8e594b3640 1 -- 172.21.15.135:0/1479323518 shutdown_connections 2024-04-20T12:22:55.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.865+0000 7f8e594b3640 1 --2- 172.21.15.135:0/1479323518 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f8e3c0a3bb0 0x7f8e3c0a6070 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.865+0000 7f8e594b3640 1 --2- 172.21.15.135:0/1479323518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8e54107ca0 0x7f8e54100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.865+0000 7f8e594b3640 1 --2- 172.21.15.135:0/1479323518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8e54105370 0x7f8e541009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.865+0000 7f8e594b3640 1 --2- 172.21.15.135:0/1479323518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e54102a40 0x7f8e541023b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.865+0000 7f8e594b3640 1 -- 172.21.15.135:0/1479323518 >> 172.21.15.135:0/1479323518 conn(0x7f8e540fc450 msgr2=0x7f8e54103380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:55.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.865+0000 7f8e594b3640 1 -- 172.21.15.135:0/1479323518 shutdown_connections 2024-04-20T12:22:55.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.865+0000 7f8e594b3640 1 -- 172.21.15.135:0/1479323518 wait complete. 2024-04-20T12:22:55.876 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:22:55.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.975+0000 7f43de225640 1 -- 172.21.15.135:0/3044369567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43d8105370 msgr2=0x7f43d8107760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.975+0000 7f43de225640 1 --2- 172.21.15.135:0/3044369567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43d8105370 0x7f43d8107760 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009900 tx=0x7f43c802bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:55.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.975+0000 7f43de225640 1 -- 172.21.15.135:0/3044369567 shutdown_connections 2024-04-20T12:22:55.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.975+0000 7f43de225640 1 --2- 172.21.15.135:0/3044369567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43d8107ca0 0x7f43d810a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.975+0000 7f43de225640 1 --2- 172.21.15.135:0/3044369567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43d8105370 0x7f43d8107760 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.975+0000 7f43de225640 1 --2- 172.21.15.135:0/3044369567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d8102a40 0x7f43d8104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.975+0000 7f43de225640 1 -- 172.21.15.135:0/3044369567 >> 172.21.15.135:0/3044369567 conn(0x7f43d80fc450 msgr2=0x7f43d80fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:55.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.975+0000 7f43de225640 1 -- 172.21.15.135:0/3044369567 shutdown_connections 2024-04-20T12:22:55.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.975+0000 7f43de225640 1 -- 172.21.15.135:0/3044369567 wait complete. 2024-04-20T12:22:55.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.975+0000 7f43de225640 1 Processor -- start 2024-04-20T12:22:55.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43de225640 1 -- start start 2024-04-20T12:22:55.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43de225640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d8102a40 0x7f43d8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43de225640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43d8105370 0x7f43d81988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43de225640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43d8107ca0 0x7f43d819f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43de225640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f43d810dcb0 con 0x7f43d8105370 2024-04-20T12:22:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43de225640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f43d810db30 con 0x7f43d8107ca0 2024-04-20T12:22:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43de225640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43d810de30 con 0x7f43d8102a40 2024-04-20T12:22:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43d6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43d8105370 0x7f43d81988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43d6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43d8105370 0x7f43d81988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41278/0 (socket says 172.21.15.135:41278) 2024-04-20T12:22:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43d6ffd640 1 -- 172.21.15.135:0/2619305054 learned_addr learned my addr 172.21.15.135:0/2619305054 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43d77fe640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d8102a40 0x7f43d8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43d7fff640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43d8107ca0 0x7f43d819f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43d6ffd640 1 -- 172.21.15.135:0/2619305054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d8102a40 msgr2=0x7f43d8198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43d6ffd640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d8102a40 0x7f43d8198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43d6ffd640 1 -- 172.21.15.135:0/2619305054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43d8107ca0 msgr2=0x7f43d819f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43d6ffd640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43d8107ca0 0x7f43d819f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43d6ffd640 1 -- 172.21.15.135:0/2619305054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43d819ff80 con 0x7f43d8105370 2024-04-20T12:22:55.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43d77fe640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d8102a40 0x7f43d8198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:55.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43d7fff640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43d8107ca0 0x7f43d819f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:55.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.976+0000 7f43d6ffd640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43d8105370 0x7f43d81988a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f43c8005ab0 tx=0x7f43c8005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:55.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.977+0000 7f43d4ff9640 1 -- 172.21.15.135:0/2619305054 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8041070 con 0x7f43d8105370 2024-04-20T12:22:55.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.977+0000 7f43d4ff9640 1 -- 172.21.15.135:0/2619305054 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43c80054e0 con 0x7f43d8105370 2024-04-20T12:22:55.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.977+0000 7f43de225640 1 -- 172.21.15.135:0/2619305054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43d81a0210 con 0x7f43d8105370 2024-04-20T12:22:55.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.977+0000 7f43d4ff9640 1 -- 172.21.15.135:0/2619305054 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c8034440 con 0x7f43d8105370 2024-04-20T12:22:55.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.977+0000 7f43de225640 1 -- 172.21.15.135:0/2619305054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43d81a0700 con 0x7f43d8105370 2024-04-20T12:22:55.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.978+0000 7f43de225640 1 -- 172.21.15.135:0/2619305054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43d80fdf40 con 0x7f43d8105370 2024-04-20T12:22:55.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.979+0000 7f43d4ff9640 1 -- 172.21.15.135:0/2619305054 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f43c8044070 con 0x7f43d8105370 2024-04-20T12:22:55.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.979+0000 7f43d4ff9640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f43c00a3bb0 0x7f43c00a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:55.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.979+0000 7f43d77fe640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f43c00a3bb0 0x7f43c00a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:55.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.980+0000 7f43d4ff9640 1 -- 172.21.15.135:0/2619305054 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f43c80f2520 con 0x7f43d8105370 2024-04-20T12:22:55.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.980+0000 7f43d77fe640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f43c00a3bb0 0x7f43c00a6070 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009b40 tx=0x7f43cc005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:55.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:55.984+0000 7f43d4ff9640 1 -- 172.21.15.135:0/2619305054 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f43c80beb60 con 0x7f43d8105370 2024-04-20T12:22:56.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.164+0000 7f43de225640 1 -- 172.21.15.135:0/2619305054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43d8062b60 con 0x7f43d8105370 2024-04-20T12:22:56.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.165+0000 7f43d4ff9640 1 -- 172.21.15.135:0/2619305054 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24814 (secure 0 0 0) 0x7f43c80be460 con 0x7f43d8105370 2024-04-20T12:22:56.165 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:56.166 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":94,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:22:37.927600+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:22:56.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.167+0000 7f43de225640 1 -- 172.21.15.135:0/2619305054 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f43c00a3bb0 msgr2=0x7f43c00a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:56.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.167+0000 7f43de225640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f43c00a3bb0 0x7f43c00a6070 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009b40 tx=0x7f43cc005e50 comp rx=0 tx=0).stop 2024-04-20T12:22:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.167+0000 7f43de225640 1 -- 172.21.15.135:0/2619305054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43d8105370 msgr2=0x7f43d81988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.167+0000 7f43de225640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43d8105370 0x7f43d81988a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f43c8005ab0 tx=0x7f43c8005dc0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.167+0000 7f43de225640 1 -- 172.21.15.135:0/2619305054 shutdown_connections 2024-04-20T12:22:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.167+0000 7f43de225640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f43c00a3bb0 0x7f43c00a6070 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.167+0000 7f43de225640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f43d8107ca0 0x7f43d819f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.167+0000 7f43de225640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43d8105370 0x7f43d81988a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.167+0000 7f43de225640 1 --2- 172.21.15.135:0/2619305054 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43d8102a40 0x7f43d8198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.167+0000 7f43de225640 1 -- 172.21.15.135:0/2619305054 >> 172.21.15.135:0/2619305054 conn(0x7f43d80fc450 msgr2=0x7f43d81033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.168+0000 7f43de225640 1 -- 172.21.15.135:0/2619305054 shutdown_connections 2024-04-20T12:22:56.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.168+0000 7f43de225640 1 -- 172.21.15.135:0/2619305054 wait complete. 2024-04-20T12:22:56.177 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:55 smithi135 ceph-mon[18264]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:22:56.178 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:55 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3546768819' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:22:56.178 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:55 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/369324898' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:22:56.178 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:55 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1591482219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:22:56.178 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:55 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1479323518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:22:56.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T12:16:02.802023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T12:20:39.656129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T12:20:40.312827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T12:20:44.307136+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T12:22:56.180 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T12:22:56.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:55 smithi154 ceph-mon[22073]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:22:56.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:55 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3546768819' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:22:56.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:55 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/369324898' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:22:56.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:55 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1591482219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:22:56.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:55 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1479323518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:22:56.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.281+0000 7fe26ad7e640 1 -- 172.21.15.135:0/3336886740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe264102a40 msgr2=0x7fe264104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:56.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.281+0000 7fe26ad7e640 1 --2- 172.21.15.135:0/3336886740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe264102a40 0x7fe264104e30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe254009900 tx=0x7fe25402bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:56.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.281+0000 7fe26ad7e640 1 -- 172.21.15.135:0/3336886740 shutdown_connections 2024-04-20T12:22:56.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.281+0000 7fe26ad7e640 1 --2- 172.21.15.135:0/3336886740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264107ca0 0x7fe26410a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.281+0000 7fe26ad7e640 1 --2- 172.21.15.135:0/3336886740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe264105370 0x7fe264107760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.281+0000 7fe26ad7e640 1 --2- 172.21.15.135:0/3336886740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe264102a40 0x7fe264104e30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.282+0000 7fe26ad7e640 1 -- 172.21.15.135:0/3336886740 >> 172.21.15.135:0/3336886740 conn(0x7fe2640fc450 msgr2=0x7fe2640fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:56.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.282+0000 7fe26ad7e640 1 -- 172.21.15.135:0/3336886740 shutdown_connections 2024-04-20T12:22:56.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.282+0000 7fe26ad7e640 1 -- 172.21.15.135:0/3336886740 wait complete. 2024-04-20T12:22:56.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.282+0000 7fe26ad7e640 1 Processor -- start 2024-04-20T12:22:56.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.282+0000 7fe26ad7e640 1 -- start start 2024-04-20T12:22:56.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.282+0000 7fe26ad7e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe264102a40 0x7fe264198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:56.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.282+0000 7fe26ad7e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe264105370 0x7fe264198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:56.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.282+0000 7fe26ad7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264107ca0 0x7fe26419f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:56.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.282+0000 7fe26ad7e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe26410dca0 con 0x7fe264105370 2024-04-20T12:22:56.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.282+0000 7fe26ad7e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe26410db20 con 0x7fe264102a40 2024-04-20T12:22:56.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.282+0000 7fe26ad7e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe26410de20 con 0x7fe264107ca0 2024-04-20T12:22:56.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.282+0000 7fe263fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe264105370 0x7fe264198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:56.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.282+0000 7fe263fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe264105370 0x7fe264198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41304/0 (socket says 172.21.15.135:41304) 2024-04-20T12:22:56.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.282+0000 7fe263fff640 1 -- 172.21.15.135:0/3854353962 learned_addr learned my addr 172.21.15.135:0/3854353962 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:56.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.282+0000 7fe268b1a640 1 --2- 172.21.15.135:0/3854353962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe264102a40 0x7fe264198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:56.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.283+0000 7fe26931b640 1 --2- 172.21.15.135:0/3854353962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264107ca0 0x7fe26419f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:56.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.283+0000 7fe263fff640 1 -- 172.21.15.135:0/3854353962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264107ca0 msgr2=0x7fe26419f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:56.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.283+0000 7fe263fff640 1 --2- 172.21.15.135:0/3854353962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264107ca0 0x7fe26419f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.283+0000 7fe263fff640 1 -- 172.21.15.135:0/3854353962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe264102a40 msgr2=0x7fe264198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:56.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.283+0000 7fe263fff640 1 --2- 172.21.15.135:0/3854353962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe264102a40 0x7fe264198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.283+0000 7fe263fff640 1 -- 172.21.15.135:0/3854353962 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26419ff30 con 0x7fe264105370 2024-04-20T12:22:56.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.283+0000 7fe263fff640 1 --2- 172.21.15.135:0/3854353962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe264105370 0x7fe264198850 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe25800e9c0 tx=0x7fe25800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:56.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.283+0000 7fe261ffb640 1 -- 172.21.15.135:0/3854353962 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25800cd80 con 0x7fe264105370 2024-04-20T12:22:56.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.283+0000 7fe261ffb640 1 -- 172.21.15.135:0/3854353962 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe258005500 con 0x7fe264105370 2024-04-20T12:22:56.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.283+0000 7fe26ad7e640 1 -- 172.21.15.135:0/3854353962 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2641a0220 con 0x7fe264105370 2024-04-20T12:22:56.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.283+0000 7fe261ffb640 1 -- 172.21.15.135:0/3854353962 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe258010690 con 0x7fe264105370 2024-04-20T12:22:56.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.283+0000 7fe26ad7e640 1 -- 172.21.15.135:0/3854353962 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2641a07c0 con 0x7fe264105370 2024-04-20T12:22:56.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.284+0000 7fe26ad7e640 1 -- 172.21.15.135:0/3854353962 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2640fdf40 con 0x7fe264105370 2024-04-20T12:22:56.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.285+0000 7fe261ffb640 1 -- 172.21.15.135:0/3854353962 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fe2580046c0 con 0x7fe264105370 2024-04-20T12:22:56.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.285+0000 7fe261ffb640 1 --2- 172.21.15.135:0/3854353962 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe24c0a3c30 0x7fe24c0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:56.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.286+0000 7fe268b1a640 1 --2- 172.21.15.135:0/3854353962 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe24c0a3c30 0x7fe24c0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:56.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.286+0000 7fe261ffb640 1 -- 172.21.15.135:0/3854353962 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7fe2580d0b30 con 0x7fe264105370 2024-04-20T12:22:56.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.286+0000 7fe268b1a640 1 --2- 172.21.15.135:0/3854353962 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe24c0a3c30 0x7fe24c0a60f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe25402c240 tx=0x7fe25402df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:56.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.290+0000 7fe261ffb640 1 -- 172.21.15.135:0/3854353962 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fe25809d170 con 0x7fe264105370 2024-04-20T12:22:56.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:55 smithi139 ceph-mon[21834]: pgmap v363: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:22:56.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:55 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3546768819' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:22:56.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:55 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/369324898' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:22:56.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:55 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1591482219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:22:56.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:55 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1479323518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:22:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.468+0000 7fe26ad7e640 1 -- 172.21.15.135:0/3854353962 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe264062b60 con 0x7fe264105370 2024-04-20T12:22:56.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.469+0000 7fe261ffb640 1 -- 172.21.15.135:0/3854353962 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7fe25809ca70 con 0x7fe264105370 2024-04-20T12:22:56.468 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-04-20T12:22:56.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.470+0000 7fe26ad7e640 1 -- 172.21.15.135:0/3854353962 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe24c0a3c30 msgr2=0x7fe24c0a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:56.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.470+0000 7fe26ad7e640 1 --2- 172.21.15.135:0/3854353962 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe24c0a3c30 0x7fe24c0a60f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe25402c240 tx=0x7fe25402df90 comp rx=0 tx=0).stop 2024-04-20T12:22:56.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.470+0000 7fe26ad7e640 1 -- 172.21.15.135:0/3854353962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe264105370 msgr2=0x7fe264198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:56.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.470+0000 7fe26ad7e640 1 --2- 172.21.15.135:0/3854353962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe264105370 0x7fe264198850 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe25800e9c0 tx=0x7fe25800ee80 comp rx=0 tx=0).stop 2024-04-20T12:22:56.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.471+0000 7fe26ad7e640 1 -- 172.21.15.135:0/3854353962 shutdown_connections 2024-04-20T12:22:56.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.471+0000 7fe26ad7e640 1 --2- 172.21.15.135:0/3854353962 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fe24c0a3c30 0x7fe24c0a60f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.471+0000 7fe26ad7e640 1 --2- 172.21.15.135:0/3854353962 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe264107ca0 0x7fe26419f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.471+0000 7fe26ad7e640 1 --2- 172.21.15.135:0/3854353962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe264105370 0x7fe264198850 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.471+0000 7fe26ad7e640 1 --2- 172.21.15.135:0/3854353962 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe264102a40 0x7fe264198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.471+0000 7fe26ad7e640 1 -- 172.21.15.135:0/3854353962 >> 172.21.15.135:0/3854353962 conn(0x7fe2640fc450 msgr2=0x7fe264103380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:56.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.471+0000 7fe26ad7e640 1 -- 172.21.15.135:0/3854353962 shutdown_connections 2024-04-20T12:22:56.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.471+0000 7fe26ad7e640 1 -- 172.21.15.135:0/3854353962 wait complete. 2024-04-20T12:22:56.481 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T12:22:56.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.582+0000 7f9809515640 1 -- 172.21.15.135:0/3884155030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9804102a10 msgr2=0x7f9804109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:56.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.582+0000 7f9809515640 1 --2- 172.21.15.135:0/3884155030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9804102a10 0x7f9804109330 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f97fc009ca0 tx=0x7f97fc02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.582+0000 7f9809515640 1 -- 172.21.15.135:0/3884155030 shutdown_connections 2024-04-20T12:22:56.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.582+0000 7f9809515640 1 --2- 172.21.15.135:0/3884155030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9804102a10 0x7f9804109330 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.582+0000 7f9809515640 1 --2- 172.21.15.135:0/3884155030 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9804102050 0x7f98041024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.582+0000 7f9809515640 1 --2- 172.21.15.135:0/3884155030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9804100e70 0x7f9804101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.582+0000 7f9809515640 1 -- 172.21.15.135:0/3884155030 >> 172.21.15.135:0/3884155030 conn(0x7f98040fc430 msgr2=0x7f98040fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:56.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.583+0000 7f9809515640 1 -- 172.21.15.135:0/3884155030 shutdown_connections 2024-04-20T12:22:56.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.583+0000 7f9809515640 1 -- 172.21.15.135:0/3884155030 wait complete. 2024-04-20T12:22:56.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.583+0000 7f9809515640 1 Processor -- start 2024-04-20T12:22:56.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.583+0000 7f9809515640 1 -- start start 2024-04-20T12:22:56.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.583+0000 7f9809515640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9804100e70 0x7f980410b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:56.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.583+0000 7f9809515640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9804102050 0x7f9804109eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:56.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.583+0000 7f9809515640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9804102a10 0x7f980410a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:56.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.583+0000 7f9809515640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f980410dc90 con 0x7f9804100e70 2024-04-20T12:22:56.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.583+0000 7f9809515640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f980410db10 con 0x7f9804102050 2024-04-20T12:22:56.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.583+0000 7f9809515640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f980410de10 con 0x7f9804102a10 2024-04-20T12:22:56.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.583+0000 7f9802ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9804100e70 0x7f980410b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:56.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.583+0000 7f9802ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9804100e70 0x7f980410b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41320/0 (socket says 172.21.15.135:41320) 2024-04-20T12:22:56.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.583+0000 7f9802ffd640 1 -- 172.21.15.135:0/1785299976 learned_addr learned my addr 172.21.15.135:0/1785299976 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:56.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.584+0000 7f98027fc640 1 --2- 172.21.15.135:0/1785299976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9804102050 0x7f9804109eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:56.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.584+0000 7f98037fe640 1 --2- 172.21.15.135:0/1785299976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9804102a10 0x7f980410a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:56.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.584+0000 7f9802ffd640 1 -- 172.21.15.135:0/1785299976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9804102a10 msgr2=0x7f980410a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:56.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.584+0000 7f9802ffd640 1 --2- 172.21.15.135:0/1785299976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9804102a10 0x7f980410a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.584+0000 7f9802ffd640 1 -- 172.21.15.135:0/1785299976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9804102050 msgr2=0x7f9804109eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:56.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.584+0000 7f9802ffd640 1 --2- 172.21.15.135:0/1785299976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9804102050 0x7f9804109eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.584+0000 7f9802ffd640 1 -- 172.21.15.135:0/1785299976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980410ac80 con 0x7f9804100e70 2024-04-20T12:22:56.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.584+0000 7f9802ffd640 1 --2- 172.21.15.135:0/1785299976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9804100e70 0x7f980410b870 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f97f400d950 tx=0x7f97f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:56.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.584+0000 7f97ebfff640 1 -- 172.21.15.135:0/1785299976 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f4017070 con 0x7f9804100e70 2024-04-20T12:22:56.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.584+0000 7f9809515640 1 -- 172.21.15.135:0/1785299976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98041a23a0 con 0x7f9804100e70 2024-04-20T12:22:56.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.584+0000 7f97ebfff640 1 -- 172.21.15.135:0/1785299976 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97f4009c30 con 0x7f9804100e70 2024-04-20T12:22:56.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.584+0000 7f97ebfff640 1 -- 172.21.15.135:0/1785299976 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f400f600 con 0x7f9804100e70 2024-04-20T12:22:56.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.584+0000 7f9809515640 1 -- 172.21.15.135:0/1785299976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98041a28f0 con 0x7f9804100e70 2024-04-20T12:22:56.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.585+0000 7f9809515640 1 -- 172.21.15.135:0/1785299976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9804108210 con 0x7f9804100e70 2024-04-20T12:22:56.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.586+0000 7f97ebfff640 1 -- 172.21.15.135:0/1785299976 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f97f401a070 con 0x7f9804100e70 2024-04-20T12:22:56.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.587+0000 7f97ebfff640 1 --2- 172.21.15.135:0/1785299976 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f97ec0a3bb0 0x7f97ec0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:56.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.587+0000 7f98027fc640 1 --2- 172.21.15.135:0/1785299976 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f97ec0a3bb0 0x7f97ec0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:56.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.587+0000 7f97ebfff640 1 -- 172.21.15.135:0/1785299976 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f97f40d0170 con 0x7f9804100e70 2024-04-20T12:22:56.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.587+0000 7f98027fc640 1 --2- 172.21.15.135:0/1785299976 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f97ec0a3bb0 0x7f97ec0a6070 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f980410b5e0 tx=0x7f97f800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:56.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.591+0000 7f97ebfff640 1 -- 172.21.15.135:0/1785299976 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f97f4009de0 con 0x7f9804100e70 2024-04-20T12:22:56.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.766+0000 7f9809515640 1 -- 172.21.15.135:0/1785299976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f980402d5d0 con 0x7f9804100e70 2024-04-20T12:22:56.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.767+0000 7f97ebfff640 1 -- 172.21.15.135:0/1785299976 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) ==== 104+0+11 (secure 0 0 0) 0x7f97f409c160 con 0x7f9804100e70 2024-04-20T12:22:56.767 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:22:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.769+0000 7f9809515640 1 -- 172.21.15.135:0/1785299976 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f97ec0a3bb0 msgr2=0x7f97ec0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.769+0000 7f9809515640 1 --2- 172.21.15.135:0/1785299976 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f97ec0a3bb0 0x7f97ec0a6070 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f980410b5e0 tx=0x7f97f800b390 comp rx=0 tx=0).stop 2024-04-20T12:22:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.769+0000 7f9809515640 1 -- 172.21.15.135:0/1785299976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9804100e70 msgr2=0x7f980410b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.769+0000 7f9809515640 1 --2- 172.21.15.135:0/1785299976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9804100e70 0x7f980410b870 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f97f400d950 tx=0x7f97f400de10 comp rx=0 tx=0).stop 2024-04-20T12:22:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.769+0000 7f9809515640 1 -- 172.21.15.135:0/1785299976 shutdown_connections 2024-04-20T12:22:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.769+0000 7f9809515640 1 --2- 172.21.15.135:0/1785299976 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f97ec0a3bb0 0x7f97ec0a6070 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.769+0000 7f9809515640 1 --2- 172.21.15.135:0/1785299976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9804102a10 0x7f980410a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.769+0000 7f9809515640 1 --2- 172.21.15.135:0/1785299976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9804102050 0x7f9804109eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.769+0000 7f9809515640 1 --2- 172.21.15.135:0/1785299976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9804100e70 0x7f980410b870 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.769+0000 7f9809515640 1 -- 172.21.15.135:0/1785299976 >> 172.21.15.135:0/1785299976 conn(0x7f98040fc430 msgr2=0x7f98041053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.769+0000 7f9809515640 1 -- 172.21.15.135:0/1785299976 shutdown_connections 2024-04-20T12:22:56.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.769+0000 7f9809515640 1 -- 172.21.15.135:0/1785299976 wait complete. 2024-04-20T12:22:56.780 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T12:22:56.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.881+0000 7f114e7bb640 1 -- 172.21.15.135:0/2050865535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1148102ac0 msgr2=0x7f1148104eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:56.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.881+0000 7f114e7bb640 1 --2- 172.21.15.135:0/2050865535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1148102ac0 0x7f1148104eb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1138009900 tx=0x7f113802bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:56.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.881+0000 7f114e7bb640 1 -- 172.21.15.135:0/2050865535 shutdown_connections 2024-04-20T12:22:56.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.881+0000 7f114e7bb640 1 --2- 172.21.15.135:0/2050865535 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1148107d20 0x7f114810a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.881+0000 7f114e7bb640 1 --2- 172.21.15.135:0/2050865535 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11481053f0 0x7f11481077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.881+0000 7f114e7bb640 1 --2- 172.21.15.135:0/2050865535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1148102ac0 0x7f1148104eb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.881+0000 7f114e7bb640 1 -- 172.21.15.135:0/2050865535 >> 172.21.15.135:0/2050865535 conn(0x7f11480fc410 msgr2=0x7f11480fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.881+0000 7f114e7bb640 1 -- 172.21.15.135:0/2050865535 shutdown_connections 2024-04-20T12:22:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.882+0000 7f114e7bb640 1 -- 172.21.15.135:0/2050865535 wait complete. 2024-04-20T12:22:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.882+0000 7f114e7bb640 1 Processor -- start 2024-04-20T12:22:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.882+0000 7f114e7bb640 1 -- start start 2024-04-20T12:22:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.882+0000 7f114e7bb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1148102ac0 0x7f1148198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.882+0000 7f114e7bb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11481053f0 0x7f1148198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.882+0000 7f114e7bb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1148107d20 0x7f114819f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.882+0000 7f114e7bb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f114810dc50 con 0x7f11481053f0 2024-04-20T12:22:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.882+0000 7f114e7bb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f114810dad0 con 0x7f1148107d20 2024-04-20T12:22:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.882+0000 7f114e7bb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f114810ddd0 con 0x7f1148102ac0 2024-04-20T12:22:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f11477fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11481053f0 0x7f1148198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f11477fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11481053f0 0x7f1148198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41338/0 (socket says 172.21.15.135:41338) 2024-04-20T12:22:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f11477fe640 1 -- 172.21.15.135:0/1806363499 learned_addr learned my addr 172.21.15.135:0/1806363499 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f1147fff640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1148102ac0 0x7f1148198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f114cd58640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1148107d20 0x7f114819f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f11477fe640 1 -- 172.21.15.135:0/1806363499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1148102ac0 msgr2=0x7f1148198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f11477fe640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1148102ac0 0x7f1148198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f11477fe640 1 -- 172.21.15.135:0/1806363499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1148107d20 msgr2=0x7f114819f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f11477fe640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1148107d20 0x7f114819f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f11477fe640 1 -- 172.21.15.135:0/1806363499 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114819ff50 con 0x7f11481053f0 2024-04-20T12:22:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f1147fff640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1148102ac0 0x7f1148198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f114cd58640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1148107d20 0x7f114819f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f11477fe640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11481053f0 0x7f1148198870 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f113000e9f0 tx=0x7f113000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f11457fa640 1 -- 172.21.15.135:0/1806363499 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f113000ccc0 con 0x7f11481053f0 2024-04-20T12:22:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f11457fa640 1 -- 172.21.15.135:0/1806363499 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1130005500 con 0x7f11481053f0 2024-04-20T12:22:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f11457fa640 1 -- 172.21.15.135:0/1806363499 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1130010690 con 0x7f11481053f0 2024-04-20T12:22:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f114e7bb640 1 -- 172.21.15.135:0/1806363499 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11481a0240 con 0x7f11481053f0 2024-04-20T12:22:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.883+0000 7f114e7bb640 1 -- 172.21.15.135:0/1806363499 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11481a0740 con 0x7f11481053f0 2024-04-20T12:22:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.884+0000 7f114e7bb640 1 -- 172.21.15.135:0/1806363499 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11480fdf00 con 0x7f11481053f0 2024-04-20T12:22:56.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.885+0000 7f11457fa640 1 -- 172.21.15.135:0/1806363499 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f11300046c0 con 0x7f11481053f0 2024-04-20T12:22:56.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.886+0000 7f11457fa640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f11340a3bb0 0x7f11340a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:56.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.886+0000 7f1147fff640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f11340a3bb0 0x7f11340a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:56.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.886+0000 7f11457fa640 1 -- 172.21.15.135:0/1806363499 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f11300d0e40 con 0x7f11481053f0 2024-04-20T12:22:56.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.886+0000 7f1147fff640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f11340a3bb0 0x7f11340a6070 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1138006010 tx=0x7f113802c8a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:56.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:56.889+0000 7f11457fa640 1 -- 172.21.15.135:0/1806363499 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f1130053ff0 con 0x7f11481053f0 2024-04-20T12:22:57.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.071+0000 7f114e7bb640 1 -- 172.21.15.135:0/1806363499 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f114802d820 con 0x7f11481053f0 2024-04-20T12:22:57.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.071+0000 7f11457fa640 1 -- 172.21.15.135:0/1806363499 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) ==== 100+0+11 (secure 0 0 0) 0x7f113009d480 con 0x7f11481053f0 2024-04-20T12:22:57.071 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-04-20T12:22:57.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.073+0000 7f114e7bb640 1 -- 172.21.15.135:0/1806363499 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f11340a3bb0 msgr2=0x7f11340a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:57.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.073+0000 7f114e7bb640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f11340a3bb0 0x7f11340a6070 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1138006010 tx=0x7f113802c8a0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.073+0000 7f114e7bb640 1 -- 172.21.15.135:0/1806363499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11481053f0 msgr2=0x7f1148198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:57.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.073+0000 7f114e7bb640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11481053f0 0x7f1148198870 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f113000e9f0 tx=0x7f113000eeb0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.073+0000 7f114e7bb640 1 -- 172.21.15.135:0/1806363499 shutdown_connections 2024-04-20T12:22:57.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.073+0000 7f114e7bb640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f11340a3bb0 0x7f11340a6070 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.073+0000 7f114e7bb640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1148107d20 0x7f114819f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.073+0000 7f114e7bb640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f11481053f0 0x7f1148198870 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.073+0000 7f114e7bb640 1 --2- 172.21.15.135:0/1806363499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1148102ac0 0x7f1148198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.073+0000 7f114e7bb640 1 -- 172.21.15.135:0/1806363499 >> 172.21.15.135:0/1806363499 conn(0x7f11480fc410 msgr2=0x7f1148103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:57.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.073+0000 7f114e7bb640 1 -- 172.21.15.135:0/1806363499 shutdown_connections 2024-04-20T12:22:57.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.073+0000 7f114e7bb640 1 -- 172.21.15.135:0/1806363499 wait complete. 2024-04-20T12:22:57.083 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:56 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2619305054' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:57.083 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:56 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3854353962' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:22:57.083 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:56 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1785299976' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:22:57.084 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T12:22:57.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.185+0000 7fd636648640 1 -- 172.21.15.135:0/3423042099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6301053d0 msgr2=0x7fd630105850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:57.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.185+0000 7fd636648640 1 --2- 172.21.15.135:0/3423042099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6301053d0 0x7fd630105850 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd624009900 tx=0x7fd62402bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:57.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.185+0000 7fd636648640 1 -- 172.21.15.135:0/3423042099 shutdown_connections 2024-04-20T12:22:57.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.185+0000 7fd636648640 1 --2- 172.21.15.135:0/3423042099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd630105d90 0x7fd63010c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.185+0000 7fd636648640 1 --2- 172.21.15.135:0/3423042099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6301053d0 0x7fd630105850 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.185+0000 7fd636648640 1 --2- 172.21.15.135:0/3423042099 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6301041e0 0x7fd630104600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.185+0000 7fd636648640 1 -- 172.21.15.135:0/3423042099 >> 172.21.15.135:0/3423042099 conn(0x7fd6300ff750 msgr2=0x7fd630101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:57.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.185+0000 7fd636648640 1 -- 172.21.15.135:0/3423042099 shutdown_connections 2024-04-20T12:22:57.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.185+0000 7fd636648640 1 -- 172.21.15.135:0/3423042099 wait complete. 2024-04-20T12:22:57.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd636648640 1 Processor -- start 2024-04-20T12:22:57.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd636648640 1 -- start start 2024-04-20T12:22:57.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd636648640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6301041e0 0x7fd63019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:57.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd636648640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6301053d0 0x7fd63019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:57.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd636648640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd630105d90 0x7fd6301a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:57.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd636648640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd63010feb0 con 0x7fd630105d90 2024-04-20T12:22:57.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd636648640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd63010fd30 con 0x7fd6301053d0 2024-04-20T12:22:57.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd636648640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd630110030 con 0x7fd6301041e0 2024-04-20T12:22:57.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd634be5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd630105d90 0x7fd6301a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:57.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd634be5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd630105d90 0x7fd6301a1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41362/0 (socket says 172.21.15.135:41362) 2024-04-20T12:22:57.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd634be5640 1 -- 172.21.15.135:0/1649220185 learned_addr learned my addr 172.21.15.135:0/1649220185 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:57.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd62ffff640 1 --2- 172.21.15.135:0/1649220185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6301041e0 0x7fd63019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:57.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd62f7fe640 1 --2- 172.21.15.135:0/1649220185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6301053d0 0x7fd63019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:57.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd634be5640 1 -- 172.21.15.135:0/1649220185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6301041e0 msgr2=0x7fd63019a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:57.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd634be5640 1 --2- 172.21.15.135:0/1649220185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6301041e0 0x7fd63019a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd634be5640 1 -- 172.21.15.135:0/1649220185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6301053d0 msgr2=0x7fd63019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:57.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd634be5640 1 --2- 172.21.15.135:0/1649220185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6301053d0 0x7fd63019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd634be5640 1 -- 172.21.15.135:0/1649220185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6301a2170 con 0x7fd630105d90 2024-04-20T12:22:57.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.186+0000 7fd62ffff640 1 --2- 172.21.15.135:0/1649220185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6301041e0 0x7fd63019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:57.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.187+0000 7fd634be5640 1 --2- 172.21.15.135:0/1649220185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd630105d90 0x7fd6301a1b00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd62800b970 tx=0x7fd62800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:57.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.187+0000 7fd62d7fa640 1 -- 172.21.15.135:0/1649220185 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628019070 con 0x7fd630105d90 2024-04-20T12:22:57.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.187+0000 7fd636648640 1 -- 172.21.15.135:0/1649220185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6301a2460 con 0x7fd630105d90 2024-04-20T12:22:57.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.187+0000 7fd62d7fa640 1 -- 172.21.15.135:0/1649220185 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd62800cb40 con 0x7fd630105d90 2024-04-20T12:22:57.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.187+0000 7fd62d7fa640 1 -- 172.21.15.135:0/1649220185 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628007650 con 0x7fd630105d90 2024-04-20T12:22:57.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.187+0000 7fd636648640 1 -- 172.21.15.135:0/1649220185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6301a2930 con 0x7fd630105d90 2024-04-20T12:22:57.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.188+0000 7fd636648640 1 -- 172.21.15.135:0/1649220185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd63010b550 con 0x7fd630105d90 2024-04-20T12:22:57.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.189+0000 7fd62d7fa640 1 -- 172.21.15.135:0/1649220185 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fd62801c070 con 0x7fd630105d90 2024-04-20T12:22:57.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.190+0000 7fd62d7fa640 1 --2- 172.21.15.135:0/1649220185 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd6180a3bb0 0x7fd6180a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:57.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.190+0000 7fd62ffff640 1 --2- 172.21.15.135:0/1649220185 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd6180a3bb0 0x7fd6180a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:57.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.190+0000 7fd62d7fa640 1 -- 172.21.15.135:0/1649220185 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7fd6280cfe20 con 0x7fd630105d90 2024-04-20T12:22:57.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.190+0000 7fd62ffff640 1 --2- 172.21.15.135:0/1649220185 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd6180a3bb0 0x7fd6180a6070 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd630105230 tx=0x7fd620005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:57.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.194+0000 7fd62d7fa640 1 -- 172.21.15.135:0/1649220185 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fd62809c460 con 0x7fd630105d90 2024-04-20T12:22:57.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:56 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2619305054' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:57.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:56 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3854353962' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:22:57.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:56 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1785299976' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:22:57.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:56 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2619305054' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:57.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:56 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3854353962' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:22:57.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:56 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1785299976' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:22:57.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.375+0000 7fd636648640 1 -- 172.21.15.135:0/1649220185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd630062b60 con 0x7fd630105d90 2024-04-20T12:22:57.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.375+0000 7fd62d7fa640 1 -- 172.21.15.135:0/1649220185 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v94) ==== 103+0+11 (secure 0 0 0) 0x7fd62809bd60 con 0x7fd630105d90 2024-04-20T12:22:57.375 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:22:57.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.377+0000 7fd636648640 1 -- 172.21.15.135:0/1649220185 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd6180a3bb0 msgr2=0x7fd6180a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:57.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.377+0000 7fd636648640 1 --2- 172.21.15.135:0/1649220185 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd6180a3bb0 0x7fd6180a6070 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd630105230 tx=0x7fd620005d30 comp rx=0 tx=0).stop 2024-04-20T12:22:57.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.377+0000 7fd636648640 1 -- 172.21.15.135:0/1649220185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd630105d90 msgr2=0x7fd6301a1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:57.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.377+0000 7fd636648640 1 --2- 172.21.15.135:0/1649220185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd630105d90 0x7fd6301a1b00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd62800b970 tx=0x7fd62800be30 comp rx=0 tx=0).stop 2024-04-20T12:22:57.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.377+0000 7fd636648640 1 -- 172.21.15.135:0/1649220185 shutdown_connections 2024-04-20T12:22:57.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.377+0000 7fd636648640 1 --2- 172.21.15.135:0/1649220185 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd6180a3bb0 0x7fd6180a6070 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.377+0000 7fd636648640 1 --2- 172.21.15.135:0/1649220185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd630105d90 0x7fd6301a1b00 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.377+0000 7fd636648640 1 --2- 172.21.15.135:0/1649220185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6301053d0 0x7fd63019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.377+0000 7fd636648640 1 --2- 172.21.15.135:0/1649220185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6301041e0 0x7fd63019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.377+0000 7fd636648640 1 -- 172.21.15.135:0/1649220185 >> 172.21.15.135:0/1649220185 conn(0x7fd6300ff750 msgr2=0x7fd630108720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:57.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.377+0000 7fd636648640 1 -- 172.21.15.135:0/1649220185 shutdown_connections 2024-04-20T12:22:57.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.377+0000 7fd636648640 1 -- 172.21.15.135:0/1649220185 wait complete. 2024-04-20T12:22:57.389 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:22:57.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.486+0000 7f22305a4640 1 -- 172.21.15.135:0/1152935282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22281029b0 msgr2=0x7f22281092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:57.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.486+0000 7f22305a4640 1 --2- 172.21.15.135:0/1152935282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22281029b0 0x7f22281092d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2220009ca0 tx=0x7f222002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.486+0000 7f22305a4640 1 -- 172.21.15.135:0/1152935282 shutdown_connections 2024-04-20T12:22:57.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.486+0000 7f22305a4640 1 --2- 172.21.15.135:0/1152935282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22281029b0 0x7f22281092d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.486+0000 7f22305a4640 1 --2- 172.21.15.135:0/1152935282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2228101ff0 0x7f2228102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.486+0000 7f22305a4640 1 --2- 172.21.15.135:0/1152935282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2228100ea0 0x7f22281012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.486+0000 7f22305a4640 1 -- 172.21.15.135:0/1152935282 >> 172.21.15.135:0/1152935282 conn(0x7f22280fc410 msgr2=0x7f22280fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:57.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.486+0000 7f22305a4640 1 -- 172.21.15.135:0/1152935282 shutdown_connections 2024-04-20T12:22:57.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.487+0000 7f22305a4640 1 -- 172.21.15.135:0/1152935282 wait complete. 2024-04-20T12:22:57.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.487+0000 7f22305a4640 1 Processor -- start 2024-04-20T12:22:57.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.487+0000 7f22305a4640 1 -- start start 2024-04-20T12:22:57.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.487+0000 7f22305a4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2228100ea0 0x7f2228069cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:57.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.487+0000 7f22305a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2228101ff0 0x7f222819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:57.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.487+0000 7f22305a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22281029b0 0x7f222819f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:57.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.487+0000 7f22305a4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f222810cb30 con 0x7f2228100ea0 2024-04-20T12:22:57.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.487+0000 7f22305a4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f222810c9b0 con 0x7f22281029b0 2024-04-20T12:22:57.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.487+0000 7f22305a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f222810ccb0 con 0x7f2228101ff0 2024-04-20T12:22:57.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.487+0000 7f222e340640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2228100ea0 0x7f2228069cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:57.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.487+0000 7f222e340640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2228100ea0 0x7f2228069cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41376/0 (socket says 172.21.15.135:41376) 2024-04-20T12:22:57.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.487+0000 7f222e340640 1 -- 172.21.15.135:0/4062076265 learned_addr learned my addr 172.21.15.135:0/4062076265 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:57.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.487+0000 7f222db3f640 1 --2- 172.21.15.135:0/4062076265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2228101ff0 0x7f222819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:57.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.488+0000 7f222eb41640 1 --2- 172.21.15.135:0/4062076265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22281029b0 0x7f222819f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:57.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.488+0000 7f222e340640 1 -- 172.21.15.135:0/4062076265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2228101ff0 msgr2=0x7f222819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:57.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.488+0000 7f222e340640 1 --2- 172.21.15.135:0/4062076265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2228101ff0 0x7f222819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.488+0000 7f222e340640 1 -- 172.21.15.135:0/4062076265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22281029b0 msgr2=0x7f222819f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:57.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.488+0000 7f222e340640 1 --2- 172.21.15.135:0/4062076265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22281029b0 0x7f222819f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.488+0000 7f222e340640 1 -- 172.21.15.135:0/4062076265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222819fe00 con 0x7f2228100ea0 2024-04-20T12:22:57.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.488+0000 7f222eb41640 1 --2- 172.21.15.135:0/4062076265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22281029b0 0x7f222819f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:57.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.488+0000 7f222e340640 1 --2- 172.21.15.135:0/4062076265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2228100ea0 0x7f2228069cc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f222400d950 tx=0x7f222400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:57.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.488+0000 7f221f7fe640 1 -- 172.21.15.135:0/4062076265 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2224017070 con 0x7f2228100ea0 2024-04-20T12:22:57.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.488+0000 7f221f7fe640 1 -- 172.21.15.135:0/4062076265 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2224009c30 con 0x7f2228100ea0 2024-04-20T12:22:57.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.488+0000 7f22305a4640 1 -- 172.21.15.135:0/4062076265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22281a00f0 con 0x7f2228100ea0 2024-04-20T12:22:57.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.488+0000 7f221f7fe640 1 -- 172.21.15.135:0/4062076265 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f222400f6b0 con 0x7f2228100ea0 2024-04-20T12:22:57.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.488+0000 7f22305a4640 1 -- 172.21.15.135:0/4062076265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22281a0640 con 0x7f2228100ea0 2024-04-20T12:22:57.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.489+0000 7f22305a4640 1 -- 172.21.15.135:0/4062076265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22281080e0 con 0x7f2228100ea0 2024-04-20T12:22:57.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.490+0000 7f221f7fe640 1 -- 172.21.15.135:0/4062076265 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f22240109d0 con 0x7f2228100ea0 2024-04-20T12:22:57.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.491+0000 7f221f7fe640 1 --2- 172.21.15.135:0/4062076265 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f22140a3bb0 0x7f22140a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:57.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.491+0000 7f221f7fe640 1 -- 172.21.15.135:0/4062076265 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f22240d04c0 con 0x7f2228100ea0 2024-04-20T12:22:57.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.491+0000 7f222db3f640 1 --2- 172.21.15.135:0/4062076265 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f22140a3bb0 0x7f22140a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:57.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.491+0000 7f222db3f640 1 --2- 172.21.15.135:0/4062076265 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f22140a3bb0 0x7f22140a6070 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f22180058c0 tx=0x7f2218005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:57.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.494+0000 7f221f7fe640 1 -- 172.21.15.135:0/4062076265 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f2224009de0 con 0x7f2228100ea0 2024-04-20T12:22:57.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.708+0000 7f22305a4640 1 -- 172.21.15.135:0/4062076265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f222802d5d0 con 0x7f2228100ea0 2024-04-20T12:22:57.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.709+0000 7f221f7fe640 1 -- 172.21.15.135:0/4062076265 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11973 (secure 0 0 0) 0x7f222409cb00 con 0x7f2228100ea0 2024-04-20T12:22:57.709 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:57.709 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:21:09.311388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24490,24476,14634,24457,24475]},"id":1}]} 2024-04-20T12:22:57.709 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 28 2024-04-20T12:22:57.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.711+0000 7f22305a4640 1 -- 172.21.15.135:0/4062076265 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f22140a3bb0 msgr2=0x7f22140a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:57.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.712+0000 7f22305a4640 1 --2- 172.21.15.135:0/4062076265 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f22140a3bb0 0x7f22140a6070 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f22180058c0 tx=0x7f2218005850 comp rx=0 tx=0).stop 2024-04-20T12:22:57.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.712+0000 7f22305a4640 1 -- 172.21.15.135:0/4062076265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2228100ea0 msgr2=0x7f2228069cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:57.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.712+0000 7f22305a4640 1 --2- 172.21.15.135:0/4062076265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2228100ea0 0x7f2228069cc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f222400d950 tx=0x7f222400de10 comp rx=0 tx=0).stop 2024-04-20T12:22:57.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.712+0000 7f22305a4640 1 -- 172.21.15.135:0/4062076265 shutdown_connections 2024-04-20T12:22:57.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.712+0000 7f22305a4640 1 --2- 172.21.15.135:0/4062076265 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f22140a3bb0 0x7f22140a6070 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.712+0000 7f22305a4640 1 --2- 172.21.15.135:0/4062076265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f22281029b0 0x7f222819f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.712+0000 7f22305a4640 1 --2- 172.21.15.135:0/4062076265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2228101ff0 0x7f222819ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.712+0000 7f22305a4640 1 --2- 172.21.15.135:0/4062076265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2228100ea0 0x7f2228069cc0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.712+0000 7f22305a4640 1 -- 172.21.15.135:0/4062076265 >> 172.21.15.135:0/4062076265 conn(0x7f22280fc410 msgr2=0x7f22281052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:57.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.712+0000 7f22305a4640 1 -- 172.21.15.135:0/4062076265 shutdown_connections 2024-04-20T12:22:57.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.712+0000 7f22305a4640 1 -- 172.21.15.135:0/4062076265 wait complete. 2024-04-20T12:22:57.723 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:22:57.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.822+0000 7fd294b85640 1 -- 172.21.15.135:0/3317191594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd290102a30 msgr2=0x7fd290104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:57.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.822+0000 7fd294b85640 1 --2- 172.21.15.135:0/3317191594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd290102a30 0x7fd290104e20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd284009900 tx=0x7fd28402bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:57.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.822+0000 7fd294b85640 1 -- 172.21.15.135:0/3317191594 shutdown_connections 2024-04-20T12:22:57.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.822+0000 7fd294b85640 1 --2- 172.21.15.135:0/3317191594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd290107c90 0x7fd29010a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.822+0000 7fd294b85640 1 --2- 172.21.15.135:0/3317191594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd290105360 0x7fd290107750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.822+0000 7fd294b85640 1 --2- 172.21.15.135:0/3317191594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd290102a30 0x7fd290104e20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.822+0000 7fd294b85640 1 -- 172.21.15.135:0/3317191594 >> 172.21.15.135:0/3317191594 conn(0x7fd2900fc440 msgr2=0x7fd2900fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:57.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.822+0000 7fd294b85640 1 -- 172.21.15.135:0/3317191594 shutdown_connections 2024-04-20T12:22:57.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.822+0000 7fd294b85640 1 -- 172.21.15.135:0/3317191594 wait complete. 2024-04-20T12:22:57.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd294b85640 1 Processor -- start 2024-04-20T12:22:57.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd294b85640 1 -- start start 2024-04-20T12:22:57.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd294b85640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd290102a30 0x7fd290102350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:57.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd294b85640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd290105360 0x7fd2901009e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:57.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd294b85640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd290107c90 0x7fd290100f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:57.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd294b85640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd29010dc40 con 0x7fd290105360 2024-04-20T12:22:57.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd294b85640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd29010dac0 con 0x7fd290107c90 2024-04-20T12:22:57.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd294b85640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd29010ddc0 con 0x7fd290102a30 2024-04-20T12:22:57.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd28dd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd290105360 0x7fd2901009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:57.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd28dd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd290105360 0x7fd2901009e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41392/0 (socket says 172.21.15.135:41392) 2024-04-20T12:22:57.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd28dd9b640 1 -- 172.21.15.135:0/1885036662 learned_addr learned my addr 172.21.15.135:0/1885036662 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:57.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd28e59c640 1 --2- 172.21.15.135:0/1885036662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd290102a30 0x7fd290102350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:57.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd28ed9d640 1 --2- 172.21.15.135:0/1885036662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd290107c90 0x7fd290100f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:57.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd28dd9b640 1 -- 172.21.15.135:0/1885036662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd290102a30 msgr2=0x7fd290102350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:57.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd28dd9b640 1 --2- 172.21.15.135:0/1885036662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd290102a30 0x7fd290102350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd28dd9b640 1 -- 172.21.15.135:0/1885036662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd290107c90 msgr2=0x7fd290100f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:57.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd28dd9b640 1 --2- 172.21.15.135:0/1885036662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd290107c90 0x7fd290100f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:57.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd28dd9b640 1 -- 172.21.15.135:0/1885036662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2901017e0 con 0x7fd290105360 2024-04-20T12:22:57.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.823+0000 7fd28ed9d640 1 --2- 172.21.15.135:0/1885036662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd290107c90 0x7fd290100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:57.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.824+0000 7fd28dd9b640 1 --2- 172.21.15.135:0/1885036662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd290105360 0x7fd2901009e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd28000d740 tx=0x7fd28000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:57.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.824+0000 7fd27f7fe640 1 -- 172.21.15.135:0/1885036662 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd280017070 con 0x7fd290105360 2024-04-20T12:22:57.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.824+0000 7fd294b85640 1 -- 172.21.15.135:0/1885036662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2901a24c0 con 0x7fd290105360 2024-04-20T12:22:57.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.824+0000 7fd27f7fe640 1 -- 172.21.15.135:0/1885036662 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd28000de50 con 0x7fd290105360 2024-04-20T12:22:57.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.824+0000 7fd294b85640 1 -- 172.21.15.135:0/1885036662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2901a29e0 con 0x7fd290105360 2024-04-20T12:22:57.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.824+0000 7fd27f7fe640 1 -- 172.21.15.135:0/1885036662 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd280004e00 con 0x7fd290105360 2024-04-20T12:22:57.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.825+0000 7fd294b85640 1 -- 172.21.15.135:0/1885036662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2900691d0 con 0x7fd290105360 2024-04-20T12:22:57.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.826+0000 7fd27f7fe640 1 -- 172.21.15.135:0/1885036662 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7fd280004fa0 con 0x7fd290105360 2024-04-20T12:22:57.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.826+0000 7fd27f7fe640 1 --2- 172.21.15.135:0/1885036662 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd2780a3bb0 0x7fd2780a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:57.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.827+0000 7fd28e59c640 1 --2- 172.21.15.135:0/1885036662 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd2780a3bb0 0x7fd2780a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:57.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.827+0000 7fd27f7fe640 1 -- 172.21.15.135:0/1885036662 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7fd2800d05f0 con 0x7fd290105360 2024-04-20T12:22:57.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.827+0000 7fd28e59c640 1 --2- 172.21.15.135:0/1885036662 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd2780a3bb0 0x7fd2780a6070 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd284005c20 tx=0x7fd284005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:57.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:57.830+0000 7fd27f7fe640 1 -- 172.21.15.135:0/1885036662 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fd28009cc30 con 0x7fd290105360 2024-04-20T12:22:58.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.011+0000 7fd294b85640 1 -- 172.21.15.135:0/1885036662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd290062b60 con 0x7fd290105360 2024-04-20T12:22:58.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.013+0000 7fd27f7fe640 1 -- 172.21.15.135:0/1885036662 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+24814 (secure 0 0 0) 0x7fd28009c530 con 0x7fd290105360 2024-04-20T12:22:58.013 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:22:58.013 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":94,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:22:37.927600+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:22:58.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.015+0000 7fd294b85640 1 -- 172.21.15.135:0/1885036662 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd2780a3bb0 msgr2=0x7fd2780a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.015+0000 7fd294b85640 1 --2- 172.21.15.135:0/1885036662 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd2780a3bb0 0x7fd2780a6070 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd284005c20 tx=0x7fd284005fd0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.015+0000 7fd294b85640 1 -- 172.21.15.135:0/1885036662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd290105360 msgr2=0x7fd2901009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.015+0000 7fd294b85640 1 --2- 172.21.15.135:0/1885036662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd290105360 0x7fd2901009e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd28000d740 tx=0x7fd28000dc00 comp rx=0 tx=0).stop 2024-04-20T12:22:58.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.015+0000 7fd294b85640 1 -- 172.21.15.135:0/1885036662 shutdown_connections 2024-04-20T12:22:58.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.015+0000 7fd294b85640 1 --2- 172.21.15.135:0/1885036662 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fd2780a3bb0 0x7fd2780a6070 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.015+0000 7fd294b85640 1 --2- 172.21.15.135:0/1885036662 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd290107c90 0x7fd290100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.015+0000 7fd294b85640 1 --2- 172.21.15.135:0/1885036662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd290105360 0x7fd2901009e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.015+0000 7fd294b85640 1 --2- 172.21.15.135:0/1885036662 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd290102a30 0x7fd290102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.015+0000 7fd294b85640 1 -- 172.21.15.135:0/1885036662 >> 172.21.15.135:0/1885036662 conn(0x7fd2900fc440 msgr2=0x7fd290103760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.015+0000 7fd294b85640 1 -- 172.21.15.135:0/1885036662 shutdown_connections 2024-04-20T12:22:58.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.015+0000 7fd294b85640 1 -- 172.21.15.135:0/1885036662 wait complete. 2024-04-20T12:22:58.025 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:57 smithi135 ceph-mon[18264]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-04-20T12:22:58.025 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:57 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1806363499' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:22:58.025 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:57 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1649220185' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:22:58.025 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:57 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/4062076265' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:22:58.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-04-20T12:20:41.367288+0000', 'modified': '2024-04-20T12:21:09.311388+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'snap_rstat': True, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24490, 'mds_1': 24476, 'mds_2': 24475, 'mds_3': 24457, 'mds_4': 14634}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14622': {'gid': 14622, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6839/3001818614', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 3001818614}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 3001818614}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14634': {'gid': 14634, 'name': 'a', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.135:6841/212699479', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6840', 'nonce': 212699479}, {'type': 'v1', 'addr': '172.21.15.135:6841', 'nonce': 212699479}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24389': {'gid': 24389, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6833/2012805307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6832', 'nonce': 2012805307}, {'type': 'v1', 'addr': '172.21.15.139:6833', 'nonce': 2012805307}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24409': {'gid': 24409, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.154:6833/406581782', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6832', 'nonce': 406581782}, {'type': 'v1', 'addr': '172.21.15.154:6833', 'nonce': 406581782}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24416': {'gid': 24416, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6835/1816377265', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6834', 'nonce': 1816377265}, {'type': 'v1', 'addr': '172.21.15.139:6835', 'nonce': 1816377265}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24455': {'gid': 24455, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.139:6837/2426010804', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6836', 'nonce': 2426010804}, {'type': 'v1', 'addr': '172.21.15.139:6837', 'nonce': 2426010804}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24457': {'gid': 24457, 'name': 'f', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.154:6835/1522201664', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6834', 'nonce': 1522201664}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 1522201664}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.154:6837/2792228805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6836', 'nonce': 2792228805}, {'type': 'v1', 'addr': '172.21.15.154:6837', 'nonce': 2792228805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'b', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.139:6839/3819947532', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.139:6838', 'nonce': 3819947532}, {'type': 'v1', 'addr': '172.21.15.139:6839', 'nonce': 3819947532}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.154:6839/1672287462', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6838', 'nonce': 1672287462}, {'type': 'v1', 'addr': '172.21.15.154:6839', 'nonce': 1672287462}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24490, 'qdb_cluster': [24490, 24476, 14634, 24457, 24475]} 2024-04-20T12:22:58.027 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-20T12:22:58.027 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-20T12:22:58.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 -- 172.21.15.135:0/3273246767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c781029b0 msgr2=0x7f5c781092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 --2- 172.21.15.135:0/3273246767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c781029b0 0x7f5c781092d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009ca0 tx=0x7f5c7002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 -- 172.21.15.135:0/3273246767 shutdown_connections 2024-04-20T12:22:58.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 --2- 172.21.15.135:0/3273246767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c781029b0 0x7f5c781092d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 --2- 172.21.15.135:0/3273246767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c78101ff0 0x7f5c78102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 --2- 172.21.15.135:0/3273246767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c78100ea0 0x7f5c781012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 -- 172.21.15.135:0/3273246767 >> 172.21.15.135:0/3273246767 conn(0x7f5c780fc410 msgr2=0x7f5c780fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 -- 172.21.15.135:0/3273246767 shutdown_connections 2024-04-20T12:22:58.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 -- 172.21.15.135:0/3273246767 wait complete. 2024-04-20T12:22:58.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 Processor -- start 2024-04-20T12:22:58.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 -- start start 2024-04-20T12:22:58.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c78100ea0 0x7f5c78069cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c78101ff0 0x7f5c7819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c781029b0 0x7f5c7819f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7810cb30 con 0x7f5c781029b0 2024-04-20T12:22:58.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7810c9b0 con 0x7f5c78100ea0 2024-04-20T12:22:58.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c7ddb6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7810ccb0 con 0x7f5c78101ff0 2024-04-20T12:22:58.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c77fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c781029b0 0x7f5c7819f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c77fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c781029b0 0x7f5c7819f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41406/0 (socket says 172.21.15.135:41406) 2024-04-20T12:22:58.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.128+0000 7f5c77fff640 1 -- 172.21.15.135:0/1484399347 learned_addr learned my addr 172.21.15.135:0/1484399347 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.129+0000 7f5c777fe640 1 --2- 172.21.15.135:0/1484399347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c78100ea0 0x7f5c78069cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.129+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/1484399347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c78101ff0 0x7f5c7819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.129+0000 7f5c77fff640 1 -- 172.21.15.135:0/1484399347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c78101ff0 msgr2=0x7f5c7819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.129+0000 7f5c77fff640 1 --2- 172.21.15.135:0/1484399347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c78101ff0 0x7f5c7819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.129+0000 7f5c77fff640 1 -- 172.21.15.135:0/1484399347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c78100ea0 msgr2=0x7f5c78069cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.129+0000 7f5c77fff640 1 --2- 172.21.15.135:0/1484399347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c78100ea0 0x7f5c78069cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.129+0000 7f5c77fff640 1 -- 172.21.15.135:0/1484399347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7819fde0 con 0x7f5c781029b0 2024-04-20T12:22:58.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.129+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/1484399347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c78101ff0 0x7f5c7819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:58.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.129+0000 7f5c77fff640 1 --2- 172.21.15.135:0/1484399347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c781029b0 0x7f5c7819f520 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5c7002c700 tx=0x7f5c70032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.129+0000 7f5c757fa640 1 -- 172.21.15.135:0/1484399347 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c70039040 con 0x7f5c781029b0 2024-04-20T12:22:58.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.129+0000 7f5c757fa640 1 -- 172.21.15.135:0/1484399347 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c70044070 con 0x7f5c781029b0 2024-04-20T12:22:58.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.129+0000 7f5c7ddb6640 1 -- 172.21.15.135:0/1484399347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c781a0070 con 0x7f5c781029b0 2024-04-20T12:22:58.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.129+0000 7f5c757fa640 1 -- 172.21.15.135:0/1484399347 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c700042a0 con 0x7f5c781029b0 2024-04-20T12:22:58.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.129+0000 7f5c7ddb6640 1 -- 172.21.15.135:0/1484399347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c781a0560 con 0x7f5c781029b0 2024-04-20T12:22:58.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.132+0000 7f5c757fa640 1 -- 172.21.15.135:0/1484399347 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f5c70032690 con 0x7f5c781029b0 2024-04-20T12:22:58.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.132+0000 7f5c809ae740 1 Processor -- start 2024-04-20T12:22:58.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.132+0000 7f5c809ae740 1 -- start start 2024-04-20T12:22:58.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.132+0000 7f5c809ae740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c20cf0 0x561766c21110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.132+0000 7f5c809ae740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c216e0 0x561766c261e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.132+0000 7f5c809ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c26850 0x561766c28ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.132+0000 7f5c809ae740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561766b34290 con 0x561766c20cf0 2024-04-20T12:22:58.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.132+0000 7f5c809ae740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561766b91a40 con 0x561766c216e0 2024-04-20T12:22:58.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.132+0000 7f5c809ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561766b4ca30 con 0x561766c26850 2024-04-20T12:22:58.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.132+0000 7f5c6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c20cf0 0x561766c21110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.132+0000 7f5c6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c20cf0 0x561766c21110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41414/0 (socket says 172.21.15.135:41414) 2024-04-20T12:22:58.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.132+0000 7f5c6ffff640 1 -- 172.21.15.135:0/3247507893 learned_addr learned my addr 172.21.15.135:0/3247507893 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.132+0000 7f5c777fe640 1 --2- 172.21.15.135:0/3247507893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c216e0 0x561766c261e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.132+0000 7f5c757fa640 1 --2- 172.21.15.135:0/1484399347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5c640a3bb0 0x7f5c640a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.133+0000 7f5c6ffff640 1 -- 172.21.15.135:0/3247507893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c26850 msgr2=0x561766c28ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.133+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/3247507893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c26850 0x561766c28ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.133+0000 7f5c6ffff640 1 -- 172.21.15.135:0/3247507893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c216e0 msgr2=0x561766c261e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.133+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/3247507893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c216e0 0x561766c261e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.133+0000 7f5c6ffff640 1 -- 172.21.15.135:0/3247507893 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561766b3fc10 con 0x561766c20cf0 2024-04-20T12:22:58.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.133+0000 7f5c77fff640 1 --2- 172.21.15.135:0/1484399347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5c640a3bb0 0x7f5c640a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.133+0000 7f5c757fa640 1 -- 172.21.15.135:0/1484399347 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f5c700f2c40 con 0x7f5c781029b0 2024-04-20T12:22:58.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.133+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/3247507893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c20cf0 0x561766c21110 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009ca0 tx=0x7f5c600106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ebb0697f695b31 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.133+0000 7f5c6dffb640 1 -- 172.21.15.135:0/3247507893 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60016070 con 0x561766c20cf0 2024-04-20T12:22:58.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.133+0000 7f5c77fff640 1 --2- 172.21.15.135:0/1484399347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5c640a3bb0 0x7f5c640a6070 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5c700bb5e0 tx=0x7f5c7002c0f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.133+0000 7f5c6dffb640 1 -- 172.21.15.135:0/3247507893 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c60005500 con 0x561766c20cf0 2024-04-20T12:22:58.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.133+0000 7f5c6dffb640 1 -- 172.21.15.135:0/3247507893 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60012640 con 0x561766c20cf0 2024-04-20T12:22:58.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 -- 172.21.15.135:0/3247507893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c20cf0 msgr2=0x561766c21110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 --2- 172.21.15.135:0/3247507893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c20cf0 0x561766c21110 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009ca0 tx=0x7f5c600106e0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 -- 172.21.15.135:0/3247507893 shutdown_connections 2024-04-20T12:22:58.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 --2- 172.21.15.135:0/3247507893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c26850 0x561766c28ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 --2- 172.21.15.135:0/3247507893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c216e0 0x561766c261e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 --2- 172.21.15.135:0/3247507893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c20cf0 0x561766c21110 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 -- 172.21.15.135:0/3247507893 >> 172.21.15.135:0/3247507893 conn(0x561766c1c260 msgr2=0x561766c1c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 -- 172.21.15.135:0/3247507893 shutdown_connections 2024-04-20T12:22:58.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 -- 172.21.15.135:0/3247507893 wait complete. 2024-04-20T12:22:58.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 -- start start 2024-04-20T12:22:58.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 Processor -- start 2024-04-20T12:22:58.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c20cf0 0x561766c2af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c216e0 0x561766c2b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c26850 0x561766c324c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561766b8b140 con 0x561766c216e0 2024-04-20T12:22:58.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561766b85e20 con 0x561766c26850 2024-04-20T12:22:58.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561766b93d20 con 0x561766c20cf0 2024-04-20T12:22:58.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.134+0000 7f5c809ae740 10 client.0 _ll_register_callbacks cb 0x561766b7c5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:58.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c777fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c216e0 0x561766c2b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c777fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c216e0 0x561766c2b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41430/0 (socket says 172.21.15.135:41430) 2024-04-20T12:22:58.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c777fe640 1 -- 172.21.15.135:0/3795430020 learned_addr learned my addr 172.21.15.135:0/3795430020 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/3795430020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c26850 0x561766c324c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c777fe640 1 -- 172.21.15.135:0/3795430020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c20cf0 msgr2=0x561766c2af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c777fe640 1 --2- 172.21.15.135:0/3795430020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c20cf0 0x561766c2af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c777fe640 1 -- 172.21.15.135:0/3795430020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c26850 msgr2=0x561766c324c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c777fe640 1 --2- 172.21.15.135:0/3795430020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c26850 0x561766c324c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c777fe640 1 -- 172.21.15.135:0/3795430020 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617668992d0 con 0x561766c216e0 2024-04-20T12:22:58.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/3795430020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c26850 0x561766c324c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:58.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c777fe640 1 --2- 172.21.15.135:0/3795430020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c216e0 0x561766c2b480 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5c68010a50 tx=0x7f5c68010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6114f45fcae6ab server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:58.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c56ffd640 1 -- 172.21.15.135:0/3795430020 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800fab0 con 0x561766c216e0 2024-04-20T12:22:58.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c56ffd640 1 -- 172.21.15.135:0/3795430020 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f5c6800fc50 con 0x561766c216e0 2024-04-20T12:22:58.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c809ae740 1 -- 172.21.15.135:0/3795430020 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c60005500 con 0x561766c216e0 2024-04-20T12:22:58.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c56ffd640 1 -- 172.21.15.135:0/3795430020 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5c68024050 con 0x561766c216e0 2024-04-20T12:22:58.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c809ae740 10 client.15438 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:58.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c809ae740 1 -- 172.21.15.135:0/3795430020 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5617669636b0 con 0x561766c216e0 2024-04-20T12:22:58.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.135+0000 7f5c56ffd640 1 -- 172.21.15.135:0/3795430020 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c60005500 con 0x561766c216e0 2024-04-20T12:22:58.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.136+0000 7f5c56ffd640 1 -- 172.21.15.135:0/3795430020 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7f5c68004c70 con 0x561766c216e0 2024-04-20T12:22:58.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.136+0000 7f5c809ae740 10 client.15438 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:58.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.136+0000 7f5c809ae740 10 client.15438 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-20T12:22:58.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.136+0000 7f5c809ae740 20 client.15438 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:58.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.136+0000 7f5c809ae740 1 --2- 172.21.15.135:0/3795430020 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x561766c37d20 0x561766c39190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.136+0000 7f5c809ae740 4 client.15438 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:22:58.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.136+0000 7f5c809ae740 1 -- 172.21.15.135:0/3795430020 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561766b0d510 con 0x561766c37d20 2024-04-20T12:22:58.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.136+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/3795430020 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x561766c37d20 0x561766c39190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.136+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/3795430020 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x561766c37d20 0x561766c39190 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ddbd815911fba450 server_cookie=419432264a813ad9 in_seq=0 out_seq=0 2024-04-20T12:22:58.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.136+0000 7f5c56ffd640 10 client.15438 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:22:58.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.137+0000 7f5c56ffd640 1 -- 172.21.15.135:0/3795430020 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561766b0d510 con 0x561766c37d20 2024-04-20T12:22:58.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.137+0000 7f5c56ffd640 10 client.15438 handle_command_reply: tid=0 2024-04-20T12:22:58.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.137+0000 7f5c809ae740 1 client.15438 shutdown 2024-04-20T12:22:58.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.137+0000 7f5c809ae740 1 -- 172.21.15.135:0/3795430020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c216e0 msgr2=0x561766c2b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.137+0000 7f5c809ae740 1 --2- 172.21.15.135:0/3795430020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c216e0 0x561766c2b480 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5c68010a50 tx=0x7f5c68010f10 comp rx=0 tx=0).stop 2024-04-20T12:22:58.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.137+0000 7f5c809ae740 1 -- 172.21.15.135:0/3795430020 shutdown_connections 2024-04-20T12:22:58.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.137+0000 7f5c809ae740 1 --2- 172.21.15.135:0/3795430020 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x561766c37d20 0x561766c39190 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.137+0000 7f5c809ae740 1 --2- 172.21.15.135:0/3795430020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c26850 0x561766c324c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.137+0000 7f5c809ae740 1 --2- 172.21.15.135:0/3795430020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c216e0 0x561766c2b480 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.137+0000 7f5c809ae740 1 --2- 172.21.15.135:0/3795430020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c20cf0 0x561766c2af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.137+0000 7f5c56ffd640 0 client.15438 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:22:58.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.137+0000 7f5c809ae740 1 -- 172.21.15.135:0/3795430020 >> 172.21.15.135:0/3795430020 conn(0x561766c1c260 msgr2=0x561766c1b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.137+0000 7f5c809ae740 1 -- 172.21.15.135:0/3795430020 shutdown_connections 2024-04-20T12:22:58.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.137+0000 7f5c809ae740 1 -- 172.21.15.135:0/3795430020 wait complete. 2024-04-20T12:22:58.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.137+0000 7f5c809ae740 20 client.15438 trim_cache size 0 max 16384 2024-04-20T12:22:58.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c809ae740 1 Processor -- start 2024-04-20T12:22:58.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c809ae740 1 -- start start 2024-04-20T12:22:58.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c809ae740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c20cf0 0x561766c1b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c809ae740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c216e0 0x561766c40460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c809ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c26850 0x561766c409a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c809ae740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561766c374d0 con 0x561766c20cf0 2024-04-20T12:22:58.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c809ae740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561766c37ba0 con 0x561766c216e0 2024-04-20T12:22:58.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c809ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561766c38270 con 0x561766c26850 2024-04-20T12:22:58.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c20cf0 0x561766c1b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c20cf0 0x561766c1b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41446/0 (socket says 172.21.15.135:41446) 2024-04-20T12:22:58.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c6ffff640 1 -- 172.21.15.135:0/1807245252 learned_addr learned my addr 172.21.15.135:0/1807245252 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c6ffff640 1 -- 172.21.15.135:0/1807245252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c26850 msgr2=0x561766c409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/1807245252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c26850 0x561766c409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c6ffff640 1 -- 172.21.15.135:0/1807245252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c216e0 msgr2=0x561766c40460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/1807245252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c216e0 0x561766c40460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c6ffff640 1 -- 172.21.15.135:0/1807245252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561766c1cfd0 con 0x561766c20cf0 2024-04-20T12:22:58.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.155+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/1807245252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c20cf0 0x561766c1b220 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009c40 tx=0x7f5c60009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aafbdeff4fedaf49 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.156+0000 7f5c6d7fa640 1 -- 172.21.15.135:0/1807245252 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6002c070 con 0x561766c20cf0 2024-04-20T12:22:58.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.156+0000 7f5c6d7fa640 1 -- 172.21.15.135:0/1807245252 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c60004860 con 0x561766c20cf0 2024-04-20T12:22:58.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.156+0000 7f5c6d7fa640 1 -- 172.21.15.135:0/1807245252 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60016040 con 0x561766c20cf0 2024-04-20T12:22:58.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.156+0000 7f5c809ae740 1 -- 172.21.15.135:0/1807245252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c20cf0 msgr2=0x561766c1b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.156+0000 7f5c809ae740 1 --2- 172.21.15.135:0/1807245252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c20cf0 0x561766c1b220 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009c40 tx=0x7f5c60009830 comp rx=0 tx=0).stop 2024-04-20T12:22:58.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.156+0000 7f5c809ae740 1 -- 172.21.15.135:0/1807245252 shutdown_connections 2024-04-20T12:22:58.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.156+0000 7f5c809ae740 1 --2- 172.21.15.135:0/1807245252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c26850 0x561766c409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.156+0000 7f5c809ae740 1 --2- 172.21.15.135:0/1807245252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c216e0 0x561766c40460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.156+0000 7f5c809ae740 1 --2- 172.21.15.135:0/1807245252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c20cf0 0x561766c1b220 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.156+0000 7f5c809ae740 1 -- 172.21.15.135:0/1807245252 >> 172.21.15.135:0/1807245252 conn(0x561766c1c260 msgr2=0x561766c1ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.156+0000 7f5c809ae740 1 -- 172.21.15.135:0/1807245252 shutdown_connections 2024-04-20T12:22:58.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.156+0000 7f5c809ae740 1 -- 172.21.15.135:0/1807245252 wait complete. 2024-04-20T12:22:58.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c809ae740 1 -- start start 2024-04-20T12:22:58.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c809ae740 1 Processor -- start 2024-04-20T12:22:58.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c809ae740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c20cf0 0x561766c9bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c809ae740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c216e0 0x561766c9e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c809ae740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c26850 0x561766ca0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c809ae740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561766c39010 con 0x561766c26850 2024-04-20T12:22:58.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c809ae740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561766c38940 con 0x561766c20cf0 2024-04-20T12:22:58.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c809ae740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561766c396e0 con 0x561766c216e0 2024-04-20T12:22:58.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c809ae740 10 client.0 _ll_register_callbacks cb 0x7f5c68010660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:58.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c26850 0x561766ca0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c26850 0x561766ca0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41456/0 (socket says 172.21.15.135:41456) 2024-04-20T12:22:58.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c6ffff640 1 -- 172.21.15.135:0/2509903989 learned_addr learned my addr 172.21.15.135:0/2509903989 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/2509903989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c20cf0 0x561766c9bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c777fe640 1 --2- 172.21.15.135:0/2509903989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c216e0 0x561766c9e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c6ffff640 1 -- 172.21.15.135:0/2509903989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c216e0 msgr2=0x561766c9e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/2509903989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c216e0 0x561766c9e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c6ffff640 1 -- 172.21.15.135:0/2509903989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c20cf0 msgr2=0x561766c9bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/2509903989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c20cf0 0x561766c9bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c6ffff640 1 -- 172.21.15.135:0/2509903989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561766ca0da0 con 0x561766c26850 2024-04-20T12:22:58.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.157+0000 7f5c777fe640 1 --2- 172.21.15.135:0/2509903989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c216e0 0x561766c9e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:58.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c6ffff640 1 --2- 172.21.15.135:0/2509903989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c26850 0x561766ca0760 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5c60010c60 tx=0x7f5c600106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7981413843f255c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:58.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c56ffd640 1 -- 172.21.15.135:0/2509903989 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6003a060 con 0x561766c26850 2024-04-20T12:22:58.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c56ffd640 1 -- 172.21.15.135:0/2509903989 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f5c60004d30 con 0x561766c26850 2024-04-20T12:22:58.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c809ae740 1 -- 172.21.15.135:0/2509903989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c60004860 con 0x561766c26850 2024-04-20T12:22:58.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c56ffd640 1 -- 172.21.15.135:0/2509903989 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5c6002c040 con 0x561766c26850 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c809ae740 10 client.15444 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c809ae740 1 -- 172.21.15.135:0/2509903989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561766ca20a0 con 0x561766c26850 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c56ffd640 1 -- 172.21.15.135:0/2509903989 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c60004860 con 0x561766c26850 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c56ffd640 1 -- 172.21.15.135:0/2509903989 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7f5c60032070 con 0x561766c26850 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c809ae740 10 client.15444 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c809ae740 10 client.15444 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c809ae740 20 client.15444 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c809ae740 1 --2- 172.21.15.135:0/2509903989 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x561766ca6500 0x561766ca5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c809ae740 4 client.15444 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c809ae740 1 -- 172.21.15.135:0/2509903989 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "status"}) -- 0x561766b94530 con 0x561766ca6500 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.158+0000 7f5c777fe640 1 --2- 172.21.15.135:0/2509903989 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x561766ca6500 0x561766ca5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c777fe640 1 --2- 172.21.15.135:0/2509903989 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x561766ca6500 0x561766ca5210 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=941a5c474cd9a6a1 server_cookie=3476a3f2e031765b in_seq=0 out_seq=0 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c56ffd640 10 client.15444 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c56ffd640 1 -- 172.21.15.135:0/2509903989 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561766b94530 con 0x561766ca6500 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c56ffd640 10 client.15444 handle_command_reply: tid=0 2024-04-20T12:22:58.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c809ae740 1 client.15444 shutdown 2024-04-20T12:22:58.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c809ae740 1 -- 172.21.15.135:0/2509903989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c26850 msgr2=0x561766ca0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c809ae740 1 --2- 172.21.15.135:0/2509903989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c26850 0x561766ca0760 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5c60010c60 tx=0x7f5c600106e0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c809ae740 1 -- 172.21.15.135:0/2509903989 shutdown_connections 2024-04-20T12:22:58.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c809ae740 1 --2- 172.21.15.135:0/2509903989 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x561766ca6500 0x561766ca5210 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c809ae740 1 --2- 172.21.15.135:0/2509903989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561766c26850 0x561766ca0760 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c809ae740 1 --2- 172.21.15.135:0/2509903989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561766c216e0 0x561766c9e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c56ffd640 0 client.15444 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:22:58.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c809ae740 1 --2- 172.21.15.135:0/2509903989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561766c20cf0 0x561766c9bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c809ae740 1 -- 172.21.15.135:0/2509903989 >> 172.21.15.135:0/2509903989 conn(0x561766c1c260 msgr2=0x561766c1b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c809ae740 1 -- 172.21.15.135:0/2509903989 shutdown_connections 2024-04-20T12:22:58.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c809ae740 1 -- 172.21.15.135:0/2509903989 wait complete. 2024-04-20T12:22:58.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.159+0000 7f5c809ae740 20 client.15444 trim_cache size 0 max 16384 2024-04-20T12:22:58.167 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:22:58.167 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "22180be8-ff0f-11ee-bc92-c7b262605968", 2024-04-20T12:22:58.167 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 4, 2024-04-20T12:22:58.167 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 14634, 2024-04-20T12:22:58.167 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-04-20T12:22:58.167 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-04-20T12:22:58.167 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-04-20T12:22:58.167 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 109.85284808199999, 2024-04-20T12:22:58.167 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 28, 2024-04-20T12:22:58.167 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 94, 2024-04-20T12:22:58.167 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 90, 2024-04-20T12:22:58.167 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 144.96944299099999 2024-04-20T12:22:58.167 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:22:58.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.160+0000 7f5c7ddb6640 1 -- 172.21.15.135:0/1484399347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5c640a3bb0 msgr2=0x7f5c640a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.160+0000 7f5c7ddb6640 1 --2- 172.21.15.135:0/1484399347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5c640a3bb0 0x7f5c640a6070 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5c700bb5e0 tx=0x7f5c7002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.160+0000 7f5c7ddb6640 1 -- 172.21.15.135:0/1484399347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c781029b0 msgr2=0x7f5c7819f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.160+0000 7f5c7ddb6640 1 --2- 172.21.15.135:0/1484399347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c781029b0 0x7f5c7819f520 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5c7002c700 tx=0x7f5c70032f20 comp rx=0 tx=0).stop 2024-04-20T12:22:58.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.160+0000 7f5c7ddb6640 1 -- 172.21.15.135:0/1484399347 shutdown_connections 2024-04-20T12:22:58.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.160+0000 7f5c7ddb6640 1 --2- 172.21.15.135:0/1484399347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5c640a3bb0 0x7f5c640a6070 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.160+0000 7f5c7ddb6640 1 --2- 172.21.15.135:0/1484399347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c781029b0 0x7f5c7819f520 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.160+0000 7f5c7ddb6640 1 --2- 172.21.15.135:0/1484399347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c78101ff0 0x7f5c7819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.160+0000 7f5c7ddb6640 1 --2- 172.21.15.135:0/1484399347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c78100ea0 0x7f5c78069cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.160+0000 7f5c7ddb6640 1 -- 172.21.15.135:0/1484399347 >> 172.21.15.135:0/1484399347 conn(0x7f5c780fc410 msgr2=0x7f5c781052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.160+0000 7f5c7ddb6640 1 -- 172.21.15.135:0/1484399347 shutdown_connections 2024-04-20T12:22:58.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.160+0000 7f5c7ddb6640 1 -- 172.21.15.135:0/1484399347 wait complete. 2024-04-20T12:22:58.170 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-20T12:22:58.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:57 smithi154 ceph-mon[22073]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-04-20T12:22:58.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:57 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1806363499' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:22:58.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:57 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1649220185' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:22:58.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:57 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/4062076265' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:22:58.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.275+0000 7f9e0ab75640 1 -- 172.21.15.135:0/4166087718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e04102050 msgr2=0x7f9e041024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.275+0000 7f9e0ab75640 1 --2- 172.21.15.135:0/4166087718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e04102050 0x7f9e041024d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009900 tx=0x7f9df002bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:58.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.275+0000 7f9e0ab75640 1 -- 172.21.15.135:0/4166087718 shutdown_connections 2024-04-20T12:22:58.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.275+0000 7f9e0ab75640 1 --2- 172.21.15.135:0/4166087718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e04102a10 0x7f9e04109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.275+0000 7f9e0ab75640 1 --2- 172.21.15.135:0/4166087718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e04102050 0x7f9e041024d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.275+0000 7f9e0ab75640 1 --2- 172.21.15.135:0/4166087718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e04100e70 0x7f9e04101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.275+0000 7f9e0ab75640 1 -- 172.21.15.135:0/4166087718 >> 172.21.15.135:0/4166087718 conn(0x7f9e040fc450 msgr2=0x7f9e040fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.275+0000 7f9e0ab75640 1 -- 172.21.15.135:0/4166087718 shutdown_connections 2024-04-20T12:22:58.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.275+0000 7f9e0ab75640 1 -- 172.21.15.135:0/4166087718 wait complete. 2024-04-20T12:22:58.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.276+0000 7f9e0ab75640 1 Processor -- start 2024-04-20T12:22:58.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.276+0000 7f9e0ab75640 1 -- start start 2024-04-20T12:22:58.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.276+0000 7f9e0ab75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e04100e70 0x7f9e04104e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.276+0000 7f9e0ab75640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e04102050 0x7f9e041034c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.276+0000 7f9e0ab75640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e04102a10 0x7f9e04103a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.276+0000 7f9e0ab75640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0410cb70 con 0x7f9e04102050 2024-04-20T12:22:58.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.276+0000 7f9e0ab75640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0410c9f0 con 0x7f9e04102a10 2024-04-20T12:22:58.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.276+0000 7f9e0ab75640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9e0410ccf0 con 0x7f9e04100e70 2024-04-20T12:22:58.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.276+0000 7f9e03fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e04102050 0x7f9e041034c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.276+0000 7f9e03fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e04102050 0x7f9e041034c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41474/0 (socket says 172.21.15.135:41474) 2024-04-20T12:22:58.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.276+0000 7f9e03fff640 1 -- 172.21.15.135:0/2925894016 learned_addr learned my addr 172.21.15.135:0/2925894016 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.276+0000 7f9e08911640 1 --2- 172.21.15.135:0/2925894016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e04100e70 0x7f9e04104e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.276+0000 7f9e09112640 1 --2- 172.21.15.135:0/2925894016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e04102a10 0x7f9e04103a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.277+0000 7f9e03fff640 1 -- 172.21.15.135:0/2925894016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e04100e70 msgr2=0x7f9e04104e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.277+0000 7f9e03fff640 1 --2- 172.21.15.135:0/2925894016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e04100e70 0x7f9e04104e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.277+0000 7f9e03fff640 1 -- 172.21.15.135:0/2925894016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e04102a10 msgr2=0x7f9e04103a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.277+0000 7f9e03fff640 1 --2- 172.21.15.135:0/2925894016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e04102a10 0x7f9e04103a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.277+0000 7f9e03fff640 1 -- 172.21.15.135:0/2925894016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e04104290 con 0x7f9e04102050 2024-04-20T12:22:58.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.277+0000 7f9e08911640 1 --2- 172.21.15.135:0/2925894016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e04100e70 0x7f9e04104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:58.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.277+0000 7f9e03fff640 1 --2- 172.21.15.135:0/2925894016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e04102050 0x7f9e041034c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9df0005ab0 tx=0x7f9df002c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.277+0000 7f9e01ffb640 1 -- 172.21.15.135:0/2925894016 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df0041070 con 0x7f9e04102050 2024-04-20T12:22:58.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.277+0000 7f9e0ab75640 1 -- 172.21.15.135:0/2925894016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e041a2400 con 0x7f9e04102050 2024-04-20T12:22:58.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.277+0000 7f9e0ab75640 1 -- 172.21.15.135:0/2925894016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e041a29a0 con 0x7f9e04102050 2024-04-20T12:22:58.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.277+0000 7f9e01ffb640 1 -- 172.21.15.135:0/2925894016 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9df0004c40 con 0x7f9e04102050 2024-04-20T12:22:58.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.277+0000 7f9e01ffb640 1 -- 172.21.15.135:0/2925894016 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df004b060 con 0x7f9e04102050 2024-04-20T12:22:58.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.280+0000 7f9e01ffb640 1 -- 172.21.15.135:0/2925894016 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f9df0044070 con 0x7f9e04102050 2024-04-20T12:22:58.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.280+0000 7f9e0d767740 1 Processor -- start 2024-04-20T12:22:58.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.280+0000 7f9e0d767740 1 -- start start 2024-04-20T12:22:58.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e0d767740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b0cf0 0x5616971b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e0d767740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b16e0 0x5616971b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e0d767740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b6850 0x5616971b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e0d767740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5616970c4290 con 0x5616971b16e0 2024-04-20T12:22:58.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e0d767740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561697121a40 con 0x5616971b0cf0 2024-04-20T12:22:58.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e0d767740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5616970dca30 con 0x5616971b6850 2024-04-20T12:22:58.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e01ffb640 1 --2- 172.21.15.135:0/2925894016 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9df40a3bb0 0x7f9df40a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e08911640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b16e0 0x5616971b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e08911640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b16e0 0x5616971b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41490/0 (socket says 172.21.15.135:41490) 2024-04-20T12:22:58.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e08911640 1 -- 172.21.15.135:0/970200949 learned_addr learned my addr 172.21.15.135:0/970200949 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e09112640 1 --2- 172.21.15.135:0/970200949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b0cf0 0x5616971b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e09112640 1 --2- 172.21.15.135:0/2925894016 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9df40a3bb0 0x7f9df40a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e01ffb640 1 -- 172.21.15.135:0/2925894016 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f9df00f27f0 con 0x7f9e04102050 2024-04-20T12:22:58.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e03fff640 1 --2- 172.21.15.135:0/970200949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b6850 0x5616971b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e08911640 1 -- 172.21.15.135:0/970200949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b6850 msgr2=0x5616971b8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e08911640 1 --2- 172.21.15.135:0/970200949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b6850 0x5616971b8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e08911640 1 -- 172.21.15.135:0/970200949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b0cf0 msgr2=0x5616971b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e08911640 1 --2- 172.21.15.135:0/970200949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b0cf0 0x5616971b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e08911640 1 -- 172.21.15.135:0/970200949 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616970cfc10 con 0x5616971b16e0 2024-04-20T12:22:58.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e08911640 1 --2- 172.21.15.135:0/970200949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b16e0 0x5616971b61e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9df800cc50 tx=0x7f9df800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4a90d573ace907 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.281+0000 7f9e09112640 1 --2- 172.21.15.135:0/2925894016 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9df40a3bb0 0x7f9df40a6070 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc005c40 tx=0x7f9dfc005bd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.282+0000 7f9deeffd640 1 -- 172.21.15.135:0/970200949 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8014070 con 0x5616971b16e0 2024-04-20T12:22:58.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.282+0000 7f9deeffd640 1 -- 172.21.15.135:0/970200949 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9df8019b40 con 0x5616971b16e0 2024-04-20T12:22:58.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.282+0000 7f9deeffd640 1 -- 172.21.15.135:0/970200949 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8010cb0 con 0x5616971b16e0 2024-04-20T12:22:58.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.282+0000 7f9e0d767740 1 -- 172.21.15.135:0/970200949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b16e0 msgr2=0x5616971b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.282+0000 7f9e0d767740 1 --2- 172.21.15.135:0/970200949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b16e0 0x5616971b61e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9df800cc50 tx=0x7f9df800e720 comp rx=0 tx=0).stop 2024-04-20T12:22:58.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.282+0000 7f9e0d767740 1 -- 172.21.15.135:0/970200949 shutdown_connections 2024-04-20T12:22:58.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.282+0000 7f9e0d767740 1 --2- 172.21.15.135:0/970200949 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b6850 0x5616971b8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.282+0000 7f9e0d767740 1 --2- 172.21.15.135:0/970200949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b16e0 0x5616971b61e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.282+0000 7f9e0d767740 1 --2- 172.21.15.135:0/970200949 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b0cf0 0x5616971b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.282+0000 7f9e0d767740 1 -- 172.21.15.135:0/970200949 >> 172.21.15.135:0/970200949 conn(0x5616971ac260 msgr2=0x5616971ac660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.282+0000 7f9e0d767740 1 -- 172.21.15.135:0/970200949 shutdown_connections 2024-04-20T12:22:58.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.283+0000 7f9e0d767740 1 -- 172.21.15.135:0/970200949 wait complete. 2024-04-20T12:22:58.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.283+0000 7f9e0d767740 1 -- start start 2024-04-20T12:22:58.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.283+0000 7f9e0d767740 1 Processor -- start 2024-04-20T12:22:58.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e0d767740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b0cf0 0x5616971baf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e0d767740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b16e0 0x5616971bb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e0d767740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b6850 0x5616971c2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e0d767740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56169711b140 con 0x5616971b6850 2024-04-20T12:22:58.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e0d767740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561697115e20 con 0x5616971b16e0 2024-04-20T12:22:58.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e0d767740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561697123d20 con 0x5616971b0cf0 2024-04-20T12:22:58.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e0d767740 10 client.0 _ll_register_callbacks cb 0x56169710c5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:58.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e09112640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b6850 0x5616971c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e09112640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b6850 0x5616971c2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41506/0 (socket says 172.21.15.135:41506) 2024-04-20T12:22:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e03fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b16e0 0x5616971bb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e09112640 1 -- 172.21.15.135:0/2425454084 learned_addr learned my addr 172.21.15.135:0/2425454084 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e08911640 1 --2- 172.21.15.135:0/2425454084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b0cf0 0x5616971baf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e03fff640 1 -- 172.21.15.135:0/2425454084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b0cf0 msgr2=0x5616971baf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e03fff640 1 --2- 172.21.15.135:0/2425454084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b0cf0 0x5616971baf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e03fff640 1 -- 172.21.15.135:0/2425454084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b6850 msgr2=0x5616971c2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e03fff640 1 --2- 172.21.15.135:0/2425454084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b6850 0x5616971c2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e03fff640 1 -- 172.21.15.135:0/2425454084 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561696e292d0 con 0x5616971b16e0 2024-04-20T12:22:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e09112640 1 --2- 172.21.15.135:0/2425454084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b6850 0x5616971c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:22:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9e03fff640 1 --2- 172.21.15.135:0/2425454084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b16e0 0x5616971bb450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9df00be3d0 tx=0x7f9df00be290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46694a4a3b74a636 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9de3fff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-20T12:22:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9de3fff640 1 -- 172.21.15.135:0/2425454084 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df00d4070 con 0x5616971b16e0 2024-04-20T12:22:58.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.284+0000 7f9de3fff640 1 -- 172.21.15.135:0/2425454084 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f9df00be930 con 0x5616971b16e0 2024-04-20T12:22:58.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.285+0000 7f9e0d767740 1 -- 172.21.15.135:0/2425454084 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9df8019b40 con 0x5616971b16e0 2024-04-20T12:22:58.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.285+0000 7f9de3fff640 1 -- 172.21.15.135:0/2425454084 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9df00c2a80 con 0x5616971b16e0 2024-04-20T12:22:58.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.285+0000 7f9e0d767740 10 client.24995 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:58.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.285+0000 7f9e0d767740 1 -- 172.21.15.135:0/2425454084 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561696ef36b0 con 0x5616971b16e0 2024-04-20T12:22:58.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.285+0000 7f9de3fff640 1 -- 172.21.15.135:0/2425454084 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9df8019b40 con 0x5616971b16e0 2024-04-20T12:22:58.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.285+0000 7f9de3fff640 1 -- 172.21.15.135:0/2425454084 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7f9df00bdb20 con 0x5616971b16e0 2024-04-20T12:22:58.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.285+0000 7f9e0d767740 10 client.24995 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:58.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.285+0000 7f9e0d767740 10 client.24995 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-20T12:22:58.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.285+0000 7f9e0d767740 20 client.24995 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:58.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.285+0000 7f9e0d767740 1 --2- 172.21.15.135:0/2425454084 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5616971c7ba0 0x5616971c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.285+0000 7f9e0d767740 4 client.24995 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:22:58.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.285+0000 7f9e0d767740 1 -- 172.21.15.135:0/2425454084 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56169709d510 con 0x5616971c7ba0 2024-04-20T12:22:58.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.286+0000 7f9e08911640 1 --2- 172.21.15.135:0/2425454084 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5616971c7ba0 0x5616971c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.286+0000 7f9de3fff640 10 client.24995 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:22:58.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.286+0000 7f9e08911640 1 --2- 172.21.15.135:0/2425454084 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5616971c7ba0 0x5616971c9010 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5288397d90cd3208 server_cookie=b83ede746e04b55b in_seq=0 out_seq=0 2024-04-20T12:22:58.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.287+0000 7f9de3fff640 1 -- 172.21.15.135:0/2425454084 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56169709d510 con 0x5616971c7ba0 2024-04-20T12:22:58.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.287+0000 7f9de3fff640 10 client.24995 handle_command_reply: tid=0 2024-04-20T12:22:58.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.287+0000 7f9e0d767740 1 client.24995 shutdown 2024-04-20T12:22:58.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.287+0000 7f9e0d767740 1 -- 172.21.15.135:0/2425454084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b16e0 msgr2=0x5616971bb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.287+0000 7f9e0d767740 1 --2- 172.21.15.135:0/2425454084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b16e0 0x5616971bb450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9df00be3d0 tx=0x7f9df00be290 comp rx=0 tx=0).stop 2024-04-20T12:22:58.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.287+0000 7f9e0d767740 1 -- 172.21.15.135:0/2425454084 shutdown_connections 2024-04-20T12:22:58.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.287+0000 7f9e0d767740 1 --2- 172.21.15.135:0/2425454084 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5616971c7ba0 0x5616971c9010 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.287+0000 7f9e0d767740 1 --2- 172.21.15.135:0/2425454084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b6850 0x5616971c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.287+0000 7f9de3fff640 0 client.24995 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:22:58.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.287+0000 7f9e0d767740 1 --2- 172.21.15.135:0/2425454084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b16e0 0x5616971bb450 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.287+0000 7f9e0d767740 1 --2- 172.21.15.135:0/2425454084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b0cf0 0x5616971baf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.287+0000 7f9e0d767740 1 -- 172.21.15.135:0/2425454084 >> 172.21.15.135:0/2425454084 conn(0x5616971ac260 msgr2=0x5616971ab3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.287+0000 7f9e0d767740 1 -- 172.21.15.135:0/2425454084 shutdown_connections 2024-04-20T12:22:58.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.287+0000 7f9e0d767740 1 -- 172.21.15.135:0/2425454084 wait complete. 2024-04-20T12:22:58.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.287+0000 7f9e0d767740 20 client.24995 trim_cache size 0 max 16384 2024-04-20T12:22:58.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.313+0000 7f9e0d767740 1 Processor -- start 2024-04-20T12:22:58.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.313+0000 7f9e0d767740 1 -- start start 2024-04-20T12:22:58.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e0d767740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b0cf0 0x5616971baee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e0d767740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b16e0 0x5616971bb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e0d767740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b6850 0x5616971c2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e0d767740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5616971c7350 con 0x5616971b0cf0 2024-04-20T12:22:58.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e0d767740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5616971c7a20 con 0x5616971b16e0 2024-04-20T12:22:58.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e0d767740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5616971c80f0 con 0x5616971b6850 2024-04-20T12:22:58.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e08911640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b0cf0 0x5616971baee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e08911640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b0cf0 0x5616971baee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41516/0 (socket says 172.21.15.135:41516) 2024-04-20T12:22:58.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e08911640 1 -- 172.21.15.135:0/4273424567 learned_addr learned my addr 172.21.15.135:0/4273424567 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e09112640 1 --2- 172.21.15.135:0/4273424567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b6850 0x5616971c2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e03fff640 1 --2- 172.21.15.135:0/4273424567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b16e0 0x5616971bb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e08911640 1 -- 172.21.15.135:0/4273424567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b6850 msgr2=0x5616971c2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e08911640 1 --2- 172.21.15.135:0/4273424567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b6850 0x5616971c2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e08911640 1 -- 172.21.15.135:0/4273424567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b16e0 msgr2=0x5616971bb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e08911640 1 --2- 172.21.15.135:0/4273424567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b16e0 0x5616971bb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e08911640 1 -- 172.21.15.135:0/4273424567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616971b5e30 con 0x5616971b0cf0 2024-04-20T12:22:58.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e03fff640 1 --2- 172.21.15.135:0/4273424567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b16e0 0x5616971bb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:58.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9e08911640 1 --2- 172.21.15.135:0/4273424567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b0cf0 0x5616971baee0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9df800cba0 tx=0x7f9df800c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5872b6a0c49e8edd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.314+0000 7f9dee7fc640 1 -- 172.21.15.135:0/4273424567 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df802b070 con 0x5616971b0cf0 2024-04-20T12:22:58.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.315+0000 7f9dee7fc640 1 -- 172.21.15.135:0/4273424567 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9df8005520 con 0x5616971b0cf0 2024-04-20T12:22:58.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.315+0000 7f9dee7fc640 1 -- 172.21.15.135:0/4273424567 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8014050 con 0x5616971b0cf0 2024-04-20T12:22:58.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.315+0000 7f9e0d767740 1 -- 172.21.15.135:0/4273424567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b0cf0 msgr2=0x5616971baee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.315+0000 7f9e0d767740 1 --2- 172.21.15.135:0/4273424567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b0cf0 0x5616971baee0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9df800cba0 tx=0x7f9df800c570 comp rx=0 tx=0).stop 2024-04-20T12:22:58.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.315+0000 7f9e0d767740 1 -- 172.21.15.135:0/4273424567 shutdown_connections 2024-04-20T12:22:58.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.315+0000 7f9e0d767740 1 --2- 172.21.15.135:0/4273424567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b6850 0x5616971c2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.315+0000 7f9e0d767740 1 --2- 172.21.15.135:0/4273424567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b16e0 0x5616971bb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.315+0000 7f9e0d767740 1 --2- 172.21.15.135:0/4273424567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b0cf0 0x5616971baee0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.315+0000 7f9e0d767740 1 -- 172.21.15.135:0/4273424567 >> 172.21.15.135:0/4273424567 conn(0x5616971ac260 msgr2=0x5616971ac640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.315+0000 7f9e0d767740 1 -- 172.21.15.135:0/4273424567 shutdown_connections 2024-04-20T12:22:58.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.315+0000 7f9e0d767740 1 -- 172.21.15.135:0/4273424567 wait complete. 2024-04-20T12:22:58.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e0d767740 1 -- start start 2024-04-20T12:22:58.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e0d767740 1 Processor -- start 2024-04-20T12:22:58.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e0d767740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b0cf0 0x5616971c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e0d767740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b16e0 0x561697229b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e0d767740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b6850 0x56169722c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e0d767740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5616971c8e90 con 0x5616971b16e0 2024-04-20T12:22:58.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e0d767740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5616971c87c0 con 0x5616971b6850 2024-04-20T12:22:58.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e0d767740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5616971c9560 con 0x5616971b0cf0 2024-04-20T12:22:58.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e0d767740 10 client.0 _ll_register_callbacks cb 0x7f9df0005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:58.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e03fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b16e0 0x561697229b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e03fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b16e0 0x561697229b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41526/0 (socket says 172.21.15.135:41526) 2024-04-20T12:22:58.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e03fff640 1 -- 172.21.15.135:0/3724853780 learned_addr learned my addr 172.21.15.135:0/3724853780 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e08911640 1 --2- 172.21.15.135:0/3724853780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b0cf0 0x5616971c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e09112640 1 --2- 172.21.15.135:0/3724853780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b6850 0x56169722c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e03fff640 1 -- 172.21.15.135:0/3724853780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b0cf0 msgr2=0x5616971c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e03fff640 1 --2- 172.21.15.135:0/3724853780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b0cf0 0x5616971c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e03fff640 1 -- 172.21.15.135:0/3724853780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b6850 msgr2=0x56169722c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e03fff640 1 --2- 172.21.15.135:0/3724853780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b6850 0x56169722c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.316+0000 7f9e03fff640 1 -- 172.21.15.135:0/3724853780 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56169722c5c0 con 0x5616971b16e0 2024-04-20T12:22:58.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9e03fff640 1 --2- 172.21.15.135:0/3724853780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b16e0 0x561697229b30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9df002cfd0 tx=0x7f9df00f0210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b990e6facb68f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9de3fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:58.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9de3fff640 1 -- 172.21.15.135:0/3724853780 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df00d4040 con 0x5616971b16e0 2024-04-20T12:22:58.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9de3fff640 1 -- 172.21.15.135:0/3724853780 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f9df00c70b0 con 0x5616971b16e0 2024-04-20T12:22:58.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9e0d767740 1 -- 172.21.15.135:0/3724853780 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9df8005520 con 0x5616971b16e0 2024-04-20T12:22:58.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9de3fff640 1 -- 172.21.15.135:0/3724853780 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9df00a5050 con 0x5616971b16e0 2024-04-20T12:22:58.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9e0d767740 10 client.15462 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:58.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9e0d767740 1 -- 172.21.15.135:0/3724853780 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56169722d8d0 con 0x5616971b16e0 2024-04-20T12:22:58.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9de3fff640 1 -- 172.21.15.135:0/3724853780 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9df8005520 con 0x5616971b16e0 2024-04-20T12:22:58.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9de3fff640 1 -- 172.21.15.135:0/3724853780 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7f9df00bd6b0 con 0x5616971b16e0 2024-04-20T12:22:58.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9e0d767740 10 client.15462 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:58.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9e0d767740 10 client.15462 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-20T12:22:58.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9e0d767740 20 client.15462 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:58.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9e0d767740 1 --2- 172.21.15.135:0/3724853780 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5616971c7ba0 0x561697231080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9e0d767740 4 client.15462 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T12:22:58.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9e0d767740 1 -- 172.21.15.135:0/3724853780 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "status"}) -- 0x561697124530 con 0x5616971c7ba0 2024-04-20T12:22:58.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.317+0000 7f9e08911640 1 --2- 172.21.15.135:0/3724853780 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5616971c7ba0 0x561697231080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9e08911640 1 --2- 172.21.15.135:0/3724853780 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5616971c7ba0 0x561697231080 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fd4c488f41323df0 server_cookie=2e1e93ad7a692b42 in_seq=0 out_seq=0 2024-04-20T12:22:58.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9de3fff640 10 client.15462 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:22:58.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9de3fff640 1 -- 172.21.15.135:0/3724853780 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561697124530 con 0x5616971c7ba0 2024-04-20T12:22:58.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9de3fff640 10 client.15462 handle_command_reply: tid=0 2024-04-20T12:22:58.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9e0d767740 1 client.15462 shutdown 2024-04-20T12:22:58.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9e0d767740 1 -- 172.21.15.135:0/3724853780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b16e0 msgr2=0x561697229b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9e0d767740 1 --2- 172.21.15.135:0/3724853780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b16e0 0x561697229b30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9df002cfd0 tx=0x7f9df00f0210 comp rx=0 tx=0).stop 2024-04-20T12:22:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9e0d767740 1 -- 172.21.15.135:0/3724853780 shutdown_connections 2024-04-20T12:22:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9e0d767740 1 --2- 172.21.15.135:0/3724853780 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5616971c7ba0 0x561697231080 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9de3fff640 0 client.15462 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:22:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9e0d767740 1 --2- 172.21.15.135:0/3724853780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5616971b6850 0x56169722c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9e0d767740 1 --2- 172.21.15.135:0/3724853780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5616971b16e0 0x561697229b30 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9e0d767740 1 --2- 172.21.15.135:0/3724853780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5616971b0cf0 0x5616971c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9e0d767740 1 -- 172.21.15.135:0/3724853780 >> 172.21.15.135:0/3724853780 conn(0x5616971ac260 msgr2=0x5616971b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9e0d767740 1 -- 172.21.15.135:0/3724853780 shutdown_connections 2024-04-20T12:22:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9e0d767740 1 -- 172.21.15.135:0/3724853780 wait complete. 2024-04-20T12:22:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.318+0000 7f9e0d767740 20 client.15462 trim_cache size 0 max 16384 2024-04-20T12:22:58.325 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:22:58.326 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "22180be8-ff0f-11ee-bc92-c7b262605968", 2024-04-20T12:22:58.326 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 3, 2024-04-20T12:22:58.326 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24457, 2024-04-20T12:22:58.326 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-04-20T12:22:58.326 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-04-20T12:22:58.326 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-04-20T12:22:58.326 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 110.40183639599999, 2024-04-20T12:22:58.326 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 28, 2024-04-20T12:22:58.326 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 94, 2024-04-20T12:22:58.326 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 90, 2024-04-20T12:22:58.326 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 159.334460992 2024-04-20T12:22:58.326 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:22:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.319+0000 7f9e0ab75640 1 -- 172.21.15.135:0/2925894016 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9df40a3bb0 msgr2=0x7f9df40a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.319+0000 7f9e0ab75640 1 --2- 172.21.15.135:0/2925894016 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9df40a3bb0 0x7f9df40a6070 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc005c40 tx=0x7f9dfc005bd0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.319+0000 7f9e0ab75640 1 -- 172.21.15.135:0/2925894016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e04102050 msgr2=0x7f9e041034c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.319+0000 7f9e0ab75640 1 --2- 172.21.15.135:0/2925894016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e04102050 0x7f9e041034c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9df0005ab0 tx=0x7f9df002c6c0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.319+0000 7f9e0ab75640 1 -- 172.21.15.135:0/2925894016 shutdown_connections 2024-04-20T12:22:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.319+0000 7f9e0ab75640 1 --2- 172.21.15.135:0/2925894016 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f9df40a3bb0 0x7f9df40a6070 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.319+0000 7f9e0ab75640 1 --2- 172.21.15.135:0/2925894016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9e04102a10 0x7f9e04103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.319+0000 7f9e0ab75640 1 --2- 172.21.15.135:0/2925894016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9e04102050 0x7f9e041034c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.319+0000 7f9e0ab75640 1 --2- 172.21.15.135:0/2925894016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9e04100e70 0x7f9e04104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.319+0000 7f9e0ab75640 1 -- 172.21.15.135:0/2925894016 >> 172.21.15.135:0/2925894016 conn(0x7f9e040fc450 msgr2=0x7f9e040fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.319+0000 7f9e0ab75640 1 -- 172.21.15.135:0/2925894016 shutdown_connections 2024-04-20T12:22:58.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.319+0000 7f9e0ab75640 1 -- 172.21.15.135:0/2925894016 wait complete. 2024-04-20T12:22:58.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:57 smithi139 ceph-mon[21834]: pgmap v364: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-04-20T12:22:58.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:57 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1806363499' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:22:58.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:57 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1649220185' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:22:58.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:57 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/4062076265' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:22:58.331 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-20T12:22:58.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.430+0000 7f448e67b640 1 -- 172.21.15.135:0/2383700010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4488103b60 msgr2=0x7f448810a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.430+0000 7f448e67b640 1 --2- 172.21.15.135:0/2383700010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4488103b60 0x7f448810a3f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4480009ca0 tx=0x7f448002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.430+0000 7f448e67b640 1 -- 172.21.15.135:0/2383700010 shutdown_connections 2024-04-20T12:22:58.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.430+0000 7f448e67b640 1 --2- 172.21.15.135:0/2383700010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4488103b60 0x7f448810a3f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.430+0000 7f448e67b640 1 --2- 172.21.15.135:0/2383700010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44881031a0 0x7f4488103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.430+0000 7f448e67b640 1 --2- 172.21.15.135:0/2383700010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4488101fb0 0x7f44881023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.430+0000 7f448e67b640 1 -- 172.21.15.135:0/2383700010 >> 172.21.15.135:0/2383700010 conn(0x7f44880fd540 msgr2=0x7f44880ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.430+0000 7f448e67b640 1 -- 172.21.15.135:0/2383700010 shutdown_connections 2024-04-20T12:22:58.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.430+0000 7f448e67b640 1 -- 172.21.15.135:0/2383700010 wait complete. 2024-04-20T12:22:58.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f448e67b640 1 Processor -- start 2024-04-20T12:22:58.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f448e67b640 1 -- start start 2024-04-20T12:22:58.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f448e67b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4488101fb0 0x7f4488198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f448e67b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44881031a0 0x7f44881987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f448e67b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4488103b60 0x7f448819f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f448e67b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f448810dc40 con 0x7f4488101fb0 2024-04-20T12:22:58.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f448e67b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f448810dac0 con 0x7f4488103b60 2024-04-20T12:22:58.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f448e67b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f448810ddc0 con 0x7f44881031a0 2024-04-20T12:22:58.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f4487fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4488101fb0 0x7f4488198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f4487fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4488101fb0 0x7f4488198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41546/0 (socket says 172.21.15.135:41546) 2024-04-20T12:22:58.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f4487fff640 1 -- 172.21.15.135:0/3304380331 learned_addr learned my addr 172.21.15.135:0/3304380331 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f44877fe640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44881031a0 0x7f44881987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f448cc18640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4488103b60 0x7f448819f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f4487fff640 1 -- 172.21.15.135:0/3304380331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44881031a0 msgr2=0x7f44881987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f4487fff640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44881031a0 0x7f44881987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f4487fff640 1 -- 172.21.15.135:0/3304380331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4488103b60 msgr2=0x7f448819f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f4487fff640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4488103b60 0x7f448819f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f4487fff640 1 -- 172.21.15.135:0/3304380331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448819fe90 con 0x7f4488101fb0 2024-04-20T12:22:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f448cc18640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4488103b60 0x7f448819f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.431+0000 7f44877fe640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44881031a0 0x7f44881987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.432+0000 7f4487fff640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4488101fb0 0x7f4488198270 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f447c00d950 tx=0x7f447c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.432+0000 7f44857fa640 1 -- 172.21.15.135:0/3304380331 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c017070 con 0x7f4488101fb0 2024-04-20T12:22:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.432+0000 7f448e67b640 1 -- 172.21.15.135:0/3304380331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44881a0180 con 0x7f4488101fb0 2024-04-20T12:22:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.432+0000 7f44857fa640 1 -- 172.21.15.135:0/3304380331 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f447c009c30 con 0x7f4488101fb0 2024-04-20T12:22:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.432+0000 7f44857fa640 1 -- 172.21.15.135:0/3304380331 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c00f600 con 0x7f4488101fb0 2024-04-20T12:22:58.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.432+0000 7f448e67b640 1 -- 172.21.15.135:0/3304380331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44881a06d0 con 0x7f4488101fb0 2024-04-20T12:22:58.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.434+0000 7f44857fa640 1 -- 172.21.15.135:0/3304380331 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f447c01a070 con 0x7f4488101fb0 2024-04-20T12:22:58.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.434+0000 7f4491272740 1 Processor -- start 2024-04-20T12:22:58.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.434+0000 7f4491272740 1 -- start start 2024-04-20T12:22:58.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.434+0000 7f4491272740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe84cf0 0x562b9fe85110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.434+0000 7f4491272740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe856e0 0x562b9fe8a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.434+0000 7f4491272740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe8a850 0x562b9fe8cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.434+0000 7f44857fa640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f44700a3bb0 0x7f44700a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.434+0000 7f4491272740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562b9fd98290 con 0x562b9fe856e0 2024-04-20T12:22:58.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.434+0000 7f4491272740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562b9fdf5a40 con 0x562b9fe84cf0 2024-04-20T12:22:58.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.434+0000 7f4491272740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562b9fdb0a30 con 0x562b9fe8a850 2024-04-20T12:22:58.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.434+0000 7f4487fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe856e0 0x562b9fe8a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.434+0000 7f448cc18640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f44700a3bb0 0x7f44700a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.434+0000 7f4487fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe856e0 0x562b9fe8a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41556/0 (socket says 172.21.15.135:41556) 2024-04-20T12:22:58.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.434+0000 7f4487fff640 1 -- 172.21.15.135:0/2690043520 learned_addr learned my addr 172.21.15.135:0/2690043520 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.435+0000 7f448cc18640 1 --2- 172.21.15.135:0/2690043520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe84cf0 0x562b9fe85110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.435+0000 7f44857fa640 1 -- 172.21.15.135:0/3304380331 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f447c0d02d0 con 0x7f4488101fb0 2024-04-20T12:22:58.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.435+0000 7f44877fe640 1 --2- 172.21.15.135:0/2690043520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe8a850 0x562b9fe8cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.435+0000 7f4487fff640 1 -- 172.21.15.135:0/2690043520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe8a850 msgr2=0x562b9fe8cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.435+0000 7f4487fff640 1 --2- 172.21.15.135:0/2690043520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe8a850 0x562b9fe8cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.435+0000 7f4487fff640 1 -- 172.21.15.135:0/2690043520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe84cf0 msgr2=0x562b9fe85110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.435+0000 7f4487fff640 1 --2- 172.21.15.135:0/2690043520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe84cf0 0x562b9fe85110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.435+0000 7f4487fff640 1 -- 172.21.15.135:0/2690043520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b9fda3c10 con 0x562b9fe856e0 2024-04-20T12:22:58.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.435+0000 7f44877fe640 1 --2- 172.21.15.135:0/2690043520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe8a850 0x562b9fe8cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:58.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.435+0000 7f4487fff640 1 --2- 172.21.15.135:0/2690043520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe856e0 0x562b9fe8a1e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f447c06ed20 tx=0x7f447c06ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c568133751ee0de0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.435+0000 7f448cc18640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f44700a3bb0 0x7f44700a6070 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x562b9fe85f40 tx=0x7f4480005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.435+0000 7f446e7fc640 1 -- 172.21.15.135:0/2690043520 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c021070 con 0x562b9fe856e0 2024-04-20T12:22:58.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.435+0000 7f446e7fc640 1 -- 172.21.15.135:0/2690043520 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f447c009de0 con 0x562b9fe856e0 2024-04-20T12:22:58.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.435+0000 7f446e7fc640 1 -- 172.21.15.135:0/2690043520 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c0c4350 con 0x562b9fe856e0 2024-04-20T12:22:58.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.436+0000 7f4491272740 1 -- 172.21.15.135:0/2690043520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe856e0 msgr2=0x562b9fe8a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.436+0000 7f4491272740 1 --2- 172.21.15.135:0/2690043520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe856e0 0x562b9fe8a1e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f447c06ed20 tx=0x7f447c06ed50 comp rx=0 tx=0).stop 2024-04-20T12:22:58.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.436+0000 7f4491272740 1 -- 172.21.15.135:0/2690043520 shutdown_connections 2024-04-20T12:22:58.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.436+0000 7f4491272740 1 --2- 172.21.15.135:0/2690043520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe8a850 0x562b9fe8cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.436+0000 7f4491272740 1 --2- 172.21.15.135:0/2690043520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe856e0 0x562b9fe8a1e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.436+0000 7f4491272740 1 --2- 172.21.15.135:0/2690043520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe84cf0 0x562b9fe85110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.436+0000 7f4491272740 1 -- 172.21.15.135:0/2690043520 >> 172.21.15.135:0/2690043520 conn(0x562b9fe80260 msgr2=0x562b9fe80660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.436+0000 7f4491272740 1 -- 172.21.15.135:0/2690043520 shutdown_connections 2024-04-20T12:22:58.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.436+0000 7f4491272740 1 -- 172.21.15.135:0/2690043520 wait complete. 2024-04-20T12:22:58.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.436+0000 7f4491272740 1 -- start start 2024-04-20T12:22:58.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.436+0000 7f4491272740 1 Processor -- start 2024-04-20T12:22:58.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f4491272740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe84cf0 0x562b9fe8ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f4491272740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe856e0 0x562b9fe8f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f4491272740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe8a850 0x562b9fe964e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f4491272740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562b9fdef140 con 0x562b9fe8a850 2024-04-20T12:22:58.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f4491272740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562b9fde9e20 con 0x562b9fe84cf0 2024-04-20T12:22:58.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f4491272740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562b9fdf7d20 con 0x562b9fe856e0 2024-04-20T12:22:58.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f4491272740 10 client.0 _ll_register_callbacks cb 0x562b9fde05c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:58.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f448cc18640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe8a850 0x562b9fe964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f448cc18640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe8a850 0x562b9fe964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41566/0 (socket says 172.21.15.135:41566) 2024-04-20T12:22:58.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f448cc18640 1 -- 172.21.15.135:0/149866009 learned_addr learned my addr 172.21.15.135:0/149866009 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f4487fff640 1 --2- 172.21.15.135:0/149866009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe84cf0 0x562b9fe8ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f44877fe640 1 --2- 172.21.15.135:0/149866009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe856e0 0x562b9fe8f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f448cc18640 1 -- 172.21.15.135:0/149866009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe856e0 msgr2=0x562b9fe8f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f448cc18640 1 --2- 172.21.15.135:0/149866009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe856e0 0x562b9fe8f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f448cc18640 1 -- 172.21.15.135:0/149866009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe84cf0 msgr2=0x562b9fe8ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f448cc18640 1 --2- 172.21.15.135:0/149866009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe84cf0 0x562b9fe8ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f448cc18640 1 -- 172.21.15.135:0/149866009 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b9fafd2d0 con 0x562b9fe8a850 2024-04-20T12:22:58.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f448cc18640 1 --2- 172.21.15.135:0/149866009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe8a850 0x562b9fe964e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4480036000 tx=0x7f448002c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1475ac46212bf4df server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f44677fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:58.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f44677fe640 1 -- 172.21.15.135:0/149866009 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4480051020 con 0x562b9fe8a850 2024-04-20T12:22:58.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f44677fe640 1 -- 172.21.15.135:0/149866009 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f44800045c0 con 0x562b9fe8a850 2024-04-20T12:22:58.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f4491272740 1 -- 172.21.15.135:0/149866009 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f447c009de0 con 0x562b9fe8a850 2024-04-20T12:22:58.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f44677fe640 1 -- 172.21.15.135:0/149866009 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4480049040 con 0x562b9fe8a850 2024-04-20T12:22:58.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.437+0000 7f4491272740 10 client.15474 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:58.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.438+0000 7f4491272740 1 -- 172.21.15.135:0/149866009 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562b9fbc76b0 con 0x562b9fe8a850 2024-04-20T12:22:58.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.438+0000 7f44677fe640 1 -- 172.21.15.135:0/149866009 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f447c009de0 con 0x562b9fe8a850 2024-04-20T12:22:58.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.438+0000 7f44677fe640 1 -- 172.21.15.135:0/149866009 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7f448004c030 con 0x562b9fe8a850 2024-04-20T12:22:58.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.438+0000 7f4491272740 10 client.15474 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:58.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.438+0000 7f4491272740 10 client.15474 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-20T12:22:58.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.438+0000 7f4491272740 20 client.15474 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:58.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.438+0000 7f4491272740 1 --2- 172.21.15.135:0/149866009 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x562b9fe9bcf0 0x562b9fe9d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.438+0000 7f4491272740 4 client.15474 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:22:58.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.438+0000 7f4491272740 1 -- 172.21.15.135:0/149866009 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b9fd71510 con 0x562b9fe9bcf0 2024-04-20T12:22:58.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.438+0000 7f4487fff640 1 --2- 172.21.15.135:0/149866009 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x562b9fe9bcf0 0x562b9fe9d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.439+0000 7f44677fe640 10 client.15474 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:22:58.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.439+0000 7f4487fff640 1 --2- 172.21.15.135:0/149866009 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x562b9fe9bcf0 0x562b9fe9d160 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c8517559969c1656 server_cookie=62513713faaad4e0 in_seq=0 out_seq=0 2024-04-20T12:22:58.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.439+0000 7f44677fe640 1 -- 172.21.15.135:0/149866009 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562b9fd71510 con 0x562b9fe9bcf0 2024-04-20T12:22:58.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.439+0000 7f44677fe640 10 client.15474 handle_command_reply: tid=0 2024-04-20T12:22:58.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.439+0000 7f4491272740 1 client.15474 shutdown 2024-04-20T12:22:58.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.439+0000 7f4491272740 1 -- 172.21.15.135:0/149866009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe8a850 msgr2=0x562b9fe964e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.439+0000 7f4491272740 1 --2- 172.21.15.135:0/149866009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe8a850 0x562b9fe964e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4480036000 tx=0x7f448002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.440+0000 7f4491272740 1 -- 172.21.15.135:0/149866009 shutdown_connections 2024-04-20T12:22:58.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.440+0000 7f4491272740 1 --2- 172.21.15.135:0/149866009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe8a850 0x562b9fe964e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.440+0000 7f4491272740 1 --2- 172.21.15.135:0/149866009 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x562b9fe9bcf0 0x562b9fe9d160 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.440+0000 7f4491272740 1 --2- 172.21.15.135:0/149866009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe856e0 0x562b9fe8f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.440+0000 7f4491272740 1 --2- 172.21.15.135:0/149866009 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe84cf0 0x562b9fe8ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.440+0000 7f44677fe640 0 client.15474 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:22:58.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.440+0000 7f4491272740 1 -- 172.21.15.135:0/149866009 >> 172.21.15.135:0/149866009 conn(0x562b9fe80260 msgr2=0x562b9fe7f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.440+0000 7f4491272740 1 -- 172.21.15.135:0/149866009 shutdown_connections 2024-04-20T12:22:58.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.440+0000 7f4491272740 1 -- 172.21.15.135:0/149866009 wait complete. 2024-04-20T12:22:58.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.440+0000 7f4491272740 20 client.15474 trim_cache size 0 max 16384 2024-04-20T12:22:58.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f4491272740 1 Processor -- start 2024-04-20T12:22:58.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f4491272740 1 -- start start 2024-04-20T12:22:58.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f4491272740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe84cf0 0x562b9fe8da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f4491272740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe856e0 0x562b9fe80640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f4491272740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe8a850 0x562b9fe86c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f4491272740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562b9fe9b4a0 con 0x562b9fe856e0 2024-04-20T12:22:58.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f4491272740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562b9fe9bb70 con 0x562b9fe8a850 2024-04-20T12:22:58.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f4491272740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562b9fe9c240 con 0x562b9fe84cf0 2024-04-20T12:22:58.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f44877fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe856e0 0x562b9fe80640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f44877fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe856e0 0x562b9fe80640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41576/0 (socket says 172.21.15.135:41576) 2024-04-20T12:22:58.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f44877fe640 1 -- 172.21.15.135:0/560328803 learned_addr learned my addr 172.21.15.135:0/560328803 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f448cc18640 1 --2- 172.21.15.135:0/560328803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe8a850 0x562b9fe86c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f44877fe640 1 -- 172.21.15.135:0/560328803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe84cf0 msgr2=0x562b9fe8da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f44877fe640 1 --2- 172.21.15.135:0/560328803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe84cf0 0x562b9fe8da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f44877fe640 1 -- 172.21.15.135:0/560328803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe8a850 msgr2=0x562b9fe86c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f44877fe640 1 --2- 172.21.15.135:0/560328803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe8a850 0x562b9fe86c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f44877fe640 1 -- 172.21.15.135:0/560328803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b9fe85ac0 con 0x562b9fe856e0 2024-04-20T12:22:58.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f44877fe640 1 --2- 172.21.15.135:0/560328803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe856e0 0x562b9fe80640 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4478009b60 tx=0x7f44780137d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22b34959c697e41 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f446dffb640 1 -- 172.21.15.135:0/560328803 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478009e50 con 0x562b9fe856e0 2024-04-20T12:22:58.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f446dffb640 1 -- 172.21.15.135:0/560328803 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44780035f0 con 0x562b9fe856e0 2024-04-20T12:22:58.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.458+0000 7f446dffb640 1 -- 172.21.15.135:0/560328803 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447801c6c0 con 0x562b9fe856e0 2024-04-20T12:22:58.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.459+0000 7f4491272740 1 -- 172.21.15.135:0/560328803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe856e0 msgr2=0x562b9fe80640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.459+0000 7f4491272740 1 --2- 172.21.15.135:0/560328803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe856e0 0x562b9fe80640 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4478009b60 tx=0x7f44780137d0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.459+0000 7f4491272740 1 -- 172.21.15.135:0/560328803 shutdown_connections 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.459+0000 7f4491272740 1 --2- 172.21.15.135:0/560328803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe8a850 0x562b9fe86c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.459+0000 7f4491272740 1 --2- 172.21.15.135:0/560328803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe856e0 0x562b9fe80640 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.459+0000 7f4491272740 1 --2- 172.21.15.135:0/560328803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe84cf0 0x562b9fe8da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.459+0000 7f4491272740 1 -- 172.21.15.135:0/560328803 >> 172.21.15.135:0/560328803 conn(0x562b9fe80260 msgr2=0x562b9fe86180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.459+0000 7f4491272740 1 -- 172.21.15.135:0/560328803 shutdown_connections 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.459+0000 7f4491272740 1 -- 172.21.15.135:0/560328803 wait complete. 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.459+0000 7f4491272740 1 -- start start 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.459+0000 7f4491272740 1 Processor -- start 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4491272740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe84cf0 0x562b9feffc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4491272740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe856e0 0x562b9ff021e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4491272740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe8a850 0x562b9ff04730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4491272740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562b9fe9cfe0 con 0x562b9fe84cf0 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4491272740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562b9fe9c910 con 0x562b9fe856e0 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4491272740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562b9fe9d6b0 con 0x562b9fe8a850 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4491272740 10 client.0 _ll_register_callbacks cb 0x7f4478005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:58.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4487fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe84cf0 0x562b9feffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4487fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe84cf0 0x562b9feffc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41578/0 (socket says 172.21.15.135:41578) 2024-04-20T12:22:58.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4487fff640 1 -- 172.21.15.135:0/2512382097 learned_addr learned my addr 172.21.15.135:0/2512382097 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f44877fe640 1 --2- 172.21.15.135:0/2512382097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe856e0 0x562b9ff021e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f448cc18640 1 --2- 172.21.15.135:0/2512382097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe8a850 0x562b9ff04730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4487fff640 1 -- 172.21.15.135:0/2512382097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe8a850 msgr2=0x562b9ff04730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4487fff640 1 --2- 172.21.15.135:0/2512382097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe8a850 0x562b9ff04730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4487fff640 1 -- 172.21.15.135:0/2512382097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe856e0 msgr2=0x562b9ff021e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4487fff640 1 --2- 172.21.15.135:0/2512382097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe856e0 0x562b9ff021e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4487fff640 1 -- 172.21.15.135:0/2512382097 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b9ff04c70 con 0x562b9fe84cf0 2024-04-20T12:22:58.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f448cc18640 1 --2- 172.21.15.135:0/2512382097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe8a850 0x562b9ff04730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:58.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4487fff640 1 --2- 172.21.15.135:0/2512382097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe84cf0 0x562b9feffc90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f447c09c1a0 tx=0x7f447c010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa9b6af7f8e1324 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f44677fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:58.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f44677fe640 1 -- 172.21.15.135:0/2512382097 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c021040 con 0x562b9fe84cf0 2024-04-20T12:22:58.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f44677fe640 1 -- 172.21.15.135:0/2512382097 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f447c09a510 con 0x562b9fe84cf0 2024-04-20T12:22:58.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.460+0000 7f4491272740 1 -- 172.21.15.135:0/2512382097 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44780035f0 con 0x562b9fe84cf0 2024-04-20T12:22:58.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.461+0000 7f44677fe640 1 -- 172.21.15.135:0/2512382097 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f447c005ab0 con 0x562b9fe84cf0 2024-04-20T12:22:58.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.461+0000 7f4491272740 10 client.15480 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:58.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.461+0000 7f4491272740 1 -- 172.21.15.135:0/2512382097 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562b9ff05f70 con 0x562b9fe84cf0 2024-04-20T12:22:58.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.461+0000 7f44677fe640 1 -- 172.21.15.135:0/2512382097 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44780035f0 con 0x562b9fe84cf0 2024-04-20T12:22:58.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.461+0000 7f44677fe640 1 -- 172.21.15.135:0/2512382097 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7f447c098880 con 0x562b9fe84cf0 2024-04-20T12:22:58.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.461+0000 7f4491272740 10 client.15480 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:58.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.461+0000 7f4491272740 10 client.15480 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-20T12:22:58.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.461+0000 7f4491272740 20 client.15480 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:58.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.461+0000 7f4491272740 1 --2- 172.21.15.135:0/2512382097 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x562b9ff0a720 0x562b9ff09430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.461+0000 7f4491272740 4 client.15480 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T12:22:58.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.461+0000 7f4491272740 1 -- 172.21.15.135:0/2512382097 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "status"}) -- 0x562b9fdf8530 con 0x562b9ff0a720 2024-04-20T12:22:58.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.461+0000 7f44877fe640 1 --2- 172.21.15.135:0/2512382097 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x562b9ff0a720 0x562b9ff09430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f44677fe640 10 client.15480 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:22:58.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f44877fe640 1 --2- 172.21.15.135:0/2512382097 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x562b9ff0a720 0x562b9ff09430 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a13582877b45c438 server_cookie=f54ee434c798e415 in_seq=0 out_seq=0 2024-04-20T12:22:58.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f44677fe640 1 -- 172.21.15.135:0/2512382097 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562b9fdf8530 con 0x562b9ff0a720 2024-04-20T12:22:58.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f44677fe640 10 client.15480 handle_command_reply: tid=0 2024-04-20T12:22:58.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f4491272740 1 client.15480 shutdown 2024-04-20T12:22:58.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f4491272740 1 -- 172.21.15.135:0/2512382097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe84cf0 msgr2=0x562b9feffc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f4491272740 1 --2- 172.21.15.135:0/2512382097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe84cf0 0x562b9feffc90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f447c09c1a0 tx=0x7f447c010ce0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f4491272740 1 -- 172.21.15.135:0/2512382097 shutdown_connections 2024-04-20T12:22:58.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f4491272740 1 --2- 172.21.15.135:0/2512382097 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x562b9ff0a720 0x562b9ff09430 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f4491272740 1 --2- 172.21.15.135:0/2512382097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562b9fe8a850 0x562b9ff04730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f44677fe640 0 client.15480 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:22:58.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f4491272740 1 --2- 172.21.15.135:0/2512382097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562b9fe856e0 0x562b9ff021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f4491272740 1 --2- 172.21.15.135:0/2512382097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562b9fe84cf0 0x562b9feffc90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f4491272740 1 -- 172.21.15.135:0/2512382097 >> 172.21.15.135:0/2512382097 conn(0x562b9fe80260 msgr2=0x562b9fe8da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f4491272740 1 -- 172.21.15.135:0/2512382097 shutdown_connections 2024-04-20T12:22:58.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f4491272740 1 -- 172.21.15.135:0/2512382097 wait complete. 2024-04-20T12:22:58.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.462+0000 7f4491272740 20 client.15480 trim_cache size 0 max 16384 2024-04-20T12:22:58.469 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:22:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "22180be8-ff0f-11ee-bc92-c7b262605968", 2024-04-20T12:22:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 2, 2024-04-20T12:22:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24475, 2024-04-20T12:22:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-04-20T12:22:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-04-20T12:22:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-04-20T12:22:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 111.550407358, 2024-04-20T12:22:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 28, 2024-04-20T12:22:58.469 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 94, 2024-04-20T12:22:58.470 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 90, 2024-04-20T12:22:58.470 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 156.58749683600001 2024-04-20T12:22:58.470 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:22:58.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.463+0000 7f448e67b640 1 -- 172.21.15.135:0/3304380331 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f44700a3bb0 msgr2=0x7f44700a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.463+0000 7f448e67b640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f44700a3bb0 0x7f44700a6070 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x562b9fe85f40 tx=0x7f4480005da0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.463+0000 7f448e67b640 1 -- 172.21.15.135:0/3304380331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4488101fb0 msgr2=0x7f4488198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.463+0000 7f448e67b640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4488101fb0 0x7f4488198270 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f447c00d950 tx=0x7f447c00de10 comp rx=0 tx=0).stop 2024-04-20T12:22:58.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.463+0000 7f448e67b640 1 -- 172.21.15.135:0/3304380331 shutdown_connections 2024-04-20T12:22:58.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.463+0000 7f448e67b640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f44700a3bb0 0x7f44700a6070 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.463+0000 7f448e67b640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4488103b60 0x7f448819f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.463+0000 7f448e67b640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44881031a0 0x7f44881987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.463+0000 7f448e67b640 1 --2- 172.21.15.135:0/3304380331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4488101fb0 0x7f4488198270 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.463+0000 7f448e67b640 1 -- 172.21.15.135:0/3304380331 >> 172.21.15.135:0/3304380331 conn(0x7f44880fd540 msgr2=0x7f44881064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.463+0000 7f448e67b640 1 -- 172.21.15.135:0/3304380331 shutdown_connections 2024-04-20T12:22:58.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.463+0000 7f448e67b640 1 -- 172.21.15.135:0/3304380331 wait complete. 2024-04-20T12:22:58.473 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-20T12:22:58.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.572+0000 7f5ba0b9d640 1 -- 172.21.15.135:0/1242456674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b9c100e70 msgr2=0x7f5b9c101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.572+0000 7f5ba0b9d640 1 --2- 172.21.15.135:0/1242456674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b9c100e70 0x7f5b9c101290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009900 tx=0x7f5b8c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:58.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.572+0000 7f5ba0b9d640 1 -- 172.21.15.135:0/1242456674 shutdown_connections 2024-04-20T12:22:58.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.572+0000 7f5ba0b9d640 1 --2- 172.21.15.135:0/1242456674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b9c102a10 0x7f5b9c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.572+0000 7f5ba0b9d640 1 --2- 172.21.15.135:0/1242456674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b9c102050 0x7f5b9c1024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.572+0000 7f5ba0b9d640 1 --2- 172.21.15.135:0/1242456674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b9c100e70 0x7f5b9c101290 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.572+0000 7f5ba0b9d640 1 -- 172.21.15.135:0/1242456674 >> 172.21.15.135:0/1242456674 conn(0x7f5b9c0fc430 msgr2=0x7f5b9c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.572+0000 7f5ba0b9d640 1 -- 172.21.15.135:0/1242456674 shutdown_connections 2024-04-20T12:22:58.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.572+0000 7f5ba0b9d640 1 -- 172.21.15.135:0/1242456674 wait complete. 2024-04-20T12:22:58.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5ba0b9d640 1 Processor -- start 2024-04-20T12:22:58.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5ba0b9d640 1 -- start start 2024-04-20T12:22:58.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5ba0b9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b9c100e70 0x7f5b9c1971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5ba0b9d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b9c102050 0x7f5b9c197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5ba0b9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b9c102a10 0x7f5b9c19e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5ba0b9d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c10cb50 con 0x7f5b9c100e70 2024-04-20T12:22:58.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5ba0b9d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c10c9d0 con 0x7f5b9c102a10 2024-04-20T12:22:58.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5ba0b9d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c10ccd0 con 0x7f5b9c102050 2024-04-20T12:22:58.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5b9a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b9c100e70 0x7f5b9c1971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5b9a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b9c100e70 0x7f5b9c1971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41604/0 (socket says 172.21.15.135:41604) 2024-04-20T12:22:58.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5b9a59c640 1 -- 172.21.15.135:0/1965132533 learned_addr learned my addr 172.21.15.135:0/1965132533 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5b99d9b640 1 --2- 172.21.15.135:0/1965132533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b9c102050 0x7f5b9c197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5b9a59c640 1 -- 172.21.15.135:0/1965132533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b9c102050 msgr2=0x7f5b9c197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5b9a59c640 1 --2- 172.21.15.135:0/1965132533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b9c102050 0x7f5b9c197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5b9a59c640 1 -- 172.21.15.135:0/1965132533 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b9c102a10 msgr2=0x7f5b9c19e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5b9a59c640 1 --2- 172.21.15.135:0/1965132533 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b9c102a10 0x7f5b9c19e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5b9a59c640 1 -- 172.21.15.135:0/1965132533 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9c06a560 con 0x7f5b9c100e70 2024-04-20T12:22:58.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.573+0000 7f5b99d9b640 1 --2- 172.21.15.135:0/1965132533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b9c102050 0x7f5b9c197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:58.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.574+0000 7f5b9a59c640 1 --2- 172.21.15.135:0/1965132533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b9c100e70 0x7f5b9c1971f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c005ab0 tx=0x7f5b8c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.574+0000 7f5b8b7fe640 1 -- 172.21.15.135:0/1965132533 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c041070 con 0x7f5b9c100e70 2024-04-20T12:22:58.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.574+0000 7f5ba0b9d640 1 -- 172.21.15.135:0/1965132533 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9c06a7f0 con 0x7f5b9c100e70 2024-04-20T12:22:58.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.574+0000 7f5b8b7fe640 1 -- 172.21.15.135:0/1965132533 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b8c0054e0 con 0x7f5b9c100e70 2024-04-20T12:22:58.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.574+0000 7f5b8b7fe640 1 -- 172.21.15.135:0/1965132533 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c034440 con 0x7f5b9c100e70 2024-04-20T12:22:58.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.574+0000 7f5ba0b9d640 1 -- 172.21.15.135:0/1965132533 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9c06ad30 con 0x7f5b9c100e70 2024-04-20T12:22:58.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.576+0000 7f5b8b7fe640 1 -- 172.21.15.135:0/1965132533 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f5b8c044070 con 0x7f5b9c100e70 2024-04-20T12:22:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.576+0000 7f5ba378e740 1 Processor -- start 2024-04-20T12:22:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.576+0000 7f5b8b7fe640 1 --2- 172.21.15.135:0/1965132533 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5b840a3bb0 0x7f5b840a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5b8b7fe640 1 -- 172.21.15.135:0/1965132533 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f5b8c0f24a0 con 0x7f5b9c100e70 2024-04-20T12:22:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5b9ad9d640 1 --2- 172.21.15.135:0/1965132533 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5b840a3bb0 0x7f5b840a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5ba378e740 1 -- start start 2024-04-20T12:22:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5ba378e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564254437cf0 0x564254438110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5ba378e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642544386e0 0x56425443d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5ba378e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56425443d850 0x56425443fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5ba378e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56425434b290 con 0x56425443d850 2024-04-20T12:22:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5ba378e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5642543a8a40 con 0x564254437cf0 2024-04-20T12:22:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5ba378e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564254363a30 con 0x5642544386e0 2024-04-20T12:22:58.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5b9ad9d640 1 --2- 172.21.15.135:0/1965132533 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5b840a3bb0 0x7f5b840a6070 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5b94005fd0 tx=0x7f5b94009710 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5b9ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56425443d850 0x56425443fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5b9ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56425443d850 0x56425443fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41608/0 (socket says 172.21.15.135:41608) 2024-04-20T12:22:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5b9ad9d640 1 -- 172.21.15.135:0/4113789758 learned_addr learned my addr 172.21.15.135:0/4113789758 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5b99d9b640 1 --2- 172.21.15.135:0/4113789758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642544386e0 0x56425443d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5b9a59c640 1 --2- 172.21.15.135:0/4113789758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564254437cf0 0x564254438110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5b9ad9d640 1 -- 172.21.15.135:0/4113789758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642544386e0 msgr2=0x56425443d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5b9ad9d640 1 --2- 172.21.15.135:0/4113789758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642544386e0 0x56425443d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5b9ad9d640 1 -- 172.21.15.135:0/4113789758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564254437cf0 msgr2=0x564254438110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5b9ad9d640 1 --2- 172.21.15.135:0/4113789758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564254437cf0 0x564254438110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5b9ad9d640 1 -- 172.21.15.135:0/4113789758 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564254356c10 con 0x56425443d850 2024-04-20T12:22:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5b9a59c640 1 --2- 172.21.15.135:0/4113789758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564254437cf0 0x564254438110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.577+0000 7f5b9ad9d640 1 --2- 172.21.15.135:0/4113789758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56425443d850 0x56425443fce0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5b940114a0 tx=0x7f5b94011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921c670344eef2ee server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.578+0000 7f5b88ff9640 1 -- 172.21.15.135:0/4113789758 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9401e640 con 0x56425443d850 2024-04-20T12:22:58.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.578+0000 7f5b88ff9640 1 -- 172.21.15.135:0/4113789758 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b94023070 con 0x56425443d850 2024-04-20T12:22:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.578+0000 7f5b88ff9640 1 -- 172.21.15.135:0/4113789758 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94010c80 con 0x56425443d850 2024-04-20T12:22:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.578+0000 7f5ba378e740 1 -- 172.21.15.135:0/4113789758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56425443d850 msgr2=0x56425443fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.578+0000 7f5ba378e740 1 --2- 172.21.15.135:0/4113789758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56425443d850 0x56425443fce0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5b940114a0 tx=0x7f5b94011000 comp rx=0 tx=0).stop 2024-04-20T12:22:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.578+0000 7f5ba378e740 1 -- 172.21.15.135:0/4113789758 shutdown_connections 2024-04-20T12:22:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.578+0000 7f5ba378e740 1 --2- 172.21.15.135:0/4113789758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56425443d850 0x56425443fce0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.578+0000 7f5ba378e740 1 --2- 172.21.15.135:0/4113789758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642544386e0 0x56425443d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.578+0000 7f5ba378e740 1 --2- 172.21.15.135:0/4113789758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564254437cf0 0x564254438110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.578+0000 7f5ba378e740 1 -- 172.21.15.135:0/4113789758 >> 172.21.15.135:0/4113789758 conn(0x564254433260 msgr2=0x564254433660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5ba378e740 1 -- 172.21.15.135:0/4113789758 shutdown_connections 2024-04-20T12:22:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5ba378e740 1 -- 172.21.15.135:0/4113789758 wait complete. 2024-04-20T12:22:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5ba378e740 1 -- start start 2024-04-20T12:22:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5ba378e740 1 Processor -- start 2024-04-20T12:22:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5ba378e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564254437cf0 0x564254441e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5ba378e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642544386e0 0x564254442380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5ba378e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56425443d850 0x5642544493c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5ba378e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5642543a2140 con 0x5642544386e0 2024-04-20T12:22:58.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5ba378e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56425439ce20 con 0x564254437cf0 2024-04-20T12:22:58.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5ba378e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5642543aad20 con 0x56425443d850 2024-04-20T12:22:58.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5ba378e740 10 client.0 _ll_register_callbacks cb 0x5642543935c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:58.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5b99d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642544386e0 0x564254442380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5b99d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642544386e0 0x564254442380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41620/0 (socket says 172.21.15.135:41620) 2024-04-20T12:22:58.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5b99d9b640 1 -- 172.21.15.135:0/2726019626 learned_addr learned my addr 172.21.15.135:0/2726019626 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5b99d9b640 1 -- 172.21.15.135:0/2726019626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56425443d850 msgr2=0x5642544493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5b99d9b640 1 --2- 172.21.15.135:0/2726019626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56425443d850 0x5642544493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5b99d9b640 1 -- 172.21.15.135:0/2726019626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564254437cf0 msgr2=0x564254441e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5b99d9b640 1 --2- 172.21.15.135:0/2726019626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564254437cf0 0x564254441e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.579+0000 7f5b99d9b640 1 -- 172.21.15.135:0/2726019626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642540b02d0 con 0x5642544386e0 2024-04-20T12:22:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5b99d9b640 1 --2- 172.21.15.135:0/2726019626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642544386e0 0x564254442380 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009fb0 tx=0x7f5b90011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f891d1a97874289a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5b81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5b81ffb640 1 -- 172.21.15.135:0/2726019626 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90012920 con 0x5642544386e0 2024-04-20T12:22:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5b81ffb640 1 -- 172.21.15.135:0/2726019626 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f5b90012ac0 con 0x5642544386e0 2024-04-20T12:22:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5ba378e740 1 -- 172.21.15.135:0/2726019626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b94023070 con 0x5642544386e0 2024-04-20T12:22:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5b81ffb640 1 -- 172.21.15.135:0/2726019626 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b90025050 con 0x5642544386e0 2024-04-20T12:22:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5ba378e740 10 client.15492 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5ba378e740 1 -- 172.21.15.135:0/2726019626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56425417a6b0 con 0x5642544386e0 2024-04-20T12:22:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5b81ffb640 1 -- 172.21.15.135:0/2726019626 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b94023070 con 0x5642544386e0 2024-04-20T12:22:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5b81ffb640 1 -- 172.21.15.135:0/2726019626 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7f5b9000f040 con 0x5642544386e0 2024-04-20T12:22:58.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5ba378e740 10 client.15492 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5ba378e740 10 client.15492 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-20T12:22:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5ba378e740 20 client.15492 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5ba378e740 1 --2- 172.21.15.135:0/2726019626 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56425444ec90 0x564254450100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5ba378e740 4 client.15492 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:22:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.580+0000 7f5ba378e740 1 -- 172.21.15.135:0/2726019626 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564254324510 con 0x56425444ec90 2024-04-20T12:22:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.581+0000 7f5b9a59c640 1 --2- 172.21.15.135:0/2726019626 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56425444ec90 0x564254450100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.581+0000 7f5b81ffb640 10 client.15492 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:22:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.581+0000 7f5b9a59c640 1 --2- 172.21.15.135:0/2726019626 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56425444ec90 0x564254450100 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=84efb71697fdc3e8 server_cookie=ab5ec3610761da03 in_seq=0 out_seq=0 2024-04-20T12:22:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.582+0000 7f5b81ffb640 1 -- 172.21.15.135:0/2726019626 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564254324510 con 0x56425444ec90 2024-04-20T12:22:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.582+0000 7f5b81ffb640 10 client.15492 handle_command_reply: tid=0 2024-04-20T12:22:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.582+0000 7f5ba378e740 1 client.15492 shutdown 2024-04-20T12:22:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.582+0000 7f5ba378e740 1 -- 172.21.15.135:0/2726019626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642544386e0 msgr2=0x564254442380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.582+0000 7f5ba378e740 1 --2- 172.21.15.135:0/2726019626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642544386e0 0x564254442380 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009fb0 tx=0x7f5b90011870 comp rx=0 tx=0).stop 2024-04-20T12:22:58.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.582+0000 7f5ba378e740 1 -- 172.21.15.135:0/2726019626 shutdown_connections 2024-04-20T12:22:58.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.582+0000 7f5ba378e740 1 --2- 172.21.15.135:0/2726019626 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56425444ec90 0x564254450100 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.582+0000 7f5ba378e740 1 --2- 172.21.15.135:0/2726019626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56425443d850 0x5642544493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.582+0000 7f5b81ffb640 0 client.15492 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:22:58.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.582+0000 7f5ba378e740 1 --2- 172.21.15.135:0/2726019626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642544386e0 0x564254442380 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.582+0000 7f5ba378e740 1 --2- 172.21.15.135:0/2726019626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564254437cf0 0x564254441e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.582+0000 7f5ba378e740 1 -- 172.21.15.135:0/2726019626 >> 172.21.15.135:0/2726019626 conn(0x564254433260 msgr2=0x5642544323a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.582+0000 7f5ba378e740 1 -- 172.21.15.135:0/2726019626 shutdown_connections 2024-04-20T12:22:58.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.582+0000 7f5ba378e740 1 -- 172.21.15.135:0/2726019626 wait complete. 2024-04-20T12:22:58.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.582+0000 7f5ba378e740 20 client.15492 trim_cache size 0 max 16384 2024-04-20T12:22:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.600+0000 7f5ba378e740 1 Processor -- start 2024-04-20T12:22:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.600+0000 7f5ba378e740 1 -- start start 2024-04-20T12:22:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.600+0000 7f5ba378e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564254437cf0 0x56425443d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.600+0000 7f5ba378e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5642544386e0 0x564254449380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.600+0000 7f5ba378e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56425443d850 0x564254438dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.600+0000 7f5ba378e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56425444e440 con 0x56425443d850 2024-04-20T12:22:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.600+0000 7f5ba378e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56425444eb10 con 0x5642544386e0 2024-04-20T12:22:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.600+0000 7f5ba378e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56425444f1e0 con 0x564254437cf0 2024-04-20T12:22:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.600+0000 7f5b9ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56425443d850 0x564254438dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.601+0000 7f5b9ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56425443d850 0x564254438dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41630/0 (socket says 172.21.15.135:41630) 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.601+0000 7f5b9ad9d640 1 -- 172.21.15.135:0/1030006495 learned_addr learned my addr 172.21.15.135:0/1030006495 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.601+0000 7f5b9ad9d640 1 -- 172.21.15.135:0/1030006495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564254437cf0 msgr2=0x56425443d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.601+0000 7f5b9ad9d640 1 --2- 172.21.15.135:0/1030006495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564254437cf0 0x56425443d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.601+0000 7f5b9ad9d640 1 -- 172.21.15.135:0/1030006495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5642544386e0 msgr2=0x564254449380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.601+0000 7f5b9ad9d640 1 --2- 172.21.15.135:0/1030006495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5642544386e0 0x564254449380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.601+0000 7f5b9ad9d640 1 -- 172.21.15.135:0/1030006495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564254433fd0 con 0x56425443d850 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.601+0000 7f5b9ad9d640 1 --2- 172.21.15.135:0/1030006495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56425443d850 0x564254438dd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5b94011470 tx=0x7f5b940099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4147d0e69ed058a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.601+0000 7f5b83fff640 1 -- 172.21.15.135:0/1030006495 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9401e640 con 0x56425443d850 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.601+0000 7f5b83fff640 1 -- 172.21.15.135:0/1030006495 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b94023070 con 0x56425443d850 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.601+0000 7f5b83fff640 1 -- 172.21.15.135:0/1030006495 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9402fbe0 con 0x56425443d850 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 -- 172.21.15.135:0/1030006495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56425443d850 msgr2=0x564254438dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 --2- 172.21.15.135:0/1030006495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56425443d850 0x564254438dd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5b94011470 tx=0x7f5b940099c0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 -- 172.21.15.135:0/1030006495 shutdown_connections 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 --2- 172.21.15.135:0/1030006495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56425443d850 0x564254438dd0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 --2- 172.21.15.135:0/1030006495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5642544386e0 0x564254449380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 --2- 172.21.15.135:0/1030006495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564254437cf0 0x56425443d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 -- 172.21.15.135:0/1030006495 >> 172.21.15.135:0/1030006495 conn(0x564254433260 msgr2=0x564254433640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 -- 172.21.15.135:0/1030006495 shutdown_connections 2024-04-20T12:22:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 -- 172.21.15.135:0/1030006495 wait complete. 2024-04-20T12:22:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 -- start start 2024-04-20T12:22:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 Processor -- start 2024-04-20T12:22:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564254437cf0 0x564254444c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642544386e0 0x564254445150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56425443d850 0x564254447f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56425444ff80 con 0x564254437cf0 2024-04-20T12:22:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56425444f8b0 con 0x56425443d850 2024-04-20T12:22:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564254450650 con 0x5642544386e0 2024-04-20T12:22:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5ba378e740 10 client.0 _ll_register_callbacks cb 0x7f5b900097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5b9a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564254437cf0 0x564254444c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5b9a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564254437cf0 0x564254444c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41634/0 (socket says 172.21.15.135:41634) 2024-04-20T12:22:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5b9a59c640 1 -- 172.21.15.135:0/4163922210 learned_addr learned my addr 172.21.15.135:0/4163922210 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.602+0000 7f5b99d9b640 1 --2- 172.21.15.135:0/4163922210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642544386e0 0x564254445150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5b9ad9d640 1 --2- 172.21.15.135:0/4163922210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56425443d850 0x564254447f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5b9a59c640 1 -- 172.21.15.135:0/4163922210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642544386e0 msgr2=0x564254445150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5b9a59c640 1 --2- 172.21.15.135:0/4163922210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642544386e0 0x564254445150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5b9a59c640 1 -- 172.21.15.135:0/4163922210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56425443d850 msgr2=0x564254447f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5b9a59c640 1 --2- 172.21.15.135:0/4163922210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56425443d850 0x564254447f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5b9a59c640 1 -- 172.21.15.135:0/4163922210 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564254448510 con 0x564254437cf0 2024-04-20T12:22:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5b9ad9d640 1 --2- 172.21.15.135:0/4163922210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56425443d850 0x564254447f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5b99d9b640 1 --2- 172.21.15.135:0/4163922210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642544386e0 0x564254445150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5b9a59c640 1 --2- 172.21.15.135:0/4163922210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564254437cf0 0x564254444c10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0badb0 tx=0x7f5b8c02bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c8840d138a91c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5b81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5b81ffb640 1 -- 172.21.15.135:0/4163922210 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c04b040 con 0x564254437cf0 2024-04-20T12:22:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5b81ffb640 1 -- 172.21.15.135:0/4163922210 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f5b8c0f21a0 con 0x564254437cf0 2024-04-20T12:22:58.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5ba378e740 1 -- 172.21.15.135:0/4163922210 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b94023070 con 0x564254437cf0 2024-04-20T12:22:58.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5b81ffb640 1 -- 172.21.15.135:0/4163922210 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5b8c0beae0 con 0x564254437cf0 2024-04-20T12:22:58.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5ba378e740 10 client.15498 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:58.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5ba378e740 1 -- 172.21.15.135:0/4163922210 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5642544b4c40 con 0x564254437cf0 2024-04-20T12:22:58.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5b81ffb640 1 -- 172.21.15.135:0/4163922210 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b94023070 con 0x564254437cf0 2024-04-20T12:22:58.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5b81ffb640 1 -- 172.21.15.135:0/4163922210 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7f5b8c0baa50 con 0x564254437cf0 2024-04-20T12:22:58.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5ba378e740 10 client.15498 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:58.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5ba378e740 10 client.15498 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-20T12:22:58.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5ba378e740 20 client.15498 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:58.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5ba378e740 1 --2- 172.21.15.135:0/4163922210 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5642544b9840 0x5642544b8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5ba378e740 4 client.15498 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T12:22:58.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.603+0000 7f5ba378e740 1 -- 172.21.15.135:0/4163922210 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "status"}) -- 0x5642543ab530 con 0x5642544b9840 2024-04-20T12:22:58.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5b99d9b640 1 --2- 172.21.15.135:0/4163922210 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5642544b9840 0x5642544b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5b99d9b640 1 --2- 172.21.15.135:0/4163922210 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5642544b9840 0x5642544b8550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac675eb9bb5d0c27 server_cookie=3d4b780d56405e93 in_seq=0 out_seq=0 2024-04-20T12:22:58.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5b81ffb640 10 client.15498 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:22:58.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5b81ffb640 1 -- 172.21.15.135:0/4163922210 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5642543ab530 con 0x5642544b9840 2024-04-20T12:22:58.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5b81ffb640 10 client.15498 handle_command_reply: tid=0 2024-04-20T12:22:58.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5ba378e740 1 client.15498 shutdown 2024-04-20T12:22:58.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5ba378e740 1 -- 172.21.15.135:0/4163922210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564254437cf0 msgr2=0x564254444c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5ba378e740 1 --2- 172.21.15.135:0/4163922210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564254437cf0 0x564254444c10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0badb0 tx=0x7f5b8c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:58.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5ba378e740 1 -- 172.21.15.135:0/4163922210 shutdown_connections 2024-04-20T12:22:58.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5ba378e740 1 --2- 172.21.15.135:0/4163922210 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5642544b9840 0x5642544b8550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5ba378e740 1 --2- 172.21.15.135:0/4163922210 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56425443d850 0x564254447f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5b81ffb640 0 client.15498 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:22:58.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5ba378e740 1 --2- 172.21.15.135:0/4163922210 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5642544386e0 0x564254445150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5ba378e740 1 --2- 172.21.15.135:0/4163922210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564254437cf0 0x564254444c10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5ba378e740 1 -- 172.21.15.135:0/4163922210 >> 172.21.15.135:0/4163922210 conn(0x564254433260 msgr2=0x564254438dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5ba378e740 1 -- 172.21.15.135:0/4163922210 shutdown_connections 2024-04-20T12:22:58.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5ba378e740 1 -- 172.21.15.135:0/4163922210 wait complete. 2024-04-20T12:22:58.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.604+0000 7f5ba378e740 20 client.15498 trim_cache size 0 max 16384 2024-04-20T12:22:58.612 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:22:58.612 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "22180be8-ff0f-11ee-bc92-c7b262605968", 2024-04-20T12:22:58.612 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 1, 2024-04-20T12:22:58.612 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24476, 2024-04-20T12:22:58.612 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-04-20T12:22:58.612 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-04-20T12:22:58.612 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-04-20T12:22:58.612 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 112.70134312499999, 2024-04-20T12:22:58.612 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 28, 2024-04-20T12:22:58.612 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 94, 2024-04-20T12:22:58.612 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 90, 2024-04-20T12:22:58.613 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 142.61194174799999 2024-04-20T12:22:58.613 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:22:58.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.605+0000 7f5ba0b9d640 1 -- 172.21.15.135:0/1965132533 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5b840a3bb0 msgr2=0x7f5b840a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.605+0000 7f5ba0b9d640 1 --2- 172.21.15.135:0/1965132533 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5b840a3bb0 0x7f5b840a6070 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5b94005fd0 tx=0x7f5b94009710 comp rx=0 tx=0).stop 2024-04-20T12:22:58.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.605+0000 7f5ba0b9d640 1 -- 172.21.15.135:0/1965132533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b9c100e70 msgr2=0x7f5b9c1971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.605+0000 7f5ba0b9d640 1 --2- 172.21.15.135:0/1965132533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b9c100e70 0x7f5b9c1971f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c005ab0 tx=0x7f5b8c005dc0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.605+0000 7f5ba0b9d640 1 -- 172.21.15.135:0/1965132533 shutdown_connections 2024-04-20T12:22:58.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.605+0000 7f5ba0b9d640 1 --2- 172.21.15.135:0/1965132533 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5b840a3bb0 0x7f5b840a6070 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.605+0000 7f5ba0b9d640 1 --2- 172.21.15.135:0/1965132533 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b9c102a10 0x7f5b9c19e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.605+0000 7f5ba0b9d640 1 --2- 172.21.15.135:0/1965132533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b9c102050 0x7f5b9c197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.605+0000 7f5ba0b9d640 1 --2- 172.21.15.135:0/1965132533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b9c100e70 0x7f5b9c1971f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.605+0000 7f5ba0b9d640 1 -- 172.21.15.135:0/1965132533 >> 172.21.15.135:0/1965132533 conn(0x7f5b9c0fc430 msgr2=0x7f5b9c105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.605+0000 7f5ba0b9d640 1 -- 172.21.15.135:0/1965132533 shutdown_connections 2024-04-20T12:22:58.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.605+0000 7f5ba0b9d640 1 -- 172.21.15.135:0/1965132533 wait complete. 2024-04-20T12:22:58.616 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-04-20T12:22:58.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.714+0000 7f53b7752640 1 -- 172.21.15.135:0/2682837873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53b0102a20 msgr2=0x7f53b0104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.714+0000 7f53b7752640 1 --2- 172.21.15.135:0/2682837873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53b0102a20 0x7f53b0104e10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009900 tx=0x7f53ac02bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:58.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.714+0000 7f53b7752640 1 -- 172.21.15.135:0/2682837873 shutdown_connections 2024-04-20T12:22:58.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.714+0000 7f53b7752640 1 --2- 172.21.15.135:0/2682837873 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53b0107c80 0x7f53b010a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.714+0000 7f53b7752640 1 --2- 172.21.15.135:0/2682837873 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b0105350 0x7f53b0107740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.714+0000 7f53b7752640 1 --2- 172.21.15.135:0/2682837873 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53b0102a20 0x7f53b0104e10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.714+0000 7f53b7752640 1 -- 172.21.15.135:0/2682837873 >> 172.21.15.135:0/2682837873 conn(0x7f53b00fc450 msgr2=0x7f53b00fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.714+0000 7f53b7752640 1 -- 172.21.15.135:0/2682837873 shutdown_connections 2024-04-20T12:22:58.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.714+0000 7f53b7752640 1 -- 172.21.15.135:0/2682837873 wait complete. 2024-04-20T12:22:58.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.715+0000 7f53b7752640 1 Processor -- start 2024-04-20T12:22:58.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.715+0000 7f53b7752640 1 -- start start 2024-04-20T12:22:58.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.715+0000 7f53b7752640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b0102a20 0x7f53b01982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.715+0000 7f53b7752640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53b0105350 0x7f53b0198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.715+0000 7f53b7752640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53b0107c80 0x7f53b019f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.715+0000 7f53b7752640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53b010dc30 con 0x7f53b0107c80 2024-04-20T12:22:58.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.715+0000 7f53b7752640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f53b010dab0 con 0x7f53b0105350 2024-04-20T12:22:58.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.715+0000 7f53b7752640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53b010ddb0 con 0x7f53b0102a20 2024-04-20T12:22:58.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.715+0000 7f53b5cef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53b0107c80 0x7f53b019f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.715+0000 7f53b5cef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53b0107c80 0x7f53b019f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41652/0 (socket says 172.21.15.135:41652) 2024-04-20T12:22:58.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.715+0000 7f53b5cef640 1 -- 172.21.15.135:0/291983433 learned_addr learned my addr 172.21.15.135:0/291983433 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.715+0000 7f53b54ee640 1 --2- 172.21.15.135:0/291983433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b0102a20 0x7f53b01982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.715+0000 7f53b4ced640 1 --2- 172.21.15.135:0/291983433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53b0105350 0x7f53b0198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.715+0000 7f53b5cef640 1 -- 172.21.15.135:0/291983433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b0102a20 msgr2=0x7f53b01982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.715+0000 7f53b5cef640 1 --2- 172.21.15.135:0/291983433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b0102a20 0x7f53b01982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.716+0000 7f53b5cef640 1 -- 172.21.15.135:0/291983433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53b0105350 msgr2=0x7f53b0198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.716+0000 7f53b5cef640 1 --2- 172.21.15.135:0/291983433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53b0105350 0x7f53b0198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.716+0000 7f53b5cef640 1 -- 172.21.15.135:0/291983433 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b019ff00 con 0x7f53b0107c80 2024-04-20T12:22:58.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.716+0000 7f53b5cef640 1 --2- 172.21.15.135:0/291983433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53b0107c80 0x7f53b019f890 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f53a800eb10 tx=0x7f53a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.716+0000 7f53a67fc640 1 -- 172.21.15.135:0/291983433 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8004b20 con 0x7f53b0107c80 2024-04-20T12:22:58.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.716+0000 7f53a67fc640 1 -- 172.21.15.135:0/291983433 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53a8004cc0 con 0x7f53b0107c80 2024-04-20T12:22:58.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.716+0000 7f53b7752640 1 -- 172.21.15.135:0/291983433 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b01a01f0 con 0x7f53b0107c80 2024-04-20T12:22:58.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.716+0000 7f53a67fc640 1 -- 172.21.15.135:0/291983433 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8010760 con 0x7f53b0107c80 2024-04-20T12:22:58.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.716+0000 7f53b7752640 1 -- 172.21.15.135:0/291983433 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b01a06f0 con 0x7f53b0107c80 2024-04-20T12:22:58.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.718+0000 7f53a67fc640 1 -- 172.21.15.135:0/291983433 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7f53a8005020 con 0x7f53b0107c80 2024-04-20T12:22:58.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.718+0000 7f53ba421740 1 Processor -- start 2024-04-20T12:22:58.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53ba421740 1 -- start start 2024-04-20T12:22:58.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53a67fc640 1 --2- 172.21.15.135:0/291983433 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f539c0a3bb0 0x7f539c0a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53ba421740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b42110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53ba421740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b426e0 0x557131b471e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53ba421740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b47850 0x557131b49ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53ba421740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557131a55290 con 0x557131b41cf0 2024-04-20T12:22:58.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53ba421740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557131ab2a40 con 0x557131b426e0 2024-04-20T12:22:58.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53ba421740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557131a6da30 con 0x557131b47850 2024-04-20T12:22:58.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53b54ee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b42110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53b4ced640 1 --2- 172.21.15.135:0/291983433 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f539c0a3bb0 0x7f539c0a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53b54ee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b42110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41654/0 (socket says 172.21.15.135:41654) 2024-04-20T12:22:58.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53b54ee640 1 -- 172.21.15.135:0/3443397222 learned_addr learned my addr 172.21.15.135:0/3443397222 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53a67fc640 1 -- 172.21.15.135:0/291983433 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f53a80d0d10 con 0x7f53b0107c80 2024-04-20T12:22:58.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53b5cef640 1 --2- 172.21.15.135:0/3443397222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b47850 0x557131b49ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53b4ced640 1 --2- 172.21.15.135:0/3443397222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b426e0 0x557131b471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53b54ee640 1 -- 172.21.15.135:0/3443397222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b47850 msgr2=0x557131b49ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53b54ee640 1 --2- 172.21.15.135:0/3443397222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b47850 0x557131b49ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53b54ee640 1 -- 172.21.15.135:0/3443397222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b426e0 msgr2=0x557131b471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53b54ee640 1 --2- 172.21.15.135:0/3443397222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b426e0 0x557131b471e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53b54ee640 1 -- 172.21.15.135:0/3443397222 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557131a60c10 con 0x557131b41cf0 2024-04-20T12:22:58.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53b5cef640 1 --2- 172.21.15.135:0/3443397222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b47850 0x557131b49ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:58.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53b4ced640 1 --2- 172.21.15.135:0/291983433 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f539c0a3bb0 0x7f539c0a6070 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f53a0009710 tx=0x7f53a0013880 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f53b54ee640 1 --2- 172.21.15.135:0/3443397222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b42110 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009900 tx=0x7f53ac009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84127ed0a43facc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.719+0000 7f539b7fe640 1 -- 172.21.15.135:0/3443397222 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac02cb80 con 0x557131b41cf0 2024-04-20T12:22:58.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.720+0000 7f539b7fe640 1 -- 172.21.15.135:0/3443397222 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53ac005040 con 0x557131b41cf0 2024-04-20T12:22:58.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.720+0000 7f539b7fe640 1 -- 172.21.15.135:0/3443397222 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac004920 con 0x557131b41cf0 2024-04-20T12:22:58.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.720+0000 7f53ba421740 1 -- 172.21.15.135:0/3443397222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 msgr2=0x557131b42110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.720+0000 7f53ba421740 1 --2- 172.21.15.135:0/3443397222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b42110 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009900 tx=0x7f53ac009560 comp rx=0 tx=0).stop 2024-04-20T12:22:58.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.720+0000 7f53ba421740 1 -- 172.21.15.135:0/3443397222 shutdown_connections 2024-04-20T12:22:58.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.720+0000 7f53ba421740 1 --2- 172.21.15.135:0/3443397222 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b47850 0x557131b49ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.720+0000 7f53ba421740 1 --2- 172.21.15.135:0/3443397222 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b426e0 0x557131b471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.720+0000 7f53ba421740 1 --2- 172.21.15.135:0/3443397222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b42110 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.720+0000 7f53ba421740 1 -- 172.21.15.135:0/3443397222 >> 172.21.15.135:0/3443397222 conn(0x557131b3d260 msgr2=0x557131b3d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.720+0000 7f53ba421740 1 -- 172.21.15.135:0/3443397222 shutdown_connections 2024-04-20T12:22:58.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.720+0000 7f53ba421740 1 -- 172.21.15.135:0/3443397222 wait complete. 2024-04-20T12:22:58.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53ba421740 1 -- start start 2024-04-20T12:22:58.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53ba421740 1 Processor -- start 2024-04-20T12:22:58.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53ba421740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b4bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53ba421740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b426e0 0x557131b4c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53ba421740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b47850 0x557131b53450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53ba421740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557131aac140 con 0x557131b41cf0 2024-04-20T12:22:58.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53ba421740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557131aa6e20 con 0x557131b426e0 2024-04-20T12:22:58.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53ba421740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557131ab4d20 con 0x557131b47850 2024-04-20T12:22:58.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53ba421740 10 client.0 _ll_register_callbacks cb 0x557131a9d5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:58.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53b54ee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b4bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53b54ee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b4bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41658/0 (socket says 172.21.15.135:41658) 2024-04-20T12:22:58.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53b54ee640 1 -- 172.21.15.135:0/183728186 learned_addr learned my addr 172.21.15.135:0/183728186 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53b5cef640 1 --2- 172.21.15.135:0/183728186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b47850 0x557131b53450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53b54ee640 1 -- 172.21.15.135:0/183728186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b47850 msgr2=0x557131b53450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53b54ee640 1 --2- 172.21.15.135:0/183728186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b47850 0x557131b53450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53b54ee640 1 -- 172.21.15.135:0/183728186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b426e0 msgr2=0x557131b4c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53b54ee640 1 --2- 172.21.15.135:0/183728186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b426e0 0x557131b4c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53b54ee640 1 -- 172.21.15.135:0/183728186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571317ba2d0 con 0x557131b41cf0 2024-04-20T12:22:58.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f53b54ee640 1 --2- 172.21.15.135:0/183728186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b4bed0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f53ac02cfd0 tx=0x7f53ac005490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f456bbf303437a02 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.721+0000 7f5398ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:58.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.722+0000 7f5398ff9640 1 -- 172.21.15.135:0/183728186 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac004ad0 con 0x557131b41cf0 2024-04-20T12:22:58.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.722+0000 7f5398ff9640 1 -- 172.21.15.135:0/183728186 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f53ac004c70 con 0x557131b41cf0 2024-04-20T12:22:58.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.722+0000 7f53ba421740 1 -- 172.21.15.135:0/183728186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53ac005040 con 0x557131b41cf0 2024-04-20T12:22:58.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.722+0000 7f5398ff9640 1 -- 172.21.15.135:0/183728186 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53ac056050 con 0x557131b41cf0 2024-04-20T12:22:58.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.722+0000 7f53ba421740 10 client.15510 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:58.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.722+0000 7f53ba421740 1 -- 172.21.15.135:0/183728186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5571318846b0 con 0x557131b41cf0 2024-04-20T12:22:58.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.722+0000 7f5398ff9640 1 -- 172.21.15.135:0/183728186 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53ac005040 con 0x557131b41cf0 2024-04-20T12:22:58.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.722+0000 7f5398ff9640 1 -- 172.21.15.135:0/183728186 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7f53ac045420 con 0x557131b41cf0 2024-04-20T12:22:58.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.722+0000 7f53ba421740 10 client.15510 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:58.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.722+0000 7f53ba421740 10 client.15510 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-20T12:22:58.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.722+0000 7f53ba421740 20 client.15510 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:58.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.722+0000 7f53ba421740 1 --2- 172.21.15.135:0/183728186 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557131b58730 0x557131b59ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.722+0000 7f53ba421740 4 client.15510 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:22:58.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.722+0000 7f53ba421740 1 -- 172.21.15.135:0/183728186 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557131a2e510 con 0x557131b58730 2024-04-20T12:22:58.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.723+0000 7f53b4ced640 1 --2- 172.21.15.135:0/183728186 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557131b58730 0x557131b59ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.723+0000 7f53b4ced640 1 --2- 172.21.15.135:0/183728186 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557131b58730 0x557131b59ba0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53927af19d427aa1 server_cookie=e6be8991b37cf761 in_seq=0 out_seq=0 2024-04-20T12:22:58.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.723+0000 7f5398ff9640 10 client.15510 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:22:58.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.724+0000 7f5398ff9640 1 -- 172.21.15.135:0/183728186 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557131a2e510 con 0x557131b58730 2024-04-20T12:22:58.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.724+0000 7f5398ff9640 10 client.15510 handle_command_reply: tid=0 2024-04-20T12:22:58.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.724+0000 7f53ba421740 1 client.15510 shutdown 2024-04-20T12:22:58.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.724+0000 7f53ba421740 1 -- 172.21.15.135:0/183728186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 msgr2=0x557131b4bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.724+0000 7f53ba421740 1 --2- 172.21.15.135:0/183728186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b4bed0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f53ac02cfd0 tx=0x7f53ac005490 comp rx=0 tx=0).stop 2024-04-20T12:22:58.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.724+0000 7f53ba421740 1 -- 172.21.15.135:0/183728186 shutdown_connections 2024-04-20T12:22:58.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.724+0000 7f53ba421740 1 --2- 172.21.15.135:0/183728186 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557131b58730 0x557131b59ba0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.724+0000 7f53ba421740 1 --2- 172.21.15.135:0/183728186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b47850 0x557131b53450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.724+0000 7f53ba421740 1 --2- 172.21.15.135:0/183728186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b426e0 0x557131b4c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.724+0000 7f53ba421740 1 --2- 172.21.15.135:0/183728186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b4bed0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.724+0000 7f5398ff9640 0 client.15510 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:22:58.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.724+0000 7f53ba421740 1 -- 172.21.15.135:0/183728186 >> 172.21.15.135:0/183728186 conn(0x557131b3d260 msgr2=0x557131b3c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.724+0000 7f53ba421740 1 -- 172.21.15.135:0/183728186 shutdown_connections 2024-04-20T12:22:58.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.724+0000 7f53ba421740 1 -- 172.21.15.135:0/183728186 wait complete. 2024-04-20T12:22:58.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.724+0000 7f53ba421740 20 client.15510 trim_cache size 0 max 16384 2024-04-20T12:22:58.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53ba421740 1 Processor -- start 2024-04-20T12:22:58.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53ba421740 1 -- start start 2024-04-20T12:22:58.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53ba421740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b53ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53ba421740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b426e0 0x557131b43180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53ba421740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b47850 0x557131b49c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53ba421740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557131b57ee0 con 0x557131b41cf0 2024-04-20T12:22:58.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53ba421740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557131b585b0 con 0x557131b47850 2024-04-20T12:22:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53ba421740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557131b58c80 con 0x557131b426e0 2024-04-20T12:22:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53b54ee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b53ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53b54ee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b53ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41662/0 (socket says 172.21.15.135:41662) 2024-04-20T12:22:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53b54ee640 1 -- 172.21.15.135:0/860738046 learned_addr learned my addr 172.21.15.135:0/860738046 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53b54ee640 1 -- 172.21.15.135:0/860738046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b426e0 msgr2=0x557131b43180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53b54ee640 1 --2- 172.21.15.135:0/860738046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b426e0 0x557131b43180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53b54ee640 1 -- 172.21.15.135:0/860738046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b47850 msgr2=0x557131b49c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53b54ee640 1 --2- 172.21.15.135:0/860738046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b47850 0x557131b49c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53b54ee640 1 -- 172.21.15.135:0/860738046 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557131b59130 con 0x557131b41cf0 2024-04-20T12:22:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f53b54ee640 1 --2- 172.21.15.135:0/860738046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b53ea0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009900 tx=0x7f53ac005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d4399856d2b708 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f539affd640 1 -- 172.21.15.135:0/860738046 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac05f070 con 0x557131b41cf0 2024-04-20T12:22:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f539affd640 1 -- 172.21.15.135:0/860738046 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53ac04d070 con 0x557131b41cf0 2024-04-20T12:22:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.742+0000 7f539affd640 1 -- 172.21.15.135:0/860738046 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac004b30 con 0x557131b41cf0 2024-04-20T12:22:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.743+0000 7f53ba421740 1 -- 172.21.15.135:0/860738046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 msgr2=0x557131b53ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.743+0000 7f53ba421740 1 --2- 172.21.15.135:0/860738046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b53ea0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009900 tx=0x7f53ac005fd0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.743+0000 7f53ba421740 1 -- 172.21.15.135:0/860738046 shutdown_connections 2024-04-20T12:22:58.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.743+0000 7f53ba421740 1 --2- 172.21.15.135:0/860738046 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b47850 0x557131b49c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.743+0000 7f53ba421740 1 --2- 172.21.15.135:0/860738046 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b426e0 0x557131b43180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.743+0000 7f53ba421740 1 --2- 172.21.15.135:0/860738046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b41cf0 0x557131b53ea0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.743+0000 7f53ba421740 1 -- 172.21.15.135:0/860738046 >> 172.21.15.135:0/860738046 conn(0x557131b3d260 msgr2=0x557131b3c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.743+0000 7f53ba421740 1 -- 172.21.15.135:0/860738046 shutdown_connections 2024-04-20T12:22:58.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.743+0000 7f53ba421740 1 -- 172.21.15.135:0/860738046 wait complete. 2024-04-20T12:22:58.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.743+0000 7f53ba421740 1 -- start start 2024-04-20T12:22:58.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.743+0000 7f53ba421740 1 Processor -- start 2024-04-20T12:22:58.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53ba421740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b41cf0 0x557131b4e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53ba421740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b426e0 0x557131b4e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53ba421740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b47850 0x557131b518e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53ba421740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557131b59a20 con 0x557131b47850 2024-04-20T12:22:58.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53ba421740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557131b59350 con 0x557131b41cf0 2024-04-20T12:22:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53ba421740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557131b5a0f0 con 0x557131b426e0 2024-04-20T12:22:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53ba421740 10 client.0 _ll_register_callbacks cb 0x7f53ac009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:22:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53b5cef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b47850 0x557131b518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53b5cef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b47850 0x557131b518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41672/0 (socket says 172.21.15.135:41672) 2024-04-20T12:22:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53b5cef640 1 -- 172.21.15.135:0/37151715 learned_addr learned my addr 172.21.15.135:0/37151715 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53b4ced640 1 --2- 172.21.15.135:0/37151715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b426e0 0x557131b4e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53b54ee640 1 --2- 172.21.15.135:0/37151715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b41cf0 0x557131b4e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53b5cef640 1 -- 172.21.15.135:0/37151715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b426e0 msgr2=0x557131b4e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53b5cef640 1 --2- 172.21.15.135:0/37151715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b426e0 0x557131b4e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53b5cef640 1 -- 172.21.15.135:0/37151715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b41cf0 msgr2=0x557131b4e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:22:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53b5cef640 1 --2- 172.21.15.135:0/37151715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b41cf0 0x557131b4e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53b5cef640 1 -- 172.21.15.135:0/37151715 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557131b51ed0 con 0x557131b47850 2024-04-20T12:22:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53b54ee640 1 --2- 172.21.15.135:0/37151715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b41cf0 0x557131b4e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:22:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53b5cef640 1 --2- 172.21.15.135:0/37151715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b47850 0x557131b518e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f53a80ce470 tx=0x7f53a8099010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0ab8b1759fad15 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f5398ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:22:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f5398ff9640 1 -- 172.21.15.135:0/37151715 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a809d350 con 0x557131b47850 2024-04-20T12:22:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f5398ff9640 1 -- 172.21.15.135:0/37151715 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f53a80a5430 con 0x557131b47850 2024-04-20T12:22:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.744+0000 7f53ba421740 1 -- 172.21.15.135:0/37151715 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53ac04d070 con 0x557131b47850 2024-04-20T12:22:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.745+0000 7f5398ff9640 1 -- 172.21.15.135:0/37151715 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f53a809cc50 con 0x557131b47850 2024-04-20T12:22:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.745+0000 7f53ba421740 10 client.15516 fetch_fsmap learned FSMap version 28 2024-04-20T12:22:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.745+0000 7f53ba421740 1 -- 172.21.15.135:0/37151715 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557131b532a0 con 0x557131b47850 2024-04-20T12:22:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.745+0000 7f5398ff9640 1 -- 172.21.15.135:0/37151715 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53ac04d070 con 0x557131b47850 2024-04-20T12:22:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.745+0000 7f5398ff9640 1 -- 172.21.15.135:0/37151715 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8363+0+0 (secure 0 0 0) 0x7f53a809c0a0 con 0x557131b47850 2024-04-20T12:22:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.745+0000 7f53ba421740 10 client.15516 fetch_fsmap finished waiting for FSMap version 28 2024-04-20T12:22:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.745+0000 7f53ba421740 10 client.15516 resolve_mds: resolved name 'i' to daemon mds.i 2024-04-20T12:22:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.745+0000 7f53ba421740 20 client.15516 populate_metadata read hostname 'smithi135' 2024-04-20T12:22:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.745+0000 7f53ba421740 1 --2- 172.21.15.135:0/37151715 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557131bc2e10 0x557131bbf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.745+0000 7f53ba421740 4 client.15516 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T12:22:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.745+0000 7f53ba421740 1 -- 172.21.15.135:0/37151715 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "status"}) -- 0x557131ab5530 con 0x557131bc2e10 2024-04-20T12:22:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.745+0000 7f53b54ee640 1 --2- 172.21.15.135:0/37151715 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557131bc2e10 0x557131bbf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f53b54ee640 1 --2- 172.21.15.135:0/37151715 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557131bc2e10 0x557131bbf920 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8aa7dabff9b1883 server_cookie=cdf2a880346198bd in_seq=0 out_seq=0 2024-04-20T12:22:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f5398ff9640 10 client.15516 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:22:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f5398ff9640 1 -- 172.21.15.135:0/37151715 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557131ab5530 con 0x557131bc2e10 2024-04-20T12:22:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f5398ff9640 10 client.15516 handle_command_reply: tid=0 2024-04-20T12:22:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f53ba421740 1 client.15516 shutdown 2024-04-20T12:22:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f53ba421740 1 -- 172.21.15.135:0/37151715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b47850 msgr2=0x557131b518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f53ba421740 1 --2- 172.21.15.135:0/37151715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b47850 0x557131b518e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f53a80ce470 tx=0x7f53a8099010 comp rx=0 tx=0).stop 2024-04-20T12:22:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f53ba421740 1 -- 172.21.15.135:0/37151715 shutdown_connections 2024-04-20T12:22:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f53ba421740 1 --2- 172.21.15.135:0/37151715 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557131bc2e10 0x557131bbf920 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f53ba421740 1 --2- 172.21.15.135:0/37151715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557131b47850 0x557131b518e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f5398ff9640 0 client.15516 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:22:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f53ba421740 1 --2- 172.21.15.135:0/37151715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557131b426e0 0x557131b4e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f53ba421740 1 --2- 172.21.15.135:0/37151715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557131b41cf0 0x557131b4e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f53ba421740 1 -- 172.21.15.135:0/37151715 >> 172.21.15.135:0/37151715 conn(0x557131b3d260 msgr2=0x557131b3c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f53ba421740 1 -- 172.21.15.135:0/37151715 shutdown_connections 2024-04-20T12:22:58.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f53ba421740 1 -- 172.21.15.135:0/37151715 wait complete. 2024-04-20T12:22:58.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.746+0000 7f53ba421740 20 client.15516 trim_cache size 0 max 16384 2024-04-20T12:22:58.753 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:22:58.753 INFO:teuthology.orchestra.run.smithi135.stdout: "cluster_fsid": "22180be8-ff0f-11ee-bc92-c7b262605968", 2024-04-20T12:22:58.753 INFO:teuthology.orchestra.run.smithi135.stdout: "whoami": 0, 2024-04-20T12:22:58.753 INFO:teuthology.orchestra.run.smithi135.stdout: "id": 24490, 2024-04-20T12:22:58.753 INFO:teuthology.orchestra.run.smithi135.stdout: "want_state": "up:active", 2024-04-20T12:22:58.753 INFO:teuthology.orchestra.run.smithi135.stdout: "state": "up:active", 2024-04-20T12:22:58.754 INFO:teuthology.orchestra.run.smithi135.stdout: "fs_name": "cephfs", 2024-04-20T12:22:58.754 INFO:teuthology.orchestra.run.smithi135.stdout: "rank_uptime": 136.73644867600001, 2024-04-20T12:22:58.754 INFO:teuthology.orchestra.run.smithi135.stdout: "mdsmap_epoch": 28, 2024-04-20T12:22:58.754 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch": 94, 2024-04-20T12:22:58.754 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_epoch_barrier": 90, 2024-04-20T12:22:58.754 INFO:teuthology.orchestra.run.smithi135.stdout: "uptime": 151.316534945 2024-04-20T12:22:58.754 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:22:58.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.747+0000 7f53b7752640 1 -- 172.21.15.135:0/291983433 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f539c0a3bb0 msgr2=0x7f539c0a6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.747+0000 7f53b7752640 1 --2- 172.21.15.135:0/291983433 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f539c0a3bb0 0x7f539c0a6070 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f53a0009710 tx=0x7f53a0013880 comp rx=0 tx=0).stop 2024-04-20T12:22:58.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.747+0000 7f53b7752640 1 -- 172.21.15.135:0/291983433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53b0107c80 msgr2=0x7f53b019f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.747+0000 7f53b7752640 1 --2- 172.21.15.135:0/291983433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53b0107c80 0x7f53b019f890 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f53a800eb10 tx=0x7f53a800c2d0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.747+0000 7f53b7752640 1 -- 172.21.15.135:0/291983433 shutdown_connections 2024-04-20T12:22:58.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.747+0000 7f53b7752640 1 --2- 172.21.15.135:0/291983433 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f539c0a3bb0 0x7f539c0a6070 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.747+0000 7f53b7752640 1 --2- 172.21.15.135:0/291983433 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53b0107c80 0x7f53b019f890 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.747+0000 7f53b7752640 1 --2- 172.21.15.135:0/291983433 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53b0105350 0x7f53b0198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.747+0000 7f53b7752640 1 --2- 172.21.15.135:0/291983433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53b0102a20 0x7f53b01982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.747+0000 7f53b7752640 1 -- 172.21.15.135:0/291983433 >> 172.21.15.135:0/291983433 conn(0x7f53b00fc450 msgr2=0x7f53b01034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.747+0000 7f53b7752640 1 -- 172.21.15.135:0/291983433 shutdown_connections 2024-04-20T12:22:58.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.747+0000 7f53b7752640 1 -- 172.21.15.135:0/291983433 wait complete. 2024-04-20T12:22:58.757 INFO:teuthology.run_tasks:Running task sequential... 2024-04-20T12:22:58.767 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-20T12:22:58.767 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-20T12:22:58.768 INFO:teuthology.task.print:Enabling mgr modules 2024-04-20T12:22:58.768 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-04-20T12:22:58.768 INFO:teuthology.task.exec:Executing custom commands... 2024-04-20T12:22:58.769 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-04-20T12:22:58.769 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-04-20T12:22:58.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.868+0000 7ff131a9a640 1 -- 172.21.15.135:0/130293988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff12c105370 msgr2=0x7ff12c107760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.868+0000 7ff131a9a640 1 --2- 172.21.15.135:0/130293988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff12c105370 0x7ff12c107760 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff120009900 tx=0x7ff12002bc30 comp rx=0 tx=0).stop 2024-04-20T12:22:58.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.868+0000 7ff131a9a640 1 -- 172.21.15.135:0/130293988 shutdown_connections 2024-04-20T12:22:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.868+0000 7ff131a9a640 1 --2- 172.21.15.135:0/130293988 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff12c107ca0 0x7ff12c10a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.868+0000 7ff131a9a640 1 --2- 172.21.15.135:0/130293988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff12c105370 0x7ff12c107760 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.868+0000 7ff131a9a640 1 --2- 172.21.15.135:0/130293988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c102a40 0x7ff12c104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.868+0000 7ff131a9a640 1 -- 172.21.15.135:0/130293988 >> 172.21.15.135:0/130293988 conn(0x7ff12c0fc430 msgr2=0x7ff12c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.868+0000 7ff131a9a640 1 -- 172.21.15.135:0/130293988 shutdown_connections 2024-04-20T12:22:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.868+0000 7ff131a9a640 1 -- 172.21.15.135:0/130293988 wait complete. 2024-04-20T12:22:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff131a9a640 1 Processor -- start 2024-04-20T12:22:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff131a9a640 1 -- start start 2024-04-20T12:22:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff131a9a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff12c102a40 0x7ff12c198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff131a9a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c105370 0x7ff12c198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff131a9a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff12c107ca0 0x7ff12c19f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff131a9a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c10dc50 con 0x7ff12c107ca0 2024-04-20T12:22:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff131a9a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c10dad0 con 0x7ff12c102a40 2024-04-20T12:22:58.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff131a9a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff12c10ddd0 con 0x7ff12c105370 2024-04-20T12:22:58.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff12bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff12c107ca0 0x7ff12c19f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff12bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff12c107ca0 0x7ff12c19f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41692/0 (socket says 172.21.15.135:41692) 2024-04-20T12:22:58.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff12bfff640 1 -- 172.21.15.135:0/486968923 learned_addr learned my addr 172.21.15.135:0/486968923 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:22:58.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff12affd640 1 --2- 172.21.15.135:0/486968923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c105370 0x7ff12c198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff12b7fe640 1 --2- 172.21.15.135:0/486968923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff12c102a40 0x7ff12c198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff12bfff640 1 -- 172.21.15.135:0/486968923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c105370 msgr2=0x7ff12c198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff12bfff640 1 --2- 172.21.15.135:0/486968923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c105370 0x7ff12c198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff12bfff640 1 -- 172.21.15.135:0/486968923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff12c102a40 msgr2=0x7ff12c198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:58.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff12bfff640 1 --2- 172.21.15.135:0/486968923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff12c102a40 0x7ff12c198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:58.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff12bfff640 1 -- 172.21.15.135:0/486968923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12c19fe40 con 0x7ff12c107ca0 2024-04-20T12:22:58.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.869+0000 7ff12b7fe640 1 --2- 172.21.15.135:0/486968923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff12c102a40 0x7ff12c198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:22:58.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.870+0000 7ff12bfff640 1 --2- 172.21.15.135:0/486968923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff12c107ca0 0x7ff12c19f7d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff12400eb10 tx=0x7ff12400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.870+0000 7ff128ff9640 1 -- 172.21.15.135:0/486968923 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124004b20 con 0x7ff12c107ca0 2024-04-20T12:22:58.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.870+0000 7ff128ff9640 1 -- 172.21.15.135:0/486968923 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff124004cc0 con 0x7ff12c107ca0 2024-04-20T12:22:58.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.870+0000 7ff131a9a640 1 -- 172.21.15.135:0/486968923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12c1a0130 con 0x7ff12c107ca0 2024-04-20T12:22:58.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.870+0000 7ff128ff9640 1 -- 172.21.15.135:0/486968923 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff124010760 con 0x7ff12c107ca0 2024-04-20T12:22:58.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.870+0000 7ff131a9a640 1 -- 172.21.15.135:0/486968923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12c1a0650 con 0x7ff12c107ca0 2024-04-20T12:22:58.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.871+0000 7ff131a9a640 1 -- 172.21.15.135:0/486968923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff12c0fdf20 con 0x7ff12c107ca0 2024-04-20T12:22:58.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.872+0000 7ff128ff9640 1 -- 172.21.15.135:0/486968923 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 138647+0+0 (secure 0 0 0) 0x7ff124005000 con 0x7ff12c107ca0 2024-04-20T12:22:58.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.873+0000 7ff128ff9640 1 --2- 172.21.15.135:0/486968923 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff1140a3cd0 0x7ff1140a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:22:58.883 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.873+0000 7ff12b7fe640 1 --2- 172.21.15.135:0/486968923 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff1140a3cd0 0x7ff1140a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:22:58.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.873+0000 7ff128ff9640 1 -- 172.21.15.135:0/486968923 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7ff1240d0f60 con 0x7ff12c107ca0 2024-04-20T12:22:58.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.873+0000 7ff12b7fe640 1 --2- 172.21.15.135:0/486968923 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff1140a3cd0 0x7ff1140a6190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009c20 tx=0x7ff11c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:22:58.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:58.876+0000 7ff128ff9640 1 -- 172.21.15.135:0/486968923 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7ff124053ff0 con 0x7ff12c107ca0 2024-04-20T12:22:59.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:59.104+0000 7ff131a9a640 1 -- 172.21.15.135:0/486968923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7ff12c062b60 con 0x7ff12c107ca0 2024-04-20T12:22:59.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:58 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1885036662' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:59.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:58 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1885036662' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:59.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:58 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1885036662' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:22:59.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:59.938+0000 7ff128ff9640 1 -- 172.21.15.135:0/486968923 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7ff12409d5a0 con 0x7ff12c107ca0 2024-04-20T12:22:59.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:59.942+0000 7ff131a9a640 1 -- 172.21.15.135:0/486968923 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff1140a3cd0 msgr2=0x7ff1140a6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:59.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:59.942+0000 7ff131a9a640 1 --2- 172.21.15.135:0/486968923 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff1140a3cd0 0x7ff1140a6190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009c20 tx=0x7ff11c005f90 comp rx=0 tx=0).stop 2024-04-20T12:22:59.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:59.942+0000 7ff131a9a640 1 -- 172.21.15.135:0/486968923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff12c107ca0 msgr2=0x7ff12c19f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:22:59.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:59.942+0000 7ff131a9a640 1 --2- 172.21.15.135:0/486968923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff12c107ca0 0x7ff12c19f7d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ff12400eb10 tx=0x7ff12400c2d0 comp rx=0 tx=0).stop 2024-04-20T12:22:59.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:59.942+0000 7ff131a9a640 1 -- 172.21.15.135:0/486968923 shutdown_connections 2024-04-20T12:22:59.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:59.942+0000 7ff131a9a640 1 --2- 172.21.15.135:0/486968923 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7ff1140a3cd0 0x7ff1140a6190 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:59.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:59.942+0000 7ff131a9a640 1 --2- 172.21.15.135:0/486968923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff12c107ca0 0x7ff12c19f7d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:59.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:59.942+0000 7ff131a9a640 1 --2- 172.21.15.135:0/486968923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff12c105370 0x7ff12c198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:59.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:59.942+0000 7ff131a9a640 1 --2- 172.21.15.135:0/486968923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff12c102a40 0x7ff12c198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:22:59.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:59.942+0000 7ff131a9a640 1 -- 172.21.15.135:0/486968923 >> 172.21.15.135:0/486968923 conn(0x7ff12c0fc430 msgr2=0x7ff12c103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:22:59.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:59.942+0000 7ff131a9a640 1 -- 172.21.15.135:0/486968923 shutdown_connections 2024-04-20T12:22:59.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:22:59.942+0000 7ff131a9a640 1 -- 172.21.15.135:0/486968923 wait complete. 2024-04-20T12:22:59.960 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-04-20T12:23:00.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.066+0000 7f569ba8c640 1 -- 172.21.15.135:0/987431637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5694107d40 msgr2=0x7f569410a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:00.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.066+0000 7f569ba8c640 1 --2- 172.21.15.135:0/987431637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5694107d40 0x7f569410a130 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f568c009ca0 tx=0x7f568c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.066+0000 7f569ba8c640 1 -- 172.21.15.135:0/987431637 shutdown_connections 2024-04-20T12:23:00.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.066+0000 7f569ba8c640 1 --2- 172.21.15.135:0/987431637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5694107d40 0x7f569410a130 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.066+0000 7f569ba8c640 1 --2- 172.21.15.135:0/987431637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5694105410 0x7f5694107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.066+0000 7f569ba8c640 1 --2- 172.21.15.135:0/987431637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5694102ae0 0x7f5694104ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.066+0000 7f569ba8c640 1 -- 172.21.15.135:0/987431637 >> 172.21.15.135:0/987431637 conn(0x7f56940fc430 msgr2=0x7f56940fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:00.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.066+0000 7f569ba8c640 1 -- 172.21.15.135:0/987431637 shutdown_connections 2024-04-20T12:23:00.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.066+0000 7f569ba8c640 1 -- 172.21.15.135:0/987431637 wait complete. 2024-04-20T12:23:00.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.067+0000 7f569ba8c640 1 Processor -- start 2024-04-20T12:23:00.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.067+0000 7f569ba8c640 1 -- start start 2024-04-20T12:23:00.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.067+0000 7f569ba8c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5694102ae0 0x7f5694198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:00.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.067+0000 7f569ba8c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5694105410 0x7f5694198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:00.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.067+0000 7f569ba8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5694107d40 0x7f569419f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:00.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.067+0000 7f569ba8c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f569410dc70 con 0x7f5694107d40 2024-04-20T12:23:00.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.067+0000 7f569ba8c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f569410daf0 con 0x7f5694105410 2024-04-20T12:23:00.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.067+0000 7f569ba8c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f569410ddf0 con 0x7f5694102ae0 2024-04-20T12:23:00.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.067+0000 7f569a029640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5694107d40 0x7f569419f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:00.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.067+0000 7f5699828640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5694102ae0 0x7f5694198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:00.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.067+0000 7f5699828640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5694102ae0 0x7f5694198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.135:38606/0 (socket says 172.21.15.135:38606) 2024-04-20T12:23:00.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.067+0000 7f569a029640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5694107d40 0x7f569419f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41742/0 (socket says 172.21.15.135:41742) 2024-04-20T12:23:00.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.067+0000 7f5699828640 1 -- 172.21.15.135:0/1524162451 learned_addr learned my addr 172.21.15.135:0/1524162451 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:00.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.067+0000 7f5699027640 1 --2- 172.21.15.135:0/1524162451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5694105410 0x7f5694198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:00.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.068+0000 7f569a029640 1 -- 172.21.15.135:0/1524162451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5694102ae0 msgr2=0x7f5694198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:00.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.068+0000 7f569a029640 1 --2- 172.21.15.135:0/1524162451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5694102ae0 0x7f5694198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.068+0000 7f569a029640 1 -- 172.21.15.135:0/1524162451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5694105410 msgr2=0x7f5694198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:00.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.068+0000 7f569a029640 1 --2- 172.21.15.135:0/1524162451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5694105410 0x7f5694198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.068+0000 7f569a029640 1 -- 172.21.15.135:0/1524162451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569419fe30 con 0x7f5694107d40 2024-04-20T12:23:00.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.068+0000 7f5699828640 1 --2- 172.21.15.135:0/1524162451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5694102ae0 0x7f5694198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:00.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.068+0000 7f569a029640 1 --2- 172.21.15.135:0/1524162451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5694107d40 0x7f569419f7c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f568c02c630 tx=0x7f568c032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:00.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.068+0000 7f568affd640 1 -- 172.21.15.135:0/1524162451 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c041020 con 0x7f5694107d40 2024-04-20T12:23:00.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.068+0000 7f569ba8c640 1 -- 172.21.15.135:0/1524162451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56941a00c0 con 0x7f5694107d40 2024-04-20T12:23:00.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.068+0000 7f568affd640 1 -- 172.21.15.135:0/1524162451 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f568c034cd0 con 0x7f5694107d40 2024-04-20T12:23:00.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.068+0000 7f568affd640 1 -- 172.21.15.135:0/1524162451 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568c039040 con 0x7f5694107d40 2024-04-20T12:23:00.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.068+0000 7f569ba8c640 1 -- 172.21.15.135:0/1524162451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56941a0580 con 0x7f5694107d40 2024-04-20T12:23:00.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.069+0000 7f569ba8c640 1 -- 172.21.15.135:0/1524162451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56940fdf20 con 0x7f5694107d40 2024-04-20T12:23:00.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.070+0000 7f568affd640 1 -- 172.21.15.135:0/1524162451 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) ==== 138664+0+0 (secure 0 0 0) 0x7f568c044020 con 0x7f5694107d40 2024-04-20T12:23:00.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.071+0000 7f568affd640 1 --2- 172.21.15.135:0/1524162451 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f56800a3ca0 0x7f56800a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:00.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.071+0000 7f5699828640 1 -- 172.21.15.135:0/1524162451 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f56800a3ca0 msgr2=0x7f56800a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3831149339 2024-04-20T12:23:00.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.071+0000 7f568affd640 1 -- 172.21.15.135:0/1524162451 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f568c0f2540 con 0x7f5694107d40 2024-04-20T12:23:00.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.071+0000 7f5699828640 1 --2- 172.21.15.135:0/1524162451 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f56800a3ca0 0x7f56800a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T12:23:00.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.075+0000 7f568affd640 1 -- 172.21.15.135:0/1524162451 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f568c04b020 con 0x7f5694107d40 2024-04-20T12:23:00.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:59 smithi154 ceph-mon[22073]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-20T12:23:00.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:22:59 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/486968923' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-20T12:23:00.252 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:22:59 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: ignoring --setuser ceph since I am not root 2024-04-20T12:23:00.252 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:22:59 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: ignoring --setgroup ceph since I am not root 2024-04-20T12:23:00.252 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:22:59 smithi154 ceph-mgr[23923]: -- 172.21.15.154:0/147442171 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561dcc1345a0 con 0x561dcc109000 2024-04-20T12:23:00.252 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:00 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:00.122+0000 7f2808972200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-20T12:23:00.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.261+0000 7f569ba8c640 1 -- 172.21.15.135:0/1524162451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f5694062b60 con 0x7f5694107d40 2024-04-20T12:23:00.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.265+0000 7f568affd640 1 -- 172.21.15.135:0/1524162451 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7f568c0bec10 con 0x7f5694107d40 2024-04-20T12:23:00.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.267+0000 7f569ba8c640 1 -- 172.21.15.135:0/1524162451 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f56800a3ca0 msgr2=0x7f56800a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T12:23:00.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.267+0000 7f569ba8c640 1 --2- 172.21.15.135:0/1524162451 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f56800a3ca0 0x7f56800a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.267+0000 7f569ba8c640 1 -- 172.21.15.135:0/1524162451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5694107d40 msgr2=0x7f569419f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:00.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.267+0000 7f569ba8c640 1 --2- 172.21.15.135:0/1524162451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5694107d40 0x7f569419f7c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f568c02c630 tx=0x7f568c032f20 comp rx=0 tx=0).stop 2024-04-20T12:23:00.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.267+0000 7f569ba8c640 1 -- 172.21.15.135:0/1524162451 shutdown_connections 2024-04-20T12:23:00.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.267+0000 7f569ba8c640 1 --2- 172.21.15.135:0/1524162451 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f56800a3ca0 0x7f56800a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.267+0000 7f569ba8c640 1 --2- 172.21.15.135:0/1524162451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5694107d40 0x7f569419f7c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.267+0000 7f569ba8c640 1 --2- 172.21.15.135:0/1524162451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5694105410 0x7f5694198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.267+0000 7f569ba8c640 1 --2- 172.21.15.135:0/1524162451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5694102ae0 0x7f5694198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.267+0000 7f569ba8c640 1 -- 172.21.15.135:0/1524162451 >> 172.21.15.135:0/1524162451 conn(0x7f56940fc430 msgr2=0x7f5694103420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:00.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.267+0000 7f569ba8c640 1 -- 172.21.15.135:0/1524162451 shutdown_connections 2024-04-20T12:23:00.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.268+0000 7f569ba8c640 1 -- 172.21.15.135:0/1524162451 wait complete. 2024-04-20T12:23:00.278 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:59 smithi135 ceph-mon[18264]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-20T12:23:00.278 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:22:59 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/486968923' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-20T12:23:00.278 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:22:59 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: ignoring --setuser ceph since I am not root 2024-04-20T12:23:00.278 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:22:59 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: ignoring --setgroup ceph since I am not root 2024-04-20T12:23:00.278 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:00 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:00.127+0000 7fdf0a2dc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-20T12:23:00.279 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-04-20T12:23:00.300 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:59 smithi139 ceph-mon[21834]: pgmap v365: 129 pgs: 129 active+clean; 645 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-04-20T12:23:00.300 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:22:59 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/486968923' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-04-20T12:23:00.300 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:22:59 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: ignoring --setuser ceph since I am not root 2024-04-20T12:23:00.300 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:22:59 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: ignoring --setgroup ceph since I am not root 2024-04-20T12:23:00.300 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:22:59 smithi139 ceph-mgr[23218]: -- 172.21.15.139:0/250909495 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f11a1465a0 con 0x55f11a11a800 2024-04-20T12:23:00.301 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:00 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:00.118+0000 7f3eb996c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-20T12:23:00.301 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:00 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:00.301+0000 7f3eb996c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:23:00.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.380+0000 7fa6534d2640 1 -- 172.21.15.135:0/2099274935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa64c100e70 msgr2=0x7fa64c101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:00.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.380+0000 7fa6534d2640 1 --2- 172.21.15.135:0/2099274935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa64c100e70 0x7fa64c101290 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa648009900 tx=0x7fa64802bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:00.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.380+0000 7fa6534d2640 1 -- 172.21.15.135:0/2099274935 shutdown_connections 2024-04-20T12:23:00.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.380+0000 7fa6534d2640 1 --2- 172.21.15.135:0/2099274935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa64c102a10 0x7fa64c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.380+0000 7fa6534d2640 1 --2- 172.21.15.135:0/2099274935 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64c102050 0x7fa64c1024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.380+0000 7fa6534d2640 1 --2- 172.21.15.135:0/2099274935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa64c100e70 0x7fa64c101290 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.380+0000 7fa6534d2640 1 -- 172.21.15.135:0/2099274935 >> 172.21.15.135:0/2099274935 conn(0x7fa64c0fc430 msgr2=0x7fa64c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:00.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.380+0000 7fa6534d2640 1 -- 172.21.15.135:0/2099274935 shutdown_connections 2024-04-20T12:23:00.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.380+0000 7fa6534d2640 1 -- 172.21.15.135:0/2099274935 wait complete. 2024-04-20T12:23:00.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.381+0000 7fa6534d2640 1 Processor -- start 2024-04-20T12:23:00.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.381+0000 7fa6534d2640 1 -- start start 2024-04-20T12:23:00.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.381+0000 7fa6534d2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64c100e70 0x7fa64c197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:00.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.381+0000 7fa6534d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa64c102050 0x7fa64c1976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:00.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.381+0000 7fa6534d2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa64c102a10 0x7fa64c19e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:00.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.381+0000 7fa6534d2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa64c10cb30 con 0x7fa64c102a10 2024-04-20T12:23:00.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.381+0000 7fa6534d2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa64c10c9b0 con 0x7fa64c100e70 2024-04-20T12:23:00.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.381+0000 7fa6534d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa64c10ccb0 con 0x7fa64c102050 2024-04-20T12:23:00.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.381+0000 7fa651a6f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa64c102a10 0x7fa64c19e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:00.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.381+0000 7fa651a6f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa64c102a10 0x7fa64c19e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41774/0 (socket says 172.21.15.135:41774) 2024-04-20T12:23:00.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.381+0000 7fa651a6f640 1 -- 172.21.15.135:0/697876126 learned_addr learned my addr 172.21.15.135:0/697876126 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:00.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.381+0000 7fa65126e640 1 --2- 172.21.15.135:0/697876126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64c100e70 0x7fa64c197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:00.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.381+0000 7fa650a6d640 1 --2- 172.21.15.135:0/697876126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa64c102050 0x7fa64c1976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:00.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.381+0000 7fa651a6f640 1 -- 172.21.15.135:0/697876126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa64c102050 msgr2=0x7fa64c1976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:00.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.381+0000 7fa651a6f640 1 --2- 172.21.15.135:0/697876126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa64c102050 0x7fa64c1976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.382+0000 7fa651a6f640 1 -- 172.21.15.135:0/697876126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64c100e70 msgr2=0x7fa64c197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:00.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.382+0000 7fa651a6f640 1 --2- 172.21.15.135:0/697876126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64c100e70 0x7fa64c197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.382+0000 7fa651a6f640 1 -- 172.21.15.135:0/697876126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa64c19ed40 con 0x7fa64c102a10 2024-04-20T12:23:00.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.382+0000 7fa65126e640 1 --2- 172.21.15.135:0/697876126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64c100e70 0x7fa64c197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:00.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.382+0000 7fa651a6f640 1 --2- 172.21.15.135:0/697876126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa64c102a10 0x7fa64c19e6d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa64400eca0 tx=0x7fa64400b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:00.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.382+0000 7fa6427fc640 1 -- 172.21.15.135:0/697876126 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa644004b20 con 0x7fa64c102a10 2024-04-20T12:23:00.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.382+0000 7fa6534d2640 1 -- 172.21.15.135:0/697876126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa64c069670 con 0x7fa64c102a10 2024-04-20T12:23:00.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.382+0000 7fa6427fc640 1 -- 172.21.15.135:0/697876126 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa644004cc0 con 0x7fa64c102a10 2024-04-20T12:23:00.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.382+0000 7fa6427fc640 1 -- 172.21.15.135:0/697876126 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa644017650 con 0x7fa64c102a10 2024-04-20T12:23:00.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.382+0000 7fa6534d2640 1 -- 172.21.15.135:0/697876126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa64c069bc0 con 0x7fa64c102a10 2024-04-20T12:23:00.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.383+0000 7fa6534d2640 1 -- 172.21.15.135:0/697876126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa64c107c80 con 0x7fa64c102a10 2024-04-20T12:23:00.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.384+0000 7fa6427fc640 1 -- 172.21.15.135:0/697876126 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) ==== 138664+0+0 (secure 0 0 0) 0x7fa644005000 con 0x7fa64c102a10 2024-04-20T12:23:00.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.385+0000 7fa6427fc640 1 --2- 172.21.15.135:0/697876126 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa6380a3ca0 0x7fa6380a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:00.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.385+0000 7fa65126e640 1 -- 172.21.15.135:0/697876126 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa6380a3ca0 msgr2=0x7fa6380a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3831149339 2024-04-20T12:23:00.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.385+0000 7fa6427fc640 1 -- 172.21.15.135:0/697876126 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7fa6440d29e0 con 0x7fa64c102a10 2024-04-20T12:23:00.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.385+0000 7fa65126e640 1 --2- 172.21.15.135:0/697876126 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa6380a3ca0 0x7fa6380a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T12:23:00.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.393+0000 7fa6427fc640 1 -- 172.21.15.135:0/697876126 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fa64409e9d0 con 0x7fa64c102a10 2024-04-20T12:23:00.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.577+0000 7fa6534d2640 1 -- 172.21.15.135:0/697876126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fa64c107e50 con 0x7fa64c102a10 2024-04-20T12:23:00.579 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:00 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:00.403+0000 7f3eb996c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-20T12:23:00.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.581+0000 7fa6427fc640 1 -- 172.21.15.135:0/697876126 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) ==== 133+0+0 (secure 0 0 0) 0x7fa6440a2cd0 con 0x7fa64c102a10 2024-04-20T12:23:00.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.584+0000 7fa6534d2640 1 -- 172.21.15.135:0/697876126 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa6380a3ca0 msgr2=0x7fa6380a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T12:23:00.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.584+0000 7fa6534d2640 1 --2- 172.21.15.135:0/697876126 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa6380a3ca0 0x7fa6380a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.584+0000 7fa6534d2640 1 -- 172.21.15.135:0/697876126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa64c102a10 msgr2=0x7fa64c19e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:00.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.584+0000 7fa6534d2640 1 --2- 172.21.15.135:0/697876126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa64c102a10 0x7fa64c19e6d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa64400eca0 tx=0x7fa64400b690 comp rx=0 tx=0).stop 2024-04-20T12:23:00.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.584+0000 7fa6534d2640 1 -- 172.21.15.135:0/697876126 shutdown_connections 2024-04-20T12:23:00.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.584+0000 7fa6534d2640 1 --2- 172.21.15.135:0/697876126 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7fa6380a3ca0 0x7fa6380a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.584+0000 7fa6534d2640 1 --2- 172.21.15.135:0/697876126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa64c102a10 0x7fa64c19e6d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.584+0000 7fa6534d2640 1 --2- 172.21.15.135:0/697876126 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa64c102050 0x7fa64c1976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.584+0000 7fa6534d2640 1 --2- 172.21.15.135:0/697876126 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa64c100e70 0x7fa64c197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:00.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.584+0000 7fa6534d2640 1 -- 172.21.15.135:0/697876126 >> 172.21.15.135:0/697876126 conn(0x7fa64c0fc430 msgr2=0x7fa64c1053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:00.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.584+0000 7fa6534d2640 1 -- 172.21.15.135:0/697876126 shutdown_connections 2024-04-20T12:23:00.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:00.584+0000 7fa6534d2640 1 -- 172.21.15.135:0/697876126 wait complete. 2024-04-20T12:23:00.594 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:00 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:00.317+0000 7fdf0a2dc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:23:00.594 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:00 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:00.430+0000 7fdf0a2dc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-20T12:23:00.595 INFO:teuthology.run_tasks:Running task kclient... 2024-04-20T12:23:00.609 INFO:tasks.kclient:Mounting kernel clients... 2024-04-20T12:23:00.609 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-20T12:23:00.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:23:00.609 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-04-20T12:23:00.624 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-20T12:23:00.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:23:00.624 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-20T12:23:00.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:23:00.689 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-04-20T12:23:00.716 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:00 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:00.306+0000 7f2808972200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:23:00.716 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:00 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:00.408+0000 7f2808972200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-20T12:23:00.717 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:00 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:00.716+0000 7f2808972200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-20T12:23:00.787 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-04-20T12:23:00.787 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-20T12:23:00.787 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-20T12:23:00.788 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph fs ls 2024-04-20T12:23:00.848 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:00 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:00.756+0000 7fdf0a2dc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-20T12:23:01.001 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:00 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:00.800+0000 7f2808972200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-20T12:23:01.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:00 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/486968923' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-20T12:23:01.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:00 smithi154 ceph-mon[22073]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-04-20T12:23:01.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:00 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1524162451' entity='client.admin' 2024-04-20T12:23:01.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:00 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/697876126' entity='client.admin' 2024-04-20T12:23:01.044 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:23:01.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:00 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/486968923' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-20T12:23:01.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:00 smithi139 ceph-mon[21834]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-04-20T12:23:01.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:00 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1524162451' entity='client.admin' 2024-04-20T12:23:01.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:00 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/697876126' entity='client.admin' 2024-04-20T12:23:01.080 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:00 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:00.706+0000 7f3eb996c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-20T12:23:01.080 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:00 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:00.790+0000 7f3eb996c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-20T12:23:01.113 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:00 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:00.847+0000 7fdf0a2dc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-20T12:23:01.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:00 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/486968923' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-04-20T12:23:01.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:00 smithi135 ceph-mon[18264]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-04-20T12:23:01.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:00 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1524162451' entity='client.admin' 2024-04-20T12:23:01.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:00 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/697876126' entity='client.admin' 2024-04-20T12:23:02.247 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:02 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:02.075+0000 7fdf0a2dc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-20T12:23:02.251 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:01 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:01.979+0000 7f2808972200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-20T12:23:02.251 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:02 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:02.150+0000 7f2808972200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-20T12:23:02.289 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:01 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:01.949+0000 7f3eb996c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-20T12:23:02.289 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:02 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:02.119+0000 7f3eb996c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-20T12:23:02.289 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:02 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:02.290+0000 7f3eb996c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-20T12:23:02.609 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:02 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:02.247+0000 7fdf0a2dc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-20T12:23:02.609 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:02 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:02.429+0000 7fdf0a2dc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-20T12:23:02.610 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:02 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:02.321+0000 7f2808972200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-20T12:23:02.610 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:02 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:02.610+0000 7f2808972200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-20T12:23:02.830 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:02 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:02.580+0000 7f3eb996c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-20T12:23:02.830 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:02 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:02.671+0000 7f3eb996c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-20T12:23:02.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.829+0000 7f96ce2d6700 1 -- 172.21.15.135:0/951817926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c8107990 msgr2=0x7f96c8107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:02.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.829+0000 7f96ce2d6700 1 --2- 172.21.15.135:0/951817926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c8107990 0x7f96c8107d70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009990 tx=0x7f96bc009ca0 comp rx=0 tx=0).stop 2024-04-20T12:23:02.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.829+0000 7f96ce2d6700 1 -- 172.21.15.135:0/951817926 shutdown_connections 2024-04-20T12:23:02.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.829+0000 7f96ce2d6700 1 --2- 172.21.15.135:0/951817926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96c8102300 0x7f96c810e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:02.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.829+0000 7f96ce2d6700 1 --2- 172.21.15.135:0/951817926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c8107990 0x7f96c8107d70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:02.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.829+0000 7f96ce2d6700 1 --2- 172.21.15.135:0/951817926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c8101940 0x7f96c8101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:02.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.829+0000 7f96ce2d6700 1 -- 172.21.15.135:0/951817926 >> 172.21.15.135:0/951817926 conn(0x7f96c80788c0 msgr2=0x7f96c8078cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:02.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.829+0000 7f96ce2d6700 1 -- 172.21.15.135:0/951817926 shutdown_connections 2024-04-20T12:23:02.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.829+0000 7f96ce2d6700 1 -- 172.21.15.135:0/951817926 wait complete. 2024-04-20T12:23:02.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.830+0000 7f96ce2d6700 1 Processor -- start 2024-04-20T12:23:02.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.830+0000 7f96ce2d6700 1 -- start start 2024-04-20T12:23:02.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.830+0000 7f96ce2d6700 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96c8101940 0x7f96c81992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:02.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.830+0000 7f96ce2d6700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c8102300 0x7f96c81997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:02.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.830+0000 7f96ce2d6700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c8107990 0x7f96c819db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:02.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.830+0000 7f96ce2d6700 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8111c30 con 0x7f96c8107990 2024-04-20T12:23:02.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.830+0000 7f96ce2d6700 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8111ab0 con 0x7f96c8101940 2024-04-20T12:23:02.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.830+0000 7f96ce2d6700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8111db0 con 0x7f96c8102300 2024-04-20T12:23:02.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.830+0000 7f96cc873700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c8107990 0x7f96c819db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:02.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.830+0000 7f96cc873700 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c8107990 0x7f96c819db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48462/0 (socket says 172.21.15.135:48462) 2024-04-20T12:23:02.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.830+0000 7f96cc873700 1 -- 172.21.15.135:0/1864470401 learned_addr learned my addr 172.21.15.135:0/1864470401 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:02.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.830+0000 7f96c77fe700 1 --2- 172.21.15.135:0/1864470401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c8102300 0x7f96c81997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:02.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.830+0000 7f96c7fff700 1 --2- 172.21.15.135:0/1864470401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96c8101940 0x7f96c81992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:02.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.831+0000 7f96cc873700 1 -- 172.21.15.135:0/1864470401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c8102300 msgr2=0x7f96c81997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:02.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.831+0000 7f96cc873700 1 --2- 172.21.15.135:0/1864470401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c8102300 0x7f96c81997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:02.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.831+0000 7f96cc873700 1 -- 172.21.15.135:0/1864470401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96c8101940 msgr2=0x7f96c81992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:02.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.831+0000 7f96cc873700 1 --2- 172.21.15.135:0/1864470401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96c8101940 0x7f96c81992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:02.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.831+0000 7f96cc873700 1 -- 172.21.15.135:0/1864470401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c819e270 con 0x7f96c8107990 2024-04-20T12:23:02.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.831+0000 7f96cc873700 1 --2- 172.21.15.135:0/1864470401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c8107990 0x7f96c819db30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f96c0007ee0 tx=0x7f96c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:02.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.831+0000 7f96c57fa700 1 -- 172.21.15.135:0/1864470401 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c000dd20 con 0x7f96c8107990 2024-04-20T12:23:02.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.831+0000 7f96c57fa700 1 -- 172.21.15.135:0/1864470401 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96c0004020 con 0x7f96c8107990 2024-04-20T12:23:02.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.831+0000 7f96ce2d6700 1 -- 172.21.15.135:0/1864470401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c819e560 con 0x7f96c8107990 2024-04-20T12:23:02.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.831+0000 7f96c57fa700 1 -- 172.21.15.135:0/1864470401 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0015660 con 0x7f96c8107990 2024-04-20T12:23:02.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.831+0000 7f96ce2d6700 1 -- 172.21.15.135:0/1864470401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c81a5de0 con 0x7f96c8107990 2024-04-20T12:23:02.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.832+0000 7f96ce2d6700 1 -- 172.21.15.135:0/1864470401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c8069740 con 0x7f96c8107990 2024-04-20T12:23:02.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.833+0000 7f96c57fa700 1 -- 172.21.15.135:0/1864470401 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) ==== 138664+0+0 (secure 0 0 0) 0x7f96c00041d0 con 0x7f96c8107990 2024-04-20T12:23:02.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.834+0000 7f96c57fa700 1 --2- 172.21.15.135:0/1864470401 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f96b00a3c90 0x7f96b00a6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:02.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.834+0000 7f96c7fff700 1 -- 172.21.15.135:0/1864470401 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f96b00a3c90 msgr2=0x7f96b00a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3831149339 2024-04-20T12:23:02.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.834+0000 7f96c57fa700 1 -- 172.21.15.135:0/1864470401 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f96c00d0a10 con 0x7f96c8107990 2024-04-20T12:23:02.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.834+0000 7f96c7fff700 1 --2- 172.21.15.135:0/1864470401 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f96b00a3c90 0x7f96b00a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T12:23:02.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:02.838+0000 7f96c57fa700 1 -- 172.21.15.135:0/1864470401 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f96c0010070 con 0x7f96c8107990 2024-04-20T12:23:02.863 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:02 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:02.728+0000 7fdf0a2dc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-20T12:23:02.863 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:02 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:02.828+0000 7fdf0a2dc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-20T12:23:02.905 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:02 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:02.702+0000 7f2808972200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-20T12:23:02.905 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:02 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:02.906+0000 7f2808972200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-20T12:23:03.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.035+0000 7f96c7fff700 1 -- 172.21.15.135:0/1864470401 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f96b00a3c90 msgr2=0x7f96b00a6150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3831149339 2024-04-20T12:23:03.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.035+0000 7f96c7fff700 1 --2- 172.21.15.135:0/1864470401 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f96b00a3c90 0x7f96b00a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-20T12:23:03.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.092+0000 7f96ce2d6700 1 -- 172.21.15.135:0/1864470401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f96c81a5fb0 con 0x7f96c8107990 2024-04-20T12:23:03.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.093+0000 7f96c57fa700 1 -- 172.21.15.135:0/1864470401 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+88 (secure 0 0 0) 0x7f96c009d050 con 0x7f96c8107990 2024-04-20T12:23:03.093 INFO:teuthology.orchestra.run.smithi135.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-20T12:23:03.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.095+0000 7f96ce2d6700 1 -- 172.21.15.135:0/1864470401 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f96b00a3c90 msgr2=0x7f96b00a6150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T12:23:03.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.095+0000 7f96ce2d6700 1 --2- 172.21.15.135:0/1864470401 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f96b00a3c90 0x7f96b00a6150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:03.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.095+0000 7f96ce2d6700 1 -- 172.21.15.135:0/1864470401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c8107990 msgr2=0x7f96c819db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:03.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.095+0000 7f96ce2d6700 1 --2- 172.21.15.135:0/1864470401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c8107990 0x7f96c819db30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f96c0007ee0 tx=0x7f96c000d3b0 comp rx=0 tx=0).stop 2024-04-20T12:23:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.095+0000 7f96ce2d6700 1 -- 172.21.15.135:0/1864470401 shutdown_connections 2024-04-20T12:23:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.095+0000 7f96ce2d6700 1 --2- 172.21.15.135:0/1864470401 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f96b00a3c90 0x7f96b00a6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.095+0000 7f96ce2d6700 1 --2- 172.21.15.135:0/1864470401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f96c8107990 0x7f96c819db30 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.095+0000 7f96ce2d6700 1 --2- 172.21.15.135:0/1864470401 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96c8101940 0x7f96c81992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.095+0000 7f96ce2d6700 1 --2- 172.21.15.135:0/1864470401 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96c8102300 0x7f96c81997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.095+0000 7f96ce2d6700 1 -- 172.21.15.135:0/1864470401 >> 172.21.15.135:0/1864470401 conn(0x7f96c80788c0 msgr2=0x7f96c806b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.095+0000 7f96ce2d6700 1 -- 172.21.15.135:0/1864470401 shutdown_connections 2024-04-20T12:23:03.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03.095+0000 7f96ce2d6700 1 -- 172.21.15.135:0/1864470401 wait complete. 2024-04-20T12:23:03.144 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:02 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:02.876+0000 7f3eb996c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-20T12:23:03.144 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:03 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:03.068+0000 7f3eb996c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:23:03.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:03 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1864470401' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-20T12:23:03.251 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:03 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:03.100+0000 7f2808972200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:23:03.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:03 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1864470401' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-20T12:23:03.364 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:03 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:03.042+0000 7fdf0a2dc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-20T12:23:03.364 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:03 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:03.252+0000 7fdf0a2dc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-20T12:23:03.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:03 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1864470401' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-20T12:23:03.806 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-20T12:23:03.807 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-20T12:23:03.807 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi135.front.sepia.ceph.com 2024-04-20T12:23:03.807 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-20T12:23:03.807 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-20T12:23:03.807 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-20T12:23:03.807 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-20T12:23:03.807 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-20T12:23:03.807 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-20T12:23:03.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:23:03.807 DEBUG:teuthology.orchestra.run.smithi135:> ip addr 2024-04-20T12:23:03.823 INFO:teuthology.orchestra.run.smithi135.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T12:23:03.824 INFO:teuthology.orchestra.run.smithi135.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T12:23:03.824 INFO:teuthology.orchestra.run.smithi135.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T12:23:03.824 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-04-20T12:23:03.824 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 ::1/128 scope host 2024-04-20T12:23:03.824 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-04-20T12:23:03.824 INFO:teuthology.orchestra.run.smithi135.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T12:23:03.824 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:76 brd ff:ff:ff:ff:ff:ff 2024-04-20T12:23:03.824 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f0 2024-04-20T12:23:03.824 INFO:teuthology.orchestra.run.smithi135.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T12:23:03.824 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:d9:36:77 brd ff:ff:ff:ff:ff:ff 2024-04-20T12:23:03.824 INFO:teuthology.orchestra.run.smithi135.stdout: altname enp7s0f1 2024-04-20T12:23:03.824 INFO:teuthology.orchestra.run.smithi135.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T12:23:03.825 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:82 brd ff:ff:ff:ff:ff:ff 2024-04-20T12:23:03.825 INFO:teuthology.orchestra.run.smithi135.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-20T12:23:03.825 INFO:teuthology.orchestra.run.smithi135.stdout: link/ether 0c:c4:7a:88:80:83 brd ff:ff:ff:ff:ff:ff 2024-04-20T12:23:03.825 INFO:teuthology.orchestra.run.smithi135.stdout: inet 172.21.15.135/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-20T12:23:03.825 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft 42150sec preferred_lft 42150sec 2024-04-20T12:23:03.825 INFO:teuthology.orchestra.run.smithi135.stdout: inet6 fe80::cde4:bb11:2417:569c/64 scope link noprefixroute 2024-04-20T12:23:03.825 INFO:teuthology.orchestra.run.smithi135.stdout: valid_lft forever preferred_lft forever 2024-04-20T12:23:03.825 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-20T12:23:03.825 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T12:23:03.825 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-04-20T12:23:03.825 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add name ceph-brx type bridge 2024-04-20T12:23:03.826 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr flush dev ceph-brx 2024-04-20T12:23:03.826 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set ceph-brx up 2024-04-20T12:23:03.826 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-20T12:23:03.826 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-04-20T12:23:03.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T12:23:03.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:23:03.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:23:03.963 DEBUG:teuthology.orchestra.run.smithi135:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-20T12:23:03.986 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-04-20T12:23:03.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:23:03.988 DEBUG:teuthology.orchestra.run.smithi135:> route 2024-04-20T12:23:04.001 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:03 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:03.698+0000 7f2808972200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-20T12:23:04.045 INFO:teuthology.orchestra.run.smithi135.stdout:Kernel IP routing table 2024-04-20T12:23:04.045 INFO:teuthology.orchestra.run.smithi135.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-20T12:23:04.045 INFO:teuthology.orchestra.run.smithi135.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-20T12:23:04.045 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-20T12:23:04.045 INFO:teuthology.orchestra.run.smithi135.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-20T12:23:04.045 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T12:23:04.046 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-04-20T12:23:04.046 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-20T12:23:04.046 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-20T12:23:04.046 DEBUG:teuthology.orchestra.run.smithi135:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-20T12:23:04.046 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-04-20T12:23:04.079 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:03 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:03.668+0000 7f3eb996c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-20T12:23:04.113 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:03 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:03.868+0000 7fdf0a2dc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-20T12:23:04.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T12:23:04.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:23:04.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:23:04.170 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-04-20T12:23:04.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:23:04.226 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list-id 2024-04-20T12:23:04.280 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T12:23:04.280 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-04-20T12:23:04.280 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T12:23:04.281 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-20T12:23:04.281 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-04-20T12:23:04.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T12:23:04.381 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:04 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:04.085+0000 7f3eb996c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-20T12:23:04.381 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:04 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:04.180+0000 7f3eb996c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-20T12:23:04.382 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:04 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:04.382+0000 7f3eb996c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-20T12:23:04.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:23:04.398 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-20T12:23:04.398 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T12:23:04.398 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-04-20T12:23:04.398 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-20T12:23:04.398 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-20T12:23:04.398 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-20T12:23:04.398 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-20T12:23:04.398 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-20T12:23:04.399 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-04-20T12:23:04.415 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:04 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:04.119+0000 7f2808972200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-20T12:23:04.415 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:04 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:04.215+0000 7f2808972200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-20T12:23:04.415 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:04 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:04.415+0000 7f2808972200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-20T12:23:04.426 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:04 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:04.322+0000 7fdf0a2dc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-20T12:23:04.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T12:23:04.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:23:04.509 DEBUG:teuthology.orchestra.run.smithi135:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T12:23:04.510 DEBUG:teuthology.orchestra.run.smithi135:> set -e 2024-04-20T12:23:04.510 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set brx.0 up 2024-04-20T12:23:04.510 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link set dev brx.0 master ceph-brx 2024-04-20T12:23:04.510 DEBUG:teuthology.orchestra.run.smithi135:> ') 2024-04-20T12:23:04.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T12:23:04.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:23:04.626 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T12:23:04.627 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-20T12:23:04.641 INFO:teuthology.orchestra.run.smithi135.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-20T12:23:04.641 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T12:23:04.641 DEBUG:teuthology.orchestra.run.smithi135:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-20T12:23:04.695 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-04-20T12:23:04.695 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-04-20T12:23:04.695 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/71264f8e-9bf4-4c1b-9dcb-f6e832f02fc4 2024-04-20T12:23:04.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:23:04.695 DEBUG:teuthology.orchestra.run.smithi135:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/71264f8e-9bf4-4c1b-9dcb-f6e832f02fc4 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-04-20T12:23:04.756 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:04 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:04.426+0000 7fdf0a2dc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-20T12:23:04.756 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:04 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:04.647+0000 7fdf0a2dc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-20T12:23:04.777 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-04-20T12:23:04.777 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-04-20T12:23:04.918 INFO:teuthology.orchestra.run.smithi135.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=legacy,wsync,nofallback 2024-04-20T12:23:04.918 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync". 2024-04-20T12:23:04.918 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: resolved to: "172.21.15.135:6789,172.21.15.139:6789,172.21.15.154:6789" 2024-04-20T12:23:04.918 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: trying mount with new device syntax: 0@22180be8-ff0f-11ee-bc92-c7b262605968.cephfs=/volumes/qa/sv_1/71264f8e-9bf4-4c1b-9dcb-f6e832f02fc4 2024-04-20T12:23:04.918 INFO:teuthology.orchestra.run.smithi135.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=legacy,wsync,name=0,key=0,mon_addr=172.21.15.135:6789/172.21.15.139:6789/172.21.15.154:6789" will pass to kernel 2024-04-20T12:23:04.919 INFO:teuthology.orchestra.run.smithi135.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-20T12:23:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: You just mounted a file system that supports labels which does not 2024-04-20T12:23:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-20T12:23:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: applications will generate AVC messages and not be allowed access to 2024-04-20T12:23:04.919 INFO:teuthology.orchestra.run.smithi135.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-20T12:23:04.921 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-20T12:23:04.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:23:04.921 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-20T12:23:04.987 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-20T12:23:05.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-20T12:23:05.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:23:05.086 INFO:teuthology.orchestra.run.smithi135.stdout:client15561 2024-04-20T12:23:05.086 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:23:05.086 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T12:23:05.103 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-20T12:23:05.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-20T12:23:05.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:23:05.198 INFO:teuthology.orchestra.run.smithi135.stdout:client15561 2024-04-20T12:23:05.199 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-20T12:23:05.245 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:04 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:04.907+0000 7f3eb996c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-20T12:23:05.245 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:05 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:05.001+0000 7f3eb996c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-20T12:23:05.247 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-20T12:23:05.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:23:05.251 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:04 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:04.943+0000 7f2808972200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-20T12:23:05.251 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:05 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:05.037+0000 7f2808972200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-20T12:23:05.255 INFO:teuthology.orchestra.run.smithi135.stdout:client15561 2024-04-20T12:23:05.255 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/22180be8-ff0f-11ee-bc92-c7b262605968.client15561/status') 2024-04-20T12:23:05.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T12:23:05.312 INFO:teuthology.orchestra.run.smithi135.stdout:instance: client.15561 (3)192.168.0.1:0/161350959 2024-04-20T12:23:05.313 INFO:teuthology.orchestra.run.smithi135.stdout:blocklisted: false 2024-04-20T12:23:05.313 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records in 2024-04-20T12:23:05.313 INFO:teuthology.orchestra.run.smithi135.stderr:0+1 records out 2024-04-20T12:23:05.313 INFO:teuthology.orchestra.run.smithi135.stderr:69 bytes copied, 2.2492e-05 s, 3.1 MB/s 2024-04-20T12:23:05.313 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T12:23:05.320 INFO:teuthology.run_tasks:Running task exec... 2024-04-20T12:23:05.329 INFO:teuthology.task.exec:Executing custom commands... 2024-04-20T12:23:05.329 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-04-20T12:23:05.329 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-04-20T12:23:05.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.431+0000 7f5ca74b3640 1 -- 172.21.15.135:0/154496151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca0102a40 msgr2=0x7f5ca0104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:05.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.431+0000 7f5ca74b3640 1 --2- 172.21.15.135:0/154496151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca0102a40 0x7f5ca0104e30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009900 tx=0x7f5c9002bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:05.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.431+0000 7f5ca74b3640 1 -- 172.21.15.135:0/154496151 shutdown_connections 2024-04-20T12:23:05.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.431+0000 7f5ca74b3640 1 --2- 172.21.15.135:0/154496151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ca0107ca0 0x7f5ca010a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:05.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.431+0000 7f5ca74b3640 1 --2- 172.21.15.135:0/154496151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca0105370 0x7f5ca0107760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:05.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.431+0000 7f5ca74b3640 1 --2- 172.21.15.135:0/154496151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca0102a40 0x7f5ca0104e30 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:05.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.431+0000 7f5ca74b3640 1 -- 172.21.15.135:0/154496151 >> 172.21.15.135:0/154496151 conn(0x7f5ca00fc430 msgr2=0x7f5ca00fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:05.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.431+0000 7f5ca74b3640 1 -- 172.21.15.135:0/154496151 shutdown_connections 2024-04-20T12:23:05.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.431+0000 7f5ca74b3640 1 -- 172.21.15.135:0/154496151 wait complete. 2024-04-20T12:23:05.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.431+0000 7f5ca74b3640 1 Processor -- start 2024-04-20T12:23:05.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.431+0000 7f5ca74b3640 1 -- start start 2024-04-20T12:23:05.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca74b3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ca0102a40 0x7f5ca0198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:05.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca74b3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca0105370 0x7f5ca01987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:05.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca74b3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca0107ca0 0x7f5ca019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:05.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca74b3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca010dc50 con 0x7f5ca0107ca0 2024-04-20T12:23:05.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca74b3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca010dad0 con 0x7f5ca0102a40 2024-04-20T12:23:05.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca74b3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca010ddd0 con 0x7f5ca0105370 2024-04-20T12:23:05.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca5a50640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca0107ca0 0x7f5ca019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:05.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca524f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ca0102a40 0x7f5ca0198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:05.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca524f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ca0102a40 0x7f5ca0198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:54334/0 (socket says 172.21.15.135:54334) 2024-04-20T12:23:05.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca5a50640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca0107ca0 0x7f5ca019f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48476/0 (socket says 172.21.15.135:48476) 2024-04-20T12:23:05.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca524f640 1 -- 172.21.15.135:0/2429616448 learned_addr learned my addr 172.21.15.135:0/2429616448 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:05.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca4a4e640 1 --2- 172.21.15.135:0/2429616448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca0105370 0x7f5ca01987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:05.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca524f640 1 -- 172.21.15.135:0/2429616448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca0105370 msgr2=0x7f5ca01987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:05.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca524f640 1 --2- 172.21.15.135:0/2429616448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca0105370 0x7f5ca01987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:05.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca524f640 1 -- 172.21.15.135:0/2429616448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca0107ca0 msgr2=0x7f5ca019f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:05.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca524f640 1 --2- 172.21.15.135:0/2429616448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca0107ca0 0x7f5ca019f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:05.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca524f640 1 -- 172.21.15.135:0/2429616448 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca019fe80 con 0x7f5ca0102a40 2024-04-20T12:23:05.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca5a50640 1 --2- 172.21.15.135:0/2429616448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca0107ca0 0x7f5ca019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:05.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca524f640 1 --2- 172.21.15.135:0/2429616448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ca0102a40 0x7f5ca0198260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009230 tx=0x7f5c9002c650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:05.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5c967fc640 1 -- 172.21.15.135:0/2429616448 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90041070 con 0x7f5ca0102a40 2024-04-20T12:23:05.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca74b3640 1 -- 172.21.15.135:0/2429616448 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca01a0110 con 0x7f5ca0102a40 2024-04-20T12:23:05.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5c967fc640 1 -- 172.21.15.135:0/2429616448 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c90004450 con 0x7f5ca0102a40 2024-04-20T12:23:05.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5c967fc640 1 -- 172.21.15.135:0/2429616448 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c90003e20 con 0x7f5ca0102a40 2024-04-20T12:23:05.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.432+0000 7f5ca74b3640 1 -- 172.21.15.135:0/2429616448 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca01a0650 con 0x7f5ca0102a40 2024-04-20T12:23:05.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.433+0000 7f5ca74b3640 1 -- 172.21.15.135:0/2429616448 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca00fdf20 con 0x7f5ca0102a40 2024-04-20T12:23:05.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.434+0000 7f5c967fc640 1 -- 172.21.15.135:0/2429616448 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 19) ==== 138664+0+0 (secure 0 0 0) 0x7f5c90044070 con 0x7f5ca0102a40 2024-04-20T12:23:05.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.435+0000 7f5c967fc640 1 --2- 172.21.15.135:0/2429616448 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5c8c0a3ca0 0x7f5c8c0a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:05.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.435+0000 7f5ca4a4e640 1 -- 172.21.15.135:0/2429616448 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5c8c0a3ca0 msgr2=0x7f5c8c0a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3831149339 2024-04-20T12:23:05.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.435+0000 7f5c967fc640 1 -- 172.21.15.135:0/2429616448 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f5c900f24a0 con 0x7f5ca0102a40 2024-04-20T12:23:05.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.435+0000 7f5ca4a4e640 1 --2- 172.21.15.135:0/2429616448 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5c8c0a3ca0 0x7f5c8c0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T12:23:05.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.439+0000 7f5c967fc640 1 -- 172.21.15.135:0/2429616448 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f5c900be490 con 0x7f5ca0102a40 2024-04-20T12:23:05.561 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:05 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:05.201+0000 7fdf0a2dc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-20T12:23:05.561 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:05 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:05.301+0000 7fdf0a2dc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-20T12:23:05.579 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:05 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:05.245+0000 7f3eb996c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-20T12:23:05.579 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:05 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:05.378+0000 7f3eb996c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-20T12:23:05.579 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:05 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:05.473+0000 7f3eb996c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-20T12:23:05.623 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:05 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:05.283+0000 7f2808972200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-20T12:23:05.623 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:05 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:05.414+0000 7f2808972200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-20T12:23:05.623 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:05 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:05.510+0000 7f2808972200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-20T12:23:05.624 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:05 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:05.624+0000 7f2808972200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-20T12:23:05.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.636+0000 7f5ca4a4e640 1 -- 172.21.15.135:0/2429616448 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5c8c0a3ca0 msgr2=0x7f5c8c0a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3831149339 2024-04-20T12:23:05.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.636+0000 7f5ca4a4e640 1 --2- 172.21.15.135:0/2429616448 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5c8c0a3ca0 0x7f5c8c0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-20T12:23:05.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.665+0000 7f5ca74b3640 1 -- 172.21.15.135:0/2429616448 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f5ca002d5d0 con 0x7f5ca0102a40 2024-04-20T12:23:05.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.721+0000 7f5c967fc640 1 -- 172.21.15.135:0/2429616448 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v29) ==== 118+0+0 (secure 0 0 0) 0x7f5c900c2790 con 0x7f5ca0102a40 2024-04-20T12:23:05.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.723+0000 7f5ca74b3640 1 -- 172.21.15.135:0/2429616448 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5c8c0a3ca0 msgr2=0x7f5c8c0a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T12:23:05.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.723+0000 7f5ca74b3640 1 --2- 172.21.15.135:0/2429616448 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5c8c0a3ca0 0x7f5c8c0a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:05.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.723+0000 7f5ca74b3640 1 -- 172.21.15.135:0/2429616448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ca0102a40 msgr2=0x7f5ca0198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:05.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.723+0000 7f5ca74b3640 1 --2- 172.21.15.135:0/2429616448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ca0102a40 0x7f5ca0198260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009230 tx=0x7f5c9002c650 comp rx=0 tx=0).stop 2024-04-20T12:23:05.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.723+0000 7f5ca74b3640 1 -- 172.21.15.135:0/2429616448 shutdown_connections 2024-04-20T12:23:05.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.723+0000 7f5ca74b3640 1 --2- 172.21.15.135:0/2429616448 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f5c8c0a3ca0 0x7f5c8c0a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:05.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.723+0000 7f5ca74b3640 1 --2- 172.21.15.135:0/2429616448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ca0107ca0 0x7f5ca019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:05.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.723+0000 7f5ca74b3640 1 --2- 172.21.15.135:0/2429616448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5ca0105370 0x7f5ca01987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:05.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.723+0000 7f5ca74b3640 1 --2- 172.21.15.135:0/2429616448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5ca0102a40 0x7f5ca0198260 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:05.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.723+0000 7f5ca74b3640 1 -- 172.21.15.135:0/2429616448 >> 172.21.15.135:0/2429616448 conn(0x7f5ca00fc430 msgr2=0x7f5ca0103380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:05.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.723+0000 7f5ca74b3640 1 -- 172.21.15.135:0/2429616448 shutdown_connections 2024-04-20T12:23:05.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.723+0000 7f5ca74b3640 1 -- 172.21.15.135:0/2429616448 wait complete. 2024-04-20T12:23:05.734 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-04-20T12:23:05.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.837+0000 7f63971db640 1 -- 172.21.15.135:0/559319843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6390105370 msgr2=0x7f6390107760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:05.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.837+0000 7f63971db640 1 --2- 172.21.15.135:0/559319843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6390105370 0x7f6390107760 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f637c009900 tx=0x7f637c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:05.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.837+0000 7f63971db640 1 -- 172.21.15.135:0/559319843 shutdown_connections 2024-04-20T12:23:05.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.837+0000 7f63971db640 1 --2- 172.21.15.135:0/559319843 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6390107ca0 0x7f639010a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:05.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.837+0000 7f63971db640 1 --2- 172.21.15.135:0/559319843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6390105370 0x7f6390107760 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:05.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.837+0000 7f63971db640 1 --2- 172.21.15.135:0/559319843 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6390102a40 0x7f6390104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:05.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.837+0000 7f63971db640 1 -- 172.21.15.135:0/559319843 >> 172.21.15.135:0/559319843 conn(0x7f63900fc430 msgr2=0x7f63900fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:05.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.837+0000 7f63971db640 1 -- 172.21.15.135:0/559319843 shutdown_connections 2024-04-20T12:23:05.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.837+0000 7f63971db640 1 -- 172.21.15.135:0/559319843 wait complete. 2024-04-20T12:23:05.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f63971db640 1 Processor -- start 2024-04-20T12:23:05.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f63971db640 1 -- start start 2024-04-20T12:23:05.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f63971db640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6390102a40 0x7f63901982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:05.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f63971db640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6390105370 0x7f63901987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:05.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f63971db640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6390107ca0 0x7f639019f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:05.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f63971db640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f639010dca0 con 0x7f6390105370 2024-04-20T12:23:05.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f63971db640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f639010db20 con 0x7f6390107ca0 2024-04-20T12:23:05.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f63971db640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f639010de20 con 0x7f6390102a40 2024-04-20T12:23:05.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f638ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6390105370 0x7f63901987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:05.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f638ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6390105370 0x7f63901987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48490/0 (socket says 172.21.15.135:48490) 2024-04-20T12:23:05.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f638ffff640 1 -- 172.21.15.135:0/1436408347 learned_addr learned my addr 172.21.15.135:0/1436408347 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:05.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f6394f77640 1 --2- 172.21.15.135:0/1436408347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6390102a40 0x7f63901982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:05.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f6395778640 1 --2- 172.21.15.135:0/1436408347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6390107ca0 0x7f639019f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:05.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f638ffff640 1 -- 172.21.15.135:0/1436408347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6390102a40 msgr2=0x7f63901982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:05.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f638ffff640 1 --2- 172.21.15.135:0/1436408347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6390102a40 0x7f63901982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:05.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f638ffff640 1 -- 172.21.15.135:0/1436408347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6390107ca0 msgr2=0x7f639019f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:05.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f638ffff640 1 --2- 172.21.15.135:0/1436408347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6390107ca0 0x7f639019f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:05.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.838+0000 7f638ffff640 1 -- 172.21.15.135:0/1436408347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639019fec0 con 0x7f6390105370 2024-04-20T12:23:05.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.839+0000 7f638ffff640 1 --2- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6390105370 0x7f63901987e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f637c000c00 tx=0x7f637c02c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:05.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.839+0000 7f638dffb640 1 -- 172.21.15.135:0/1436408347 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c043020 con 0x7f6390105370 2024-04-20T12:23:05.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.839+0000 7f638dffb640 1 -- 172.21.15.135:0/1436408347 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f637c0054e0 con 0x7f6390105370 2024-04-20T12:23:05.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.839+0000 7f63971db640 1 -- 172.21.15.135:0/1436408347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63901a0150 con 0x7f6390105370 2024-04-20T12:23:05.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.839+0000 7f638dffb640 1 -- 172.21.15.135:0/1436408347 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c003ce0 con 0x7f6390105370 2024-04-20T12:23:05.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.839+0000 7f63971db640 1 -- 172.21.15.135:0/1436408347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63901a0670 con 0x7f6390105370 2024-04-20T12:23:05.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.840+0000 7f63971db640 1 -- 172.21.15.135:0/1436408347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63900fdf20 con 0x7f6390105370 2024-04-20T12:23:05.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.841+0000 7f638dffb640 1 -- 172.21.15.135:0/1436408347 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 19) ==== 138664+0+0 (secure 0 0 0) 0x7f637c046020 con 0x7f6390105370 2024-04-20T12:23:05.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.842+0000 7f638dffb640 1 --2- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f63800a3ca0 0x7f63800a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:05.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.842+0000 7f6394f77640 1 -- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f63800a3ca0 msgr2=0x7f63800a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3831149339 2024-04-20T12:23:05.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.842+0000 7f638dffb640 1 -- 172.21.15.135:0/1436408347 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9158+0+0 (secure 0 0 0) 0x7f637c0f28c0 con 0x7f6390105370 2024-04-20T12:23:05.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.842+0000 7f6394f77640 1 --2- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f63800a3ca0 0x7f63800a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T12:23:05.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:05.846+0000 7f638dffb640 1 -- 172.21.15.135:0/1436408347 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f637c04d020 con 0x7f6390105370 2024-04-20T12:23:05.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:05 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2429616448' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-20T12:23:05.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:05 smithi135 ceph-mon[18264]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-20T12:23:05.864 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:05 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:05.561+0000 7fdf0a2dc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-20T12:23:05.864 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:05 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:05.699+0000 7fdf0a2dc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-20T12:23:05.864 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:05 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:05.802+0000 7fdf0a2dc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-20T12:23:05.895 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:05 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2429616448' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-20T12:23:05.895 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:05 smithi139 ceph-mon[21834]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-20T12:23:05.895 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:05 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:05.589+0000 7f3eb996c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-20T12:23:05.928 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:05 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2429616448' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-20T12:23:05.928 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:05 smithi154 ceph-mon[22073]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-04-20T12:23:06.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:06.043+0000 7f6394f77640 1 -- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f63800a3ca0 msgr2=0x7f63800a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3831149339 2024-04-20T12:23:06.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:06.043+0000 7f6394f77640 1 --2- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f63800a3ca0 0x7f63800a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-20T12:23:06.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:06.064+0000 7f63971db640 1 -- 172.21.15.135:0/1436408347 --> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f6390062500 con 0x7f63800a3ca0 2024-04-20T12:23:06.236 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:05 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:05.925+0000 7fdf0a2dc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-20T12:23:06.251 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:05 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:05.929+0000 7f2808972200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-20T12:23:06.329 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:05 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:05.895+0000 7f3eb996c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-20T12:23:06.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:06.444+0000 7f6394f77640 1 -- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f63800a3ca0 msgr2=0x7f63800a6160 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.135:6800/3831149339 2024-04-20T12:23:06.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:06.444+0000 7f6394f77640 1 --2- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f63800a3ca0 0x7f63800a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-20T12:23:06.613 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:06 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:06.236+0000 7fdf0a2dc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-20T12:23:06.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:06.735+0000 7f638dffb640 1 -- 172.21.15.135:0/1436408347 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 20) ==== 138664+0+0 (secure 0 0 0) 0x7f637c0bae70 con 0x7f6390105370 2024-04-20T12:23:06.830 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:06 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:06.497+0000 7f3eb996c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-20T12:23:06.830 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:23:06 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y[23213]: 2024-04-20T12:23:06.710+0000 7f3eb996c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-20T12:23:06.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:06 smithi139 ceph-mon[21834]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-20T12:23:06.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:06 smithi139 ceph-mon[21834]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-20T12:23:06.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:06 smithi139 ceph-mon[21834]: Standby manager daemon y restarted 2024-04-20T12:23:06.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:06 smithi139 ceph-mon[21834]: Standby manager daemon y started 2024-04-20T12:23:06.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:06 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.139:0/1918413231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-20T12:23:06.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:06 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.139:0/1918413231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T12:23:06.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:06 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.139:0/1918413231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-20T12:23:06.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:06 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.139:0/1918413231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T12:23:07.001 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:06 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:06.533+0000 7f2808972200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-20T12:23:07.001 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:23:06 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z[23919]: 2024-04-20T12:23:06.753+0000 7f2808972200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-20T12:23:07.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:06 smithi154 ceph-mon[22073]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-20T12:23:07.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:06 smithi154 ceph-mon[22073]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-20T12:23:07.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:06 smithi154 ceph-mon[22073]: Standby manager daemon y restarted 2024-04-20T12:23:07.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:06 smithi154 ceph-mon[22073]: Standby manager daemon y started 2024-04-20T12:23:07.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:06 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.139:0/1918413231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-20T12:23:07.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:06 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.139:0/1918413231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T12:23:07.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:06 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.139:0/1918413231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-20T12:23:07.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:06 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.139:0/1918413231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T12:23:07.077 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:06 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:06.852+0000 7fdf0a2dc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-20T12:23:07.078 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:06 smithi135 ceph-mon[18264]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-04-20T12:23:07.078 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:06 smithi135 ceph-mon[18264]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-04-20T12:23:07.078 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:06 smithi135 ceph-mon[18264]: Standby manager daemon y restarted 2024-04-20T12:23:07.078 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:06 smithi135 ceph-mon[18264]: Standby manager daemon y started 2024-04-20T12:23:07.078 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:06 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.139:0/1918413231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-04-20T12:23:07.078 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:06 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.139:0/1918413231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T12:23:07.078 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:06 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.139:0/1918413231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-04-20T12:23:07.078 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:06 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.139:0/1918413231' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T12:23:07.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:07.091+0000 7f638dffb640 1 -- 172.21.15.135:0/1436408347 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mgrmap(e 21) ==== 138331+0+0 (secure 0 0 0) 0x7f637c003ce0 con 0x7f6390105370 2024-04-20T12:23:07.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:07.091+0000 7f638dffb640 1 -- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f63800a3ca0 msgr2=0x7f63800a6160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T12:23:07.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:07.091+0000 7f638dffb640 1 --2- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:6800/3831149339,v1:172.21.15.135:6801/3831149339] conn(0x7f63800a3ca0 0x7f63800a6160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:07.343 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:07.076+0000 7fdf0a2dc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-20T12:23:07.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:07.343+0000 7fde6cc52700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:23:07.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:07.343+0000 7fde6cc52700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:23:07.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:07.343+0000 7fde6cc52700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:23:07.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:07.343+0000 7fde6cc52700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:23:07.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:07.343+0000 7fde6cc52700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:23:07.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:07.343+0000 7fde69c4c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:23:07.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:07.343+0000 7fde69c4c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:23:07.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:07.343+0000 7fde69c4c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:23:07.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:07.343+0000 7fde69c4c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:23:07.614 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:07.343+0000 7fde69c4c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:23:08.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: mgrmap e20: x(active, since 9m), standbys: z, y 2024-04-20T12:23:08.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: Standby manager daemon z restarted 2024-04-20T12:23:08.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: Standby manager daemon z started 2024-04-20T12:23:08.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.154:0/546398023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-20T12:23:08.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.154:0/546398023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T12:23:08.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.154:0/546398023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-20T12:23:08.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.? 172.21.15.154:0/546398023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T12:23:08.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: Active manager daemon x restarted 2024-04-20T12:23:08.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: Activating manager daemon x 2024-04-20T12:23:08.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: osdmap e95: 12 total, 12 up, 12 in 2024-04-20T12:23:08.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: mgrmap e21: x(active, starting, since 0.014273s), standbys: y, z 2024-04-20T12:23:08.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:23:08.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:23:08.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-20T12:23:08.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:23:08.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:23:08.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:23:08.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:23:08.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:23:08.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:23:08.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:23:08.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:23:08.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:23:08.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:23:08.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:23:08.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:23:08.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T12:23:08.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T12:23:08.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T12:23:08.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: Manager daemon x is now available 2024-04-20T12:23:08.005 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:23:08.005 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-20T12:23:08.005 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-20T12:23:08.005 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-20T12:23:08.005 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:07 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-20T12:23:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: mgrmap e20: x(active, since 9m), standbys: z, y 2024-04-20T12:23:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: Standby manager daemon z restarted 2024-04-20T12:23:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: Standby manager daemon z started 2024-04-20T12:23:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.154:0/546398023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-20T12:23:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.154:0/546398023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T12:23:08.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.154:0/546398023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-20T12:23:08.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.? 172.21.15.154:0/546398023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T12:23:08.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: Active manager daemon x restarted 2024-04-20T12:23:08.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: Activating manager daemon x 2024-04-20T12:23:08.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: osdmap e95: 12 total, 12 up, 12 in 2024-04-20T12:23:08.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: mgrmap e21: x(active, starting, since 0.014273s), standbys: y, z 2024-04-20T12:23:08.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:23:08.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:23:08.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:23:08.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-20T12:23:08.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-20T12:23:08.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-20T12:23:08.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-20T12:23:08.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-20T12:23:08.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-20T12:23:08.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-20T12:23:08.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-20T12:23:08.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-20T12:23:08.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-20T12:23:08.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-20T12:23:08.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-20T12:23:08.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-20T12:23:08.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-20T12:23:08.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-20T12:23:08.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:23:08.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:23:08.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:23:08.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:23:08.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:23:08.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:23:08.083 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:23:08.083 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:23:08.083 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:23:08.083 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:23:08.083 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:23:08.083 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:23:08.083 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T12:23:08.083 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T12:23:08.083 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T12:23:08.083 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: Manager daemon x is now available 2024-04-20T12:23:08.083 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:23:08.083 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-20T12:23:08.083 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-20T12:23:08.084 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-20T12:23:08.084 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:07 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-20T12:23:08.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.097+0000 7f638dffb640 1 -- 172.21.15.135:0/1436408347 <== mon.0 v2:172.21.15.135:3300/0 9 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7f637c0f0070 con 0x7f6390105370 2024-04-20T12:23:08.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.098+0000 7f638dffb640 1 --2- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6380035890 0x7f6380035c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:08.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.098+0000 7f638dffb640 1 -- 172.21.15.135:0/1436408347 --> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f637c04ce70 con 0x7f6380035890 2024-04-20T12:23:08.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.102+0000 7f6394f77640 1 --2- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6380035890 0x7f6380035c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:08.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.108+0000 7f6394f77640 1 --2- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6380035890 0x7f6380035c70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f63840097d0 tx=0x7f6384005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: mgrmap e20: x(active, since 9m), standbys: z, y 2024-04-20T12:23:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: Standby manager daemon z restarted 2024-04-20T12:23:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: Standby manager daemon z started 2024-04-20T12:23:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.154:0/546398023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-04-20T12:23:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.154:0/546398023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-20T12:23:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.154:0/546398023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-04-20T12:23:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.? 172.21.15.154:0/546398023' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-20T12:23:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: Active manager daemon x restarted 2024-04-20T12:23:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: Activating manager daemon x 2024-04-20T12:23:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: osdmap e95: 12 total, 12 up, 12 in 2024-04-20T12:23:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: mgrmap e21: x(active, starting, since 0.014273s), standbys: y, z 2024-04-20T12:23:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-04-20T12:23:08.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-04-20T12:23:08.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-04-20T12:23:08.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-04-20T12:23:08.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-04-20T12:23:08.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-20T12:23:08.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-20T12:23:08.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-20T12:23:08.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-20T12:23:08.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-20T12:23:08.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-20T12:23:08.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-20T12:23:08.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-20T12:23:08.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-20T12:23:08.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-20T12:23:08.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-04-20T12:23:08.116 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-04-20T12:23:08.116 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-04-20T12:23:08.116 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-20T12:23:08.116 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-20T12:23:08.116 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-20T12:23:08.116 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-20T12:23:08.116 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-20T12:23:08.116 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-20T12:23:08.116 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-04-20T12:23:08.116 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-04-20T12:23:08.117 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-04-20T12:23:08.117 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-04-20T12:23:08.117 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-04-20T12:23:08.117 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-04-20T12:23:08.117 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-20T12:23:08.117 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-20T12:23:08.117 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-20T12:23:08.117 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: Manager daemon x is now available 2024-04-20T12:23:08.117 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:23:08.117 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-20T12:23:08.117 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-04-20T12:23:08.117 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-20T12:23:08.117 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:07 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-04-20T12:23:08.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.133+0000 7f638dffb640 1 -- 172.21.15.135:0/1436408347 <== mgr.25093 v2:172.21.15.135:6800/15232286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f637c04ce70 con 0x7f6380035890 2024-04-20T12:23:08.133 INFO:teuthology.orchestra.run.smithi135.stdout:{} 2024-04-20T12:23:08.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.135+0000 7f63971db640 1 -- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6380035890 msgr2=0x7f6380035c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:08.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.135+0000 7f63971db640 1 --2- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6380035890 0x7f6380035c70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f63840097d0 tx=0x7f6384005f90 comp rx=0 tx=0).stop 2024-04-20T12:23:08.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.135+0000 7f63971db640 1 -- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6390105370 msgr2=0x7f63901987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:08.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.135+0000 7f63971db640 1 --2- 172.21.15.135:0/1436408347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6390105370 0x7f63901987e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f637c000c00 tx=0x7f637c02c6c0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.136+0000 7f6395778640 1 -- 172.21.15.135:0/1436408347 reap_dead start 2024-04-20T12:23:08.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.136+0000 7f63971db640 1 -- 172.21.15.135:0/1436408347 shutdown_connections 2024-04-20T12:23:08.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.136+0000 7f63971db640 1 -- 172.21.15.135:0/1436408347 >> 172.21.15.135:0/1436408347 conn(0x7f63900fc430 msgr2=0x7f6390103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:08.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.136+0000 7f63971db640 1 -- 172.21.15.135:0/1436408347 shutdown_connections 2024-04-20T12:23:08.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.136+0000 7f63971db640 1 -- 172.21.15.135:0/1436408347 wait complete. 2024-04-20T12:23:08.149 INFO:teuthology.run_tasks:Running task check-counter... 2024-04-20T12:23:08.159 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-04-20T12:23:08.196 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:23:08.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.299+0000 7f6cb2011640 1 -- 172.21.15.135:0/3849142736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cac102a00 msgr2=0x7f6cac109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:08.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.299+0000 7f6cb2011640 1 --2- 172.21.15.135:0/3849142736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cac102a00 0x7f6cac109320 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009ca0 tx=0x7f6ca402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.299+0000 7f6cb2011640 1 -- 172.21.15.135:0/3849142736 shutdown_connections 2024-04-20T12:23:08.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.299+0000 7f6cb2011640 1 --2- 172.21.15.135:0/3849142736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cac102a00 0x7f6cac109320 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.299+0000 7f6cb2011640 1 --2- 172.21.15.135:0/3849142736 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cac102040 0x7f6cac1024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.299+0000 7f6cb2011640 1 --2- 172.21.15.135:0/3849142736 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cac100e60 0x7f6cac101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.299+0000 7f6cb2011640 1 -- 172.21.15.135:0/3849142736 >> 172.21.15.135:0/3849142736 conn(0x7f6cac0fc440 msgr2=0x7f6cac0fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:08.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.299+0000 7f6cb2011640 1 -- 172.21.15.135:0/3849142736 shutdown_connections 2024-04-20T12:23:08.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.299+0000 7f6cb2011640 1 -- 172.21.15.135:0/3849142736 wait complete. 2024-04-20T12:23:08.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.299+0000 7f6cb2011640 1 Processor -- start 2024-04-20T12:23:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cb2011640 1 -- start start 2024-04-20T12:23:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cb2011640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cac100e60 0x7f6cac1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cb2011640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cac102040 0x7f6cac198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cb2011640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cac102a00 0x7f6cac19f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cb2011640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac10cb40 con 0x7f6cac102a00 2024-04-20T12:23:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cb2011640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac10c9c0 con 0x7f6cac100e60 2024-04-20T12:23:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cb2011640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac10ccc0 con 0x7f6cac102040 2024-04-20T12:23:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cabfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cac102a00 0x7f6cac19f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cabfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cac102a00 0x7f6cac19f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48654/0 (socket says 172.21.15.135:48654) 2024-04-20T12:23:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cabfff640 1 -- 172.21.15.135:0/2502052838 learned_addr learned my addr 172.21.15.135:0/2502052838 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6caaffd640 1 --2- 172.21.15.135:0/2502052838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cac102040 0x7f6cac198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cab7fe640 1 --2- 172.21.15.135:0/2502052838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cac100e60 0x7f6cac1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cabfff640 1 -- 172.21.15.135:0/2502052838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cac102040 msgr2=0x7f6cac198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:08.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cabfff640 1 --2- 172.21.15.135:0/2502052838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cac102040 0x7f6cac198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cabfff640 1 -- 172.21.15.135:0/2502052838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cac100e60 msgr2=0x7f6cac1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:08.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cabfff640 1 --2- 172.21.15.135:0/2502052838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cac100e60 0x7f6cac1982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cabfff640 1 -- 172.21.15.135:0/2502052838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac19ff00 con 0x7f6cac102a00 2024-04-20T12:23:08.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6cabfff640 1 --2- 172.21.15.135:0/2502052838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cac102a00 0x7f6cac19f890 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4032530 tx=0x7f6ca4032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:08.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.300+0000 7f6ca8ff9640 1 -- 172.21.15.135:0/2502052838 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4041020 con 0x7f6cac102a00 2024-04-20T12:23:08.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.301+0000 7f6cb2011640 1 -- 172.21.15.135:0/2502052838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cac1a0190 con 0x7f6cac102a00 2024-04-20T12:23:08.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.301+0000 7f6ca8ff9640 1 -- 172.21.15.135:0/2502052838 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ca4034cd0 con 0x7f6cac102a00 2024-04-20T12:23:08.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.301+0000 7f6ca8ff9640 1 -- 172.21.15.135:0/2502052838 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4039040 con 0x7f6cac102a00 2024-04-20T12:23:08.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.301+0000 7f6cb2011640 1 -- 172.21.15.135:0/2502052838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cac1a0650 con 0x7f6cac102a00 2024-04-20T12:23:08.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.301+0000 7f6cb2011640 1 -- 172.21.15.135:0/2502052838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cac1a08b0 con 0x7f6cac102a00 2024-04-20T12:23:08.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.303+0000 7f6ca8ff9640 1 -- 172.21.15.135:0/2502052838 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7f6ca4044020 con 0x7f6cac102a00 2024-04-20T12:23:08.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.303+0000 7f6ca8ff9640 1 --2- 172.21.15.135:0/2502052838 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c940a39b0 0x7f6c940a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:08.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.303+0000 7f6cab7fe640 1 --2- 172.21.15.135:0/2502052838 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c940a39b0 0x7f6c940a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:08.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.303+0000 7f6ca8ff9640 1 -- 172.21.15.135:0/2502052838 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f6ca40f2740 con 0x7f6cac102a00 2024-04-20T12:23:08.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.304+0000 7f6cab7fe640 1 --2- 172.21.15.135:0/2502052838 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c940a39b0 0x7f6c940a5e70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6cac101bb0 tx=0x7f6c9c005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:08.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.307+0000 7f6ca8ff9640 1 -- 172.21.15.135:0/2502052838 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f6ca404b020 con 0x7f6cac102a00 2024-04-20T12:23:08.401 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:08.116+0000 7fde66c46700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:23:08.401 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:08.116+0000 7fde66c46700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:23:08.401 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:08.116+0000 7fde66c46700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:23:08.401 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:08.116+0000 7fde66c46700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:23:08.401 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:23:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:23:08.116+0000 7fde66c46700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:23:08.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.498+0000 7f6cb2011640 1 -- 172.21.15.135:0/2502052838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6cac1a0c40 con 0x7f6cac102a00 2024-04-20T12:23:08.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.499+0000 7f6ca8ff9640 1 -- 172.21.15.135:0/2502052838 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+25197 (secure 0 0 0) 0x7f6ca40bf000 con 0x7f6cac102a00 2024-04-20T12:23:08.499 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:23:08.500 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":95,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:23:07.080106+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2052292307":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/669936771":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/4276159294":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6800/3831149339":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/1087722944":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6801/3831149339":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:23:08.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.502+0000 7f6cb2011640 1 -- 172.21.15.135:0/2502052838 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c940a39b0 msgr2=0x7f6c940a5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:08.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.502+0000 7f6cb2011640 1 --2- 172.21.15.135:0/2502052838 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c940a39b0 0x7f6c940a5e70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6cac101bb0 tx=0x7f6c9c005f90 comp rx=0 tx=0).stop 2024-04-20T12:23:08.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.502+0000 7f6cb2011640 1 -- 172.21.15.135:0/2502052838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cac102a00 msgr2=0x7f6cac19f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:08.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.502+0000 7f6cb2011640 1 --2- 172.21.15.135:0/2502052838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cac102a00 0x7f6cac19f890 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4032530 tx=0x7f6ca4032f40 comp rx=0 tx=0).stop 2024-04-20T12:23:08.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.502+0000 7f6cb2011640 1 -- 172.21.15.135:0/2502052838 shutdown_connections 2024-04-20T12:23:08.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.502+0000 7f6cb2011640 1 --2- 172.21.15.135:0/2502052838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6cac102a00 0x7f6cac19f890 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.502+0000 7f6cb2011640 1 --2- 172.21.15.135:0/2502052838 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c940a39b0 0x7f6c940a5e70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.502+0000 7f6cb2011640 1 --2- 172.21.15.135:0/2502052838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6cac102040 0x7f6cac198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.502+0000 7f6cb2011640 1 --2- 172.21.15.135:0/2502052838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6cac100e60 0x7f6cac1982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.502+0000 7f6cb2011640 1 -- 172.21.15.135:0/2502052838 >> 172.21.15.135:0/2502052838 conn(0x7f6cac0fc440 msgr2=0x7f6cac0fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:08.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.502+0000 7f6cb2011640 1 -- 172.21.15.135:0/2502052838 shutdown_connections 2024-04-20T12:23:08.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.502+0000 7f6cb2011640 1 -- 172.21.15.135:0/2502052838 wait complete. 2024-04-20T12:23:08.514 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T12:16:02.802023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T12:20:39.656129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T12:20:40.312827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T12:20:44.307136+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T12:23:08.514 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T12:23:08.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.620+0000 7fab5185c640 1 -- 172.21.15.135:0/1940066731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab4c101fb0 msgr2=0x7fab4c1023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:08.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.620+0000 7fab5185c640 1 --2- 172.21.15.135:0/1940066731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab4c101fb0 0x7fab4c1023d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009900 tx=0x7fab3c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:08.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.620+0000 7fab5185c640 1 -- 172.21.15.135:0/1940066731 shutdown_connections 2024-04-20T12:23:08.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.620+0000 7fab5185c640 1 --2- 172.21.15.135:0/1940066731 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab4c103b60 0x7fab4c10a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.620+0000 7fab5185c640 1 --2- 172.21.15.135:0/1940066731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab4c1031a0 0x7fab4c103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.620+0000 7fab5185c640 1 --2- 172.21.15.135:0/1940066731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab4c101fb0 0x7fab4c1023d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.620+0000 7fab5185c640 1 -- 172.21.15.135:0/1940066731 >> 172.21.15.135:0/1940066731 conn(0x7fab4c0fd540 msgr2=0x7fab4c0ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:08.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.620+0000 7fab5185c640 1 -- 172.21.15.135:0/1940066731 shutdown_connections 2024-04-20T12:23:08.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.620+0000 7fab5185c640 1 -- 172.21.15.135:0/1940066731 wait complete. 2024-04-20T12:23:08.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.620+0000 7fab5185c640 1 Processor -- start 2024-04-20T12:23:08.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.620+0000 7fab5185c640 1 -- start start 2024-04-20T12:23:08.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab5185c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab4c101fb0 0x7fab4c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab5185c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab4c1031a0 0x7fab4c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab5185c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab4c103b60 0x7fab4c19f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab5185c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c10dc40 con 0x7fab4c101fb0 2024-04-20T12:23:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab5185c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c10dac0 con 0x7fab4c1031a0 2024-04-20T12:23:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab5185c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c10ddc0 con 0x7fab4c103b60 2024-04-20T12:23:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab4affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab4c101fb0 0x7fab4c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab4affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab4c101fb0 0x7fab4c198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48670/0 (socket says 172.21.15.135:48670) 2024-04-20T12:23:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab4affd640 1 -- 172.21.15.135:0/193926135 learned_addr learned my addr 172.21.15.135:0/193926135 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab4b7fe640 1 --2- 172.21.15.135:0/193926135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab4c103b60 0x7fab4c19f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab4a7fc640 1 --2- 172.21.15.135:0/193926135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab4c1031a0 0x7fab4c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab4affd640 1 -- 172.21.15.135:0/193926135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab4c103b60 msgr2=0x7fab4c19f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab4affd640 1 --2- 172.21.15.135:0/193926135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab4c103b60 0x7fab4c19f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab4affd640 1 -- 172.21.15.135:0/193926135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab4c1031a0 msgr2=0x7fab4c198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab4affd640 1 --2- 172.21.15.135:0/193926135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab4c1031a0 0x7fab4c198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab4affd640 1 -- 172.21.15.135:0/193926135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4c19ff20 con 0x7fab4c101fb0 2024-04-20T12:23:08.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab4a7fc640 1 --2- 172.21.15.135:0/193926135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab4c1031a0 0x7fab4c198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:08.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab4affd640 1 --2- 172.21.15.135:0/193926135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab4c101fb0 0x7fab4c198300 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fab3c000c00 tx=0x7fab3c02c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:08.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab5085a640 1 -- 172.21.15.135:0/193926135 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c041070 con 0x7fab4c101fb0 2024-04-20T12:23:08.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab5185c640 1 -- 172.21.15.135:0/193926135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab4c1a01b0 con 0x7fab4c101fb0 2024-04-20T12:23:08.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab5085a640 1 -- 172.21.15.135:0/193926135 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab3c004450 con 0x7fab4c101fb0 2024-04-20T12:23:08.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab5085a640 1 -- 172.21.15.135:0/193926135 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c034440 con 0x7fab4c101fb0 2024-04-20T12:23:08.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.621+0000 7fab5185c640 1 -- 172.21.15.135:0/193926135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab4c1a06a0 con 0x7fab4c101fb0 2024-04-20T12:23:08.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.622+0000 7fab5185c640 1 -- 172.21.15.135:0/193926135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab4c109350 con 0x7fab4c101fb0 2024-04-20T12:23:08.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.623+0000 7fab5085a640 1 -- 172.21.15.135:0/193926135 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7fab3c044070 con 0x7fab4c101fb0 2024-04-20T12:23:08.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.624+0000 7fab5085a640 1 --2- 172.21.15.135:0/193926135 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fab340a39b0 0x7fab340a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:08.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.624+0000 7fab4a7fc640 1 --2- 172.21.15.135:0/193926135 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fab340a39b0 0x7fab340a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:08.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.624+0000 7fab5085a640 1 -- 172.21.15.135:0/193926135 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fab3c0f2210 con 0x7fab4c101fb0 2024-04-20T12:23:08.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.624+0000 7fab4a7fc640 1 --2- 172.21.15.135:0/193926135 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fab340a39b0 0x7fab340a5e70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fab4c199810 tx=0x7fab40005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:08.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.628+0000 7fab5085a640 1 -- 172.21.15.135:0/193926135 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fab3c0bead0 con 0x7fab4c101fb0 2024-04-20T12:23:08.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.807+0000 7fab5185c640 1 -- 172.21.15.135:0/193926135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fab4c02d760 con 0x7fab4c101fb0 2024-04-20T12:23:08.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.807+0000 7fab5085a640 1 -- 172.21.15.135:0/193926135 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7fab3c0be3d0 con 0x7fab4c101fb0 2024-04-20T12:23:08.807 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-04-20T12:23:08.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.809+0000 7fab5185c640 1 -- 172.21.15.135:0/193926135 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fab340a39b0 msgr2=0x7fab340a5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:08.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.809+0000 7fab5185c640 1 --2- 172.21.15.135:0/193926135 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fab340a39b0 0x7fab340a5e70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fab4c199810 tx=0x7fab40005f90 comp rx=0 tx=0).stop 2024-04-20T12:23:08.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.809+0000 7fab5185c640 1 -- 172.21.15.135:0/193926135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab4c101fb0 msgr2=0x7fab4c198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:08.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.809+0000 7fab5185c640 1 --2- 172.21.15.135:0/193926135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab4c101fb0 0x7fab4c198300 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fab3c000c00 tx=0x7fab3c02c640 comp rx=0 tx=0).stop 2024-04-20T12:23:08.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.809+0000 7fab5185c640 1 -- 172.21.15.135:0/193926135 shutdown_connections 2024-04-20T12:23:08.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.809+0000 7fab5185c640 1 --2- 172.21.15.135:0/193926135 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fab340a39b0 0x7fab340a5e70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.809+0000 7fab5185c640 1 --2- 172.21.15.135:0/193926135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab4c103b60 0x7fab4c19f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.809+0000 7fab5185c640 1 --2- 172.21.15.135:0/193926135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fab4c1031a0 0x7fab4c198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.809+0000 7fab5185c640 1 --2- 172.21.15.135:0/193926135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fab4c101fb0 0x7fab4c198300 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.809+0000 7fab5185c640 1 -- 172.21.15.135:0/193926135 >> 172.21.15.135:0/193926135 conn(0x7fab4c0fd540 msgr2=0x7fab4c106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:08.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.810+0000 7fab5185c640 1 -- 172.21.15.135:0/193926135 shutdown_connections 2024-04-20T12:23:08.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.810+0000 7fab5185c640 1 -- 172.21.15.135:0/193926135 wait complete. 2024-04-20T12:23:08.821 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T12:23:08.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.928+0000 7f1610b2e640 1 -- 172.21.15.135:0/934444905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c102a10 msgr2=0x7f160c109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:08.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.928+0000 7f1610b2e640 1 --2- 172.21.15.135:0/934444905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c102a10 0x7f160c109330 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1604009ca0 tx=0x7f160402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.928+0000 7f1610b2e640 1 -- 172.21.15.135:0/934444905 shutdown_connections 2024-04-20T12:23:08.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.928+0000 7f1610b2e640 1 --2- 172.21.15.135:0/934444905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c102a10 0x7f160c109330 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.928+0000 7f1610b2e640 1 --2- 172.21.15.135:0/934444905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f160c102050 0x7f160c1024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.928+0000 7f1610b2e640 1 --2- 172.21.15.135:0/934444905 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f160c100e70 0x7f160c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.928+0000 7f1610b2e640 1 -- 172.21.15.135:0/934444905 >> 172.21.15.135:0/934444905 conn(0x7f160c0fc430 msgr2=0x7f160c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:08.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.928+0000 7f1610b2e640 1 -- 172.21.15.135:0/934444905 shutdown_connections 2024-04-20T12:23:08.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.928+0000 7f1610b2e640 1 -- 172.21.15.135:0/934444905 wait complete. 2024-04-20T12:23:08.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1610b2e640 1 Processor -- start 2024-04-20T12:23:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1610b2e640 1 -- start start 2024-04-20T12:23:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1610b2e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f160c100e70 0x7f160c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1610b2e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c102050 0x7f160c198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1610b2e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f160c102a10 0x7f160c19f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1610b2e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f160c10cb50 con 0x7f160c102050 2024-04-20T12:23:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1610b2e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f160c10c9d0 con 0x7f160c102a10 2024-04-20T12:23:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1610b2e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f160c10ccd0 con 0x7f160c100e70 2024-04-20T12:23:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1609d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c102050 0x7f160c198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1609d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c102050 0x7f160c198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48696/0 (socket says 172.21.15.135:48696) 2024-04-20T12:23:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f160a59c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f160c100e70 0x7f160c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1609d9b640 1 -- 172.21.15.135:0/4160873489 learned_addr learned my addr 172.21.15.135:0/4160873489 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f160ad9d640 1 --2- 172.21.15.135:0/4160873489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f160c102a10 0x7f160c19f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1609d9b640 1 -- 172.21.15.135:0/4160873489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f160c100e70 msgr2=0x7f160c1982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1609d9b640 1 --2- 172.21.15.135:0/4160873489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f160c100e70 0x7f160c1982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1609d9b640 1 -- 172.21.15.135:0/4160873489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f160c102a10 msgr2=0x7f160c19f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1609d9b640 1 --2- 172.21.15.135:0/4160873489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f160c102a10 0x7f160c19f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f1609d9b640 1 -- 172.21.15.135:0/4160873489 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160c19fef0 con 0x7f160c102050 2024-04-20T12:23:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.929+0000 7f160a59c640 1 --2- 172.21.15.135:0/4160873489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f160c100e70 0x7f160c1982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.930+0000 7f1609d9b640 1 --2- 172.21.15.135:0/4160873489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c102050 0x7f160c198810 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00e9f0 tx=0x7f15fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.930+0000 7f15fb7fe640 1 -- 172.21.15.135:0/4160873489 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00cd80 con 0x7f160c102050 2024-04-20T12:23:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.930+0000 7f1610b2e640 1 -- 172.21.15.135:0/4160873489 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160c1a01e0 con 0x7f160c102050 2024-04-20T12:23:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.930+0000 7f15fb7fe640 1 -- 172.21.15.135:0/4160873489 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15fc010910 con 0x7f160c102050 2024-04-20T12:23:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.930+0000 7f15fb7fe640 1 -- 172.21.15.135:0/4160873489 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0188f0 con 0x7f160c102050 2024-04-20T12:23:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.930+0000 7f1610b2e640 1 -- 172.21.15.135:0/4160873489 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f160c1a0780 con 0x7f160c102050 2024-04-20T12:23:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.931+0000 7f1610b2e640 1 -- 172.21.15.135:0/4160873489 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f160c1a09e0 con 0x7f160c102050 2024-04-20T12:23:08.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.932+0000 7f15fb7fe640 1 -- 172.21.15.135:0/4160873489 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 22) ==== 138458+0+0 (secure 0 0 0) 0x7f15fc010ac0 con 0x7f160c102050 2024-04-20T12:23:08.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.933+0000 7f15fb7fe640 1 --2- 172.21.15.135:0/4160873489 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f15f40a39b0 0x7f15f40a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:08.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.933+0000 7f160a59c640 1 --2- 172.21.15.135:0/4160873489 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f15f40a39b0 0x7f15f40a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:08.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.933+0000 7f15fb7fe640 1 -- 172.21.15.135:0/4160873489 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f15fc0d0bd0 con 0x7f160c102050 2024-04-20T12:23:08.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.933+0000 7f160a59c640 1 --2- 172.21.15.135:0/4160873489 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f15f40a39b0 0x7f15f40a5e70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f160c101bc0 tx=0x7f1600005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:08.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:08.937+0000 7f15fb7fe640 1 -- 172.21.15.135:0/4160873489 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f15fc09cdb0 con 0x7f160c102050 2024-04-20T12:23:09.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.110+0000 7f15fb7fe640 1 -- 172.21.15.135:0/4160873489 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 23) ==== 138818+0+0 (secure 0 0 0) 0x7f15fc099420 con 0x7f160c102050 2024-04-20T12:23:09.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.140+0000 7f1610b2e640 1 -- 172.21.15.135:0/4160873489 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f160c1a0bb0 con 0x7f160c102050 2024-04-20T12:23:09.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.141+0000 7f15fb7fe640 1 -- 172.21.15.135:0/4160873489 <== mon.0 v2:172.21.15.135:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) ==== 104+0+11 (secure 0 0 0) 0x7f15fc057540 con 0x7f160c102050 2024-04-20T12:23:09.140 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:23:09.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.143+0000 7f1610b2e640 1 -- 172.21.15.135:0/4160873489 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f15f40a39b0 msgr2=0x7f15f40a5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:09.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.143+0000 7f1610b2e640 1 --2- 172.21.15.135:0/4160873489 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f15f40a39b0 0x7f15f40a5e70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f160c101bc0 tx=0x7f1600005f90 comp rx=0 tx=0).stop 2024-04-20T12:23:09.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.143+0000 7f1610b2e640 1 -- 172.21.15.135:0/4160873489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c102050 msgr2=0x7f160c198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:09.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.143+0000 7f1610b2e640 1 --2- 172.21.15.135:0/4160873489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c102050 0x7f160c198810 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00e9f0 tx=0x7f15fc00eeb0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.143+0000 7f1610b2e640 1 -- 172.21.15.135:0/4160873489 shutdown_connections 2024-04-20T12:23:09.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.143+0000 7f1610b2e640 1 --2- 172.21.15.135:0/4160873489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f160c102a10 0x7f160c19f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.143+0000 7f1610b2e640 1 --2- 172.21.15.135:0/4160873489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f160c102050 0x7f160c198810 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.143+0000 7f1610b2e640 1 --2- 172.21.15.135:0/4160873489 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f15f40a39b0 0x7f15f40a5e70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.143+0000 7f1610b2e640 1 --2- 172.21.15.135:0/4160873489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f160c100e70 0x7f160c1982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.143+0000 7f1610b2e640 1 -- 172.21.15.135:0/4160873489 >> 172.21.15.135:0/4160873489 conn(0x7f160c0fc430 msgr2=0x7f160c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:09.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.143+0000 7f1610b2e640 1 -- 172.21.15.135:0/4160873489 shutdown_connections 2024-04-20T12:23:09.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.143+0000 7f1610b2e640 1 -- 172.21.15.135:0/4160873489 wait complete. 2024-04-20T12:23:09.156 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T12:23:09.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.271+0000 7fc50f738640 1 -- 172.21.15.135:0/822405814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc508103bf0 msgr2=0x7fc50810a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:09.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.271+0000 7fc50f738640 1 --2- 172.21.15.135:0/822405814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc508103bf0 0x7fc50810a480 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc500009cd0 tx=0x7fc50002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.271+0000 7fc50f738640 1 -- 172.21.15.135:0/822405814 shutdown_connections 2024-04-20T12:23:09.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.271+0000 7fc50f738640 1 --2- 172.21.15.135:0/822405814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc508103bf0 0x7fc50810a480 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.271+0000 7fc50f738640 1 --2- 172.21.15.135:0/822405814 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508103230 0x7fc5081036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.271+0000 7fc50f738640 1 --2- 172.21.15.135:0/822405814 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc508100260 0x7fc508100680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.271+0000 7fc50f738640 1 -- 172.21.15.135:0/822405814 >> 172.21.15.135:0/822405814 conn(0x7fc5080fbb90 msgr2=0x7fc5080fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:09.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.271+0000 7fc50f738640 1 -- 172.21.15.135:0/822405814 shutdown_connections 2024-04-20T12:23:09.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.271+0000 7fc50f738640 1 -- 172.21.15.135:0/822405814 wait complete. 2024-04-20T12:23:09.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.272+0000 7fc50f738640 1 Processor -- start 2024-04-20T12:23:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.272+0000 7fc50f738640 1 -- start start 2024-04-20T12:23:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.272+0000 7fc50f738640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508100260 0x7fc508102ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.272+0000 7fc50f738640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc508103230 0x7fc5081011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.272+0000 7fc50f738640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc508103bf0 0x7fc508101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.273+0000 7fc50f738640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc50810dc50 con 0x7fc508103bf0 2024-04-20T12:23:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.273+0000 7fc50ccd3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc508103230 0x7fc5081011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.273+0000 7fc50f738640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc50810dad0 con 0x7fc508100260 2024-04-20T12:23:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.273+0000 7fc50f738640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc50810ddd0 con 0x7fc508103230 2024-04-20T12:23:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.273+0000 7fc50dcd5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc508103bf0 0x7fc508101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.273+0000 7fc50ccd3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc508103230 0x7fc5081011e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.135:58430/0 (socket says 172.21.15.135:58430) 2024-04-20T12:23:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.273+0000 7fc50ccd3640 1 -- 172.21.15.135:0/2710319077 learned_addr learned my addr 172.21.15.135:0/2710319077 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.273+0000 7fc50d4d4640 1 --2- 172.21.15.135:0/2710319077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508100260 0x7fc508102ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:09.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.273+0000 7fc50dcd5640 1 -- 172.21.15.135:0/2710319077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc508103230 msgr2=0x7fc5081011e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:09.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.273+0000 7fc50dcd5640 1 --2- 172.21.15.135:0/2710319077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc508103230 0x7fc5081011e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.273+0000 7fc50dcd5640 1 -- 172.21.15.135:0/2710319077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508100260 msgr2=0x7fc508102ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:09.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.273+0000 7fc50dcd5640 1 --2- 172.21.15.135:0/2710319077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508100260 0x7fc508102ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.273+0000 7fc50dcd5640 1 -- 172.21.15.135:0/2710319077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc508101fb0 con 0x7fc508103bf0 2024-04-20T12:23:09.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.273+0000 7fc50ccd3640 1 --2- 172.21.15.135:0/2710319077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc508103230 0x7fc5081011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:09.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.273+0000 7fc50dcd5640 1 --2- 172.21.15.135:0/2710319077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc508103bf0 0x7fc508101720 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc500037040 tx=0x7fc5000346d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:09.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.276+0000 7fc4fe7fc640 1 -- 172.21.15.135:0/2710319077 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500041020 con 0x7fc508103bf0 2024-04-20T12:23:09.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.276+0000 7fc50f738640 1 -- 172.21.15.135:0/2710319077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5081a2370 con 0x7fc508103bf0 2024-04-20T12:23:09.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.276+0000 7fc50f738640 1 -- 172.21.15.135:0/2710319077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5081a28e0 con 0x7fc508103bf0 2024-04-20T12:23:09.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.276+0000 7fc4fe7fc640 1 -- 172.21.15.135:0/2710319077 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc500032890 con 0x7fc508103bf0 2024-04-20T12:23:09.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.276+0000 7fc4fe7fc640 1 -- 172.21.15.135:0/2710319077 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc500039040 con 0x7fc508103bf0 2024-04-20T12:23:09.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.277+0000 7fc50f738640 1 -- 172.21.15.135:0/2710319077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4ec0052c0 con 0x7fc508103bf0 2024-04-20T12:23:09.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.279+0000 7fc4fe7fc640 1 -- 172.21.15.135:0/2710319077 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138818+0+0 (secure 0 0 0) 0x7fc500044020 con 0x7fc508103bf0 2024-04-20T12:23:09.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.280+0000 7fc4fe7fc640 1 --2- 172.21.15.135:0/2710319077 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc4f40a3e30 0x7fc4f40a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:09.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.280+0000 7fc50d4d4640 1 --2- 172.21.15.135:0/2710319077 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc4f40a3e30 0x7fc4f40a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:09.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.280+0000 7fc4fe7fc640 1 -- 172.21.15.135:0/2710319077 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc5000f24a0 con 0x7fc508103bf0 2024-04-20T12:23:09.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.280+0000 7fc50d4d4640 1 --2- 172.21.15.135:0/2710319077 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc4f40a3e30 0x7fc4f40a62f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc508068ef0 tx=0x7fc504005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:09.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.284+0000 7fc4fe7fc640 1 -- 172.21.15.135:0/2710319077 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fc50004b030 con 0x7fc508103bf0 2024-04-20T12:23:09.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:09 smithi135 ceph-mon[18264]: mgrmap e22: x(active, since 1.02543s), standbys: y, z 2024-04-20T12:23:09.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:09 smithi135 ceph-mon[18264]: [20/Apr/2024:12:23:08] ENGINE Bus STARTING 2024-04-20T12:23:09.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:09 smithi135 ceph-mon[18264]: [20/Apr/2024:12:23:08] ENGINE Serving on http://172.21.15.135:8765 2024-04-20T12:23:09.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:09 smithi135 ceph-mon[18264]: [20/Apr/2024:12:23:08] ENGINE Serving on https://172.21.15.135:7150 2024-04-20T12:23:09.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:09 smithi135 ceph-mon[18264]: [20/Apr/2024:12:23:08] ENGINE Bus STARTED 2024-04-20T12:23:09.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:09 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2502052838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:23:09.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:09 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/193926135' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:23:09.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.472+0000 7fc50f738640 1 -- 172.21.15.135:0/2710319077 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc4ec005880 con 0x7fc508103bf0 2024-04-20T12:23:09.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.473+0000 7fc4fe7fc640 1 -- 172.21.15.135:0/2710319077 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) ==== 100+0+11 (secure 0 0 0) 0x7fc5000be7e0 con 0x7fc508103bf0 2024-04-20T12:23:09.473 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-04-20T12:23:09.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.475+0000 7fc50f738640 1 -- 172.21.15.135:0/2710319077 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc4f40a3e30 msgr2=0x7fc4f40a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:09.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.475+0000 7fc50f738640 1 --2- 172.21.15.135:0/2710319077 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc4f40a3e30 0x7fc4f40a62f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc508068ef0 tx=0x7fc504005f90 comp rx=0 tx=0).stop 2024-04-20T12:23:09.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.475+0000 7fc50f738640 1 -- 172.21.15.135:0/2710319077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc508103bf0 msgr2=0x7fc508101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:09.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.475+0000 7fc50f738640 1 --2- 172.21.15.135:0/2710319077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc508103bf0 0x7fc508101720 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc500037040 tx=0x7fc5000346d0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.475+0000 7fc50f738640 1 -- 172.21.15.135:0/2710319077 shutdown_connections 2024-04-20T12:23:09.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.475+0000 7fc50f738640 1 --2- 172.21.15.135:0/2710319077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc508103bf0 0x7fc508101720 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.475+0000 7fc50f738640 1 --2- 172.21.15.135:0/2710319077 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc4f40a3e30 0x7fc4f40a62f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.475+0000 7fc50f738640 1 --2- 172.21.15.135:0/2710319077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc508103230 0x7fc5081011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.475+0000 7fc50f738640 1 --2- 172.21.15.135:0/2710319077 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc508100260 0x7fc508102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.475+0000 7fc50f738640 1 -- 172.21.15.135:0/2710319077 >> 172.21.15.135:0/2710319077 conn(0x7fc5080fbb90 msgr2=0x7fc508106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:09.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.475+0000 7fc50f738640 1 -- 172.21.15.135:0/2710319077 shutdown_connections 2024-04-20T12:23:09.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.475+0000 7fc50f738640 1 -- 172.21.15.135:0/2710319077 wait complete. 2024-04-20T12:23:09.487 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T12:23:09.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:09 smithi154 ceph-mon[22073]: mgrmap e22: x(active, since 1.02543s), standbys: y, z 2024-04-20T12:23:09.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:09 smithi154 ceph-mon[22073]: [20/Apr/2024:12:23:08] ENGINE Bus STARTING 2024-04-20T12:23:09.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:09 smithi154 ceph-mon[22073]: [20/Apr/2024:12:23:08] ENGINE Serving on http://172.21.15.135:8765 2024-04-20T12:23:09.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:09 smithi154 ceph-mon[22073]: [20/Apr/2024:12:23:08] ENGINE Serving on https://172.21.15.135:7150 2024-04-20T12:23:09.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:09 smithi154 ceph-mon[22073]: [20/Apr/2024:12:23:08] ENGINE Bus STARTED 2024-04-20T12:23:09.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:09 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2502052838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:23:09.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:09 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/193926135' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:23:09.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:09 smithi139 ceph-mon[21834]: mgrmap e22: x(active, since 1.02543s), standbys: y, z 2024-04-20T12:23:09.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:09 smithi139 ceph-mon[21834]: [20/Apr/2024:12:23:08] ENGINE Bus STARTING 2024-04-20T12:23:09.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:09 smithi139 ceph-mon[21834]: [20/Apr/2024:12:23:08] ENGINE Serving on http://172.21.15.135:8765 2024-04-20T12:23:09.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:09 smithi139 ceph-mon[21834]: [20/Apr/2024:12:23:08] ENGINE Serving on https://172.21.15.135:7150 2024-04-20T12:23:09.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:09 smithi139 ceph-mon[21834]: [20/Apr/2024:12:23:08] ENGINE Bus STARTED 2024-04-20T12:23:09.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:09 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2502052838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:23:09.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:09 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/193926135' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:23:09.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.592+0000 7f3c07db2640 1 -- 172.21.15.135:0/3912061826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c001029b0 msgr2=0x7f3c001092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:09.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.592+0000 7f3c07db2640 1 --2- 172.21.15.135:0/3912061826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c001029b0 0x7f3c001092d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009ca0 tx=0x7f3bf802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.592+0000 7f3c07db2640 1 -- 172.21.15.135:0/3912061826 shutdown_connections 2024-04-20T12:23:09.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.592+0000 7f3c07db2640 1 --2- 172.21.15.135:0/3912061826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c001029b0 0x7f3c001092d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.592+0000 7f3c07db2640 1 --2- 172.21.15.135:0/3912061826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c00101ff0 0x7f3c00102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.592+0000 7f3c07db2640 1 --2- 172.21.15.135:0/3912061826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c00100ea0 0x7f3c001012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.592+0000 7f3c07db2640 1 -- 172.21.15.135:0/3912061826 >> 172.21.15.135:0/3912061826 conn(0x7f3c000fc410 msgr2=0x7f3c000fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:09.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.592+0000 7f3c07db2640 1 -- 172.21.15.135:0/3912061826 shutdown_connections 2024-04-20T12:23:09.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.592+0000 7f3c07db2640 1 -- 172.21.15.135:0/3912061826 wait complete. 2024-04-20T12:23:09.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.592+0000 7f3c07db2640 1 Processor -- start 2024-04-20T12:23:09.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.592+0000 7f3c07db2640 1 -- start start 2024-04-20T12:23:09.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c07db2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c00100ea0 0x7f3c001971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:09.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c07db2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c00101ff0 0x7f3c001976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:09.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c07db2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c001029b0 0x7f3c0019e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:09.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c07db2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0010cb50 con 0x7f3c00101ff0 2024-04-20T12:23:09.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c07db2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0010c9d0 con 0x7f3c001029b0 2024-04-20T12:23:09.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c07db2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0010ccd0 con 0x7f3c00100ea0 2024-04-20T12:23:09.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c0534d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c00101ff0 0x7f3c001976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:09.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c0534d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c00101ff0 0x7f3c001976e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48742/0 (socket says 172.21.15.135:48742) 2024-04-20T12:23:09.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c0534d640 1 -- 172.21.15.135:0/2560622479 learned_addr learned my addr 172.21.15.135:0/2560622479 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:09.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c05b4e640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c00100ea0 0x7f3c001971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:09.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c0634f640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c001029b0 0x7f3c0019e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:09.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c0534d640 1 -- 172.21.15.135:0/2560622479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c00100ea0 msgr2=0x7f3c001971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:09.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c0534d640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c00100ea0 0x7f3c001971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c0534d640 1 -- 172.21.15.135:0/2560622479 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c001029b0 msgr2=0x7f3c0019e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:09.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c0534d640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c001029b0 0x7f3c0019e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c0534d640 1 -- 172.21.15.135:0/2560622479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0019edc0 con 0x7f3c00101ff0 2024-04-20T12:23:09.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c05b4e640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c00100ea0 0x7f3c001971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:09.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c0634f640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c001029b0 0x7f3c0019e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:09.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c0534d640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c00101ff0 0x7f3c001976e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000e9c0 tx=0x7f3bf000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:09.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3bf6ffd640 1 -- 172.21.15.135:0/2560622479 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf000cde0 con 0x7f3c00101ff0 2024-04-20T12:23:09.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c07db2640 1 -- 172.21.15.135:0/2560622479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0019f0b0 con 0x7f3c00101ff0 2024-04-20T12:23:09.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3bf6ffd640 1 -- 172.21.15.135:0/2560622479 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bf0010910 con 0x7f3c00101ff0 2024-04-20T12:23:09.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3bf6ffd640 1 -- 172.21.15.135:0/2560622479 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0018a10 con 0x7f3c00101ff0 2024-04-20T12:23:09.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.593+0000 7f3c07db2640 1 -- 172.21.15.135:0/2560622479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c0019f650 con 0x7f3c00101ff0 2024-04-20T12:23:09.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.594+0000 7f3c07db2640 1 -- 172.21.15.135:0/2560622479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c001081b0 con 0x7f3c00101ff0 2024-04-20T12:23:09.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.596+0000 7f3bf6ffd640 1 -- 172.21.15.135:0/2560622479 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138818+0+0 (secure 0 0 0) 0x7f3bf001f020 con 0x7f3c00101ff0 2024-04-20T12:23:09.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.597+0000 7f3bf6ffd640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3bec0a3db0 0x7f3bec0a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:09.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.597+0000 7f3c05b4e640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3bec0a3db0 0x7f3bec0a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:09.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.597+0000 7f3bf6ffd640 1 -- 172.21.15.135:0/2560622479 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f3bf00d1480 con 0x7f3c00101ff0 2024-04-20T12:23:09.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.597+0000 7f3c05b4e640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3bec0a3db0 0x7f3bec0a6270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009fc0 tx=0x7f3bfc005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:09.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.600+0000 7f3bf6ffd640 1 -- 172.21.15.135:0/2560622479 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f3bf009d6d0 con 0x7f3c00101ff0 2024-04-20T12:23:09.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.784+0000 7f3c07db2640 1 -- 172.21.15.135:0/2560622479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f3c0002d7d0 con 0x7f3c00101ff0 2024-04-20T12:23:09.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.785+0000 7f3bf6ffd640 1 -- 172.21.15.135:0/2560622479 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v95) ==== 103+0+11 (secure 0 0 0) 0x7f3bf009cfd0 con 0x7f3c00101ff0 2024-04-20T12:23:09.785 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:23:09.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.787+0000 7f3c07db2640 1 -- 172.21.15.135:0/2560622479 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3bec0a3db0 msgr2=0x7f3bec0a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:09.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.787+0000 7f3c07db2640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3bec0a3db0 0x7f3bec0a6270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009fc0 tx=0x7f3bfc005f90 comp rx=0 tx=0).stop 2024-04-20T12:23:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.787+0000 7f3c07db2640 1 -- 172.21.15.135:0/2560622479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c00101ff0 msgr2=0x7f3c001976e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.787+0000 7f3c07db2640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c00101ff0 0x7f3c001976e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000e9c0 tx=0x7f3bf000ee80 comp rx=0 tx=0).stop 2024-04-20T12:23:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.788+0000 7f3c07db2640 1 -- 172.21.15.135:0/2560622479 shutdown_connections 2024-04-20T12:23:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.788+0000 7f3c07db2640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c001029b0 0x7f3c0019e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.788+0000 7f3c07db2640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c00101ff0 0x7f3c001976e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.788+0000 7f3c07db2640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3bec0a3db0 0x7f3bec0a6270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.788+0000 7f3c07db2640 1 --2- 172.21.15.135:0/2560622479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c00100ea0 0x7f3c001971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.788+0000 7f3c07db2640 1 -- 172.21.15.135:0/2560622479 >> 172.21.15.135:0/2560622479 conn(0x7f3c000fc410 msgr2=0x7f3c00105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.788+0000 7f3c07db2640 1 -- 172.21.15.135:0/2560622479 shutdown_connections 2024-04-20T12:23:09.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.788+0000 7f3c07db2640 1 -- 172.21.15.135:0/2560622479 wait complete. 2024-04-20T12:23:09.799 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:23:09.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.900+0000 7efe89c1e640 1 -- 172.21.15.135:0/3435422986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe841053f0 msgr2=0x7efe841077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:09.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.900+0000 7efe89c1e640 1 --2- 172.21.15.135:0/3435422986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe841053f0 0x7efe841077e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7efe78009900 tx=0x7efe7802bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:09.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.900+0000 7efe89c1e640 1 -- 172.21.15.135:0/3435422986 shutdown_connections 2024-04-20T12:23:09.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.900+0000 7efe89c1e640 1 --2- 172.21.15.135:0/3435422986 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe84107d20 0x7efe8410a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.900+0000 7efe89c1e640 1 --2- 172.21.15.135:0/3435422986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe841053f0 0x7efe841077e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.900+0000 7efe89c1e640 1 --2- 172.21.15.135:0/3435422986 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe84102ac0 0x7efe84104eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.900+0000 7efe89c1e640 1 -- 172.21.15.135:0/3435422986 >> 172.21.15.135:0/3435422986 conn(0x7efe840fc410 msgr2=0x7efe840fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:09.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.900+0000 7efe89c1e640 1 -- 172.21.15.135:0/3435422986 shutdown_connections 2024-04-20T12:23:09.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.900+0000 7efe89c1e640 1 -- 172.21.15.135:0/3435422986 wait complete. 2024-04-20T12:23:09.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.901+0000 7efe89c1e640 1 Processor -- start 2024-04-20T12:23:09.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.901+0000 7efe89c1e640 1 -- start start 2024-04-20T12:23:09.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.901+0000 7efe89c1e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe84102ac0 0x7efe841982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:09.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.901+0000 7efe89c1e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe841053f0 0x7efe84198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:09.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.901+0000 7efe89c1e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe84107d20 0x7efe8419f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:09.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.901+0000 7efe89c1e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efe8410dc50 con 0x7efe84102ac0 2024-04-20T12:23:09.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.901+0000 7efe89c1e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efe8410dad0 con 0x7efe84107d20 2024-04-20T12:23:09.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.901+0000 7efe89c1e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efe8410ddd0 con 0x7efe841053f0 2024-04-20T12:23:09.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.901+0000 7efe837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe84102ac0 0x7efe841982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:09.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.902+0000 7efe837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe84102ac0 0x7efe841982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48772/0 (socket says 172.21.15.135:48772) 2024-04-20T12:23:09.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.902+0000 7efe837fe640 1 -- 172.21.15.135:0/4034420185 learned_addr learned my addr 172.21.15.135:0/4034420185 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:09.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.902+0000 7efe82ffd640 1 --2- 172.21.15.135:0/4034420185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe841053f0 0x7efe84198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:09.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.902+0000 7efe83fff640 1 --2- 172.21.15.135:0/4034420185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe84107d20 0x7efe8419f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:09.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.902+0000 7efe82ffd640 1 -- 172.21.15.135:0/4034420185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe84107d20 msgr2=0x7efe8419f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:09.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.902+0000 7efe82ffd640 1 --2- 172.21.15.135:0/4034420185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe84107d20 0x7efe8419f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.902+0000 7efe82ffd640 1 -- 172.21.15.135:0/4034420185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe84102ac0 msgr2=0x7efe841982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:09.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.902+0000 7efe82ffd640 1 --2- 172.21.15.135:0/4034420185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe84102ac0 0x7efe841982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:09.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.902+0000 7efe82ffd640 1 -- 172.21.15.135:0/4034420185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8419ff00 con 0x7efe841053f0 2024-04-20T12:23:09.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.902+0000 7efe82ffd640 1 --2- 172.21.15.135:0/4034420185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe841053f0 0x7efe84198820 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efe7802c170 tx=0x7efe7802c650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:09.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.902+0000 7efe80ff9640 1 -- 172.21.15.135:0/4034420185 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78041070 con 0x7efe841053f0 2024-04-20T12:23:09.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.902+0000 7efe80ff9640 1 -- 172.21.15.135:0/4034420185 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe78004450 con 0x7efe841053f0 2024-04-20T12:23:09.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.902+0000 7efe80ff9640 1 -- 172.21.15.135:0/4034420185 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe78003e50 con 0x7efe841053f0 2024-04-20T12:23:09.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.902+0000 7efe89c1e640 1 -- 172.21.15.135:0/4034420185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe841a0190 con 0x7efe841053f0 2024-04-20T12:23:09.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.902+0000 7efe89c1e640 1 -- 172.21.15.135:0/4034420185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe841a06a0 con 0x7efe841053f0 2024-04-20T12:23:09.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.903+0000 7efe89c1e640 1 -- 172.21.15.135:0/4034420185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe840fdf00 con 0x7efe841053f0 2024-04-20T12:23:09.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.905+0000 7efe80ff9640 1 -- 172.21.15.135:0/4034420185 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 23) ==== 138818+0+0 (secure 0 0 0) 0x7efe78044070 con 0x7efe841053f0 2024-04-20T12:23:09.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.906+0000 7efe80ff9640 1 --2- 172.21.15.135:0/4034420185 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7efe6c0a3fd0 0x7efe6c0a6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:09.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.906+0000 7efe80ff9640 1 -- 172.21.15.135:0/4034420185 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7efe780f25b0 con 0x7efe841053f0 2024-04-20T12:23:09.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.906+0000 7efe837fe640 1 --2- 172.21.15.135:0/4034420185 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7efe6c0a3fd0 0x7efe6c0a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:09.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.906+0000 7efe837fe640 1 --2- 172.21.15.135:0/4034420185 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7efe6c0a3fd0 0x7efe6c0a6490 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe740095f0 tx=0x7efe74005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:09.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:09.911+0000 7efe80ff9640 1 -- 172.21.15.135:0/4034420185 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7efe780be220 con 0x7efe841053f0 2024-04-20T12:23:10.100 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:10 smithi135 ceph-mon[18264]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:23:10.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.106+0000 7efe89c1e640 1 -- 172.21.15.135:0/4034420185 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe8402d7d0 con 0x7efe841053f0 2024-04-20T12:23:10.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.107+0000 7efe80ff9640 1 -- 172.21.15.135:0/4034420185 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+25197 (secure 0 0 0) 0x7efe780c2520 con 0x7efe841053f0 2024-04-20T12:23:10.108 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:23:10.108 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":95,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:23:07.080106+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2052292307":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/669936771":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/4276159294":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6800/3831149339":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/1087722944":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6801/3831149339":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:23:10.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.110+0000 7efe89c1e640 1 -- 172.21.15.135:0/4034420185 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7efe6c0a3fd0 msgr2=0x7efe6c0a6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:10.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.110+0000 7efe89c1e640 1 --2- 172.21.15.135:0/4034420185 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7efe6c0a3fd0 0x7efe6c0a6490 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe740095f0 tx=0x7efe74005f90 comp rx=0 tx=0).stop 2024-04-20T12:23:10.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.110+0000 7efe89c1e640 1 -- 172.21.15.135:0/4034420185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe841053f0 msgr2=0x7efe84198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:10.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.110+0000 7efe89c1e640 1 --2- 172.21.15.135:0/4034420185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe841053f0 0x7efe84198820 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efe7802c170 tx=0x7efe7802c650 comp rx=0 tx=0).stop 2024-04-20T12:23:10.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.110+0000 7efe89c1e640 1 -- 172.21.15.135:0/4034420185 shutdown_connections 2024-04-20T12:23:10.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.110+0000 7efe89c1e640 1 --2- 172.21.15.135:0/4034420185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efe84107d20 0x7efe8419f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.110+0000 7efe89c1e640 1 --2- 172.21.15.135:0/4034420185 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7efe6c0a3fd0 0x7efe6c0a6490 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.110+0000 7efe89c1e640 1 --2- 172.21.15.135:0/4034420185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe841053f0 0x7efe84198820 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.110+0000 7efe89c1e640 1 --2- 172.21.15.135:0/4034420185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe84102ac0 0x7efe841982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.110+0000 7efe89c1e640 1 -- 172.21.15.135:0/4034420185 >> 172.21.15.135:0/4034420185 conn(0x7efe840fc410 msgr2=0x7efe84103420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:10.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.110+0000 7efe89c1e640 1 -- 172.21.15.135:0/4034420185 shutdown_connections 2024-04-20T12:23:10.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.110+0000 7efe89c1e640 1 -- 172.21.15.135:0/4034420185 wait complete. 2024-04-20T12:23:10.121 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T12:16:02.802023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T12:20:39.656129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T12:20:40.312827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T12:20:44.307136+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T12:23:10.122 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T12:23:10.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.225+0000 7f06c00f2640 1 -- 172.21.15.135:0/3615977885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06b8102a20 msgr2=0x7f06b8104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:10.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.225+0000 7f06c00f2640 1 --2- 172.21.15.135:0/3615977885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06b8102a20 0x7f06b8104e10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f06b4009900 tx=0x7f06b402bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:10.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.225+0000 7f06c00f2640 1 -- 172.21.15.135:0/3615977885 shutdown_connections 2024-04-20T12:23:10.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.225+0000 7f06c00f2640 1 --2- 172.21.15.135:0/3615977885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06b8107c80 0x7f06b810a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.225+0000 7f06c00f2640 1 --2- 172.21.15.135:0/3615977885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b8105350 0x7f06b8107740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.225+0000 7f06c00f2640 1 --2- 172.21.15.135:0/3615977885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06b8102a20 0x7f06b8104e10 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.225+0000 7f06c00f2640 1 -- 172.21.15.135:0/3615977885 >> 172.21.15.135:0/3615977885 conn(0x7f06b80fc410 msgr2=0x7f06b80fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:10.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.225+0000 7f06c00f2640 1 -- 172.21.15.135:0/3615977885 shutdown_connections 2024-04-20T12:23:10.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.226+0000 7f06c00f2640 1 -- 172.21.15.135:0/3615977885 wait complete. 2024-04-20T12:23:10.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.226+0000 7f06c00f2640 1 Processor -- start 2024-04-20T12:23:10.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.226+0000 7f06c00f2640 1 -- start start 2024-04-20T12:23:10.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.226+0000 7f06c00f2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06b8102a20 0x7f06b8198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:10.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.226+0000 7f06c00f2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06b8105350 0x7f06b8198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:10.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06c00f2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b8107c80 0x7f06b819f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:10.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06c00f2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06b810dc30 con 0x7f06b8105350 2024-04-20T12:23:10.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06c00f2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f06b810dab0 con 0x7f06b8102a20 2024-04-20T12:23:10.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06c00f2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f06b810ddb0 con 0x7f06b8107c80 2024-04-20T12:23:10.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06bd68d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06b8105350 0x7f06b8198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:10.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06bde8e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06b8102a20 0x7f06b8198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:10.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06bde8e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06b8102a20 0x7f06b8198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:54608/0 (socket says 172.21.15.135:54608) 2024-04-20T12:23:10.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06bd68d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06b8105350 0x7f06b8198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48800/0 (socket says 172.21.15.135:48800) 2024-04-20T12:23:10.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06bde8e640 1 -- 172.21.15.135:0/2536757205 learned_addr learned my addr 172.21.15.135:0/2536757205 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:10.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06be68f640 1 --2- 172.21.15.135:0/2536757205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b8107c80 0x7f06b819f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:10.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06bde8e640 1 -- 172.21.15.135:0/2536757205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b8107c80 msgr2=0x7f06b819f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:10.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06bde8e640 1 --2- 172.21.15.135:0/2536757205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b8107c80 0x7f06b819f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06bde8e640 1 -- 172.21.15.135:0/2536757205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06b8105350 msgr2=0x7f06b8198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:10.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06bde8e640 1 --2- 172.21.15.135:0/2536757205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06b8105350 0x7f06b8198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06bde8e640 1 -- 172.21.15.135:0/2536757205 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b819ff30 con 0x7f06b8102a20 2024-04-20T12:23:10.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06bd68d640 1 --2- 172.21.15.135:0/2536757205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06b8105350 0x7f06b8198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:10.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06bde8e640 1 --2- 172.21.15.135:0/2536757205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06b8102a20 0x7f06b8198310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f06b4009230 tx=0x7f06b4005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:10.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06aeffd640 1 -- 172.21.15.135:0/2536757205 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b4041070 con 0x7f06b8102a20 2024-04-20T12:23:10.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06c00f2640 1 -- 172.21.15.135:0/2536757205 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b81a01c0 con 0x7f06b8102a20 2024-04-20T12:23:10.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06aeffd640 1 -- 172.21.15.135:0/2536757205 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06b40044d0 con 0x7f06b8102a20 2024-04-20T12:23:10.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06aeffd640 1 -- 172.21.15.135:0/2536757205 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b4034440 con 0x7f06b8102a20 2024-04-20T12:23:10.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.227+0000 7f06c00f2640 1 -- 172.21.15.135:0/2536757205 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b81a0700 con 0x7f06b8102a20 2024-04-20T12:23:10.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.228+0000 7f06c00f2640 1 -- 172.21.15.135:0/2536757205 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b80fdf00 con 0x7f06b8102a20 2024-04-20T12:23:10.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.230+0000 7f06aeffd640 1 -- 172.21.15.135:0/2536757205 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 23) ==== 138818+0+0 (secure 0 0 0) 0x7f06b4044070 con 0x7f06b8102a20 2024-04-20T12:23:10.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.230+0000 7f06aeffd640 1 --2- 172.21.15.135:0/2536757205 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f06a40a3db0 0x7f06a40a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:10.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.230+0000 7f06aeffd640 1 -- 172.21.15.135:0/2536757205 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f06b40f2a40 con 0x7f06b8102a20 2024-04-20T12:23:10.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.230+0000 7f06bd68d640 1 --2- 172.21.15.135:0/2536757205 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f06a40a3db0 0x7f06a40a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:10.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.231+0000 7f06bd68d640 1 --2- 172.21.15.135:0/2536757205 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f06a40a3db0 0x7f06a40a6270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06b8199820 tx=0x7f06a800b390 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:10.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.234+0000 7f06aeffd640 1 -- 172.21.15.135:0/2536757205 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f06b40be6b0 con 0x7f06b8102a20 2024-04-20T12:23:10.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:10 smithi135 ceph-mon[18264]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-04-20T12:23:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:10 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/4160873489' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:23:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:10 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:10 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:10 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:10 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:10 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:10 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:10 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2710319077' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:23:10.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:10 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2560622479' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:23:10.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.430+0000 7f06c00f2640 1 -- 172.21.15.135:0/2536757205 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f06b802d760 con 0x7f06b8102a20 2024-04-20T12:23:10.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.430+0000 7f06aeffd640 1 -- 172.21.15.135:0/2536757205 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7f06b40c29b0 con 0x7f06b8102a20 2024-04-20T12:23:10.430 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-04-20T12:23:10.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.433+0000 7f06c00f2640 1 -- 172.21.15.135:0/2536757205 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f06a40a3db0 msgr2=0x7f06a40a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:10.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.433+0000 7f06c00f2640 1 --2- 172.21.15.135:0/2536757205 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f06a40a3db0 0x7f06a40a6270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06b8199820 tx=0x7f06a800b390 comp rx=0 tx=0).stop 2024-04-20T12:23:10.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.433+0000 7f06c00f2640 1 -- 172.21.15.135:0/2536757205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06b8102a20 msgr2=0x7f06b8198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:10.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.433+0000 7f06c00f2640 1 --2- 172.21.15.135:0/2536757205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06b8102a20 0x7f06b8198310 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f06b4009230 tx=0x7f06b4005d50 comp rx=0 tx=0).stop 2024-04-20T12:23:10.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.433+0000 7f06c00f2640 1 -- 172.21.15.135:0/2536757205 shutdown_connections 2024-04-20T12:23:10.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.433+0000 7f06c00f2640 1 --2- 172.21.15.135:0/2536757205 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f06a40a3db0 0x7f06a40a6270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.433+0000 7f06c00f2640 1 --2- 172.21.15.135:0/2536757205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f06b8107c80 0x7f06b819f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.433+0000 7f06c00f2640 1 --2- 172.21.15.135:0/2536757205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f06b8105350 0x7f06b8198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.433+0000 7f06c00f2640 1 --2- 172.21.15.135:0/2536757205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f06b8102a20 0x7f06b8198310 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.433+0000 7f06c00f2640 1 -- 172.21.15.135:0/2536757205 >> 172.21.15.135:0/2536757205 conn(0x7f06b80fc410 msgr2=0x7f06b81034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:10.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.433+0000 7f06c00f2640 1 -- 172.21.15.135:0/2536757205 shutdown_connections 2024-04-20T12:23:10.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.433+0000 7f06c00f2640 1 -- 172.21.15.135:0/2536757205 wait complete. 2024-04-20T12:23:10.445 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T12:23:10.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:10 smithi154 ceph-mon[22073]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:23:10.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:10 smithi154 ceph-mon[22073]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-04-20T12:23:10.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:10 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/4160873489' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:23:10.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:10 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:10 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:10 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:10 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:10 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:10 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:10 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2710319077' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:23:10.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:10 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2560622479' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:23:10.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.553+0000 7f47e7375640 1 -- 172.21.15.135:0/3662715572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47e0101ff0 msgr2=0x7f47e0102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:10.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.553+0000 7f47e7375640 1 --2- 172.21.15.135:0/3662715572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47e0101ff0 0x7f47e0102470 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009900 tx=0x7f47d002bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:10.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.553+0000 7f47e7375640 1 -- 172.21.15.135:0/3662715572 shutdown_connections 2024-04-20T12:23:10.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.553+0000 7f47e7375640 1 --2- 172.21.15.135:0/3662715572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47e01029b0 0x7f47e01092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.553+0000 7f47e7375640 1 --2- 172.21.15.135:0/3662715572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47e0101ff0 0x7f47e0102470 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.553+0000 7f47e7375640 1 --2- 172.21.15.135:0/3662715572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e0100ea0 0x7f47e01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.553+0000 7f47e7375640 1 -- 172.21.15.135:0/3662715572 >> 172.21.15.135:0/3662715572 conn(0x7f47e00fc410 msgr2=0x7f47e00fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:10.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.553+0000 7f47e7375640 1 -- 172.21.15.135:0/3662715572 shutdown_connections 2024-04-20T12:23:10.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.553+0000 7f47e7375640 1 -- 172.21.15.135:0/3662715572 wait complete. 2024-04-20T12:23:10.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.554+0000 7f47e7375640 1 Processor -- start 2024-04-20T12:23:10.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.554+0000 7f47e7375640 1 -- start start 2024-04-20T12:23:10.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.554+0000 7f47e7375640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47e0100ea0 0x7f47e0069c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:10.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.554+0000 7f47e7375640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e0101ff0 0x7f47e019d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:10.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.554+0000 7f47e7375640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47e01029b0 0x7f47e019f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:10.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.554+0000 7f47e7375640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f47e010cb50 con 0x7f47e01029b0 2024-04-20T12:23:10.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.554+0000 7f47e7375640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f47e010c9d0 con 0x7f47e0100ea0 2024-04-20T12:23:10.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.554+0000 7f47e7375640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f47e010ccd0 con 0x7f47e0101ff0 2024-04-20T12:23:10.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.554+0000 7f47e5912640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47e01029b0 0x7f47e019f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:10.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.554+0000 7f47e5111640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47e0100ea0 0x7f47e0069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:10.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.554+0000 7f47e5912640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47e01029b0 0x7f47e019f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35244/0 (socket says 172.21.15.135:35244) 2024-04-20T12:23:10.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.554+0000 7f47e4910640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e0101ff0 0x7f47e019d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:10.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.554+0000 7f47e5912640 1 -- 172.21.15.135:0/1193454578 learned_addr learned my addr 172.21.15.135:0/1193454578 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:10.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.555+0000 7f47e5912640 1 -- 172.21.15.135:0/1193454578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e0101ff0 msgr2=0x7f47e019d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:10.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.555+0000 7f47e5912640 1 --2- 172.21.15.135:0/1193454578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e0101ff0 0x7f47e019d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.555+0000 7f47e5912640 1 -- 172.21.15.135:0/1193454578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47e0100ea0 msgr2=0x7f47e0069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:10.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.555+0000 7f47e5912640 1 --2- 172.21.15.135:0/1193454578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47e0100ea0 0x7f47e0069c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.555+0000 7f47e5912640 1 -- 172.21.15.135:0/1193454578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e019ff60 con 0x7f47e01029b0 2024-04-20T12:23:10.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.555+0000 7f47e4910640 1 --2- 172.21.15.135:0/1193454578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e0101ff0 0x7f47e019d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:10.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.555+0000 7f47e5912640 1 --2- 172.21.15.135:0/1193454578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47e01029b0 0x7f47e019f6a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f47d800eb10 tx=0x7f47d800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:10.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.555+0000 7f47d67fc640 1 -- 172.21.15.135:0/1193454578 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8004b20 con 0x7f47e01029b0 2024-04-20T12:23:10.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.555+0000 7f47d67fc640 1 -- 172.21.15.135:0/1193454578 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47d8004cc0 con 0x7f47e01029b0 2024-04-20T12:23:10.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.555+0000 7f47d67fc640 1 -- 172.21.15.135:0/1193454578 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d8010760 con 0x7f47e01029b0 2024-04-20T12:23:10.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.555+0000 7f47e7375640 1 -- 172.21.15.135:0/1193454578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47e01a0250 con 0x7f47e01029b0 2024-04-20T12:23:10.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.555+0000 7f47e7375640 1 -- 172.21.15.135:0/1193454578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47e01a0770 con 0x7f47e01029b0 2024-04-20T12:23:10.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.556+0000 7f47e7375640 1 -- 172.21.15.135:0/1193454578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e01081d0 con 0x7f47e01029b0 2024-04-20T12:23:10.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.557+0000 7f47d67fc640 1 -- 172.21.15.135:0/1193454578 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138818+0+0 (secure 0 0 0) 0x7f47d8005020 con 0x7f47e01029b0 2024-04-20T12:23:10.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.558+0000 7f47d67fc640 1 --2- 172.21.15.135:0/1193454578 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f47cc0a3e30 0x7f47cc0a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:10.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.558+0000 7f47e5111640 1 --2- 172.21.15.135:0/1193454578 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f47cc0a3e30 0x7f47cc0a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:10.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.558+0000 7f47d67fc640 1 -- 172.21.15.135:0/1193454578 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f47d80d1280 con 0x7f47e01029b0 2024-04-20T12:23:10.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.558+0000 7f47e5111640 1 --2- 172.21.15.135:0/1193454578 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f47cc0a3e30 0x7f47cc0a62f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009bd0 tx=0x7f47dc005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:10.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.562+0000 7f47d67fc640 1 -- 172.21.15.135:0/1193454578 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f47d809d3d0 con 0x7f47e01029b0 2024-04-20T12:23:10.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:10 smithi139 ceph-mon[21834]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:23:10.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:10 smithi139 ceph-mon[21834]: mgrmap e23: x(active, since 2s), standbys: y, z 2024-04-20T12:23:10.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:10 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/4160873489' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:23:10.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:10 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:10 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:10 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:10 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:10 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:10 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:10.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:10 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2710319077' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:23:10.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:10 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2560622479' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:23:10.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.753+0000 7f47e7375640 1 -- 172.21.15.135:0/1193454578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f47e002d7e0 con 0x7f47e01029b0 2024-04-20T12:23:10.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.753+0000 7f47d67fc640 1 -- 172.21.15.135:0/1193454578 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) ==== 104+0+11 (secure 0 0 0) 0x7f47d809ccd0 con 0x7f47e01029b0 2024-04-20T12:23:10.754 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:23:10.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.755+0000 7f47e7375640 1 -- 172.21.15.135:0/1193454578 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f47cc0a3e30 msgr2=0x7f47cc0a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:10.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.755+0000 7f47e7375640 1 --2- 172.21.15.135:0/1193454578 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f47cc0a3e30 0x7f47cc0a62f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009bd0 tx=0x7f47dc005f90 comp rx=0 tx=0).stop 2024-04-20T12:23:10.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.755+0000 7f47e7375640 1 -- 172.21.15.135:0/1193454578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47e01029b0 msgr2=0x7f47e019f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:10.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.755+0000 7f47e7375640 1 --2- 172.21.15.135:0/1193454578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47e01029b0 0x7f47e019f6a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f47d800eb10 tx=0x7f47d800c2d0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.755+0000 7f47e7375640 1 -- 172.21.15.135:0/1193454578 shutdown_connections 2024-04-20T12:23:10.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.755+0000 7f47e7375640 1 --2- 172.21.15.135:0/1193454578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f47e01029b0 0x7f47e019f6a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.755+0000 7f47e7375640 1 --2- 172.21.15.135:0/1193454578 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f47cc0a3e30 0x7f47cc0a62f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.755+0000 7f47e7375640 1 --2- 172.21.15.135:0/1193454578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47e0101ff0 0x7f47e019d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.755+0000 7f47e7375640 1 --2- 172.21.15.135:0/1193454578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f47e0100ea0 0x7f47e0069c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.755+0000 7f47e7375640 1 -- 172.21.15.135:0/1193454578 >> 172.21.15.135:0/1193454578 conn(0x7f47e00fc410 msgr2=0x7f47e01053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:10.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.755+0000 7f47e7375640 1 -- 172.21.15.135:0/1193454578 shutdown_connections 2024-04-20T12:23:10.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.755+0000 7f47e7375640 1 -- 172.21.15.135:0/1193454578 wait complete. 2024-04-20T12:23:10.766 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T12:23:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.889+0000 7fabfaea5640 1 -- 172.21.15.135:0/3137555806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf4105350 msgr2=0x7fabf4107740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.889+0000 7fabfaea5640 1 --2- 172.21.15.135:0/3137555806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf4105350 0x7fabf4107740 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009900 tx=0x7fabe002bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.889+0000 7fabfaea5640 1 -- 172.21.15.135:0/3137555806 shutdown_connections 2024-04-20T12:23:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.889+0000 7fabfaea5640 1 --2- 172.21.15.135:0/3137555806 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf4107c80 0x7fabf410a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.889+0000 7fabfaea5640 1 --2- 172.21.15.135:0/3137555806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf4105350 0x7fabf4107740 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.889+0000 7fabfaea5640 1 --2- 172.21.15.135:0/3137555806 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabf4102a20 0x7fabf4104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.889+0000 7fabfaea5640 1 -- 172.21.15.135:0/3137555806 >> 172.21.15.135:0/3137555806 conn(0x7fabf40fc410 msgr2=0x7fabf40fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.889+0000 7fabfaea5640 1 -- 172.21.15.135:0/3137555806 shutdown_connections 2024-04-20T12:23:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.889+0000 7fabfaea5640 1 -- 172.21.15.135:0/3137555806 wait complete. 2024-04-20T12:23:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.889+0000 7fabfaea5640 1 Processor -- start 2024-04-20T12:23:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabfaea5640 1 -- start start 2024-04-20T12:23:10.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabfaea5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabf4102a20 0x7fabf4198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabfaea5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf4105350 0x7fabf4198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabfaea5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf4107c80 0x7fabf419f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabfaea5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fabf410dc30 con 0x7fabf4105350 2024-04-20T12:23:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabfaea5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fabf410dab0 con 0x7fabf4102a20 2024-04-20T12:23:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabfaea5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fabf410ddb0 con 0x7fabf4107c80 2024-04-20T12:23:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabf3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf4105350 0x7fabf4198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabf3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf4105350 0x7fabf4198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35258/0 (socket says 172.21.15.135:35258) 2024-04-20T12:23:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabf3fff640 1 -- 172.21.15.135:0/3024279564 learned_addr learned my addr 172.21.15.135:0/3024279564 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabf8c41640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabf4102a20 0x7fabf4198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabf9442640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf4107c80 0x7fabf419f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabf3fff640 1 -- 172.21.15.135:0/3024279564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf4107c80 msgr2=0x7fabf419f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabf3fff640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf4107c80 0x7fabf419f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabf3fff640 1 -- 172.21.15.135:0/3024279564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabf4102a20 msgr2=0x7fabf4198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabf3fff640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabf4102a20 0x7fabf4198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:10.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabf3fff640 1 -- 172.21.15.135:0/3024279564 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf419ff60 con 0x7fabf4105350 2024-04-20T12:23:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabf8c41640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabf4102a20 0x7fabf4198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabf9442640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf4107c80 0x7fabf419f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabf3fff640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf4105350 0x7fabf4198880 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fabe0000c00 tx=0x7fabe002c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabf1ffb640 1 -- 172.21.15.135:0/3024279564 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe0041070 con 0x7fabf4105350 2024-04-20T12:23:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.890+0000 7fabfaea5640 1 -- 172.21.15.135:0/3024279564 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf41a01f0 con 0x7fabf4105350 2024-04-20T12:23:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.891+0000 7fabf1ffb640 1 -- 172.21.15.135:0/3024279564 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabe0004450 con 0x7fabf4105350 2024-04-20T12:23:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.891+0000 7fabf1ffb640 1 -- 172.21.15.135:0/3024279564 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe0034440 con 0x7fabf4105350 2024-04-20T12:23:10.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.891+0000 7fabfaea5640 1 -- 172.21.15.135:0/3024279564 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf41a0730 con 0x7fabf4105350 2024-04-20T12:23:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.892+0000 7fabfaea5640 1 -- 172.21.15.135:0/3024279564 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabf40fdf00 con 0x7fabf4105350 2024-04-20T12:23:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.893+0000 7fabf1ffb640 1 -- 172.21.15.135:0/3024279564 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 23) ==== 138818+0+0 (secure 0 0 0) 0x7fabe0044070 con 0x7fabf4105350 2024-04-20T12:23:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.893+0000 7fabf1ffb640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fabe40a3db0 0x7fabe40a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.893+0000 7fabf1ffb640 1 -- 172.21.15.135:0/3024279564 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fabe00f2760 con 0x7fabf4105350 2024-04-20T12:23:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.893+0000 7fabf8c41640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fabe40a3db0 0x7fabe40a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:10.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.894+0000 7fabf8c41640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fabe40a3db0 0x7fabe40a6270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009fc0 tx=0x7fabe8005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:10.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:10.898+0000 7fabf1ffb640 1 -- 172.21.15.135:0/3024279564 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fabe00beab0 con 0x7fabf4105350 2024-04-20T12:23:11.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.094+0000 7fabfaea5640 1 -- 172.21.15.135:0/3024279564 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fabf402d7a0 con 0x7fabf4105350 2024-04-20T12:23:11.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.094+0000 7fabf1ffb640 1 -- 172.21.15.135:0/3024279564 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) ==== 100+0+11 (secure 0 0 0) 0x7fabe00be3b0 con 0x7fabf4105350 2024-04-20T12:23:11.094 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-04-20T12:23:11.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.097+0000 7fabfaea5640 1 -- 172.21.15.135:0/3024279564 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fabe40a3db0 msgr2=0x7fabe40a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:11.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.097+0000 7fabfaea5640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fabe40a3db0 0x7fabe40a6270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fabe8009fc0 tx=0x7fabe8005f90 comp rx=0 tx=0).stop 2024-04-20T12:23:11.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.097+0000 7fabfaea5640 1 -- 172.21.15.135:0/3024279564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf4105350 msgr2=0x7fabf4198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:11.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.097+0000 7fabfaea5640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf4105350 0x7fabf4198880 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fabe0000c00 tx=0x7fabe002c640 comp rx=0 tx=0).stop 2024-04-20T12:23:11.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.097+0000 7fabfaea5640 1 -- 172.21.15.135:0/3024279564 shutdown_connections 2024-04-20T12:23:11.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.097+0000 7fabfaea5640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fabe40a3db0 0x7fabe40a6270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.097+0000 7fabfaea5640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabf4107c80 0x7fabf419f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.097+0000 7fabfaea5640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabf4105350 0x7fabf4198880 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.097+0000 7fabfaea5640 1 --2- 172.21.15.135:0/3024279564 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fabf4102a20 0x7fabf4198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.097+0000 7fabfaea5640 1 -- 172.21.15.135:0/3024279564 >> 172.21.15.135:0/3024279564 conn(0x7fabf40fc410 msgr2=0x7fabf4104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:11.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.097+0000 7fabfaea5640 1 -- 172.21.15.135:0/3024279564 shutdown_connections 2024-04-20T12:23:11.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.097+0000 7fabfaea5640 1 -- 172.21.15.135:0/3024279564 wait complete. 2024-04-20T12:23:11.111 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T12:23:11.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.231+0000 7fe71ac3a640 1 -- 172.21.15.135:0/1735028105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe714102a80 msgr2=0x7fe714104e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:11.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.231+0000 7fe71ac3a640 1 --2- 172.21.15.135:0/1735028105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe714102a80 0x7fe714104e70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe708009900 tx=0x7fe70802bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:11.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.231+0000 7fe71ac3a640 1 -- 172.21.15.135:0/1735028105 shutdown_connections 2024-04-20T12:23:11.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.231+0000 7fe71ac3a640 1 --2- 172.21.15.135:0/1735028105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe714107ce0 0x7fe71410a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.231+0000 7fe71ac3a640 1 --2- 172.21.15.135:0/1735028105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7141053b0 0x7fe7141077a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.231+0000 7fe71ac3a640 1 --2- 172.21.15.135:0/1735028105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe714102a80 0x7fe714104e70 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.231+0000 7fe71ac3a640 1 -- 172.21.15.135:0/1735028105 >> 172.21.15.135:0/1735028105 conn(0x7fe7140fc410 msgr2=0x7fe7140fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:11.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.231+0000 7fe71ac3a640 1 -- 172.21.15.135:0/1735028105 shutdown_connections 2024-04-20T12:23:11.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.231+0000 7fe71ac3a640 1 -- 172.21.15.135:0/1735028105 wait complete. 2024-04-20T12:23:11.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.232+0000 7fe71ac3a640 1 Processor -- start 2024-04-20T12:23:11.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.232+0000 7fe71ac3a640 1 -- start start 2024-04-20T12:23:11.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.232+0000 7fe71ac3a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe714102a80 0x7fe714198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:11.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.232+0000 7fe71ac3a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7141053b0 0x7fe7141988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:11.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.232+0000 7fe71ac3a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe714107ce0 0x7fe71419f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:11.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.232+0000 7fe71ac3a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe71410dc80 con 0x7fe714102a80 2024-04-20T12:23:11.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.232+0000 7fe71ac3a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe71410db00 con 0x7fe7141053b0 2024-04-20T12:23:11.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.232+0000 7fe71ac3a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe71410de00 con 0x7fe714107ce0 2024-04-20T12:23:11.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.232+0000 7fe7189d6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe714102a80 0x7fe714198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:11.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.232+0000 7fe713fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7141053b0 0x7fe7141988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:11.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.232+0000 7fe7189d6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe714102a80 0x7fe714198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35276/0 (socket says 172.21.15.135:35276) 2024-04-20T12:23:11.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.232+0000 7fe713fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7141053b0 0x7fe7141988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:37850/0 (socket says 172.21.15.135:37850) 2024-04-20T12:23:11.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.232+0000 7fe7189d6640 1 -- 172.21.15.135:0/14443301 learned_addr learned my addr 172.21.15.135:0/14443301 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:11.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.232+0000 7fe7191d7640 1 --2- 172.21.15.135:0/14443301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe714107ce0 0x7fe71419f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:11.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.233+0000 7fe7191d7640 1 -- 172.21.15.135:0/14443301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7141053b0 msgr2=0x7fe7141988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:11.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.233+0000 7fe7191d7640 1 --2- 172.21.15.135:0/14443301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7141053b0 0x7fe7141988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.233+0000 7fe7191d7640 1 -- 172.21.15.135:0/14443301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe714102a80 msgr2=0x7fe714198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:11.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.233+0000 7fe7191d7640 1 --2- 172.21.15.135:0/14443301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe714102a80 0x7fe714198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.233+0000 7fe7191d7640 1 -- 172.21.15.135:0/14443301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71419ff80 con 0x7fe714107ce0 2024-04-20T12:23:11.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.233+0000 7fe713fff640 1 --2- 172.21.15.135:0/14443301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7141053b0 0x7fe7141988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:11.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.233+0000 7fe7191d7640 1 --2- 172.21.15.135:0/14443301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe714107ce0 0x7fe71419f910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00e940 tx=0x7fe70c00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:11.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.233+0000 7fe711ffb640 1 -- 172.21.15.135:0/14443301 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c004d20 con 0x7fe714107ce0 2024-04-20T12:23:11.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.233+0000 7fe71ac3a640 1 -- 172.21.15.135:0/14443301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7141a0270 con 0x7fe714107ce0 2024-04-20T12:23:11.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.233+0000 7fe711ffb640 1 -- 172.21.15.135:0/14443301 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe70c005020 con 0x7fe714107ce0 2024-04-20T12:23:11.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.233+0000 7fe711ffb640 1 -- 172.21.15.135:0/14443301 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0116b0 con 0x7fe714107ce0 2024-04-20T12:23:11.236 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.233+0000 7fe71ac3a640 1 -- 172.21.15.135:0/14443301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7141a07c0 con 0x7fe714107ce0 2024-04-20T12:23:11.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.234+0000 7fe71ac3a640 1 -- 172.21.15.135:0/14443301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7140fdf00 con 0x7fe714107ce0 2024-04-20T12:23:11.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.235+0000 7fe711ffb640 1 -- 172.21.15.135:0/14443301 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 23) ==== 138818+0+0 (secure 0 0 0) 0x7fe70c0054d0 con 0x7fe714107ce0 2024-04-20T12:23:11.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.236+0000 7fe711ffb640 1 --2- 172.21.15.135:0/14443301 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe7040a3db0 0x7fe7040a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:11.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.236+0000 7fe7189d6640 1 --2- 172.21.15.135:0/14443301 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe7040a3db0 0x7fe7040a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:11.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.236+0000 7fe711ffb640 1 -- 172.21.15.135:0/14443301 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe70c0d0d90 con 0x7fe714107ce0 2024-04-20T12:23:11.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.236+0000 7fe7189d6640 1 --2- 172.21.15.135:0/14443301 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe7040a3db0 0x7fe7040a6270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe70802c8e0 tx=0x7fe70802df90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:11.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.240+0000 7fe711ffb640 1 -- 172.21.15.135:0/14443301 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fe70c016030 con 0x7fe714107ce0 2024-04-20T12:23:11.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/4034420185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:23:11.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi139 to 176.2M 2024-04-20T12:23:11.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: Unable to set osd_memory_target on smithi139 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-20T12:23:11.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi154 to 176.2M 2024-04-20T12:23:11.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: Unable to set osd_memory_target on smithi154 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-20T12:23:11.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2536757205' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:23:11.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi135 to 176.2M 2024-04-20T12:23:11.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: Unable to set osd_memory_target on smithi135 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-20T12:23:11.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:23:11.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:23:11.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: Updating smithi135:/etc/ceph/ceph.conf 2024-04-20T12:23:11.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: Updating smithi139:/etc/ceph/ceph.conf 2024-04-20T12:23:11.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: Updating smithi154:/etc/ceph/ceph.conf 2024-04-20T12:23:11.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1193454578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:23:11.367 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: Updating smithi135:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:23:11.368 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: Updating smithi139:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:23:11.368 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: Updating smithi154:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:23:11.368 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:11 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3024279564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:23:11.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.429+0000 7fe71ac3a640 1 -- 172.21.15.135:0/14443301 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe71402d780 con 0x7fe714107ce0 2024-04-20T12:23:11.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.429+0000 7fe711ffb640 1 -- 172.21.15.135:0/14443301 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v95) ==== 103+0+11 (secure 0 0 0) 0x7fe70c09c8f0 con 0x7fe714107ce0 2024-04-20T12:23:11.429 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:23:11.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.432+0000 7fe71ac3a640 1 -- 172.21.15.135:0/14443301 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe7040a3db0 msgr2=0x7fe7040a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:11.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.432+0000 7fe71ac3a640 1 --2- 172.21.15.135:0/14443301 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe7040a3db0 0x7fe7040a6270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe70802c8e0 tx=0x7fe70802df90 comp rx=0 tx=0).stop 2024-04-20T12:23:11.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.432+0000 7fe71ac3a640 1 -- 172.21.15.135:0/14443301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe714107ce0 msgr2=0x7fe71419f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:11.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.432+0000 7fe71ac3a640 1 --2- 172.21.15.135:0/14443301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe714107ce0 0x7fe71419f910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00e940 tx=0x7fe70c00ee00 comp rx=0 tx=0).stop 2024-04-20T12:23:11.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.432+0000 7fe71ac3a640 1 -- 172.21.15.135:0/14443301 shutdown_connections 2024-04-20T12:23:11.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.432+0000 7fe71ac3a640 1 --2- 172.21.15.135:0/14443301 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe7040a3db0 0x7fe7040a6270 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.432+0000 7fe71ac3a640 1 --2- 172.21.15.135:0/14443301 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe714107ce0 0x7fe71419f910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.432+0000 7fe71ac3a640 1 --2- 172.21.15.135:0/14443301 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe7141053b0 0x7fe7141988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.432+0000 7fe71ac3a640 1 --2- 172.21.15.135:0/14443301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe714102a80 0x7fe714198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.432+0000 7fe71ac3a640 1 -- 172.21.15.135:0/14443301 >> 172.21.15.135:0/14443301 conn(0x7fe7140fc410 msgr2=0x7fe714103560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:11.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.432+0000 7fe71ac3a640 1 -- 172.21.15.135:0/14443301 shutdown_connections 2024-04-20T12:23:11.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.432+0000 7fe71ac3a640 1 -- 172.21.15.135:0/14443301 wait complete. 2024-04-20T12:23:11.443 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-04-20T12:23:11.443 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:23:11.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/4034420185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:23:11.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi139 to 176.2M 2024-04-20T12:23:11.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: Unable to set osd_memory_target on smithi139 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-20T12:23:11.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi154 to 176.2M 2024-04-20T12:23:11.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: Unable to set osd_memory_target on smithi154 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-20T12:23:11.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2536757205' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:23:11.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi135 to 176.2M 2024-04-20T12:23:11.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: Unable to set osd_memory_target on smithi135 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-20T12:23:11.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:23:11.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:23:11.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: Updating smithi135:/etc/ceph/ceph.conf 2024-04-20T12:23:11.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: Updating smithi139:/etc/ceph/ceph.conf 2024-04-20T12:23:11.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: Updating smithi154:/etc/ceph/ceph.conf 2024-04-20T12:23:11.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1193454578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:23:11.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: Updating smithi135:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:23:11.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: Updating smithi139:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:23:11.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: Updating smithi154:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:23:11.505 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:11 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3024279564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:23:11.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.552+0000 7fda6d0ba640 1 -- 172.21.15.135:0/4175729310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda68106180 msgr2=0x7fda6810dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.552+0000 7fda6d0ba640 1 --2- 172.21.15.135:0/4175729310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda68106180 0x7fda6810dd50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fda60009ca0 tx=0x7fda6002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.552+0000 7fda6d0ba640 1 -- 172.21.15.135:0/4175729310 shutdown_connections 2024-04-20T12:23:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.552+0000 7fda6d0ba640 1 --2- 172.21.15.135:0/4175729310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda68106180 0x7fda6810dd50 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.552+0000 7fda6d0ba640 1 --2- 172.21.15.135:0/4175729310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda68101a60 0x7fda68105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.552+0000 7fda6d0ba640 1 --2- 172.21.15.135:0/4175729310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda681010b0 0x7fda68101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.552+0000 7fda6d0ba640 1 -- 172.21.15.135:0/4175729310 >> 172.21.15.135:0/4175729310 conn(0x7fda68077f60 msgr2=0x7fda68078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.552+0000 7fda6d0ba640 1 -- 172.21.15.135:0/4175729310 shutdown_connections 2024-04-20T12:23:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.552+0000 7fda6d0ba640 1 -- 172.21.15.135:0/4175729310 wait complete. 2024-04-20T12:23:11.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.553+0000 7fda6d0ba640 1 Processor -- start 2024-04-20T12:23:11.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.553+0000 7fda6d0ba640 1 -- start start 2024-04-20T12:23:11.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.553+0000 7fda6d0ba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda681010b0 0x7fda6819e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:11.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda6d0ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda68106180 0x7fda6819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:11.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda6d0ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda681986a0 0x7fda68198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda6d0ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda68111240 con 0x7fda68106180 2024-04-20T12:23:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda6d0ba640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fda681110c0 con 0x7fda681010b0 2024-04-20T12:23:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda6d0ba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fda681113c0 con 0x7fda681986a0 2024-04-20T12:23:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda6659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda68106180 0x7fda6819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda66d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda681010b0 0x7fda6819e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda66d9d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda681010b0 0x7fda6819e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:37864/0 (socket says 172.21.15.135:37864) 2024-04-20T12:23:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda66d9d640 1 -- 172.21.15.135:0/1271543606 learned_addr learned my addr 172.21.15.135:0/1271543606 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda6659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda68106180 0x7fda6819eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35290/0 (socket says 172.21.15.135:35290) 2024-04-20T12:23:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda6759e640 1 --2- 172.21.15.135:0/1271543606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda681986a0 0x7fda68198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda66d9d640 1 -- 172.21.15.135:0/1271543606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda681986a0 msgr2=0x7fda68198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda66d9d640 1 --2- 172.21.15.135:0/1271543606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda681986a0 0x7fda68198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda66d9d640 1 -- 172.21.15.135:0/1271543606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda68106180 msgr2=0x7fda6819eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:11.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda66d9d640 1 --2- 172.21.15.135:0/1271543606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda68106180 0x7fda6819eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda66d9d640 1 -- 172.21.15.135:0/1271543606 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda681992a0 con 0x7fda681010b0 2024-04-20T12:23:11.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda6659c640 1 --2- 172.21.15.135:0/1271543606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda68106180 0x7fda6819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:11.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda6759e640 1 --2- 172.21.15.135:0/1271543606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda681986a0 0x7fda68198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:11.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda66d9d640 1 --2- 172.21.15.135:0/1271543606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda681010b0 0x7fda6819e5e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00e9f0 tx=0x7fda5c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:11.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda4ffff640 1 -- 172.21.15.135:0/1271543606 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c00cd80 con 0x7fda681010b0 2024-04-20T12:23:11.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda6d0ba640 1 -- 172.21.15.135:0/1271543606 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda681a5380 con 0x7fda681010b0 2024-04-20T12:23:11.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda4ffff640 1 -- 172.21.15.135:0/1271543606 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda5c005500 con 0x7fda681010b0 2024-04-20T12:23:11.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda4ffff640 1 -- 172.21.15.135:0/1271543606 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5c010690 con 0x7fda681010b0 2024-04-20T12:23:11.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.554+0000 7fda6d0ba640 1 -- 172.21.15.135:0/1271543606 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda681a5730 con 0x7fda681010b0 2024-04-20T12:23:11.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.556+0000 7fda6d0ba640 1 -- 172.21.15.135:0/1271543606 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda68102580 con 0x7fda681010b0 2024-04-20T12:23:11.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.557+0000 7fda4ffff640 1 -- 172.21.15.135:0/1271543606 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7fda5c0046c0 con 0x7fda681010b0 2024-04-20T12:23:11.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.557+0000 7fda4ffff640 1 --2- 172.21.15.135:0/1271543606 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fda500a3e40 0x7fda500a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:11.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.557+0000 7fda6659c640 1 --2- 172.21.15.135:0/1271543606 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fda500a3e40 0x7fda500a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:11.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.557+0000 7fda4ffff640 1 -- 172.21.15.135:0/1271543606 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fda5c0d1220 con 0x7fda681010b0 2024-04-20T12:23:11.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.558+0000 7fda6659c640 1 --2- 172.21.15.135:0/1271543606 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fda500a3e40 0x7fda500a6300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda68199ef0 tx=0x7fda58005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:11.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.562+0000 7fda4ffff640 1 -- 172.21.15.135:0/1271543606 <== mon.2 v2:172.21.15.139:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fda5c09d2f0 con 0x7fda681010b0 2024-04-20T12:23:11.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/4034420185' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:23:11.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi139 to 176.2M 2024-04-20T12:23:11.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: Unable to set osd_memory_target on smithi139 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-20T12:23:11.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi154 to 176.2M 2024-04-20T12:23:11.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: Unable to set osd_memory_target on smithi154 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-20T12:23:11.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2536757205' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:23:11.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:11.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:23:11.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi135 to 176.2M 2024-04-20T12:23:11.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: Unable to set osd_memory_target on smithi135 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-20T12:23:11.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:23:11.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:23:11.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: Updating smithi135:/etc/ceph/ceph.conf 2024-04-20T12:23:11.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: Updating smithi139:/etc/ceph/ceph.conf 2024-04-20T12:23:11.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: Updating smithi154:/etc/ceph/ceph.conf 2024-04-20T12:23:11.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1193454578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:23:11.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: Updating smithi135:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:23:11.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: Updating smithi139:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:23:11.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: Updating smithi154:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.conf 2024-04-20T12:23:11.583 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:11 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3024279564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:23:11.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.813+0000 7fda6d0ba640 1 -- 172.21.15.135:0/1271543606 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda68068d80 con 0x7fda681010b0 2024-04-20T12:23:11.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.814+0000 7fda4ffff640 1 -- 172.21.15.135:0/1271543606 <== mon.2 v2:172.21.15.139:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7fda5c09cbf0 con 0x7fda681010b0 2024-04-20T12:23:11.814 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:23:11.814 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:23:11.814 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:23:11.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.816+0000 7fda6d0ba640 1 -- 172.21.15.135:0/1271543606 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fda500a3e40 msgr2=0x7fda500a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:11.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.816+0000 7fda6d0ba640 1 --2- 172.21.15.135:0/1271543606 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fda500a3e40 0x7fda500a6300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda68199ef0 tx=0x7fda58005f90 comp rx=0 tx=0).stop 2024-04-20T12:23:11.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.816+0000 7fda6d0ba640 1 -- 172.21.15.135:0/1271543606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda681010b0 msgr2=0x7fda6819e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:11.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.816+0000 7fda6d0ba640 1 --2- 172.21.15.135:0/1271543606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda681010b0 0x7fda6819e5e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00e9f0 tx=0x7fda5c00edf0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.816+0000 7fda6d0ba640 1 -- 172.21.15.135:0/1271543606 shutdown_connections 2024-04-20T12:23:11.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.816+0000 7fda6d0ba640 1 --2- 172.21.15.135:0/1271543606 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fda500a3e40 0x7fda500a6300 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.816+0000 7fda6d0ba640 1 --2- 172.21.15.135:0/1271543606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fda681986a0 0x7fda68198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.816+0000 7fda6d0ba640 1 --2- 172.21.15.135:0/1271543606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda68106180 0x7fda6819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.816+0000 7fda6d0ba640 1 --2- 172.21.15.135:0/1271543606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fda681010b0 0x7fda6819e5e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.816+0000 7fda6d0ba640 1 -- 172.21.15.135:0/1271543606 >> 172.21.15.135:0/1271543606 conn(0x7fda68077f60 msgr2=0x7fda68104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:11.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.816+0000 7fda6d0ba640 1 -- 172.21.15.135:0/1271543606 shutdown_connections 2024-04-20T12:23:11.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.816+0000 7fda6d0ba640 1 -- 172.21.15.135:0/1271543606 wait complete. 2024-04-20T12:23:11.828 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-04-20T12:23:11.828 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-04-20T12:23:11.828 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T12:23:11.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.928+0000 7f81e243a640 1 -- 172.21.15.135:0/2972591441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81dc1021b0 msgr2=0x7f81dc102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:11.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.928+0000 7f81e243a640 1 --2- 172.21.15.135:0/2972591441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81dc1021b0 0x7f81dc102590 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f81cc009900 tx=0x7f81cc02bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:11.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.928+0000 7f81e243a640 1 -- 172.21.15.135:0/2972591441 shutdown_connections 2024-04-20T12:23:11.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.928+0000 7f81e243a640 1 --2- 172.21.15.135:0/2972591441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc107280 0x7f81dc10ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.928+0000 7f81e243a640 1 --2- 172.21.15.135:0/2972591441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81dc102b60 0x7f81dc106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.928+0000 7f81e243a640 1 --2- 172.21.15.135:0/2972591441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81dc1021b0 0x7f81dc102590 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.928+0000 7f81e243a640 1 -- 172.21.15.135:0/2972591441 >> 172.21.15.135:0/2972591441 conn(0x7f81dc079360 msgr2=0x7f81dc079770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:11.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.928+0000 7f81e243a640 1 -- 172.21.15.135:0/2972591441 shutdown_connections 2024-04-20T12:23:11.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.928+0000 7f81e243a640 1 -- 172.21.15.135:0/2972591441 wait complete. 2024-04-20T12:23:11.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.929+0000 7f81e243a640 1 Processor -- start 2024-04-20T12:23:11.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.929+0000 7f81e243a640 1 -- start start 2024-04-20T12:23:11.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.929+0000 7f81e243a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81dc1021b0 0x7f81dc19e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:11.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.929+0000 7f81e243a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc107280 0x7f81dc19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:11.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.929+0000 7f81e243a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81dc198680 0x7f81dc198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:11.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.929+0000 7f81e243a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81dc112340 con 0x7f81dc1021b0 2024-04-20T12:23:11.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.929+0000 7f81e243a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f81dc1121c0 con 0x7f81dc198680 2024-04-20T12:23:11.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.929+0000 7f81e243a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81dc1124c0 con 0x7f81dc107280 2024-04-20T12:23:11.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.929+0000 7f81dbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81dc1021b0 0x7f81dc19e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:11.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.930+0000 7f81dbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81dc1021b0 0x7f81dc19e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35294/0 (socket says 172.21.15.135:35294) 2024-04-20T12:23:11.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.930+0000 7f81dbfff640 1 -- 172.21.15.135:0/2141838282 learned_addr learned my addr 172.21.15.135:0/2141838282 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:11.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.930+0000 7f81db7fe640 1 --2- 172.21.15.135:0/2141838282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc107280 0x7f81dc19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:11.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.930+0000 7f81e09d7640 1 --2- 172.21.15.135:0/2141838282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81dc198680 0x7f81dc198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:11.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.930+0000 7f81dbfff640 1 -- 172.21.15.135:0/2141838282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc107280 msgr2=0x7f81dc19eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:11.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.930+0000 7f81dbfff640 1 --2- 172.21.15.135:0/2141838282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc107280 0x7f81dc19eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.930+0000 7f81dbfff640 1 -- 172.21.15.135:0/2141838282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81dc198680 msgr2=0x7f81dc198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:11.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.930+0000 7f81dbfff640 1 --2- 172.21.15.135:0/2141838282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81dc198680 0x7f81dc198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:11.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.930+0000 7f81dbfff640 1 -- 172.21.15.135:0/2141838282 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81dc199280 con 0x7f81dc1021b0 2024-04-20T12:23:11.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.930+0000 7f81dbfff640 1 --2- 172.21.15.135:0/2141838282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81dc1021b0 0x7f81dc19e5c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f81cc006010 tx=0x7f81cc02cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:11.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.930+0000 7f81d97fa640 1 -- 172.21.15.135:0/2141838282 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc041070 con 0x7f81dc1021b0 2024-04-20T12:23:11.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.930+0000 7f81e243a640 1 -- 172.21.15.135:0/2141838282 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81dc199510 con 0x7f81dc1021b0 2024-04-20T12:23:11.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.930+0000 7f81d97fa640 1 -- 172.21.15.135:0/2141838282 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81cc004450 con 0x7f81dc1021b0 2024-04-20T12:23:11.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.930+0000 7f81d97fa640 1 -- 172.21.15.135:0/2141838282 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc003e00 con 0x7f81dc1021b0 2024-04-20T12:23:11.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.930+0000 7f81e243a640 1 -- 172.21.15.135:0/2141838282 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81dc1a5650 con 0x7f81dc1021b0 2024-04-20T12:23:11.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.931+0000 7f81e243a640 1 -- 172.21.15.135:0/2141838282 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81dc103680 con 0x7f81dc1021b0 2024-04-20T12:23:11.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.932+0000 7f81d97fa640 1 -- 172.21.15.135:0/2141838282 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7f81cc044070 con 0x7f81dc1021b0 2024-04-20T12:23:11.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.933+0000 7f81d97fa640 1 --2- 172.21.15.135:0/2141838282 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f81c40a3e40 0x7f81c40a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:11.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.933+0000 7f81db7fe640 1 --2- 172.21.15.135:0/2141838282 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f81c40a3e40 0x7f81c40a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:11.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.933+0000 7f81d97fa640 1 -- 172.21.15.135:0/2141838282 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f81cc0f2830 con 0x7f81dc1021b0 2024-04-20T12:23:11.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.933+0000 7f81db7fe640 1 --2- 172.21.15.135:0/2141838282 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f81c40a3e40 0x7f81c40a6300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f81dc199ed0 tx=0x7f81d0005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:11.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:11.938+0000 7f81d97fa640 1 -- 172.21.15.135:0/2141838282 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f81cc0bea10 con 0x7f81dc1021b0 2024-04-20T12:23:12.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.115+0000 7f81e243a640 1 -- 172.21.15.135:0/2141838282 --> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81dc10a520 con 0x7f81c40a3e40 2024-04-20T12:23:12.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.125+0000 7f81d97fa640 1 -- 172.21.15.135:0/2141838282 <== mgr.25093 v2:172.21.15.135:6800/15232286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339746 (secure 0 0 0) 0x7f81d001b3f0 con 0x7f81c40a3e40 2024-04-20T12:23:12.129 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:23:12.131 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-04-20T12:23:12.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.128+0000 7f81e243a640 1 -- 172.21.15.135:0/2141838282 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f81c40a3e40 msgr2=0x7f81c40a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:12.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.128+0000 7f81e243a640 1 --2- 172.21.15.135:0/2141838282 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f81c40a3e40 0x7f81c40a6300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f81dc199ed0 tx=0x7f81d0005f90 comp rx=0 tx=0).stop 2024-04-20T12:23:12.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.128+0000 7f81e243a640 1 -- 172.21.15.135:0/2141838282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81dc1021b0 msgr2=0x7f81dc19e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:12.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.128+0000 7f81e243a640 1 --2- 172.21.15.135:0/2141838282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81dc1021b0 0x7f81dc19e5c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f81cc006010 tx=0x7f81cc02cb30 comp rx=0 tx=0).stop 2024-04-20T12:23:12.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.129+0000 7f81e243a640 1 -- 172.21.15.135:0/2141838282 shutdown_connections 2024-04-20T12:23:12.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.129+0000 7f81e243a640 1 --2- 172.21.15.135:0/2141838282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f81dc198680 0x7f81dc198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.129+0000 7f81e243a640 1 --2- 172.21.15.135:0/2141838282 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f81c40a3e40 0x7f81c40a6300 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.129+0000 7f81e243a640 1 --2- 172.21.15.135:0/2141838282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc107280 0x7f81dc19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.129+0000 7f81e243a640 1 --2- 172.21.15.135:0/2141838282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f81dc1021b0 0x7f81dc19e5c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.129+0000 7f81e243a640 1 -- 172.21.15.135:0/2141838282 >> 172.21.15.135:0/2141838282 conn(0x7f81dc079360 msgr2=0x7f81dc100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:12.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.129+0000 7f81e243a640 1 -- 172.21.15.135:0/2141838282 shutdown_connections 2024-04-20T12:23:12.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.129+0000 7f81e243a640 1 -- 172.21.15.135:0/2141838282 wait complete. 2024-04-20T12:23:12.140 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-20T12:23:11.100659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1194562,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1464,"num_read_kb":907,"num_write":555,"num_write_kb":4410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181358,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":941,"ondisk_log_size":941,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366336,"kb_used_data":12980,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575488,"statfs":{"total":1151940427776,"available":1151565299712,"internally_reserved":0,"allocated":13291520,"data_stored":9622455,"data_compressed":555695,"data_compressed_allocated":757760,"data_compressed_original":4022272,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.985672"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216249+0000","last_change":"2024-04-20T12:20:42.031660+0000","last_active":"2024-04-20T12:23:07.216249+0000","last_peered":"2024-04-20T12:23:07.216249+0000","last_clean":"2024-04-20T12:23:07.216249+0000","last_became_active":"2024-04-20T12:20:42.031334+0000","last_became_peered":"2024-04-20T12:20:42.031334+0000","last_unstale":"2024-04-20T12:23:07.216249+0000","last_undegraded":"2024-04-20T12:23:07.216249+0000","last_fullsized":"2024-04-20T12:23:07.216249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:27.971885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216525+0000","last_change":"2024-04-20T12:20:42.039049+0000","last_active":"2024-04-20T12:23:07.216525+0000","last_peered":"2024-04-20T12:23:07.216525+0000","last_clean":"2024-04-20T12:23:07.216525+0000","last_became_active":"2024-04-20T12:20:42.037960+0000","last_became_peered":"2024-04-20T12:20:42.037960+0000","last_unstale":"2024-04-20T12:23:07.216525+0000","last_undegraded":"2024-04-20T12:23:07.216525+0000","last_fullsized":"2024-04-20T12:23:07.216525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:45:44.482154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216180+0000","last_change":"2024-04-20T12:20:42.036915+0000","last_active":"2024-04-20T12:23:07.216180+0000","last_peered":"2024-04-20T12:23:07.216180+0000","last_clean":"2024-04-20T12:23:07.216180+0000","last_became_active":"2024-04-20T12:20:42.036282+0000","last_became_peered":"2024-04-20T12:20:42.036282+0000","last_unstale":"2024-04-20T12:23:07.216180+0000","last_undegraded":"2024-04-20T12:23:07.216180+0000","last_fullsized":"2024-04-20T12:23:07.216180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:04:55.865977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216235+0000","last_change":"2024-04-20T12:20:42.036653+0000","last_active":"2024-04-20T12:23:07.216235+0000","last_peered":"2024-04-20T12:23:07.216235+0000","last_clean":"2024-04-20T12:23:07.216235+0000","last_became_active":"2024-04-20T12:20:42.036112+0000","last_became_peered":"2024-04-20T12:20:42.036112+0000","last_unstale":"2024-04-20T12:23:07.216235+0000","last_undegraded":"2024-04-20T12:23:07.216235+0000","last_fullsized":"2024-04-20T12:23:07.216235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:05:50.728127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087883+0000","last_change":"2024-04-20T12:20:42.031271+0000","last_active":"2024-04-20T12:23:07.087883+0000","last_peered":"2024-04-20T12:23:07.087883+0000","last_clean":"2024-04-20T12:23:07.087883+0000","last_became_active":"2024-04-20T12:20:42.030930+0000","last_became_peered":"2024-04-20T12:20:42.030930+0000","last_unstale":"2024-04-20T12:23:07.087883+0000","last_undegraded":"2024-04-20T12:23:07.087883+0000","last_fullsized":"2024-04-20T12:23:07.087883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:30:53.523203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087836+0000","last_change":"2024-04-20T12:20:42.037556+0000","last_active":"2024-04-20T12:23:07.087836+0000","last_peered":"2024-04-20T12:23:07.087836+0000","last_clean":"2024-04-20T12:23:07.087836+0000","last_became_active":"2024-04-20T12:20:42.037140+0000","last_became_peered":"2024-04-20T12:20:42.037140+0000","last_unstale":"2024-04-20T12:23:07.087836+0000","last_undegraded":"2024-04-20T12:23:07.087836+0000","last_fullsized":"2024-04-20T12:23:07.087836+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:41:50.827641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217082+0000","last_change":"2024-04-20T12:20:42.042004+0000","last_active":"2024-04-20T12:23:07.217082+0000","last_peered":"2024-04-20T12:23:07.217082+0000","last_clean":"2024-04-20T12:23:07.217082+0000","last_became_active":"2024-04-20T12:20:42.041663+0000","last_became_peered":"2024-04-20T12:20:42.041663+0000","last_unstale":"2024-04-20T12:23:07.217082+0000","last_undegraded":"2024-04-20T12:23:07.217082+0000","last_fullsized":"2024-04-20T12:23:07.217082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:00.196652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.085989+0000","last_change":"2024-04-20T12:20:42.043250+0000","last_active":"2024-04-20T12:23:07.085989+0000","last_peered":"2024-04-20T12:23:07.085989+0000","last_clean":"2024-04-20T12:23:07.085989+0000","last_became_active":"2024-04-20T12:20:42.042678+0000","last_became_peered":"2024-04-20T12:20:42.042678+0000","last_unstale":"2024-04-20T12:23:07.085989+0000","last_undegraded":"2024-04-20T12:23:07.085989+0000","last_fullsized":"2024-04-20T12:23:07.085989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:28:36.825718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216164+0000","last_change":"2024-04-20T12:20:42.026370+0000","last_active":"2024-04-20T12:23:07.216164+0000","last_peered":"2024-04-20T12:23:07.216164+0000","last_clean":"2024-04-20T12:23:07.216164+0000","last_became_active":"2024-04-20T12:20:42.026010+0000","last_became_peered":"2024-04-20T12:20:42.026010+0000","last_unstale":"2024-04-20T12:23:07.216164+0000","last_undegraded":"2024-04-20T12:23:07.216164+0000","last_fullsized":"2024-04-20T12:23:07.216164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:13.526130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":55,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087972+0000","last_change":"2024-04-20T12:21:37.912184+0000","last_active":"2024-04-20T12:23:07.087972+0000","last_peered":"2024-04-20T12:23:07.087972+0000","last_clean":"2024-04-20T12:23:07.087972+0000","last_became_active":"2024-04-20T12:21:37.911745+0000","last_became_peered":"2024-04-20T12:21:37.911745+0000","last_unstale":"2024-04-20T12:23:07.087972+0000","last_undegraded":"2024-04-20T12:23:07.087972+0000","last_fullsized":"2024-04-20T12:23:07.087972+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:39:26.296420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216834+0000","last_change":"2024-04-20T12:20:42.032408+0000","last_active":"2024-04-20T12:23:07.216834+0000","last_peered":"2024-04-20T12:23:07.216834+0000","last_clean":"2024-04-20T12:23:07.216834+0000","last_became_active":"2024-04-20T12:20:42.032035+0000","last_became_peered":"2024-04-20T12:20:42.032035+0000","last_unstale":"2024-04-20T12:23:07.216834+0000","last_undegraded":"2024-04-20T12:23:07.216834+0000","last_fullsized":"2024-04-20T12:23:07.216834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:03.702299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216212+0000","last_change":"2024-04-20T12:20:42.040299+0000","last_active":"2024-04-20T12:23:07.216212+0000","last_peered":"2024-04-20T12:23:07.216212+0000","last_clean":"2024-04-20T12:23:07.216212+0000","last_became_active":"2024-04-20T12:20:42.039891+0000","last_became_peered":"2024-04-20T12:20:42.039891+0000","last_unstale":"2024-04-20T12:23:07.216212+0000","last_undegraded":"2024-04-20T12:23:07.216212+0000","last_fullsized":"2024-04-20T12:23:07.216212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:16:31.701459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.353753+0000","last_change":"2024-04-20T12:20:42.032551+0000","last_active":"2024-04-20T12:23:07.353753+0000","last_peered":"2024-04-20T12:23:07.353753+0000","last_clean":"2024-04-20T12:23:07.353753+0000","last_became_active":"2024-04-20T12:20:42.032247+0000","last_became_peered":"2024-04-20T12:20:42.032247+0000","last_unstale":"2024-04-20T12:23:07.353753+0000","last_undegraded":"2024-04-20T12:23:07.353753+0000","last_fullsized":"2024-04-20T12:23:07.353753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:02:22.181110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215795+0000","last_change":"2024-04-20T12:20:42.042662+0000","last_active":"2024-04-20T12:23:07.215795+0000","last_peered":"2024-04-20T12:23:07.215795+0000","last_clean":"2024-04-20T12:23:07.215795+0000","last_became_active":"2024-04-20T12:20:42.042351+0000","last_became_peered":"2024-04-20T12:20:42.042351+0000","last_unstale":"2024-04-20T12:23:07.215795+0000","last_undegraded":"2024-04-20T12:23:07.215795+0000","last_fullsized":"2024-04-20T12:23:07.215795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:15:21.632339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215730+0000","last_change":"2024-04-20T12:20:42.033402+0000","last_active":"2024-04-20T12:23:07.215730+0000","last_peered":"2024-04-20T12:23:07.215730+0000","last_clean":"2024-04-20T12:23:07.215730+0000","last_became_active":"2024-04-20T12:20:42.032996+0000","last_became_peered":"2024-04-20T12:20:42.032996+0000","last_unstale":"2024-04-20T12:23:07.215730+0000","last_undegraded":"2024-04-20T12:23:07.215730+0000","last_fullsized":"2024-04-20T12:23:07.215730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:45.487051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215744+0000","last_change":"2024-04-20T12:20:42.033836+0000","last_active":"2024-04-20T12:23:07.215744+0000","last_peered":"2024-04-20T12:23:07.215744+0000","last_clean":"2024-04-20T12:23:07.215744+0000","last_became_active":"2024-04-20T12:20:42.033497+0000","last_became_peered":"2024-04-20T12:20:42.033497+0000","last_unstale":"2024-04-20T12:23:07.215744+0000","last_undegraded":"2024-04-20T12:23:07.215744+0000","last_fullsized":"2024-04-20T12:23:07.215744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:25:16.428158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216116+0000","last_change":"2024-04-20T12:20:42.030284+0000","last_active":"2024-04-20T12:23:07.216116+0000","last_peered":"2024-04-20T12:23:07.216116+0000","last_clean":"2024-04-20T12:23:07.216116+0000","last_became_active":"2024-04-20T12:20:42.029899+0000","last_became_peered":"2024-04-20T12:20:42.029899+0000","last_unstale":"2024-04-20T12:23:07.216116+0000","last_undegraded":"2024-04-20T12:23:07.216116+0000","last_fullsized":"2024-04-20T12:23:07.216116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:39:14.371947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.187992+0000","last_change":"2024-04-20T12:20:42.028298+0000","last_active":"2024-04-20T12:23:07.187992+0000","last_peered":"2024-04-20T12:23:07.187992+0000","last_clean":"2024-04-20T12:23:07.187992+0000","last_became_active":"2024-04-20T12:20:42.027814+0000","last_became_peered":"2024-04-20T12:20:42.027814+0000","last_unstale":"2024-04-20T12:23:07.187992+0000","last_undegraded":"2024-04-20T12:23:07.187992+0000","last_fullsized":"2024-04-20T12:23:07.187992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:44:39.903424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216529+0000","last_change":"2024-04-20T12:20:42.043697+0000","last_active":"2024-04-20T12:23:07.216529+0000","last_peered":"2024-04-20T12:23:07.216529+0000","last_clean":"2024-04-20T12:23:07.216529+0000","last_became_active":"2024-04-20T12:20:42.043322+0000","last_became_peered":"2024-04-20T12:20:42.043322+0000","last_unstale":"2024-04-20T12:23:07.216529+0000","last_undegraded":"2024-04-20T12:23:07.216529+0000","last_fullsized":"2024-04-20T12:23:07.216529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:08:35.148726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215596+0000","last_change":"2024-04-20T12:20:46.326298+0000","last_active":"2024-04-20T12:23:07.215596+0000","last_peered":"2024-04-20T12:23:07.215596+0000","last_clean":"2024-04-20T12:23:07.215596+0000","last_became_active":"2024-04-20T12:20:46.325893+0000","last_became_peered":"2024-04-20T12:20:46.325893+0000","last_unstale":"2024-04-20T12:23:07.215596+0000","last_undegraded":"2024-04-20T12:23:07.215596+0000","last_fullsized":"2024-04-20T12:23:07.215596+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:17.076871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"95'14","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.352563+0000","last_change":"2024-04-20T12:20:41.027834+0000","last_active":"2024-04-20T12:23:07.352563+0000","last_peered":"2024-04-20T12:23:07.352563+0000","last_clean":"2024-04-20T12:23:07.352563+0000","last_became_active":"2024-04-20T12:20:41.027541+0000","last_became_peered":"2024-04-20T12:20:41.027541+0000","last_unstale":"2024-04-20T12:23:07.352563+0000","last_undegraded":"2024-04-20T12:23:07.352563+0000","last_fullsized":"2024-04-20T12:23:07.352563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:30.454875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086589+0000","last_change":"2024-04-20T12:20:42.043315+0000","last_active":"2024-04-20T12:23:07.086589+0000","last_peered":"2024-04-20T12:23:07.086589+0000","last_clean":"2024-04-20T12:23:07.086589+0000","last_became_active":"2024-04-20T12:20:42.042920+0000","last_became_peered":"2024-04-20T12:20:42.042920+0000","last_unstale":"2024-04-20T12:23:07.086589+0000","last_undegraded":"2024-04-20T12:23:07.086589+0000","last_fullsized":"2024-04-20T12:23:07.086589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:52.353023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215802+0000","last_change":"2024-04-20T12:20:46.327004+0000","last_active":"2024-04-20T12:23:07.215802+0000","last_peered":"2024-04-20T12:23:07.215802+0000","last_clean":"2024-04-20T12:23:07.215802+0000","last_became_active":"2024-04-20T12:20:46.326433+0000","last_became_peered":"2024-04-20T12:20:46.326433+0000","last_unstale":"2024-04-20T12:23:07.215802+0000","last_undegraded":"2024-04-20T12:23:07.215802+0000","last_fullsized":"2024-04-20T12:23:07.215802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:58:05.864093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086674+0000","last_change":"2024-04-20T12:20:41.032149+0000","last_active":"2024-04-20T12:23:07.086674+0000","last_peered":"2024-04-20T12:23:07.086674+0000","last_clean":"2024-04-20T12:23:07.086674+0000","last_became_active":"2024-04-20T12:20:41.031708+0000","last_became_peered":"2024-04-20T12:20:41.031708+0000","last_unstale":"2024-04-20T12:23:07.086674+0000","last_undegraded":"2024-04-20T12:23:07.086674+0000","last_fullsized":"2024-04-20T12:23:07.086674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:55.167376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216198+0000","last_change":"2024-04-20T12:20:42.040462+0000","last_active":"2024-04-20T12:23:07.216198+0000","last_peered":"2024-04-20T12:23:07.216198+0000","last_clean":"2024-04-20T12:23:07.216198+0000","last_became_active":"2024-04-20T12:20:42.040098+0000","last_became_peered":"2024-04-20T12:20:42.040098+0000","last_unstale":"2024-04-20T12:23:07.216198+0000","last_undegraded":"2024-04-20T12:23:07.216198+0000","last_fullsized":"2024-04-20T12:23:07.216198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:16.091488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216097+0000","last_change":"2024-04-20T12:22:38.007648+0000","last_active":"2024-04-20T12:23:07.216097+0000","last_peered":"2024-04-20T12:23:07.216097+0000","last_clean":"2024-04-20T12:23:07.216097+0000","last_became_active":"2024-04-20T12:22:38.007115+0000","last_became_peered":"2024-04-20T12:22:38.007115+0000","last_unstale":"2024-04-20T12:23:07.216097+0000","last_undegraded":"2024-04-20T12:23:07.216097+0000","last_fullsized":"2024-04-20T12:23:07.216097+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:37:37.683366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":33,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216447+0000","last_change":"2024-04-20T12:21:37.924962+0000","last_active":"2024-04-20T12:23:07.216447+0000","last_peered":"2024-04-20T12:23:07.216447+0000","last_clean":"2024-04-20T12:23:07.216447+0000","last_became_active":"2024-04-20T12:21:37.914275+0000","last_became_peered":"2024-04-20T12:21:37.914275+0000","last_unstale":"2024-04-20T12:23:07.216447+0000","last_undegraded":"2024-04-20T12:23:07.216447+0000","last_fullsized":"2024-04-20T12:23:07.216447+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:05.894889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216326+0000","last_change":"2024-04-20T12:20:42.029785+0000","last_active":"2024-04-20T12:23:07.216326+0000","last_peered":"2024-04-20T12:23:07.216326+0000","last_clean":"2024-04-20T12:23:07.216326+0000","last_became_active":"2024-04-20T12:20:42.029377+0000","last_became_peered":"2024-04-20T12:20:42.029377+0000","last_unstale":"2024-04-20T12:23:07.216326+0000","last_undegraded":"2024-04-20T12:23:07.216326+0000","last_fullsized":"2024-04-20T12:23:07.216326+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:22:52.429274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215910+0000","last_change":"2024-04-20T12:20:46.326552+0000","last_active":"2024-04-20T12:23:07.215910+0000","last_peered":"2024-04-20T12:23:07.215910+0000","last_clean":"2024-04-20T12:23:07.215910+0000","last_became_active":"2024-04-20T12:20:46.325573+0000","last_became_peered":"2024-04-20T12:20:46.325573+0000","last_unstale":"2024-04-20T12:23:07.215910+0000","last_undegraded":"2024-04-20T12:23:07.215910+0000","last_fullsized":"2024-04-20T12:23:07.215910+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:26:01.218141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.088150+0000","last_change":"2024-04-20T12:20:41.023884+0000","last_active":"2024-04-20T12:23:07.088150+0000","last_peered":"2024-04-20T12:23:07.088150+0000","last_clean":"2024-04-20T12:23:07.088150+0000","last_became_active":"2024-04-20T12:20:41.023496+0000","last_became_peered":"2024-04-20T12:20:41.023496+0000","last_unstale":"2024-04-20T12:23:07.088150+0000","last_undegraded":"2024-04-20T12:23:07.088150+0000","last_fullsized":"2024-04-20T12:23:07.088150+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:08.824928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":32,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.187759+0000","last_change":"2024-04-20T12:21:37.941552+0000","last_active":"2024-04-20T12:23:07.187759+0000","last_peered":"2024-04-20T12:23:07.187759+0000","last_clean":"2024-04-20T12:23:07.187759+0000","last_became_active":"2024-04-20T12:21:37.941228+0000","last_became_peered":"2024-04-20T12:21:37.941228+0000","last_unstale":"2024-04-20T12:23:07.187759+0000","last_undegraded":"2024-04-20T12:23:07.187759+0000","last_fullsized":"2024-04-20T12:23:07.187759+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:33.915039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216425+0000","last_change":"2024-04-20T12:20:46.324508+0000","last_active":"2024-04-20T12:23:07.216425+0000","last_peered":"2024-04-20T12:23:07.216425+0000","last_clean":"2024-04-20T12:23:07.216425+0000","last_became_active":"2024-04-20T12:20:46.324014+0000","last_became_peered":"2024-04-20T12:20:46.324014+0000","last_unstale":"2024-04-20T12:23:07.216425+0000","last_undegraded":"2024-04-20T12:23:07.216425+0000","last_fullsized":"2024-04-20T12:23:07.216425+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:17.765152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'7","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:08.048129+0000","last_change":"2024-04-20T12:21:37.927225+0000","last_active":"2024-04-20T12:23:08.048129+0000","last_peered":"2024-04-20T12:23:08.048129+0000","last_clean":"2024-04-20T12:23:08.048129+0000","last_became_active":"2024-04-20T12:21:37.911437+0000","last_became_peered":"2024-04-20T12:21:37.911437+0000","last_unstale":"2024-04-20T12:23:08.048129+0000","last_undegraded":"2024-04-20T12:23:08.048129+0000","last_fullsized":"2024-04-20T12:23:08.048129+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:08:14.576145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087776+0000","last_change":"2024-04-20T12:20:42.047403+0000","last_active":"2024-04-20T12:23:07.087776+0000","last_peered":"2024-04-20T12:23:07.087776+0000","last_clean":"2024-04-20T12:23:07.087776+0000","last_became_active":"2024-04-20T12:20:42.046240+0000","last_became_peered":"2024-04-20T12:20:42.046240+0000","last_unstale":"2024-04-20T12:23:07.087776+0000","last_undegraded":"2024-04-20T12:23:07.087776+0000","last_fullsized":"2024-04-20T12:23:07.087776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:21:40.410666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216108+0000","last_change":"2024-04-20T12:22:38.082510+0000","last_active":"2024-04-20T12:23:07.216108+0000","last_peered":"2024-04-20T12:23:07.216108+0000","last_clean":"2024-04-20T12:23:07.216108+0000","last_became_active":"2024-04-20T12:22:38.081953+0000","last_became_peered":"2024-04-20T12:22:38.081953+0000","last_unstale":"2024-04-20T12:23:07.216108+0000","last_undegraded":"2024-04-20T12:23:07.216108+0000","last_fullsized":"2024-04-20T12:23:07.216108+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:57:25.210260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087868+0000","last_change":"2024-04-20T12:20:41.027532+0000","last_active":"2024-04-20T12:23:07.087868+0000","last_peered":"2024-04-20T12:23:07.087868+0000","last_clean":"2024-04-20T12:23:07.087868+0000","last_became_active":"2024-04-20T12:20:41.027090+0000","last_became_peered":"2024-04-20T12:20:41.027090+0000","last_unstale":"2024-04-20T12:23:07.087868+0000","last_undegraded":"2024-04-20T12:23:07.087868+0000","last_fullsized":"2024-04-20T12:23:07.087868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:40:10.450305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196092+0000","last_change":"2024-04-20T12:21:37.912691+0000","last_active":"2024-04-20T12:23:07.196092+0000","last_peered":"2024-04-20T12:23:07.196092+0000","last_clean":"2024-04-20T12:23:07.196092+0000","last_became_active":"2024-04-20T12:21:37.912295+0000","last_became_peered":"2024-04-20T12:21:37.912295+0000","last_unstale":"2024-04-20T12:23:07.196092+0000","last_undegraded":"2024-04-20T12:23:07.196092+0000","last_fullsized":"2024-04-20T12:23:07.196092+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:48:04.501944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215972+0000","last_change":"2024-04-20T12:20:46.318633+0000","last_active":"2024-04-20T12:23:07.215972+0000","last_peered":"2024-04-20T12:23:07.215972+0000","last_clean":"2024-04-20T12:23:07.215972+0000","last_became_active":"2024-04-20T12:20:46.318215+0000","last_became_peered":"2024-04-20T12:20:46.318215+0000","last_unstale":"2024-04-20T12:23:07.215972+0000","last_undegraded":"2024-04-20T12:23:07.215972+0000","last_fullsized":"2024-04-20T12:23:07.215972+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:07:31.241287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.353126+0000","last_change":"2024-04-20T12:20:41.027009+0000","last_active":"2024-04-20T12:23:07.353126+0000","last_peered":"2024-04-20T12:23:07.353126+0000","last_clean":"2024-04-20T12:23:07.353126+0000","last_became_active":"2024-04-20T12:20:41.026683+0000","last_became_peered":"2024-04-20T12:20:41.026683+0000","last_unstale":"2024-04-20T12:23:07.353126+0000","last_undegraded":"2024-04-20T12:23:07.353126+0000","last_fullsized":"2024-04-20T12:23:07.353126+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:56:35.955635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086145+0000","last_change":"2024-04-20T12:20:42.030833+0000","last_active":"2024-04-20T12:23:07.086145+0000","last_peered":"2024-04-20T12:23:07.086145+0000","last_clean":"2024-04-20T12:23:07.086145+0000","last_became_active":"2024-04-20T12:20:42.030470+0000","last_became_peered":"2024-04-20T12:20:42.030470+0000","last_unstale":"2024-04-20T12:23:07.086145+0000","last_undegraded":"2024-04-20T12:23:07.086145+0000","last_fullsized":"2024-04-20T12:23:07.086145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:20:07.381222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216429+0000","last_change":"2024-04-20T12:20:46.327091+0000","last_active":"2024-04-20T12:23:07.216429+0000","last_peered":"2024-04-20T12:23:07.216429+0000","last_clean":"2024-04-20T12:23:07.216429+0000","last_became_active":"2024-04-20T12:20:46.326663+0000","last_became_peered":"2024-04-20T12:20:46.326663+0000","last_unstale":"2024-04-20T12:23:07.216429+0000","last_undegraded":"2024-04-20T12:23:07.216429+0000","last_fullsized":"2024-04-20T12:23:07.216429+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:37:31.968946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.195825+0000","last_change":"2024-04-20T12:20:41.028908+0000","last_active":"2024-04-20T12:23:07.195825+0000","last_peered":"2024-04-20T12:23:07.195825+0000","last_clean":"2024-04-20T12:23:07.195825+0000","last_became_active":"2024-04-20T12:20:41.028570+0000","last_became_peered":"2024-04-20T12:20:41.028570+0000","last_unstale":"2024-04-20T12:23:07.195825+0000","last_undegraded":"2024-04-20T12:23:07.195825+0000","last_fullsized":"2024-04-20T12:23:07.195825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:39:27.309249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.187437+0000","last_change":"2024-04-20T12:20:42.028802+0000","last_active":"2024-04-20T12:23:07.187437+0000","last_peered":"2024-04-20T12:23:07.187437+0000","last_clean":"2024-04-20T12:23:07.187437+0000","last_became_active":"2024-04-20T12:20:42.028458+0000","last_became_peered":"2024-04-20T12:20:42.028458+0000","last_unstale":"2024-04-20T12:23:07.187437+0000","last_undegraded":"2024-04-20T12:23:07.187437+0000","last_fullsized":"2024-04-20T12:23:07.187437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:59:28.284954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086291+0000","last_change":"2024-04-20T12:20:46.331055+0000","last_active":"2024-04-20T12:23:07.086291+0000","last_peered":"2024-04-20T12:23:07.086291+0000","last_clean":"2024-04-20T12:23:07.086291+0000","last_became_active":"2024-04-20T12:20:46.330181+0000","last_became_peered":"2024-04-20T12:20:46.330181+0000","last_unstale":"2024-04-20T12:23:07.086291+0000","last_undegraded":"2024-04-20T12:23:07.086291+0000","last_fullsized":"2024-04-20T12:23:07.086291+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:27.430141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"95'6","reported_seq":282,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:08.047687+0000","last_change":"2024-04-20T12:20:41.025859+0000","last_active":"2024-04-20T12:23:08.047687+0000","last_peered":"2024-04-20T12:23:08.047687+0000","last_clean":"2024-04-20T12:23:08.047687+0000","last_became_active":"2024-04-20T12:20:41.025443+0000","last_became_peered":"2024-04-20T12:20:41.025443+0000","last_unstale":"2024-04-20T12:23:08.047687+0000","last_undegraded":"2024-04-20T12:23:08.047687+0000","last_fullsized":"2024-04-20T12:23:08.047687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:11:28.100797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216219+0000","last_change":"2024-04-20T12:20:42.028510+0000","last_active":"2024-04-20T12:23:07.216219+0000","last_peered":"2024-04-20T12:23:07.216219+0000","last_clean":"2024-04-20T12:23:07.216219+0000","last_became_active":"2024-04-20T12:20:42.028176+0000","last_became_peered":"2024-04-20T12:20:42.028176+0000","last_unstale":"2024-04-20T12:23:07.216219+0000","last_undegraded":"2024-04-20T12:23:07.216219+0000","last_fullsized":"2024-04-20T12:23:07.216219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:49:44.606154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.187328+0000","last_change":"2024-04-20T12:20:46.327813+0000","last_active":"2024-04-20T12:23:07.187328+0000","last_peered":"2024-04-20T12:23:07.187328+0000","last_clean":"2024-04-20T12:23:07.187328+0000","last_became_active":"2024-04-20T12:20:46.327446+0000","last_became_peered":"2024-04-20T12:20:46.327446+0000","last_unstale":"2024-04-20T12:23:07.187328+0000","last_undegraded":"2024-04-20T12:23:07.187328+0000","last_fullsized":"2024-04-20T12:23:07.187328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:30:23.990693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216702+0000","last_change":"2024-04-20T12:20:41.027748+0000","last_active":"2024-04-20T12:23:07.216702+0000","last_peered":"2024-04-20T12:23:07.216702+0000","last_clean":"2024-04-20T12:23:07.216702+0000","last_became_active":"2024-04-20T12:20:41.027400+0000","last_became_peered":"2024-04-20T12:20:41.027400+0000","last_unstale":"2024-04-20T12:23:07.216702+0000","last_undegraded":"2024-04-20T12:23:07.216702+0000","last_fullsized":"2024-04-20T12:23:07.216702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:27:50.008057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216926+0000","last_change":"2024-04-20T12:21:37.912851+0000","last_active":"2024-04-20T12:23:07.216926+0000","last_peered":"2024-04-20T12:23:07.216926+0000","last_clean":"2024-04-20T12:23:07.216926+0000","last_became_active":"2024-04-20T12:21:37.912487+0000","last_became_peered":"2024-04-20T12:21:37.912487+0000","last_unstale":"2024-04-20T12:23:07.216926+0000","last_undegraded":"2024-04-20T12:23:07.216926+0000","last_fullsized":"2024-04-20T12:23:07.216926+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:09:49.568654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216501+0000","last_change":"2024-04-20T12:20:46.326239+0000","last_active":"2024-04-20T12:23:07.216501+0000","last_peered":"2024-04-20T12:23:07.216501+0000","last_clean":"2024-04-20T12:23:07.216501+0000","last_became_active":"2024-04-20T12:20:46.325830+0000","last_became_peered":"2024-04-20T12:20:46.325830+0000","last_unstale":"2024-04-20T12:23:07.216501+0000","last_undegraded":"2024-04-20T12:23:07.216501+0000","last_fullsized":"2024-04-20T12:23:07.216501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:07.311396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196154+0000","last_change":"2024-04-20T12:20:41.024662+0000","last_active":"2024-04-20T12:23:07.196154+0000","last_peered":"2024-04-20T12:23:07.196154+0000","last_clean":"2024-04-20T12:23:07.196154+0000","last_became_active":"2024-04-20T12:20:41.024327+0000","last_became_peered":"2024-04-20T12:20:41.024327+0000","last_unstale":"2024-04-20T12:23:07.196154+0000","last_undegraded":"2024-04-20T12:23:07.196154+0000","last_fullsized":"2024-04-20T12:23:07.196154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:07.079126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216596+0000","last_change":"2024-04-20T12:20:42.031910+0000","last_active":"2024-04-20T12:23:07.216596+0000","last_peered":"2024-04-20T12:23:07.216596+0000","last_clean":"2024-04-20T12:23:07.216596+0000","last_became_active":"2024-04-20T12:20:42.031600+0000","last_became_peered":"2024-04-20T12:20:42.031600+0000","last_unstale":"2024-04-20T12:23:07.216596+0000","last_undegraded":"2024-04-20T12:23:07.216596+0000","last_fullsized":"2024-04-20T12:23:07.216596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:23:56.448246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087465+0000","last_change":"2024-04-20T12:21:37.911484+0000","last_active":"2024-04-20T12:23:07.087465+0000","last_peered":"2024-04-20T12:23:07.087465+0000","last_clean":"2024-04-20T12:23:07.087465+0000","last_became_active":"2024-04-20T12:21:37.911069+0000","last_became_peered":"2024-04-20T12:21:37.911069+0000","last_unstale":"2024-04-20T12:23:07.087465+0000","last_undegraded":"2024-04-20T12:23:07.087465+0000","last_fullsized":"2024-04-20T12:23:07.087465+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:58:54.938004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"95'42","reported_seq":329,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:08.048902+0000","last_change":"2024-04-20T12:20:41.024722+0000","last_active":"2024-04-20T12:23:08.048902+0000","last_peered":"2024-04-20T12:23:08.048902+0000","last_clean":"2024-04-20T12:23:08.048902+0000","last_became_active":"2024-04-20T12:20:41.024150+0000","last_became_peered":"2024-04-20T12:20:41.024150+0000","last_unstale":"2024-04-20T12:23:08.048902+0000","last_undegraded":"2024-04-20T12:23:08.048902+0000","last_fullsized":"2024-04-20T12:23:08.048902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:14:49.622937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70068,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":195,"num_write":44,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.088143+0000","last_change":"2024-04-20T12:20:42.037589+0000","last_active":"2024-04-20T12:23:07.088143+0000","last_peered":"2024-04-20T12:23:07.088143+0000","last_clean":"2024-04-20T12:23:07.088143+0000","last_became_active":"2024-04-20T12:20:42.037256+0000","last_became_peered":"2024-04-20T12:20:42.037256+0000","last_unstale":"2024-04-20T12:23:07.088143+0000","last_undegraded":"2024-04-20T12:23:07.088143+0000","last_fullsized":"2024-04-20T12:23:07.088143+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:25.966289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196417+0000","last_change":"2024-04-20T12:20:46.326476+0000","last_active":"2024-04-20T12:23:07.196417+0000","last_peered":"2024-04-20T12:23:07.196417+0000","last_clean":"2024-04-20T12:23:07.196417+0000","last_became_active":"2024-04-20T12:20:46.326085+0000","last_became_peered":"2024-04-20T12:20:46.326085+0000","last_unstale":"2024-04-20T12:23:07.196417+0000","last_undegraded":"2024-04-20T12:23:07.196417+0000","last_fullsized":"2024-04-20T12:23:07.196417+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:34:15.608820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215928+0000","last_change":"2024-04-20T12:20:41.028360+0000","last_active":"2024-04-20T12:23:07.215928+0000","last_peered":"2024-04-20T12:23:07.215928+0000","last_clean":"2024-04-20T12:23:07.215928+0000","last_became_active":"2024-04-20T12:20:41.028057+0000","last_became_peered":"2024-04-20T12:20:41.028057+0000","last_unstale":"2024-04-20T12:23:07.215928+0000","last_undegraded":"2024-04-20T12:23:07.215928+0000","last_fullsized":"2024-04-20T12:23:07.215928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:30:49.699051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.353468+0000","last_change":"2024-04-20T12:21:37.912138+0000","last_active":"2024-04-20T12:23:07.353468+0000","last_peered":"2024-04-20T12:23:07.353468+0000","last_clean":"2024-04-20T12:23:07.353468+0000","last_became_active":"2024-04-20T12:21:37.911774+0000","last_became_peered":"2024-04-20T12:21:37.911774+0000","last_unstale":"2024-04-20T12:23:07.353468+0000","last_undegraded":"2024-04-20T12:23:07.353468+0000","last_fullsized":"2024-04-20T12:23:07.353468+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:41:34.250785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215847+0000","last_change":"2024-04-20T12:20:46.328605+0000","last_active":"2024-04-20T12:23:07.215847+0000","last_peered":"2024-04-20T12:23:07.215847+0000","last_clean":"2024-04-20T12:23:07.215847+0000","last_became_active":"2024-04-20T12:20:46.328091+0000","last_became_peered":"2024-04-20T12:20:46.328091+0000","last_unstale":"2024-04-20T12:23:07.215847+0000","last_undegraded":"2024-04-20T12:23:07.215847+0000","last_fullsized":"2024-04-20T12:23:07.215847+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:21:12.908696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196057+0000","last_change":"2024-04-20T12:20:41.028149+0000","last_active":"2024-04-20T12:23:07.196057+0000","last_peered":"2024-04-20T12:23:07.196057+0000","last_clean":"2024-04-20T12:23:07.196057+0000","last_became_active":"2024-04-20T12:20:41.027784+0000","last_became_peered":"2024-04-20T12:20:41.027784+0000","last_unstale":"2024-04-20T12:23:07.196057+0000","last_undegraded":"2024-04-20T12:23:07.196057+0000","last_fullsized":"2024-04-20T12:23:07.196057+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:45:31.227275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217137+0000","last_change":"2024-04-20T12:20:42.030961+0000","last_active":"2024-04-20T12:23:07.217137+0000","last_peered":"2024-04-20T12:23:07.217137+0000","last_clean":"2024-04-20T12:23:07.217137+0000","last_became_active":"2024-04-20T12:20:42.030597+0000","last_became_peered":"2024-04-20T12:20:42.030597+0000","last_unstale":"2024-04-20T12:23:07.217137+0000","last_undegraded":"2024-04-20T12:23:07.217137+0000","last_fullsized":"2024-04-20T12:23:07.217137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:59:29.679840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.188312+0000","last_change":"2024-04-20T12:20:46.327034+0000","last_active":"2024-04-20T12:23:07.188312+0000","last_peered":"2024-04-20T12:23:07.188312+0000","last_clean":"2024-04-20T12:23:07.188312+0000","last_became_active":"2024-04-20T12:20:46.325107+0000","last_became_peered":"2024-04-20T12:20:46.325107+0000","last_unstale":"2024-04-20T12:23:07.188312+0000","last_undegraded":"2024-04-20T12:23:07.188312+0000","last_fullsized":"2024-04-20T12:23:07.188312+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:44:04.924677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"95'7","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.511321+0000","last_change":"2024-04-20T12:20:41.020878+0000","last_active":"2024-04-20T12:23:07.511321+0000","last_peered":"2024-04-20T12:23:07.511321+0000","last_clean":"2024-04-20T12:23:07.511321+0000","last_became_active":"2024-04-20T12:20:41.020503+0000","last_became_peered":"2024-04-20T12:20:41.020503+0000","last_unstale":"2024-04-20T12:23:07.511321+0000","last_undegraded":"2024-04-20T12:23:07.511321+0000","last_fullsized":"2024-04-20T12:23:07.511321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:59:00.555136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1287,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217353+0000","last_change":"2024-04-20T12:20:42.039699+0000","last_active":"2024-04-20T12:23:07.217353+0000","last_peered":"2024-04-20T12:23:07.217353+0000","last_clean":"2024-04-20T12:23:07.217353+0000","last_became_active":"2024-04-20T12:20:42.039384+0000","last_became_peered":"2024-04-20T12:20:42.039384+0000","last_unstale":"2024-04-20T12:23:07.217353+0000","last_undegraded":"2024-04-20T12:23:07.217353+0000","last_fullsized":"2024-04-20T12:23:07.217353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:45:41.056018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.354238+0000","last_change":"2024-04-20T12:20:46.333294+0000","last_active":"2024-04-20T12:23:07.354238+0000","last_peered":"2024-04-20T12:23:07.354238+0000","last_clean":"2024-04-20T12:23:07.354238+0000","last_became_active":"2024-04-20T12:20:46.332887+0000","last_became_peered":"2024-04-20T12:20:46.332887+0000","last_unstale":"2024-04-20T12:23:07.354238+0000","last_undegraded":"2024-04-20T12:23:07.354238+0000","last_fullsized":"2024-04-20T12:23:07.354238+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:10.686220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087716+0000","last_change":"2024-04-20T12:20:41.027313+0000","last_active":"2024-04-20T12:23:07.087716+0000","last_peered":"2024-04-20T12:23:07.087716+0000","last_clean":"2024-04-20T12:23:07.087716+0000","last_became_active":"2024-04-20T12:20:41.026980+0000","last_became_peered":"2024-04-20T12:20:41.026980+0000","last_unstale":"2024-04-20T12:23:07.087716+0000","last_undegraded":"2024-04-20T12:23:07.087716+0000","last_fullsized":"2024-04-20T12:23:07.087716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:12.692075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196031+0000","last_change":"2024-04-20T12:20:42.027807+0000","last_active":"2024-04-20T12:23:07.196031+0000","last_peered":"2024-04-20T12:23:07.196031+0000","last_clean":"2024-04-20T12:23:07.196031+0000","last_became_active":"2024-04-20T12:20:42.027468+0000","last_became_peered":"2024-04-20T12:20:42.027468+0000","last_unstale":"2024-04-20T12:23:07.196031+0000","last_undegraded":"2024-04-20T12:23:07.196031+0000","last_fullsized":"2024-04-20T12:23:07.196031+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:51.924249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.195863+0000","last_change":"2024-04-20T12:20:46.324164+0000","last_active":"2024-04-20T12:23:07.195863+0000","last_peered":"2024-04-20T12:23:07.195863+0000","last_clean":"2024-04-20T12:23:07.195863+0000","last_became_active":"2024-04-20T12:20:46.323651+0000","last_became_peered":"2024-04-20T12:20:46.323651+0000","last_unstale":"2024-04-20T12:23:07.195863+0000","last_undegraded":"2024-04-20T12:23:07.195863+0000","last_fullsized":"2024-04-20T12:23:07.195863+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:07:54.429586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.088316+0000","last_change":"2024-04-20T12:20:41.023999+0000","last_active":"2024-04-20T12:23:07.088316+0000","last_peered":"2024-04-20T12:23:07.088316+0000","last_clean":"2024-04-20T12:23:07.088316+0000","last_became_active":"2024-04-20T12:20:41.023440+0000","last_became_peered":"2024-04-20T12:20:41.023440+0000","last_unstale":"2024-04-20T12:23:07.088316+0000","last_undegraded":"2024-04-20T12:23:07.088316+0000","last_fullsized":"2024-04-20T12:23:07.088316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:13:18.493395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215938+0000","last_change":"2024-04-20T12:20:42.036718+0000","last_active":"2024-04-20T12:23:07.215938+0000","last_peered":"2024-04-20T12:23:07.215938+0000","last_clean":"2024-04-20T12:23:07.215938+0000","last_became_active":"2024-04-20T12:20:42.036305+0000","last_became_peered":"2024-04-20T12:20:42.036305+0000","last_unstale":"2024-04-20T12:23:07.215938+0000","last_undegraded":"2024-04-20T12:23:07.215938+0000","last_fullsized":"2024-04-20T12:23:07.215938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:14.462345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087768+0000","last_change":"2024-04-20T12:20:46.930437+0000","last_active":"2024-04-20T12:23:07.087768+0000","last_peered":"2024-04-20T12:23:07.087768+0000","last_clean":"2024-04-20T12:23:07.087768+0000","last_became_active":"2024-04-20T12:20:46.929882+0000","last_became_peered":"2024-04-20T12:20:46.929882+0000","last_unstale":"2024-04-20T12:23:07.087768+0000","last_undegraded":"2024-04-20T12:23:07.087768+0000","last_fullsized":"2024-04-20T12:23:07.087768+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:56.540256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.187733+0000","last_change":"2024-04-20T12:20:41.023584+0000","last_active":"2024-04-20T12:23:07.187733+0000","last_peered":"2024-04-20T12:23:07.187733+0000","last_clean":"2024-04-20T12:23:07.187733+0000","last_became_active":"2024-04-20T12:20:41.023249+0000","last_became_peered":"2024-04-20T12:20:41.023249+0000","last_unstale":"2024-04-20T12:23:07.187733+0000","last_undegraded":"2024-04-20T12:23:07.187733+0000","last_fullsized":"2024-04-20T12:23:07.187733+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:18:06.704703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'4","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087908+0000","last_change":"2024-04-20T12:20:42.041424+0000","last_active":"2024-04-20T12:23:07.087908+0000","last_peered":"2024-04-20T12:23:07.087908+0000","last_clean":"2024-04-20T12:23:07.087908+0000","last_became_active":"2024-04-20T12:20:42.040231+0000","last_became_peered":"2024-04-20T12:20:42.040231+0000","last_unstale":"2024-04-20T12:23:07.087908+0000","last_undegraded":"2024-04-20T12:23:07.087908+0000","last_fullsized":"2024-04-20T12:23:07.087908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:29.523746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.353974+0000","last_change":"2024-04-20T12:20:46.326852+0000","last_active":"2024-04-20T12:23:07.353974+0000","last_peered":"2024-04-20T12:23:07.353974+0000","last_clean":"2024-04-20T12:23:07.353974+0000","last_became_active":"2024-04-20T12:20:46.326398+0000","last_became_peered":"2024-04-20T12:20:46.326398+0000","last_unstale":"2024-04-20T12:23:07.353974+0000","last_undegraded":"2024-04-20T12:23:07.353974+0000","last_fullsized":"2024-04-20T12:23:07.353974+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:00:33.076429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"95'7","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.509906+0000","last_change":"2024-04-20T12:20:41.032542+0000","last_active":"2024-04-20T12:23:07.509906+0000","last_peered":"2024-04-20T12:23:07.509906+0000","last_clean":"2024-04-20T12:23:07.509906+0000","last_became_active":"2024-04-20T12:20:41.032048+0000","last_became_peered":"2024-04-20T12:20:41.032048+0000","last_unstale":"2024-04-20T12:23:07.509906+0000","last_undegraded":"2024-04-20T12:23:07.509906+0000","last_fullsized":"2024-04-20T12:23:07.509906+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:16:35.515446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1370,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087596+0000","last_change":"2024-04-20T12:20:42.034006+0000","last_active":"2024-04-20T12:23:07.087596+0000","last_peered":"2024-04-20T12:23:07.087596+0000","last_clean":"2024-04-20T12:23:07.087596+0000","last_became_active":"2024-04-20T12:20:42.033639+0000","last_became_peered":"2024-04-20T12:20:42.033639+0000","last_unstale":"2024-04-20T12:23:07.087596+0000","last_undegraded":"2024-04-20T12:23:07.087596+0000","last_fullsized":"2024-04-20T12:23:07.087596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:39:27.435103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.354385+0000","last_change":"2024-04-20T12:20:46.930253+0000","last_active":"2024-04-20T12:23:07.354385+0000","last_peered":"2024-04-20T12:23:07.354385+0000","last_clean":"2024-04-20T12:23:07.354385+0000","last_became_active":"2024-04-20T12:20:46.929806+0000","last_became_peered":"2024-04-20T12:20:46.929806+0000","last_unstale":"2024-04-20T12:23:07.354385+0000","last_undegraded":"2024-04-20T12:23:07.354385+0000","last_fullsized":"2024-04-20T12:23:07.354385+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:23:55.085024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196120+0000","last_change":"2024-04-20T12:20:42.031231+0000","last_active":"2024-04-20T12:23:07.196120+0000","last_peered":"2024-04-20T12:23:07.196120+0000","last_clean":"2024-04-20T12:23:07.196120+0000","last_became_active":"2024-04-20T12:20:42.030920+0000","last_became_peered":"2024-04-20T12:20:42.030920+0000","last_unstale":"2024-04-20T12:23:07.196120+0000","last_undegraded":"2024-04-20T12:23:07.196120+0000","last_fullsized":"2024-04-20T12:23:07.196120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:14.631696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"94'6","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.353016+0000","last_change":"2024-04-20T12:20:41.030703+0000","last_active":"2024-04-20T12:23:07.353016+0000","last_peered":"2024-04-20T12:23:07.353016+0000","last_clean":"2024-04-20T12:23:07.353016+0000","last_became_active":"2024-04-20T12:20:41.030400+0000","last_became_peered":"2024-04-20T12:20:41.030400+0000","last_unstale":"2024-04-20T12:23:07.353016+0000","last_undegraded":"2024-04-20T12:23:07.353016+0000","last_fullsized":"2024-04-20T12:23:07.353016+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:46:07.845022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216517+0000","last_change":"2024-04-20T12:20:46.322872+0000","last_active":"2024-04-20T12:23:07.216517+0000","last_peered":"2024-04-20T12:23:07.216517+0000","last_clean":"2024-04-20T12:23:07.216517+0000","last_became_active":"2024-04-20T12:20:46.322440+0000","last_became_peered":"2024-04-20T12:20:46.322440+0000","last_unstale":"2024-04-20T12:23:07.216517+0000","last_undegraded":"2024-04-20T12:23:07.216517+0000","last_fullsized":"2024-04-20T12:23:07.216517+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:24:02.010584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086138+0000","last_change":"2024-04-20T12:20:42.041895+0000","last_active":"2024-04-20T12:23:07.086138+0000","last_peered":"2024-04-20T12:23:07.086138+0000","last_clean":"2024-04-20T12:23:07.086138+0000","last_became_active":"2024-04-20T12:20:42.040451+0000","last_became_peered":"2024-04-20T12:20:42.040451+0000","last_unstale":"2024-04-20T12:23:07.086138+0000","last_undegraded":"2024-04-20T12:23:07.086138+0000","last_fullsized":"2024-04-20T12:23:07.086138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:17.711581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216193+0000","last_change":"2024-04-20T12:20:41.020656+0000","last_active":"2024-04-20T12:23:07.216193+0000","last_peered":"2024-04-20T12:23:07.216193+0000","last_clean":"2024-04-20T12:23:07.216193+0000","last_became_active":"2024-04-20T12:20:41.020226+0000","last_became_peered":"2024-04-20T12:20:41.020226+0000","last_unstale":"2024-04-20T12:23:07.216193+0000","last_undegraded":"2024-04-20T12:23:07.216193+0000","last_fullsized":"2024-04-20T12:23:07.216193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:21:03.446920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":370,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217015+0000","last_change":"2024-04-20T12:19:29.284050+0000","last_active":"2024-04-20T12:23:07.217015+0000","last_peered":"2024-04-20T12:23:07.217015+0000","last_clean":"2024-04-20T12:23:07.217015+0000","last_became_active":"2024-04-20T12:19:29.283508+0000","last_became_peered":"2024-04-20T12:19:29.283508+0000","last_unstale":"2024-04-20T12:23:07.217015+0000","last_undegraded":"2024-04-20T12:23:07.217015+0000","last_fullsized":"2024-04-20T12:23:07.217015+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:16:03.444995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:16:03.444995+0000","last_clean_scrub_stamp":"2024-04-20T12:16:03.444995+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:28:39.268704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.088086+0000","last_change":"2024-04-20T12:22:38.089431+0000","last_active":"2024-04-20T12:23:07.088086+0000","last_peered":"2024-04-20T12:23:07.088086+0000","last_clean":"2024-04-20T12:23:07.088086+0000","last_became_active":"2024-04-20T12:22:38.089034+0000","last_became_peered":"2024-04-20T12:22:38.089034+0000","last_unstale":"2024-04-20T12:23:07.088086+0000","last_undegraded":"2024-04-20T12:23:07.088086+0000","last_fullsized":"2024-04-20T12:23:07.088086+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:53:00.078160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.352835+0000","last_change":"2024-04-20T12:20:42.030739+0000","last_active":"2024-04-20T12:23:07.352835+0000","last_peered":"2024-04-20T12:23:07.352835+0000","last_clean":"2024-04-20T12:23:07.352835+0000","last_became_active":"2024-04-20T12:20:42.030440+0000","last_became_peered":"2024-04-20T12:20:42.030440+0000","last_unstale":"2024-04-20T12:23:07.352835+0000","last_undegraded":"2024-04-20T12:23:07.352835+0000","last_fullsized":"2024-04-20T12:23:07.352835+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:44:39.311317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217147+0000","last_change":"2024-04-20T12:20:41.029967+0000","last_active":"2024-04-20T12:23:07.217147+0000","last_peered":"2024-04-20T12:23:07.217147+0000","last_clean":"2024-04-20T12:23:07.217147+0000","last_became_active":"2024-04-20T12:20:41.029618+0000","last_became_peered":"2024-04-20T12:20:41.029618+0000","last_unstale":"2024-04-20T12:23:07.217147+0000","last_undegraded":"2024-04-20T12:23:07.217147+0000","last_fullsized":"2024-04-20T12:23:07.217147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:48.762751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215840+0000","last_change":"2024-04-20T12:20:46.327782+0000","last_active":"2024-04-20T12:23:07.215840+0000","last_peered":"2024-04-20T12:23:07.215840+0000","last_clean":"2024-04-20T12:23:07.215840+0000","last_became_active":"2024-04-20T12:20:46.325462+0000","last_became_peered":"2024-04-20T12:20:46.325462+0000","last_unstale":"2024-04-20T12:23:07.215840+0000","last_undegraded":"2024-04-20T12:23:07.215840+0000","last_fullsized":"2024-04-20T12:23:07.215840+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:41.792496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.088129+0000","last_change":"2024-04-20T12:20:41.025454+0000","last_active":"2024-04-20T12:23:07.088129+0000","last_peered":"2024-04-20T12:23:07.088129+0000","last_clean":"2024-04-20T12:23:07.088129+0000","last_became_active":"2024-04-20T12:20:41.025121+0000","last_became_peered":"2024-04-20T12:20:41.025121+0000","last_unstale":"2024-04-20T12:23:07.088129+0000","last_undegraded":"2024-04-20T12:23:07.088129+0000","last_fullsized":"2024-04-20T12:23:07.088129+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:57:14.662567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.354075+0000","last_change":"2024-04-20T12:20:42.038483+0000","last_active":"2024-04-20T12:23:07.354075+0000","last_peered":"2024-04-20T12:23:07.354075+0000","last_clean":"2024-04-20T12:23:07.354075+0000","last_became_active":"2024-04-20T12:20:42.037626+0000","last_became_peered":"2024-04-20T12:20:42.037626+0000","last_unstale":"2024-04-20T12:23:07.354075+0000","last_undegraded":"2024-04-20T12:23:07.354075+0000","last_fullsized":"2024-04-20T12:23:07.354075+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:11:27.520320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086078+0000","last_change":"2024-04-20T12:20:46.930331+0000","last_active":"2024-04-20T12:23:07.086078+0000","last_peered":"2024-04-20T12:23:07.086078+0000","last_clean":"2024-04-20T12:23:07.086078+0000","last_became_active":"2024-04-20T12:20:46.929816+0000","last_became_peered":"2024-04-20T12:20:46.929816+0000","last_unstale":"2024-04-20T12:23:07.086078+0000","last_undegraded":"2024-04-20T12:23:07.086078+0000","last_fullsized":"2024-04-20T12:23:07.086078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:42:18.148443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'48","reported_seq":107,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.309867+0000","last_change":"2024-04-20T12:20:41.022365+0000","last_active":"2024-04-20T12:23:07.309867+0000","last_peered":"2024-04-20T12:23:07.309867+0000","last_clean":"2024-04-20T12:23:07.309867+0000","last_became_active":"2024-04-20T12:20:41.022028+0000","last_became_peered":"2024-04-20T12:20:41.022028+0000","last_unstale":"2024-04-20T12:23:07.309867+0000","last_undegraded":"2024-04-20T12:23:07.309867+0000","last_fullsized":"2024-04-20T12:23:07.309867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:16.436008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":84,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086487+0000","last_change":"2024-04-20T12:20:42.031833+0000","last_active":"2024-04-20T12:23:07.086487+0000","last_peered":"2024-04-20T12:23:07.086487+0000","last_clean":"2024-04-20T12:23:07.086487+0000","last_became_active":"2024-04-20T12:20:42.031535+0000","last_became_peered":"2024-04-20T12:20:42.031535+0000","last_unstale":"2024-04-20T12:23:07.086487+0000","last_undegraded":"2024-04-20T12:23:07.086487+0000","last_fullsized":"2024-04-20T12:23:07.086487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:39:38.955662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215412+0000","last_change":"2024-04-20T12:20:46.319218+0000","last_active":"2024-04-20T12:23:07.215412+0000","last_peered":"2024-04-20T12:23:07.215412+0000","last_clean":"2024-04-20T12:23:07.215412+0000","last_became_active":"2024-04-20T12:20:46.318822+0000","last_became_peered":"2024-04-20T12:20:46.318822+0000","last_unstale":"2024-04-20T12:23:07.215412+0000","last_undegraded":"2024-04-20T12:23:07.215412+0000","last_fullsized":"2024-04-20T12:23:07.215412+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:19:16.907942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216386+0000","last_change":"2024-04-20T12:20:41.035984+0000","last_active":"2024-04-20T12:23:07.216386+0000","last_peered":"2024-04-20T12:23:07.216386+0000","last_clean":"2024-04-20T12:23:07.216386+0000","last_became_active":"2024-04-20T12:20:41.035594+0000","last_became_peered":"2024-04-20T12:20:41.035594+0000","last_unstale":"2024-04-20T12:23:07.216386+0000","last_undegraded":"2024-04-20T12:23:07.216386+0000","last_fullsized":"2024-04-20T12:23:07.216386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:15.549551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216452+0000","last_change":"2024-04-20T12:20:42.032156+0000","last_active":"2024-04-20T12:23:07.216452+0000","last_peered":"2024-04-20T12:23:07.216452+0000","last_clean":"2024-04-20T12:23:07.216452+0000","last_became_active":"2024-04-20T12:20:42.031779+0000","last_became_peered":"2024-04-20T12:20:42.031779+0000","last_unstale":"2024-04-20T12:23:07.216452+0000","last_undegraded":"2024-04-20T12:23:07.216452+0000","last_fullsized":"2024-04-20T12:23:07.216452+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:43:48.156406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216036+0000","last_change":"2024-04-20T12:20:46.931229+0000","last_active":"2024-04-20T12:23:07.216036+0000","last_peered":"2024-04-20T12:23:07.216036+0000","last_clean":"2024-04-20T12:23:07.216036+0000","last_became_active":"2024-04-20T12:20:46.930677+0000","last_became_peered":"2024-04-20T12:20:46.930677+0000","last_unstale":"2024-04-20T12:23:07.216036+0000","last_undegraded":"2024-04-20T12:23:07.216036+0000","last_fullsized":"2024-04-20T12:23:07.216036+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:54.933944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215852+0000","last_change":"2024-04-20T12:20:41.023789+0000","last_active":"2024-04-20T12:23:07.215852+0000","last_peered":"2024-04-20T12:23:07.215852+0000","last_clean":"2024-04-20T12:23:07.215852+0000","last_became_active":"2024-04-20T12:20:41.023329+0000","last_became_peered":"2024-04-20T12:20:41.023329+0000","last_unstale":"2024-04-20T12:23:07.215852+0000","last_undegraded":"2024-04-20T12:23:07.215852+0000","last_fullsized":"2024-04-20T12:23:07.215852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:02:17.634230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087648+0000","last_change":"2024-04-20T12:20:42.028708+0000","last_active":"2024-04-20T12:23:07.087648+0000","last_peered":"2024-04-20T12:23:07.087648+0000","last_clean":"2024-04-20T12:23:07.087648+0000","last_became_active":"2024-04-20T12:20:42.028358+0000","last_became_peered":"2024-04-20T12:20:42.028358+0000","last_unstale":"2024-04-20T12:23:07.087648+0000","last_undegraded":"2024-04-20T12:23:07.087648+0000","last_fullsized":"2024-04-20T12:23:07.087648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:21:58.583709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.188431+0000","last_change":"2024-04-20T12:20:46.329173+0000","last_active":"2024-04-20T12:23:07.188431+0000","last_peered":"2024-04-20T12:23:07.188431+0000","last_clean":"2024-04-20T12:23:07.188431+0000","last_became_active":"2024-04-20T12:20:46.328771+0000","last_became_peered":"2024-04-20T12:20:46.328771+0000","last_unstale":"2024-04-20T12:23:07.188431+0000","last_undegraded":"2024-04-20T12:23:07.188431+0000","last_fullsized":"2024-04-20T12:23:07.188431+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:43:57.796849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086001+0000","last_change":"2024-04-20T12:20:41.030389+0000","last_active":"2024-04-20T12:23:07.086001+0000","last_peered":"2024-04-20T12:23:07.086001+0000","last_clean":"2024-04-20T12:23:07.086001+0000","last_became_active":"2024-04-20T12:20:41.029864+0000","last_became_peered":"2024-04-20T12:20:41.029864+0000","last_unstale":"2024-04-20T12:23:07.086001+0000","last_undegraded":"2024-04-20T12:23:07.086001+0000","last_fullsized":"2024-04-20T12:23:07.086001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:01:13.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215706+0000","last_change":"2024-04-20T12:20:42.032322+0000","last_active":"2024-04-20T12:23:07.215706+0000","last_peered":"2024-04-20T12:23:07.215706+0000","last_clean":"2024-04-20T12:23:07.215706+0000","last_became_active":"2024-04-20T12:20:42.031973+0000","last_became_peered":"2024-04-20T12:20:42.031973+0000","last_unstale":"2024-04-20T12:23:07.215706+0000","last_undegraded":"2024-04-20T12:23:07.215706+0000","last_fullsized":"2024-04-20T12:23:07.215706+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:44:17.135478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216033+0000","last_change":"2024-04-20T12:20:46.321909+0000","last_active":"2024-04-20T12:23:07.216033+0000","last_peered":"2024-04-20T12:23:07.216033+0000","last_clean":"2024-04-20T12:23:07.216033+0000","last_became_active":"2024-04-20T12:20:46.321273+0000","last_became_peered":"2024-04-20T12:20:46.321273+0000","last_unstale":"2024-04-20T12:23:07.216033+0000","last_undegraded":"2024-04-20T12:23:07.216033+0000","last_fullsized":"2024-04-20T12:23:07.216033+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:58:18.429052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"95'4","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216473+0000","last_change":"2024-04-20T12:21:37.947242+0000","last_active":"2024-04-20T12:23:07.216473+0000","last_peered":"2024-04-20T12:23:07.216473+0000","last_clean":"2024-04-20T12:23:07.216473+0000","last_became_active":"2024-04-20T12:21:37.941542+0000","last_became_peered":"2024-04-20T12:21:37.941542+0000","last_unstale":"2024-04-20T12:23:07.216473+0000","last_undegraded":"2024-04-20T12:23:07.216473+0000","last_fullsized":"2024-04-20T12:23:07.216473+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:48:04.916848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086363+0000","last_change":"2024-04-20T12:20:42.037258+0000","last_active":"2024-04-20T12:23:07.086363+0000","last_peered":"2024-04-20T12:23:07.086363+0000","last_clean":"2024-04-20T12:23:07.086363+0000","last_became_active":"2024-04-20T12:20:42.036755+0000","last_became_peered":"2024-04-20T12:20:42.036755+0000","last_unstale":"2024-04-20T12:23:07.086363+0000","last_undegraded":"2024-04-20T12:23:07.086363+0000","last_fullsized":"2024-04-20T12:23:07.086363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:23:17.093038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215884+0000","last_change":"2024-04-20T12:20:46.929829+0000","last_active":"2024-04-20T12:23:07.215884+0000","last_peered":"2024-04-20T12:23:07.215884+0000","last_clean":"2024-04-20T12:23:07.215884+0000","last_became_active":"2024-04-20T12:20:46.929296+0000","last_became_peered":"2024-04-20T12:20:46.929296+0000","last_unstale":"2024-04-20T12:23:07.215884+0000","last_undegraded":"2024-04-20T12:23:07.215884+0000","last_fullsized":"2024-04-20T12:23:07.215884+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:30.700141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087825+0000","last_change":"2024-04-20T12:20:41.027753+0000","last_active":"2024-04-20T12:23:07.087825+0000","last_peered":"2024-04-20T12:23:07.087825+0000","last_clean":"2024-04-20T12:23:07.087825+0000","last_became_active":"2024-04-20T12:20:41.027360+0000","last_became_peered":"2024-04-20T12:20:41.027360+0000","last_unstale":"2024-04-20T12:23:07.087825+0000","last_undegraded":"2024-04-20T12:23:07.087825+0000","last_fullsized":"2024-04-20T12:23:07.087825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:30:59.710541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217146+0000","last_change":"2024-04-20T12:20:42.029409+0000","last_active":"2024-04-20T12:23:07.217146+0000","last_peered":"2024-04-20T12:23:07.217146+0000","last_clean":"2024-04-20T12:23:07.217146+0000","last_became_active":"2024-04-20T12:20:42.029062+0000","last_became_peered":"2024-04-20T12:20:42.029062+0000","last_unstale":"2024-04-20T12:23:07.217146+0000","last_undegraded":"2024-04-20T12:23:07.217146+0000","last_fullsized":"2024-04-20T12:23:07.217146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:47:33.412087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215926+0000","last_change":"2024-04-20T12:20:46.326605+0000","last_active":"2024-04-20T12:23:07.215926+0000","last_peered":"2024-04-20T12:23:07.215926+0000","last_clean":"2024-04-20T12:23:07.215926+0000","last_became_active":"2024-04-20T12:20:46.326162+0000","last_became_peered":"2024-04-20T12:20:46.326162+0000","last_unstale":"2024-04-20T12:23:07.215926+0000","last_undegraded":"2024-04-20T12:23:07.215926+0000","last_fullsized":"2024-04-20T12:23:07.215926+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:44:37.344357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"95'6","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.485909+0000","last_change":"2024-04-20T12:20:41.035324+0000","last_active":"2024-04-20T12:23:07.485909+0000","last_peered":"2024-04-20T12:23:07.485909+0000","last_clean":"2024-04-20T12:23:07.485909+0000","last_became_active":"2024-04-20T12:20:41.034996+0000","last_became_peered":"2024-04-20T12:20:41.034996+0000","last_unstale":"2024-04-20T12:23:07.485909+0000","last_undegraded":"2024-04-20T12:23:07.485909+0000","last_fullsized":"2024-04-20T12:23:07.485909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:33.788405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216933+0000","last_change":"2024-04-20T12:20:42.028803+0000","last_active":"2024-04-20T12:23:07.216933+0000","last_peered":"2024-04-20T12:23:07.216933+0000","last_clean":"2024-04-20T12:23:07.216933+0000","last_became_active":"2024-04-20T12:20:42.028316+0000","last_became_peered":"2024-04-20T12:20:42.028316+0000","last_unstale":"2024-04-20T12:23:07.216933+0000","last_undegraded":"2024-04-20T12:23:07.216933+0000","last_fullsized":"2024-04-20T12:23:07.216933+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:09.000315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215788+0000","last_change":"2024-04-20T12:20:46.328502+0000","last_active":"2024-04-20T12:23:07.215788+0000","last_peered":"2024-04-20T12:23:07.215788+0000","last_clean":"2024-04-20T12:23:07.215788+0000","last_became_active":"2024-04-20T12:20:46.328106+0000","last_became_peered":"2024-04-20T12:20:46.328106+0000","last_unstale":"2024-04-20T12:23:07.215788+0000","last_undegraded":"2024-04-20T12:23:07.215788+0000","last_fullsized":"2024-04-20T12:23:07.215788+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:06:30.041621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"95'41","reported_seq":85,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.307416+0000","last_change":"2024-04-20T12:20:41.023918+0000","last_active":"2024-04-20T12:23:07.307416+0000","last_peered":"2024-04-20T12:23:07.307416+0000","last_clean":"2024-04-20T12:23:07.307416+0000","last_became_active":"2024-04-20T12:20:41.023088+0000","last_became_peered":"2024-04-20T12:20:41.023088+0000","last_unstale":"2024-04-20T12:23:07.307416+0000","last_undegraded":"2024-04-20T12:23:07.307416+0000","last_fullsized":"2024-04-20T12:23:07.307416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:15:03.220660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217351+0000","last_change":"2024-04-20T12:20:42.038981+0000","last_active":"2024-04-20T12:23:07.217351+0000","last_peered":"2024-04-20T12:23:07.217351+0000","last_clean":"2024-04-20T12:23:07.217351+0000","last_became_active":"2024-04-20T12:20:42.038656+0000","last_became_peered":"2024-04-20T12:20:42.038656+0000","last_unstale":"2024-04-20T12:23:07.217351+0000","last_undegraded":"2024-04-20T12:23:07.217351+0000","last_fullsized":"2024-04-20T12:23:07.217351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:51:08.446546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.195670+0000","last_change":"2024-04-20T12:20:46.323446+0000","last_active":"2024-04-20T12:23:07.195670+0000","last_peered":"2024-04-20T12:23:07.195670+0000","last_clean":"2024-04-20T12:23:07.195670+0000","last_became_active":"2024-04-20T12:20:46.322259+0000","last_became_peered":"2024-04-20T12:20:46.322259+0000","last_unstale":"2024-04-20T12:23:07.195670+0000","last_undegraded":"2024-04-20T12:23:07.195670+0000","last_fullsized":"2024-04-20T12:23:07.195670+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:01:11.833469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.354552+0000","last_change":"2024-04-20T12:20:41.029995+0000","last_active":"2024-04-20T12:23:07.354552+0000","last_peered":"2024-04-20T12:23:07.354552+0000","last_clean":"2024-04-20T12:23:07.354552+0000","last_became_active":"2024-04-20T12:20:41.029650+0000","last_became_peered":"2024-04-20T12:20:41.029650+0000","last_unstale":"2024-04-20T12:23:07.354552+0000","last_undegraded":"2024-04-20T12:23:07.354552+0000","last_fullsized":"2024-04-20T12:23:07.354552+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:24:54.522855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217386+0000","last_change":"2024-04-20T12:20:42.030357+0000","last_active":"2024-04-20T12:23:07.217386+0000","last_peered":"2024-04-20T12:23:07.217386+0000","last_clean":"2024-04-20T12:23:07.217386+0000","last_became_active":"2024-04-20T12:20:42.029966+0000","last_became_peered":"2024-04-20T12:20:42.029966+0000","last_unstale":"2024-04-20T12:23:07.217386+0000","last_undegraded":"2024-04-20T12:23:07.217386+0000","last_fullsized":"2024-04-20T12:23:07.217386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:35:09.487965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215896+0000","last_change":"2024-04-20T12:20:42.036914+0000","last_active":"2024-04-20T12:23:07.215896+0000","last_peered":"2024-04-20T12:23:07.215896+0000","last_clean":"2024-04-20T12:23:07.215896+0000","last_became_active":"2024-04-20T12:20:42.036434+0000","last_became_peered":"2024-04-20T12:20:42.036434+0000","last_unstale":"2024-04-20T12:23:07.215896+0000","last_undegraded":"2024-04-20T12:23:07.215896+0000","last_fullsized":"2024-04-20T12:23:07.215896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.552096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215529+0000","last_change":"2024-04-20T12:20:42.040424+0000","last_active":"2024-04-20T12:23:07.215529+0000","last_peered":"2024-04-20T12:23:07.215529+0000","last_clean":"2024-04-20T12:23:07.215529+0000","last_became_active":"2024-04-20T12:20:42.040095+0000","last_became_peered":"2024-04-20T12:20:42.040095+0000","last_unstale":"2024-04-20T12:23:07.215529+0000","last_undegraded":"2024-04-20T12:23:07.215529+0000","last_fullsized":"2024-04-20T12:23:07.215529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:24.669083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215646+0000","last_change":"2024-04-20T12:20:42.037764+0000","last_active":"2024-04-20T12:23:07.215646+0000","last_peered":"2024-04-20T12:23:07.215646+0000","last_clean":"2024-04-20T12:23:07.215646+0000","last_became_active":"2024-04-20T12:20:42.037389+0000","last_became_peered":"2024-04-20T12:20:42.037389+0000","last_unstale":"2024-04-20T12:23:07.215646+0000","last_undegraded":"2024-04-20T12:23:07.215646+0000","last_fullsized":"2024-04-20T12:23:07.215646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:20.284714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216037+0000","last_change":"2024-04-20T12:20:42.027546+0000","last_active":"2024-04-20T12:23:07.216037+0000","last_peered":"2024-04-20T12:23:07.216037+0000","last_clean":"2024-04-20T12:23:07.216037+0000","last_became_active":"2024-04-20T12:20:42.027229+0000","last_became_peered":"2024-04-20T12:20:42.027229+0000","last_unstale":"2024-04-20T12:23:07.216037+0000","last_undegraded":"2024-04-20T12:23:07.216037+0000","last_fullsized":"2024-04-20T12:23:07.216037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:22.649256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.354052+0000","last_change":"2024-04-20T12:20:42.024971+0000","last_active":"2024-04-20T12:23:07.354052+0000","last_peered":"2024-04-20T12:23:07.354052+0000","last_clean":"2024-04-20T12:23:07.354052+0000","last_became_active":"2024-04-20T12:20:42.024607+0000","last_became_peered":"2024-04-20T12:20:42.024607+0000","last_unstale":"2024-04-20T12:23:07.354052+0000","last_undegraded":"2024-04-20T12:23:07.354052+0000","last_fullsized":"2024-04-20T12:23:07.354052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:15:56.160140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216590+0000","last_change":"2024-04-20T12:20:42.036699+0000","last_active":"2024-04-20T12:23:07.216590+0000","last_peered":"2024-04-20T12:23:07.216590+0000","last_clean":"2024-04-20T12:23:07.216590+0000","last_became_active":"2024-04-20T12:20:42.036355+0000","last_became_peered":"2024-04-20T12:20:42.036355+0000","last_unstale":"2024-04-20T12:23:07.216590+0000","last_undegraded":"2024-04-20T12:23:07.216590+0000","last_fullsized":"2024-04-20T12:23:07.216590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:14:40.276148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216080+0000","last_change":"2024-04-20T12:20:42.034906+0000","last_active":"2024-04-20T12:23:07.216080+0000","last_peered":"2024-04-20T12:23:07.216080+0000","last_clean":"2024-04-20T12:23:07.216080+0000","last_became_active":"2024-04-20T12:20:42.034572+0000","last_became_peered":"2024-04-20T12:20:42.034572+0000","last_unstale":"2024-04-20T12:23:07.216080+0000","last_undegraded":"2024-04-20T12:23:07.216080+0000","last_fullsized":"2024-04-20T12:23:07.216080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:54.166032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086645+0000","last_change":"2024-04-20T12:20:42.041180+0000","last_active":"2024-04-20T12:23:07.086645+0000","last_peered":"2024-04-20T12:23:07.086645+0000","last_clean":"2024-04-20T12:23:07.086645+0000","last_became_active":"2024-04-20T12:20:42.040648+0000","last_became_peered":"2024-04-20T12:20:42.040648+0000","last_unstale":"2024-04-20T12:23:07.086645+0000","last_undegraded":"2024-04-20T12:23:07.086645+0000","last_fullsized":"2024-04-20T12:23:07.086645+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:55:38.855441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.195776+0000","last_change":"2024-04-20T12:20:42.030153+0000","last_active":"2024-04-20T12:23:07.195776+0000","last_peered":"2024-04-20T12:23:07.195776+0000","last_clean":"2024-04-20T12:23:07.195776+0000","last_became_active":"2024-04-20T12:20:42.029796+0000","last_became_peered":"2024-04-20T12:20:42.029796+0000","last_unstale":"2024-04-20T12:23:07.195776+0000","last_undegraded":"2024-04-20T12:23:07.195776+0000","last_fullsized":"2024-04-20T12:23:07.195776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:50.676958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086066+0000","last_change":"2024-04-20T12:20:42.039864+0000","last_active":"2024-04-20T12:23:07.086066+0000","last_peered":"2024-04-20T12:23:07.086066+0000","last_clean":"2024-04-20T12:23:07.086066+0000","last_became_active":"2024-04-20T12:20:42.036624+0000","last_became_peered":"2024-04-20T12:20:42.036624+0000","last_unstale":"2024-04-20T12:23:07.086066+0000","last_undegraded":"2024-04-20T12:23:07.086066+0000","last_fullsized":"2024-04-20T12:23:07.086066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:13.271749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216312+0000","last_change":"2024-04-20T12:20:42.033628+0000","last_active":"2024-04-20T12:23:07.216312+0000","last_peered":"2024-04-20T12:23:07.216312+0000","last_clean":"2024-04-20T12:23:07.216312+0000","last_became_active":"2024-04-20T12:20:42.033296+0000","last_became_peered":"2024-04-20T12:20:42.033296+0000","last_unstale":"2024-04-20T12:23:07.216312+0000","last_undegraded":"2024-04-20T12:23:07.216312+0000","last_fullsized":"2024-04-20T12:23:07.216312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:16:16.029327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.352822+0000","last_change":"2024-04-20T12:20:42.024730+0000","last_active":"2024-04-20T12:23:07.352822+0000","last_peered":"2024-04-20T12:23:07.352822+0000","last_clean":"2024-04-20T12:23:07.352822+0000","last_became_active":"2024-04-20T12:20:42.024400+0000","last_became_peered":"2024-04-20T12:20:42.024400+0000","last_unstale":"2024-04-20T12:23:07.352822+0000","last_undegraded":"2024-04-20T12:23:07.352822+0000","last_fullsized":"2024-04-20T12:23:07.352822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:27:41.514880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216011+0000","last_change":"2024-04-20T12:20:42.033623+0000","last_active":"2024-04-20T12:23:07.216011+0000","last_peered":"2024-04-20T12:23:07.216011+0000","last_clean":"2024-04-20T12:23:07.216011+0000","last_became_active":"2024-04-20T12:20:42.033105+0000","last_became_peered":"2024-04-20T12:20:42.033105+0000","last_unstale":"2024-04-20T12:23:07.216011+0000","last_undegraded":"2024-04-20T12:23:07.216011+0000","last_fullsized":"2024-04-20T12:23:07.216011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:01.121977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":106764,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":603960,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1328,"num_read_kb":788,"num_write":372,"num_write_kb":1470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":622,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":712704,"data_stored":1811880,"data_compressed":80748,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383722,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":529596,"data_compressed":29543,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645358,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32376,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712776,"statfs":{"total":95995035648,"available":95961882624,"internally_reserved":0,"allocated":1224704,"data_stored":1328653,"data_compressed":75884,"data_compressed_allocated":102400,"data_compressed_original":811008,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808884,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1081344,"data_stored":543496,"data_compressed":32526,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070522,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1097728,"data_stored":932994,"data_compressed":51672,"data_compressed_allocated":69632,"data_compressed_original":483328,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332159,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32280,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712872,"statfs":{"total":95995035648,"available":95961980928,"internally_reserved":0,"allocated":1126400,"data_stored":1138147,"data_compressed":68114,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495683,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1052672,"data_stored":535686,"data_compressed":32526,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1122304,"data_stored":606784,"data_compressed":34140,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1077248,"data_stored":536751,"data_compressed":32526,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712864,"statfs":{"total":95995035648,"available":95961972736,"internally_reserved":0,"allocated":1134592,"data_stored":605991,"data_compressed":34140,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":1059428,"data_compressed":57828,"data_compressed_allocated":77824,"data_compressed_original":606208,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920846,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1069056,"data_stored":541081,"data_compressed":32526,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757321,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32304,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712848,"statfs":{"total":95995035648,"available":95961956352,"internally_reserved":0,"allocated":1155072,"data_stored":1263848,"data_compressed":74270,"data_compressed_allocated":98304,"data_compressed_original":802816,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":72602,"data_compressed":1614,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":71809,"data_compressed":1614,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":135202,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":394716,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":204103,"data_compressed":7770,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T12:23:12.145 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T12:23:12.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.278+0000 7fd00825c640 1 -- 172.21.15.135:0/1786805528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0001021a0 msgr2=0x7fd000102580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:12.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.278+0000 7fd00825c640 1 --2- 172.21.15.135:0/1786805528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0001021a0 0x7fd000102580 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcffc009900 tx=0x7fcffc02bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:12.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.278+0000 7fd00825c640 1 -- 172.21.15.135:0/1786805528 shutdown_connections 2024-04-20T12:23:12.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.278+0000 7fd00825c640 1 --2- 172.21.15.135:0/1786805528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd000107270 0x7fd00010ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.278+0000 7fd00825c640 1 --2- 172.21.15.135:0/1786805528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd000102b50 0x7fd000106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.278+0000 7fd00825c640 1 --2- 172.21.15.135:0/1786805528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd0001021a0 0x7fd000102580 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.278+0000 7fd00825c640 1 -- 172.21.15.135:0/1786805528 >> 172.21.15.135:0/1786805528 conn(0x7fd000079320 msgr2=0x7fd000079730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:12.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.279+0000 7fd00825c640 1 -- 172.21.15.135:0/1786805528 shutdown_connections 2024-04-20T12:23:12.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.279+0000 7fd00825c640 1 -- 172.21.15.135:0/1786805528 wait complete. 2024-04-20T12:23:12.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.279+0000 7fd00825c640 1 Processor -- start 2024-04-20T12:23:12.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.279+0000 7fd00825c640 1 -- start start 2024-04-20T12:23:12.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.279+0000 7fd00825c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0001021a0 0x7fd00019e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:12.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.279+0000 7fd00825c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd000107270 0x7fd00019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:12.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.279+0000 7fd00825c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd000198670 0x7fd000198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:12.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.279+0000 7fd00825c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd000112330 con 0x7fd000107270 2024-04-20T12:23:12.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.279+0000 7fd00825c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd0001121b0 con 0x7fd0001021a0 2024-04-20T12:23:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.279+0000 7fd00825c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd0001124b0 con 0x7fd000198670 2024-04-20T12:23:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.279+0000 7fd0057f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd000107270 0x7fd00019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.279+0000 7fd0057f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd000107270 0x7fd00019eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35314/0 (socket says 172.21.15.135:35314) 2024-04-20T12:23:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.279+0000 7fd0057f7640 1 -- 172.21.15.135:0/752105973 learned_addr learned my addr 172.21.15.135:0/752105973 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.280+0000 7fd0067f9640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd000198670 0x7fd000198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.280+0000 7fd005ff8640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0001021a0 0x7fd00019e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.280+0000 7fd0057f7640 1 -- 172.21.15.135:0/752105973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd000198670 msgr2=0x7fd000198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.280+0000 7fd0057f7640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd000198670 0x7fd000198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.280+0000 7fd0057f7640 1 -- 172.21.15.135:0/752105973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0001021a0 msgr2=0x7fd00019e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.280+0000 7fd0057f7640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0001021a0 0x7fd00019e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.280+0000 7fd0057f7640 1 -- 172.21.15.135:0/752105973 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd000199270 con 0x7fd000107270 2024-04-20T12:23:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.280+0000 7fd0067f9640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd000198670 0x7fd000198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.280+0000 7fd005ff8640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0001021a0 0x7fd00019e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.280+0000 7fd0057f7640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd000107270 0x7fd00019eaf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcff000d770 tx=0x7fcff000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:12.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.280+0000 7fcff6ffd640 1 -- 172.21.15.135:0/752105973 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff0017070 con 0x7fd000107270 2024-04-20T12:23:12.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.280+0000 7fd00825c640 1 -- 172.21.15.135:0/752105973 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0001a5350 con 0x7fd000107270 2024-04-20T12:23:12.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.280+0000 7fcff6ffd640 1 -- 172.21.15.135:0/752105973 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcff0009c30 con 0x7fd000107270 2024-04-20T12:23:12.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.280+0000 7fcff6ffd640 1 -- 172.21.15.135:0/752105973 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff000f620 con 0x7fd000107270 2024-04-20T12:23:12.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.280+0000 7fd00825c640 1 -- 172.21.15.135:0/752105973 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0001a5750 con 0x7fd000107270 2024-04-20T12:23:12.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.281+0000 7fd00825c640 1 -- 172.21.15.135:0/752105973 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd000103670 con 0x7fd000107270 2024-04-20T12:23:12.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.282+0000 7fcff6ffd640 1 -- 172.21.15.135:0/752105973 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7fcff001a070 con 0x7fd000107270 2024-04-20T12:23:12.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.283+0000 7fcff6ffd640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcfec0a3e40 0x7fcfec0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:12.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.283+0000 7fd005ff8640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcfec0a3e40 0x7fcfec0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:12.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.283+0000 7fcff6ffd640 1 -- 172.21.15.135:0/752105973 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fcff00d09b0 con 0x7fd000107270 2024-04-20T12:23:12.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.283+0000 7fd005ff8640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcfec0a3e40 0x7fcfec0a6300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcffc036040 tx=0x7fcffc000bc0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:12.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.286+0000 7fcff6ffd640 1 -- 172.21.15.135:0/752105973 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fcff0009de0 con 0x7fd000107270 2024-04-20T12:23:12.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:23:12.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:23:12.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:23:12.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:23:12.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: Updating smithi135:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T12:23:12.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: Updating smithi154:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T12:23:12.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: Updating smithi139:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T12:23:12.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/14443301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:23:12.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-04-20T12:23:12.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1271543606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:23:12.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:23:12.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:23:12.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:23:12.365 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:12 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.462+0000 7fd00825c640 1 -- 172.21.15.135:0/752105973 --> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd000102b50 con 0x7fcfec0a3e40 2024-04-20T12:23:12.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.470+0000 7fcff6ffd640 1 -- 172.21.15.135:0/752105973 <== mgr.25093 v2:172.21.15.135:6800/15232286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339746 (secure 0 0 0) 0x7fd000102b50 con 0x7fcfec0a3e40 2024-04-20T12:23:12.474 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:23:12.476 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-04-20T12:23:12.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.474+0000 7fd00825c640 1 -- 172.21.15.135:0/752105973 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcfec0a3e40 msgr2=0x7fcfec0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:12.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.474+0000 7fd00825c640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcfec0a3e40 0x7fcfec0a6300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcffc036040 tx=0x7fcffc000bc0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.474+0000 7fd00825c640 1 -- 172.21.15.135:0/752105973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd000107270 msgr2=0x7fd00019eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.474+0000 7fd00825c640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd000107270 0x7fd00019eaf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fcff000d770 tx=0x7fcff000dc30 comp rx=0 tx=0).stop 2024-04-20T12:23:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.474+0000 7fd00825c640 1 -- 172.21.15.135:0/752105973 shutdown_connections 2024-04-20T12:23:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.474+0000 7fd00825c640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcfec0a3e40 0x7fcfec0a6300 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.474+0000 7fd00825c640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd000198670 0x7fd000198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.474+0000 7fd00825c640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd000107270 0x7fd00019eaf0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.474+0000 7fd00825c640 1 --2- 172.21.15.135:0/752105973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd0001021a0 0x7fd00019e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.474+0000 7fd00825c640 1 -- 172.21.15.135:0/752105973 >> 172.21.15.135:0/752105973 conn(0x7fd000079320 msgr2=0x7fd000100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.474+0000 7fd00825c640 1 -- 172.21.15.135:0/752105973 shutdown_connections 2024-04-20T12:23:12.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.474+0000 7fd00825c640 1 -- 172.21.15.135:0/752105973 wait complete. 2024-04-20T12:23:12.485 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-20T12:23:11.100659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1194562,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1464,"num_read_kb":907,"num_write":555,"num_write_kb":4410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181358,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":941,"ondisk_log_size":941,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366336,"kb_used_data":12980,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575488,"statfs":{"total":1151940427776,"available":1151565299712,"internally_reserved":0,"allocated":13291520,"data_stored":9622455,"data_compressed":555695,"data_compressed_allocated":757760,"data_compressed_original":4022272,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.985672"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216249+0000","last_change":"2024-04-20T12:20:42.031660+0000","last_active":"2024-04-20T12:23:07.216249+0000","last_peered":"2024-04-20T12:23:07.216249+0000","last_clean":"2024-04-20T12:23:07.216249+0000","last_became_active":"2024-04-20T12:20:42.031334+0000","last_became_peered":"2024-04-20T12:20:42.031334+0000","last_unstale":"2024-04-20T12:23:07.216249+0000","last_undegraded":"2024-04-20T12:23:07.216249+0000","last_fullsized":"2024-04-20T12:23:07.216249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:27.971885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216525+0000","last_change":"2024-04-20T12:20:42.039049+0000","last_active":"2024-04-20T12:23:07.216525+0000","last_peered":"2024-04-20T12:23:07.216525+0000","last_clean":"2024-04-20T12:23:07.216525+0000","last_became_active":"2024-04-20T12:20:42.037960+0000","last_became_peered":"2024-04-20T12:20:42.037960+0000","last_unstale":"2024-04-20T12:23:07.216525+0000","last_undegraded":"2024-04-20T12:23:07.216525+0000","last_fullsized":"2024-04-20T12:23:07.216525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:45:44.482154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216180+0000","last_change":"2024-04-20T12:20:42.036915+0000","last_active":"2024-04-20T12:23:07.216180+0000","last_peered":"2024-04-20T12:23:07.216180+0000","last_clean":"2024-04-20T12:23:07.216180+0000","last_became_active":"2024-04-20T12:20:42.036282+0000","last_became_peered":"2024-04-20T12:20:42.036282+0000","last_unstale":"2024-04-20T12:23:07.216180+0000","last_undegraded":"2024-04-20T12:23:07.216180+0000","last_fullsized":"2024-04-20T12:23:07.216180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:04:55.865977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216235+0000","last_change":"2024-04-20T12:20:42.036653+0000","last_active":"2024-04-20T12:23:07.216235+0000","last_peered":"2024-04-20T12:23:07.216235+0000","last_clean":"2024-04-20T12:23:07.216235+0000","last_became_active":"2024-04-20T12:20:42.036112+0000","last_became_peered":"2024-04-20T12:20:42.036112+0000","last_unstale":"2024-04-20T12:23:07.216235+0000","last_undegraded":"2024-04-20T12:23:07.216235+0000","last_fullsized":"2024-04-20T12:23:07.216235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:05:50.728127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087883+0000","last_change":"2024-04-20T12:20:42.031271+0000","last_active":"2024-04-20T12:23:07.087883+0000","last_peered":"2024-04-20T12:23:07.087883+0000","last_clean":"2024-04-20T12:23:07.087883+0000","last_became_active":"2024-04-20T12:20:42.030930+0000","last_became_peered":"2024-04-20T12:20:42.030930+0000","last_unstale":"2024-04-20T12:23:07.087883+0000","last_undegraded":"2024-04-20T12:23:07.087883+0000","last_fullsized":"2024-04-20T12:23:07.087883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:30:53.523203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087836+0000","last_change":"2024-04-20T12:20:42.037556+0000","last_active":"2024-04-20T12:23:07.087836+0000","last_peered":"2024-04-20T12:23:07.087836+0000","last_clean":"2024-04-20T12:23:07.087836+0000","last_became_active":"2024-04-20T12:20:42.037140+0000","last_became_peered":"2024-04-20T12:20:42.037140+0000","last_unstale":"2024-04-20T12:23:07.087836+0000","last_undegraded":"2024-04-20T12:23:07.087836+0000","last_fullsized":"2024-04-20T12:23:07.087836+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:41:50.827641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217082+0000","last_change":"2024-04-20T12:20:42.042004+0000","last_active":"2024-04-20T12:23:07.217082+0000","last_peered":"2024-04-20T12:23:07.217082+0000","last_clean":"2024-04-20T12:23:07.217082+0000","last_became_active":"2024-04-20T12:20:42.041663+0000","last_became_peered":"2024-04-20T12:20:42.041663+0000","last_unstale":"2024-04-20T12:23:07.217082+0000","last_undegraded":"2024-04-20T12:23:07.217082+0000","last_fullsized":"2024-04-20T12:23:07.217082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:00.196652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.085989+0000","last_change":"2024-04-20T12:20:42.043250+0000","last_active":"2024-04-20T12:23:07.085989+0000","last_peered":"2024-04-20T12:23:07.085989+0000","last_clean":"2024-04-20T12:23:07.085989+0000","last_became_active":"2024-04-20T12:20:42.042678+0000","last_became_peered":"2024-04-20T12:20:42.042678+0000","last_unstale":"2024-04-20T12:23:07.085989+0000","last_undegraded":"2024-04-20T12:23:07.085989+0000","last_fullsized":"2024-04-20T12:23:07.085989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:28:36.825718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216164+0000","last_change":"2024-04-20T12:20:42.026370+0000","last_active":"2024-04-20T12:23:07.216164+0000","last_peered":"2024-04-20T12:23:07.216164+0000","last_clean":"2024-04-20T12:23:07.216164+0000","last_became_active":"2024-04-20T12:20:42.026010+0000","last_became_peered":"2024-04-20T12:20:42.026010+0000","last_unstale":"2024-04-20T12:23:07.216164+0000","last_undegraded":"2024-04-20T12:23:07.216164+0000","last_fullsized":"2024-04-20T12:23:07.216164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:13.526130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":55,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087972+0000","last_change":"2024-04-20T12:21:37.912184+0000","last_active":"2024-04-20T12:23:07.087972+0000","last_peered":"2024-04-20T12:23:07.087972+0000","last_clean":"2024-04-20T12:23:07.087972+0000","last_became_active":"2024-04-20T12:21:37.911745+0000","last_became_peered":"2024-04-20T12:21:37.911745+0000","last_unstale":"2024-04-20T12:23:07.087972+0000","last_undegraded":"2024-04-20T12:23:07.087972+0000","last_fullsized":"2024-04-20T12:23:07.087972+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:39:26.296420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216834+0000","last_change":"2024-04-20T12:20:42.032408+0000","last_active":"2024-04-20T12:23:07.216834+0000","last_peered":"2024-04-20T12:23:07.216834+0000","last_clean":"2024-04-20T12:23:07.216834+0000","last_became_active":"2024-04-20T12:20:42.032035+0000","last_became_peered":"2024-04-20T12:20:42.032035+0000","last_unstale":"2024-04-20T12:23:07.216834+0000","last_undegraded":"2024-04-20T12:23:07.216834+0000","last_fullsized":"2024-04-20T12:23:07.216834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:03.702299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216212+0000","last_change":"2024-04-20T12:20:42.040299+0000","last_active":"2024-04-20T12:23:07.216212+0000","last_peered":"2024-04-20T12:23:07.216212+0000","last_clean":"2024-04-20T12:23:07.216212+0000","last_became_active":"2024-04-20T12:20:42.039891+0000","last_became_peered":"2024-04-20T12:20:42.039891+0000","last_unstale":"2024-04-20T12:23:07.216212+0000","last_undegraded":"2024-04-20T12:23:07.216212+0000","last_fullsized":"2024-04-20T12:23:07.216212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:16:31.701459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.353753+0000","last_change":"2024-04-20T12:20:42.032551+0000","last_active":"2024-04-20T12:23:07.353753+0000","last_peered":"2024-04-20T12:23:07.353753+0000","last_clean":"2024-04-20T12:23:07.353753+0000","last_became_active":"2024-04-20T12:20:42.032247+0000","last_became_peered":"2024-04-20T12:20:42.032247+0000","last_unstale":"2024-04-20T12:23:07.353753+0000","last_undegraded":"2024-04-20T12:23:07.353753+0000","last_fullsized":"2024-04-20T12:23:07.353753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:02:22.181110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215795+0000","last_change":"2024-04-20T12:20:42.042662+0000","last_active":"2024-04-20T12:23:07.215795+0000","last_peered":"2024-04-20T12:23:07.215795+0000","last_clean":"2024-04-20T12:23:07.215795+0000","last_became_active":"2024-04-20T12:20:42.042351+0000","last_became_peered":"2024-04-20T12:20:42.042351+0000","last_unstale":"2024-04-20T12:23:07.215795+0000","last_undegraded":"2024-04-20T12:23:07.215795+0000","last_fullsized":"2024-04-20T12:23:07.215795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:15:21.632339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215730+0000","last_change":"2024-04-20T12:20:42.033402+0000","last_active":"2024-04-20T12:23:07.215730+0000","last_peered":"2024-04-20T12:23:07.215730+0000","last_clean":"2024-04-20T12:23:07.215730+0000","last_became_active":"2024-04-20T12:20:42.032996+0000","last_became_peered":"2024-04-20T12:20:42.032996+0000","last_unstale":"2024-04-20T12:23:07.215730+0000","last_undegraded":"2024-04-20T12:23:07.215730+0000","last_fullsized":"2024-04-20T12:23:07.215730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:45.487051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215744+0000","last_change":"2024-04-20T12:20:42.033836+0000","last_active":"2024-04-20T12:23:07.215744+0000","last_peered":"2024-04-20T12:23:07.215744+0000","last_clean":"2024-04-20T12:23:07.215744+0000","last_became_active":"2024-04-20T12:20:42.033497+0000","last_became_peered":"2024-04-20T12:20:42.033497+0000","last_unstale":"2024-04-20T12:23:07.215744+0000","last_undegraded":"2024-04-20T12:23:07.215744+0000","last_fullsized":"2024-04-20T12:23:07.215744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:25:16.428158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216116+0000","last_change":"2024-04-20T12:20:42.030284+0000","last_active":"2024-04-20T12:23:07.216116+0000","last_peered":"2024-04-20T12:23:07.216116+0000","last_clean":"2024-04-20T12:23:07.216116+0000","last_became_active":"2024-04-20T12:20:42.029899+0000","last_became_peered":"2024-04-20T12:20:42.029899+0000","last_unstale":"2024-04-20T12:23:07.216116+0000","last_undegraded":"2024-04-20T12:23:07.216116+0000","last_fullsized":"2024-04-20T12:23:07.216116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:39:14.371947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.187992+0000","last_change":"2024-04-20T12:20:42.028298+0000","last_active":"2024-04-20T12:23:07.187992+0000","last_peered":"2024-04-20T12:23:07.187992+0000","last_clean":"2024-04-20T12:23:07.187992+0000","last_became_active":"2024-04-20T12:20:42.027814+0000","last_became_peered":"2024-04-20T12:20:42.027814+0000","last_unstale":"2024-04-20T12:23:07.187992+0000","last_undegraded":"2024-04-20T12:23:07.187992+0000","last_fullsized":"2024-04-20T12:23:07.187992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:44:39.903424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216529+0000","last_change":"2024-04-20T12:20:42.043697+0000","last_active":"2024-04-20T12:23:07.216529+0000","last_peered":"2024-04-20T12:23:07.216529+0000","last_clean":"2024-04-20T12:23:07.216529+0000","last_became_active":"2024-04-20T12:20:42.043322+0000","last_became_peered":"2024-04-20T12:20:42.043322+0000","last_unstale":"2024-04-20T12:23:07.216529+0000","last_undegraded":"2024-04-20T12:23:07.216529+0000","last_fullsized":"2024-04-20T12:23:07.216529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:08:35.148726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215596+0000","last_change":"2024-04-20T12:20:46.326298+0000","last_active":"2024-04-20T12:23:07.215596+0000","last_peered":"2024-04-20T12:23:07.215596+0000","last_clean":"2024-04-20T12:23:07.215596+0000","last_became_active":"2024-04-20T12:20:46.325893+0000","last_became_peered":"2024-04-20T12:20:46.325893+0000","last_unstale":"2024-04-20T12:23:07.215596+0000","last_undegraded":"2024-04-20T12:23:07.215596+0000","last_fullsized":"2024-04-20T12:23:07.215596+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:17.076871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"95'14","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.352563+0000","last_change":"2024-04-20T12:20:41.027834+0000","last_active":"2024-04-20T12:23:07.352563+0000","last_peered":"2024-04-20T12:23:07.352563+0000","last_clean":"2024-04-20T12:23:07.352563+0000","last_became_active":"2024-04-20T12:20:41.027541+0000","last_became_peered":"2024-04-20T12:20:41.027541+0000","last_unstale":"2024-04-20T12:23:07.352563+0000","last_undegraded":"2024-04-20T12:23:07.352563+0000","last_fullsized":"2024-04-20T12:23:07.352563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:30.454875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086589+0000","last_change":"2024-04-20T12:20:42.043315+0000","last_active":"2024-04-20T12:23:07.086589+0000","last_peered":"2024-04-20T12:23:07.086589+0000","last_clean":"2024-04-20T12:23:07.086589+0000","last_became_active":"2024-04-20T12:20:42.042920+0000","last_became_peered":"2024-04-20T12:20:42.042920+0000","last_unstale":"2024-04-20T12:23:07.086589+0000","last_undegraded":"2024-04-20T12:23:07.086589+0000","last_fullsized":"2024-04-20T12:23:07.086589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:52.353023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215802+0000","last_change":"2024-04-20T12:20:46.327004+0000","last_active":"2024-04-20T12:23:07.215802+0000","last_peered":"2024-04-20T12:23:07.215802+0000","last_clean":"2024-04-20T12:23:07.215802+0000","last_became_active":"2024-04-20T12:20:46.326433+0000","last_became_peered":"2024-04-20T12:20:46.326433+0000","last_unstale":"2024-04-20T12:23:07.215802+0000","last_undegraded":"2024-04-20T12:23:07.215802+0000","last_fullsized":"2024-04-20T12:23:07.215802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:58:05.864093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086674+0000","last_change":"2024-04-20T12:20:41.032149+0000","last_active":"2024-04-20T12:23:07.086674+0000","last_peered":"2024-04-20T12:23:07.086674+0000","last_clean":"2024-04-20T12:23:07.086674+0000","last_became_active":"2024-04-20T12:20:41.031708+0000","last_became_peered":"2024-04-20T12:20:41.031708+0000","last_unstale":"2024-04-20T12:23:07.086674+0000","last_undegraded":"2024-04-20T12:23:07.086674+0000","last_fullsized":"2024-04-20T12:23:07.086674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:55.167376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216198+0000","last_change":"2024-04-20T12:20:42.040462+0000","last_active":"2024-04-20T12:23:07.216198+0000","last_peered":"2024-04-20T12:23:07.216198+0000","last_clean":"2024-04-20T12:23:07.216198+0000","last_became_active":"2024-04-20T12:20:42.040098+0000","last_became_peered":"2024-04-20T12:20:42.040098+0000","last_unstale":"2024-04-20T12:23:07.216198+0000","last_undegraded":"2024-04-20T12:23:07.216198+0000","last_fullsized":"2024-04-20T12:23:07.216198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:16.091488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216097+0000","last_change":"2024-04-20T12:22:38.007648+0000","last_active":"2024-04-20T12:23:07.216097+0000","last_peered":"2024-04-20T12:23:07.216097+0000","last_clean":"2024-04-20T12:23:07.216097+0000","last_became_active":"2024-04-20T12:22:38.007115+0000","last_became_peered":"2024-04-20T12:22:38.007115+0000","last_unstale":"2024-04-20T12:23:07.216097+0000","last_undegraded":"2024-04-20T12:23:07.216097+0000","last_fullsized":"2024-04-20T12:23:07.216097+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:37:37.683366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":33,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216447+0000","last_change":"2024-04-20T12:21:37.924962+0000","last_active":"2024-04-20T12:23:07.216447+0000","last_peered":"2024-04-20T12:23:07.216447+0000","last_clean":"2024-04-20T12:23:07.216447+0000","last_became_active":"2024-04-20T12:21:37.914275+0000","last_became_peered":"2024-04-20T12:21:37.914275+0000","last_unstale":"2024-04-20T12:23:07.216447+0000","last_undegraded":"2024-04-20T12:23:07.216447+0000","last_fullsized":"2024-04-20T12:23:07.216447+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:05.894889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216326+0000","last_change":"2024-04-20T12:20:42.029785+0000","last_active":"2024-04-20T12:23:07.216326+0000","last_peered":"2024-04-20T12:23:07.216326+0000","last_clean":"2024-04-20T12:23:07.216326+0000","last_became_active":"2024-04-20T12:20:42.029377+0000","last_became_peered":"2024-04-20T12:20:42.029377+0000","last_unstale":"2024-04-20T12:23:07.216326+0000","last_undegraded":"2024-04-20T12:23:07.216326+0000","last_fullsized":"2024-04-20T12:23:07.216326+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:22:52.429274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215910+0000","last_change":"2024-04-20T12:20:46.326552+0000","last_active":"2024-04-20T12:23:07.215910+0000","last_peered":"2024-04-20T12:23:07.215910+0000","last_clean":"2024-04-20T12:23:07.215910+0000","last_became_active":"2024-04-20T12:20:46.325573+0000","last_became_peered":"2024-04-20T12:20:46.325573+0000","last_unstale":"2024-04-20T12:23:07.215910+0000","last_undegraded":"2024-04-20T12:23:07.215910+0000","last_fullsized":"2024-04-20T12:23:07.215910+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:26:01.218141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.088150+0000","last_change":"2024-04-20T12:20:41.023884+0000","last_active":"2024-04-20T12:23:07.088150+0000","last_peered":"2024-04-20T12:23:07.088150+0000","last_clean":"2024-04-20T12:23:07.088150+0000","last_became_active":"2024-04-20T12:20:41.023496+0000","last_became_peered":"2024-04-20T12:20:41.023496+0000","last_unstale":"2024-04-20T12:23:07.088150+0000","last_undegraded":"2024-04-20T12:23:07.088150+0000","last_fullsized":"2024-04-20T12:23:07.088150+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:08.824928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":32,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.187759+0000","last_change":"2024-04-20T12:21:37.941552+0000","last_active":"2024-04-20T12:23:07.187759+0000","last_peered":"2024-04-20T12:23:07.187759+0000","last_clean":"2024-04-20T12:23:07.187759+0000","last_became_active":"2024-04-20T12:21:37.941228+0000","last_became_peered":"2024-04-20T12:21:37.941228+0000","last_unstale":"2024-04-20T12:23:07.187759+0000","last_undegraded":"2024-04-20T12:23:07.187759+0000","last_fullsized":"2024-04-20T12:23:07.187759+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:33.915039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216425+0000","last_change":"2024-04-20T12:20:46.324508+0000","last_active":"2024-04-20T12:23:07.216425+0000","last_peered":"2024-04-20T12:23:07.216425+0000","last_clean":"2024-04-20T12:23:07.216425+0000","last_became_active":"2024-04-20T12:20:46.324014+0000","last_became_peered":"2024-04-20T12:20:46.324014+0000","last_unstale":"2024-04-20T12:23:07.216425+0000","last_undegraded":"2024-04-20T12:23:07.216425+0000","last_fullsized":"2024-04-20T12:23:07.216425+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:17.765152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'7","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:08.048129+0000","last_change":"2024-04-20T12:21:37.927225+0000","last_active":"2024-04-20T12:23:08.048129+0000","last_peered":"2024-04-20T12:23:08.048129+0000","last_clean":"2024-04-20T12:23:08.048129+0000","last_became_active":"2024-04-20T12:21:37.911437+0000","last_became_peered":"2024-04-20T12:21:37.911437+0000","last_unstale":"2024-04-20T12:23:08.048129+0000","last_undegraded":"2024-04-20T12:23:08.048129+0000","last_fullsized":"2024-04-20T12:23:08.048129+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:08:14.576145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087776+0000","last_change":"2024-04-20T12:20:42.047403+0000","last_active":"2024-04-20T12:23:07.087776+0000","last_peered":"2024-04-20T12:23:07.087776+0000","last_clean":"2024-04-20T12:23:07.087776+0000","last_became_active":"2024-04-20T12:20:42.046240+0000","last_became_peered":"2024-04-20T12:20:42.046240+0000","last_unstale":"2024-04-20T12:23:07.087776+0000","last_undegraded":"2024-04-20T12:23:07.087776+0000","last_fullsized":"2024-04-20T12:23:07.087776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:21:40.410666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216108+0000","last_change":"2024-04-20T12:22:38.082510+0000","last_active":"2024-04-20T12:23:07.216108+0000","last_peered":"2024-04-20T12:23:07.216108+0000","last_clean":"2024-04-20T12:23:07.216108+0000","last_became_active":"2024-04-20T12:22:38.081953+0000","last_became_peered":"2024-04-20T12:22:38.081953+0000","last_unstale":"2024-04-20T12:23:07.216108+0000","last_undegraded":"2024-04-20T12:23:07.216108+0000","last_fullsized":"2024-04-20T12:23:07.216108+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:57:25.210260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087868+0000","last_change":"2024-04-20T12:20:41.027532+0000","last_active":"2024-04-20T12:23:07.087868+0000","last_peered":"2024-04-20T12:23:07.087868+0000","last_clean":"2024-04-20T12:23:07.087868+0000","last_became_active":"2024-04-20T12:20:41.027090+0000","last_became_peered":"2024-04-20T12:20:41.027090+0000","last_unstale":"2024-04-20T12:23:07.087868+0000","last_undegraded":"2024-04-20T12:23:07.087868+0000","last_fullsized":"2024-04-20T12:23:07.087868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:40:10.450305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196092+0000","last_change":"2024-04-20T12:21:37.912691+0000","last_active":"2024-04-20T12:23:07.196092+0000","last_peered":"2024-04-20T12:23:07.196092+0000","last_clean":"2024-04-20T12:23:07.196092+0000","last_became_active":"2024-04-20T12:21:37.912295+0000","last_became_peered":"2024-04-20T12:21:37.912295+0000","last_unstale":"2024-04-20T12:23:07.196092+0000","last_undegraded":"2024-04-20T12:23:07.196092+0000","last_fullsized":"2024-04-20T12:23:07.196092+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:48:04.501944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215972+0000","last_change":"2024-04-20T12:20:46.318633+0000","last_active":"2024-04-20T12:23:07.215972+0000","last_peered":"2024-04-20T12:23:07.215972+0000","last_clean":"2024-04-20T12:23:07.215972+0000","last_became_active":"2024-04-20T12:20:46.318215+0000","last_became_peered":"2024-04-20T12:20:46.318215+0000","last_unstale":"2024-04-20T12:23:07.215972+0000","last_undegraded":"2024-04-20T12:23:07.215972+0000","last_fullsized":"2024-04-20T12:23:07.215972+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:07:31.241287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.353126+0000","last_change":"2024-04-20T12:20:41.027009+0000","last_active":"2024-04-20T12:23:07.353126+0000","last_peered":"2024-04-20T12:23:07.353126+0000","last_clean":"2024-04-20T12:23:07.353126+0000","last_became_active":"2024-04-20T12:20:41.026683+0000","last_became_peered":"2024-04-20T12:20:41.026683+0000","last_unstale":"2024-04-20T12:23:07.353126+0000","last_undegraded":"2024-04-20T12:23:07.353126+0000","last_fullsized":"2024-04-20T12:23:07.353126+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:56:35.955635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086145+0000","last_change":"2024-04-20T12:20:42.030833+0000","last_active":"2024-04-20T12:23:07.086145+0000","last_peered":"2024-04-20T12:23:07.086145+0000","last_clean":"2024-04-20T12:23:07.086145+0000","last_became_active":"2024-04-20T12:20:42.030470+0000","last_became_peered":"2024-04-20T12:20:42.030470+0000","last_unstale":"2024-04-20T12:23:07.086145+0000","last_undegraded":"2024-04-20T12:23:07.086145+0000","last_fullsized":"2024-04-20T12:23:07.086145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:20:07.381222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216429+0000","last_change":"2024-04-20T12:20:46.327091+0000","last_active":"2024-04-20T12:23:07.216429+0000","last_peered":"2024-04-20T12:23:07.216429+0000","last_clean":"2024-04-20T12:23:07.216429+0000","last_became_active":"2024-04-20T12:20:46.326663+0000","last_became_peered":"2024-04-20T12:20:46.326663+0000","last_unstale":"2024-04-20T12:23:07.216429+0000","last_undegraded":"2024-04-20T12:23:07.216429+0000","last_fullsized":"2024-04-20T12:23:07.216429+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:37:31.968946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.195825+0000","last_change":"2024-04-20T12:20:41.028908+0000","last_active":"2024-04-20T12:23:07.195825+0000","last_peered":"2024-04-20T12:23:07.195825+0000","last_clean":"2024-04-20T12:23:07.195825+0000","last_became_active":"2024-04-20T12:20:41.028570+0000","last_became_peered":"2024-04-20T12:20:41.028570+0000","last_unstale":"2024-04-20T12:23:07.195825+0000","last_undegraded":"2024-04-20T12:23:07.195825+0000","last_fullsized":"2024-04-20T12:23:07.195825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:39:27.309249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.187437+0000","last_change":"2024-04-20T12:20:42.028802+0000","last_active":"2024-04-20T12:23:07.187437+0000","last_peered":"2024-04-20T12:23:07.187437+0000","last_clean":"2024-04-20T12:23:07.187437+0000","last_became_active":"2024-04-20T12:20:42.028458+0000","last_became_peered":"2024-04-20T12:20:42.028458+0000","last_unstale":"2024-04-20T12:23:07.187437+0000","last_undegraded":"2024-04-20T12:23:07.187437+0000","last_fullsized":"2024-04-20T12:23:07.187437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:59:28.284954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086291+0000","last_change":"2024-04-20T12:20:46.331055+0000","last_active":"2024-04-20T12:23:07.086291+0000","last_peered":"2024-04-20T12:23:07.086291+0000","last_clean":"2024-04-20T12:23:07.086291+0000","last_became_active":"2024-04-20T12:20:46.330181+0000","last_became_peered":"2024-04-20T12:20:46.330181+0000","last_unstale":"2024-04-20T12:23:07.086291+0000","last_undegraded":"2024-04-20T12:23:07.086291+0000","last_fullsized":"2024-04-20T12:23:07.086291+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:27.430141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"95'6","reported_seq":282,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:08.047687+0000","last_change":"2024-04-20T12:20:41.025859+0000","last_active":"2024-04-20T12:23:08.047687+0000","last_peered":"2024-04-20T12:23:08.047687+0000","last_clean":"2024-04-20T12:23:08.047687+0000","last_became_active":"2024-04-20T12:20:41.025443+0000","last_became_peered":"2024-04-20T12:20:41.025443+0000","last_unstale":"2024-04-20T12:23:08.047687+0000","last_undegraded":"2024-04-20T12:23:08.047687+0000","last_fullsized":"2024-04-20T12:23:08.047687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:11:28.100797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216219+0000","last_change":"2024-04-20T12:20:42.028510+0000","last_active":"2024-04-20T12:23:07.216219+0000","last_peered":"2024-04-20T12:23:07.216219+0000","last_clean":"2024-04-20T12:23:07.216219+0000","last_became_active":"2024-04-20T12:20:42.028176+0000","last_became_peered":"2024-04-20T12:20:42.028176+0000","last_unstale":"2024-04-20T12:23:07.216219+0000","last_undegraded":"2024-04-20T12:23:07.216219+0000","last_fullsized":"2024-04-20T12:23:07.216219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:49:44.606154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.187328+0000","last_change":"2024-04-20T12:20:46.327813+0000","last_active":"2024-04-20T12:23:07.187328+0000","last_peered":"2024-04-20T12:23:07.187328+0000","last_clean":"2024-04-20T12:23:07.187328+0000","last_became_active":"2024-04-20T12:20:46.327446+0000","last_became_peered":"2024-04-20T12:20:46.327446+0000","last_unstale":"2024-04-20T12:23:07.187328+0000","last_undegraded":"2024-04-20T12:23:07.187328+0000","last_fullsized":"2024-04-20T12:23:07.187328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:30:23.990693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216702+0000","last_change":"2024-04-20T12:20:41.027748+0000","last_active":"2024-04-20T12:23:07.216702+0000","last_peered":"2024-04-20T12:23:07.216702+0000","last_clean":"2024-04-20T12:23:07.216702+0000","last_became_active":"2024-04-20T12:20:41.027400+0000","last_became_peered":"2024-04-20T12:20:41.027400+0000","last_unstale":"2024-04-20T12:23:07.216702+0000","last_undegraded":"2024-04-20T12:23:07.216702+0000","last_fullsized":"2024-04-20T12:23:07.216702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:27:50.008057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216926+0000","last_change":"2024-04-20T12:21:37.912851+0000","last_active":"2024-04-20T12:23:07.216926+0000","last_peered":"2024-04-20T12:23:07.216926+0000","last_clean":"2024-04-20T12:23:07.216926+0000","last_became_active":"2024-04-20T12:21:37.912487+0000","last_became_peered":"2024-04-20T12:21:37.912487+0000","last_unstale":"2024-04-20T12:23:07.216926+0000","last_undegraded":"2024-04-20T12:23:07.216926+0000","last_fullsized":"2024-04-20T12:23:07.216926+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:09:49.568654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216501+0000","last_change":"2024-04-20T12:20:46.326239+0000","last_active":"2024-04-20T12:23:07.216501+0000","last_peered":"2024-04-20T12:23:07.216501+0000","last_clean":"2024-04-20T12:23:07.216501+0000","last_became_active":"2024-04-20T12:20:46.325830+0000","last_became_peered":"2024-04-20T12:20:46.325830+0000","last_unstale":"2024-04-20T12:23:07.216501+0000","last_undegraded":"2024-04-20T12:23:07.216501+0000","last_fullsized":"2024-04-20T12:23:07.216501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:07.311396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196154+0000","last_change":"2024-04-20T12:20:41.024662+0000","last_active":"2024-04-20T12:23:07.196154+0000","last_peered":"2024-04-20T12:23:07.196154+0000","last_clean":"2024-04-20T12:23:07.196154+0000","last_became_active":"2024-04-20T12:20:41.024327+0000","last_became_peered":"2024-04-20T12:20:41.024327+0000","last_unstale":"2024-04-20T12:23:07.196154+0000","last_undegraded":"2024-04-20T12:23:07.196154+0000","last_fullsized":"2024-04-20T12:23:07.196154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:07.079126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216596+0000","last_change":"2024-04-20T12:20:42.031910+0000","last_active":"2024-04-20T12:23:07.216596+0000","last_peered":"2024-04-20T12:23:07.216596+0000","last_clean":"2024-04-20T12:23:07.216596+0000","last_became_active":"2024-04-20T12:20:42.031600+0000","last_became_peered":"2024-04-20T12:20:42.031600+0000","last_unstale":"2024-04-20T12:23:07.216596+0000","last_undegraded":"2024-04-20T12:23:07.216596+0000","last_fullsized":"2024-04-20T12:23:07.216596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:23:56.448246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087465+0000","last_change":"2024-04-20T12:21:37.911484+0000","last_active":"2024-04-20T12:23:07.087465+0000","last_peered":"2024-04-20T12:23:07.087465+0000","last_clean":"2024-04-20T12:23:07.087465+0000","last_became_active":"2024-04-20T12:21:37.911069+0000","last_became_peered":"2024-04-20T12:21:37.911069+0000","last_unstale":"2024-04-20T12:23:07.087465+0000","last_undegraded":"2024-04-20T12:23:07.087465+0000","last_fullsized":"2024-04-20T12:23:07.087465+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:58:54.938004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"95'42","reported_seq":329,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:08.048902+0000","last_change":"2024-04-20T12:20:41.024722+0000","last_active":"2024-04-20T12:23:08.048902+0000","last_peered":"2024-04-20T12:23:08.048902+0000","last_clean":"2024-04-20T12:23:08.048902+0000","last_became_active":"2024-04-20T12:20:41.024150+0000","last_became_peered":"2024-04-20T12:20:41.024150+0000","last_unstale":"2024-04-20T12:23:08.048902+0000","last_undegraded":"2024-04-20T12:23:08.048902+0000","last_fullsized":"2024-04-20T12:23:08.048902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:14:49.622937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70068,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":195,"num_write":44,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.088143+0000","last_change":"2024-04-20T12:20:42.037589+0000","last_active":"2024-04-20T12:23:07.088143+0000","last_peered":"2024-04-20T12:23:07.088143+0000","last_clean":"2024-04-20T12:23:07.088143+0000","last_became_active":"2024-04-20T12:20:42.037256+0000","last_became_peered":"2024-04-20T12:20:42.037256+0000","last_unstale":"2024-04-20T12:23:07.088143+0000","last_undegraded":"2024-04-20T12:23:07.088143+0000","last_fullsized":"2024-04-20T12:23:07.088143+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:25.966289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196417+0000","last_change":"2024-04-20T12:20:46.326476+0000","last_active":"2024-04-20T12:23:07.196417+0000","last_peered":"2024-04-20T12:23:07.196417+0000","last_clean":"2024-04-20T12:23:07.196417+0000","last_became_active":"2024-04-20T12:20:46.326085+0000","last_became_peered":"2024-04-20T12:20:46.326085+0000","last_unstale":"2024-04-20T12:23:07.196417+0000","last_undegraded":"2024-04-20T12:23:07.196417+0000","last_fullsized":"2024-04-20T12:23:07.196417+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:34:15.608820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215928+0000","last_change":"2024-04-20T12:20:41.028360+0000","last_active":"2024-04-20T12:23:07.215928+0000","last_peered":"2024-04-20T12:23:07.215928+0000","last_clean":"2024-04-20T12:23:07.215928+0000","last_became_active":"2024-04-20T12:20:41.028057+0000","last_became_peered":"2024-04-20T12:20:41.028057+0000","last_unstale":"2024-04-20T12:23:07.215928+0000","last_undegraded":"2024-04-20T12:23:07.215928+0000","last_fullsized":"2024-04-20T12:23:07.215928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:30:49.699051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.353468+0000","last_change":"2024-04-20T12:21:37.912138+0000","last_active":"2024-04-20T12:23:07.353468+0000","last_peered":"2024-04-20T12:23:07.353468+0000","last_clean":"2024-04-20T12:23:07.353468+0000","last_became_active":"2024-04-20T12:21:37.911774+0000","last_became_peered":"2024-04-20T12:21:37.911774+0000","last_unstale":"2024-04-20T12:23:07.353468+0000","last_undegraded":"2024-04-20T12:23:07.353468+0000","last_fullsized":"2024-04-20T12:23:07.353468+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:41:34.250785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215847+0000","last_change":"2024-04-20T12:20:46.328605+0000","last_active":"2024-04-20T12:23:07.215847+0000","last_peered":"2024-04-20T12:23:07.215847+0000","last_clean":"2024-04-20T12:23:07.215847+0000","last_became_active":"2024-04-20T12:20:46.328091+0000","last_became_peered":"2024-04-20T12:20:46.328091+0000","last_unstale":"2024-04-20T12:23:07.215847+0000","last_undegraded":"2024-04-20T12:23:07.215847+0000","last_fullsized":"2024-04-20T12:23:07.215847+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:21:12.908696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196057+0000","last_change":"2024-04-20T12:20:41.028149+0000","last_active":"2024-04-20T12:23:07.196057+0000","last_peered":"2024-04-20T12:23:07.196057+0000","last_clean":"2024-04-20T12:23:07.196057+0000","last_became_active":"2024-04-20T12:20:41.027784+0000","last_became_peered":"2024-04-20T12:20:41.027784+0000","last_unstale":"2024-04-20T12:23:07.196057+0000","last_undegraded":"2024-04-20T12:23:07.196057+0000","last_fullsized":"2024-04-20T12:23:07.196057+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:45:31.227275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217137+0000","last_change":"2024-04-20T12:20:42.030961+0000","last_active":"2024-04-20T12:23:07.217137+0000","last_peered":"2024-04-20T12:23:07.217137+0000","last_clean":"2024-04-20T12:23:07.217137+0000","last_became_active":"2024-04-20T12:20:42.030597+0000","last_became_peered":"2024-04-20T12:20:42.030597+0000","last_unstale":"2024-04-20T12:23:07.217137+0000","last_undegraded":"2024-04-20T12:23:07.217137+0000","last_fullsized":"2024-04-20T12:23:07.217137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:59:29.679840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.188312+0000","last_change":"2024-04-20T12:20:46.327034+0000","last_active":"2024-04-20T12:23:07.188312+0000","last_peered":"2024-04-20T12:23:07.188312+0000","last_clean":"2024-04-20T12:23:07.188312+0000","last_became_active":"2024-04-20T12:20:46.325107+0000","last_became_peered":"2024-04-20T12:20:46.325107+0000","last_unstale":"2024-04-20T12:23:07.188312+0000","last_undegraded":"2024-04-20T12:23:07.188312+0000","last_fullsized":"2024-04-20T12:23:07.188312+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:44:04.924677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"95'7","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.511321+0000","last_change":"2024-04-20T12:20:41.020878+0000","last_active":"2024-04-20T12:23:07.511321+0000","last_peered":"2024-04-20T12:23:07.511321+0000","last_clean":"2024-04-20T12:23:07.511321+0000","last_became_active":"2024-04-20T12:20:41.020503+0000","last_became_peered":"2024-04-20T12:20:41.020503+0000","last_unstale":"2024-04-20T12:23:07.511321+0000","last_undegraded":"2024-04-20T12:23:07.511321+0000","last_fullsized":"2024-04-20T12:23:07.511321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:59:00.555136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1287,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217353+0000","last_change":"2024-04-20T12:20:42.039699+0000","last_active":"2024-04-20T12:23:07.217353+0000","last_peered":"2024-04-20T12:23:07.217353+0000","last_clean":"2024-04-20T12:23:07.217353+0000","last_became_active":"2024-04-20T12:20:42.039384+0000","last_became_peered":"2024-04-20T12:20:42.039384+0000","last_unstale":"2024-04-20T12:23:07.217353+0000","last_undegraded":"2024-04-20T12:23:07.217353+0000","last_fullsized":"2024-04-20T12:23:07.217353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:45:41.056018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.354238+0000","last_change":"2024-04-20T12:20:46.333294+0000","last_active":"2024-04-20T12:23:07.354238+0000","last_peered":"2024-04-20T12:23:07.354238+0000","last_clean":"2024-04-20T12:23:07.354238+0000","last_became_active":"2024-04-20T12:20:46.332887+0000","last_became_peered":"2024-04-20T12:20:46.332887+0000","last_unstale":"2024-04-20T12:23:07.354238+0000","last_undegraded":"2024-04-20T12:23:07.354238+0000","last_fullsized":"2024-04-20T12:23:07.354238+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:10.686220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087716+0000","last_change":"2024-04-20T12:20:41.027313+0000","last_active":"2024-04-20T12:23:07.087716+0000","last_peered":"2024-04-20T12:23:07.087716+0000","last_clean":"2024-04-20T12:23:07.087716+0000","last_became_active":"2024-04-20T12:20:41.026980+0000","last_became_peered":"2024-04-20T12:20:41.026980+0000","last_unstale":"2024-04-20T12:23:07.087716+0000","last_undegraded":"2024-04-20T12:23:07.087716+0000","last_fullsized":"2024-04-20T12:23:07.087716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:12.692075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196031+0000","last_change":"2024-04-20T12:20:42.027807+0000","last_active":"2024-04-20T12:23:07.196031+0000","last_peered":"2024-04-20T12:23:07.196031+0000","last_clean":"2024-04-20T12:23:07.196031+0000","last_became_active":"2024-04-20T12:20:42.027468+0000","last_became_peered":"2024-04-20T12:20:42.027468+0000","last_unstale":"2024-04-20T12:23:07.196031+0000","last_undegraded":"2024-04-20T12:23:07.196031+0000","last_fullsized":"2024-04-20T12:23:07.196031+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:51.924249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.195863+0000","last_change":"2024-04-20T12:20:46.324164+0000","last_active":"2024-04-20T12:23:07.195863+0000","last_peered":"2024-04-20T12:23:07.195863+0000","last_clean":"2024-04-20T12:23:07.195863+0000","last_became_active":"2024-04-20T12:20:46.323651+0000","last_became_peered":"2024-04-20T12:20:46.323651+0000","last_unstale":"2024-04-20T12:23:07.195863+0000","last_undegraded":"2024-04-20T12:23:07.195863+0000","last_fullsized":"2024-04-20T12:23:07.195863+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:07:54.429586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.088316+0000","last_change":"2024-04-20T12:20:41.023999+0000","last_active":"2024-04-20T12:23:07.088316+0000","last_peered":"2024-04-20T12:23:07.088316+0000","last_clean":"2024-04-20T12:23:07.088316+0000","last_became_active":"2024-04-20T12:20:41.023440+0000","last_became_peered":"2024-04-20T12:20:41.023440+0000","last_unstale":"2024-04-20T12:23:07.088316+0000","last_undegraded":"2024-04-20T12:23:07.088316+0000","last_fullsized":"2024-04-20T12:23:07.088316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:13:18.493395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215938+0000","last_change":"2024-04-20T12:20:42.036718+0000","last_active":"2024-04-20T12:23:07.215938+0000","last_peered":"2024-04-20T12:23:07.215938+0000","last_clean":"2024-04-20T12:23:07.215938+0000","last_became_active":"2024-04-20T12:20:42.036305+0000","last_became_peered":"2024-04-20T12:20:42.036305+0000","last_unstale":"2024-04-20T12:23:07.215938+0000","last_undegraded":"2024-04-20T12:23:07.215938+0000","last_fullsized":"2024-04-20T12:23:07.215938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:14.462345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087768+0000","last_change":"2024-04-20T12:20:46.930437+0000","last_active":"2024-04-20T12:23:07.087768+0000","last_peered":"2024-04-20T12:23:07.087768+0000","last_clean":"2024-04-20T12:23:07.087768+0000","last_became_active":"2024-04-20T12:20:46.929882+0000","last_became_peered":"2024-04-20T12:20:46.929882+0000","last_unstale":"2024-04-20T12:23:07.087768+0000","last_undegraded":"2024-04-20T12:23:07.087768+0000","last_fullsized":"2024-04-20T12:23:07.087768+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:56.540256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.187733+0000","last_change":"2024-04-20T12:20:41.023584+0000","last_active":"2024-04-20T12:23:07.187733+0000","last_peered":"2024-04-20T12:23:07.187733+0000","last_clean":"2024-04-20T12:23:07.187733+0000","last_became_active":"2024-04-20T12:20:41.023249+0000","last_became_peered":"2024-04-20T12:20:41.023249+0000","last_unstale":"2024-04-20T12:23:07.187733+0000","last_undegraded":"2024-04-20T12:23:07.187733+0000","last_fullsized":"2024-04-20T12:23:07.187733+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:18:06.704703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'4","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087908+0000","last_change":"2024-04-20T12:20:42.041424+0000","last_active":"2024-04-20T12:23:07.087908+0000","last_peered":"2024-04-20T12:23:07.087908+0000","last_clean":"2024-04-20T12:23:07.087908+0000","last_became_active":"2024-04-20T12:20:42.040231+0000","last_became_peered":"2024-04-20T12:20:42.040231+0000","last_unstale":"2024-04-20T12:23:07.087908+0000","last_undegraded":"2024-04-20T12:23:07.087908+0000","last_fullsized":"2024-04-20T12:23:07.087908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:29.523746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.353974+0000","last_change":"2024-04-20T12:20:46.326852+0000","last_active":"2024-04-20T12:23:07.353974+0000","last_peered":"2024-04-20T12:23:07.353974+0000","last_clean":"2024-04-20T12:23:07.353974+0000","last_became_active":"2024-04-20T12:20:46.326398+0000","last_became_peered":"2024-04-20T12:20:46.326398+0000","last_unstale":"2024-04-20T12:23:07.353974+0000","last_undegraded":"2024-04-20T12:23:07.353974+0000","last_fullsized":"2024-04-20T12:23:07.353974+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:00:33.076429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"95'7","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.509906+0000","last_change":"2024-04-20T12:20:41.032542+0000","last_active":"2024-04-20T12:23:07.509906+0000","last_peered":"2024-04-20T12:23:07.509906+0000","last_clean":"2024-04-20T12:23:07.509906+0000","last_became_active":"2024-04-20T12:20:41.032048+0000","last_became_peered":"2024-04-20T12:20:41.032048+0000","last_unstale":"2024-04-20T12:23:07.509906+0000","last_undegraded":"2024-04-20T12:23:07.509906+0000","last_fullsized":"2024-04-20T12:23:07.509906+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:16:35.515446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1370,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087596+0000","last_change":"2024-04-20T12:20:42.034006+0000","last_active":"2024-04-20T12:23:07.087596+0000","last_peered":"2024-04-20T12:23:07.087596+0000","last_clean":"2024-04-20T12:23:07.087596+0000","last_became_active":"2024-04-20T12:20:42.033639+0000","last_became_peered":"2024-04-20T12:20:42.033639+0000","last_unstale":"2024-04-20T12:23:07.087596+0000","last_undegraded":"2024-04-20T12:23:07.087596+0000","last_fullsized":"2024-04-20T12:23:07.087596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:39:27.435103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.354385+0000","last_change":"2024-04-20T12:20:46.930253+0000","last_active":"2024-04-20T12:23:07.354385+0000","last_peered":"2024-04-20T12:23:07.354385+0000","last_clean":"2024-04-20T12:23:07.354385+0000","last_became_active":"2024-04-20T12:20:46.929806+0000","last_became_peered":"2024-04-20T12:20:46.929806+0000","last_unstale":"2024-04-20T12:23:07.354385+0000","last_undegraded":"2024-04-20T12:23:07.354385+0000","last_fullsized":"2024-04-20T12:23:07.354385+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:23:55.085024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196120+0000","last_change":"2024-04-20T12:20:42.031231+0000","last_active":"2024-04-20T12:23:07.196120+0000","last_peered":"2024-04-20T12:23:07.196120+0000","last_clean":"2024-04-20T12:23:07.196120+0000","last_became_active":"2024-04-20T12:20:42.030920+0000","last_became_peered":"2024-04-20T12:20:42.030920+0000","last_unstale":"2024-04-20T12:23:07.196120+0000","last_undegraded":"2024-04-20T12:23:07.196120+0000","last_fullsized":"2024-04-20T12:23:07.196120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:14.631696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"94'6","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.353016+0000","last_change":"2024-04-20T12:20:41.030703+0000","last_active":"2024-04-20T12:23:07.353016+0000","last_peered":"2024-04-20T12:23:07.353016+0000","last_clean":"2024-04-20T12:23:07.353016+0000","last_became_active":"2024-04-20T12:20:41.030400+0000","last_became_peered":"2024-04-20T12:20:41.030400+0000","last_unstale":"2024-04-20T12:23:07.353016+0000","last_undegraded":"2024-04-20T12:23:07.353016+0000","last_fullsized":"2024-04-20T12:23:07.353016+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:46:07.845022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216517+0000","last_change":"2024-04-20T12:20:46.322872+0000","last_active":"2024-04-20T12:23:07.216517+0000","last_peered":"2024-04-20T12:23:07.216517+0000","last_clean":"2024-04-20T12:23:07.216517+0000","last_became_active":"2024-04-20T12:20:46.322440+0000","last_became_peered":"2024-04-20T12:20:46.322440+0000","last_unstale":"2024-04-20T12:23:07.216517+0000","last_undegraded":"2024-04-20T12:23:07.216517+0000","last_fullsized":"2024-04-20T12:23:07.216517+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:24:02.010584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086138+0000","last_change":"2024-04-20T12:20:42.041895+0000","last_active":"2024-04-20T12:23:07.086138+0000","last_peered":"2024-04-20T12:23:07.086138+0000","last_clean":"2024-04-20T12:23:07.086138+0000","last_became_active":"2024-04-20T12:20:42.040451+0000","last_became_peered":"2024-04-20T12:20:42.040451+0000","last_unstale":"2024-04-20T12:23:07.086138+0000","last_undegraded":"2024-04-20T12:23:07.086138+0000","last_fullsized":"2024-04-20T12:23:07.086138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:17.711581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216193+0000","last_change":"2024-04-20T12:20:41.020656+0000","last_active":"2024-04-20T12:23:07.216193+0000","last_peered":"2024-04-20T12:23:07.216193+0000","last_clean":"2024-04-20T12:23:07.216193+0000","last_became_active":"2024-04-20T12:20:41.020226+0000","last_became_peered":"2024-04-20T12:20:41.020226+0000","last_unstale":"2024-04-20T12:23:07.216193+0000","last_undegraded":"2024-04-20T12:23:07.216193+0000","last_fullsized":"2024-04-20T12:23:07.216193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:21:03.446920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":370,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217015+0000","last_change":"2024-04-20T12:19:29.284050+0000","last_active":"2024-04-20T12:23:07.217015+0000","last_peered":"2024-04-20T12:23:07.217015+0000","last_clean":"2024-04-20T12:23:07.217015+0000","last_became_active":"2024-04-20T12:19:29.283508+0000","last_became_peered":"2024-04-20T12:19:29.283508+0000","last_unstale":"2024-04-20T12:23:07.217015+0000","last_undegraded":"2024-04-20T12:23:07.217015+0000","last_fullsized":"2024-04-20T12:23:07.217015+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:16:03.444995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:16:03.444995+0000","last_clean_scrub_stamp":"2024-04-20T12:16:03.444995+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:28:39.268704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.088086+0000","last_change":"2024-04-20T12:22:38.089431+0000","last_active":"2024-04-20T12:23:07.088086+0000","last_peered":"2024-04-20T12:23:07.088086+0000","last_clean":"2024-04-20T12:23:07.088086+0000","last_became_active":"2024-04-20T12:22:38.089034+0000","last_became_peered":"2024-04-20T12:22:38.089034+0000","last_unstale":"2024-04-20T12:23:07.088086+0000","last_undegraded":"2024-04-20T12:23:07.088086+0000","last_fullsized":"2024-04-20T12:23:07.088086+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:53:00.078160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.352835+0000","last_change":"2024-04-20T12:20:42.030739+0000","last_active":"2024-04-20T12:23:07.352835+0000","last_peered":"2024-04-20T12:23:07.352835+0000","last_clean":"2024-04-20T12:23:07.352835+0000","last_became_active":"2024-04-20T12:20:42.030440+0000","last_became_peered":"2024-04-20T12:20:42.030440+0000","last_unstale":"2024-04-20T12:23:07.352835+0000","last_undegraded":"2024-04-20T12:23:07.352835+0000","last_fullsized":"2024-04-20T12:23:07.352835+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:44:39.311317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217147+0000","last_change":"2024-04-20T12:20:41.029967+0000","last_active":"2024-04-20T12:23:07.217147+0000","last_peered":"2024-04-20T12:23:07.217147+0000","last_clean":"2024-04-20T12:23:07.217147+0000","last_became_active":"2024-04-20T12:20:41.029618+0000","last_became_peered":"2024-04-20T12:20:41.029618+0000","last_unstale":"2024-04-20T12:23:07.217147+0000","last_undegraded":"2024-04-20T12:23:07.217147+0000","last_fullsized":"2024-04-20T12:23:07.217147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:48.762751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215840+0000","last_change":"2024-04-20T12:20:46.327782+0000","last_active":"2024-04-20T12:23:07.215840+0000","last_peered":"2024-04-20T12:23:07.215840+0000","last_clean":"2024-04-20T12:23:07.215840+0000","last_became_active":"2024-04-20T12:20:46.325462+0000","last_became_peered":"2024-04-20T12:20:46.325462+0000","last_unstale":"2024-04-20T12:23:07.215840+0000","last_undegraded":"2024-04-20T12:23:07.215840+0000","last_fullsized":"2024-04-20T12:23:07.215840+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:41.792496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.088129+0000","last_change":"2024-04-20T12:20:41.025454+0000","last_active":"2024-04-20T12:23:07.088129+0000","last_peered":"2024-04-20T12:23:07.088129+0000","last_clean":"2024-04-20T12:23:07.088129+0000","last_became_active":"2024-04-20T12:20:41.025121+0000","last_became_peered":"2024-04-20T12:20:41.025121+0000","last_unstale":"2024-04-20T12:23:07.088129+0000","last_undegraded":"2024-04-20T12:23:07.088129+0000","last_fullsized":"2024-04-20T12:23:07.088129+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:57:14.662567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.354075+0000","last_change":"2024-04-20T12:20:42.038483+0000","last_active":"2024-04-20T12:23:07.354075+0000","last_peered":"2024-04-20T12:23:07.354075+0000","last_clean":"2024-04-20T12:23:07.354075+0000","last_became_active":"2024-04-20T12:20:42.037626+0000","last_became_peered":"2024-04-20T12:20:42.037626+0000","last_unstale":"2024-04-20T12:23:07.354075+0000","last_undegraded":"2024-04-20T12:23:07.354075+0000","last_fullsized":"2024-04-20T12:23:07.354075+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:11:27.520320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086078+0000","last_change":"2024-04-20T12:20:46.930331+0000","last_active":"2024-04-20T12:23:07.086078+0000","last_peered":"2024-04-20T12:23:07.086078+0000","last_clean":"2024-04-20T12:23:07.086078+0000","last_became_active":"2024-04-20T12:20:46.929816+0000","last_became_peered":"2024-04-20T12:20:46.929816+0000","last_unstale":"2024-04-20T12:23:07.086078+0000","last_undegraded":"2024-04-20T12:23:07.086078+0000","last_fullsized":"2024-04-20T12:23:07.086078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:42:18.148443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'48","reported_seq":107,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.309867+0000","last_change":"2024-04-20T12:20:41.022365+0000","last_active":"2024-04-20T12:23:07.309867+0000","last_peered":"2024-04-20T12:23:07.309867+0000","last_clean":"2024-04-20T12:23:07.309867+0000","last_became_active":"2024-04-20T12:20:41.022028+0000","last_became_peered":"2024-04-20T12:20:41.022028+0000","last_unstale":"2024-04-20T12:23:07.309867+0000","last_undegraded":"2024-04-20T12:23:07.309867+0000","last_fullsized":"2024-04-20T12:23:07.309867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:16.436008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":84,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086487+0000","last_change":"2024-04-20T12:20:42.031833+0000","last_active":"2024-04-20T12:23:07.086487+0000","last_peered":"2024-04-20T12:23:07.086487+0000","last_clean":"2024-04-20T12:23:07.086487+0000","last_became_active":"2024-04-20T12:20:42.031535+0000","last_became_peered":"2024-04-20T12:20:42.031535+0000","last_unstale":"2024-04-20T12:23:07.086487+0000","last_undegraded":"2024-04-20T12:23:07.086487+0000","last_fullsized":"2024-04-20T12:23:07.086487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:39:38.955662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215412+0000","last_change":"2024-04-20T12:20:46.319218+0000","last_active":"2024-04-20T12:23:07.215412+0000","last_peered":"2024-04-20T12:23:07.215412+0000","last_clean":"2024-04-20T12:23:07.215412+0000","last_became_active":"2024-04-20T12:20:46.318822+0000","last_became_peered":"2024-04-20T12:20:46.318822+0000","last_unstale":"2024-04-20T12:23:07.215412+0000","last_undegraded":"2024-04-20T12:23:07.215412+0000","last_fullsized":"2024-04-20T12:23:07.215412+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:19:16.907942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216386+0000","last_change":"2024-04-20T12:20:41.035984+0000","last_active":"2024-04-20T12:23:07.216386+0000","last_peered":"2024-04-20T12:23:07.216386+0000","last_clean":"2024-04-20T12:23:07.216386+0000","last_became_active":"2024-04-20T12:20:41.035594+0000","last_became_peered":"2024-04-20T12:20:41.035594+0000","last_unstale":"2024-04-20T12:23:07.216386+0000","last_undegraded":"2024-04-20T12:23:07.216386+0000","last_fullsized":"2024-04-20T12:23:07.216386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:15.549551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216452+0000","last_change":"2024-04-20T12:20:42.032156+0000","last_active":"2024-04-20T12:23:07.216452+0000","last_peered":"2024-04-20T12:23:07.216452+0000","last_clean":"2024-04-20T12:23:07.216452+0000","last_became_active":"2024-04-20T12:20:42.031779+0000","last_became_peered":"2024-04-20T12:20:42.031779+0000","last_unstale":"2024-04-20T12:23:07.216452+0000","last_undegraded":"2024-04-20T12:23:07.216452+0000","last_fullsized":"2024-04-20T12:23:07.216452+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:43:48.156406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216036+0000","last_change":"2024-04-20T12:20:46.931229+0000","last_active":"2024-04-20T12:23:07.216036+0000","last_peered":"2024-04-20T12:23:07.216036+0000","last_clean":"2024-04-20T12:23:07.216036+0000","last_became_active":"2024-04-20T12:20:46.930677+0000","last_became_peered":"2024-04-20T12:20:46.930677+0000","last_unstale":"2024-04-20T12:23:07.216036+0000","last_undegraded":"2024-04-20T12:23:07.216036+0000","last_fullsized":"2024-04-20T12:23:07.216036+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:54.933944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215852+0000","last_change":"2024-04-20T12:20:41.023789+0000","last_active":"2024-04-20T12:23:07.215852+0000","last_peered":"2024-04-20T12:23:07.215852+0000","last_clean":"2024-04-20T12:23:07.215852+0000","last_became_active":"2024-04-20T12:20:41.023329+0000","last_became_peered":"2024-04-20T12:20:41.023329+0000","last_unstale":"2024-04-20T12:23:07.215852+0000","last_undegraded":"2024-04-20T12:23:07.215852+0000","last_fullsized":"2024-04-20T12:23:07.215852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:02:17.634230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087648+0000","last_change":"2024-04-20T12:20:42.028708+0000","last_active":"2024-04-20T12:23:07.087648+0000","last_peered":"2024-04-20T12:23:07.087648+0000","last_clean":"2024-04-20T12:23:07.087648+0000","last_became_active":"2024-04-20T12:20:42.028358+0000","last_became_peered":"2024-04-20T12:20:42.028358+0000","last_unstale":"2024-04-20T12:23:07.087648+0000","last_undegraded":"2024-04-20T12:23:07.087648+0000","last_fullsized":"2024-04-20T12:23:07.087648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:21:58.583709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.188431+0000","last_change":"2024-04-20T12:20:46.329173+0000","last_active":"2024-04-20T12:23:07.188431+0000","last_peered":"2024-04-20T12:23:07.188431+0000","last_clean":"2024-04-20T12:23:07.188431+0000","last_became_active":"2024-04-20T12:20:46.328771+0000","last_became_peered":"2024-04-20T12:20:46.328771+0000","last_unstale":"2024-04-20T12:23:07.188431+0000","last_undegraded":"2024-04-20T12:23:07.188431+0000","last_fullsized":"2024-04-20T12:23:07.188431+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:43:57.796849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086001+0000","last_change":"2024-04-20T12:20:41.030389+0000","last_active":"2024-04-20T12:23:07.086001+0000","last_peered":"2024-04-20T12:23:07.086001+0000","last_clean":"2024-04-20T12:23:07.086001+0000","last_became_active":"2024-04-20T12:20:41.029864+0000","last_became_peered":"2024-04-20T12:20:41.029864+0000","last_unstale":"2024-04-20T12:23:07.086001+0000","last_undegraded":"2024-04-20T12:23:07.086001+0000","last_fullsized":"2024-04-20T12:23:07.086001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:01:13.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215706+0000","last_change":"2024-04-20T12:20:42.032322+0000","last_active":"2024-04-20T12:23:07.215706+0000","last_peered":"2024-04-20T12:23:07.215706+0000","last_clean":"2024-04-20T12:23:07.215706+0000","last_became_active":"2024-04-20T12:20:42.031973+0000","last_became_peered":"2024-04-20T12:20:42.031973+0000","last_unstale":"2024-04-20T12:23:07.215706+0000","last_undegraded":"2024-04-20T12:23:07.215706+0000","last_fullsized":"2024-04-20T12:23:07.215706+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:44:17.135478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216033+0000","last_change":"2024-04-20T12:20:46.321909+0000","last_active":"2024-04-20T12:23:07.216033+0000","last_peered":"2024-04-20T12:23:07.216033+0000","last_clean":"2024-04-20T12:23:07.216033+0000","last_became_active":"2024-04-20T12:20:46.321273+0000","last_became_peered":"2024-04-20T12:20:46.321273+0000","last_unstale":"2024-04-20T12:23:07.216033+0000","last_undegraded":"2024-04-20T12:23:07.216033+0000","last_fullsized":"2024-04-20T12:23:07.216033+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:58:18.429052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"95'4","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216473+0000","last_change":"2024-04-20T12:21:37.947242+0000","last_active":"2024-04-20T12:23:07.216473+0000","last_peered":"2024-04-20T12:23:07.216473+0000","last_clean":"2024-04-20T12:23:07.216473+0000","last_became_active":"2024-04-20T12:21:37.941542+0000","last_became_peered":"2024-04-20T12:21:37.941542+0000","last_unstale":"2024-04-20T12:23:07.216473+0000","last_undegraded":"2024-04-20T12:23:07.216473+0000","last_fullsized":"2024-04-20T12:23:07.216473+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:48:04.916848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086363+0000","last_change":"2024-04-20T12:20:42.037258+0000","last_active":"2024-04-20T12:23:07.086363+0000","last_peered":"2024-04-20T12:23:07.086363+0000","last_clean":"2024-04-20T12:23:07.086363+0000","last_became_active":"2024-04-20T12:20:42.036755+0000","last_became_peered":"2024-04-20T12:20:42.036755+0000","last_unstale":"2024-04-20T12:23:07.086363+0000","last_undegraded":"2024-04-20T12:23:07.086363+0000","last_fullsized":"2024-04-20T12:23:07.086363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:23:17.093038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215884+0000","last_change":"2024-04-20T12:20:46.929829+0000","last_active":"2024-04-20T12:23:07.215884+0000","last_peered":"2024-04-20T12:23:07.215884+0000","last_clean":"2024-04-20T12:23:07.215884+0000","last_became_active":"2024-04-20T12:20:46.929296+0000","last_became_peered":"2024-04-20T12:20:46.929296+0000","last_unstale":"2024-04-20T12:23:07.215884+0000","last_undegraded":"2024-04-20T12:23:07.215884+0000","last_fullsized":"2024-04-20T12:23:07.215884+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:30.700141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087825+0000","last_change":"2024-04-20T12:20:41.027753+0000","last_active":"2024-04-20T12:23:07.087825+0000","last_peered":"2024-04-20T12:23:07.087825+0000","last_clean":"2024-04-20T12:23:07.087825+0000","last_became_active":"2024-04-20T12:20:41.027360+0000","last_became_peered":"2024-04-20T12:20:41.027360+0000","last_unstale":"2024-04-20T12:23:07.087825+0000","last_undegraded":"2024-04-20T12:23:07.087825+0000","last_fullsized":"2024-04-20T12:23:07.087825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:30:59.710541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217146+0000","last_change":"2024-04-20T12:20:42.029409+0000","last_active":"2024-04-20T12:23:07.217146+0000","last_peered":"2024-04-20T12:23:07.217146+0000","last_clean":"2024-04-20T12:23:07.217146+0000","last_became_active":"2024-04-20T12:20:42.029062+0000","last_became_peered":"2024-04-20T12:20:42.029062+0000","last_unstale":"2024-04-20T12:23:07.217146+0000","last_undegraded":"2024-04-20T12:23:07.217146+0000","last_fullsized":"2024-04-20T12:23:07.217146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:47:33.412087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215926+0000","last_change":"2024-04-20T12:20:46.326605+0000","last_active":"2024-04-20T12:23:07.215926+0000","last_peered":"2024-04-20T12:23:07.215926+0000","last_clean":"2024-04-20T12:23:07.215926+0000","last_became_active":"2024-04-20T12:20:46.326162+0000","last_became_peered":"2024-04-20T12:20:46.326162+0000","last_unstale":"2024-04-20T12:23:07.215926+0000","last_undegraded":"2024-04-20T12:23:07.215926+0000","last_fullsized":"2024-04-20T12:23:07.215926+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:44:37.344357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"95'6","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.485909+0000","last_change":"2024-04-20T12:20:41.035324+0000","last_active":"2024-04-20T12:23:07.485909+0000","last_peered":"2024-04-20T12:23:07.485909+0000","last_clean":"2024-04-20T12:23:07.485909+0000","last_became_active":"2024-04-20T12:20:41.034996+0000","last_became_peered":"2024-04-20T12:20:41.034996+0000","last_unstale":"2024-04-20T12:23:07.485909+0000","last_undegraded":"2024-04-20T12:23:07.485909+0000","last_fullsized":"2024-04-20T12:23:07.485909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:33.788405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216933+0000","last_change":"2024-04-20T12:20:42.028803+0000","last_active":"2024-04-20T12:23:07.216933+0000","last_peered":"2024-04-20T12:23:07.216933+0000","last_clean":"2024-04-20T12:23:07.216933+0000","last_became_active":"2024-04-20T12:20:42.028316+0000","last_became_peered":"2024-04-20T12:20:42.028316+0000","last_unstale":"2024-04-20T12:23:07.216933+0000","last_undegraded":"2024-04-20T12:23:07.216933+0000","last_fullsized":"2024-04-20T12:23:07.216933+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:09.000315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215788+0000","last_change":"2024-04-20T12:20:46.328502+0000","last_active":"2024-04-20T12:23:07.215788+0000","last_peered":"2024-04-20T12:23:07.215788+0000","last_clean":"2024-04-20T12:23:07.215788+0000","last_became_active":"2024-04-20T12:20:46.328106+0000","last_became_peered":"2024-04-20T12:20:46.328106+0000","last_unstale":"2024-04-20T12:23:07.215788+0000","last_undegraded":"2024-04-20T12:23:07.215788+0000","last_fullsized":"2024-04-20T12:23:07.215788+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:06:30.041621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"95'41","reported_seq":85,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.307416+0000","last_change":"2024-04-20T12:20:41.023918+0000","last_active":"2024-04-20T12:23:07.307416+0000","last_peered":"2024-04-20T12:23:07.307416+0000","last_clean":"2024-04-20T12:23:07.307416+0000","last_became_active":"2024-04-20T12:20:41.023088+0000","last_became_peered":"2024-04-20T12:20:41.023088+0000","last_unstale":"2024-04-20T12:23:07.307416+0000","last_undegraded":"2024-04-20T12:23:07.307416+0000","last_fullsized":"2024-04-20T12:23:07.307416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:15:03.220660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217351+0000","last_change":"2024-04-20T12:20:42.038981+0000","last_active":"2024-04-20T12:23:07.217351+0000","last_peered":"2024-04-20T12:23:07.217351+0000","last_clean":"2024-04-20T12:23:07.217351+0000","last_became_active":"2024-04-20T12:20:42.038656+0000","last_became_peered":"2024-04-20T12:20:42.038656+0000","last_unstale":"2024-04-20T12:23:07.217351+0000","last_undegraded":"2024-04-20T12:23:07.217351+0000","last_fullsized":"2024-04-20T12:23:07.217351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:51:08.446546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.195670+0000","last_change":"2024-04-20T12:20:46.323446+0000","last_active":"2024-04-20T12:23:07.195670+0000","last_peered":"2024-04-20T12:23:07.195670+0000","last_clean":"2024-04-20T12:23:07.195670+0000","last_became_active":"2024-04-20T12:20:46.322259+0000","last_became_peered":"2024-04-20T12:20:46.322259+0000","last_unstale":"2024-04-20T12:23:07.195670+0000","last_undegraded":"2024-04-20T12:23:07.195670+0000","last_fullsized":"2024-04-20T12:23:07.195670+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:01:11.833469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.354552+0000","last_change":"2024-04-20T12:20:41.029995+0000","last_active":"2024-04-20T12:23:07.354552+0000","last_peered":"2024-04-20T12:23:07.354552+0000","last_clean":"2024-04-20T12:23:07.354552+0000","last_became_active":"2024-04-20T12:20:41.029650+0000","last_became_peered":"2024-04-20T12:20:41.029650+0000","last_unstale":"2024-04-20T12:23:07.354552+0000","last_undegraded":"2024-04-20T12:23:07.354552+0000","last_fullsized":"2024-04-20T12:23:07.354552+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:24:54.522855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217386+0000","last_change":"2024-04-20T12:20:42.030357+0000","last_active":"2024-04-20T12:23:07.217386+0000","last_peered":"2024-04-20T12:23:07.217386+0000","last_clean":"2024-04-20T12:23:07.217386+0000","last_became_active":"2024-04-20T12:20:42.029966+0000","last_became_peered":"2024-04-20T12:20:42.029966+0000","last_unstale":"2024-04-20T12:23:07.217386+0000","last_undegraded":"2024-04-20T12:23:07.217386+0000","last_fullsized":"2024-04-20T12:23:07.217386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:35:09.487965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215896+0000","last_change":"2024-04-20T12:20:42.036914+0000","last_active":"2024-04-20T12:23:07.215896+0000","last_peered":"2024-04-20T12:23:07.215896+0000","last_clean":"2024-04-20T12:23:07.215896+0000","last_became_active":"2024-04-20T12:20:42.036434+0000","last_became_peered":"2024-04-20T12:20:42.036434+0000","last_unstale":"2024-04-20T12:23:07.215896+0000","last_undegraded":"2024-04-20T12:23:07.215896+0000","last_fullsized":"2024-04-20T12:23:07.215896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.552096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215529+0000","last_change":"2024-04-20T12:20:42.040424+0000","last_active":"2024-04-20T12:23:07.215529+0000","last_peered":"2024-04-20T12:23:07.215529+0000","last_clean":"2024-04-20T12:23:07.215529+0000","last_became_active":"2024-04-20T12:20:42.040095+0000","last_became_peered":"2024-04-20T12:20:42.040095+0000","last_unstale":"2024-04-20T12:23:07.215529+0000","last_undegraded":"2024-04-20T12:23:07.215529+0000","last_fullsized":"2024-04-20T12:23:07.215529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:24.669083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215646+0000","last_change":"2024-04-20T12:20:42.037764+0000","last_active":"2024-04-20T12:23:07.215646+0000","last_peered":"2024-04-20T12:23:07.215646+0000","last_clean":"2024-04-20T12:23:07.215646+0000","last_became_active":"2024-04-20T12:20:42.037389+0000","last_became_peered":"2024-04-20T12:20:42.037389+0000","last_unstale":"2024-04-20T12:23:07.215646+0000","last_undegraded":"2024-04-20T12:23:07.215646+0000","last_fullsized":"2024-04-20T12:23:07.215646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:20.284714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216037+0000","last_change":"2024-04-20T12:20:42.027546+0000","last_active":"2024-04-20T12:23:07.216037+0000","last_peered":"2024-04-20T12:23:07.216037+0000","last_clean":"2024-04-20T12:23:07.216037+0000","last_became_active":"2024-04-20T12:20:42.027229+0000","last_became_peered":"2024-04-20T12:20:42.027229+0000","last_unstale":"2024-04-20T12:23:07.216037+0000","last_undegraded":"2024-04-20T12:23:07.216037+0000","last_fullsized":"2024-04-20T12:23:07.216037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:22.649256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.354052+0000","last_change":"2024-04-20T12:20:42.024971+0000","last_active":"2024-04-20T12:23:07.354052+0000","last_peered":"2024-04-20T12:23:07.354052+0000","last_clean":"2024-04-20T12:23:07.354052+0000","last_became_active":"2024-04-20T12:20:42.024607+0000","last_became_peered":"2024-04-20T12:20:42.024607+0000","last_unstale":"2024-04-20T12:23:07.354052+0000","last_undegraded":"2024-04-20T12:23:07.354052+0000","last_fullsized":"2024-04-20T12:23:07.354052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:15:56.160140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216590+0000","last_change":"2024-04-20T12:20:42.036699+0000","last_active":"2024-04-20T12:23:07.216590+0000","last_peered":"2024-04-20T12:23:07.216590+0000","last_clean":"2024-04-20T12:23:07.216590+0000","last_became_active":"2024-04-20T12:20:42.036355+0000","last_became_peered":"2024-04-20T12:20:42.036355+0000","last_unstale":"2024-04-20T12:23:07.216590+0000","last_undegraded":"2024-04-20T12:23:07.216590+0000","last_fullsized":"2024-04-20T12:23:07.216590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:14:40.276148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216080+0000","last_change":"2024-04-20T12:20:42.034906+0000","last_active":"2024-04-20T12:23:07.216080+0000","last_peered":"2024-04-20T12:23:07.216080+0000","last_clean":"2024-04-20T12:23:07.216080+0000","last_became_active":"2024-04-20T12:20:42.034572+0000","last_became_peered":"2024-04-20T12:20:42.034572+0000","last_unstale":"2024-04-20T12:23:07.216080+0000","last_undegraded":"2024-04-20T12:23:07.216080+0000","last_fullsized":"2024-04-20T12:23:07.216080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:54.166032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086645+0000","last_change":"2024-04-20T12:20:42.041180+0000","last_active":"2024-04-20T12:23:07.086645+0000","last_peered":"2024-04-20T12:23:07.086645+0000","last_clean":"2024-04-20T12:23:07.086645+0000","last_became_active":"2024-04-20T12:20:42.040648+0000","last_became_peered":"2024-04-20T12:20:42.040648+0000","last_unstale":"2024-04-20T12:23:07.086645+0000","last_undegraded":"2024-04-20T12:23:07.086645+0000","last_fullsized":"2024-04-20T12:23:07.086645+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:55:38.855441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.195776+0000","last_change":"2024-04-20T12:20:42.030153+0000","last_active":"2024-04-20T12:23:07.195776+0000","last_peered":"2024-04-20T12:23:07.195776+0000","last_clean":"2024-04-20T12:23:07.195776+0000","last_became_active":"2024-04-20T12:20:42.029796+0000","last_became_peered":"2024-04-20T12:20:42.029796+0000","last_unstale":"2024-04-20T12:23:07.195776+0000","last_undegraded":"2024-04-20T12:23:07.195776+0000","last_fullsized":"2024-04-20T12:23:07.195776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:50.676958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086066+0000","last_change":"2024-04-20T12:20:42.039864+0000","last_active":"2024-04-20T12:23:07.086066+0000","last_peered":"2024-04-20T12:23:07.086066+0000","last_clean":"2024-04-20T12:23:07.086066+0000","last_became_active":"2024-04-20T12:20:42.036624+0000","last_became_peered":"2024-04-20T12:20:42.036624+0000","last_unstale":"2024-04-20T12:23:07.086066+0000","last_undegraded":"2024-04-20T12:23:07.086066+0000","last_fullsized":"2024-04-20T12:23:07.086066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:13.271749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216312+0000","last_change":"2024-04-20T12:20:42.033628+0000","last_active":"2024-04-20T12:23:07.216312+0000","last_peered":"2024-04-20T12:23:07.216312+0000","last_clean":"2024-04-20T12:23:07.216312+0000","last_became_active":"2024-04-20T12:20:42.033296+0000","last_became_peered":"2024-04-20T12:20:42.033296+0000","last_unstale":"2024-04-20T12:23:07.216312+0000","last_undegraded":"2024-04-20T12:23:07.216312+0000","last_fullsized":"2024-04-20T12:23:07.216312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:16:16.029327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.352822+0000","last_change":"2024-04-20T12:20:42.024730+0000","last_active":"2024-04-20T12:23:07.352822+0000","last_peered":"2024-04-20T12:23:07.352822+0000","last_clean":"2024-04-20T12:23:07.352822+0000","last_became_active":"2024-04-20T12:20:42.024400+0000","last_became_peered":"2024-04-20T12:20:42.024400+0000","last_unstale":"2024-04-20T12:23:07.352822+0000","last_undegraded":"2024-04-20T12:23:07.352822+0000","last_fullsized":"2024-04-20T12:23:07.352822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:27:41.514880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216011+0000","last_change":"2024-04-20T12:20:42.033623+0000","last_active":"2024-04-20T12:23:07.216011+0000","last_peered":"2024-04-20T12:23:07.216011+0000","last_clean":"2024-04-20T12:23:07.216011+0000","last_became_active":"2024-04-20T12:20:42.033105+0000","last_became_peered":"2024-04-20T12:20:42.033105+0000","last_unstale":"2024-04-20T12:23:07.216011+0000","last_undegraded":"2024-04-20T12:23:07.216011+0000","last_fullsized":"2024-04-20T12:23:07.216011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:01.121977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":106764,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":603960,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1328,"num_read_kb":788,"num_write":372,"num_write_kb":1470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":622,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":712704,"data_stored":1811880,"data_compressed":80748,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383722,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":529596,"data_compressed":29543,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645358,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32376,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712776,"statfs":{"total":95995035648,"available":95961882624,"internally_reserved":0,"allocated":1224704,"data_stored":1328653,"data_compressed":75884,"data_compressed_allocated":102400,"data_compressed_original":811008,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808884,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1081344,"data_stored":543496,"data_compressed":32526,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070522,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1097728,"data_stored":932994,"data_compressed":51672,"data_compressed_allocated":69632,"data_compressed_original":483328,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332159,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32280,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712872,"statfs":{"total":95995035648,"available":95961980928,"internally_reserved":0,"allocated":1126400,"data_stored":1138147,"data_compressed":68114,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495683,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1052672,"data_stored":535686,"data_compressed":32526,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1122304,"data_stored":606784,"data_compressed":34140,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1077248,"data_stored":536751,"data_compressed":32526,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712864,"statfs":{"total":95995035648,"available":95961972736,"internally_reserved":0,"allocated":1134592,"data_stored":605991,"data_compressed":34140,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":1059428,"data_compressed":57828,"data_compressed_allocated":77824,"data_compressed_original":606208,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920846,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1069056,"data_stored":541081,"data_compressed":32526,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757321,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32304,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712848,"statfs":{"total":95995035648,"available":95961956352,"internally_reserved":0,"allocated":1155072,"data_stored":1263848,"data_compressed":74270,"data_compressed_allocated":98304,"data_compressed_original":802816,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":72602,"data_compressed":1614,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":71809,"data_compressed":1614,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":135202,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":394716,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":204103,"data_compressed":7770,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T12:23:12.490 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-04-20T12:23:12.490 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T12:23:12.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:23:12.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:23:12.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:23:12.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:23:12.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: Updating smithi135:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T12:23:12.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: Updating smithi154:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T12:23:12.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: Updating smithi139:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T12:23:12.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/14443301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:23:12.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-04-20T12:23:12.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1271543606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:23:12.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:23:12.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:23:12.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:23:12.504 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:12 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:23:12.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: Updating smithi154:/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:23:12.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: Updating smithi139:/etc/ceph/ceph.client.admin.keyring 2024-04-20T12:23:12.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-04-20T12:23:12.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: Updating smithi135:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T12:23:12.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: Updating smithi154:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T12:23:12.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: Updating smithi139:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/config/ceph.client.admin.keyring 2024-04-20T12:23:12.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/14443301' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:23:12.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: mgrmap e24: x(active, since 4s), standbys: y, z 2024-04-20T12:23:12.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1271543606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:23:12.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:23:12.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:23:12.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:23:12.582 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:12 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:23:12.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.624+0000 7fae4613d640 1 -- 172.21.15.135:0/3815748145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4010c530 msgr2=0x7fae4010e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:12.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.624+0000 7fae4613d640 1 --2- 172.21.15.135:0/3815748145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4010c530 0x7fae4010e9d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fae38009ca0 tx=0x7fae3802c230 comp rx=0 tx=0).stop 2024-04-20T12:23:12.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.624+0000 7fae4613d640 1 -- 172.21.15.135:0/3815748145 shutdown_connections 2024-04-20T12:23:12.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.624+0000 7fae4613d640 1 --2- 172.21.15.135:0/3815748145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4010c530 0x7fae4010e9d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.624+0000 7fae4613d640 1 --2- 172.21.15.135:0/3815748145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae40103b10 0x7fae4010bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.624+0000 7fae4613d640 1 --2- 172.21.15.135:0/3815748145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae401031f0 0x7fae401035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.624+0000 7fae4613d640 1 -- 172.21.15.135:0/3815748145 >> 172.21.15.135:0/3815748145 conn(0x7fae40077f60 msgr2=0x7fae40078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:12.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.624+0000 7fae4613d640 1 -- 172.21.15.135:0/3815748145 shutdown_connections 2024-04-20T12:23:12.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.624+0000 7fae4613d640 1 -- 172.21.15.135:0/3815748145 wait complete. 2024-04-20T12:23:12.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.624+0000 7fae4613d640 1 Processor -- start 2024-04-20T12:23:12.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.624+0000 7fae4613d640 1 -- start start 2024-04-20T12:23:12.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae4613d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae401031f0 0x7fae4019e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:12.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae4613d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae40103b10 0x7fae4019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:12.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae4613d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4010c530 0x7fae401985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:12.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae4613d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fae40112310 con 0x7fae4010c530 2024-04-20T12:23:12.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae4613d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fae40112190 con 0x7fae40103b10 2024-04-20T12:23:12.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae4613d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae40112490 con 0x7fae401031f0 2024-04-20T12:23:12.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae3ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4010c530 0x7fae401985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:12.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae3ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4010c530 0x7fae401985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35320/0 (socket says 172.21.15.135:35320) 2024-04-20T12:23:12.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae3ffff640 1 -- 172.21.15.135:0/919424108 learned_addr learned my addr 172.21.15.135:0/919424108 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:12.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae3f7fe640 1 --2- 172.21.15.135:0/919424108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae401031f0 0x7fae4019e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:12.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae37fff640 1 --2- 172.21.15.135:0/919424108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae40103b10 0x7fae4019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:12.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae3ffff640 1 -- 172.21.15.135:0/919424108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae401031f0 msgr2=0x7fae4019e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:12.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae3ffff640 1 --2- 172.21.15.135:0/919424108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae401031f0 0x7fae4019e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae3ffff640 1 -- 172.21.15.135:0/919424108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae40103b10 msgr2=0x7fae4019e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:12.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae3ffff640 1 --2- 172.21.15.135:0/919424108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae40103b10 0x7fae4019e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae3ffff640 1 -- 172.21.15.135:0/919424108 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae40198d50 con 0x7fae4010c530 2024-04-20T12:23:12.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae37fff640 1 --2- 172.21.15.135:0/919424108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae40103b10 0x7fae4019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:12.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae3ffff640 1 --2- 172.21.15.135:0/919424108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4010c530 0x7fae401985d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fae3802c840 tx=0x7fae38035d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:12.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae3d7fa640 1 -- 172.21.15.135:0/919424108 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38039040 con 0x7fae4010c530 2024-04-20T12:23:12.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae3d7fa640 1 -- 172.21.15.135:0/919424108 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae38044070 con 0x7fae4010c530 2024-04-20T12:23:12.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae4613d640 1 -- 172.21.15.135:0/919424108 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae40198fe0 con 0x7fae4010c530 2024-04-20T12:23:12.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae3d7fa640 1 -- 172.21.15.135:0/919424108 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae380042a0 con 0x7fae4010c530 2024-04-20T12:23:12.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.625+0000 7fae4613d640 1 -- 172.21.15.135:0/919424108 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae401a52e0 con 0x7fae4010c530 2024-04-20T12:23:12.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.626+0000 7fae4613d640 1 -- 172.21.15.135:0/919424108 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae40068d80 con 0x7fae4010c530 2024-04-20T12:23:12.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.627+0000 7fae3d7fa640 1 -- 172.21.15.135:0/919424108 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7fae38004440 con 0x7fae4010c530 2024-04-20T12:23:12.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.628+0000 7fae3d7fa640 1 --2- 172.21.15.135:0/919424108 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fae2c0a3e40 0x7fae2c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:12.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.628+0000 7fae3f7fe640 1 --2- 172.21.15.135:0/919424108 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fae2c0a3e40 0x7fae2c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:12.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.628+0000 7fae3d7fa640 1 -- 172.21.15.135:0/919424108 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fae380f3180 con 0x7fae4010c530 2024-04-20T12:23:12.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.628+0000 7fae3f7fe640 1 --2- 172.21.15.135:0/919424108 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fae2c0a3e40 0x7fae2c0a6300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae30009bd0 tx=0x7fae30005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:12.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.632+0000 7fae3d7fa640 1 -- 172.21.15.135:0/919424108 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fae380bf360 con 0x7fae4010c530 2024-04-20T12:23:12.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.808+0000 7fae4613d640 1 -- 172.21.15.135:0/919424108 --> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fae400623a0 con 0x7fae2c0a3e40 2024-04-20T12:23:12.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.817+0000 7fae3d7fa640 1 -- 172.21.15.135:0/919424108 <== mgr.25093 v2:172.21.15.135:6800/15232286 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339746 (secure 0 0 0) 0x7fae400623a0 con 0x7fae2c0a3e40 2024-04-20T12:23:12.820 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:23:12.822 INFO:teuthology.orchestra.run.smithi135.stderr:dumped all 2024-04-20T12:23:12.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.820+0000 7fae4613d640 1 -- 172.21.15.135:0/919424108 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fae2c0a3e40 msgr2=0x7fae2c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:12.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.820+0000 7fae4613d640 1 --2- 172.21.15.135:0/919424108 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fae2c0a3e40 0x7fae2c0a6300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae30009bd0 tx=0x7fae30005f90 comp rx=0 tx=0).stop 2024-04-20T12:23:12.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.820+0000 7fae4613d640 1 -- 172.21.15.135:0/919424108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4010c530 msgr2=0x7fae401985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:12.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.820+0000 7fae4613d640 1 --2- 172.21.15.135:0/919424108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4010c530 0x7fae401985d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fae3802c840 tx=0x7fae38035d90 comp rx=0 tx=0).stop 2024-04-20T12:23:12.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.820+0000 7fae4613d640 1 -- 172.21.15.135:0/919424108 shutdown_connections 2024-04-20T12:23:12.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.820+0000 7fae4613d640 1 --2- 172.21.15.135:0/919424108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4010c530 0x7fae401985d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.820+0000 7fae4613d640 1 --2- 172.21.15.135:0/919424108 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae40103b10 0x7fae4019e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.820+0000 7fae4613d640 1 --2- 172.21.15.135:0/919424108 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fae2c0a3e40 0x7fae2c0a6300 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.820+0000 7fae4613d640 1 --2- 172.21.15.135:0/919424108 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae401031f0 0x7fae4019e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.820+0000 7fae4613d640 1 -- 172.21.15.135:0/919424108 >> 172.21.15.135:0/919424108 conn(0x7fae40077f60 msgr2=0x7fae400fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:12.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.820+0000 7fae4613d640 1 -- 172.21.15.135:0/919424108 shutdown_connections 2024-04-20T12:23:12.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.820+0000 7fae4613d640 1 -- 172.21.15.135:0/919424108 wait complete. 2024-04-20T12:23:12.831 INFO:teuthology.orchestra.run.smithi135.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-20T12:23:11.100659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1194562,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":1464,"num_read_kb":907,"num_write":555,"num_write_kb":4410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1181358,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":941,"ondisk_log_size":941,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366336,"kb_used_data":12980,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575488,"statfs":{"total":1151940427776,"available":1151565299712,"internally_reserved":0,"allocated":13291520,"data_stored":9622455,"data_compressed":555695,"data_compressed_allocated":757760,"data_compressed_original":4022272,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.985672"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216249+0000","last_change":"2024-04-20T12:20:42.031660+0000","last_active":"2024-04-20T12:23:07.216249+0000","last_peered":"2024-04-20T12:23:07.216249+0000","last_clean":"2024-04-20T12:23:07.216249+0000","last_became_active":"2024-04-20T12:20:42.031334+0000","last_became_peered":"2024-04-20T12:20:42.031334+0000","last_unstale":"2024-04-20T12:23:07.216249+0000","last_undegraded":"2024-04-20T12:23:07.216249+0000","last_fullsized":"2024-04-20T12:23:07.216249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:27.971885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216525+0000","last_change":"2024-04-20T12:20:42.039049+0000","last_active":"2024-04-20T12:23:07.216525+0000","last_peered":"2024-04-20T12:23:07.216525+0000","last_clean":"2024-04-20T12:23:07.216525+0000","last_became_active":"2024-04-20T12:20:42.037960+0000","last_became_peered":"2024-04-20T12:20:42.037960+0000","last_unstale":"2024-04-20T12:23:07.216525+0000","last_undegraded":"2024-04-20T12:23:07.216525+0000","last_fullsized":"2024-04-20T12:23:07.216525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:45:44.482154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216180+0000","last_change":"2024-04-20T12:20:42.036915+0000","last_active":"2024-04-20T12:23:07.216180+0000","last_peered":"2024-04-20T12:23:07.216180+0000","last_clean":"2024-04-20T12:23:07.216180+0000","last_became_active":"2024-04-20T12:20:42.036282+0000","last_became_peered":"2024-04-20T12:20:42.036282+0000","last_unstale":"2024-04-20T12:23:07.216180+0000","last_undegraded":"2024-04-20T12:23:07.216180+0000","last_fullsized":"2024-04-20T12:23:07.216180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:04:55.865977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216235+0000","last_change":"2024-04-20T12:20:42.036653+0000","last_active":"2024-04-20T12:23:07.216235+0000","last_peered":"2024-04-20T12:23:07.216235+0000","last_clean":"2024-04-20T12:23:07.216235+0000","last_became_active":"2024-04-20T12:20:42.036112+0000","last_became_peered":"2024-04-20T12:20:42.036112+0000","last_unstale":"2024-04-20T12:23:07.216235+0000","last_undegraded":"2024-04-20T12:23:07.216235+0000","last_fullsized":"2024-04-20T12:23:07.216235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:05:50.728127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087883+0000","last_change":"2024-04-20T12:20:42.031271+0000","last_active":"2024-04-20T12:23:07.087883+0000","last_peered":"2024-04-20T12:23:07.087883+0000","last_clean":"2024-04-20T12:23:07.087883+0000","last_became_active":"2024-04-20T12:20:42.030930+0000","last_became_peered":"2024-04-20T12:20:42.030930+0000","last_unstale":"2024-04-20T12:23:07.087883+0000","last_undegraded":"2024-04-20T12:23:07.087883+0000","last_fullsized":"2024-04-20T12:23:07.087883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:30:53.523203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087836+0000","last_change":"2024-04-20T12:20:42.037556+0000","last_active":"2024-04-20T12:23:07.087836+0000","last_peered":"2024-04-20T12:23:07.087836+0000","last_clean":"2024-04-20T12:23:07.087836+0000","last_became_active":"2024-04-20T12:20:42.037140+0000","last_became_peered":"2024-04-20T12:20:42.037140+0000","last_unstale":"2024-04-20T12:23:07.087836+0000","last_undegraded":"2024-04-20T12:23:07.087836+0000","last_fullsized":"2024-04-20T12:23:07.087836+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:41:50.827641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217082+0000","last_change":"2024-04-20T12:20:42.042004+0000","last_active":"2024-04-20T12:23:07.217082+0000","last_peered":"2024-04-20T12:23:07.217082+0000","last_clean":"2024-04-20T12:23:07.217082+0000","last_became_active":"2024-04-20T12:20:42.041663+0000","last_became_peered":"2024-04-20T12:20:42.041663+0000","last_unstale":"2024-04-20T12:23:07.217082+0000","last_undegraded":"2024-04-20T12:23:07.217082+0000","last_fullsized":"2024-04-20T12:23:07.217082+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:00.196652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.085989+0000","last_change":"2024-04-20T12:20:42.043250+0000","last_active":"2024-04-20T12:23:07.085989+0000","last_peered":"2024-04-20T12:23:07.085989+0000","last_clean":"2024-04-20T12:23:07.085989+0000","last_became_active":"2024-04-20T12:20:42.042678+0000","last_became_peered":"2024-04-20T12:20:42.042678+0000","last_unstale":"2024-04-20T12:23:07.085989+0000","last_undegraded":"2024-04-20T12:23:07.085989+0000","last_fullsized":"2024-04-20T12:23:07.085989+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:28:36.825718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216164+0000","last_change":"2024-04-20T12:20:42.026370+0000","last_active":"2024-04-20T12:23:07.216164+0000","last_peered":"2024-04-20T12:23:07.216164+0000","last_clean":"2024-04-20T12:23:07.216164+0000","last_became_active":"2024-04-20T12:20:42.026010+0000","last_became_peered":"2024-04-20T12:20:42.026010+0000","last_unstale":"2024-04-20T12:23:07.216164+0000","last_undegraded":"2024-04-20T12:23:07.216164+0000","last_fullsized":"2024-04-20T12:23:07.216164+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:13.526130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":55,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087972+0000","last_change":"2024-04-20T12:21:37.912184+0000","last_active":"2024-04-20T12:23:07.087972+0000","last_peered":"2024-04-20T12:23:07.087972+0000","last_clean":"2024-04-20T12:23:07.087972+0000","last_became_active":"2024-04-20T12:21:37.911745+0000","last_became_peered":"2024-04-20T12:21:37.911745+0000","last_unstale":"2024-04-20T12:23:07.087972+0000","last_undegraded":"2024-04-20T12:23:07.087972+0000","last_fullsized":"2024-04-20T12:23:07.087972+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:39:26.296420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216834+0000","last_change":"2024-04-20T12:20:42.032408+0000","last_active":"2024-04-20T12:23:07.216834+0000","last_peered":"2024-04-20T12:23:07.216834+0000","last_clean":"2024-04-20T12:23:07.216834+0000","last_became_active":"2024-04-20T12:20:42.032035+0000","last_became_peered":"2024-04-20T12:20:42.032035+0000","last_unstale":"2024-04-20T12:23:07.216834+0000","last_undegraded":"2024-04-20T12:23:07.216834+0000","last_fullsized":"2024-04-20T12:23:07.216834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:03.702299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216212+0000","last_change":"2024-04-20T12:20:42.040299+0000","last_active":"2024-04-20T12:23:07.216212+0000","last_peered":"2024-04-20T12:23:07.216212+0000","last_clean":"2024-04-20T12:23:07.216212+0000","last_became_active":"2024-04-20T12:20:42.039891+0000","last_became_peered":"2024-04-20T12:20:42.039891+0000","last_unstale":"2024-04-20T12:23:07.216212+0000","last_undegraded":"2024-04-20T12:23:07.216212+0000","last_fullsized":"2024-04-20T12:23:07.216212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:16:31.701459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.353753+0000","last_change":"2024-04-20T12:20:42.032551+0000","last_active":"2024-04-20T12:23:07.353753+0000","last_peered":"2024-04-20T12:23:07.353753+0000","last_clean":"2024-04-20T12:23:07.353753+0000","last_became_active":"2024-04-20T12:20:42.032247+0000","last_became_peered":"2024-04-20T12:20:42.032247+0000","last_unstale":"2024-04-20T12:23:07.353753+0000","last_undegraded":"2024-04-20T12:23:07.353753+0000","last_fullsized":"2024-04-20T12:23:07.353753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:02:22.181110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215795+0000","last_change":"2024-04-20T12:20:42.042662+0000","last_active":"2024-04-20T12:23:07.215795+0000","last_peered":"2024-04-20T12:23:07.215795+0000","last_clean":"2024-04-20T12:23:07.215795+0000","last_became_active":"2024-04-20T12:20:42.042351+0000","last_became_peered":"2024-04-20T12:20:42.042351+0000","last_unstale":"2024-04-20T12:23:07.215795+0000","last_undegraded":"2024-04-20T12:23:07.215795+0000","last_fullsized":"2024-04-20T12:23:07.215795+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:15:21.632339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215730+0000","last_change":"2024-04-20T12:20:42.033402+0000","last_active":"2024-04-20T12:23:07.215730+0000","last_peered":"2024-04-20T12:23:07.215730+0000","last_clean":"2024-04-20T12:23:07.215730+0000","last_became_active":"2024-04-20T12:20:42.032996+0000","last_became_peered":"2024-04-20T12:20:42.032996+0000","last_unstale":"2024-04-20T12:23:07.215730+0000","last_undegraded":"2024-04-20T12:23:07.215730+0000","last_fullsized":"2024-04-20T12:23:07.215730+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:45.487051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215744+0000","last_change":"2024-04-20T12:20:42.033836+0000","last_active":"2024-04-20T12:23:07.215744+0000","last_peered":"2024-04-20T12:23:07.215744+0000","last_clean":"2024-04-20T12:23:07.215744+0000","last_became_active":"2024-04-20T12:20:42.033497+0000","last_became_peered":"2024-04-20T12:20:42.033497+0000","last_unstale":"2024-04-20T12:23:07.215744+0000","last_undegraded":"2024-04-20T12:23:07.215744+0000","last_fullsized":"2024-04-20T12:23:07.215744+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:25:16.428158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216116+0000","last_change":"2024-04-20T12:20:42.030284+0000","last_active":"2024-04-20T12:23:07.216116+0000","last_peered":"2024-04-20T12:23:07.216116+0000","last_clean":"2024-04-20T12:23:07.216116+0000","last_became_active":"2024-04-20T12:20:42.029899+0000","last_became_peered":"2024-04-20T12:20:42.029899+0000","last_unstale":"2024-04-20T12:23:07.216116+0000","last_undegraded":"2024-04-20T12:23:07.216116+0000","last_fullsized":"2024-04-20T12:23:07.216116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:39:14.371947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.187992+0000","last_change":"2024-04-20T12:20:42.028298+0000","last_active":"2024-04-20T12:23:07.187992+0000","last_peered":"2024-04-20T12:23:07.187992+0000","last_clean":"2024-04-20T12:23:07.187992+0000","last_became_active":"2024-04-20T12:20:42.027814+0000","last_became_peered":"2024-04-20T12:20:42.027814+0000","last_unstale":"2024-04-20T12:23:07.187992+0000","last_undegraded":"2024-04-20T12:23:07.187992+0000","last_fullsized":"2024-04-20T12:23:07.187992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:44:39.903424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216529+0000","last_change":"2024-04-20T12:20:42.043697+0000","last_active":"2024-04-20T12:23:07.216529+0000","last_peered":"2024-04-20T12:23:07.216529+0000","last_clean":"2024-04-20T12:23:07.216529+0000","last_became_active":"2024-04-20T12:20:42.043322+0000","last_became_peered":"2024-04-20T12:20:42.043322+0000","last_unstale":"2024-04-20T12:23:07.216529+0000","last_undegraded":"2024-04-20T12:23:07.216529+0000","last_fullsized":"2024-04-20T12:23:07.216529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:08:35.148726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215596+0000","last_change":"2024-04-20T12:20:46.326298+0000","last_active":"2024-04-20T12:23:07.215596+0000","last_peered":"2024-04-20T12:23:07.215596+0000","last_clean":"2024-04-20T12:23:07.215596+0000","last_became_active":"2024-04-20T12:20:46.325893+0000","last_became_peered":"2024-04-20T12:20:46.325893+0000","last_unstale":"2024-04-20T12:23:07.215596+0000","last_undegraded":"2024-04-20T12:23:07.215596+0000","last_fullsized":"2024-04-20T12:23:07.215596+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:17.076871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"95'14","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.352563+0000","last_change":"2024-04-20T12:20:41.027834+0000","last_active":"2024-04-20T12:23:07.352563+0000","last_peered":"2024-04-20T12:23:07.352563+0000","last_clean":"2024-04-20T12:23:07.352563+0000","last_became_active":"2024-04-20T12:20:41.027541+0000","last_became_peered":"2024-04-20T12:20:41.027541+0000","last_unstale":"2024-04-20T12:23:07.352563+0000","last_undegraded":"2024-04-20T12:23:07.352563+0000","last_fullsized":"2024-04-20T12:23:07.352563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:30.454875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":120,"num_read_kb":120,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086589+0000","last_change":"2024-04-20T12:20:42.043315+0000","last_active":"2024-04-20T12:23:07.086589+0000","last_peered":"2024-04-20T12:23:07.086589+0000","last_clean":"2024-04-20T12:23:07.086589+0000","last_became_active":"2024-04-20T12:20:42.042920+0000","last_became_peered":"2024-04-20T12:20:42.042920+0000","last_unstale":"2024-04-20T12:23:07.086589+0000","last_undegraded":"2024-04-20T12:23:07.086589+0000","last_fullsized":"2024-04-20T12:23:07.086589+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:52.353023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215802+0000","last_change":"2024-04-20T12:20:46.327004+0000","last_active":"2024-04-20T12:23:07.215802+0000","last_peered":"2024-04-20T12:23:07.215802+0000","last_clean":"2024-04-20T12:23:07.215802+0000","last_became_active":"2024-04-20T12:20:46.326433+0000","last_became_peered":"2024-04-20T12:20:46.326433+0000","last_unstale":"2024-04-20T12:23:07.215802+0000","last_undegraded":"2024-04-20T12:23:07.215802+0000","last_fullsized":"2024-04-20T12:23:07.215802+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:58:05.864093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086674+0000","last_change":"2024-04-20T12:20:41.032149+0000","last_active":"2024-04-20T12:23:07.086674+0000","last_peered":"2024-04-20T12:23:07.086674+0000","last_clean":"2024-04-20T12:23:07.086674+0000","last_became_active":"2024-04-20T12:20:41.031708+0000","last_became_peered":"2024-04-20T12:20:41.031708+0000","last_unstale":"2024-04-20T12:23:07.086674+0000","last_undegraded":"2024-04-20T12:23:07.086674+0000","last_fullsized":"2024-04-20T12:23:07.086674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:55.167376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216198+0000","last_change":"2024-04-20T12:20:42.040462+0000","last_active":"2024-04-20T12:23:07.216198+0000","last_peered":"2024-04-20T12:23:07.216198+0000","last_clean":"2024-04-20T12:23:07.216198+0000","last_became_active":"2024-04-20T12:20:42.040098+0000","last_became_peered":"2024-04-20T12:20:42.040098+0000","last_unstale":"2024-04-20T12:23:07.216198+0000","last_undegraded":"2024-04-20T12:23:07.216198+0000","last_fullsized":"2024-04-20T12:23:07.216198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:16.091488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216097+0000","last_change":"2024-04-20T12:22:38.007648+0000","last_active":"2024-04-20T12:23:07.216097+0000","last_peered":"2024-04-20T12:23:07.216097+0000","last_clean":"2024-04-20T12:23:07.216097+0000","last_became_active":"2024-04-20T12:22:38.007115+0000","last_became_peered":"2024-04-20T12:22:38.007115+0000","last_unstale":"2024-04-20T12:23:07.216097+0000","last_undegraded":"2024-04-20T12:23:07.216097+0000","last_fullsized":"2024-04-20T12:23:07.216097+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:37:37.683366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'12","reported_seq":33,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216447+0000","last_change":"2024-04-20T12:21:37.924962+0000","last_active":"2024-04-20T12:23:07.216447+0000","last_peered":"2024-04-20T12:23:07.216447+0000","last_clean":"2024-04-20T12:23:07.216447+0000","last_became_active":"2024-04-20T12:21:37.914275+0000","last_became_peered":"2024-04-20T12:21:37.914275+0000","last_unstale":"2024-04-20T12:23:07.216447+0000","last_undegraded":"2024-04-20T12:23:07.216447+0000","last_fullsized":"2024-04-20T12:23:07.216447+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:05.894889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216326+0000","last_change":"2024-04-20T12:20:42.029785+0000","last_active":"2024-04-20T12:23:07.216326+0000","last_peered":"2024-04-20T12:23:07.216326+0000","last_clean":"2024-04-20T12:23:07.216326+0000","last_became_active":"2024-04-20T12:20:42.029377+0000","last_became_peered":"2024-04-20T12:20:42.029377+0000","last_unstale":"2024-04-20T12:23:07.216326+0000","last_undegraded":"2024-04-20T12:23:07.216326+0000","last_fullsized":"2024-04-20T12:23:07.216326+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:22:52.429274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215910+0000","last_change":"2024-04-20T12:20:46.326552+0000","last_active":"2024-04-20T12:23:07.215910+0000","last_peered":"2024-04-20T12:23:07.215910+0000","last_clean":"2024-04-20T12:23:07.215910+0000","last_became_active":"2024-04-20T12:20:46.325573+0000","last_became_peered":"2024-04-20T12:20:46.325573+0000","last_unstale":"2024-04-20T12:23:07.215910+0000","last_undegraded":"2024-04-20T12:23:07.215910+0000","last_fullsized":"2024-04-20T12:23:07.215910+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:26:01.218141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"90'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.088150+0000","last_change":"2024-04-20T12:20:41.023884+0000","last_active":"2024-04-20T12:23:07.088150+0000","last_peered":"2024-04-20T12:23:07.088150+0000","last_clean":"2024-04-20T12:23:07.088150+0000","last_became_active":"2024-04-20T12:20:41.023496+0000","last_became_peered":"2024-04-20T12:20:41.023496+0000","last_unstale":"2024-04-20T12:23:07.088150+0000","last_undegraded":"2024-04-20T12:23:07.088150+0000","last_fullsized":"2024-04-20T12:23:07.088150+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:08.824928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":32,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.187759+0000","last_change":"2024-04-20T12:21:37.941552+0000","last_active":"2024-04-20T12:23:07.187759+0000","last_peered":"2024-04-20T12:23:07.187759+0000","last_clean":"2024-04-20T12:23:07.187759+0000","last_became_active":"2024-04-20T12:21:37.941228+0000","last_became_peered":"2024-04-20T12:21:37.941228+0000","last_unstale":"2024-04-20T12:23:07.187759+0000","last_undegraded":"2024-04-20T12:23:07.187759+0000","last_fullsized":"2024-04-20T12:23:07.187759+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:33.915039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216425+0000","last_change":"2024-04-20T12:20:46.324508+0000","last_active":"2024-04-20T12:23:07.216425+0000","last_peered":"2024-04-20T12:23:07.216425+0000","last_clean":"2024-04-20T12:23:07.216425+0000","last_became_active":"2024-04-20T12:20:46.324014+0000","last_became_peered":"2024-04-20T12:20:46.324014+0000","last_unstale":"2024-04-20T12:23:07.216425+0000","last_undegraded":"2024-04-20T12:23:07.216425+0000","last_fullsized":"2024-04-20T12:23:07.216425+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:17.765152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"95'7","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:08.048129+0000","last_change":"2024-04-20T12:21:37.927225+0000","last_active":"2024-04-20T12:23:08.048129+0000","last_peered":"2024-04-20T12:23:08.048129+0000","last_clean":"2024-04-20T12:23:08.048129+0000","last_became_active":"2024-04-20T12:21:37.911437+0000","last_became_peered":"2024-04-20T12:21:37.911437+0000","last_unstale":"2024-04-20T12:23:08.048129+0000","last_undegraded":"2024-04-20T12:23:08.048129+0000","last_fullsized":"2024-04-20T12:23:08.048129+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:08:14.576145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1404,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087776+0000","last_change":"2024-04-20T12:20:42.047403+0000","last_active":"2024-04-20T12:23:07.087776+0000","last_peered":"2024-04-20T12:23:07.087776+0000","last_clean":"2024-04-20T12:23:07.087776+0000","last_became_active":"2024-04-20T12:20:42.046240+0000","last_became_peered":"2024-04-20T12:20:42.046240+0000","last_unstale":"2024-04-20T12:23:07.087776+0000","last_undegraded":"2024-04-20T12:23:07.087776+0000","last_fullsized":"2024-04-20T12:23:07.087776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:21:40.410666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216108+0000","last_change":"2024-04-20T12:22:38.082510+0000","last_active":"2024-04-20T12:23:07.216108+0000","last_peered":"2024-04-20T12:23:07.216108+0000","last_clean":"2024-04-20T12:23:07.216108+0000","last_became_active":"2024-04-20T12:22:38.081953+0000","last_became_peered":"2024-04-20T12:22:38.081953+0000","last_unstale":"2024-04-20T12:23:07.216108+0000","last_undegraded":"2024-04-20T12:23:07.216108+0000","last_fullsized":"2024-04-20T12:23:07.216108+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:57:25.210260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087868+0000","last_change":"2024-04-20T12:20:41.027532+0000","last_active":"2024-04-20T12:23:07.087868+0000","last_peered":"2024-04-20T12:23:07.087868+0000","last_clean":"2024-04-20T12:23:07.087868+0000","last_became_active":"2024-04-20T12:20:41.027090+0000","last_became_peered":"2024-04-20T12:20:41.027090+0000","last_unstale":"2024-04-20T12:23:07.087868+0000","last_undegraded":"2024-04-20T12:23:07.087868+0000","last_fullsized":"2024-04-20T12:23:07.087868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:40:10.450305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196092+0000","last_change":"2024-04-20T12:21:37.912691+0000","last_active":"2024-04-20T12:23:07.196092+0000","last_peered":"2024-04-20T12:23:07.196092+0000","last_clean":"2024-04-20T12:23:07.196092+0000","last_became_active":"2024-04-20T12:21:37.912295+0000","last_became_peered":"2024-04-20T12:21:37.912295+0000","last_unstale":"2024-04-20T12:23:07.196092+0000","last_undegraded":"2024-04-20T12:23:07.196092+0000","last_fullsized":"2024-04-20T12:23:07.196092+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:48:04.501944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215972+0000","last_change":"2024-04-20T12:20:46.318633+0000","last_active":"2024-04-20T12:23:07.215972+0000","last_peered":"2024-04-20T12:23:07.215972+0000","last_clean":"2024-04-20T12:23:07.215972+0000","last_became_active":"2024-04-20T12:20:46.318215+0000","last_became_peered":"2024-04-20T12:20:46.318215+0000","last_unstale":"2024-04-20T12:23:07.215972+0000","last_undegraded":"2024-04-20T12:23:07.215972+0000","last_fullsized":"2024-04-20T12:23:07.215972+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:07:31.241287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'3","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.353126+0000","last_change":"2024-04-20T12:20:41.027009+0000","last_active":"2024-04-20T12:23:07.353126+0000","last_peered":"2024-04-20T12:23:07.353126+0000","last_clean":"2024-04-20T12:23:07.353126+0000","last_became_active":"2024-04-20T12:20:41.026683+0000","last_became_peered":"2024-04-20T12:20:41.026683+0000","last_unstale":"2024-04-20T12:23:07.353126+0000","last_undegraded":"2024-04-20T12:23:07.353126+0000","last_fullsized":"2024-04-20T12:23:07.353126+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:56:35.955635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086145+0000","last_change":"2024-04-20T12:20:42.030833+0000","last_active":"2024-04-20T12:23:07.086145+0000","last_peered":"2024-04-20T12:23:07.086145+0000","last_clean":"2024-04-20T12:23:07.086145+0000","last_became_active":"2024-04-20T12:20:42.030470+0000","last_became_peered":"2024-04-20T12:20:42.030470+0000","last_unstale":"2024-04-20T12:23:07.086145+0000","last_undegraded":"2024-04-20T12:23:07.086145+0000","last_fullsized":"2024-04-20T12:23:07.086145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:20:07.381222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216429+0000","last_change":"2024-04-20T12:20:46.327091+0000","last_active":"2024-04-20T12:23:07.216429+0000","last_peered":"2024-04-20T12:23:07.216429+0000","last_clean":"2024-04-20T12:23:07.216429+0000","last_became_active":"2024-04-20T12:20:46.326663+0000","last_became_peered":"2024-04-20T12:20:46.326663+0000","last_unstale":"2024-04-20T12:23:07.216429+0000","last_undegraded":"2024-04-20T12:23:07.216429+0000","last_fullsized":"2024-04-20T12:23:07.216429+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:37:31.968946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'3","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.195825+0000","last_change":"2024-04-20T12:20:41.028908+0000","last_active":"2024-04-20T12:23:07.195825+0000","last_peered":"2024-04-20T12:23:07.195825+0000","last_clean":"2024-04-20T12:23:07.195825+0000","last_became_active":"2024-04-20T12:20:41.028570+0000","last_became_peered":"2024-04-20T12:20:41.028570+0000","last_unstale":"2024-04-20T12:23:07.195825+0000","last_undegraded":"2024-04-20T12:23:07.195825+0000","last_fullsized":"2024-04-20T12:23:07.195825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:39:27.309249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.187437+0000","last_change":"2024-04-20T12:20:42.028802+0000","last_active":"2024-04-20T12:23:07.187437+0000","last_peered":"2024-04-20T12:23:07.187437+0000","last_clean":"2024-04-20T12:23:07.187437+0000","last_became_active":"2024-04-20T12:20:42.028458+0000","last_became_peered":"2024-04-20T12:20:42.028458+0000","last_unstale":"2024-04-20T12:23:07.187437+0000","last_undegraded":"2024-04-20T12:23:07.187437+0000","last_fullsized":"2024-04-20T12:23:07.187437+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:59:28.284954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086291+0000","last_change":"2024-04-20T12:20:46.331055+0000","last_active":"2024-04-20T12:23:07.086291+0000","last_peered":"2024-04-20T12:23:07.086291+0000","last_clean":"2024-04-20T12:23:07.086291+0000","last_became_active":"2024-04-20T12:20:46.330181+0000","last_became_peered":"2024-04-20T12:20:46.330181+0000","last_unstale":"2024-04-20T12:23:07.086291+0000","last_undegraded":"2024-04-20T12:23:07.086291+0000","last_fullsized":"2024-04-20T12:23:07.086291+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:27.430141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"95'6","reported_seq":282,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:08.047687+0000","last_change":"2024-04-20T12:20:41.025859+0000","last_active":"2024-04-20T12:23:08.047687+0000","last_peered":"2024-04-20T12:23:08.047687+0000","last_clean":"2024-04-20T12:23:08.047687+0000","last_became_active":"2024-04-20T12:20:41.025443+0000","last_became_peered":"2024-04-20T12:20:41.025443+0000","last_unstale":"2024-04-20T12:23:08.047687+0000","last_undegraded":"2024-04-20T12:23:08.047687+0000","last_fullsized":"2024-04-20T12:23:08.047687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:11:28.100797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216219+0000","last_change":"2024-04-20T12:20:42.028510+0000","last_active":"2024-04-20T12:23:07.216219+0000","last_peered":"2024-04-20T12:23:07.216219+0000","last_clean":"2024-04-20T12:23:07.216219+0000","last_became_active":"2024-04-20T12:20:42.028176+0000","last_became_peered":"2024-04-20T12:20:42.028176+0000","last_unstale":"2024-04-20T12:23:07.216219+0000","last_undegraded":"2024-04-20T12:23:07.216219+0000","last_fullsized":"2024-04-20T12:23:07.216219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:49:44.606154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.187328+0000","last_change":"2024-04-20T12:20:46.327813+0000","last_active":"2024-04-20T12:23:07.187328+0000","last_peered":"2024-04-20T12:23:07.187328+0000","last_clean":"2024-04-20T12:23:07.187328+0000","last_became_active":"2024-04-20T12:20:46.327446+0000","last_became_peered":"2024-04-20T12:20:46.327446+0000","last_unstale":"2024-04-20T12:23:07.187328+0000","last_undegraded":"2024-04-20T12:23:07.187328+0000","last_fullsized":"2024-04-20T12:23:07.187328+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:30:23.990693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216702+0000","last_change":"2024-04-20T12:20:41.027748+0000","last_active":"2024-04-20T12:23:07.216702+0000","last_peered":"2024-04-20T12:23:07.216702+0000","last_clean":"2024-04-20T12:23:07.216702+0000","last_became_active":"2024-04-20T12:20:41.027400+0000","last_became_peered":"2024-04-20T12:20:41.027400+0000","last_unstale":"2024-04-20T12:23:07.216702+0000","last_undegraded":"2024-04-20T12:23:07.216702+0000","last_fullsized":"2024-04-20T12:23:07.216702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:27:50.008057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216926+0000","last_change":"2024-04-20T12:21:37.912851+0000","last_active":"2024-04-20T12:23:07.216926+0000","last_peered":"2024-04-20T12:23:07.216926+0000","last_clean":"2024-04-20T12:23:07.216926+0000","last_became_active":"2024-04-20T12:21:37.912487+0000","last_became_peered":"2024-04-20T12:21:37.912487+0000","last_unstale":"2024-04-20T12:23:07.216926+0000","last_undegraded":"2024-04-20T12:23:07.216926+0000","last_fullsized":"2024-04-20T12:23:07.216926+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:09:49.568654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216501+0000","last_change":"2024-04-20T12:20:46.326239+0000","last_active":"2024-04-20T12:23:07.216501+0000","last_peered":"2024-04-20T12:23:07.216501+0000","last_clean":"2024-04-20T12:23:07.216501+0000","last_became_active":"2024-04-20T12:20:46.325830+0000","last_became_peered":"2024-04-20T12:20:46.325830+0000","last_unstale":"2024-04-20T12:23:07.216501+0000","last_undegraded":"2024-04-20T12:23:07.216501+0000","last_fullsized":"2024-04-20T12:23:07.216501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:07.311396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'5","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196154+0000","last_change":"2024-04-20T12:20:41.024662+0000","last_active":"2024-04-20T12:23:07.196154+0000","last_peered":"2024-04-20T12:23:07.196154+0000","last_clean":"2024-04-20T12:23:07.196154+0000","last_became_active":"2024-04-20T12:20:41.024327+0000","last_became_peered":"2024-04-20T12:20:41.024327+0000","last_unstale":"2024-04-20T12:23:07.196154+0000","last_undegraded":"2024-04-20T12:23:07.196154+0000","last_fullsized":"2024-04-20T12:23:07.196154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:07.079126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216596+0000","last_change":"2024-04-20T12:20:42.031910+0000","last_active":"2024-04-20T12:23:07.216596+0000","last_peered":"2024-04-20T12:23:07.216596+0000","last_clean":"2024-04-20T12:23:07.216596+0000","last_became_active":"2024-04-20T12:20:42.031600+0000","last_became_peered":"2024-04-20T12:20:42.031600+0000","last_unstale":"2024-04-20T12:23:07.216596+0000","last_undegraded":"2024-04-20T12:23:07.216596+0000","last_fullsized":"2024-04-20T12:23:07.216596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:23:56.448246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087465+0000","last_change":"2024-04-20T12:21:37.911484+0000","last_active":"2024-04-20T12:23:07.087465+0000","last_peered":"2024-04-20T12:23:07.087465+0000","last_clean":"2024-04-20T12:23:07.087465+0000","last_became_active":"2024-04-20T12:21:37.911069+0000","last_became_peered":"2024-04-20T12:21:37.911069+0000","last_unstale":"2024-04-20T12:23:07.087465+0000","last_undegraded":"2024-04-20T12:23:07.087465+0000","last_fullsized":"2024-04-20T12:23:07.087465+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:58:54.938004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,5],"acting":[10,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.14","version":"95'42","reported_seq":329,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:08.048902+0000","last_change":"2024-04-20T12:20:41.024722+0000","last_active":"2024-04-20T12:23:08.048902+0000","last_peered":"2024-04-20T12:23:08.048902+0000","last_clean":"2024-04-20T12:23:08.048902+0000","last_became_active":"2024-04-20T12:20:41.024150+0000","last_became_peered":"2024-04-20T12:20:41.024150+0000","last_unstale":"2024-04-20T12:23:08.048902+0000","last_undegraded":"2024-04-20T12:23:08.048902+0000","last_fullsized":"2024-04-20T12:23:08.048902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T00:14:49.622937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70068,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":251,"num_read_kb":195,"num_write":44,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.088143+0000","last_change":"2024-04-20T12:20:42.037589+0000","last_active":"2024-04-20T12:23:07.088143+0000","last_peered":"2024-04-20T12:23:07.088143+0000","last_clean":"2024-04-20T12:23:07.088143+0000","last_became_active":"2024-04-20T12:20:42.037256+0000","last_became_peered":"2024-04-20T12:20:42.037256+0000","last_unstale":"2024-04-20T12:23:07.088143+0000","last_undegraded":"2024-04-20T12:23:07.088143+0000","last_fullsized":"2024-04-20T12:23:07.088143+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:25.966289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196417+0000","last_change":"2024-04-20T12:20:46.326476+0000","last_active":"2024-04-20T12:23:07.196417+0000","last_peered":"2024-04-20T12:23:07.196417+0000","last_clean":"2024-04-20T12:23:07.196417+0000","last_became_active":"2024-04-20T12:20:46.326085+0000","last_became_peered":"2024-04-20T12:20:46.326085+0000","last_unstale":"2024-04-20T12:23:07.196417+0000","last_undegraded":"2024-04-20T12:23:07.196417+0000","last_fullsized":"2024-04-20T12:23:07.196417+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:34:15.608820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'9","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215928+0000","last_change":"2024-04-20T12:20:41.028360+0000","last_active":"2024-04-20T12:23:07.215928+0000","last_peered":"2024-04-20T12:23:07.215928+0000","last_clean":"2024-04-20T12:23:07.215928+0000","last_became_active":"2024-04-20T12:20:41.028057+0000","last_became_peered":"2024-04-20T12:20:41.028057+0000","last_unstale":"2024-04-20T12:23:07.215928+0000","last_undegraded":"2024-04-20T12:23:07.215928+0000","last_fullsized":"2024-04-20T12:23:07.215928+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:30:49.699051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.353468+0000","last_change":"2024-04-20T12:21:37.912138+0000","last_active":"2024-04-20T12:23:07.353468+0000","last_peered":"2024-04-20T12:23:07.353468+0000","last_clean":"2024-04-20T12:23:07.353468+0000","last_became_active":"2024-04-20T12:21:37.911774+0000","last_became_peered":"2024-04-20T12:21:37.911774+0000","last_unstale":"2024-04-20T12:23:07.353468+0000","last_undegraded":"2024-04-20T12:23:07.353468+0000","last_fullsized":"2024-04-20T12:23:07.353468+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:41:34.250785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215847+0000","last_change":"2024-04-20T12:20:46.328605+0000","last_active":"2024-04-20T12:23:07.215847+0000","last_peered":"2024-04-20T12:23:07.215847+0000","last_clean":"2024-04-20T12:23:07.215847+0000","last_became_active":"2024-04-20T12:20:46.328091+0000","last_became_peered":"2024-04-20T12:20:46.328091+0000","last_unstale":"2024-04-20T12:23:07.215847+0000","last_undegraded":"2024-04-20T12:23:07.215847+0000","last_fullsized":"2024-04-20T12:23:07.215847+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:21:12.908696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'5","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196057+0000","last_change":"2024-04-20T12:20:41.028149+0000","last_active":"2024-04-20T12:23:07.196057+0000","last_peered":"2024-04-20T12:23:07.196057+0000","last_clean":"2024-04-20T12:23:07.196057+0000","last_became_active":"2024-04-20T12:20:41.027784+0000","last_became_peered":"2024-04-20T12:20:41.027784+0000","last_unstale":"2024-04-20T12:23:07.196057+0000","last_undegraded":"2024-04-20T12:23:07.196057+0000","last_fullsized":"2024-04-20T12:23:07.196057+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:45:31.227275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217137+0000","last_change":"2024-04-20T12:20:42.030961+0000","last_active":"2024-04-20T12:23:07.217137+0000","last_peered":"2024-04-20T12:23:07.217137+0000","last_clean":"2024-04-20T12:23:07.217137+0000","last_became_active":"2024-04-20T12:20:42.030597+0000","last_became_peered":"2024-04-20T12:20:42.030597+0000","last_unstale":"2024-04-20T12:23:07.217137+0000","last_undegraded":"2024-04-20T12:23:07.217137+0000","last_fullsized":"2024-04-20T12:23:07.217137+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:59:29.679840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.188312+0000","last_change":"2024-04-20T12:20:46.327034+0000","last_active":"2024-04-20T12:23:07.188312+0000","last_peered":"2024-04-20T12:23:07.188312+0000","last_clean":"2024-04-20T12:23:07.188312+0000","last_became_active":"2024-04-20T12:20:46.325107+0000","last_became_peered":"2024-04-20T12:20:46.325107+0000","last_unstale":"2024-04-20T12:23:07.188312+0000","last_undegraded":"2024-04-20T12:23:07.188312+0000","last_fullsized":"2024-04-20T12:23:07.188312+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:44:04.924677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"95'7","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.511321+0000","last_change":"2024-04-20T12:20:41.020878+0000","last_active":"2024-04-20T12:23:07.511321+0000","last_peered":"2024-04-20T12:23:07.511321+0000","last_clean":"2024-04-20T12:23:07.511321+0000","last_became_active":"2024-04-20T12:20:41.020503+0000","last_became_peered":"2024-04-20T12:20:41.020503+0000","last_unstale":"2024-04-20T12:23:07.511321+0000","last_undegraded":"2024-04-20T12:23:07.511321+0000","last_fullsized":"2024-04-20T12:23:07.511321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:59:00.555136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1287,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217353+0000","last_change":"2024-04-20T12:20:42.039699+0000","last_active":"2024-04-20T12:23:07.217353+0000","last_peered":"2024-04-20T12:23:07.217353+0000","last_clean":"2024-04-20T12:23:07.217353+0000","last_became_active":"2024-04-20T12:20:42.039384+0000","last_became_peered":"2024-04-20T12:20:42.039384+0000","last_unstale":"2024-04-20T12:23:07.217353+0000","last_undegraded":"2024-04-20T12:23:07.217353+0000","last_fullsized":"2024-04-20T12:23:07.217353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:45:41.056018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.354238+0000","last_change":"2024-04-20T12:20:46.333294+0000","last_active":"2024-04-20T12:23:07.354238+0000","last_peered":"2024-04-20T12:23:07.354238+0000","last_clean":"2024-04-20T12:23:07.354238+0000","last_became_active":"2024-04-20T12:20:46.332887+0000","last_became_peered":"2024-04-20T12:20:46.332887+0000","last_unstale":"2024-04-20T12:23:07.354238+0000","last_undegraded":"2024-04-20T12:23:07.354238+0000","last_fullsized":"2024-04-20T12:23:07.354238+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:10.686220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'17","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087716+0000","last_change":"2024-04-20T12:20:41.027313+0000","last_active":"2024-04-20T12:23:07.087716+0000","last_peered":"2024-04-20T12:23:07.087716+0000","last_clean":"2024-04-20T12:23:07.087716+0000","last_became_active":"2024-04-20T12:20:41.026980+0000","last_became_peered":"2024-04-20T12:20:41.026980+0000","last_unstale":"2024-04-20T12:23:07.087716+0000","last_undegraded":"2024-04-20T12:23:07.087716+0000","last_fullsized":"2024-04-20T12:23:07.087716+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:12.692075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196031+0000","last_change":"2024-04-20T12:20:42.027807+0000","last_active":"2024-04-20T12:23:07.196031+0000","last_peered":"2024-04-20T12:23:07.196031+0000","last_clean":"2024-04-20T12:23:07.196031+0000","last_became_active":"2024-04-20T12:20:42.027468+0000","last_became_peered":"2024-04-20T12:20:42.027468+0000","last_unstale":"2024-04-20T12:23:07.196031+0000","last_undegraded":"2024-04-20T12:23:07.196031+0000","last_fullsized":"2024-04-20T12:23:07.196031+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:51.924249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.195863+0000","last_change":"2024-04-20T12:20:46.324164+0000","last_active":"2024-04-20T12:23:07.195863+0000","last_peered":"2024-04-20T12:23:07.195863+0000","last_clean":"2024-04-20T12:23:07.195863+0000","last_became_active":"2024-04-20T12:20:46.323651+0000","last_became_peered":"2024-04-20T12:20:46.323651+0000","last_unstale":"2024-04-20T12:23:07.195863+0000","last_undegraded":"2024-04-20T12:23:07.195863+0000","last_fullsized":"2024-04-20T12:23:07.195863+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:07:54.429586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.088316+0000","last_change":"2024-04-20T12:20:41.023999+0000","last_active":"2024-04-20T12:23:07.088316+0000","last_peered":"2024-04-20T12:23:07.088316+0000","last_clean":"2024-04-20T12:23:07.088316+0000","last_became_active":"2024-04-20T12:20:41.023440+0000","last_became_peered":"2024-04-20T12:20:41.023440+0000","last_unstale":"2024-04-20T12:23:07.088316+0000","last_undegraded":"2024-04-20T12:23:07.088316+0000","last_fullsized":"2024-04-20T12:23:07.088316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:13:18.493395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215938+0000","last_change":"2024-04-20T12:20:42.036718+0000","last_active":"2024-04-20T12:23:07.215938+0000","last_peered":"2024-04-20T12:23:07.215938+0000","last_clean":"2024-04-20T12:23:07.215938+0000","last_became_active":"2024-04-20T12:20:42.036305+0000","last_became_peered":"2024-04-20T12:20:42.036305+0000","last_unstale":"2024-04-20T12:23:07.215938+0000","last_undegraded":"2024-04-20T12:23:07.215938+0000","last_fullsized":"2024-04-20T12:23:07.215938+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:14.462345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087768+0000","last_change":"2024-04-20T12:20:46.930437+0000","last_active":"2024-04-20T12:23:07.087768+0000","last_peered":"2024-04-20T12:23:07.087768+0000","last_clean":"2024-04-20T12:23:07.087768+0000","last_became_active":"2024-04-20T12:20:46.929882+0000","last_became_peered":"2024-04-20T12:20:46.929882+0000","last_unstale":"2024-04-20T12:23:07.087768+0000","last_undegraded":"2024-04-20T12:23:07.087768+0000","last_fullsized":"2024-04-20T12:23:07.087768+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:56.540256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"90'1","reported_seq":37,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.187733+0000","last_change":"2024-04-20T12:20:41.023584+0000","last_active":"2024-04-20T12:23:07.187733+0000","last_peered":"2024-04-20T12:23:07.187733+0000","last_clean":"2024-04-20T12:23:07.187733+0000","last_became_active":"2024-04-20T12:20:41.023249+0000","last_became_peered":"2024-04-20T12:20:41.023249+0000","last_unstale":"2024-04-20T12:23:07.187733+0000","last_undegraded":"2024-04-20T12:23:07.187733+0000","last_fullsized":"2024-04-20T12:23:07.187733+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:18:06.704703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'4","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087908+0000","last_change":"2024-04-20T12:20:42.041424+0000","last_active":"2024-04-20T12:23:07.087908+0000","last_peered":"2024-04-20T12:23:07.087908+0000","last_clean":"2024-04-20T12:23:07.087908+0000","last_became_active":"2024-04-20T12:20:42.040231+0000","last_became_peered":"2024-04-20T12:20:42.040231+0000","last_unstale":"2024-04-20T12:23:07.087908+0000","last_undegraded":"2024-04-20T12:23:07.087908+0000","last_fullsized":"2024-04-20T12:23:07.087908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:29.523746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.353974+0000","last_change":"2024-04-20T12:20:46.326852+0000","last_active":"2024-04-20T12:23:07.353974+0000","last_peered":"2024-04-20T12:23:07.353974+0000","last_clean":"2024-04-20T12:23:07.353974+0000","last_became_active":"2024-04-20T12:20:46.326398+0000","last_became_peered":"2024-04-20T12:20:46.326398+0000","last_unstale":"2024-04-20T12:23:07.353974+0000","last_undegraded":"2024-04-20T12:23:07.353974+0000","last_fullsized":"2024-04-20T12:23:07.353974+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:00:33.076429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"95'7","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.509906+0000","last_change":"2024-04-20T12:20:41.032542+0000","last_active":"2024-04-20T12:23:07.509906+0000","last_peered":"2024-04-20T12:23:07.509906+0000","last_clean":"2024-04-20T12:23:07.509906+0000","last_became_active":"2024-04-20T12:20:41.032048+0000","last_became_peered":"2024-04-20T12:20:41.032048+0000","last_unstale":"2024-04-20T12:23:07.509906+0000","last_undegraded":"2024-04-20T12:23:07.509906+0000","last_fullsized":"2024-04-20T12:23:07.509906+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:16:35.515446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1370,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087596+0000","last_change":"2024-04-20T12:20:42.034006+0000","last_active":"2024-04-20T12:23:07.087596+0000","last_peered":"2024-04-20T12:23:07.087596+0000","last_clean":"2024-04-20T12:23:07.087596+0000","last_became_active":"2024-04-20T12:20:42.033639+0000","last_became_peered":"2024-04-20T12:20:42.033639+0000","last_unstale":"2024-04-20T12:23:07.087596+0000","last_undegraded":"2024-04-20T12:23:07.087596+0000","last_fullsized":"2024-04-20T12:23:07.087596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:39:27.435103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.354385+0000","last_change":"2024-04-20T12:20:46.930253+0000","last_active":"2024-04-20T12:23:07.354385+0000","last_peered":"2024-04-20T12:23:07.354385+0000","last_clean":"2024-04-20T12:23:07.354385+0000","last_became_active":"2024-04-20T12:20:46.929806+0000","last_became_peered":"2024-04-20T12:20:46.929806+0000","last_unstale":"2024-04-20T12:23:07.354385+0000","last_undegraded":"2024-04-20T12:23:07.354385+0000","last_fullsized":"2024-04-20T12:23:07.354385+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:23:55.085024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.196120+0000","last_change":"2024-04-20T12:20:42.031231+0000","last_active":"2024-04-20T12:23:07.196120+0000","last_peered":"2024-04-20T12:23:07.196120+0000","last_clean":"2024-04-20T12:23:07.196120+0000","last_became_active":"2024-04-20T12:20:42.030920+0000","last_became_peered":"2024-04-20T12:20:42.030920+0000","last_unstale":"2024-04-20T12:23:07.196120+0000","last_undegraded":"2024-04-20T12:23:07.196120+0000","last_fullsized":"2024-04-20T12:23:07.196120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:35:14.631696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"94'6","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.353016+0000","last_change":"2024-04-20T12:20:41.030703+0000","last_active":"2024-04-20T12:23:07.353016+0000","last_peered":"2024-04-20T12:23:07.353016+0000","last_clean":"2024-04-20T12:23:07.353016+0000","last_became_active":"2024-04-20T12:20:41.030400+0000","last_became_peered":"2024-04-20T12:20:41.030400+0000","last_unstale":"2024-04-20T12:23:07.353016+0000","last_undegraded":"2024-04-20T12:23:07.353016+0000","last_fullsized":"2024-04-20T12:23:07.353016+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:46:07.845022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":121,"num_read_kb":121,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216517+0000","last_change":"2024-04-20T12:20:46.322872+0000","last_active":"2024-04-20T12:23:07.216517+0000","last_peered":"2024-04-20T12:23:07.216517+0000","last_clean":"2024-04-20T12:23:07.216517+0000","last_became_active":"2024-04-20T12:20:46.322440+0000","last_became_peered":"2024-04-20T12:20:46.322440+0000","last_unstale":"2024-04-20T12:23:07.216517+0000","last_undegraded":"2024-04-20T12:23:07.216517+0000","last_fullsized":"2024-04-20T12:23:07.216517+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:24:02.010584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086138+0000","last_change":"2024-04-20T12:20:42.041895+0000","last_active":"2024-04-20T12:23:07.086138+0000","last_peered":"2024-04-20T12:23:07.086138+0000","last_clean":"2024-04-20T12:23:07.086138+0000","last_became_active":"2024-04-20T12:20:42.040451+0000","last_became_peered":"2024-04-20T12:20:42.040451+0000","last_unstale":"2024-04-20T12:23:07.086138+0000","last_undegraded":"2024-04-20T12:23:07.086138+0000","last_fullsized":"2024-04-20T12:23:07.086138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:17.711581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'6","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216193+0000","last_change":"2024-04-20T12:20:41.020656+0000","last_active":"2024-04-20T12:23:07.216193+0000","last_peered":"2024-04-20T12:23:07.216193+0000","last_clean":"2024-04-20T12:23:07.216193+0000","last_became_active":"2024-04-20T12:20:41.020226+0000","last_became_peered":"2024-04-20T12:20:41.020226+0000","last_unstale":"2024-04-20T12:23:07.216193+0000","last_undegraded":"2024-04-20T12:23:07.216193+0000","last_fullsized":"2024-04-20T12:23:07.216193+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:21:03.446920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":370,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217015+0000","last_change":"2024-04-20T12:19:29.284050+0000","last_active":"2024-04-20T12:23:07.217015+0000","last_peered":"2024-04-20T12:23:07.217015+0000","last_clean":"2024-04-20T12:23:07.217015+0000","last_became_active":"2024-04-20T12:19:29.283508+0000","last_became_peered":"2024-04-20T12:19:29.283508+0000","last_unstale":"2024-04-20T12:23:07.217015+0000","last_undegraded":"2024-04-20T12:23:07.217015+0000","last_fullsized":"2024-04-20T12:23:07.217015+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:16:03.444995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:16:03.444995+0000","last_clean_scrub_stamp":"2024-04-20T12:16:03.444995+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:28:39.268704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.088086+0000","last_change":"2024-04-20T12:22:38.089431+0000","last_active":"2024-04-20T12:23:07.088086+0000","last_peered":"2024-04-20T12:23:07.088086+0000","last_clean":"2024-04-20T12:23:07.088086+0000","last_became_active":"2024-04-20T12:22:38.089034+0000","last_became_peered":"2024-04-20T12:22:38.089034+0000","last_unstale":"2024-04-20T12:23:07.088086+0000","last_undegraded":"2024-04-20T12:23:07.088086+0000","last_fullsized":"2024-04-20T12:23:07.088086+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:53:00.078160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.352835+0000","last_change":"2024-04-20T12:20:42.030739+0000","last_active":"2024-04-20T12:23:07.352835+0000","last_peered":"2024-04-20T12:23:07.352835+0000","last_clean":"2024-04-20T12:23:07.352835+0000","last_became_active":"2024-04-20T12:20:42.030440+0000","last_became_peered":"2024-04-20T12:20:42.030440+0000","last_unstale":"2024-04-20T12:23:07.352835+0000","last_undegraded":"2024-04-20T12:23:07.352835+0000","last_fullsized":"2024-04-20T12:23:07.352835+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:44:39.311317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'4","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217147+0000","last_change":"2024-04-20T12:20:41.029967+0000","last_active":"2024-04-20T12:23:07.217147+0000","last_peered":"2024-04-20T12:23:07.217147+0000","last_clean":"2024-04-20T12:23:07.217147+0000","last_became_active":"2024-04-20T12:20:41.029618+0000","last_became_peered":"2024-04-20T12:20:41.029618+0000","last_unstale":"2024-04-20T12:23:07.217147+0000","last_undegraded":"2024-04-20T12:23:07.217147+0000","last_fullsized":"2024-04-20T12:23:07.217147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:37:48.762751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215840+0000","last_change":"2024-04-20T12:20:46.327782+0000","last_active":"2024-04-20T12:23:07.215840+0000","last_peered":"2024-04-20T12:23:07.215840+0000","last_clean":"2024-04-20T12:23:07.215840+0000","last_became_active":"2024-04-20T12:20:46.325462+0000","last_became_peered":"2024-04-20T12:20:46.325462+0000","last_unstale":"2024-04-20T12:23:07.215840+0000","last_undegraded":"2024-04-20T12:23:07.215840+0000","last_fullsized":"2024-04-20T12:23:07.215840+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:41.792496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'4","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.088129+0000","last_change":"2024-04-20T12:20:41.025454+0000","last_active":"2024-04-20T12:23:07.088129+0000","last_peered":"2024-04-20T12:23:07.088129+0000","last_clean":"2024-04-20T12:23:07.088129+0000","last_became_active":"2024-04-20T12:20:41.025121+0000","last_became_peered":"2024-04-20T12:20:41.025121+0000","last_unstale":"2024-04-20T12:23:07.088129+0000","last_undegraded":"2024-04-20T12:23:07.088129+0000","last_fullsized":"2024-04-20T12:23:07.088129+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:57:14.662567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.354075+0000","last_change":"2024-04-20T12:20:42.038483+0000","last_active":"2024-04-20T12:23:07.354075+0000","last_peered":"2024-04-20T12:23:07.354075+0000","last_clean":"2024-04-20T12:23:07.354075+0000","last_became_active":"2024-04-20T12:20:42.037626+0000","last_became_peered":"2024-04-20T12:20:42.037626+0000","last_unstale":"2024-04-20T12:23:07.354075+0000","last_undegraded":"2024-04-20T12:23:07.354075+0000","last_fullsized":"2024-04-20T12:23:07.354075+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:11:27.520320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086078+0000","last_change":"2024-04-20T12:20:46.930331+0000","last_active":"2024-04-20T12:23:07.086078+0000","last_peered":"2024-04-20T12:23:07.086078+0000","last_clean":"2024-04-20T12:23:07.086078+0000","last_became_active":"2024-04-20T12:20:46.929816+0000","last_became_peered":"2024-04-20T12:20:46.929816+0000","last_unstale":"2024-04-20T12:23:07.086078+0000","last_undegraded":"2024-04-20T12:23:07.086078+0000","last_fullsized":"2024-04-20T12:23:07.086078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:42:18.148443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"95'48","reported_seq":107,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.309867+0000","last_change":"2024-04-20T12:20:41.022365+0000","last_active":"2024-04-20T12:23:07.309867+0000","last_peered":"2024-04-20T12:23:07.309867+0000","last_clean":"2024-04-20T12:23:07.309867+0000","last_became_active":"2024-04-20T12:20:41.022028+0000","last_became_peered":"2024-04-20T12:20:41.022028+0000","last_unstale":"2024-04-20T12:23:07.309867+0000","last_undegraded":"2024-04-20T12:23:07.309867+0000","last_fullsized":"2024-04-20T12:23:07.309867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:16.436008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":84,"num_write_kb":836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086487+0000","last_change":"2024-04-20T12:20:42.031833+0000","last_active":"2024-04-20T12:23:07.086487+0000","last_peered":"2024-04-20T12:23:07.086487+0000","last_clean":"2024-04-20T12:23:07.086487+0000","last_became_active":"2024-04-20T12:20:42.031535+0000","last_became_peered":"2024-04-20T12:20:42.031535+0000","last_unstale":"2024-04-20T12:23:07.086487+0000","last_undegraded":"2024-04-20T12:23:07.086487+0000","last_fullsized":"2024-04-20T12:23:07.086487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:39:38.955662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215412+0000","last_change":"2024-04-20T12:20:46.319218+0000","last_active":"2024-04-20T12:23:07.215412+0000","last_peered":"2024-04-20T12:23:07.215412+0000","last_clean":"2024-04-20T12:23:07.215412+0000","last_became_active":"2024-04-20T12:20:46.318822+0000","last_became_peered":"2024-04-20T12:20:46.318822+0000","last_unstale":"2024-04-20T12:23:07.215412+0000","last_undegraded":"2024-04-20T12:23:07.215412+0000","last_fullsized":"2024-04-20T12:23:07.215412+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:19:16.907942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'7","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216386+0000","last_change":"2024-04-20T12:20:41.035984+0000","last_active":"2024-04-20T12:23:07.216386+0000","last_peered":"2024-04-20T12:23:07.216386+0000","last_clean":"2024-04-20T12:23:07.216386+0000","last_became_active":"2024-04-20T12:20:41.035594+0000","last_became_peered":"2024-04-20T12:20:41.035594+0000","last_unstale":"2024-04-20T12:23:07.216386+0000","last_undegraded":"2024-04-20T12:23:07.216386+0000","last_fullsized":"2024-04-20T12:23:07.216386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:15.549551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216452+0000","last_change":"2024-04-20T12:20:42.032156+0000","last_active":"2024-04-20T12:23:07.216452+0000","last_peered":"2024-04-20T12:23:07.216452+0000","last_clean":"2024-04-20T12:23:07.216452+0000","last_became_active":"2024-04-20T12:20:42.031779+0000","last_became_peered":"2024-04-20T12:20:42.031779+0000","last_unstale":"2024-04-20T12:23:07.216452+0000","last_undegraded":"2024-04-20T12:23:07.216452+0000","last_fullsized":"2024-04-20T12:23:07.216452+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:43:48.156406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216036+0000","last_change":"2024-04-20T12:20:46.931229+0000","last_active":"2024-04-20T12:23:07.216036+0000","last_peered":"2024-04-20T12:23:07.216036+0000","last_clean":"2024-04-20T12:23:07.216036+0000","last_became_active":"2024-04-20T12:20:46.930677+0000","last_became_peered":"2024-04-20T12:20:46.930677+0000","last_unstale":"2024-04-20T12:23:07.216036+0000","last_undegraded":"2024-04-20T12:23:07.216036+0000","last_fullsized":"2024-04-20T12:23:07.216036+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:54.933944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215852+0000","last_change":"2024-04-20T12:20:41.023789+0000","last_active":"2024-04-20T12:23:07.215852+0000","last_peered":"2024-04-20T12:23:07.215852+0000","last_clean":"2024-04-20T12:23:07.215852+0000","last_became_active":"2024-04-20T12:20:41.023329+0000","last_became_peered":"2024-04-20T12:20:41.023329+0000","last_unstale":"2024-04-20T12:23:07.215852+0000","last_undegraded":"2024-04-20T12:23:07.215852+0000","last_fullsized":"2024-04-20T12:23:07.215852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:02:17.634230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087648+0000","last_change":"2024-04-20T12:20:42.028708+0000","last_active":"2024-04-20T12:23:07.087648+0000","last_peered":"2024-04-20T12:23:07.087648+0000","last_clean":"2024-04-20T12:23:07.087648+0000","last_became_active":"2024-04-20T12:20:42.028358+0000","last_became_peered":"2024-04-20T12:20:42.028358+0000","last_unstale":"2024-04-20T12:23:07.087648+0000","last_undegraded":"2024-04-20T12:23:07.087648+0000","last_fullsized":"2024-04-20T12:23:07.087648+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:21:58.583709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.188431+0000","last_change":"2024-04-20T12:20:46.329173+0000","last_active":"2024-04-20T12:23:07.188431+0000","last_peered":"2024-04-20T12:23:07.188431+0000","last_clean":"2024-04-20T12:23:07.188431+0000","last_became_active":"2024-04-20T12:20:46.328771+0000","last_became_peered":"2024-04-20T12:20:46.328771+0000","last_unstale":"2024-04-20T12:23:07.188431+0000","last_undegraded":"2024-04-20T12:23:07.188431+0000","last_fullsized":"2024-04-20T12:23:07.188431+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:43:57.796849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'7","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086001+0000","last_change":"2024-04-20T12:20:41.030389+0000","last_active":"2024-04-20T12:23:07.086001+0000","last_peered":"2024-04-20T12:23:07.086001+0000","last_clean":"2024-04-20T12:23:07.086001+0000","last_became_active":"2024-04-20T12:20:41.029864+0000","last_became_peered":"2024-04-20T12:20:41.029864+0000","last_unstale":"2024-04-20T12:23:07.086001+0000","last_undegraded":"2024-04-20T12:23:07.086001+0000","last_fullsized":"2024-04-20T12:23:07.086001+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:01:13.513853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215706+0000","last_change":"2024-04-20T12:20:42.032322+0000","last_active":"2024-04-20T12:23:07.215706+0000","last_peered":"2024-04-20T12:23:07.215706+0000","last_clean":"2024-04-20T12:23:07.215706+0000","last_became_active":"2024-04-20T12:20:42.031973+0000","last_became_peered":"2024-04-20T12:20:42.031973+0000","last_unstale":"2024-04-20T12:23:07.215706+0000","last_undegraded":"2024-04-20T12:23:07.215706+0000","last_fullsized":"2024-04-20T12:23:07.215706+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:44:17.135478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":29,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216033+0000","last_change":"2024-04-20T12:20:46.321909+0000","last_active":"2024-04-20T12:23:07.216033+0000","last_peered":"2024-04-20T12:23:07.216033+0000","last_clean":"2024-04-20T12:23:07.216033+0000","last_became_active":"2024-04-20T12:20:46.321273+0000","last_became_peered":"2024-04-20T12:20:46.321273+0000","last_unstale":"2024-04-20T12:23:07.216033+0000","last_undegraded":"2024-04-20T12:23:07.216033+0000","last_fullsized":"2024-04-20T12:23:07.216033+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:58:18.429052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"95'4","reported_seq":26,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216473+0000","last_change":"2024-04-20T12:21:37.947242+0000","last_active":"2024-04-20T12:23:07.216473+0000","last_peered":"2024-04-20T12:23:07.216473+0000","last_clean":"2024-04-20T12:23:07.216473+0000","last_became_active":"2024-04-20T12:21:37.941542+0000","last_became_peered":"2024-04-20T12:21:37.941542+0000","last_unstale":"2024-04-20T12:23:07.216473+0000","last_undegraded":"2024-04-20T12:23:07.216473+0000","last_fullsized":"2024-04-20T12:23:07.216473+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:48:04.916848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,1],"acting":[11,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086363+0000","last_change":"2024-04-20T12:20:42.037258+0000","last_active":"2024-04-20T12:23:07.086363+0000","last_peered":"2024-04-20T12:23:07.086363+0000","last_clean":"2024-04-20T12:23:07.086363+0000","last_became_active":"2024-04-20T12:20:42.036755+0000","last_became_peered":"2024-04-20T12:20:42.036755+0000","last_unstale":"2024-04-20T12:23:07.086363+0000","last_undegraded":"2024-04-20T12:23:07.086363+0000","last_fullsized":"2024-04-20T12:23:07.086363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:23:17.093038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215884+0000","last_change":"2024-04-20T12:20:46.929829+0000","last_active":"2024-04-20T12:23:07.215884+0000","last_peered":"2024-04-20T12:23:07.215884+0000","last_clean":"2024-04-20T12:23:07.215884+0000","last_became_active":"2024-04-20T12:20:46.929296+0000","last_became_peered":"2024-04-20T12:20:46.929296+0000","last_unstale":"2024-04-20T12:23:07.215884+0000","last_undegraded":"2024-04-20T12:23:07.215884+0000","last_fullsized":"2024-04-20T12:23:07.215884+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:30.700141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.087825+0000","last_change":"2024-04-20T12:20:41.027753+0000","last_active":"2024-04-20T12:23:07.087825+0000","last_peered":"2024-04-20T12:23:07.087825+0000","last_clean":"2024-04-20T12:23:07.087825+0000","last_became_active":"2024-04-20T12:20:41.027360+0000","last_became_peered":"2024-04-20T12:20:41.027360+0000","last_unstale":"2024-04-20T12:23:07.087825+0000","last_undegraded":"2024-04-20T12:23:07.087825+0000","last_fullsized":"2024-04-20T12:23:07.087825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:30:59.710541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217146+0000","last_change":"2024-04-20T12:20:42.029409+0000","last_active":"2024-04-20T12:23:07.217146+0000","last_peered":"2024-04-20T12:23:07.217146+0000","last_clean":"2024-04-20T12:23:07.217146+0000","last_became_active":"2024-04-20T12:20:42.029062+0000","last_became_peered":"2024-04-20T12:20:42.029062+0000","last_unstale":"2024-04-20T12:23:07.217146+0000","last_undegraded":"2024-04-20T12:23:07.217146+0000","last_fullsized":"2024-04-20T12:23:07.217146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:47:33.412087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215926+0000","last_change":"2024-04-20T12:20:46.326605+0000","last_active":"2024-04-20T12:23:07.215926+0000","last_peered":"2024-04-20T12:23:07.215926+0000","last_clean":"2024-04-20T12:23:07.215926+0000","last_became_active":"2024-04-20T12:20:46.326162+0000","last_became_peered":"2024-04-20T12:20:46.326162+0000","last_unstale":"2024-04-20T12:23:07.215926+0000","last_undegraded":"2024-04-20T12:23:07.215926+0000","last_fullsized":"2024-04-20T12:23:07.215926+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:44:37.344357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"95'6","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.485909+0000","last_change":"2024-04-20T12:20:41.035324+0000","last_active":"2024-04-20T12:23:07.485909+0000","last_peered":"2024-04-20T12:23:07.485909+0000","last_clean":"2024-04-20T12:23:07.485909+0000","last_became_active":"2024-04-20T12:20:41.034996+0000","last_became_peered":"2024-04-20T12:20:41.034996+0000","last_unstale":"2024-04-20T12:23:07.485909+0000","last_undegraded":"2024-04-20T12:23:07.485909+0000","last_fullsized":"2024-04-20T12:23:07.485909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:33.788405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216933+0000","last_change":"2024-04-20T12:20:42.028803+0000","last_active":"2024-04-20T12:23:07.216933+0000","last_peered":"2024-04-20T12:23:07.216933+0000","last_clean":"2024-04-20T12:23:07.216933+0000","last_became_active":"2024-04-20T12:20:42.028316+0000","last_became_peered":"2024-04-20T12:20:42.028316+0000","last_unstale":"2024-04-20T12:23:07.216933+0000","last_undegraded":"2024-04-20T12:23:07.216933+0000","last_fullsized":"2024-04-20T12:23:07.216933+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:09.000315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215788+0000","last_change":"2024-04-20T12:20:46.328502+0000","last_active":"2024-04-20T12:23:07.215788+0000","last_peered":"2024-04-20T12:23:07.215788+0000","last_clean":"2024-04-20T12:23:07.215788+0000","last_became_active":"2024-04-20T12:20:46.328106+0000","last_became_peered":"2024-04-20T12:20:46.328106+0000","last_unstale":"2024-04-20T12:23:07.215788+0000","last_undegraded":"2024-04-20T12:23:07.215788+0000","last_fullsized":"2024-04-20T12:23:07.215788+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:06:30.041621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"95'41","reported_seq":85,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.307416+0000","last_change":"2024-04-20T12:20:41.023918+0000","last_active":"2024-04-20T12:23:07.307416+0000","last_peered":"2024-04-20T12:23:07.307416+0000","last_clean":"2024-04-20T12:23:07.307416+0000","last_became_active":"2024-04-20T12:20:41.023088+0000","last_became_peered":"2024-04-20T12:20:41.023088+0000","last_unstale":"2024-04-20T12:23:07.307416+0000","last_undegraded":"2024-04-20T12:23:07.307416+0000","last_fullsized":"2024-04-20T12:23:07.307416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:15:03.220660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217351+0000","last_change":"2024-04-20T12:20:42.038981+0000","last_active":"2024-04-20T12:23:07.217351+0000","last_peered":"2024-04-20T12:23:07.217351+0000","last_clean":"2024-04-20T12:23:07.217351+0000","last_became_active":"2024-04-20T12:20:42.038656+0000","last_became_peered":"2024-04-20T12:20:42.038656+0000","last_unstale":"2024-04-20T12:23:07.217351+0000","last_undegraded":"2024-04-20T12:23:07.217351+0000","last_fullsized":"2024-04-20T12:23:07.217351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:51:08.446546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.195670+0000","last_change":"2024-04-20T12:20:46.323446+0000","last_active":"2024-04-20T12:23:07.195670+0000","last_peered":"2024-04-20T12:23:07.195670+0000","last_clean":"2024-04-20T12:23:07.195670+0000","last_became_active":"2024-04-20T12:20:46.322259+0000","last_became_peered":"2024-04-20T12:20:46.322259+0000","last_unstale":"2024-04-20T12:23:07.195670+0000","last_undegraded":"2024-04-20T12:23:07.195670+0000","last_fullsized":"2024-04-20T12:23:07.195670+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:45.298174+0000","last_clean_scrub_stamp":"2024-04-20T12:20:45.298174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:01:11.833469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"90'5","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.354552+0000","last_change":"2024-04-20T12:20:41.029995+0000","last_active":"2024-04-20T12:23:07.354552+0000","last_peered":"2024-04-20T12:23:07.354552+0000","last_clean":"2024-04-20T12:23:07.354552+0000","last_became_active":"2024-04-20T12:20:41.029650+0000","last_became_peered":"2024-04-20T12:20:41.029650+0000","last_unstale":"2024-04-20T12:23:07.354552+0000","last_undegraded":"2024-04-20T12:23:07.354552+0000","last_fullsized":"2024-04-20T12:23:07.354552+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:39.998787+0000","last_clean_scrub_stamp":"2024-04-20T12:20:39.998787+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:24:54.522855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":43,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.217386+0000","last_change":"2024-04-20T12:20:42.030357+0000","last_active":"2024-04-20T12:23:07.217386+0000","last_peered":"2024-04-20T12:23:07.217386+0000","last_clean":"2024-04-20T12:23:07.217386+0000","last_became_active":"2024-04-20T12:20:42.029966+0000","last_became_peered":"2024-04-20T12:20:42.029966+0000","last_unstale":"2024-04-20T12:23:07.217386+0000","last_undegraded":"2024-04-20T12:23:07.217386+0000","last_fullsized":"2024-04-20T12:23:07.217386+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:35:09.487965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215896+0000","last_change":"2024-04-20T12:20:42.036914+0000","last_active":"2024-04-20T12:23:07.215896+0000","last_peered":"2024-04-20T12:23:07.215896+0000","last_clean":"2024-04-20T12:23:07.215896+0000","last_became_active":"2024-04-20T12:20:42.036434+0000","last_became_peered":"2024-04-20T12:20:42.036434+0000","last_unstale":"2024-04-20T12:23:07.215896+0000","last_undegraded":"2024-04-20T12:23:07.215896+0000","last_fullsized":"2024-04-20T12:23:07.215896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.552096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215529+0000","last_change":"2024-04-20T12:20:42.040424+0000","last_active":"2024-04-20T12:23:07.215529+0000","last_peered":"2024-04-20T12:23:07.215529+0000","last_clean":"2024-04-20T12:23:07.215529+0000","last_became_active":"2024-04-20T12:20:42.040095+0000","last_became_peered":"2024-04-20T12:20:42.040095+0000","last_unstale":"2024-04-20T12:23:07.215529+0000","last_undegraded":"2024-04-20T12:23:07.215529+0000","last_fullsized":"2024-04-20T12:23:07.215529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:24.669083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.215646+0000","last_change":"2024-04-20T12:20:42.037764+0000","last_active":"2024-04-20T12:23:07.215646+0000","last_peered":"2024-04-20T12:23:07.215646+0000","last_clean":"2024-04-20T12:23:07.215646+0000","last_became_active":"2024-04-20T12:20:42.037389+0000","last_became_peered":"2024-04-20T12:20:42.037389+0000","last_unstale":"2024-04-20T12:23:07.215646+0000","last_undegraded":"2024-04-20T12:23:07.215646+0000","last_fullsized":"2024-04-20T12:23:07.215646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:20.284714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216037+0000","last_change":"2024-04-20T12:20:42.027546+0000","last_active":"2024-04-20T12:23:07.216037+0000","last_peered":"2024-04-20T12:23:07.216037+0000","last_clean":"2024-04-20T12:23:07.216037+0000","last_became_active":"2024-04-20T12:20:42.027229+0000","last_became_peered":"2024-04-20T12:20:42.027229+0000","last_unstale":"2024-04-20T12:23:07.216037+0000","last_undegraded":"2024-04-20T12:23:07.216037+0000","last_fullsized":"2024-04-20T12:23:07.216037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:22.649256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.354052+0000","last_change":"2024-04-20T12:20:42.024971+0000","last_active":"2024-04-20T12:23:07.354052+0000","last_peered":"2024-04-20T12:23:07.354052+0000","last_clean":"2024-04-20T12:23:07.354052+0000","last_became_active":"2024-04-20T12:20:42.024607+0000","last_became_peered":"2024-04-20T12:20:42.024607+0000","last_unstale":"2024-04-20T12:23:07.354052+0000","last_undegraded":"2024-04-20T12:23:07.354052+0000","last_fullsized":"2024-04-20T12:23:07.354052+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T23:15:56.160140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216590+0000","last_change":"2024-04-20T12:20:42.036699+0000","last_active":"2024-04-20T12:23:07.216590+0000","last_peered":"2024-04-20T12:23:07.216590+0000","last_clean":"2024-04-20T12:23:07.216590+0000","last_became_active":"2024-04-20T12:20:42.036355+0000","last_became_peered":"2024-04-20T12:20:42.036355+0000","last_unstale":"2024-04-20T12:23:07.216590+0000","last_undegraded":"2024-04-20T12:23:07.216590+0000","last_fullsized":"2024-04-20T12:23:07.216590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:14:40.276148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216080+0000","last_change":"2024-04-20T12:20:42.034906+0000","last_active":"2024-04-20T12:23:07.216080+0000","last_peered":"2024-04-20T12:23:07.216080+0000","last_clean":"2024-04-20T12:23:07.216080+0000","last_became_active":"2024-04-20T12:20:42.034572+0000","last_became_peered":"2024-04-20T12:20:42.034572+0000","last_unstale":"2024-04-20T12:23:07.216080+0000","last_undegraded":"2024-04-20T12:23:07.216080+0000","last_fullsized":"2024-04-20T12:23:07.216080+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:54.166032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":36,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086645+0000","last_change":"2024-04-20T12:20:42.041180+0000","last_active":"2024-04-20T12:23:07.086645+0000","last_peered":"2024-04-20T12:23:07.086645+0000","last_clean":"2024-04-20T12:23:07.086645+0000","last_became_active":"2024-04-20T12:20:42.040648+0000","last_became_peered":"2024-04-20T12:20:42.040648+0000","last_unstale":"2024-04-20T12:23:07.086645+0000","last_undegraded":"2024-04-20T12:23:07.086645+0000","last_fullsized":"2024-04-20T12:23:07.086645+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:55:38.855441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.195776+0000","last_change":"2024-04-20T12:20:42.030153+0000","last_active":"2024-04-20T12:23:07.195776+0000","last_peered":"2024-04-20T12:23:07.195776+0000","last_clean":"2024-04-20T12:23:07.195776+0000","last_became_active":"2024-04-20T12:20:42.029796+0000","last_became_peered":"2024-04-20T12:20:42.029796+0000","last_unstale":"2024-04-20T12:23:07.195776+0000","last_undegraded":"2024-04-20T12:23:07.195776+0000","last_fullsized":"2024-04-20T12:23:07.195776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:50.676958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.086066+0000","last_change":"2024-04-20T12:20:42.039864+0000","last_active":"2024-04-20T12:23:07.086066+0000","last_peered":"2024-04-20T12:23:07.086066+0000","last_clean":"2024-04-20T12:23:07.086066+0000","last_became_active":"2024-04-20T12:20:42.036624+0000","last_became_peered":"2024-04-20T12:20:42.036624+0000","last_unstale":"2024-04-20T12:23:07.086066+0000","last_undegraded":"2024-04-20T12:23:07.086066+0000","last_fullsized":"2024-04-20T12:23:07.086066+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:13.271749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216312+0000","last_change":"2024-04-20T12:20:42.033628+0000","last_active":"2024-04-20T12:23:07.216312+0000","last_peered":"2024-04-20T12:23:07.216312+0000","last_clean":"2024-04-20T12:23:07.216312+0000","last_became_active":"2024-04-20T12:20:42.033296+0000","last_became_peered":"2024-04-20T12:20:42.033296+0000","last_unstale":"2024-04-20T12:23:07.216312+0000","last_undegraded":"2024-04-20T12:23:07.216312+0000","last_fullsized":"2024-04-20T12:23:07.216312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:16:16.029327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.352822+0000","last_change":"2024-04-20T12:20:42.024730+0000","last_active":"2024-04-20T12:23:07.352822+0000","last_peered":"2024-04-20T12:23:07.352822+0000","last_clean":"2024-04-20T12:23:07.352822+0000","last_became_active":"2024-04-20T12:20:42.024400+0000","last_became_peered":"2024-04-20T12:20:42.024400+0000","last_unstale":"2024-04-20T12:23:07.352822+0000","last_undegraded":"2024-04-20T12:23:07.352822+0000","last_fullsized":"2024-04-20T12:23:07.352822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:27:41.514880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-20T12:23:07.216011+0000","last_change":"2024-04-20T12:20:42.033623+0000","last_active":"2024-04-20T12:23:07.216011+0000","last_peered":"2024-04-20T12:23:07.216011+0000","last_clean":"2024-04-20T12:23:07.216011+0000","last_became_active":"2024-04-20T12:20:42.033105+0000","last_became_peered":"2024-04-20T12:20:42.033105+0000","last_unstale":"2024-04-20T12:23:07.216011+0000","last_undegraded":"2024-04-20T12:23:07.216011+0000","last_fullsized":"2024-04-20T12:23:07.216011+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T12:20:41.001150+0000","last_clean_scrub_stamp":"2024-04-20T12:20:41.001150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:01.121977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":106764,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":603960,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":1328,"num_read_kb":788,"num_write":372,"num_write_kb":1470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":622,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":712704,"data_stored":1811880,"data_compressed":80748,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383722,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1040384,"data_stored":529596,"data_compressed":29543,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":72,"seq":309237645358,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32376,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712776,"statfs":{"total":95995035648,"available":95961882624,"internally_reserved":0,"allocated":1224704,"data_stored":1328653,"data_compressed":75884,"data_compressed_allocated":102400,"data_compressed_original":811008,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":67,"seq":287762808884,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1081344,"data_stored":543496,"data_compressed":32526,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":59,"seq":253403070522,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1097728,"data_stored":932994,"data_compressed":51672,"data_compressed_allocated":69632,"data_compressed_original":483328,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":51,"seq":219043332159,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32280,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712872,"statfs":{"total":95995035648,"available":95961980928,"internally_reserved":0,"allocated":1126400,"data_stored":1138147,"data_compressed":68114,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495683,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1052672,"data_stored":535686,"data_compressed":32526,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1122304,"data_stored":606784,"data_compressed":34140,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1077248,"data_stored":536751,"data_compressed":32526,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32288,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712864,"statfs":{"total":95995035648,"available":95961972736,"internally_reserved":0,"allocated":1134592,"data_stored":605991,"data_compressed":34140,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1110016,"data_stored":1059428,"data_compressed":57828,"data_compressed_allocated":77824,"data_compressed_original":606208,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920846,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32224,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712928,"statfs":{"total":95995035648,"available":95962038272,"internally_reserved":0,"allocated":1069056,"data_stored":541081,"data_compressed":32526,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757321,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32304,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712848,"statfs":{"total":95995035648,"available":95961956352,"internally_reserved":0,"allocated":1155072,"data_stored":1263848,"data_compressed":74270,"data_compressed_allocated":98304,"data_compressed_original":802816,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35588,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":72602,"data_compressed":1614,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":71809,"data_compressed":1614,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":525246,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":135202,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":394716,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":394338,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":204103,"data_compressed":7770,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T12:23:12.837 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:23:12.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.969+0000 7fd39b0c8640 1 -- 172.21.15.135:0/145760474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3941010b0 msgr2=0x7fd394101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:12.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.969+0000 7fd39b0c8640 1 --2- 172.21.15.135:0/145760474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3941010b0 0x7fd394101490 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd38c009ca0 tx=0x7fd38c02c100 comp rx=0 tx=0).stop 2024-04-20T12:23:12.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.969+0000 7fd39b0c8640 1 -- 172.21.15.135:0/145760474 shutdown_connections 2024-04-20T12:23:12.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.969+0000 7fd39b0c8640 1 --2- 172.21.15.135:0/145760474 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd394106180 0x7fd39410dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.969+0000 7fd39b0c8640 1 --2- 172.21.15.135:0/145760474 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd394101a60 0x7fd394105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.969+0000 7fd39b0c8640 1 --2- 172.21.15.135:0/145760474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3941010b0 0x7fd394101490 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.969+0000 7fd39b0c8640 1 -- 172.21.15.135:0/145760474 >> 172.21.15.135:0/145760474 conn(0x7fd394077f60 msgr2=0x7fd394078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:12.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.969+0000 7fd39b0c8640 1 -- 172.21.15.135:0/145760474 shutdown_connections 2024-04-20T12:23:12.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.969+0000 7fd39b0c8640 1 -- 172.21.15.135:0/145760474 wait complete. 2024-04-20T12:23:12.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd39b0c8640 1 Processor -- start 2024-04-20T12:23:12.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd39b0c8640 1 -- start start 2024-04-20T12:23:12.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd39b0c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3941010b0 0x7fd39419e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:12.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd39b0c8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd394106180 0x7fd39419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:12.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd39b0c8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3941985b0 0x7fd394198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:12.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd39b0c8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd394111210 con 0x7fd394106180 2024-04-20T12:23:12.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd39b0c8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd394111090 con 0x7fd3941985b0 2024-04-20T12:23:12.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd39b0c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd394111390 con 0x7fd3941010b0 2024-04-20T12:23:12.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd393fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd394106180 0x7fd39419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:12.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd393fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd394106180 0x7fd39419e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35328/0 (socket says 172.21.15.135:35328) 2024-04-20T12:23:12.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd393fff640 1 -- 172.21.15.135:0/1565936369 learned_addr learned my addr 172.21.15.135:0/1565936369 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd399665640 1 --2- 172.21.15.135:0/1565936369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3941985b0 0x7fd394198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd398e64640 1 --2- 172.21.15.135:0/1565936369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3941010b0 0x7fd39419e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd393fff640 1 -- 172.21.15.135:0/1565936369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3941010b0 msgr2=0x7fd39419e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd393fff640 1 --2- 172.21.15.135:0/1565936369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3941010b0 0x7fd39419e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd393fff640 1 -- 172.21.15.135:0/1565936369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3941985b0 msgr2=0x7fd394198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd393fff640 1 --2- 172.21.15.135:0/1565936369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3941985b0 0x7fd394198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd393fff640 1 -- 172.21.15.135:0/1565936369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3941990d0 con 0x7fd394106180 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd393fff640 1 --2- 172.21.15.135:0/1565936369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd394106180 0x7fd39419e940 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd38800c970 tx=0x7fd38800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd391ffb640 1 -- 172.21.15.135:0/1565936369 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd388014070 con 0x7fd394106180 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd391ffb640 1 -- 172.21.15.135:0/1565936369 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd388004440 con 0x7fd394106180 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.970+0000 7fd39b0c8640 1 -- 172.21.15.135:0/1565936369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3941993c0 con 0x7fd394106180 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.971+0000 7fd391ffb640 1 -- 172.21.15.135:0/1565936369 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd38800f450 con 0x7fd394106180 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.971+0000 7fd39b0c8640 1 -- 172.21.15.135:0/1565936369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3941a5610 con 0x7fd394106180 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.972+0000 7fd39b0c8640 1 -- 172.21.15.135:0/1565936369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd394068d80 con 0x7fd394106180 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.973+0000 7fd391ffb640 1 -- 172.21.15.135:0/1565936369 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7fd388017070 con 0x7fd394106180 2024-04-20T12:23:12.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.973+0000 7fd391ffb640 1 --2- 172.21.15.135:0/1565936369 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd37c0a3e40 0x7fd37c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:12.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.973+0000 7fd398e64640 1 --2- 172.21.15.135:0/1565936369 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd37c0a3e40 0x7fd37c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:12.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.973+0000 7fd391ffb640 1 -- 172.21.15.135:0/1565936369 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fd3880d0d40 con 0x7fd394106180 2024-04-20T12:23:12.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.974+0000 7fd398e64640 1 --2- 172.21.15.135:0/1565936369 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd37c0a3e40 0x7fd37c0a6300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd38c000f80 tx=0x7fd38c005c30 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:12.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:12.978+0000 7fd391ffb640 1 -- 172.21.15.135:0/1565936369 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fd38801e020 con 0x7fd394106180 2024-04-20T12:23:13.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.165+0000 7fd39b0c8640 1 -- 172.21.15.135:0/1565936369 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd394199ae0 con 0x7fd394106180 2024-04-20T12:23:13.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.167+0000 7fd391ffb640 1 -- 172.21.15.135:0/1565936369 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+25197 (secure 0 0 0) 0x7fd394199ae0 con 0x7fd394106180 2024-04-20T12:23:13.167 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:23:13.167 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":95,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:23:07.080106+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2052292307":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/669936771":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/4276159294":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6800/3831149339":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/1087722944":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6801/3831149339":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:23:13.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.169+0000 7fd39b0c8640 1 -- 172.21.15.135:0/1565936369 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd37c0a3e40 msgr2=0x7fd37c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:13.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.169+0000 7fd39b0c8640 1 --2- 172.21.15.135:0/1565936369 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd37c0a3e40 0x7fd37c0a6300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd38c000f80 tx=0x7fd38c005c30 comp rx=0 tx=0).stop 2024-04-20T12:23:13.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.169+0000 7fd39b0c8640 1 -- 172.21.15.135:0/1565936369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd394106180 msgr2=0x7fd39419e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:13.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.169+0000 7fd39b0c8640 1 --2- 172.21.15.135:0/1565936369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd394106180 0x7fd39419e940 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd38800c970 tx=0x7fd38800ce30 comp rx=0 tx=0).stop 2024-04-20T12:23:13.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.169+0000 7fd39b0c8640 1 -- 172.21.15.135:0/1565936369 shutdown_connections 2024-04-20T12:23:13.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.169+0000 7fd39b0c8640 1 --2- 172.21.15.135:0/1565936369 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3941985b0 0x7fd394198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.169+0000 7fd39b0c8640 1 --2- 172.21.15.135:0/1565936369 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd394106180 0x7fd39419e940 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.169+0000 7fd39b0c8640 1 --2- 172.21.15.135:0/1565936369 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd37c0a3e40 0x7fd37c0a6300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.169+0000 7fd39b0c8640 1 --2- 172.21.15.135:0/1565936369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3941010b0 0x7fd39419e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.169+0000 7fd39b0c8640 1 -- 172.21.15.135:0/1565936369 >> 172.21.15.135:0/1565936369 conn(0x7fd394077f60 msgr2=0x7fd394069420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:13.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.169+0000 7fd39b0c8640 1 -- 172.21.15.135:0/1565936369 shutdown_connections 2024-04-20T12:23:13.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.169+0000 7fd39b0c8640 1 -- 172.21.15.135:0/1565936369 wait complete. 2024-04-20T12:23:13.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T12:16:02.802023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T12:20:39.656129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T12:20:40.312827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T12:20:44.307136+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T12:23:13.181 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T12:23:13.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.282+0000 7f78633f4640 1 -- 172.21.15.135:0/3637119944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f785c102200 msgr2=0x7f785c105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:13.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.282+0000 7f78633f4640 1 --2- 172.21.15.135:0/3637119944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f785c102200 0x7f785c105a80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f784c009900 tx=0x7f784c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:13.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.282+0000 7f78633f4640 1 -- 172.21.15.135:0/3637119944 shutdown_connections 2024-04-20T12:23:13.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.282+0000 7f78633f4640 1 --2- 172.21.15.135:0/3637119944 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f785c106160 0x7f785c10dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.282+0000 7f78633f4640 1 --2- 172.21.15.135:0/3637119944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f785c102200 0x7f785c105a80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.282+0000 7f78633f4640 1 --2- 172.21.15.135:0/3637119944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f785c101850 0x7f785c101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.282+0000 7f78633f4640 1 -- 172.21.15.135:0/3637119944 >> 172.21.15.135:0/3637119944 conn(0x7f785c077460 msgr2=0x7f785c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:13.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.282+0000 7f78633f4640 1 -- 172.21.15.135:0/3637119944 shutdown_connections 2024-04-20T12:23:13.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.282+0000 7f78633f4640 1 -- 172.21.15.135:0/3637119944 wait complete. 2024-04-20T12:23:13.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f78633f4640 1 Processor -- start 2024-04-20T12:23:13.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f78633f4640 1 -- start start 2024-04-20T12:23:13.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f78633f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f785c101850 0x7f785c19d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:13.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f78633f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f785c106160 0x7f785c19d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:13.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f78633f4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f785c1975f0 0x7f785c197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:13.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f78633f4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f785c111270 con 0x7f785c1975f0 2024-04-20T12:23:13.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f78633f4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f785c1110f0 con 0x7f785c101850 2024-04-20T12:23:13.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f78633f4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f785c1113f0 con 0x7f785c106160 2024-04-20T12:23:13.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f7861991640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f785c1975f0 0x7f785c197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:13.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f7861991640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f785c1975f0 0x7f785c197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35356/0 (socket says 172.21.15.135:35356) 2024-04-20T12:23:13.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f7861991640 1 -- 172.21.15.135:0/2546623621 learned_addr learned my addr 172.21.15.135:0/2546623621 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:13.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f7861190640 1 --2- 172.21.15.135:0/2546623621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f785c101850 0x7f785c19d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:13.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f786098f640 1 --2- 172.21.15.135:0/2546623621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f785c106160 0x7f785c19d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:13.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f7861991640 1 -- 172.21.15.135:0/2546623621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f785c106160 msgr2=0x7f785c19d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:13.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f7861991640 1 --2- 172.21.15.135:0/2546623621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f785c106160 0x7f785c19d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f7861991640 1 -- 172.21.15.135:0/2546623621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f785c101850 msgr2=0x7f785c19d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:13.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f7861991640 1 --2- 172.21.15.135:0/2546623621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f785c101850 0x7f785c19d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.283+0000 7f7861991640 1 -- 172.21.15.135:0/2546623621 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785c198110 con 0x7f785c1975f0 2024-04-20T12:23:13.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.284+0000 7f7861991640 1 --2- 172.21.15.135:0/2546623621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f785c1975f0 0x7f785c197aa0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f785400b970 tx=0x7f785400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:13.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.284+0000 7f78527fc640 1 -- 172.21.15.135:0/2546623621 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7854019070 con 0x7f785c1975f0 2024-04-20T12:23:13.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.284+0000 7f78527fc640 1 -- 172.21.15.135:0/2546623621 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f785400cb40 con 0x7f785c1975f0 2024-04-20T12:23:13.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.284+0000 7f78527fc640 1 -- 172.21.15.135:0/2546623621 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7854007650 con 0x7f785c1975f0 2024-04-20T12:23:13.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.284+0000 7f78633f4640 1 -- 172.21.15.135:0/2546623621 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785c198400 con 0x7f785c1975f0 2024-04-20T12:23:13.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.284+0000 7f78633f4640 1 -- 172.21.15.135:0/2546623621 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f785c1a4600 con 0x7f785c1975f0 2024-04-20T12:23:13.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.285+0000 7f78633f4640 1 -- 172.21.15.135:0/2546623621 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f785c198b20 con 0x7f785c1975f0 2024-04-20T12:23:13.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.286+0000 7f78527fc640 1 -- 172.21.15.135:0/2546623621 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7f785401c070 con 0x7f785c1975f0 2024-04-20T12:23:13.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.286+0000 7f78527fc640 1 --2- 172.21.15.135:0/2546623621 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78480a3e40 0x7f78480a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:13.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.286+0000 7f78527fc640 1 -- 172.21.15.135:0/2546623621 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f78540d07e0 con 0x7f785c1975f0 2024-04-20T12:23:13.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.286+0000 7f7861190640 1 --2- 172.21.15.135:0/2546623621 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78480a3e40 0x7f78480a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:13.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.287+0000 7f7861190640 1 --2- 172.21.15.135:0/2546623621 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78480a3e40 0x7f78480a6300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7858005fd0 tx=0x7f785800b390 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:13.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.290+0000 7f78527fc640 1 -- 172.21.15.135:0/2546623621 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f785409c370 con 0x7f785c1975f0 2024-04-20T12:23:13.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:13 smithi135 ceph-mon[18264]: from='client.15693 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:23:13.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:13 smithi135 ceph-mon[18264]: from='client.15699 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:23:13.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:13 smithi135 ceph-mon[18264]: from='client.15705 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:23:13.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.470+0000 7f78633f4640 1 -- 172.21.15.135:0/2546623621 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f785c02d600 con 0x7f785c1975f0 2024-04-20T12:23:13.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.471+0000 7f78527fc640 1 -- 172.21.15.135:0/2546623621 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7f78540a0670 con 0x7f785c1975f0 2024-04-20T12:23:13.471 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-04-20T12:23:13.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.473+0000 7f78633f4640 1 -- 172.21.15.135:0/2546623621 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78480a3e40 msgr2=0x7f78480a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:13.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.473+0000 7f78633f4640 1 --2- 172.21.15.135:0/2546623621 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78480a3e40 0x7f78480a6300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7858005fd0 tx=0x7f785800b390 comp rx=0 tx=0).stop 2024-04-20T12:23:13.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.473+0000 7f78633f4640 1 -- 172.21.15.135:0/2546623621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f785c1975f0 msgr2=0x7f785c197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:13.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.473+0000 7f78633f4640 1 --2- 172.21.15.135:0/2546623621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f785c1975f0 0x7f785c197aa0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f785400b970 tx=0x7f785400be30 comp rx=0 tx=0).stop 2024-04-20T12:23:13.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.473+0000 7f78633f4640 1 -- 172.21.15.135:0/2546623621 shutdown_connections 2024-04-20T12:23:13.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.473+0000 7f78633f4640 1 --2- 172.21.15.135:0/2546623621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f785c1975f0 0x7f785c197aa0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.473+0000 7f78633f4640 1 --2- 172.21.15.135:0/2546623621 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78480a3e40 0x7f78480a6300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.473+0000 7f78633f4640 1 --2- 172.21.15.135:0/2546623621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f785c106160 0x7f785c19d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.473+0000 7f78633f4640 1 --2- 172.21.15.135:0/2546623621 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f785c101850 0x7f785c19d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.473+0000 7f78633f4640 1 -- 172.21.15.135:0/2546623621 >> 172.21.15.135:0/2546623621 conn(0x7f785c077460 msgr2=0x7f785c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:13.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.473+0000 7f78633f4640 1 -- 172.21.15.135:0/2546623621 shutdown_connections 2024-04-20T12:23:13.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.473+0000 7f78633f4640 1 -- 172.21.15.135:0/2546623621 wait complete. 2024-04-20T12:23:13.484 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T12:23:13.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:13 smithi154 ceph-mon[22073]: from='client.15693 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:23:13.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:13 smithi154 ceph-mon[22073]: from='client.15699 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:23:13.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:13 smithi154 ceph-mon[22073]: from='client.15705 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:23:13.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:13 smithi139 ceph-mon[21834]: from='client.15693 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:23:13.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:13 smithi139 ceph-mon[21834]: from='client.15699 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:23:13.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:13 smithi139 ceph-mon[21834]: from='client.15705 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-20T12:23:13.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.585+0000 7f951c932640 1 -- 172.21.15.135:0/947875437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9518102b50 msgr2=0x7f9518106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:13.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.585+0000 7f951c932640 1 --2- 172.21.15.135:0/947875437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9518102b50 0x7f9518106b90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9508009900 tx=0x7f950802bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:13.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.585+0000 7f951c932640 1 -- 172.21.15.135:0/947875437 shutdown_connections 2024-04-20T12:23:13.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.585+0000 7f951c932640 1 --2- 172.21.15.135:0/947875437 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9518107270 0x7f951810ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.585+0000 7f951c932640 1 --2- 172.21.15.135:0/947875437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9518102b50 0x7f9518106b90 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.585+0000 7f951c932640 1 --2- 172.21.15.135:0/947875437 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95181021a0 0x7f9518102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.585+0000 7f951c932640 1 -- 172.21.15.135:0/947875437 >> 172.21.15.135:0/947875437 conn(0x7f95180793b0 msgr2=0x7f95180797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:13.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.585+0000 7f951c932640 1 -- 172.21.15.135:0/947875437 shutdown_connections 2024-04-20T12:23:13.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.585+0000 7f951c932640 1 -- 172.21.15.135:0/947875437 wait complete. 2024-04-20T12:23:13.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f951c932640 1 Processor -- start 2024-04-20T12:23:13.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f951c932640 1 -- start start 2024-04-20T12:23:13.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f951c932640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95181021a0 0x7f9518074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:13.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f951c932640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9518107270 0x7f95180747a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:13.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f951c932640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9518074ce0 0x7f95181a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:13.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f951c932640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9518112300 con 0x7f9518074ce0 2024-04-20T12:23:13.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f951c932640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9518112180 con 0x7f9518107270 2024-04-20T12:23:13.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f951c932640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9518112480 con 0x7f95181021a0 2024-04-20T12:23:13.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f9516d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9518074ce0 0x7f95181a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:13.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f9516d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9518074ce0 0x7f95181a6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35364/0 (socket says 172.21.15.135:35364) 2024-04-20T12:23:13.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f9516d9d640 1 -- 172.21.15.135:0/1966683085 learned_addr learned my addr 172.21.15.135:0/1966683085 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:13.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f9515d9b640 1 --2- 172.21.15.135:0/1966683085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9518107270 0x7f95180747a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:13.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f951659c640 1 --2- 172.21.15.135:0/1966683085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95181021a0 0x7f9518074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:13.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f9516d9d640 1 -- 172.21.15.135:0/1966683085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95181021a0 msgr2=0x7f9518074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:13.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f9516d9d640 1 --2- 172.21.15.135:0/1966683085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95181021a0 0x7f9518074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f9516d9d640 1 -- 172.21.15.135:0/1966683085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9518107270 msgr2=0x7f95180747a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:13.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f9516d9d640 1 --2- 172.21.15.135:0/1966683085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9518107270 0x7f95180747a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f9516d9d640 1 -- 172.21.15.135:0/1966683085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95181a7150 con 0x7f9518074ce0 2024-04-20T12:23:13.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.586+0000 7f9516d9d640 1 --2- 172.21.15.135:0/1966683085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9518074ce0 0x7f95181a6a50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9510009fd0 tx=0x7f951000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:13.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.587+0000 7f950f7fe640 1 -- 172.21.15.135:0/1966683085 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9510017070 con 0x7f9518074ce0 2024-04-20T12:23:13.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.587+0000 7f950f7fe640 1 -- 172.21.15.135:0/1966683085 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9510003e50 con 0x7f9518074ce0 2024-04-20T12:23:13.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.587+0000 7f951c932640 1 -- 172.21.15.135:0/1966683085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95181a7440 con 0x7f9518074ce0 2024-04-20T12:23:13.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.587+0000 7f950f7fe640 1 -- 172.21.15.135:0/1966683085 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95100106c0 con 0x7f9518074ce0 2024-04-20T12:23:13.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.587+0000 7f951c932640 1 -- 172.21.15.135:0/1966683085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95181a7910 con 0x7f9518074ce0 2024-04-20T12:23:13.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.588+0000 7f951c932640 1 -- 172.21.15.135:0/1966683085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95180691d0 con 0x7f9518074ce0 2024-04-20T12:23:13.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.589+0000 7f950f7fe640 1 -- 172.21.15.135:0/1966683085 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7f9510003970 con 0x7f9518074ce0 2024-04-20T12:23:13.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.589+0000 7f950f7fe640 1 --2- 172.21.15.135:0/1966683085 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f95040a3e70 0x7f95040a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:13.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.589+0000 7f951659c640 1 --2- 172.21.15.135:0/1966683085 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f95040a3e70 0x7f95040a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:13.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.590+0000 7f950f7fe640 1 -- 172.21.15.135:0/1966683085 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f95100d0b00 con 0x7f9518074ce0 2024-04-20T12:23:13.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.590+0000 7f951659c640 1 --2- 172.21.15.135:0/1966683085 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f95040a3e70 0x7f95040a6330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9500005fd0 tx=0x7f9500005e20 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:13.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.594+0000 7f950f7fe640 1 -- 172.21.15.135:0/1966683085 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f951009cbd0 con 0x7f9518074ce0 2024-04-20T12:23:13.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.770+0000 7f951c932640 1 -- 172.21.15.135:0/1966683085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f951810a4a0 con 0x7f9518074ce0 2024-04-20T12:23:13.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.771+0000 7f950f7fe640 1 -- 172.21.15.135:0/1966683085 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) ==== 104+0+11 (secure 0 0 0) 0x7f951009c4d0 con 0x7f9518074ce0 2024-04-20T12:23:13.771 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:23:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.773+0000 7f951c932640 1 -- 172.21.15.135:0/1966683085 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f95040a3e70 msgr2=0x7f95040a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.773+0000 7f951c932640 1 --2- 172.21.15.135:0/1966683085 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f95040a3e70 0x7f95040a6330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9500005fd0 tx=0x7f9500005e20 comp rx=0 tx=0).stop 2024-04-20T12:23:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.773+0000 7f951c932640 1 -- 172.21.15.135:0/1966683085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9518074ce0 msgr2=0x7f95181a6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.773+0000 7f951c932640 1 --2- 172.21.15.135:0/1966683085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9518074ce0 0x7f95181a6a50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9510009fd0 tx=0x7f951000b260 comp rx=0 tx=0).stop 2024-04-20T12:23:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.773+0000 7f951c932640 1 -- 172.21.15.135:0/1966683085 shutdown_connections 2024-04-20T12:23:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.773+0000 7f951c932640 1 --2- 172.21.15.135:0/1966683085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9518074ce0 0x7f95181a6a50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.773+0000 7f951c932640 1 --2- 172.21.15.135:0/1966683085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9518107270 0x7f95180747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.773+0000 7f951c932640 1 --2- 172.21.15.135:0/1966683085 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f95040a3e70 0x7f95040a6330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.773+0000 7f951c932640 1 --2- 172.21.15.135:0/1966683085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95181021a0 0x7f9518074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.773+0000 7f951c932640 1 -- 172.21.15.135:0/1966683085 >> 172.21.15.135:0/1966683085 conn(0x7f95180793b0 msgr2=0x7f95180fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:13.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.773+0000 7f951c932640 1 -- 172.21.15.135:0/1966683085 shutdown_connections 2024-04-20T12:23:13.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.773+0000 7f951c932640 1 -- 172.21.15.135:0/1966683085 wait complete. 2024-04-20T12:23:13.784 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T12:23:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.886+0000 7f484ef60640 1 -- 172.21.15.135:0/3523233151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48481010a0 msgr2=0x7f4848101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.886+0000 7f484ef60640 1 --2- 172.21.15.135:0/3523233151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48481010a0 0x7f4848101480 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4840009900 tx=0x7f484002bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:13.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.886+0000 7f484ef60640 1 -- 172.21.15.135:0/3523233151 shutdown_connections 2024-04-20T12:23:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.886+0000 7f484ef60640 1 --2- 172.21.15.135:0/3523233151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4848106170 0x7f484810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.886+0000 7f484ef60640 1 --2- 172.21.15.135:0/3523233151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4848101a50 0x7f4848105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.886+0000 7f484ef60640 1 --2- 172.21.15.135:0/3523233151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48481010a0 0x7f4848101480 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.886+0000 7f484ef60640 1 -- 172.21.15.135:0/3523233151 >> 172.21.15.135:0/3523233151 conn(0x7f4848077f60 msgr2=0x7f4848078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.886+0000 7f484ef60640 1 -- 172.21.15.135:0/3523233151 shutdown_connections 2024-04-20T12:23:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.886+0000 7f484ef60640 1 -- 172.21.15.135:0/3523233151 wait complete. 2024-04-20T12:23:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ef60640 1 Processor -- start 2024-04-20T12:23:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ef60640 1 -- start start 2024-04-20T12:23:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ef60640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48481010a0 0x7f4848199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ef60640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4848106170 0x7f4848199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ef60640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f484819a0d0 0x7f48481a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ef60640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4848111220 con 0x7f48481010a0 2024-04-20T12:23:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ef60640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f48481110a0 con 0x7f484819a0d0 2024-04-20T12:23:13.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ef60640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f48481113a0 con 0x7f4848106170 2024-04-20T12:23:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ccfc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48481010a0 0x7f4848199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ccfc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48481010a0 0x7f4848199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35390/0 (socket says 172.21.15.135:35390) 2024-04-20T12:23:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ccfc640 1 -- 172.21.15.135:0/2067513908 learned_addr learned my addr 172.21.15.135:0/2067513908 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484d4fd640 1 --2- 172.21.15.135:0/2067513908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f484819a0d0 0x7f48481a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f4847fff640 1 --2- 172.21.15.135:0/2067513908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4848106170 0x7f4848199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ccfc640 1 -- 172.21.15.135:0/2067513908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4848106170 msgr2=0x7f4848199b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ccfc640 1 --2- 172.21.15.135:0/2067513908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4848106170 0x7f4848199b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ccfc640 1 -- 172.21.15.135:0/2067513908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f484819a0d0 msgr2=0x7f48481a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ccfc640 1 --2- 172.21.15.135:0/2067513908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f484819a0d0 0x7f48481a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ccfc640 1 -- 172.21.15.135:0/2067513908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48481a4e80 con 0x7f48481010a0 2024-04-20T12:23:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f4847fff640 1 --2- 172.21.15.135:0/2067513908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4848106170 0x7f4848199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.887+0000 7f484ccfc640 1 --2- 172.21.15.135:0/2067513908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48481010a0 0x7f4848199600 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4840006010 tx=0x7f484002cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.888+0000 7f4845ffb640 1 -- 172.21.15.135:0/2067513908 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840041070 con 0x7f48481010a0 2024-04-20T12:23:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.888+0000 7f4845ffb640 1 -- 172.21.15.135:0/2067513908 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4840004450 con 0x7f48481010a0 2024-04-20T12:23:13.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.888+0000 7f484ef60640 1 -- 172.21.15.135:0/2067513908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48481a5110 con 0x7f48481010a0 2024-04-20T12:23:13.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.888+0000 7f4845ffb640 1 -- 172.21.15.135:0/2067513908 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840034440 con 0x7f48481010a0 2024-04-20T12:23:13.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.888+0000 7f484ef60640 1 -- 172.21.15.135:0/2067513908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48481a5600 con 0x7f48481010a0 2024-04-20T12:23:13.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.889+0000 7f484ef60640 1 -- 172.21.15.135:0/2067513908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4848068d80 con 0x7f48481010a0 2024-04-20T12:23:13.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.890+0000 7f4845ffb640 1 -- 172.21.15.135:0/2067513908 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7f4840044070 con 0x7f48481010a0 2024-04-20T12:23:13.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.890+0000 7f4845ffb640 1 --2- 172.21.15.135:0/2067513908 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f48340a3e40 0x7f48340a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:13.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.891+0000 7f4845ffb640 1 -- 172.21.15.135:0/2067513908 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f48400f29e0 con 0x7f48481010a0 2024-04-20T12:23:13.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.891+0000 7f4847fff640 1 --2- 172.21.15.135:0/2067513908 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f48340a3e40 0x7f48340a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:13.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.891+0000 7f4847fff640 1 --2- 172.21.15.135:0/2067513908 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f48340a3e40 0x7f48340a6300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4848069c60 tx=0x7f48380093e0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:13.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:13.895+0000 7f4845ffb640 1 -- 172.21.15.135:0/2067513908 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f48400bebc0 con 0x7f48481010a0 2024-04-20T12:23:14.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.080+0000 7f484ef60640 1 -- 172.21.15.135:0/2067513908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f48481093a0 con 0x7f48481010a0 2024-04-20T12:23:14.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.080+0000 7f4845ffb640 1 -- 172.21.15.135:0/2067513908 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) ==== 100+0+11 (secure 0 0 0) 0x7f48400be4c0 con 0x7f48481010a0 2024-04-20T12:23:14.080 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-04-20T12:23:14.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.082+0000 7f484ef60640 1 -- 172.21.15.135:0/2067513908 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f48340a3e40 msgr2=0x7f48340a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:14.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.082+0000 7f484ef60640 1 --2- 172.21.15.135:0/2067513908 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f48340a3e40 0x7f48340a6300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4848069c60 tx=0x7f48380093e0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.082+0000 7f484ef60640 1 -- 172.21.15.135:0/2067513908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48481010a0 msgr2=0x7f4848199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:14.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.082+0000 7f484ef60640 1 --2- 172.21.15.135:0/2067513908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48481010a0 0x7f4848199600 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4840006010 tx=0x7f484002cc70 comp rx=0 tx=0).stop 2024-04-20T12:23:14.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.083+0000 7f484ef60640 1 -- 172.21.15.135:0/2067513908 shutdown_connections 2024-04-20T12:23:14.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.083+0000 7f484ef60640 1 --2- 172.21.15.135:0/2067513908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f484819a0d0 0x7f48481a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.083+0000 7f484ef60640 1 --2- 172.21.15.135:0/2067513908 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f48340a3e40 0x7f48340a6300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.083+0000 7f484ef60640 1 --2- 172.21.15.135:0/2067513908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4848106170 0x7f4848199b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.083+0000 7f484ef60640 1 --2- 172.21.15.135:0/2067513908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f48481010a0 0x7f4848199600 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.083+0000 7f484ef60640 1 -- 172.21.15.135:0/2067513908 >> 172.21.15.135:0/2067513908 conn(0x7f4848077f60 msgr2=0x7f48480fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:14.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.083+0000 7f484ef60640 1 -- 172.21.15.135:0/2067513908 shutdown_connections 2024-04-20T12:23:14.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.083+0000 7f484ef60640 1 -- 172.21.15.135:0/2067513908 wait complete. 2024-04-20T12:23:14.093 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T12:23:14.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.196+0000 7f23311f4640 1 -- 172.21.15.135:0/641462431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c107270 msgr2=0x7f232c10ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:14.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.196+0000 7f23311f4640 1 --2- 172.21.15.135:0/641462431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c107270 0x7f232c10ee40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2324009ca0 tx=0x7f232402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.196+0000 7f23311f4640 1 -- 172.21.15.135:0/641462431 shutdown_connections 2024-04-20T12:23:14.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.196+0000 7f23311f4640 1 --2- 172.21.15.135:0/641462431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c107270 0x7f232c10ee40 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.196+0000 7f23311f4640 1 --2- 172.21.15.135:0/641462431 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f232c102b50 0x7f232c106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.196+0000 7f23311f4640 1 --2- 172.21.15.135:0/641462431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232c1021a0 0x7f232c102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.196+0000 7f23311f4640 1 -- 172.21.15.135:0/641462431 >> 172.21.15.135:0/641462431 conn(0x7f232c0793b0 msgr2=0x7f232c0797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:14.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.196+0000 7f23311f4640 1 -- 172.21.15.135:0/641462431 shutdown_connections 2024-04-20T12:23:14.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.196+0000 7f23311f4640 1 -- 172.21.15.135:0/641462431 wait complete. 2024-04-20T12:23:14.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.197+0000 7f23311f4640 1 Processor -- start 2024-04-20T12:23:14.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.197+0000 7f23311f4640 1 -- start start 2024-04-20T12:23:14.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f23311f4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c1021a0 0x7f232c19e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:14.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f23311f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f232c107270 0x7f232c19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:14.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f23311f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232c198630 0x7f232c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:14.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f23311f4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f232c112330 con 0x7f232c1021a0 2024-04-20T12:23:14.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f23311f4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f232c1121b0 con 0x7f232c107270 2024-04-20T12:23:14.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f23311f4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f232c1124b0 con 0x7f232c198630 2024-04-20T12:23:14.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f232ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c1021a0 0x7f232c19e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:14.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f232ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c1021a0 0x7f232c19e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35410/0 (socket says 172.21.15.135:35410) 2024-04-20T12:23:14.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f232ad9d640 1 -- 172.21.15.135:0/635034641 learned_addr learned my addr 172.21.15.135:0/635034641 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:14.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f232a59c640 1 --2- 172.21.15.135:0/635034641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f232c107270 0x7f232c19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:14.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f232b59e640 1 --2- 172.21.15.135:0/635034641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232c198630 0x7f232c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:14.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f232ad9d640 1 -- 172.21.15.135:0/635034641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232c198630 msgr2=0x7f232c198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:14.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f232ad9d640 1 --2- 172.21.15.135:0/635034641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232c198630 0x7f232c198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f232ad9d640 1 -- 172.21.15.135:0/635034641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f232c107270 msgr2=0x7f232c19eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:14.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f232ad9d640 1 --2- 172.21.15.135:0/635034641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f232c107270 0x7f232c19eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f232ad9d640 1 -- 172.21.15.135:0/635034641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232c199230 con 0x7f232c1021a0 2024-04-20T12:23:14.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f232ad9d640 1 --2- 172.21.15.135:0/635034641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c1021a0 0x7f232c19e570 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f231c00d770 tx=0x7f231c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:14.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f2313fff640 1 -- 172.21.15.135:0/635034641 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c017070 con 0x7f232c1021a0 2024-04-20T12:23:14.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f23311f4640 1 -- 172.21.15.135:0/635034641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f232c1a5310 con 0x7f232c1021a0 2024-04-20T12:23:14.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f2313fff640 1 -- 172.21.15.135:0/635034641 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f231c005500 con 0x7f232c1021a0 2024-04-20T12:23:14.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f2313fff640 1 -- 172.21.15.135:0/635034641 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c020060 con 0x7f232c1021a0 2024-04-20T12:23:14.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.198+0000 7f23311f4640 1 -- 172.21.15.135:0/635034641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f232c1a56c0 con 0x7f232c1021a0 2024-04-20T12:23:14.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.199+0000 7f23311f4640 1 -- 172.21.15.135:0/635034641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f232c103670 con 0x7f232c1021a0 2024-04-20T12:23:14.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.200+0000 7f2313fff640 1 -- 172.21.15.135:0/635034641 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7f231c004da0 con 0x7f232c1021a0 2024-04-20T12:23:14.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.201+0000 7f2313fff640 1 --2- 172.21.15.135:0/635034641 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f23140a3e40 0x7f23140a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:14.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.201+0000 7f232a59c640 1 --2- 172.21.15.135:0/635034641 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f23140a3e40 0x7f23140a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:14.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.201+0000 7f2313fff640 1 -- 172.21.15.135:0/635034641 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f231c0d0940 con 0x7f232c1021a0 2024-04-20T12:23:14.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.201+0000 7f232a59c640 1 --2- 172.21.15.135:0/635034641 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f23140a3e40 0x7f23140a6300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f232c199e80 tx=0x7f232000b390 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:14.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.205+0000 7f2313fff640 1 -- 172.21.15.135:0/635034641 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f231c09ca10 con 0x7f232c1021a0 2024-04-20T12:23:14.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:14 smithi135 ceph-mon[18264]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-20T12:23:14.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:14 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1565936369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:23:14.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:14 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2546623621' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:23:14.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:14 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1966683085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:23:14.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:14 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2067513908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:23:14.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.385+0000 7f23311f4640 1 -- 172.21.15.135:0/635034641 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f232c0691d0 con 0x7f232c1021a0 2024-04-20T12:23:14.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.385+0000 7f2313fff640 1 -- 172.21.15.135:0/635034641 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v95) ==== 103+0+11 (secure 0 0 0) 0x7f231c09c310 con 0x7f232c1021a0 2024-04-20T12:23:14.385 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:23:14.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.387+0000 7f23311f4640 1 -- 172.21.15.135:0/635034641 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f23140a3e40 msgr2=0x7f23140a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:14.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.387+0000 7f23311f4640 1 --2- 172.21.15.135:0/635034641 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f23140a3e40 0x7f23140a6300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f232c199e80 tx=0x7f232000b390 comp rx=0 tx=0).stop 2024-04-20T12:23:14.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.387+0000 7f23311f4640 1 -- 172.21.15.135:0/635034641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c1021a0 msgr2=0x7f232c19e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:14.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.387+0000 7f23311f4640 1 --2- 172.21.15.135:0/635034641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c1021a0 0x7f232c19e570 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f231c00d770 tx=0x7f231c00dc30 comp rx=0 tx=0).stop 2024-04-20T12:23:14.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.387+0000 7f23311f4640 1 -- 172.21.15.135:0/635034641 shutdown_connections 2024-04-20T12:23:14.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.387+0000 7f23311f4640 1 --2- 172.21.15.135:0/635034641 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f23140a3e40 0x7f23140a6300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.387+0000 7f23311f4640 1 --2- 172.21.15.135:0/635034641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f232c198630 0x7f232c198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.387+0000 7f23311f4640 1 --2- 172.21.15.135:0/635034641 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f232c107270 0x7f232c19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.387+0000 7f23311f4640 1 --2- 172.21.15.135:0/635034641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f232c1021a0 0x7f232c19e570 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.387+0000 7f23311f4640 1 -- 172.21.15.135:0/635034641 >> 172.21.15.135:0/635034641 conn(0x7f232c0793b0 msgr2=0x7f232c0ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:14.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.388+0000 7f23311f4640 1 -- 172.21.15.135:0/635034641 shutdown_connections 2024-04-20T12:23:14.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.388+0000 7f23311f4640 1 -- 172.21.15.135:0/635034641 wait complete. 2024-04-20T12:23:14.399 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:23:14.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.496+0000 7fcf99104640 1 -- 172.21.15.135:0/895552276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf94107270 msgr2=0x7fcf9410ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:14.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.496+0000 7fcf99104640 1 --2- 172.21.15.135:0/895552276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf94107270 0x7fcf9410ee40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009ca0 tx=0x7fcf8c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.496+0000 7fcf99104640 1 -- 172.21.15.135:0/895552276 shutdown_connections 2024-04-20T12:23:14.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.496+0000 7fcf99104640 1 --2- 172.21.15.135:0/895552276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf94107270 0x7fcf9410ee40 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.496+0000 7fcf99104640 1 --2- 172.21.15.135:0/895552276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf94102b50 0x7fcf94106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.496+0000 7fcf99104640 1 --2- 172.21.15.135:0/895552276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf941021a0 0x7fcf94102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.496+0000 7fcf99104640 1 -- 172.21.15.135:0/895552276 >> 172.21.15.135:0/895552276 conn(0x7fcf94079320 msgr2=0x7fcf94079730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:14.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.496+0000 7fcf99104640 1 -- 172.21.15.135:0/895552276 shutdown_connections 2024-04-20T12:23:14.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.496+0000 7fcf99104640 1 -- 172.21.15.135:0/895552276 wait complete. 2024-04-20T12:23:14.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.497+0000 7fcf99104640 1 Processor -- start 2024-04-20T12:23:14.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.497+0000 7fcf99104640 1 -- start start 2024-04-20T12:23:14.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.497+0000 7fcf99104640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf941021a0 0x7fcf9419e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:14.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.497+0000 7fcf99104640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf94107270 0x7fcf9419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:14.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.497+0000 7fcf99104640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf941986b0 0x7fcf94198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:14.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.497+0000 7fcf99104640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcf94112330 con 0x7fcf941986b0 2024-04-20T12:23:14.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.497+0000 7fcf99104640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcf941121b0 con 0x7fcf941021a0 2024-04-20T12:23:14.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.497+0000 7fcf99104640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcf941124b0 con 0x7fcf94107270 2024-04-20T12:23:14.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.497+0000 7fcf9359e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf941986b0 0x7fcf94198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:14.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.497+0000 7fcf9359e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf941986b0 0x7fcf94198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35424/0 (socket says 172.21.15.135:35424) 2024-04-20T12:23:14.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.497+0000 7fcf9359e640 1 -- 172.21.15.135:0/2730415318 learned_addr learned my addr 172.21.15.135:0/2730415318 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:14.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.498+0000 7fcf92d9d640 1 --2- 172.21.15.135:0/2730415318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf941021a0 0x7fcf9419e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:14.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.498+0000 7fcf8bfff640 1 --2- 172.21.15.135:0/2730415318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf94107270 0x7fcf9419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:14.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.498+0000 7fcf9359e640 1 -- 172.21.15.135:0/2730415318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf94107270 msgr2=0x7fcf9419eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:14.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.498+0000 7fcf9359e640 1 --2- 172.21.15.135:0/2730415318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf94107270 0x7fcf9419eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.498+0000 7fcf9359e640 1 -- 172.21.15.135:0/2730415318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf941021a0 msgr2=0x7fcf9419e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:14.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.498+0000 7fcf9359e640 1 --2- 172.21.15.135:0/2730415318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf941021a0 0x7fcf9419e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.498+0000 7fcf9359e640 1 -- 172.21.15.135:0/2730415318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf941992b0 con 0x7fcf941986b0 2024-04-20T12:23:14.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.498+0000 7fcf8bfff640 1 --2- 172.21.15.135:0/2730415318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf94107270 0x7fcf9419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:14.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.498+0000 7fcf9359e640 1 --2- 172.21.15.135:0/2730415318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf941986b0 0x7fcf94198b30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c02c700 tx=0x7fcf8c032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:14.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.498+0000 7fcf90d99640 1 -- 172.21.15.135:0/2730415318 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c041020 con 0x7fcf941986b0 2024-04-20T12:23:14.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.498+0000 7fcf99104640 1 -- 172.21.15.135:0/2730415318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf94199540 con 0x7fcf941986b0 2024-04-20T12:23:14.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.498+0000 7fcf90d99640 1 -- 172.21.15.135:0/2730415318 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf8c034cd0 con 0x7fcf941986b0 2024-04-20T12:23:14.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.498+0000 7fcf99104640 1 -- 172.21.15.135:0/2730415318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf941a5680 con 0x7fcf941986b0 2024-04-20T12:23:14.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.498+0000 7fcf90d99640 1 -- 172.21.15.135:0/2730415318 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c039040 con 0x7fcf941986b0 2024-04-20T12:23:14.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.499+0000 7fcf99104640 1 -- 172.21.15.135:0/2730415318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf94103670 con 0x7fcf941986b0 2024-04-20T12:23:14.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:14 smithi154 ceph-mon[22073]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-20T12:23:14.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:14 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1565936369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:23:14.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:14 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2546623621' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:23:14.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:14 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1966683085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:23:14.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:14 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2067513908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:23:14.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.500+0000 7fcf90d99640 1 -- 172.21.15.135:0/2730415318 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7fcf8c044020 con 0x7fcf941986b0 2024-04-20T12:23:14.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.501+0000 7fcf90d99640 1 --2- 172.21.15.135:0/2730415318 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcf800a3e40 0x7fcf800a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:14.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.501+0000 7fcf92d9d640 1 --2- 172.21.15.135:0/2730415318 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcf800a3e40 0x7fcf800a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:14.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.501+0000 7fcf90d99640 1 -- 172.21.15.135:0/2730415318 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fcf8c0f2a80 con 0x7fcf941986b0 2024-04-20T12:23:14.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.501+0000 7fcf92d9d640 1 --2- 172.21.15.135:0/2730415318 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcf800a3e40 0x7fcf800a6300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009bd0 tx=0x7fcf84005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:14.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.505+0000 7fcf90d99640 1 -- 172.21.15.135:0/2730415318 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fcf8c04b020 con 0x7fcf941986b0 2024-04-20T12:23:14.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:14 smithi139 ceph-mon[21834]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 1 op/s 2024-04-20T12:23:14.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:14 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1565936369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:23:14.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:14 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2546623621' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:23:14.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:14 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1966683085' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:23:14.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:14 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2067513908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:23:14.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.722+0000 7fcf99104640 1 -- 172.21.15.135:0/2730415318 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf94102b50 con 0x7fcf941986b0 2024-04-20T12:23:14.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.723+0000 7fcf90d99640 1 -- 172.21.15.135:0/2730415318 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7fcf8c0bec60 con 0x7fcf941986b0 2024-04-20T12:23:14.723 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:23:14.723 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:23:14.723 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:23:14.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.725+0000 7fcf99104640 1 -- 172.21.15.135:0/2730415318 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcf800a3e40 msgr2=0x7fcf800a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:14.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.725+0000 7fcf99104640 1 --2- 172.21.15.135:0/2730415318 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcf800a3e40 0x7fcf800a6300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009bd0 tx=0x7fcf84005f90 comp rx=0 tx=0).stop 2024-04-20T12:23:14.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.725+0000 7fcf99104640 1 -- 172.21.15.135:0/2730415318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf941986b0 msgr2=0x7fcf94198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:14.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.725+0000 7fcf99104640 1 --2- 172.21.15.135:0/2730415318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf941986b0 0x7fcf94198b30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c02c700 tx=0x7fcf8c032f20 comp rx=0 tx=0).stop 2024-04-20T12:23:14.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.725+0000 7fcf99104640 1 -- 172.21.15.135:0/2730415318 shutdown_connections 2024-04-20T12:23:14.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.725+0000 7fcf99104640 1 --2- 172.21.15.135:0/2730415318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf941986b0 0x7fcf94198b30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.725+0000 7fcf99104640 1 --2- 172.21.15.135:0/2730415318 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcf800a3e40 0x7fcf800a6300 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.725+0000 7fcf99104640 1 --2- 172.21.15.135:0/2730415318 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf94107270 0x7fcf9419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.725+0000 7fcf99104640 1 --2- 172.21.15.135:0/2730415318 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcf941021a0 0x7fcf9419e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.725+0000 7fcf99104640 1 -- 172.21.15.135:0/2730415318 >> 172.21.15.135:0/2730415318 conn(0x7fcf94079320 msgr2=0x7fcf941000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:14.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.725+0000 7fcf99104640 1 -- 172.21.15.135:0/2730415318 shutdown_connections 2024-04-20T12:23:14.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.725+0000 7fcf99104640 1 -- 172.21.15.135:0/2730415318 wait complete. 2024-04-20T12:23:14.736 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:23:14.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.834+0000 7f7b97159640 1 -- 172.21.15.135:0/1581258718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b90101a60 msgr2=0x7f7b90105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:14.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.834+0000 7f7b97159640 1 --2- 172.21.15.135:0/1581258718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b90101a60 0x7f7b90105aa0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009900 tx=0x7f7b8402bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:14.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.834+0000 7f7b97159640 1 -- 172.21.15.135:0/1581258718 shutdown_connections 2024-04-20T12:23:14.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.834+0000 7f7b97159640 1 --2- 172.21.15.135:0/1581258718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b90106180 0x7f7b9010dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.834+0000 7f7b97159640 1 --2- 172.21.15.135:0/1581258718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b90101a60 0x7f7b90105aa0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.834+0000 7f7b97159640 1 --2- 172.21.15.135:0/1581258718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b901010b0 0x7f7b90101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.834+0000 7f7b97159640 1 -- 172.21.15.135:0/1581258718 >> 172.21.15.135:0/1581258718 conn(0x7f7b90077f60 msgr2=0x7f7b90078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:14.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.835+0000 7f7b97159640 1 -- 172.21.15.135:0/1581258718 shutdown_connections 2024-04-20T12:23:14.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.835+0000 7f7b97159640 1 -- 172.21.15.135:0/1581258718 wait complete. 2024-04-20T12:23:14.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.835+0000 7f7b97159640 1 Processor -- start 2024-04-20T12:23:14.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.835+0000 7f7b97159640 1 -- start start 2024-04-20T12:23:14.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.835+0000 7f7b97159640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b901010b0 0x7f7b9019e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:14.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.835+0000 7f7b97159640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b90106180 0x7f7b9019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:14.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.835+0000 7f7b97159640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b90198590 0x7f7b90198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:14.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.835+0000 7f7b97159640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b90111210 con 0x7f7b90198590 2024-04-20T12:23:14.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.835+0000 7f7b97159640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7b90111090 con 0x7f7b901010b0 2024-04-20T12:23:14.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.835+0000 7f7b97159640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b90111390 con 0x7f7b90106180 2024-04-20T12:23:14.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.835+0000 7f7b956f6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b90198590 0x7f7b90198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:14.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.835+0000 7f7b956f6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b90198590 0x7f7b90198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35454/0 (socket says 172.21.15.135:35454) 2024-04-20T12:23:14.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.835+0000 7f7b956f6640 1 -- 172.21.15.135:0/1715534359 learned_addr learned my addr 172.21.15.135:0/1715534359 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:14.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.836+0000 7f7b8ffff640 1 --2- 172.21.15.135:0/1715534359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b90106180 0x7f7b9019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:14.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.836+0000 7f7b94ef5640 1 --2- 172.21.15.135:0/1715534359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b901010b0 0x7f7b9019e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:14.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.836+0000 7f7b956f6640 1 -- 172.21.15.135:0/1715534359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b90106180 msgr2=0x7f7b9019e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:14.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.836+0000 7f7b956f6640 1 --2- 172.21.15.135:0/1715534359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b90106180 0x7f7b9019e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.836+0000 7f7b956f6640 1 -- 172.21.15.135:0/1715534359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b901010b0 msgr2=0x7f7b9019e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:14.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.836+0000 7f7b956f6640 1 --2- 172.21.15.135:0/1715534359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b901010b0 0x7f7b9019e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:14.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.836+0000 7f7b956f6640 1 -- 172.21.15.135:0/1715534359 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b901990b0 con 0x7f7b90198590 2024-04-20T12:23:14.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.836+0000 7f7b8ffff640 1 --2- 172.21.15.135:0/1715534359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b90106180 0x7f7b9019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:14.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.836+0000 7f7b956f6640 1 --2- 172.21.15.135:0/1715534359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b90198590 0x7f7b90198a40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800cce0 tx=0x7f7b8800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:14.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.836+0000 7f7b8dffb640 1 -- 172.21.15.135:0/1715534359 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b8800f450 con 0x7f7b90198590 2024-04-20T12:23:14.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.836+0000 7f7b8dffb640 1 -- 172.21.15.135:0/1715534359 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7b8800fad0 con 0x7f7b90198590 2024-04-20T12:23:14.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.836+0000 7f7b97159640 1 -- 172.21.15.135:0/1715534359 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b901993a0 con 0x7f7b90198590 2024-04-20T12:23:14.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.836+0000 7f7b8dffb640 1 -- 172.21.15.135:0/1715534359 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b88018c10 con 0x7f7b90198590 2024-04-20T12:23:14.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.836+0000 7f7b97159640 1 -- 172.21.15.135:0/1715534359 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b901a55a0 con 0x7f7b90198590 2024-04-20T12:23:14.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.837+0000 7f7b97159640 1 -- 172.21.15.135:0/1715534359 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b90068d80 con 0x7f7b90198590 2024-04-20T12:23:14.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.838+0000 7f7b8dffb640 1 -- 172.21.15.135:0/1715534359 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7f7b8800f5f0 con 0x7f7b90198590 2024-04-20T12:23:14.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.839+0000 7f7b8dffb640 1 --2- 172.21.15.135:0/1715534359 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7b780a3e40 0x7f7b780a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:14.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.839+0000 7f7b8dffb640 1 -- 172.21.15.135:0/1715534359 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f7b880d1460 con 0x7f7b90198590 2024-04-20T12:23:14.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.839+0000 7f7b94ef5640 1 --2- 172.21.15.135:0/1715534359 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7b780a3e40 0x7f7b780a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:14.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.839+0000 7f7b94ef5640 1 --2- 172.21.15.135:0/1715534359 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7b780a3e40 0x7f7b780a6300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b80005fd0 tx=0x7f7b80005850 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:14.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:14.843+0000 7f7b8dffb640 1 -- 172.21.15.135:0/1715534359 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f7b88014030 con 0x7f7b90198590 2024-04-20T12:23:15.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.022+0000 7f7b97159640 1 -- 172.21.15.135:0/1715534359 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b90199ac0 con 0x7f7b90198590 2024-04-20T12:23:15.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.023+0000 7f7b8dffb640 1 -- 172.21.15.135:0/1715534359 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+25197 (secure 0 0 0) 0x7f7b90199ac0 con 0x7f7b90198590 2024-04-20T12:23:15.023 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:23:15.024 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":95,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:23:07.080106+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2052292307":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/669936771":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/4276159294":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6800/3831149339":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/1087722944":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6801/3831149339":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:23:15.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.026+0000 7f7b97159640 1 -- 172.21.15.135:0/1715534359 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7b780a3e40 msgr2=0x7f7b780a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.026+0000 7f7b97159640 1 --2- 172.21.15.135:0/1715534359 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7b780a3e40 0x7f7b780a6300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b80005fd0 tx=0x7f7b80005850 comp rx=0 tx=0).stop 2024-04-20T12:23:15.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.026+0000 7f7b97159640 1 -- 172.21.15.135:0/1715534359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b90198590 msgr2=0x7f7b90198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.026+0000 7f7b97159640 1 --2- 172.21.15.135:0/1715534359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b90198590 0x7f7b90198a40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800cce0 tx=0x7f7b8800a620 comp rx=0 tx=0).stop 2024-04-20T12:23:15.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.026+0000 7f7b97159640 1 -- 172.21.15.135:0/1715534359 shutdown_connections 2024-04-20T12:23:15.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.026+0000 7f7b97159640 1 --2- 172.21.15.135:0/1715534359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b90198590 0x7f7b90198a40 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.026+0000 7f7b97159640 1 --2- 172.21.15.135:0/1715534359 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7b780a3e40 0x7f7b780a6300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.026+0000 7f7b97159640 1 --2- 172.21.15.135:0/1715534359 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b90106180 0x7f7b9019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.026+0000 7f7b97159640 1 --2- 172.21.15.135:0/1715534359 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b901010b0 0x7f7b9019e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.026+0000 7f7b97159640 1 -- 172.21.15.135:0/1715534359 >> 172.21.15.135:0/1715534359 conn(0x7f7b90077f60 msgr2=0x7f7b90069400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.026+0000 7f7b97159640 1 -- 172.21.15.135:0/1715534359 shutdown_connections 2024-04-20T12:23:15.027 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.026+0000 7f7b97159640 1 -- 172.21.15.135:0/1715534359 wait complete. 2024-04-20T12:23:15.037 DEBUG:tasks.fwd_scrub:Yielding 2024-04-20T12:23:15.037 INFO:teuthology.run_tasks:Running task exec... 2024-04-20T12:23:15.047 INFO:teuthology.task.exec:Executing custom commands... 2024-04-20T12:23:15.047 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-04-20T12:23:15.047 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-04-20T12:23:15.047 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-04-20T12:23:15.047 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:23:15.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:23:15.048 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:23:15.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.152+0000 7fb55f2f2640 1 -- 172.21.15.135:0/119155330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb558106690 msgr2=0x7fb558106a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.152+0000 7fb55f2f2640 1 --2- 172.21.15.135:0/119155330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb558106690 0x7fb558106a70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb550009ca0 tx=0x7fb55002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.152+0000 7fb55f2f2640 1 -- 172.21.15.135:0/119155330 shutdown_connections 2024-04-20T12:23:15.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.152+0000 7fb55f2f2640 1 --2- 172.21.15.135:0/119155330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb558100f90 0x7fb55810d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.152+0000 7fb55f2f2640 1 --2- 172.21.15.135:0/119155330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb5581005d0 0x7fb558100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.152+0000 7fb55f2f2640 1 --2- 172.21.15.135:0/119155330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb558106690 0x7fb558106a70 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.152+0000 7fb55f2f2640 1 -- 172.21.15.135:0/119155330 >> 172.21.15.135:0/119155330 conn(0x7fb5580773f0 msgr2=0x7fb5580fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.152+0000 7fb55f2f2640 1 -- 172.21.15.135:0/119155330 shutdown_connections 2024-04-20T12:23:15.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.152+0000 7fb55f2f2640 1 -- 172.21.15.135:0/119155330 wait complete. 2024-04-20T12:23:15.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55f2f2640 1 Processor -- start 2024-04-20T12:23:15.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55f2f2640 1 -- start start 2024-04-20T12:23:15.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7f92ac75f640 1 -- 172.21.15.135:0/3813511405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a4101aa0 msgr2=0x7f92a4105ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7f92ac75f640 1 --2- 172.21.15.135:0/3813511405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a4101aa0 0x7f92a4105ae0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9294009900 tx=0x7f929402bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:15.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55f2f2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5581005d0 0x7fb55810ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7f92ac75f640 1 -- 172.21.15.135:0/3813511405 shutdown_connections 2024-04-20T12:23:15.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7f92ac75f640 1 --2- 172.21.15.135:0/3813511405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92a41061c0 0x7f92a410dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7f92ac75f640 1 --2- 172.21.15.135:0/3813511405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a4101aa0 0x7f92a4105ae0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55f2f2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb558100f90 0x7fb55810f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7f92ac75f640 1 --2- 172.21.15.135:0/3813511405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a41010f0 0x7f92a41014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7f92ac75f640 1 -- 172.21.15.135:0/3813511405 >> 172.21.15.135:0/3813511405 conn(0x7f92a40771e0 msgr2=0x7f92a40775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55f2f2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb558106690 0x7fb55810f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55f2f2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581123a0 con 0x7fb558100f90 2024-04-20T12:23:15.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55f2f2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb558112220 con 0x7fb558106690 2024-04-20T12:23:15.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55f2f2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb558112520 con 0x7fb5581005d0 2024-04-20T12:23:15.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7f92ac75f640 1 -- 172.21.15.135:0/3813511405 shutdown_connections 2024-04-20T12:23:15.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7f92ac75f640 1 -- 172.21.15.135:0/3813511405 wait complete. 2024-04-20T12:23:15.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55c88d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb558100f90 0x7fb55810f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55c88d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb558100f90 0x7fb55810f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35492/0 (socket says 172.21.15.135:35492) 2024-04-20T12:23:15.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55c88d640 1 -- 172.21.15.135:0/390467675 learned_addr learned my addr 172.21.15.135:0/390467675 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:15.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55d08e640 1 --2- 172.21.15.135:0/390467675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5581005d0 0x7fb55810ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55d88f640 1 --2- 172.21.15.135:0/390467675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb558106690 0x7fb55810f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55c88d640 1 -- 172.21.15.135:0/390467675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5581005d0 msgr2=0x7fb55810ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55c88d640 1 --2- 172.21.15.135:0/390467675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5581005d0 0x7fb55810ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55c88d640 1 -- 172.21.15.135:0/390467675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb558106690 msgr2=0x7fb55810f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55c88d640 1 --2- 172.21.15.135:0/390467675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb558106690 0x7fb55810f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7fb55c88d640 1 -- 172.21.15.135:0/390467675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5581a6c80 con 0x7fb558100f90 2024-04-20T12:23:15.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.153+0000 7f92ac75f640 1 Processor -- start 2024-04-20T12:23:15.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92ac75f640 1 -- start start 2024-04-20T12:23:15.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7fb55c88d640 1 --2- 172.21.15.135:0/390467675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb558100f90 0x7fb55810f230 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb54800c890 tx=0x7fb54800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7fb54e7fc640 1 -- 172.21.15.135:0/390467675 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb548004220 con 0x7fb558100f90 2024-04-20T12:23:15.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92ac75f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a41010f0 0x7f92a419e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7fb54e7fc640 1 -- 172.21.15.135:0/390467675 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5480043c0 con 0x7fb558100f90 2024-04-20T12:23:15.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7fb55f2f2640 1 -- 172.21.15.135:0/390467675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5581a6f70 con 0x7fb558100f90 2024-04-20T12:23:15.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92ac75f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a41061c0 0x7f92a419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7fb54e7fc640 1 -- 172.21.15.135:0/390467675 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5480049e0 con 0x7fb558100f90 2024-04-20T12:23:15.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7fb55f2f2640 1 -- 172.21.15.135:0/390467675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5581a7430 con 0x7fb558100f90 2024-04-20T12:23:15.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92a9cfa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a41061c0 0x7f92a419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92a9cfa640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a41061c0 0x7f92a419eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35496/0 (socket says 172.21.15.135:35496) 2024-04-20T12:23:15.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92ac75f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92a4198660 0x7f92a4198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92aa4fb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a41010f0 0x7f92a419e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92a9cfa640 1 -- 172.21.15.135:0/1294165743 learned_addr learned my addr 172.21.15.135:0/1294165743 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:15.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92ac75f640 1 -- 172.21.15.135:0/1294165743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f92a41112b0 con 0x7f92a41061c0 2024-04-20T12:23:15.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92ac75f640 1 -- 172.21.15.135:0/1294165743 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f92a4111130 con 0x7f92a4198660 2024-04-20T12:23:15.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92ac75f640 1 -- 172.21.15.135:0/1294165743 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f92a4111430 con 0x7f92a41010f0 2024-04-20T12:23:15.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92a9cfa640 1 -- 172.21.15.135:0/1294165743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a41010f0 msgr2=0x7f92a419e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92a9cfa640 1 --2- 172.21.15.135:0/1294165743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a41010f0 0x7f92a419e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92a9cfa640 1 -- 172.21.15.135:0/1294165743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92a4198660 msgr2=0x7f92a4198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92a9cfa640 1 --2- 172.21.15.135:0/1294165743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92a4198660 0x7f92a4198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92a9cfa640 1 -- 172.21.15.135:0/1294165743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a4199260 con 0x7f92a41061c0 2024-04-20T12:23:15.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.154+0000 7f92aa4fb640 1 --2- 172.21.15.135:0/1294165743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a41010f0 0x7f92a419e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:15.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.155+0000 7f92a9cfa640 1 --2- 172.21.15.135:0/1294165743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a41061c0 0x7f92a419eae0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9294036040 tx=0x7f929402ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.155+0000 7f929b7fe640 1 -- 172.21.15.135:0/1294165743 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294041070 con 0x7f92a41061c0 2024-04-20T12:23:15.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.155+0000 7f929b7fe640 1 -- 172.21.15.135:0/1294165743 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9294004450 con 0x7f92a41061c0 2024-04-20T12:23:15.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.155+0000 7f92ac75f640 1 -- 172.21.15.135:0/1294165743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a41994f0 con 0x7f92a41061c0 2024-04-20T12:23:15.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.155+0000 7f929b7fe640 1 -- 172.21.15.135:0/1294165743 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9294003e20 con 0x7f92a41061c0 2024-04-20T12:23:15.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.155+0000 7f92ac75f640 1 -- 172.21.15.135:0/1294165743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a41a5680 con 0x7f92a41061c0 2024-04-20T12:23:15.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7f92ac75f640 1 -- 172.21.15.135:0/1294165743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a41025c0 con 0x7f92a41061c0 2024-04-20T12:23:15.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7fb54e7fc640 1 -- 172.21.15.135:0/390467675 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7fb5480079b0 con 0x7fb558100f90 2024-04-20T12:23:15.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7fb561fc1740 1 Processor -- start 2024-04-20T12:23:15.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7fb561fc1740 1 -- start start 2024-04-20T12:23:15.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7fb561fc1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd49c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7fb561fc1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd49c900 0x55effd4a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7fb561fc1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd4a54e0 0x55effd4a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7fb561fc1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55effd400f00 con 0x55effd49bfe0 2024-04-20T12:23:15.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7fb561fc1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55effd39e530 con 0x55effd49c900 2024-04-20T12:23:15.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7fb561fc1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55effd3fcec0 con 0x55effd4a54e0 2024-04-20T12:23:15.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7fb55d88f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd49c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7fb55d88f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd49c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35500/0 (socket says 172.21.15.135:35500) 2024-04-20T12:23:15.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7fb55d88f640 1 -- 172.21.15.135:0/3885989279 learned_addr learned my addr 172.21.15.135:0/3885989279 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:15.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7fb54e7fc640 1 --2- 172.21.15.135:0/390467675 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5440a3e70 0x7fb5440a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7fb55c88d640 1 --2- 172.21.15.135:0/3885989279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd4a54e0 0x55effd4a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.157+0000 7fb55d08e640 1 --2- 172.21.15.135:0/3885989279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd49c900 0x55effd4a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.158+0000 7fb55d88f640 1 -- 172.21.15.135:0/3885989279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd4a54e0 msgr2=0x55effd4a78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.158+0000 7fb55d88f640 1 --2- 172.21.15.135:0/3885989279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd4a54e0 0x55effd4a78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.158+0000 7fb55d88f640 1 -- 172.21.15.135:0/3885989279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd49c900 msgr2=0x55effd4a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.158+0000 7fb55d88f640 1 --2- 172.21.15.135:0/3885989279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd49c900 0x55effd4a4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.158+0000 7fb55d88f640 1 -- 172.21.15.135:0/3885989279 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effd1db7e0 con 0x55effd49bfe0 2024-04-20T12:23:15.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.158+0000 7fb55d08e640 1 --2- 172.21.15.135:0/3885989279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd49c900 0x55effd4a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:15.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.158+0000 7fb54e7fc640 1 -- 172.21.15.135:0/390467675 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fb5480d0e10 con 0x7fb558100f90 2024-04-20T12:23:15.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.158+0000 7fb55d88f640 1 --2- 172.21.15.135:0/390467675 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5440a3e70 0x7fb5440a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.158+0000 7fb55d88f640 1 --2- 172.21.15.135:0/3885989279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd49c3c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb55400cc40 tx=0x7fb55400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca15d143946767ca server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.158+0000 7f929b7fe640 1 -- 172.21.15.135:0/1294165743 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7f9294044070 con 0x7f92a41061c0 2024-04-20T12:23:15.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.158+0000 7fb5437fe640 1 -- 172.21.15.135:0/3885989279 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb554022070 con 0x55effd49bfe0 2024-04-20T12:23:15.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.158+0000 7fb5437fe640 1 -- 172.21.15.135:0/3885989279 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb554018070 con 0x55effd49bfe0 2024-04-20T12:23:15.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.158+0000 7fb5437fe640 1 -- 172.21.15.135:0/3885989279 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55401c990 con 0x55effd49bfe0 2024-04-20T12:23:15.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.158+0000 7fb55d88f640 1 --2- 172.21.15.135:0/390467675 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5440a3e70 0x7fb5440a6330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb55401f000 tx=0x7fb554020000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.158+0000 7f929b7fe640 1 --2- 172.21.15.135:0/1294165743 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f92900a3f60 0x7f92900a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.159+0000 7f92aa4fb640 1 --2- 172.21.15.135:0/1294165743 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f92900a3f60 0x7f92900a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.159+0000 7f929b7fe640 1 -- 172.21.15.135:0/1294165743 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f92940f2900 con 0x7f92a41061c0 2024-04-20T12:23:15.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.159+0000 7fb561fc1740 1 -- 172.21.15.135:0/3885989279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 msgr2=0x55effd49c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.159+0000 7fb561fc1740 1 --2- 172.21.15.135:0/3885989279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd49c3c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb55400cc40 tx=0x7fb55400e720 comp rx=0 tx=0).stop 2024-04-20T12:23:15.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.159+0000 7fb561fc1740 1 -- 172.21.15.135:0/3885989279 shutdown_connections 2024-04-20T12:23:15.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.159+0000 7fb561fc1740 1 --2- 172.21.15.135:0/3885989279 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd4a54e0 0x55effd4a78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.159+0000 7fb561fc1740 1 --2- 172.21.15.135:0/3885989279 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd49c900 0x55effd4a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.159+0000 7fb561fc1740 1 --2- 172.21.15.135:0/3885989279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd49c3c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.159+0000 7fb561fc1740 1 -- 172.21.15.135:0/3885989279 >> 172.21.15.135:0/3885989279 conn(0x55effd496710 msgr2=0x55effd496af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.159+0000 7f92aa4fb640 1 --2- 172.21.15.135:0/1294165743 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f92900a3f60 0x7f92900a6420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009d60 tx=0x7f92a0009110 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.159+0000 7fb561fc1740 1 -- 172.21.15.135:0/3885989279 shutdown_connections 2024-04-20T12:23:15.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.159+0000 7fb561fc1740 1 -- 172.21.15.135:0/3885989279 wait complete. 2024-04-20T12:23:15.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.159+0000 7fb561fc1740 1 -- start start 2024-04-20T12:23:15.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.159+0000 7fb561fc1740 1 Processor -- start 2024-04-20T12:23:15.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb561fc1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb561fc1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd49c900 0x55effd4a2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb561fc1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd4a54e0 0x55effd4a2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb561fc1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55effd4a82d0 con 0x55effd49bfe0 2024-04-20T12:23:15.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb561fc1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55effd389480 con 0x55effd4a54e0 2024-04-20T12:23:15.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb561fc1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55effd4a8450 con 0x55effd49c900 2024-04-20T12:23:15.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb561fc1740 10 client.0 _ll_register_callbacks cb 0x55effd388e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:15.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb55d08e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb55d08e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4a4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35512/0 (socket says 172.21.15.135:35512) 2024-04-20T12:23:15.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb55d08e640 1 -- 172.21.15.135:0/4011082244 learned_addr learned my addr 172.21.15.135:0/4011082244 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:15.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb55c88d640 1 --2- 172.21.15.135:0/4011082244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd49c900 0x55effd4a2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb55d88f640 1 --2- 172.21.15.135:0/4011082244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd4a54e0 0x55effd4a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb55d08e640 1 -- 172.21.15.135:0/4011082244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd49c900 msgr2=0x55effd4a2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb55d08e640 1 --2- 172.21.15.135:0/4011082244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd49c900 0x55effd4a2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb55d08e640 1 -- 172.21.15.135:0/4011082244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd4a54e0 msgr2=0x55effd4a2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb55d08e640 1 --2- 172.21.15.135:0/4011082244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd4a54e0 0x55effd4a2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb55d08e640 1 -- 172.21.15.135:0/4011082244 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55effd23bf70 con 0x55effd49bfe0 2024-04-20T12:23:15.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb55d88f640 1 --2- 172.21.15.135:0/4011082244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd4a54e0 0x55effd4a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:15.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb55d08e640 1 --2- 172.21.15.135:0/4011082244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4a4ea0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb550037040 tx=0x7fb550032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67bfb44316e7e45 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.160+0000 7fb540ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:15.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.163+0000 7fb540ff9640 1 -- 172.21.15.135:0/4011082244 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550044070 con 0x55effd49bfe0 2024-04-20T12:23:15.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.163+0000 7fb540ff9640 1 -- 172.21.15.135:0/4011082244 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fb5500329a0 con 0x55effd49bfe0 2024-04-20T12:23:15.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.163+0000 7fb561fc1740 1 -- 172.21.15.135:0/4011082244 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb554018070 con 0x55effd49bfe0 2024-04-20T12:23:15.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.163+0000 7f929b7fe640 1 -- 172.21.15.135:0/1294165743 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f92940beb70 con 0x7f92a41061c0 2024-04-20T12:23:15.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.163+0000 7fb540ff9640 1 -- 172.21.15.135:0/4011082244 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb550050050 con 0x55effd49bfe0 2024-04-20T12:23:15.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.163+0000 7fb561fc1740 10 client.15765 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:15.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.164+0000 7fb561fc1740 1 -- 172.21.15.135:0/4011082244 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55effd0d3170 con 0x55effd49bfe0 2024-04-20T12:23:15.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.164+0000 7fb540ff9640 1 -- 172.21.15.135:0/4011082244 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb554018070 con 0x55effd49bfe0 2024-04-20T12:23:15.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.164+0000 7fb540ff9640 1 -- 172.21.15.135:0/4011082244 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fb550040460 con 0x55effd49bfe0 2024-04-20T12:23:15.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.164+0000 7fb561fc1740 10 client.15765 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:15.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.164+0000 7fb561fc1740 10 client.15765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:15.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.164+0000 7fb561fc1740 20 client.15765 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:15.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.164+0000 7fb561fc1740 1 --2- 172.21.15.135:0/4011082244 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55effd4b54e0 0x55effd4b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.164+0000 7fb561fc1740 4 client.15765 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:23:15.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.164+0000 7fb561fc1740 1 -- 172.21.15.135:0/4011082244 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55effd40e920 con 0x55effd4b54e0 2024-04-20T12:23:15.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.164+0000 7fb55c88d640 1 --2- 172.21.15.135:0/4011082244 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55effd4b54e0 0x55effd4b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.165+0000 7fb540ff9640 10 client.15765 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:15.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.165+0000 7fb55c88d640 1 --2- 172.21.15.135:0/4011082244 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55effd4b54e0 0x55effd4b7960 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ccd1bf8a89b94b5 server_cookie=6397d5bcfc452e09 in_seq=0 out_seq=0 2024-04-20T12:23:15.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.165+0000 7fb540ff9640 1 -- 172.21.15.135:0/4011082244 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55effd40e920 con 0x55effd4b54e0 2024-04-20T12:23:15.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.165+0000 7fb540ff9640 10 client.15765 handle_command_reply: tid=0 2024-04-20T12:23:15.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.165+0000 7fb561fc1740 1 client.15765 shutdown 2024-04-20T12:23:15.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.165+0000 7fb561fc1740 1 -- 172.21.15.135:0/4011082244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 msgr2=0x55effd4a4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.165+0000 7fb561fc1740 1 --2- 172.21.15.135:0/4011082244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4a4ea0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb550037040 tx=0x7fb550032df0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.166+0000 7fb561fc1740 1 -- 172.21.15.135:0/4011082244 shutdown_connections 2024-04-20T12:23:15.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.166+0000 7fb561fc1740 1 --2- 172.21.15.135:0/4011082244 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55effd4b54e0 0x55effd4b7960 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.166+0000 7fb561fc1740 1 --2- 172.21.15.135:0/4011082244 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd4a54e0 0x55effd4a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.166+0000 7fb540ff9640 0 client.15765 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:15.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.166+0000 7fb561fc1740 1 --2- 172.21.15.135:0/4011082244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd49c900 0x55effd4a2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.166+0000 7fb561fc1740 1 --2- 172.21.15.135:0/4011082244 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4a4ea0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.166+0000 7fb561fc1740 1 -- 172.21.15.135:0/4011082244 >> 172.21.15.135:0/4011082244 conn(0x55effd496710 msgr2=0x55effd498460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.166+0000 7fb561fc1740 1 -- 172.21.15.135:0/4011082244 shutdown_connections 2024-04-20T12:23:15.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.166+0000 7fb561fc1740 1 -- 172.21.15.135:0/4011082244 wait complete. 2024-04-20T12:23:15.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.166+0000 7fb561fc1740 20 client.15765 trim_cache size 0 max 16384 2024-04-20T12:23:15.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.183+0000 7fb561fc1740 1 Processor -- start 2024-04-20T12:23:15.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.183+0000 7fb561fc1740 1 -- start start 2024-04-20T12:23:15.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.183+0000 7fb561fc1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4a10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.183+0000 7fb561fc1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd49c900 0x55effd4a4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.183+0000 7fb561fc1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd4a54e0 0x55effd4a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.183+0000 7fb561fc1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581b1610 con 0x55effd49bfe0 2024-04-20T12:23:15.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.183+0000 7fb561fc1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581b3150 con 0x55effd49c900 2024-04-20T12:23:15.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.183+0000 7fb561fc1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581b1ce0 con 0x55effd4a54e0 2024-04-20T12:23:15.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.183+0000 7fb55d08e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4a10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.183+0000 7fb55d08e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4a10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35516/0 (socket says 172.21.15.135:35516) 2024-04-20T12:23:15.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.183+0000 7fb55d08e640 1 -- 172.21.15.135:0/657077593 learned_addr learned my addr 172.21.15.135:0/657077593 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:15.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.184+0000 7fb55c88d640 1 --2- 172.21.15.135:0/657077593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd49c900 0x55effd4a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.184+0000 7fb55d88f640 1 --2- 172.21.15.135:0/657077593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd4a54e0 0x55effd4a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.184+0000 7fb55d08e640 1 -- 172.21.15.135:0/657077593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd4a54e0 msgr2=0x55effd4a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.184+0000 7fb55d08e640 1 --2- 172.21.15.135:0/657077593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd4a54e0 0x55effd4a4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.184+0000 7fb55d08e640 1 -- 172.21.15.135:0/657077593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd49c900 msgr2=0x55effd4a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.184+0000 7fb55d08e640 1 --2- 172.21.15.135:0/657077593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd49c900 0x55effd4a4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.184+0000 7fb55d08e640 1 -- 172.21.15.135:0/657077593 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effd49b0d0 con 0x55effd49bfe0 2024-04-20T12:23:15.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.184+0000 7fb55d08e640 1 --2- 172.21.15.135:0/657077593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4a10e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb550000f80 tx=0x7fb55002c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568da7e201dc8cb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.184+0000 7fb542ffd640 1 -- 172.21.15.135:0/657077593 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550059070 con 0x55effd49bfe0 2024-04-20T12:23:15.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.184+0000 7fb542ffd640 1 -- 172.21.15.135:0/657077593 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb550040660 con 0x55effd49bfe0 2024-04-20T12:23:15.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.184+0000 7fb542ffd640 1 -- 172.21.15.135:0/657077593 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550044050 con 0x55effd49bfe0 2024-04-20T12:23:15.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.185+0000 7fb561fc1740 1 -- 172.21.15.135:0/657077593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 msgr2=0x55effd4a10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.185+0000 7fb561fc1740 1 --2- 172.21.15.135:0/657077593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4a10e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb550000f80 tx=0x7fb55002c770 comp rx=0 tx=0).stop 2024-04-20T12:23:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.185+0000 7fb561fc1740 1 -- 172.21.15.135:0/657077593 shutdown_connections 2024-04-20T12:23:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.185+0000 7fb561fc1740 1 --2- 172.21.15.135:0/657077593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd4a54e0 0x55effd4a4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.185+0000 7fb561fc1740 1 --2- 172.21.15.135:0/657077593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd49c900 0x55effd4a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.185+0000 7fb561fc1740 1 --2- 172.21.15.135:0/657077593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4a10e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.185+0000 7fb561fc1740 1 -- 172.21.15.135:0/657077593 >> 172.21.15.135:0/657077593 conn(0x55effd496710 msgr2=0x55effd4a09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.185+0000 7fb561fc1740 1 -- 172.21.15.135:0/657077593 shutdown_connections 2024-04-20T12:23:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.185+0000 7fb561fc1740 1 -- 172.21.15.135:0/657077593 wait complete. 2024-04-20T12:23:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.185+0000 7fb561fc1740 1 -- start start 2024-04-20T12:23:15.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.185+0000 7fb561fc1740 1 Processor -- start 2024-04-20T12:23:15.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb561fc1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4ad900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb561fc1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd49c900 0x55effd4a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb561fc1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd4a54e0 0x55effd4aa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb561fc1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581b2a80 con 0x55effd49bfe0 2024-04-20T12:23:15.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb561fc1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581b23b0 con 0x55effd4a54e0 2024-04-20T12:23:15.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb561fc1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581af5e0 con 0x55effd49c900 2024-04-20T12:23:15.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb561fc1740 10 client.0 _ll_register_callbacks cb 0x7fb550032c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:15.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb55d08e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb55d08e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4ad900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35532/0 (socket says 172.21.15.135:35532) 2024-04-20T12:23:15.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb55d08e640 1 -- 172.21.15.135:0/1214303245 learned_addr learned my addr 172.21.15.135:0/1214303245 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:15.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb55d88f640 1 --2- 172.21.15.135:0/1214303245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd4a54e0 0x55effd4aa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb55d08e640 1 -- 172.21.15.135:0/1214303245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd49c900 msgr2=0x55effd4a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb55c88d640 1 --2- 172.21.15.135:0/1214303245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd49c900 0x55effd4a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb55d08e640 1 --2- 172.21.15.135:0/1214303245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd49c900 0x55effd4a9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb55d08e640 1 -- 172.21.15.135:0/1214303245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd4a54e0 msgr2=0x55effd4aa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb55d08e640 1 --2- 172.21.15.135:0/1214303245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd4a54e0 0x55effd4aa1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb55d08e640 1 -- 172.21.15.135:0/1214303245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55effd4aa860 con 0x55effd49bfe0 2024-04-20T12:23:15.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb55d08e640 1 --2- 172.21.15.135:0/1214303245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4ad900 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb550040ea0 tx=0x7fb550004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a31aa0f7c627a18 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb540ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:15.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb540ff9640 1 -- 172.21.15.135:0/1214303245 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550059070 con 0x55effd49bfe0 2024-04-20T12:23:15.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb540ff9640 1 -- 172.21.15.135:0/1214303245 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fb550032dd0 con 0x55effd49bfe0 2024-04-20T12:23:15.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.186+0000 7fb561fc1740 1 -- 172.21.15.135:0/1214303245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb550040660 con 0x55effd49bfe0 2024-04-20T12:23:15.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.187+0000 7fb540ff9640 1 -- 172.21.15.135:0/1214303245 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb550044050 con 0x55effd49bfe0 2024-04-20T12:23:15.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.187+0000 7fb561fc1740 10 client.15771 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:15.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.187+0000 7fb561fc1740 1 -- 172.21.15.135:0/1214303245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55effd51c980 con 0x55effd49bfe0 2024-04-20T12:23:15.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.187+0000 7fb540ff9640 1 -- 172.21.15.135:0/1214303245 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb550040660 con 0x55effd49bfe0 2024-04-20T12:23:15.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.187+0000 7fb540ff9640 1 -- 172.21.15.135:0/1214303245 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fb550034440 con 0x55effd49bfe0 2024-04-20T12:23:15.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.187+0000 7fb561fc1740 10 client.15771 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:15.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.187+0000 7fb561fc1740 10 client.15771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:15.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.187+0000 7fb561fc1740 20 client.15771 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:15.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.187+0000 7fb561fc1740 1 --2- 172.21.15.135:0/1214303245 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55effd51cfe0 0x55effd51f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.187+0000 7fb561fc1740 4 client.15771 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:23:15.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.187+0000 7fb561fc1740 1 -- 172.21.15.135:0/1214303245 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55effd408790 con 0x55effd51cfe0 2024-04-20T12:23:15.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.187+0000 7fb55c88d640 1 --2- 172.21.15.135:0/1214303245 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55effd51cfe0 0x55effd51f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.188+0000 7fb540ff9640 10 client.15771 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:15.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.188+0000 7fb55c88d640 1 --2- 172.21.15.135:0/1214303245 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55effd51cfe0 0x55effd51f3d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8c127aedf276400 server_cookie=9676232f7229e01c in_seq=0 out_seq=0 2024-04-20T12:23:15.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.189+0000 7fb540ff9640 1 -- 172.21.15.135:0/1214303245 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55effd408790 con 0x55effd51cfe0 2024-04-20T12:23:15.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.189+0000 7fb540ff9640 10 client.15771 handle_command_reply: tid=0 2024-04-20T12:23:15.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.189+0000 7fb561fc1740 1 client.15771 shutdown 2024-04-20T12:23:15.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.189+0000 7fb561fc1740 1 -- 172.21.15.135:0/1214303245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 msgr2=0x55effd4ad900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.189+0000 7fb561fc1740 1 --2- 172.21.15.135:0/1214303245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4ad900 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb550040ea0 tx=0x7fb550004a40 comp rx=0 tx=0).stop 2024-04-20T12:23:15.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.189+0000 7fb561fc1740 1 -- 172.21.15.135:0/1214303245 shutdown_connections 2024-04-20T12:23:15.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.189+0000 7fb561fc1740 1 --2- 172.21.15.135:0/1214303245 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55effd51cfe0 0x55effd51f3d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.189+0000 7fb561fc1740 1 --2- 172.21.15.135:0/1214303245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55effd4a54e0 0x55effd4aa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.189+0000 7fb561fc1740 1 --2- 172.21.15.135:0/1214303245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55effd49c900 0x55effd4a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.189+0000 7fb540ff9640 0 client.15771 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:15.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.189+0000 7fb561fc1740 1 --2- 172.21.15.135:0/1214303245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55effd49bfe0 0x55effd4ad900 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.189+0000 7fb561fc1740 1 -- 172.21.15.135:0/1214303245 >> 172.21.15.135:0/1214303245 conn(0x55effd496710 msgr2=0x55effd4a1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.189+0000 7fb561fc1740 1 -- 172.21.15.135:0/1214303245 shutdown_connections 2024-04-20T12:23:15.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.189+0000 7fb561fc1740 1 -- 172.21.15.135:0/1214303245 wait complete. 2024-04-20T12:23:15.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.189+0000 7fb561fc1740 20 client.15771 trim_cache size 0 max 16384 2024-04-20T12:23:15.195 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:23:15.195 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:23:15.195 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "c408de5a-0762-4cf1-aead-d90c6523f4b9", 2024-04-20T12:23:15.195 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:23:15.195 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:23:15.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.190+0000 7fb55f2f2640 1 -- 172.21.15.135:0/390467675 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5440a3e70 msgr2=0x7fb5440a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.190+0000 7fb55f2f2640 1 --2- 172.21.15.135:0/390467675 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5440a3e70 0x7fb5440a6330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb55401f000 tx=0x7fb554020000 comp rx=0 tx=0).stop 2024-04-20T12:23:15.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.190+0000 7fb55f2f2640 1 -- 172.21.15.135:0/390467675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb558100f90 msgr2=0x7fb55810f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.190+0000 7fb55f2f2640 1 --2- 172.21.15.135:0/390467675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb558100f90 0x7fb55810f230 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb54800c890 tx=0x7fb54800cd50 comp rx=0 tx=0).stop 2024-04-20T12:23:15.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.190+0000 7fb55f2f2640 1 -- 172.21.15.135:0/390467675 shutdown_connections 2024-04-20T12:23:15.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.190+0000 7fb55f2f2640 1 --2- 172.21.15.135:0/390467675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb558106690 0x7fb55810f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.190+0000 7fb55f2f2640 1 --2- 172.21.15.135:0/390467675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb558100f90 0x7fb55810f230 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.190+0000 7fb55f2f2640 1 --2- 172.21.15.135:0/390467675 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5440a3e70 0x7fb5440a6330 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.190+0000 7fb55f2f2640 1 --2- 172.21.15.135:0/390467675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb5581005d0 0x7fb55810ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.190+0000 7fb55f2f2640 1 -- 172.21.15.135:0/390467675 >> 172.21.15.135:0/390467675 conn(0x7fb5580773f0 msgr2=0x7fb5580feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.190+0000 7fb55f2f2640 1 -- 172.21.15.135:0/390467675 shutdown_connections 2024-04-20T12:23:15.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.190+0000 7fb55f2f2640 1 -- 172.21.15.135:0/390467675 wait complete. 2024-04-20T12:23:15.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:23:15.201 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:23:15.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.302+0000 7f125b1b2640 1 -- 172.21.15.135:0/1816711610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1254101a50 msgr2=0x7f1254105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.302+0000 7f125b1b2640 1 --2- 172.21.15.135:0/1816711610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1254101a50 0x7f1254105a90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1240009900 tx=0x7f124002bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:15.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.302+0000 7f125b1b2640 1 -- 172.21.15.135:0/1816711610 shutdown_connections 2024-04-20T12:23:15.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.302+0000 7f125b1b2640 1 --2- 172.21.15.135:0/1816711610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1254106170 0x7f125410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.302+0000 7f125b1b2640 1 --2- 172.21.15.135:0/1816711610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1254101a50 0x7f1254105a90 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.302+0000 7f125b1b2640 1 --2- 172.21.15.135:0/1816711610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12541010a0 0x7f1254101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.302+0000 7f125b1b2640 1 -- 172.21.15.135:0/1816711610 >> 172.21.15.135:0/1816711610 conn(0x7f1254077f60 msgr2=0x7f1254078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.303+0000 7f125b1b2640 1 -- 172.21.15.135:0/1816711610 shutdown_connections 2024-04-20T12:23:15.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.303+0000 7f125b1b2640 1 -- 172.21.15.135:0/1816711610 wait complete. 2024-04-20T12:23:15.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.303+0000 7f125b1b2640 1 Processor -- start 2024-04-20T12:23:15.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.303+0000 7f125b1b2640 1 -- start start 2024-04-20T12:23:15.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.303+0000 7f125b1b2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12541010a0 0x7f12541996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.303+0000 7f125b1b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1254106170 0x7f1254199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.303+0000 7f125b1b2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f125419a190 0x7f12541a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.303+0000 7f125b1b2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1254111200 con 0x7f125419a190 2024-04-20T12:23:15.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.303+0000 7f125b1b2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1254111080 con 0x7f12541010a0 2024-04-20T12:23:15.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.303+0000 7f125b1b2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1254111380 con 0x7f1254106170 2024-04-20T12:23:15.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.303+0000 7f125974f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f125419a190 0x7f12541a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.303+0000 7f125974f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f125419a190 0x7f12541a4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35550/0 (socket says 172.21.15.135:35550) 2024-04-20T12:23:15.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.303+0000 7f125974f640 1 -- 172.21.15.135:0/4076561562 learned_addr learned my addr 172.21.15.135:0/4076561562 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:15.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.304+0000 7f1253fff640 1 --2- 172.21.15.135:0/4076561562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1254106170 0x7f1254199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.304+0000 7f1258f4e640 1 --2- 172.21.15.135:0/4076561562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12541010a0 0x7f12541996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.304+0000 7f125974f640 1 -- 172.21.15.135:0/4076561562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1254106170 msgr2=0x7f1254199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.304+0000 7f125974f640 1 --2- 172.21.15.135:0/4076561562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1254106170 0x7f1254199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.304+0000 7f125974f640 1 -- 172.21.15.135:0/4076561562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12541010a0 msgr2=0x7f12541996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.304+0000 7f125974f640 1 --2- 172.21.15.135:0/4076561562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12541010a0 0x7f12541996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.304+0000 7f125974f640 1 -- 172.21.15.135:0/4076561562 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12541a4f10 con 0x7f125419a190 2024-04-20T12:23:15.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.304+0000 7f125974f640 1 --2- 172.21.15.135:0/4076561562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f125419a190 0x7f12541a4740 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f124c00eb10 tx=0x7f124c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.304+0000 7f1251ffb640 1 -- 172.21.15.135:0/4076561562 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c004b20 con 0x7f125419a190 2024-04-20T12:23:15.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.304+0000 7f1251ffb640 1 -- 172.21.15.135:0/4076561562 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f124c004cc0 con 0x7f125419a190 2024-04-20T12:23:15.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.304+0000 7f1251ffb640 1 -- 172.21.15.135:0/4076561562 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c010760 con 0x7f125419a190 2024-04-20T12:23:15.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.304+0000 7f125b1b2640 1 -- 172.21.15.135:0/4076561562 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12541a5200 con 0x7f125419a190 2024-04-20T12:23:15.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.304+0000 7f125b1b2640 1 -- 172.21.15.135:0/4076561562 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12541a5720 con 0x7f125419a190 2024-04-20T12:23:15.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.307+0000 7f125dd9f740 1 Processor -- start 2024-04-20T12:23:15.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.307+0000 7f1251ffb640 1 -- 172.21.15.135:0/4076561562 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7f124c005020 con 0x7f125419a190 2024-04-20T12:23:15.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.307+0000 7f125dd9f740 1 -- start start 2024-04-20T12:23:15.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f125dd9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ec9d20 0x55c385eca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f125dd9f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385eca640 0x55c385ed2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f125dd9f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385ed3220 0x55c385ed5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f125dd9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c385e2f1b0 con 0x55c385ec9d20 2024-04-20T12:23:15.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f125dd9f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c385dcc390 con 0x55c385ed3220 2024-04-20T12:23:15.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f125dd9f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c385e2b170 con 0x55c385eca640 2024-04-20T12:23:15.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f1253fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ec9d20 0x55c385eca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f1253fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ec9d20 0x55c385eca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35558/0 (socket says 172.21.15.135:35558) 2024-04-20T12:23:15.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f1253fff640 1 -- 172.21.15.135:0/716604793 learned_addr learned my addr 172.21.15.135:0/716604793 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:15.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f1251ffb640 1 --2- 172.21.15.135:0/4076561562 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12440a3ec0 0x7f12440a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f1253fff640 1 --2- 172.21.15.135:0/716604793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385ed3220 0x55c385ed5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f1258f4e640 1 --2- 172.21.15.135:0/716604793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385eca640 0x55c385ed2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f1253fff640 1 -- 172.21.15.135:0/716604793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385eca640 msgr2=0x55c385ed2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f1253fff640 1 --2- 172.21.15.135:0/716604793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385eca640 0x55c385ed2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f1253fff640 1 -- 172.21.15.135:0/716604793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385ed3220 msgr2=0x55c385ed5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f1253fff640 1 --2- 172.21.15.135:0/716604793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385ed3220 0x55c385ed5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f1253fff640 1 -- 172.21.15.135:0/716604793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c385c0b7d0 con 0x55c385ec9d20 2024-04-20T12:23:15.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f1258f4e640 1 --2- 172.21.15.135:0/716604793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385eca640 0x55c385ed2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:15.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f1251ffb640 1 -- 172.21.15.135:0/4076561562 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f124c0d12e0 con 0x7f125419a190 2024-04-20T12:23:15.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f125974f640 1 --2- 172.21.15.135:0/4076561562 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12440a3ec0 0x7f12440a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f1253fff640 1 --2- 172.21.15.135:0/716604793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ec9d20 0x55c385eca100 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f125406b6f0 tx=0x7f1240005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dddc2267c742281 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.308+0000 7f123effd640 1 -- 172.21.15.135:0/716604793 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240049070 con 0x55c385ec9d20 2024-04-20T12:23:15.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.309+0000 7f123effd640 1 -- 172.21.15.135:0/716604793 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f124002cc40 con 0x55c385ec9d20 2024-04-20T12:23:15.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.309+0000 7f123effd640 1 -- 172.21.15.135:0/716604793 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240005120 con 0x55c385ec9d20 2024-04-20T12:23:15.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.309+0000 7f125974f640 1 --2- 172.21.15.135:0/4076561562 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12440a3ec0 0x7f12440a6380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f124c0ce590 tx=0x7f124c00efd0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.309+0000 7f125dd9f740 1 -- 172.21.15.135:0/716604793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ec9d20 msgr2=0x55c385eca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.309+0000 7f125dd9f740 1 --2- 172.21.15.135:0/716604793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ec9d20 0x55c385eca100 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f125406b6f0 tx=0x7f1240005dd0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 1 -- 172.21.15.135:0/716604793 shutdown_connections 2024-04-20T12:23:15.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 1 --2- 172.21.15.135:0/716604793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385ed3220 0x55c385ed5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 1 --2- 172.21.15.135:0/716604793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385eca640 0x55c385ed2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 1 --2- 172.21.15.135:0/716604793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ec9d20 0x55c385eca100 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 1 -- 172.21.15.135:0/716604793 >> 172.21.15.135:0/716604793 conn(0x55c385ec4450 msgr2=0x55c385ec4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 1 -- 172.21.15.135:0/716604793 shutdown_connections 2024-04-20T12:23:15.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 1 -- 172.21.15.135:0/716604793 wait complete. 2024-04-20T12:23:15.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 1 -- start start 2024-04-20T12:23:15.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 1 Processor -- start 2024-04-20T12:23:15.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385ec9d20 0x55c385ed02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385eca640 0x55c385ed0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ed3220 0x55c385ed0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c385ed5fb0 con 0x55c385ed3220 2024-04-20T12:23:15.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c385de82f0 con 0x55c385ec9d20 2024-04-20T12:23:15.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c385ed6130 con 0x55c385eca640 2024-04-20T12:23:15.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f125dd9f740 10 client.0 _ll_register_callbacks cb 0x55c385db24e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:15.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.310+0000 7f1253fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ed3220 0x55c385ed0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f1253fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ed3220 0x55c385ed0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35562/0 (socket says 172.21.15.135:35562) 2024-04-20T12:23:15.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f1253fff640 1 -- 172.21.15.135:0/2336514284 learned_addr learned my addr 172.21.15.135:0/2336514284 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:15.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f1253fff640 1 --2- 172.21.15.135:0/2336514284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385ec9d20 0x55c385ed02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f1258f4e640 1 --2- 172.21.15.135:0/2336514284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385eca640 0x55c385ed0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f1253fff640 1 -- 172.21.15.135:0/2336514284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385eca640 msgr2=0x55c385ed0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f1253fff640 1 --2- 172.21.15.135:0/2336514284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385eca640 0x55c385ed0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f1253fff640 1 -- 172.21.15.135:0/2336514284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385ec9d20 msgr2=0x55c385ed02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f1253fff640 1 --2- 172.21.15.135:0/2336514284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385ec9d20 0x55c385ed02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f1253fff640 1 -- 172.21.15.135:0/2336514284 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c385b413f0 con 0x55c385ed3220 2024-04-20T12:23:15.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f1253fff640 1 --2- 172.21.15.135:0/2336514284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ed3220 0x55c385ed0d40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1240047040 tx=0x7f124002e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80882504d24e502f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f1233fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:15.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f1233fff640 1 -- 172.21.15.135:0/2336514284 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240049040 con 0x55c385ed3220 2024-04-20T12:23:15.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f1233fff640 1 -- 172.21.15.135:0/2336514284 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f12400052d0 con 0x55c385ed3220 2024-04-20T12:23:15.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f125dd9f740 1 -- 172.21.15.135:0/2336514284 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f124002cc40 con 0x55c385ed3220 2024-04-20T12:23:15.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f1233fff640 1 -- 172.21.15.135:0/2336514284 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f12400054d0 con 0x55c385ed3220 2024-04-20T12:23:15.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f125dd9f740 10 client.15783 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:15.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f125dd9f740 1 -- 172.21.15.135:0/2336514284 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c385b010f0 con 0x55c385ed3220 2024-04-20T12:23:15.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.311+0000 7f1233fff640 1 -- 172.21.15.135:0/2336514284 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f124002cc40 con 0x55c385ed3220 2024-04-20T12:23:15.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.312+0000 7f1233fff640 1 -- 172.21.15.135:0/2336514284 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f124003d450 con 0x55c385ed3220 2024-04-20T12:23:15.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.312+0000 7f125dd9f740 10 client.15783 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:15.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.312+0000 7f125dd9f740 10 client.15783 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:15.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.312+0000 7f125dd9f740 20 client.15783 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:15.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.312+0000 7f125dd9f740 1 --2- 172.21.15.135:0/2336514284 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c385ee3430 0x55c385ee5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.312+0000 7f125dd9f740 4 client.15783 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:23:15.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.312+0000 7f125dd9f740 1 -- 172.21.15.135:0/2336514284 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c385e3cbd0 con 0x55c385ee3430 2024-04-20T12:23:15.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.312+0000 7f1258f4e640 1 --2- 172.21.15.135:0/2336514284 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c385ee3430 0x55c385ee5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.312+0000 7f1258f4e640 1 --2- 172.21.15.135:0/2336514284 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c385ee3430 0x55c385ee5820 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f4c0cebf69aef29 server_cookie=a4ef9cb14a749489 in_seq=0 out_seq=0 2024-04-20T12:23:15.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.312+0000 7f1233fff640 10 client.15783 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:15.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.313+0000 7f1233fff640 1 -- 172.21.15.135:0/2336514284 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c385e3cbd0 con 0x55c385ee3430 2024-04-20T12:23:15.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.313+0000 7f1233fff640 10 client.15783 handle_command_reply: tid=0 2024-04-20T12:23:15.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.313+0000 7f125dd9f740 1 client.15783 shutdown 2024-04-20T12:23:15.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.313+0000 7f125dd9f740 1 -- 172.21.15.135:0/2336514284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ed3220 msgr2=0x55c385ed0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.313+0000 7f125dd9f740 1 --2- 172.21.15.135:0/2336514284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ed3220 0x55c385ed0d40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1240047040 tx=0x7f124002e040 comp rx=0 tx=0).stop 2024-04-20T12:23:15.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.313+0000 7f125dd9f740 1 -- 172.21.15.135:0/2336514284 shutdown_connections 2024-04-20T12:23:15.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.313+0000 7f125dd9f740 1 --2- 172.21.15.135:0/2336514284 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c385ee3430 0x55c385ee5820 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.313+0000 7f125dd9f740 1 --2- 172.21.15.135:0/2336514284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ed3220 0x55c385ed0d40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.313+0000 7f1233fff640 0 client.15783 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:15.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.313+0000 7f125dd9f740 1 --2- 172.21.15.135:0/2336514284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385eca640 0x55c385ed0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.313+0000 7f125dd9f740 1 --2- 172.21.15.135:0/2336514284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385ec9d20 0x55c385ed02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.313+0000 7f125dd9f740 1 -- 172.21.15.135:0/2336514284 >> 172.21.15.135:0/2336514284 conn(0x55c385ec4450 msgr2=0x55c385ec61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.313+0000 7f125dd9f740 1 -- 172.21.15.135:0/2336514284 shutdown_connections 2024-04-20T12:23:15.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.313+0000 7f125dd9f740 1 -- 172.21.15.135:0/2336514284 wait complete. 2024-04-20T12:23:15.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.314+0000 7f125dd9f740 20 client.15783 trim_cache size 0 max 16384 2024-04-20T12:23:15.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.348+0000 7f125dd9f740 1 Processor -- start 2024-04-20T12:23:15.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f125dd9f740 1 -- start start 2024-04-20T12:23:15.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f125dd9f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385ec9d20 0x55c385ed29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f125dd9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385eca640 0x55c385ecf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f125dd9f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385ed3220 0x55c385edea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f125dd9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12541af280 con 0x55c385eca640 2024-04-20T12:23:15.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f125dd9f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f12541b0dc0 con 0x55c385ed3220 2024-04-20T12:23:15.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f125dd9f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12541af950 con 0x55c385ec9d20 2024-04-20T12:23:15.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f1258f4e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385eca640 0x55c385ecf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f1258f4e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385eca640 0x55c385ecf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35572/0 (socket says 172.21.15.135:35572) 2024-04-20T12:23:15.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f1258f4e640 1 -- 172.21.15.135:0/1710777518 learned_addr learned my addr 172.21.15.135:0/1710777518 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:15.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f1253fff640 1 --2- 172.21.15.135:0/1710777518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385ec9d20 0x55c385ed29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f1253fff640 1 --2- 172.21.15.135:0/1710777518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385ed3220 0x55c385edea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f1258f4e640 1 -- 172.21.15.135:0/1710777518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385ec9d20 msgr2=0x55c385ed29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f1258f4e640 1 --2- 172.21.15.135:0/1710777518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385ec9d20 0x55c385ed29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f1258f4e640 1 -- 172.21.15.135:0/1710777518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385ed3220 msgr2=0x55c385edea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f1258f4e640 1 --2- 172.21.15.135:0/1710777518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385ed3220 0x55c385edea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f1258f4e640 1 -- 172.21.15.135:0/1710777518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c385eca470 con 0x55c385eca640 2024-04-20T12:23:15.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f1253fff640 1 --2- 172.21.15.135:0/1710777518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385ec9d20 0x55c385ed29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:15.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f1258f4e640 1 --2- 172.21.15.135:0/1710777518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385eca640 0x55c385ecf420 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x55c385ecfb20 tx=0x7f1248005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ec38c1155699c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f123e7fc640 1 -- 172.21.15.135:0/1710777518 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1248004250 con 0x55c385eca640 2024-04-20T12:23:15.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f123e7fc640 1 -- 172.21.15.135:0/1710777518 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12480043f0 con 0x55c385eca640 2024-04-20T12:23:15.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.349+0000 7f123e7fc640 1 -- 172.21.15.135:0/1710777518 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1248020110 con 0x55c385eca640 2024-04-20T12:23:15.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.350+0000 7f125dd9f740 1 -- 172.21.15.135:0/1710777518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385eca640 msgr2=0x55c385ecf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.350+0000 7f125dd9f740 1 --2- 172.21.15.135:0/1710777518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385eca640 0x55c385ecf420 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x55c385ecfb20 tx=0x7f1248005f90 comp rx=0 tx=0).stop 2024-04-20T12:23:15.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.350+0000 7f125dd9f740 1 -- 172.21.15.135:0/1710777518 shutdown_connections 2024-04-20T12:23:15.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.350+0000 7f125dd9f740 1 --2- 172.21.15.135:0/1710777518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385ed3220 0x55c385edea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.350+0000 7f125dd9f740 1 --2- 172.21.15.135:0/1710777518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385eca640 0x55c385ecf420 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.350+0000 7f125dd9f740 1 --2- 172.21.15.135:0/1710777518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385ec9d20 0x55c385ed29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.350+0000 7f125dd9f740 1 -- 172.21.15.135:0/1710777518 >> 172.21.15.135:0/1710777518 conn(0x55c385ec4450 msgr2=0x55c385ede380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.350+0000 7f125dd9f740 1 -- 172.21.15.135:0/1710777518 shutdown_connections 2024-04-20T12:23:15.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.350+0000 7f125dd9f740 1 -- 172.21.15.135:0/1710777518 wait complete. 2024-04-20T12:23:15.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.350+0000 7f125dd9f740 1 -- start start 2024-04-20T12:23:15.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f125dd9f740 1 Processor -- start 2024-04-20T12:23:15.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f125dd9f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385ec9d20 0x55c385f42010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f125dd9f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385eca640 0x55c385f42550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f125dd9f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ed3220 0x55c385ee81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f125dd9f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12541b06f0 con 0x55c385ed3220 2024-04-20T12:23:15.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f125dd9f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f12541b0020 con 0x55c385eca640 2024-04-20T12:23:15.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f125dd9f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12541ad250 con 0x55c385ec9d20 2024-04-20T12:23:15.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f125dd9f740 10 client.0 _ll_register_callbacks cb 0x7f1240047070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:15.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f1253fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ed3220 0x55c385ee81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f1253fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ed3220 0x55c385ee81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35576/0 (socket says 172.21.15.135:35576) 2024-04-20T12:23:15.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f1253fff640 1 -- 172.21.15.135:0/3013288933 learned_addr learned my addr 172.21.15.135:0/3013288933 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:15.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f1258f4e640 1 --2- 172.21.15.135:0/3013288933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385eca640 0x55c385f42550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f1253fff640 1 --2- 172.21.15.135:0/3013288933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385ec9d20 0x55c385f42010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f1253fff640 1 -- 172.21.15.135:0/3013288933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385ec9d20 msgr2=0x55c385f42010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f1253fff640 1 --2- 172.21.15.135:0/3013288933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385ec9d20 0x55c385f42010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f1253fff640 1 -- 172.21.15.135:0/3013288933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385eca640 msgr2=0x55c385f42550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:15.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f1253fff640 1 --2- 172.21.15.135:0/3013288933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385eca640 0x55c385f42550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.351+0000 7f1253fff640 1 -- 172.21.15.135:0/3013288933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c385ee8890 con 0x55c385ed3220 2024-04-20T12:23:15.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f1253fff640 1 --2- 172.21.15.135:0/3013288933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ed3220 0x55c385ee81a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x55c385f3d700 tx=0x7f124002e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743a6868fc51a8d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f1233fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:15.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f1233fff640 1 -- 172.21.15.135:0/3013288933 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240049040 con 0x55c385ed3220 2024-04-20T12:23:15.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f125dd9f740 1 -- 172.21.15.135:0/3013288933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12480043f0 con 0x55c385ed3220 2024-04-20T12:23:15.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f1233fff640 1 -- 172.21.15.135:0/3013288933 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f12400052d0 con 0x55c385ed3220 2024-04-20T12:23:15.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f1233fff640 1 -- 172.21.15.135:0/3013288933 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1240069050 con 0x55c385ed3220 2024-04-20T12:23:15.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f125dd9f740 10 client.15789 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:15.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f125dd9f740 1 -- 172.21.15.135:0/3013288933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c385f49730 con 0x55c385ed3220 2024-04-20T12:23:15.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f1233fff640 1 -- 172.21.15.135:0/3013288933 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12480043f0 con 0x55c385ed3220 2024-04-20T12:23:15.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f1233fff640 1 -- 172.21.15.135:0/3013288933 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f124005ac10 con 0x55c385ed3220 2024-04-20T12:23:15.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f125dd9f740 10 client.15789 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:15.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f125dd9f740 10 client.15789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:15.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f125dd9f740 20 client.15789 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:15.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f125dd9f740 1 --2- 172.21.15.135:0/3013288933 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c385f49e20 0x55c385f4c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f125dd9f740 4 client.15789 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:23:15.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f125dd9f740 1 -- 172.21.15.135:0/3013288933 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c385e36a40 con 0x55c385f49e20 2024-04-20T12:23:15.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.352+0000 7f1258f4e640 1 --2- 172.21.15.135:0/3013288933 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c385f49e20 0x55c385f4c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f1233fff640 10 client.15789 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:15.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f1258f4e640 1 --2- 172.21.15.135:0/3013288933 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c385f49e20 0x55c385f4c240 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd0840ecfd9f6e4f server_cookie=b53752553122544a in_seq=0 out_seq=0 2024-04-20T12:23:15.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f1233fff640 1 -- 172.21.15.135:0/3013288933 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55c385e36a40 con 0x55c385f49e20 2024-04-20T12:23:15.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f1233fff640 10 client.15789 handle_command_reply: tid=0 2024-04-20T12:23:15.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f125dd9f740 1 client.15789 shutdown 2024-04-20T12:23:15.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f125dd9f740 1 -- 172.21.15.135:0/3013288933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ed3220 msgr2=0x55c385ee81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f125dd9f740 1 --2- 172.21.15.135:0/3013288933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ed3220 0x55c385ee81a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x55c385f3d700 tx=0x7f124002e040 comp rx=0 tx=0).stop 2024-04-20T12:23:15.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f125dd9f740 1 -- 172.21.15.135:0/3013288933 shutdown_connections 2024-04-20T12:23:15.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f125dd9f740 1 --2- 172.21.15.135:0/3013288933 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c385f49e20 0x55c385f4c240 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f125dd9f740 1 --2- 172.21.15.135:0/3013288933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c385ed3220 0x55c385ee81a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f1233fff640 0 client.15789 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:15.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f125dd9f740 1 --2- 172.21.15.135:0/3013288933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c385eca640 0x55c385f42550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f125dd9f740 1 --2- 172.21.15.135:0/3013288933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c385ec9d20 0x55c385f42010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f125dd9f740 1 -- 172.21.15.135:0/3013288933 >> 172.21.15.135:0/3013288933 conn(0x55c385ec4450 msgr2=0x55c385ed0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f125dd9f740 1 -- 172.21.15.135:0/3013288933 shutdown_connections 2024-04-20T12:23:15.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f125dd9f740 1 -- 172.21.15.135:0/3013288933 wait complete. 2024-04-20T12:23:15.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.353+0000 7f125dd9f740 20 client.15789 trim_cache size 0 max 16384 2024-04-20T12:23:15.360 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:23:15.360 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:23:15.360 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:23:15.360 INFO:teuthology.orchestra.run.smithi135.stdout: "c408de5a-0762-4cf1-aead-d90c6523f4b9": { 2024-04-20T12:23:15.360 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:23:15.361 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "c408de5a-0762-4cf1-aead-d90c6523f4b9", 2024-04-20T12:23:15.361 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:23:15.361 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:23:15.361 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:23:15.361 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:23:15.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.354+0000 7f125b1b2640 1 -- 172.21.15.135:0/4076561562 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12440a3ec0 msgr2=0x7f12440a6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.354+0000 7f125b1b2640 1 --2- 172.21.15.135:0/4076561562 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12440a3ec0 0x7f12440a6380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f124c0ce590 tx=0x7f124c00efd0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.354+0000 7f125b1b2640 1 -- 172.21.15.135:0/4076561562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f125419a190 msgr2=0x7f12541a4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.354+0000 7f125b1b2640 1 --2- 172.21.15.135:0/4076561562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f125419a190 0x7f12541a4740 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f124c00eb10 tx=0x7f124c00c2d0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.354+0000 7f125b1b2640 1 -- 172.21.15.135:0/4076561562 shutdown_connections 2024-04-20T12:23:15.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.354+0000 7f125b1b2640 1 --2- 172.21.15.135:0/4076561562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f125419a190 0x7f12541a4740 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.354+0000 7f125b1b2640 1 --2- 172.21.15.135:0/4076561562 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12440a3ec0 0x7f12440a6380 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.354+0000 7f125b1b2640 1 --2- 172.21.15.135:0/4076561562 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1254106170 0x7f1254199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.354+0000 7f125b1b2640 1 --2- 172.21.15.135:0/4076561562 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12541010a0 0x7f12541996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.354+0000 7f125b1b2640 1 -- 172.21.15.135:0/4076561562 >> 172.21.15.135:0/4076561562 conn(0x7f1254077f60 msgr2=0x7f12540ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.354+0000 7f125b1b2640 1 -- 172.21.15.135:0/4076561562 shutdown_connections 2024-04-20T12:23:15.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.354+0000 7f125b1b2640 1 -- 172.21.15.135:0/4076561562 wait complete. 2024-04-20T12:23:15.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:15 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/635034641' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:23:15.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:15 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2730415318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:23:15.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:15 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1715534359' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:23:15.364 INFO:tasks.cephfs.filesystem:scrub status for tag:c408de5a-0762-4cf1-aead-d90c6523f4b9 - {'path': '/', 'tag': 'c408de5a-0762-4cf1-aead-d90c6523f4b9', 'options': 'recursive,force'} 2024-04-20T12:23:15.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.396+0000 7f92ac75f640 1 -- 172.21.15.135:0/1294165743 --> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f92a4101aa0 con 0x7f92900a3f60 2024-04-20T12:23:15.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.465+0000 7f929b7fe640 1 -- 172.21.15.135:0/1294165743 <== mgr.25093 v2:172.21.15.135:6800/15232286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f92a4101aa0 con 0x7f92900a3f60 2024-04-20T12:23:15.465 INFO:teuthology.orchestra.run.smithi135.stdout:Schedule set for path / 2024-04-20T12:23:15.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.467+0000 7f92ac75f640 1 -- 172.21.15.135:0/1294165743 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f92900a3f60 msgr2=0x7f92900a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.467+0000 7f92ac75f640 1 --2- 172.21.15.135:0/1294165743 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f92900a3f60 0x7f92900a6420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009d60 tx=0x7f92a0009110 comp rx=0 tx=0).stop 2024-04-20T12:23:15.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.467+0000 7f92ac75f640 1 -- 172.21.15.135:0/1294165743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a41061c0 msgr2=0x7f92a419eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.467+0000 7f92ac75f640 1 --2- 172.21.15.135:0/1294165743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a41061c0 0x7f92a419eae0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9294036040 tx=0x7f929402ce20 comp rx=0 tx=0).stop 2024-04-20T12:23:15.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.467+0000 7f92ac75f640 1 -- 172.21.15.135:0/1294165743 shutdown_connections 2024-04-20T12:23:15.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.467+0000 7f92ac75f640 1 --2- 172.21.15.135:0/1294165743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92a4198660 0x7f92a4198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.467+0000 7f92ac75f640 1 --2- 172.21.15.135:0/1294165743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a41061c0 0x7f92a419eae0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.467+0000 7f92ac75f640 1 --2- 172.21.15.135:0/1294165743 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f92900a3f60 0x7f92900a6420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.467+0000 7f92ac75f640 1 --2- 172.21.15.135:0/1294165743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92a41010f0 0x7f92a419e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.467+0000 7f92ac75f640 1 -- 172.21.15.135:0/1294165743 >> 172.21.15.135:0/1294165743 conn(0x7f92a40771e0 msgr2=0x7f92a406aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.467+0000 7f92ac75f640 1 -- 172.21.15.135:0/1294165743 shutdown_connections 2024-04-20T12:23:15.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.467+0000 7f92ac75f640 1 -- 172.21.15.135:0/1294165743 wait complete. 2024-04-20T12:23:15.478 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-04-20T12:23:15.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:15 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/635034641' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:23:15.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:15 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2730415318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:23:15.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:15 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1715534359' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:23:15.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:15 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/635034641' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:23:15.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:15 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2730415318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:23:15.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:15 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1715534359' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:23:15.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.619+0000 7fd71b532640 1 -- 172.21.15.135:0/1898184996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd714100e20 msgr2=0x7fd714105bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.619+0000 7fd71b532640 1 --2- 172.21.15.135:0/1898184996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd714100e20 0x7fd714105bb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009ca0 tx=0x7fd70c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.619+0000 7fd71b532640 1 -- 172.21.15.135:0/1898184996 shutdown_connections 2024-04-20T12:23:15.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.619+0000 7fd71b532640 1 --2- 172.21.15.135:0/1898184996 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd714100e20 0x7fd714105bb0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.619+0000 7fd71b532640 1 --2- 172.21.15.135:0/1898184996 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd714100460 0x7fd7141008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.619+0000 7fd71b532640 1 --2- 172.21.15.135:0/1898184996 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd714106f50 0x7fd714107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.619+0000 7fd71b532640 1 -- 172.21.15.135:0/1898184996 >> 172.21.15.135:0/1898184996 conn(0x7fd7140773a0 msgr2=0x7fd7140fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.619+0000 7fd71b532640 1 -- 172.21.15.135:0/1898184996 shutdown_connections 2024-04-20T12:23:15.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.619+0000 7fd71b532640 1 -- 172.21.15.135:0/1898184996 wait complete. 2024-04-20T12:23:15.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd71b532640 1 Processor -- start 2024-04-20T12:23:15.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd71b532640 1 -- start start 2024-04-20T12:23:15.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd71b532640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd714100460 0x7fd7141a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd71b532640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd714100e20 0x7fd7141a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd71b532640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd714106f50 0x7fd71419ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd71b532640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd714118950 con 0x7fd714100460 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd71b532640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd7141187d0 con 0x7fd714106f50 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd71b532640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd714118ad0 con 0x7fd714100e20 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd7192ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd714100460 0x7fd7141a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd7192ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd714100460 0x7fd7141a48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35598/0 (socket says 172.21.15.135:35598) 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd7192ce640 1 -- 172.21.15.135:0/1525424751 learned_addr learned my addr 172.21.15.135:0/1525424751 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd718acd640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd714100e20 0x7fd7141a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd719acf640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd714106f50 0x7fd71419ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd7192ce640 1 -- 172.21.15.135:0/1525424751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd714100e20 msgr2=0x7fd7141a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd7192ce640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd714100e20 0x7fd7141a4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd7192ce640 1 -- 172.21.15.135:0/1525424751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd714106f50 msgr2=0x7fd71419ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd7192ce640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd714106f50 0x7fd71419ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd7192ce640 1 -- 172.21.15.135:0/1525424751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71419f210 con 0x7fd714100460 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd719acf640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd714106f50 0x7fd71419ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:15.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.620+0000 7fd718acd640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd714100e20 0x7fd7141a4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:15.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.621+0000 7fd7192ce640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd714100460 0x7fd7141a48e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd71000d950 tx=0x7fd71000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.621+0000 7fd70a7fc640 1 -- 172.21.15.135:0/1525424751 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd710017020 con 0x7fd714100460 2024-04-20T12:23:15.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.621+0000 7fd70a7fc640 1 -- 172.21.15.135:0/1525424751 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd710009c30 con 0x7fd714100460 2024-04-20T12:23:15.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.621+0000 7fd71b532640 1 -- 172.21.15.135:0/1525424751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd71419f500 con 0x7fd714100460 2024-04-20T12:23:15.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.621+0000 7fd70a7fc640 1 -- 172.21.15.135:0/1525424751 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71000f740 con 0x7fd714100460 2024-04-20T12:23:15.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.621+0000 7fd71b532640 1 -- 172.21.15.135:0/1525424751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7141ab7a0 con 0x7fd714100460 2024-04-20T12:23:15.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.622+0000 7fd71b532640 1 -- 172.21.15.135:0/1525424751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd71404fcf0 con 0x7fd714100460 2024-04-20T12:23:15.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.623+0000 7fd70a7fc640 1 -- 172.21.15.135:0/1525424751 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7fd71001a020 con 0x7fd714100460 2024-04-20T12:23:15.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.624+0000 7fd70a7fc640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd7000a3ee0 0x7fd7000a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.624+0000 7fd718acd640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd7000a3ee0 0x7fd7000a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.624+0000 7fd70a7fc640 1 -- 172.21.15.135:0/1525424751 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fd7100d07c0 con 0x7fd714100460 2024-04-20T12:23:15.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.624+0000 7fd718acd640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd7000a3ee0 0x7fd7000a63a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd714069a80 tx=0x7fd704005d90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:15.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.628+0000 7fd70a7fc640 1 -- 172.21.15.135:0/1525424751 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fd710021070 con 0x7fd714100460 2024-04-20T12:23:15.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.826+0000 7fd71b532640 1 -- 172.21.15.135:0/1525424751 --> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fd7141052a0 con 0x7fd7000a3ee0 2024-04-20T12:23:15.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.884+0000 7fd70a7fc640 1 -- 172.21.15.135:0/1525424751 <== mgr.25093 v2:172.21.15.135:6800/15232286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fd7141052a0 con 0x7fd7000a3ee0 2024-04-20T12:23:15.884 INFO:teuthology.orchestra.run.smithi135.stdout:Retention added to path / 2024-04-20T12:23:15.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.886+0000 7fd71b532640 1 -- 172.21.15.135:0/1525424751 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd7000a3ee0 msgr2=0x7fd7000a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.886+0000 7fd71b532640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd7000a3ee0 0x7fd7000a63a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd714069a80 tx=0x7fd704005d90 comp rx=0 tx=0).stop 2024-04-20T12:23:15.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.886+0000 7fd71b532640 1 -- 172.21.15.135:0/1525424751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd714100460 msgr2=0x7fd7141a48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.886+0000 7fd71b532640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd714100460 0x7fd7141a48e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd71000d950 tx=0x7fd71000de10 comp rx=0 tx=0).stop 2024-04-20T12:23:15.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.886+0000 7fd71b532640 1 -- 172.21.15.135:0/1525424751 shutdown_connections 2024-04-20T12:23:15.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.886+0000 7fd71b532640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd714106f50 0x7fd71419ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.886+0000 7fd71b532640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd7000a3ee0 0x7fd7000a63a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.886+0000 7fd71b532640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd714100e20 0x7fd7141a4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.886+0000 7fd71b532640 1 --2- 172.21.15.135:0/1525424751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd714100460 0x7fd7141a48e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.886+0000 7fd71b532640 1 -- 172.21.15.135:0/1525424751 >> 172.21.15.135:0/1525424751 conn(0x7fd7140773a0 msgr2=0x7fd714103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.887+0000 7fd71b532640 1 -- 172.21.15.135:0/1525424751 shutdown_connections 2024-04-20T12:23:15.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.887+0000 7fd71b532640 1 -- 172.21.15.135:0/1525424751 wait complete. 2024-04-20T12:23:15.897 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-20T12:23:15.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.996+0000 7f10b5a50640 1 -- 172.21.15.135:0/393673313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10b0105e50 msgr2=0x7f10b0106230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:15.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.996+0000 7f10b5a50640 1 --2- 172.21.15.135:0/393673313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10b0105e50 0x7f10b0106230 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1098009900 tx=0x7f109802bc80 comp rx=0 tx=0).stop 2024-04-20T12:23:15.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.996+0000 7f10b5a50640 1 -- 172.21.15.135:0/393673313 shutdown_connections 2024-04-20T12:23:15.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.996+0000 7f10b5a50640 1 --2- 172.21.15.135:0/393673313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10b0101f90 0x7f10b010dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.996+0000 7f10b5a50640 1 --2- 172.21.15.135:0/393673313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10b01015f0 0x7f10b0101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.996+0000 7f10b5a50640 1 --2- 172.21.15.135:0/393673313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10b0105e50 0x7f10b0106230 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:15.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.996+0000 7f10b5a50640 1 -- 172.21.15.135:0/393673313 >> 172.21.15.135:0/393673313 conn(0x7f10b00773a0 msgr2=0x7f10b00fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:15.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.996+0000 7f10b5a50640 1 -- 172.21.15.135:0/393673313 shutdown_connections 2024-04-20T12:23:15.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.996+0000 7f10b5a50640 1 -- 172.21.15.135:0/393673313 wait complete. 2024-04-20T12:23:15.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10b5a50640 1 Processor -- start 2024-04-20T12:23:15.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10b5a50640 1 -- start start 2024-04-20T12:23:15.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10b5a50640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10b01015f0 0x7f10b019e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10b5a50640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10b0101f90 0x7f10b019eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10b5a50640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10b0105e50 0x7f10b0198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:15.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10b5a50640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0112470 con 0x7f10b0105e50 2024-04-20T12:23:15.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10b5a50640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01122f0 con 0x7f10b01015f0 2024-04-20T12:23:15.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10b5a50640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01125f0 con 0x7f10b0101f90 2024-04-20T12:23:15.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10af7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10b0105e50 0x7f10b0198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:15.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10af7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10b0105e50 0x7f10b0198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35618/0 (socket says 172.21.15.135:35618) 2024-04-20T12:23:15.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10af7fe640 1 -- 172.21.15.135:0/4241965753 learned_addr learned my addr 172.21.15.135:0/4241965753 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:16.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10aeffd640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10b01015f0 0x7f10b019e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:16.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10ae7fc640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10b0101f90 0x7f10b019eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:16.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10af7fe640 1 -- 172.21.15.135:0/4241965753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10b0101f90 msgr2=0x7f10b019eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:16.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10af7fe640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10b0101f90 0x7f10b019eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10af7fe640 1 -- 172.21.15.135:0/4241965753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10b01015f0 msgr2=0x7f10b019e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:16.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10af7fe640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10b01015f0 0x7f10b019e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10af7fe640 1 -- 172.21.15.135:0/4241965753 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b0198ef0 con 0x7f10b0105e50 2024-04-20T12:23:16.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10aeffd640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10b01015f0 0x7f10b019e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:16.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10ae7fc640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10b0101f90 0x7f10b019eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:16.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.997+0000 7f10af7fe640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10b0105e50 0x7f10b0198630 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f10a800eaa0 tx=0x7f10a800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:16.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.998+0000 7f10b4a4e640 1 -- 172.21.15.135:0/4241965753 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a800cdb0 con 0x7f10b0105e50 2024-04-20T12:23:16.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.998+0000 7f10b4a4e640 1 -- 172.21.15.135:0/4241965753 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a8005020 con 0x7f10b0105e50 2024-04-20T12:23:16.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.998+0000 7f10b5a50640 1 -- 172.21.15.135:0/4241965753 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b01991e0 con 0x7f10b0105e50 2024-04-20T12:23:16.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.998+0000 7f10b4a4e640 1 -- 172.21.15.135:0/4241965753 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a80116b0 con 0x7f10b0105e50 2024-04-20T12:23:16.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.998+0000 7f10b5a50640 1 -- 172.21.15.135:0/4241965753 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b01a54f0 con 0x7f10b0105e50 2024-04-20T12:23:16.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:15.999+0000 7f10b5a50640 1 -- 172.21.15.135:0/4241965753 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b0102600 con 0x7f10b0105e50 2024-04-20T12:23:16.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.000+0000 7f10b4a4e640 1 -- 172.21.15.135:0/4241965753 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7f10a8005560 con 0x7f10b0105e50 2024-04-20T12:23:16.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.000+0000 7f10b4a4e640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f109c0a3ee0 0x7f109c0a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:16.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.000+0000 7f10b4a4e640 1 -- 172.21.15.135:0/4241965753 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f10a80d1130 con 0x7f10b0105e50 2024-04-20T12:23:16.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.000+0000 7f10aeffd640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f109c0a3ee0 0x7f109c0a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:16.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.001+0000 7f10aeffd640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f109c0a3ee0 0x7f109c0a63a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1098005ab0 tx=0x7f1098005a20 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:16.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.005+0000 7f10b4a4e640 1 -- 172.21.15.135:0/4241965753 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f10a8016030 con 0x7f10b0105e50 2024-04-20T12:23:16.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.209+0000 7f10b5a50640 1 -- 172.21.15.135:0/4241965753 --> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f10b01042a0 con 0x7f109c0a3ee0 2024-04-20T12:23:16.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.216+0000 7f10b4a4e640 1 -- 172.21.15.135:0/4241965753 <== mgr.25093 v2:172.21.15.135:6800/15232286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f10b01042a0 con 0x7f109c0a3ee0 2024-04-20T12:23:16.216 INFO:teuthology.orchestra.run.smithi135.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-20T00:00:00", "created": "2024-04-20T12:23:15", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-04-20T12:23:16.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.219+0000 7f10b5a50640 1 -- 172.21.15.135:0/4241965753 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f109c0a3ee0 msgr2=0x7f109c0a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:16.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.219+0000 7f10b5a50640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f109c0a3ee0 0x7f109c0a63a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1098005ab0 tx=0x7f1098005a20 comp rx=0 tx=0).stop 2024-04-20T12:23:16.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.219+0000 7f10b5a50640 1 -- 172.21.15.135:0/4241965753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10b0105e50 msgr2=0x7f10b0198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:16.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.219+0000 7f10b5a50640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10b0105e50 0x7f10b0198630 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f10a800eaa0 tx=0x7f10a800ef60 comp rx=0 tx=0).stop 2024-04-20T12:23:16.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.219+0000 7f10b5a50640 1 -- 172.21.15.135:0/4241965753 shutdown_connections 2024-04-20T12:23:16.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.219+0000 7f10b5a50640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f10b0105e50 0x7f10b0198630 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.219+0000 7f10b5a50640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f109c0a3ee0 0x7f109c0a63a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.219+0000 7f10b5a50640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f10b0101f90 0x7f10b019eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.219+0000 7f10b5a50640 1 --2- 172.21.15.135:0/4241965753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f10b01015f0 0x7f10b019e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.219+0000 7f10b5a50640 1 -- 172.21.15.135:0/4241965753 >> 172.21.15.135:0/4241965753 conn(0x7f10b00773a0 msgr2=0x7f10b0103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:16.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.219+0000 7f10b5a50640 1 -- 172.21.15.135:0/4241965753 shutdown_connections 2024-04-20T12:23:16.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.219+0000 7f10b5a50640 1 -- 172.21.15.135:0/4241965753 wait complete. 2024-04-20T12:23:16.228 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:16 smithi135 ceph-mon[18264]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 1.1 KiB/s wr, 26 op/s 2024-04-20T12:23:16.228 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:16 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:23:16.229 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:16 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:23:16.229 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:16 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:23:16.229 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:16 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:23:16.229 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:16 smithi135 ceph-mon[18264]: from='client.15759 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:23:16.229 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:16 smithi135 ceph-mon[18264]: from='client.15795 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:23:16.230 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-20T12:23:16.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.330+0000 7fde33c7a640 1 -- 172.21.15.135:0/3269441981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde2c06a790 msgr2=0x7fde2c06abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:16.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.330+0000 7fde33c7a640 1 --2- 172.21.15.135:0/3269441981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde2c06a790 0x7fde2c06abf0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fde1c009900 tx=0x7fde1c02bcd0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.330+0000 7fde33c7a640 1 -- 172.21.15.135:0/3269441981 shutdown_connections 2024-04-20T12:23:16.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.330+0000 7fde33c7a640 1 --2- 172.21.15.135:0/3269441981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde2c06b130 0x7fde2c10ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.330+0000 7fde33c7a640 1 --2- 172.21.15.135:0/3269441981 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde2c06a790 0x7fde2c06abf0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.330+0000 7fde33c7a640 1 --2- 172.21.15.135:0/3269441981 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde2c1080f0 0x7fde2c1084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.330+0000 7fde33c7a640 1 -- 172.21.15.135:0/3269441981 >> 172.21.15.135:0/3269441981 conn(0x7fde2c076c60 msgr2=0x7fde2c077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:16.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.331+0000 7fde33c7a640 1 -- 172.21.15.135:0/3269441981 shutdown_connections 2024-04-20T12:23:16.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.331+0000 7fde33c7a640 1 -- 172.21.15.135:0/3269441981 wait complete. 2024-04-20T12:23:16.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.331+0000 7fde33c7a640 1 Processor -- start 2024-04-20T12:23:16.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.331+0000 7fde33c7a640 1 -- start start 2024-04-20T12:23:16.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.331+0000 7fde33c7a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde2c06a790 0x7fde2c102e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:16.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.331+0000 7fde33c7a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde2c06b130 0x7fde2c101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:16.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.331+0000 7fde33c7a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde2c1080f0 0x7fde2c1018c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:16.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.331+0000 7fde33c7a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c112310 con 0x7fde2c06a790 2024-04-20T12:23:16.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.331+0000 7fde33c7a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c112190 con 0x7fde2c1080f0 2024-04-20T12:23:16.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.331+0000 7fde33c7a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c112490 con 0x7fde2c06b130 2024-04-20T12:23:16.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.331+0000 7fde31a16640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde2c06a790 0x7fde2c102e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:16.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.331+0000 7fde31a16640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde2c06a790 0x7fde2c102e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:35646/0 (socket says 172.21.15.135:35646) 2024-04-20T12:23:16.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.331+0000 7fde31a16640 1 -- 172.21.15.135:0/1971048053 learned_addr learned my addr 172.21.15.135:0/1971048053 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:16.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.332+0000 7fde31215640 1 --2- 172.21.15.135:0/1971048053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde2c06b130 0x7fde2c101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:16.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.332+0000 7fde32217640 1 --2- 172.21.15.135:0/1971048053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde2c1080f0 0x7fde2c1018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:16.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.332+0000 7fde31a16640 1 -- 172.21.15.135:0/1971048053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde2c06b130 msgr2=0x7fde2c101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:16.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.332+0000 7fde31a16640 1 --2- 172.21.15.135:0/1971048053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde2c06b130 0x7fde2c101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.332+0000 7fde31a16640 1 -- 172.21.15.135:0/1971048053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde2c1080f0 msgr2=0x7fde2c1018c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:16.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.332+0000 7fde31a16640 1 --2- 172.21.15.135:0/1971048053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde2c1080f0 0x7fde2c1018c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.332+0000 7fde31a16640 1 -- 172.21.15.135:0/1971048053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2c1ab190 con 0x7fde2c06a790 2024-04-20T12:23:16.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.332+0000 7fde31a16640 1 --2- 172.21.15.135:0/1971048053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde2c06a790 0x7fde2c102e80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fde2800c890 tx=0x7fde2800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:16.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.332+0000 7fde22ffd640 1 -- 172.21.15.135:0/1971048053 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde28004220 con 0x7fde2c06a790 2024-04-20T12:23:16.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.332+0000 7fde22ffd640 1 -- 172.21.15.135:0/1971048053 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde280043c0 con 0x7fde2c06a790 2024-04-20T12:23:16.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.332+0000 7fde33c7a640 1 -- 172.21.15.135:0/1971048053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde2c1ab3c0 con 0x7fde2c06a790 2024-04-20T12:23:16.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.332+0000 7fde22ffd640 1 -- 172.21.15.135:0/1971048053 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde280049e0 con 0x7fde2c06a790 2024-04-20T12:23:16.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.332+0000 7fde33c7a640 1 -- 172.21.15.135:0/1971048053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde2c1ab890 con 0x7fde2c06a790 2024-04-20T12:23:16.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.333+0000 7fde33c7a640 1 -- 172.21.15.135:0/1971048053 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde2c069fe0 con 0x7fde2c06a790 2024-04-20T12:23:16.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.334+0000 7fde22ffd640 1 -- 172.21.15.135:0/1971048053 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7fde280079b0 con 0x7fde2c06a790 2024-04-20T12:23:16.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.335+0000 7fde22ffd640 1 --2- 172.21.15.135:0/1971048053 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde180a3ee0 0x7fde180a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:16.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.335+0000 7fde31215640 1 --2- 172.21.15.135:0/1971048053 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde180a3ee0 0x7fde180a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:16.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.335+0000 7fde22ffd640 1 -- 172.21.15.135:0/1971048053 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fde280d0e20 con 0x7fde2c06a790 2024-04-20T12:23:16.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.336+0000 7fde31215640 1 --2- 172.21.15.135:0/1971048053 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde180a3ee0 0x7fde180a63a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde1c02efd0 tx=0x7fde1c02cf90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:16.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.340+0000 7fde22ffd640 1 -- 172.21.15.135:0/1971048053 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fde28014030 con 0x7fde2c06a790 2024-04-20T12:23:16.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:16 smithi154 ceph-mon[22073]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 1.1 KiB/s wr, 26 op/s 2024-04-20T12:23:16.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:16 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:23:16.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:16 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:23:16.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:16 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:23:16.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:16 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:23:16.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:16 smithi154 ceph-mon[22073]: from='client.15759 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:23:16.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:16 smithi154 ceph-mon[22073]: from='client.15795 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:23:16.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.537+0000 7fde33c7a640 1 -- 172.21.15.135:0/1971048053 --> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fde2c0623a0 con 0x7fde180a3ee0 2024-04-20T12:23:16.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.544+0000 7fde22ffd640 1 -- 172.21.15.135:0/1971048053 <== mgr.25093 v2:172.21.15.135:6800/15232286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fde2c0623a0 con 0x7fde180a3ee0 2024-04-20T12:23:16.544 INFO:teuthology.orchestra.run.smithi135.stdout:/ 1m 6m3h 2024-04-20T12:23:16.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.546+0000 7fde33c7a640 1 -- 172.21.15.135:0/1971048053 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde180a3ee0 msgr2=0x7fde180a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:16.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.546+0000 7fde33c7a640 1 --2- 172.21.15.135:0/1971048053 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde180a3ee0 0x7fde180a63a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fde1c02efd0 tx=0x7fde1c02cf90 comp rx=0 tx=0).stop 2024-04-20T12:23:16.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.546+0000 7fde33c7a640 1 -- 172.21.15.135:0/1971048053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde2c06a790 msgr2=0x7fde2c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:16.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.546+0000 7fde33c7a640 1 --2- 172.21.15.135:0/1971048053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde2c06a790 0x7fde2c102e80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fde2800c890 tx=0x7fde2800cd50 comp rx=0 tx=0).stop 2024-04-20T12:23:16.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.546+0000 7fde33c7a640 1 -- 172.21.15.135:0/1971048053 shutdown_connections 2024-04-20T12:23:16.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.546+0000 7fde33c7a640 1 --2- 172.21.15.135:0/1971048053 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde2c1080f0 0x7fde2c1018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.546+0000 7fde33c7a640 1 --2- 172.21.15.135:0/1971048053 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde180a3ee0 0x7fde180a63a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.546+0000 7fde33c7a640 1 --2- 172.21.15.135:0/1971048053 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde2c06b130 0x7fde2c101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.546+0000 7fde33c7a640 1 --2- 172.21.15.135:0/1971048053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde2c06a790 0x7fde2c102e80 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:16.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.546+0000 7fde33c7a640 1 -- 172.21.15.135:0/1971048053 >> 172.21.15.135:0/1971048053 conn(0x7fde2c076c60 msgr2=0x7fde2c0ffe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:16.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.546+0000 7fde33c7a640 1 -- 172.21.15.135:0/1971048053 shutdown_connections 2024-04-20T12:23:16.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:16.546+0000 7fde33c7a640 1 -- 172.21.15.135:0/1971048053 wait complete. 2024-04-20T12:23:16.557 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-04-20T12:23:16.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:16 smithi139 ceph-mon[21834]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 1.1 KiB/s wr, 26 op/s 2024-04-20T12:23:16.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:16 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:23:16.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:16 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:23:16.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:16 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:23:16.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:16 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:23:16.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:16 smithi139 ceph-mon[21834]: from='client.15759 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:23:16.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:16 smithi139 ceph-mon[21834]: from='client.15795 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:23:16.581 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-04-20T12:23:16.591 INFO:teuthology.run_tasks:Running task background_exec... 2024-04-20T12:23:16.635 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-04-20T12:23:16.635 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-04-20T12:23:16.637 INFO:teuthology.run_tasks:Running task workunit... 2024-04-20T12:23:16.672 INFO:tasks.workunit:Pulling workunits from ref a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T12:23:16.672 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-20T12:23:16.672 INFO:tasks.workunit:timeout=3h 2024-04-20T12:23:16.672 INFO:tasks.workunit:cleanup=True 2024-04-20T12:23:16.673 DEBUG:teuthology.orchestra.run.smithi135:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-20T12:23:16.687 INFO:teuthology.orchestra.run.smithi135.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-20T12:23:16.687 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-20T12:23:16.687 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 73h/115d Inode: 1099511628283 Links: 2 2024-04-20T12:23:16.688 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T12:23:16.688 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-20T12:23:16.688 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-04-20 12:21:09.387236057 +0000 2024-04-20T12:23:16.688 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-04-20 12:21:09.387236057 +0000 2024-04-20T12:23:16.688 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-04-20 12:23:04.984800667 +0000 2024-04-20T12:23:16.688 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-04-20 12:21:09.387236057 +0000 2024-04-20T12:23:16.688 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-20T12:23:16.688 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-20T12:23:16.759 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T12:23:16.815 INFO:tasks.workunit.client.0.smithi135.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-20T12:23:17.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:17 smithi154 ceph-mon[22073]: from='client.15801 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:23:17.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:17 smithi154 ceph-mon[22073]: from='client.15807 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:23:17.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:17 smithi139 ceph-mon[21834]: from='client.15801 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:23:17.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:17 smithi139 ceph-mon[21834]: from='client.15807 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:23:17.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:17 smithi135 ceph-mon[18264]: from='client.15801 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:23:17.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:17 smithi135 ceph-mon[18264]: from='client.15807 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:23:18.488 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:18 smithi135 ceph-mon[18264]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 911 B/s wr, 20 op/s 2024-04-20T12:23:18.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:18 smithi154 ceph-mon[22073]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 911 B/s wr, 20 op/s 2024-04-20T12:23:18.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:18 smithi139 ceph-mon[21834]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 911 B/s wr, 20 op/s 2024-04-20T12:23:20.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:20 smithi154 ceph-mon[22073]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 85 KiB/s wr, 56 op/s 2024-04-20T12:23:20.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:20 smithi139 ceph-mon[21834]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 85 KiB/s wr, 56 op/s 2024-04-20T12:23:20.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:20 smithi135 ceph-mon[18264]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 85 KiB/s wr, 56 op/s 2024-04-20T12:23:22.382 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:22 smithi139 ceph-mon[21834]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 78 KiB/s wr, 51 op/s 2024-04-20T12:23:22.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:22 smithi154 ceph-mon[22073]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 78 KiB/s wr, 51 op/s 2024-04-20T12:23:22.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:22 smithi135 ceph-mon[18264]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 78 KiB/s wr, 51 op/s 2024-04-20T12:23:24.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:24 smithi154 ceph-mon[22073]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 78 KiB/s wr, 52 op/s 2024-04-20T12:23:24.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:24 smithi139 ceph-mon[21834]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 78 KiB/s wr, 52 op/s 2024-04-20T12:23:24.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:24 smithi135 ceph-mon[18264]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 78 KiB/s wr, 52 op/s 2024-04-20T12:23:26.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:26 smithi154 ceph-mon[22073]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 78 KiB/s wr, 55 op/s 2024-04-20T12:23:26.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:26 smithi139 ceph-mon[21834]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 78 KiB/s wr, 55 op/s 2024-04-20T12:23:26.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:26 smithi135 ceph-mon[18264]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 78 KiB/s wr, 55 op/s 2024-04-20T12:23:28.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:28 smithi154 ceph-mon[22073]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-04-20T12:23:28.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:28 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:23:28.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:28 smithi139 ceph-mon[21834]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-04-20T12:23:28.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:28 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:23:28.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:28 smithi135 ceph-mon[18264]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-04-20T12:23:28.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:28 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:23:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.774+0000 7f2ded915640 1 -- 172.21.15.135:0/2881238145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de81031f0 msgr2=0x7f2de81035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.774+0000 7f2ded915640 1 --2- 172.21.15.135:0/2881238145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de81031f0 0x7f2de81035d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009ca0 tx=0x7f2dd802c230 comp rx=0 tx=0).stop 2024-04-20T12:23:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.774+0000 7f2ded915640 1 -- 172.21.15.135:0/2881238145 shutdown_connections 2024-04-20T12:23:29.776 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.774+0000 7f2ded915640 1 --2- 172.21.15.135:0/2881238145 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de810c530 0x7f2de810e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.774+0000 7f2ded915640 1 --2- 172.21.15.135:0/2881238145 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2de8103b10 0x7f2de810bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.774+0000 7f2ded915640 1 --2- 172.21.15.135:0/2881238145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de81031f0 0x7f2de81035d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.774+0000 7f2ded915640 1 -- 172.21.15.135:0/2881238145 >> 172.21.15.135:0/2881238145 conn(0x7f2de8077fe0 msgr2=0x7f2de80783f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.774+0000 7f2ded915640 1 -- 172.21.15.135:0/2881238145 shutdown_connections 2024-04-20T12:23:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.774+0000 7f2ded915640 1 -- 172.21.15.135:0/2881238145 wait complete. 2024-04-20T12:23:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.774+0000 7f2ded915640 1 Processor -- start 2024-04-20T12:23:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2ded915640 1 -- start start 2024-04-20T12:23:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2ded915640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2de81031f0 0x7f2de8100e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2ded915640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de8103b10 0x7f2de8101380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2ded915640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de810c530 0x7f2de81018c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2ded915640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2de81122f0 con 0x7f2de8103b10 2024-04-20T12:23:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2ded915640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8112170 con 0x7f2de81031f0 2024-04-20T12:23:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2ded915640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8112470 con 0x7f2de810c530 2024-04-20T12:23:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2de67fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de8103b10 0x7f2de8101380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2de67fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de8103b10 0x7f2de8101380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51022/0 (socket says 172.21.15.135:51022) 2024-04-20T12:23:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2de67fc640 1 -- 172.21.15.135:0/2381220888 learned_addr learned my addr 172.21.15.135:0/2381220888 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2de6ffd640 1 --2- 172.21.15.135:0/2381220888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2de81031f0 0x7f2de8100e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2de77fe640 1 --2- 172.21.15.135:0/2381220888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de810c530 0x7f2de81018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2de67fc640 1 -- 172.21.15.135:0/2381220888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de810c530 msgr2=0x7f2de81018c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2de67fc640 1 --2- 172.21.15.135:0/2381220888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de810c530 0x7f2de81018c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2de67fc640 1 -- 172.21.15.135:0/2381220888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2de81031f0 msgr2=0x7f2de8100e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2de67fc640 1 --2- 172.21.15.135:0/2381220888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2de81031f0 0x7f2de8100e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.775+0000 7f2de67fc640 1 -- 172.21.15.135:0/2381220888 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de81a6cd0 con 0x7f2de8103b10 2024-04-20T12:23:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.776+0000 7f2de67fc640 1 --2- 172.21.15.135:0/2381220888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de8103b10 0x7f2de8101380 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00d950 tx=0x7f2ddc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.776+0000 7f2dec913640 1 -- 172.21.15.135:0/2381220888 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc017070 con 0x7f2de8103b10 2024-04-20T12:23:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.776+0000 7f2dec913640 1 -- 172.21.15.135:0/2381220888 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ddc009c30 con 0x7f2de8103b10 2024-04-20T12:23:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.776+0000 7f2ded915640 1 -- 172.21.15.135:0/2381220888 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de81a6fc0 con 0x7f2de8103b10 2024-04-20T12:23:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.776+0000 7f2dec913640 1 -- 172.21.15.135:0/2381220888 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc00f6b0 con 0x7f2de8103b10 2024-04-20T12:23:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.776+0000 7f2ded915640 1 -- 172.21.15.135:0/2381220888 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de81a74d0 con 0x7f2de8103b10 2024-04-20T12:23:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.778+0000 7f2dec913640 1 -- 172.21.15.135:0/2381220888 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7f2ddc0109d0 con 0x7f2de8103b10 2024-04-20T12:23:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2df05e6740 1 Processor -- start 2024-04-20T12:23:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2df05e6740 1 -- start start 2024-04-20T12:23:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2df05e6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a0e110 0x55d5b2a0e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2df05e6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a172c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2df05e6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a17800 0x55d5b2a19bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2df05e6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d5b2973820 con 0x55d5b2a0ea30 2024-04-20T12:23:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2df05e6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d5b2910fc0 con 0x55d5b2a0e110 2024-04-20T12:23:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2df05e6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d5b296f7e0 con 0x55d5b2a17800 2024-04-20T12:23:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2dec913640 1 --2- 172.21.15.135:0/2381220888 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2dd00a3f60 0x7f2dd00a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2de6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a172c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2de6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a172c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51030/0 (socket says 172.21.15.135:51030) 2024-04-20T12:23:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2de6ffd640 1 -- 172.21.15.135:0/2777286265 learned_addr learned my addr 172.21.15.135:0/2777286265 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2de77fe640 1 --2- 172.21.15.135:0/2381220888 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2dd00a3f60 0x7f2dd00a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2de77fe640 1 --2- 172.21.15.135:0/2777286265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a0e110 0x55d5b2a0e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2dec913640 1 -- 172.21.15.135:0/2381220888 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f2ddc0d0a20 con 0x7f2de8103b10 2024-04-20T12:23:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2de67fc640 1 --2- 172.21.15.135:0/2777286265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a17800 0x55d5b2a19bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2de6ffd640 1 -- 172.21.15.135:0/2777286265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a17800 msgr2=0x55d5b2a19bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2de6ffd640 1 --2- 172.21.15.135:0/2777286265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a17800 0x55d5b2a19bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2de6ffd640 1 -- 172.21.15.135:0/2777286265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a0e110 msgr2=0x55d5b2a0e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.779+0000 7f2de6ffd640 1 --2- 172.21.15.135:0/2777286265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a0e110 0x55d5b2a0e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.780+0000 7f2de6ffd640 1 -- 172.21.15.135:0/2777286265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5b2686210 con 0x55d5b2a0ea30 2024-04-20T12:23:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.780+0000 7f2de77fe640 1 --2- 172.21.15.135:0/2777286265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a0e110 0x55d5b2a0e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.780+0000 7f2de6ffd640 1 --2- 172.21.15.135:0/2777286265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a172c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2dd802c840 tx=0x7f2dd80099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c40ea3e82c8d99 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.780+0000 7f2de77fe640 1 --2- 172.21.15.135:0/2381220888 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2dd00a3f60 0x7f2dd00a6420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2de0005d50 tx=0x7f2de0005dd0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.780+0000 7f2dcdffb640 1 -- 172.21.15.135:0/2777286265 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8043070 con 0x55d5b2a0ea30 2024-04-20T12:23:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.780+0000 7f2dcdffb640 1 -- 172.21.15.135:0/2777286265 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dd8032c00 con 0x55d5b2a0ea30 2024-04-20T12:23:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.780+0000 7f2dcdffb640 1 -- 172.21.15.135:0/2777286265 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8039040 con 0x55d5b2a0ea30 2024-04-20T12:23:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.781+0000 7f2df05e6740 1 -- 172.21.15.135:0/2777286265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a0ea30 msgr2=0x55d5b2a172c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.781+0000 7f2df05e6740 1 --2- 172.21.15.135:0/2777286265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a172c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2dd802c840 tx=0x7f2dd80099f0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.781+0000 7f2df05e6740 1 -- 172.21.15.135:0/2777286265 shutdown_connections 2024-04-20T12:23:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.781+0000 7f2df05e6740 1 --2- 172.21.15.135:0/2777286265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a17800 0x55d5b2a19bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.781+0000 7f2df05e6740 1 --2- 172.21.15.135:0/2777286265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a172c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.781+0000 7f2df05e6740 1 --2- 172.21.15.135:0/2777286265 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a0e110 0x55d5b2a0e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.781+0000 7f2df05e6740 1 -- 172.21.15.135:0/2777286265 >> 172.21.15.135:0/2777286265 conn(0x55d5b2a08a30 msgr2=0x55d5b2a08e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.781+0000 7f2df05e6740 1 -- 172.21.15.135:0/2777286265 shutdown_connections 2024-04-20T12:23:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.781+0000 7f2df05e6740 1 -- 172.21.15.135:0/2777286265 wait complete. 2024-04-20T12:23:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.781+0000 7f2df05e6740 1 -- start start 2024-04-20T12:23:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.781+0000 7f2df05e6740 1 Processor -- start 2024-04-20T12:23:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2df05e6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a0e110 0x55d5b2a14820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2df05e6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a14d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2df05e6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a17800 0x55d5b2a152a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2df05e6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d5b2a1a3d0 con 0x55d5b2a17800 2024-04-20T12:23:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2df05e6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d5b28fbee0 con 0x55d5b2a0ea30 2024-04-20T12:23:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2df05e6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d5b2a1a550 con 0x55d5b2a0e110 2024-04-20T12:23:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2df05e6740 10 client.0 _ll_register_callbacks cb 0x55d5b2911d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2de77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a17800 0x55d5b2a152a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2de77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a17800 0x55d5b2a152a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51044/0 (socket says 172.21.15.135:51044) 2024-04-20T12:23:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2de77fe640 1 -- 172.21.15.135:0/1774571968 learned_addr learned my addr 172.21.15.135:0/1774571968 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2de67fc640 1 --2- 172.21.15.135:0/1774571968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a14d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2de6ffd640 1 --2- 172.21.15.135:0/1774571968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a0e110 0x55d5b2a14820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2de77fe640 1 -- 172.21.15.135:0/1774571968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a0e110 msgr2=0x55d5b2a14820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2de77fe640 1 --2- 172.21.15.135:0/1774571968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a0e110 0x55d5b2a14820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2de77fe640 1 -- 172.21.15.135:0/1774571968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a0ea30 msgr2=0x55d5b2a14d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2de77fe640 1 --2- 172.21.15.135:0/1774571968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a14d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2de77fe640 1 -- 172.21.15.135:0/1774571968 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5b2752620 con 0x55d5b2a17800 2024-04-20T12:23:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2de77fe640 1 --2- 172.21.15.135:0/1774571968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a17800 0x55d5b2a152a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2de000e870 tx=0x7f2de0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5411ae52d95239d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2dc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2dc6ffd640 1 -- 172.21.15.135:0/1774571968 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0023070 con 0x55d5b2a17800 2024-04-20T12:23:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2dc6ffd640 1 -- 172.21.15.135:0/1774571968 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f2de0010c80 con 0x55d5b2a17800 2024-04-20T12:23:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2df05e6740 1 -- 172.21.15.135:0/1774571968 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dd8032c00 con 0x55d5b2a17800 2024-04-20T12:23:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.782+0000 7f2dc6ffd640 1 -- 172.21.15.135:0/1774571968 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2de002e050 con 0x55d5b2a17800 2024-04-20T12:23:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.783+0000 7f2df05e6740 10 client.15819 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.783+0000 7f2df05e6740 1 -- 172.21.15.135:0/1774571968 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d5b2a26630 con 0x55d5b2a17800 2024-04-20T12:23:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.783+0000 7f2dc6ffd640 1 -- 172.21.15.135:0/1774571968 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dd8032c00 con 0x55d5b2a17800 2024-04-20T12:23:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.783+0000 7f2dc6ffd640 1 -- 172.21.15.135:0/1774571968 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2de0004c00 con 0x55d5b2a17800 2024-04-20T12:23:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.783+0000 7f2df05e6740 10 client.15819 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.783+0000 7f2df05e6740 10 client.15819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.783+0000 7f2df05e6740 20 client.15819 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.783+0000 7f2df05e6740 1 --2- 172.21.15.135:0/1774571968 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d5b2a27aa0 0x55d5b2a29f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.783+0000 7f2df05e6740 4 client.15819 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:23:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.783+0000 7f2df05e6740 1 -- 172.21.15.135:0/1774571968 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5b2981240 con 0x55d5b2a27aa0 2024-04-20T12:23:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.783+0000 7f2de6ffd640 1 --2- 172.21.15.135:0/1774571968 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d5b2a27aa0 0x55d5b2a29f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.784+0000 7f2de6ffd640 1 --2- 172.21.15.135:0/1774571968 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d5b2a27aa0 0x55d5b2a29f10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81b0d8d97c184bf2 server_cookie=fe20f7675425513a in_seq=0 out_seq=0 2024-04-20T12:23:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.784+0000 7f2dc6ffd640 10 client.15819 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.784+0000 7f2dc6ffd640 1 -- 172.21.15.135:0/1774571968 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d5b2981240 con 0x55d5b2a27aa0 2024-04-20T12:23:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.784+0000 7f2dc6ffd640 10 client.15819 handle_command_reply: tid=0 2024-04-20T12:23:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.784+0000 7f2df05e6740 1 client.15819 shutdown 2024-04-20T12:23:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.785+0000 7f2df05e6740 1 -- 172.21.15.135:0/1774571968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a17800 msgr2=0x55d5b2a152a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.785+0000 7f2df05e6740 1 --2- 172.21.15.135:0/1774571968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a17800 0x55d5b2a152a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2de000e870 tx=0x7f2de0004730 comp rx=0 tx=0).stop 2024-04-20T12:23:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.785+0000 7f2df05e6740 1 -- 172.21.15.135:0/1774571968 shutdown_connections 2024-04-20T12:23:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.785+0000 7f2df05e6740 1 --2- 172.21.15.135:0/1774571968 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d5b2a27aa0 0x55d5b2a29f10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.785+0000 7f2df05e6740 1 --2- 172.21.15.135:0/1774571968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a17800 0x55d5b2a152a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.785+0000 7f2df05e6740 1 --2- 172.21.15.135:0/1774571968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a14d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.785+0000 7f2dc6ffd640 0 client.15819 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.785+0000 7f2df05e6740 1 --2- 172.21.15.135:0/1774571968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a0e110 0x55d5b2a14820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.785+0000 7f2df05e6740 1 -- 172.21.15.135:0/1774571968 >> 172.21.15.135:0/1774571968 conn(0x55d5b2a08a30 msgr2=0x55d5b2a0a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.785+0000 7f2df05e6740 1 -- 172.21.15.135:0/1774571968 shutdown_connections 2024-04-20T12:23:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.785+0000 7f2df05e6740 1 -- 172.21.15.135:0/1774571968 wait complete. 2024-04-20T12:23:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.785+0000 7f2df05e6740 20 client.15819 trim_cache size 0 max 16384 2024-04-20T12:23:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.799+0000 7f2df05e6740 1 Processor -- start 2024-04-20T12:23:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.799+0000 7f2df05e6740 1 -- start start 2024-04-20T12:23:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2df05e6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a0e110 0x55d5b2a16f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2df05e6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a23290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2df05e6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a17800 0x55d5b2a14ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2df05e6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2de81b1550 con 0x55d5b2a17800 2024-04-20T12:23:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2df05e6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2de81b3090 con 0x55d5b2a0ea30 2024-04-20T12:23:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2df05e6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2de81b1c20 con 0x55d5b2a0e110 2024-04-20T12:23:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2de77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a17800 0x55d5b2a14ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2de77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a17800 0x55d5b2a14ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51056/0 (socket says 172.21.15.135:51056) 2024-04-20T12:23:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2de77fe640 1 -- 172.21.15.135:0/274241285 learned_addr learned my addr 172.21.15.135:0/274241285 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2de6ffd640 1 --2- 172.21.15.135:0/274241285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a0e110 0x55d5b2a16f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2de77fe640 1 -- 172.21.15.135:0/274241285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a0e110 msgr2=0x55d5b2a16f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2de77fe640 1 --2- 172.21.15.135:0/274241285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a0e110 0x55d5b2a16f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2de77fe640 1 -- 172.21.15.135:0/274241285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a0ea30 msgr2=0x55d5b2a23290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2de77fe640 1 --2- 172.21.15.135:0/274241285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a23290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2de77fe640 1 -- 172.21.15.135:0/274241285 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5b2a0e860 con 0x55d5b2a17800 2024-04-20T12:23:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2de77fe640 1 --2- 172.21.15.135:0/274241285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a17800 0x55d5b2a14ef0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2de0000c00 tx=0x7f2de0011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c744a2fbbc9760 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2dcd7fa640 1 -- 172.21.15.135:0/274241285 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0023070 con 0x55d5b2a17800 2024-04-20T12:23:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2dcd7fa640 1 -- 172.21.15.135:0/274241285 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2de0037070 con 0x55d5b2a17800 2024-04-20T12:23:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.800+0000 7f2dcd7fa640 1 -- 172.21.15.135:0/274241285 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0004fd0 con 0x55d5b2a17800 2024-04-20T12:23:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.801+0000 7f2df05e6740 1 -- 172.21.15.135:0/274241285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a17800 msgr2=0x55d5b2a14ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.801+0000 7f2df05e6740 1 --2- 172.21.15.135:0/274241285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a17800 0x55d5b2a14ef0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2de0000c00 tx=0x7f2de0011f60 comp rx=0 tx=0).stop 2024-04-20T12:23:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.801+0000 7f2df05e6740 1 -- 172.21.15.135:0/274241285 shutdown_connections 2024-04-20T12:23:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.801+0000 7f2df05e6740 1 --2- 172.21.15.135:0/274241285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a17800 0x55d5b2a14ef0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.801+0000 7f2df05e6740 1 --2- 172.21.15.135:0/274241285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a23290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.801+0000 7f2df05e6740 1 --2- 172.21.15.135:0/274241285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a0e110 0x55d5b2a16f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.801+0000 7f2df05e6740 1 -- 172.21.15.135:0/274241285 >> 172.21.15.135:0/274241285 conn(0x55d5b2a08a30 msgr2=0x55d5b2a147e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.801+0000 7f2df05e6740 1 -- 172.21.15.135:0/274241285 shutdown_connections 2024-04-20T12:23:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.801+0000 7f2df05e6740 1 -- 172.21.15.135:0/274241285 wait complete. 2024-04-20T12:23:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.801+0000 7f2df05e6740 1 -- start start 2024-04-20T12:23:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.801+0000 7f2df05e6740 1 Processor -- start 2024-04-20T12:23:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2df05e6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a0e110 0x55d5b2a1b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2df05e6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a1baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2df05e6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a17800 0x55d5b2a8d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2df05e6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2de81b29c0 con 0x55d5b2a0ea30 2024-04-20T12:23:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2df05e6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2de81b22f0 con 0x55d5b2a17800 2024-04-20T12:23:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2df05e6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2de81af520 con 0x55d5b2a0e110 2024-04-20T12:23:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2df05e6740 10 client.0 _ll_register_callbacks cb 0x7f2de000e740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2de67fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a1baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2de67fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a1baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51060/0 (socket says 172.21.15.135:51060) 2024-04-20T12:23:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2de67fc640 1 -- 172.21.15.135:0/2464208628 learned_addr learned my addr 172.21.15.135:0/2464208628 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2de6ffd640 1 --2- 172.21.15.135:0/2464208628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a0e110 0x55d5b2a1b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2de77fe640 1 --2- 172.21.15.135:0/2464208628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a17800 0x55d5b2a8d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2de67fc640 1 -- 172.21.15.135:0/2464208628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a0e110 msgr2=0x55d5b2a1b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2de67fc640 1 --2- 172.21.15.135:0/2464208628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a0e110 0x55d5b2a1b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2de67fc640 1 -- 172.21.15.135:0/2464208628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a17800 msgr2=0x55d5b2a8d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2de67fc640 1 --2- 172.21.15.135:0/2464208628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a17800 0x55d5b2a8d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2de67fc640 1 -- 172.21.15.135:0/2464208628 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5b2a1c370 con 0x55d5b2a0ea30 2024-04-20T12:23:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2de77fe640 1 --2- 172.21.15.135:0/2464208628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a17800 0x55d5b2a8d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2de67fc640 1 --2- 172.21.15.135:0/2464208628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a1baa0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc0987f0 tx=0x7f2ddc09be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f1f8f11e58a63f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2dc6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2dc6ffd640 1 -- 172.21.15.135:0/2464208628 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc020040 con 0x55d5b2a0ea30 2024-04-20T12:23:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2dc6ffd640 1 -- 172.21.15.135:0/2464208628 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f2ddc0ce0f0 con 0x55d5b2a0ea30 2024-04-20T12:23:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.802+0000 7f2df05e6740 1 -- 172.21.15.135:0/2464208628 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2de0037070 con 0x55d5b2a0ea30 2024-04-20T12:23:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.803+0000 7f2dc6ffd640 1 -- 172.21.15.135:0/2464208628 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ddc0a5000 con 0x55d5b2a0ea30 2024-04-20T12:23:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.803+0000 7f2df05e6740 10 client.15825 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.803+0000 7f2df05e6740 1 -- 172.21.15.135:0/2464208628 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d5b2a8e780 con 0x55d5b2a0ea30 2024-04-20T12:23:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.803+0000 7f2dc6ffd640 1 -- 172.21.15.135:0/2464208628 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2de0037070 con 0x55d5b2a0ea30 2024-04-20T12:23:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.803+0000 7f2dc6ffd640 1 -- 172.21.15.135:0/2464208628 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2ddc098200 con 0x55d5b2a0ea30 2024-04-20T12:23:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.803+0000 7f2df05e6740 10 client.15825 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.803+0000 7f2df05e6740 10 client.15825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.803+0000 7f2df05e6740 20 client.15825 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.803+0000 7f2df05e6740 1 --2- 172.21.15.135:0/2464208628 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d5b2a8eee0 0x55d5b2a91300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.803+0000 7f2df05e6740 4 client.15825 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-20T12:23:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.803+0000 7f2df05e6740 1 -- 172.21.15.135:0/2464208628 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d5b297b0b0 con 0x55d5b2a8eee0 2024-04-20T12:23:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.803+0000 7f2de6ffd640 1 --2- 172.21.15.135:0/2464208628 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d5b2a8eee0 0x55d5b2a91300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.803+0000 7f2de6ffd640 1 --2- 172.21.15.135:0/2464208628 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d5b2a8eee0 0x55d5b2a91300 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=869400e4a33f853 server_cookie=74ddc8bd45d6bf66 in_seq=0 out_seq=0 2024-04-20T12:23:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.803+0000 7f2dc6ffd640 10 client.15825 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.816+0000 7f2dc6ffd640 1 -- 172.21.15.135:0/2464208628 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d5b297b0b0 con 0x55d5b2a8eee0 2024-04-20T12:23:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.816+0000 7f2dc6ffd640 10 client.15825 handle_command_reply: tid=0 2024-04-20T12:23:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.816+0000 7f2df05e6740 1 client.15825 shutdown 2024-04-20T12:23:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.816+0000 7f2df05e6740 1 -- 172.21.15.135:0/2464208628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a0ea30 msgr2=0x55d5b2a1baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.816+0000 7f2df05e6740 1 --2- 172.21.15.135:0/2464208628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a1baa0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc0987f0 tx=0x7f2ddc09be20 comp rx=0 tx=0).stop 2024-04-20T12:23:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.816+0000 7f2df05e6740 1 -- 172.21.15.135:0/2464208628 shutdown_connections 2024-04-20T12:23:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.816+0000 7f2df05e6740 1 --2- 172.21.15.135:0/2464208628 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d5b2a8eee0 0x55d5b2a91300 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.816+0000 7f2df05e6740 1 --2- 172.21.15.135:0/2464208628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d5b2a17800 0x55d5b2a8d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.816+0000 7f2df05e6740 1 --2- 172.21.15.135:0/2464208628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d5b2a0ea30 0x55d5b2a1baa0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.816+0000 7f2dc6ffd640 0 client.15825 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.816+0000 7f2df05e6740 1 --2- 172.21.15.135:0/2464208628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d5b2a0e110 0x55d5b2a1b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.816+0000 7f2df05e6740 1 -- 172.21.15.135:0/2464208628 >> 172.21.15.135:0/2464208628 conn(0x55d5b2a08a30 msgr2=0x55d5b2a07b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.816+0000 7f2df05e6740 1 -- 172.21.15.135:0/2464208628 shutdown_connections 2024-04-20T12:23:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.816+0000 7f2df05e6740 1 -- 172.21.15.135:0/2464208628 wait complete. 2024-04-20T12:23:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.816+0000 7f2df05e6740 20 client.15825 trim_cache size 0 max 16384 2024-04-20T12:23:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-04-20T12:23:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-04-20T12:23:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-04-20T12:23:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-04-20T12:23:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.817+0000 7f2ded915640 1 -- 172.21.15.135:0/2381220888 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2dd00a3f60 msgr2=0x7f2dd00a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.817+0000 7f2ded915640 1 --2- 172.21.15.135:0/2381220888 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2dd00a3f60 0x7f2dd00a6420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2de0005d50 tx=0x7f2de0005dd0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.817+0000 7f2ded915640 1 -- 172.21.15.135:0/2381220888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de8103b10 msgr2=0x7f2de8101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.817+0000 7f2ded915640 1 --2- 172.21.15.135:0/2381220888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de8103b10 0x7f2de8101380 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00d950 tx=0x7f2ddc00de10 comp rx=0 tx=0).stop 2024-04-20T12:23:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.817+0000 7f2ded915640 1 -- 172.21.15.135:0/2381220888 shutdown_connections 2024-04-20T12:23:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.817+0000 7f2ded915640 1 --2- 172.21.15.135:0/2381220888 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2dd00a3f60 0x7f2dd00a6420 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.817+0000 7f2ded915640 1 --2- 172.21.15.135:0/2381220888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2de810c530 0x7f2de81018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.817+0000 7f2ded915640 1 --2- 172.21.15.135:0/2381220888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2de8103b10 0x7f2de8101380 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.817+0000 7f2ded915640 1 --2- 172.21.15.135:0/2381220888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2de81031f0 0x7f2de8100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.817+0000 7f2ded915640 1 -- 172.21.15.135:0/2381220888 >> 172.21.15.135:0/2381220888 conn(0x7f2de8077fe0 msgr2=0x7f2de80fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.817+0000 7f2ded915640 1 -- 172.21.15.135:0/2381220888 shutdown_connections 2024-04-20T12:23:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:29.817+0000 7f2ded915640 1 -- 172.21.15.135:0/2381220888 wait complete. 2024-04-20T12:23:30.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:30 smithi154 ceph-mon[22073]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-04-20T12:23:30.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:30 smithi139 ceph-mon[21834]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-04-20T12:23:30.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:30 smithi135 ceph-mon[18264]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-04-20T12:23:32.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:32 smithi154 ceph-mon[22073]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:23:32.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:32 smithi139 ceph-mon[21834]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:23:32.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:32 smithi135 ceph-mon[18264]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:23:34.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:34 smithi154 ceph-mon[22073]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-20T12:23:34.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:34 smithi139 ceph-mon[21834]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-20T12:23:34.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:34 smithi135 ceph-mon[18264]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-04-20T12:23:36.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:36 smithi154 ceph-mon[22073]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.6 KiB/s wr, 16 op/s 2024-04-20T12:23:36.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:36 smithi139 ceph-mon[21834]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.6 KiB/s wr, 16 op/s 2024-04-20T12:23:36.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:36 smithi135 ceph-mon[18264]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.6 KiB/s wr, 16 op/s 2024-04-20T12:23:38.416 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:38 smithi135 ceph-mon[18264]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-04-20T12:23:38.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:38 smithi154 ceph-mon[22073]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-04-20T12:23:38.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:38 smithi139 ceph-mon[21834]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-04-20T12:23:40.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:40 smithi154 ceph-mon[22073]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.6 KiB/s wr, 17 op/s 2024-04-20T12:23:40.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:40 smithi139 ceph-mon[21834]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.6 KiB/s wr, 17 op/s 2024-04-20T12:23:40.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:40 smithi135 ceph-mon[18264]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.6 KiB/s wr, 17 op/s 2024-04-20T12:23:42.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:42 smithi154 ceph-mon[22073]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-04-20T12:23:42.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:42 smithi139 ceph-mon[21834]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-04-20T12:23:42.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:42 smithi135 ceph-mon[18264]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-04-20T12:23:42.915 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.914+0000 7f9d13bfd640 1 -- 172.21.15.135:0/2963585373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d0c106180 msgr2=0x7f9d0c10dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:42.915 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.914+0000 7f9d13bfd640 1 --2- 172.21.15.135:0/2963585373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d0c106180 0x7f9d0c10dd50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9d04009ca0 tx=0x7f9d0402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.915 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.914+0000 7f9d13bfd640 1 -- 172.21.15.135:0/2963585373 shutdown_connections 2024-04-20T12:23:42.915 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.914+0000 7f9d13bfd640 1 --2- 172.21.15.135:0/2963585373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d0c106180 0x7f9d0c10dd50 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.915 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.914+0000 7f9d13bfd640 1 --2- 172.21.15.135:0/2963585373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0c101ab0 0x7f9d0c105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.914+0000 7f9d13bfd640 1 --2- 172.21.15.135:0/2963585373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d0c101100 0x7f9d0c1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.914+0000 7f9d13bfd640 1 -- 172.21.15.135:0/2963585373 >> 172.21.15.135:0/2963585373 conn(0x7f9d0c077fe0 msgr2=0x7f9d0c0783f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.914+0000 7f9d13bfd640 1 -- 172.21.15.135:0/2963585373 shutdown_connections 2024-04-20T12:23:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.914+0000 7f9d13bfd640 1 -- 172.21.15.135:0/2963585373 wait complete. 2024-04-20T12:23:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.915+0000 7f9d13bfd640 1 Processor -- start 2024-04-20T12:23:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.915+0000 7f9d13bfd640 1 -- start start 2024-04-20T12:23:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.915+0000 7f9d13bfd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0c101100 0x7f9d0c199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.915+0000 7f9d13bfd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d0c106180 0x7f9d0c199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.915+0000 7f9d13bfd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d0c19a040 0x7f9d0c1a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.915+0000 7f9d13bfd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c111220 con 0x7f9d0c19a040 2024-04-20T12:23:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.915+0000 7f9d13bfd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c1110a0 con 0x7f9d0c106180 2024-04-20T12:23:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.915+0000 7f9d13bfd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c1113a0 con 0x7f9d0c101100 2024-04-20T12:23:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.915+0000 7f9d1219a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d0c19a040 0x7f9d0c1a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.915+0000 7f9d1219a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d0c19a040 0x7f9d0c1a45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39168/0 (socket says 172.21.15.135:39168) 2024-04-20T12:23:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.915+0000 7f9d1219a640 1 -- 172.21.15.135:0/2465060975 learned_addr learned my addr 172.21.15.135:0/2465060975 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.915+0000 7f9d11999640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0c101100 0x7f9d0c199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.915+0000 7f9d11198640 1 --2- 172.21.15.135:0/2465060975 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d0c106180 0x7f9d0c199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.916+0000 7f9d1219a640 1 -- 172.21.15.135:0/2465060975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0c101100 msgr2=0x7f9d0c199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.916+0000 7f9d1219a640 1 --2- 172.21.15.135:0/2465060975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0c101100 0x7f9d0c199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.916+0000 7f9d1219a640 1 -- 172.21.15.135:0/2465060975 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d0c106180 msgr2=0x7f9d0c199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.916+0000 7f9d1219a640 1 --2- 172.21.15.135:0/2465060975 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d0c106180 0x7f9d0c199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.916+0000 7f9d1219a640 1 -- 172.21.15.135:0/2465060975 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0c1a4dc0 con 0x7f9d0c19a040 2024-04-20T12:23:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.916+0000 7f9d1219a640 1 --2- 172.21.15.135:0/2465060975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d0c19a040 0x7f9d0c1a45a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9d0402c700 tx=0x7f9d04032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.916+0000 7f9d02ffd640 1 -- 172.21.15.135:0/2465060975 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04039040 con 0x7f9d0c19a040 2024-04-20T12:23:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.916+0000 7f9d02ffd640 1 -- 172.21.15.135:0/2465060975 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d04044070 con 0x7f9d0c19a040 2024-04-20T12:23:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.916+0000 7f9d02ffd640 1 -- 172.21.15.135:0/2465060975 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d040042a0 con 0x7f9d0c19a040 2024-04-20T12:23:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.916+0000 7f9d13bfd640 1 -- 172.21.15.135:0/2465060975 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d0c1a5050 con 0x7f9d0c19a040 2024-04-20T12:23:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.916+0000 7f9d13bfd640 1 -- 172.21.15.135:0/2465060975 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0c1a5590 con 0x7f9d0c19a040 2024-04-20T12:23:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.918+0000 7f9d02ffd640 1 -- 172.21.15.135:0/2465060975 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7f9d04004440 con 0x7f9d0c19a040 2024-04-20T12:23:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.919+0000 7f9d167df740 1 Processor -- start 2024-04-20T12:23:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.919+0000 7f9d167df740 1 -- start start 2024-04-20T12:23:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.919+0000 7f9d167df740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3b110 0x56263ff3b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.919+0000 7f9d167df740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3ba30 0x56263ff442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.919+0000 7f9d167df740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff46bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.919+0000 7f9d02ffd640 1 --2- 172.21.15.135:0/2465060975 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9cf80a3f60 0x7f9cf80a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.919+0000 7f9d167df740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56263fea0820 con 0x56263ff44800 2024-04-20T12:23:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.919+0000 7f9d167df740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56263fe3dfc0 con 0x56263ff3b110 2024-04-20T12:23:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.919+0000 7f9d167df740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56263fe9c7e0 con 0x56263ff3ba30 2024-04-20T12:23:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.919+0000 7f9d11198640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff46bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.919+0000 7f9d11999640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3ba30 0x56263ff442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.919+0000 7f9d11198640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3b110 0x56263ff3b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.919+0000 7f9d11999640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3ba30 0x56263ff442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.135:33836/0 (socket says 172.21.15.135:33836) 2024-04-20T12:23:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.919+0000 7f9d11999640 1 -- 172.21.15.135:0/2961459361 learned_addr learned my addr 172.21.15.135:0/2961459361 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.920+0000 7f9d1219a640 1 --2- 172.21.15.135:0/2465060975 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9cf80a3f60 0x7f9cf80a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.920+0000 7f9d11198640 1 -- 172.21.15.135:0/2961459361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3ba30 msgr2=0x56263ff442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.920+0000 7f9d11198640 1 --2- 172.21.15.135:0/2961459361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3ba30 0x56263ff442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.920+0000 7f9d11198640 1 -- 172.21.15.135:0/2961459361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 msgr2=0x56263ff46bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.920+0000 7f9d11198640 1 --2- 172.21.15.135:0/2961459361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff46bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.920+0000 7f9d11198640 1 -- 172.21.15.135:0/2961459361 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56263fbb3210 con 0x56263ff3b110 2024-04-20T12:23:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.920+0000 7f9d02ffd640 1 -- 172.21.15.135:0/2465060975 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9d040f2fe0 con 0x7f9d0c19a040 2024-04-20T12:23:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.920+0000 7f9d1219a640 1 --2- 172.21.15.135:0/2465060975 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9cf80a3f60 0x7f9cf80a6420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9d040f03a0 tx=0x7f9d040915b0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.920+0000 7f9d11198640 1 --2- 172.21.15.135:0/2961459361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3b110 0x56263ff3b4f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c06a1c0 tx=0x7f9d0800b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e764825351c1a2e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.920+0000 7f9cf7fff640 1 -- 172.21.15.135:0/2961459361 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08004050 con 0x56263ff3b110 2024-04-20T12:23:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.920+0000 7f9cf7fff640 1 -- 172.21.15.135:0/2961459361 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d08005500 con 0x56263ff3b110 2024-04-20T12:23:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.920+0000 7f9cf7fff640 1 -- 172.21.15.135:0/2961459361 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08004d00 con 0x56263ff3b110 2024-04-20T12:23:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.921+0000 7f9d167df740 1 -- 172.21.15.135:0/2961459361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3b110 msgr2=0x56263ff3b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.921+0000 7f9d167df740 1 --2- 172.21.15.135:0/2961459361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3b110 0x56263ff3b4f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c06a1c0 tx=0x7f9d0800b390 comp rx=0 tx=0).stop 2024-04-20T12:23:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.921+0000 7f9d167df740 1 -- 172.21.15.135:0/2961459361 shutdown_connections 2024-04-20T12:23:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.921+0000 7f9d167df740 1 --2- 172.21.15.135:0/2961459361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff46bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.921+0000 7f9d167df740 1 --2- 172.21.15.135:0/2961459361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3ba30 0x56263ff442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.921+0000 7f9d167df740 1 --2- 172.21.15.135:0/2961459361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3b110 0x56263ff3b4f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.921+0000 7f9d167df740 1 -- 172.21.15.135:0/2961459361 >> 172.21.15.135:0/2961459361 conn(0x56263ff35a30 msgr2=0x56263ff35e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.921+0000 7f9d167df740 1 -- 172.21.15.135:0/2961459361 shutdown_connections 2024-04-20T12:23:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.921+0000 7f9d167df740 1 -- 172.21.15.135:0/2961459361 wait complete. 2024-04-20T12:23:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.921+0000 7f9d167df740 1 -- start start 2024-04-20T12:23:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d167df740 1 Processor -- start 2024-04-20T12:23:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d167df740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3b110 0x56263ff41830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d167df740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3ba30 0x56263ff41d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d167df740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff422b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d167df740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56263ff47430 con 0x56263ff44800 2024-04-20T12:23:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d167df740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56263fe28ee0 con 0x56263ff3ba30 2024-04-20T12:23:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d167df740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56263ff475b0 con 0x56263ff3b110 2024-04-20T12:23:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d167df740 10 client.0 _ll_register_callbacks cb 0x56263fe3ed90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d11198640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d11198640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff422b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39196/0 (socket says 172.21.15.135:39196) 2024-04-20T12:23:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d11198640 1 -- 172.21.15.135:0/2940090343 learned_addr learned my addr 172.21.15.135:0/2940090343 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d11198640 1 --2- 172.21.15.135:0/2940090343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3b110 0x56263ff41830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d11999640 1 --2- 172.21.15.135:0/2940090343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3ba30 0x56263ff41d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d11198640 1 -- 172.21.15.135:0/2940090343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3b110 msgr2=0x56263ff41830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d11198640 1 --2- 172.21.15.135:0/2940090343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3b110 0x56263ff41830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d11198640 1 -- 172.21.15.135:0/2940090343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3ba30 msgr2=0x56263ff41d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d11198640 1 --2- 172.21.15.135:0/2940090343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3ba30 0x56263ff41d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d11198640 1 -- 172.21.15.135:0/2940090343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56263fc7f620 con 0x56263ff44800 2024-04-20T12:23:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.922+0000 7f9d11999640 1 --2- 172.21.15.135:0/2940090343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3ba30 0x56263ff41d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9d11198640 1 --2- 172.21.15.135:0/2940090343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff422b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9d08004770 tx=0x7f9d08004980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e3f250e4e6e840 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9cf57fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9cf57fa640 1 -- 172.21.15.135:0/2940090343 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08023020 con 0x56263ff44800 2024-04-20T12:23:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9cf57fa640 1 -- 172.21.15.135:0/2940090343 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9d08004050 con 0x56263ff44800 2024-04-20T12:23:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9d167df740 1 -- 172.21.15.135:0/2940090343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d08005500 con 0x56263ff44800 2024-04-20T12:23:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9cf57fa640 1 -- 172.21.15.135:0/2940090343 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9d08033050 con 0x56263ff44800 2024-04-20T12:23:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9d167df740 10 client.15837 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9d167df740 1 -- 172.21.15.135:0/2940090343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56263ff53690 con 0x56263ff44800 2024-04-20T12:23:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9cf57fa640 1 -- 172.21.15.135:0/2940090343 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d08005500 con 0x56263ff44800 2024-04-20T12:23:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9cf57fa640 1 -- 172.21.15.135:0/2940090343 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f9d08003b60 con 0x56263ff44800 2024-04-20T12:23:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9d167df740 10 client.15837 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9d167df740 10 client.15837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9d167df740 20 client.15837 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9d167df740 1 --2- 172.21.15.135:0/2940090343 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56263ff54af0 0x56263ff56ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9d167df740 4 client.15837 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:23:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.923+0000 7f9d167df740 1 -- 172.21.15.135:0/2940090343 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56263feae240 con 0x56263ff54af0 2024-04-20T12:23:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.924+0000 7f9d11999640 1 --2- 172.21.15.135:0/2940090343 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56263ff54af0 0x56263ff56ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.924+0000 7f9d11999640 1 --2- 172.21.15.135:0/2940090343 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56263ff54af0 0x56263ff56ee0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d910a06bc0e9125d server_cookie=ac6e3430bc92a594 in_seq=0 out_seq=0 2024-04-20T12:23:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.924+0000 7f9cf57fa640 10 client.15837 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.925+0000 7f9cf57fa640 1 -- 172.21.15.135:0/2940090343 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56263feae240 con 0x56263ff54af0 2024-04-20T12:23:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.925+0000 7f9cf57fa640 10 client.15837 handle_command_reply: tid=0 2024-04-20T12:23:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.925+0000 7f9d167df740 1 client.15837 shutdown 2024-04-20T12:23:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.925+0000 7f9d167df740 1 -- 172.21.15.135:0/2940090343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 msgr2=0x56263ff422b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.925+0000 7f9d167df740 1 --2- 172.21.15.135:0/2940090343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff422b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9d08004770 tx=0x7f9d08004980 comp rx=0 tx=0).stop 2024-04-20T12:23:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.925+0000 7f9d167df740 1 -- 172.21.15.135:0/2940090343 shutdown_connections 2024-04-20T12:23:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.925+0000 7f9d167df740 1 --2- 172.21.15.135:0/2940090343 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56263ff54af0 0x56263ff56ee0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.925+0000 7f9d167df740 1 --2- 172.21.15.135:0/2940090343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff422b0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.925+0000 7f9d167df740 1 --2- 172.21.15.135:0/2940090343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3ba30 0x56263ff41d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.930 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.925+0000 7f9cf57fa640 0 client.15837 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:42.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.925+0000 7f9d167df740 1 --2- 172.21.15.135:0/2940090343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3b110 0x56263ff41830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.925+0000 7f9d167df740 1 -- 172.21.15.135:0/2940090343 >> 172.21.15.135:0/2940090343 conn(0x56263ff35a30 msgr2=0x56263ff37780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:42.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.925+0000 7f9d167df740 1 -- 172.21.15.135:0/2940090343 shutdown_connections 2024-04-20T12:23:42.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.925+0000 7f9d167df740 1 -- 172.21.15.135:0/2940090343 wait complete. 2024-04-20T12:23:42.931 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.925+0000 7f9d167df740 20 client.15837 trim_cache size 0 max 16384 2024-04-20T12:23:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.940+0000 7f9d167df740 1 Processor -- start 2024-04-20T12:23:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.940+0000 7f9d167df740 1 -- start start 2024-04-20T12:23:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d167df740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3b110 0x56263ff43f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d167df740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3ba30 0x56263ff502f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d167df740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff4cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d167df740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c1af2b0 con 0x56263ff44800 2024-04-20T12:23:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d167df740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c1b0df0 con 0x56263ff3ba30 2024-04-20T12:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d167df740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c1af980 con 0x56263ff3b110 2024-04-20T12:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d11198640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff4cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d11198640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff4cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39202/0 (socket says 172.21.15.135:39202) 2024-04-20T12:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d11198640 1 -- 172.21.15.135:0/797551420 learned_addr learned my addr 172.21.15.135:0/797551420 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d11999640 1 --2- 172.21.15.135:0/797551420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3ba30 0x56263ff502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d11198640 1 --2- 172.21.15.135:0/797551420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3b110 0x56263ff43f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d11198640 1 -- 172.21.15.135:0/797551420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3b110 msgr2=0x56263ff43f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d11198640 1 --2- 172.21.15.135:0/797551420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3b110 0x56263ff43f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d11198640 1 -- 172.21.15.135:0/797551420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3ba30 msgr2=0x56263ff502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d11198640 1 --2- 172.21.15.135:0/797551420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3ba30 0x56263ff502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d11198640 1 -- 172.21.15.135:0/797551420 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56263ff46bf0 con 0x56263ff44800 2024-04-20T12:23:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9d11198640 1 --2- 172.21.15.135:0/797551420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff4cbe0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9d080048d0 tx=0x7f9d08013f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a75c47f2998ca9f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9cf77fe640 1 -- 172.21.15.135:0/797551420 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0803c070 con 0x56263ff44800 2024-04-20T12:23:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9cf77fe640 1 -- 172.21.15.135:0/797551420 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d08024040 con 0x56263ff44800 2024-04-20T12:23:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.941+0000 7f9cf77fe640 1 -- 172.21.15.135:0/797551420 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08023070 con 0x56263ff44800 2024-04-20T12:23:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.942+0000 7f9d167df740 1 -- 172.21.15.135:0/797551420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 msgr2=0x56263ff4cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.942+0000 7f9d167df740 1 --2- 172.21.15.135:0/797551420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff4cbe0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9d080048d0 tx=0x7f9d08013f90 comp rx=0 tx=0).stop 2024-04-20T12:23:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.942+0000 7f9d167df740 1 -- 172.21.15.135:0/797551420 shutdown_connections 2024-04-20T12:23:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.942+0000 7f9d167df740 1 --2- 172.21.15.135:0/797551420 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff44800 0x56263ff4cbe0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.942+0000 7f9d167df740 1 --2- 172.21.15.135:0/797551420 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff3ba30 0x56263ff502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.942+0000 7f9d167df740 1 --2- 172.21.15.135:0/797551420 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3b110 0x56263ff43f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.942+0000 7f9d167df740 1 -- 172.21.15.135:0/797551420 >> 172.21.15.135:0/797551420 conn(0x56263ff35a30 msgr2=0x56263ff3cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.942+0000 7f9d167df740 1 -- 172.21.15.135:0/797551420 shutdown_connections 2024-04-20T12:23:42.947 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.942+0000 7f9d167df740 1 -- 172.21.15.135:0/797551420 wait complete. 2024-04-20T12:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.942+0000 7f9d167df740 1 -- start start 2024-04-20T12:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.942+0000 7f9d167df740 1 Processor -- start 2024-04-20T12:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d167df740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff3b110 0x56263ff5bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d167df740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3ba30 0x56263ff5c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d167df740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff44800 0x56263ffb6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d167df740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c1b0720 con 0x56263ff3b110 2024-04-20T12:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d167df740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c1b0050 con 0x56263ff44800 2024-04-20T12:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d167df740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c1ad280 con 0x56263ff3ba30 2024-04-20T12:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d167df740 10 client.0 _ll_register_callbacks cb 0x7f9d0800bd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d11198640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff3b110 0x56263ff5bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d11198640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff3b110 0x56263ff5bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39214/0 (socket says 172.21.15.135:39214) 2024-04-20T12:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d11198640 1 -- 172.21.15.135:0/4124459136 learned_addr learned my addr 172.21.15.135:0/4124459136 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d11198640 1 --2- 172.21.15.135:0/4124459136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff44800 0x56263ffb6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d11198640 1 -- 172.21.15.135:0/4124459136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3ba30 msgr2=0x56263ff5c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d11198640 1 --2- 172.21.15.135:0/4124459136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3ba30 0x56263ff5c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d11198640 1 -- 172.21.15.135:0/4124459136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff44800 msgr2=0x56263ffb6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d11198640 1 --2- 172.21.15.135:0/4124459136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff44800 0x56263ffb6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d11198640 1 -- 172.21.15.135:0/4124459136 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56263ffb68e0 con 0x56263ff3b110 2024-04-20T12:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d11198640 1 --2- 172.21.15.135:0/4124459136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff3b110 0x56263ff5bf20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9d08001eb0 tx=0x7f9d0801f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e63b7458f9c8f88 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9cf57fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9cf57fa640 1 -- 172.21.15.135:0/4124459136 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08047060 con 0x56263ff3b110 2024-04-20T12:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9d167df740 1 -- 172.21.15.135:0/4124459136 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d08024040 con 0x56263ff3b110 2024-04-20T12:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.943+0000 7f9cf57fa640 1 -- 172.21.15.135:0/4124459136 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9d0801fbb0 con 0x56263ff3b110 2024-04-20T12:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.944+0000 7f9cf57fa640 1 -- 172.21.15.135:0/4124459136 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9d0804e050 con 0x56263ff3b110 2024-04-20T12:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.944+0000 7f9d167df740 10 client.15843 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.944+0000 7f9d167df740 1 -- 172.21.15.135:0/4124459136 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56263ffbee90 con 0x56263ff3b110 2024-04-20T12:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.944+0000 7f9cf57fa640 1 -- 172.21.15.135:0/4124459136 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d08024040 con 0x56263ff3b110 2024-04-20T12:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.944+0000 7f9cf57fa640 1 -- 172.21.15.135:0/4124459136 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f9d080035f0 con 0x56263ff3b110 2024-04-20T12:23:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.944+0000 7f9d167df740 10 client.15843 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.944+0000 7f9d167df740 10 client.15843 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.944+0000 7f9d167df740 20 client.15843 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.944+0000 7f9d167df740 1 --2- 172.21.15.135:0/4124459136 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56263ffbf490 0x56263ffc18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.944+0000 7f9d167df740 4 client.15843 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-20T12:23:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.944+0000 7f9d167df740 1 -- 172.21.15.135:0/4124459136 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56263fea80b0 con 0x56263ffbf490 2024-04-20T12:23:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.944+0000 7f9d11999640 1 --2- 172.21.15.135:0/4124459136 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56263ffbf490 0x56263ffc18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.945+0000 7f9d11999640 1 --2- 172.21.15.135:0/4124459136 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56263ffbf490 0x56263ffc18b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcad52bb3b72ed2 server_cookie=784f1c0c423a44c4 in_seq=0 out_seq=0 2024-04-20T12:23:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.945+0000 7f9cf57fa640 10 client.15843 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.948+0000 7f9cf57fa640 1 -- 172.21.15.135:0/4124459136 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56263fea80b0 con 0x56263ffbf490 2024-04-20T12:23:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.948+0000 7f9cf57fa640 10 client.15843 handle_command_reply: tid=0 2024-04-20T12:23:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.948+0000 7f9d167df740 1 client.15843 shutdown 2024-04-20T12:23:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.948+0000 7f9d167df740 1 -- 172.21.15.135:0/4124459136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff3b110 msgr2=0x56263ff5bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.948+0000 7f9d167df740 1 --2- 172.21.15.135:0/4124459136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff3b110 0x56263ff5bf20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9d08001eb0 tx=0x7f9d0801f5f0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.948+0000 7f9d167df740 1 -- 172.21.15.135:0/4124459136 shutdown_connections 2024-04-20T12:23:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.948+0000 7f9d167df740 1 --2- 172.21.15.135:0/4124459136 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56263ffbf490 0x56263ffc18b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.948+0000 7f9d167df740 1 --2- 172.21.15.135:0/4124459136 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56263ff44800 0x56263ffb6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.948+0000 7f9d167df740 1 --2- 172.21.15.135:0/4124459136 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56263ff3ba30 0x56263ff5c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.948+0000 7f9cf57fa640 0 client.15843 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.948+0000 7f9d167df740 1 --2- 172.21.15.135:0/4124459136 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56263ff3b110 0x56263ff5bf20 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.948+0000 7f9d167df740 1 -- 172.21.15.135:0/4124459136 >> 172.21.15.135:0/4124459136 conn(0x56263ff35a30 msgr2=0x56263ff342c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.948+0000 7f9d167df740 1 -- 172.21.15.135:0/4124459136 shutdown_connections 2024-04-20T12:23:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.948+0000 7f9d167df740 1 -- 172.21.15.135:0/4124459136 wait complete. 2024-04-20T12:23:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.949+0000 7f9d167df740 20 client.15843 trim_cache size 0 max 16384 2024-04-20T12:23:42.953 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-04-20T12:23:42.953 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-04-20T12:23:42.953 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-04-20T12:23:42.953 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-04-20T12:23:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.949+0000 7f9d13bfd640 1 -- 172.21.15.135:0/2465060975 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9cf80a3f60 msgr2=0x7f9cf80a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.949+0000 7f9d13bfd640 1 --2- 172.21.15.135:0/2465060975 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9cf80a3f60 0x7f9cf80a6420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9d040f03a0 tx=0x7f9d040915b0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.949+0000 7f9d13bfd640 1 -- 172.21.15.135:0/2465060975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d0c19a040 msgr2=0x7f9d0c1a45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.949+0000 7f9d13bfd640 1 --2- 172.21.15.135:0/2465060975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d0c19a040 0x7f9d0c1a45a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9d0402c700 tx=0x7f9d04032f20 comp rx=0 tx=0).stop 2024-04-20T12:23:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.949+0000 7f9d13bfd640 1 -- 172.21.15.135:0/2465060975 shutdown_connections 2024-04-20T12:23:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.949+0000 7f9d13bfd640 1 --2- 172.21.15.135:0/2465060975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d0c19a040 0x7f9d0c1a45a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.949+0000 7f9d13bfd640 1 --2- 172.21.15.135:0/2465060975 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d0c106180 0x7f9d0c199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.949+0000 7f9d13bfd640 1 --2- 172.21.15.135:0/2465060975 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9cf80a3f60 0x7f9cf80a6420 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.949+0000 7f9d13bfd640 1 --2- 172.21.15.135:0/2465060975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d0c101100 0x7f9d0c199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.949+0000 7f9d13bfd640 1 -- 172.21.15.135:0/2465060975 >> 172.21.15.135:0/2465060975 conn(0x7f9d0c077fe0 msgr2=0x7f9d0c0fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.949+0000 7f9d13bfd640 1 -- 172.21.15.135:0/2465060975 shutdown_connections 2024-04-20T12:23:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:42.949+0000 7f9d13bfd640 1 -- 172.21.15.135:0/2465060975 wait complete. 2024-04-20T12:23:44.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:44 smithi154 ceph-mon[22073]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-04-20T12:23:44.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:44 smithi139 ceph-mon[21834]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-04-20T12:23:44.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:44 smithi135 ceph-mon[18264]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 14 op/s 2024-04-20T12:23:45.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:23:45.366 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:23:45.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.480+0000 7f1c33262640 1 -- 172.21.15.135:0/3703641211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c2c10a750 msgr2=0x7f1c2c10abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.480+0000 7f1c33262640 1 --2- 172.21.15.135:0/3703641211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c2c10a750 0x7f1c2c10abd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009930 tx=0x7f1c1c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:45.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.480+0000 7f1c33262640 1 -- 172.21.15.135:0/3703641211 shutdown_connections 2024-04-20T12:23:45.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.480+0000 7f1c33262640 1 --2- 172.21.15.135:0/3703641211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2c10b110 0x7f1c2c117620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.480+0000 7f1c33262640 1 --2- 172.21.15.135:0/3703641211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c2c10a750 0x7f1c2c10abd0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.480+0000 7f1c33262640 1 --2- 172.21.15.135:0/3703641211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c2c110760 0x7f1c2c110b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.480+0000 7f1c33262640 1 -- 172.21.15.135:0/3703641211 >> 172.21.15.135:0/3703641211 conn(0x7f1c2c073560 msgr2=0x7f1c2c073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:45.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.480+0000 7f1c33262640 1 -- 172.21.15.135:0/3703641211 shutdown_connections 2024-04-20T12:23:45.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.480+0000 7f1c33262640 1 -- 172.21.15.135:0/3703641211 wait complete. 2024-04-20T12:23:45.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.481+0000 7f1c33262640 1 Processor -- start 2024-04-20T12:23:45.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.481+0000 7f1c33262640 1 -- start start 2024-04-20T12:23:45.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.481+0000 7f1c33262640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c2c10a750 0x7f1c2c1a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.481+0000 7f1c33262640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2c10b110 0x7f1c2c1a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.481+0000 7f1c33262640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c2c110760 0x7f1c2c1a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.481+0000 7f1c33262640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2c11abc0 con 0x7f1c2c10a750 2024-04-20T12:23:45.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.481+0000 7f1c33262640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2c11aa40 con 0x7f1c2c110760 2024-04-20T12:23:45.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.481+0000 7f1c33262640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2c11ad40 con 0x7f1c2c10b110 2024-04-20T12:23:45.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.481+0000 7f1c30ffe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c2c10a750 0x7f1c2c1a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.481+0000 7f1c30ffe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c2c10a750 0x7f1c2c1a1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39244/0 (socket says 172.21.15.135:39244) 2024-04-20T12:23:45.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.481+0000 7f1c30ffe640 1 -- 172.21.15.135:0/2573497609 learned_addr learned my addr 172.21.15.135:0/2573497609 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:45.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.481+0000 7f1c23fff640 1 --2- 172.21.15.135:0/2573497609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2c10b110 0x7f1c2c1a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.482+0000 7f1c317ff640 1 --2- 172.21.15.135:0/2573497609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c2c110760 0x7f1c2c1a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.482+0000 7f1c30ffe640 1 -- 172.21.15.135:0/2573497609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2c10b110 msgr2=0x7f1c2c1a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.482+0000 7f1c30ffe640 1 --2- 172.21.15.135:0/2573497609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2c10b110 0x7f1c2c1a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.482+0000 7f1c30ffe640 1 -- 172.21.15.135:0/2573497609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c2c110760 msgr2=0x7f1c2c1a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.482+0000 7f1c30ffe640 1 --2- 172.21.15.135:0/2573497609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c2c110760 0x7f1c2c1a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.482+0000 7f1c30ffe640 1 -- 172.21.15.135:0/2573497609 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c2c1a60c0 con 0x7f1c2c10a750 2024-04-20T12:23:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.482+0000 7f1c317ff640 1 --2- 172.21.15.135:0/2573497609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c2c110760 0x7f1c2c1a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.482+0000 7f1c30ffe640 1 --2- 172.21.15.135:0/2573497609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c2c10a750 0x7f1c2c1a1120 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800d950 tx=0x7f1c2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.482+0000 7f1c21ffb640 1 -- 172.21.15.135:0/2573497609 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c28017030 con 0x7f1c2c10a750 2024-04-20T12:23:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.482+0000 7f1c33262640 1 -- 172.21.15.135:0/2573497609 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c2c1a63b0 con 0x7f1c2c10a750 2024-04-20T12:23:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.482+0000 7f1c21ffb640 1 -- 172.21.15.135:0/2573497609 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c28004020 con 0x7f1c2c10a750 2024-04-20T12:23:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.482+0000 7f1c21ffb640 1 -- 172.21.15.135:0/2573497609 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c280047a0 con 0x7f1c2c10a750 2024-04-20T12:23:45.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.482+0000 7f1c33262640 1 -- 172.21.15.135:0/2573497609 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c2c1adc40 con 0x7f1c2c10a750 2024-04-20T12:23:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.484+0000 7f1c21ffb640 1 -- 172.21.15.135:0/2573497609 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7f1c280041d0 con 0x7f1c2c10a750 2024-04-20T12:23:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c35e4b740 1 Processor -- start 2024-04-20T12:23:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c21ffb640 1 --2- 172.21.15.135:0/2573497609 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1c140a3e40 0x7f1c140a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c35e4b740 1 -- start start 2024-04-20T12:23:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c317ff640 1 --2- 172.21.15.135:0/2573497609 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1c140a3e40 0x7f1c140a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c21ffb640 1 -- 172.21.15.135:0/2573497609 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f1c280d07e0 con 0x7f1c2c10a750 2024-04-20T12:23:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c35e4b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b90a50 0x55d127b90e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c35e4b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b91370 0x55d127b9e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c35e4b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b9e630 0x55d127ba0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c35e4b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d127af61b0 con 0x55d127b9e630 2024-04-20T12:23:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c35e4b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d127a93390 con 0x55d127b91370 2024-04-20T12:23:45.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c35e4b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d127af2170 con 0x55d127b90a50 2024-04-20T12:23:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c317ff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b9e630 0x55d127ba0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c317ff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b9e630 0x55d127ba0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39256/0 (socket says 172.21.15.135:39256) 2024-04-20T12:23:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c317ff640 1 -- 172.21.15.135:0/73564118 learned_addr learned my addr 172.21.15.135:0/73564118 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c30ffe640 1 --2- 172.21.15.135:0/73564118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b90a50 0x55d127b90e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c23fff640 1 --2- 172.21.15.135:0/73564118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b91370 0x55d127b9e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c317ff640 1 --2- 172.21.15.135:0/2573497609 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1c140a3e40 0x7f1c140a6300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1c24012720 tx=0x7f1c24012b20 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c317ff640 1 -- 172.21.15.135:0/73564118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b90a50 msgr2=0x55d127b90e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c317ff640 1 --2- 172.21.15.135:0/73564118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b90a50 0x55d127b90e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c317ff640 1 -- 172.21.15.135:0/73564118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b91370 msgr2=0x55d127b9e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c317ff640 1 --2- 172.21.15.135:0/73564118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b91370 0x55d127b9e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c317ff640 1 -- 172.21.15.135:0/73564118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1278d27d0 con 0x55d127b9e630 2024-04-20T12:23:45.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c23fff640 1 --2- 172.21.15.135:0/73564118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b91370 0x55d127b9e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:45.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.485+0000 7f1c30ffe640 1 --2- 172.21.15.135:0/73564118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b90a50 0x55d127b90e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:45.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.486+0000 7f1c317ff640 1 --2- 172.21.15.135:0/73564118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b9e630 0x55d127ba0a20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1c24012e20 tx=0x7f1c2401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7b062f6dbc76f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:45.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.486+0000 7f1c12ffd640 1 -- 172.21.15.135:0/73564118 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c24015230 con 0x55d127b9e630 2024-04-20T12:23:45.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.486+0000 7f1c12ffd640 1 -- 172.21.15.135:0/73564118 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c24010790 con 0x55d127b9e630 2024-04-20T12:23:45.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.486+0000 7f1c12ffd640 1 -- 172.21.15.135:0/73564118 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2401f770 con 0x55d127b9e630 2024-04-20T12:23:45.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.486+0000 7f1c35e4b740 1 -- 172.21.15.135:0/73564118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b9e630 msgr2=0x55d127ba0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.486+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/73564118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b9e630 0x55d127ba0a20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f1c24012e20 tx=0x7f1c2401c000 comp rx=0 tx=0).stop 2024-04-20T12:23:45.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 1 -- 172.21.15.135:0/73564118 shutdown_connections 2024-04-20T12:23:45.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/73564118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b9e630 0x55d127ba0a20 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/73564118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b91370 0x55d127b9e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/73564118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b90a50 0x55d127b90e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 1 -- 172.21.15.135:0/73564118 >> 172.21.15.135:0/73564118 conn(0x55d127b8b450 msgr2=0x55d127b8b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:45.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 1 -- 172.21.15.135:0/73564118 shutdown_connections 2024-04-20T12:23:45.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 1 -- 172.21.15.135:0/73564118 wait complete. 2024-04-20T12:23:45.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 1 -- start start 2024-04-20T12:23:45.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 1 Processor -- start 2024-04-20T12:23:45.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 0x55d127b9b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b91370 0x55d127b9bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b9e630 0x55d127b9c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d127ba1330 con 0x55d127b91370 2024-04-20T12:23:45.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d127aaf2f0 con 0x55d127b90a50 2024-04-20T12:23:45.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d127ba14b0 con 0x55d127b9e630 2024-04-20T12:23:45.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c35e4b740 10 client.0 _ll_register_callbacks cb 0x55d127a794e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:45.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.487+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b91370 0x55d127b9bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b91370 0x55d127b9bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39262/0 (socket says 172.21.15.135:39262) 2024-04-20T12:23:45.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c23fff640 1 -- 172.21.15.135:0/3376215386 learned_addr learned my addr 172.21.15.135:0/3376215386 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:45.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c317ff640 1 --2- 172.21.15.135:0/3376215386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b9e630 0x55d127b9c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c30ffe640 1 --2- 172.21.15.135:0/3376215386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 0x55d127b9b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c23fff640 1 -- 172.21.15.135:0/3376215386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b9e630 msgr2=0x55d127b9c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:45.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c23fff640 1 --2- 172.21.15.135:0/3376215386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b9e630 0x55d127b9c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c23fff640 1 -- 172.21.15.135:0/3376215386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 msgr2=0x55d127b9b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:45.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c23fff640 1 --2- 172.21.15.135:0/3376215386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 0x55d127b9b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c23fff640 1 -- 172.21.15.135:0/3376215386 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1278083f0 con 0x55d127b91370 2024-04-20T12:23:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c317ff640 1 --2- 172.21.15.135:0/3376215386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b9e630 0x55d127b9c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c30ffe640 1 --2- 172.21.15.135:0/3376215386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 0x55d127b9b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c23fff640 1 --2- 172.21.15.135:0/3376215386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b91370 0x55d127b9bbe0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c000c00 tx=0x7f1c1c0095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3eddaa159e27aa server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c0bfff640 1 -- 172.21.15.135:0/3376215386 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c02cc50 con 0x55d127b91370 2024-04-20T12:23:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c0bfff640 1 -- 172.21.15.135:0/3376215386 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f1c1c0046c0 con 0x55d127b91370 2024-04-20T12:23:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c35e4b740 1 -- 172.21.15.135:0/3376215386 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c24010790 con 0x55d127b91370 2024-04-20T12:23:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c0bfff640 1 -- 172.21.15.135:0/3376215386 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1c1c0048c0 con 0x55d127b91370 2024-04-20T12:23:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c35e4b740 10 client.15855 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:45.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c35e4b740 1 -- 172.21.15.135:0/3376215386 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d1277c80f0 con 0x55d127b91370 2024-04-20T12:23:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.488+0000 7f1c0bfff640 1 -- 172.21.15.135:0/3376215386 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c24010790 con 0x55d127b91370 2024-04-20T12:23:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.489+0000 7f1c0bfff640 1 -- 172.21.15.135:0/3376215386 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f1c1c003710 con 0x55d127b91370 2024-04-20T12:23:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.489+0000 7f1c35e4b740 10 client.15855 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.489+0000 7f1c35e4b740 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.489+0000 7f1c35e4b740 20 client.15855 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.489+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/3376215386 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d127bae950 0x55d127bb0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.489+0000 7f1c35e4b740 4 client.15855 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:23:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.489+0000 7f1c35e4b740 1 -- 172.21.15.135:0/3376215386 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d127b03bd0 con 0x55d127bae950 2024-04-20T12:23:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.489+0000 7f1c30ffe640 1 --2- 172.21.15.135:0/3376215386 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d127bae950 0x55d127bb0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.489+0000 7f1c0bfff640 10 client.15855 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.489+0000 7f1c30ffe640 1 --2- 172.21.15.135:0/3376215386 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d127bae950 0x55d127bb0d80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfa2293a7ffc3fe1 server_cookie=ab89d54e1e014fb1 in_seq=0 out_seq=0 2024-04-20T12:23:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.490+0000 7f1c0bfff640 1 -- 172.21.15.135:0/3376215386 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d127b03bd0 con 0x55d127bae950 2024-04-20T12:23:45.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.490+0000 7f1c0bfff640 10 client.15855 handle_command_reply: tid=0 2024-04-20T12:23:45.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.490+0000 7f1c35e4b740 1 client.15855 shutdown 2024-04-20T12:23:45.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.490+0000 7f1c35e4b740 1 -- 172.21.15.135:0/3376215386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b91370 msgr2=0x55d127b9bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.490+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/3376215386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b91370 0x55d127b9bbe0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c000c00 tx=0x7f1c1c0095e0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.490+0000 7f1c35e4b740 1 -- 172.21.15.135:0/3376215386 shutdown_connections 2024-04-20T12:23:45.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.490+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/3376215386 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d127bae950 0x55d127bb0d80 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.490+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/3376215386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b9e630 0x55d127b9c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.490+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/3376215386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b91370 0x55d127b9bbe0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.490+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/3376215386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 0x55d127b9b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.502 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.490+0000 7f1c0bfff640 0 client.15855 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:45.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.490+0000 7f1c35e4b740 1 -- 172.21.15.135:0/3376215386 >> 172.21.15.135:0/3376215386 conn(0x55d127b8b450 msgr2=0x55d127b8d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:45.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.491+0000 7f1c35e4b740 1 -- 172.21.15.135:0/3376215386 shutdown_connections 2024-04-20T12:23:45.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.491+0000 7f1c35e4b740 1 -- 172.21.15.135:0/3376215386 wait complete. 2024-04-20T12:23:45.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.491+0000 7f1c35e4b740 20 client.15855 trim_cache size 0 max 16384 2024-04-20T12:23:45.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.508+0000 7f1c35e4b740 1 Processor -- start 2024-04-20T12:23:45.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.508+0000 7f1c35e4b740 1 -- start start 2024-04-20T12:23:45.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.508+0000 7f1c35e4b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 0x55d127b9ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.508+0000 7f1c35e4b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b91370 0x55d127baa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.508+0000 7f1c35e4b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b9e630 0x55d127b8cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.508+0000 7f1c35e4b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2c1b5ae0 con 0x55d127b91370 2024-04-20T12:23:45.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.508+0000 7f1c35e4b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2c1b7620 con 0x55d127b90a50 2024-04-20T12:23:45.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.508+0000 7f1c35e4b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2c1b61b0 con 0x55d127b9e630 2024-04-20T12:23:45.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.508+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b91370 0x55d127baa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.508+0000 7f1c23fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b91370 0x55d127baa230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39270/0 (socket says 172.21.15.135:39270) 2024-04-20T12:23:45.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.508+0000 7f1c23fff640 1 -- 172.21.15.135:0/4256968120 learned_addr learned my addr 172.21.15.135:0/4256968120 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:45.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.508+0000 7f1c317ff640 1 --2- 172.21.15.135:0/4256968120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b9e630 0x55d127b8cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.509+0000 7f1c23fff640 1 -- 172.21.15.135:0/4256968120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b9e630 msgr2=0x55d127b8cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:45.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.509+0000 7f1c23fff640 1 --2- 172.21.15.135:0/4256968120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b9e630 0x55d127b8cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.509+0000 7f1c30ffe640 1 --2- 172.21.15.135:0/4256968120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 0x55d127b9ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.509+0000 7f1c23fff640 1 -- 172.21.15.135:0/4256968120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 msgr2=0x55d127b9ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:45.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.509+0000 7f1c23fff640 1 --2- 172.21.15.135:0/4256968120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 0x55d127b9ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.509+0000 7f1c23fff640 1 -- 172.21.15.135:0/4256968120 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d127b8c680 con 0x55d127b91370 2024-04-20T12:23:45.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.509+0000 7f1c23fff640 1 --2- 172.21.15.135:0/4256968120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b91370 0x55d127baa230 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c02c170 tx=0x7f1c1c02bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae51910820d0d82 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:45.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.509+0000 7f1c127fc640 1 -- 172.21.15.135:0/4256968120 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c000e60 con 0x55d127b91370 2024-04-20T12:23:45.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.509+0000 7f1c127fc640 1 -- 172.21.15.135:0/4256968120 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c1c02cc50 con 0x55d127b91370 2024-04-20T12:23:45.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.509+0000 7f1c127fc640 1 -- 172.21.15.135:0/4256968120 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c004cc0 con 0x55d127b91370 2024-04-20T12:23:45.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.509+0000 7f1c35e4b740 1 -- 172.21.15.135:0/4256968120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b91370 msgr2=0x55d127baa230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.509+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/4256968120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b91370 0x55d127baa230 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c02c170 tx=0x7f1c1c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:45.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 1 -- 172.21.15.135:0/4256968120 shutdown_connections 2024-04-20T12:23:45.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/4256968120 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b9e630 0x55d127b8cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/4256968120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b91370 0x55d127baa230 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/4256968120 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 0x55d127b9ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 1 -- 172.21.15.135:0/4256968120 >> 172.21.15.135:0/4256968120 conn(0x55d127b8b450 msgr2=0x55d127b8c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:45.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 1 -- 172.21.15.135:0/4256968120 shutdown_connections 2024-04-20T12:23:45.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 1 -- 172.21.15.135:0/4256968120 wait complete. 2024-04-20T12:23:45.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 1 -- start start 2024-04-20T12:23:45.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 1 Processor -- start 2024-04-20T12:23:45.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 0x55d127b947c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b91370 0x55d127b94d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b9e630 0x55d127ba5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2c1b6f50 con 0x55d127b9e630 2024-04-20T12:23:45.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2c1b6880 con 0x55d127b90a50 2024-04-20T12:23:45.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2c1b3ab0 con 0x55d127b91370 2024-04-20T12:23:45.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c35e4b740 10 client.0 _ll_register_callbacks cb 0x7f1c1c005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:45.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c317ff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b9e630 0x55d127ba5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c317ff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b9e630 0x55d127ba5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39282/0 (socket says 172.21.15.135:39282) 2024-04-20T12:23:45.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c317ff640 1 -- 172.21.15.135:0/1282794246 learned_addr learned my addr 172.21.15.135:0/1282794246 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:45.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.510+0000 7f1c23fff640 1 --2- 172.21.15.135:0/1282794246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b91370 0x55d127b94d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c30ffe640 1 --2- 172.21.15.135:0/1282794246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 0x55d127b947c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c317ff640 1 -- 172.21.15.135:0/1282794246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b91370 msgr2=0x55d127b94d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:45.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c317ff640 1 --2- 172.21.15.135:0/1282794246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b91370 0x55d127b94d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c317ff640 1 -- 172.21.15.135:0/1282794246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 msgr2=0x55d127b947c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:45.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c317ff640 1 --2- 172.21.15.135:0/1282794246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 0x55d127b947c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c317ff640 1 -- 172.21.15.135:0/1282794246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d127ba5d30 con 0x55d127b9e630 2024-04-20T12:23:45.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c30ffe640 1 --2- 172.21.15.135:0/1282794246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 0x55d127b947c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:45.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c317ff640 1 --2- 172.21.15.135:0/1282794246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b9e630 0x55d127ba5740 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1c24015890 tx=0x7f1c24015380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7400de31f9f58fb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:45.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:45.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c0bfff640 1 -- 172.21.15.135:0/1282794246 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2402e020 con 0x55d127b9e630 2024-04-20T12:23:45.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c0bfff640 1 -- 172.21.15.135:0/1282794246 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f1c24004d30 con 0x55d127b9e630 2024-04-20T12:23:45.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c35e4b740 1 -- 172.21.15.135:0/1282794246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c1c02cc50 con 0x55d127b9e630 2024-04-20T12:23:45.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c0bfff640 1 -- 172.21.15.135:0/1282794246 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1c24039050 con 0x55d127b9e630 2024-04-20T12:23:45.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c35e4b740 10 client.15861 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:45.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c35e4b740 1 -- 172.21.15.135:0/1282794246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d127ba7020 con 0x55d127b9e630 2024-04-20T12:23:45.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c0bfff640 1 -- 172.21.15.135:0/1282794246 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c1c02cc50 con 0x55d127b9e630 2024-04-20T12:23:45.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c0bfff640 1 -- 172.21.15.135:0/1282794246 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f1c24029870 con 0x55d127b9e630 2024-04-20T12:23:45.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c35e4b740 10 client.15861 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:45.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c35e4b740 10 client.15861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:45.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.511+0000 7f1c35e4b740 20 client.15861 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:45.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.512+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/1282794246 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d127c19980 0x55d127c1bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.512+0000 7f1c35e4b740 4 client.15861 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:23:45.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.512+0000 7f1c35e4b740 1 -- 172.21.15.135:0/1282794246 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d127afda40 con 0x55d127c19980 2024-04-20T12:23:45.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.512+0000 7f1c30ffe640 1 --2- 172.21.15.135:0/1282794246 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d127c19980 0x55d127c1bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.512+0000 7f1c0bfff640 10 client.15861 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:45.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.512+0000 7f1c30ffe640 1 --2- 172.21.15.135:0/1282794246 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d127c19980 0x55d127c1bda0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d73b1fc3786085a server_cookie=264713316f615d9 in_seq=0 out_seq=0 2024-04-20T12:23:45.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.512+0000 7f1c0bfff640 1 -- 172.21.15.135:0/1282794246 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d127afda40 con 0x55d127c19980 2024-04-20T12:23:45.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.512+0000 7f1c0bfff640 10 client.15861 handle_command_reply: tid=0 2024-04-20T12:23:45.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.512+0000 7f1c35e4b740 1 client.15861 shutdown 2024-04-20T12:23:45.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c35e4b740 1 -- 172.21.15.135:0/1282794246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b9e630 msgr2=0x55d127ba5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/1282794246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b9e630 0x55d127ba5740 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1c24015890 tx=0x7f1c24015380 comp rx=0 tx=0).stop 2024-04-20T12:23:45.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c35e4b740 1 -- 172.21.15.135:0/1282794246 shutdown_connections 2024-04-20T12:23:45.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/1282794246 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d127c19980 0x55d127c1bda0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/1282794246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127b9e630 0x55d127ba5740 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/1282794246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d127b91370 0x55d127b94d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c0bfff640 0 client.15861 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:45.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c35e4b740 1 --2- 172.21.15.135:0/1282794246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d127b90a50 0x55d127b947c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c35e4b740 1 -- 172.21.15.135:0/1282794246 >> 172.21.15.135:0/1282794246 conn(0x55d127b8b450 msgr2=0x55d127b8a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:45.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c35e4b740 1 -- 172.21.15.135:0/1282794246 shutdown_connections 2024-04-20T12:23:45.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c35e4b740 1 -- 172.21.15.135:0/1282794246 wait complete. 2024-04-20T12:23:45.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c35e4b740 20 client.15861 trim_cache size 0 max 16384 2024-04-20T12:23:45.522 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:23:45.522 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:23:45.522 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:23:45.522 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:23:45.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c33262640 1 -- 172.21.15.135:0/2573497609 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1c140a3e40 msgr2=0x7f1c140a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c33262640 1 --2- 172.21.15.135:0/2573497609 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1c140a3e40 0x7f1c140a6300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1c24012720 tx=0x7f1c24012b20 comp rx=0 tx=0).stop 2024-04-20T12:23:45.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c33262640 1 -- 172.21.15.135:0/2573497609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c2c10a750 msgr2=0x7f1c2c1a1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c33262640 1 --2- 172.21.15.135:0/2573497609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c2c10a750 0x7f1c2c1a1120 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800d950 tx=0x7f1c2800de10 comp rx=0 tx=0).stop 2024-04-20T12:23:45.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c33262640 1 -- 172.21.15.135:0/2573497609 shutdown_connections 2024-04-20T12:23:45.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c33262640 1 --2- 172.21.15.135:0/2573497609 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1c2c110760 0x7f1c2c1a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c33262640 1 --2- 172.21.15.135:0/2573497609 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1c140a3e40 0x7f1c140a6300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c33262640 1 --2- 172.21.15.135:0/2573497609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2c10b110 0x7f1c2c1a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c33262640 1 --2- 172.21.15.135:0/2573497609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c2c10a750 0x7f1c2c1a1120 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c33262640 1 -- 172.21.15.135:0/2573497609 >> 172.21.15.135:0/2573497609 conn(0x7f1c2c073560 msgr2=0x7f1c2c06ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:45.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c33262640 1 -- 172.21.15.135:0/2573497609 shutdown_connections 2024-04-20T12:23:45.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.513+0000 7f1c33262640 1 -- 172.21.15.135:0/2573497609 wait complete. 2024-04-20T12:23:45.525 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:23:45.526 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:23:45.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.625+0000 7fde2a83f640 1 -- 172.21.15.135:0/4012329633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde24102c00 msgr2=0x7fde24106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.625+0000 7fde2a83f640 1 --2- 172.21.15.135:0/4012329633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde24102c00 0x7fde24106bb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fde18009900 tx=0x7fde1802bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:45.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.625+0000 7fde2a83f640 1 -- 172.21.15.135:0/4012329633 shutdown_connections 2024-04-20T12:23:45.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.625+0000 7fde2a83f640 1 --2- 172.21.15.135:0/4012329633 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde24107290 0x7fde2410ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.625+0000 7fde2a83f640 1 --2- 172.21.15.135:0/4012329633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde24102c00 0x7fde24106bb0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.625+0000 7fde2a83f640 1 --2- 172.21.15.135:0/4012329633 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde24102250 0x7fde24102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.625+0000 7fde2a83f640 1 -- 172.21.15.135:0/4012329633 >> 172.21.15.135:0/4012329633 conn(0x7fde240790f0 msgr2=0x7fde24079500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:45.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.625+0000 7fde2a83f640 1 -- 172.21.15.135:0/4012329633 shutdown_connections 2024-04-20T12:23:45.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.626+0000 7fde2a83f640 1 -- 172.21.15.135:0/4012329633 wait complete. 2024-04-20T12:23:45.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.626+0000 7fde2a83f640 1 Processor -- start 2024-04-20T12:23:45.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.626+0000 7fde2a83f640 1 -- start start 2024-04-20T12:23:45.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.626+0000 7fde2a83f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde24102250 0x7fde2419e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.626+0000 7fde2a83f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde24107290 0x7fde2419ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.626+0000 7fde2a83f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde241986a0 0x7fde24198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.626+0000 7fde2a83f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fde24112320 con 0x7fde24102250 2024-04-20T12:23:45.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.626+0000 7fde2a83f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fde241121a0 con 0x7fde24107290 2024-04-20T12:23:45.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.626+0000 7fde2a83f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fde241124a0 con 0x7fde241986a0 2024-04-20T12:23:45.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde23fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde24102250 0x7fde2419e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde23fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde24102250 0x7fde2419e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39302/0 (socket says 172.21.15.135:39302) 2024-04-20T12:23:45.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde23fff640 1 -- 172.21.15.135:0/2256579793 learned_addr learned my addr 172.21.15.135:0/2256579793 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:45.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde237fe640 1 --2- 172.21.15.135:0/2256579793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde24107290 0x7fde2419ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde28ddc640 1 --2- 172.21.15.135:0/2256579793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde241986a0 0x7fde24198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde23fff640 1 -- 172.21.15.135:0/2256579793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde241986a0 msgr2=0x7fde24198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde23fff640 1 --2- 172.21.15.135:0/2256579793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde241986a0 0x7fde24198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde23fff640 1 -- 172.21.15.135:0/2256579793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde24107290 msgr2=0x7fde2419ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde23fff640 1 --2- 172.21.15.135:0/2256579793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde24107290 0x7fde2419ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde23fff640 1 -- 172.21.15.135:0/2256579793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde241992a0 con 0x7fde24102250 2024-04-20T12:23:45.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde23fff640 1 --2- 172.21.15.135:0/2256579793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde24102250 0x7fde2419e590 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fde1400d950 tx=0x7fde1400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:45.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde217fa640 1 -- 172.21.15.135:0/2256579793 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde14017070 con 0x7fde24102250 2024-04-20T12:23:45.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde217fa640 1 -- 172.21.15.135:0/2256579793 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde14009c30 con 0x7fde24102250 2024-04-20T12:23:45.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde217fa640 1 -- 172.21.15.135:0/2256579793 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1400f6b0 con 0x7fde24102250 2024-04-20T12:23:45.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde2a83f640 1 -- 172.21.15.135:0/2256579793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde241a5330 con 0x7fde24102250 2024-04-20T12:23:45.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.627+0000 7fde2a83f640 1 -- 172.21.15.135:0/2256579793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde241a56e0 con 0x7fde24102250 2024-04-20T12:23:45.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.628+0000 7fde2a83f640 1 -- 172.21.15.135:0/2256579793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde24103690 con 0x7fde24102250 2024-04-20T12:23:45.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.629+0000 7fde217fa640 1 -- 172.21.15.135:0/2256579793 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7fde140109d0 con 0x7fde24102250 2024-04-20T12:23:45.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.630+0000 7fde217fa640 1 --2- 172.21.15.135:0/2256579793 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde0c0a3e40 0x7fde0c0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.630+0000 7fde237fe640 1 --2- 172.21.15.135:0/2256579793 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde0c0a3e40 0x7fde0c0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.630+0000 7fde217fa640 1 -- 172.21.15.135:0/2256579793 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fde140d0b10 con 0x7fde24102250 2024-04-20T12:23:45.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.630+0000 7fde237fe640 1 --2- 172.21.15.135:0/2256579793 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde0c0a3e40 0x7fde0c0a6300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fde18009230 tx=0x7fde18005fd0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:45.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.635+0000 7fde217fa640 1 -- 172.21.15.135:0/2256579793 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fde14009de0 con 0x7fde24102250 2024-04-20T12:23:45.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.850+0000 7fde2a83f640 1 -- 172.21.15.135:0/2256579793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde2410a510 con 0x7fde24102250 2024-04-20T12:23:45.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.851+0000 7fde217fa640 1 -- 172.21.15.135:0/2256579793 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7fde1409cbe0 con 0x7fde24102250 2024-04-20T12:23:45.851 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:23:45.852 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:23:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:23:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.853+0000 7fde2a83f640 1 -- 172.21.15.135:0/2256579793 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde0c0a3e40 msgr2=0x7fde0c0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.853+0000 7fde2a83f640 1 --2- 172.21.15.135:0/2256579793 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde0c0a3e40 0x7fde0c0a6300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fde18009230 tx=0x7fde18005fd0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.853+0000 7fde2a83f640 1 -- 172.21.15.135:0/2256579793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde24102250 msgr2=0x7fde2419e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.853+0000 7fde2a83f640 1 --2- 172.21.15.135:0/2256579793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde24102250 0x7fde2419e590 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fde1400d950 tx=0x7fde1400de10 comp rx=0 tx=0).stop 2024-04-20T12:23:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.854+0000 7fde2a83f640 1 -- 172.21.15.135:0/2256579793 shutdown_connections 2024-04-20T12:23:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.854+0000 7fde2a83f640 1 --2- 172.21.15.135:0/2256579793 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde0c0a3e40 0x7fde0c0a6300 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.854+0000 7fde2a83f640 1 --2- 172.21.15.135:0/2256579793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde241986a0 0x7fde24198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.854+0000 7fde2a83f640 1 --2- 172.21.15.135:0/2256579793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde24107290 0x7fde2419ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.854+0000 7fde2a83f640 1 --2- 172.21.15.135:0/2256579793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde24102250 0x7fde2419e590 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.854+0000 7fde2a83f640 1 -- 172.21.15.135:0/2256579793 >> 172.21.15.135:0/2256579793 conn(0x7fde240790f0 msgr2=0x7fde24100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.854+0000 7fde2a83f640 1 -- 172.21.15.135:0/2256579793 shutdown_connections 2024-04-20T12:23:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.854+0000 7fde2a83f640 1 -- 172.21.15.135:0/2256579793 wait complete. 2024-04-20T12:23:45.871 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:23:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.973+0000 7fd8f0f0e640 1 -- 172.21.15.135:0/175421635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8ec101b50 msgr2=0x7fd8ec10dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.973+0000 7fd8f0f0e640 1 --2- 172.21.15.135:0/175421635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8ec101b50 0x7fd8ec10dc50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009ca0 tx=0x7fd8e402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.973+0000 7fd8f0f0e640 1 -- 172.21.15.135:0/175421635 shutdown_connections 2024-04-20T12:23:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.973+0000 7fd8f0f0e640 1 --2- 172.21.15.135:0/175421635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8ec101b50 0x7fd8ec10dc50 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.973+0000 7fd8f0f0e640 1 --2- 172.21.15.135:0/175421635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8ec1011b0 0x7fd8ec101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.973+0000 7fd8f0f0e640 1 --2- 172.21.15.135:0/175421635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8ec106fa0 0x7fd8ec107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.973+0000 7fd8f0f0e640 1 -- 172.21.15.135:0/175421635 >> 172.21.15.135:0/175421635 conn(0x7fd8ec076c60 msgr2=0x7fd8ec077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.973+0000 7fd8f0f0e640 1 -- 172.21.15.135:0/175421635 shutdown_connections 2024-04-20T12:23:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.973+0000 7fd8f0f0e640 1 -- 172.21.15.135:0/175421635 wait complete. 2024-04-20T12:23:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8f0f0e640 1 Processor -- start 2024-04-20T12:23:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8f0f0e640 1 -- start start 2024-04-20T12:23:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8f0f0e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8ec1011b0 0x7fd8ec1976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8f0f0e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8ec101b50 0x7fd8ec197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8f0f0e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8ec106fa0 0x7fd8ec19bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8f0f0e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec111230 con 0x7fd8ec106fa0 2024-04-20T12:23:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8f0f0e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec1110b0 con 0x7fd8ec1011b0 2024-04-20T12:23:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8f0f0e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec1113b0 con 0x7fd8ec101b50 2024-04-20T12:23:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8ead9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8ec106fa0 0x7fd8ec19bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8ead9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8ec106fa0 0x7fd8ec19bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39326/0 (socket says 172.21.15.135:39326) 2024-04-20T12:23:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8ead9d640 1 -- 172.21.15.135:0/2745663495 learned_addr learned my addr 172.21.15.135:0/2745663495 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8ea59c640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8ec1011b0 0x7fd8ec1976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8ec101b50 0x7fd8ec197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8ead9d640 1 -- 172.21.15.135:0/2745663495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8ec101b50 msgr2=0x7fd8ec197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8ead9d640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8ec101b50 0x7fd8ec197c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8ead9d640 1 -- 172.21.15.135:0/2745663495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8ec1011b0 msgr2=0x7fd8ec1976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8ead9d640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8ec1011b0 0x7fd8ec1976d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8ead9d640 1 -- 172.21.15.135:0/2745663495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ec19c6c0 con 0x7fd8ec106fa0 2024-04-20T12:23:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8ea59c640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8ec1011b0 0x7fd8ec1976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8ec101b50 0x7fd8ec197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.974+0000 7fd8ead9d640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8ec106fa0 0x7fd8ec19bf90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd8e402c700 tx=0x7fd8e4032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.975+0000 7fd8e37fe640 1 -- 172.21.15.135:0/2745663495 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4041020 con 0x7fd8ec106fa0 2024-04-20T12:23:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.975+0000 7fd8f0f0e640 1 -- 172.21.15.135:0/2745663495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8ec19c950 con 0x7fd8ec106fa0 2024-04-20T12:23:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.975+0000 7fd8e37fe640 1 -- 172.21.15.135:0/2745663495 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8e4034cd0 con 0x7fd8ec106fa0 2024-04-20T12:23:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.975+0000 7fd8e37fe640 1 -- 172.21.15.135:0/2745663495 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4039040 con 0x7fd8ec106fa0 2024-04-20T12:23:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.975+0000 7fd8f0f0e640 1 -- 172.21.15.135:0/2745663495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8ec1a4240 con 0x7fd8ec106fa0 2024-04-20T12:23:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.977+0000 7fd8e37fe640 1 -- 172.21.15.135:0/2745663495 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7fd8e4044020 con 0x7fd8ec106fa0 2024-04-20T12:23:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.977+0000 7fd8f3bd9740 1 Processor -- start 2024-04-20T12:23:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.977+0000 7fd8f3bd9740 1 -- start start 2024-04-20T12:23:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8f3bd9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411af9e10 0x55e411afa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8f3bd9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411afa730 0x55e411b02dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8f3bd9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411b03310 0x55e411b05700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8f3bd9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e411a5f110 con 0x55e411afa730 2024-04-20T12:23:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8f3bd9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e4119fc550 con 0x55e411af9e10 2024-04-20T12:23:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8f3bd9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e411a5b0d0 con 0x55e411b03310 2024-04-20T12:23:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8ea59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411afa730 0x55e411b02dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8ea59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411afa730 0x55e411b02dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39328/0 (socket says 172.21.15.135:39328) 2024-04-20T12:23:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8e37fe640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd8d80a3e40 0x7fd8d80a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8ea59c640 1 -- 172.21.15.135:0/1079248350 learned_addr learned my addr 172.21.15.135:0/1079248350 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/1079248350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411b03310 0x55e411b05700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8ead9d640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd8d80a3e40 0x7fd8d80a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/1079248350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411af9e10 0x55e411afa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8ea59c640 1 -- 172.21.15.135:0/1079248350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411b03310 msgr2=0x55e411b05700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8ea59c640 1 --2- 172.21.15.135:0/1079248350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411b03310 0x55e411b05700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8ea59c640 1 -- 172.21.15.135:0/1079248350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411af9e10 msgr2=0x55e411afa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8ea59c640 1 --2- 172.21.15.135:0/1079248350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411af9e10 0x55e411afa1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8e37fe640 1 -- 172.21.15.135:0/2745663495 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fd8e40f2c80 con 0x7fd8ec106fa0 2024-04-20T12:23:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8ea59c640 1 -- 172.21.15.135:0/1079248350 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e411a24900 con 0x55e411afa730 2024-04-20T12:23:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.978+0000 7fd8ea59c640 1 --2- 172.21.15.135:0/1079248350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411afa730 0x55e411b02dd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00bcc0 tx=0x7fd8dc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69776359945b38cc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.979+0000 7fd8ead9d640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd8d80a3e40 0x7fd8d80a6300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40f0020 tx=0x7fd8e40095c0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.979+0000 7fd8e0ff9640 1 -- 172.21.15.135:0/1079248350 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc015070 con 0x55e411afa730 2024-04-20T12:23:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.979+0000 7fd8e0ff9640 1 -- 172.21.15.135:0/1079248350 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8dc011920 con 0x55e411afa730 2024-04-20T12:23:45.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.979+0000 7fd8e0ff9640 1 -- 172.21.15.135:0/1079248350 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc0109f0 con 0x55e411afa730 2024-04-20T12:23:45.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.979+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1079248350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411afa730 msgr2=0x55e411b02dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.979+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/1079248350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411afa730 0x55e411b02dd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00bcc0 tx=0x7fd8dc00f730 comp rx=0 tx=0).stop 2024-04-20T12:23:45.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.979+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1079248350 shutdown_connections 2024-04-20T12:23:45.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.979+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/1079248350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411b03310 0x55e411b05700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.979+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/1079248350 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411afa730 0x55e411b02dd0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.979+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/1079248350 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411af9e10 0x55e411afa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.979+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1079248350 >> 172.21.15.135:0/1079248350 conn(0x55e411af4540 msgr2=0x55e411af4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:45.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1079248350 shutdown_connections 2024-04-20T12:23:45.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1079248350 wait complete. 2024-04-20T12:23:45.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8f3bd9740 1 -- start start 2024-04-20T12:23:45.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8f3bd9740 1 Processor -- start 2024-04-20T12:23:45.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8f3bd9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411af9e10 0x55e411b003d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8f3bd9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411afa730 0x55e411b00910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8f3bd9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411b03310 0x55e411b00e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8f3bd9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e411b06040 con 0x55e411afa730 2024-04-20T12:23:45.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8f3bd9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e411a18500 con 0x55e411b03310 2024-04-20T12:23:45.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8f3bd9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e411b061c0 con 0x55e411af9e10 2024-04-20T12:23:45.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8f3bd9740 10 client.0 _ll_register_callbacks cb 0x55e4119fd2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:45.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8ea59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411afa730 0x55e411b00910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8ea59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411afa730 0x55e411b00910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39342/0 (socket says 172.21.15.135:39342) 2024-04-20T12:23:45.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8ea59c640 1 -- 172.21.15.135:0/1399587000 learned_addr learned my addr 172.21.15.135:0/1399587000 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:45.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/1399587000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411af9e10 0x55e411b003d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/1399587000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411b03310 0x55e411b00e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8ea59c640 1 -- 172.21.15.135:0/1399587000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411af9e10 msgr2=0x55e411b003d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:45.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8ea59c640 1 --2- 172.21.15.135:0/1399587000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411af9e10 0x55e411b003d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8ea59c640 1 -- 172.21.15.135:0/1399587000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411b03310 msgr2=0x55e411b00e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:45.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8ea59c640 1 --2- 172.21.15.135:0/1399587000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411b03310 0x55e411b00e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8ea59c640 1 -- 172.21.15.135:0/1399587000 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4117713f0 con 0x55e411afa730 2024-04-20T12:23:45.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.980+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/1399587000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411b03310 0x55e411b00e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:45.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8ea59c640 1 --2- 172.21.15.135:0/1399587000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411afa730 0x55e411b00910 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc005850 tx=0x7fd8dc00b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b21bb767aaf276b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:45.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:45.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8d1ffb640 1 -- 172.21.15.135:0/1399587000 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc015070 con 0x55e411afa730 2024-04-20T12:23:45.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8d1ffb640 1 -- 172.21.15.135:0/1399587000 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fd8dc0116d0 con 0x55e411afa730 2024-04-20T12:23:45.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1399587000 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8dc011920 con 0x55e411afa730 2024-04-20T12:23:45.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8d1ffb640 1 -- 172.21.15.135:0/1399587000 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd8dc011ad0 con 0x55e411afa730 2024-04-20T12:23:45.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8f3bd9740 10 client.15879 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:45.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1399587000 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e41183b7d0 con 0x55e411afa730 2024-04-20T12:23:45.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8d1ffb640 1 -- 172.21.15.135:0/1399587000 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8dc011920 con 0x55e411afa730 2024-04-20T12:23:45.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8d1ffb640 1 -- 172.21.15.135:0/1399587000 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fd8dc010690 con 0x55e411afa730 2024-04-20T12:23:45.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8f3bd9740 10 client.15879 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:45.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8f3bd9740 10 client.15879 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:23:45.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8f3bd9740 20 client.15879 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:45.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/1399587000 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55e411b13630 0x55e411b15a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:45.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8f3bd9740 4 client.15879 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:23:45.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1399587000 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e411a6cb30 con 0x55e411b13630 2024-04-20T12:23:45.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.981+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/1399587000 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55e411b13630 0x55e411b15a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:45.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.982+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/1399587000 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55e411b13630 0x55e411b15a20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2a18128c7c73f097 server_cookie=ef877dc11287e49f in_seq=0 out_seq=0 2024-04-20T12:23:45.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.982+0000 7fd8d1ffb640 10 client.15879 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:23:45.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.982+0000 7fd8d1ffb640 1 -- 172.21.15.135:0/1399587000 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e411a6cb30 con 0x55e411b13630 2024-04-20T12:23:45.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.982+0000 7fd8d1ffb640 10 client.15879 handle_command_reply: tid=0 2024-04-20T12:23:45.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.982+0000 7fd8f3bd9740 1 client.15879 shutdown 2024-04-20T12:23:45.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.982+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1399587000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411afa730 msgr2=0x55e411b00910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:45.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.982+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/1399587000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411afa730 0x55e411b00910 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc005850 tx=0x7fd8dc00b920 comp rx=0 tx=0).stop 2024-04-20T12:23:45.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.982+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1399587000 shutdown_connections 2024-04-20T12:23:45.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.982+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/1399587000 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55e411b13630 0x55e411b15a20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.982+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/1399587000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411b03310 0x55e411b00e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.982+0000 7fd8d1ffb640 0 client.15879 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:23:45.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.982+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/1399587000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411afa730 0x55e411b00910 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.982+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/1399587000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411af9e10 0x55e411b003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:45.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.982+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1399587000 >> 172.21.15.135:0/1399587000 conn(0x55e411af4540 msgr2=0x55e411af6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:45.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.983+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1399587000 shutdown_connections 2024-04-20T12:23:45.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.983+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1399587000 wait complete. 2024-04-20T12:23:45.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.983+0000 7fd8f3bd9740 20 client.15879 trim_cache size 0 max 16384 2024-04-20T12:23:46.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8f3bd9740 1 Processor -- start 2024-04-20T12:23:46.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8f3bd9740 1 -- start start 2024-04-20T12:23:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8f3bd9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411af9e10 0x55e411b0f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8f3bd9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411afa730 0x55e411b1b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8f3bd9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411b03310 0x55e411b1b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8f3bd9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec1ae2b0 con 0x55e411b03310 2024-04-20T12:23:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8f3bd9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec1afdf0 con 0x55e411afa730 2024-04-20T12:23:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8f3bd9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec1ae980 con 0x55e411af9e10 2024-04-20T12:23:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8e3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411b03310 0x55e411b1b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8e3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411b03310 0x55e411b1b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39344/0 (socket says 172.21.15.135:39344) 2024-04-20T12:23:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8e3fff640 1 -- 172.21.15.135:0/1066237358 learned_addr learned my addr 172.21.15.135:0/1066237358 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8ea59c640 1 --2- 172.21.15.135:0/1066237358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411afa730 0x55e411b1b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/1066237358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411af9e10 0x55e411b0f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8e3fff640 1 -- 172.21.15.135:0/1066237358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411af9e10 msgr2=0x55e411b0f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/1066237358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411af9e10 0x55e411b0f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8e3fff640 1 -- 172.21.15.135:0/1066237358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411afa730 msgr2=0x55e411b1b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/1066237358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411afa730 0x55e411b1b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.996+0000 7fd8e3fff640 1 -- 172.21.15.135:0/1066237358 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e411b16000 con 0x55e411b03310 2024-04-20T12:23:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.997+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/1066237358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411b03310 0x55e411b1b7d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4005d00 tx=0x7fd8d4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab060b3f87973a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.997+0000 7fd8d3fff640 1 -- 172.21.15.135:0/1066237358 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d401e940 con 0x55e411b03310 2024-04-20T12:23:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.997+0000 7fd8d3fff640 1 -- 172.21.15.135:0/1066237358 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8d4005020 con 0x55e411b03310 2024-04-20T12:23:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.997+0000 7fd8d3fff640 1 -- 172.21.15.135:0/1066237358 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4004b20 con 0x55e411b03310 2024-04-20T12:23:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.997+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1066237358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411b03310 msgr2=0x55e411b1b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.997+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/1066237358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411b03310 0x55e411b1b7d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4005d00 tx=0x7fd8d4005850 comp rx=0 tx=0).stop 2024-04-20T12:23:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.997+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1066237358 shutdown_connections 2024-04-20T12:23:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.997+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/1066237358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411b03310 0x55e411b1b7d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.997+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/1066237358 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411afa730 0x55e411b1b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.997+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/1066237358 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411af9e10 0x55e411b0f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.997+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1066237358 >> 172.21.15.135:0/1066237358 conn(0x55e411af4540 msgr2=0x55e411af36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.997+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1066237358 shutdown_connections 2024-04-20T12:23:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.997+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/1066237358 wait complete. 2024-04-20T12:23:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8f3bd9740 1 -- start start 2024-04-20T12:23:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8f3bd9740 1 Processor -- start 2024-04-20T12:23:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8f3bd9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411af9e10 0x55e411b0b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8f3bd9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411afa730 0x55e411b0ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8f3bd9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411b03310 0x55e411b08560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8f3bd9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec1af720 con 0x55e411af9e10 2024-04-20T12:23:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8f3bd9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec1af050 con 0x55e411b03310 2024-04-20T12:23:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8f3bd9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ec1ac280 con 0x55e411afa730 2024-04-20T12:23:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8f3bd9740 10 client.0 _ll_register_callbacks cb 0x7fd8d400b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8e3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411af9e10 0x55e411b0b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8e3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411af9e10 0x55e411b0b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39346/0 (socket says 172.21.15.135:39346) 2024-04-20T12:23:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8e3fff640 1 -- 172.21.15.135:0/3543228585 learned_addr learned my addr 172.21.15.135:0/3543228585 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/3543228585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411b03310 0x55e411b08560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8ea59c640 1 --2- 172.21.15.135:0/3543228585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411afa730 0x55e411b0ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8e3fff640 1 -- 172.21.15.135:0/3543228585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411afa730 msgr2=0x55e411b0ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/3543228585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411afa730 0x55e411b0ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8e3fff640 1 -- 172.21.15.135:0/3543228585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411b03310 msgr2=0x55e411b08560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/3543228585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411b03310 0x55e411b08560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8e3fff640 1 -- 172.21.15.135:0/3543228585 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e411b08d90 con 0x55e411af9e10 2024-04-20T12:23:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8ea59c640 1 --2- 172.21.15.135:0/3543228585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411afa730 0x55e411b0ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8e3fff640 1 --2- 172.21.15.135:0/3543228585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411af9e10 0x55e411b0b530 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4006010 tx=0x7fd8d4005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc45fa97db7999f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.998+0000 7fd8d1ffb640 1 -- 172.21.15.135:0/3543228585 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d401e310 con 0x55e411af9e10 2024-04-20T12:23:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8d1ffb640 1 -- 172.21.15.135:0/3543228585 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fd8d40051d0 con 0x55e411af9e10 2024-04-20T12:23:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/3543228585 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8d4005020 con 0x55e411af9e10 2024-04-20T12:23:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8d1ffb640 1 -- 172.21.15.135:0/3543228585 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd8d40053d0 con 0x55e411af9e10 2024-04-20T12:23:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8f3bd9740 10 client.15885 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/3543228585 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e411b7a690 con 0x55e411af9e10 2024-04-20T12:23:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8d1ffb640 1 -- 172.21.15.135:0/3543228585 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8d4005020 con 0x55e411af9e10 2024-04-20T12:23:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8d1ffb640 1 -- 172.21.15.135:0/3543228585 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fd8d400f040 con 0x55e411af9e10 2024-04-20T12:23:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8f3bd9740 10 client.15885 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8f3bd9740 10 client.15885 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:23:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8f3bd9740 20 client.15885 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/3543228585 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55e411b7aca0 0x55e411b7d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8f3bd9740 4 client.15885 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:23:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/3543228585 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e411a669a0 con 0x55e411b7aca0 2024-04-20T12:23:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8ea59c640 1 --2- 172.21.15.135:0/3543228585 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55e411b7aca0 0x55e411b7d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8d1ffb640 10 client.15885 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:23:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:45.999+0000 7fd8ea59c640 1 --2- 172.21.15.135:0/3543228585 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55e411b7aca0 0x55e411b7d090 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4f457a237796d0ac server_cookie=a03dd0bdf3b200d5 in_seq=0 out_seq=0 2024-04-20T12:23:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8d1ffb640 1 -- 172.21.15.135:0/3543228585 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e411a669a0 con 0x55e411b7aca0 2024-04-20T12:23:46.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8d1ffb640 10 client.15885 handle_command_reply: tid=0 2024-04-20T12:23:46.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f3bd9740 1 client.15885 shutdown 2024-04-20T12:23:46.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/3543228585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411af9e10 msgr2=0x55e411b0b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/3543228585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411af9e10 0x55e411b0b530 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4006010 tx=0x7fd8d4005fa0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/3543228585 shutdown_connections 2024-04-20T12:23:46.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/3543228585 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55e411b7aca0 0x55e411b7d090 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/3543228585 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e411b03310 0x55e411b08560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8d1ffb640 0 client.15885 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:23:46.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/3543228585 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e411afa730 0x55e411b0ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f3bd9740 1 --2- 172.21.15.135:0/3543228585 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e411af9e10 0x55e411b0b530 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/3543228585 >> 172.21.15.135:0/3543228585 conn(0x55e411af4540 msgr2=0x55e411b00370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/3543228585 shutdown_connections 2024-04-20T12:23:46.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f3bd9740 1 -- 172.21.15.135:0/3543228585 wait complete. 2024-04-20T12:23:46.007 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f3bd9740 20 client.15885 trim_cache size 0 max 16384 2024-04-20T12:23:46.008 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:23:46.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f0f0e640 1 -- 172.21.15.135:0/2745663495 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd8d80a3e40 msgr2=0x7fd8d80a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f0f0e640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd8d80a3e40 0x7fd8d80a6300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40f0020 tx=0x7fd8e40095c0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f0f0e640 1 -- 172.21.15.135:0/2745663495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8ec106fa0 msgr2=0x7fd8ec19bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f0f0e640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8ec106fa0 0x7fd8ec19bf90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd8e402c700 tx=0x7fd8e4032f20 comp rx=0 tx=0).stop 2024-04-20T12:23:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f0f0e640 1 -- 172.21.15.135:0/2745663495 shutdown_connections 2024-04-20T12:23:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f0f0e640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8ec106fa0 0x7fd8ec19bf90 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f0f0e640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd8d80a3e40 0x7fd8d80a6300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f0f0e640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd8ec101b50 0x7fd8ec197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f0f0e640 1 --2- 172.21.15.135:0/2745663495 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd8ec1011b0 0x7fd8ec1976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.000+0000 7fd8f0f0e640 1 -- 172.21.15.135:0/2745663495 >> 172.21.15.135:0/2745663495 conn(0x7fd8ec076c60 msgr2=0x7fd8ec0ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.001+0000 7fd8f0f0e640 1 -- 172.21.15.135:0/2745663495 shutdown_connections 2024-04-20T12:23:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.001+0000 7fd8f0f0e640 1 -- 172.21.15.135:0/2745663495 wait complete. 2024-04-20T12:23:46.011 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:23:46.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.113+0000 7effea1a4640 1 -- 172.21.15.135:0/1210602882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effe4106160 msgr2=0x7effe410dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.113+0000 7effea1a4640 1 --2- 172.21.15.135:0/1210602882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effe4106160 0x7effe410dd30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7effd4009ca0 tx=0x7effd402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.113+0000 7effea1a4640 1 -- 172.21.15.135:0/1210602882 shutdown_connections 2024-04-20T12:23:46.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.113+0000 7effea1a4640 1 --2- 172.21.15.135:0/1210602882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effe4106160 0x7effe410dd30 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.113+0000 7effea1a4640 1 --2- 172.21.15.135:0/1210602882 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effe4101a40 0x7effe4105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.113+0000 7effea1a4640 1 --2- 172.21.15.135:0/1210602882 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effe4101090 0x7effe4101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.113+0000 7effea1a4640 1 -- 172.21.15.135:0/1210602882 >> 172.21.15.135:0/1210602882 conn(0x7effe4078010 msgr2=0x7effe4078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.113+0000 7effea1a4640 1 -- 172.21.15.135:0/1210602882 shutdown_connections 2024-04-20T12:23:46.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.113+0000 7effea1a4640 1 -- 172.21.15.135:0/1210602882 wait complete. 2024-04-20T12:23:46.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.114+0000 7effea1a4640 1 Processor -- start 2024-04-20T12:23:46.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.114+0000 7effea1a4640 1 -- start start 2024-04-20T12:23:46.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.114+0000 7effea1a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effe4101090 0x7effe41973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.114+0000 7effea1a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effe4106160 0x7effe4197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.114+0000 7effea1a4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effe4197e70 0x7effe41a6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.114+0000 7effea1a4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7effe4111220 con 0x7effe4197e70 2024-04-20T12:23:46.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.114+0000 7effea1a4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7effe41110a0 con 0x7effe4101090 2024-04-20T12:23:46.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.114+0000 7effea1a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7effe41113a0 con 0x7effe4106160 2024-04-20T12:23:46.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.114+0000 7effe3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effe4197e70 0x7effe41a6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.114+0000 7effe3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effe4197e70 0x7effe41a6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39366/0 (socket says 172.21.15.135:39366) 2024-04-20T12:23:46.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.114+0000 7effe3fff640 1 -- 172.21.15.135:0/4183814551 learned_addr learned my addr 172.21.15.135:0/4183814551 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.114+0000 7effe37fe640 1 --2- 172.21.15.135:0/4183814551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effe4101090 0x7effe41973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.114+0000 7effe2ffd640 1 --2- 172.21.15.135:0/4183814551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effe4106160 0x7effe4197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.115+0000 7effe3fff640 1 -- 172.21.15.135:0/4183814551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effe4106160 msgr2=0x7effe4197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.115+0000 7effe3fff640 1 --2- 172.21.15.135:0/4183814551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effe4106160 0x7effe4197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.115+0000 7effe3fff640 1 -- 172.21.15.135:0/4183814551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effe4101090 msgr2=0x7effe41973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.115+0000 7effe3fff640 1 --2- 172.21.15.135:0/4183814551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effe4101090 0x7effe41973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.115+0000 7effe3fff640 1 -- 172.21.15.135:0/4183814551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe41a7050 con 0x7effe4197e70 2024-04-20T12:23:46.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.115+0000 7effe3fff640 1 --2- 172.21.15.135:0/4183814551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effe4197e70 0x7effe41a6a70 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7effd4037040 tx=0x7effd4032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.115+0000 7effe0ff9640 1 -- 172.21.15.135:0/4183814551 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4041020 con 0x7effe4197e70 2024-04-20T12:23:46.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.115+0000 7effea1a4640 1 -- 172.21.15.135:0/4183814551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe41a72e0 con 0x7effe4197e70 2024-04-20T12:23:46.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.115+0000 7effe0ff9640 1 -- 172.21.15.135:0/4183814551 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effd4035d60 con 0x7effe4197e70 2024-04-20T12:23:46.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.115+0000 7effe0ff9640 1 -- 172.21.15.135:0/4183814551 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4039040 con 0x7effe4197e70 2024-04-20T12:23:46.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.115+0000 7effea1a4640 1 -- 172.21.15.135:0/4183814551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe41a7820 con 0x7effe4197e70 2024-04-20T12:23:46.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.117+0000 7effecd93740 1 Processor -- start 2024-04-20T12:23:46.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.117+0000 7effe0ff9640 1 -- 172.21.15.135:0/4183814551 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7effd4044020 con 0x7effe4197e70 2024-04-20T12:23:46.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.117+0000 7effecd93740 1 -- start start 2024-04-20T12:23:46.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effecd93740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddb3e10 0x55d9eddb41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effecd93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb4730 0x55d9eddbcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effecd93740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddbd310 0x55d9eddbf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effecd93740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d9edd19110 con 0x55d9eddbd310 2024-04-20T12:23:46.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effecd93740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d9edcb6550 con 0x55d9eddb4730 2024-04-20T12:23:46.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effecd93740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d9edd150d0 con 0x55d9eddb3e10 2024-04-20T12:23:46.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effe2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddbd310 0x55d9eddbf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effe2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddbd310 0x55d9eddbf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39370/0 (socket says 172.21.15.135:39370) 2024-04-20T12:23:46.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effe2ffd640 1 -- 172.21.15.135:0/594828532 learned_addr learned my addr 172.21.15.135:0/594828532 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effe37fe640 1 --2- 172.21.15.135:0/594828532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb4730 0x55d9eddbcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effe0ff9640 1 --2- 172.21.15.135:0/4183814551 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7effcc0a3e40 0x7effcc0a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effe2ffd640 1 --2- 172.21.15.135:0/594828532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddb3e10 0x55d9eddb41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effe37fe640 1 -- 172.21.15.135:0/594828532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddb3e10 msgr2=0x55d9eddb41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effe37fe640 1 --2- 172.21.15.135:0/594828532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddb3e10 0x55d9eddb41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effe37fe640 1 -- 172.21.15.135:0/594828532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddbd310 msgr2=0x55d9eddbf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effe37fe640 1 --2- 172.21.15.135:0/594828532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddbd310 0x55d9eddbf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effe37fe640 1 -- 172.21.15.135:0/594828532 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9edcde900 con 0x55d9eddb4730 2024-04-20T12:23:46.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effe2ffd640 1 --2- 172.21.15.135:0/594828532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddbd310 0x55d9eddbf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:46.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effe3fff640 1 --2- 172.21.15.135:0/4183814551 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7effcc0a3e40 0x7effcc0a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effe0ff9640 1 -- 172.21.15.135:0/4183814551 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7effd40f2b20 con 0x7effe4197e70 2024-04-20T12:23:46.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effe37fe640 1 --2- 172.21.15.135:0/594828532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb4730 0x55d9eddbcdd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7effdc004630 tx=0x7effdc00bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33a76113150f80c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.118+0000 7effc9ffb640 1 -- 172.21.15.135:0/594828532 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc003bd0 con 0x55d9eddb4730 2024-04-20T12:23:46.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.119+0000 7effe3fff640 1 --2- 172.21.15.135:0/4183814551 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7effcc0a3e40 0x7effcc0a6300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7effd40efee0 tx=0x7effd4003d40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.119+0000 7effc9ffb640 1 -- 172.21.15.135:0/594828532 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effdc015070 con 0x55d9eddb4730 2024-04-20T12:23:46.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.119+0000 7effc9ffb640 1 -- 172.21.15.135:0/594828532 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc004d90 con 0x55d9eddb4730 2024-04-20T12:23:46.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.119+0000 7effecd93740 1 -- 172.21.15.135:0/594828532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb4730 msgr2=0x55d9eddbcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.119+0000 7effecd93740 1 --2- 172.21.15.135:0/594828532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb4730 0x55d9eddbcdd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7effdc004630 tx=0x7effdc00bb20 comp rx=0 tx=0).stop 2024-04-20T12:23:46.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.119+0000 7effecd93740 1 -- 172.21.15.135:0/594828532 shutdown_connections 2024-04-20T12:23:46.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.119+0000 7effecd93740 1 --2- 172.21.15.135:0/594828532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddbd310 0x55d9eddbf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.119+0000 7effecd93740 1 --2- 172.21.15.135:0/594828532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb4730 0x55d9eddbcdd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.119+0000 7effecd93740 1 --2- 172.21.15.135:0/594828532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddb3e10 0x55d9eddb41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.119+0000 7effecd93740 1 -- 172.21.15.135:0/594828532 >> 172.21.15.135:0/594828532 conn(0x55d9eddae540 msgr2=0x55d9eddae920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.119+0000 7effecd93740 1 -- 172.21.15.135:0/594828532 shutdown_connections 2024-04-20T12:23:46.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.119+0000 7effecd93740 1 -- 172.21.15.135:0/594828532 wait complete. 2024-04-20T12:23:46.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effecd93740 1 -- start start 2024-04-20T12:23:46.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effecd93740 1 Processor -- start 2024-04-20T12:23:46.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effecd93740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb3e10 0x55d9eddba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effecd93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb4730 0x55d9eddbaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effecd93740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddbd310 0x55d9eddbaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effecd93740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d9eddbffe0 con 0x55d9eddb3e10 2024-04-20T12:23:46.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effecd93740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d9edcd2500 con 0x55d9eddb4730 2024-04-20T12:23:46.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effecd93740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d9eddc0160 con 0x55d9eddbd310 2024-04-20T12:23:46.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effecd93740 10 client.0 _ll_register_callbacks cb 0x55d9edcb72f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:46.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effe2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb3e10 0x55d9eddba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effe2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb3e10 0x55d9eddba4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39386/0 (socket says 172.21.15.135:39386) 2024-04-20T12:23:46.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effe2ffd640 1 -- 172.21.15.135:0/83809200 learned_addr learned my addr 172.21.15.135:0/83809200 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effe37fe640 1 --2- 172.21.15.135:0/83809200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb4730 0x55d9eddbaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effe2ffd640 1 --2- 172.21.15.135:0/83809200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddbd310 0x55d9eddbaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effe2ffd640 1 -- 172.21.15.135:0/83809200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddbd310 msgr2=0x55d9eddbaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.120+0000 7effe2ffd640 1 --2- 172.21.15.135:0/83809200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddbd310 0x55d9eddbaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effe2ffd640 1 -- 172.21.15.135:0/83809200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb4730 msgr2=0x55d9eddbaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effe2ffd640 1 --2- 172.21.15.135:0/83809200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb4730 0x55d9eddbaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effe2ffd640 1 -- 172.21.15.135:0/83809200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9eda2b3f0 con 0x55d9eddb3e10 2024-04-20T12:23:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effe37fe640 1 --2- 172.21.15.135:0/83809200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb4730 0x55d9eddbaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effe2ffd640 1 --2- 172.21.15.135:0/83809200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb3e10 0x55d9eddba4d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7effd8004640 tx=0x7effd8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a79ddd563ebcec server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effc2ffd640 1 -- 172.21.15.135:0/83809200 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd8005220 con 0x55d9eddb3e10 2024-04-20T12:23:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effc2ffd640 1 -- 172.21.15.135:0/83809200 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7effd80053c0 con 0x55d9eddb3e10 2024-04-20T12:23:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effecd93740 1 -- 172.21.15.135:0/83809200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effdc015070 con 0x55d9eddb3e10 2024-04-20T12:23:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effc2ffd640 1 -- 172.21.15.135:0/83809200 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7effd8029050 con 0x55d9eddb3e10 2024-04-20T12:23:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effecd93740 10 client.15897 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effecd93740 1 -- 172.21.15.135:0/83809200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d9edaf57d0 con 0x55d9eddb3e10 2024-04-20T12:23:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effc2ffd640 1 -- 172.21.15.135:0/83809200 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effdc015070 con 0x55d9eddb3e10 2024-04-20T12:23:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effc2ffd640 1 -- 172.21.15.135:0/83809200 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7effd8004b30 con 0x55d9eddb3e10 2024-04-20T12:23:46.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effecd93740 10 client.15897 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:46.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effecd93740 10 client.15897 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:23:46.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effecd93740 20 client.15897 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:46.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effecd93740 1 --2- 172.21.15.135:0/83809200 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d9eddcd6e0 0x55d9eddcfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effecd93740 4 client.15897 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:23:46.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.121+0000 7effecd93740 1 -- 172.21.15.135:0/83809200 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9edd26b30 con 0x55d9eddcd6e0 2024-04-20T12:23:46.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.122+0000 7effe37fe640 1 --2- 172.21.15.135:0/83809200 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d9eddcd6e0 0x55d9eddcfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.122+0000 7effc2ffd640 10 client.15897 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:23:46.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.122+0000 7effe37fe640 1 --2- 172.21.15.135:0/83809200 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d9eddcd6e0 0x55d9eddcfb40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5470e88aafa3b665 server_cookie=3e1164635766b23a in_seq=0 out_seq=0 2024-04-20T12:23:46.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.123+0000 7effc2ffd640 1 -- 172.21.15.135:0/83809200 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d9edd26b30 con 0x55d9eddcd6e0 2024-04-20T12:23:46.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.123+0000 7effc2ffd640 10 client.15897 handle_command_reply: tid=0 2024-04-20T12:23:46.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.123+0000 7effecd93740 1 client.15897 shutdown 2024-04-20T12:23:46.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.123+0000 7effecd93740 1 -- 172.21.15.135:0/83809200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb3e10 msgr2=0x55d9eddba4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.123+0000 7effecd93740 1 --2- 172.21.15.135:0/83809200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb3e10 0x55d9eddba4d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7effd8004640 tx=0x7effd8004730 comp rx=0 tx=0).stop 2024-04-20T12:23:46.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.123+0000 7effecd93740 1 -- 172.21.15.135:0/83809200 shutdown_connections 2024-04-20T12:23:46.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.123+0000 7effecd93740 1 --2- 172.21.15.135:0/83809200 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d9eddcd6e0 0x55d9eddcfb40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.123+0000 7effecd93740 1 --2- 172.21.15.135:0/83809200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddbd310 0x55d9eddbaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.123+0000 7effecd93740 1 --2- 172.21.15.135:0/83809200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb4730 0x55d9eddbaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.123+0000 7effc2ffd640 0 client.15897 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:23:46.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.123+0000 7effecd93740 1 --2- 172.21.15.135:0/83809200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb3e10 0x55d9eddba4d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.123+0000 7effecd93740 1 -- 172.21.15.135:0/83809200 >> 172.21.15.135:0/83809200 conn(0x55d9eddae540 msgr2=0x55d9eddb0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.123+0000 7effecd93740 1 -- 172.21.15.135:0/83809200 shutdown_connections 2024-04-20T12:23:46.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.123+0000 7effecd93740 1 -- 172.21.15.135:0/83809200 wait complete. 2024-04-20T12:23:46.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.123+0000 7effecd93740 20 client.15897 trim_cache size 0 max 16384 2024-04-20T12:23:46.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.136+0000 7effecd93740 1 Processor -- start 2024-04-20T12:23:46.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.136+0000 7effecd93740 1 -- start start 2024-04-20T12:23:46.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.136+0000 7effecd93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb3e10 0x55d9eddc8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.136+0000 7effecd93740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb4730 0x55d9eddb9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.136+0000 7effecd93740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddbd310 0x55d9eddad560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.136+0000 7effecd93740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7effe41b1570 con 0x55d9eddb4730 2024-04-20T12:23:46.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.136+0000 7effecd93740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7effe41b30b0 con 0x55d9eddb3e10 2024-04-20T12:23:46.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.136+0000 7effecd93740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7effe41b1c40 con 0x55d9eddbd310 2024-04-20T12:23:46.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.136+0000 7effe37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb4730 0x55d9eddb9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.136+0000 7effe37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb4730 0x55d9eddb9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39402/0 (socket says 172.21.15.135:39402) 2024-04-20T12:23:46.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.136+0000 7effe37fe640 1 -- 172.21.15.135:0/123904087 learned_addr learned my addr 172.21.15.135:0/123904087 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effe2ffd640 1 --2- 172.21.15.135:0/123904087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddbd310 0x55d9eddad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effe37fe640 1 -- 172.21.15.135:0/123904087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddbd310 msgr2=0x55d9eddad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effe37fe640 1 --2- 172.21.15.135:0/123904087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddbd310 0x55d9eddad560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effe37fe640 1 -- 172.21.15.135:0/123904087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb3e10 msgr2=0x55d9eddc8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effe37fe640 1 --2- 172.21.15.135:0/123904087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb3e10 0x55d9eddc8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effe37fe640 1 -- 172.21.15.135:0/123904087 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9eddbfa70 con 0x55d9eddb4730 2024-04-20T12:23:46.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effe2ffd640 1 --2- 172.21.15.135:0/123904087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddbd310 0x55d9eddad560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effe37fe640 1 --2- 172.21.15.135:0/123904087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb4730 0x55d9eddb9dd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7effdc004630 tx=0x7effdc005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd9521515d6913d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effc97fa640 1 -- 172.21.15.135:0/123904087 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc030070 con 0x55d9eddb4730 2024-04-20T12:23:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effc97fa640 1 -- 172.21.15.135:0/123904087 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effdc015040 con 0x55d9eddb4730 2024-04-20T12:23:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effc97fa640 1 -- 172.21.15.135:0/123904087 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc0116a0 con 0x55d9eddb4730 2024-04-20T12:23:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effecd93740 1 -- 172.21.15.135:0/123904087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb4730 msgr2=0x55d9eddb9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effecd93740 1 --2- 172.21.15.135:0/123904087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb4730 0x55d9eddb9dd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7effdc004630 tx=0x7effdc005760 comp rx=0 tx=0).stop 2024-04-20T12:23:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effecd93740 1 -- 172.21.15.135:0/123904087 shutdown_connections 2024-04-20T12:23:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effecd93740 1 --2- 172.21.15.135:0/123904087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddbd310 0x55d9eddad560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effecd93740 1 --2- 172.21.15.135:0/123904087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb4730 0x55d9eddb9dd0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.137+0000 7effecd93740 1 --2- 172.21.15.135:0/123904087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddb3e10 0x55d9eddc8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effecd93740 1 -- 172.21.15.135:0/123904087 >> 172.21.15.135:0/123904087 conn(0x55d9eddae540 msgr2=0x55d9eddace50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effecd93740 1 -- 172.21.15.135:0/123904087 shutdown_connections 2024-04-20T12:23:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effecd93740 1 -- 172.21.15.135:0/123904087 wait complete. 2024-04-20T12:23:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effecd93740 1 -- start start 2024-04-20T12:23:46.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effecd93740 1 Processor -- start 2024-04-20T12:23:46.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effecd93740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddb3e10 0x55d9eddc5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effecd93740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb4730 0x55d9eddc5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effecd93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddbd310 0x55d9eddb6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effecd93740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7effe41b29e0 con 0x55d9eddb4730 2024-04-20T12:23:46.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effecd93740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7effe41b2310 con 0x55d9eddbd310 2024-04-20T12:23:46.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effecd93740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7effe41af540 con 0x55d9eddb3e10 2024-04-20T12:23:46.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effecd93740 10 client.0 _ll_register_callbacks cb 0x7effd800bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:46.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effe37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb4730 0x55d9eddc5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effe37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb4730 0x55d9eddc5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39404/0 (socket says 172.21.15.135:39404) 2024-04-20T12:23:46.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effe37fe640 1 -- 172.21.15.135:0/1719897786 learned_addr learned my addr 172.21.15.135:0/1719897786 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.138+0000 7effe2ffd640 1 --2- 172.21.15.135:0/1719897786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddb3e10 0x55d9eddc5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effe37fe640 1 -- 172.21.15.135:0/1719897786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddb3e10 msgr2=0x55d9eddc5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effe37fe640 1 --2- 172.21.15.135:0/1719897786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddb3e10 0x55d9eddc5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effe37fe640 1 -- 172.21.15.135:0/1719897786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddbd310 msgr2=0x55d9eddb6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effe37fe640 1 --2- 172.21.15.135:0/1719897786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddbd310 0x55d9eddb6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effe37fe640 1 -- 172.21.15.135:0/1719897786 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9eddb6cf0 con 0x55d9eddb4730 2024-04-20T12:23:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effe37fe640 1 --2- 172.21.15.135:0/1719897786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb4730 0x55d9eddc5950 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7effdc0039c0 tx=0x7effdc004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ea45191f17d85c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effc2ffd640 1 -- 172.21.15.135:0/1719897786 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc039060 con 0x55d9eddb4730 2024-04-20T12:23:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effc2ffd640 1 -- 172.21.15.135:0/1719897786 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7effdc02a1d0 con 0x55d9eddb4730 2024-04-20T12:23:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effecd93740 1 -- 172.21.15.135:0/1719897786 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effdc015040 con 0x55d9eddb4730 2024-04-20T12:23:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effc2ffd640 1 -- 172.21.15.135:0/1719897786 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7effdc030040 con 0x55d9eddb4730 2024-04-20T12:23:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effecd93740 10 client.15903 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effecd93740 1 -- 172.21.15.135:0/1719897786 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d9ede33470 con 0x55d9eddb4730 2024-04-20T12:23:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effc2ffd640 1 -- 172.21.15.135:0/1719897786 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effdc015040 con 0x55d9eddb4730 2024-04-20T12:23:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effc2ffd640 1 -- 172.21.15.135:0/1719897786 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7effdc033070 con 0x55d9eddb4730 2024-04-20T12:23:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effecd93740 10 client.15903 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effecd93740 10 client.15903 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:23:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effecd93740 20 client.15903 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:46.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effecd93740 1 --2- 172.21.15.135:0/1719897786 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d9ede33a20 0x55d9ede35e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effecd93740 4 client.15903 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:23:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.139+0000 7effecd93740 1 -- 172.21.15.135:0/1719897786 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d9edd209a0 con 0x55d9ede33a20 2024-04-20T12:23:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effe2ffd640 1 --2- 172.21.15.135:0/1719897786 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d9ede33a20 0x55d9ede35e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effc2ffd640 10 client.15903 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:23:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effe2ffd640 1 --2- 172.21.15.135:0/1719897786 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d9ede33a20 0x55d9ede35e40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=35c7f824dfca6ad server_cookie=aeef3b24fc6dc853 in_seq=0 out_seq=0 2024-04-20T12:23:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effc2ffd640 1 -- 172.21.15.135:0/1719897786 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d9edd209a0 con 0x55d9ede33a20 2024-04-20T12:23:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effc2ffd640 10 client.15903 handle_command_reply: tid=0 2024-04-20T12:23:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effecd93740 1 client.15903 shutdown 2024-04-20T12:23:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effecd93740 1 -- 172.21.15.135:0/1719897786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb4730 msgr2=0x55d9eddc5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effecd93740 1 --2- 172.21.15.135:0/1719897786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb4730 0x55d9eddc5950 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7effdc0039c0 tx=0x7effdc004120 comp rx=0 tx=0).stop 2024-04-20T12:23:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effecd93740 1 -- 172.21.15.135:0/1719897786 shutdown_connections 2024-04-20T12:23:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effecd93740 1 --2- 172.21.15.135:0/1719897786 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d9ede33a20 0x55d9ede35e40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effecd93740 1 --2- 172.21.15.135:0/1719897786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9eddbd310 0x55d9eddb6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effc2ffd640 0 client.15903 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:23:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effecd93740 1 --2- 172.21.15.135:0/1719897786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9eddb4730 0x55d9eddc5950 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effecd93740 1 --2- 172.21.15.135:0/1719897786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9eddb3e10 0x55d9eddc5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effecd93740 1 -- 172.21.15.135:0/1719897786 >> 172.21.15.135:0/1719897786 conn(0x55d9eddae540 msgr2=0x55d9eddbad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effecd93740 1 -- 172.21.15.135:0/1719897786 shutdown_connections 2024-04-20T12:23:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.140+0000 7effecd93740 1 -- 172.21.15.135:0/1719897786 wait complete. 2024-04-20T12:23:46.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.141+0000 7effecd93740 20 client.15903 trim_cache size 0 max 16384 2024-04-20T12:23:46.147 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:23:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.141+0000 7effea1a4640 1 -- 172.21.15.135:0/4183814551 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7effcc0a3e40 msgr2=0x7effcc0a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.141+0000 7effea1a4640 1 --2- 172.21.15.135:0/4183814551 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7effcc0a3e40 0x7effcc0a6300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7effd40efee0 tx=0x7effd4003d40 comp rx=0 tx=0).stop 2024-04-20T12:23:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.141+0000 7effea1a4640 1 -- 172.21.15.135:0/4183814551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effe4197e70 msgr2=0x7effe41a6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.141+0000 7effea1a4640 1 --2- 172.21.15.135:0/4183814551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effe4197e70 0x7effe41a6a70 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7effd4037040 tx=0x7effd4032f20 comp rx=0 tx=0).stop 2024-04-20T12:23:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.141+0000 7effea1a4640 1 -- 172.21.15.135:0/4183814551 shutdown_connections 2024-04-20T12:23:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.141+0000 7effea1a4640 1 --2- 172.21.15.135:0/4183814551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effe4197e70 0x7effe41a6a70 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.141+0000 7effea1a4640 1 --2- 172.21.15.135:0/4183814551 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7effcc0a3e40 0x7effcc0a6300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.141+0000 7effea1a4640 1 --2- 172.21.15.135:0/4183814551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7effe4106160 0x7effe4197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.141+0000 7effea1a4640 1 --2- 172.21.15.135:0/4183814551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7effe4101090 0x7effe41973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.141+0000 7effea1a4640 1 -- 172.21.15.135:0/4183814551 >> 172.21.15.135:0/4183814551 conn(0x7effe4078010 msgr2=0x7effe40fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.141+0000 7effea1a4640 1 -- 172.21.15.135:0/4183814551 shutdown_connections 2024-04-20T12:23:46.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.141+0000 7effea1a4640 1 -- 172.21.15.135:0/4183814551 wait complete. 2024-04-20T12:23:46.151 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:23:46.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.252+0000 7ff27ebe0640 1 -- 172.21.15.135:0/1048988354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff278101a40 msgr2=0x7ff278105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.252+0000 7ff27ebe0640 1 --2- 172.21.15.135:0/1048988354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff278101a40 0x7ff278105a80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009900 tx=0x7ff26c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:46.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.252+0000 7ff27ebe0640 1 -- 172.21.15.135:0/1048988354 shutdown_connections 2024-04-20T12:23:46.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.252+0000 7ff27ebe0640 1 --2- 172.21.15.135:0/1048988354 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff278106160 0x7ff27810dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.252+0000 7ff27ebe0640 1 --2- 172.21.15.135:0/1048988354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff278101a40 0x7ff278105a80 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.252+0000 7ff27ebe0640 1 --2- 172.21.15.135:0/1048988354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff278101090 0x7ff278101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.252+0000 7ff27ebe0640 1 -- 172.21.15.135:0/1048988354 >> 172.21.15.135:0/1048988354 conn(0x7ff278078010 msgr2=0x7ff278078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.253+0000 7ff27ebe0640 1 -- 172.21.15.135:0/1048988354 shutdown_connections 2024-04-20T12:23:46.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.253+0000 7ff27ebe0640 1 -- 172.21.15.135:0/1048988354 wait complete. 2024-04-20T12:23:46.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.253+0000 7ff27ebe0640 1 Processor -- start 2024-04-20T12:23:46.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.253+0000 7ff27ebe0640 1 -- start start 2024-04-20T12:23:46.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.253+0000 7ff27ebe0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff278101090 0x7ff27819e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.253+0000 7ff27ebe0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff278106160 0x7ff27819eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.253+0000 7ff27ebe0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff278198690 0x7ff278198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.253+0000 7ff27ebe0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff278112330 con 0x7ff278198690 2024-04-20T12:23:46.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.253+0000 7ff27ebe0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781121b0 con 0x7ff278106160 2024-04-20T12:23:46.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.253+0000 7ff27ebe0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781124b0 con 0x7ff278101090 2024-04-20T12:23:46.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.253+0000 7ff27d17d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff278198690 0x7ff278198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.253+0000 7ff27d17d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff278198690 0x7ff278198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39424/0 (socket says 172.21.15.135:39424) 2024-04-20T12:23:46.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.253+0000 7ff27d17d640 1 -- 172.21.15.135:0/1437473245 learned_addr learned my addr 172.21.15.135:0/1437473245 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.254+0000 7ff277fff640 1 --2- 172.21.15.135:0/1437473245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff278106160 0x7ff27819eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.254+0000 7ff27c97c640 1 --2- 172.21.15.135:0/1437473245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff278101090 0x7ff27819e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.254+0000 7ff27d17d640 1 -- 172.21.15.135:0/1437473245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff278101090 msgr2=0x7ff27819e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.254+0000 7ff27d17d640 1 --2- 172.21.15.135:0/1437473245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff278101090 0x7ff27819e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.254+0000 7ff27d17d640 1 -- 172.21.15.135:0/1437473245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff278106160 msgr2=0x7ff27819eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.254+0000 7ff27d17d640 1 --2- 172.21.15.135:0/1437473245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff278106160 0x7ff27819eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.254+0000 7ff27d17d640 1 -- 172.21.15.135:0/1437473245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff278199290 con 0x7ff278198690 2024-04-20T12:23:46.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.254+0000 7ff277fff640 1 --2- 172.21.15.135:0/1437473245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff278106160 0x7ff27819eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:46.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.254+0000 7ff27d17d640 1 --2- 172.21.15.135:0/1437473245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff278198690 0x7ff278198b10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff27000eaa0 tx=0x7ff27000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.254+0000 7ff275ffb640 1 -- 172.21.15.135:0/1437473245 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27000cdb0 con 0x7ff278198690 2024-04-20T12:23:46.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.254+0000 7ff275ffb640 1 -- 172.21.15.135:0/1437473245 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff270005020 con 0x7ff278198690 2024-04-20T12:23:46.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.254+0000 7ff27ebe0640 1 -- 172.21.15.135:0/1437473245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2781a5320 con 0x7ff278198690 2024-04-20T12:23:46.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.254+0000 7ff275ffb640 1 -- 172.21.15.135:0/1437473245 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2700116b0 con 0x7ff278198690 2024-04-20T12:23:46.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.254+0000 7ff27ebe0640 1 -- 172.21.15.135:0/1437473245 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2781a56d0 con 0x7ff278198690 2024-04-20T12:23:46.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.256+0000 7ff275ffb640 1 -- 172.21.15.135:0/1437473245 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7ff270005560 con 0x7ff278198690 2024-04-20T12:23:46.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff2817cd740 1 Processor -- start 2024-04-20T12:23:46.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff2817cd740 1 -- start start 2024-04-20T12:23:46.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff275ffb640 1 --2- 172.21.15.135:0/1437473245 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff2600a3e40 0x7ff2600a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff2817cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc8e10 0x55a35fcc91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff2817cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcc9730 0x55a35fcd1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff2817cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcd2310 0x55a35fcd4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff2817cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a35fc2e110 con 0x55a35fcc8e10 2024-04-20T12:23:46.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff2817cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a35fbcb550 con 0x55a35fcd2310 2024-04-20T12:23:46.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff2817cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a35fc2a0d0 con 0x55a35fcc9730 2024-04-20T12:23:46.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff275ffb640 1 -- 172.21.15.135:0/1437473245 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff2700d10e0 con 0x7ff278198690 2024-04-20T12:23:46.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff27c97c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc8e10 0x55a35fcc91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff277fff640 1 --2- 172.21.15.135:0/1437473245 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff2600a3e40 0x7ff2600a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff27c97c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc8e10 0x55a35fcc91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39426/0 (socket says 172.21.15.135:39426) 2024-04-20T12:23:46.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff27c97c640 1 -- 172.21.15.135:0/3828476116 learned_addr learned my addr 172.21.15.135:0/3828476116 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff27d17d640 1 --2- 172.21.15.135:0/3828476116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcd2310 0x55a35fcd4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff27c97c640 1 -- 172.21.15.135:0/3828476116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcc9730 msgr2=0x55a35fcd1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff27c97c640 1 --2- 172.21.15.135:0/3828476116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcc9730 0x55a35fcd1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff27c97c640 1 -- 172.21.15.135:0/3828476116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcd2310 msgr2=0x55a35fcd4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff27c97c640 1 --2- 172.21.15.135:0/3828476116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcd2310 0x55a35fcd4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff27c97c640 1 -- 172.21.15.135:0/3828476116 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a35fbf3900 con 0x55a35fcc8e10 2024-04-20T12:23:46.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff27d17d640 1 --2- 172.21.15.135:0/3828476116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcd2310 0x55a35fcd4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:46.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff277fff640 1 --2- 172.21.15.135:0/1437473245 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff2600a3e40 0x7ff2600a6300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff26c006010 tx=0x7ff26c0095f0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff27c97c640 1 --2- 172.21.15.135:0/3828476116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc8e10 0x55a35fcc91f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff26800cbe0 tx=0x7ff26800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a7fc19ba934407 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.257+0000 7ff25effd640 1 -- 172.21.15.135:0/3828476116 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268010630 con 0x55a35fcc8e10 2024-04-20T12:23:46.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.258+0000 7ff25effd640 1 -- 172.21.15.135:0/3828476116 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff268010cb0 con 0x55a35fcc8e10 2024-04-20T12:23:46.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.258+0000 7ff25effd640 1 -- 172.21.15.135:0/3828476116 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26801abc0 con 0x55a35fcc8e10 2024-04-20T12:23:46.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.258+0000 7ff2817cd740 1 -- 172.21.15.135:0/3828476116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc8e10 msgr2=0x55a35fcc91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.258+0000 7ff2817cd740 1 --2- 172.21.15.135:0/3828476116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc8e10 0x55a35fcc91f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff26800cbe0 tx=0x7ff26800e720 comp rx=0 tx=0).stop 2024-04-20T12:23:46.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.258+0000 7ff2817cd740 1 -- 172.21.15.135:0/3828476116 shutdown_connections 2024-04-20T12:23:46.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.258+0000 7ff2817cd740 1 --2- 172.21.15.135:0/3828476116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcd2310 0x55a35fcd4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.258+0000 7ff2817cd740 1 --2- 172.21.15.135:0/3828476116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcc9730 0x55a35fcd1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.258+0000 7ff2817cd740 1 --2- 172.21.15.135:0/3828476116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc8e10 0x55a35fcc91f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.258+0000 7ff2817cd740 1 -- 172.21.15.135:0/3828476116 >> 172.21.15.135:0/3828476116 conn(0x55a35fcc3540 msgr2=0x55a35fcc3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.258+0000 7ff2817cd740 1 -- 172.21.15.135:0/3828476116 shutdown_connections 2024-04-20T12:23:46.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.258+0000 7ff2817cd740 1 -- 172.21.15.135:0/3828476116 wait complete. 2024-04-20T12:23:46.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff2817cd740 1 -- start start 2024-04-20T12:23:46.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff2817cd740 1 Processor -- start 2024-04-20T12:23:46.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff2817cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 0x55a35fccf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff2817cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcc9730 0x55a35fccf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff2817cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcd2310 0x55a35fccfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff2817cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a35fcd5040 con 0x55a35fcd2310 2024-04-20T12:23:46.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff2817cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a35fbe7500 con 0x55a35fcc8e10 2024-04-20T12:23:46.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff2817cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a35fcd51c0 con 0x55a35fcc9730 2024-04-20T12:23:46.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff2817cd740 10 client.0 _ll_register_callbacks cb 0x55a35fbcc2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:46.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff27d17d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcd2310 0x55a35fccfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff27d17d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcd2310 0x55a35fccfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39438/0 (socket says 172.21.15.135:39438) 2024-04-20T12:23:46.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff27d17d640 1 -- 172.21.15.135:0/169448357 learned_addr learned my addr 172.21.15.135:0/169448357 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff277fff640 1 --2- 172.21.15.135:0/169448357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcc9730 0x55a35fccf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff27c97c640 1 --2- 172.21.15.135:0/169448357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 0x55a35fccf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff27d17d640 1 -- 172.21.15.135:0/169448357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcc9730 msgr2=0x55a35fccf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff27d17d640 1 --2- 172.21.15.135:0/169448357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcc9730 0x55a35fccf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff27d17d640 1 -- 172.21.15.135:0/169448357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 msgr2=0x55a35fccf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff27d17d640 1 --2- 172.21.15.135:0/169448357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 0x55a35fccf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.259+0000 7ff27d17d640 1 -- 172.21.15.135:0/169448357 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a35f9403f0 con 0x55a35fcd2310 2024-04-20T12:23:46.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff27d17d640 1 --2- 172.21.15.135:0/169448357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcd2310 0x55a35fccfe50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff27000efd0 tx=0x7ff27009cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a3687fbfb6c162 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff257fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:46.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff257fff640 1 -- 172.21.15.135:0/169448357 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27001f040 con 0x55a35fcd2310 2024-04-20T12:23:46.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff257fff640 1 -- 172.21.15.135:0/169448357 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff2700ce810 con 0x55a35fcd2310 2024-04-20T12:23:46.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff2817cd740 1 -- 172.21.15.135:0/169448357 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff268010cb0 con 0x55a35fcd2310 2024-04-20T12:23:46.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff257fff640 1 -- 172.21.15.135:0/169448357 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff27009bf00 con 0x55a35fcd2310 2024-04-20T12:23:46.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff2817cd740 10 client.15915 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:46.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff2817cd740 1 -- 172.21.15.135:0/169448357 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a35fa0a7d0 con 0x55a35fcd2310 2024-04-20T12:23:46.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff257fff640 1 -- 172.21.15.135:0/169448357 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff268010cb0 con 0x55a35fcd2310 2024-04-20T12:23:46.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff257fff640 1 -- 172.21.15.135:0/169448357 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7ff27000f040 con 0x55a35fcd2310 2024-04-20T12:23:46.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff2817cd740 10 client.15915 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:46.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff2817cd740 10 client.15915 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:23:46.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff2817cd740 20 client.15915 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:46.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff2817cd740 1 --2- 172.21.15.135:0/169448357 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a35fce2620 0x55a35fce4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff2817cd740 4 client.15915 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:23:46.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.260+0000 7ff2817cd740 1 -- 172.21.15.135:0/169448357 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a35fc3bb30 con 0x55a35fce2620 2024-04-20T12:23:46.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.261+0000 7ff27c97c640 1 --2- 172.21.15.135:0/169448357 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a35fce2620 0x55a35fce4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.261+0000 7ff257fff640 10 client.15915 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:23:46.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.261+0000 7ff27c97c640 1 --2- 172.21.15.135:0/169448357 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a35fce2620 0x55a35fce4a50 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5aac03f5bbc16ab7 server_cookie=31967a725628b2c3 in_seq=0 out_seq=0 2024-04-20T12:23:46.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.262+0000 7ff257fff640 1 -- 172.21.15.135:0/169448357 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a35fc3bb30 con 0x55a35fce2620 2024-04-20T12:23:46.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.262+0000 7ff257fff640 10 client.15915 handle_command_reply: tid=0 2024-04-20T12:23:46.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.262+0000 7ff2817cd740 1 client.15915 shutdown 2024-04-20T12:23:46.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.262+0000 7ff2817cd740 1 -- 172.21.15.135:0/169448357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcd2310 msgr2=0x55a35fccfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.262+0000 7ff2817cd740 1 --2- 172.21.15.135:0/169448357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcd2310 0x55a35fccfe50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff27000efd0 tx=0x7ff27009cbf0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.262+0000 7ff2817cd740 1 -- 172.21.15.135:0/169448357 shutdown_connections 2024-04-20T12:23:46.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.262+0000 7ff2817cd740 1 --2- 172.21.15.135:0/169448357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcd2310 0x55a35fccfe50 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.262+0000 7ff2817cd740 1 --2- 172.21.15.135:0/169448357 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a35fce2620 0x55a35fce4a50 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.262+0000 7ff2817cd740 1 --2- 172.21.15.135:0/169448357 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcc9730 0x55a35fccf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.262+0000 7ff2817cd740 1 --2- 172.21.15.135:0/169448357 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 0x55a35fccf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.262+0000 7ff257fff640 0 client.15915 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:23:46.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.262+0000 7ff2817cd740 1 -- 172.21.15.135:0/169448357 >> 172.21.15.135:0/169448357 conn(0x55a35fcc3540 msgr2=0x55a35fcc5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.262+0000 7ff2817cd740 1 -- 172.21.15.135:0/169448357 shutdown_connections 2024-04-20T12:23:46.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.262+0000 7ff2817cd740 1 -- 172.21.15.135:0/169448357 wait complete. 2024-04-20T12:23:46.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.262+0000 7ff2817cd740 20 client.15915 trim_cache size 0 max 16384 2024-04-20T12:23:46.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.275+0000 7ff2817cd740 1 Processor -- start 2024-04-20T12:23:46.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.275+0000 7ff2817cd740 1 -- start start 2024-04-20T12:23:46.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.275+0000 7ff2817cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 0x55a35fcd1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.275+0000 7ff2817cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc9730 0x55a35fcddf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.275+0000 7ff2817cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcd2310 0x55a35fcda880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.275+0000 7ff2817cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781af3b0 con 0x55a35fcc9730 2024-04-20T12:23:46.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.275+0000 7ff2817cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781b0ef0 con 0x55a35fcc8e10 2024-04-20T12:23:46.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.275+0000 7ff2817cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781afa80 con 0x55a35fcd2310 2024-04-20T12:23:46.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.276+0000 7ff277fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc9730 0x55a35fcddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.276+0000 7ff277fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc9730 0x55a35fcddf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39444/0 (socket says 172.21.15.135:39444) 2024-04-20T12:23:46.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.276+0000 7ff277fff640 1 -- 172.21.15.135:0/3624989247 learned_addr learned my addr 172.21.15.135:0/3624989247 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.276+0000 7ff27c97c640 1 --2- 172.21.15.135:0/3624989247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 0x55a35fcd1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.276+0000 7ff27d17d640 1 --2- 172.21.15.135:0/3624989247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcd2310 0x55a35fcda880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.276+0000 7ff277fff640 1 -- 172.21.15.135:0/3624989247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcd2310 msgr2=0x55a35fcda880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.276+0000 7ff277fff640 1 --2- 172.21.15.135:0/3624989247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcd2310 0x55a35fcda880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.276+0000 7ff277fff640 1 -- 172.21.15.135:0/3624989247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 msgr2=0x55a35fcd1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.276+0000 7ff277fff640 1 --2- 172.21.15.135:0/3624989247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 0x55a35fcd1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.276+0000 7ff277fff640 1 -- 172.21.15.135:0/3624989247 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a35fcc4110 con 0x55a35fcc9730 2024-04-20T12:23:46.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.276+0000 7ff27c97c640 1 --2- 172.21.15.135:0/3624989247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 0x55a35fcd1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:46.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.276+0000 7ff277fff640 1 --2- 172.21.15.135:0/3624989247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc9730 0x55a35fcddf90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009900 tx=0x7ff26c03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7360d25a65a2dc41 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.276+0000 7ff25e7fc640 1 -- 172.21.15.135:0/3624989247 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c048040 con 0x55a35fcc9730 2024-04-20T12:23:46.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.276+0000 7ff25e7fc640 1 -- 172.21.15.135:0/3624989247 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c053070 con 0x55a35fcc9730 2024-04-20T12:23:46.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.276+0000 7ff25e7fc640 1 -- 172.21.15.135:0/3624989247 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c004aa0 con 0x55a35fcc9730 2024-04-20T12:23:46.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.277+0000 7ff2817cd740 1 -- 172.21.15.135:0/3624989247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc9730 msgr2=0x55a35fcddf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.277+0000 7ff2817cd740 1 --2- 172.21.15.135:0/3624989247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc9730 0x55a35fcddf90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009900 tx=0x7ff26c03f000 comp rx=0 tx=0).stop 2024-04-20T12:23:46.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.277+0000 7ff2817cd740 1 -- 172.21.15.135:0/3624989247 shutdown_connections 2024-04-20T12:23:46.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.277+0000 7ff2817cd740 1 --2- 172.21.15.135:0/3624989247 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcd2310 0x55a35fcda880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.277+0000 7ff2817cd740 1 --2- 172.21.15.135:0/3624989247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc9730 0x55a35fcddf90 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.277+0000 7ff2817cd740 1 --2- 172.21.15.135:0/3624989247 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 0x55a35fcd1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.277+0000 7ff2817cd740 1 -- 172.21.15.135:0/3624989247 >> 172.21.15.135:0/3624989247 conn(0x55a35fcc3540 msgr2=0x55a35fcbe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.277+0000 7ff2817cd740 1 -- 172.21.15.135:0/3624989247 shutdown_connections 2024-04-20T12:23:46.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.277+0000 7ff2817cd740 1 -- 172.21.15.135:0/3624989247 wait complete. 2024-04-20T12:23:46.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.277+0000 7ff2817cd740 1 -- start start 2024-04-20T12:23:46.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.277+0000 7ff2817cd740 1 Processor -- start 2024-04-20T12:23:46.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff2817cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 0x55a35fce9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff2817cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc9730 0x55a35fcea320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff2817cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcd2310 0x55a35fcea860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff2817cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781b0820 con 0x55a35fcc9730 2024-04-20T12:23:46.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff2817cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781b0150 con 0x55a35fcc8e10 2024-04-20T12:23:46.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff2817cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff2781ad380 con 0x55a35fcd2310 2024-04-20T12:23:46.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff2817cd740 10 client.0 _ll_register_callbacks cb 0x7ff270098e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:46.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff277fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc9730 0x55a35fcea320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff277fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc9730 0x55a35fcea320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39450/0 (socket says 172.21.15.135:39450) 2024-04-20T12:23:46.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff277fff640 1 -- 172.21.15.135:0/3958415236 learned_addr learned my addr 172.21.15.135:0/3958415236 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff27c97c640 1 --2- 172.21.15.135:0/3958415236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 0x55a35fce9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff27d17d640 1 --2- 172.21.15.135:0/3958415236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcd2310 0x55a35fcea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff277fff640 1 -- 172.21.15.135:0/3958415236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcd2310 msgr2=0x55a35fcea860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff277fff640 1 --2- 172.21.15.135:0/3958415236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcd2310 0x55a35fcea860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff277fff640 1 -- 172.21.15.135:0/3958415236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 msgr2=0x55a35fce9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff277fff640 1 --2- 172.21.15.135:0/3958415236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 0x55a35fce9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff277fff640 1 -- 172.21.15.135:0/3958415236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a35fd4bc60 con 0x55a35fcc9730 2024-04-20T12:23:46.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff277fff640 1 --2- 172.21.15.135:0/3958415236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc9730 0x55a35fcea320 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009850 tx=0x7ff26c0054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38e66b125ba811 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff257fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:46.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff257fff640 1 -- 172.21.15.135:0/3958415236 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26c05b020 con 0x55a35fcc9730 2024-04-20T12:23:46.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff257fff640 1 -- 172.21.15.135:0/3958415236 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff26c004960 con 0x55a35fcc9730 2024-04-20T12:23:46.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.278+0000 7ff2817cd740 1 -- 172.21.15.135:0/3958415236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff26c053070 con 0x55a35fcc9730 2024-04-20T12:23:46.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.279+0000 7ff257fff640 1 -- 172.21.15.135:0/3958415236 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff26c066050 con 0x55a35fcc9730 2024-04-20T12:23:46.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.279+0000 7ff2817cd740 10 client.15921 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:46.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.279+0000 7ff2817cd740 1 -- 172.21.15.135:0/3958415236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a35fd4cf60 con 0x55a35fcc9730 2024-04-20T12:23:46.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.279+0000 7ff257fff640 1 -- 172.21.15.135:0/3958415236 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff26c053070 con 0x55a35fcc9730 2024-04-20T12:23:46.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.279+0000 7ff257fff640 1 -- 172.21.15.135:0/3958415236 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7ff26c04b030 con 0x55a35fcc9730 2024-04-20T12:23:46.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.279+0000 7ff2817cd740 10 client.15921 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:46.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.279+0000 7ff2817cd740 10 client.15921 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:23:46.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.279+0000 7ff2817cd740 20 client.15921 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:46.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.279+0000 7ff2817cd740 1 --2- 172.21.15.135:0/3958415236 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a35fd4d700 0x55a35fd4fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.279+0000 7ff2817cd740 4 client.15921 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:23:46.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.279+0000 7ff2817cd740 1 -- 172.21.15.135:0/3958415236 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a35fc359a0 con 0x55a35fd4d700 2024-04-20T12:23:46.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.279+0000 7ff27c97c640 1 --2- 172.21.15.135:0/3958415236 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a35fd4d700 0x55a35fd4fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff257fff640 10 client.15921 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:23:46.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff27c97c640 1 --2- 172.21.15.135:0/3958415236 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a35fd4d700 0x55a35fd4fb20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a1bf689833dcb70a server_cookie=a0dbe9d2883b008a in_seq=0 out_seq=0 2024-04-20T12:23:46.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff257fff640 1 -- 172.21.15.135:0/3958415236 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a35fc359a0 con 0x55a35fd4d700 2024-04-20T12:23:46.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff257fff640 10 client.15921 handle_command_reply: tid=0 2024-04-20T12:23:46.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff2817cd740 1 client.15921 shutdown 2024-04-20T12:23:46.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff2817cd740 1 -- 172.21.15.135:0/3958415236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc9730 msgr2=0x55a35fcea320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff2817cd740 1 --2- 172.21.15.135:0/3958415236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc9730 0x55a35fcea320 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009850 tx=0x7ff26c0054a0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff2817cd740 1 -- 172.21.15.135:0/3958415236 shutdown_connections 2024-04-20T12:23:46.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff2817cd740 1 --2- 172.21.15.135:0/3958415236 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55a35fd4d700 0x55a35fd4fb20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff2817cd740 1 --2- 172.21.15.135:0/3958415236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a35fcd2310 0x55a35fcea860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff2817cd740 1 --2- 172.21.15.135:0/3958415236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a35fcc9730 0x55a35fcea320 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff257fff640 0 client.15921 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:23:46.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff2817cd740 1 --2- 172.21.15.135:0/3958415236 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a35fcc8e10 0x55a35fce9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff2817cd740 1 -- 172.21.15.135:0/3958415236 >> 172.21.15.135:0/3958415236 conn(0x55a35fcc3540 msgr2=0x55a35fccf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff2817cd740 1 -- 172.21.15.135:0/3958415236 shutdown_connections 2024-04-20T12:23:46.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff2817cd740 1 -- 172.21.15.135:0/3958415236 wait complete. 2024-04-20T12:23:46.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.280+0000 7ff2817cd740 20 client.15921 trim_cache size 0 max 16384 2024-04-20T12:23:46.287 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:23:46.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.281+0000 7ff27ebe0640 1 -- 172.21.15.135:0/1437473245 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff2600a3e40 msgr2=0x7ff2600a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.281+0000 7ff27ebe0640 1 --2- 172.21.15.135:0/1437473245 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff2600a3e40 0x7ff2600a6300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff26c006010 tx=0x7ff26c0095f0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.281+0000 7ff27ebe0640 1 -- 172.21.15.135:0/1437473245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff278198690 msgr2=0x7ff278198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.281+0000 7ff27ebe0640 1 --2- 172.21.15.135:0/1437473245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff278198690 0x7ff278198b10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff27000eaa0 tx=0x7ff27000ef60 comp rx=0 tx=0).stop 2024-04-20T12:23:46.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.281+0000 7ff27ebe0640 1 -- 172.21.15.135:0/1437473245 shutdown_connections 2024-04-20T12:23:46.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.281+0000 7ff27ebe0640 1 --2- 172.21.15.135:0/1437473245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff278198690 0x7ff278198b10 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.281+0000 7ff27ebe0640 1 --2- 172.21.15.135:0/1437473245 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff278106160 0x7ff27819eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.281+0000 7ff27ebe0640 1 --2- 172.21.15.135:0/1437473245 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff2600a3e40 0x7ff2600a6300 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.281+0000 7ff27ebe0640 1 --2- 172.21.15.135:0/1437473245 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff278101090 0x7ff27819e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.281+0000 7ff27ebe0640 1 -- 172.21.15.135:0/1437473245 >> 172.21.15.135:0/1437473245 conn(0x7ff278078010 msgr2=0x7ff2780feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.281+0000 7ff27ebe0640 1 -- 172.21.15.135:0/1437473245 shutdown_connections 2024-04-20T12:23:46.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.281+0000 7ff27ebe0640 1 -- 172.21.15.135:0/1437473245 wait complete. 2024-04-20T12:23:46.291 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:23:46.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.393+0000 7fc68a5a4640 1 -- 172.21.15.135:0/1809392566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6841010a0 msgr2=0x7fc684101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.393+0000 7fc68a5a4640 1 --2- 172.21.15.135:0/1809392566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6841010a0 0x7fc684101480 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009900 tx=0x7fc66c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:46.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.393+0000 7fc68a5a4640 1 -- 172.21.15.135:0/1809392566 shutdown_connections 2024-04-20T12:23:46.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.393+0000 7fc68a5a4640 1 --2- 172.21.15.135:0/1809392566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc684106170 0x7fc68410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.393+0000 7fc68a5a4640 1 --2- 172.21.15.135:0/1809392566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc684101a50 0x7fc684105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.393+0000 7fc68a5a4640 1 --2- 172.21.15.135:0/1809392566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6841010a0 0x7fc684101480 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.393+0000 7fc68a5a4640 1 -- 172.21.15.135:0/1809392566 >> 172.21.15.135:0/1809392566 conn(0x7fc6840771e0 msgr2=0x7fc6840775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.393+0000 7fc68a5a4640 1 -- 172.21.15.135:0/1809392566 shutdown_connections 2024-04-20T12:23:46.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.393+0000 7fc68a5a4640 1 -- 172.21.15.135:0/1809392566 wait complete. 2024-04-20T12:23:46.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.393+0000 7fc68a5a4640 1 Processor -- start 2024-04-20T12:23:46.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.393+0000 7fc68a5a4640 1 -- start start 2024-04-20T12:23:46.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc68a5a4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6841010a0 0x7fc684102b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc68a5a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc684106170 0x7fc684103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc68a5a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6841035b0 0x7fc6841a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc68a5a4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc684111220 con 0x7fc6841010a0 2024-04-20T12:23:46.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc68a5a4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc6841110a0 con 0x7fc684106170 2024-04-20T12:23:46.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc68a5a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc6841113a0 con 0x7fc6841035b0 2024-04-20T12:23:46.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc683fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6841010a0 0x7fc684102b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc683fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6841010a0 0x7fc684102b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39476/0 (socket says 172.21.15.135:39476) 2024-04-20T12:23:46.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc683fff640 1 -- 172.21.15.135:0/2788544624 learned_addr learned my addr 172.21.15.135:0/2788544624 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc688b41640 1 --2- 172.21.15.135:0/2788544624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6841035b0 0x7fc6841a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc6837fe640 1 --2- 172.21.15.135:0/2788544624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc684106170 0x7fc684103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc683fff640 1 -- 172.21.15.135:0/2788544624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6841035b0 msgr2=0x7fc6841a6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc683fff640 1 --2- 172.21.15.135:0/2788544624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6841035b0 0x7fc6841a6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc683fff640 1 -- 172.21.15.135:0/2788544624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc684106170 msgr2=0x7fc684103070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc683fff640 1 --2- 172.21.15.135:0/2788544624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc684106170 0x7fc684103070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc683fff640 1 -- 172.21.15.135:0/2788544624 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6841a7120 con 0x7fc6841010a0 2024-04-20T12:23:46.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc6837fe640 1 --2- 172.21.15.135:0/2788544624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc684106170 0x7fc684103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:46.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc683fff640 1 --2- 172.21.15.135:0/2788544624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6841010a0 0x7fc684102b30 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc66c006010 tx=0x7fc66c02cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc6817fa640 1 -- 172.21.15.135:0/2788544624 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66c041070 con 0x7fc6841010a0 2024-04-20T12:23:46.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc6817fa640 1 -- 172.21.15.135:0/2788544624 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc66c004450 con 0x7fc6841010a0 2024-04-20T12:23:46.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc68a5a4640 1 -- 172.21.15.135:0/2788544624 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6841a73b0 con 0x7fc6841010a0 2024-04-20T12:23:46.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc6817fa640 1 -- 172.21.15.135:0/2788544624 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66c034440 con 0x7fc6841010a0 2024-04-20T12:23:46.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.394+0000 7fc68a5a4640 1 -- 172.21.15.135:0/2788544624 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6841a78a0 con 0x7fc6841010a0 2024-04-20T12:23:46.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.396+0000 7fc6817fa640 1 -- 172.21.15.135:0/2788544624 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7fc66c044070 con 0x7fc6841010a0 2024-04-20T12:23:46.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.397+0000 7fc68d194740 1 Processor -- start 2024-04-20T12:23:46.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.397+0000 7fc68d194740 1 -- start start 2024-04-20T12:23:46.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.397+0000 7fc68d194740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48aee10 0x5572b48af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.397+0000 7fc68d194740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48af730 0x5572b48b7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.397+0000 7fc68d194740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48ba700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.397+0000 7fc68d194740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5572b4814110 con 0x5572b48b8310 2024-04-20T12:23:46.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.397+0000 7fc68d194740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5572b47b1550 con 0x5572b48aee10 2024-04-20T12:23:46.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.397+0000 7fc68d194740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5572b48100d0 con 0x5572b48af730 2024-04-20T12:23:46.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.397+0000 7fc6817fa640 1 --2- 172.21.15.135:0/2788544624 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc6700a3e70 0x7fc6700a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.397+0000 7fc6837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48ba700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.397+0000 7fc6837fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48ba700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39482/0 (socket says 172.21.15.135:39482) 2024-04-20T12:23:46.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.397+0000 7fc6837fe640 1 -- 172.21.15.135:0/1946911499 learned_addr learned my addr 172.21.15.135:0/1946911499 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.397+0000 7fc688b41640 1 --2- 172.21.15.135:0/1946911499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48aee10 0x5572b48af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.398+0000 7fc6817fa640 1 -- 172.21.15.135:0/2788544624 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc66c0f2950 con 0x7fc6841010a0 2024-04-20T12:23:46.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.398+0000 7fc688b41640 1 --2- 172.21.15.135:0/2788544624 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc6700a3e70 0x7fc6700a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.398+0000 7fc683fff640 1 --2- 172.21.15.135:0/1946911499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48af730 0x5572b48b7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.398+0000 7fc6837fe640 1 -- 172.21.15.135:0/1946911499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48af730 msgr2=0x5572b48b7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.398+0000 7fc6837fe640 1 --2- 172.21.15.135:0/1946911499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48af730 0x5572b48b7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.398+0000 7fc6837fe640 1 -- 172.21.15.135:0/1946911499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48aee10 msgr2=0x5572b48af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.398+0000 7fc6837fe640 1 --2- 172.21.15.135:0/1946911499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48aee10 0x5572b48af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.398+0000 7fc6837fe640 1 -- 172.21.15.135:0/1946911499 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b47d9900 con 0x5572b48b8310 2024-04-20T12:23:46.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.398+0000 7fc688b41640 1 --2- 172.21.15.135:0/1946911499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48aee10 0x5572b48af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:46.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.398+0000 7fc6837fe640 1 --2- 172.21.15.135:0/1946911499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48ba700 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc67400bce0 tx=0x7fc67400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8dc485388e8fc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.398+0000 7fc688b41640 1 --2- 172.21.15.135:0/2788544624 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc6700a3e70 0x7fc6700a6330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009990 tx=0x7fc67c0096a0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.398+0000 7fc67a7fc640 1 -- 172.21.15.135:0/1946911499 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674015070 con 0x5572b48b8310 2024-04-20T12:23:46.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.398+0000 7fc67a7fc640 1 -- 172.21.15.135:0/1946911499 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc67401a940 con 0x5572b48b8310 2024-04-20T12:23:46.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.398+0000 7fc67a7fc640 1 -- 172.21.15.135:0/1946911499 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674011a40 con 0x5572b48b8310 2024-04-20T12:23:46.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.399+0000 7fc68d194740 1 -- 172.21.15.135:0/1946911499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 msgr2=0x5572b48ba700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.399+0000 7fc68d194740 1 --2- 172.21.15.135:0/1946911499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48ba700 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc67400bce0 tx=0x7fc67400f730 comp rx=0 tx=0).stop 2024-04-20T12:23:46.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.399+0000 7fc68d194740 1 -- 172.21.15.135:0/1946911499 shutdown_connections 2024-04-20T12:23:46.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.399+0000 7fc68d194740 1 --2- 172.21.15.135:0/1946911499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48ba700 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.399+0000 7fc68d194740 1 --2- 172.21.15.135:0/1946911499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48af730 0x5572b48b7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.399+0000 7fc68d194740 1 --2- 172.21.15.135:0/1946911499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48aee10 0x5572b48af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.399+0000 7fc68d194740 1 -- 172.21.15.135:0/1946911499 >> 172.21.15.135:0/1946911499 conn(0x5572b48a9540 msgr2=0x5572b48a9920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.399+0000 7fc68d194740 1 -- 172.21.15.135:0/1946911499 shutdown_connections 2024-04-20T12:23:46.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.399+0000 7fc68d194740 1 -- 172.21.15.135:0/1946911499 wait complete. 2024-04-20T12:23:46.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.399+0000 7fc68d194740 1 -- start start 2024-04-20T12:23:46.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.399+0000 7fc68d194740 1 Processor -- start 2024-04-20T12:23:46.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc68d194740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48aee10 0x5572b48b5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc68d194740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48af730 0x5572b48b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc68d194740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc68d194740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5572b48bb0a0 con 0x5572b48b8310 2024-04-20T12:23:46.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc68d194740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5572b47cd500 con 0x5572b48aee10 2024-04-20T12:23:46.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc68d194740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5572b48bb220 con 0x5572b48af730 2024-04-20T12:23:46.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc68d194740 10 client.0 _ll_register_callbacks cb 0x5572b47b22f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:46.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc688b41640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc688b41640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48b5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39492/0 (socket says 172.21.15.135:39492) 2024-04-20T12:23:46.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc688b41640 1 -- 172.21.15.135:0/2524263031 learned_addr learned my addr 172.21.15.135:0/2524263031 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc683fff640 1 --2- 172.21.15.135:0/2524263031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48aee10 0x5572b48b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc6837fe640 1 --2- 172.21.15.135:0/2524263031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48af730 0x5572b48b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc688b41640 1 -- 172.21.15.135:0/2524263031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48af730 msgr2=0x5572b48b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc688b41640 1 --2- 172.21.15.135:0/2524263031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48af730 0x5572b48b58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc688b41640 1 -- 172.21.15.135:0/2524263031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48aee10 msgr2=0x5572b48b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc688b41640 1 --2- 172.21.15.135:0/2524263031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48aee10 0x5572b48b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc688b41640 1 -- 172.21.15.135:0/2524263031 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b45263f0 con 0x5572b48b8310 2024-04-20T12:23:46.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc688b41640 1 --2- 172.21.15.135:0/2524263031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48b5df0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc67c012790 tx=0x7fc67c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ded398e2b23767 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc6637fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:46.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc6637fe640 1 -- 172.21.15.135:0/2524263031 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c01f780 con 0x5572b48b8310 2024-04-20T12:23:46.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc6637fe640 1 -- 172.21.15.135:0/2524263031 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc67c01f920 con 0x5572b48b8310 2024-04-20T12:23:46.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc68d194740 1 -- 172.21.15.135:0/2524263031 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc67401a940 con 0x5572b48b8310 2024-04-20T12:23:46.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc6637fe640 1 -- 172.21.15.135:0/2524263031 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc67c01fb20 con 0x5572b48b8310 2024-04-20T12:23:46.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.400+0000 7fc68d194740 10 client.15933 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:46.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.401+0000 7fc68d194740 1 -- 172.21.15.135:0/2524263031 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5572b45f07d0 con 0x5572b48b8310 2024-04-20T12:23:46.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.401+0000 7fc6637fe640 1 -- 172.21.15.135:0/2524263031 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc67401a940 con 0x5572b48b8310 2024-04-20T12:23:46.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.401+0000 7fc6637fe640 1 -- 172.21.15.135:0/2524263031 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc67c01e3f0 con 0x5572b48b8310 2024-04-20T12:23:46.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.401+0000 7fc68d194740 10 client.15933 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:46.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.401+0000 7fc68d194740 10 client.15933 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:23:46.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.401+0000 7fc68d194740 20 client.15933 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:46.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.401+0000 7fc68d194740 1 --2- 172.21.15.135:0/2524263031 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5572b48c8640 0x5572b48caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.401+0000 7fc68d194740 4 client.15933 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:23:46.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.401+0000 7fc68d194740 1 -- 172.21.15.135:0/2524263031 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572b4821b30 con 0x5572b48c8640 2024-04-20T12:23:46.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.401+0000 7fc683fff640 1 --2- 172.21.15.135:0/2524263031 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5572b48c8640 0x5572b48caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.402+0000 7fc6637fe640 10 client.15933 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:23:46.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.402+0000 7fc683fff640 1 --2- 172.21.15.135:0/2524263031 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5572b48c8640 0x5572b48caa30 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=74ecb7726e4e5ec7 server_cookie=8c4562ec0dafb7a5 in_seq=0 out_seq=0 2024-04-20T12:23:46.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.402+0000 7fc6637fe640 1 -- 172.21.15.135:0/2524263031 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5572b4821b30 con 0x5572b48c8640 2024-04-20T12:23:46.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.402+0000 7fc6637fe640 10 client.15933 handle_command_reply: tid=0 2024-04-20T12:23:46.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.402+0000 7fc68d194740 1 client.15933 shutdown 2024-04-20T12:23:46.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.402+0000 7fc68d194740 1 -- 172.21.15.135:0/2524263031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 msgr2=0x5572b48b5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.402+0000 7fc68d194740 1 --2- 172.21.15.135:0/2524263031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48b5df0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc67c012790 tx=0x7fc67c004ab0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.402+0000 7fc68d194740 1 -- 172.21.15.135:0/2524263031 shutdown_connections 2024-04-20T12:23:46.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.402+0000 7fc68d194740 1 --2- 172.21.15.135:0/2524263031 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5572b48c8640 0x5572b48caa30 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.402+0000 7fc68d194740 1 --2- 172.21.15.135:0/2524263031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48b5df0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.402+0000 7fc68d194740 1 --2- 172.21.15.135:0/2524263031 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48af730 0x5572b48b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.402+0000 7fc68d194740 1 --2- 172.21.15.135:0/2524263031 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48aee10 0x5572b48b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.402+0000 7fc6637fe640 0 client.15933 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:23:46.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.402+0000 7fc68d194740 1 -- 172.21.15.135:0/2524263031 >> 172.21.15.135:0/2524263031 conn(0x5572b48a9540 msgr2=0x5572b48ab290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.402+0000 7fc68d194740 1 -- 172.21.15.135:0/2524263031 shutdown_connections 2024-04-20T12:23:46.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.403+0000 7fc68d194740 1 -- 172.21.15.135:0/2524263031 wait complete. 2024-04-20T12:23:46.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.403+0000 7fc68d194740 20 client.15933 trim_cache size 0 max 16384 2024-04-20T12:23:46.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.415+0000 7fc68d194740 1 Processor -- start 2024-04-20T12:23:46.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc68d194740 1 -- start start 2024-04-20T12:23:46.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc68d194740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48aee10 0x5572b48c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc68d194740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48af730 0x5572b48a8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc68d194740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc68d194740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc6841b1550 con 0x5572b48b8310 2024-04-20T12:23:46.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc68d194740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc6841b3090 con 0x5572b48af730 2024-04-20T12:23:46.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc68d194740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc6841b1c20 con 0x5572b48aee10 2024-04-20T12:23:46.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc688b41640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc688b41640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48d02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39504/0 (socket says 172.21.15.135:39504) 2024-04-20T12:23:46.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc688b41640 1 -- 172.21.15.135:0/2717193109 learned_addr learned my addr 172.21.15.135:0/2717193109 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc6837fe640 1 --2- 172.21.15.135:0/2717193109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48af730 0x5572b48a8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc683fff640 1 --2- 172.21.15.135:0/2717193109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48aee10 0x5572b48c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc688b41640 1 -- 172.21.15.135:0/2717193109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48aee10 msgr2=0x5572b48c3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc688b41640 1 --2- 172.21.15.135:0/2717193109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48aee10 0x5572b48c3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc688b41640 1 -- 172.21.15.135:0/2717193109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48af730 msgr2=0x5572b48a8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc688b41640 1 --2- 172.21.15.135:0/2717193109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48af730 0x5572b48a8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc688b41640 1 -- 172.21.15.135:0/2717193109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b48ba700 con 0x5572b48b8310 2024-04-20T12:23:46.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc683fff640 1 --2- 172.21.15.135:0/2717193109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48aee10 0x5572b48c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:46.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc688b41640 1 --2- 172.21.15.135:0/2717193109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48d02b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc67c01e890 tx=0x7fc67c012f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5255dd65c09f10 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc679ffb640 1 -- 172.21.15.135:0/2717193109 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c009e30 con 0x5572b48b8310 2024-04-20T12:23:46.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc679ffb640 1 -- 172.21.15.135:0/2717193109 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc67c023070 con 0x5572b48b8310 2024-04-20T12:23:46.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.416+0000 7fc679ffb640 1 -- 172.21.15.135:0/2717193109 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67c028470 con 0x5572b48b8310 2024-04-20T12:23:46.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.417+0000 7fc68d194740 1 -- 172.21.15.135:0/2717193109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 msgr2=0x5572b48d02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.417+0000 7fc68d194740 1 --2- 172.21.15.135:0/2717193109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48d02b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc67c01e890 tx=0x7fc67c012f60 comp rx=0 tx=0).stop 2024-04-20T12:23:46.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.417+0000 7fc68d194740 1 -- 172.21.15.135:0/2717193109 shutdown_connections 2024-04-20T12:23:46.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.417+0000 7fc68d194740 1 --2- 172.21.15.135:0/2717193109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48b8310 0x5572b48d02b0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.417+0000 7fc68d194740 1 --2- 172.21.15.135:0/2717193109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48af730 0x5572b48a8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.417+0000 7fc68d194740 1 --2- 172.21.15.135:0/2717193109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48aee10 0x5572b48c3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.417+0000 7fc68d194740 1 -- 172.21.15.135:0/2717193109 >> 172.21.15.135:0/2717193109 conn(0x5572b48a9540 msgr2=0x5572b48a7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.417+0000 7fc68d194740 1 -- 172.21.15.135:0/2717193109 shutdown_connections 2024-04-20T12:23:46.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.417+0000 7fc68d194740 1 -- 172.21.15.135:0/2717193109 wait complete. 2024-04-20T12:23:46.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.417+0000 7fc68d194740 1 -- start start 2024-04-20T12:23:46.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc68d194740 1 Processor -- start 2024-04-20T12:23:46.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc68d194740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48aee10 0x5572b48bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc68d194740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48af730 0x5572b48bc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc68d194740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48b8310 0x5572b48bcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc68d194740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc6841b29c0 con 0x5572b48aee10 2024-04-20T12:23:46.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc68d194740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc6841b22f0 con 0x5572b48b8310 2024-04-20T12:23:46.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc68d194740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc6841af520 con 0x5572b48af730 2024-04-20T12:23:46.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc68d194740 10 client.0 _ll_register_callbacks cb 0x7fc67c009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:46.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc683fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48aee10 0x5572b48bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc683fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48aee10 0x5572b48bc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39514/0 (socket says 172.21.15.135:39514) 2024-04-20T12:23:46.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc683fff640 1 -- 172.21.15.135:0/2749660611 learned_addr learned my addr 172.21.15.135:0/2749660611 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc688b41640 1 --2- 172.21.15.135:0/2749660611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48b8310 0x5572b48bcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc683fff640 1 -- 172.21.15.135:0/2749660611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48af730 msgr2=0x5572b48bc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc683fff640 1 --2- 172.21.15.135:0/2749660611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48af730 0x5572b48bc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc683fff640 1 -- 172.21.15.135:0/2749660611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48b8310 msgr2=0x5572b48bcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc683fff640 1 --2- 172.21.15.135:0/2749660611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48b8310 0x5572b48bcb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc683fff640 1 -- 172.21.15.135:0/2749660611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b492dd70 con 0x5572b48aee10 2024-04-20T12:23:46.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc688b41640 1 --2- 172.21.15.135:0/2749660611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48b8310 0x5572b48bcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:46.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc683fff640 1 --2- 172.21.15.135:0/2749660611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48aee10 0x5572b48bc0a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc66c02cfd0 tx=0x7fc66c02cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f81007b1e89b82b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc6637fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:46.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc6637fe640 1 -- 172.21.15.135:0/2749660611 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66c04b040 con 0x5572b48aee10 2024-04-20T12:23:46.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc6637fe640 1 -- 172.21.15.135:0/2749660611 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc66c0035f0 con 0x5572b48aee10 2024-04-20T12:23:46.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.418+0000 7fc68d194740 1 -- 172.21.15.135:0/2749660611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc67c023070 con 0x5572b48aee10 2024-04-20T12:23:46.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.419+0000 7fc6637fe640 1 -- 172.21.15.135:0/2749660611 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc66c0be3d0 con 0x5572b48aee10 2024-04-20T12:23:46.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.419+0000 7fc68d194740 10 client.15939 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:46.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.419+0000 7fc68d194740 1 -- 172.21.15.135:0/2749660611 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5572b492f000 con 0x5572b48aee10 2024-04-20T12:23:46.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.419+0000 7fc6637fe640 1 -- 172.21.15.135:0/2749660611 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc67c023070 con 0x5572b48aee10 2024-04-20T12:23:46.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.419+0000 7fc6637fe640 1 -- 172.21.15.135:0/2749660611 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc66c0c6c40 con 0x5572b48aee10 2024-04-20T12:23:46.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.419+0000 7fc68d194740 10 client.15939 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:46.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.419+0000 7fc68d194740 10 client.15939 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:23:46.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.419+0000 7fc68d194740 20 client.15939 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:46.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.419+0000 7fc68d194740 1 --2- 172.21.15.135:0/2749660611 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5572b492f720 0x5572b4931b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.419+0000 7fc68d194740 4 client.15939 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:23:46.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.419+0000 7fc68d194740 1 -- 172.21.15.135:0/2749660611 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5572b481b9a0 con 0x5572b492f720 2024-04-20T12:23:46.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.419+0000 7fc6837fe640 1 --2- 172.21.15.135:0/2749660611 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5572b492f720 0x5572b4931b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.419+0000 7fc6837fe640 1 --2- 172.21.15.135:0/2749660611 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5572b492f720 0x5572b4931b70 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d65e18991dccd39a server_cookie=387b99d5137333ce in_seq=0 out_seq=0 2024-04-20T12:23:46.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.419+0000 7fc6637fe640 10 client.15939 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:23:46.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc6637fe640 1 -- 172.21.15.135:0/2749660611 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5572b481b9a0 con 0x5572b492f720 2024-04-20T12:23:46.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc6637fe640 10 client.15939 handle_command_reply: tid=0 2024-04-20T12:23:46.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68d194740 1 client.15939 shutdown 2024-04-20T12:23:46.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68d194740 1 -- 172.21.15.135:0/2749660611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48aee10 msgr2=0x5572b48bc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68d194740 1 --2- 172.21.15.135:0/2749660611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48aee10 0x5572b48bc0a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc66c02cfd0 tx=0x7fc66c02cbf0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68d194740 1 -- 172.21.15.135:0/2749660611 shutdown_connections 2024-04-20T12:23:46.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68d194740 1 --2- 172.21.15.135:0/2749660611 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5572b492f720 0x5572b4931b70 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68d194740 1 --2- 172.21.15.135:0/2749660611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572b48b8310 0x5572b48bcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68d194740 1 --2- 172.21.15.135:0/2749660611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5572b48af730 0x5572b48bc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc6637fe640 0 client.15939 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:23:46.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68d194740 1 --2- 172.21.15.135:0/2749660611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572b48aee10 0x5572b48bc0a0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68d194740 1 -- 172.21.15.135:0/2749660611 >> 172.21.15.135:0/2749660611 conn(0x5572b48a9540 msgr2=0x5572b48a7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68d194740 1 -- 172.21.15.135:0/2749660611 shutdown_connections 2024-04-20T12:23:46.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68d194740 1 -- 172.21.15.135:0/2749660611 wait complete. 2024-04-20T12:23:46.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68d194740 20 client.15939 trim_cache size 0 max 16384 2024-04-20T12:23:46.429 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:23:46.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68a5a4640 1 -- 172.21.15.135:0/2788544624 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc6700a3e70 msgr2=0x7fc6700a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68a5a4640 1 --2- 172.21.15.135:0/2788544624 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc6700a3e70 0x7fc6700a6330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009990 tx=0x7fc67c0096a0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68a5a4640 1 -- 172.21.15.135:0/2788544624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6841010a0 msgr2=0x7fc684102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.420+0000 7fc68a5a4640 1 --2- 172.21.15.135:0/2788544624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6841010a0 0x7fc684102b30 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc66c006010 tx=0x7fc66c02cc70 comp rx=0 tx=0).stop 2024-04-20T12:23:46.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.421+0000 7fc68a5a4640 1 -- 172.21.15.135:0/2788544624 shutdown_connections 2024-04-20T12:23:46.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.421+0000 7fc68a5a4640 1 --2- 172.21.15.135:0/2788544624 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc6700a3e70 0x7fc6700a6330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.421+0000 7fc68a5a4640 1 --2- 172.21.15.135:0/2788544624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc6841035b0 0x7fc6841a6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.421+0000 7fc68a5a4640 1 --2- 172.21.15.135:0/2788544624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc684106170 0x7fc684103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.421+0000 7fc68a5a4640 1 --2- 172.21.15.135:0/2788544624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc6841010a0 0x7fc684102b30 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.421+0000 7fc68a5a4640 1 -- 172.21.15.135:0/2788544624 >> 172.21.15.135:0/2788544624 conn(0x7fc6840771e0 msgr2=0x7fc68406a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.421+0000 7fc68a5a4640 1 -- 172.21.15.135:0/2788544624 shutdown_connections 2024-04-20T12:23:46.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.421+0000 7fc68a5a4640 1 -- 172.21.15.135:0/2788544624 wait complete. 2024-04-20T12:23:46.431 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:46 smithi135 ceph-mon[18264]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 KiB/s wr, 16 op/s 2024-04-20T12:23:46.431 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:46 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2256579793' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:23:46.432 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:23:46.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:46 smithi154 ceph-mon[22073]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 KiB/s wr, 16 op/s 2024-04-20T12:23:46.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:46 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2256579793' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:23:46.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.533+0000 7f61dbe14640 1 -- 172.21.15.135:0/3625903030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d410e900 msgr2=0x7f61d4110cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.533+0000 7f61dbe14640 1 --2- 172.21.15.135:0/3625903030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d410e900 0x7f61d4110cf0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009ca0 tx=0x7f61cc02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.533+0000 7f61dbe14640 1 -- 172.21.15.135:0/3625903030 shutdown_connections 2024-04-20T12:23:46.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.533+0000 7f61dbe14640 1 --2- 172.21.15.135:0/3625903030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d410e900 0x7f61d4110cf0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.533+0000 7f61dbe14640 1 --2- 172.21.15.135:0/3625903030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d4101670 0x7f61d410e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.533+0000 7f61dbe14640 1 --2- 172.21.15.135:0/3625903030 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61d4100d50 0x7f61d4101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.533+0000 7f61dbe14640 1 -- 172.21.15.135:0/3625903030 >> 172.21.15.135:0/3625903030 conn(0x7f61d4078010 msgr2=0x7f61d4078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.533+0000 7f61dbe14640 1 -- 172.21.15.135:0/3625903030 shutdown_connections 2024-04-20T12:23:46.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.533+0000 7f61dbe14640 1 -- 172.21.15.135:0/3625903030 wait complete. 2024-04-20T12:23:46.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.533+0000 7f61dbe14640 1 Processor -- start 2024-04-20T12:23:46.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.533+0000 7f61dbe14640 1 -- start start 2024-04-20T12:23:46.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61dbe14640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d4100d50 0x7f61d41a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61dbe14640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4101670 0x7f61d41a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61dbe14640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61d410e900 0x7f61d419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61dbe14640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f61d41144f0 con 0x7f61d4101670 2024-04-20T12:23:46.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61dbe14640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f61d4114370 con 0x7f61d410e900 2024-04-20T12:23:46.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61dbe14640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f61d4114670 con 0x7f61d4100d50 2024-04-20T12:23:46.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61d93af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4101670 0x7f61d41a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61d93af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4101670 0x7f61d41a0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39532/0 (socket says 172.21.15.135:39532) 2024-04-20T12:23:46.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61d93af640 1 -- 172.21.15.135:0/2070778250 learned_addr learned my addr 172.21.15.135:0/2070778250 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61da3b1640 1 --2- 172.21.15.135:0/2070778250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61d410e900 0x7f61d419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61d9bb0640 1 --2- 172.21.15.135:0/2070778250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d4100d50 0x7f61d41a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61d93af640 1 -- 172.21.15.135:0/2070778250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d4100d50 msgr2=0x7f61d41a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61d93af640 1 --2- 172.21.15.135:0/2070778250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d4100d50 0x7f61d41a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61d93af640 1 -- 172.21.15.135:0/2070778250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61d410e900 msgr2=0x7f61d419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61d93af640 1 --2- 172.21.15.135:0/2070778250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61d410e900 0x7f61d419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61d93af640 1 -- 172.21.15.135:0/2070778250 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d419aff0 con 0x7f61d4101670 2024-04-20T12:23:46.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61d93af640 1 --2- 172.21.15.135:0/2070778250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4101670 0x7f61d41a0bb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f61c400c920 tx=0x7f61c400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61caffd640 1 -- 172.21.15.135:0/2070778250 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c4007c70 con 0x7f61d4101670 2024-04-20T12:23:46.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61dbe14640 1 -- 172.21.15.135:0/2070778250 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d419b2e0 con 0x7f61d4101670 2024-04-20T12:23:46.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61caffd640 1 -- 172.21.15.135:0/2070778250 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c4007e10 con 0x7f61d4101670 2024-04-20T12:23:46.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61caffd640 1 -- 172.21.15.135:0/2070778250 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c4018890 con 0x7f61d4101670 2024-04-20T12:23:46.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.534+0000 7f61dbe14640 1 -- 172.21.15.135:0/2070778250 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d41a75f0 con 0x7f61d4101670 2024-04-20T12:23:46.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.537+0000 7f61caffd640 1 -- 172.21.15.135:0/2070778250 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7f61c4018a70 con 0x7f61d4101670 2024-04-20T12:23:46.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.537+0000 7f61dea0a740 1 Processor -- start 2024-04-20T12:23:46.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.537+0000 7f61dea0a740 1 -- start start 2024-04-20T12:23:46.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61caffd640 1 --2- 172.21.15.135:0/2070778250 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f61c00a3e40 0x7f61c00a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61dea0a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe511e10 0x55acbe5121f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61dea0a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe512730 0x55acbe51add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61dea0a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe51b310 0x55acbe51d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61dea0a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55acbe477110 con 0x55acbe511e10 2024-04-20T12:23:46.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61dea0a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55acbe414550 con 0x55acbe512730 2024-04-20T12:23:46.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61dea0a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55acbe4730d0 con 0x55acbe51b310 2024-04-20T12:23:46.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61da3b1640 1 --2- 172.21.15.135:0/2070778250 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f61c00a3e40 0x7f61c00a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61d9bb0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe511e10 0x55acbe5121f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61caffd640 1 -- 172.21.15.135:0/2070778250 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f61c40d0f90 con 0x7f61d4101670 2024-04-20T12:23:46.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61d9bb0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe511e10 0x55acbe5121f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39548/0 (socket says 172.21.15.135:39548) 2024-04-20T12:23:46.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61d9bb0640 1 -- 172.21.15.135:0/1858653993 learned_addr learned my addr 172.21.15.135:0/1858653993 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61d93af640 1 --2- 172.21.15.135:0/1858653993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe512730 0x55acbe51add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61da3b1640 1 --2- 172.21.15.135:0/1858653993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe51b310 0x55acbe51d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61d9bb0640 1 -- 172.21.15.135:0/1858653993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe51b310 msgr2=0x55acbe51d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61d9bb0640 1 --2- 172.21.15.135:0/1858653993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe51b310 0x55acbe51d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61d9bb0640 1 -- 172.21.15.135:0/1858653993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe512730 msgr2=0x55acbe51add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61d9bb0640 1 --2- 172.21.15.135:0/1858653993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe512730 0x55acbe51add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61d9bb0640 1 -- 172.21.15.135:0/1858653993 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acbe43c900 con 0x55acbe511e10 2024-04-20T12:23:46.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61da3b1640 1 --2- 172.21.15.135:0/2070778250 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f61c00a3e40 0x7f61c00a6300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f61cc006010 tx=0x7f61cc02cea0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61d9bb0640 1 --2- 172.21.15.135:0/1858653993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe511e10 0x55acbe5121f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009c00 tx=0x7f61d00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdd0d74d5cb1edb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.538+0000 7f61bffff640 1 -- 172.21.15.135:0/1858653993 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d0012450 con 0x55acbe511e10 2024-04-20T12:23:46.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.539+0000 7f61bffff640 1 -- 172.21.15.135:0/1858653993 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61d0012ad0 con 0x55acbe511e10 2024-04-20T12:23:46.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.539+0000 7f61bffff640 1 -- 172.21.15.135:0/1858653993 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d000fbc0 con 0x55acbe511e10 2024-04-20T12:23:46.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.539+0000 7f61dea0a740 1 -- 172.21.15.135:0/1858653993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe511e10 msgr2=0x55acbe5121f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.539+0000 7f61dea0a740 1 --2- 172.21.15.135:0/1858653993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe511e10 0x55acbe5121f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f61d0009c00 tx=0x7f61d00117b0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.539+0000 7f61dea0a740 1 -- 172.21.15.135:0/1858653993 shutdown_connections 2024-04-20T12:23:46.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.539+0000 7f61dea0a740 1 --2- 172.21.15.135:0/1858653993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe51b310 0x55acbe51d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.539+0000 7f61dea0a740 1 --2- 172.21.15.135:0/1858653993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe512730 0x55acbe51add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.539+0000 7f61dea0a740 1 --2- 172.21.15.135:0/1858653993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe511e10 0x55acbe5121f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.539+0000 7f61dea0a740 1 -- 172.21.15.135:0/1858653993 >> 172.21.15.135:0/1858653993 conn(0x55acbe50c540 msgr2=0x55acbe50c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.539+0000 7f61dea0a740 1 -- 172.21.15.135:0/1858653993 shutdown_connections 2024-04-20T12:23:46.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.539+0000 7f61dea0a740 1 -- 172.21.15.135:0/1858653993 wait complete. 2024-04-20T12:23:46.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61dea0a740 1 -- start start 2024-04-20T12:23:46.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61dea0a740 1 Processor -- start 2024-04-20T12:23:46.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61dea0a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe511e10 0x55acbe518340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61dea0a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe512730 0x55acbe518880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61dea0a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe51b310 0x55acbe518dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61dea0a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55acbe51e0a0 con 0x55acbe511e10 2024-04-20T12:23:46.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61dea0a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55acbe430500 con 0x55acbe51b310 2024-04-20T12:23:46.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61dea0a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55acbe51e220 con 0x55acbe512730 2024-04-20T12:23:46.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61dea0a740 10 client.0 _ll_register_callbacks cb 0x55acbe4152f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:46.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61d9bb0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe511e10 0x55acbe518340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61d9bb0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe511e10 0x55acbe518340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39552/0 (socket says 172.21.15.135:39552) 2024-04-20T12:23:46.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61d9bb0640 1 -- 172.21.15.135:0/2500097787 learned_addr learned my addr 172.21.15.135:0/2500097787 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61d93af640 1 --2- 172.21.15.135:0/2500097787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe512730 0x55acbe518880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61d9bb0640 1 -- 172.21.15.135:0/2500097787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe512730 msgr2=0x55acbe518880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61d9bb0640 1 --2- 172.21.15.135:0/2500097787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe512730 0x55acbe518880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61da3b1640 1 --2- 172.21.15.135:0/2500097787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe51b310 0x55acbe518dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61d9bb0640 1 -- 172.21.15.135:0/2500097787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe51b310 msgr2=0x55acbe518dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.540+0000 7f61d9bb0640 1 --2- 172.21.15.135:0/2500097787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe51b310 0x55acbe518dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61d9bb0640 1 -- 172.21.15.135:0/2500097787 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acbe1893f0 con 0x55acbe511e10 2024-04-20T12:23:46.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61d9bb0640 1 --2- 172.21.15.135:0/2500097787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe511e10 0x55acbe518340 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f61d000f480 tx=0x7f61d0005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d609308a963976 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:46.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61bd7fa640 1 -- 172.21.15.135:0/2500097787 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d0029020 con 0x55acbe511e10 2024-04-20T12:23:46.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61bd7fa640 1 -- 172.21.15.135:0/2500097787 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f61d0012660 con 0x55acbe511e10 2024-04-20T12:23:46.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61dea0a740 1 -- 172.21.15.135:0/2500097787 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61d0012ad0 con 0x55acbe511e10 2024-04-20T12:23:46.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61bd7fa640 1 -- 172.21.15.135:0/2500097787 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f61d00044b0 con 0x55acbe511e10 2024-04-20T12:23:46.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61dea0a740 10 client.15951 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:46.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61dea0a740 1 -- 172.21.15.135:0/2500097787 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55acbe2537d0 con 0x55acbe511e10 2024-04-20T12:23:46.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61bd7fa640 1 -- 172.21.15.135:0/2500097787 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61d0012ad0 con 0x55acbe511e10 2024-04-20T12:23:46.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61bd7fa640 1 -- 172.21.15.135:0/2500097787 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f61d0003850 con 0x55acbe511e10 2024-04-20T12:23:46.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61dea0a740 10 client.15951 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:46.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61dea0a740 10 client.15951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:46.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61dea0a740 20 client.15951 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:46.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61dea0a740 1 --2- 172.21.15.135:0/2500097787 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55acbe52b5b0 0x55acbe52d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61dea0a740 4 client.15951 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:23:46.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.541+0000 7f61dea0a740 1 -- 172.21.15.135:0/2500097787 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acbe484b30 con 0x55acbe52b5b0 2024-04-20T12:23:46.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.542+0000 7f61d93af640 1 --2- 172.21.15.135:0/2500097787 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55acbe52b5b0 0x55acbe52d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.542+0000 7f61bd7fa640 10 client.15951 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:46.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.542+0000 7f61d93af640 1 --2- 172.21.15.135:0/2500097787 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55acbe52b5b0 0x55acbe52d9a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5ec129243c213e server_cookie=80d1d25e9b4f7a7f in_seq=0 out_seq=0 2024-04-20T12:23:46.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.543+0000 7f61bd7fa640 1 -- 172.21.15.135:0/2500097787 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55acbe484b30 con 0x55acbe52b5b0 2024-04-20T12:23:46.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.543+0000 7f61bd7fa640 10 client.15951 handle_command_reply: tid=0 2024-04-20T12:23:46.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.543+0000 7f61dea0a740 1 client.15951 shutdown 2024-04-20T12:23:46.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.543+0000 7f61dea0a740 1 -- 172.21.15.135:0/2500097787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe511e10 msgr2=0x55acbe518340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.543+0000 7f61dea0a740 1 --2- 172.21.15.135:0/2500097787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe511e10 0x55acbe518340 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f61d000f480 tx=0x7f61d0005890 comp rx=0 tx=0).stop 2024-04-20T12:23:46.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.543+0000 7f61dea0a740 1 -- 172.21.15.135:0/2500097787 shutdown_connections 2024-04-20T12:23:46.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.543+0000 7f61dea0a740 1 --2- 172.21.15.135:0/2500097787 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55acbe52b5b0 0x55acbe52d9a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.543+0000 7f61dea0a740 1 --2- 172.21.15.135:0/2500097787 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe51b310 0x55acbe518dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.543+0000 7f61bd7fa640 0 client.15951 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:46.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.543+0000 7f61dea0a740 1 --2- 172.21.15.135:0/2500097787 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe512730 0x55acbe518880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.543+0000 7f61dea0a740 1 --2- 172.21.15.135:0/2500097787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe511e10 0x55acbe518340 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.543+0000 7f61dea0a740 1 -- 172.21.15.135:0/2500097787 >> 172.21.15.135:0/2500097787 conn(0x55acbe50c540 msgr2=0x55acbe50e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.543+0000 7f61dea0a740 1 -- 172.21.15.135:0/2500097787 shutdown_connections 2024-04-20T12:23:46.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.543+0000 7f61dea0a740 1 -- 172.21.15.135:0/2500097787 wait complete. 2024-04-20T12:23:46.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.543+0000 7f61dea0a740 20 client.15951 trim_cache size 0 max 16384 2024-04-20T12:23:46.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.556+0000 7f61dea0a740 1 Processor -- start 2024-04-20T12:23:46.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.556+0000 7f61dea0a740 1 -- start start 2024-04-20T12:23:46.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.556+0000 7f61dea0a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe511e10 0x55acbe51aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.556+0000 7f61dea0a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe512730 0x55acbe513b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.556+0000 7f61dea0a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe51b310 0x55acbe526f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.556+0000 7f61dea0a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f61d41b15a0 con 0x55acbe51b310 2024-04-20T12:23:46.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.556+0000 7f61dea0a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f61d41b30e0 con 0x55acbe512730 2024-04-20T12:23:46.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.556+0000 7f61dea0a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f61d41b1c70 con 0x55acbe511e10 2024-04-20T12:23:46.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61da3b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe51b310 0x55acbe526f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61da3b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe51b310 0x55acbe526f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39560/0 (socket says 172.21.15.135:39560) 2024-04-20T12:23:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61da3b1640 1 -- 172.21.15.135:0/1140624613 learned_addr learned my addr 172.21.15.135:0/1140624613 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61d93af640 1 --2- 172.21.15.135:0/1140624613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe512730 0x55acbe513b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61d9bb0640 1 --2- 172.21.15.135:0/1140624613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe511e10 0x55acbe51aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61da3b1640 1 -- 172.21.15.135:0/1140624613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe511e10 msgr2=0x55acbe51aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61da3b1640 1 --2- 172.21.15.135:0/1140624613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe511e10 0x55acbe51aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61da3b1640 1 -- 172.21.15.135:0/1140624613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe512730 msgr2=0x55acbe513b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61da3b1640 1 --2- 172.21.15.135:0/1140624613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe512730 0x55acbe513b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61da3b1640 1 -- 172.21.15.135:0/1140624613 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acbe512560 con 0x55acbe51b310 2024-04-20T12:23:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61d9bb0640 1 --2- 172.21.15.135:0/1140624613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe511e10 0x55acbe51aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61d93af640 1 --2- 172.21.15.135:0/1140624613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe512730 0x55acbe513b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61da3b1640 1 --2- 172.21.15.135:0/1140624613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe51b310 0x55acbe526f60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f61cc036000 tx=0x7f61cc044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49f1b2bc0e8773f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61bf7fe640 1 -- 172.21.15.135:0/1140624613 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc039040 con 0x55acbe51b310 2024-04-20T12:23:46.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61bf7fe640 1 -- 172.21.15.135:0/1140624613 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61cc003e50 con 0x55acbe51b310 2024-04-20T12:23:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.557+0000 7f61bf7fe640 1 -- 172.21.15.135:0/1140624613 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc04d6a0 con 0x55acbe51b310 2024-04-20T12:23:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 -- 172.21.15.135:0/1140624613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe51b310 msgr2=0x55acbe526f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 --2- 172.21.15.135:0/1140624613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe51b310 0x55acbe526f60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f61cc036000 tx=0x7f61cc044000 comp rx=0 tx=0).stop 2024-04-20T12:23:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 -- 172.21.15.135:0/1140624613 shutdown_connections 2024-04-20T12:23:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 --2- 172.21.15.135:0/1140624613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe51b310 0x55acbe526f60 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 --2- 172.21.15.135:0/1140624613 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe512730 0x55acbe513b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 --2- 172.21.15.135:0/1140624613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe511e10 0x55acbe51aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 -- 172.21.15.135:0/1140624613 >> 172.21.15.135:0/1140624613 conn(0x55acbe50c540 msgr2=0x55acbe50ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 -- 172.21.15.135:0/1140624613 shutdown_connections 2024-04-20T12:23:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 -- 172.21.15.135:0/1140624613 wait complete. 2024-04-20T12:23:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 -- start start 2024-04-20T12:23:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 Processor -- start 2024-04-20T12:23:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe511e10 0x55acbe51e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe512730 0x55acbe51ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe51b310 0x55acbe5897e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f61d41b2a10 con 0x55acbe512730 2024-04-20T12:23:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.558+0000 7f61dea0a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f61d41b2340 con 0x55acbe51b310 2024-04-20T12:23:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61dea0a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f61d41af570 con 0x55acbe511e10 2024-04-20T12:23:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61dea0a740 10 client.0 _ll_register_callbacks cb 0x7f61c400a560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61d93af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe512730 0x55acbe51ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61d93af640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe512730 0x55acbe51ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39576/0 (socket says 172.21.15.135:39576) 2024-04-20T12:23:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61d93af640 1 -- 172.21.15.135:0/1927992663 learned_addr learned my addr 172.21.15.135:0/1927992663 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61d9bb0640 1 --2- 172.21.15.135:0/1927992663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe511e10 0x55acbe51e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61da3b1640 1 --2- 172.21.15.135:0/1927992663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe51b310 0x55acbe5897e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61d93af640 1 -- 172.21.15.135:0/1927992663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe511e10 msgr2=0x55acbe51e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61d93af640 1 --2- 172.21.15.135:0/1927992663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe511e10 0x55acbe51e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61d93af640 1 -- 172.21.15.135:0/1927992663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe51b310 msgr2=0x55acbe5897e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:46.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61d93af640 1 --2- 172.21.15.135:0/1927992663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe51b310 0x55acbe5897e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61d93af640 1 -- 172.21.15.135:0/1927992663 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acbe589da0 con 0x55acbe512730 2024-04-20T12:23:46.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61d93af640 1 --2- 172.21.15.135:0/1927992663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe512730 0x55acbe51ec60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f61c40ce2f0 tx=0x7f61c40972f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea2beaa629e26ed server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:46.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:46.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61bd7fa640 1 -- 172.21.15.135:0/1927992663 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c409c960 con 0x55acbe512730 2024-04-20T12:23:46.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61bd7fa640 1 -- 172.21.15.135:0/1927992663 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f61c409ac60 con 0x55acbe512730 2024-04-20T12:23:46.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61dea0a740 1 -- 172.21.15.135:0/1927992663 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61cc003e50 con 0x55acbe512730 2024-04-20T12:23:46.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61bd7fa640 1 -- 172.21.15.135:0/1927992663 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f61c40a0d10 con 0x55acbe512730 2024-04-20T12:23:46.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61dea0a740 10 client.15957 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:46.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61dea0a740 1 -- 172.21.15.135:0/1927992663 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55acbe591120 con 0x55acbe512730 2024-04-20T12:23:46.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.559+0000 7f61bd7fa640 1 -- 172.21.15.135:0/1927992663 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c4063080 con 0x55acbe512730 2024-04-20T12:23:46.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.560+0000 7f61bd7fa640 1 -- 172.21.15.135:0/1927992663 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f61c4098fd0 con 0x55acbe512730 2024-04-20T12:23:46.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.560+0000 7f61dea0a740 10 client.15957 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.560+0000 7f61dea0a740 10 client.15957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.560+0000 7f61dea0a740 20 client.15957 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.560+0000 7f61dea0a740 1 --2- 172.21.15.135:0/1927992663 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55acbe591880 0x55acbe593ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.560+0000 7f61dea0a740 4 client.15957 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:23:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.560+0000 7f61dea0a740 1 -- 172.21.15.135:0/1927992663 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55acbe47e9a0 con 0x55acbe591880 2024-04-20T12:23:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.560+0000 7f61d9bb0640 1 --2- 172.21.15.135:0/1927992663 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55acbe591880 0x55acbe593ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.560+0000 7f61d9bb0640 1 --2- 172.21.15.135:0/1927992663 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55acbe591880 0x55acbe593ca0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75166a7bd0f9fc31 server_cookie=b09964c60aeb3592 in_seq=0 out_seq=0 2024-04-20T12:23:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.560+0000 7f61bd7fa640 10 client.15957 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61bd7fa640 1 -- 172.21.15.135:0/1927992663 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55acbe47e9a0 con 0x55acbe591880 2024-04-20T12:23:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61bd7fa640 10 client.15957 handle_command_reply: tid=0 2024-04-20T12:23:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dea0a740 1 client.15957 shutdown 2024-04-20T12:23:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dea0a740 1 -- 172.21.15.135:0/1927992663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe512730 msgr2=0x55acbe51ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dea0a740 1 --2- 172.21.15.135:0/1927992663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe512730 0x55acbe51ec60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f61c40ce2f0 tx=0x7f61c40972f0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dea0a740 1 -- 172.21.15.135:0/1927992663 shutdown_connections 2024-04-20T12:23:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dea0a740 1 --2- 172.21.15.135:0/1927992663 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55acbe591880 0x55acbe593ca0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dea0a740 1 --2- 172.21.15.135:0/1927992663 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55acbe51b310 0x55acbe5897e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61bd7fa640 0 client.15957 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:46.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dea0a740 1 --2- 172.21.15.135:0/1927992663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55acbe512730 0x55acbe51ec60 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dea0a740 1 --2- 172.21.15.135:0/1927992663 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55acbe511e10 0x55acbe51e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dea0a740 1 -- 172.21.15.135:0/1927992663 >> 172.21.15.135:0/1927992663 conn(0x55acbe50c540 msgr2=0x55acbe50b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dea0a740 1 -- 172.21.15.135:0/1927992663 shutdown_connections 2024-04-20T12:23:46.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dea0a740 1 -- 172.21.15.135:0/1927992663 wait complete. 2024-04-20T12:23:46.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dea0a740 20 client.15957 trim_cache size 0 max 16384 2024-04-20T12:23:46.568 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:23:46.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dbe14640 1 -- 172.21.15.135:0/2070778250 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f61c00a3e40 msgr2=0x7f61c00a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dbe14640 1 --2- 172.21.15.135:0/2070778250 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f61c00a3e40 0x7f61c00a6300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f61cc006010 tx=0x7f61cc02cea0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dbe14640 1 -- 172.21.15.135:0/2070778250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4101670 msgr2=0x7f61d41a0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:46.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dbe14640 1 --2- 172.21.15.135:0/2070778250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4101670 0x7f61d41a0bb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f61c400c920 tx=0x7f61c400cde0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dbe14640 1 -- 172.21.15.135:0/2070778250 shutdown_connections 2024-04-20T12:23:46.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dbe14640 1 --2- 172.21.15.135:0/2070778250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f61d410e900 0x7f61d419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dbe14640 1 --2- 172.21.15.135:0/2070778250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61d4101670 0x7f61d41a0bb0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dbe14640 1 --2- 172.21.15.135:0/2070778250 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f61c00a3e40 0x7f61c00a6300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dbe14640 1 --2- 172.21.15.135:0/2070778250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f61d4100d50 0x7f61d41a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:46.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.561+0000 7f61dbe14640 1 -- 172.21.15.135:0/2070778250 >> 172.21.15.135:0/2070778250 conn(0x7f61d4078010 msgr2=0x7f61d410fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:46.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.562+0000 7f61dbe14640 1 -- 172.21.15.135:0/2070778250 shutdown_connections 2024-04-20T12:23:46.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:46.562+0000 7f61dbe14640 1 -- 172.21.15.135:0/2070778250 wait complete. 2024-04-20T12:23:46.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:46 smithi139 ceph-mon[21834]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 KiB/s wr, 16 op/s 2024-04-20T12:23:46.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:46 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2256579793' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:23:47.573 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:23:47.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:23:47.573 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:23:47.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.688+0000 7fb410550640 1 -- 172.21.15.135:0/3625690879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb408074b50 msgr2=0x7fb40810e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.688+0000 7fb410550640 1 --2- 172.21.15.135:0/3625690879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb408074b50 0x7fb40810e300 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009900 tx=0x7fb3f802bcd0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.688+0000 7fb410550640 1 -- 172.21.15.135:0/3625690879 shutdown_connections 2024-04-20T12:23:47.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.688+0000 7fb410550640 1 --2- 172.21.15.135:0/3625690879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb40810e840 0x7fb408110c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.688+0000 7fb410550640 1 --2- 172.21.15.135:0/3625690879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb408074b50 0x7fb40810e300 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.688+0000 7fb410550640 1 --2- 172.21.15.135:0/3625690879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb408074230 0x7fb408074610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.688+0000 7fb410550640 1 -- 172.21.15.135:0/3625690879 >> 172.21.15.135:0/3625690879 conn(0x7fb4080793b0 msgr2=0x7fb4080797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:47.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.688+0000 7fb410550640 1 -- 172.21.15.135:0/3625690879 shutdown_connections 2024-04-20T12:23:47.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.688+0000 7fb410550640 1 -- 172.21.15.135:0/3625690879 wait complete. 2024-04-20T12:23:47.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.689+0000 7fb410550640 1 Processor -- start 2024-04-20T12:23:47.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.689+0000 7fb410550640 1 -- start start 2024-04-20T12:23:47.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.689+0000 7fb410550640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb408074230 0x7fb4081a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.689+0000 7fb410550640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb408074b50 0x7fb4081a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.689+0000 7fb410550640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40810e840 0x7fb40819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.689+0000 7fb410550640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb408114550 con 0x7fb408074230 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.689+0000 7fb410550640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb4081143d0 con 0x7fb408074b50 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.689+0000 7fb410550640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb4081146d0 con 0x7fb40810e840 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.689+0000 7fb40e2ec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb408074230 0x7fb4081a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.689+0000 7fb40e2ec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb408074230 0x7fb4081a0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39594/0 (socket says 172.21.15.135:39594) 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.689+0000 7fb40e2ec640 1 -- 172.21.15.135:0/3686591788 learned_addr learned my addr 172.21.15.135:0/3686591788 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.689+0000 7fb40daeb640 1 --2- 172.21.15.135:0/3686591788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb408074b50 0x7fb4081a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.690+0000 7fb40eaed640 1 --2- 172.21.15.135:0/3686591788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40810e840 0x7fb40819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.690+0000 7fb40e2ec640 1 -- 172.21.15.135:0/3686591788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40810e840 msgr2=0x7fb40819a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.690+0000 7fb40e2ec640 1 --2- 172.21.15.135:0/3686591788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40810e840 0x7fb40819a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.690+0000 7fb40e2ec640 1 -- 172.21.15.135:0/3686591788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb408074b50 msgr2=0x7fb4081a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.690+0000 7fb40e2ec640 1 --2- 172.21.15.135:0/3686591788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb408074b50 0x7fb4081a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.690+0000 7fb40e2ec640 1 -- 172.21.15.135:0/3686591788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40819b0d0 con 0x7fb408074230 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.690+0000 7fb40eaed640 1 --2- 172.21.15.135:0/3686591788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40810e840 0x7fb40819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.690+0000 7fb40e2ec640 1 --2- 172.21.15.135:0/3686591788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb408074230 0x7fb4081a0750 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb40400d770 tx=0x7fb40400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:47.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.690+0000 7fb3ff7fe640 1 -- 172.21.15.135:0/3686591788 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404017070 con 0x7fb408074230 2024-04-20T12:23:47.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.690+0000 7fb3ff7fe640 1 -- 172.21.15.135:0/3686591788 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb404005500 con 0x7fb408074230 2024-04-20T12:23:47.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.690+0000 7fb410550640 1 -- 172.21.15.135:0/3686591788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40819b3c0 con 0x7fb408074230 2024-04-20T12:23:47.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.690+0000 7fb3ff7fe640 1 -- 172.21.15.135:0/3686591788 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404004e00 con 0x7fb408074230 2024-04-20T12:23:47.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.690+0000 7fb410550640 1 -- 172.21.15.135:0/3686591788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4081a7610 con 0x7fb408074230 2024-04-20T12:23:47.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.692+0000 7fb3ff7fe640 1 -- 172.21.15.135:0/3686591788 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7fb404004fa0 con 0x7fb408074230 2024-04-20T12:23:47.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.693+0000 7fb41321b740 1 Processor -- start 2024-04-20T12:23:47.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.693+0000 7fb41321b740 1 -- start start 2024-04-20T12:23:47.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.693+0000 7fb41321b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc85fe0 0x55edefc863c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.693+0000 7fb41321b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc86900 0x55edefc8efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb41321b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc8f4e0 0x55edefc918d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb41321b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55edefbeaf00 con 0x55edefc85fe0 2024-04-20T12:23:47.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb41321b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55edefb88530 con 0x55edefc8f4e0 2024-04-20T12:23:47.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb41321b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55edefbe6ec0 con 0x55edefc86900 2024-04-20T12:23:47.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb3ff7fe640 1 --2- 172.21.15.135:0/3686591788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb3f40a3e40 0x7fb3f40a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb40eaed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc85fe0 0x55edefc863c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb40daeb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc8f4e0 0x55edefc918d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb40eaed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc85fe0 0x55edefc863c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39604/0 (socket says 172.21.15.135:39604) 2024-04-20T12:23:47.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb40eaed640 1 -- 172.21.15.135:0/3013234880 learned_addr learned my addr 172.21.15.135:0/3013234880 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:47.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb40eaed640 1 --2- 172.21.15.135:0/3686591788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb3f40a3e40 0x7fb3f40a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb3ff7fe640 1 -- 172.21.15.135:0/3686591788 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fb4040d08e0 con 0x7fb408074230 2024-04-20T12:23:47.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb40e2ec640 1 --2- 172.21.15.135:0/3013234880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc86900 0x55edefc8efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb40daeb640 1 -- 172.21.15.135:0/3013234880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc86900 msgr2=0x55edefc8efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb40daeb640 1 --2- 172.21.15.135:0/3013234880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc86900 0x55edefc8efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb40daeb640 1 -- 172.21.15.135:0/3013234880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc85fe0 msgr2=0x55edefc863c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb40daeb640 1 --2- 172.21.15.135:0/3013234880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc85fe0 0x55edefc863c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb40daeb640 1 -- 172.21.15.135:0/3013234880 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edef9c57e0 con 0x55edefc8f4e0 2024-04-20T12:23:47.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb40e2ec640 1 --2- 172.21.15.135:0/3013234880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc86900 0x55edefc8efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:47.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb40eaed640 1 --2- 172.21.15.135:0/3686591788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb3f40a3e40 0x7fb3f40a6300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb400013ba0 tx=0x7fb400009240 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:47.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb40daeb640 1 --2- 172.21.15.135:0/3013234880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc8f4e0 0x55edefc918d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8000c00 tx=0x7fb3f8005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8a5390b2bf6ce8a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:47.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.694+0000 7fb3fcbfe640 1 -- 172.21.15.135:0/3013234880 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8042070 con 0x55edefc8f4e0 2024-04-20T12:23:47.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.695+0000 7fb3fcbfe640 1 -- 172.21.15.135:0/3013234880 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3f802cb20 con 0x55edefc8f4e0 2024-04-20T12:23:47.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.695+0000 7fb3fcbfe640 1 -- 172.21.15.135:0/3013234880 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8004f10 con 0x55edefc8f4e0 2024-04-20T12:23:47.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.695+0000 7fb41321b740 1 -- 172.21.15.135:0/3013234880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc8f4e0 msgr2=0x55edefc918d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.695+0000 7fb41321b740 1 --2- 172.21.15.135:0/3013234880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc8f4e0 0x55edefc918d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8000c00 tx=0x7fb3f8005d50 comp rx=0 tx=0).stop 2024-04-20T12:23:47.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.695+0000 7fb41321b740 1 -- 172.21.15.135:0/3013234880 shutdown_connections 2024-04-20T12:23:47.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.695+0000 7fb41321b740 1 --2- 172.21.15.135:0/3013234880 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc8f4e0 0x55edefc918d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.695+0000 7fb41321b740 1 --2- 172.21.15.135:0/3013234880 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc86900 0x55edefc8efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.695+0000 7fb41321b740 1 --2- 172.21.15.135:0/3013234880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc85fe0 0x55edefc863c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.695+0000 7fb41321b740 1 -- 172.21.15.135:0/3013234880 >> 172.21.15.135:0/3013234880 conn(0x55edefc80710 msgr2=0x55edefc80af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:47.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.695+0000 7fb41321b740 1 -- 172.21.15.135:0/3013234880 shutdown_connections 2024-04-20T12:23:47.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.695+0000 7fb41321b740 1 -- 172.21.15.135:0/3013234880 wait complete. 2024-04-20T12:23:47.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb41321b740 1 -- start start 2024-04-20T12:23:47.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb41321b740 1 Processor -- start 2024-04-20T12:23:47.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb41321b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc85fe0 0x55edefc8ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb41321b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc86900 0x55edefc8c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb41321b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc8f4e0 0x55edefc8c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb41321b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55edefc92270 con 0x55edefc8f4e0 2024-04-20T12:23:47.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb41321b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55edefb73480 con 0x55edefc85fe0 2024-04-20T12:23:47.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb41321b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55edefc923f0 con 0x55edefc86900 2024-04-20T12:23:47.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb41321b740 10 client.0 _ll_register_callbacks cb 0x55edefb72e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:47.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb40eaed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc8f4e0 0x55edefc8c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb40eaed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc8f4e0 0x55edefc8c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39608/0 (socket says 172.21.15.135:39608) 2024-04-20T12:23:47.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb40eaed640 1 -- 172.21.15.135:0/2281647753 learned_addr learned my addr 172.21.15.135:0/2281647753 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:47.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb40e2ec640 1 --2- 172.21.15.135:0/2281647753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc85fe0 0x55edefc8ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb40daeb640 1 --2- 172.21.15.135:0/2281647753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc86900 0x55edefc8c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb40eaed640 1 -- 172.21.15.135:0/2281647753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc86900 msgr2=0x55edefc8c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb40eaed640 1 --2- 172.21.15.135:0/2281647753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc86900 0x55edefc8c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb40eaed640 1 -- 172.21.15.135:0/2281647753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc85fe0 msgr2=0x55edefc8ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb40eaed640 1 --2- 172.21.15.135:0/2281647753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc85fe0 0x55edefc8ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.696+0000 7fb40eaed640 1 -- 172.21.15.135:0/2281647753 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edefa25f70 con 0x55edefc8f4e0 2024-04-20T12:23:47.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb40eaed640 1 --2- 172.21.15.135:0/2281647753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc8f4e0 0x55edefc8c770 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb4000095d0 tx=0x7fb400004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d433bb224fba29a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:47.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb3f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:47.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb3f1ffb640 1 -- 172.21.15.135:0/2281647753 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400025070 con 0x55edefc8f4e0 2024-04-20T12:23:47.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb3f1ffb640 1 -- 172.21.15.135:0/2281647753 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fb400004510 con 0x55edefc8f4e0 2024-04-20T12:23:47.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb41321b740 1 -- 172.21.15.135:0/2281647753 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3f802cb20 con 0x55edefc8f4e0 2024-04-20T12:23:47.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb3f1ffb640 1 -- 172.21.15.135:0/2281647753 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb400031050 con 0x55edefc8f4e0 2024-04-20T12:23:47.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb41321b740 10 client.15969 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:47.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb41321b740 1 -- 172.21.15.135:0/2281647753 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55edef8bd170 con 0x55edefc8f4e0 2024-04-20T12:23:47.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb3f1ffb640 1 -- 172.21.15.135:0/2281647753 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3f802cb20 con 0x55edefc8f4e0 2024-04-20T12:23:47.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb3f1ffb640 1 -- 172.21.15.135:0/2281647753 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fb40000f040 con 0x55edefc8f4e0 2024-04-20T12:23:47.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb41321b740 10 client.15969 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:47.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb41321b740 10 client.15969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:47.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb41321b740 20 client.15969 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:47.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb41321b740 1 --2- 172.21.15.135:0/2281647753 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55edefc9f490 0x55edefca1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb41321b740 4 client.15969 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:23:47.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.697+0000 7fb41321b740 1 -- 172.21.15.135:0/2281647753 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edefbf8920 con 0x55edefc9f490 2024-04-20T12:23:47.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.698+0000 7fb40e2ec640 1 --2- 172.21.15.135:0/2281647753 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55edefc9f490 0x55edefca1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.698+0000 7fb3f1ffb640 10 client.15969 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:47.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.698+0000 7fb40e2ec640 1 --2- 172.21.15.135:0/2281647753 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55edefc9f490 0x55edefca1900 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58e1a55aa8d8bf13 server_cookie=25b1aa064f5ce1b2 in_seq=0 out_seq=0 2024-04-20T12:23:47.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.699+0000 7fb3f1ffb640 1 -- 172.21.15.135:0/2281647753 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55edefbf8920 con 0x55edefc9f490 2024-04-20T12:23:47.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.699+0000 7fb3f1ffb640 10 client.15969 handle_command_reply: tid=0 2024-04-20T12:23:47.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.699+0000 7fb41321b740 1 client.15969 shutdown 2024-04-20T12:23:47.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.699+0000 7fb41321b740 1 -- 172.21.15.135:0/2281647753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc8f4e0 msgr2=0x55edefc8c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.699+0000 7fb41321b740 1 --2- 172.21.15.135:0/2281647753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc8f4e0 0x55edefc8c770 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb4000095d0 tx=0x7fb400004a40 comp rx=0 tx=0).stop 2024-04-20T12:23:47.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.699+0000 7fb41321b740 1 -- 172.21.15.135:0/2281647753 shutdown_connections 2024-04-20T12:23:47.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.699+0000 7fb41321b740 1 --2- 172.21.15.135:0/2281647753 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55edefc9f490 0x55edefca1900 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.699+0000 7fb41321b740 1 --2- 172.21.15.135:0/2281647753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc8f4e0 0x55edefc8c770 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.699+0000 7fb3f1ffb640 0 client.15969 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:47.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.699+0000 7fb41321b740 1 --2- 172.21.15.135:0/2281647753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc86900 0x55edefc8c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.699+0000 7fb41321b740 1 --2- 172.21.15.135:0/2281647753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc85fe0 0x55edefc8ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.699+0000 7fb41321b740 1 -- 172.21.15.135:0/2281647753 >> 172.21.15.135:0/2281647753 conn(0x55edefc80710 msgr2=0x55edefc82460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:47.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.699+0000 7fb41321b740 1 -- 172.21.15.135:0/2281647753 shutdown_connections 2024-04-20T12:23:47.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.699+0000 7fb41321b740 1 -- 172.21.15.135:0/2281647753 wait complete. 2024-04-20T12:23:47.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.699+0000 7fb41321b740 20 client.15969 trim_cache size 0 max 16384 2024-04-20T12:23:47.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb41321b740 1 Processor -- start 2024-04-20T12:23:47.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb41321b740 1 -- start start 2024-04-20T12:23:47.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb41321b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc85fe0 0x55edefc80af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb41321b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc86900 0x55edefc8aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb41321b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc8f4e0 0x55edefc8e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb41321b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4081b15d0 con 0x55edefc86900 2024-04-20T12:23:47.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb41321b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb4081b3110 con 0x55edefc85fe0 2024-04-20T12:23:47.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb41321b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb4081b1ca0 con 0x55edefc8f4e0 2024-04-20T12:23:47.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb40daeb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc86900 0x55edefc8aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb40daeb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc86900 0x55edefc8aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39624/0 (socket says 172.21.15.135:39624) 2024-04-20T12:23:47.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb40daeb640 1 -- 172.21.15.135:0/2163604078 learned_addr learned my addr 172.21.15.135:0/2163604078 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:47.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb40daeb640 1 -- 172.21.15.135:0/2163604078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc8f4e0 msgr2=0x55edefc8e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb40daeb640 1 --2- 172.21.15.135:0/2163604078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc8f4e0 0x55edefc8e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb40daeb640 1 -- 172.21.15.135:0/2163604078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc85fe0 msgr2=0x55edefc80af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb40e2ec640 1 --2- 172.21.15.135:0/2163604078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc85fe0 0x55edefc80af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb40daeb640 1 --2- 172.21.15.135:0/2163604078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc85fe0 0x55edefc80af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb40daeb640 1 -- 172.21.15.135:0/2163604078 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edefc812e0 con 0x55edefc86900 2024-04-20T12:23:47.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb40daeb640 1 --2- 172.21.15.135:0/2163604078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc86900 0x55edefc8aac0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8005ab0 tx=0x7fb3f802c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4327a1fbb159d0ae server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:47.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb3f3fff640 1 -- 172.21.15.135:0/2163604078 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8042040 con 0x55edefc86900 2024-04-20T12:23:47.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb3f3fff640 1 -- 172.21.15.135:0/2163604078 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3f804b020 con 0x55edefc86900 2024-04-20T12:23:47.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.717+0000 7fb3f3fff640 1 -- 172.21.15.135:0/2163604078 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8005200 con 0x55edefc86900 2024-04-20T12:23:47.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.718+0000 7fb41321b740 1 -- 172.21.15.135:0/2163604078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc86900 msgr2=0x55edefc8aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.718+0000 7fb41321b740 1 --2- 172.21.15.135:0/2163604078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc86900 0x55edefc8aac0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8005ab0 tx=0x7fb3f802c880 comp rx=0 tx=0).stop 2024-04-20T12:23:47.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.718+0000 7fb41321b740 1 -- 172.21.15.135:0/2163604078 shutdown_connections 2024-04-20T12:23:47.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.718+0000 7fb41321b740 1 --2- 172.21.15.135:0/2163604078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc8f4e0 0x55edefc8e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.718+0000 7fb41321b740 1 --2- 172.21.15.135:0/2163604078 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc86900 0x55edefc8aac0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.718+0000 7fb41321b740 1 --2- 172.21.15.135:0/2163604078 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc85fe0 0x55edefc80af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.718+0000 7fb41321b740 1 -- 172.21.15.135:0/2163604078 >> 172.21.15.135:0/2163604078 conn(0x55edefc80710 msgr2=0x55edefc86e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:47.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.718+0000 7fb41321b740 1 -- 172.21.15.135:0/2163604078 shutdown_connections 2024-04-20T12:23:47.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.718+0000 7fb41321b740 1 -- 172.21.15.135:0/2163604078 wait complete. 2024-04-20T12:23:47.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.718+0000 7fb41321b740 1 -- start start 2024-04-20T12:23:47.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.718+0000 7fb41321b740 1 Processor -- start 2024-04-20T12:23:47.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb41321b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc85fe0 0x55edefc97640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb41321b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc86900 0x55edefc97b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb41321b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc8f4e0 0x55edefc94700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb41321b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4081b2a40 con 0x55edefc86900 2024-04-20T12:23:47.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb41321b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb4081b2370 con 0x55edefc85fe0 2024-04-20T12:23:47.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb41321b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb4081af5a0 con 0x55edefc8f4e0 2024-04-20T12:23:47.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb41321b740 10 client.0 _ll_register_callbacks cb 0x7fb400013760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:47.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb40daeb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc86900 0x55edefc97b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb40daeb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc86900 0x55edefc97b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39634/0 (socket says 172.21.15.135:39634) 2024-04-20T12:23:47.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb40daeb640 1 -- 172.21.15.135:0/366018291 learned_addr learned my addr 172.21.15.135:0/366018291 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:47.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb40e2ec640 1 --2- 172.21.15.135:0/366018291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc85fe0 0x55edefc97640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb40daeb640 1 -- 172.21.15.135:0/366018291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc8f4e0 msgr2=0x55edefc94700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb40daeb640 1 --2- 172.21.15.135:0/366018291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc8f4e0 0x55edefc94700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb40daeb640 1 -- 172.21.15.135:0/366018291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc85fe0 msgr2=0x55edefc97640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb40daeb640 1 --2- 172.21.15.135:0/366018291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc85fe0 0x55edefc97640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb40daeb640 1 -- 172.21.15.135:0/366018291 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edefc94f00 con 0x55edefc86900 2024-04-20T12:23:47.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb40daeb640 1 --2- 172.21.15.135:0/366018291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc86900 0x55edefc97b80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb3f80096c0 tx=0x7fb3f8004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacbd0b7eabbddb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:47.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb3f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:47.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb3f1ffb640 1 -- 172.21.15.135:0/366018291 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8042030 con 0x55edefc86900 2024-04-20T12:23:47.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb41321b740 1 -- 172.21.15.135:0/366018291 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3f804b020 con 0x55edefc86900 2024-04-20T12:23:47.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb3f1ffb640 1 -- 172.21.15.135:0/366018291 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fb3f8004f10 con 0x55edefc86900 2024-04-20T12:23:47.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb3f1ffb640 1 -- 172.21.15.135:0/366018291 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb3f805f050 con 0x55edefc86900 2024-04-20T12:23:47.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb41321b740 10 client.15975 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:47.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.719+0000 7fb41321b740 1 -- 172.21.15.135:0/366018291 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55edefd06670 con 0x55edefc86900 2024-04-20T12:23:47.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.720+0000 7fb3f1ffb640 1 -- 172.21.15.135:0/366018291 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3f804b020 con 0x55edefc86900 2024-04-20T12:23:47.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.720+0000 7fb3f1ffb640 1 -- 172.21.15.135:0/366018291 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fb3f8047a00 con 0x55edefc86900 2024-04-20T12:23:47.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.720+0000 7fb41321b740 10 client.15975 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:47.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.720+0000 7fb41321b740 10 client.15975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:47.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.720+0000 7fb41321b740 20 client.15975 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:47.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.720+0000 7fb41321b740 1 --2- 172.21.15.135:0/366018291 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55edefd06970 0x55edefd08d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.720+0000 7fb41321b740 4 client.15975 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:23:47.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.720+0000 7fb41321b740 1 -- 172.21.15.135:0/366018291 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55edefbf2790 con 0x55edefd06970 2024-04-20T12:23:47.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.720+0000 7fb40e2ec640 1 --2- 172.21.15.135:0/366018291 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55edefd06970 0x55edefd08d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.720+0000 7fb3f1ffb640 10 client.15975 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:47.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.720+0000 7fb40e2ec640 1 --2- 172.21.15.135:0/366018291 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55edefd06970 0x55edefd08d90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b036e76f0872d89 server_cookie=59522a595d6d6c97 in_seq=0 out_seq=0 2024-04-20T12:23:47.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb3f1ffb640 1 -- 172.21.15.135:0/366018291 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55edefbf2790 con 0x55edefd06970 2024-04-20T12:23:47.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb3f1ffb640 10 client.15975 handle_command_reply: tid=0 2024-04-20T12:23:47.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb41321b740 1 client.15975 shutdown 2024-04-20T12:23:47.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb41321b740 1 -- 172.21.15.135:0/366018291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc86900 msgr2=0x55edefc97b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb41321b740 1 --2- 172.21.15.135:0/366018291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc86900 0x55edefc97b80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb3f80096c0 tx=0x7fb3f8004970 comp rx=0 tx=0).stop 2024-04-20T12:23:47.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb41321b740 1 -- 172.21.15.135:0/366018291 shutdown_connections 2024-04-20T12:23:47.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb41321b740 1 --2- 172.21.15.135:0/366018291 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55edefd06970 0x55edefd08d90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb41321b740 1 --2- 172.21.15.135:0/366018291 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55edefc8f4e0 0x55edefc94700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb3f1ffb640 0 client.15975 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:47.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb41321b740 1 --2- 172.21.15.135:0/366018291 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55edefc86900 0x55edefc97b80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb41321b740 1 --2- 172.21.15.135:0/366018291 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55edefc85fe0 0x55edefc97640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb41321b740 1 -- 172.21.15.135:0/366018291 >> 172.21.15.135:0/366018291 conn(0x55edefc80710 msgr2=0x55edefc876b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:47.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb41321b740 1 -- 172.21.15.135:0/366018291 shutdown_connections 2024-04-20T12:23:47.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb41321b740 1 -- 172.21.15.135:0/366018291 wait complete. 2024-04-20T12:23:47.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb41321b740 20 client.15975 trim_cache size 0 max 16384 2024-04-20T12:23:47.728 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:23:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:23:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "ea0518e1-4006-4c2f-9c5a-912a093a1d8f", 2024-04-20T12:23:47.728 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:23:47.728 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:23:47.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb410550640 1 -- 172.21.15.135:0/3686591788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb3f40a3e40 msgr2=0x7fb3f40a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb410550640 1 --2- 172.21.15.135:0/3686591788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb3f40a3e40 0x7fb3f40a6300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb400013ba0 tx=0x7fb400009240 comp rx=0 tx=0).stop 2024-04-20T12:23:47.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb410550640 1 -- 172.21.15.135:0/3686591788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb408074230 msgr2=0x7fb4081a0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb410550640 1 --2- 172.21.15.135:0/3686591788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb408074230 0x7fb4081a0750 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb40400d770 tx=0x7fb40400dc30 comp rx=0 tx=0).stop 2024-04-20T12:23:47.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb410550640 1 -- 172.21.15.135:0/3686591788 shutdown_connections 2024-04-20T12:23:47.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb410550640 1 --2- 172.21.15.135:0/3686591788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb3f40a3e40 0x7fb3f40a6300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb410550640 1 --2- 172.21.15.135:0/3686591788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb40810e840 0x7fb40819a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb410550640 1 --2- 172.21.15.135:0/3686591788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb408074b50 0x7fb4081a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb410550640 1 --2- 172.21.15.135:0/3686591788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb408074230 0x7fb4081a0750 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.722+0000 7fb410550640 1 -- 172.21.15.135:0/3686591788 >> 172.21.15.135:0/3686591788 conn(0x7fb4080793b0 msgr2=0x7fb4080fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:47.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.723+0000 7fb410550640 1 -- 172.21.15.135:0/3686591788 shutdown_connections 2024-04-20T12:23:47.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.723+0000 7fb410550640 1 -- 172.21.15.135:0/3686591788 wait complete. 2024-04-20T12:23:47.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:23:47.733 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:23:47.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.834+0000 7feec3967640 1 -- 172.21.15.135:0/130126840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feebc106170 msgr2=0x7feebc10dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.834+0000 7feec3967640 1 --2- 172.21.15.135:0/130126840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feebc106170 0x7feebc10dd40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009ca0 tx=0x7feeb402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.834+0000 7feec3967640 1 -- 172.21.15.135:0/130126840 shutdown_connections 2024-04-20T12:23:47.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.834+0000 7feec3967640 1 --2- 172.21.15.135:0/130126840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feebc106170 0x7feebc10dd40 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.834+0000 7feec3967640 1 --2- 172.21.15.135:0/130126840 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feebc101a50 0x7feebc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.834+0000 7feec3967640 1 --2- 172.21.15.135:0/130126840 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feebc1010a0 0x7feebc101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.834+0000 7feec3967640 1 -- 172.21.15.135:0/130126840 >> 172.21.15.135:0/130126840 conn(0x7feebc077f60 msgr2=0x7feebc078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:47.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.834+0000 7feec3967640 1 -- 172.21.15.135:0/130126840 shutdown_connections 2024-04-20T12:23:47.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.834+0000 7feec3967640 1 -- 172.21.15.135:0/130126840 wait complete. 2024-04-20T12:23:47.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.834+0000 7feec3967640 1 Processor -- start 2024-04-20T12:23:47.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.834+0000 7feec3967640 1 -- start start 2024-04-20T12:23:47.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec3967640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feebc1010a0 0x7feebc197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec3967640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feebc106170 0x7feebc197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec3967640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feebc19bf80 0x7feebc19c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec3967640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feebc111230 con 0x7feebc1010a0 2024-04-20T12:23:47.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec3967640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1110b0 con 0x7feebc19bf80 2024-04-20T12:23:47.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec3967640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1113b0 con 0x7feebc106170 2024-04-20T12:23:47.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec1703640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feebc1010a0 0x7feebc197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec1703640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feebc1010a0 0x7feebc197710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39666/0 (socket says 172.21.15.135:39666) 2024-04-20T12:23:47.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec1703640 1 -- 172.21.15.135:0/2809699565 learned_addr learned my addr 172.21.15.135:0/2809699565 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:47.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec1f04640 1 --2- 172.21.15.135:0/2809699565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feebc19bf80 0x7feebc19c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec1703640 1 -- 172.21.15.135:0/2809699565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feebc106170 msgr2=0x7feebc197c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec1703640 1 --2- 172.21.15.135:0/2809699565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feebc106170 0x7feebc197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec1703640 1 -- 172.21.15.135:0/2809699565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feebc19bf80 msgr2=0x7feebc19c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec1703640 1 --2- 172.21.15.135:0/2809699565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feebc19bf80 0x7feebc19c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec1703640 1 -- 172.21.15.135:0/2809699565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feebc19ca70 con 0x7feebc1010a0 2024-04-20T12:23:47.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec1f04640 1 --2- 172.21.15.135:0/2809699565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feebc19bf80 0x7feebc19c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:47.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec1703640 1 --2- 172.21.15.135:0/2809699565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feebc1010a0 0x7feebc197710 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7feeac00d770 tx=0x7feeac00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:47.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feeb27fc640 1 -- 172.21.15.135:0/2809699565 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac017070 con 0x7feebc1010a0 2024-04-20T12:23:47.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec3967640 1 -- 172.21.15.135:0/2809699565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feebc19cd60 con 0x7feebc1010a0 2024-04-20T12:23:47.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feeb27fc640 1 -- 172.21.15.135:0/2809699565 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feeac005500 con 0x7feebc1010a0 2024-04-20T12:23:47.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feeb27fc640 1 -- 172.21.15.135:0/2809699565 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac004e00 con 0x7feebc1010a0 2024-04-20T12:23:47.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.835+0000 7feec3967640 1 -- 172.21.15.135:0/2809699565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feebc1a4500 con 0x7feebc1010a0 2024-04-20T12:23:47.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.838+0000 7feeb27fc640 1 -- 172.21.15.135:0/2809699565 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7feeac004fa0 con 0x7feebc1010a0 2024-04-20T12:23:47.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.838+0000 7feec6639740 1 Processor -- start 2024-04-20T12:23:47.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.838+0000 7feec6639740 1 -- start start 2024-04-20T12:23:47.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec6639740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e05f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec6639740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05f4330 0x5564e05feef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec6639740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05ff430 0x5564e0601820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feeb27fc640 1 --2- 172.21.15.135:0/2809699565 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feea80a3e40 0x7feea80a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec6639740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5564e05591b0 con 0x5564e05f3a10 2024-04-20T12:23:47.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec6639740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5564e04f6390 con 0x5564e05ff430 2024-04-20T12:23:47.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec6639740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5564e0555170 con 0x5564e05f4330 2024-04-20T12:23:47.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec1f04640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e05f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec1f04640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e05f3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39680/0 (socket says 172.21.15.135:39680) 2024-04-20T12:23:47.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec1f04640 1 -- 172.21.15.135:0/2638314290 learned_addr learned my addr 172.21.15.135:0/2638314290 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:47.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec1f04640 1 --2- 172.21.15.135:0/2809699565 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feea80a3e40 0x7feea80a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec0f02640 1 --2- 172.21.15.135:0/2638314290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05ff430 0x5564e0601820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feeb27fc640 1 -- 172.21.15.135:0/2809699565 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7feeac0d0960 con 0x7feebc1010a0 2024-04-20T12:23:47.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec1703640 1 --2- 172.21.15.135:0/2638314290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05f4330 0x5564e05feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec1f04640 1 -- 172.21.15.135:0/2638314290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05f4330 msgr2=0x5564e05feef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec1f04640 1 --2- 172.21.15.135:0/2638314290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05f4330 0x5564e05feef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec1f04640 1 -- 172.21.15.135:0/2638314290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05ff430 msgr2=0x5564e0601820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec1f04640 1 --2- 172.21.15.135:0/2638314290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05ff430 0x5564e0601820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.846 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec1f04640 1 -- 172.21.15.135:0/2638314290 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564e03357d0 con 0x5564e05f3a10 2024-04-20T12:23:47.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec0f02640 1 --2- 172.21.15.135:0/2638314290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05ff430 0x5564e0601820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:47.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec1f04640 1 --2- 172.21.15.135:0/2638314290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e05f3df0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7feeb4005fe0 tx=0x7feeb4032fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f26037754e8a75 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:47.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feec1f04640 1 --2- 172.21.15.135:0/2809699565 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feea80a3e40 0x7feea80a6300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009430 tx=0x7feeb4041000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:47.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feea77fe640 1 -- 172.21.15.135:0/2638314290 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4051070 con 0x5564e05f3a10 2024-04-20T12:23:47.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feea77fe640 1 -- 172.21.15.135:0/2638314290 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feeb4048070 con 0x5564e05f3a10 2024-04-20T12:23:47.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.839+0000 7feea77fe640 1 -- 172.21.15.135:0/2638314290 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4039040 con 0x5564e05f3a10 2024-04-20T12:23:47.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.840+0000 7feec6639740 1 -- 172.21.15.135:0/2638314290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 msgr2=0x5564e05f3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.840+0000 7feec6639740 1 --2- 172.21.15.135:0/2638314290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e05f3df0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7feeb4005fe0 tx=0x7feeb4032fa0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.840+0000 7feec6639740 1 -- 172.21.15.135:0/2638314290 shutdown_connections 2024-04-20T12:23:47.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.840+0000 7feec6639740 1 --2- 172.21.15.135:0/2638314290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05ff430 0x5564e0601820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.840+0000 7feec6639740 1 --2- 172.21.15.135:0/2638314290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05f4330 0x5564e05feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.840+0000 7feec6639740 1 --2- 172.21.15.135:0/2638314290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e05f3df0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.840+0000 7feec6639740 1 -- 172.21.15.135:0/2638314290 >> 172.21.15.135:0/2638314290 conn(0x5564e05ee450 msgr2=0x5564e05ee830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:47.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.840+0000 7feec6639740 1 -- 172.21.15.135:0/2638314290 shutdown_connections 2024-04-20T12:23:47.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.840+0000 7feec6639740 1 -- 172.21.15.135:0/2638314290 wait complete. 2024-04-20T12:23:47.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.840+0000 7feec6639740 1 -- start start 2024-04-20T12:23:47.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec6639740 1 Processor -- start 2024-04-20T12:23:47.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec6639740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e05fc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec6639740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05f4330 0x5564e05fc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec6639740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05ff430 0x5564e05fced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec6639740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5564e06021c0 con 0x5564e05f3a10 2024-04-20T12:23:47.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec6639740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5564e05122f0 con 0x5564e05f4330 2024-04-20T12:23:47.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec6639740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5564e0602340 con 0x5564e05ff430 2024-04-20T12:23:47.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec6639740 10 client.0 _ll_register_callbacks cb 0x5564e04dc4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:47.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec1703640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e05fc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec1703640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e05fc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39690/0 (socket says 172.21.15.135:39690) 2024-04-20T12:23:47.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec1703640 1 -- 172.21.15.135:0/1221350881 learned_addr learned my addr 172.21.15.135:0/1221350881 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:47.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec0f02640 1 --2- 172.21.15.135:0/1221350881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05f4330 0x5564e05fc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec1f04640 1 --2- 172.21.15.135:0/1221350881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05ff430 0x5564e05fced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec1703640 1 -- 172.21.15.135:0/1221350881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05ff430 msgr2=0x5564e05fced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec1703640 1 --2- 172.21.15.135:0/1221350881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05ff430 0x5564e05fced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec1703640 1 -- 172.21.15.135:0/1221350881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05f4330 msgr2=0x5564e05fc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec1703640 1 --2- 172.21.15.135:0/1221350881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05f4330 0x5564e05fc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec1703640 1 -- 172.21.15.135:0/1221350881 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564e026b3f0 con 0x5564e05f3a10 2024-04-20T12:23:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.841+0000 7feec1f04640 1 --2- 172.21.15.135:0/1221350881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05ff430 0x5564e05fced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feec1703640 1 --2- 172.21.15.135:0/1221350881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e05fc450 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7feeac0ce330 tx=0x7feeac0a1870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeeb29ae6651188e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feea4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feea4ff9640 1 -- 172.21.15.135:0/1221350881 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac0b5060 con 0x5564e05f3a10 2024-04-20T12:23:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feea4ff9640 1 -- 172.21.15.135:0/1221350881 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7feeac0989a0 con 0x5564e05f3a10 2024-04-20T12:23:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feec6639740 1 -- 172.21.15.135:0/1221350881 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feeb4048070 con 0x5564e05f3a10 2024-04-20T12:23:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feea4ff9640 1 -- 172.21.15.135:0/1221350881 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feeac020040 con 0x5564e05f3a10 2024-04-20T12:23:47.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feec6639740 10 client.15987 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feec6639740 1 -- 172.21.15.135:0/1221350881 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564e022b0f0 con 0x5564e05f3a10 2024-04-20T12:23:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feea4ff9640 1 -- 172.21.15.135:0/1221350881 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feeb4048070 con 0x5564e05f3a10 2024-04-20T12:23:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feea4ff9640 1 -- 172.21.15.135:0/1221350881 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7feeac0a4b10 con 0x5564e05f3a10 2024-04-20T12:23:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feec6639740 10 client.15987 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feec6639740 10 client.15987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feec6639740 20 client.15987 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feec6639740 1 --2- 172.21.15.135:0/1221350881 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5564e060f730 0x5564e0611bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feec6639740 4 client.15987 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:23:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feec6639740 1 -- 172.21.15.135:0/1221350881 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564e0566bd0 con 0x5564e060f730 2024-04-20T12:23:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.842+0000 7feec0f02640 1 --2- 172.21.15.135:0/1221350881 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5564e060f730 0x5564e0611bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.843+0000 7feea4ff9640 10 client.15987 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.843+0000 7feec0f02640 1 --2- 172.21.15.135:0/1221350881 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5564e060f730 0x5564e0611bb0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e78b5688bb929c99 server_cookie=8601ad669839e821 in_seq=0 out_seq=0 2024-04-20T12:23:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.843+0000 7feea4ff9640 1 -- 172.21.15.135:0/1221350881 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5564e0566bd0 con 0x5564e060f730 2024-04-20T12:23:47.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.843+0000 7feea4ff9640 10 client.15987 handle_command_reply: tid=0 2024-04-20T12:23:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.843+0000 7feec6639740 1 client.15987 shutdown 2024-04-20T12:23:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.844+0000 7feec6639740 1 -- 172.21.15.135:0/1221350881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 msgr2=0x5564e05fc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.844+0000 7feec6639740 1 --2- 172.21.15.135:0/1221350881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e05fc450 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7feeac0ce330 tx=0x7feeac0a1870 comp rx=0 tx=0).stop 2024-04-20T12:23:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.844+0000 7feec6639740 1 -- 172.21.15.135:0/1221350881 shutdown_connections 2024-04-20T12:23:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.844+0000 7feec6639740 1 --2- 172.21.15.135:0/1221350881 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5564e060f730 0x5564e0611bb0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.844+0000 7feec6639740 1 --2- 172.21.15.135:0/1221350881 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05ff430 0x5564e05fced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.844+0000 7feec6639740 1 --2- 172.21.15.135:0/1221350881 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05f4330 0x5564e05fc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.844+0000 7feea4ff9640 0 client.15987 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.844+0000 7feec6639740 1 --2- 172.21.15.135:0/1221350881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e05fc450 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.844+0000 7feec6639740 1 -- 172.21.15.135:0/1221350881 >> 172.21.15.135:0/1221350881 conn(0x5564e05ee450 msgr2=0x5564e05f01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.844+0000 7feec6639740 1 -- 172.21.15.135:0/1221350881 shutdown_connections 2024-04-20T12:23:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.844+0000 7feec6639740 1 -- 172.21.15.135:0/1221350881 wait complete. 2024-04-20T12:23:47.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.844+0000 7feec6639740 20 client.15987 trim_cache size 0 max 16384 2024-04-20T12:23:47.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec6639740 1 Processor -- start 2024-04-20T12:23:47.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec6639740 1 -- start start 2024-04-20T12:23:47.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec6639740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05f3a10 0x5564e05feb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec6639740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f4330 0x5564e060b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec6639740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05ff430 0x5564e05ee830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec6639740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1ad170 con 0x5564e05f4330 2024-04-20T12:23:47.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec6639740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1aecb0 con 0x5564e05f3a10 2024-04-20T12:23:47.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec6639740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1ad840 con 0x5564e05ff430 2024-04-20T12:23:47.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec0f02640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f4330 0x5564e060b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec0f02640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f4330 0x5564e060b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39704/0 (socket says 172.21.15.135:39704) 2024-04-20T12:23:47.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec0f02640 1 -- 172.21.15.135:0/323721969 learned_addr learned my addr 172.21.15.135:0/323721969 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:47.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec1703640 1 --2- 172.21.15.135:0/323721969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05f3a10 0x5564e05feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec0f02640 1 -- 172.21.15.135:0/323721969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05ff430 msgr2=0x5564e05ee830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec0f02640 1 --2- 172.21.15.135:0/323721969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05ff430 0x5564e05ee830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec0f02640 1 -- 172.21.15.135:0/323721969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05f3a10 msgr2=0x5564e05feb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec0f02640 1 --2- 172.21.15.135:0/323721969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05f3a10 0x5564e05feb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec0f02640 1 -- 172.21.15.135:0/323721969 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564e05ef610 con 0x5564e05f4330 2024-04-20T12:23:47.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.861+0000 7feec1703640 1 --2- 172.21.15.135:0/323721969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05f3a10 0x5564e05feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:47.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.862+0000 7feec0f02640 1 --2- 172.21.15.135:0/323721969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f4330 0x5564e060b0c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7feeb8009c10 tx=0x7feeb8004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa77d775ba1e0f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:47.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.862+0000 7feea6ffd640 1 -- 172.21.15.135:0/323721969 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb8003d20 con 0x5564e05f4330 2024-04-20T12:23:47.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.862+0000 7feea6ffd640 1 -- 172.21.15.135:0/323721969 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feeb8022070 con 0x5564e05f4330 2024-04-20T12:23:47.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.862+0000 7feea6ffd640 1 -- 172.21.15.135:0/323721969 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb8010bf0 con 0x5564e05f4330 2024-04-20T12:23:47.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.862+0000 7feec6639740 1 -- 172.21.15.135:0/323721969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f4330 msgr2=0x5564e060b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.862+0000 7feec6639740 1 --2- 172.21.15.135:0/323721969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f4330 0x5564e060b0c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7feeb8009c10 tx=0x7feeb8004410 comp rx=0 tx=0).stop 2024-04-20T12:23:47.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.862+0000 7feec6639740 1 -- 172.21.15.135:0/323721969 shutdown_connections 2024-04-20T12:23:47.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.862+0000 7feec6639740 1 --2- 172.21.15.135:0/323721969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05ff430 0x5564e05ee830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.862+0000 7feec6639740 1 --2- 172.21.15.135:0/323721969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f4330 0x5564e060b0c0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.862+0000 7feec6639740 1 --2- 172.21.15.135:0/323721969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05f3a10 0x5564e05feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.862+0000 7feec6639740 1 -- 172.21.15.135:0/323721969 >> 172.21.15.135:0/323721969 conn(0x5564e05ee450 msgr2=0x5564e05ecda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:47.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.862+0000 7feec6639740 1 -- 172.21.15.135:0/323721969 shutdown_connections 2024-04-20T12:23:47.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.862+0000 7feec6639740 1 -- 172.21.15.135:0/323721969 wait complete. 2024-04-20T12:23:47.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec6639740 1 -- start start 2024-04-20T12:23:47.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec6639740 1 Processor -- start 2024-04-20T12:23:47.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec6639740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e0607980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec6639740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05f4330 0x5564e0604d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec6639740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05ff430 0x5564e0605250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec6639740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1ae5e0 con 0x5564e05f3a10 2024-04-20T12:23:47.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec6639740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1adf10 con 0x5564e05f4330 2024-04-20T12:23:47.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec6639740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feebc1ab140 con 0x5564e05ff430 2024-04-20T12:23:47.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec6639740 10 client.0 _ll_register_callbacks cb 0x7feeac00d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:47.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec1703640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e0607980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec1703640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e0607980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39718/0 (socket says 172.21.15.135:39718) 2024-04-20T12:23:47.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec1703640 1 -- 172.21.15.135:0/331192719 learned_addr learned my addr 172.21.15.135:0/331192719 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:47.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec1f04640 1 --2- 172.21.15.135:0/331192719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05ff430 0x5564e0605250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec1703640 1 -- 172.21.15.135:0/331192719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05ff430 msgr2=0x5564e0605250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec1703640 1 --2- 172.21.15.135:0/331192719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05ff430 0x5564e0605250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec1703640 1 -- 172.21.15.135:0/331192719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05f4330 msgr2=0x5564e0604d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:47.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec1703640 1 --2- 172.21.15.135:0/331192719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05f4330 0x5564e0604d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.863+0000 7feec1703640 1 -- 172.21.15.135:0/331192719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564e0605a80 con 0x5564e05f3a10 2024-04-20T12:23:47.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feec1703640 1 --2- 172.21.15.135:0/331192719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e0607980 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7feeac012040 tx=0x7feeac0048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb6638c5fad11aa server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:47.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feea4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:47.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feea4ff9640 1 -- 172.21.15.135:0/331192719 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac0b5040 con 0x5564e05f3a10 2024-04-20T12:23:47.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feea4ff9640 1 -- 172.21.15.135:0/331192719 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7feeac009cc0 con 0x5564e05f3a10 2024-04-20T12:23:47.869 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feec6639740 1 -- 172.21.15.135:0/331192719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feeb8022070 con 0x5564e05f3a10 2024-04-20T12:23:47.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feea4ff9640 1 -- 172.21.15.135:0/331192719 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feeac084050 con 0x5564e05f3a10 2024-04-20T12:23:47.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feec6639740 10 client.15993 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:47.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feec6639740 1 -- 172.21.15.135:0/331192719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564e0675c70 con 0x5564e05f3a10 2024-04-20T12:23:47.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feea4ff9640 1 -- 172.21.15.135:0/331192719 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feeb8022070 con 0x5564e05f3a10 2024-04-20T12:23:47.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feea4ff9640 1 -- 172.21.15.135:0/331192719 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7feeac0a4b10 con 0x5564e05f3a10 2024-04-20T12:23:47.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feec6639740 10 client.15993 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:47.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feec6639740 10 client.15993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:47.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feec6639740 20 client.15993 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:47.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feec6639740 1 --2- 172.21.15.135:0/331192719 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5564e0676290 0x5564e06786b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:47.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feec6639740 4 client.15993 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:23:47.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.864+0000 7feec6639740 1 -- 172.21.15.135:0/331192719 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5564e0560a40 con 0x5564e0676290 2024-04-20T12:23:47.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feec0f02640 1 --2- 172.21.15.135:0/331192719 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5564e0676290 0x5564e06786b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:47.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feec0f02640 1 --2- 172.21.15.135:0/331192719 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5564e0676290 0x5564e06786b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a47121f96d20a45 server_cookie=d3f6c43f0bc4611f in_seq=0 out_seq=0 2024-04-20T12:23:47.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feea4ff9640 10 client.15993 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:47.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feea4ff9640 1 -- 172.21.15.135:0/331192719 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5564e0560a40 con 0x5564e0676290 2024-04-20T12:23:47.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feea4ff9640 10 client.15993 handle_command_reply: tid=0 2024-04-20T12:23:47.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feec6639740 1 client.15993 shutdown 2024-04-20T12:23:47.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feec6639740 1 -- 172.21.15.135:0/331192719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 msgr2=0x5564e0607980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feec6639740 1 --2- 172.21.15.135:0/331192719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e0607980 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7feeac012040 tx=0x7feeac0048a0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feec6639740 1 -- 172.21.15.135:0/331192719 shutdown_connections 2024-04-20T12:23:47.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feec6639740 1 --2- 172.21.15.135:0/331192719 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5564e0676290 0x5564e06786b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feec6639740 1 --2- 172.21.15.135:0/331192719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564e05ff430 0x5564e0605250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feea4ff9640 0 client.15993 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:47.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feec6639740 1 --2- 172.21.15.135:0/331192719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564e05f4330 0x5564e0604d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feec6639740 1 --2- 172.21.15.135:0/331192719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564e05f3a10 0x5564e0607980 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feec6639740 1 -- 172.21.15.135:0/331192719 >> 172.21.15.135:0/331192719 conn(0x5564e05ee450 msgr2=0x5564e05ed630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:47.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feec6639740 1 -- 172.21.15.135:0/331192719 shutdown_connections 2024-04-20T12:23:47.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feec6639740 1 -- 172.21.15.135:0/331192719 wait complete. 2024-04-20T12:23:47.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.865+0000 7feec6639740 20 client.15993 trim_cache size 0 max 16384 2024-04-20T12:23:47.872 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:23:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:23:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:23:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "ea0518e1-4006-4c2f-9c5a-912a093a1d8f": { 2024-04-20T12:23:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:23:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "ea0518e1-4006-4c2f-9c5a-912a093a1d8f", 2024-04-20T12:23:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:23:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:23:47.872 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:23:47.872 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:23:47.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.866+0000 7feec3967640 1 -- 172.21.15.135:0/2809699565 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feea80a3e40 msgr2=0x7feea80a6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.866+0000 7feec3967640 1 --2- 172.21.15.135:0/2809699565 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feea80a3e40 0x7feea80a6300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009430 tx=0x7feeb4041000 comp rx=0 tx=0).stop 2024-04-20T12:23:47.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.866+0000 7feec3967640 1 -- 172.21.15.135:0/2809699565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feebc1010a0 msgr2=0x7feebc197710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:47.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.866+0000 7feec3967640 1 --2- 172.21.15.135:0/2809699565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feebc1010a0 0x7feebc197710 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7feeac00d770 tx=0x7feeac00dc30 comp rx=0 tx=0).stop 2024-04-20T12:23:47.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.866+0000 7feec3967640 1 -- 172.21.15.135:0/2809699565 shutdown_connections 2024-04-20T12:23:47.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.866+0000 7feec3967640 1 --2- 172.21.15.135:0/2809699565 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feebc19bf80 0x7feebc19c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.866+0000 7feec3967640 1 --2- 172.21.15.135:0/2809699565 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feea80a3e40 0x7feea80a6300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.866+0000 7feec3967640 1 --2- 172.21.15.135:0/2809699565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feebc106170 0x7feebc197c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.866+0000 7feec3967640 1 --2- 172.21.15.135:0/2809699565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feebc1010a0 0x7feebc197710 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:47.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.866+0000 7feec3967640 1 -- 172.21.15.135:0/2809699565 >> 172.21.15.135:0/2809699565 conn(0x7feebc077f60 msgr2=0x7feebc0fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:47.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.866+0000 7feec3967640 1 -- 172.21.15.135:0/2809699565 shutdown_connections 2024-04-20T12:23:47.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:23:47.866+0000 7feec3967640 1 -- 172.21.15.135:0/2809699565 wait complete. 2024-04-20T12:23:47.876 INFO:tasks.cephfs.filesystem:scrub status for tag:ea0518e1-4006-4c2f-9c5a-912a093a1d8f - {'path': '/', 'tag': 'ea0518e1-4006-4c2f-9c5a-912a093a1d8f', 'options': 'recursive,force'} 2024-04-20T12:23:48.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:48 smithi154 ceph-mon[22073]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-20T12:23:48.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:48 smithi139 ceph-mon[21834]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-20T12:23:48.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:48 smithi135 ceph-mon[18264]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-04-20T12:23:49.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:49 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:23:49.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:49 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:23:49.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:49 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:23:49.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:49 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:23:49.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:49 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:23:49.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:49 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:23:49.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:49 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:23:49.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:49 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:23:49.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:49 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:23:49.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:49 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:23:49.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:49 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:23:49.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:49 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:23:50.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:50 smithi154 ceph-mon[22073]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-20T12:23:50.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:50 smithi139 ceph-mon[21834]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-20T12:23:50.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:50 smithi135 ceph-mon[18264]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-20T12:23:52.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:52 smithi154 ceph-mon[22073]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-20T12:23:52.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:52 smithi139 ceph-mon[21834]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-20T12:23:52.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:52 smithi135 ceph-mon[18264]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-20T12:23:53.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:53 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:23:53.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:53 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:23:53.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:53 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:23:54.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:54 smithi154 ceph-mon[22073]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 11 op/s 2024-04-20T12:23:54.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:54 smithi139 ceph-mon[21834]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 11 op/s 2024-04-20T12:23:54.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:54 smithi135 ceph-mon[18264]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 11 op/s 2024-04-20T12:23:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.036+0000 7ff46418f640 1 -- 172.21.15.135:0/238797581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff45c102ba0 msgr2=0x7ff45c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.036+0000 7ff46418f640 1 --2- 172.21.15.135:0/238797581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff45c102ba0 0x7ff45c106be0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009900 tx=0x7ff44c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:23:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.036+0000 7ff46418f640 1 -- 172.21.15.135:0/238797581 shutdown_connections 2024-04-20T12:23:56.039 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.036+0000 7ff46418f640 1 --2- 172.21.15.135:0/238797581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff45c1072c0 0x7ff45c10ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.036+0000 7ff46418f640 1 --2- 172.21.15.135:0/238797581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff45c102ba0 0x7ff45c106be0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.036+0000 7ff46418f640 1 --2- 172.21.15.135:0/238797581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff45c1021f0 0x7ff45c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.037+0000 7ff46418f640 1 -- 172.21.15.135:0/238797581 >> 172.21.15.135:0/238797581 conn(0x7ff45c0fda10 msgr2=0x7ff45c0ffe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:56.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.037+0000 7ff46418f640 1 -- 172.21.15.135:0/238797581 shutdown_connections 2024-04-20T12:23:56.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.037+0000 7ff46418f640 1 -- 172.21.15.135:0/238797581 wait complete. 2024-04-20T12:23:56.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.037+0000 7ff46418f640 1 Processor -- start 2024-04-20T12:23:56.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.037+0000 7ff46418f640 1 -- start start 2024-04-20T12:23:56.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.037+0000 7ff46418f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff45c1021f0 0x7ff45c074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.037+0000 7ff46418f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff45c1072c0 0x7ff45c0747a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.040 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.037+0000 7ff46418f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff45c074ce0 0x7ff45c1a69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.037+0000 7ff46418f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c112330 con 0x7ff45c074ce0 2024-04-20T12:23:56.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.037+0000 7ff46418f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c1121b0 con 0x7ff45c1021f0 2024-04-20T12:23:56.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.037+0000 7ff46418f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c1124b0 con 0x7ff45c1072c0 2024-04-20T12:23:56.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff46272c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff45c074ce0 0x7ff45c1a69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff46272c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff45c074ce0 0x7ff45c1a69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42886/0 (socket says 172.21.15.135:42886) 2024-04-20T12:23:56.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff46272c640 1 -- 172.21.15.135:0/2953421869 learned_addr learned my addr 172.21.15.135:0/2953421869 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:56.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff461f2b640 1 --2- 172.21.15.135:0/2953421869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff45c1021f0 0x7ff45c074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff46172a640 1 --2- 172.21.15.135:0/2953421869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff45c1072c0 0x7ff45c0747a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff46272c640 1 -- 172.21.15.135:0/2953421869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff45c1072c0 msgr2=0x7ff45c0747a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:56.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff46272c640 1 --2- 172.21.15.135:0/2953421869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff45c1072c0 0x7ff45c0747a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.041 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff46272c640 1 -- 172.21.15.135:0/2953421869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff45c1021f0 msgr2=0x7ff45c074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:56.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff46272c640 1 --2- 172.21.15.135:0/2953421869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff45c1021f0 0x7ff45c074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff46272c640 1 -- 172.21.15.135:0/2953421869 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c1a7040 con 0x7ff45c074ce0 2024-04-20T12:23:56.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff46172a640 1 --2- 172.21.15.135:0/2953421869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff45c1072c0 0x7ff45c0747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:56.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff46272c640 1 --2- 172.21.15.135:0/2953421869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff45c074ce0 0x7ff45c1a69a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff454009fd0 tx=0x7ff45400def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:56.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff452ffd640 1 -- 172.21.15.135:0/2953421869 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff454017070 con 0x7ff45c074ce0 2024-04-20T12:23:56.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff46418f640 1 -- 172.21.15.135:0/2953421869 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45c1a7330 con 0x7ff45c074ce0 2024-04-20T12:23:56.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff452ffd640 1 -- 172.21.15.135:0/2953421869 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff454003e50 con 0x7ff45c074ce0 2024-04-20T12:23:56.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff452ffd640 1 -- 172.21.15.135:0/2953421869 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff454010460 con 0x7ff45c074ce0 2024-04-20T12:23:56.042 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.038+0000 7ff46418f640 1 -- 172.21.15.135:0/2953421869 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff45c1a7850 con 0x7ff45c074ce0 2024-04-20T12:23:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.040+0000 7ff452ffd640 1 -- 172.21.15.135:0/2953421869 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 24) ==== 138874+0+0 (secure 0 0 0) 0x7ff454003970 con 0x7ff45c074ce0 2024-04-20T12:23:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.041+0000 7ff452ffd640 1 --2- 172.21.15.135:0/2953421869 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff4480a3ee0 0x7ff4480a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.041+0000 7ff461f2b640 1 --2- 172.21.15.135:0/2953421869 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff4480a3ee0 0x7ff4480a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.041+0000 7ff452ffd640 1 -- 172.21.15.135:0/2953421869 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff4540d0ab0 con 0x7ff45c074ce0 2024-04-20T12:23:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.042+0000 7ff461f2b640 1 --2- 172.21.15.135:0/2953421869 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff4480a3ee0 0x7ff4480a63a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff45800abe0 tx=0x7ff45800a2d0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.042+0000 7ff466d7c740 1 Processor -- start 2024-04-20T12:23:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.042+0000 7ff466d7c740 1 -- start start 2024-04-20T12:23:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.042+0000 7ff466d7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e0110 0x55f4833e04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.051 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.042+0000 7ff466d7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.042+0000 7ff466d7c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e9800 0x55f4833ebbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.042+0000 7ff466d7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f483345820 con 0x55f4833e0a30 2024-04-20T12:23:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.042+0000 7ff466d7c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f4832e2fc0 con 0x55f4833e9800 2024-04-20T12:23:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.042+0000 7ff466d7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f4833417e0 con 0x55f4833e0110 2024-04-20T12:23:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.042+0000 7ff46172a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.042+0000 7ff46172a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42888/0 (socket says 172.21.15.135:42888) 2024-04-20T12:23:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.042+0000 7ff46172a640 1 -- 172.21.15.135:0/796096515 learned_addr learned my addr 172.21.15.135:0/796096515 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.042+0000 7ff461f2b640 1 --2- 172.21.15.135:0/796096515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e0110 0x55f4833e04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.043+0000 7ff46272c640 1 --2- 172.21.15.135:0/796096515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e9800 0x55f4833ebbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.043+0000 7ff46172a640 1 -- 172.21.15.135:0/796096515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e0110 msgr2=0x55f4833e04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.043+0000 7ff46172a640 1 --2- 172.21.15.135:0/796096515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e0110 0x55f4833e04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.052 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.043+0000 7ff46172a640 1 -- 172.21.15.135:0/796096515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e9800 msgr2=0x55f4833ebbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.043+0000 7ff46172a640 1 --2- 172.21.15.135:0/796096515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e9800 0x55f4833ebbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.043+0000 7ff46172a640 1 -- 172.21.15.135:0/796096515 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f483058210 con 0x55f4833e0a30 2024-04-20T12:23:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.043+0000 7ff46172a640 1 --2- 172.21.15.135:0/796096515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e92c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff45c06b5c0 tx=0x7ff44c02c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6ef3e6fce37052 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.043+0000 7ff447fff640 1 -- 172.21.15.135:0/796096515 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c02cbc0 con 0x55f4833e0a30 2024-04-20T12:23:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.043+0000 7ff447fff640 1 -- 172.21.15.135:0/796096515 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff44c005040 con 0x55f4833e0a30 2024-04-20T12:23:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.043+0000 7ff447fff640 1 -- 172.21.15.135:0/796096515 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c004a40 con 0x55f4833e0a30 2024-04-20T12:23:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.044+0000 7ff466d7c740 1 -- 172.21.15.135:0/796096515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 msgr2=0x55f4833e92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.044+0000 7ff466d7c740 1 --2- 172.21.15.135:0/796096515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e92c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff45c06b5c0 tx=0x7ff44c02c650 comp rx=0 tx=0).stop 2024-04-20T12:23:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.044+0000 7ff466d7c740 1 -- 172.21.15.135:0/796096515 shutdown_connections 2024-04-20T12:23:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.044+0000 7ff466d7c740 1 --2- 172.21.15.135:0/796096515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e9800 0x55f4833ebbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.053 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.044+0000 7ff466d7c740 1 --2- 172.21.15.135:0/796096515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e92c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.044+0000 7ff466d7c740 1 --2- 172.21.15.135:0/796096515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e0110 0x55f4833e04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.044+0000 7ff466d7c740 1 -- 172.21.15.135:0/796096515 >> 172.21.15.135:0/796096515 conn(0x55f4833daa30 msgr2=0x55f4833dae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:56.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.044+0000 7ff466d7c740 1 -- 172.21.15.135:0/796096515 shutdown_connections 2024-04-20T12:23:56.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.044+0000 7ff466d7c740 1 -- 172.21.15.135:0/796096515 wait complete. 2024-04-20T12:23:56.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.044+0000 7ff466d7c740 1 -- start start 2024-04-20T12:23:56.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.044+0000 7ff466d7c740 1 Processor -- start 2024-04-20T12:23:56.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff466d7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e0110 0x55f4833e67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff466d7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff466d7c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e9800 0x55f4833e7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff466d7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f4833ec3d0 con 0x55f4833e0a30 2024-04-20T12:23:56.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff466d7c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f4832cdee0 con 0x55f4833e9800 2024-04-20T12:23:56.054 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff466d7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f4833ec550 con 0x55f4833e0110 2024-04-20T12:23:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff466d7c740 10 client.0 _ll_register_callbacks cb 0x55f4832e3d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff46172a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff46172a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42892/0 (socket says 172.21.15.135:42892) 2024-04-20T12:23:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff46172a640 1 -- 172.21.15.135:0/4063144105 learned_addr learned my addr 172.21.15.135:0/4063144105 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff46272c640 1 --2- 172.21.15.135:0/4063144105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e9800 0x55f4833e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff461f2b640 1 --2- 172.21.15.135:0/4063144105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e0110 0x55f4833e67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff46172a640 1 -- 172.21.15.135:0/4063144105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e0110 msgr2=0x55f4833e67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff46172a640 1 --2- 172.21.15.135:0/4063144105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e0110 0x55f4833e67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff46172a640 1 -- 172.21.15.135:0/4063144105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e9800 msgr2=0x55f4833e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff46172a640 1 --2- 172.21.15.135:0/4063144105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e9800 0x55f4833e7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff46172a640 1 -- 172.21.15.135:0/4063144105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f483124620 con 0x55f4833e0a30 2024-04-20T12:23:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff46272c640 1 --2- 172.21.15.135:0/4063144105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e9800 0x55f4833e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:23:56.055 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff46172a640 1 --2- 172.21.15.135:0/4063144105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e6d00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff44c02c170 tx=0x7ff44c005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6442a26e94632e87 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.045+0000 7ff4457fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.046+0000 7ff4457fa640 1 -- 172.21.15.135:0/4063144105 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c04e060 con 0x55f4833e0a30 2024-04-20T12:23:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.046+0000 7ff4457fa640 1 -- 172.21.15.135:0/4063144105 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff44c004bd0 con 0x55f4833e0a30 2024-04-20T12:23:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.046+0000 7ff466d7c740 1 -- 172.21.15.135:0/4063144105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff44c005040 con 0x55f4833e0a30 2024-04-20T12:23:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.046+0000 7ff4457fa640 1 -- 172.21.15.135:0/4063144105 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff44c055050 con 0x55f4833e0a30 2024-04-20T12:23:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.046+0000 7ff466d7c740 10 client.16005 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.046+0000 7ff466d7c740 1 -- 172.21.15.135:0/4063144105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f4833f85d0 con 0x55f4833e0a30 2024-04-20T12:23:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.046+0000 7ff4457fa640 1 -- 172.21.15.135:0/4063144105 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff44c005040 con 0x55f4833e0a30 2024-04-20T12:23:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.046+0000 7ff4457fa640 1 -- 172.21.15.135:0/4063144105 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7ff44c03d420 con 0x55f4833e0a30 2024-04-20T12:23:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.046+0000 7ff466d7c740 10 client.16005 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.046+0000 7ff466d7c740 10 client.16005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:56.056 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.046+0000 7ff466d7c740 20 client.16005 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.046+0000 7ff466d7c740 1 --2- 172.21.15.135:0/4063144105 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4833f9920 0x55f4833fbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.046+0000 7ff466d7c740 4 client.16005 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:23:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.046+0000 7ff466d7c740 1 -- 172.21.15.135:0/4063144105 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f483353240 con 0x55f4833f9920 2024-04-20T12:23:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.047+0000 7ff461f2b640 1 --2- 172.21.15.135:0/4063144105 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4833f9920 0x55f4833fbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.047+0000 7ff4457fa640 10 client.16005 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.047+0000 7ff461f2b640 1 --2- 172.21.15.135:0/4063144105 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4833f9920 0x55f4833fbd10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fed7a34a82e82a93 server_cookie=a4cf49dab6b8dee7 in_seq=0 out_seq=0 2024-04-20T12:23:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.048+0000 7ff4457fa640 1 -- 172.21.15.135:0/4063144105 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f483353240 con 0x55f4833f9920 2024-04-20T12:23:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.048+0000 7ff4457fa640 10 client.16005 handle_command_reply: tid=0 2024-04-20T12:23:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.048+0000 7ff466d7c740 1 client.16005 shutdown 2024-04-20T12:23:56.057 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.048+0000 7ff466d7c740 1 -- 172.21.15.135:0/4063144105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 msgr2=0x55f4833e6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.048+0000 7ff466d7c740 1 --2- 172.21.15.135:0/4063144105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e6d00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff44c02c170 tx=0x7ff44c005420 comp rx=0 tx=0).stop 2024-04-20T12:23:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.048+0000 7ff466d7c740 1 -- 172.21.15.135:0/4063144105 shutdown_connections 2024-04-20T12:23:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.048+0000 7ff466d7c740 1 --2- 172.21.15.135:0/4063144105 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4833f9920 0x55f4833fbd10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.048+0000 7ff466d7c740 1 --2- 172.21.15.135:0/4063144105 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e9800 0x55f4833e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.048+0000 7ff466d7c740 1 --2- 172.21.15.135:0/4063144105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e6d00 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.048+0000 7ff4457fa640 0 client.16005 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.048+0000 7ff466d7c740 1 --2- 172.21.15.135:0/4063144105 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e0110 0x55f4833e67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.048+0000 7ff466d7c740 1 -- 172.21.15.135:0/4063144105 >> 172.21.15.135:0/4063144105 conn(0x55f4833daa30 msgr2=0x55f4833dc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.048+0000 7ff466d7c740 1 -- 172.21.15.135:0/4063144105 shutdown_connections 2024-04-20T12:23:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.048+0000 7ff466d7c740 1 -- 172.21.15.135:0/4063144105 wait complete. 2024-04-20T12:23:56.058 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.048+0000 7ff466d7c740 20 client.16005 trim_cache size 0 max 16384 2024-04-20T12:23:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.063+0000 7ff466d7c740 1 Processor -- start 2024-04-20T12:23:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.063+0000 7ff466d7c740 1 -- start start 2024-04-20T12:23:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.063+0000 7ff466d7c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e0110 0x55f4833f5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.063+0000 7ff466d7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.063+0000 7ff466d7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e9800 0x55f4833d99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.063+0000 7ff466d7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c1b1370 con 0x55f4833e0a30 2024-04-20T12:23:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.063+0000 7ff466d7c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c1b2eb0 con 0x55f4833e0110 2024-04-20T12:23:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.063+0000 7ff466d7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c1b1a40 con 0x55f4833e9800 2024-04-20T12:23:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.063+0000 7ff46172a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.063+0000 7ff46172a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42894/0 (socket says 172.21.15.135:42894) 2024-04-20T12:23:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.063+0000 7ff46172a640 1 -- 172.21.15.135:0/679805176 learned_addr learned my addr 172.21.15.135:0/679805176 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.064+0000 7ff46272c640 1 --2- 172.21.15.135:0/679805176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e9800 0x55f4833d99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.070 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.064+0000 7ff461f2b640 1 --2- 172.21.15.135:0/679805176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e0110 0x55f4833f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.064+0000 7ff46172a640 1 -- 172.21.15.135:0/679805176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e9800 msgr2=0x55f4833d99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.064+0000 7ff46172a640 1 --2- 172.21.15.135:0/679805176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e9800 0x55f4833d99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.064+0000 7ff46172a640 1 -- 172.21.15.135:0/679805176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e0110 msgr2=0x55f4833f5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.064+0000 7ff46172a640 1 --2- 172.21.15.135:0/679805176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e0110 0x55f4833f5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.064+0000 7ff46172a640 1 -- 172.21.15.135:0/679805176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4833da860 con 0x55f4833e0a30 2024-04-20T12:23:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.064+0000 7ff461f2b640 1 --2- 172.21.15.135:0/679805176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e0110 0x55f4833f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:23:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.064+0000 7ff46172a640 1 --2- 172.21.15.135:0/679805176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e8e80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff44c02e000 tx=0x7ff44c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fd1449fe8c1db5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.064+0000 7ff4477fe640 1 -- 172.21.15.135:0/679805176 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c04e040 con 0x55f4833e0a30 2024-04-20T12:23:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.064+0000 7ff4477fe640 1 -- 172.21.15.135:0/679805176 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff44c005490 con 0x55f4833e0a30 2024-04-20T12:23:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.064+0000 7ff4477fe640 1 -- 172.21.15.135:0/679805176 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c004ef0 con 0x55f4833e0a30 2024-04-20T12:23:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.065+0000 7ff466d7c740 1 -- 172.21.15.135:0/679805176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 msgr2=0x55f4833e8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.065+0000 7ff466d7c740 1 --2- 172.21.15.135:0/679805176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e8e80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff44c02e000 tx=0x7ff44c004740 comp rx=0 tx=0).stop 2024-04-20T12:23:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.065+0000 7ff466d7c740 1 -- 172.21.15.135:0/679805176 shutdown_connections 2024-04-20T12:23:56.071 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.065+0000 7ff466d7c740 1 --2- 172.21.15.135:0/679805176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e9800 0x55f4833d99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.065+0000 7ff466d7c740 1 --2- 172.21.15.135:0/679805176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0a30 0x55f4833e8e80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.065+0000 7ff466d7c740 1 --2- 172.21.15.135:0/679805176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e0110 0x55f4833f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.065+0000 7ff466d7c740 1 -- 172.21.15.135:0/679805176 >> 172.21.15.135:0/679805176 conn(0x55f4833daa30 msgr2=0x55f4833d92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.065+0000 7ff466d7c740 1 -- 172.21.15.135:0/679805176 shutdown_connections 2024-04-20T12:23:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.065+0000 7ff466d7c740 1 -- 172.21.15.135:0/679805176 wait complete. 2024-04-20T12:23:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.065+0000 7ff466d7c740 1 -- start start 2024-04-20T12:23:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.065+0000 7ff466d7c740 1 Processor -- start 2024-04-20T12:23:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff466d7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0110 0x55f4833e33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff466d7c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e0a30 0x55f4833e38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff466d7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e9800 0x55f4833e3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff466d7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c1b27e0 con 0x55f4833e0110 2024-04-20T12:23:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff466d7c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c1b2110 con 0x55f4833e0a30 2024-04-20T12:23:56.072 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff466d7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c1af340 con 0x55f4833e9800 2024-04-20T12:23:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff466d7c740 10 client.0 _ll_register_callbacks cb 0x7ff45800a830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:23:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff461f2b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0110 0x55f4833e33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff461f2b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0110 0x55f4833e33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42896/0 (socket says 172.21.15.135:42896) 2024-04-20T12:23:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff461f2b640 1 -- 172.21.15.135:0/1090276027 learned_addr learned my addr 172.21.15.135:0/1090276027 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:23:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff46172a640 1 --2- 172.21.15.135:0/1090276027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e0a30 0x55f4833e38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff46272c640 1 --2- 172.21.15.135:0/1090276027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e9800 0x55f4833e3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff461f2b640 1 -- 172.21.15.135:0/1090276027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e9800 msgr2=0x55f4833e3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff461f2b640 1 --2- 172.21.15.135:0/1090276027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e9800 0x55f4833e3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff461f2b640 1 -- 172.21.15.135:0/1090276027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e0a30 msgr2=0x55f4833e38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:23:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff461f2b640 1 --2- 172.21.15.135:0/1090276027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e0a30 0x55f4833e38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff461f2b640 1 -- 172.21.15.135:0/1090276027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4833dfaf0 con 0x55f4833e0110 2024-04-20T12:23:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.066+0000 7ff46172a640 1 --2- 172.21.15.135:0/1090276027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e0a30 0x55f4833e38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:23:56.073 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff461f2b640 1 --2- 172.21.15.135:0/1090276027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0110 0x55f4833e33a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x55f4833fc3a0 tx=0x7ff458004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453687e8e950904c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff4457fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff4457fa640 1 -- 172.21.15.135:0/1090276027 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458016070 con 0x55f4833e0110 2024-04-20T12:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff4457fa640 1 -- 172.21.15.135:0/1090276027 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff45802b4f0 con 0x55f4833e0110 2024-04-20T12:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff466d7c740 1 -- 172.21.15.135:0/1090276027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff44c005490 con 0x55f4833e0110 2024-04-20T12:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff4457fa640 1 -- 172.21.15.135:0/1090276027 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff45803d050 con 0x55f4833e0110 2024-04-20T12:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff466d7c740 10 client.16011 fetch_fsmap learned FSMap version 29 2024-04-20T12:23:56.074 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff466d7c740 1 -- 172.21.15.135:0/1090276027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f48345fc80 con 0x55f4833e0110 2024-04-20T12:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff4457fa640 1 -- 172.21.15.135:0/1090276027 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff44c005490 con 0x55f4833e0110 2024-04-20T12:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff4457fa640 1 -- 172.21.15.135:0/1090276027 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7ff458029400 con 0x55f4833e0110 2024-04-20T12:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff466d7c740 10 client.16011 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff466d7c740 10 client.16011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff466d7c740 20 client.16011 populate_metadata read hostname 'smithi135' 2024-04-20T12:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff466d7c740 1 --2- 172.21.15.135:0/1090276027 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4834603e0 0x55f483462800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff466d7c740 4 client.16011 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-20T12:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff466d7c740 1 -- 172.21.15.135:0/1090276027 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f48334d0b0 con 0x55f4834603e0 2024-04-20T12:23:56.075 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.067+0000 7ff46172a640 1 --2- 172.21.15.135:0/1090276027 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4834603e0 0x55f483462800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:23:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.068+0000 7ff4457fa640 10 client.16011 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:56.076 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.068+0000 7ff46172a640 1 --2- 172.21.15.135:0/1090276027 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4834603e0 0x55f483462800 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4a18337bcd80a9a server_cookie=b3ec91e6910de5e0 in_seq=0 out_seq=0 2024-04-20T12:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.075+0000 7ff4457fa640 1 -- 172.21.15.135:0/1090276027 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f48334d0b0 con 0x55f4834603e0 2024-04-20T12:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.075+0000 7ff4457fa640 10 client.16011 handle_command_reply: tid=0 2024-04-20T12:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.075+0000 7ff466d7c740 1 client.16011 shutdown 2024-04-20T12:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.075+0000 7ff466d7c740 1 -- 172.21.15.135:0/1090276027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0110 msgr2=0x55f4833e33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.075+0000 7ff466d7c740 1 --2- 172.21.15.135:0/1090276027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0110 0x55f4833e33a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x55f4833fc3a0 tx=0x7ff458004730 comp rx=0 tx=0).stop 2024-04-20T12:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff466d7c740 1 -- 172.21.15.135:0/1090276027 shutdown_connections 2024-04-20T12:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff466d7c740 1 --2- 172.21.15.135:0/1090276027 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4834603e0 0x55f483462800 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff466d7c740 1 --2- 172.21.15.135:0/1090276027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4833e9800 0x55f4833e3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff466d7c740 1 --2- 172.21.15.135:0/1090276027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f4833e0a30 0x55f4833e38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff466d7c740 1 --2- 172.21.15.135:0/1090276027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f4833e0110 0x55f4833e33a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff4457fa640 0 client.16011 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff466d7c740 1 -- 172.21.15.135:0/1090276027 >> 172.21.15.135:0/1090276027 conn(0x55f4833daa30 msgr2=0x55f4833d9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:56.078 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff466d7c740 1 -- 172.21.15.135:0/1090276027 shutdown_connections 2024-04-20T12:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff466d7c740 1 -- 172.21.15.135:0/1090276027 wait complete. 2024-04-20T12:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff466d7c740 20 client.16011 trim_cache size 0 max 16384 2024-04-20T12:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-04-20T12:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-04-20T12:23:56.079 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-04-20T12:23:56.080 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-04-20T12:23:56.080 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff46418f640 1 -- 172.21.15.135:0/2953421869 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff4480a3ee0 msgr2=0x7ff4480a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff46418f640 1 --2- 172.21.15.135:0/2953421869 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff4480a3ee0 0x7ff4480a63a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff45800abe0 tx=0x7ff45800a2d0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff46418f640 1 -- 172.21.15.135:0/2953421869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff45c074ce0 msgr2=0x7ff45c1a69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff46418f640 1 --2- 172.21.15.135:0/2953421869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff45c074ce0 0x7ff45c1a69a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff454009fd0 tx=0x7ff45400def0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff46418f640 1 -- 172.21.15.135:0/2953421869 shutdown_connections 2024-04-20T12:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff46418f640 1 --2- 172.21.15.135:0/2953421869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff45c074ce0 0x7ff45c1a69a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff46418f640 1 --2- 172.21.15.135:0/2953421869 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff4480a3ee0 0x7ff4480a63a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff46418f640 1 --2- 172.21.15.135:0/2953421869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff45c1072c0 0x7ff45c0747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff46418f640 1 --2- 172.21.15.135:0/2953421869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff45c1021f0 0x7ff45c074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff46418f640 1 -- 172.21.15.135:0/2953421869 >> 172.21.15.135:0/2953421869 conn(0x7ff45c0fda10 msgr2=0x7ff45c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:23:56.081 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff46418f640 1 -- 172.21.15.135:0/2953421869 shutdown_connections 2024-04-20T12:23:56.082 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:23:56.076+0000 7ff46418f640 1 -- 172.21.15.135:0/2953421869 wait complete. 2024-04-20T12:23:56.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:56 smithi154 ceph-mon[22073]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-04-20T12:23:56.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:56 smithi139 ceph-mon[21834]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-04-20T12:23:56.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:56 smithi135 ceph-mon[18264]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-04-20T12:23:58.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:23:58 smithi154 ceph-mon[22073]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 9 op/s 2024-04-20T12:23:58.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:23:58 smithi139 ceph-mon[21834]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 9 op/s 2024-04-20T12:23:58.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:23:58 smithi135 ceph-mon[18264]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 9 op/s 2024-04-20T12:24:00.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:00 smithi154 ceph-mon[22073]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-04-20T12:24:00.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:00 smithi139 ceph-mon[21834]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-04-20T12:24:00.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:00 smithi135 ceph-mon[18264]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 1.7 KiB/s wr, 15 op/s 2024-04-20T12:24:01.364 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:24:00 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:24:00.893+0000 7fde41ebd700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:24:01.364 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:24:00 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:24:00.893+0000 7fde41ebd700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:24:01.364 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:24:00 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:24:00.893+0000 7fde41ebd700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:24:01.364 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:24:00 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:24:00.893+0000 7fde41ebd700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:24:01.364 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:24:00 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x[18492]: 2024-04-20T12:24:00.893+0000 7fde41ebd700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-20T12:24:02.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:02 smithi154 ceph-mon[22073]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-04-20T12:24:02.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:02 smithi154 ceph-mon[22073]: mgrmap e25: x(active, since 54s), standbys: y, z 2024-04-20T12:24:02.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:02 smithi139 ceph-mon[21834]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-04-20T12:24:02.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:02 smithi139 ceph-mon[21834]: mgrmap e25: x(active, since 54s), standbys: y, z 2024-04-20T12:24:02.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:02 smithi135 ceph-mon[18264]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-04-20T12:24:02.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:02 smithi135 ceph-mon[18264]: mgrmap e25: x(active, since 54s), standbys: y, z 2024-04-20T12:24:04.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:04 smithi154 ceph-mon[22073]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-04-20T12:24:04.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:04 smithi139 ceph-mon[21834]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-04-20T12:24:04.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:04 smithi135 ceph-mon[18264]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-04-20T12:24:06.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:06 smithi154 ceph-mon[22073]: pgmap v32: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-04-20T12:24:06.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:06 smithi139 ceph-mon[21834]: pgmap v32: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-04-20T12:24:06.615 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:06 smithi135 ceph-mon[18264]: pgmap v32: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-04-20T12:24:08.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:08 smithi154 ceph-mon[22073]: pgmap v33: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-04-20T12:24:08.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:08 smithi139 ceph-mon[21834]: pgmap v33: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-04-20T12:24:08.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:08 smithi135 ceph-mon[18264]: pgmap v33: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-04-20T12:24:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.197+0000 7f4942055640 1 -- 172.21.15.135:0/910501628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c101ab0 msgr2=0x7f493c105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:09.199 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.197+0000 7f4942055640 1 --2- 172.21.15.135:0/910501628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c101ab0 0x7f493c105aa0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4930009900 tx=0x7f493002bc30 comp rx=0 tx=0).stop 2024-04-20T12:24:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.197+0000 7f4942055640 1 -- 172.21.15.135:0/910501628 shutdown_connections 2024-04-20T12:24:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.197+0000 7f4942055640 1 --2- 172.21.15.135:0/910501628 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f493c106180 0x7f493c10dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.197+0000 7f4942055640 1 --2- 172.21.15.135:0/910501628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c101ab0 0x7f493c105aa0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.197+0000 7f4942055640 1 --2- 172.21.15.135:0/910501628 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f493c101100 0x7f493c1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.197+0000 7f4942055640 1 -- 172.21.15.135:0/910501628 >> 172.21.15.135:0/910501628 conn(0x7f493c077fe0 msgr2=0x7f493c0783f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.198+0000 7f4942055640 1 -- 172.21.15.135:0/910501628 shutdown_connections 2024-04-20T12:24:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.198+0000 7f4942055640 1 -- 172.21.15.135:0/910501628 wait complete. 2024-04-20T12:24:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.198+0000 7f4942055640 1 Processor -- start 2024-04-20T12:24:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.198+0000 7f4942055640 1 -- start start 2024-04-20T12:24:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.198+0000 7f4942055640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f493c101100 0x7f493c102b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.198+0000 7f4942055640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f493c106180 0x7f493c103080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f4942055640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c1035c0 0x7f493c1a6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f4942055640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f493c1111f0 con 0x7f493c1035c0 2024-04-20T12:24:09.200 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f4942055640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f493c111070 con 0x7f493c106180 2024-04-20T12:24:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f4942055640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f493c111370 con 0x7f493c101100 2024-04-20T12:24:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f493bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c1035c0 0x7f493c1a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f493bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c1035c0 0x7f493c1a6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60078/0 (socket says 172.21.15.135:60078) 2024-04-20T12:24:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f493bfff640 1 -- 172.21.15.135:0/870950169 learned_addr learned my addr 172.21.15.135:0/870950169 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f493affd640 1 --2- 172.21.15.135:0/870950169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f493c106180 0x7f493c103080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f493b7fe640 1 --2- 172.21.15.135:0/870950169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f493c101100 0x7f493c102b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f493bfff640 1 -- 172.21.15.135:0/870950169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f493c101100 msgr2=0x7f493c102b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f493bfff640 1 --2- 172.21.15.135:0/870950169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f493c101100 0x7f493c102b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f493bfff640 1 -- 172.21.15.135:0/870950169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f493c106180 msgr2=0x7f493c103080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f493bfff640 1 --2- 172.21.15.135:0/870950169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f493c106180 0x7f493c103080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f493bfff640 1 -- 172.21.15.135:0/870950169 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c1a7060 con 0x7f493c1035c0 2024-04-20T12:24:09.201 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f493affd640 1 --2- 172.21.15.135:0/870950169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f493c106180 0x7f493c103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f493bfff640 1 --2- 172.21.15.135:0/870950169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c1035c0 0x7f493c1a6960 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f493400eaa0 tx=0x7f493400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f4938ff9640 1 -- 172.21.15.135:0/870950169 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493400cdb0 con 0x7f493c1035c0 2024-04-20T12:24:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f4938ff9640 1 -- 172.21.15.135:0/870950169 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4934005020 con 0x7f493c1035c0 2024-04-20T12:24:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f4942055640 1 -- 172.21.15.135:0/870950169 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493c1a7350 con 0x7f493c1035c0 2024-04-20T12:24:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.199+0000 7f4938ff9640 1 -- 172.21.15.135:0/870950169 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49340116b0 con 0x7f493c1035c0 2024-04-20T12:24:09.202 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.200+0000 7f4942055640 1 -- 172.21.15.135:0/870950169 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f493c1a7870 con 0x7f493c1035c0 2024-04-20T12:24:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.202+0000 7f4938ff9640 1 -- 172.21.15.135:0/870950169 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 138931+0+0 (secure 0 0 0) 0x7f4934005560 con 0x7f493c1035c0 2024-04-20T12:24:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.202+0000 7f4944c48740 1 Processor -- start 2024-04-20T12:24:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f4944c48740 1 -- start start 2024-04-20T12:24:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f4944c48740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704110 0x5611c87044f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f4944c48740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704a30 0x5611c870d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f4944c48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c870d800 0x5611c870fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f4944c48740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5611c8669820 con 0x5611c8704a30 2024-04-20T12:24:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f4944c48740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5611c8606fc0 con 0x5611c8704110 2024-04-20T12:24:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f4944c48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5611c86657e0 con 0x5611c870d800 2024-04-20T12:24:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f493b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704a30 0x5611c870d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f493b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704a30 0x5611c870d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60082/0 (socket says 172.21.15.135:60082) 2024-04-20T12:24:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f493b7fe640 1 -- 172.21.15.135:0/3138036739 learned_addr learned my addr 172.21.15.135:0/3138036739 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f4938ff9640 1 --2- 172.21.15.135:0/870950169 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f49240a4030 0x7f49240a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f493affd640 1 --2- 172.21.15.135:0/3138036739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704110 0x5611c87044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f493affd640 1 --2- 172.21.15.135:0/3138036739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c870d800 0x5611c870fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f4938ff9640 1 -- 172.21.15.135:0/870950169 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f49340d0ee0 con 0x7f493c1035c0 2024-04-20T12:24:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f493b7fe640 1 -- 172.21.15.135:0/3138036739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c870d800 msgr2=0x5611c870fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f493b7fe640 1 --2- 172.21.15.135:0/3138036739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c870d800 0x5611c870fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f493b7fe640 1 -- 172.21.15.135:0/3138036739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704110 msgr2=0x5611c87044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f493b7fe640 1 --2- 172.21.15.135:0/3138036739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704110 0x5611c87044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f493b7fe640 1 -- 172.21.15.135:0/3138036739 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611c837c210 con 0x5611c8704a30 2024-04-20T12:24:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.203+0000 7f493affd640 1 --2- 172.21.15.135:0/3138036739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704110 0x5611c87044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.204+0000 7f493bfff640 1 --2- 172.21.15.135:0/870950169 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f49240a4030 0x7f49240a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.204+0000 7f493b7fe640 1 --2- 172.21.15.135:0/3138036739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704a30 0x5611c870d2c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f492c00bd10 tx=0x7f492c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2256f8966e9024b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.204+0000 7f493bfff640 1 --2- 172.21.15.135:0/870950169 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f49240a4030 0x7f49240a64f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f49340ce0d0 tx=0x7f4934005850 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.204+0000 7f4921ffb640 1 -- 172.21.15.135:0/3138036739 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c004030 con 0x5611c8704a30 2024-04-20T12:24:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.204+0000 7f4921ffb640 1 -- 172.21.15.135:0/3138036739 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f492c0041d0 con 0x5611c8704a30 2024-04-20T12:24:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.204+0000 7f4921ffb640 1 -- 172.21.15.135:0/3138036739 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c011800 con 0x5611c8704a30 2024-04-20T12:24:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.205+0000 7f4944c48740 1 -- 172.21.15.135:0/3138036739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704a30 msgr2=0x5611c870d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.205+0000 7f4944c48740 1 --2- 172.21.15.135:0/3138036739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704a30 0x5611c870d2c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f492c00bd10 tx=0x7f492c0107a0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.205+0000 7f4944c48740 1 -- 172.21.15.135:0/3138036739 shutdown_connections 2024-04-20T12:24:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.205+0000 7f4944c48740 1 --2- 172.21.15.135:0/3138036739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c870d800 0x5611c870fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.205+0000 7f4944c48740 1 --2- 172.21.15.135:0/3138036739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704a30 0x5611c870d2c0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.205+0000 7f4944c48740 1 --2- 172.21.15.135:0/3138036739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704110 0x5611c87044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.205+0000 7f4944c48740 1 -- 172.21.15.135:0/3138036739 >> 172.21.15.135:0/3138036739 conn(0x5611c86fea30 msgr2=0x5611c86fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.205+0000 7f4944c48740 1 -- 172.21.15.135:0/3138036739 shutdown_connections 2024-04-20T12:24:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.205+0000 7f4944c48740 1 -- 172.21.15.135:0/3138036739 wait complete. 2024-04-20T12:24:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.205+0000 7f4944c48740 1 -- start start 2024-04-20T12:24:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f4944c48740 1 Processor -- start 2024-04-20T12:24:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f4944c48740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704110 0x5611c870a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f4944c48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c8704a30 0x5611c870ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f4944c48740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c870d800 0x5611c870b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f4944c48740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5611c8710430 con 0x5611c870d800 2024-04-20T12:24:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f4944c48740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5611c85f1ee0 con 0x5611c8704110 2024-04-20T12:24:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f4944c48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5611c87105b0 con 0x5611c8704a30 2024-04-20T12:24:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f4944c48740 10 client.0 _ll_register_callbacks cb 0x5611c8607d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f493affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c870d800 0x5611c870b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f493affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c870d800 0x5611c870b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60090/0 (socket says 172.21.15.135:60090) 2024-04-20T12:24:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f493affd640 1 -- 172.21.15.135:0/2501136684 learned_addr learned my addr 172.21.15.135:0/2501136684 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f493affd640 1 --2- 172.21.15.135:0/2501136684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704110 0x5611c870a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f493b7fe640 1 --2- 172.21.15.135:0/2501136684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c8704a30 0x5611c870ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f493affd640 1 -- 172.21.15.135:0/2501136684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c8704a30 msgr2=0x5611c870ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f493affd640 1 --2- 172.21.15.135:0/2501136684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c8704a30 0x5611c870ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f493affd640 1 -- 172.21.15.135:0/2501136684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704110 msgr2=0x5611c870a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f493affd640 1 --2- 172.21.15.135:0/2501136684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704110 0x5611c870a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.206+0000 7f493affd640 1 -- 172.21.15.135:0/2501136684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611c8448620 con 0x5611c870d800 2024-04-20T12:24:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.207+0000 7f493affd640 1 --2- 172.21.15.135:0/2501136684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c870d800 0x5611c870b380 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f493002cfd0 tx=0x7f493002bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3eeb5da8a12db0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.207+0000 7f491affd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.207+0000 7f491affd640 1 -- 172.21.15.135:0/2501136684 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49300055e0 con 0x5611c870d800 2024-04-20T12:24:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.207+0000 7f491affd640 1 -- 172.21.15.135:0/2501136684 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f4930034440 con 0x5611c870d800 2024-04-20T12:24:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.207+0000 7f4944c48740 1 -- 172.21.15.135:0/2501136684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f492c0041d0 con 0x5611c870d800 2024-04-20T12:24:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.207+0000 7f491affd640 1 -- 172.21.15.135:0/2501136684 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4930034640 con 0x5611c870d800 2024-04-20T12:24:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.207+0000 7f4944c48740 10 client.16029 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.207+0000 7f4944c48740 1 -- 172.21.15.135:0/2501136684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5611c871c770 con 0x5611c870d800 2024-04-20T12:24:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.207+0000 7f491affd640 1 -- 172.21.15.135:0/2501136684 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f492c0041d0 con 0x5611c870d800 2024-04-20T12:24:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.208+0000 7f491affd640 1 -- 172.21.15.135:0/2501136684 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f493003f740 con 0x5611c870d800 2024-04-20T12:24:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.208+0000 7f4944c48740 10 client.16029 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.208+0000 7f4944c48740 10 client.16029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.208+0000 7f4944c48740 20 client.16029 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.208+0000 7f4944c48740 1 --2- 172.21.15.135:0/2501136684 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5611c871dbe0 0x5611c871ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.208+0000 7f4944c48740 4 client.16029 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.208+0000 7f4944c48740 1 -- 172.21.15.135:0/2501136684 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611c8677240 con 0x5611c871dbe0 2024-04-20T12:24:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.208+0000 7f493b7fe640 1 --2- 172.21.15.135:0/2501136684 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5611c871dbe0 0x5611c871ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.209+0000 7f493b7fe640 1 --2- 172.21.15.135:0/2501136684 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5611c871dbe0 0x5611c871ffd0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56566ebfafa9a2a9 server_cookie=6e74efb04476126b in_seq=0 out_seq=0 2024-04-20T12:24:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.209+0000 7f491affd640 10 client.16029 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.209+0000 7f491affd640 1 -- 172.21.15.135:0/2501136684 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5611c8677240 con 0x5611c871dbe0 2024-04-20T12:24:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.209+0000 7f491affd640 10 client.16029 handle_command_reply: tid=0 2024-04-20T12:24:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.209+0000 7f4944c48740 1 client.16029 shutdown 2024-04-20T12:24:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.210+0000 7f4944c48740 1 -- 172.21.15.135:0/2501136684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c870d800 msgr2=0x5611c870b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.210+0000 7f4944c48740 1 --2- 172.21.15.135:0/2501136684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c870d800 0x5611c870b380 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f493002cfd0 tx=0x7f493002bc30 comp rx=0 tx=0).stop 2024-04-20T12:24:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.210+0000 7f4944c48740 1 -- 172.21.15.135:0/2501136684 shutdown_connections 2024-04-20T12:24:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.210+0000 7f4944c48740 1 --2- 172.21.15.135:0/2501136684 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5611c871dbe0 0x5611c871ffd0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.210+0000 7f4944c48740 1 --2- 172.21.15.135:0/2501136684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c870d800 0x5611c870b380 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.210+0000 7f491affd640 0 client.16029 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.210+0000 7f4944c48740 1 --2- 172.21.15.135:0/2501136684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c8704a30 0x5611c870ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.210+0000 7f4944c48740 1 --2- 172.21.15.135:0/2501136684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704110 0x5611c870a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.210+0000 7f4944c48740 1 -- 172.21.15.135:0/2501136684 >> 172.21.15.135:0/2501136684 conn(0x5611c86fea30 msgr2=0x5611c8700780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.210+0000 7f4944c48740 1 -- 172.21.15.135:0/2501136684 shutdown_connections 2024-04-20T12:24:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.210+0000 7f4944c48740 1 -- 172.21.15.135:0/2501136684 wait complete. 2024-04-20T12:24:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.210+0000 7f4944c48740 20 client.16029 trim_cache size 0 max 16384 2024-04-20T12:24:09.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.238+0000 7f4944c48740 1 Processor -- start 2024-04-20T12:24:09.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.238+0000 7f4944c48740 1 -- start start 2024-04-20T12:24:09.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.238+0000 7f4944c48740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704110 0x5611c870d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.238+0000 7f4944c48740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704a30 0x5611c87192f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.239 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.238+0000 7f4944c48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c870d800 0x5611c86fd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.238+0000 7f4944c48740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f493c1b1600 con 0x5611c8704110 2024-04-20T12:24:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.238+0000 7f4944c48740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f493c1b3140 con 0x5611c8704a30 2024-04-20T12:24:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.238+0000 7f4944c48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f493c1b1cd0 con 0x5611c870d800 2024-04-20T12:24:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.238+0000 7f493affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704110 0x5611c870d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.238+0000 7f493affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704110 0x5611c870d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60102/0 (socket says 172.21.15.135:60102) 2024-04-20T12:24:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.238+0000 7f493affd640 1 -- 172.21.15.135:0/883869451 learned_addr learned my addr 172.21.15.135:0/883869451 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.239+0000 7f493b7fe640 1 --2- 172.21.15.135:0/883869451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704a30 0x5611c87192f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.239+0000 7f493affd640 1 --2- 172.21.15.135:0/883869451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c870d800 0x5611c86fd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.239+0000 7f493affd640 1 -- 172.21.15.135:0/883869451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c870d800 msgr2=0x5611c86fd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.239+0000 7f493affd640 1 --2- 172.21.15.135:0/883869451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c870d800 0x5611c86fd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.239+0000 7f493affd640 1 -- 172.21.15.135:0/883869451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704a30 msgr2=0x5611c87192f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.239+0000 7f493affd640 1 --2- 172.21.15.135:0/883869451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704a30 0x5611c87192f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.240 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.239+0000 7f493affd640 1 -- 172.21.15.135:0/883869451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611c8703680 con 0x5611c8704110 2024-04-20T12:24:09.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.239+0000 7f493affd640 1 --2- 172.21.15.135:0/883869451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704110 0x5611c870d030 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f493002c170 tx=0x7f4930005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46be70c266c16ee3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:09.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.239+0000 7f49217fa640 1 -- 172.21.15.135:0/883869451 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49300055e0 con 0x5611c8704110 2024-04-20T12:24:09.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.239+0000 7f49217fa640 1 -- 172.21.15.135:0/883869451 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f493003f8f0 con 0x5611c8704110 2024-04-20T12:24:09.241 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.239+0000 7f49217fa640 1 -- 172.21.15.135:0/883869451 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493004e440 con 0x5611c8704110 2024-04-20T12:24:09.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.240+0000 7f4944c48740 1 -- 172.21.15.135:0/883869451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704110 msgr2=0x5611c870d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:09.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.240+0000 7f4944c48740 1 --2- 172.21.15.135:0/883869451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704110 0x5611c870d030 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f493002c170 tx=0x7f4930005fd0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.244 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.240+0000 7f4944c48740 1 -- 172.21.15.135:0/883869451 shutdown_connections 2024-04-20T12:24:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.240+0000 7f4944c48740 1 --2- 172.21.15.135:0/883869451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c870d800 0x5611c86fd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.240+0000 7f4944c48740 1 --2- 172.21.15.135:0/883869451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704a30 0x5611c87192f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.240+0000 7f4944c48740 1 --2- 172.21.15.135:0/883869451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704110 0x5611c870d030 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.240+0000 7f4944c48740 1 -- 172.21.15.135:0/883869451 >> 172.21.15.135:0/883869451 conn(0x5611c86fea30 msgr2=0x5611c86fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.240+0000 7f4944c48740 1 -- 172.21.15.135:0/883869451 shutdown_connections 2024-04-20T12:24:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.240+0000 7f4944c48740 1 -- 172.21.15.135:0/883869451 wait complete. 2024-04-20T12:24:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.241+0000 7f4944c48740 1 -- start start 2024-04-20T12:24:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.241+0000 7f4944c48740 1 Processor -- start 2024-04-20T12:24:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.241+0000 7f4944c48740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704110 0x5611c8715b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.241+0000 7f4944c48740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704a30 0x5611c8710ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.241+0000 7f4944c48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c870d800 0x5611c87113e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.241+0000 7f4944c48740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f493c1b2a70 con 0x5611c8704110 2024-04-20T12:24:09.245 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.241+0000 7f4944c48740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f493c1b23a0 con 0x5611c8704a30 2024-04-20T12:24:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.241+0000 7f493affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704110 0x5611c8715b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.241+0000 7f4944c48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f493c1af5d0 con 0x5611c870d800 2024-04-20T12:24:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.241+0000 7f493affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704110 0x5611c8715b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60118/0 (socket says 172.21.15.135:60118) 2024-04-20T12:24:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.241+0000 7f493affd640 1 -- 172.21.15.135:0/73843737 learned_addr learned my addr 172.21.15.135:0/73843737 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f4944c48740 10 client.0 _ll_register_callbacks cb 0x7f4930005060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f493affd640 1 --2- 172.21.15.135:0/73843737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c870d800 0x5611c87113e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f493b7fe640 1 --2- 172.21.15.135:0/73843737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704a30 0x5611c8710ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f493affd640 1 -- 172.21.15.135:0/73843737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c870d800 msgr2=0x5611c87113e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f493affd640 1 --2- 172.21.15.135:0/73843737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c870d800 0x5611c87113e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f493affd640 1 -- 172.21.15.135:0/73843737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704a30 msgr2=0x5611c8710ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f493affd640 1 --2- 172.21.15.135:0/73843737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704a30 0x5611c8710ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.246 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f493affd640 1 -- 172.21.15.135:0/73843737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611c8711b20 con 0x5611c8704110 2024-04-20T12:24:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f493affd640 1 --2- 172.21.15.135:0/73843737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704110 0x5611c8715b30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f493003fb10 tx=0x7f4930005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8c04e526fca2d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f491affd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f491affd640 1 -- 172.21.15.135:0/73843737 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49300349e0 con 0x5611c8704110 2024-04-20T12:24:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f491affd640 1 -- 172.21.15.135:0/73843737 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f493005d430 con 0x5611c8704110 2024-04-20T12:24:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f4944c48740 1 -- 172.21.15.135:0/73843737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f493003f8f0 con 0x5611c8704110 2024-04-20T12:24:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f491affd640 1 -- 172.21.15.135:0/73843737 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f493005d630 con 0x5611c8704110 2024-04-20T12:24:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f4944c48740 10 client.16035 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.242+0000 7f4944c48740 1 -- 172.21.15.135:0/73843737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5611c8784090 con 0x5611c8704110 2024-04-20T12:24:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.243+0000 7f491affd640 1 -- 172.21.15.135:0/73843737 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f493003f8f0 con 0x5611c8704110 2024-04-20T12:24:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.243+0000 7f491affd640 1 -- 172.21.15.135:0/73843737 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f493005f420 con 0x5611c8704110 2024-04-20T12:24:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.243+0000 7f4944c48740 10 client.16035 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.243+0000 7f4944c48740 10 client.16035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.243+0000 7f4944c48740 20 client.16035 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:09.247 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.243+0000 7f4944c48740 1 --2- 172.21.15.135:0/73843737 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5611c871dbe0 0x5611c8786790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.243+0000 7f4944c48740 4 client.16035 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-20T12:24:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.243+0000 7f4944c48740 1 -- 172.21.15.135:0/73843737 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5611c86710b0 con 0x5611c871dbe0 2024-04-20T12:24:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.243+0000 7f493b7fe640 1 --2- 172.21.15.135:0/73843737 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5611c871dbe0 0x5611c8786790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.244+0000 7f491affd640 10 client.16035 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:09.248 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.244+0000 7f493b7fe640 1 --2- 172.21.15.135:0/73843737 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5611c871dbe0 0x5611c8786790 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=314b43684340ab92 server_cookie=4e3ad069b5a791d6 in_seq=0 out_seq=0 2024-04-20T12:24:09.250 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.250+0000 7f491affd640 1 -- 172.21.15.135:0/73843737 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5611c86710b0 con 0x5611c871dbe0 2024-04-20T12:24:09.250 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.250+0000 7f491affd640 10 client.16035 handle_command_reply: tid=0 2024-04-20T12:24:09.250 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.250+0000 7f4944c48740 1 client.16035 shutdown 2024-04-20T12:24:09.250 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.250+0000 7f4944c48740 1 -- 172.21.15.135:0/73843737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704110 msgr2=0x5611c8715b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.250+0000 7f4944c48740 1 --2- 172.21.15.135:0/73843737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704110 0x5611c8715b30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f493003fb10 tx=0x7f4930005c90 comp rx=0 tx=0).stop 2024-04-20T12:24:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.250+0000 7f4944c48740 1 -- 172.21.15.135:0/73843737 shutdown_connections 2024-04-20T12:24:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.250+0000 7f4944c48740 1 --2- 172.21.15.135:0/73843737 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5611c871dbe0 0x5611c8786790 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.250+0000 7f4944c48740 1 --2- 172.21.15.135:0/73843737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5611c870d800 0x5611c87113e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.250+0000 7f4944c48740 1 --2- 172.21.15.135:0/73843737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5611c8704a30 0x5611c8710ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.250+0000 7f491affd640 0 client.16035 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.250+0000 7f4944c48740 1 --2- 172.21.15.135:0/73843737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611c8704110 0x5611c8715b30 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.250+0000 7f4944c48740 1 -- 172.21.15.135:0/73843737 >> 172.21.15.135:0/73843737 conn(0x5611c86fea30 msgr2=0x5611c870b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.250+0000 7f4944c48740 1 -- 172.21.15.135:0/73843737 shutdown_connections 2024-04-20T12:24:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.250+0000 7f4944c48740 1 -- 172.21.15.135:0/73843737 wait complete. 2024-04-20T12:24:09.251 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.250+0000 7f4944c48740 20 client.16035 trim_cache size 0 max 16384 2024-04-20T12:24:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-04-20T12:24:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-04-20T12:24:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-04-20T12:24:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-04-20T12:24:09.252 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.251+0000 7f4942055640 1 -- 172.21.15.135:0/870950169 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f49240a4030 msgr2=0x7f49240a64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:09.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.251+0000 7f4942055640 1 --2- 172.21.15.135:0/870950169 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f49240a4030 0x7f49240a64f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f49340ce0d0 tx=0x7f4934005850 comp rx=0 tx=0).stop 2024-04-20T12:24:09.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.251+0000 7f4942055640 1 -- 172.21.15.135:0/870950169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c1035c0 msgr2=0x7f493c1a6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:09.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.251+0000 7f4942055640 1 --2- 172.21.15.135:0/870950169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c1035c0 0x7f493c1a6960 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f493400eaa0 tx=0x7f493400ef60 comp rx=0 tx=0).stop 2024-04-20T12:24:09.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.251+0000 7f4942055640 1 -- 172.21.15.135:0/870950169 shutdown_connections 2024-04-20T12:24:09.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.251+0000 7f4942055640 1 --2- 172.21.15.135:0/870950169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f493c1035c0 0x7f493c1a6960 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.251+0000 7f4942055640 1 --2- 172.21.15.135:0/870950169 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f493c106180 0x7f493c103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.251+0000 7f4942055640 1 --2- 172.21.15.135:0/870950169 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f49240a4030 0x7f49240a64f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.251+0000 7f4942055640 1 --2- 172.21.15.135:0/870950169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f493c101100 0x7f493c102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:09.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.251+0000 7f4942055640 1 -- 172.21.15.135:0/870950169 >> 172.21.15.135:0/870950169 conn(0x7f493c077fe0 msgr2=0x7f493c069950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:09.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.251+0000 7f4942055640 1 -- 172.21.15.135:0/870950169 shutdown_connections 2024-04-20T12:24:09.253 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:09.251+0000 7f4942055640 1 -- 172.21.15.135:0/870950169 wait complete. 2024-04-20T12:24:10.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:10 smithi154 ceph-mon[22073]: pgmap v34: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 29 op/s 2024-04-20T12:24:10.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:10 smithi139 ceph-mon[21834]: pgmap v34: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 29 op/s 2024-04-20T12:24:10.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:10 smithi135 ceph-mon[18264]: pgmap v34: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 29 op/s 2024-04-20T12:24:12.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:12 smithi154 ceph-mon[22073]: pgmap v35: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-04-20T12:24:12.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:12 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:24:12.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:12 smithi139 ceph-mon[21834]: pgmap v35: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-04-20T12:24:12.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:12 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:24:12.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:12 smithi135 ceph-mon[18264]: pgmap v35: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-04-20T12:24:12.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:12 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:24:13.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:13 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:13 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:13 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:13 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:13 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:13 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:13 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:24:13.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:13 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:24:13.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:13 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:13 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:13 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:13 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:13 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:13 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:13 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:13 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:24:13.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:13 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:24:13.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:13 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:13 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:13 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:13 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:13 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:13 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:13 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:13.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:13 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:24:13.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:13 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:24:13.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:13 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:24:14.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:14 smithi135 ceph-mon[18264]: pgmap v36: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-20T12:24:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:14 smithi154 ceph-mon[22073]: pgmap v36: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-20T12:24:15.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:14 smithi139 ceph-mon[21834]: pgmap v36: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 28 op/s 2024-04-20T12:24:16.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:16 smithi135 ceph-mon[18264]: pgmap v37: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1023 B/s wr, 11 op/s 2024-04-20T12:24:17.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:16 smithi154 ceph-mon[22073]: pgmap v37: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1023 B/s wr, 11 op/s 2024-04-20T12:24:17.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:16 smithi139 ceph-mon[21834]: pgmap v37: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1023 B/s wr, 11 op/s 2024-04-20T12:24:17.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:24:17.877 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:24:17.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.983+0000 7f987744a640 1 -- 172.21.15.135:0/3488753626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98701010a0 msgr2=0x7f9870101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:17.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.983+0000 7f987744a640 1 --2- 172.21.15.135:0/3488753626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98701010a0 0x7f9870101480 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f986c009900 tx=0x7f986c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:24:17.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.983+0000 7f987744a640 1 -- 172.21.15.135:0/3488753626 shutdown_connections 2024-04-20T12:24:17.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.983+0000 7f987744a640 1 --2- 172.21.15.135:0/3488753626 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9870106170 0x7f987010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.983+0000 7f987744a640 1 --2- 172.21.15.135:0/3488753626 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9870101a50 0x7f9870105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.983+0000 7f987744a640 1 --2- 172.21.15.135:0/3488753626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98701010a0 0x7f9870101480 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.983+0000 7f987744a640 1 -- 172.21.15.135:0/3488753626 >> 172.21.15.135:0/3488753626 conn(0x7f9870077f60 msgr2=0x7f9870078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:17.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.983+0000 7f987744a640 1 -- 172.21.15.135:0/3488753626 shutdown_connections 2024-04-20T12:24:17.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.983+0000 7f987744a640 1 -- 172.21.15.135:0/3488753626 wait complete. 2024-04-20T12:24:17.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.984+0000 7f987744a640 1 Processor -- start 2024-04-20T12:24:17.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.984+0000 7f987744a640 1 -- start start 2024-04-20T12:24:17.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.984+0000 7f987744a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98701010a0 0x7f9870196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:17.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.984+0000 7f987744a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9870106170 0x7f9870196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:17.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.984+0000 7f987744a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f987019aec0 0x7f987019b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:17.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.984+0000 7f987744a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9870110120 con 0x7f987019aec0 2024-04-20T12:24:17.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.984+0000 7f987744a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f987010ffa0 con 0x7f98701010a0 2024-04-20T12:24:17.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.984+0000 7f987744a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98701102a0 con 0x7f9870106170 2024-04-20T12:24:17.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.984+0000 7f98759e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f987019aec0 0x7f987019b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:17.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.984+0000 7f98759e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f987019aec0 0x7f987019b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39248/0 (socket says 172.21.15.135:39248) 2024-04-20T12:24:17.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.984+0000 7f98759e7640 1 -- 172.21.15.135:0/785988654 learned_addr learned my addr 172.21.15.135:0/785988654 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:17.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.984+0000 7f98749e5640 1 --2- 172.21.15.135:0/785988654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9870106170 0x7f9870196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:17.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.984+0000 7f98751e6640 1 --2- 172.21.15.135:0/785988654 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98701010a0 0x7f9870196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:17.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.985+0000 7f98759e7640 1 -- 172.21.15.135:0/785988654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9870106170 msgr2=0x7f9870196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:17.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.985+0000 7f98759e7640 1 --2- 172.21.15.135:0/785988654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9870106170 0x7f9870196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.985+0000 7f98759e7640 1 -- 172.21.15.135:0/785988654 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98701010a0 msgr2=0x7f9870196600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:17.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.985+0000 7f98759e7640 1 --2- 172.21.15.135:0/785988654 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98701010a0 0x7f9870196600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.985+0000 7f98759e7640 1 -- 172.21.15.135:0/785988654 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987019b9b0 con 0x7f987019aec0 2024-04-20T12:24:17.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.985+0000 7f98759e7640 1 --2- 172.21.15.135:0/785988654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f987019aec0 0x7f987019b370 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9868010f90 tx=0x7f986800e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:17.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.985+0000 7f98667fc640 1 -- 172.21.15.135:0/785988654 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986801a030 con 0x7f987019aec0 2024-04-20T12:24:17.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.985+0000 7f987744a640 1 -- 172.21.15.135:0/785988654 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987019bca0 con 0x7f987019aec0 2024-04-20T12:24:17.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.985+0000 7f98667fc640 1 -- 172.21.15.135:0/785988654 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f986800ed30 con 0x7f987019aec0 2024-04-20T12:24:17.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.985+0000 7f98667fc640 1 -- 172.21.15.135:0/785988654 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868016480 con 0x7f987019aec0 2024-04-20T12:24:17.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.985+0000 7f987744a640 1 -- 172.21.15.135:0/785988654 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98701a3490 con 0x7f987019aec0 2024-04-20T12:24:17.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.988+0000 7f98667fc640 1 -- 172.21.15.135:0/785988654 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 138931+0+0 (secure 0 0 0) 0x7f986801d070 con 0x7f987019aec0 2024-04-20T12:24:17.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.988+0000 7f98667fc640 1 --2- 172.21.15.135:0/785988654 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f985c0a8360 0x7f985c0aa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:17.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.988+0000 7f987a03e740 1 Processor -- start 2024-04-20T12:24:17.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.989+0000 7f98667fc640 1 -- 172.21.15.135:0/785988654 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f98680d0f80 con 0x7f987019aec0 2024-04-20T12:24:17.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.989+0000 7f98751e6640 1 --2- 172.21.15.135:0/785988654 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f985c0a8360 0x7f985c0aa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:17.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.989+0000 7f987a03e740 1 -- start start 2024-04-20T12:24:17.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.989+0000 7f987a03e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 0x55829408e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:17.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.989+0000 7f987a03e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408e640 0x558294096ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:17.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.989+0000 7f987a03e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558294097220 0x558294099610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:17.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.989+0000 7f987a03e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558293ff31b0 con 0x55829408e640 2024-04-20T12:24:17.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.989+0000 7f987a03e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558293f90390 con 0x558294097220 2024-04-20T12:24:17.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.989+0000 7f987a03e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558293fef170 con 0x55829408dd20 2024-04-20T12:24:17.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.989+0000 7f98749e5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408e640 0x558294096ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:17.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.989+0000 7f98749e5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408e640 0x558294096ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39254/0 (socket says 172.21.15.135:39254) 2024-04-20T12:24:17.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.989+0000 7f98749e5640 1 -- 172.21.15.135:0/3407478913 learned_addr learned my addr 172.21.15.135:0/3407478913 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:17.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.989+0000 7f98751e6640 1 --2- 172.21.15.135:0/785988654 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f985c0a8360 0x7f985c0aa820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f986c006010 tx=0x7f986c000bc0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:17.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.989+0000 7f98759e7640 1 --2- 172.21.15.135:0/3407478913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558294097220 0x558294099610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:17.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.990+0000 7f98759e7640 1 -- 172.21.15.135:0/3407478913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 msgr2=0x55829408e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:17.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.990+0000 7f98751e6640 1 --2- 172.21.15.135:0/3407478913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 0x55829408e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:17.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.990+0000 7f98759e7640 1 --2- 172.21.15.135:0/3407478913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 0x55829408e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.990+0000 7f98759e7640 1 -- 172.21.15.135:0/3407478913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408e640 msgr2=0x558294096ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:17.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.990+0000 7f98759e7640 1 --2- 172.21.15.135:0/3407478913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408e640 0x558294096ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.990+0000 7f98759e7640 1 -- 172.21.15.135:0/3407478913 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558293dcf7d0 con 0x558294097220 2024-04-20T12:24:17.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.990+0000 7f98749e5640 1 --2- 172.21.15.135:0/3407478913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408e640 0x558294096ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:17.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.990+0000 7f98751e6640 1 --2- 172.21.15.135:0/3407478913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 0x55829408e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:24:17.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.990+0000 7f98759e7640 1 --2- 172.21.15.135:0/3407478913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558294097220 0x558294099610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f98680ce110 tx=0x7f986809c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=793f933094b42222 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:17.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.990+0000 7f985b7fe640 1 -- 172.21.15.135:0/3407478913 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680a0d10 con 0x558294097220 2024-04-20T12:24:17.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.990+0000 7f985b7fe640 1 -- 172.21.15.135:0/3407478913 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98680a55d0 con 0x558294097220 2024-04-20T12:24:17.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.990+0000 7f985b7fe640 1 -- 172.21.15.135:0/3407478913 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98680870c0 con 0x558294097220 2024-04-20T12:24:17.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.991+0000 7f987a03e740 1 -- 172.21.15.135:0/3407478913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558294097220 msgr2=0x558294099610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:17.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.991+0000 7f987a03e740 1 --2- 172.21.15.135:0/3407478913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558294097220 0x558294099610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f98680ce110 tx=0x7f986809c2c0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.991+0000 7f987a03e740 1 -- 172.21.15.135:0/3407478913 shutdown_connections 2024-04-20T12:24:17.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.991+0000 7f987a03e740 1 --2- 172.21.15.135:0/3407478913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558294097220 0x558294099610 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.991+0000 7f987a03e740 1 --2- 172.21.15.135:0/3407478913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408e640 0x558294096ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.991+0000 7f987a03e740 1 --2- 172.21.15.135:0/3407478913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 0x55829408e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.991+0000 7f987a03e740 1 -- 172.21.15.135:0/3407478913 >> 172.21.15.135:0/3407478913 conn(0x558294088450 msgr2=0x558294088830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:17.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.991+0000 7f987a03e740 1 -- 172.21.15.135:0/3407478913 shutdown_connections 2024-04-20T12:24:17.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.991+0000 7f987a03e740 1 -- 172.21.15.135:0/3407478913 wait complete. 2024-04-20T12:24:17.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.992+0000 7f987a03e740 1 -- start start 2024-04-20T12:24:17.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.992+0000 7f987a03e740 1 Processor -- start 2024-04-20T12:24:17.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.992+0000 7f987a03e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 0x558294094350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:17.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.992+0000 7f987a03e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55829408e640 0x558294094890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:17.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.992+0000 7f987a03e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558294097220 0x558294094dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:17.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.992+0000 7f987a03e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5582940a2820 con 0x558294097220 2024-04-20T12:24:17.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.992+0000 7f987a03e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558293fac2f0 con 0x55829408e640 2024-04-20T12:24:17.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.992+0000 7f987a03e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5582940a29a0 con 0x55829408dd20 2024-04-20T12:24:17.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.992+0000 7f987a03e740 10 client.0 _ll_register_callbacks cb 0x558293f764e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:17.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.992+0000 7f98759e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558294097220 0x558294094dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:17.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.992+0000 7f98759e7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558294097220 0x558294094dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39264/0 (socket says 172.21.15.135:39264) 2024-04-20T12:24:17.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.992+0000 7f98759e7640 1 -- 172.21.15.135:0/3571975331 learned_addr learned my addr 172.21.15.135:0/3571975331 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:17.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.993+0000 7f98751e6640 1 --2- 172.21.15.135:0/3571975331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 0x558294094350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:17.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.993+0000 7f98759e7640 1 -- 172.21.15.135:0/3571975331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 msgr2=0x558294094350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:17.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.993+0000 7f98759e7640 1 --2- 172.21.15.135:0/3571975331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 0x558294094350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.993+0000 7f98759e7640 1 -- 172.21.15.135:0/3571975331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55829408e640 msgr2=0x558294094890 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-20T12:24:17.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.993+0000 7f98759e7640 1 --2- 172.21.15.135:0/3571975331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55829408e640 0x558294094890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.993+0000 7f98759e7640 1 -- 172.21.15.135:0/3571975331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558293d053f0 con 0x558294097220 2024-04-20T12:24:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.993+0000 7f98751e6640 1 --2- 172.21.15.135:0/3571975331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 0x558294094350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.993+0000 7f98759e7640 1 --2- 172.21.15.135:0/3571975331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558294097220 0x558294094dd0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f986800e990 tx=0x7f986809cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2f83ae0221dca6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.993+0000 7f9858ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.993+0000 7f9858ff9640 1 -- 172.21.15.135:0/3571975331 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868066060 con 0x558294097220 2024-04-20T12:24:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.993+0000 7f9858ff9640 1 -- 172.21.15.135:0/3571975331 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9868098fd0 con 0x558294097220 2024-04-20T12:24:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.993+0000 7f987a03e740 1 -- 172.21.15.135:0/3571975331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98680a55d0 con 0x558294097220 2024-04-20T12:24:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.993+0000 7f9858ff9640 1 -- 172.21.15.135:0/3571975331 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9868067250 con 0x558294097220 2024-04-20T12:24:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.994+0000 7f987a03e740 10 client.16047 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.994+0000 7f987a03e740 1 -- 172.21.15.135:0/3571975331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558293cc50f0 con 0x558294097220 2024-04-20T12:24:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.994+0000 7f9858ff9640 1 -- 172.21.15.135:0/3571975331 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98680a55d0 con 0x558294097220 2024-04-20T12:24:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.994+0000 7f9858ff9640 1 -- 172.21.15.135:0/3571975331 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f98680986b0 con 0x558294097220 2024-04-20T12:24:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.994+0000 7f987a03e740 10 client.16047 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.994+0000 7f987a03e740 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:17.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.994+0000 7f987a03e740 20 client.16047 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.994+0000 7f987a03e740 1 --2- 172.21.15.135:0/3571975331 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5582940afec0 0x5582940b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.994+0000 7f987a03e740 4 client.16047 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.994+0000 7f987a03e740 1 -- 172.21.15.135:0/3571975331 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558294000bd0 con 0x5582940afec0 2024-04-20T12:24:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.994+0000 7f98751e6640 1 --2- 172.21.15.135:0/3571975331 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5582940afec0 0x5582940b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.995+0000 7f9858ff9640 10 client.16047 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.995+0000 7f98751e6640 1 --2- 172.21.15.135:0/3571975331 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5582940afec0 0x5582940b2320 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f6e6daa980b9ceb server_cookie=e11bd074cdb99837 in_seq=0 out_seq=0 2024-04-20T12:24:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.995+0000 7f9858ff9640 1 -- 172.21.15.135:0/3571975331 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558294000bd0 con 0x5582940afec0 2024-04-20T12:24:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.995+0000 7f9858ff9640 10 client.16047 handle_command_reply: tid=0 2024-04-20T12:24:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.995+0000 7f987a03e740 1 client.16047 shutdown 2024-04-20T12:24:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.996+0000 7f987a03e740 1 -- 172.21.15.135:0/3571975331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558294097220 msgr2=0x558294094dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.996+0000 7f987a03e740 1 --2- 172.21.15.135:0/3571975331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558294097220 0x558294094dd0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f986800e990 tx=0x7f986809cae0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.996+0000 7f987a03e740 1 -- 172.21.15.135:0/3571975331 shutdown_connections 2024-04-20T12:24:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.996+0000 7f987a03e740 1 --2- 172.21.15.135:0/3571975331 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5582940afec0 0x5582940b2320 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.996+0000 7f987a03e740 1 --2- 172.21.15.135:0/3571975331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558294097220 0x558294094dd0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:17.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.996+0000 7f987a03e740 1 --2- 172.21.15.135:0/3571975331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55829408e640 0x558294094890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.996+0000 7f987a03e740 1 --2- 172.21.15.135:0/3571975331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 0x558294094350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.996+0000 7f987a03e740 1 -- 172.21.15.135:0/3571975331 >> 172.21.15.135:0/3571975331 conn(0x558294088450 msgr2=0x55829408a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.996+0000 7f9858ff9640 0 client.16047 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:18.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.996+0000 7f987a03e740 1 -- 172.21.15.135:0/3571975331 shutdown_connections 2024-04-20T12:24:18.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.996+0000 7f987a03e740 1 -- 172.21.15.135:0/3571975331 wait complete. 2024-04-20T12:24:18.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:17.996+0000 7f987a03e740 20 client.16047 trim_cache size 0 max 16384 2024-04-20T12:24:18.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.013+0000 7f987a03e740 1 Processor -- start 2024-04-20T12:24:18.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.014+0000 7f987a03e740 1 -- start start 2024-04-20T12:24:18.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.014+0000 7f987a03e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408dd20 0x558294096a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.014+0000 7f987a03e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55829408e640 0x5582940ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.014+0000 7f987a03e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558294097220 0x558294094bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.014+0000 7f987a03e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f98701ad180 con 0x55829408dd20 2024-04-20T12:24:18.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.014+0000 7f987a03e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f98701aecc0 con 0x55829408e640 2024-04-20T12:24:18.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.014+0000 7f987a03e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98701ad850 con 0x558294097220 2024-04-20T12:24:18.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.014+0000 7f98751e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408dd20 0x558294096a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.014+0000 7f98751e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408dd20 0x558294096a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39276/0 (socket says 172.21.15.135:39276) 2024-04-20T12:24:18.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.014+0000 7f98751e6640 1 -- 172.21.15.135:0/1210597107 learned_addr learned my addr 172.21.15.135:0/1210597107 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.014+0000 7f98749e5640 1 --2- 172.21.15.135:0/1210597107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55829408e640 0x5582940ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.014+0000 7f98759e7640 1 --2- 172.21.15.135:0/1210597107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558294097220 0x558294094bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.014+0000 7f98751e6640 1 -- 172.21.15.135:0/1210597107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558294097220 msgr2=0x558294094bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.014+0000 7f98751e6640 1 --2- 172.21.15.135:0/1210597107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558294097220 0x558294094bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.015+0000 7f98751e6640 1 -- 172.21.15.135:0/1210597107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55829408e640 msgr2=0x5582940ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.015+0000 7f98751e6640 1 --2- 172.21.15.135:0/1210597107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55829408e640 0x5582940ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.015+0000 7f98751e6640 1 -- 172.21.15.135:0/1210597107 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558294095130 con 0x55829408dd20 2024-04-20T12:24:18.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.015+0000 7f98751e6640 1 --2- 172.21.15.135:0/1210597107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408dd20 0x558294096a80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f986c02c170 tx=0x7f986c03d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9e456f4f488e19 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.015+0000 7f985affd640 1 -- 172.21.15.135:0/1210597107 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c058070 con 0x55829408dd20 2024-04-20T12:24:18.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.015+0000 7f985affd640 1 -- 172.21.15.135:0/1210597107 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f986c0046c0 con 0x55829408dd20 2024-04-20T12:24:18.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.015+0000 7f985affd640 1 -- 172.21.15.135:0/1210597107 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c003850 con 0x55829408dd20 2024-04-20T12:24:18.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.016+0000 7f987a03e740 1 -- 172.21.15.135:0/1210597107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408dd20 msgr2=0x558294096a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.016+0000 7f987a03e740 1 --2- 172.21.15.135:0/1210597107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408dd20 0x558294096a80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f986c02c170 tx=0x7f986c03d000 comp rx=0 tx=0).stop 2024-04-20T12:24:18.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.016+0000 7f987a03e740 1 -- 172.21.15.135:0/1210597107 shutdown_connections 2024-04-20T12:24:18.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.016+0000 7f987a03e740 1 --2- 172.21.15.135:0/1210597107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558294097220 0x558294094bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.016+0000 7f987a03e740 1 --2- 172.21.15.135:0/1210597107 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55829408e640 0x5582940ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.016+0000 7f987a03e740 1 --2- 172.21.15.135:0/1210597107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408dd20 0x558294096a80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.016+0000 7f987a03e740 1 -- 172.21.15.135:0/1210597107 >> 172.21.15.135:0/1210597107 conn(0x558294088450 msgr2=0x55829408f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.016+0000 7f987a03e740 1 -- 172.21.15.135:0/1210597107 shutdown_connections 2024-04-20T12:24:18.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.016+0000 7f987a03e740 1 -- 172.21.15.135:0/1210597107 wait complete. 2024-04-20T12:24:18.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.016+0000 7f987a03e740 1 -- start start 2024-04-20T12:24:18.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.016+0000 7f987a03e740 1 Processor -- start 2024-04-20T12:24:18.020 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f987a03e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 0x5582940a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f987a03e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408e640 0x5582940a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f987a03e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558294097220 0x5582940a5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f987a03e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f98701ae5f0 con 0x55829408e640 2024-04-20T12:24:18.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f987a03e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f98701adf20 con 0x558294097220 2024-04-20T12:24:18.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f987a03e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98701ab150 con 0x55829408dd20 2024-04-20T12:24:18.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f987a03e740 10 client.0 _ll_register_callbacks cb 0x7f98680b4070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:18.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f98749e5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408e640 0x5582940a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f98749e5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408e640 0x5582940a4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39284/0 (socket says 172.21.15.135:39284) 2024-04-20T12:24:18.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f98749e5640 1 -- 172.21.15.135:0/1131846072 learned_addr learned my addr 172.21.15.135:0/1131846072 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f98751e6640 1 --2- 172.21.15.135:0/1131846072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 0x5582940a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f98759e7640 1 --2- 172.21.15.135:0/1131846072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558294097220 0x5582940a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f98751e6640 1 -- 172.21.15.135:0/1131846072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558294097220 msgr2=0x5582940a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f98751e6640 1 --2- 172.21.15.135:0/1131846072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558294097220 0x5582940a5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f98751e6640 1 -- 172.21.15.135:0/1131846072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408e640 msgr2=0x5582940a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f98751e6640 1 --2- 172.21.15.135:0/1131846072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408e640 0x5582940a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f98751e6640 1 -- 172.21.15.135:0/1131846072 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582940a5930 con 0x55829408dd20 2024-04-20T12:24:18.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f98759e7640 1 --2- 172.21.15.135:0/1131846072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558294097220 0x5582940a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:24:18.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.017+0000 7f98749e5640 1 --2- 172.21.15.135:0/1131846072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408e640 0x5582940a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:18.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.018+0000 7f98751e6640 1 --2- 172.21.15.135:0/1131846072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 0x5582940a7fa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f986c005940 tx=0x7f986c004d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcbc86ec878ddb3e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.018+0000 7f9858ff9640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-20T12:24:18.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.018+0000 7f9858ff9640 1 -- 172.21.15.135:0/1131846072 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c061060 con 0x55829408dd20 2024-04-20T12:24:18.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.018+0000 7f987a03e740 1 -- 172.21.15.135:0/1131846072 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f986c0046c0 con 0x55829408dd20 2024-04-20T12:24:18.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.018+0000 7f9858ff9640 1 -- 172.21.15.135:0/1131846072 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f986c004a80 con 0x55829408dd20 2024-04-20T12:24:18.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.018+0000 7f9858ff9640 1 -- 172.21.15.135:0/1131846072 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f986c058030 con 0x55829408dd20 2024-04-20T12:24:18.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.018+0000 7f987a03e740 10 client.25492 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:18.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.018+0000 7f987a03e740 1 -- 172.21.15.135:0/1131846072 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558294115410 con 0x55829408dd20 2024-04-20T12:24:18.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.018+0000 7f9858ff9640 1 -- 172.21.15.135:0/1131846072 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f986c0055e0 con 0x55829408dd20 2024-04-20T12:24:18.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.019+0000 7f9858ff9640 1 -- 172.21.15.135:0/1131846072 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f986c03d420 con 0x55829408dd20 2024-04-20T12:24:18.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.019+0000 7f987a03e740 10 client.25492 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:18.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.019+0000 7f987a03e740 10 client.25492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:18.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.019+0000 7f987a03e740 20 client.25492 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:18.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.019+0000 7f987a03e740 1 --2- 172.21.15.135:0/1131846072 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558294115ac0 0x558294117ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.019+0000 7f987a03e740 4 client.25492 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:24:18.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.019+0000 7f987a03e740 1 -- 172.21.15.135:0/1131846072 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f986c0046c0 con 0x558294115ac0 2024-04-20T12:24:18.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.019+0000 7f98749e5640 1 --2- 172.21.15.135:0/1131846072 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558294115ac0 0x558294117ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.019+0000 7f9858ff9640 10 client.25492 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:18.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.019+0000 7f98749e5640 1 --2- 172.21.15.135:0/1131846072 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558294115ac0 0x558294117ee0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc0ff59e074fa7c4 server_cookie=f96f4a0e8d14a5af in_seq=0 out_seq=0 2024-04-20T12:24:18.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.019+0000 7f9858ff9640 1 -- 172.21.15.135:0/1131846072 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f986c0046c0 con 0x558294115ac0 2024-04-20T12:24:18.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.019+0000 7f9858ff9640 10 client.25492 handle_command_reply: tid=0 2024-04-20T12:24:18.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987a03e740 1 client.25492 shutdown 2024-04-20T12:24:18.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987a03e740 1 -- 172.21.15.135:0/1131846072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 msgr2=0x5582940a7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.023 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987a03e740 1 --2- 172.21.15.135:0/1131846072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 0x5582940a7fa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f986c005940 tx=0x7f986c004d60 comp rx=0 tx=0).stop 2024-04-20T12:24:18.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987a03e740 1 -- 172.21.15.135:0/1131846072 shutdown_connections 2024-04-20T12:24:18.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987a03e740 1 --2- 172.21.15.135:0/1131846072 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558294115ac0 0x558294117ee0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987a03e740 1 --2- 172.21.15.135:0/1131846072 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558294097220 0x5582940a5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f9858ff9640 0 client.25492 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:18.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987a03e740 1 --2- 172.21.15.135:0/1131846072 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55829408e640 0x5582940a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987a03e740 1 --2- 172.21.15.135:0/1131846072 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55829408dd20 0x5582940a7fa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987a03e740 1 -- 172.21.15.135:0/1131846072 >> 172.21.15.135:0/1131846072 conn(0x558294088450 msgr2=0x558294086da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987a03e740 1 -- 172.21.15.135:0/1131846072 shutdown_connections 2024-04-20T12:24:18.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987a03e740 1 -- 172.21.15.135:0/1131846072 wait complete. 2024-04-20T12:24:18.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987a03e740 20 client.25492 trim_cache size 0 max 16384 2024-04-20T12:24:18.024 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:24:18.025 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:24:18.025 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:24:18.025 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:24:18.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987744a640 1 -- 172.21.15.135:0/785988654 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f985c0a8360 msgr2=0x7f985c0aa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987744a640 1 --2- 172.21.15.135:0/785988654 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f985c0a8360 0x7f985c0aa820 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f986c006010 tx=0x7f986c000bc0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987744a640 1 -- 172.21.15.135:0/785988654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f987019aec0 msgr2=0x7f987019b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.020+0000 7f987744a640 1 --2- 172.21.15.135:0/785988654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f987019aec0 0x7f987019b370 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9868010f90 tx=0x7f986800e490 comp rx=0 tx=0).stop 2024-04-20T12:24:18.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.021+0000 7f987744a640 1 -- 172.21.15.135:0/785988654 shutdown_connections 2024-04-20T12:24:18.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.021+0000 7f987744a640 1 --2- 172.21.15.135:0/785988654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f987019aec0 0x7f987019b370 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.021+0000 7f987744a640 1 --2- 172.21.15.135:0/785988654 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f985c0a8360 0x7f985c0aa820 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.021+0000 7f987744a640 1 --2- 172.21.15.135:0/785988654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9870106170 0x7f9870196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.021+0000 7f987744a640 1 --2- 172.21.15.135:0/785988654 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98701010a0 0x7f9870196600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.021+0000 7f987744a640 1 -- 172.21.15.135:0/785988654 >> 172.21.15.135:0/785988654 conn(0x7f9870077f60 msgr2=0x7f98700fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.021+0000 7f987744a640 1 -- 172.21.15.135:0/785988654 shutdown_connections 2024-04-20T12:24:18.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.021+0000 7f987744a640 1 -- 172.21.15.135:0/785988654 wait complete. 2024-04-20T12:24:18.033 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:24:18.033 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:24:18.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.182+0000 7f349fad9640 1 -- 172.21.15.135:0/808321127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3498103b10 msgr2=0x7f349810bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.182+0000 7f349fad9640 1 --2- 172.21.15.135:0/808321127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3498103b10 0x7f349810bff0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3488009900 tx=0x7f348802bd60 comp rx=0 tx=0).stop 2024-04-20T12:24:18.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.182+0000 7f349fad9640 1 -- 172.21.15.135:0/808321127 shutdown_connections 2024-04-20T12:24:18.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.182+0000 7f349fad9640 1 --2- 172.21.15.135:0/808321127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f349810c530 0x7f349810e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.182+0000 7f349fad9640 1 --2- 172.21.15.135:0/808321127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3498103b10 0x7f349810bff0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.182+0000 7f349fad9640 1 --2- 172.21.15.135:0/808321127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f34981031f0 0x7f34981035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.182+0000 7f349fad9640 1 -- 172.21.15.135:0/808321127 >> 172.21.15.135:0/808321127 conn(0x7f3498077f60 msgr2=0x7f3498078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.182+0000 7f349fad9640 1 -- 172.21.15.135:0/808321127 shutdown_connections 2024-04-20T12:24:18.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.182+0000 7f349fad9640 1 -- 172.21.15.135:0/808321127 wait complete. 2024-04-20T12:24:18.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.183+0000 7f349fad9640 1 Processor -- start 2024-04-20T12:24:18.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.183+0000 7f349fad9640 1 -- start start 2024-04-20T12:24:18.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.183+0000 7f349fad9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34981031f0 0x7f3498196630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.183+0000 7f349fad9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3498103b10 0x7f3498196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.183+0000 7f349fad9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f349810c530 0x7f349819aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349fad9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3498110190 con 0x7f3498103b10 2024-04-20T12:24:18.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349fad9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3498110010 con 0x7f349810c530 2024-04-20T12:24:18.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349fad9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3498110310 con 0x7f34981031f0 2024-04-20T12:24:18.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349d074640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3498103b10 0x7f3498196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349d875640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34981031f0 0x7f3498196630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349d875640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34981031f0 0x7f3498196630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.135:55854/0 (socket says 172.21.15.135:55854) 2024-04-20T12:24:18.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349d875640 1 -- 172.21.15.135:0/199021763 learned_addr learned my addr 172.21.15.135:0/199021763 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349d074640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3498103b10 0x7f3498196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39310/0 (socket says 172.21.15.135:39310) 2024-04-20T12:24:18.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349e076640 1 --2- 172.21.15.135:0/199021763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f349810c530 0x7f349819aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349d875640 1 -- 172.21.15.135:0/199021763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f349810c530 msgr2=0x7f349819aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349d875640 1 --2- 172.21.15.135:0/199021763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f349810c530 0x7f349819aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349d875640 1 -- 172.21.15.135:0/199021763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3498103b10 msgr2=0x7f3498196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349d875640 1 --2- 172.21.15.135:0/199021763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3498103b10 0x7f3498196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349d875640 1 -- 172.21.15.135:0/199021763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f349819b620 con 0x7f34981031f0 2024-04-20T12:24:18.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349d074640 1 --2- 172.21.15.135:0/199021763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3498103b10 0x7f3498196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:18.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349d875640 1 --2- 172.21.15.135:0/199021763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34981031f0 0x7f3498196630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f349400e9f0 tx=0x7f349400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f348effd640 1 -- 172.21.15.135:0/199021763 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349400cd80 con 0x7f34981031f0 2024-04-20T12:24:18.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349fad9640 1 -- 172.21.15.135:0/199021763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349819b910 con 0x7f34981031f0 2024-04-20T12:24:18.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f348effd640 1 -- 172.21.15.135:0/199021763 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3494010910 con 0x7f34981031f0 2024-04-20T12:24:18.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f348effd640 1 -- 172.21.15.135:0/199021763 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34940188f0 con 0x7f34981031f0 2024-04-20T12:24:18.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.184+0000 7f349fad9640 1 -- 172.21.15.135:0/199021763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34981a31a0 con 0x7f34981031f0 2024-04-20T12:24:18.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.186+0000 7f349fad9640 1 -- 172.21.15.135:0/199021763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3498068d80 con 0x7f34981031f0 2024-04-20T12:24:18.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.187+0000 7f348effd640 1 -- 172.21.15.135:0/199021763 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 25) ==== 138931+0+0 (secure 0 0 0) 0x7f3494010ac0 con 0x7f34981031f0 2024-04-20T12:24:18.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.188+0000 7f348effd640 1 --2- 172.21.15.135:0/199021763 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f34840a3ed0 0x7f34840a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.188+0000 7f349d074640 1 --2- 172.21.15.135:0/199021763 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f34840a3ed0 0x7f34840a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.188+0000 7f348effd640 1 -- 172.21.15.135:0/199021763 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f34940d1530 con 0x7f34981031f0 2024-04-20T12:24:18.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.188+0000 7f349d074640 1 --2- 172.21.15.135:0/199021763 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f34840a3ed0 0x7f34840a6390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3488000c00 tx=0x7f34880058d0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.191+0000 7f348effd640 1 -- 172.21.15.135:0/199021763 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f349409d610 con 0x7f34981031f0 2024-04-20T12:24:18.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.430+0000 7f349fad9640 1 -- 172.21.15.135:0/199021763 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34981076b0 con 0x7f34981031f0 2024-04-20T12:24:18.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.431+0000 7f348effd640 1 -- 172.21.15.135:0/199021763 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7f349409cf10 con 0x7f34981031f0 2024-04-20T12:24:18.431 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:24:18.431 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:24:18.431 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:24:18.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.434+0000 7f349fad9640 1 -- 172.21.15.135:0/199021763 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f34840a3ed0 msgr2=0x7f34840a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.434+0000 7f349fad9640 1 --2- 172.21.15.135:0/199021763 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f34840a3ed0 0x7f34840a6390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3488000c00 tx=0x7f34880058d0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.434+0000 7f349fad9640 1 -- 172.21.15.135:0/199021763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34981031f0 msgr2=0x7f3498196630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.434+0000 7f349fad9640 1 --2- 172.21.15.135:0/199021763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34981031f0 0x7f3498196630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f349400e9f0 tx=0x7f349400eeb0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.434+0000 7f349fad9640 1 -- 172.21.15.135:0/199021763 shutdown_connections 2024-04-20T12:24:18.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.434+0000 7f349fad9640 1 --2- 172.21.15.135:0/199021763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f349810c530 0x7f349819aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.434+0000 7f349fad9640 1 --2- 172.21.15.135:0/199021763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3498103b10 0x7f3498196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.434+0000 7f349fad9640 1 --2- 172.21.15.135:0/199021763 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f34840a3ed0 0x7f34840a6390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.434+0000 7f349fad9640 1 --2- 172.21.15.135:0/199021763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f34981031f0 0x7f3498196630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.434+0000 7f349fad9640 1 -- 172.21.15.135:0/199021763 >> 172.21.15.135:0/199021763 conn(0x7f3498077f60 msgr2=0x7f34980fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.434+0000 7f349fad9640 1 -- 172.21.15.135:0/199021763 shutdown_connections 2024-04-20T12:24:18.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.434+0000 7f349fad9640 1 -- 172.21.15.135:0/199021763 wait complete. 2024-04-20T12:24:18.449 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:24:18.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.553+0000 7f93065b2640 1 -- 172.21.15.135:0/1014298264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930006ad30 msgr2=0x7f930010edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.553+0000 7f93065b2640 1 --2- 172.21.15.135:0/1014298264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930006ad30 0x7f930010edc0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009ca0 tx=0x7f92f802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.554+0000 7f93065b2640 1 -- 172.21.15.135:0/1014298264 shutdown_connections 2024-04-20T12:24:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.554+0000 7f93065b2640 1 --2- 172.21.15.135:0/1014298264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930006ad30 0x7f930010edc0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.554+0000 7f93065b2640 1 --2- 172.21.15.135:0/1014298264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f930006a370 0x7f930006a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.554+0000 7f93065b2640 1 --2- 172.21.15.135:0/1014298264 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9300106f30 0x7f9300107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.554+0000 7f93065b2640 1 -- 172.21.15.135:0/1014298264 >> 172.21.15.135:0/1014298264 conn(0x7f9300077c20 msgr2=0x7f9300078030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.554+0000 7f93065b2640 1 -- 172.21.15.135:0/1014298264 shutdown_connections 2024-04-20T12:24:18.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.554+0000 7f93065b2640 1 -- 172.21.15.135:0/1014298264 wait complete. 2024-04-20T12:24:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.554+0000 7f93065b2640 1 Processor -- start 2024-04-20T12:24:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.554+0000 7f93065b2640 1 -- start start 2024-04-20T12:24:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f93065b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f930006a370 0x7f9300198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f93065b2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930006ad30 0x7f9300198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f93065b2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9300106f30 0x7f930019cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f93065b2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93001122d0 con 0x7f930006ad30 2024-04-20T12:24:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f93065b2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9300112150 con 0x7f9300106f30 2024-04-20T12:24:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f93065b2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9300112450 con 0x7f930006a370 2024-04-20T12:24:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f92ff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930006ad30 0x7f9300198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f92ff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930006ad30 0x7f9300198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39332/0 (socket says 172.21.15.135:39332) 2024-04-20T12:24:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f92ff7fe640 1 -- 172.21.15.135:0/4280167623 learned_addr learned my addr 172.21.15.135:0/4280167623 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f9304b4f640 1 --2- 172.21.15.135:0/4280167623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9300106f30 0x7f930019cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f92fffff640 1 --2- 172.21.15.135:0/4280167623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f930006a370 0x7f9300198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f92ff7fe640 1 -- 172.21.15.135:0/4280167623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f930006a370 msgr2=0x7f9300198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f92ff7fe640 1 --2- 172.21.15.135:0/4280167623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f930006a370 0x7f9300198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f92ff7fe640 1 -- 172.21.15.135:0/4280167623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9300106f30 msgr2=0x7f930019cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f92ff7fe640 1 --2- 172.21.15.135:0/4280167623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9300106f30 0x7f930019cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.555+0000 7f92ff7fe640 1 -- 172.21.15.135:0/4280167623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930019d6b0 con 0x7f930006ad30 2024-04-20T12:24:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.556+0000 7f92ff7fe640 1 --2- 172.21.15.135:0/4280167623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930006ad30 0x7f9300198c50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f92f400d950 tx=0x7f92f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.556+0000 7f92fd7fa640 1 -- 172.21.15.135:0/4280167623 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4017070 con 0x7f930006ad30 2024-04-20T12:24:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.556+0000 7f93065b2640 1 -- 172.21.15.135:0/4280167623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930019d9a0 con 0x7f930006ad30 2024-04-20T12:24:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.556+0000 7f92fd7fa640 1 -- 172.21.15.135:0/4280167623 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92f4009c30 con 0x7f930006ad30 2024-04-20T12:24:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.556+0000 7f92fd7fa640 1 -- 172.21.15.135:0/4280167623 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f400f6b0 con 0x7f930006ad30 2024-04-20T12:24:18.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.556+0000 7f93065b2640 1 -- 172.21.15.135:0/4280167623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93001a5230 con 0x7f930006ad30 2024-04-20T12:24:18.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.559+0000 7f93091a5740 1 Processor -- start 2024-04-20T12:24:18.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.559+0000 7f93091a5740 1 -- start start 2024-04-20T12:24:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f92fd7fa640 1 -- 172.21.15.135:0/4280167623 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 138931+0+0 (secure 0 0 0) 0x7f92f40109d0 con 0x7f930006ad30 2024-04-20T12:24:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f93091a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02ae9880 0x558e02ae9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f93091a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02aea230 0x558e02aea6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f93091a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02afba40 0x558e02afde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f93091a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558e02a4f110 con 0x558e02ae9880 2024-04-20T12:24:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f93091a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558e029ec550 con 0x558e02aea230 2024-04-20T12:24:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f93091a5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558e02a4b0d0 con 0x558e02afba40 2024-04-20T12:24:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f9304b4f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02ae9880 0x558e02ae9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f9304b4f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02ae9880 0x558e02ae9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39340/0 (socket says 172.21.15.135:39340) 2024-04-20T12:24:18.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f9304b4f640 1 -- 172.21.15.135:0/2422155790 learned_addr learned my addr 172.21.15.135:0/2422155790 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f92ff7fe640 1 --2- 172.21.15.135:0/2422155790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02afba40 0x558e02afde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f92fffff640 1 --2- 172.21.15.135:0/2422155790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02aea230 0x558e02aea6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f9304b4f640 1 -- 172.21.15.135:0/2422155790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02afba40 msgr2=0x558e02afde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f9304b4f640 1 --2- 172.21.15.135:0/2422155790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02afba40 0x558e02afde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f9304b4f640 1 -- 172.21.15.135:0/2422155790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02aea230 msgr2=0x558e02aea6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f92fd7fa640 1 --2- 172.21.15.135:0/4280167623 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f92e80a3ed0 0x7f92e80a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f9304b4f640 1 --2- 172.21.15.135:0/2422155790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02aea230 0x558e02aea6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f9304b4f640 1 -- 172.21.15.135:0/2422155790 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e02a14900 con 0x558e02ae9880 2024-04-20T12:24:18.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.560+0000 7f92ff7fe640 1 --2- 172.21.15.135:0/2422155790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02afba40 0x558e02afde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:18.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.561+0000 7f92fd7fa640 1 -- 172.21.15.135:0/4280167623 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f92f40d0320 con 0x7f930006ad30 2024-04-20T12:24:18.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.561+0000 7f92fffff640 1 --2- 172.21.15.135:0/2422155790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02aea230 0x558e02aea6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:18.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.561+0000 7f9304b4f640 1 --2- 172.21.15.135:0/2422155790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02ae9880 0x558e02ae9c60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009ca0 tx=0x7f92f8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49b9540d25c2e3d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.561+0000 7f9304b4f640 1 --2- 172.21.15.135:0/4280167623 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f92e80a3ed0 0x7f92e80a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.561+0000 7f92e67fc640 1 -- 172.21.15.135:0/2422155790 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8045030 con 0x558e02ae9880 2024-04-20T12:24:18.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.561+0000 7f92e67fc640 1 -- 172.21.15.135:0/2422155790 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92f8032e30 con 0x558e02ae9880 2024-04-20T12:24:18.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.561+0000 7f92e67fc640 1 -- 172.21.15.135:0/2422155790 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8039040 con 0x558e02ae9880 2024-04-20T12:24:18.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.562+0000 7f93091a5740 1 -- 172.21.15.135:0/2422155790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02ae9880 msgr2=0x558e02ae9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.562+0000 7f9304b4f640 1 --2- 172.21.15.135:0/4280167623 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f92e80a3ed0 0x7f92e80a6390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f92f8049000 tx=0x7f92f80047b0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.562+0000 7f93091a5740 1 --2- 172.21.15.135:0/2422155790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02ae9880 0x558e02ae9c60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009ca0 tx=0x7f92f8009900 comp rx=0 tx=0).stop 2024-04-20T12:24:18.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.562+0000 7f93091a5740 1 -- 172.21.15.135:0/2422155790 shutdown_connections 2024-04-20T12:24:18.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.562+0000 7f93091a5740 1 --2- 172.21.15.135:0/2422155790 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02afba40 0x558e02afde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.562+0000 7f93091a5740 1 --2- 172.21.15.135:0/2422155790 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02aea230 0x558e02aea6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.562+0000 7f93091a5740 1 --2- 172.21.15.135:0/2422155790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02ae9880 0x558e02ae9c60 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.562+0000 7f93091a5740 1 -- 172.21.15.135:0/2422155790 >> 172.21.15.135:0/2422155790 conn(0x558e02ae4540 msgr2=0x558e02ae4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.562+0000 7f93091a5740 1 -- 172.21.15.135:0/2422155790 shutdown_connections 2024-04-20T12:24:18.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.562+0000 7f93091a5740 1 -- 172.21.15.135:0/2422155790 wait complete. 2024-04-20T12:24:18.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.563+0000 7f93091a5740 1 -- start start 2024-04-20T12:24:18.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.563+0000 7f93091a5740 1 Processor -- start 2024-04-20T12:24:18.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.563+0000 7f93091a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02ae9880 0x558e02aebdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.563+0000 7f93091a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02aea230 0x558e02aec330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.563+0000 7f93091a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02afba40 0x558e02aec870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f93091a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558e02afe8f0 con 0x558e02afba40 2024-04-20T12:24:18.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f93091a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558e02a08500 con 0x558e02ae9880 2024-04-20T12:24:18.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f93091a5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558e02afea70 con 0x558e02aea230 2024-04-20T12:24:18.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f9304b4f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02afba40 0x558e02aec870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f9304b4f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02afba40 0x558e02aec870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39352/0 (socket says 172.21.15.135:39352) 2024-04-20T12:24:18.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f9304b4f640 1 -- 172.21.15.135:0/3909017209 learned_addr learned my addr 172.21.15.135:0/3909017209 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f93091a5740 10 client.0 _ll_register_callbacks cb 0x558e029ed2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:18.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f92fffff640 1 --2- 172.21.15.135:0/3909017209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02ae9880 0x558e02aebdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f92ff7fe640 1 --2- 172.21.15.135:0/3909017209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02aea230 0x558e02aec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f9304b4f640 1 -- 172.21.15.135:0/3909017209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02aea230 msgr2=0x558e02aec330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f9304b4f640 1 --2- 172.21.15.135:0/3909017209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02aea230 0x558e02aec330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f9304b4f640 1 -- 172.21.15.135:0/3909017209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02ae9880 msgr2=0x558e02aebdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f9304b4f640 1 --2- 172.21.15.135:0/3909017209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02ae9880 0x558e02aebdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f9304b4f640 1 -- 172.21.15.135:0/3909017209 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e027613f0 con 0x558e02afba40 2024-04-20T12:24:18.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f9304b4f640 1 --2- 172.21.15.135:0/3909017209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02afba40 0x558e02aec870 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f92f8003fa0 tx=0x7f92f8040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f23c32f4d3dc02 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f92df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:18.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.564+0000 7f92df7fe640 1 -- 172.21.15.135:0/3909017209 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8059070 con 0x558e02afba40 2024-04-20T12:24:18.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.565+0000 7f93091a5740 1 -- 172.21.15.135:0/3909017209 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92f8032e30 con 0x558e02afba40 2024-04-20T12:24:18.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.565+0000 7f92df7fe640 1 -- 172.21.15.135:0/3909017209 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f92f8003970 con 0x558e02afba40 2024-04-20T12:24:18.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.565+0000 7f92df7fe640 1 -- 172.21.15.135:0/3909017209 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f92f8065050 con 0x558e02afba40 2024-04-20T12:24:18.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.565+0000 7f93091a5740 10 client.16071 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:18.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.565+0000 7f93091a5740 1 -- 172.21.15.135:0/3909017209 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558e0282b7d0 con 0x558e02afba40 2024-04-20T12:24:18.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.565+0000 7f92df7fe640 1 -- 172.21.15.135:0/3909017209 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92f8032e30 con 0x558e02afba40 2024-04-20T12:24:18.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.565+0000 7f92df7fe640 1 -- 172.21.15.135:0/3909017209 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f92f8032590 con 0x558e02afba40 2024-04-20T12:24:18.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.565+0000 7f93091a5740 10 client.16071 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:18.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.565+0000 7f93091a5740 10 client.16071 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:24:18.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.565+0000 7f93091a5740 20 client.16071 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:18.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.565+0000 7f93091a5740 1 --2- 172.21.15.135:0/3909017209 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558e02b0bcf0 0x558e02b0e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.565+0000 7f93091a5740 4 client.16071 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:18.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.565+0000 7f93091a5740 1 -- 172.21.15.135:0/3909017209 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e02a5cb30 con 0x558e02b0bcf0 2024-04-20T12:24:18.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.565+0000 7f92fffff640 1 --2- 172.21.15.135:0/3909017209 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558e02b0bcf0 0x558e02b0e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.566+0000 7f92df7fe640 10 client.16071 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:24:18.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.566+0000 7f92fffff640 1 --2- 172.21.15.135:0/3909017209 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558e02b0bcf0 0x558e02b0e0e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=81e156d1da929dd3 server_cookie=36e0e69172ffd626 in_seq=0 out_seq=0 2024-04-20T12:24:18.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.567+0000 7f92df7fe640 1 -- 172.21.15.135:0/3909017209 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558e02a5cb30 con 0x558e02b0bcf0 2024-04-20T12:24:18.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.567+0000 7f92df7fe640 10 client.16071 handle_command_reply: tid=0 2024-04-20T12:24:18.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.567+0000 7f93091a5740 1 client.16071 shutdown 2024-04-20T12:24:18.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.567+0000 7f93091a5740 1 -- 172.21.15.135:0/3909017209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02afba40 msgr2=0x558e02aec870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.567+0000 7f93091a5740 1 --2- 172.21.15.135:0/3909017209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02afba40 0x558e02aec870 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f92f8003fa0 tx=0x7f92f8040000 comp rx=0 tx=0).stop 2024-04-20T12:24:18.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.567+0000 7f93091a5740 1 -- 172.21.15.135:0/3909017209 shutdown_connections 2024-04-20T12:24:18.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.567+0000 7f93091a5740 1 --2- 172.21.15.135:0/3909017209 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558e02b0bcf0 0x558e02b0e0e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.567+0000 7f92df7fe640 0 client.16071 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:24:18.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.567+0000 7f93091a5740 1 --2- 172.21.15.135:0/3909017209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02afba40 0x558e02aec870 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.567+0000 7f93091a5740 1 --2- 172.21.15.135:0/3909017209 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02aea230 0x558e02aec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.567+0000 7f93091a5740 1 --2- 172.21.15.135:0/3909017209 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02ae9880 0x558e02aebdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.567+0000 7f93091a5740 1 -- 172.21.15.135:0/3909017209 >> 172.21.15.135:0/3909017209 conn(0x558e02ae4540 msgr2=0x558e02ae6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.567+0000 7f93091a5740 1 -- 172.21.15.135:0/3909017209 shutdown_connections 2024-04-20T12:24:18.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.568+0000 7f93091a5740 1 -- 172.21.15.135:0/3909017209 wait complete. 2024-04-20T12:24:18.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.568+0000 7f93091a5740 20 client.16071 trim_cache size 0 max 16384 2024-04-20T12:24:18.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.593+0000 7f93091a5740 1 Processor -- start 2024-04-20T12:24:18.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.594+0000 7f93091a5740 1 -- start start 2024-04-20T12:24:18.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.594+0000 7f93091a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02ae9880 0x558e02aee520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.594+0000 7f93091a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02aea230 0x558e02afce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.594+0000 7f92fffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02ae9880 0x558e02aee520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.594+0000 7f92fffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02ae9880 0x558e02aee520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39360/0 (socket says 172.21.15.135:39360) 2024-04-20T12:24:18.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.594+0000 7f92fffff640 1 -- 172.21.15.135:0/3018414057 learned_addr learned my addr 172.21.15.135:0/3018414057 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.595+0000 7f93091a5740 1 --2- 172.21.15.135:0/3018414057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02afba40 0x558e02afd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.595+0000 7f93091a5740 1 -- 172.21.15.135:0/3018414057 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93001ad150 con 0x558e02ae9880 2024-04-20T12:24:18.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.595+0000 7f93091a5740 1 -- 172.21.15.135:0/3018414057 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f93001aec90 con 0x558e02afba40 2024-04-20T12:24:18.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.595+0000 7f93091a5740 1 -- 172.21.15.135:0/3018414057 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f93001ad820 con 0x558e02aea230 2024-04-20T12:24:18.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.595+0000 7f92ff7fe640 1 --2- 172.21.15.135:0/3018414057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02aea230 0x558e02afce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.595+0000 7f9304b4f640 1 --2- 172.21.15.135:0/3018414057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02afba40 0x558e02afd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.595+0000 7f92fffff640 1 -- 172.21.15.135:0/3018414057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02aea230 msgr2=0x558e02afce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.595+0000 7f92fffff640 1 --2- 172.21.15.135:0/3018414057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02aea230 0x558e02afce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.595+0000 7f92fffff640 1 -- 172.21.15.135:0/3018414057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02afba40 msgr2=0x558e02afd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.595+0000 7f92fffff640 1 --2- 172.21.15.135:0/3018414057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02afba40 0x558e02afd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.595+0000 7f92fffff640 1 -- 172.21.15.135:0/3018414057 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e02afafa0 con 0x558e02ae9880 2024-04-20T12:24:18.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.595+0000 7f92ff7fe640 1 --2- 172.21.15.135:0/3018414057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02aea230 0x558e02afce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:18.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.595+0000 7f92fffff640 1 --2- 172.21.15.135:0/3018414057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02ae9880 0x558e02aee520 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009ca0 tx=0x7f92f0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b77f4df735b3d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.598+0000 7f92e5ffb640 1 -- 172.21.15.135:0/3018414057 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0003d60 con 0x558e02ae9880 2024-04-20T12:24:18.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.598+0000 7f92e5ffb640 1 -- 172.21.15.135:0/3018414057 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92f00205d0 con 0x558e02ae9880 2024-04-20T12:24:18.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.598+0000 7f92e5ffb640 1 -- 172.21.15.135:0/3018414057 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0010ad0 con 0x558e02ae9880 2024-04-20T12:24:18.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.599+0000 7f93091a5740 1 -- 172.21.15.135:0/3018414057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02ae9880 msgr2=0x558e02aee520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.599+0000 7f93091a5740 1 --2- 172.21.15.135:0/3018414057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02ae9880 0x558e02aee520 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009ca0 tx=0x7f92f0005f90 comp rx=0 tx=0).stop 2024-04-20T12:24:18.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.599+0000 7f93091a5740 1 -- 172.21.15.135:0/3018414057 shutdown_connections 2024-04-20T12:24:18.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.599+0000 7f93091a5740 1 --2- 172.21.15.135:0/3018414057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02afba40 0x558e02afd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.599+0000 7f93091a5740 1 --2- 172.21.15.135:0/3018414057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02aea230 0x558e02afce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.599+0000 7f93091a5740 1 --2- 172.21.15.135:0/3018414057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02ae9880 0x558e02aee520 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.599+0000 7f93091a5740 1 -- 172.21.15.135:0/3018414057 >> 172.21.15.135:0/3018414057 conn(0x558e02ae4540 msgr2=0x558e02ae36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.599+0000 7f93091a5740 1 -- 172.21.15.135:0/3018414057 shutdown_connections 2024-04-20T12:24:18.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.599+0000 7f93091a5740 1 -- 172.21.15.135:0/3018414057 wait complete. 2024-04-20T12:24:18.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.599+0000 7f93091a5740 1 -- start start 2024-04-20T12:24:18.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.599+0000 7f93091a5740 1 Processor -- start 2024-04-20T12:24:18.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f93091a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02ae9880 0x558e02b0cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f93091a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02aea230 0x558e02b0d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f93091a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02afba40 0x558e02b0d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f93091a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93001ae5c0 con 0x558e02aea230 2024-04-20T12:24:18.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f93091a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f93001adef0 con 0x558e02ae9880 2024-04-20T12:24:18.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f93091a5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f93001ab120 con 0x558e02afba40 2024-04-20T12:24:18.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f93091a5740 10 client.0 _ll_register_callbacks cb 0x7f92f8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:18.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f92fffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02ae9880 0x558e02b0cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f92ff7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02aea230 0x558e02b0d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f92fffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02ae9880 0x558e02b0cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:57346/0 (socket says 172.21.15.135:57346) 2024-04-20T12:24:18.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f92fffff640 1 -- 172.21.15.135:0/1649836816 learned_addr learned my addr 172.21.15.135:0/1649836816 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f9304b4f640 1 --2- 172.21.15.135:0/1649836816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02afba40 0x558e02b0d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f9304b4f640 1 -- 172.21.15.135:0/1649836816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02ae9880 msgr2=0x558e02b0cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f9304b4f640 1 --2- 172.21.15.135:0/1649836816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02ae9880 0x558e02b0cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f9304b4f640 1 -- 172.21.15.135:0/1649836816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02aea230 msgr2=0x558e02b0d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f9304b4f640 1 --2- 172.21.15.135:0/1649836816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02aea230 0x558e02b0d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f9304b4f640 1 -- 172.21.15.135:0/1649836816 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e02b71020 con 0x558e02afba40 2024-04-20T12:24:18.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.600+0000 7f92fffff640 1 --2- 172.21.15.135:0/1649836816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02ae9880 0x558e02b0cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:18.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.601+0000 7f9304b4f640 1 --2- 172.21.15.135:0/1649836816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02afba40 0x558e02b0d790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f92f8032990 tx=0x7f92f8004960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d66441854699efc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.601+0000 7f92df7fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-20T12:24:18.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.601+0000 7f92df7fe640 1 -- 172.21.15.135:0/1649836816 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f8059070 con 0x558e02afba40 2024-04-20T12:24:18.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.601+0000 7f93091a5740 1 -- 172.21.15.135:0/1649836816 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92f00205d0 con 0x558e02afba40 2024-04-20T12:24:18.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.601+0000 7f92df7fe640 1 -- 172.21.15.135:0/1649836816 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f92f8003fd0 con 0x558e02afba40 2024-04-20T12:24:18.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.601+0000 7f92df7fe640 1 -- 172.21.15.135:0/1649836816 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f92f8039040 con 0x558e02afba40 2024-04-20T12:24:18.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.601+0000 7f93091a5740 10 client.25516 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:18.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.601+0000 7f93091a5740 1 -- 172.21.15.135:0/1649836816 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558e02b72300 con 0x558e02afba40 2024-04-20T12:24:18.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.601+0000 7f92df7fe640 1 -- 172.21.15.135:0/1649836816 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92f00205d0 con 0x558e02afba40 2024-04-20T12:24:18.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.602+0000 7f92df7fe640 1 -- 172.21.15.135:0/1649836816 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f92f803f8d0 con 0x558e02afba40 2024-04-20T12:24:18.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.602+0000 7f93091a5740 10 client.25516 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:18.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.602+0000 7f93091a5740 10 client.25516 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:24:18.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.602+0000 7f93091a5740 20 client.25516 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:18.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.602+0000 7f93091a5740 1 --2- 172.21.15.135:0/1649836816 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558e02b72820 0x558e02b74c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.602+0000 7f93091a5740 4 client.25516 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:24:18.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.602+0000 7f93091a5740 1 -- 172.21.15.135:0/1649836816 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558e02a569a0 con 0x558e02b72820 2024-04-20T12:24:18.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.602+0000 7f92fffff640 1 --2- 172.21.15.135:0/1649836816 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558e02b72820 0x558e02b74c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.602+0000 7f92df7fe640 10 client.25516 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:24:18.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.602+0000 7f92fffff640 1 --2- 172.21.15.135:0/1649836816 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558e02b72820 0x558e02b74c10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6cce00ffde1101da server_cookie=bbeccc107ee407d in_seq=0 out_seq=0 2024-04-20T12:24:18.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.603+0000 7f92df7fe640 1 -- 172.21.15.135:0/1649836816 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558e02a569a0 con 0x558e02b72820 2024-04-20T12:24:18.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.603+0000 7f92df7fe640 10 client.25516 handle_command_reply: tid=0 2024-04-20T12:24:18.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.603+0000 7f93091a5740 1 client.25516 shutdown 2024-04-20T12:24:18.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.603+0000 7f93091a5740 1 -- 172.21.15.135:0/1649836816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02afba40 msgr2=0x558e02b0d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.603+0000 7f93091a5740 1 --2- 172.21.15.135:0/1649836816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02afba40 0x558e02b0d790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f92f8032990 tx=0x7f92f8004960 comp rx=0 tx=0).stop 2024-04-20T12:24:18.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.603+0000 7f93091a5740 1 -- 172.21.15.135:0/1649836816 shutdown_connections 2024-04-20T12:24:18.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.603+0000 7f93091a5740 1 --2- 172.21.15.135:0/1649836816 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558e02b72820 0x558e02b74c10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.603+0000 7f92df7fe640 0 client.25516 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:24:18.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.603+0000 7f93091a5740 1 --2- 172.21.15.135:0/1649836816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558e02afba40 0x558e02b0d790 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.603+0000 7f93091a5740 1 --2- 172.21.15.135:0/1649836816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e02aea230 0x558e02b0d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.603+0000 7f93091a5740 1 --2- 172.21.15.135:0/1649836816 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558e02ae9880 0x558e02b0cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.603+0000 7f93091a5740 1 -- 172.21.15.135:0/1649836816 >> 172.21.15.135:0/1649836816 conn(0x558e02ae4540 msgr2=0x558e02ae2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.603+0000 7f93091a5740 1 -- 172.21.15.135:0/1649836816 shutdown_connections 2024-04-20T12:24:18.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.603+0000 7f93091a5740 1 -- 172.21.15.135:0/1649836816 wait complete. 2024-04-20T12:24:18.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.603+0000 7f93091a5740 20 client.25516 trim_cache size 0 max 16384 2024-04-20T12:24:18.607 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:24:18.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.604+0000 7f93065b2640 1 -- 172.21.15.135:0/4280167623 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f92e80a3ed0 msgr2=0x7f92e80a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.604+0000 7f93065b2640 1 --2- 172.21.15.135:0/4280167623 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f92e80a3ed0 0x7f92e80a6390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f92f8049000 tx=0x7f92f80047b0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.604+0000 7f93065b2640 1 -- 172.21.15.135:0/4280167623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930006ad30 msgr2=0x7f9300198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.604+0000 7f93065b2640 1 --2- 172.21.15.135:0/4280167623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930006ad30 0x7f9300198c50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f92f400d950 tx=0x7f92f400de10 comp rx=0 tx=0).stop 2024-04-20T12:24:18.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.604+0000 7f93065b2640 1 -- 172.21.15.135:0/4280167623 shutdown_connections 2024-04-20T12:24:18.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.604+0000 7f93065b2640 1 --2- 172.21.15.135:0/4280167623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9300106f30 0x7f930019cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.604+0000 7f93065b2640 1 --2- 172.21.15.135:0/4280167623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f930006ad30 0x7f9300198c50 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.604+0000 7f93065b2640 1 --2- 172.21.15.135:0/4280167623 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f92e80a3ed0 0x7f92e80a6390 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.604+0000 7f93065b2640 1 --2- 172.21.15.135:0/4280167623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f930006a370 0x7f9300198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.604+0000 7f93065b2640 1 -- 172.21.15.135:0/4280167623 >> 172.21.15.135:0/4280167623 conn(0x7f9300077c20 msgr2=0x7f93000fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.604+0000 7f93065b2640 1 -- 172.21.15.135:0/4280167623 shutdown_connections 2024-04-20T12:24:18.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.604+0000 7f93065b2640 1 -- 172.21.15.135:0/4280167623 wait complete. 2024-04-20T12:24:18.618 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:24:18.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.721+0000 7f53a6ae0640 1 -- 172.21.15.135:0/225621385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a0101090 msgr2=0x7f53a0101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.721+0000 7f53a6ae0640 1 --2- 172.21.15.135:0/225621385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a0101090 0x7f53a0101470 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f5394009900 tx=0x7f539402bc30 comp rx=0 tx=0).stop 2024-04-20T12:24:18.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.722+0000 7f53a6ae0640 1 -- 172.21.15.135:0/225621385 shutdown_connections 2024-04-20T12:24:18.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.722+0000 7f53a6ae0640 1 --2- 172.21.15.135:0/225621385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a0106160 0x7f53a010dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.722+0000 7f53a6ae0640 1 --2- 172.21.15.135:0/225621385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a0101a40 0x7f53a0105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.722+0000 7f53a6ae0640 1 --2- 172.21.15.135:0/225621385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a0101090 0x7f53a0101470 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.722+0000 7f53a6ae0640 1 -- 172.21.15.135:0/225621385 >> 172.21.15.135:0/225621385 conn(0x7f53a0078010 msgr2=0x7f53a0078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.722+0000 7f53a6ae0640 1 -- 172.21.15.135:0/225621385 shutdown_connections 2024-04-20T12:24:18.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.722+0000 7f53a6ae0640 1 -- 172.21.15.135:0/225621385 wait complete. 2024-04-20T12:24:18.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.722+0000 7f53a6ae0640 1 Processor -- start 2024-04-20T12:24:18.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.722+0000 7f53a6ae0640 1 -- start start 2024-04-20T12:24:18.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f53a6ae0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a0101090 0x7f53a0197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f53a6ae0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a0106160 0x7f53a0197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f53a6ae0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a019bff0 0x7f53a019c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f53a6ae0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53a0111210 con 0x7f53a019bff0 2024-04-20T12:24:18.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f53a6ae0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f53a0111090 con 0x7f53a0101090 2024-04-20T12:24:18.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f53a6ae0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53a0111390 con 0x7f53a0106160 2024-04-20T12:24:18.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f53a507d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a019bff0 0x7f53a019c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f53a507d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a019bff0 0x7f53a019c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39384/0 (socket says 172.21.15.135:39384) 2024-04-20T12:24:18.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f53a507d640 1 -- 172.21.15.135:0/1087843785 learned_addr learned my addr 172.21.15.135:0/1087843785 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f53a487c640 1 --2- 172.21.15.135:0/1087843785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a0101090 0x7f53a0197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f539ffff640 1 --2- 172.21.15.135:0/1087843785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a0106160 0x7f53a0197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f53a507d640 1 -- 172.21.15.135:0/1087843785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a0106160 msgr2=0x7f53a0197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f53a507d640 1 --2- 172.21.15.135:0/1087843785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a0106160 0x7f53a0197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f53a507d640 1 -- 172.21.15.135:0/1087843785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a0101090 msgr2=0x7f53a0197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f53a507d640 1 --2- 172.21.15.135:0/1087843785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a0101090 0x7f53a0197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f53a507d640 1 -- 172.21.15.135:0/1087843785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a019cae0 con 0x7f53a019bff0 2024-04-20T12:24:18.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.723+0000 7f539ffff640 1 --2- 172.21.15.135:0/1087843785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a0106160 0x7f53a0197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:24:18.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.724+0000 7f53a507d640 1 --2- 172.21.15.135:0/1087843785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a019bff0 0x7f53a019c4a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f539800eaa0 tx=0x7f539800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.724+0000 7f539dffb640 1 -- 172.21.15.135:0/1087843785 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539800cdb0 con 0x7f53a019bff0 2024-04-20T12:24:18.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.724+0000 7f539dffb640 1 -- 172.21.15.135:0/1087843785 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5398005020 con 0x7f53a019bff0 2024-04-20T12:24:18.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.724+0000 7f539dffb640 1 -- 172.21.15.135:0/1087843785 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53980116d0 con 0x7f53a019bff0 2024-04-20T12:24:18.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.724+0000 7f53a6ae0640 1 -- 172.21.15.135:0/1087843785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a019cdd0 con 0x7f53a019bff0 2024-04-20T12:24:18.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.724+0000 7f53a6ae0640 1 -- 172.21.15.135:0/1087843785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a00693c0 con 0x7f53a019bff0 2024-04-20T12:24:18.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.727+0000 7f53a97ac740 1 Processor -- start 2024-04-20T12:24:18.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f539dffb640 1 -- 172.21.15.135:0/1087843785 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 138931+0+0 (secure 0 0 0) 0x7f5398011870 con 0x7f53a019bff0 2024-04-20T12:24:18.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f53a97ac740 1 -- start start 2024-04-20T12:24:18.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f53a97ac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd21e10 0x56067bd221f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f53a97ac740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 0x56067bd2add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f53a97ac740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd2b310 0x56067bd2d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f53a97ac740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56067bc87110 con 0x56067bd2b310 2024-04-20T12:24:18.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f53a97ac740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56067bc24550 con 0x56067bd22730 2024-04-20T12:24:18.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f53a97ac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56067bc830d0 con 0x56067bd21e10 2024-04-20T12:24:18.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f539ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd2b310 0x56067bd2d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f539ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd2b310 0x56067bd2d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39396/0 (socket says 172.21.15.135:39396) 2024-04-20T12:24:18.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f539ffff640 1 -- 172.21.15.135:0/1721369513 learned_addr learned my addr 172.21.15.135:0/1721369513 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f539ffff640 1 --2- 172.21.15.135:0/1721369513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd21e10 0x56067bd221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f53a487c640 1 --2- 172.21.15.135:0/1721369513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 0x56067bd2add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f539dffb640 1 --2- 172.21.15.135:0/1087843785 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f53900a4010 0x7f53900a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f539ffff640 1 -- 172.21.15.135:0/1721369513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd21e10 msgr2=0x56067bd221f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.728+0000 7f539ffff640 1 --2- 172.21.15.135:0/1721369513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd21e10 0x56067bd221f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.729+0000 7f539ffff640 1 -- 172.21.15.135:0/1721369513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 msgr2=0x56067bd2add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.729+0000 7f539ffff640 1 --2- 172.21.15.135:0/1721369513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 0x56067bd2add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.729+0000 7f539ffff640 1 -- 172.21.15.135:0/1721369513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56067bc4c900 con 0x56067bd2b310 2024-04-20T12:24:18.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.729+0000 7f53a487c640 1 --2- 172.21.15.135:0/1721369513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 0x56067bd2add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:18.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.729+0000 7f539ffff640 1 --2- 172.21.15.135:0/1721369513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd2b310 0x56067bd2d700 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f538c013860 tx=0x7f538c00b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7faff76f747d5ff3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.729+0000 7f539dffb640 1 -- 172.21.15.135:0/1087843785 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f53980d0ff0 con 0x7f53a019bff0 2024-04-20T12:24:18.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.729+0000 7f538affd640 1 -- 172.21.15.135:0/1721369513 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c00e8f0 con 0x56067bd2b310 2024-04-20T12:24:18.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.729+0000 7f538affd640 1 -- 172.21.15.135:0/1721369513 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f538c01e430 con 0x56067bd2b310 2024-04-20T12:24:18.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.729+0000 7f538affd640 1 -- 172.21.15.135:0/1721369513 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c011640 con 0x56067bd2b310 2024-04-20T12:24:18.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.729+0000 7f53a507d640 1 --2- 172.21.15.135:0/1087843785 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f53900a4010 0x7f53900a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.730+0000 7f53a97ac740 1 -- 172.21.15.135:0/1721369513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd2b310 msgr2=0x56067bd2d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.730+0000 7f53a97ac740 1 --2- 172.21.15.135:0/1721369513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd2b310 0x56067bd2d700 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f538c013860 tx=0x7f538c00b400 comp rx=0 tx=0).stop 2024-04-20T12:24:18.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.730+0000 7f53a507d640 1 --2- 172.21.15.135:0/1087843785 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f53900a4010 0x7f53900a64d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f53980ce1e0 tx=0x7f5398098cf0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.730+0000 7f53a97ac740 1 -- 172.21.15.135:0/1721369513 shutdown_connections 2024-04-20T12:24:18.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.730+0000 7f53a97ac740 1 --2- 172.21.15.135:0/1721369513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd2b310 0x56067bd2d700 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.730+0000 7f53a97ac740 1 --2- 172.21.15.135:0/1721369513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 0x56067bd2add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.730+0000 7f53a97ac740 1 --2- 172.21.15.135:0/1721369513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd21e10 0x56067bd221f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.730+0000 7f53a97ac740 1 -- 172.21.15.135:0/1721369513 >> 172.21.15.135:0/1721369513 conn(0x56067bd1c540 msgr2=0x56067bd1c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.730+0000 7f53a97ac740 1 -- 172.21.15.135:0/1721369513 shutdown_connections 2024-04-20T12:24:18.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.730+0000 7f53a97ac740 1 -- 172.21.15.135:0/1721369513 wait complete. 2024-04-20T12:24:18.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.730+0000 7f53a97ac740 1 -- start start 2024-04-20T12:24:18.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.730+0000 7f53a97ac740 1 Processor -- start 2024-04-20T12:24:18.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f53a97ac740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd21e10 0x56067bd285c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f53a97ac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd22730 0x56067bd28b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f53a97ac740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd2b310 0x56067bd37410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f53a97ac740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56067bd2dfe0 con 0x56067bd21e10 2024-04-20T12:24:18.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f53a97ac740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56067bc40500 con 0x56067bd2b310 2024-04-20T12:24:18.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f53a97ac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56067bd2e160 con 0x56067bd22730 2024-04-20T12:24:18.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f53a97ac740 10 client.0 _ll_register_callbacks cb 0x56067bc252f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:18.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f539ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd21e10 0x56067bd285c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f539ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd21e10 0x56067bd285c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39398/0 (socket says 172.21.15.135:39398) 2024-04-20T12:24:18.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f539ffff640 1 -- 172.21.15.135:0/2165334942 learned_addr learned my addr 172.21.15.135:0/2165334942 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f53a487c640 1 --2- 172.21.15.135:0/2165334942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd22730 0x56067bd28b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f539ffff640 1 --2- 172.21.15.135:0/2165334942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd2b310 0x56067bd37410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f539ffff640 1 -- 172.21.15.135:0/2165334942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd22730 msgr2=0x56067bd28b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f539ffff640 1 --2- 172.21.15.135:0/2165334942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd22730 0x56067bd28b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f539ffff640 1 -- 172.21.15.135:0/2165334942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd2b310 msgr2=0x56067bd37410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f539ffff640 1 --2- 172.21.15.135:0/2165334942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd2b310 0x56067bd37410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f539ffff640 1 -- 172.21.15.135:0/2165334942 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56067b9993f0 con 0x56067bd21e10 2024-04-20T12:24:18.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.731+0000 7f53a487c640 1 --2- 172.21.15.135:0/2165334942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd22730 0x56067bd28b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:18.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.732+0000 7f539ffff640 1 --2- 172.21.15.135:0/2165334942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd21e10 0x56067bd285c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f538c00bdf0 tx=0x7f538c013460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad1b9ae52a4b793 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.732+0000 7f537ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:18.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.732+0000 7f537ffff640 1 -- 172.21.15.135:0/2165334942 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c01e7f0 con 0x56067bd21e10 2024-04-20T12:24:18.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.732+0000 7f537ffff640 1 -- 172.21.15.135:0/2165334942 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f538c01e990 con 0x56067bd21e10 2024-04-20T12:24:18.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.732+0000 7f53a97ac740 1 -- 172.21.15.135:0/2165334942 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f538c01e430 con 0x56067bd21e10 2024-04-20T12:24:18.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.732+0000 7f537ffff640 1 -- 172.21.15.135:0/2165334942 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f538c00e6c0 con 0x56067bd21e10 2024-04-20T12:24:18.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.732+0000 7f53a97ac740 10 client.16089 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:18.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.732+0000 7f53a97ac740 1 -- 172.21.15.135:0/2165334942 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56067ba637d0 con 0x56067bd21e10 2024-04-20T12:24:18.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.732+0000 7f537ffff640 1 -- 172.21.15.135:0/2165334942 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f538c01e430 con 0x56067bd21e10 2024-04-20T12:24:18.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.732+0000 7f537ffff640 1 -- 172.21.15.135:0/2165334942 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f538c00f040 con 0x56067bd21e10 2024-04-20T12:24:18.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.732+0000 7f53a97ac740 10 client.16089 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:18.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.732+0000 7f53a97ac740 10 client.16089 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:24:18.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.732+0000 7f53a97ac740 20 client.16089 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:18.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.732+0000 7f53a97ac740 1 --2- 172.21.15.135:0/2165334942 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56067bd3b6a0 0x56067bd3da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.733+0000 7f53a97ac740 4 client.16089 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:18.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.733+0000 7f53a97ac740 1 -- 172.21.15.135:0/2165334942 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56067bc94b30 con 0x56067bd3b6a0 2024-04-20T12:24:18.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.733+0000 7f53a487c640 1 --2- 172.21.15.135:0/2165334942 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56067bd3b6a0 0x56067bd3da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.733+0000 7f537ffff640 10 client.16089 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:24:18.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.733+0000 7f53a487c640 1 --2- 172.21.15.135:0/2165334942 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56067bd3b6a0 0x56067bd3da90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7de3212a9da260ce server_cookie=6cd2639d9dcc1be5 in_seq=0 out_seq=0 2024-04-20T12:24:18.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.734+0000 7f537ffff640 1 -- 172.21.15.135:0/2165334942 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56067bc94b30 con 0x56067bd3b6a0 2024-04-20T12:24:18.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.734+0000 7f537ffff640 10 client.16089 handle_command_reply: tid=0 2024-04-20T12:24:18.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.734+0000 7f53a97ac740 1 client.16089 shutdown 2024-04-20T12:24:18.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.734+0000 7f53a97ac740 1 -- 172.21.15.135:0/2165334942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd21e10 msgr2=0x56067bd285c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.734+0000 7f53a97ac740 1 --2- 172.21.15.135:0/2165334942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd21e10 0x56067bd285c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f538c00bdf0 tx=0x7f538c013460 comp rx=0 tx=0).stop 2024-04-20T12:24:18.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.734+0000 7f53a97ac740 1 -- 172.21.15.135:0/2165334942 shutdown_connections 2024-04-20T12:24:18.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.734+0000 7f53a97ac740 1 --2- 172.21.15.135:0/2165334942 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56067bd3b6a0 0x56067bd3da90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.734+0000 7f537ffff640 0 client.16089 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:24:18.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.734+0000 7f53a97ac740 1 --2- 172.21.15.135:0/2165334942 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd2b310 0x56067bd37410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.734+0000 7f53a97ac740 1 --2- 172.21.15.135:0/2165334942 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd22730 0x56067bd28b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.734+0000 7f53a97ac740 1 --2- 172.21.15.135:0/2165334942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd21e10 0x56067bd285c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.734+0000 7f53a97ac740 1 -- 172.21.15.135:0/2165334942 >> 172.21.15.135:0/2165334942 conn(0x56067bd1c540 msgr2=0x56067bd1e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.734+0000 7f53a97ac740 1 -- 172.21.15.135:0/2165334942 shutdown_connections 2024-04-20T12:24:18.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.734+0000 7f53a97ac740 1 -- 172.21.15.135:0/2165334942 wait complete. 2024-04-20T12:24:18.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.734+0000 7f53a97ac740 20 client.16089 trim_cache size 0 max 16384 2024-04-20T12:24:18.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.747+0000 7f53a97ac740 1 Processor -- start 2024-04-20T12:24:18.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f53a97ac740 1 -- start start 2024-04-20T12:24:18.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f53a97ac740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd21e10 0x56067bd27ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f53a97ac740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 0x56067bd1b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f53a97ac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd2b310 0x56067bd36ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f53a97ac740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53a01b1630 con 0x56067bd21e10 2024-04-20T12:24:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f53a97ac740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f53a01b3170 con 0x56067bd22730 2024-04-20T12:24:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f53a97ac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53a01b1d00 con 0x56067bd2b310 2024-04-20T12:24:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f539ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd21e10 0x56067bd27ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f539ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd21e10 0x56067bd27ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39412/0 (socket says 172.21.15.135:39412) 2024-04-20T12:24:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f539ffff640 1 -- 172.21.15.135:0/2621726062 learned_addr learned my addr 172.21.15.135:0/2621726062 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f53a487c640 1 --2- 172.21.15.135:0/2621726062 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 0x56067bd1b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f539ffff640 1 -- 172.21.15.135:0/2621726062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd2b310 msgr2=0x56067bd36ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f539ffff640 1 --2- 172.21.15.135:0/2621726062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd2b310 0x56067bd36ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f539ffff640 1 -- 172.21.15.135:0/2621726062 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 msgr2=0x56067bd1b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f539ffff640 1 --2- 172.21.15.135:0/2621726062 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 0x56067bd1b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f539ffff640 1 -- 172.21.15.135:0/2621726062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56067bd22430 con 0x56067bd21e10 2024-04-20T12:24:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.748+0000 7f539ffff640 1 --2- 172.21.15.135:0/2621726062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd21e10 0x56067bd27ea0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f538c00b890 tx=0x7f538c00ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f68b155871a2e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.749+0000 7f538a7fc640 1 -- 172.21.15.135:0/2621726062 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c005e50 con 0x56067bd21e10 2024-04-20T12:24:18.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.749+0000 7f538a7fc640 1 -- 172.21.15.135:0/2621726062 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f538c01ecd0 con 0x56067bd21e10 2024-04-20T12:24:18.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.749+0000 7f538a7fc640 1 -- 172.21.15.135:0/2621726062 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c02ba30 con 0x56067bd21e10 2024-04-20T12:24:18.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.749+0000 7f53a97ac740 1 -- 172.21.15.135:0/2621726062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd21e10 msgr2=0x56067bd27ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.749+0000 7f53a97ac740 1 --2- 172.21.15.135:0/2621726062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd21e10 0x56067bd27ea0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f538c00b890 tx=0x7f538c00ba00 comp rx=0 tx=0).stop 2024-04-20T12:24:18.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.749+0000 7f53a97ac740 1 -- 172.21.15.135:0/2621726062 shutdown_connections 2024-04-20T12:24:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.749+0000 7f53a97ac740 1 --2- 172.21.15.135:0/2621726062 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd2b310 0x56067bd36ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.749+0000 7f53a97ac740 1 --2- 172.21.15.135:0/2621726062 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 0x56067bd1b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.749+0000 7f53a97ac740 1 --2- 172.21.15.135:0/2621726062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd21e10 0x56067bd27ea0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.749+0000 7f53a97ac740 1 -- 172.21.15.135:0/2621726062 >> 172.21.15.135:0/2621726062 conn(0x56067bd1c540 msgr2=0x56067bd1ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.749+0000 7f53a97ac740 1 -- 172.21.15.135:0/2621726062 shutdown_connections 2024-04-20T12:24:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.749+0000 7f53a97ac740 1 -- 172.21.15.135:0/2621726062 wait complete. 2024-04-20T12:24:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.750+0000 7f53a97ac740 1 -- start start 2024-04-20T12:24:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.750+0000 7f53a97ac740 1 Processor -- start 2024-04-20T12:24:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.750+0000 7f53a97ac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd21e10 0x56067bd333b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.750+0000 7f53a97ac740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 0x56067bd338f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.750+0000 7f53a97ac740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd2b310 0x56067bd24be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.750+0000 7f53a97ac740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53a01b2aa0 con 0x56067bd2b310 2024-04-20T12:24:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.750+0000 7f53a97ac740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f53a01b23d0 con 0x56067bd22730 2024-04-20T12:24:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.750+0000 7f53a97ac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f53a01af600 con 0x56067bd21e10 2024-04-20T12:24:18.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.750+0000 7f53a97ac740 10 client.0 _ll_register_callbacks cb 0x7f538c00be40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:18.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.750+0000 7f539ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd2b310 0x56067bd24be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.750+0000 7f539ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd2b310 0x56067bd24be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39420/0 (socket says 172.21.15.135:39420) 2024-04-20T12:24:18.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.750+0000 7f539ffff640 1 -- 172.21.15.135:0/3211322152 learned_addr learned my addr 172.21.15.135:0/3211322152 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.750+0000 7f53a487c640 1 --2- 172.21.15.135:0/3211322152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 0x56067bd338f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.751+0000 7f539ffff640 1 --2- 172.21.15.135:0/3211322152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd21e10 0x56067bd333b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.751+0000 7f539ffff640 1 -- 172.21.15.135:0/3211322152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd21e10 msgr2=0x56067bd333b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.751+0000 7f539ffff640 1 --2- 172.21.15.135:0/3211322152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd21e10 0x56067bd333b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.751+0000 7f539ffff640 1 -- 172.21.15.135:0/3211322152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 msgr2=0x56067bd338f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.751+0000 7f539ffff640 1 --2- 172.21.15.135:0/3211322152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 0x56067bd338f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.751+0000 7f539ffff640 1 -- 172.21.15.135:0/3211322152 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56067bd25460 con 0x56067bd2b310 2024-04-20T12:24:18.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.751+0000 7f539ffff640 1 --2- 172.21.15.135:0/3211322152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd2b310 0x56067bd24be0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x56067bd25d20 tx=0x7f538c00b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db703e5fde79bae server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.751+0000 7f537ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:18.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.751+0000 7f537ffff640 1 -- 172.21.15.135:0/3211322152 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c02bb00 con 0x56067bd2b310 2024-04-20T12:24:18.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.751+0000 7f53a97ac740 1 -- 172.21.15.135:0/3211322152 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56067bc8e9a0 con 0x56067bd2b310 2024-04-20T12:24:18.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.751+0000 7f537ffff640 1 -- 172.21.15.135:0/3211322152 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f538c01e9f0 con 0x56067bd2b310 2024-04-20T12:24:18.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.751+0000 7f537ffff640 1 -- 172.21.15.135:0/3211322152 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f538c013070 con 0x56067bd2b310 2024-04-20T12:24:18.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.751+0000 7f53a97ac740 10 client.16095 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:18.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.751+0000 7f53a97ac740 1 -- 172.21.15.135:0/3211322152 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56067bda1510 con 0x56067bd2b310 2024-04-20T12:24:18.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.752+0000 7f537ffff640 1 -- 172.21.15.135:0/3211322152 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56067bc8e9a0 con 0x56067bd2b310 2024-04-20T12:24:18.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.752+0000 7f537ffff640 1 -- 172.21.15.135:0/3211322152 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f538c00e860 con 0x56067bd2b310 2024-04-20T12:24:18.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.752+0000 7f53a97ac740 10 client.16095 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:18.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.752+0000 7f53a97ac740 10 client.16095 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:24:18.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.752+0000 7f53a97ac740 20 client.16095 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:18.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.752+0000 7f53a97ac740 1 --2- 172.21.15.135:0/3211322152 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56067bd3b6a0 0x56067bda3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.752+0000 7f53a97ac740 4 client.16095 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:24:18.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.752+0000 7f53a97ac740 1 -- 172.21.15.135:0/3211322152 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56067bc0a6e0 con 0x56067bd3b6a0 2024-04-20T12:24:18.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.752+0000 7f53a487c640 1 --2- 172.21.15.135:0/3211322152 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56067bd3b6a0 0x56067bda3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.752+0000 7f537ffff640 10 client.16095 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:24:18.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.752+0000 7f53a487c640 1 --2- 172.21.15.135:0/3211322152 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56067bd3b6a0 0x56067bda3be0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1a3ee2d3c44069db server_cookie=e2dfe50f26f29e30 in_seq=0 out_seq=0 2024-04-20T12:24:18.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.753+0000 7f537ffff640 1 -- 172.21.15.135:0/3211322152 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56067bc0a6e0 con 0x56067bd3b6a0 2024-04-20T12:24:18.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.753+0000 7f537ffff640 10 client.16095 handle_command_reply: tid=0 2024-04-20T12:24:18.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.753+0000 7f53a97ac740 1 client.16095 shutdown 2024-04-20T12:24:18.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.753+0000 7f53a97ac740 1 -- 172.21.15.135:0/3211322152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd2b310 msgr2=0x56067bd24be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.753+0000 7f53a97ac740 1 --2- 172.21.15.135:0/3211322152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd2b310 0x56067bd24be0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x56067bd25d20 tx=0x7f538c00b640 comp rx=0 tx=0).stop 2024-04-20T12:24:18.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.753+0000 7f53a97ac740 1 -- 172.21.15.135:0/3211322152 shutdown_connections 2024-04-20T12:24:18.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.753+0000 7f53a97ac740 1 --2- 172.21.15.135:0/3211322152 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56067bd3b6a0 0x56067bda3be0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.753+0000 7f53a97ac740 1 --2- 172.21.15.135:0/3211322152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56067bd2b310 0x56067bd24be0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.753+0000 7f537ffff640 0 client.16095 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:24:18.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.753+0000 7f53a97ac740 1 --2- 172.21.15.135:0/3211322152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56067bd22730 0x56067bd338f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.753+0000 7f53a97ac740 1 --2- 172.21.15.135:0/3211322152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56067bd21e10 0x56067bd333b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.753+0000 7f53a97ac740 1 -- 172.21.15.135:0/3211322152 >> 172.21.15.135:0/3211322152 conn(0x56067bd1c540 msgr2=0x56067bd1b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.753+0000 7f53a97ac740 1 -- 172.21.15.135:0/3211322152 shutdown_connections 2024-04-20T12:24:18.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.753+0000 7f53a97ac740 1 -- 172.21.15.135:0/3211322152 wait complete. 2024-04-20T12:24:18.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.753+0000 7f53a97ac740 20 client.16095 trim_cache size 0 max 16384 2024-04-20T12:24:18.760 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:24:18.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.754+0000 7f53a6ae0640 1 -- 172.21.15.135:0/1087843785 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f53900a4010 msgr2=0x7f53900a64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.754+0000 7f53a6ae0640 1 --2- 172.21.15.135:0/1087843785 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f53900a4010 0x7f53900a64d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f53980ce1e0 tx=0x7f5398098cf0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.754+0000 7f53a6ae0640 1 -- 172.21.15.135:0/1087843785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a019bff0 msgr2=0x7f53a019c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.754+0000 7f53a6ae0640 1 --2- 172.21.15.135:0/1087843785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a019bff0 0x7f53a019c4a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f539800eaa0 tx=0x7f539800ef60 comp rx=0 tx=0).stop 2024-04-20T12:24:18.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.754+0000 7f53a6ae0640 1 -- 172.21.15.135:0/1087843785 shutdown_connections 2024-04-20T12:24:18.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.754+0000 7f53a6ae0640 1 --2- 172.21.15.135:0/1087843785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53a019bff0 0x7f53a019c4a0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.754+0000 7f53a6ae0640 1 --2- 172.21.15.135:0/1087843785 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f53900a4010 0x7f53900a64d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.754+0000 7f53a6ae0640 1 --2- 172.21.15.135:0/1087843785 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f53a0106160 0x7f53a0197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.754+0000 7f53a6ae0640 1 --2- 172.21.15.135:0/1087843785 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f53a0101090 0x7f53a0197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.754+0000 7f53a6ae0640 1 -- 172.21.15.135:0/1087843785 >> 172.21.15.135:0/1087843785 conn(0x7f53a0078010 msgr2=0x7f53a00fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.754+0000 7f53a6ae0640 1 -- 172.21.15.135:0/1087843785 shutdown_connections 2024-04-20T12:24:18.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.754+0000 7f53a6ae0640 1 -- 172.21.15.135:0/1087843785 wait complete. 2024-04-20T12:24:18.766 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:18 smithi135 ceph-mon[18264]: pgmap v38: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-04-20T12:24:18.767 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:18 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/199021763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:24:18.768 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:24:18.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.870+0000 7f25c2031640 1 -- 172.21.15.135:0/2770121703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25bc101670 msgr2=0x7f25bc10e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.870+0000 7f25c2031640 1 --2- 172.21.15.135:0/2770121703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25bc101670 0x7f25bc10e3c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f25b0009900 tx=0x7f25b002bc30 comp rx=0 tx=0).stop 2024-04-20T12:24:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.870+0000 7f25c2031640 1 -- 172.21.15.135:0/2770121703 shutdown_connections 2024-04-20T12:24:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.870+0000 7f25c2031640 1 --2- 172.21.15.135:0/2770121703 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25bc10e900 0x7f25bc110cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.870+0000 7f25c2031640 1 --2- 172.21.15.135:0/2770121703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25bc101670 0x7f25bc10e3c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.870+0000 7f25c2031640 1 --2- 172.21.15.135:0/2770121703 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25bc100d50 0x7f25bc101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.870+0000 7f25c2031640 1 -- 172.21.15.135:0/2770121703 >> 172.21.15.135:0/2770121703 conn(0x7f25bc078010 msgr2=0x7f25bc078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.870+0000 7f25c2031640 1 -- 172.21.15.135:0/2770121703 shutdown_connections 2024-04-20T12:24:18.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.870+0000 7f25c2031640 1 -- 172.21.15.135:0/2770121703 wait complete. 2024-04-20T12:24:18.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.871+0000 7f25c2031640 1 Processor -- start 2024-04-20T12:24:18.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.871+0000 7f25c2031640 1 -- start start 2024-04-20T12:24:18.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.871+0000 7f25c2031640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25bc100d50 0x7f25bc1a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.871+0000 7f25c2031640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25bc101670 0x7f25bc1a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25c2031640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25bc10e900 0x7f25bc19a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25baffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25bc101670 0x7f25bc1a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25baffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25bc101670 0x7f25bc1a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39452/0 (socket says 172.21.15.135:39452) 2024-04-20T12:24:18.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25baffd640 1 -- 172.21.15.135:0/2368214955 learned_addr learned my addr 172.21.15.135:0/2368214955 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25c2031640 1 -- 172.21.15.135:0/2368214955 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc114530 con 0x7f25bc101670 2024-04-20T12:24:18.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25c2031640 1 -- 172.21.15.135:0/2368214955 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc1143b0 con 0x7f25bc10e900 2024-04-20T12:24:18.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25c2031640 1 -- 172.21.15.135:0/2368214955 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc1146b0 con 0x7f25bc100d50 2024-04-20T12:24:18.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25bb7fe640 1 --2- 172.21.15.135:0/2368214955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25bc100d50 0x7f25bc1a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25bbfff640 1 --2- 172.21.15.135:0/2368214955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25bc10e900 0x7f25bc19a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25baffd640 1 -- 172.21.15.135:0/2368214955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25bc100d50 msgr2=0x7f25bc1a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25baffd640 1 --2- 172.21.15.135:0/2368214955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25bc100d50 0x7f25bc1a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25baffd640 1 -- 172.21.15.135:0/2368214955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25bc10e900 msgr2=0x7f25bc19a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25baffd640 1 --2- 172.21.15.135:0/2368214955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25bc10e900 0x7f25bc19a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25baffd640 1 -- 172.21.15.135:0/2368214955 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25bc19b020 con 0x7f25bc101670 2024-04-20T12:24:18.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25bbfff640 1 --2- 172.21.15.135:0/2368214955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25bc10e900 0x7f25bc19a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:24:18.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25baffd640 1 --2- 172.21.15.135:0/2368214955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25bc101670 0x7f25bc1a0c20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f25b0005940 tx=0x7f25b002cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.872+0000 7f25b8ff9640 1 -- 172.21.15.135:0/2368214955 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0041070 con 0x7f25bc101670 2024-04-20T12:24:18.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.873+0000 7f25b8ff9640 1 -- 172.21.15.135:0/2368214955 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25b0004450 con 0x7f25bc101670 2024-04-20T12:24:18.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.873+0000 7f25c2031640 1 -- 172.21.15.135:0/2368214955 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25bc19b2b0 con 0x7f25bc101670 2024-04-20T12:24:18.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.873+0000 7f25b8ff9640 1 -- 172.21.15.135:0/2368214955 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b0034440 con 0x7f25bc101670 2024-04-20T12:24:18.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.873+0000 7f25c2031640 1 -- 172.21.15.135:0/2368214955 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25bc1a7530 con 0x7f25bc101670 2024-04-20T12:24:18.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.875+0000 7f25b8ff9640 1 -- 172.21.15.135:0/2368214955 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 138931+0+0 (secure 0 0 0) 0x7f25b0044070 con 0x7f25bc101670 2024-04-20T12:24:18.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.875+0000 7f25b8ff9640 1 --2- 172.21.15.135:0/2368214955 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f25a40a3f50 0x7f25a40a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.876+0000 7f25b8ff9640 1 -- 172.21.15.135:0/2368214955 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f25b00f2870 con 0x7f25bc101670 2024-04-20T12:24:18.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.876+0000 7f25bb7fe640 1 --2- 172.21.15.135:0/2368214955 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f25a40a3f50 0x7f25a40a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.876+0000 7f25c4c26740 1 Processor -- start 2024-04-20T12:24:18.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.876+0000 7f25c4c26740 1 -- start start 2024-04-20T12:24:18.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.876+0000 7f25bb7fe640 1 --2- 172.21.15.135:0/2368214955 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f25a40a3f50 0x7f25a40a6410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f25ac005fd0 tx=0x7f25ac00b390 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.876+0000 7f25c4c26740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7ee620 0x55e21b7eea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.876+0000 7f25c4c26740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7eef40 0x55e21b7f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.876+0000 7f25c4c26740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.876+0000 7f25c4c26740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e21b74b110 con 0x55e21b7f7b20 2024-04-20T12:24:18.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.876+0000 7f25c4c26740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e21b6e8550 con 0x55e21b7eef40 2024-04-20T12:24:18.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.876+0000 7f25c4c26740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e21b7470d0 con 0x55e21b7ee620 2024-04-20T12:24:18.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.876+0000 7f25bbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.877+0000 7f25bbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39454/0 (socket says 172.21.15.135:39454) 2024-04-20T12:24:18.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.877+0000 7f25bbfff640 1 -- 172.21.15.135:0/20112743 learned_addr learned my addr 172.21.15.135:0/20112743 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.877+0000 7f25bb7fe640 1 --2- 172.21.15.135:0/20112743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7ee620 0x55e21b7eea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.877+0000 7f25baffd640 1 --2- 172.21.15.135:0/20112743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7eef40 0x55e21b7f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.877+0000 7f25bbfff640 1 -- 172.21.15.135:0/20112743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7ee620 msgr2=0x55e21b7eea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.877+0000 7f25bbfff640 1 --2- 172.21.15.135:0/20112743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7ee620 0x55e21b7eea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.877+0000 7f25bbfff640 1 -- 172.21.15.135:0/20112743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7eef40 msgr2=0x55e21b7f75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.877+0000 7f25bbfff640 1 --2- 172.21.15.135:0/20112743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7eef40 0x55e21b7f75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.877+0000 7f25bbfff640 1 -- 172.21.15.135:0/20112743 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e21b710900 con 0x55e21b7f7b20 2024-04-20T12:24:18.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.877+0000 7f25bbfff640 1 --2- 172.21.15.135:0/20112743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f9f10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009ee0 tx=0x7f25b400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493efdf6682bde7c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.877+0000 7f25a1ffb640 1 -- 172.21.15.135:0/20112743 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4011640 con 0x55e21b7f7b20 2024-04-20T12:24:18.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.877+0000 7f25a1ffb640 1 -- 172.21.15.135:0/20112743 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25b4011cc0 con 0x55e21b7f7b20 2024-04-20T12:24:18.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.877+0000 7f25a1ffb640 1 -- 172.21.15.135:0/20112743 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b401bde0 con 0x55e21b7f7b20 2024-04-20T12:24:18.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.878+0000 7f25c4c26740 1 -- 172.21.15.135:0/20112743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 msgr2=0x55e21b7f9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.878+0000 7f25c4c26740 1 --2- 172.21.15.135:0/20112743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f9f10 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009ee0 tx=0x7f25b400f730 comp rx=0 tx=0).stop 2024-04-20T12:24:18.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.878+0000 7f25c4c26740 1 -- 172.21.15.135:0/20112743 shutdown_connections 2024-04-20T12:24:18.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.878+0000 7f25c4c26740 1 --2- 172.21.15.135:0/20112743 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f9f10 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.878+0000 7f25c4c26740 1 --2- 172.21.15.135:0/20112743 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7eef40 0x55e21b7f75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.878+0000 7f25c4c26740 1 --2- 172.21.15.135:0/20112743 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7ee620 0x55e21b7eea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.878+0000 7f25c4c26740 1 -- 172.21.15.135:0/20112743 >> 172.21.15.135:0/20112743 conn(0x55e21b7e8d50 msgr2=0x55e21b7e9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.878+0000 7f25c4c26740 1 -- 172.21.15.135:0/20112743 shutdown_connections 2024-04-20T12:24:18.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.878+0000 7f25c4c26740 1 -- 172.21.15.135:0/20112743 wait complete. 2024-04-20T12:24:18.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.879+0000 7f25c4c26740 1 -- start start 2024-04-20T12:24:18.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.879+0000 7f25c4c26740 1 Processor -- start 2024-04-20T12:24:18.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.879+0000 7f25c4c26740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7ee620 0x55e21b7f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.879+0000 7f25c4c26740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7eef40 0x55e21b7f5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.879+0000 7f25c4c26740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.879+0000 7f25bbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.879+0000 7f25bbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39460/0 (socket says 172.21.15.135:39460) 2024-04-20T12:24:18.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.879+0000 7f25bbfff640 1 -- 172.21.15.135:0/142055242 learned_addr learned my addr 172.21.15.135:0/142055242 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.879+0000 7f25c4c26740 1 -- 172.21.15.135:0/142055242 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e21b7fa910 con 0x55e21b7f7b20 2024-04-20T12:24:18.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.879+0000 7f25c4c26740 1 -- 172.21.15.135:0/142055242 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e21b704500 con 0x55e21b7eef40 2024-04-20T12:24:18.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.879+0000 7f25c4c26740 1 -- 172.21.15.135:0/142055242 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e21b7faa90 con 0x55e21b7ee620 2024-04-20T12:24:18.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.879+0000 7f25baffd640 1 --2- 172.21.15.135:0/142055242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7eef40 0x55e21b7f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.879+0000 7f25c4c26740 10 client.0 _ll_register_callbacks cb 0x55e21b6e92f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:18.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.879+0000 7f25bb7fe640 1 --2- 172.21.15.135:0/142055242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7ee620 0x55e21b7f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.880+0000 7f25bbfff640 1 -- 172.21.15.135:0/142055242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7ee620 msgr2=0x55e21b7f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.880+0000 7f25bbfff640 1 --2- 172.21.15.135:0/142055242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7ee620 0x55e21b7f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.880+0000 7f25bbfff640 1 -- 172.21.15.135:0/142055242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7eef40 msgr2=0x55e21b7f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.880+0000 7f25bbfff640 1 --2- 172.21.15.135:0/142055242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7eef40 0x55e21b7f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.880+0000 7f25bbfff640 1 -- 172.21.15.135:0/142055242 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e21b45d3f0 con 0x55e21b7f7b20 2024-04-20T12:24:18.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.880+0000 7f25bbfff640 1 --2- 172.21.15.135:0/142055242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f55c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f25b401ba00 tx=0x7f25b4009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f719c1af9b9b52e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.880+0000 7f259affd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:18.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.880+0000 7f259affd640 1 -- 172.21.15.135:0/142055242 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b401bb60 con 0x55e21b7f7b20 2024-04-20T12:24:18.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.880+0000 7f25c4c26740 1 -- 172.21.15.135:0/142055242 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25b4011cc0 con 0x55e21b7f7b20 2024-04-20T12:24:18.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.880+0000 7f259affd640 1 -- 172.21.15.135:0/142055242 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f25b401bd00 con 0x55e21b7f7b20 2024-04-20T12:24:18.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.880+0000 7f259affd640 1 -- 172.21.15.135:0/142055242 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f25b4003970 con 0x55e21b7f7b20 2024-04-20T12:24:18.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.880+0000 7f25c4c26740 10 client.16107 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:18.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.880+0000 7f25c4c26740 1 -- 172.21.15.135:0/142055242 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e21b5277d0 con 0x55e21b7f7b20 2024-04-20T12:24:18.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.881+0000 7f259affd640 1 -- 172.21.15.135:0/142055242 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25b4011cc0 con 0x55e21b7f7b20 2024-04-20T12:24:18.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.881+0000 7f259affd640 1 -- 172.21.15.135:0/142055242 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f25b4004040 con 0x55e21b7f7b20 2024-04-20T12:24:18.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.881+0000 7f25c4c26740 10 client.16107 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:18.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.881+0000 7f25c4c26740 10 client.16107 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:24:18.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.881+0000 7f25c4c26740 20 client.16107 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:18.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.881+0000 7f25c4c26740 1 --2- 172.21.15.135:0/142055242 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e21b807da0 0x55e21b80a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.881+0000 7f25c4c26740 4 client.16107 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:18.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.881+0000 7f25c4c26740 1 -- 172.21.15.135:0/142055242 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e21b758b30 con 0x55e21b807da0 2024-04-20T12:24:18.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.881+0000 7f25bb7fe640 1 --2- 172.21.15.135:0/142055242 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e21b807da0 0x55e21b80a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.882+0000 7f259affd640 10 client.16107 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:24:18.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.882+0000 7f25bb7fe640 1 --2- 172.21.15.135:0/142055242 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e21b807da0 0x55e21b80a190 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=26879c0b080d6700 server_cookie=806370cb7f790c90 in_seq=0 out_seq=0 2024-04-20T12:24:18.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.883+0000 7f259affd640 1 -- 172.21.15.135:0/142055242 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e21b758b30 con 0x55e21b807da0 2024-04-20T12:24:18.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.883+0000 7f259affd640 10 client.16107 handle_command_reply: tid=0 2024-04-20T12:24:18.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.883+0000 7f25c4c26740 1 client.16107 shutdown 2024-04-20T12:24:18.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.883+0000 7f25c4c26740 1 -- 172.21.15.135:0/142055242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 msgr2=0x55e21b7f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.883+0000 7f25c4c26740 1 --2- 172.21.15.135:0/142055242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f55c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f25b401ba00 tx=0x7f25b4009330 comp rx=0 tx=0).stop 2024-04-20T12:24:18.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.883+0000 7f25c4c26740 1 -- 172.21.15.135:0/142055242 shutdown_connections 2024-04-20T12:24:18.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.883+0000 7f25c4c26740 1 --2- 172.21.15.135:0/142055242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f55c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.883+0000 7f25c4c26740 1 --2- 172.21.15.135:0/142055242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7eef40 0x55e21b7f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.883+0000 7f25c4c26740 1 --2- 172.21.15.135:0/142055242 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e21b807da0 0x55e21b80a190 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.883+0000 7f25c4c26740 1 --2- 172.21.15.135:0/142055242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7ee620 0x55e21b7f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.883+0000 7f259affd640 0 client.16107 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:24:18.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.883+0000 7f25c4c26740 1 -- 172.21.15.135:0/142055242 >> 172.21.15.135:0/142055242 conn(0x55e21b7e8d50 msgr2=0x55e21b7df6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.883+0000 7f25c4c26740 1 -- 172.21.15.135:0/142055242 shutdown_connections 2024-04-20T12:24:18.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.883+0000 7f25c4c26740 1 -- 172.21.15.135:0/142055242 wait complete. 2024-04-20T12:24:18.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.883+0000 7f25c4c26740 20 client.16107 trim_cache size 0 max 16384 2024-04-20T12:24:18.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.909+0000 7f25c4c26740 1 Processor -- start 2024-04-20T12:24:18.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.909+0000 7f25c4c26740 1 -- start start 2024-04-20T12:24:18.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.909+0000 7f25c4c26740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7ee620 0x55e21b7f7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.909+0000 7f25c4c26740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7eef40 0x55e21b8037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.909+0000 7f25c4c26740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7f7b20 0x55e21b7f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.909+0000 7f25c4c26740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc1ad230 con 0x55e21b7ee620 2024-04-20T12:24:18.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.909+0000 7f25c4c26740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc1aed70 con 0x55e21b7f7b20 2024-04-20T12:24:18.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.909+0000 7f25c4c26740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc1ad900 con 0x55e21b7eef40 2024-04-20T12:24:18.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.909+0000 7f25bb7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7ee620 0x55e21b7f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.910+0000 7f25bb7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7ee620 0x55e21b7f7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39472/0 (socket says 172.21.15.135:39472) 2024-04-20T12:24:18.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.910+0000 7f25bb7fe640 1 -- 172.21.15.135:0/2315060878 learned_addr learned my addr 172.21.15.135:0/2315060878 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.910+0000 7f25baffd640 1 --2- 172.21.15.135:0/2315060878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7eef40 0x55e21b8037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.910+0000 7f25bbfff640 1 --2- 172.21.15.135:0/2315060878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7f7b20 0x55e21b7f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.910+0000 7f25bb7fe640 1 -- 172.21.15.135:0/2315060878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7eef40 msgr2=0x55e21b8037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.910+0000 7f25bb7fe640 1 --2- 172.21.15.135:0/2315060878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7eef40 0x55e21b8037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.910+0000 7f25bb7fe640 1 -- 172.21.15.135:0/2315060878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7f7b20 msgr2=0x55e21b7f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.910+0000 7f25bb7fe640 1 --2- 172.21.15.135:0/2315060878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7f7b20 0x55e21b7f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.910+0000 7f25bb7fe640 1 -- 172.21.15.135:0/2315060878 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e21b80a500 con 0x55e21b7ee620 2024-04-20T12:24:18.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.910+0000 7f25bbfff640 1 --2- 172.21.15.135:0/2315060878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7f7b20 0x55e21b7f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:24:18.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.910+0000 7f25bb7fe640 1 --2- 172.21.15.135:0/2315060878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7ee620 0x55e21b7f7270 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55e21b80a8c0 tx=0x7f25ac013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ed4e5c19b37dda server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.910+0000 7f25a17fa640 1 -- 172.21.15.135:0/2315060878 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac011d40 con 0x55e21b7ee620 2024-04-20T12:24:18.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.910+0000 7f25a17fa640 1 -- 172.21.15.135:0/2315060878 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25ac02a900 con 0x55e21b7ee620 2024-04-20T12:24:18.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.910+0000 7f25a17fa640 1 -- 172.21.15.135:0/2315060878 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ac004a00 con 0x55e21b7ee620 2024-04-20T12:24:18.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.911+0000 7f25c4c26740 1 -- 172.21.15.135:0/2315060878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7ee620 msgr2=0x55e21b7f7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.911+0000 7f25c4c26740 1 --2- 172.21.15.135:0/2315060878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7ee620 0x55e21b7f7270 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x55e21b80a8c0 tx=0x7f25ac013000 comp rx=0 tx=0).stop 2024-04-20T12:24:18.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.911+0000 7f25c4c26740 1 -- 172.21.15.135:0/2315060878 shutdown_connections 2024-04-20T12:24:18.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.911+0000 7f25c4c26740 1 --2- 172.21.15.135:0/2315060878 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7f7b20 0x55e21b7f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.911+0000 7f25c4c26740 1 --2- 172.21.15.135:0/2315060878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7eef40 0x55e21b8037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.911+0000 7f25c4c26740 1 --2- 172.21.15.135:0/2315060878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7ee620 0x55e21b7f7270 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.911+0000 7f25c4c26740 1 -- 172.21.15.135:0/2315060878 >> 172.21.15.135:0/2315060878 conn(0x55e21b7e8d50 msgr2=0x55e21b7e9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.911+0000 7f25c4c26740 1 -- 172.21.15.135:0/2315060878 shutdown_connections 2024-04-20T12:24:18.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.911+0000 7f25c4c26740 1 -- 172.21.15.135:0/2315060878 wait complete. 2024-04-20T12:24:18.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.912+0000 7f25c4c26740 1 -- start start 2024-04-20T12:24:18.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.912+0000 7f25c4c26740 1 Processor -- start 2024-04-20T12:24:18.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.912+0000 7f25c4c26740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7ee620 0x55e21b7ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.912+0000 7f25c4c26740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7eef40 0x55e21b7f1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.912+0000 7f25c4c26740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.912+0000 7f25c4c26740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc1ae6a0 con 0x55e21b7f7b20 2024-04-20T12:24:18.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.912+0000 7f25c4c26740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc1adfd0 con 0x55e21b7ee620 2024-04-20T12:24:18.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f25c4c26740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f25bc1ab200 con 0x55e21b7eef40 2024-04-20T12:24:18.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f25c4c26740 10 client.0 _ll_register_callbacks cb 0x7f25b4015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:18.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f25bbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f25bbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39480/0 (socket says 172.21.15.135:39480) 2024-04-20T12:24:18.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f25bbfff640 1 -- 172.21.15.135:0/763410135 learned_addr learned my addr 172.21.15.135:0/763410135 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:18.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f25bb7fe640 1 --2- 172.21.15.135:0/763410135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7ee620 0x55e21b7ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f25baffd640 1 --2- 172.21.15.135:0/763410135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7eef40 0x55e21b7f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f25bbfff640 1 -- 172.21.15.135:0/763410135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7eef40 msgr2=0x55e21b7f1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f25bbfff640 1 --2- 172.21.15.135:0/763410135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7eef40 0x55e21b7f1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f25bbfff640 1 -- 172.21.15.135:0/763410135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7ee620 msgr2=0x55e21b7ffed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:18.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f25bbfff640 1 --2- 172.21.15.135:0/763410135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7ee620 0x55e21b7ffed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f25bbfff640 1 -- 172.21.15.135:0/763410135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e21b7f1e90 con 0x55e21b7f7b20 2024-04-20T12:24:18.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f25bbfff640 1 --2- 172.21.15.135:0/763410135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f18d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f25b40045b0 tx=0x7f25b401b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2953badf4ad4cf26 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:18.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f259affd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:18.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f259affd640 1 -- 172.21.15.135:0/763410135 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4011cc0 con 0x55e21b7f7b20 2024-04-20T12:24:18.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f25c4c26740 1 -- 172.21.15.135:0/763410135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25ac02a900 con 0x55e21b7f7b20 2024-04-20T12:24:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.913+0000 7f259affd640 1 -- 172.21.15.135:0/763410135 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f25b40049e0 con 0x55e21b7f7b20 2024-04-20T12:24:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.914+0000 7f259affd640 1 -- 172.21.15.135:0/763410135 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f25b4004be0 con 0x55e21b7f7b20 2024-04-20T12:24:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.914+0000 7f25c4c26740 10 client.16113 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.914+0000 7f25c4c26740 1 -- 172.21.15.135:0/763410135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e21b86df20 con 0x55e21b7f7b20 2024-04-20T12:24:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.914+0000 7f259affd640 1 -- 172.21.15.135:0/763410135 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f25ac02a900 con 0x55e21b7f7b20 2024-04-20T12:24:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.914+0000 7f259affd640 1 -- 172.21.15.135:0/763410135 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f25b4032070 con 0x55e21b7f7b20 2024-04-20T12:24:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.914+0000 7f25c4c26740 10 client.16113 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.914+0000 7f25c4c26740 10 client.16113 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:24:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.914+0000 7f25c4c26740 20 client.16113 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.914+0000 7f25c4c26740 1 --2- 172.21.15.135:0/763410135 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e21b86e3f0 0x55e21b8707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.914+0000 7f25c4c26740 4 client.16113 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:24:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.914+0000 7f25c4c26740 1 -- 172.21.15.135:0/763410135 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e21b7529a0 con 0x55e21b86e3f0 2024-04-20T12:24:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.914+0000 7f25bb7fe640 1 --2- 172.21.15.135:0/763410135 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e21b86e3f0 0x55e21b8707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f259affd640 10 client.16113 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:24:18.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f25bb7fe640 1 --2- 172.21.15.135:0/763410135 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e21b86e3f0 0x55e21b8707e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8c9b080f79f29ec0 server_cookie=c91183971569ad62 in_seq=0 out_seq=0 2024-04-20T12:24:18.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f259affd640 1 -- 172.21.15.135:0/763410135 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e21b7529a0 con 0x55e21b86e3f0 2024-04-20T12:24:18.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f259affd640 10 client.16113 handle_command_reply: tid=0 2024-04-20T12:24:18.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f25c4c26740 1 client.16113 shutdown 2024-04-20T12:24:18.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f25c4c26740 1 -- 172.21.15.135:0/763410135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 msgr2=0x55e21b7f18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f25c4c26740 1 --2- 172.21.15.135:0/763410135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f18d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f25b40045b0 tx=0x7f25b401b960 comp rx=0 tx=0).stop 2024-04-20T12:24:18.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f25c4c26740 1 -- 172.21.15.135:0/763410135 shutdown_connections 2024-04-20T12:24:18.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f25c4c26740 1 --2- 172.21.15.135:0/763410135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e21b7f7b20 0x55e21b7f18d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f25c4c26740 1 --2- 172.21.15.135:0/763410135 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e21b86e3f0 0x55e21b8707e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f259affd640 0 client.16113 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:24:18.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f25c4c26740 1 --2- 172.21.15.135:0/763410135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e21b7eef40 0x55e21b7f1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f25c4c26740 1 --2- 172.21.15.135:0/763410135 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e21b7ee620 0x55e21b7ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f25c4c26740 1 -- 172.21.15.135:0/763410135 >> 172.21.15.135:0/763410135 conn(0x55e21b7e8d50 msgr2=0x55e21b7f3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f25c4c26740 1 -- 172.21.15.135:0/763410135 shutdown_connections 2024-04-20T12:24:18.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f25c4c26740 1 -- 172.21.15.135:0/763410135 wait complete. 2024-04-20T12:24:18.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.915+0000 7f25c4c26740 20 client.16113 trim_cache size 0 max 16384 2024-04-20T12:24:18.921 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:24:18.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.916+0000 7f25c2031640 1 -- 172.21.15.135:0/2368214955 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f25a40a3f50 msgr2=0x7f25a40a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.916+0000 7f25c2031640 1 --2- 172.21.15.135:0/2368214955 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f25a40a3f50 0x7f25a40a6410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f25ac005fd0 tx=0x7f25ac00b390 comp rx=0 tx=0).stop 2024-04-20T12:24:18.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.916+0000 7f25c2031640 1 -- 172.21.15.135:0/2368214955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25bc101670 msgr2=0x7f25bc1a0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:18.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.916+0000 7f25c2031640 1 --2- 172.21.15.135:0/2368214955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25bc101670 0x7f25bc1a0c20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f25b0005940 tx=0x7f25b002cba0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.916+0000 7f25c2031640 1 -- 172.21.15.135:0/2368214955 shutdown_connections 2024-04-20T12:24:18.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.916+0000 7f25c2031640 1 --2- 172.21.15.135:0/2368214955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f25bc10e900 0x7f25bc19a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.916+0000 7f25c2031640 1 --2- 172.21.15.135:0/2368214955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f25bc101670 0x7f25bc1a0c20 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.916+0000 7f25c2031640 1 --2- 172.21.15.135:0/2368214955 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f25a40a3f50 0x7f25a40a6410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.916+0000 7f25c2031640 1 --2- 172.21.15.135:0/2368214955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f25bc100d50 0x7f25bc1a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:18.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.916+0000 7f25c2031640 1 -- 172.21.15.135:0/2368214955 >> 172.21.15.135:0/2368214955 conn(0x7f25bc078010 msgr2=0x7f25bc10fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:18.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.916+0000 7f25c2031640 1 -- 172.21.15.135:0/2368214955 shutdown_connections 2024-04-20T12:24:18.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:18.916+0000 7f25c2031640 1 -- 172.21.15.135:0/2368214955 wait complete. 2024-04-20T12:24:18.930 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:24:19.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:18 smithi154 ceph-mon[22073]: pgmap v38: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-04-20T12:24:19.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:18 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/199021763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:24:19.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.037+0000 7f199d8c1640 1 -- 172.21.15.135:0/2282857464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1998106160 msgr2=0x7f199810dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.037+0000 7f199d8c1640 1 --2- 172.21.15.135:0/2282857464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1998106160 0x7f199810dd30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1990009ca0 tx=0x7f199002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.037+0000 7f199d8c1640 1 -- 172.21.15.135:0/2282857464 shutdown_connections 2024-04-20T12:24:19.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.037+0000 7f199d8c1640 1 --2- 172.21.15.135:0/2282857464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1998106160 0x7f199810dd30 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.037+0000 7f199d8c1640 1 --2- 172.21.15.135:0/2282857464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1998101a40 0x7f1998105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.037+0000 7f199d8c1640 1 --2- 172.21.15.135:0/2282857464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1998101090 0x7f1998101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.037+0000 7f199d8c1640 1 -- 172.21.15.135:0/2282857464 >> 172.21.15.135:0/2282857464 conn(0x7f1998078010 msgr2=0x7f1998078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:19.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.037+0000 7f199d8c1640 1 -- 172.21.15.135:0/2282857464 shutdown_connections 2024-04-20T12:24:19.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.037+0000 7f199d8c1640 1 -- 172.21.15.135:0/2282857464 wait complete. 2024-04-20T12:24:19.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.037+0000 7f199d8c1640 1 Processor -- start 2024-04-20T12:24:19.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.038+0000 7f199d8c1640 1 -- start start 2024-04-20T12:24:19.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.038+0000 7f199d8c1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1998101090 0x7f1998199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.038+0000 7f199d8c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1998106160 0x7f1998199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.038+0000 7f199d8c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f199819a050 0x7f19981a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.038+0000 7f199d8c1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1998111220 con 0x7f199819a050 2024-04-20T12:24:19.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.038+0000 7f199d8c1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f19981110a0 con 0x7f1998106160 2024-04-20T12:24:19.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.038+0000 7f199d8c1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f19981113a0 con 0x7f1998101090 2024-04-20T12:24:19.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.038+0000 7f19977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f199819a050 0x7f19981a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.038+0000 7f1996ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1998101090 0x7f1998199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.038+0000 7f19967fc640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1998106160 0x7f1998199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.038+0000 7f1996ffd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1998101090 0x7f1998199580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.135:56058/0 (socket says 172.21.15.135:56058) 2024-04-20T12:24:19.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.038+0000 7f1996ffd640 1 -- 172.21.15.135:0/1375658573 learned_addr learned my addr 172.21.15.135:0/1375658573 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:19.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.039+0000 7f1996ffd640 1 -- 172.21.15.135:0/1375658573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1998106160 msgr2=0x7f1998199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.039+0000 7f1996ffd640 1 --2- 172.21.15.135:0/1375658573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1998106160 0x7f1998199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.039+0000 7f1996ffd640 1 -- 172.21.15.135:0/1375658573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f199819a050 msgr2=0x7f19981a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.039+0000 7f1996ffd640 1 --2- 172.21.15.135:0/1375658573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f199819a050 0x7f19981a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.039+0000 7f1996ffd640 1 -- 172.21.15.135:0/1375658573 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19981a4e00 con 0x7f1998101090 2024-04-20T12:24:19.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.039+0000 7f19977fe640 1 --2- 172.21.15.135:0/1375658573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f199819a050 0x7f19981a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:19.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.039+0000 7f19967fc640 1 --2- 172.21.15.135:0/1375658573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1998106160 0x7f1998199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:19.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.039+0000 7f1996ffd640 1 --2- 172.21.15.135:0/1375658573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1998101090 0x7f1998199580 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f198800bec0 tx=0x7f198800dd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:19.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.039+0000 7f199c8bf640 1 -- 172.21.15.135:0/1375658573 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1988018070 con 0x7f1998101090 2024-04-20T12:24:19.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.039+0000 7f199d8c1640 1 -- 172.21.15.135:0/1375658573 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19981973d0 con 0x7f1998101090 2024-04-20T12:24:19.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.039+0000 7f199d8c1640 1 -- 172.21.15.135:0/1375658573 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1998197970 con 0x7f1998101090 2024-04-20T12:24:19.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.039+0000 7f199c8bf640 1 -- 172.21.15.135:0/1375658573 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1988016070 con 0x7f1998101090 2024-04-20T12:24:19.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.039+0000 7f199c8bf640 1 -- 172.21.15.135:0/1375658573 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19880047a0 con 0x7f1998101090 2024-04-20T12:24:19.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19a0594740 1 Processor -- start 2024-04-20T12:24:19.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19a0594740 1 -- start start 2024-04-20T12:24:19.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19a0594740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e6e10 0x555aa27e71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19a0594740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27e7730 0x555aa27efdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19a0594740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 0x555aa27f2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19a0594740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555aa274c110 con 0x555aa27e6e10 2024-04-20T12:24:19.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19a0594740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555aa26e9550 con 0x555aa27f0310 2024-04-20T12:24:19.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19a0594740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555aa27480d0 con 0x555aa27e7730 2024-04-20T12:24:19.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e6e10 0x555aa27e71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e6e10 0x555aa27e71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39496/0 (socket says 172.21.15.135:39496) 2024-04-20T12:24:19.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19977fe640 1 -- 172.21.15.135:0/1731971977 learned_addr learned my addr 172.21.15.135:0/1731971977 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:19.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19967fc640 1 --2- 172.21.15.135:0/1731971977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 0x555aa27f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f199c8bf640 1 -- 172.21.15.135:0/1375658573 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 25) ==== 138931+0+0 (secure 0 0 0) 0x7f1988009c30 con 0x7f1998101090 2024-04-20T12:24:19.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19977fe640 1 -- 172.21.15.135:0/1731971977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27e7730 msgr2=0x555aa27efdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19977fe640 1 --2- 172.21.15.135:0/1731971977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27e7730 0x555aa27efdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19977fe640 1 -- 172.21.15.135:0/1731971977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 msgr2=0x555aa27f2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.042+0000 7f19977fe640 1 --2- 172.21.15.135:0/1731971977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 0x555aa27f2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.043+0000 7f19977fe640 1 -- 172.21.15.135:0/1731971977 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa2711900 con 0x555aa27e6e10 2024-04-20T12:24:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.043+0000 7f19977fe640 1 --2- 172.21.15.135:0/1731971977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e6e10 0x555aa27e71f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1990009ca0 tx=0x7f1990009980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec9abaff928084a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.043+0000 7f197dffb640 1 -- 172.21.15.135:0/1731971977 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1990043070 con 0x555aa27e6e10 2024-04-20T12:24:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.043+0000 7f197dffb640 1 -- 172.21.15.135:0/1731971977 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1990032c90 con 0x555aa27e6e10 2024-04-20T12:24:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.043+0000 7f197dffb640 1 -- 172.21.15.135:0/1731971977 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1990039040 con 0x555aa27e6e10 2024-04-20T12:24:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.043+0000 7f199c8bf640 1 --2- 172.21.15.135:0/1375658573 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f19800a3f50 0x7f19800a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.043+0000 7f1996ffd640 1 --2- 172.21.15.135:0/1375658573 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f19800a3f50 0x7f19800a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.044+0000 7f199c8bf640 1 -- 172.21.15.135:0/1375658573 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f19880d4780 con 0x7f1998101090 2024-04-20T12:24:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.044+0000 7f19a0594740 1 -- 172.21.15.135:0/1731971977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e6e10 msgr2=0x555aa27e71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.044+0000 7f19a0594740 1 --2- 172.21.15.135:0/1731971977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e6e10 0x555aa27e71f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1990009ca0 tx=0x7f1990009980 comp rx=0 tx=0).stop 2024-04-20T12:24:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.044+0000 7f1996ffd640 1 --2- 172.21.15.135:0/1375658573 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f19800a3f50 0x7f19800a6410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f19880d1a80 tx=0x7f19880da180 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.044+0000 7f19a0594740 1 -- 172.21.15.135:0/1731971977 shutdown_connections 2024-04-20T12:24:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.044+0000 7f19a0594740 1 --2- 172.21.15.135:0/1731971977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 0x555aa27f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.044+0000 7f19a0594740 1 --2- 172.21.15.135:0/1731971977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27e7730 0x555aa27efdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.044+0000 7f19a0594740 1 --2- 172.21.15.135:0/1731971977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e6e10 0x555aa27e71f0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.044+0000 7f19a0594740 1 -- 172.21.15.135:0/1731971977 >> 172.21.15.135:0/1731971977 conn(0x555aa27e1540 msgr2=0x555aa27e1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.044+0000 7f19a0594740 1 -- 172.21.15.135:0/1731971977 shutdown_connections 2024-04-20T12:24:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.044+0000 7f19a0594740 1 -- 172.21.15.135:0/1731971977 wait complete. 2024-04-20T12:24:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.044+0000 7f19a0594740 1 -- start start 2024-04-20T12:24:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.044+0000 7f19a0594740 1 Processor -- start 2024-04-20T12:24:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19a0594740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27e6e10 0x555aa27ed250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19a0594740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e7730 0x555aa27ed790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19a0594740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 0x555aa27edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19a0594740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555aa27f30a0 con 0x555aa27e7730 2024-04-20T12:24:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19967fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e7730 0x555aa27ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19967fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e7730 0x555aa27ed790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39502/0 (socket says 172.21.15.135:39502) 2024-04-20T12:24:19.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19967fc640 1 -- 172.21.15.135:0/2963041772 learned_addr learned my addr 172.21.15.135:0/2963041772 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19a0594740 1 -- 172.21.15.135:0/2963041772 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555aa2705500 con 0x555aa27f0310 2024-04-20T12:24:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19a0594740 1 -- 172.21.15.135:0/2963041772 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555aa27f3220 con 0x555aa27e6e10 2024-04-20T12:24:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19a0594740 10 client.0 _ll_register_callbacks cb 0x555aa26ea2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19977fe640 1 --2- 172.21.15.135:0/2963041772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27e6e10 0x555aa27ed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19977fe640 1 --2- 172.21.15.135:0/2963041772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 0x555aa27edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19967fc640 1 -- 172.21.15.135:0/2963041772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27e6e10 msgr2=0x555aa27ed250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19967fc640 1 --2- 172.21.15.135:0/2963041772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27e6e10 0x555aa27ed250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19967fc640 1 -- 172.21.15.135:0/2963041772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 msgr2=0x555aa27edcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19967fc640 1 --2- 172.21.15.135:0/2963041772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 0x555aa27edcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19967fc640 1 -- 172.21.15.135:0/2963041772 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aa245e3f0 con 0x555aa27e7730 2024-04-20T12:24:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19977fe640 1 --2- 172.21.15.135:0/2963041772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 0x555aa27edcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:24:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f19967fc640 1 --2- 172.21.15.135:0/2963041772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e7730 0x555aa27ed790 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f198c004380 tx=0x7f198c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989a3b0188c93b02 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.045+0000 7f1976ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.046+0000 7f1976ffd640 1 -- 172.21.15.135:0/2963041772 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c005020 con 0x555aa27e7730 2024-04-20T12:24:19.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.046+0000 7f19a0594740 1 -- 172.21.15.135:0/2963041772 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1990032c90 con 0x555aa27e7730 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.046+0000 7f1976ffd640 1 -- 172.21.15.135:0/2963041772 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f198c0051c0 con 0x555aa27e7730 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.046+0000 7f1976ffd640 1 -- 172.21.15.135:0/2963041772 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f198c0053c0 con 0x555aa27e7730 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.046+0000 7f19a0594740 10 client.16125 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.046+0000 7f19a0594740 1 -- 172.21.15.135:0/2963041772 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555aa25287d0 con 0x555aa27e7730 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.046+0000 7f1976ffd640 1 -- 172.21.15.135:0/2963041772 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1990032c90 con 0x555aa27e7730 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.046+0000 7f1976ffd640 1 -- 172.21.15.135:0/2963041772 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f198c0119e0 con 0x555aa27e7730 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.046+0000 7f19a0594740 10 client.16125 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.046+0000 7f19a0594740 10 client.16125 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.046+0000 7f19a0594740 20 client.16125 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.046+0000 7f19a0594740 1 --2- 172.21.15.135:0/2963041772 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x555aa2800670 0x555aa2802ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.046+0000 7f19a0594740 4 client.16125 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.046+0000 7f19a0594740 1 -- 172.21.15.135:0/2963041772 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555aa2759b30 con 0x555aa2800670 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.047+0000 7f19977fe640 1 --2- 172.21.15.135:0/2963041772 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x555aa2800670 0x555aa2802ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.047+0000 7f19977fe640 1 --2- 172.21.15.135:0/2963041772 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x555aa2800670 0x555aa2802ad0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9ad816e6d6313e26 server_cookie=cec8eebc18429af1 in_seq=0 out_seq=0 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.047+0000 7f1976ffd640 10 client.16125 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:24:19.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.048+0000 7f1976ffd640 1 -- 172.21.15.135:0/2963041772 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555aa2759b30 con 0x555aa2800670 2024-04-20T12:24:19.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.048+0000 7f1976ffd640 10 client.16125 handle_command_reply: tid=0 2024-04-20T12:24:19.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.048+0000 7f19a0594740 1 client.16125 shutdown 2024-04-20T12:24:19.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.048+0000 7f19a0594740 1 -- 172.21.15.135:0/2963041772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e7730 msgr2=0x555aa27ed790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.048+0000 7f19a0594740 1 --2- 172.21.15.135:0/2963041772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e7730 0x555aa27ed790 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f198c004380 tx=0x7f198c0039c0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.048+0000 7f19a0594740 1 -- 172.21.15.135:0/2963041772 shutdown_connections 2024-04-20T12:24:19.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.048+0000 7f19a0594740 1 --2- 172.21.15.135:0/2963041772 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x555aa2800670 0x555aa2802ad0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.048+0000 7f1976ffd640 0 client.16125 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:24:19.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.048+0000 7f19a0594740 1 --2- 172.21.15.135:0/2963041772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 0x555aa27edcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.048+0000 7f19a0594740 1 --2- 172.21.15.135:0/2963041772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e7730 0x555aa27ed790 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.048+0000 7f19a0594740 1 --2- 172.21.15.135:0/2963041772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27e6e10 0x555aa27ed250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.048+0000 7f19a0594740 1 -- 172.21.15.135:0/2963041772 >> 172.21.15.135:0/2963041772 conn(0x555aa27e1540 msgr2=0x555aa27e3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:19.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.048+0000 7f19a0594740 1 -- 172.21.15.135:0/2963041772 shutdown_connections 2024-04-20T12:24:19.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.048+0000 7f19a0594740 1 -- 172.21.15.135:0/2963041772 wait complete. 2024-04-20T12:24:19.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.048+0000 7f19a0594740 20 client.16125 trim_cache size 0 max 16384 2024-04-20T12:24:19.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.061+0000 7f19a0594740 1 Processor -- start 2024-04-20T12:24:19.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.061+0000 7f19a0594740 1 -- start start 2024-04-20T12:24:19.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.061+0000 7f19a0594740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27e6e10 0x555aa27ef980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.061+0000 7f19a0594740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e7730 0x555aa27fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.061+0000 7f19a0594740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 0x555aa27dc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.061+0000 7f19a0594740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f198400fe80 con 0x555aa27e7730 2024-04-20T12:24:19.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.061+0000 7f19a0594740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f19840119c0 con 0x555aa27f0310 2024-04-20T12:24:19.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.061+0000 7f19a0594740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1984010550 con 0x555aa27e6e10 2024-04-20T12:24:19.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.062+0000 7f19967fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e7730 0x555aa27fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.062+0000 7f19967fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e7730 0x555aa27fbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39518/0 (socket says 172.21.15.135:39518) 2024-04-20T12:24:19.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.062+0000 7f19967fc640 1 -- 172.21.15.135:0/1165195030 learned_addr learned my addr 172.21.15.135:0/1165195030 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:19.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.062+0000 7f19977fe640 1 --2- 172.21.15.135:0/1165195030 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 0x555aa27dc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.062+0000 7f19977fe640 1 --2- 172.21.15.135:0/1165195030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27e6e10 0x555aa27ef980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.062+0000 7f19967fc640 1 -- 172.21.15.135:0/1165195030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27e6e10 msgr2=0x555aa27ef980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.062+0000 7f19967fc640 1 --2- 172.21.15.135:0/1165195030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27e6e10 0x555aa27ef980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.062+0000 7f19967fc640 1 -- 172.21.15.135:0/1165195030 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 msgr2=0x555aa27dc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.062+0000 7f19967fc640 1 --2- 172.21.15.135:0/1165195030 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 0x555aa27dc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.062+0000 7f19967fc640 1 -- 172.21.15.135:0/1165195030 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aa27e1370 con 0x555aa27e7730 2024-04-20T12:24:19.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.062+0000 7f19977fe640 1 --2- 172.21.15.135:0/1165195030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27e6e10 0x555aa27ef980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:24:19.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.062+0000 7f19967fc640 1 --2- 172.21.15.135:0/1165195030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e7730 0x555aa27fbfc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f198c000c00 tx=0x7f198c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4846da3d29bf28 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:19.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.062+0000 7f197d7fa640 1 -- 172.21.15.135:0/1165195030 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c005560 con 0x555aa27e7730 2024-04-20T12:24:19.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.062+0000 7f197d7fa640 1 -- 172.21.15.135:0/1165195030 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f198c011b30 con 0x555aa27e7730 2024-04-20T12:24:19.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.062+0000 7f197d7fa640 1 -- 172.21.15.135:0/1165195030 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c01bd30 con 0x555aa27e7730 2024-04-20T12:24:19.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.063+0000 7f19a0594740 1 -- 172.21.15.135:0/1165195030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e7730 msgr2=0x555aa27fbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.063+0000 7f19a0594740 1 --2- 172.21.15.135:0/1165195030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e7730 0x555aa27fbfc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f198c000c00 tx=0x7f198c00bf30 comp rx=0 tx=0).stop 2024-04-20T12:24:19.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.063+0000 7f19a0594740 1 -- 172.21.15.135:0/1165195030 shutdown_connections 2024-04-20T12:24:19.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.063+0000 7f19a0594740 1 --2- 172.21.15.135:0/1165195030 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27f0310 0x555aa27dc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.063+0000 7f19a0594740 1 --2- 172.21.15.135:0/1165195030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa27e7730 0x555aa27fbfc0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.063+0000 7f19a0594740 1 --2- 172.21.15.135:0/1165195030 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27e6e10 0x555aa27ef980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.063+0000 7f19a0594740 1 -- 172.21.15.135:0/1165195030 >> 172.21.15.135:0/1165195030 conn(0x555aa27e1540 msgr2=0x555aa27e06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:19.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.063+0000 7f19a0594740 1 -- 172.21.15.135:0/1165195030 shutdown_connections 2024-04-20T12:24:19.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.063+0000 7f19a0594740 1 -- 172.21.15.135:0/1165195030 wait complete. 2024-04-20T12:24:19.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.063+0000 7f19a0594740 1 -- start start 2024-04-20T12:24:19.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19a0594740 1 Processor -- start 2024-04-20T12:24:19.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19a0594740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27e6e10 0x555aa27f87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19a0594740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27f0310 0x555aa27e9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19a0594740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa2800670 0x555aa27e9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19a0594740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f19840112f0 con 0x555aa2800670 2024-04-20T12:24:19.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19a0594740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1984010c20 con 0x555aa27e6e10 2024-04-20T12:24:19.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19a0594740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f198400de50 con 0x555aa27f0310 2024-04-20T12:24:19.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa2800670 0x555aa27e9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19a0594740 10 client.0 _ll_register_callbacks cb 0x7f198c00bbd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:19.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa2800670 0x555aa27e9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39520/0 (socket says 172.21.15.135:39520) 2024-04-20T12:24:19.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19977fe640 1 -- 172.21.15.135:0/1710224716 learned_addr learned my addr 172.21.15.135:0/1710224716 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:19.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19977fe640 1 --2- 172.21.15.135:0/1710224716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27e6e10 0x555aa27f87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19977fe640 1 -- 172.21.15.135:0/1710224716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27f0310 msgr2=0x555aa27e9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19977fe640 1 --2- 172.21.15.135:0/1710224716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27f0310 0x555aa27e9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19977fe640 1 -- 172.21.15.135:0/1710224716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27e6e10 msgr2=0x555aa27f87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19977fe640 1 --2- 172.21.15.135:0/1710224716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27e6e10 0x555aa27f87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.064+0000 7f19977fe640 1 -- 172.21.15.135:0/1710224716 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aa27ea640 con 0x555aa2800670 2024-04-20T12:24:19.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.065+0000 7f19977fe640 1 --2- 172.21.15.135:0/1710224716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa2800670 0x555aa27e9f80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1990003af0 tx=0x7f199004a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e389eba6d9780d29 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:19.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.065+0000 7f1976ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:19.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.065+0000 7f1976ffd640 1 -- 172.21.15.135:0/1710224716 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1990043040 con 0x555aa2800670 2024-04-20T12:24:19.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.065+0000 7f1976ffd640 1 -- 172.21.15.135:0/1710224716 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f1990052bd0 con 0x555aa2800670 2024-04-20T12:24:19.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.065+0000 7f19a0594740 1 -- 172.21.15.135:0/1710224716 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f198c011b30 con 0x555aa2800670 2024-04-20T12:24:19.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.065+0000 7f1976ffd640 1 -- 172.21.15.135:0/1710224716 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1990039040 con 0x555aa2800670 2024-04-20T12:24:19.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.065+0000 7f19a0594740 10 client.16131 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:19.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.065+0000 7f19a0594740 1 -- 172.21.15.135:0/1710224716 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555aa2866a30 con 0x555aa2800670 2024-04-20T12:24:19.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.065+0000 7f1976ffd640 1 -- 172.21.15.135:0/1710224716 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f198c011b30 con 0x555aa2800670 2024-04-20T12:24:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.065+0000 7f1976ffd640 1 -- 172.21.15.135:0/1710224716 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f19900347f0 con 0x555aa2800670 2024-04-20T12:24:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.065+0000 7f19a0594740 10 client.16131 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.065+0000 7f19a0594740 10 client.16131 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:24:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.065+0000 7f19a0594740 20 client.16131 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.065+0000 7f19a0594740 1 --2- 172.21.15.135:0/1710224716 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x555aa2866d70 0x555aa2869160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.066+0000 7f19a0594740 4 client.16131 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:24:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.066+0000 7f19a0594740 1 -- 172.21.15.135:0/1710224716 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555aa27539a0 con 0x555aa2866d70 2024-04-20T12:24:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.066+0000 7f19967fc640 1 --2- 172.21.15.135:0/1710224716 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x555aa2866d70 0x555aa2869160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.066+0000 7f1976ffd640 10 client.16131 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:24:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.066+0000 7f19967fc640 1 --2- 172.21.15.135:0/1710224716 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x555aa2866d70 0x555aa2869160 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3091fdfd3f2cd8e6 server_cookie=f0f27b25bb1f92a0 in_seq=0 out_seq=0 2024-04-20T12:24:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.066+0000 7f1976ffd640 1 -- 172.21.15.135:0/1710224716 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555aa27539a0 con 0x555aa2866d70 2024-04-20T12:24:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.066+0000 7f1976ffd640 10 client.16131 handle_command_reply: tid=0 2024-04-20T12:24:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.066+0000 7f19a0594740 1 client.16131 shutdown 2024-04-20T12:24:19.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.066+0000 7f19a0594740 1 -- 172.21.15.135:0/1710224716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa2800670 msgr2=0x555aa27e9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.066+0000 7f19a0594740 1 --2- 172.21.15.135:0/1710224716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa2800670 0x555aa27e9f80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1990003af0 tx=0x7f199004a040 comp rx=0 tx=0).stop 2024-04-20T12:24:19.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.066+0000 7f19a0594740 1 -- 172.21.15.135:0/1710224716 shutdown_connections 2024-04-20T12:24:19.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.066+0000 7f19a0594740 1 --2- 172.21.15.135:0/1710224716 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x555aa2866d70 0x555aa2869160 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f1976ffd640 0 client.16131 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:24:19.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f19a0594740 1 --2- 172.21.15.135:0/1710224716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555aa2800670 0x555aa27e9f80 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f19a0594740 1 --2- 172.21.15.135:0/1710224716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555aa27f0310 0x555aa27e9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f19a0594740 1 --2- 172.21.15.135:0/1710224716 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555aa27e6e10 0x555aa27f87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f19a0594740 1 -- 172.21.15.135:0/1710224716 >> 172.21.15.135:0/1710224716 conn(0x555aa27e1540 msgr2=0x555aa27e06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:19.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f19a0594740 1 -- 172.21.15.135:0/1710224716 shutdown_connections 2024-04-20T12:24:19.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f19a0594740 1 -- 172.21.15.135:0/1710224716 wait complete. 2024-04-20T12:24:19.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f19a0594740 20 client.16131 trim_cache size 0 max 16384 2024-04-20T12:24:19.072 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:24:19.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f199d8c1640 1 -- 172.21.15.135:0/1375658573 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f19800a3f50 msgr2=0x7f19800a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f199d8c1640 1 --2- 172.21.15.135:0/1375658573 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f19800a3f50 0x7f19800a6410 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f19880d1a80 tx=0x7f19880da180 comp rx=0 tx=0).stop 2024-04-20T12:24:19.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f199d8c1640 1 -- 172.21.15.135:0/1375658573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1998101090 msgr2=0x7f1998199580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f199d8c1640 1 --2- 172.21.15.135:0/1375658573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1998101090 0x7f1998199580 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f198800bec0 tx=0x7f198800dd20 comp rx=0 tx=0).stop 2024-04-20T12:24:19.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f199d8c1640 1 -- 172.21.15.135:0/1375658573 shutdown_connections 2024-04-20T12:24:19.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f199d8c1640 1 --2- 172.21.15.135:0/1375658573 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f199819a050 0x7f19981a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f199d8c1640 1 --2- 172.21.15.135:0/1375658573 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1998106160 0x7f1998199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f199d8c1640 1 --2- 172.21.15.135:0/1375658573 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f19800a3f50 0x7f19800a6410 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f199d8c1640 1 --2- 172.21.15.135:0/1375658573 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1998101090 0x7f1998199580 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.067+0000 7f199d8c1640 1 -- 172.21.15.135:0/1375658573 >> 172.21.15.135:0/1375658573 conn(0x7f1998078010 msgr2=0x7f19980fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:19.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.068+0000 7f199d8c1640 1 -- 172.21.15.135:0/1375658573 shutdown_connections 2024-04-20T12:24:19.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.068+0000 7f199d8c1640 1 -- 172.21.15.135:0/1375658573 wait complete. 2024-04-20T12:24:19.078 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:24:19.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:18 smithi139 ceph-mon[21834]: pgmap v38: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-04-20T12:24:19.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:18 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/199021763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:24:19.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.180+0000 7f4f57626640 1 -- 172.21.15.135:0/641013207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f50103af0 msgr2=0x7f4f5010bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.180+0000 7f4f57626640 1 --2- 172.21.15.135:0/641013207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f50103af0 0x7f4f5010bfd0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009900 tx=0x7f4f4002bd60 comp rx=0 tx=0).stop 2024-04-20T12:24:19.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.180+0000 7f4f57626640 1 -- 172.21.15.135:0/641013207 shutdown_connections 2024-04-20T12:24:19.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.180+0000 7f4f57626640 1 --2- 172.21.15.135:0/641013207 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f5010c510 0x7f4f5010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.180+0000 7f4f57626640 1 --2- 172.21.15.135:0/641013207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f50103af0 0x7f4f5010bfd0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.180+0000 7f4f57626640 1 --2- 172.21.15.135:0/641013207 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f501031d0 0x7f4f501035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.180+0000 7f4f57626640 1 -- 172.21.15.135:0/641013207 >> 172.21.15.135:0/641013207 conn(0x7f4f50078010 msgr2=0x7f4f50078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:19.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.181+0000 7f4f57626640 1 -- 172.21.15.135:0/641013207 shutdown_connections 2024-04-20T12:24:19.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.181+0000 7f4f57626640 1 -- 172.21.15.135:0/641013207 wait complete. 2024-04-20T12:24:19.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.181+0000 7f4f57626640 1 Processor -- start 2024-04-20T12:24:19.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.181+0000 7f4f57626640 1 -- start start 2024-04-20T12:24:19.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.181+0000 7f4f57626640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f501031d0 0x7f4f5019e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.181+0000 7f4f57626640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f5010c510 0x7f4f5019ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.181+0000 7f4f57626640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f501987f0 0x7f4f50198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.181+0000 7f4f57626640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f50112340 con 0x7f4f501031d0 2024-04-20T12:24:19.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.181+0000 7f4f57626640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4f501121c0 con 0x7f4f5010c510 2024-04-20T12:24:19.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.181+0000 7f4f57626640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4f501124c0 con 0x7f4f501987f0 2024-04-20T12:24:19.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.182+0000 7f4f553c2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f501031d0 0x7f4f5019e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.182+0000 7f4f553c2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f501031d0 0x7f4f5019e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39528/0 (socket says 172.21.15.135:39528) 2024-04-20T12:24:19.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.182+0000 7f4f553c2640 1 -- 172.21.15.135:0/2208643818 learned_addr learned my addr 172.21.15.135:0/2208643818 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:19.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.182+0000 7f4f54bc1640 1 --2- 172.21.15.135:0/2208643818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f5010c510 0x7f4f5019ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.182+0000 7f4f553c2640 1 -- 172.21.15.135:0/2208643818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f501987f0 msgr2=0x7f4f50198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.182+0000 7f4f553c2640 1 --2- 172.21.15.135:0/2208643818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f501987f0 0x7f4f50198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.182+0000 7f4f553c2640 1 -- 172.21.15.135:0/2208643818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f5010c510 msgr2=0x7f4f5019ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.182+0000 7f4f553c2640 1 --2- 172.21.15.135:0/2208643818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f5010c510 0x7f4f5019ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.182+0000 7f4f553c2640 1 -- 172.21.15.135:0/2208643818 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f50199380 con 0x7f4f501031d0 2024-04-20T12:24:19.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.182+0000 7f4f553c2640 1 --2- 172.21.15.135:0/2208643818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f501031d0 0x7f4f5019e680 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00e9f0 tx=0x7f4f4c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:19.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.182+0000 7f4f467fc640 1 -- 172.21.15.135:0/2208643818 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c00cd80 con 0x7f4f501031d0 2024-04-20T12:24:19.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.182+0000 7f4f467fc640 1 -- 172.21.15.135:0/2208643818 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f4c010910 con 0x7f4f501031d0 2024-04-20T12:24:19.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.182+0000 7f4f467fc640 1 -- 172.21.15.135:0/2208643818 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c018990 con 0x7f4f501031d0 2024-04-20T12:24:19.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.182+0000 7f4f57626640 1 -- 172.21.15.135:0/2208643818 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f50199670 con 0x7f4f501031d0 2024-04-20T12:24:19.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.183+0000 7f4f57626640 1 -- 172.21.15.135:0/2208643818 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f50101050 con 0x7f4f501031d0 2024-04-20T12:24:19.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.185+0000 7f4f467fc640 1 -- 172.21.15.135:0/2208643818 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 138931+0+0 (secure 0 0 0) 0x7f4f4c010ac0 con 0x7f4f501031d0 2024-04-20T12:24:19.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.186+0000 7f4f467fc640 1 --2- 172.21.15.135:0/2208643818 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4f3c0a3f50 0x7f4f3c0a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.186+0000 7f4f5a20f740 1 Processor -- start 2024-04-20T12:24:19.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.186+0000 7f4f5a20f740 1 -- start start 2024-04-20T12:24:19.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.186+0000 7f4f54bc1640 1 --2- 172.21.15.135:0/2208643818 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4f3c0a3f50 0x7f4f3c0a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.186+0000 7f4f467fc640 1 -- 172.21.15.135:0/2208643818 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f4f4c0d1190 con 0x7f4f501031d0 2024-04-20T12:24:19.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.186+0000 7f4f5a20f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.186+0000 7f4f5a20f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fab730 0x55df35fb3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.186+0000 7f4f5a20f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35fb4310 0x55df35fb6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.186+0000 7f4f5a20f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55df35f10110 con 0x55df35fab730 2024-04-20T12:24:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.186+0000 7f4f5a20f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55df35ead550 con 0x55df35faae10 2024-04-20T12:24:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.186+0000 7f4f5a20f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55df35f0c0d0 con 0x55df35fb4310 2024-04-20T12:24:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.187+0000 7f4f54bc1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fab730 0x55df35fb3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.187+0000 7f4f553c2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.187+0000 7f4f54bc1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fab730 0x55df35fb3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39540/0 (socket says 172.21.15.135:39540) 2024-04-20T12:24:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.187+0000 7f4f54bc1640 1 -- 172.21.15.135:0/2267797343 learned_addr learned my addr 172.21.15.135:0/2267797343 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.187+0000 7f4f55bc3640 1 --2- 172.21.15.135:0/2267797343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35fb4310 0x55df35fb6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.187+0000 7f4f54bc1640 1 --2- 172.21.15.135:0/2208643818 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4f3c0a3f50 0x7f4f3c0a6410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4f40036040 tx=0x7f4f40005a20 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.187+0000 7f4f553c2640 1 -- 172.21.15.135:0/2267797343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35fb4310 msgr2=0x55df35fb6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.187+0000 7f4f553c2640 1 --2- 172.21.15.135:0/2267797343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35fb4310 0x55df35fb6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.187+0000 7f4f553c2640 1 -- 172.21.15.135:0/2267797343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fab730 msgr2=0x55df35fb3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.187+0000 7f4f553c2640 1 --2- 172.21.15.135:0/2267797343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fab730 0x55df35fb3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.187+0000 7f4f553c2640 1 -- 172.21.15.135:0/2267797343 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df35ed5900 con 0x55df35faae10 2024-04-20T12:24:19.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.187+0000 7f4f553c2640 1 --2- 172.21.15.135:0/2267797343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fab1f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0ce320 tx=0x7f4f4c09d270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65a6ea734c3a4ec1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:19.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.187+0000 7f4f3b7fe640 1 -- 172.21.15.135:0/2267797343 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0a57e0 con 0x55df35faae10 2024-04-20T12:24:19.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.187+0000 7f4f3b7fe640 1 -- 172.21.15.135:0/2267797343 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f4c0bd070 con 0x55df35faae10 2024-04-20T12:24:19.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.187+0000 7f4f3b7fe640 1 -- 172.21.15.135:0/2267797343 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c09c1e0 con 0x55df35faae10 2024-04-20T12:24:19.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.188+0000 7f4f5a20f740 1 -- 172.21.15.135:0/2267797343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 msgr2=0x55df35fab1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.188+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/2267797343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fab1f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0ce320 tx=0x7f4f4c09d270 comp rx=0 tx=0).stop 2024-04-20T12:24:19.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.188+0000 7f4f5a20f740 1 -- 172.21.15.135:0/2267797343 shutdown_connections 2024-04-20T12:24:19.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.188+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/2267797343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35fb4310 0x55df35fb6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.188+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/2267797343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fab730 0x55df35fb3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.188+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/2267797343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fab1f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.188+0000 7f4f5a20f740 1 -- 172.21.15.135:0/2267797343 >> 172.21.15.135:0/2267797343 conn(0x55df35fa5540 msgr2=0x55df35fa5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:19.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.189+0000 7f4f5a20f740 1 -- 172.21.15.135:0/2267797343 shutdown_connections 2024-04-20T12:24:19.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.189+0000 7f4f5a20f740 1 -- 172.21.15.135:0/2267797343 wait complete. 2024-04-20T12:24:19.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.189+0000 7f4f5a20f740 1 -- start start 2024-04-20T12:24:19.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.189+0000 7f4f5a20f740 1 Processor -- start 2024-04-20T12:24:19.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.189+0000 7f4f5a20f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fb14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.189+0000 7f4f5a20f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35fab730 0x55df35fb1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f5a20f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fb4310 0x55df35fb1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f553c2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fb14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f553c2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fb14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:57558/0 (socket says 172.21.15.135:57558) 2024-04-20T12:24:19.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f55bc3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fb4310 0x55df35fb1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f55bc3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fb4310 0x55df35fb1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39556/0 (socket says 172.21.15.135:39556) 2024-04-20T12:24:19.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f553c2640 1 -- 172.21.15.135:0/3166469066 learned_addr learned my addr 172.21.15.135:0/3166469066 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:19.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3166469066 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55df35fb6fe0 con 0x55df35fb4310 2024-04-20T12:24:19.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3166469066 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55df35ec9500 con 0x55df35faae10 2024-04-20T12:24:19.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3166469066 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55df35fb7160 con 0x55df35fab730 2024-04-20T12:24:19.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f553c2640 1 -- 172.21.15.135:0/3166469066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35fab730 msgr2=0x55df35fb1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f553c2640 1 --2- 172.21.15.135:0/3166469066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35fab730 0x55df35fb1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f553c2640 1 -- 172.21.15.135:0/3166469066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fb4310 msgr2=0x55df35fb1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f553c2640 1 --2- 172.21.15.135:0/3166469066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fb4310 0x55df35fb1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f553c2640 1 -- 172.21.15.135:0/3166469066 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df35c223f0 con 0x55df35faae10 2024-04-20T12:24:19.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f55bc3640 1 --2- 172.21.15.135:0/3166469066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fb4310 0x55df35fb1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:19.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f5a20f740 10 client.0 _ll_register_callbacks cb 0x55df35eae2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:19.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3166469066 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f4c0bd070 con 0x55df35faae10 2024-04-20T12:24:19.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f553c2640 1 --2- 172.21.15.135:0/3166469066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fb14c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c099540 tx=0x7f4f4c018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fa7ca97032c786b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:19.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.190+0000 7f4f38ff9640 10 client.25556 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-20T12:24:19.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.191+0000 7f4f38ff9640 1 -- 172.21.15.135:0/3166469066 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0aa050 con 0x55df35faae10 2024-04-20T12:24:19.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.191+0000 7f4f38ff9640 1 -- 172.21.15.135:0/3166469066 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f4f4c09c1d0 con 0x55df35faae10 2024-04-20T12:24:19.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.191+0000 7f4f38ff9640 1 -- 172.21.15.135:0/3166469066 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4f4c0b6070 con 0x55df35faae10 2024-04-20T12:24:19.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.191+0000 7f4f5a20f740 10 client.25556 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:19.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.191+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3166469066 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55df35cec7d0 con 0x55df35faae10 2024-04-20T12:24:19.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.191+0000 7f4f38ff9640 1 -- 172.21.15.135:0/3166469066 <== mon.2 v2:172.21.15.139:3300/0 4 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f4f4c0b7020 con 0x55df35faae10 2024-04-20T12:24:19.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.191+0000 7f4f5a20f740 10 client.25556 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:19.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.191+0000 7f4f5a20f740 10 client.25556 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:19.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.191+0000 7f4f5a20f740 20 client.25556 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:19.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.191+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/3166469066 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55df35fc41b0 0x55df35fc65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.191+0000 7f4f5a20f740 4 client.25556 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:19.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.191+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3166469066 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df35f1db30 con 0x55df35fc41b0 2024-04-20T12:24:19.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.192+0000 7f4f54bc1640 1 --2- 172.21.15.135:0/3166469066 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55df35fc41b0 0x55df35fc65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.192+0000 7f4f38ff9640 10 client.25556 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:19.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.192+0000 7f4f54bc1640 1 --2- 172.21.15.135:0/3166469066 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55df35fc41b0 0x55df35fc65a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4281de7c2e650ea9 server_cookie=65e0a071e50a260d in_seq=0 out_seq=0 2024-04-20T12:24:19.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.193+0000 7f4f38ff9640 1 -- 172.21.15.135:0/3166469066 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55df35f1db30 con 0x55df35fc41b0 2024-04-20T12:24:19.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.193+0000 7f4f38ff9640 10 client.25556 handle_command_reply: tid=0 2024-04-20T12:24:19.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.193+0000 7f4f5a20f740 1 client.25556 shutdown 2024-04-20T12:24:19.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.193+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3166469066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 msgr2=0x55df35fb14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.193+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/3166469066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fb14c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c099540 tx=0x7f4f4c018420 comp rx=0 tx=0).stop 2024-04-20T12:24:19.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.193+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3166469066 shutdown_connections 2024-04-20T12:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.193+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/3166469066 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55df35fc41b0 0x55df35fc65a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.193+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/3166469066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fb4310 0x55df35fb1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.193+0000 7f4f38ff9640 0 client.25556 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.193+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/3166469066 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35fab730 0x55df35fb1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.193+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/3166469066 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fb14c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.193+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3166469066 >> 172.21.15.135:0/3166469066 conn(0x55df35fa5540 msgr2=0x55df35fa7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.193+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3166469066 shutdown_connections 2024-04-20T12:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.193+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3166469066 wait complete. 2024-04-20T12:24:19.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.193+0000 7f4f5a20f740 20 client.25556 trim_cache size 0 max 16384 2024-04-20T12:24:19.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.219+0000 7f4f5a20f740 1 Processor -- start 2024-04-20T12:24:19.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.219+0000 7f4f5a20f740 1 -- start start 2024-04-20T12:24:19.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.219+0000 7f4f5a20f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35fa5540 0x55df35fb0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.219+0000 7f4f5a20f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fcbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f5a20f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fab730 0x55df35fcc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f55bc3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fab730 0x55df35fcc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f55bc3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fab730 0x55df35fcc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39572/0 (socket says 172.21.15.135:39572) 2024-04-20T12:24:19.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f54bc1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fcbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f553c2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35fa5540 0x55df35fb0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f55bc3640 1 -- 172.21.15.135:0/3845484709 learned_addr learned my addr 172.21.15.135:0/3845484709 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:19.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3845484709 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f501b1bc0 con 0x55df35fab730 2024-04-20T12:24:19.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3845484709 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4f501b3700 con 0x55df35faae10 2024-04-20T12:24:19.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3845484709 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4f501b2290 con 0x55df35fa5540 2024-04-20T12:24:19.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f54bc1640 1 -- 172.21.15.135:0/3845484709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35fa5540 msgr2=0x55df35fb0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f54bc1640 1 --2- 172.21.15.135:0/3845484709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35fa5540 0x55df35fb0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f54bc1640 1 -- 172.21.15.135:0/3845484709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fab730 msgr2=0x55df35fcc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f54bc1640 1 --2- 172.21.15.135:0/3845484709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fab730 0x55df35fcc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f54bc1640 1 -- 172.21.15.135:0/3845484709 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df35fa62d0 con 0x55df35faae10 2024-04-20T12:24:19.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f55bc3640 1 --2- 172.21.15.135:0/3845484709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fab730 0x55df35fcc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:19.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.220+0000 7f4f54bc1640 1 --2- 172.21.15.135:0/3845484709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fcbd50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55df35faa8e0 tx=0x7f4f4002bd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a7116dc8364d49b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:19.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.221+0000 7f4f3affd640 1 -- 172.21.15.135:0/3845484709 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4002cd70 con 0x55df35faae10 2024-04-20T12:24:19.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.221+0000 7f4f3affd640 1 -- 172.21.15.135:0/3845484709 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f40045040 con 0x55df35faae10 2024-04-20T12:24:19.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.221+0000 7f4f3affd640 1 -- 172.21.15.135:0/3845484709 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f40005180 con 0x55df35faae10 2024-04-20T12:24:19.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.221+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3845484709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 msgr2=0x55df35fcbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.221+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/3845484709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fcbd50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55df35faa8e0 tx=0x7f4f4002bd60 comp rx=0 tx=0).stop 2024-04-20T12:24:19.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.221+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3845484709 shutdown_connections 2024-04-20T12:24:19.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.221+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/3845484709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fab730 0x55df35fcc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.221+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/3845484709 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35faae10 0x55df35fcbd50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.221+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/3845484709 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35fa5540 0x55df35fb0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.221+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3845484709 >> 172.21.15.135:0/3845484709 conn(0x55df35fc6910 msgr2=0x55df35fa46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:19.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.222+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3845484709 shutdown_connections 2024-04-20T12:24:19.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.222+0000 7f4f5a20f740 1 -- 172.21.15.135:0/3845484709 wait complete. 2024-04-20T12:24:19.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.222+0000 7f4f5a20f740 1 -- start start 2024-04-20T12:24:19.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.222+0000 7f4f5a20f740 1 Processor -- start 2024-04-20T12:24:19.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.222+0000 7f4f5a20f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fa5540 0x55df35fbc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.222+0000 7f4f5a20f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35faae10 0x55df35fadd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.222+0000 7f4f5a20f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35fab730 0x55df35fae250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.222+0000 7f4f5a20f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4f501b3030 con 0x55df35fa5540 2024-04-20T12:24:19.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.222+0000 7f4f5a20f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4f501b2960 con 0x55df35fab730 2024-04-20T12:24:19.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.222+0000 7f4f5a20f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4f501afb90 con 0x55df35faae10 2024-04-20T12:24:19.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.222+0000 7f4f5a20f740 10 client.0 _ll_register_callbacks cb 0x7f4f480093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:19.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.222+0000 7f4f553c2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fa5540 0x55df35fbc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f55bc3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35fab730 0x55df35fae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f553c2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fa5540 0x55df35fbc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39586/0 (socket says 172.21.15.135:39586) 2024-04-20T12:24:19.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f553c2640 1 -- 172.21.15.135:0/1015233055 learned_addr learned my addr 172.21.15.135:0/1015233055 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:19.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f54bc1640 1 --2- 172.21.15.135:0/1015233055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35faae10 0x55df35fadd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f55bc3640 1 -- 172.21.15.135:0/1015233055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35faae10 msgr2=0x55df35fadd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f55bc3640 1 --2- 172.21.15.135:0/1015233055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35faae10 0x55df35fadd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f55bc3640 1 -- 172.21.15.135:0/1015233055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fa5540 msgr2=0x55df35fbc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:19.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f55bc3640 1 --2- 172.21.15.135:0/1015233055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fa5540 0x55df35fbc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f55bc3640 1 -- 172.21.15.135:0/1015233055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df35fae810 con 0x55df35fab730 2024-04-20T12:24:19.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f553c2640 1 --2- 172.21.15.135:0/1015233055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fa5540 0x55df35fbc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:19.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f55bc3640 1 --2- 172.21.15.135:0/1015233055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35fab730 0x55df35fae250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55df35fcc7d0 tx=0x7f4f4800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f2242a20802d940 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:19.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-20T12:24:19.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f38ff9640 1 -- 172.21.15.135:0/1015233055 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f48004d20 con 0x55df35fab730 2024-04-20T12:24:19.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f38ff9640 1 -- 172.21.15.135:0/1015233055 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f4f48005020 con 0x55df35fab730 2024-04-20T12:24:19.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f5a20f740 1 -- 172.21.15.135:0/1015233055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f40045040 con 0x55df35fab730 2024-04-20T12:24:19.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.223+0000 7f4f38ff9640 1 -- 172.21.15.135:0/1015233055 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4f48003970 con 0x55df35fab730 2024-04-20T12:24:19.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.224+0000 7f4f5a20f740 10 client.25562 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:19.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.224+0000 7f4f5a20f740 1 -- 172.21.15.135:0/1015233055 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55df3602a3f0 con 0x55df35fab730 2024-04-20T12:24:19.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.224+0000 7f4f38ff9640 1 -- 172.21.15.135:0/1015233055 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f48005700 con 0x55df35fab730 2024-04-20T12:24:19.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.224+0000 7f4f38ff9640 1 -- 172.21.15.135:0/1015233055 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f4f4801b070 con 0x55df35fab730 2024-04-20T12:24:19.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.224+0000 7f4f5a20f740 10 client.25562 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:19.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.224+0000 7f4f5a20f740 10 client.25562 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:19.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.224+0000 7f4f5a20f740 20 client.25562 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:19.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.224+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/1015233055 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55df35fb4310 0x55df3602cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:19.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.224+0000 7f4f5a20f740 4 client.25562 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:24:19.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.224+0000 7f4f5a20f740 1 -- 172.21.15.135:0/1015233055 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f4f40045040 con 0x55df35fb4310 2024-04-20T12:24:19.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.224+0000 7f4f553c2640 1 --2- 172.21.15.135:0/1015233055 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55df35fb4310 0x55df3602cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:19.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f553c2640 1 --2- 172.21.15.135:0/1015233055 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55df35fb4310 0x55df3602cba0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d71c6351b51c05b server_cookie=cb3f4e2ba5503c0b in_seq=0 out_seq=0 2024-04-20T12:24:19.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f38ff9640 10 client.25562 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:19.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f38ff9640 1 -- 172.21.15.135:0/1015233055 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f4f40045040 con 0x55df35fb4310 2024-04-20T12:24:19.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f38ff9640 10 client.25562 handle_command_reply: tid=0 2024-04-20T12:24:19.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f5a20f740 1 client.25562 shutdown 2024-04-20T12:24:19.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f5a20f740 1 -- 172.21.15.135:0/1015233055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35fab730 msgr2=0x55df35fae250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/1015233055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35fab730 0x55df35fae250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55df35fcc7d0 tx=0x7f4f4800f790 comp rx=0 tx=0).stop 2024-04-20T12:24:19.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f5a20f740 1 -- 172.21.15.135:0/1015233055 shutdown_connections 2024-04-20T12:24:19.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/1015233055 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55df35fb4310 0x55df3602cba0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/1015233055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55df35fab730 0x55df35fae250 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/1015233055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55df35faae10 0x55df35fadd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f38ff9640 0 client.25562 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:19.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f5a20f740 1 --2- 172.21.15.135:0/1015233055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df35fa5540 0x55df35fbc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f5a20f740 1 -- 172.21.15.135:0/1015233055 >> 172.21.15.135:0/1015233055 conn(0x55df35fc6910 msgr2=0x55df35fb1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:19.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f5a20f740 1 -- 172.21.15.135:0/1015233055 shutdown_connections 2024-04-20T12:24:19.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f5a20f740 1 -- 172.21.15.135:0/1015233055 wait complete. 2024-04-20T12:24:19.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.225+0000 7f4f5a20f740 20 client.25562 trim_cache size 0 max 16384 2024-04-20T12:24:19.231 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:24:19.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.226+0000 7f4f57626640 1 -- 172.21.15.135:0/2208643818 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4f3c0a3f50 msgr2=0x7f4f3c0a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.226+0000 7f4f57626640 1 --2- 172.21.15.135:0/2208643818 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4f3c0a3f50 0x7f4f3c0a6410 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4f40036040 tx=0x7f4f40005a20 comp rx=0 tx=0).stop 2024-04-20T12:24:19.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.226+0000 7f4f57626640 1 -- 172.21.15.135:0/2208643818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f501031d0 msgr2=0x7f4f5019e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:19.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.226+0000 7f4f57626640 1 --2- 172.21.15.135:0/2208643818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f501031d0 0x7f4f5019e680 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00e9f0 tx=0x7f4f4c00eeb0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.226+0000 7f4f57626640 1 -- 172.21.15.135:0/2208643818 shutdown_connections 2024-04-20T12:24:19.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.226+0000 7f4f57626640 1 --2- 172.21.15.135:0/2208643818 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4f3c0a3f50 0x7f4f3c0a6410 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.226+0000 7f4f57626640 1 --2- 172.21.15.135:0/2208643818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4f501987f0 0x7f4f50198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.226+0000 7f4f57626640 1 --2- 172.21.15.135:0/2208643818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4f5010c510 0x7f4f5019ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.226+0000 7f4f57626640 1 --2- 172.21.15.135:0/2208643818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4f501031d0 0x7f4f5019e680 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:19.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.226+0000 7f4f57626640 1 -- 172.21.15.135:0/2208643818 >> 172.21.15.135:0/2208643818 conn(0x7f4f50078010 msgr2=0x7f4f500fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:19.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.226+0000 7f4f57626640 1 -- 172.21.15.135:0/2208643818 shutdown_connections 2024-04-20T12:24:19.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:19.226+0000 7f4f57626640 1 -- 172.21.15.135:0/2208643818 wait complete. 2024-04-20T12:24:20.237 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:24:20.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:24:20.238 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:24:20.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.342+0000 7f2ef6ba4640 1 -- 172.21.15.135:0/640337239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef010c520 msgr2=0x7f2ef010e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.342+0000 7f2ef6ba4640 1 --2- 172.21.15.135:0/640337239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef010c520 0x7f2ef010e9c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009ca0 tx=0x7f2ee802c230 comp rx=0 tx=0).stop 2024-04-20T12:24:20.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.342+0000 7f2ef6ba4640 1 -- 172.21.15.135:0/640337239 shutdown_connections 2024-04-20T12:24:20.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.342+0000 7f2ef6ba4640 1 --2- 172.21.15.135:0/640337239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef010c520 0x7f2ef010e9c0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.342+0000 7f2ef6ba4640 1 --2- 172.21.15.135:0/640337239 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef0103b00 0x7f2ef010bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.342+0000 7f2ef6ba4640 1 --2- 172.21.15.135:0/640337239 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ef01031e0 0x7f2ef01035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.342+0000 7f2ef6ba4640 1 -- 172.21.15.135:0/640337239 >> 172.21.15.135:0/640337239 conn(0x7f2ef0077f60 msgr2=0x7f2ef0078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:20.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.342+0000 7f2ef6ba4640 1 -- 172.21.15.135:0/640337239 shutdown_connections 2024-04-20T12:24:20.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.342+0000 7f2ef6ba4640 1 -- 172.21.15.135:0/640337239 wait complete. 2024-04-20T12:24:20.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.343+0000 7f2ef6ba4640 1 Processor -- start 2024-04-20T12:24:20.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.343+0000 7f2ef6ba4640 1 -- start start 2024-04-20T12:24:20.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.343+0000 7f2ef6ba4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef01031e0 0x7f2ef0100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.343+0000 7f2ef6ba4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ef0103b00 0x7f2ef0101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.343+0000 7f2ef6ba4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef010c520 0x7f2ef01018b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.343+0000 7f2ef6ba4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef01122e0 con 0x7f2ef01031e0 2024-04-20T12:24:20.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.343+0000 7f2ef6ba4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef0112160 con 0x7f2ef010c520 2024-04-20T12:24:20.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.343+0000 7f2ef6ba4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef0112460 con 0x7f2ef0103b00 2024-04-20T12:24:20.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.343+0000 7f2ef4940640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef01031e0 0x7f2ef0100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.343+0000 7f2ef4940640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef01031e0 0x7f2ef0100e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39604/0 (socket says 172.21.15.135:39604) 2024-04-20T12:24:20.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.343+0000 7f2ef4940640 1 -- 172.21.15.135:0/546408027 learned_addr learned my addr 172.21.15.135:0/546408027 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:20.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.343+0000 7f2eeffff640 1 --2- 172.21.15.135:0/546408027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ef0103b00 0x7f2ef0101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.344+0000 7f2ef5141640 1 --2- 172.21.15.135:0/546408027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef010c520 0x7f2ef01018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.344+0000 7f2ef4940640 1 -- 172.21.15.135:0/546408027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ef0103b00 msgr2=0x7f2ef0101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.344+0000 7f2ef4940640 1 --2- 172.21.15.135:0/546408027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ef0103b00 0x7f2ef0101370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.344+0000 7f2ef4940640 1 -- 172.21.15.135:0/546408027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef010c520 msgr2=0x7f2ef01018b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.344+0000 7f2ef4940640 1 --2- 172.21.15.135:0/546408027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef010c520 0x7f2ef01018b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.344+0000 7f2ef4940640 1 -- 172.21.15.135:0/546408027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef01a6d00 con 0x7f2ef01031e0 2024-04-20T12:24:20.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.344+0000 7f2ef4940640 1 --2- 172.21.15.135:0/546408027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef01031e0 0x7f2ef0100e30 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400d950 tx=0x7f2ee400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:20.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.344+0000 7f2eedffb640 1 -- 172.21.15.135:0/546408027 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4017070 con 0x7f2ef01031e0 2024-04-20T12:24:20.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.344+0000 7f2ef6ba4640 1 -- 172.21.15.135:0/546408027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef01a6ff0 con 0x7f2ef01031e0 2024-04-20T12:24:20.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.344+0000 7f2eedffb640 1 -- 172.21.15.135:0/546408027 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ee4009c30 con 0x7f2ef01031e0 2024-04-20T12:24:20.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.344+0000 7f2eedffb640 1 -- 172.21.15.135:0/546408027 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400f6b0 con 0x7f2ef01031e0 2024-04-20T12:24:20.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.344+0000 7f2ef6ba4640 1 -- 172.21.15.135:0/546408027 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef01a7500 con 0x7f2ef01031e0 2024-04-20T12:24:20.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.348+0000 7f2ef9791740 1 Processor -- start 2024-04-20T12:24:20.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.348+0000 7f2eedffb640 1 -- 172.21.15.135:0/546408027 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 138931+0+0 (secure 0 0 0) 0x7f2ee40109d0 con 0x7f2ef01031e0 2024-04-20T12:24:20.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.348+0000 7f2ef9791740 1 -- start start 2024-04-20T12:24:20.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.348+0000 7f2ef9791740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781ff5fe0 0x55e781ff63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.348+0000 7f2ef9791740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff6900 0x55e781ffefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.348+0000 7f2ef9791740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781fff4e0 0x55e7820018d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.348+0000 7f2ef9791740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e781f5af00 con 0x55e781ff5fe0 2024-04-20T12:24:20.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.348+0000 7f2ef9791740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e781ef8530 con 0x55e781ff6900 2024-04-20T12:24:20.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.348+0000 7f2ef9791740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e781f56ec0 con 0x55e781fff4e0 2024-04-20T12:24:20.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.348+0000 7f2ef5141640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781ff5fe0 0x55e781ff63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.348+0000 7f2ef5141640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781ff5fe0 0x55e781ff63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39610/0 (socket says 172.21.15.135:39610) 2024-04-20T12:24:20.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.348+0000 7f2ef5141640 1 -- 172.21.15.135:0/3635221718 learned_addr learned my addr 172.21.15.135:0/3635221718 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:20.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.348+0000 7f2ef4940640 1 --2- 172.21.15.135:0/3635221718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff6900 0x55e781ffefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.348+0000 7f2eeffff640 1 --2- 172.21.15.135:0/3635221718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781fff4e0 0x55e7820018d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.349+0000 7f2ef5141640 1 -- 172.21.15.135:0/3635221718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781fff4e0 msgr2=0x55e7820018d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.349+0000 7f2ef5141640 1 --2- 172.21.15.135:0/3635221718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781fff4e0 0x55e7820018d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.349+0000 7f2ef5141640 1 -- 172.21.15.135:0/3635221718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff6900 msgr2=0x55e781ffefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.349+0000 7f2ef5141640 1 --2- 172.21.15.135:0/3635221718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff6900 0x55e781ffefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.349+0000 7f2ef5141640 1 -- 172.21.15.135:0/3635221718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e781d357e0 con 0x55e781ff5fe0 2024-04-20T12:24:20.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.349+0000 7f2eedffb640 1 --2- 172.21.15.135:0/546408027 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2ee00a3ed0 0x7f2ee00a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.349+0000 7f2ef5141640 1 --2- 172.21.15.135:0/3635221718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781ff5fe0 0x55e781ff63c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009ca0 tx=0x7f2ee8009980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a493fc414cdee3cb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:20.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.349+0000 7f2ef4940640 1 --2- 172.21.15.135:0/546408027 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2ee00a3ed0 0x7f2ee00a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.349+0000 7f2eedffb640 1 -- 172.21.15.135:0/546408027 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f2ee40d0320 con 0x7f2ef01031e0 2024-04-20T12:24:20.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.349+0000 7f2edaffd640 1 -- 172.21.15.135:0/3635221718 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8043070 con 0x55e781ff5fe0 2024-04-20T12:24:20.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.349+0000 7f2edaffd640 1 -- 172.21.15.135:0/3635221718 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ee8003e50 con 0x55e781ff5fe0 2024-04-20T12:24:20.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.349+0000 7f2edaffd640 1 -- 172.21.15.135:0/3635221718 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8039040 con 0x55e781ff5fe0 2024-04-20T12:24:20.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.350+0000 7f2ef9791740 1 -- 172.21.15.135:0/3635221718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781ff5fe0 msgr2=0x55e781ff63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.350+0000 7f2ef9791740 1 --2- 172.21.15.135:0/3635221718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781ff5fe0 0x55e781ff63c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009ca0 tx=0x7f2ee8009980 comp rx=0 tx=0).stop 2024-04-20T12:24:20.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.350+0000 7f2ef4940640 1 --2- 172.21.15.135:0/546408027 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2ee00a3ed0 0x7f2ee00a6390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40cd510 tx=0x7f2ee400bf60 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:20.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.350+0000 7f2ef9791740 1 -- 172.21.15.135:0/3635221718 shutdown_connections 2024-04-20T12:24:20.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.350+0000 7f2ef9791740 1 --2- 172.21.15.135:0/3635221718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781fff4e0 0x55e7820018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.350+0000 7f2ef9791740 1 --2- 172.21.15.135:0/3635221718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff6900 0x55e781ffefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.350+0000 7f2ef9791740 1 --2- 172.21.15.135:0/3635221718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781ff5fe0 0x55e781ff63c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.350+0000 7f2ef9791740 1 -- 172.21.15.135:0/3635221718 >> 172.21.15.135:0/3635221718 conn(0x55e781ff0710 msgr2=0x55e781ff0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:20.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.350+0000 7f2ef9791740 1 -- 172.21.15.135:0/3635221718 shutdown_connections 2024-04-20T12:24:20.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.350+0000 7f2ef9791740 1 -- 172.21.15.135:0/3635221718 wait complete. 2024-04-20T12:24:20.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.351+0000 7f2ef9791740 1 -- start start 2024-04-20T12:24:20.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.351+0000 7f2ef9791740 1 Processor -- start 2024-04-20T12:24:20.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.351+0000 7f2ef9791740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff5fe0 0x55e781ffeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.351+0000 7f2ef9791740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 0x55e781ffc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.351+0000 7f2ef9791740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781fff4e0 0x55e781ffc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.351+0000 7f2ef9791740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e782002270 con 0x55e781fff4e0 2024-04-20T12:24:20.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.351+0000 7f2ef5141640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff5fe0 0x55e781ffeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.351+0000 7f2ef9791740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e781ee3480 con 0x55e781ff5fe0 2024-04-20T12:24:20.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.351+0000 7f2ef9791740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e7820023f0 con 0x55e781ff6900 2024-04-20T12:24:20.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.351+0000 7f2ef5141640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff5fe0 0x55e781ffeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:57622/0 (socket says 172.21.15.135:57622) 2024-04-20T12:24:20.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.351+0000 7f2ef5141640 1 -- 172.21.15.135:0/2508505021 learned_addr learned my addr 172.21.15.135:0/2508505021 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:20.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.351+0000 7f2ef5141640 1 --2- 172.21.15.135:0/2508505021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781fff4e0 0x55e781ffc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.351+0000 7f2ef9791740 10 client.0 _ll_register_callbacks cb 0x55e781ee2e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:20.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.352+0000 7f2eeffff640 1 --2- 172.21.15.135:0/2508505021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 0x55e781ffc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.352+0000 7f2ef5141640 1 -- 172.21.15.135:0/2508505021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 msgr2=0x55e781ffc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.352+0000 7f2ef5141640 1 --2- 172.21.15.135:0/2508505021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 0x55e781ffc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.352+0000 7f2ef5141640 1 -- 172.21.15.135:0/2508505021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781fff4e0 msgr2=0x55e781ffc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.352+0000 7f2ef5141640 1 --2- 172.21.15.135:0/2508505021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781fff4e0 0x55e781ffc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.352+0000 7f2ef5141640 1 -- 172.21.15.135:0/2508505021 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e781d95f70 con 0x55e781ff5fe0 2024-04-20T12:24:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.352+0000 7f2ef5141640 1 --2- 172.21.15.135:0/2508505021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff5fe0 0x55e781ffeeb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009430 tx=0x7f2ee8032d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a87e07ff328886bb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.352+0000 7f2ecffff640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-20T12:24:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.352+0000 7f2ecffff640 1 -- 172.21.15.135:0/2508505021 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8043050 con 0x55e781ff5fe0 2024-04-20T12:24:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.352+0000 7f2ef9791740 1 -- 172.21.15.135:0/2508505021 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ee8003e50 con 0x55e781ff5fe0 2024-04-20T12:24:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.352+0000 7f2ecffff640 1 -- 172.21.15.135:0/2508505021 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f2ee8004200 con 0x55e781ff5fe0 2024-04-20T12:24:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.352+0000 7f2ecffff640 1 -- 172.21.15.135:0/2508505021 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ee805b050 con 0x55e781ff5fe0 2024-04-20T12:24:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.352+0000 7f2ef9791740 10 client.25574 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.352+0000 7f2ef9791740 1 -- 172.21.15.135:0/2508505021 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e781c2d170 con 0x55e781ff5fe0 2024-04-20T12:24:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.353+0000 7f2ecffff640 1 -- 172.21.15.135:0/2508505021 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ee8003e50 con 0x55e781ff5fe0 2024-04-20T12:24:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.353+0000 7f2ecffff640 1 -- 172.21.15.135:0/2508505021 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2ee8048a90 con 0x55e781ff5fe0 2024-04-20T12:24:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.353+0000 7f2ef9791740 10 client.25574 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:20.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.353+0000 7f2ef9791740 10 client.25574 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:20.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.353+0000 7f2ef9791740 20 client.25574 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:20.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.353+0000 7f2ef9791740 1 --2- 172.21.15.135:0/2508505021 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55e78200f3b0 0x55e7820117a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.353+0000 7f2ef9791740 4 client.25574 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:20.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.353+0000 7f2ef9791740 1 -- 172.21.15.135:0/2508505021 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e781f68920 con 0x55e78200f3b0 2024-04-20T12:24:20.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.353+0000 7f2eeffff640 1 --2- 172.21.15.135:0/2508505021 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55e78200f3b0 0x55e7820117a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.354+0000 7f2ecffff640 10 client.25574 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:20.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.354+0000 7f2eeffff640 1 --2- 172.21.15.135:0/2508505021 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55e78200f3b0 0x55e7820117a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eca71959ea4a26e6 server_cookie=ff707eb1e75d8d9b in_seq=0 out_seq=0 2024-04-20T12:24:20.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.355+0000 7f2ecffff640 1 -- 172.21.15.135:0/2508505021 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e781f68920 con 0x55e78200f3b0 2024-04-20T12:24:20.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.355+0000 7f2ecffff640 10 client.25574 handle_command_reply: tid=0 2024-04-20T12:24:20.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.355+0000 7f2ef9791740 1 client.25574 shutdown 2024-04-20T12:24:20.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.355+0000 7f2ef9791740 1 -- 172.21.15.135:0/2508505021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff5fe0 msgr2=0x55e781ffeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.355+0000 7f2ef9791740 1 --2- 172.21.15.135:0/2508505021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff5fe0 0x55e781ffeeb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009430 tx=0x7f2ee8032d40 comp rx=0 tx=0).stop 2024-04-20T12:24:20.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.355+0000 7f2ef9791740 1 -- 172.21.15.135:0/2508505021 shutdown_connections 2024-04-20T12:24:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.355+0000 7f2ef9791740 1 --2- 172.21.15.135:0/2508505021 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55e78200f3b0 0x55e7820117a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.355+0000 7f2ef9791740 1 --2- 172.21.15.135:0/2508505021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781fff4e0 0x55e781ffc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.355+0000 7f2ef9791740 1 --2- 172.21.15.135:0/2508505021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 0x55e781ffc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.355+0000 7f2ef9791740 1 --2- 172.21.15.135:0/2508505021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff5fe0 0x55e781ffeeb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.355+0000 7f2ef9791740 1 -- 172.21.15.135:0/2508505021 >> 172.21.15.135:0/2508505021 conn(0x55e781ff0710 msgr2=0x55e781ff2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.355+0000 7f2ecffff640 0 client.25574 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.355+0000 7f2ef9791740 1 -- 172.21.15.135:0/2508505021 shutdown_connections 2024-04-20T12:24:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.355+0000 7f2ef9791740 1 -- 172.21.15.135:0/2508505021 wait complete. 2024-04-20T12:24:20.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.355+0000 7f2ef9791740 20 client.25574 trim_cache size 0 max 16384 2024-04-20T12:24:20.373 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.372+0000 7f2ef9791740 1 Processor -- start 2024-04-20T12:24:20.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.372+0000 7f2ef9791740 1 -- start start 2024-04-20T12:24:20.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef9791740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781ff5fe0 0x55e781ffe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef9791740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 0x55e781ffeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef9791740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781fff4e0 0x55e782016dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef9791740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef01b1580 con 0x55e781ff5fe0 2024-04-20T12:24:20.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef9791740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef01b30c0 con 0x55e781fff4e0 2024-04-20T12:24:20.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef9791740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef01b1c50 con 0x55e781ff6900 2024-04-20T12:24:20.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef5141640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781ff5fe0 0x55e781ffe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef5141640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781ff5fe0 0x55e781ffe970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39636/0 (socket says 172.21.15.135:39636) 2024-04-20T12:24:20.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef5141640 1 -- 172.21.15.135:0/3656711029 learned_addr learned my addr 172.21.15.135:0/3656711029 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:20.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2eeffff640 1 --2- 172.21.15.135:0/3656711029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 0x55e781ffeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef5141640 1 --2- 172.21.15.135:0/3656711029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781fff4e0 0x55e782016dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.374 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef5141640 1 -- 172.21.15.135:0/3656711029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 msgr2=0x55e781ffeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef5141640 1 --2- 172.21.15.135:0/3656711029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 0x55e781ffeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef5141640 1 -- 172.21.15.135:0/3656711029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781fff4e0 msgr2=0x55e782016dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef5141640 1 --2- 172.21.15.135:0/3656711029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781fff4e0 0x55e782016dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef5141640 1 -- 172.21.15.135:0/3656711029 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e781ffce50 con 0x55e781ff5fe0 2024-04-20T12:24:20.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2eeffff640 1 --2- 172.21.15.135:0/3656711029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 0x55e781ffeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:20.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.373+0000 7f2ef5141640 1 --2- 172.21.15.135:0/3656711029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781ff5fe0 0x55e781ffe970 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f2ee802c840 tx=0x7f2ee802c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3f67fc308babc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:20.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.374+0000 7f2eda7fc640 1 -- 172.21.15.135:0/3656711029 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8043040 con 0x55e781ff5fe0 2024-04-20T12:24:20.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.374+0000 7f2eda7fc640 1 -- 172.21.15.135:0/3656711029 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ee8032340 con 0x55e781ff5fe0 2024-04-20T12:24:20.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.374+0000 7f2eda7fc640 1 -- 172.21.15.135:0/3656711029 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8039040 con 0x55e781ff5fe0 2024-04-20T12:24:20.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.375+0000 7f2ef9791740 1 -- 172.21.15.135:0/3656711029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781ff5fe0 msgr2=0x55e781ffe970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.375+0000 7f2ef9791740 1 --2- 172.21.15.135:0/3656711029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781ff5fe0 0x55e781ffe970 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f2ee802c840 tx=0x7f2ee802c230 comp rx=0 tx=0).stop 2024-04-20T12:24:20.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.375+0000 7f2ef9791740 1 -- 172.21.15.135:0/3656711029 shutdown_connections 2024-04-20T12:24:20.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.375+0000 7f2ef9791740 1 --2- 172.21.15.135:0/3656711029 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781fff4e0 0x55e782016dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.375+0000 7f2ef9791740 1 --2- 172.21.15.135:0/3656711029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 0x55e781ffeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.375+0000 7f2ef9791740 1 --2- 172.21.15.135:0/3656711029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781ff5fe0 0x55e781ffe970 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.375+0000 7f2ef9791740 1 -- 172.21.15.135:0/3656711029 >> 172.21.15.135:0/3656711029 conn(0x55e781ff0710 msgr2=0x55e781ff1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:20.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.375+0000 7f2ef9791740 1 -- 172.21.15.135:0/3656711029 shutdown_connections 2024-04-20T12:24:20.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.375+0000 7f2ef9791740 1 -- 172.21.15.135:0/3656711029 wait complete. 2024-04-20T12:24:20.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.375+0000 7f2ef9791740 1 -- start start 2024-04-20T12:24:20.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.375+0000 7f2ef9791740 1 Processor -- start 2024-04-20T12:24:20.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef9791740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff5fe0 0x55e781ff9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef9791740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 0x55e781ff9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef9791740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781fff4e0 0x55e782074640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef9791740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef01b29f0 con 0x55e781fff4e0 2024-04-20T12:24:20.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef9791740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef01b2320 con 0x55e781ff5fe0 2024-04-20T12:24:20.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef9791740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef01af550 con 0x55e781ff6900 2024-04-20T12:24:20.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef9791740 10 client.0 _ll_register_callbacks cb 0x7f2ee8032520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:20.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef5141640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781fff4e0 0x55e782074640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef5141640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781fff4e0 0x55e782074640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39640/0 (socket says 172.21.15.135:39640) 2024-04-20T12:24:20.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef5141640 1 -- 172.21.15.135:0/4192831345 learned_addr learned my addr 172.21.15.135:0/4192831345 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:20.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef5141640 1 --2- 172.21.15.135:0/4192831345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff5fe0 0x55e781ff9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2eeffff640 1 --2- 172.21.15.135:0/4192831345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 0x55e781ff9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef5141640 1 -- 172.21.15.135:0/4192831345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 msgr2=0x55e781ff9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef5141640 1 --2- 172.21.15.135:0/4192831345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 0x55e781ff9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef5141640 1 -- 172.21.15.135:0/4192831345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff5fe0 msgr2=0x55e781ff9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef5141640 1 --2- 172.21.15.135:0/4192831345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff5fe0 0x55e781ff9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2ef5141640 1 -- 172.21.15.135:0/4192831345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e782074b80 con 0x55e781fff4e0 2024-04-20T12:24:20.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.376+0000 7f2eeffff640 1 --2- 172.21.15.135:0/4192831345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 0x55e781ff9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:24:20.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.377+0000 7f2ef5141640 1 --2- 172.21.15.135:0/4192831345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781fff4e0 0x55e782074640 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x55e7820046b0 tx=0x7f2ee8004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c24e0342181993 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:20.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.377+0000 7f2ecffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:20.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.377+0000 7f2ecffff640 1 -- 172.21.15.135:0/4192831345 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8039070 con 0x55e781fff4e0 2024-04-20T12:24:20.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.377+0000 7f2ecffff640 1 -- 172.21.15.135:0/4192831345 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f2ee803f7c0 con 0x55e781fff4e0 2024-04-20T12:24:20.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.377+0000 7f2ef9791740 1 -- 172.21.15.135:0/4192831345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ee8032340 con 0x55e781fff4e0 2024-04-20T12:24:20.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.377+0000 7f2ecffff640 1 -- 172.21.15.135:0/4192831345 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ee803f9c0 con 0x55e781fff4e0 2024-04-20T12:24:20.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.377+0000 7f2ef9791740 10 client.16167 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:20.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.377+0000 7f2ef9791740 1 -- 172.21.15.135:0/4192831345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e782075d60 con 0x55e781fff4e0 2024-04-20T12:24:20.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.377+0000 7f2ecffff640 1 -- 172.21.15.135:0/4192831345 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ee8032340 con 0x55e781fff4e0 2024-04-20T12:24:20.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.378+0000 7f2ecffff640 1 -- 172.21.15.135:0/4192831345 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2ee806c450 con 0x55e781fff4e0 2024-04-20T12:24:20.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.378+0000 7f2ef9791740 10 client.16167 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:20.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.378+0000 7f2ef9791740 10 client.16167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:20.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.378+0000 7f2ef9791740 20 client.16167 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:20.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.378+0000 7f2ef9791740 1 --2- 172.21.15.135:0/4192831345 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55e7820762c0 0x55e7820786b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.378+0000 7f2ef9791740 4 client.16167 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:24:20.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.378+0000 7f2ef9791740 1 -- 172.21.15.135:0/4192831345 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e781f62790 con 0x55e7820762c0 2024-04-20T12:24:20.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.378+0000 7f2eeffff640 1 --2- 172.21.15.135:0/4192831345 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55e7820762c0 0x55e7820786b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.378+0000 7f2eeffff640 1 --2- 172.21.15.135:0/4192831345 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55e7820762c0 0x55e7820786b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4c6156e3e3cd620 server_cookie=68ec0045185d16d0 in_seq=0 out_seq=0 2024-04-20T12:24:20.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.378+0000 7f2ecffff640 10 client.16167 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:20.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.380+0000 7f2ecffff640 1 -- 172.21.15.135:0/4192831345 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e781f62790 con 0x55e7820762c0 2024-04-20T12:24:20.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.380+0000 7f2ecffff640 10 client.16167 handle_command_reply: tid=0 2024-04-20T12:24:20.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.380+0000 7f2ef9791740 1 client.16167 shutdown 2024-04-20T12:24:20.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.380+0000 7f2ef9791740 1 -- 172.21.15.135:0/4192831345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781fff4e0 msgr2=0x55e782074640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.380+0000 7f2ef9791740 1 --2- 172.21.15.135:0/4192831345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781fff4e0 0x55e782074640 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x55e7820046b0 tx=0x7f2ee8004b40 comp rx=0 tx=0).stop 2024-04-20T12:24:20.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.380+0000 7f2ef9791740 1 -- 172.21.15.135:0/4192831345 shutdown_connections 2024-04-20T12:24:20.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.380+0000 7f2ef9791740 1 --2- 172.21.15.135:0/4192831345 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55e7820762c0 0x55e7820786b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.380+0000 7f2ecffff640 0 client.16167 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:20.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.380+0000 7f2ef9791740 1 --2- 172.21.15.135:0/4192831345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e781fff4e0 0x55e782074640 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.380+0000 7f2ef9791740 1 --2- 172.21.15.135:0/4192831345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e781ff6900 0x55e781ff9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.380+0000 7f2ef9791740 1 --2- 172.21.15.135:0/4192831345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e781ff5fe0 0x55e781ff9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.380+0000 7f2ef9791740 1 -- 172.21.15.135:0/4192831345 >> 172.21.15.135:0/4192831345 conn(0x55e781ff0710 msgr2=0x55e781ff2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:20.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.381+0000 7f2ef9791740 1 -- 172.21.15.135:0/4192831345 shutdown_connections 2024-04-20T12:24:20.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.381+0000 7f2ef9791740 1 -- 172.21.15.135:0/4192831345 wait complete. 2024-04-20T12:24:20.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.381+0000 7f2ef9791740 20 client.16167 trim_cache size 0 max 16384 2024-04-20T12:24:20.385 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:24:20.385 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:24:20.385 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "ed45fa36-56fa-4a7d-84d9-db5bb2fa3ec9", 2024-04-20T12:24:20.385 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:24:20.385 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:24:20.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.382+0000 7f2ef6ba4640 1 -- 172.21.15.135:0/546408027 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2ee00a3ed0 msgr2=0x7f2ee00a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.382+0000 7f2ef6ba4640 1 --2- 172.21.15.135:0/546408027 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2ee00a3ed0 0x7f2ee00a6390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2ee40cd510 tx=0x7f2ee400bf60 comp rx=0 tx=0).stop 2024-04-20T12:24:20.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.382+0000 7f2ef6ba4640 1 -- 172.21.15.135:0/546408027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef01031e0 msgr2=0x7f2ef0100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.382+0000 7f2ef6ba4640 1 --2- 172.21.15.135:0/546408027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef01031e0 0x7f2ef0100e30 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400d950 tx=0x7f2ee400de10 comp rx=0 tx=0).stop 2024-04-20T12:24:20.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.382+0000 7f2ef6ba4640 1 -- 172.21.15.135:0/546408027 shutdown_connections 2024-04-20T12:24:20.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.382+0000 7f2ef6ba4640 1 --2- 172.21.15.135:0/546408027 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2ef010c520 0x7f2ef01018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.382+0000 7f2ef6ba4640 1 --2- 172.21.15.135:0/546408027 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2ee00a3ed0 0x7f2ee00a6390 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.382+0000 7f2ef6ba4640 1 --2- 172.21.15.135:0/546408027 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ef0103b00 0x7f2ef0101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.382+0000 7f2ef6ba4640 1 --2- 172.21.15.135:0/546408027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ef01031e0 0x7f2ef0100e30 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.382+0000 7f2ef6ba4640 1 -- 172.21.15.135:0/546408027 >> 172.21.15.135:0/546408027 conn(0x7f2ef0077f60 msgr2=0x7f2ef00fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:20.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.382+0000 7f2ef6ba4640 1 -- 172.21.15.135:0/546408027 shutdown_connections 2024-04-20T12:24:20.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.382+0000 7f2ef6ba4640 1 -- 172.21.15.135:0/546408027 wait complete. 2024-04-20T12:24:20.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:24:20.393 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:24:20.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.496+0000 7f16da85c640 1 -- 172.21.15.135:0/3407444977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d41072f0 msgr2=0x7f16d410eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.496+0000 7f16da85c640 1 --2- 172.21.15.135:0/3407444977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d41072f0 0x7f16d410eec0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009ca0 tx=0x7f16cc02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.496+0000 7f16da85c640 1 -- 172.21.15.135:0/3407444977 shutdown_connections 2024-04-20T12:24:20.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.496+0000 7f16da85c640 1 --2- 172.21.15.135:0/3407444977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d41072f0 0x7f16d410eec0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.496+0000 7f16da85c640 1 --2- 172.21.15.135:0/3407444977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d4102bd0 0x7f16d4106c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.496+0000 7f16da85c640 1 --2- 172.21.15.135:0/3407444977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d4102220 0x7f16d4102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.496+0000 7f16da85c640 1 -- 172.21.15.135:0/3407444977 >> 172.21.15.135:0/3407444977 conn(0x7f16d40fdac0 msgr2=0x7f16d40ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:20.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.496+0000 7f16da85c640 1 -- 172.21.15.135:0/3407444977 shutdown_connections 2024-04-20T12:24:20.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.496+0000 7f16da85c640 1 -- 172.21.15.135:0/3407444977 wait complete. 2024-04-20T12:24:20.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.497+0000 7f16da85c640 1 Processor -- start 2024-04-20T12:24:20.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.497+0000 7f16da85c640 1 -- start start 2024-04-20T12:24:20.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.497+0000 7f16da85c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d4102220 0x7f16d419e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.497+0000 7f16da85c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d41072f0 0x7f16d419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.497+0000 7f16da85c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d41986d0 0x7f16d4198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.497+0000 7f16da85c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f16d4112390 con 0x7f16d41072f0 2024-04-20T12:24:20.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.497+0000 7f16da85c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f16d4112210 con 0x7f16d4102220 2024-04-20T12:24:20.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.497+0000 7f16da85c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16d4112510 con 0x7f16d41986d0 2024-04-20T12:24:20.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.498+0000 7f16d37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d41072f0 0x7f16d419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.498+0000 7f16d37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d41072f0 0x7f16d419eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39662/0 (socket says 172.21.15.135:39662) 2024-04-20T12:24:20.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.498+0000 7f16d37fe640 1 -- 172.21.15.135:0/2425492757 learned_addr learned my addr 172.21.15.135:0/2425492757 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:20.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.498+0000 7f16d3fff640 1 --2- 172.21.15.135:0/2425492757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d4102220 0x7f16d419e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.498+0000 7f16d8df9640 1 --2- 172.21.15.135:0/2425492757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d41986d0 0x7f16d4198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.498+0000 7f16d37fe640 1 -- 172.21.15.135:0/2425492757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d41986d0 msgr2=0x7f16d4198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.498+0000 7f16d37fe640 1 --2- 172.21.15.135:0/2425492757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d41986d0 0x7f16d4198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.498+0000 7f16d37fe640 1 -- 172.21.15.135:0/2425492757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d4102220 msgr2=0x7f16d419e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.498+0000 7f16d37fe640 1 --2- 172.21.15.135:0/2425492757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d4102220 0x7f16d419e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.498+0000 7f16d37fe640 1 -- 172.21.15.135:0/2425492757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d41992d0 con 0x7f16d41072f0 2024-04-20T12:24:20.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.498+0000 7f16d37fe640 1 --2- 172.21.15.135:0/2425492757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d41072f0 0x7f16d419eb50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f16c8005fd0 tx=0x7f16c800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:20.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.498+0000 7f16d17fa640 1 -- 172.21.15.135:0/2425492757 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8017070 con 0x7f16d41072f0 2024-04-20T12:24:20.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.498+0000 7f16da85c640 1 -- 172.21.15.135:0/2425492757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d41a53b0 con 0x7f16d41072f0 2024-04-20T12:24:20.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.498+0000 7f16d17fa640 1 -- 172.21.15.135:0/2425492757 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16c8009c30 con 0x7f16d41072f0 2024-04-20T12:24:20.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.498+0000 7f16d17fa640 1 -- 172.21.15.135:0/2425492757 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8010460 con 0x7f16d41072f0 2024-04-20T12:24:20.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.499+0000 7f16da85c640 1 -- 172.21.15.135:0/2425492757 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d4074190 con 0x7f16d41072f0 2024-04-20T12:24:20.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.501+0000 7f16d17fa640 1 -- 172.21.15.135:0/2425492757 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 138931+0+0 (secure 0 0 0) 0x7f16c8003e70 con 0x7f16d41072f0 2024-04-20T12:24:20.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.502+0000 7f16dd455740 1 Processor -- start 2024-04-20T12:24:20.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.502+0000 7f16d17fa640 1 --2- 172.21.15.135:0/2425492757 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f16bc0a8360 0x7f16bc0aa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.502+0000 7f16dd455740 1 -- start start 2024-04-20T12:24:20.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.502+0000 7f16d17fa640 1 -- 172.21.15.135:0/2425492757 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f16c80d09f0 con 0x7f16d41072f0 2024-04-20T12:24:20.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.502+0000 7f16dd455740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e0d20 0x5561120e1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.503 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.502+0000 7f16dd455740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e1640 0x5561120e9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.502+0000 7f16dd455740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120ec610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.502+0000 7f16dd455740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5561120461b0 con 0x5561120ea220 2024-04-20T12:24:20.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.502+0000 7f16dd455740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556111fe3390 con 0x5561120e1640 2024-04-20T12:24:20.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.502+0000 7f16dd455740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556112042170 con 0x5561120e0d20 2024-04-20T12:24:20.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.503+0000 7f16d8df9640 1 --2- 172.21.15.135:0/2425492757 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f16bc0a8360 0x7f16bc0aa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.503+0000 7f16d8df9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120ec610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.503+0000 7f16d37fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e1640 0x5561120e9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.503+0000 7f16d8df9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120ec610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43976/0 (socket says 172.21.15.135:43976) 2024-04-20T12:24:20.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.503+0000 7f16d3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e0d20 0x5561120e1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.503+0000 7f16d8df9640 1 -- 172.21.15.135:0/1271670498 learned_addr learned my addr 172.21.15.135:0/1271670498 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:20.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.503+0000 7f16d3fff640 1 -- 172.21.15.135:0/1271670498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e1640 msgr2=0x5561120e9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.503+0000 7f16d3fff640 1 --2- 172.21.15.135:0/1271670498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e1640 0x5561120e9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.503+0000 7f16d3fff640 1 -- 172.21.15.135:0/1271670498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 msgr2=0x5561120ec610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.504 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.503+0000 7f16d3fff640 1 --2- 172.21.15.135:0/1271670498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120ec610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.503+0000 7f16d3fff640 1 -- 172.21.15.135:0/1271670498 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556111e227d0 con 0x5561120e0d20 2024-04-20T12:24:20.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.503+0000 7f16d8df9640 1 --2- 172.21.15.135:0/2425492757 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f16bc0a8360 0x7f16bc0aa820 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f16cc032530 tx=0x7f16cc009800 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:20.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.503+0000 7f16d3fff640 1 --2- 172.21.15.135:0/1271670498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e0d20 0x5561120e1100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f16c400bbf0 tx=0x7f16c40107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e253cd204e3cdbf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:20.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.503+0000 7f16ba7fc640 1 -- 172.21.15.135:0/1271670498 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c4004030 con 0x5561120e0d20 2024-04-20T12:24:20.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.504+0000 7f16ba7fc640 1 -- 172.21.15.135:0/1271670498 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16c40041d0 con 0x5561120e0d20 2024-04-20T12:24:20.505 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.504+0000 7f16ba7fc640 1 -- 172.21.15.135:0/1271670498 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c40116a0 con 0x5561120e0d20 2024-04-20T12:24:20.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.504+0000 7f16dd455740 1 -- 172.21.15.135:0/1271670498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e0d20 msgr2=0x5561120e1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.504+0000 7f16dd455740 1 --2- 172.21.15.135:0/1271670498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e0d20 0x5561120e1100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f16c400bbf0 tx=0x7f16c40107a0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.504+0000 7f16dd455740 1 -- 172.21.15.135:0/1271670498 shutdown_connections 2024-04-20T12:24:20.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.504+0000 7f16dd455740 1 --2- 172.21.15.135:0/1271670498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120ec610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.504+0000 7f16dd455740 1 --2- 172.21.15.135:0/1271670498 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e1640 0x5561120e9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.504+0000 7f16dd455740 1 --2- 172.21.15.135:0/1271670498 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e0d20 0x5561120e1100 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.504+0000 7f16dd455740 1 -- 172.21.15.135:0/1271670498 >> 172.21.15.135:0/1271670498 conn(0x5561120db450 msgr2=0x5561120db830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:20.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.504+0000 7f16dd455740 1 -- 172.21.15.135:0/1271670498 shutdown_connections 2024-04-20T12:24:20.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.504+0000 7f16dd455740 1 -- 172.21.15.135:0/1271670498 wait complete. 2024-04-20T12:24:20.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.505+0000 7f16dd455740 1 -- start start 2024-04-20T12:24:20.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.505+0000 7f16dd455740 1 Processor -- start 2024-04-20T12:24:20.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.505+0000 7f16dd455740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e0d20 0x5561120e72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.505+0000 7f16dd455740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 0x5561120e7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.505+0000 7f16dd455740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120e7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.505+0000 7f16dd455740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5561120ed010 con 0x5561120ea220 2024-04-20T12:24:20.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.505+0000 7f16dd455740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556111fff2f0 con 0x5561120e0d20 2024-04-20T12:24:20.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.505+0000 7f16dd455740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5561120ed190 con 0x5561120e1640 2024-04-20T12:24:20.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.505+0000 7f16dd455740 10 client.0 _ll_register_callbacks cb 0x556111fc94e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:20.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.506+0000 7f16d8df9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120e7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.506+0000 7f16d37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 0x5561120e7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.506+0000 7f16d3fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e0d20 0x5561120e72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.506+0000 7f16d37fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 0x5561120e7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.135:38026/0 (socket says 172.21.15.135:38026) 2024-04-20T12:24:20.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.506+0000 7f16d37fe640 1 -- 172.21.15.135:0/3985724741 learned_addr learned my addr 172.21.15.135:0/3985724741 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:20.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.506+0000 7f16d37fe640 1 -- 172.21.15.135:0/3985724741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e0d20 msgr2=0x5561120e72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.506+0000 7f16d37fe640 1 --2- 172.21.15.135:0/3985724741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e0d20 0x5561120e72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.506+0000 7f16d37fe640 1 -- 172.21.15.135:0/3985724741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 msgr2=0x5561120e7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.506+0000 7f16d37fe640 1 --2- 172.21.15.135:0/3985724741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120e7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.506+0000 7f16d37fe640 1 -- 172.21.15.135:0/3985724741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556111d583f0 con 0x5561120e1640 2024-04-20T12:24:20.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.506+0000 7f16d3fff640 1 --2- 172.21.15.135:0/3985724741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e0d20 0x5561120e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:20.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.506+0000 7f16d8df9640 1 --2- 172.21.15.135:0/3985724741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120e7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:20.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.506+0000 7f16d37fe640 1 --2- 172.21.15.135:0/3985724741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 0x5561120e7820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f16c809c360 tx=0x7f16c8009e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d496d8552451721f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:20.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.506+0000 7f16b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-20T12:24:20.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.506+0000 7f16b37fe640 1 -- 172.21.15.135:0/3985724741 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c80b5060 con 0x5561120e1640 2024-04-20T12:24:20.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.507+0000 7f16dd455740 1 -- 172.21.15.135:0/3985724741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16c40041d0 con 0x5561120e1640 2024-04-20T12:24:20.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.507+0000 7f16b37fe640 1 -- 172.21.15.135:0/3985724741 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f16c809ba20 con 0x5561120e1640 2024-04-20T12:24:20.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.507+0000 7f16b37fe640 1 -- 172.21.15.135:0/3985724741 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f16c80ba050 con 0x5561120e1640 2024-04-20T12:24:20.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.507+0000 7f16dd455740 10 client.25591 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:20.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.507+0000 7f16dd455740 1 -- 172.21.15.135:0/3985724741 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556111d180f0 con 0x5561120e1640 2024-04-20T12:24:20.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.507+0000 7f16b37fe640 1 -- 172.21.15.135:0/3985724741 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16c40041d0 con 0x5561120e1640 2024-04-20T12:24:20.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.508+0000 7f16b37fe640 1 -- 172.21.15.135:0/3985724741 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f16c807e020 con 0x5561120e1640 2024-04-20T12:24:20.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.508+0000 7f16dd455740 10 client.25591 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:20.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.508+0000 7f16dd455740 10 client.25591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:20.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.508+0000 7f16dd455740 20 client.25591 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:20.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.508+0000 7f16dd455740 1 --2- 172.21.15.135:0/3985724741 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5561120fa6e0 0x5561120fcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.508+0000 7f16dd455740 4 client.25591 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:20.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.508+0000 7f16dd455740 1 -- 172.21.15.135:0/3985724741 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556112053bd0 con 0x5561120fa6e0 2024-04-20T12:24:20.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.508+0000 7f16d3fff640 1 --2- 172.21.15.135:0/3985724741 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5561120fa6e0 0x5561120fcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.508+0000 7f16d3fff640 1 --2- 172.21.15.135:0/3985724741 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5561120fa6e0 0x5561120fcaf0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c68d7cbbcbddee4 server_cookie=bfa0e1b3b8032bc9 in_seq=0 out_seq=0 2024-04-20T12:24:20.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.508+0000 7f16b37fe640 10 client.25591 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:20.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.509+0000 7f16b37fe640 1 -- 172.21.15.135:0/3985724741 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556112053bd0 con 0x5561120fa6e0 2024-04-20T12:24:20.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.509+0000 7f16b37fe640 10 client.25591 handle_command_reply: tid=0 2024-04-20T12:24:20.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.509+0000 7f16dd455740 1 client.25591 shutdown 2024-04-20T12:24:20.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.509+0000 7f16dd455740 1 -- 172.21.15.135:0/3985724741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 msgr2=0x5561120e7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.509+0000 7f16dd455740 1 --2- 172.21.15.135:0/3985724741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 0x5561120e7820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f16c809c360 tx=0x7f16c8009e60 comp rx=0 tx=0).stop 2024-04-20T12:24:20.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.509+0000 7f16dd455740 1 -- 172.21.15.135:0/3985724741 shutdown_connections 2024-04-20T12:24:20.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.509+0000 7f16dd455740 1 --2- 172.21.15.135:0/3985724741 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5561120fa6e0 0x5561120fcaf0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.509+0000 7f16dd455740 1 --2- 172.21.15.135:0/3985724741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120e7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.509+0000 7f16b37fe640 0 client.25591 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:20.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.509+0000 7f16dd455740 1 --2- 172.21.15.135:0/3985724741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 0x5561120e7820 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.509+0000 7f16dd455740 1 --2- 172.21.15.135:0/3985724741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e0d20 0x5561120e72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.509+0000 7f16dd455740 1 -- 172.21.15.135:0/3985724741 >> 172.21.15.135:0/3985724741 conn(0x5561120db450 msgr2=0x5561120dd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:20.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.509+0000 7f16dd455740 1 -- 172.21.15.135:0/3985724741 shutdown_connections 2024-04-20T12:24:20.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.509+0000 7f16dd455740 1 -- 172.21.15.135:0/3985724741 wait complete. 2024-04-20T12:24:20.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.509+0000 7f16dd455740 20 client.25591 trim_cache size 0 max 16384 2024-04-20T12:24:20.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16dd455740 1 Processor -- start 2024-04-20T12:24:20.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16dd455740 1 -- start start 2024-04-20T12:24:20.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16dd455740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120e0d20 0x5561120f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16dd455740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 0x5561120e7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16dd455740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120ea220 0x5561120da4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16dd455740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f16d41ad120 con 0x5561120e0d20 2024-04-20T12:24:20.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16dd455740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f16d41aec60 con 0x5561120ea220 2024-04-20T12:24:20.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16dd455740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16d41ad7f0 con 0x5561120e1640 2024-04-20T12:24:20.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16d3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120e0d20 0x5561120f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16d3fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120e0d20 0x5561120f5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43994/0 (socket says 172.21.15.135:43994) 2024-04-20T12:24:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16d3fff640 1 -- 172.21.15.135:0/465649033 learned_addr learned my addr 172.21.15.135:0/465649033 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16d8df9640 1 --2- 172.21.15.135:0/465649033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120ea220 0x5561120da4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16d37fe640 1 --2- 172.21.15.135:0/465649033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 0x5561120e7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16d3fff640 1 -- 172.21.15.135:0/465649033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 msgr2=0x5561120e7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16d3fff640 1 --2- 172.21.15.135:0/465649033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 0x5561120e7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16d3fff640 1 -- 172.21.15.135:0/465649033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120ea220 msgr2=0x5561120da4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16d3fff640 1 --2- 172.21.15.135:0/465649033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120ea220 0x5561120da4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.527+0000 7f16d3fff640 1 -- 172.21.15.135:0/465649033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561120ec980 con 0x5561120e0d20 2024-04-20T12:24:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.528+0000 7f16d37fe640 1 --2- 172.21.15.135:0/465649033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 0x5561120e7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.528+0000 7f16d3fff640 1 --2- 172.21.15.135:0/465649033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120e0d20 0x5561120f5ed0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f16c400bbc0 tx=0x7f16c4005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4753d3428487ce server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.528+0000 7f16b9ffb640 1 -- 172.21.15.135:0/465649033 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c400b770 con 0x5561120e0d20 2024-04-20T12:24:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.528+0000 7f16b9ffb640 1 -- 172.21.15.135:0/465649033 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16c4005520 con 0x5561120e0d20 2024-04-20T12:24:20.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.528+0000 7f16b9ffb640 1 -- 172.21.15.135:0/465649033 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c4003bf0 con 0x5561120e0d20 2024-04-20T12:24:20.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.529+0000 7f16dd455740 1 -- 172.21.15.135:0/465649033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120e0d20 msgr2=0x5561120f5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.529+0000 7f16dd455740 1 --2- 172.21.15.135:0/465649033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120e0d20 0x5561120f5ed0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f16c400bbc0 tx=0x7f16c4005c90 comp rx=0 tx=0).stop 2024-04-20T12:24:20.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.529+0000 7f16dd455740 1 -- 172.21.15.135:0/465649033 shutdown_connections 2024-04-20T12:24:20.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.529+0000 7f16dd455740 1 --2- 172.21.15.135:0/465649033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120ea220 0x5561120da4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.529+0000 7f16dd455740 1 --2- 172.21.15.135:0/465649033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 0x5561120e7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.529+0000 7f16dd455740 1 --2- 172.21.15.135:0/465649033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120e0d20 0x5561120f5ed0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.529+0000 7f16dd455740 1 -- 172.21.15.135:0/465649033 >> 172.21.15.135:0/465649033 conn(0x5561120db450 msgr2=0x5561120d9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:20.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.529+0000 7f16dd455740 1 -- 172.21.15.135:0/465649033 shutdown_connections 2024-04-20T12:24:20.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.529+0000 7f16dd455740 1 -- 172.21.15.135:0/465649033 wait complete. 2024-04-20T12:24:20.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.529+0000 7f16dd455740 1 -- start start 2024-04-20T12:24:20.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.529+0000 7f16dd455740 1 Processor -- start 2024-04-20T12:24:20.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16dd455740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e0d20 0x5561120f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16dd455740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 0x5561120f2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16dd455740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16dd455740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f16d41ae590 con 0x5561120ea220 2024-04-20T12:24:20.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16dd455740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f16d41adec0 con 0x5561120e0d20 2024-04-20T12:24:20.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16dd455740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f16d41ab0f0 con 0x5561120e1640 2024-04-20T12:24:20.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16dd455740 10 client.0 _ll_register_callbacks cb 0x7f16c809cba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:20.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16d8df9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16d8df9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120efbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44010/0 (socket says 172.21.15.135:44010) 2024-04-20T12:24:20.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16d8df9640 1 -- 172.21.15.135:0/2359139683 learned_addr learned my addr 172.21.15.135:0/2359139683 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:20.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16d37fe640 1 --2- 172.21.15.135:0/2359139683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 0x5561120f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16d3fff640 1 --2- 172.21.15.135:0/2359139683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e0d20 0x5561120f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16d8df9640 1 -- 172.21.15.135:0/2359139683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 msgr2=0x5561120f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16d8df9640 1 --2- 172.21.15.135:0/2359139683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 0x5561120f2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16d8df9640 1 -- 172.21.15.135:0/2359139683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e0d20 msgr2=0x5561120f23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16d8df9640 1 --2- 172.21.15.135:0/2359139683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e0d20 0x5561120f23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16d8df9640 1 -- 172.21.15.135:0/2359139683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561120f03b0 con 0x5561120ea220 2024-04-20T12:24:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.530+0000 7f16d3fff640 1 --2- 172.21.15.135:0/2359139683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e0d20 0x5561120f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16d8df9640 1 --2- 172.21.15.135:0/2359139683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120efbb0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f16cc02c630 tx=0x7f16cc045070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8946d6c8f0ec49 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16b37fe640 1 -- 172.21.15.135:0/2359139683 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16cc053030 con 0x5561120ea220 2024-04-20T12:24:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16b37fe640 1 -- 172.21.15.135:0/2359139683 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f16cc049040 con 0x5561120ea220 2024-04-20T12:24:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16dd455740 1 -- 172.21.15.135:0/2359139683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16c4005520 con 0x5561120ea220 2024-04-20T12:24:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16b37fe640 1 -- 172.21.15.135:0/2359139683 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f16cc060050 con 0x5561120ea220 2024-04-20T12:24:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16dd455740 10 client.16185 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16dd455740 1 -- 172.21.15.135:0/2359139683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556112160900 con 0x5561120ea220 2024-04-20T12:24:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16b37fe640 1 -- 172.21.15.135:0/2359139683 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16c4005520 con 0x5561120ea220 2024-04-20T12:24:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16b37fe640 1 -- 172.21.15.135:0/2359139683 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f16cc04fab0 con 0x5561120ea220 2024-04-20T12:24:20.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16dd455740 10 client.16185 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:20.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16dd455740 10 client.16185 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:20.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16dd455740 20 client.16185 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:20.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16dd455740 1 --2- 172.21.15.135:0/2359139683 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5561121610e0 0x556112163500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:20.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16dd455740 4 client.16185 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:24:20.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.531+0000 7f16dd455740 1 -- 172.21.15.135:0/2359139683 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55611204da40 con 0x5561121610e0 2024-04-20T12:24:20.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.532+0000 7f16d3fff640 1 --2- 172.21.15.135:0/2359139683 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5561121610e0 0x556112163500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:20.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.532+0000 7f16d3fff640 1 --2- 172.21.15.135:0/2359139683 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5561121610e0 0x556112163500 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf9450e6c648697a server_cookie=b25a99056a80d03a in_seq=0 out_seq=0 2024-04-20T12:24:20.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.532+0000 7f16b37fe640 10 client.16185 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:20.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.532+0000 7f16b37fe640 1 -- 172.21.15.135:0/2359139683 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55611204da40 con 0x5561121610e0 2024-04-20T12:24:20.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.532+0000 7f16b37fe640 10 client.16185 handle_command_reply: tid=0 2024-04-20T12:24:20.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.532+0000 7f16dd455740 1 client.16185 shutdown 2024-04-20T12:24:20.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.533+0000 7f16dd455740 1 -- 172.21.15.135:0/2359139683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 msgr2=0x5561120efbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.533+0000 7f16dd455740 1 --2- 172.21.15.135:0/2359139683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120efbb0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f16cc02c630 tx=0x7f16cc045070 comp rx=0 tx=0).stop 2024-04-20T12:24:20.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.533+0000 7f16dd455740 1 -- 172.21.15.135:0/2359139683 shutdown_connections 2024-04-20T12:24:20.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.533+0000 7f16dd455740 1 --2- 172.21.15.135:0/2359139683 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5561121610e0 0x556112163500 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.533+0000 7f16dd455740 1 --2- 172.21.15.135:0/2359139683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5561120ea220 0x5561120efbb0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.533+0000 7f16dd455740 1 --2- 172.21.15.135:0/2359139683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5561120e1640 0x5561120f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.533+0000 7f16b37fe640 0 client.16185 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:20.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.533+0000 7f16dd455740 1 --2- 172.21.15.135:0/2359139683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5561120e0d20 0x5561120f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.533+0000 7f16dd455740 1 -- 172.21.15.135:0/2359139683 >> 172.21.15.135:0/2359139683 conn(0x5561120db450 msgr2=0x5561120da630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:20.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.533+0000 7f16dd455740 1 -- 172.21.15.135:0/2359139683 shutdown_connections 2024-04-20T12:24:20.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.533+0000 7f16dd455740 1 -- 172.21.15.135:0/2359139683 wait complete. 2024-04-20T12:24:20.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.533+0000 7f16dd455740 20 client.16185 trim_cache size 0 max 16384 2024-04-20T12:24:20.538 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:24:20.539 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:24:20.539 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:24:20.539 INFO:teuthology.orchestra.run.smithi135.stdout: "ed45fa36-56fa-4a7d-84d9-db5bb2fa3ec9": { 2024-04-20T12:24:20.539 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:24:20.539 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "ed45fa36-56fa-4a7d-84d9-db5bb2fa3ec9", 2024-04-20T12:24:20.539 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:24:20.539 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:24:20.539 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:24:20.539 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:24:20.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.534+0000 7f16da85c640 1 -- 172.21.15.135:0/2425492757 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f16bc0a8360 msgr2=0x7f16bc0aa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.534+0000 7f16da85c640 1 --2- 172.21.15.135:0/2425492757 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f16bc0a8360 0x7f16bc0aa820 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f16cc032530 tx=0x7f16cc009800 comp rx=0 tx=0).stop 2024-04-20T12:24:20.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.534+0000 7f16da85c640 1 -- 172.21.15.135:0/2425492757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d41072f0 msgr2=0x7f16d419eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:20.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.534+0000 7f16da85c640 1 --2- 172.21.15.135:0/2425492757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d41072f0 0x7f16d419eb50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f16c8005fd0 tx=0x7f16c800dde0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.534+0000 7f16da85c640 1 -- 172.21.15.135:0/2425492757 shutdown_connections 2024-04-20T12:24:20.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.534+0000 7f16da85c640 1 --2- 172.21.15.135:0/2425492757 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f16bc0a8360 0x7f16bc0aa820 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.534+0000 7f16da85c640 1 --2- 172.21.15.135:0/2425492757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d41986d0 0x7f16d4198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.534+0000 7f16da85c640 1 --2- 172.21.15.135:0/2425492757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f16d41072f0 0x7f16d419eb50 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.534+0000 7f16da85c640 1 --2- 172.21.15.135:0/2425492757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f16d4102220 0x7f16d419e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:20.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.534+0000 7f16da85c640 1 -- 172.21.15.135:0/2425492757 >> 172.21.15.135:0/2425492757 conn(0x7f16d40fdac0 msgr2=0x7f16d40ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:20.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.534+0000 7f16da85c640 1 -- 172.21.15.135:0/2425492757 shutdown_connections 2024-04-20T12:24:20.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:20.534+0000 7f16da85c640 1 -- 172.21.15.135:0/2425492757 wait complete. 2024-04-20T12:24:20.545 INFO:tasks.cephfs.filesystem:scrub status for tag:ed45fa36-56fa-4a7d-84d9-db5bb2fa3ec9 - {'path': '/', 'tag': 'ed45fa36-56fa-4a7d-84d9-db5bb2fa3ec9', 'options': 'recursive,force'} 2024-04-20T12:24:20.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:20 smithi135 ceph-mon[18264]: pgmap v39: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 13 op/s 2024-04-20T12:24:20.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:20 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:24:20.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:20 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:24:20.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:20 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:24:20.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:20 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:24:21.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:20 smithi154 ceph-mon[22073]: pgmap v39: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 13 op/s 2024-04-20T12:24:21.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:20 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:24:21.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:20 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:24:21.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:20 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:24:21.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:20 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:24:21.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:20 smithi139 ceph-mon[21834]: pgmap v39: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 597 B/s wr, 13 op/s 2024-04-20T12:24:21.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:20 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:24:21.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:20 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:24:21.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:20 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:24:21.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:20 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:24:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.343+0000 7f3166d7e640 1 -- 172.21.15.135:0/242545819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31601061a0 msgr2=0x7f316010dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.343+0000 7f3166d7e640 1 --2- 172.21.15.135:0/242545819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31601061a0 0x7f316010dd70 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3158009ca0 tx=0x7f315802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.343+0000 7f3166d7e640 1 -- 172.21.15.135:0/242545819 shutdown_connections 2024-04-20T12:24:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.343+0000 7f3166d7e640 1 --2- 172.21.15.135:0/242545819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31601061a0 0x7f316010dd70 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.343+0000 7f3166d7e640 1 --2- 172.21.15.135:0/242545819 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3160101a80 0x7f3160105ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.343+0000 7f3166d7e640 1 --2- 172.21.15.135:0/242545819 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31601010d0 0x7f31601014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.343+0000 7f3166d7e640 1 -- 172.21.15.135:0/242545819 >> 172.21.15.135:0/242545819 conn(0x7f3160077fb0 msgr2=0x7f31600783c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.343+0000 7f3166d7e640 1 -- 172.21.15.135:0/242545819 shutdown_connections 2024-04-20T12:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.343+0000 7f3166d7e640 1 -- 172.21.15.135:0/242545819 wait complete. 2024-04-20T12:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.344+0000 7f3166d7e640 1 Processor -- start 2024-04-20T12:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.344+0000 7f3166d7e640 1 -- start start 2024-04-20T12:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.344+0000 7f3166d7e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31601010d0 0x7f3160198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.344+0000 7f3166d7e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31601061a0 0x7f3160198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.344+0000 7f3166d7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316019d010 0x7f316019d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.344+0000 7f3166d7e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3160111260 con 0x7f31601061a0 2024-04-20T12:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.344+0000 7f3166d7e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f31601110e0 con 0x7f31601010d0 2024-04-20T12:24:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.344+0000 7f3166d7e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f31601113e0 con 0x7f316019d010 2024-04-20T12:24:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.344+0000 7f315ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31601061a0 0x7f3160198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.344+0000 7f315ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31601061a0 0x7f3160198c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44028/0 (socket says 172.21.15.135:44028) 2024-04-20T12:24:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.345+0000 7f315ffff640 1 -- 172.21.15.135:0/336081171 learned_addr learned my addr 172.21.15.135:0/336081171 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.345+0000 7f3164b1a640 1 --2- 172.21.15.135:0/336081171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31601010d0 0x7f3160198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.345+0000 7f316531b640 1 --2- 172.21.15.135:0/336081171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316019d010 0x7f316019d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.345+0000 7f315ffff640 1 -- 172.21.15.135:0/336081171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316019d010 msgr2=0x7f316019d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.345+0000 7f315ffff640 1 --2- 172.21.15.135:0/336081171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316019d010 0x7f316019d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.345+0000 7f315ffff640 1 -- 172.21.15.135:0/336081171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31601010d0 msgr2=0x7f3160198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.345+0000 7f315ffff640 1 --2- 172.21.15.135:0/336081171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31601010d0 0x7f3160198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.345+0000 7f315ffff640 1 -- 172.21.15.135:0/336081171 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316019db00 con 0x7f31601061a0 2024-04-20T12:24:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.345+0000 7f3164b1a640 1 --2- 172.21.15.135:0/336081171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31601010d0 0x7f3160198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.345+0000 7f315ffff640 1 --2- 172.21.15.135:0/336081171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31601061a0 0x7f3160198c90 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f314c00e9f0 tx=0x7f314c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.345+0000 7f315dffb640 1 -- 172.21.15.135:0/336081171 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c00ccc0 con 0x7f31601061a0 2024-04-20T12:24:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.345+0000 7f315dffb640 1 -- 172.21.15.135:0/336081171 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f314c005500 con 0x7f31601061a0 2024-04-20T12:24:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.345+0000 7f3166d7e640 1 -- 172.21.15.135:0/336081171 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f316019ddf0 con 0x7f31601061a0 2024-04-20T12:24:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.345+0000 7f315dffb640 1 -- 172.21.15.135:0/336081171 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c010690 con 0x7f31601061a0 2024-04-20T12:24:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.346+0000 7f3166d7e640 1 -- 172.21.15.135:0/336081171 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31601a5530 con 0x7f31601061a0 2024-04-20T12:24:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.348+0000 7f3169968740 1 Processor -- start 2024-04-20T12:24:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f3169968740 1 -- start start 2024-04-20T12:24:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f3169968740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750110 0x55ec8a7504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f3169968740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750a30 0x55ec8a7592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f3169968740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a759800 0x55ec8a75bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f315dffb640 1 -- 172.21.15.135:0/336081171 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 138931+0+0 (secure 0 0 0) 0x7f314c0046c0 con 0x7f31601061a0 2024-04-20T12:24:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f3169968740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ec8a6b5820 con 0x55ec8a759800 2024-04-20T12:24:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f3169968740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ec8a652fc0 con 0x55ec8a750a30 2024-04-20T12:24:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f3169968740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ec8a6b17e0 con 0x55ec8a750110 2024-04-20T12:24:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f316531b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750110 0x55ec8a7504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f316531b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750110 0x55ec8a7504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.135:38090/0 (socket says 172.21.15.135:38090) 2024-04-20T12:24:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f316531b640 1 -- 172.21.15.135:0/2240205241 learned_addr learned my addr 172.21.15.135:0/2240205241 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f3164b1a640 1 --2- 172.21.15.135:0/2240205241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750a30 0x55ec8a7592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f315ffff640 1 --2- 172.21.15.135:0/2240205241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a759800 0x55ec8a75bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f316531b640 1 -- 172.21.15.135:0/2240205241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750a30 msgr2=0x55ec8a7592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f316531b640 1 --2- 172.21.15.135:0/2240205241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750a30 0x55ec8a7592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f316531b640 1 -- 172.21.15.135:0/2240205241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a759800 msgr2=0x55ec8a75bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f316531b640 1 --2- 172.21.15.135:0/2240205241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a759800 0x55ec8a75bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f316531b640 1 -- 172.21.15.135:0/2240205241 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec8a3c8210 con 0x55ec8a750110 2024-04-20T12:24:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f315ffff640 1 --2- 172.21.15.135:0/2240205241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a759800 0x55ec8a75bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.349+0000 7f315dffb640 1 --2- 172.21.15.135:0/336081171 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f31500a3ff0 0x7f31500a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.350+0000 7f3164b1a640 1 --2- 172.21.15.135:0/336081171 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f31500a3ff0 0x7f31500a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.350+0000 7f315dffb640 1 -- 172.21.15.135:0/336081171 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f314c0d1180 con 0x7f31601061a0 2024-04-20T12:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.350+0000 7f316531b640 1 --2- 172.21.15.135:0/2240205241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750110 0x55ec8a7504f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3158009ca0 tx=0x7f31580093f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2221ec2ab9a8aa18 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.350+0000 7f314affd640 1 -- 172.21.15.135:0/2240205241 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158043020 con 0x55ec8a750110 2024-04-20T12:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.350+0000 7f314affd640 1 -- 172.21.15.135:0/2240205241 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f315802cca0 con 0x55ec8a750110 2024-04-20T12:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.350+0000 7f314affd640 1 -- 172.21.15.135:0/2240205241 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158039040 con 0x55ec8a750110 2024-04-20T12:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.351+0000 7f3169968740 1 -- 172.21.15.135:0/2240205241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750110 msgr2=0x55ec8a7504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.351+0000 7f3164b1a640 1 --2- 172.21.15.135:0/336081171 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f31500a3ff0 0x7f31500a64b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55ec8a74fbc0 tx=0x7f315400b390 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.351+0000 7f3169968740 1 --2- 172.21.15.135:0/2240205241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750110 0x55ec8a7504f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3158009ca0 tx=0x7f31580093f0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.351+0000 7f3169968740 1 -- 172.21.15.135:0/2240205241 shutdown_connections 2024-04-20T12:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.351+0000 7f3169968740 1 --2- 172.21.15.135:0/2240205241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a759800 0x55ec8a75bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.351+0000 7f3169968740 1 --2- 172.21.15.135:0/2240205241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750a30 0x55ec8a7592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.351+0000 7f3169968740 1 --2- 172.21.15.135:0/2240205241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750110 0x55ec8a7504f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.351+0000 7f3169968740 1 -- 172.21.15.135:0/2240205241 >> 172.21.15.135:0/2240205241 conn(0x55ec8a74aa30 msgr2=0x55ec8a74ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.351+0000 7f3169968740 1 -- 172.21.15.135:0/2240205241 shutdown_connections 2024-04-20T12:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.351+0000 7f3169968740 1 -- 172.21.15.135:0/2240205241 wait complete. 2024-04-20T12:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.351+0000 7f3169968740 1 -- start start 2024-04-20T12:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.352+0000 7f3169968740 1 Processor -- start 2024-04-20T12:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.352+0000 7f3169968740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750110 0x55ec8a756820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.352+0000 7f3169968740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750a30 0x55ec8a756d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.352+0000 7f3169968740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a759800 0x55ec8a7572a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.352+0000 7f3169968740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ec8a7607e0 con 0x55ec8a759800 2024-04-20T12:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.352+0000 7f3169968740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ec8a63dee0 con 0x55ec8a750a30 2024-04-20T12:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.352+0000 7f3169968740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ec8a760960 con 0x55ec8a750110 2024-04-20T12:24:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.352+0000 7f316531b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a759800 0x55ec8a7572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.352+0000 7f3169968740 10 client.0 _ll_register_callbacks cb 0x55ec8a653d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.352+0000 7f316531b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a759800 0x55ec8a7572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44044/0 (socket says 172.21.15.135:44044) 2024-04-20T12:24:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.352+0000 7f316531b640 1 -- 172.21.15.135:0/1282366686 learned_addr learned my addr 172.21.15.135:0/1282366686 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.352+0000 7f315ffff640 1 --2- 172.21.15.135:0/1282366686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750a30 0x55ec8a756d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.352+0000 7f3164b1a640 1 --2- 172.21.15.135:0/1282366686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750110 0x55ec8a756820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.353+0000 7f316531b640 1 -- 172.21.15.135:0/1282366686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750110 msgr2=0x55ec8a756820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.353+0000 7f316531b640 1 --2- 172.21.15.135:0/1282366686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750110 0x55ec8a756820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.353+0000 7f316531b640 1 -- 172.21.15.135:0/1282366686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750a30 msgr2=0x55ec8a756d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.353+0000 7f316531b640 1 --2- 172.21.15.135:0/1282366686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750a30 0x55ec8a756d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.353+0000 7f316531b640 1 -- 172.21.15.135:0/1282366686 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec8a494620 con 0x55ec8a759800 2024-04-20T12:24:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.353+0000 7f315ffff640 1 --2- 172.21.15.135:0/1282366686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750a30 0x55ec8a756d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.353+0000 7f316531b640 1 --2- 172.21.15.135:0/1282366686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a759800 0x55ec8a7572a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3158009bf0 tx=0x7f3158005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b38b07d40fc5f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.353+0000 7f313ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.353+0000 7f313ffff640 1 -- 172.21.15.135:0/1282366686 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3158039070 con 0x55ec8a759800 2024-04-20T12:24:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.353+0000 7f3169968740 1 -- 172.21.15.135:0/1282366686 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f315802cca0 con 0x55ec8a759800 2024-04-20T12:24:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.353+0000 7f313ffff640 1 -- 172.21.15.135:0/1282366686 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f31580329a0 con 0x55ec8a759800 2024-04-20T12:24:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.353+0000 7f313ffff640 1 -- 172.21.15.135:0/1282366686 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3158056050 con 0x55ec8a759800 2024-04-20T12:24:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.353+0000 7f3169968740 10 client.16197 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.353+0000 7f3169968740 1 -- 172.21.15.135:0/1282366686 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ec8a76ca20 con 0x55ec8a759800 2024-04-20T12:24:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.354+0000 7f313ffff640 1 -- 172.21.15.135:0/1282366686 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f315802cca0 con 0x55ec8a759800 2024-04-20T12:24:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.354+0000 7f313ffff640 1 -- 172.21.15.135:0/1282366686 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f3158048680 con 0x55ec8a759800 2024-04-20T12:24:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.354+0000 7f3169968740 10 client.16197 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.354+0000 7f3169968740 10 client.16197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.354+0000 7f3169968740 20 client.16197 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.354+0000 7f3169968740 1 --2- 172.21.15.135:0/1282366686 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ec8a76e010 0x55ec8a770400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.354+0000 7f3169968740 4 client.16197 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.354+0000 7f3169968740 1 -- 172.21.15.135:0/1282366686 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec8a6c3240 con 0x55ec8a76e010 2024-04-20T12:24:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.354+0000 7f3164b1a640 1 --2- 172.21.15.135:0/1282366686 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ec8a76e010 0x55ec8a770400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.355+0000 7f313ffff640 10 client.16197 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.355+0000 7f3164b1a640 1 --2- 172.21.15.135:0/1282366686 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ec8a76e010 0x55ec8a770400 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84d34dce85e77cfb server_cookie=a2c7c34346acf1e in_seq=0 out_seq=0 2024-04-20T12:24:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.355+0000 7f313ffff640 1 -- 172.21.15.135:0/1282366686 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ec8a6c3240 con 0x55ec8a76e010 2024-04-20T12:24:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.355+0000 7f313ffff640 10 client.16197 handle_command_reply: tid=0 2024-04-20T12:24:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.355+0000 7f3169968740 1 client.16197 shutdown 2024-04-20T12:24:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.355+0000 7f3169968740 1 -- 172.21.15.135:0/1282366686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a759800 msgr2=0x55ec8a7572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.355+0000 7f3169968740 1 --2- 172.21.15.135:0/1282366686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a759800 0x55ec8a7572a0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3158009bf0 tx=0x7f3158005f70 comp rx=0 tx=0).stop 2024-04-20T12:24:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.355+0000 7f3169968740 1 -- 172.21.15.135:0/1282366686 shutdown_connections 2024-04-20T12:24:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.355+0000 7f3169968740 1 --2- 172.21.15.135:0/1282366686 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ec8a76e010 0x55ec8a770400 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.355+0000 7f3169968740 1 --2- 172.21.15.135:0/1282366686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a759800 0x55ec8a7572a0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.355+0000 7f3169968740 1 --2- 172.21.15.135:0/1282366686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750a30 0x55ec8a756d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.355+0000 7f3169968740 1 --2- 172.21.15.135:0/1282366686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750110 0x55ec8a756820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.355+0000 7f3169968740 1 -- 172.21.15.135:0/1282366686 >> 172.21.15.135:0/1282366686 conn(0x55ec8a74aa30 msgr2=0x55ec8a74c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.355+0000 7f313ffff640 0 client.16197 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.356+0000 7f3169968740 1 -- 172.21.15.135:0/1282366686 shutdown_connections 2024-04-20T12:24:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.356+0000 7f3169968740 1 -- 172.21.15.135:0/1282366686 wait complete. 2024-04-20T12:24:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.356+0000 7f3169968740 20 client.16197 trim_cache size 0 max 16384 2024-04-20T12:24:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.370+0000 7f3169968740 1 Processor -- start 2024-04-20T12:24:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.370+0000 7f3169968740 1 -- start start 2024-04-20T12:24:22.370 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f3169968740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750110 0x55ec8a758f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f3169968740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a750a30 0x55ec8a74c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f3169968740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a759800 0x55ec8a7570c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f3169968740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f31601ad0a0 con 0x55ec8a750a30 2024-04-20T12:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f3169968740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f31601aebe0 con 0x55ec8a750110 2024-04-20T12:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f3169968740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f31601ad770 con 0x55ec8a759800 2024-04-20T12:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f315ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a750a30 0x55ec8a74c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f315ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a750a30 0x55ec8a74c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44054/0 (socket says 172.21.15.135:44054) 2024-04-20T12:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f315ffff640 1 -- 172.21.15.135:0/791847012 learned_addr learned my addr 172.21.15.135:0/791847012 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f3164b1a640 1 --2- 172.21.15.135:0/791847012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750110 0x55ec8a758f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f315ffff640 1 -- 172.21.15.135:0/791847012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a759800 msgr2=0x55ec8a7570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f315ffff640 1 --2- 172.21.15.135:0/791847012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a759800 0x55ec8a7570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f315ffff640 1 -- 172.21.15.135:0/791847012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750110 msgr2=0x55ec8a758f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f315ffff640 1 --2- 172.21.15.135:0/791847012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750110 0x55ec8a758f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f315ffff640 1 -- 172.21.15.135:0/791847012 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec8a770a30 con 0x55ec8a750a30 2024-04-20T12:24:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f3164b1a640 1 --2- 172.21.15.135:0/791847012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750110 0x55ec8a758f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.371+0000 7f315ffff640 1 --2- 172.21.15.135:0/791847012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a750a30 0x55ec8a74c6a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f314c098fc0 tx=0x7f314c0d4c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bd600ebcea756 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.372+0000 7f314a7fc640 1 -- 172.21.15.135:0/791847012 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c09c6a0 con 0x55ec8a750a30 2024-04-20T12:24:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.372+0000 7f314a7fc640 1 -- 172.21.15.135:0/791847012 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f314c09d260 con 0x55ec8a750a30 2024-04-20T12:24:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.372+0000 7f314a7fc640 1 -- 172.21.15.135:0/791847012 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c0056b0 con 0x55ec8a750a30 2024-04-20T12:24:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.372+0000 7f3169968740 1 -- 172.21.15.135:0/791847012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a750a30 msgr2=0x55ec8a74c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:22.376 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.372+0000 7f3169968740 1 --2- 172.21.15.135:0/791847012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a750a30 0x55ec8a74c6a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f314c098fc0 tx=0x7f314c0d4c50 comp rx=0 tx=0).stop 2024-04-20T12:24:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.373+0000 7f3169968740 1 -- 172.21.15.135:0/791847012 shutdown_connections 2024-04-20T12:24:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.373+0000 7f3169968740 1 --2- 172.21.15.135:0/791847012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a759800 0x55ec8a7570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.373+0000 7f3169968740 1 --2- 172.21.15.135:0/791847012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a750a30 0x55ec8a74c6a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.373+0000 7f3169968740 1 --2- 172.21.15.135:0/791847012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a750110 0x55ec8a758f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.373+0000 7f3169968740 1 -- 172.21.15.135:0/791847012 >> 172.21.15.135:0/791847012 conn(0x55ec8a74aa30 msgr2=0x55ec8a7492c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.373+0000 7f3169968740 1 -- 172.21.15.135:0/791847012 shutdown_connections 2024-04-20T12:24:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.373+0000 7f3169968740 1 -- 172.21.15.135:0/791847012 wait complete. 2024-04-20T12:24:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.373+0000 7f3169968740 1 -- start start 2024-04-20T12:24:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.373+0000 7f3169968740 1 Processor -- start 2024-04-20T12:24:22.377 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3169968740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a750110 0x55ec8a766120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3169968740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750a30 0x55ec8a7614e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3169968740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a759800 0x55ec8a761bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3169968740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f31601ae510 con 0x55ec8a750110 2024-04-20T12:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3164b1a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a750110 0x55ec8a766120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3169968740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f31601ade40 con 0x55ec8a759800 2024-04-20T12:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3169968740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f31601ab070 con 0x55ec8a750a30 2024-04-20T12:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3164b1a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a750110 0x55ec8a766120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44068/0 (socket says 172.21.15.135:44068) 2024-04-20T12:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3164b1a640 1 -- 172.21.15.135:0/161879737 learned_addr learned my addr 172.21.15.135:0/161879737 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f315ffff640 1 --2- 172.21.15.135:0/161879737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750a30 0x55ec8a7614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f316531b640 1 --2- 172.21.15.135:0/161879737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a759800 0x55ec8a761bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3164b1a640 1 -- 172.21.15.135:0/161879737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750a30 msgr2=0x55ec8a7614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:22.378 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3164b1a640 1 --2- 172.21.15.135:0/161879737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750a30 0x55ec8a7614e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3169968740 10 client.0 _ll_register_callbacks cb 0x7f314c0d4b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3164b1a640 1 -- 172.21.15.135:0/161879737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a759800 msgr2=0x55ec8a761bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3164b1a640 1 --2- 172.21.15.135:0/161879737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a759800 0x55ec8a761bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3164b1a640 1 -- 172.21.15.135:0/161879737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec8a75bbf0 con 0x55ec8a750110 2024-04-20T12:24:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f316531b640 1 --2- 172.21.15.135:0/161879737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a759800 0x55ec8a761bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3169968740 1 -- 172.21.15.135:0/161879737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f314c09d260 con 0x55ec8a750110 2024-04-20T12:24:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f3164b1a640 1 --2- 172.21.15.135:0/161879737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a750110 0x55ec8a766120 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x55ec8a770c60 tx=0x7f31540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757455b2fb7d1f77 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.374+0000 7f313ffff640 10 client.16203 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.375+0000 7f313ffff640 1 -- 172.21.15.135:0/161879737 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315401e9a0 con 0x55ec8a750110 2024-04-20T12:24:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.375+0000 7f313ffff640 1 -- 172.21.15.135:0/161879737 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f315401eb40 con 0x55ec8a750110 2024-04-20T12:24:22.379 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.375+0000 7f313ffff640 1 -- 172.21.15.135:0/161879737 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f315401ed40 con 0x55ec8a750110 2024-04-20T12:24:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.375+0000 7f3169968740 10 client.16203 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.375+0000 7f3169968740 1 -- 172.21.15.135:0/161879737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55ec8a7d4490 con 0x55ec8a750110 2024-04-20T12:24:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.375+0000 7f313ffff640 1 -- 172.21.15.135:0/161879737 <== mon.0 v2:172.21.15.135:3300/0 4 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f315402a380 con 0x55ec8a750110 2024-04-20T12:24:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.375+0000 7f3169968740 10 client.16203 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.375+0000 7f3169968740 10 client.16203 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.375+0000 7f3169968740 20 client.16203 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.375+0000 7f3169968740 1 --2- 172.21.15.135:0/161879737 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ec8a7d4be0 0x55ec8a7d6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.375+0000 7f3169968740 4 client.16203 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-20T12:24:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.375+0000 7f3169968740 1 -- 172.21.15.135:0/161879737 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ec8a6bd0b0 con 0x55ec8a7d4be0 2024-04-20T12:24:22.380 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.376+0000 7f315ffff640 1 --2- 172.21.15.135:0/161879737 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ec8a7d4be0 0x55ec8a7d6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.376+0000 7f315ffff640 1 --2- 172.21.15.135:0/161879737 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ec8a7d4be0 0x55ec8a7d6fd0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4262e46fcb7c616c server_cookie=46004fe664fb18f in_seq=0 out_seq=0 2024-04-20T12:24:22.381 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.376+0000 7f313ffff640 10 client.16203 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:22.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.379+0000 7f313ffff640 1 -- 172.21.15.135:0/161879737 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ec8a6bd0b0 con 0x55ec8a7d4be0 2024-04-20T12:24:22.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.379+0000 7f313ffff640 10 client.16203 handle_command_reply: tid=0 2024-04-20T12:24:22.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.379+0000 7f3169968740 1 client.16203 shutdown 2024-04-20T12:24:22.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.380+0000 7f3169968740 1 -- 172.21.15.135:0/161879737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a750110 msgr2=0x55ec8a766120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:22.382 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.380+0000 7f3169968740 1 --2- 172.21.15.135:0/161879737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a750110 0x55ec8a766120 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x55ec8a770c60 tx=0x7f31540046c0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.380+0000 7f3169968740 1 -- 172.21.15.135:0/161879737 shutdown_connections 2024-04-20T12:24:22.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.380+0000 7f3169968740 1 --2- 172.21.15.135:0/161879737 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ec8a7d4be0 0x55ec8a7d6fd0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.380+0000 7f3169968740 1 --2- 172.21.15.135:0/161879737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec8a759800 0x55ec8a761bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.380+0000 7f313ffff640 0 client.16203 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:22.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.380+0000 7f3169968740 1 --2- 172.21.15.135:0/161879737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec8a750a30 0x55ec8a7614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.380+0000 7f3169968740 1 --2- 172.21.15.135:0/161879737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec8a750110 0x55ec8a766120 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.380+0000 7f3169968740 1 -- 172.21.15.135:0/161879737 >> 172.21.15.135:0/161879737 conn(0x55ec8a74aa30 msgr2=0x55ec8a7492c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:22.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.380+0000 7f3169968740 1 -- 172.21.15.135:0/161879737 shutdown_connections 2024-04-20T12:24:22.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.380+0000 7f3169968740 1 -- 172.21.15.135:0/161879737 wait complete. 2024-04-20T12:24:22.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.380+0000 7f3169968740 20 client.16203 trim_cache size 0 max 16384 2024-04-20T12:24:22.383 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-04-20T12:24:22.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-04-20T12:24:22.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-04-20T12:24:22.384 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-04-20T12:24:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.381+0000 7f3166d7e640 1 -- 172.21.15.135:0/336081171 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f31500a3ff0 msgr2=0x7f31500a64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.381+0000 7f3166d7e640 1 --2- 172.21.15.135:0/336081171 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f31500a3ff0 0x7f31500a64b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55ec8a74fbc0 tx=0x7f315400b390 comp rx=0 tx=0).stop 2024-04-20T12:24:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.381+0000 7f3166d7e640 1 -- 172.21.15.135:0/336081171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31601061a0 msgr2=0x7f3160198c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.381+0000 7f3166d7e640 1 --2- 172.21.15.135:0/336081171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31601061a0 0x7f3160198c90 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f314c00e9f0 tx=0x7f314c00eeb0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.381+0000 7f3166d7e640 1 -- 172.21.15.135:0/336081171 shutdown_connections 2024-04-20T12:24:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.381+0000 7f3166d7e640 1 --2- 172.21.15.135:0/336081171 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f31500a3ff0 0x7f31500a64b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.381+0000 7f3166d7e640 1 --2- 172.21.15.135:0/336081171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f316019d010 0x7f316019d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.381+0000 7f3166d7e640 1 --2- 172.21.15.135:0/336081171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f31601061a0 0x7f3160198c90 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.381+0000 7f3166d7e640 1 --2- 172.21.15.135:0/336081171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f31601010d0 0x7f3160198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.381+0000 7f3166d7e640 1 -- 172.21.15.135:0/336081171 >> 172.21.15.135:0/336081171 conn(0x7f3160077fb0 msgr2=0x7f316006a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.381+0000 7f3166d7e640 1 -- 172.21.15.135:0/336081171 shutdown_connections 2024-04-20T12:24:22.385 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:22.381+0000 7f3166d7e640 1 -- 172.21.15.135:0/336081171 wait complete. 2024-04-20T12:24:22.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:22 smithi135 ceph-mon[18264]: pgmap v40: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-04-20T12:24:22.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:22 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:24:22.881 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:22 smithi139 ceph-mon[21834]: pgmap v40: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-04-20T12:24:22.882 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:22 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:24:23.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:22 smithi154 ceph-mon[22073]: pgmap v40: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 511 B/s wr, 9 op/s 2024-04-20T12:24:23.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:22 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:24:24.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:24 smithi135 ceph-mon[18264]: pgmap v41: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 767 B/s wr, 14 op/s 2024-04-20T12:24:25.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:24 smithi154 ceph-mon[22073]: pgmap v41: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 767 B/s wr, 14 op/s 2024-04-20T12:24:25.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:24 smithi139 ceph-mon[21834]: pgmap v41: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 767 B/s wr, 14 op/s 2024-04-20T12:24:26.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:26 smithi135 ceph-mon[18264]: pgmap v42: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-20T12:24:27.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:26 smithi154 ceph-mon[22073]: pgmap v42: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-20T12:24:27.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:26 smithi139 ceph-mon[21834]: pgmap v42: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-20T12:24:28.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:28 smithi135 ceph-mon[18264]: pgmap v43: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-20T12:24:29.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:28 smithi154 ceph-mon[22073]: pgmap v43: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-20T12:24:29.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:28 smithi139 ceph-mon[21834]: pgmap v43: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-20T12:24:30.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:30 smithi135 ceph-mon[18264]: pgmap v44: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-20T12:24:31.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:30 smithi154 ceph-mon[22073]: pgmap v44: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-20T12:24:31.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:30 smithi139 ceph-mon[21834]: pgmap v44: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-20T12:24:32.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:32 smithi135 ceph-mon[18264]: pgmap v45: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-20T12:24:33.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:32 smithi154 ceph-mon[22073]: pgmap v45: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-20T12:24:33.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:32 smithi139 ceph-mon[21834]: pgmap v45: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 255 B/s wr, 9 op/s 2024-04-20T12:24:35.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:34 smithi154 ceph-mon[22073]: pgmap v46: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-20T12:24:35.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:34 smithi139 ceph-mon[21834]: pgmap v46: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-20T12:24:35.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:34 smithi135 ceph-mon[18264]: pgmap v46: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 255 B/s wr, 13 op/s 2024-04-20T12:24:35.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.469+0000 7f4a7e998640 1 -- 172.21.15.135:0/208976862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a78101ab0 msgr2=0x7f4a78105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:35.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.469+0000 7f4a7e998640 1 --2- 172.21.15.135:0/208976862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a78101ab0 0x7f4a78105aa0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009900 tx=0x7f4a6802bc30 comp rx=0 tx=0).stop 2024-04-20T12:24:35.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.469+0000 7f4a7e998640 1 -- 172.21.15.135:0/208976862 shutdown_connections 2024-04-20T12:24:35.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.469+0000 7f4a7e998640 1 --2- 172.21.15.135:0/208976862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a78106180 0x7f4a7810dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.469+0000 7f4a7e998640 1 --2- 172.21.15.135:0/208976862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a78101ab0 0x7f4a78105aa0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.469+0000 7f4a7e998640 1 --2- 172.21.15.135:0/208976862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a78101100 0x7f4a781014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.469+0000 7f4a7e998640 1 -- 172.21.15.135:0/208976862 >> 172.21.15.135:0/208976862 conn(0x7f4a78077fe0 msgr2=0x7f4a780783f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:35.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.469+0000 7f4a7e998640 1 -- 172.21.15.135:0/208976862 shutdown_connections 2024-04-20T12:24:35.471 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.469+0000 7f4a7e998640 1 -- 172.21.15.135:0/208976862 wait complete. 2024-04-20T12:24:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.469+0000 7f4a7e998640 1 Processor -- start 2024-04-20T12:24:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.469+0000 7f4a7e998640 1 -- start start 2024-04-20T12:24:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7e998640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a78101100 0x7f4a7819e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7e998640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a78106180 0x7f4a7819e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7e998640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a781985d0 0x7f4a78198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7e998640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4a78111260 con 0x7f4a781985d0 2024-04-20T12:24:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7e998640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4a781110e0 con 0x7f4a78101100 2024-04-20T12:24:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7e998640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4a781113e0 con 0x7f4a78106180 2024-04-20T12:24:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7cf35640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a781985d0 0x7f4a78198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7cf35640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a781985d0 0x7f4a78198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37434/0 (socket says 172.21.15.135:37434) 2024-04-20T12:24:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7cf35640 1 -- 172.21.15.135:0/3932382845 learned_addr learned my addr 172.21.15.135:0/3932382845 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a77fff640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a78101100 0x7f4a7819e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.472 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a777fe640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a78106180 0x7f4a7819e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7cf35640 1 -- 172.21.15.135:0/3932382845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a78106180 msgr2=0x7f4a7819e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7cf35640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a78106180 0x7f4a7819e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7cf35640 1 -- 172.21.15.135:0/3932382845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a78101100 msgr2=0x7f4a7819e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7cf35640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a78101100 0x7f4a7819e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7cf35640 1 -- 172.21.15.135:0/3932382845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a781990f0 con 0x7f4a781985d0 2024-04-20T12:24:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a777fe640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a78106180 0x7f4a7819e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a77fff640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a78101100 0x7f4a7819e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7cf35640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a781985d0 0x7f4a78198a80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000cce0 tx=0x7f4a7000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a757fa640 1 -- 172.21.15.135:0/3932382845 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7000f450 con 0x7f4a781985d0 2024-04-20T12:24:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a757fa640 1 -- 172.21.15.135:0/3932382845 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a7000fad0 con 0x7f4a781985d0 2024-04-20T12:24:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.470+0000 7f4a7e998640 1 -- 172.21.15.135:0/3932382845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a781993e0 con 0x7f4a781985d0 2024-04-20T12:24:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.471+0000 7f4a757fa640 1 -- 172.21.15.135:0/3932382845 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a70018c10 con 0x7f4a781985d0 2024-04-20T12:24:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.471+0000 7f4a7e998640 1 -- 172.21.15.135:0/3932382845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a781a55e0 con 0x7f4a781985d0 2024-04-20T12:24:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.473+0000 7f4a757fa640 1 -- 172.21.15.135:0/3932382845 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 25) ==== 138931+0+0 (secure 0 0 0) 0x7f4a7000f5f0 con 0x7f4a781985d0 2024-04-20T12:24:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.473+0000 7f4a81581740 1 Processor -- start 2024-04-20T12:24:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.473+0000 7f4a81581740 1 -- start start 2024-04-20T12:24:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.473+0000 7f4a81581740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 0x557be15ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.473+0000 7f4a81581740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be15f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.473+0000 7f4a81581740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15f6800 0x557be15f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.473+0000 7f4a81581740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557be1552820 con 0x557be15eda30 2024-04-20T12:24:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.473+0000 7f4a81581740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557be14effc0 con 0x557be15ed110 2024-04-20T12:24:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.473+0000 7f4a81581740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557be154e7e0 con 0x557be15f6800 2024-04-20T12:24:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.473+0000 7f4a757fa640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4a600a3f70 0x7f4a600a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a77fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be15f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a777fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 0x557be15ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a777fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 0x557be15ed4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:54054/0 (socket says 172.21.15.135:54054) 2024-04-20T12:24:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a77fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be15f62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37446/0 (socket says 172.21.15.135:37446) 2024-04-20T12:24:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a777fe640 1 -- 172.21.15.135:0/3143451906 learned_addr learned my addr 172.21.15.135:0/3143451906 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a7cf35640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4a600a3f70 0x7f4a600a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a757fa640 1 -- 172.21.15.135:0/3932382845 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f4a700d1490 con 0x7f4a781985d0 2024-04-20T12:24:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a777fe640 1 --2- 172.21.15.135:0/3143451906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15f6800 0x557be15f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a777fe640 1 -- 172.21.15.135:0/3143451906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15f6800 msgr2=0x557be15f8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a777fe640 1 --2- 172.21.15.135:0/3143451906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15f6800 0x557be15f8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a777fe640 1 -- 172.21.15.135:0/3143451906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 msgr2=0x557be15f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a777fe640 1 --2- 172.21.15.135:0/3143451906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be15f62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a777fe640 1 -- 172.21.15.135:0/3143451906 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557be1265210 con 0x557be15ed110 2024-04-20T12:24:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a7cf35640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4a600a3f70 0x7f4a600a6430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4a700ce720 tx=0x7f4a70067510 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a777fe640 1 --2- 172.21.15.135:0/3143451906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 0x557be15ed4f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4a68000c00 tx=0x7f4a68009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6801f793127c28c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a5e7fc640 1 -- 172.21.15.135:0/3143451906 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6802c880 con 0x557be15ed110 2024-04-20T12:24:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a5e7fc640 1 -- 172.21.15.135:0/3143451906 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a68048070 con 0x557be15ed110 2024-04-20T12:24:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.474+0000 7f4a5e7fc640 1 -- 172.21.15.135:0/3143451906 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a680049b0 con 0x557be15ed110 2024-04-20T12:24:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.475+0000 7f4a81581740 1 -- 172.21.15.135:0/3143451906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 msgr2=0x557be15ed4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.475+0000 7f4a81581740 1 --2- 172.21.15.135:0/3143451906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 0x557be15ed4f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4a68000c00 tx=0x7f4a68009560 comp rx=0 tx=0).stop 2024-04-20T12:24:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.475+0000 7f4a81581740 1 -- 172.21.15.135:0/3143451906 shutdown_connections 2024-04-20T12:24:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.475+0000 7f4a81581740 1 --2- 172.21.15.135:0/3143451906 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15f6800 0x557be15f8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.475+0000 7f4a81581740 1 --2- 172.21.15.135:0/3143451906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be15f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.475+0000 7f4a81581740 1 --2- 172.21.15.135:0/3143451906 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 0x557be15ed4f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.475+0000 7f4a81581740 1 -- 172.21.15.135:0/3143451906 >> 172.21.15.135:0/3143451906 conn(0x557be15e7a30 msgr2=0x557be15e7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.475+0000 7f4a81581740 1 -- 172.21.15.135:0/3143451906 shutdown_connections 2024-04-20T12:24:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.475+0000 7f4a81581740 1 -- 172.21.15.135:0/3143451906 wait complete. 2024-04-20T12:24:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a81581740 1 -- start start 2024-04-20T12:24:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a81581740 1 Processor -- start 2024-04-20T12:24:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a81581740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15ed110 0x557be15f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a81581740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15eda30 0x557be15f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a81581740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15f6800 0x557be15f4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a81581740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557be15f93d0 con 0x557be15ed110 2024-04-20T12:24:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a81581740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557be14daee0 con 0x557be15f6800 2024-04-20T12:24:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a81581740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557be15f9550 con 0x557be15eda30 2024-04-20T12:24:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a81581740 10 client.0 _ll_register_callbacks cb 0x557be14f0d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a777fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15ed110 0x557be15f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a777fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15ed110 0x557be15f37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37450/0 (socket says 172.21.15.135:37450) 2024-04-20T12:24:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a777fe640 1 -- 172.21.15.135:0/2085003333 learned_addr learned my addr 172.21.15.135:0/2085003333 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a77fff640 1 --2- 172.21.15.135:0/2085003333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15eda30 0x557be15f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a777fe640 1 --2- 172.21.15.135:0/2085003333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15f6800 0x557be15f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a777fe640 1 -- 172.21.15.135:0/2085003333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15eda30 msgr2=0x557be15f3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a777fe640 1 --2- 172.21.15.135:0/2085003333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15eda30 0x557be15f3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a777fe640 1 -- 172.21.15.135:0/2085003333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15f6800 msgr2=0x557be15f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a777fe640 1 --2- 172.21.15.135:0/2085003333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15f6800 0x557be15f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.476+0000 7f4a777fe640 1 -- 172.21.15.135:0/2085003333 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557be1331620 con 0x557be15ed110 2024-04-20T12:24:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a777fe640 1 --2- 172.21.15.135:0/2085003333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15ed110 0x557be15f37e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4a680092a0 tx=0x7f4a68009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbddba5c447908ba server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a577fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a577fe640 1 -- 172.21.15.135:0/2085003333 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a68055060 con 0x557be15ed110 2024-04-20T12:24:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a577fe640 1 -- 172.21.15.135:0/2085003333 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f4a68005250 con 0x557be15ed110 2024-04-20T12:24:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a81581740 1 -- 172.21.15.135:0/2085003333 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a68048070 con 0x557be15ed110 2024-04-20T12:24:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a577fe640 1 -- 172.21.15.135:0/2085003333 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4a6805c050 con 0x557be15ed110 2024-04-20T12:24:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a81581740 10 client.16215 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a81581740 1 -- 172.21.15.135:0/2085003333 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557be16055e0 con 0x557be15ed110 2024-04-20T12:24:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a577fe640 1 -- 172.21.15.135:0/2085003333 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a68048070 con 0x557be15ed110 2024-04-20T12:24:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a577fe640 1 -- 172.21.15.135:0/2085003333 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f4a68003680 con 0x557be15ed110 2024-04-20T12:24:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a81581740 10 client.16215 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a81581740 10 client.16215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a81581740 20 client.16215 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a81581740 1 --2- 172.21.15.135:0/2085003333 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557be1606930 0x557be1608d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a81581740 4 client.16215 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.477+0000 7f4a81581740 1 -- 172.21.15.135:0/2085003333 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557be1560240 con 0x557be1606930 2024-04-20T12:24:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.478+0000 7f4a77fff640 1 --2- 172.21.15.135:0/2085003333 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557be1606930 0x557be1608d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.478+0000 7f4a577fe640 10 client.16215 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.478+0000 7f4a77fff640 1 --2- 172.21.15.135:0/2085003333 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557be1606930 0x557be1608d20 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=569ad56fc3fb61cf server_cookie=ed5fac6492e3082c in_seq=0 out_seq=0 2024-04-20T12:24:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.479+0000 7f4a577fe640 1 -- 172.21.15.135:0/2085003333 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557be1560240 con 0x557be1606930 2024-04-20T12:24:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.479+0000 7f4a577fe640 10 client.16215 handle_command_reply: tid=0 2024-04-20T12:24:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.479+0000 7f4a81581740 1 client.16215 shutdown 2024-04-20T12:24:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.479+0000 7f4a81581740 1 -- 172.21.15.135:0/2085003333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15ed110 msgr2=0x557be15f37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.479+0000 7f4a81581740 1 --2- 172.21.15.135:0/2085003333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15ed110 0x557be15f37e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4a680092a0 tx=0x7f4a68009230 comp rx=0 tx=0).stop 2024-04-20T12:24:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.479+0000 7f4a81581740 1 -- 172.21.15.135:0/2085003333 shutdown_connections 2024-04-20T12:24:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.479+0000 7f4a81581740 1 --2- 172.21.15.135:0/2085003333 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557be1606930 0x557be1608d20 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.479+0000 7f4a81581740 1 --2- 172.21.15.135:0/2085003333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15f6800 0x557be15f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.479+0000 7f4a577fe640 0 client.16215 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.479+0000 7f4a81581740 1 --2- 172.21.15.135:0/2085003333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15eda30 0x557be15f3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.479+0000 7f4a81581740 1 --2- 172.21.15.135:0/2085003333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15ed110 0x557be15f37e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.479+0000 7f4a81581740 1 -- 172.21.15.135:0/2085003333 >> 172.21.15.135:0/2085003333 conn(0x557be15e7a30 msgr2=0x557be15e9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.479+0000 7f4a81581740 1 -- 172.21.15.135:0/2085003333 shutdown_connections 2024-04-20T12:24:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.479+0000 7f4a81581740 1 -- 172.21.15.135:0/2085003333 wait complete. 2024-04-20T12:24:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.479+0000 7f4a81581740 20 client.16215 trim_cache size 0 max 16384 2024-04-20T12:24:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a81581740 1 Processor -- start 2024-04-20T12:24:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a81581740 1 -- start start 2024-04-20T12:24:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a81581740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 0x557be15f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a81581740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be15e69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a81581740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15f6800 0x557be160bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.498 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a81581740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4a781af150 con 0x557be15eda30 2024-04-20T12:24:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a81581740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4a781b0c90 con 0x557be15ed110 2024-04-20T12:24:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a81581740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4a781af820 con 0x557be15f6800 2024-04-20T12:24:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a77fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be15e69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a77fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be15e69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37456/0 (socket says 172.21.15.135:37456) 2024-04-20T12:24:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a77fff640 1 -- 172.21.15.135:0/2023718128 learned_addr learned my addr 172.21.15.135:0/2023718128 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a777fe640 1 --2- 172.21.15.135:0/2023718128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 0x557be15f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a777fe640 1 --2- 172.21.15.135:0/2023718128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15f6800 0x557be160bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a77fff640 1 -- 172.21.15.135:0/2023718128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15f6800 msgr2=0x557be160bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a77fff640 1 --2- 172.21.15.135:0/2023718128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15f6800 0x557be160bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a77fff640 1 -- 172.21.15.135:0/2023718128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 msgr2=0x557be15f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a77fff640 1 --2- 172.21.15.135:0/2023718128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 0x557be15f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.499 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a77fff640 1 -- 172.21.15.135:0/2023718128 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557be15e7860 con 0x557be15eda30 2024-04-20T12:24:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.494+0000 7f4a777fe640 1 --2- 172.21.15.135:0/2023718128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 0x557be15f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.495+0000 7f4a77fff640 1 --2- 172.21.15.135:0/2023718128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be15e69d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x557be15f3040 tx=0x7f4a6c011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e5c8471fe99734 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.495+0000 7f4a5dffb640 1 -- 172.21.15.135:0/2023718128 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c021030 con 0x557be15eda30 2024-04-20T12:24:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.495+0000 7f4a5dffb640 1 -- 172.21.15.135:0/2023718128 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a6c005020 con 0x557be15eda30 2024-04-20T12:24:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.495+0000 7f4a5dffb640 1 -- 172.21.15.135:0/2023718128 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c004c40 con 0x557be15eda30 2024-04-20T12:24:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.495+0000 7f4a81581740 1 -- 172.21.15.135:0/2023718128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 msgr2=0x557be15e69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.495+0000 7f4a81581740 1 --2- 172.21.15.135:0/2023718128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be15e69d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x557be15f3040 tx=0x7f4a6c011980 comp rx=0 tx=0).stop 2024-04-20T12:24:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 1 -- 172.21.15.135:0/2023718128 shutdown_connections 2024-04-20T12:24:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 1 --2- 172.21.15.135:0/2023718128 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15f6800 0x557be160bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 1 --2- 172.21.15.135:0/2023718128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be15e69d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 1 --2- 172.21.15.135:0/2023718128 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 0x557be15f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 1 -- 172.21.15.135:0/2023718128 >> 172.21.15.135:0/2023718128 conn(0x557be15e7a30 msgr2=0x557be15e62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 1 -- 172.21.15.135:0/2023718128 shutdown_connections 2024-04-20T12:24:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 1 -- 172.21.15.135:0/2023718128 wait complete. 2024-04-20T12:24:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 1 -- start start 2024-04-20T12:24:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 1 Processor -- start 2024-04-20T12:24:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 0x557be1609a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be1609f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15f6800 0x557be160a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4a781b05c0 con 0x557be15eda30 2024-04-20T12:24:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4a781afef0 con 0x557be15ed110 2024-04-20T12:24:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4a781ad120 con 0x557be15f6800 2024-04-20T12:24:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a81581740 10 client.0 _ll_register_callbacks cb 0x7f4a6c00b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.496+0000 7f4a77fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be1609f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a77fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be1609f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37466/0 (socket says 172.21.15.135:37466) 2024-04-20T12:24:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a77fff640 1 -- 172.21.15.135:0/622667589 learned_addr learned my addr 172.21.15.135:0/622667589 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a777fe640 1 --2- 172.21.15.135:0/622667589 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 0x557be1609a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a777fe640 1 --2- 172.21.15.135:0/622667589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15f6800 0x557be160a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a77fff640 1 -- 172.21.15.135:0/622667589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15f6800 msgr2=0x557be160a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a77fff640 1 --2- 172.21.15.135:0/622667589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15f6800 0x557be160a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a77fff640 1 -- 172.21.15.135:0/622667589 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 msgr2=0x557be1609a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a77fff640 1 --2- 172.21.15.135:0/622667589 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 0x557be1609a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a77fff640 1 -- 172.21.15.135:0/622667589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557be166bd10 con 0x557be15eda30 2024-04-20T12:24:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a77fff640 1 --2- 172.21.15.135:0/622667589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be1609f40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0047a0 tx=0x7f4a6c00bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f72b9734c1682 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a577fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a577fe640 1 -- 172.21.15.135:0/622667589 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c021040 con 0x557be15eda30 2024-04-20T12:24:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a577fe640 1 -- 172.21.15.135:0/622667589 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f4a6c01d820 con 0x557be15eda30 2024-04-20T12:24:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a81581740 1 -- 172.21.15.135:0/622667589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a6c005020 con 0x557be15eda30 2024-04-20T12:24:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a577fe640 1 -- 172.21.15.135:0/622667589 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4a6c0051d0 con 0x557be15eda30 2024-04-20T12:24:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a81581740 10 client.16221 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a81581740 1 -- 172.21.15.135:0/622667589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557be166cfe0 con 0x557be15eda30 2024-04-20T12:24:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.497+0000 7f4a577fe640 1 -- 172.21.15.135:0/622667589 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a6c005020 con 0x557be15eda30 2024-04-20T12:24:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.498+0000 7f4a577fe640 1 -- 172.21.15.135:0/622667589 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f4a6c010640 con 0x557be15eda30 2024-04-20T12:24:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.498+0000 7f4a81581740 10 client.16221 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.498+0000 7f4a81581740 10 client.16221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.498+0000 7f4a81581740 20 client.16221 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.498+0000 7f4a81581740 1 --2- 172.21.15.135:0/622667589 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557be166d720 0x557be166fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.498+0000 7f4a81581740 4 client.16221 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-20T12:24:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.498+0000 7f4a81581740 1 -- 172.21.15.135:0/622667589 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557be155a0b0 con 0x557be166d720 2024-04-20T12:24:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.498+0000 7f4a777fe640 1 --2- 172.21.15.135:0/622667589 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557be166d720 0x557be166fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.498+0000 7f4a577fe640 10 client.16221 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.498+0000 7f4a777fe640 1 --2- 172.21.15.135:0/622667589 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557be166d720 0x557be166fb40 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6698a42644209677 server_cookie=3112be7cc6e5bcc5 in_seq=0 out_seq=0 2024-04-20T12:24:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.502+0000 7f4a577fe640 1 -- 172.21.15.135:0/622667589 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557be155a0b0 con 0x557be166d720 2024-04-20T12:24:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.502+0000 7f4a577fe640 10 client.16221 handle_command_reply: tid=0 2024-04-20T12:24:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.502+0000 7f4a81581740 1 client.16221 shutdown 2024-04-20T12:24:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.502+0000 7f4a81581740 1 -- 172.21.15.135:0/622667589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 msgr2=0x557be1609f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.502+0000 7f4a81581740 1 --2- 172.21.15.135:0/622667589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be1609f40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0047a0 tx=0x7f4a6c00bbf0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.502+0000 7f4a81581740 1 -- 172.21.15.135:0/622667589 shutdown_connections 2024-04-20T12:24:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.502+0000 7f4a81581740 1 --2- 172.21.15.135:0/622667589 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557be166d720 0x557be166fb40 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.502+0000 7f4a81581740 1 --2- 172.21.15.135:0/622667589 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557be15f6800 0x557be160a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.502+0000 7f4a577fe640 0 client.16221 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.502+0000 7f4a81581740 1 --2- 172.21.15.135:0/622667589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557be15eda30 0x557be1609f40 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.502+0000 7f4a81581740 1 --2- 172.21.15.135:0/622667589 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557be15ed110 0x557be1609a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.502+0000 7f4a81581740 1 -- 172.21.15.135:0/622667589 >> 172.21.15.135:0/622667589 conn(0x557be15e7a30 msgr2=0x557be1602030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.502+0000 7f4a81581740 1 -- 172.21.15.135:0/622667589 shutdown_connections 2024-04-20T12:24:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.502+0000 7f4a81581740 1 -- 172.21.15.135:0/622667589 wait complete. 2024-04-20T12:24:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.503+0000 7f4a81581740 20 client.16221 trim_cache size 0 max 16384 2024-04-20T12:24:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-04-20T12:24:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-04-20T12:24:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-04-20T12:24:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-04-20T12:24:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.503+0000 7f4a7e998640 1 -- 172.21.15.135:0/3932382845 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4a600a3f70 msgr2=0x7f4a600a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.503+0000 7f4a7e998640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4a600a3f70 0x7f4a600a6430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4a700ce720 tx=0x7f4a70067510 comp rx=0 tx=0).stop 2024-04-20T12:24:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.503+0000 7f4a7e998640 1 -- 172.21.15.135:0/3932382845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a781985d0 msgr2=0x7f4a78198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.503+0000 7f4a7e998640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a781985d0 0x7f4a78198a80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000cce0 tx=0x7f4a7000a620 comp rx=0 tx=0).stop 2024-04-20T12:24:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.503+0000 7f4a7e998640 1 -- 172.21.15.135:0/3932382845 shutdown_connections 2024-04-20T12:24:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.503+0000 7f4a7e998640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a781985d0 0x7f4a78198a80 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.503+0000 7f4a7e998640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4a600a3f70 0x7f4a600a6430 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.503+0000 7f4a7e998640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4a78106180 0x7f4a7819e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.503+0000 7f4a7e998640 1 --2- 172.21.15.135:0/3932382845 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4a78101100 0x7f4a7819e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.503+0000 7f4a7e998640 1 -- 172.21.15.135:0/3932382845 >> 172.21.15.135:0/3932382845 conn(0x7f4a78077fe0 msgr2=0x7f4a78069890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.503+0000 7f4a7e998640 1 -- 172.21.15.135:0/3932382845 shutdown_connections 2024-04-20T12:24:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:35.503+0000 7f4a7e998640 1 -- 172.21.15.135:0/3932382845 wait complete. 2024-04-20T12:24:37.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:36 smithi154 ceph-mon[22073]: pgmap v47: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:24:37.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:36 smithi139 ceph-mon[21834]: pgmap v47: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:24:37.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:36 smithi135 ceph-mon[18264]: pgmap v47: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:24:38.690 INFO:tasks.workunit.client.0.smithi135.stderr:Note: switching to 'a8c84f5997950fd7d008204839253291d52e6eda'. 2024-04-20T12:24:38.690 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-04-20T12:24:38.690 INFO:tasks.workunit.client.0.smithi135.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-20T12:24:38.690 INFO:tasks.workunit.client.0.smithi135.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-20T12:24:38.690 INFO:tasks.workunit.client.0.smithi135.stderr:state without impacting any branches by switching back to a branch. 2024-04-20T12:24:38.691 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-04-20T12:24:38.691 INFO:tasks.workunit.client.0.smithi135.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-20T12:24:38.691 INFO:tasks.workunit.client.0.smithi135.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-20T12:24:38.691 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-04-20T12:24:38.691 INFO:tasks.workunit.client.0.smithi135.stderr: git switch -c 2024-04-20T12:24:38.691 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-04-20T12:24:38.691 INFO:tasks.workunit.client.0.smithi135.stderr:Or undo this operation with: 2024-04-20T12:24:38.691 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-04-20T12:24:38.691 INFO:tasks.workunit.client.0.smithi135.stderr: git switch - 2024-04-20T12:24:38.691 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-04-20T12:24:38.691 INFO:tasks.workunit.client.0.smithi135.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-20T12:24:38.691 INFO:tasks.workunit.client.0.smithi135.stderr: 2024-04-20T12:24:38.692 INFO:tasks.workunit.client.0.smithi135.stderr:HEAD is now at a8c84f59979 Merge PR #51659 into wip-rishabh-testing-20240416.193735 2024-04-20T12:24:38.697 DEBUG:teuthology.orchestra.run.smithi135:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-20T12:24:38.760 INFO:tasks.workunit.client.0.smithi135.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-20T12:24:38.762 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-20T12:24:38.762 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-20T12:24:38.915 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:38 smithi135 ceph-mon[18264]: pgmap v48: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:24:39.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:38 smithi154 ceph-mon[22073]: pgmap v48: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:24:39.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:38 smithi139 ceph-mon[21834]: pgmap v48: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:24:39.395 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-20T12:24:39.450 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-20T12:24:39.488 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-20T12:24:39.490 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-20T12:24:39.490 INFO:tasks.workunit.client.0.smithi135.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-20T12:24:39.529 INFO:tasks.workunit.client.0.smithi135.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-20T12:24:39.532 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:24:39.532 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-20T12:24:39.587 INFO:tasks.workunit:Running workunits matching direct_io on client.0... 2024-04-20T12:24:39.588 INFO:tasks.workunit:Running workunit direct_io/big.sh... 2024-04-20T12:24:39.589 DEBUG:teuthology.orchestra.run.smithi135:workunit test direct_io/big.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c84f5997950fd7d008204839253291d52e6eda TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/big.sh 2024-04-20T12:24:39.650 INFO:tasks.workunit.client.0.smithi135.stdout:test large (16MB) dio write 2024-04-20T12:24:39.650 INFO:tasks.workunit.client.0.smithi135.stderr:+ echo 'test large (16MB) dio write' 2024-04-20T12:24:39.650 INFO:tasks.workunit.client.0.smithi135.stderr:+ dd if=/dev/zero of=foo.big bs=16M count=1 oflag=direct 2024-04-20T12:24:39.716 INFO:tasks.workunit.client.0.smithi135.stderr:1+0 records in 2024-04-20T12:24:39.716 INFO:tasks.workunit.client.0.smithi135.stderr:1+0 records out 2024-04-20T12:24:39.716 INFO:tasks.workunit.client.0.smithi135.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0639457 s, 262 MB/s 2024-04-20T12:24:39.716 INFO:tasks.workunit.client.0.smithi135.stdout:OK 2024-04-20T12:24:39.717 INFO:tasks.workunit.client.0.smithi135.stderr:+ echo OK 2024-04-20T12:24:39.717 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-20T12:24:39.717 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-20T12:24:39.793 INFO:tasks.workunit:Running workunit direct_io/direct_io_test... 2024-04-20T12:24:39.793 DEBUG:teuthology.orchestra.run.smithi135:workunit test direct_io/direct_io_test> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c84f5997950fd7d008204839253291d52e6eda TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/direct_io_test 2024-04-20T12:24:41.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:40 smithi154 ceph-mon[22073]: pgmap v49: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-04-20T12:24:41.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:40 smithi154 ceph-mon[22073]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-04-20T12:24:41.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:40 smithi139 ceph-mon[21834]: pgmap v49: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-04-20T12:24:41.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:40 smithi139 ceph-mon[21834]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-04-20T12:24:41.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:40 smithi135 ceph-mon[18264]: pgmap v49: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-04-20T12:24:41.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:40 smithi135 ceph-mon[18264]: mgrmap e26: x(active, since 92s), standbys: y, z 2024-04-20T12:24:43.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:42 smithi154 ceph-mon[22073]: pgmap v50: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-04-20T12:24:43.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:42 smithi139 ceph-mon[21834]: pgmap v50: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-04-20T12:24:43.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:42 smithi135 ceph-mon[18264]: pgmap v50: 129 pgs: 129 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-04-20T12:24:45.000 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:44 smithi154 ceph-mon[22073]: pgmap v51: 129 pgs: 129 active+clean; 18 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 417 op/s 2024-04-20T12:24:45.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:44 smithi139 ceph-mon[21834]: pgmap v51: 129 pgs: 129 active+clean; 18 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 417 op/s 2024-04-20T12:24:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:44 smithi135 ceph-mon[18264]: pgmap v51: 129 pgs: 129 active+clean; 18 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 417 op/s 2024-04-20T12:24:47.000 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:46 smithi154 ceph-mon[22073]: pgmap v52: 129 pgs: 129 active+clean; 18 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 413 op/s 2024-04-20T12:24:47.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:46 smithi139 ceph-mon[21834]: pgmap v52: 129 pgs: 129 active+clean; 18 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 413 op/s 2024-04-20T12:24:47.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:46 smithi135 ceph-mon[18264]: pgmap v52: 129 pgs: 129 active+clean; 18 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 413 op/s 2024-04-20T12:24:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.598+0000 7fd7ba3a4640 1 -- 172.21.15.135:0/1284308578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7b410c570 msgr2=0x7fd7b410e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.598+0000 7fd7ba3a4640 1 --2- 172.21.15.135:0/1284308578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7b410c570 0x7fd7b410e9c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009ca0 tx=0x7fd7ac02c180 comp rx=0 tx=0).stop 2024-04-20T12:24:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.598+0000 7fd7ba3a4640 1 -- 172.21.15.135:0/1284308578 shutdown_connections 2024-04-20T12:24:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.598+0000 7fd7ba3a4640 1 --2- 172.21.15.135:0/1284308578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7b410c570 0x7fd7b410e9c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.598+0000 7fd7ba3a4640 1 --2- 172.21.15.135:0/1284308578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7b4103b50 0x7fd7b410c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.598+0000 7fd7ba3a4640 1 --2- 172.21.15.135:0/1284308578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b4103230 0x7fd7b4103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.598+0000 7fd7ba3a4640 1 -- 172.21.15.135:0/1284308578 >> 172.21.15.135:0/1284308578 conn(0x7fd7b4077fe0 msgr2=0x7fd7b40783f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.598+0000 7fd7ba3a4640 1 -- 172.21.15.135:0/1284308578 shutdown_connections 2024-04-20T12:24:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.598+0000 7fd7ba3a4640 1 -- 172.21.15.135:0/1284308578 wait complete. 2024-04-20T12:24:48.600 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.598+0000 7fd7ba3a4640 1 Processor -- start 2024-04-20T12:24:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.598+0000 7fd7ba3a4640 1 -- start start 2024-04-20T12:24:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7ba3a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b4103230 0x7fd7b419e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7ba3a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7b4103b50 0x7fd7b419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7ba3a4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7b410c570 0x7fd7b4198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7ba3a4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4112300 con 0x7fd7b410c570 2024-04-20T12:24:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7ba3a4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4112180 con 0x7fd7b4103b50 2024-04-20T12:24:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7ba3a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4112480 con 0x7fd7b4103230 2024-04-20T12:24:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7b8941640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7b410c570 0x7fd7b4198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7b8941640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7b410c570 0x7fd7b4198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39732/0 (socket says 172.21.15.135:39732) 2024-04-20T12:24:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7b8941640 1 -- 172.21.15.135:0/2886009793 learned_addr learned my addr 172.21.15.135:0/2886009793 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7b3fff640 1 --2- 172.21.15.135:0/2886009793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b4103230 0x7fd7b419e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/2886009793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7b4103b50 0x7fd7b419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7b8941640 1 -- 172.21.15.135:0/2886009793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b4103230 msgr2=0x7fd7b419e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:48.601 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7b8941640 1 --2- 172.21.15.135:0/2886009793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b4103230 0x7fd7b419e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7b8941640 1 -- 172.21.15.135:0/2886009793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7b4103b50 msgr2=0x7fd7b419e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7b8941640 1 --2- 172.21.15.135:0/2886009793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7b4103b50 0x7fd7b419e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7b8941640 1 -- 172.21.15.135:0/2886009793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b4198da0 con 0x7fd7b410c570 2024-04-20T12:24:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7b8941640 1 --2- 172.21.15.135:0/2886009793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7b410c570 0x7fd7b4198620 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac037040 tx=0x7fd7ac035cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7b17fa640 1 -- 172.21.15.135:0/2886009793 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac039040 con 0x7fd7b410c570 2024-04-20T12:24:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7b17fa640 1 -- 172.21.15.135:0/2886009793 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7ac044070 con 0x7fd7b410c570 2024-04-20T12:24:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7ba3a4640 1 -- 172.21.15.135:0/2886009793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b4199030 con 0x7fd7b410c570 2024-04-20T12:24:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7b17fa640 1 -- 172.21.15.135:0/2886009793 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac0328d0 con 0x7fd7b410c570 2024-04-20T12:24:48.602 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.599+0000 7fd7ba3a4640 1 -- 172.21.15.135:0/2886009793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b41a52e0 con 0x7fd7b410c570 2024-04-20T12:24:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.601+0000 7fd7b17fa640 1 -- 172.21.15.135:0/2886009793 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fd7ac004040 con 0x7fd7b410c570 2024-04-20T12:24:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7bcf93740 1 Processor -- start 2024-04-20T12:24:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7bcf93740 1 -- start start 2024-04-20T12:24:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7bcf93740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3030110 0x563ab30304f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7bcf93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030a30 0x563ab30392c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7bcf93740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3039800 0x563ab303bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7bcf93740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563ab2f95820 con 0x563ab3030110 2024-04-20T12:24:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7bcf93740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563ab2f32fc0 con 0x563ab3030a30 2024-04-20T12:24:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7bcf93740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563ab2f917e0 con 0x563ab3039800 2024-04-20T12:24:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7b17fa640 1 --2- 172.21.15.135:0/2886009793 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd79c0a3dc0 0x7fd79c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7b37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3030110 0x563ab30304f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7b37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3030110 0x563ab30304f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39748/0 (socket says 172.21.15.135:39748) 2024-04-20T12:24:48.609 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7b37fe640 1 -- 172.21.15.135:0/537878411 learned_addr learned my addr 172.21.15.135:0/537878411 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/537878411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3039800 0x563ab303bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7b8941640 1 --2- 172.21.15.135:0/2886009793 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd79c0a3dc0 0x7fd79c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7b3fff640 1 --2- 172.21.15.135:0/537878411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030a30 0x563ab30392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7b17fa640 1 -- 172.21.15.135:0/2886009793 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fd7ac0f2ec0 con 0x7fd7b410c570 2024-04-20T12:24:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7b37fe640 1 -- 172.21.15.135:0/537878411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3039800 msgr2=0x563ab303bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/537878411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3039800 0x563ab303bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7b37fe640 1 -- 172.21.15.135:0/537878411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030a30 msgr2=0x563ab30392c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/537878411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030a30 0x563ab30392c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7b37fe640 1 -- 172.21.15.135:0/537878411 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ab2ca8210 con 0x563ab3030110 2024-04-20T12:24:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.602+0000 7fd7b3fff640 1 --2- 172.21.15.135:0/537878411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030a30 0x563ab30392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.603+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/537878411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3030110 0x563ab30304f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80126b0 tx=0x7fd7a800b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476431b1e865c348 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.603+0000 7fd7b8941640 1 --2- 172.21.15.135:0/2886009793 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd79c0a3dc0 0x7fd79c0a6280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0bb5c0 tx=0x7fd7ac0df040 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:48.610 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.603+0000 7fd79a7fc640 1 -- 172.21.15.135:0/537878411 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8004020 con 0x563ab3030110 2024-04-20T12:24:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.603+0000 7fd79a7fc640 1 -- 172.21.15.135:0/537878411 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7a8004c80 con 0x563ab3030110 2024-04-20T12:24:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.603+0000 7fd79a7fc640 1 -- 172.21.15.135:0/537878411 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8005520 con 0x563ab3030110 2024-04-20T12:24:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.603+0000 7fd7bcf93740 1 -- 172.21.15.135:0/537878411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3030110 msgr2=0x563ab30304f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/537878411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3030110 0x563ab30304f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80126b0 tx=0x7fd7a800b410 comp rx=0 tx=0).stop 2024-04-20T12:24:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 -- 172.21.15.135:0/537878411 shutdown_connections 2024-04-20T12:24:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/537878411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3039800 0x563ab303bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/537878411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030a30 0x563ab30392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/537878411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3030110 0x563ab30304f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 -- 172.21.15.135:0/537878411 >> 172.21.15.135:0/537878411 conn(0x563ab302aa30 msgr2=0x563ab302ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 -- 172.21.15.135:0/537878411 shutdown_connections 2024-04-20T12:24:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 -- 172.21.15.135:0/537878411 wait complete. 2024-04-20T12:24:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 -- start start 2024-04-20T12:24:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 Processor -- start 2024-04-20T12:24:48.611 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030110 0x563ab30367c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3030a30 0x563ab3036d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3039800 0x563ab3037240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563ab303c3d0 con 0x563ab3039800 2024-04-20T12:24:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563ab2f1dee0 con 0x563ab3030110 2024-04-20T12:24:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563ab303c550 con 0x563ab3030a30 2024-04-20T12:24:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7bcf93740 10 client.0 _ll_register_callbacks cb 0x563ab2f33d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.604+0000 7fd7b37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3039800 0x563ab3037240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7b3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3030a30 0x563ab3036d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7b37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3039800 0x563ab3037240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39756/0 (socket says 172.21.15.135:39756) 2024-04-20T12:24:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7b37fe640 1 -- 172.21.15.135:0/1527564557 learned_addr learned my addr 172.21.15.135:0/1527564557 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/1527564557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030110 0x563ab30367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7b3fff640 1 -- 172.21.15.135:0/1527564557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030110 msgr2=0x563ab30367c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7b3fff640 1 --2- 172.21.15.135:0/1527564557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030110 0x563ab30367c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.612 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7b3fff640 1 -- 172.21.15.135:0/1527564557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3039800 msgr2=0x563ab3037240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7b3fff640 1 --2- 172.21.15.135:0/1527564557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3039800 0x563ab3037240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7b3fff640 1 -- 172.21.15.135:0/1527564557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ab2d74620 con 0x563ab3030a30 2024-04-20T12:24:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/1527564557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3039800 0x563ab3037240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7b3fff640 1 --2- 172.21.15.135:0/1527564557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3030a30 0x563ab3036d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7a40126d0 tx=0x7fd7a4012b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=654f283c4a7a0581 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7937fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-20T12:24:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7937fe640 1 -- 172.21.15.135:0/1527564557 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a400f940 con 0x563ab3030a30 2024-04-20T12:24:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7bcf93740 1 -- 172.21.15.135:0/1527564557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7a8004c80 con 0x563ab3030a30 2024-04-20T12:24:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7937fe640 1 -- 172.21.15.135:0/1527564557 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fd7a400fae0 con 0x563ab3030a30 2024-04-20T12:24:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7937fe640 1 -- 172.21.15.135:0/1527564557 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd7a4024050 con 0x563ab3030a30 2024-04-20T12:24:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7bcf93740 10 client.25642 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.605+0000 7fd7bcf93740 1 -- 172.21.15.135:0/1527564557 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563ab30486c0 con 0x563ab3030a30 2024-04-20T12:24:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.606+0000 7fd7937fe640 1 -- 172.21.15.135:0/1527564557 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7a8004c80 con 0x563ab3030a30 2024-04-20T12:24:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.606+0000 7fd7937fe640 1 -- 172.21.15.135:0/1527564557 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fd7a4004a00 con 0x563ab3030a30 2024-04-20T12:24:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.606+0000 7fd7bcf93740 10 client.25642 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:48.613 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.606+0000 7fd7bcf93740 10 client.25642 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.606+0000 7fd7bcf93740 20 client.25642 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.606+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/1527564557 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563ab3049c90 0x563ab304c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.606+0000 7fd7bcf93740 4 client.25642 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.606+0000 7fd7bcf93740 1 -- 172.21.15.135:0/1527564557 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ab2fa3240 con 0x563ab3049c90 2024-04-20T12:24:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.606+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/1527564557 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563ab3049c90 0x563ab304c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.606+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/1527564557 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563ab3049c90 0x563ab304c080 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6800b8ba6ebe8856 server_cookie=118ca47f8ad51f02 in_seq=0 out_seq=0 2024-04-20T12:24:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.606+0000 7fd7937fe640 10 client.25642 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.607+0000 7fd7937fe640 1 -- 172.21.15.135:0/1527564557 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563ab2fa3240 con 0x563ab3049c90 2024-04-20T12:24:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.607+0000 7fd7937fe640 10 client.25642 handle_command_reply: tid=0 2024-04-20T12:24:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.607+0000 7fd7bcf93740 1 client.25642 shutdown 2024-04-20T12:24:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.607+0000 7fd7bcf93740 1 -- 172.21.15.135:0/1527564557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3030a30 msgr2=0x563ab3036d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.607+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/1527564557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3030a30 0x563ab3036d00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd7a40126d0 tx=0x7fd7a4012b90 comp rx=0 tx=0).stop 2024-04-20T12:24:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.607+0000 7fd7bcf93740 1 -- 172.21.15.135:0/1527564557 shutdown_connections 2024-04-20T12:24:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.607+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/1527564557 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563ab3049c90 0x563ab304c080 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.607+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/1527564557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3039800 0x563ab3037240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.607+0000 7fd7937fe640 0 client.25642 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.607+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/1527564557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3030a30 0x563ab3036d00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.607+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/1527564557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030110 0x563ab30367c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.607+0000 7fd7bcf93740 1 -- 172.21.15.135:0/1527564557 >> 172.21.15.135:0/1527564557 conn(0x563ab302aa30 msgr2=0x563ab302c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.607+0000 7fd7bcf93740 1 -- 172.21.15.135:0/1527564557 shutdown_connections 2024-04-20T12:24:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.607+0000 7fd7bcf93740 1 -- 172.21.15.135:0/1527564557 wait complete. 2024-04-20T12:24:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.608+0000 7fd7bcf93740 20 client.25642 trim_cache size 0 max 16384 2024-04-20T12:24:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.622+0000 7fd7bcf93740 1 Processor -- start 2024-04-20T12:24:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7bcf93740 1 -- start start 2024-04-20T12:24:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7bcf93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030110 0x563ab3045290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7bcf93740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3030a30 0x563ab3041b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7bcf93740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3039800 0x563ab3037060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.624 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7bcf93740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b41af270 con 0x563ab3039800 2024-04-20T12:24:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7bcf93740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b41b0db0 con 0x563ab3030110 2024-04-20T12:24:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7bcf93740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b41af940 con 0x563ab3030a30 2024-04-20T12:24:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7b37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3039800 0x563ab3037060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7b37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3039800 0x563ab3037060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39772/0 (socket says 172.21.15.135:39772) 2024-04-20T12:24:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7b3fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3030a30 0x563ab3041b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7b37fe640 1 -- 172.21.15.135:0/2000635214 learned_addr learned my addr 172.21.15.135:0/2000635214 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/2000635214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030110 0x563ab3045290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7b37fe640 1 -- 172.21.15.135:0/2000635214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3030a30 msgr2=0x563ab3041b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/2000635214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3030a30 0x563ab3041b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7b37fe640 1 -- 172.21.15.135:0/2000635214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030110 msgr2=0x563ab3045290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/2000635214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030110 0x563ab3045290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7b37fe640 1 -- 172.21.15.135:0/2000635214 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ab3030860 con 0x563ab3039800 2024-04-20T12:24:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/2000635214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3039800 0x563ab3037060 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8005090 tx=0x7fd7a80050c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b514ffd897008504 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.623+0000 7fd799ffb640 1 -- 172.21.15.135:0/2000635214 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8005270 con 0x563ab3039800 2024-04-20T12:24:48.625 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.624+0000 7fd799ffb640 1 -- 172.21.15.135:0/2000635214 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7a8004660 con 0x563ab3039800 2024-04-20T12:24:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.624+0000 7fd799ffb640 1 -- 172.21.15.135:0/2000635214 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8003850 con 0x563ab3039800 2024-04-20T12:24:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.624+0000 7fd7bcf93740 1 -- 172.21.15.135:0/2000635214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3039800 msgr2=0x563ab3037060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.624+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/2000635214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3039800 0x563ab3037060 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8005090 tx=0x7fd7a80050c0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.624+0000 7fd7bcf93740 1 -- 172.21.15.135:0/2000635214 shutdown_connections 2024-04-20T12:24:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.624+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/2000635214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3039800 0x563ab3037060 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.624+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/2000635214 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3030a30 0x563ab3041b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.624+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/2000635214 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030110 0x563ab3045290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.624+0000 7fd7bcf93740 1 -- 172.21.15.135:0/2000635214 >> 172.21.15.135:0/2000635214 conn(0x563ab302aa30 msgr2=0x563ab30292c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.624+0000 7fd7bcf93740 1 -- 172.21.15.135:0/2000635214 shutdown_connections 2024-04-20T12:24:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.624+0000 7fd7bcf93740 1 -- 172.21.15.135:0/2000635214 wait complete. 2024-04-20T12:24:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.624+0000 7fd7bcf93740 1 -- start start 2024-04-20T12:24:48.626 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7bcf93740 1 Processor -- start 2024-04-20T12:24:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7bcf93740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3030110 0x563ab30ac930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7bcf93740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030a30 0x563ab30ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7bcf93740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3039800 0x563ab3051040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7bcf93740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b41b06e0 con 0x563ab3030110 2024-04-20T12:24:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7bcf93740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b41b0010 con 0x563ab3030a30 2024-04-20T12:24:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7bcf93740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b41ad240 con 0x563ab3039800 2024-04-20T12:24:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7bcf93740 10 client.0 _ll_register_callbacks cb 0x7fd7a4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7b37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3030110 0x563ab30ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.629 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7b37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3030110 0x563ab30ac930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39788/0 (socket says 172.21.15.135:39788) 2024-04-20T12:24:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7b37fe640 1 -- 172.21.15.135:0/386465442 learned_addr learned my addr 172.21.15.135:0/386465442 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/386465442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3039800 0x563ab3051040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7b3fff640 1 --2- 172.21.15.135:0/386465442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030a30 0x563ab30ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7b37fe640 1 -- 172.21.15.135:0/386465442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3039800 msgr2=0x563ab3051040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/386465442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3039800 0x563ab3051040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7b37fe640 1 -- 172.21.15.135:0/386465442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030a30 msgr2=0x563ab30ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/386465442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030a30 0x563ab30ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.625+0000 7fd7b37fe640 1 -- 172.21.15.135:0/386465442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ab3051780 con 0x563ab3030110 2024-04-20T12:24:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7b37fe640 1 --2- 172.21.15.135:0/386465442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3030110 0x563ab30ac930 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8001eb0 tx=0x7fd7a8004880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96013edfff8b3229 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7937fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7937fe640 1 -- 172.21.15.135:0/386465442 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8004b70 con 0x563ab3030110 2024-04-20T12:24:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7937fe640 1 -- 172.21.15.135:0/386465442 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fd7a8004d10 con 0x563ab3030110 2024-04-20T12:24:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7bcf93740 1 -- 172.21.15.135:0/386465442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7a8004660 con 0x563ab3030110 2024-04-20T12:24:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7937fe640 1 -- 172.21.15.135:0/386465442 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd7a8044050 con 0x563ab3030110 2024-04-20T12:24:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7bcf93740 10 client.16239 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7bcf93740 1 -- 172.21.15.135:0/386465442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563ab30b4160 con 0x563ab3030110 2024-04-20T12:24:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7937fe640 1 -- 172.21.15.135:0/386465442 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7a8004660 con 0x563ab3030110 2024-04-20T12:24:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7937fe640 1 -- 172.21.15.135:0/386465442 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fd7a8003bc0 con 0x563ab3030110 2024-04-20T12:24:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7bcf93740 10 client.16239 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7bcf93740 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7bcf93740 20 client.16239 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/386465442 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563ab30b4580 0x563ab30b6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7bcf93740 4 client.16239 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-20T12:24:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7bcf93740 1 -- 172.21.15.135:0/386465442 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563ab2f9d0b0 con 0x563ab30b4580 2024-04-20T12:24:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.626+0000 7fd7b3fff640 1 --2- 172.21.15.135:0/386465442 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563ab30b4580 0x563ab30b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.627+0000 7fd7937fe640 10 client.16239 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.627+0000 7fd7b3fff640 1 --2- 172.21.15.135:0/386465442 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563ab30b4580 0x563ab30b6970 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43402a9246564fc8 server_cookie=c3801a9f90aaa9a1 in_seq=0 out_seq=0 2024-04-20T12:24:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.637+0000 7fd7937fe640 1 -- 172.21.15.135:0/386465442 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563ab2f9d0b0 con 0x563ab30b4580 2024-04-20T12:24:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.637+0000 7fd7937fe640 10 client.16239 handle_command_reply: tid=0 2024-04-20T12:24:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.637+0000 7fd7bcf93740 1 client.16239 shutdown 2024-04-20T12:24:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.637+0000 7fd7bcf93740 1 -- 172.21.15.135:0/386465442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3030110 msgr2=0x563ab30ac930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/386465442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3030110 0x563ab30ac930 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8001eb0 tx=0x7fd7a8004880 comp rx=0 tx=0).stop 2024-04-20T12:24:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7bcf93740 1 -- 172.21.15.135:0/386465442 shutdown_connections 2024-04-20T12:24:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/386465442 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563ab30b4580 0x563ab30b6970 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/386465442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563ab3039800 0x563ab3051040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/386465442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563ab3030a30 0x563ab30ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7937fe640 0 client.16239 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7bcf93740 1 --2- 172.21.15.135:0/386465442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563ab3030110 0x563ab30ac930 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7bcf93740 1 -- 172.21.15.135:0/386465442 >> 172.21.15.135:0/386465442 conn(0x563ab302aa30 msgr2=0x563ab302c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7bcf93740 1 -- 172.21.15.135:0/386465442 shutdown_connections 2024-04-20T12:24:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7bcf93740 1 -- 172.21.15.135:0/386465442 wait complete. 2024-04-20T12:24:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7bcf93740 20 client.16239 trim_cache size 0 max 16384 2024-04-20T12:24:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-04-20T12:24:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-04-20T12:24:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-04-20T12:24:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-04-20T12:24:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7ba3a4640 1 -- 172.21.15.135:0/2886009793 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd79c0a3dc0 msgr2=0x7fd79c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7ba3a4640 1 --2- 172.21.15.135:0/2886009793 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd79c0a3dc0 0x7fd79c0a6280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0bb5c0 tx=0x7fd7ac0df040 comp rx=0 tx=0).stop 2024-04-20T12:24:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7ba3a4640 1 -- 172.21.15.135:0/2886009793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7b410c570 msgr2=0x7fd7b4198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7ba3a4640 1 --2- 172.21.15.135:0/2886009793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7b410c570 0x7fd7b4198620 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac037040 tx=0x7fd7ac035cf0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7ba3a4640 1 -- 172.21.15.135:0/2886009793 shutdown_connections 2024-04-20T12:24:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7ba3a4640 1 --2- 172.21.15.135:0/2886009793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7b410c570 0x7fd7b4198620 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7ba3a4640 1 --2- 172.21.15.135:0/2886009793 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd7b4103b50 0x7fd7b419e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7ba3a4640 1 --2- 172.21.15.135:0/2886009793 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd79c0a3dc0 0x7fd79c0a6280 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7ba3a4640 1 --2- 172.21.15.135:0/2886009793 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd7b4103230 0x7fd7b419e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:48.640 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7ba3a4640 1 -- 172.21.15.135:0/2886009793 >> 172.21.15.135:0/2886009793 conn(0x7fd7b4077fe0 msgr2=0x7fd7b40fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.638+0000 7fd7ba3a4640 1 -- 172.21.15.135:0/2886009793 shutdown_connections 2024-04-20T12:24:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:24:48.639+0000 7fd7ba3a4640 1 -- 172.21.15.135:0/2886009793 wait complete. 2024-04-20T12:24:49.000 INFO:tasks.workunit.client.0.smithi135.stdout:.......... 2024-04-20T12:24:49.000 INFO:tasks.workunit.client.0.smithi135.stdout:do_o_direct_reads: SUCCESS 2024-04-20T12:24:49.000 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:48 smithi154 ceph-mon[22073]: pgmap v53: 129 pgs: 129 active+clean; 18 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 413 op/s 2024-04-20T12:24:49.002 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-20T12:24:49.002 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-20T12:24:49.022 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:48 smithi135 ceph-mon[18264]: pgmap v53: 129 pgs: 129 active+clean; 18 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 413 op/s 2024-04-20T12:24:49.031 INFO:tasks.workunit:Running workunit direct_io/misc.sh... 2024-04-20T12:24:49.031 DEBUG:teuthology.orchestra.run.smithi135:workunit test direct_io/misc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c84f5997950fd7d008204839253291d52e6eda TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/misc.sh 2024-04-20T12:24:49.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:48 smithi139 ceph-mon[21834]: pgmap v53: 129 pgs: 129 active+clean; 18 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 413 op/s 2024-04-20T12:24:49.091 INFO:tasks.workunit.client.0.smithi135.stdout:test read from hole 2024-04-20T12:24:49.092 INFO:tasks.workunit.client.0.smithi135.stderr:+ echo 'test read from hole' 2024-04-20T12:24:49.092 INFO:tasks.workunit.client.0.smithi135.stderr:+ dd if=/dev/zero of=dd3 bs=1 seek=1048576 count=0 2024-04-20T12:24:49.093 INFO:tasks.workunit.client.0.smithi135.stderr:0+0 records in 2024-04-20T12:24:49.093 INFO:tasks.workunit.client.0.smithi135.stderr:0+0 records out 2024-04-20T12:24:49.093 INFO:tasks.workunit.client.0.smithi135.stderr:0 bytes copied, 3.2237e-05 s, 0.0 kB/s 2024-04-20T12:24:49.093 INFO:tasks.workunit.client.0.smithi135.stderr:+ dd if=dd3 of=/tmp/ddout1 skip=8 bs=512 count=2 iflag=direct 2024-04-20T12:24:49.095 INFO:tasks.workunit.client.0.smithi135.stderr:2+0 records in 2024-04-20T12:24:49.095 INFO:tasks.workunit.client.0.smithi135.stderr:2+0 records out 2024-04-20T12:24:49.095 INFO:tasks.workunit.client.0.smithi135.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00133403 s, 768 kB/s 2024-04-20T12:24:49.095 INFO:tasks.workunit.client.0.smithi135.stderr:+ dd if=/dev/zero of=/tmp/dd3 bs=512 count=2 2024-04-20T12:24:49.096 INFO:tasks.workunit.client.0.smithi135.stderr:2+0 records in 2024-04-20T12:24:49.096 INFO:tasks.workunit.client.0.smithi135.stderr:2+0 records out 2024-04-20T12:24:49.096 INFO:tasks.workunit.client.0.smithi135.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 3.5856e-05 s, 28.6 MB/s 2024-04-20T12:24:49.096 INFO:tasks.workunit.client.0.smithi135.stderr:+ cmp /tmp/dd3 /tmp/ddout1 2024-04-20T12:24:49.096 INFO:tasks.workunit.client.0.smithi135.stdout:other thing 2024-04-20T12:24:49.097 INFO:tasks.workunit.client.0.smithi135.stderr:+ echo 'other thing' 2024-04-20T12:24:49.097 INFO:tasks.workunit.client.0.smithi135.stderr:+ dd if=/dev/urandom of=/tmp/dd10 bs=500 count=1 2024-04-20T12:24:49.097 INFO:tasks.workunit.client.0.smithi135.stderr:1+0 records in 2024-04-20T12:24:49.097 INFO:tasks.workunit.client.0.smithi135.stderr:1+0 records out 2024-04-20T12:24:49.097 INFO:tasks.workunit.client.0.smithi135.stderr:500 bytes copied, 4.2571e-05 s, 11.7 MB/s 2024-04-20T12:24:49.097 INFO:tasks.workunit.client.0.smithi135.stderr:+ dd if=/tmp/dd10 of=dd10 bs=512 seek=8388 count=1 2024-04-20T12:24:49.105 INFO:tasks.workunit.client.0.smithi135.stderr:0+1 records in 2024-04-20T12:24:49.105 INFO:tasks.workunit.client.0.smithi135.stderr:0+1 records out 2024-04-20T12:24:49.105 INFO:tasks.workunit.client.0.smithi135.stderr:500 bytes copied, 0.00589564 s, 84.8 kB/s 2024-04-20T12:24:49.105 INFO:tasks.workunit.client.0.smithi135.stderr:+ dd if=dd10 of=/tmp/dd10out bs=512 skip=8388 count=1 iflag=direct 2024-04-20T12:24:49.111 INFO:tasks.workunit.client.0.smithi135.stderr:0+1 records in 2024-04-20T12:24:49.111 INFO:tasks.workunit.client.0.smithi135.stderr:0+1 records out 2024-04-20T12:24:49.111 INFO:tasks.workunit.client.0.smithi135.stderr:500 bytes copied, 0.00545593 s, 91.6 kB/s 2024-04-20T12:24:49.111 INFO:tasks.workunit.client.0.smithi135.stderr:+ cmp /tmp/dd10 /tmp/dd10out 2024-04-20T12:24:49.112 INFO:tasks.workunit.client.0.smithi135.stdout:OK 2024-04-20T12:24:49.113 INFO:tasks.workunit.client.0.smithi135.stderr:+ echo OK 2024-04-20T12:24:49.113 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-20T12:24:49.113 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-20T12:24:49.195 INFO:tasks.workunit:Running workunit direct_io/test_short_dio_read... 2024-04-20T12:24:49.195 DEBUG:teuthology.orchestra.run.smithi135:workunit test direct_io/test_short_dio_read> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c84f5997950fd7d008204839253291d52e6eda TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_short_dio_read 2024-04-20T12:24:49.264 INFO:tasks.workunit.client.0.smithi135.stdout:writing first 3 bytes of 10k file 2024-04-20T12:24:49.265 INFO:tasks.workunit.client.0.smithi135.stdout:reading O_DIRECT 2024-04-20T12:24:49.265 INFO:tasks.workunit.client.0.smithi135.stdout:got 10000 2024-04-20T12:24:49.265 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-20T12:24:49.265 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-20T12:24:49.340 INFO:tasks.workunit:Running workunit direct_io/test_sync_io... 2024-04-20T12:24:49.340 DEBUG:teuthology.orchestra.run.smithi135:workunit test direct_io/test_sync_io> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c84f5997950fd7d008204839253291d52e6eda TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_sync_io 2024-04-20T12:24:50.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:24:50.546 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:24:50.626 INFO:tasks.workunit.client.0.smithi135.stdout:writing pattern 2024-04-20T12:24:50.626 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4190208 len 1024 2024-04-20T12:24:50.627 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-04-20T12:24:50.627 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4190208 len 1024 2024-04-20T12:24:50.627 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190208 len 1024 2024-04-20T12:24:50.627 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4190208 len 2048 2024-04-20T12:24:50.627 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-04-20T12:24:50.627 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4190208 len 2048 2024-04-20T12:24:50.627 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190208 len 2048 2024-04-20T12:24:50.627 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4190208 len 4096 2024-04-20T12:24:50.627 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-04-20T12:24:50.627 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4190208 len 4096 2024-04-20T12:24:50.627 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190208 len 4096 2024-04-20T12:24:50.627 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4190208 len 8192 2024-04-20T12:24:50.627 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-04-20T12:24:50.627 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4190208 len 8192 2024-04-20T12:24:50.627 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190208 len 8192 2024-04-20T12:24:50.628 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4190208 len 16384 2024-04-20T12:24:50.628 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-04-20T12:24:50.628 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4190208 len 16384 2024-04-20T12:24:50.628 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190208 len 16384 2024-04-20T12:24:50.628 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4190720 len 1024 2024-04-20T12:24:50.628 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-04-20T12:24:50.628 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4190720 len 1024 2024-04-20T12:24:50.628 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190720 len 1024 2024-04-20T12:24:50.628 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4190720 len 2048 2024-04-20T12:24:50.628 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-04-20T12:24:50.628 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4190720 len 2048 2024-04-20T12:24:50.628 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190720 len 2048 2024-04-20T12:24:50.629 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4190720 len 4096 2024-04-20T12:24:50.629 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-04-20T12:24:50.629 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4190720 len 4096 2024-04-20T12:24:50.629 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190720 len 4096 2024-04-20T12:24:50.629 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4190720 len 8192 2024-04-20T12:24:50.629 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-04-20T12:24:50.629 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4190720 len 8192 2024-04-20T12:24:50.629 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190720 len 8192 2024-04-20T12:24:50.629 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4190720 len 16384 2024-04-20T12:24:50.629 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-04-20T12:24:50.629 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4190720 len 16384 2024-04-20T12:24:50.629 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4190720 len 16384 2024-04-20T12:24:50.629 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4191232 len 1024 2024-04-20T12:24:50.629 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-04-20T12:24:50.629 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4191232 len 1024 2024-04-20T12:24:50.630 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191232 len 1024 2024-04-20T12:24:50.630 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4191232 len 2048 2024-04-20T12:24:50.630 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-04-20T12:24:50.630 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4191232 len 2048 2024-04-20T12:24:50.630 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191232 len 2048 2024-04-20T12:24:50.630 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4191232 len 4096 2024-04-20T12:24:50.630 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-04-20T12:24:50.630 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4191232 len 4096 2024-04-20T12:24:50.630 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191232 len 4096 2024-04-20T12:24:50.630 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4191232 len 8192 2024-04-20T12:24:50.630 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-04-20T12:24:50.630 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4191232 len 8192 2024-04-20T12:24:50.630 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191232 len 8192 2024-04-20T12:24:50.630 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4191232 len 16384 2024-04-20T12:24:50.630 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-04-20T12:24:50.631 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4191232 len 16384 2024-04-20T12:24:50.631 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191232 len 16384 2024-04-20T12:24:50.631 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4191744 len 1024 2024-04-20T12:24:50.631 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-04-20T12:24:50.631 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4191744 len 1024 2024-04-20T12:24:50.631 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191744 len 1024 2024-04-20T12:24:50.631 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4191744 len 2048 2024-04-20T12:24:50.631 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-04-20T12:24:50.631 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4191744 len 2048 2024-04-20T12:24:50.631 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191744 len 2048 2024-04-20T12:24:50.631 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4191744 len 4096 2024-04-20T12:24:50.631 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-04-20T12:24:50.631 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4191744 len 4096 2024-04-20T12:24:50.631 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191744 len 4096 2024-04-20T12:24:50.631 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4191744 len 8192 2024-04-20T12:24:50.632 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-04-20T12:24:50.632 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4191744 len 8192 2024-04-20T12:24:50.632 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191744 len 8192 2024-04-20T12:24:50.632 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4191744 len 16384 2024-04-20T12:24:50.632 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-04-20T12:24:50.632 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4191744 len 16384 2024-04-20T12:24:50.632 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4191744 len 16384 2024-04-20T12:24:50.632 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4192256 len 1024 2024-04-20T12:24:50.632 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-04-20T12:24:50.632 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4192256 len 1024 2024-04-20T12:24:50.632 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192256 len 1024 2024-04-20T12:24:50.632 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4192256 len 2048 2024-04-20T12:24:50.632 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-04-20T12:24:50.632 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4192256 len 2048 2024-04-20T12:24:50.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.657+0000 7f7bbd9ce640 1 -- 172.21.15.135:0/3138849990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bb8101a50 msgr2=0x7f7bb8105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:50.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.657+0000 7f7bbd9ce640 1 --2- 172.21.15.135:0/3138849990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bb8101a50 0x7f7bb8105a90 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7bac009900 tx=0x7f7bac02bc30 comp rx=0 tx=0).stop 2024-04-20T12:24:50.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.657+0000 7f7bbd9ce640 1 -- 172.21.15.135:0/3138849990 shutdown_connections 2024-04-20T12:24:50.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.657+0000 7f7bbd9ce640 1 --2- 172.21.15.135:0/3138849990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bb8106170 0x7f7bb810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.657+0000 7f7bbd9ce640 1 --2- 172.21.15.135:0/3138849990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bb8101a50 0x7f7bb8105a90 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.657+0000 7f7bbd9ce640 1 --2- 172.21.15.135:0/3138849990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bb81010a0 0x7f7bb8101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.657+0000 7f7bbd9ce640 1 -- 172.21.15.135:0/3138849990 >> 172.21.15.135:0/3138849990 conn(0x7f7bb8077f60 msgr2=0x7f7bb8078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:50.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.657+0000 7f7bbd9ce640 1 -- 172.21.15.135:0/3138849990 shutdown_connections 2024-04-20T12:24:50.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.657+0000 7f7bbd9ce640 1 -- 172.21.15.135:0/3138849990 wait complete. 2024-04-20T12:24:50.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.657+0000 7f7bbd9ce640 1 Processor -- start 2024-04-20T12:24:50.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bbd9ce640 1 -- start start 2024-04-20T12:24:50.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bbd9ce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bb81010a0 0x7f7bb819b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bbd9ce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bb8106170 0x7f7bb819b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bbd9ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bb819f3f0 0x7f7bb819f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bbd9ce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb8110130 con 0x7f7bb819f3f0 2024-04-20T12:24:50.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bbd9ce640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb810ffb0 con 0x7f7bb81010a0 2024-04-20T12:24:50.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bbd9ce640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb81102b0 con 0x7f7bb8106170 2024-04-20T12:24:50.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bb6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bb81010a0 0x7f7bb819b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bb77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bb819f3f0 0x7f7bb819f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bb6ffd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bb81010a0 0x7f7bb819b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:38876/0 (socket says 172.21.15.135:38876) 2024-04-20T12:24:50.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bb6ffd640 1 -- 172.21.15.135:0/3086690596 learned_addr learned my addr 172.21.15.135:0/3086690596 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:50.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bb67fc640 1 --2- 172.21.15.135:0/3086690596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bb8106170 0x7f7bb819b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bb77fe640 1 -- 172.21.15.135:0/3086690596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bb8106170 msgr2=0x7f7bb819b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:50.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bb77fe640 1 --2- 172.21.15.135:0/3086690596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bb8106170 0x7f7bb819b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bb77fe640 1 -- 172.21.15.135:0/3086690596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bb81010a0 msgr2=0x7f7bb819b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:50.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bb77fe640 1 --2- 172.21.15.135:0/3086690596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bb81010a0 0x7f7bb819b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bb77fe640 1 -- 172.21.15.135:0/3086690596 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb819fee0 con 0x7f7bb819f3f0 2024-04-20T12:24:50.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.658+0000 7f7bb6ffd640 1 --2- 172.21.15.135:0/3086690596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bb81010a0 0x7f7bb819b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:50.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.659+0000 7f7bb77fe640 1 --2- 172.21.15.135:0/3086690596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bb819f3f0 0x7f7bb819f8a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009fd0 tx=0x7f7bb000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:50.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.659+0000 7f7bbc9cc640 1 -- 172.21.15.135:0/3086690596 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb000ce20 con 0x7f7bb819f3f0 2024-04-20T12:24:50.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.659+0000 7f7bbc9cc640 1 -- 172.21.15.135:0/3086690596 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bb0005020 con 0x7f7bb819f3f0 2024-04-20T12:24:50.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.659+0000 7f7bbd9ce640 1 -- 172.21.15.135:0/3086690596 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb81a01d0 con 0x7f7bb819f3f0 2024-04-20T12:24:50.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.659+0000 7f7bbc9cc640 1 -- 172.21.15.135:0/3086690596 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0010720 con 0x7f7bb819f3f0 2024-04-20T12:24:50.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.659+0000 7f7bbd9ce640 1 -- 172.21.15.135:0/3086690596 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb81a7940 con 0x7f7bb819f3f0 2024-04-20T12:24:50.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.661+0000 7f7bbc9cc640 1 -- 172.21.15.135:0/3086690596 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f7bb0005540 con 0x7f7bb819f3f0 2024-04-20T12:24:50.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.661+0000 7f7bc05bf740 1 Processor -- start 2024-04-20T12:24:50.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bc05bf740 1 -- start start 2024-04-20T12:24:50.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bbc9cc640 1 --2- 172.21.15.135:0/3086690596 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7ba00a3d20 0x7f7ba00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bc05bf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a81cd20 0x55948a81d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bc05bf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81d640 0x55948a825ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bc05bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a828610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bc05bf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55948a7821b0 con 0x55948a81d640 2024-04-20T12:24:50.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bc05bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55948a71f390 con 0x55948a826220 2024-04-20T12:24:50.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bc05bf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55948a77e170 con 0x55948a81cd20 2024-04-20T12:24:50.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bb67fc640 1 --2- 172.21.15.135:0/3086690596 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7ba00a3d20 0x7f7ba00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bbc9cc640 1 -- 172.21.15.135:0/3086690596 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f7bb00d12a0 con 0x7f7bb819f3f0 2024-04-20T12:24:50.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bb77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a828610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bb77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a828610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:38892/0 (socket says 172.21.15.135:38892) 2024-04-20T12:24:50.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bb77fe640 1 -- 172.21.15.135:0/1778931250 learned_addr learned my addr 172.21.15.135:0/1778931250 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:50.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bb67fc640 1 --2- 172.21.15.135:0/1778931250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81d640 0x55948a825ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bb6ffd640 1 --2- 172.21.15.135:0/1778931250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a81cd20 0x55948a81d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bb77fe640 1 -- 172.21.15.135:0/1778931250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a81cd20 msgr2=0x55948a81d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bb77fe640 1 --2- 172.21.15.135:0/1778931250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a81cd20 0x55948a81d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bb77fe640 1 -- 172.21.15.135:0/1778931250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81d640 msgr2=0x55948a825ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bb77fe640 1 --2- 172.21.15.135:0/1778931250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81d640 0x55948a825ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.662+0000 7f7bb77fe640 1 -- 172.21.15.135:0/1778931250 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55948a55e7d0 con 0x55948a826220 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.663+0000 7f7bb77fe640 1 --2- 172.21.15.135:0/1778931250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a828610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0099890 tx=0x7f7bb007a780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aa3d0be872e3cbb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.663+0000 7f7bb67fc640 1 --2- 172.21.15.135:0/3086690596 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7ba00a3d20 0x7f7ba00a61e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7bac006010 tx=0x7f7bac005e60 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.663+0000 7f7b9dffb640 1 -- 172.21.15.135:0/1778931250 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00175c0 con 0x55948a826220 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.663+0000 7f7b9dffb640 1 -- 172.21.15.135:0/1778931250 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bb009d5c0 con 0x55948a826220 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.663+0000 7f7b9dffb640 1 -- 172.21.15.135:0/1778931250 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0016370 con 0x55948a826220 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.663+0000 7f7bc05bf740 1 -- 172.21.15.135:0/1778931250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 msgr2=0x55948a828610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.663+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/1778931250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a828610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0099890 tx=0x7f7bb007a780 comp rx=0 tx=0).stop 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.663+0000 7f7bc05bf740 1 -- 172.21.15.135:0/1778931250 shutdown_connections 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.663+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/1778931250 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a828610 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/1778931250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81d640 0x55948a825ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/1778931250 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a81cd20 0x55948a81d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bc05bf740 1 -- 172.21.15.135:0/1778931250 >> 172.21.15.135:0/1778931250 conn(0x55948a817450 msgr2=0x55948a817830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bc05bf740 1 -- 172.21.15.135:0/1778931250 shutdown_connections 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bc05bf740 1 -- 172.21.15.135:0/1778931250 wait complete. 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bc05bf740 1 -- start start 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bc05bf740 1 Processor -- start 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bc05bf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81cd20 0x55948a8232c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bc05bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a81d640 0x55948a823800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bc05bf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a826220 0x55948a823d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bc05bf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55948a829010 con 0x55948a81cd20 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bc05bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55948a73b2f0 con 0x55948a81d640 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bc05bf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55948a829190 con 0x55948a826220 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bc05bf740 10 client.0 _ll_register_callbacks cb 0x55948a7054e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bb6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81cd20 0x55948a8232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bb6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81cd20 0x55948a8232c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36058/0 (socket says 172.21.15.135:36058) 2024-04-20T12:24:50.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.664+0000 7f7bb6ffd640 1 -- 172.21.15.135:0/22280682 learned_addr learned my addr 172.21.15.135:0/22280682 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7bb67fc640 1 --2- 172.21.15.135:0/22280682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a81d640 0x55948a823800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7bb77fe640 1 --2- 172.21.15.135:0/22280682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a826220 0x55948a823d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7bb6ffd640 1 -- 172.21.15.135:0/22280682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a826220 msgr2=0x55948a823d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7bb6ffd640 1 --2- 172.21.15.135:0/22280682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a826220 0x55948a823d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7bb6ffd640 1 -- 172.21.15.135:0/22280682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a81d640 msgr2=0x55948a823800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7bb6ffd640 1 --2- 172.21.15.135:0/22280682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a81d640 0x55948a823800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7bb6ffd640 1 -- 172.21.15.135:0/22280682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55948a4943f0 con 0x55948a81cd20 2024-04-20T12:24:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7bb77fe640 1 --2- 172.21.15.135:0/22280682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a826220 0x55948a823d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:24:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7bb67fc640 1 --2- 172.21.15.135:0/22280682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a81d640 0x55948a823800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7bb6ffd640 1 --2- 172.21.15.135:0/22280682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81cd20 0x55948a8232c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8011940 tx=0x7f7ba8011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484fb6feb1b071d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7b96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7b96ffd640 1 -- 172.21.15.135:0/22280682 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8010c60 con 0x55948a81cd20 2024-04-20T12:24:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7b96ffd640 1 -- 172.21.15.135:0/22280682 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f7ba8010e00 con 0x55948a81cd20 2024-04-20T12:24:50.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7bc05bf740 1 -- 172.21.15.135:0/22280682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bb009d5c0 con 0x55948a81cd20 2024-04-20T12:24:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7b96ffd640 1 -- 172.21.15.135:0/22280682 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7ba8025050 con 0x55948a81cd20 2024-04-20T12:24:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7bc05bf740 10 client.16251 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.665+0000 7f7bc05bf740 1 -- 172.21.15.135:0/22280682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55948a4540f0 con 0x55948a81cd20 2024-04-20T12:24:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.666+0000 7f7b96ffd640 1 -- 172.21.15.135:0/22280682 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bb009d5c0 con 0x55948a81cd20 2024-04-20T12:24:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.666+0000 7f7b96ffd640 1 -- 172.21.15.135:0/22280682 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f7ba800f650 con 0x55948a81cd20 2024-04-20T12:24:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.666+0000 7f7bc05bf740 10 client.16251 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.666+0000 7f7bc05bf740 10 client.16251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.666+0000 7f7bc05bf740 20 client.16251 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.666+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/22280682 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55948a836650 0x55948a838ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.666+0000 7f7bc05bf740 4 client.16251 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.666+0000 7f7bc05bf740 1 -- 172.21.15.135:0/22280682 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55948a78fbd0 con 0x55948a836650 2024-04-20T12:24:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.666+0000 7f7bb67fc640 1 --2- 172.21.15.135:0/22280682 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55948a836650 0x55948a838ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.667+0000 7f7b96ffd640 10 client.16251 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:50.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.667+0000 7f7bb67fc640 1 --2- 172.21.15.135:0/22280682 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55948a836650 0x55948a838ae0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88fb980257854ea1 server_cookie=dbd9c827fe654f8 in_seq=0 out_seq=0 2024-04-20T12:24:50.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.667+0000 7f7b96ffd640 1 -- 172.21.15.135:0/22280682 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55948a78fbd0 con 0x55948a836650 2024-04-20T12:24:50.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.667+0000 7f7b96ffd640 10 client.16251 handle_command_reply: tid=0 2024-04-20T12:24:50.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.667+0000 7f7bc05bf740 1 client.16251 shutdown 2024-04-20T12:24:50.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.667+0000 7f7bc05bf740 1 -- 172.21.15.135:0/22280682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81cd20 msgr2=0x55948a8232c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:50.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.667+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/22280682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81cd20 0x55948a8232c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8011940 tx=0x7f7ba8011e00 comp rx=0 tx=0).stop 2024-04-20T12:24:50.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.667+0000 7f7bc05bf740 1 -- 172.21.15.135:0/22280682 shutdown_connections 2024-04-20T12:24:50.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.667+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/22280682 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55948a836650 0x55948a838ae0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.667+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/22280682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a826220 0x55948a823d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.667+0000 7f7b96ffd640 0 client.16251 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:50.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.667+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/22280682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a81d640 0x55948a823800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.668+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/22280682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81cd20 0x55948a8232c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.668+0000 7f7bc05bf740 1 -- 172.21.15.135:0/22280682 >> 172.21.15.135:0/22280682 conn(0x55948a817450 msgr2=0x55948a8191a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:50.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.668+0000 7f7bc05bf740 1 -- 172.21.15.135:0/22280682 shutdown_connections 2024-04-20T12:24:50.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.668+0000 7f7bc05bf740 1 -- 172.21.15.135:0/22280682 wait complete. 2024-04-20T12:24:50.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.668+0000 7f7bc05bf740 20 client.16251 trim_cache size 0 max 16384 2024-04-20T12:24:50.674 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192256 len 2048 2024-04-20T12:24:50.674 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4192256 len 4096 2024-04-20T12:24:50.674 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-04-20T12:24:50.675 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4192256 len 4096 2024-04-20T12:24:50.675 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192256 len 4096 2024-04-20T12:24:50.675 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4192256 len 8192 2024-04-20T12:24:50.675 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-04-20T12:24:50.675 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4192256 len 8192 2024-04-20T12:24:50.675 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192256 len 8192 2024-04-20T12:24:50.675 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4192256 len 16384 2024-04-20T12:24:50.675 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-04-20T12:24:50.675 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4192256 len 16384 2024-04-20T12:24:50.675 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192256 len 16384 2024-04-20T12:24:50.675 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4192768 len 1024 2024-04-20T12:24:50.675 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-04-20T12:24:50.675 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4192768 len 1024 2024-04-20T12:24:50.675 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192768 len 1024 2024-04-20T12:24:50.675 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4192768 len 2048 2024-04-20T12:24:50.676 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-04-20T12:24:50.676 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4192768 len 2048 2024-04-20T12:24:50.676 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192768 len 2048 2024-04-20T12:24:50.676 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4192768 len 4096 2024-04-20T12:24:50.676 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-04-20T12:24:50.676 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4192768 len 4096 2024-04-20T12:24:50.676 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192768 len 4096 2024-04-20T12:24:50.676 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4192768 len 8192 2024-04-20T12:24:50.676 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-04-20T12:24:50.676 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4192768 len 8192 2024-04-20T12:24:50.676 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192768 len 8192 2024-04-20T12:24:50.676 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4192768 len 16384 2024-04-20T12:24:50.676 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-04-20T12:24:50.676 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4192768 len 16384 2024-04-20T12:24:50.676 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4192768 len 16384 2024-04-20T12:24:50.677 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4193280 len 1024 2024-04-20T12:24:50.677 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-04-20T12:24:50.677 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4193280 len 1024 2024-04-20T12:24:50.677 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193280 len 1024 2024-04-20T12:24:50.677 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4193280 len 2048 2024-04-20T12:24:50.677 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-04-20T12:24:50.677 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4193280 len 2048 2024-04-20T12:24:50.677 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193280 len 2048 2024-04-20T12:24:50.677 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4193280 len 4096 2024-04-20T12:24:50.677 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-04-20T12:24:50.677 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4193280 len 4096 2024-04-20T12:24:50.677 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193280 len 4096 2024-04-20T12:24:50.677 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4193280 len 8192 2024-04-20T12:24:50.677 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-04-20T12:24:50.677 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4193280 len 8192 2024-04-20T12:24:50.678 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193280 len 8192 2024-04-20T12:24:50.678 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4193280 len 16384 2024-04-20T12:24:50.678 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-04-20T12:24:50.678 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4193280 len 16384 2024-04-20T12:24:50.678 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193280 len 16384 2024-04-20T12:24:50.678 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4193792 len 1024 2024-04-20T12:24:50.678 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-04-20T12:24:50.678 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4193792 len 1024 2024-04-20T12:24:50.678 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193792 len 1024 2024-04-20T12:24:50.678 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4193792 len 2048 2024-04-20T12:24:50.678 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-04-20T12:24:50.678 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4193792 len 2048 2024-04-20T12:24:50.678 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193792 len 2048 2024-04-20T12:24:50.678 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4193792 len 4096 2024-04-20T12:24:50.678 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4193792 len 4096 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193792 len 4096 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4193792 len 8192 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4193792 len 8192 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193792 len 8192 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4193792 len 16384 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4193792 len 16384 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4193792 len 16384 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4194304 len 1024 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4194304 len 1024 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194304 len 1024 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4194304 len 2048 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-04-20T12:24:50.679 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4194304 len 2048 2024-04-20T12:24:50.680 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194304 len 2048 2024-04-20T12:24:50.680 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4194304 len 4096 2024-04-20T12:24:50.680 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-04-20T12:24:50.680 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4194304 len 4096 2024-04-20T12:24:50.680 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194304 len 4096 2024-04-20T12:24:50.680 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4194304 len 8192 2024-04-20T12:24:50.680 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-04-20T12:24:50.680 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4194304 len 8192 2024-04-20T12:24:50.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.688+0000 7f7bc05bf740 1 Processor -- start 2024-04-20T12:24:50.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.688+0000 7f7bc05bf740 1 -- start start 2024-04-20T12:24:50.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.688+0000 7f7bc05bf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81cd20 0x55948a831ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.688+0000 7f7bc05bf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a81d640 0x55948a823b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.688+0000 7f7bc05bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a8164b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.688+0000 7f7bc05bf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb81b15e0 con 0x55948a81cd20 2024-04-20T12:24:50.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.688+0000 7f7bc05bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb81b3120 con 0x55948a826220 2024-04-20T12:24:50.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.688+0000 7f7bc05bf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb81b1cb0 con 0x55948a81d640 2024-04-20T12:24:50.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.688+0000 7f7bb6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81cd20 0x55948a831ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.688+0000 7f7bb77fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a8164b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.688+0000 7f7bb6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81cd20 0x55948a831ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36072/0 (socket says 172.21.15.135:36072) 2024-04-20T12:24:50.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.688+0000 7f7bb6ffd640 1 -- 172.21.15.135:0/2014463623 learned_addr learned my addr 172.21.15.135:0/2014463623 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:50.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.689+0000 7f7bb67fc640 1 --2- 172.21.15.135:0/2014463623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a81d640 0x55948a823b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.689+0000 7f7bb77fe640 1 -- 172.21.15.135:0/2014463623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a81d640 msgr2=0x55948a823b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.689+0000 7f7bb77fe640 1 --2- 172.21.15.135:0/2014463623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a81d640 0x55948a823b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.689+0000 7f7bb77fe640 1 -- 172.21.15.135:0/2014463623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81cd20 msgr2=0x55948a831ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.689+0000 7f7bb77fe640 1 --2- 172.21.15.135:0/2014463623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81cd20 0x55948a831ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.689+0000 7f7bb77fe640 1 -- 172.21.15.135:0/2014463623 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55948a81d470 con 0x55948a826220 2024-04-20T12:24:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.689+0000 7f7bb6ffd640 1 --2- 172.21.15.135:0/2014463623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81cd20 0x55948a831ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.689+0000 7f7bb77fe640 1 --2- 172.21.15.135:0/2014463623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a8164b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55948a828c60 tx=0x7f7bb00054b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce286932c586a40d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.689+0000 7f7b9d7fa640 1 -- 172.21.15.135:0/2014463623 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00173d0 con 0x55948a826220 2024-04-20T12:24:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.689+0000 7f7b9d7fa640 1 -- 172.21.15.135:0/2014463623 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bb00a1270 con 0x55948a826220 2024-04-20T12:24:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.689+0000 7f7b9d7fa640 1 -- 172.21.15.135:0/2014463623 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00175c0 con 0x55948a826220 2024-04-20T12:24:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.690+0000 7f7bc05bf740 1 -- 172.21.15.135:0/2014463623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 msgr2=0x55948a8164b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.690+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/2014463623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a8164b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55948a828c60 tx=0x7f7bb00054b0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.690+0000 7f7bc05bf740 1 -- 172.21.15.135:0/2014463623 shutdown_connections 2024-04-20T12:24:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.690+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/2014463623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a8164b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.690+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/2014463623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a81d640 0x55948a823b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.690+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/2014463623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81cd20 0x55948a831ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.690+0000 7f7bc05bf740 1 -- 172.21.15.135:0/2014463623 >> 172.21.15.135:0/2014463623 conn(0x55948a817450 msgr2=0x55948a815da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:50.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.690+0000 7f7bc05bf740 1 -- 172.21.15.135:0/2014463623 shutdown_connections 2024-04-20T12:24:50.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.690+0000 7f7bc05bf740 1 -- 172.21.15.135:0/2014463623 wait complete. 2024-04-20T12:24:50.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.690+0000 7f7bc05bf740 1 -- start start 2024-04-20T12:24:50.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bc05bf740 1 Processor -- start 2024-04-20T12:24:50.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bc05bf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a81cd20 0x55948a82e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bc05bf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81d640 0x55948a82bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bc05bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a82c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bc05bf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb81b2a50 con 0x55948a81d640 2024-04-20T12:24:50.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bc05bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb81b2380 con 0x55948a826220 2024-04-20T12:24:50.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bc05bf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb81af5b0 con 0x55948a81cd20 2024-04-20T12:24:50.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bc05bf740 10 client.0 _ll_register_callbacks cb 0x7f7ba800bd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:50.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bb67fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81d640 0x55948a82bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bb67fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81d640 0x55948a82bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36086/0 (socket says 172.21.15.135:36086) 2024-04-20T12:24:50.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bb67fc640 1 -- 172.21.15.135:0/2949476481 learned_addr learned my addr 172.21.15.135:0/2949476481 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:50.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bb77fe640 1 --2- 172.21.15.135:0/2949476481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a82c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bb6ffd640 1 --2- 172.21.15.135:0/2949476481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a81cd20 0x55948a82e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bb67fc640 1 -- 172.21.15.135:0/2949476481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a81cd20 msgr2=0x55948a82e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:50.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bb67fc640 1 --2- 172.21.15.135:0/2949476481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a81cd20 0x55948a82e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bb67fc640 1 -- 172.21.15.135:0/2949476481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 msgr2=0x55948a82c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:50.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bb67fc640 1 --2- 172.21.15.135:0/2949476481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a82c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bb67fc640 1 -- 172.21.15.135:0/2949476481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55948a82ca10 con 0x55948a81d640 2024-04-20T12:24:50.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.691+0000 7f7bb77fe640 1 --2- 172.21.15.135:0/2949476481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a82c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:50.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7bb67fc640 1 --2- 172.21.15.135:0/2949476481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81d640 0x55948a82bc00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7bac02cfd0 tx=0x7f7bac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541c3defc3dd1440 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:50.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7b96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:50.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7b96ffd640 1 -- 172.21.15.135:0/2949476481 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bac055070 con 0x55948a81d640 2024-04-20T12:24:50.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7b96ffd640 1 -- 172.21.15.135:0/2949476481 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f7bac0048c0 con 0x55948a81d640 2024-04-20T12:24:50.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7bc05bf740 1 -- 172.21.15.135:0/2949476481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bb00a1270 con 0x55948a81d640 2024-04-20T12:24:50.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7b96ffd640 1 -- 172.21.15.135:0/2949476481 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7bac060050 con 0x55948a81d640 2024-04-20T12:24:50.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7bc05bf740 10 client.16257 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:50.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7bc05bf740 1 -- 172.21.15.135:0/2949476481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55948a89cd10 con 0x55948a81d640 2024-04-20T12:24:50.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7b96ffd640 1 -- 172.21.15.135:0/2949476481 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bb00a1270 con 0x55948a81d640 2024-04-20T12:24:50.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7b96ffd640 1 -- 172.21.15.135:0/2949476481 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f7bac04d040 con 0x55948a81d640 2024-04-20T12:24:50.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7bc05bf740 10 client.16257 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:50.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7bc05bf740 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:50.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7bc05bf740 20 client.16257 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:50.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/2949476481 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55948a89d440 0x55948a89f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7bc05bf740 4 client.16257 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:24:50.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.692+0000 7f7bc05bf740 1 -- 172.21.15.135:0/2949476481 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55948a789a40 con 0x55948a89d440 2024-04-20T12:24:50.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.693+0000 7f7bb6ffd640 1 --2- 172.21.15.135:0/2949476481 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55948a89d440 0x55948a89f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.693+0000 7f7b96ffd640 10 client.16257 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:50.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.693+0000 7f7bb6ffd640 1 --2- 172.21.15.135:0/2949476481 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55948a89d440 0x55948a89f860 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f5b4c108854c9b server_cookie=d6e89c0a2719e778 in_seq=0 out_seq=0 2024-04-20T12:24:50.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.693+0000 7f7b96ffd640 1 -- 172.21.15.135:0/2949476481 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55948a789a40 con 0x55948a89d440 2024-04-20T12:24:50.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.693+0000 7f7b96ffd640 10 client.16257 handle_command_reply: tid=0 2024-04-20T12:24:50.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.693+0000 7f7bc05bf740 1 client.16257 shutdown 2024-04-20T12:24:50.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.693+0000 7f7bc05bf740 1 -- 172.21.15.135:0/2949476481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81d640 msgr2=0x55948a82bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:50.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.693+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/2949476481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81d640 0x55948a82bc00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7bac02cfd0 tx=0x7f7bac000bc0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7bc05bf740 1 -- 172.21.15.135:0/2949476481 shutdown_connections 2024-04-20T12:24:50.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/2949476481 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55948a89d440 0x55948a89f860 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/2949476481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55948a826220 0x55948a82c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/2949476481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55948a81d640 0x55948a82bc00 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7bc05bf740 1 --2- 172.21.15.135:0/2949476481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55948a81cd20 0x55948a82e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7b96ffd640 0 client.16257 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:50.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7bc05bf740 1 -- 172.21.15.135:0/2949476481 >> 172.21.15.135:0/2949476481 conn(0x55948a817450 msgr2=0x55948a816630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:50.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7bc05bf740 1 -- 172.21.15.135:0/2949476481 shutdown_connections 2024-04-20T12:24:50.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7bc05bf740 1 -- 172.21.15.135:0/2949476481 wait complete. 2024-04-20T12:24:50.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7bc05bf740 20 client.16257 trim_cache size 0 max 16384 2024-04-20T12:24:50.702 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:24:50.702 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:24:50.702 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:24:50.702 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:24:50.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7bbd9ce640 1 -- 172.21.15.135:0/3086690596 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7ba00a3d20 msgr2=0x7f7ba00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:50.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7bbd9ce640 1 --2- 172.21.15.135:0/3086690596 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7ba00a3d20 0x7f7ba00a61e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7bac006010 tx=0x7f7bac005e60 comp rx=0 tx=0).stop 2024-04-20T12:24:50.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7bbd9ce640 1 -- 172.21.15.135:0/3086690596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bb819f3f0 msgr2=0x7f7bb819f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:50.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7bbd9ce640 1 --2- 172.21.15.135:0/3086690596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bb819f3f0 0x7f7bb819f8a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009fd0 tx=0x7f7bb000ef10 comp rx=0 tx=0).stop 2024-04-20T12:24:50.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7bbd9ce640 1 -- 172.21.15.135:0/3086690596 shutdown_connections 2024-04-20T12:24:50.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.694+0000 7f7bbd9ce640 1 --2- 172.21.15.135:0/3086690596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bb819f3f0 0x7f7bb819f8a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.695+0000 7f7bbd9ce640 1 --2- 172.21.15.135:0/3086690596 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7ba00a3d20 0x7f7ba00a61e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.695+0000 7f7bbd9ce640 1 --2- 172.21.15.135:0/3086690596 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7bb8106170 0x7f7bb819b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.695+0000 7f7bbd9ce640 1 --2- 172.21.15.135:0/3086690596 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7bb81010a0 0x7f7bb819b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.695+0000 7f7bbd9ce640 1 -- 172.21.15.135:0/3086690596 >> 172.21.15.135:0/3086690596 conn(0x7f7bb8077f60 msgr2=0x7f7bb80fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:50.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.695+0000 7f7bbd9ce640 1 -- 172.21.15.135:0/3086690596 shutdown_connections 2024-04-20T12:24:50.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.695+0000 7f7bbd9ce640 1 -- 172.21.15.135:0/3086690596 wait complete. 2024-04-20T12:24:50.704 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194304 len 8192 2024-04-20T12:24:50.704 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4194304 len 16384 2024-04-20T12:24:50.704 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-04-20T12:24:50.704 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4194304 len 16384 2024-04-20T12:24:50.704 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194304 len 16384 2024-04-20T12:24:50.704 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4194816 len 1024 2024-04-20T12:24:50.704 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-04-20T12:24:50.704 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4194816 len 1024 2024-04-20T12:24:50.704 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194816 len 1024 2024-04-20T12:24:50.705 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4194816 len 2048 2024-04-20T12:24:50.705 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-04-20T12:24:50.705 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4194816 len 2048 2024-04-20T12:24:50.705 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194816 len 2048 2024-04-20T12:24:50.705 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4194816 len 4096 2024-04-20T12:24:50.705 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-04-20T12:24:50.705 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4194816 len 4096 2024-04-20T12:24:50.705 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194816 len 4096 2024-04-20T12:24:50.705 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4194816 len 8192 2024-04-20T12:24:50.705 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-04-20T12:24:50.705 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4194816 len 8192 2024-04-20T12:24:50.705 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194816 len 8192 2024-04-20T12:24:50.705 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4194816 len 16384 2024-04-20T12:24:50.705 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-04-20T12:24:50.705 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4194816 len 16384 2024-04-20T12:24:50.706 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4194816 len 16384 2024-04-20T12:24:50.706 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4195328 len 1024 2024-04-20T12:24:50.706 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-04-20T12:24:50.706 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4195328 len 1024 2024-04-20T12:24:50.706 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195328 len 1024 2024-04-20T12:24:50.706 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4195328 len 2048 2024-04-20T12:24:50.706 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-04-20T12:24:50.706 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4195328 len 2048 2024-04-20T12:24:50.706 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195328 len 2048 2024-04-20T12:24:50.706 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4195328 len 4096 2024-04-20T12:24:50.706 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-04-20T12:24:50.706 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4195328 len 4096 2024-04-20T12:24:50.706 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195328 len 4096 2024-04-20T12:24:50.706 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4195328 len 8192 2024-04-20T12:24:50.706 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-04-20T12:24:50.707 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4195328 len 8192 2024-04-20T12:24:50.707 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195328 len 8192 2024-04-20T12:24:50.707 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4195328 len 16384 2024-04-20T12:24:50.707 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-04-20T12:24:50.707 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4195328 len 16384 2024-04-20T12:24:50.707 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195328 len 16384 2024-04-20T12:24:50.707 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4195840 len 1024 2024-04-20T12:24:50.707 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-04-20T12:24:50.707 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4195840 len 1024 2024-04-20T12:24:50.707 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195840 len 1024 2024-04-20T12:24:50.707 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4195840 len 2048 2024-04-20T12:24:50.707 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-04-20T12:24:50.707 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4195840 len 2048 2024-04-20T12:24:50.707 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195840 len 2048 2024-04-20T12:24:50.707 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4195840 len 4096 2024-04-20T12:24:50.708 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-04-20T12:24:50.708 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4195840 len 4096 2024-04-20T12:24:50.708 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195840 len 4096 2024-04-20T12:24:50.708 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4195840 len 8192 2024-04-20T12:24:50.708 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-04-20T12:24:50.708 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4195840 len 8192 2024-04-20T12:24:50.708 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195840 len 8192 2024-04-20T12:24:50.708 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4195840 len 16384 2024-04-20T12:24:50.708 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-04-20T12:24:50.708 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4195840 len 16384 2024-04-20T12:24:50.708 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4195840 len 16384 2024-04-20T12:24:50.708 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4196352 len 1024 2024-04-20T12:24:50.709 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-04-20T12:24:50.709 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4196352 len 1024 2024-04-20T12:24:50.709 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196352 len 1024 2024-04-20T12:24:50.709 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4196352 len 2048 2024-04-20T12:24:50.709 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-04-20T12:24:50.709 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4196352 len 2048 2024-04-20T12:24:50.709 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196352 len 2048 2024-04-20T12:24:50.709 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4196352 len 4096 2024-04-20T12:24:50.709 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-04-20T12:24:50.709 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4196352 len 4096 2024-04-20T12:24:50.709 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196352 len 4096 2024-04-20T12:24:50.709 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4196352 len 8192 2024-04-20T12:24:50.709 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-04-20T12:24:50.709 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4196352 len 8192 2024-04-20T12:24:50.710 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196352 len 8192 2024-04-20T12:24:50.710 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4196352 len 16384 2024-04-20T12:24:50.710 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-04-20T12:24:50.710 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4196352 len 16384 2024-04-20T12:24:50.710 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196352 len 16384 2024-04-20T12:24:50.710 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4196864 len 1024 2024-04-20T12:24:50.710 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-04-20T12:24:50.712 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:24:50.712 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:24:50.729 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4196864 len 1024 2024-04-20T12:24:50.729 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196864 len 1024 2024-04-20T12:24:50.729 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4196864 len 2048 2024-04-20T12:24:50.729 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-04-20T12:24:50.729 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4196864 len 2048 2024-04-20T12:24:50.730 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196864 len 2048 2024-04-20T12:24:50.730 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4196864 len 4096 2024-04-20T12:24:50.730 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-04-20T12:24:50.730 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4196864 len 4096 2024-04-20T12:24:50.730 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196864 len 4096 2024-04-20T12:24:50.730 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4196864 len 8192 2024-04-20T12:24:50.730 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-04-20T12:24:50.730 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4196864 len 8192 2024-04-20T12:24:50.730 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196864 len 8192 2024-04-20T12:24:50.730 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4196864 len 16384 2024-04-20T12:24:50.730 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-04-20T12:24:50.730 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4196864 len 16384 2024-04-20T12:24:50.730 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4196864 len 16384 2024-04-20T12:24:50.731 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4197376 len 1024 2024-04-20T12:24:50.731 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-04-20T12:24:50.731 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4197376 len 1024 2024-04-20T12:24:50.731 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197376 len 1024 2024-04-20T12:24:50.731 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4197376 len 2048 2024-04-20T12:24:50.731 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-04-20T12:24:50.731 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4197376 len 2048 2024-04-20T12:24:50.731 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197376 len 2048 2024-04-20T12:24:50.731 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4197376 len 4096 2024-04-20T12:24:50.731 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-04-20T12:24:50.732 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4197376 len 4096 2024-04-20T12:24:50.732 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197376 len 4096 2024-04-20T12:24:50.732 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4197376 len 8192 2024-04-20T12:24:50.732 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-04-20T12:24:50.732 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4197376 len 8192 2024-04-20T12:24:50.732 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197376 len 8192 2024-04-20T12:24:50.732 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4197376 len 16384 2024-04-20T12:24:50.732 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-04-20T12:24:50.732 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4197376 len 16384 2024-04-20T12:24:50.732 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197376 len 16384 2024-04-20T12:24:50.732 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4197888 len 1024 2024-04-20T12:24:50.732 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-04-20T12:24:50.732 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4197888 len 1024 2024-04-20T12:24:50.732 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197888 len 1024 2024-04-20T12:24:50.732 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4197888 len 2048 2024-04-20T12:24:50.733 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-04-20T12:24:50.733 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4197888 len 2048 2024-04-20T12:24:50.733 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197888 len 2048 2024-04-20T12:24:50.733 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4197888 len 4096 2024-04-20T12:24:50.733 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-04-20T12:24:50.733 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4197888 len 4096 2024-04-20T12:24:50.733 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197888 len 4096 2024-04-20T12:24:50.733 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4197888 len 8192 2024-04-20T12:24:50.733 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-04-20T12:24:50.733 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4197888 len 8192 2024-04-20T12:24:50.733 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197888 len 8192 2024-04-20T12:24:50.733 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 0 offset 4197888 len 16384 2024-04-20T12:24:50.733 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-04-20T12:24:50.733 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 0 offset 4197888 len 16384 2024-04-20T12:24:50.733 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 0 offset 4197888 len 16384 2024-04-20T12:24:50.734 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4190208 len 1024 2024-04-20T12:24:50.734 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-04-20T12:24:50.734 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4190208 len 1024 2024-04-20T12:24:50.734 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190208 len 1024 2024-04-20T12:24:50.734 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4190208 len 2048 2024-04-20T12:24:50.734 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-04-20T12:24:50.734 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4190208 len 2048 2024-04-20T12:24:50.734 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190208 len 2048 2024-04-20T12:24:50.734 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4190208 len 4096 2024-04-20T12:24:50.734 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-04-20T12:24:50.734 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4190208 len 4096 2024-04-20T12:24:50.734 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190208 len 4096 2024-04-20T12:24:50.734 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4190208 len 8192 2024-04-20T12:24:50.734 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-04-20T12:24:50.735 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4190208 len 8192 2024-04-20T12:24:50.735 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190208 len 8192 2024-04-20T12:24:50.735 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4190208 len 16384 2024-04-20T12:24:50.735 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-04-20T12:24:50.735 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4190208 len 16384 2024-04-20T12:24:50.735 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190208 len 16384 2024-04-20T12:24:50.735 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4190720 len 1024 2024-04-20T12:24:50.735 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-04-20T12:24:50.735 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4190720 len 1024 2024-04-20T12:24:50.735 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190720 len 1024 2024-04-20T12:24:50.735 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4190720 len 2048 2024-04-20T12:24:50.735 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-04-20T12:24:50.735 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4190720 len 2048 2024-04-20T12:24:50.735 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190720 len 2048 2024-04-20T12:24:50.735 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4190720 len 4096 2024-04-20T12:24:50.769 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-04-20T12:24:50.769 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4190720 len 4096 2024-04-20T12:24:50.769 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190720 len 4096 2024-04-20T12:24:50.769 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4190720 len 8192 2024-04-20T12:24:50.769 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-04-20T12:24:50.769 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4190720 len 8192 2024-04-20T12:24:50.769 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190720 len 8192 2024-04-20T12:24:50.769 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4190720 len 16384 2024-04-20T12:24:50.769 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-04-20T12:24:50.769 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4190720 len 16384 2024-04-20T12:24:50.769 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4190720 len 16384 2024-04-20T12:24:50.769 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4191232 len 1024 2024-04-20T12:24:50.769 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-04-20T12:24:50.770 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4191232 len 1024 2024-04-20T12:24:50.770 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191232 len 1024 2024-04-20T12:24:50.770 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4191232 len 2048 2024-04-20T12:24:50.770 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-04-20T12:24:50.770 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4191232 len 2048 2024-04-20T12:24:50.770 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191232 len 2048 2024-04-20T12:24:50.770 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4191232 len 4096 2024-04-20T12:24:50.770 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-04-20T12:24:50.770 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4191232 len 4096 2024-04-20T12:24:50.770 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191232 len 4096 2024-04-20T12:24:50.770 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4191232 len 8192 2024-04-20T12:24:50.770 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-04-20T12:24:50.771 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4191232 len 8192 2024-04-20T12:24:50.771 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191232 len 8192 2024-04-20T12:24:50.771 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4191232 len 16384 2024-04-20T12:24:50.771 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-04-20T12:24:50.771 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4191232 len 16384 2024-04-20T12:24:50.771 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191232 len 16384 2024-04-20T12:24:50.771 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4191744 len 1024 2024-04-20T12:24:50.771 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-04-20T12:24:50.771 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4191744 len 1024 2024-04-20T12:24:50.771 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191744 len 1024 2024-04-20T12:24:50.771 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4191744 len 2048 2024-04-20T12:24:50.771 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-04-20T12:24:50.772 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4191744 len 2048 2024-04-20T12:24:50.772 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191744 len 2048 2024-04-20T12:24:50.772 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4191744 len 4096 2024-04-20T12:24:50.772 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-04-20T12:24:50.772 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4191744 len 4096 2024-04-20T12:24:50.772 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191744 len 4096 2024-04-20T12:24:50.772 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4191744 len 8192 2024-04-20T12:24:50.772 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-04-20T12:24:50.772 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4191744 len 8192 2024-04-20T12:24:50.772 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191744 len 8192 2024-04-20T12:24:50.772 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4191744 len 16384 2024-04-20T12:24:50.772 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-04-20T12:24:50.772 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4191744 len 16384 2024-04-20T12:24:50.772 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4191744 len 16384 2024-04-20T12:24:50.772 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4192256 len 1024 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4192256 len 1024 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192256 len 1024 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4192256 len 2048 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4192256 len 2048 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192256 len 2048 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4192256 len 4096 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4192256 len 4096 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192256 len 4096 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4192256 len 8192 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4192256 len 8192 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192256 len 8192 2024-04-20T12:24:50.773 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4192256 len 16384 2024-04-20T12:24:50.774 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-04-20T12:24:50.774 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4192256 len 16384 2024-04-20T12:24:50.774 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192256 len 16384 2024-04-20T12:24:50.774 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4192768 len 1024 2024-04-20T12:24:50.774 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-04-20T12:24:50.774 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4192768 len 1024 2024-04-20T12:24:50.774 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192768 len 1024 2024-04-20T12:24:50.774 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4192768 len 2048 2024-04-20T12:24:50.774 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-04-20T12:24:50.774 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4192768 len 2048 2024-04-20T12:24:50.775 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192768 len 2048 2024-04-20T12:24:50.775 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4192768 len 4096 2024-04-20T12:24:50.775 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-04-20T12:24:50.775 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4192768 len 4096 2024-04-20T12:24:50.775 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192768 len 4096 2024-04-20T12:24:50.775 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4192768 len 8192 2024-04-20T12:24:50.803 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-04-20T12:24:50.803 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4192768 len 8192 2024-04-20T12:24:50.803 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192768 len 8192 2024-04-20T12:24:50.803 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4192768 len 16384 2024-04-20T12:24:50.803 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-04-20T12:24:50.804 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4192768 len 16384 2024-04-20T12:24:50.804 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4192768 len 16384 2024-04-20T12:24:50.804 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4193280 len 1024 2024-04-20T12:24:50.804 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-04-20T12:24:50.804 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4193280 len 1024 2024-04-20T12:24:50.804 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193280 len 1024 2024-04-20T12:24:50.804 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4193280 len 2048 2024-04-20T12:24:50.804 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-04-20T12:24:50.804 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4193280 len 2048 2024-04-20T12:24:50.804 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193280 len 2048 2024-04-20T12:24:50.804 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4193280 len 4096 2024-04-20T12:24:50.804 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-04-20T12:24:50.804 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4193280 len 4096 2024-04-20T12:24:50.804 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193280 len 4096 2024-04-20T12:24:50.804 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4193280 len 8192 2024-04-20T12:24:50.805 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-04-20T12:24:50.805 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4193280 len 8192 2024-04-20T12:24:50.805 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193280 len 8192 2024-04-20T12:24:50.805 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4193280 len 16384 2024-04-20T12:24:50.805 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-04-20T12:24:50.805 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4193280 len 16384 2024-04-20T12:24:50.805 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193280 len 16384 2024-04-20T12:24:50.805 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4193792 len 1024 2024-04-20T12:24:50.805 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-04-20T12:24:50.805 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4193792 len 1024 2024-04-20T12:24:50.805 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193792 len 1024 2024-04-20T12:24:50.805 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4193792 len 2048 2024-04-20T12:24:50.805 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-04-20T12:24:50.805 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4193792 len 2048 2024-04-20T12:24:50.805 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193792 len 2048 2024-04-20T12:24:50.806 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4193792 len 4096 2024-04-20T12:24:50.806 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-04-20T12:24:50.806 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4193792 len 4096 2024-04-20T12:24:50.806 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193792 len 4096 2024-04-20T12:24:50.806 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4193792 len 8192 2024-04-20T12:24:50.806 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-04-20T12:24:50.806 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4193792 len 8192 2024-04-20T12:24:50.806 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193792 len 8192 2024-04-20T12:24:50.806 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4193792 len 16384 2024-04-20T12:24:50.806 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-04-20T12:24:50.806 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4193792 len 16384 2024-04-20T12:24:50.806 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4193792 len 16384 2024-04-20T12:24:50.806 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4194304 len 1024 2024-04-20T12:24:50.806 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-04-20T12:24:50.806 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4194304 len 1024 2024-04-20T12:24:50.807 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194304 len 1024 2024-04-20T12:24:50.807 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4194304 len 2048 2024-04-20T12:24:50.807 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-04-20T12:24:50.807 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4194304 len 2048 2024-04-20T12:24:50.807 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194304 len 2048 2024-04-20T12:24:50.807 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4194304 len 4096 2024-04-20T12:24:50.807 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-04-20T12:24:50.807 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4194304 len 4096 2024-04-20T12:24:50.807 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194304 len 4096 2024-04-20T12:24:50.807 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4194304 len 8192 2024-04-20T12:24:50.807 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-04-20T12:24:50.807 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4194304 len 8192 2024-04-20T12:24:50.807 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194304 len 8192 2024-04-20T12:24:50.807 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4194304 len 16384 2024-04-20T12:24:50.807 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-04-20T12:24:50.808 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4194304 len 16384 2024-04-20T12:24:50.808 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194304 len 16384 2024-04-20T12:24:50.808 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4194816 len 1024 2024-04-20T12:24:50.808 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-04-20T12:24:50.808 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4194816 len 1024 2024-04-20T12:24:50.808 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194816 len 1024 2024-04-20T12:24:50.808 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4194816 len 2048 2024-04-20T12:24:50.808 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-04-20T12:24:50.808 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4194816 len 2048 2024-04-20T12:24:50.808 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194816 len 2048 2024-04-20T12:24:50.808 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4194816 len 4096 2024-04-20T12:24:50.808 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-04-20T12:24:50.809 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4194816 len 4096 2024-04-20T12:24:50.809 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194816 len 4096 2024-04-20T12:24:50.809 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4194816 len 8192 2024-04-20T12:24:50.809 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-04-20T12:24:50.809 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4194816 len 8192 2024-04-20T12:24:50.809 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194816 len 8192 2024-04-20T12:24:50.809 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4194816 len 16384 2024-04-20T12:24:50.826 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-04-20T12:24:50.826 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4194816 len 16384 2024-04-20T12:24:50.826 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4194816 len 16384 2024-04-20T12:24:50.826 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4195328 len 1024 2024-04-20T12:24:50.826 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-04-20T12:24:50.826 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4195328 len 1024 2024-04-20T12:24:50.826 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195328 len 1024 2024-04-20T12:24:50.827 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4195328 len 2048 2024-04-20T12:24:50.827 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-04-20T12:24:50.827 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4195328 len 2048 2024-04-20T12:24:50.827 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195328 len 2048 2024-04-20T12:24:50.827 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4195328 len 4096 2024-04-20T12:24:50.827 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-04-20T12:24:50.827 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4195328 len 4096 2024-04-20T12:24:50.827 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195328 len 4096 2024-04-20T12:24:50.827 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4195328 len 8192 2024-04-20T12:24:50.827 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-04-20T12:24:50.827 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4195328 len 8192 2024-04-20T12:24:50.827 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195328 len 8192 2024-04-20T12:24:50.827 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4195328 len 16384 2024-04-20T12:24:50.827 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-04-20T12:24:50.827 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4195328 len 16384 2024-04-20T12:24:50.828 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195328 len 16384 2024-04-20T12:24:50.828 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4195840 len 1024 2024-04-20T12:24:50.828 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-04-20T12:24:50.828 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4195840 len 1024 2024-04-20T12:24:50.828 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195840 len 1024 2024-04-20T12:24:50.828 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4195840 len 2048 2024-04-20T12:24:50.828 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-04-20T12:24:50.828 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4195840 len 2048 2024-04-20T12:24:50.828 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195840 len 2048 2024-04-20T12:24:50.828 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4195840 len 4096 2024-04-20T12:24:50.828 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-04-20T12:24:50.828 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4195840 len 4096 2024-04-20T12:24:50.828 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195840 len 4096 2024-04-20T12:24:50.828 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4195840 len 8192 2024-04-20T12:24:50.828 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-04-20T12:24:50.829 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4195840 len 8192 2024-04-20T12:24:50.829 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195840 len 8192 2024-04-20T12:24:50.829 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4195840 len 16384 2024-04-20T12:24:50.829 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-04-20T12:24:50.829 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4195840 len 16384 2024-04-20T12:24:50.829 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4195840 len 16384 2024-04-20T12:24:50.829 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4196352 len 1024 2024-04-20T12:24:50.829 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-04-20T12:24:50.829 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4196352 len 1024 2024-04-20T12:24:50.829 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196352 len 1024 2024-04-20T12:24:50.829 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4196352 len 2048 2024-04-20T12:24:50.829 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-04-20T12:24:50.829 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4196352 len 2048 2024-04-20T12:24:50.829 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196352 len 2048 2024-04-20T12:24:50.829 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4196352 len 4096 2024-04-20T12:24:50.830 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-04-20T12:24:50.830 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4196352 len 4096 2024-04-20T12:24:50.830 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196352 len 4096 2024-04-20T12:24:50.830 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4196352 len 8192 2024-04-20T12:24:50.830 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-04-20T12:24:50.830 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4196352 len 8192 2024-04-20T12:24:50.830 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196352 len 8192 2024-04-20T12:24:50.830 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4196352 len 16384 2024-04-20T12:24:50.830 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-04-20T12:24:50.830 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4196352 len 16384 2024-04-20T12:24:50.830 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196352 len 16384 2024-04-20T12:24:50.830 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4196864 len 1024 2024-04-20T12:24:50.830 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-04-20T12:24:50.830 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4196864 len 1024 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196864 len 1024 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4196864 len 2048 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4196864 len 2048 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196864 len 2048 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4196864 len 4096 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4196864 len 4096 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196864 len 4096 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4196864 len 8192 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4196864 len 8192 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196864 len 8192 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4196864 len 16384 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-04-20T12:24:50.831 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4196864 len 16384 2024-04-20T12:24:50.832 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4196864 len 16384 2024-04-20T12:24:50.832 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4197376 len 1024 2024-04-20T12:24:50.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.832+0000 7f9cc405c640 1 -- 172.21.15.135:0/98551940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cbc104d80 msgr2=0x7f9cbc108dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:50.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.832+0000 7f9cc405c640 1 --2- 172.21.15.135:0/98551940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cbc104d80 0x7f9cbc108dc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009900 tx=0x7f9cac02bc30 comp rx=0 tx=0).stop 2024-04-20T12:24:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.832+0000 7f9cc405c640 1 -- 172.21.15.135:0/98551940 shutdown_connections 2024-04-20T12:24:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.832+0000 7f9cc405c640 1 --2- 172.21.15.135:0/98551940 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cbc1094a0 0x7f9cbc111070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.832+0000 7f9cc405c640 1 --2- 172.21.15.135:0/98551940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cbc104d80 0x7f9cbc108dc0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.832+0000 7f9cc405c640 1 --2- 172.21.15.135:0/98551940 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cbc1043d0 0x7f9cbc1047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.832+0000 7f9cc405c640 1 -- 172.21.15.135:0/98551940 >> 172.21.15.135:0/98551940 conn(0x7f9cbc0ffc50 msgr2=0x7f9cbc102070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.833+0000 7f9cc405c640 1 -- 172.21.15.135:0/98551940 shutdown_connections 2024-04-20T12:24:50.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.833+0000 7f9cc405c640 1 -- 172.21.15.135:0/98551940 wait complete. 2024-04-20T12:24:50.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.833+0000 7f9cc405c640 1 Processor -- start 2024-04-20T12:24:50.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.833+0000 7f9cc405c640 1 -- start start 2024-04-20T12:24:50.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc405c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cbc1043d0 0x7f9cbc1a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc405c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cbc1094a0 0x7f9cbc1a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc405c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cbc19a8f0 0x7f9cbc19ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc405c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc114510 con 0x7f9cbc1094a0 2024-04-20T12:24:50.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc405c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc114390 con 0x7f9cbc19a8f0 2024-04-20T12:24:50.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc405c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc114690 con 0x7f9cbc1043d0 2024-04-20T12:24:50.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc15f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cbc1094a0 0x7f9cbc1a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc15f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cbc1094a0 0x7f9cbc1a0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36106/0 (socket says 172.21.15.135:36106) 2024-04-20T12:24:50.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc15f7640 1 -- 172.21.15.135:0/1762208683 learned_addr learned my addr 172.21.15.135:0/1762208683 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:50.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc25f9640 1 --2- 172.21.15.135:0/1762208683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cbc19a8f0 0x7f9cbc19ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc1df8640 1 --2- 172.21.15.135:0/1762208683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cbc1043d0 0x7f9cbc1a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc15f7640 1 -- 172.21.15.135:0/1762208683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cbc1043d0 msgr2=0x7f9cbc1a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:50.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc15f7640 1 --2- 172.21.15.135:0/1762208683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cbc1043d0 0x7f9cbc1a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc15f7640 1 -- 172.21.15.135:0/1762208683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cbc19a8f0 msgr2=0x7f9cbc19ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:50.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc15f7640 1 --2- 172.21.15.135:0/1762208683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cbc19a8f0 0x7f9cbc19ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:50.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc15f7640 1 -- 172.21.15.135:0/1762208683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cbc19b410 con 0x7f9cbc1094a0 2024-04-20T12:24:50.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc1df8640 1 --2- 172.21.15.135:0/1762208683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cbc1043d0 0x7f9cbc1a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:50.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc15f7640 1 --2- 172.21.15.135:0/1762208683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cbc1094a0 0x7f9cbc1a0c30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9cac036040 tx=0x7f9cac02ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:50.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cb2ffd640 1 -- 172.21.15.135:0/1762208683 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac041070 con 0x7f9cbc1094a0 2024-04-20T12:24:50.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.834+0000 7f9cc405c640 1 -- 172.21.15.135:0/1762208683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cbc19b6a0 con 0x7f9cbc1094a0 2024-04-20T12:24:50.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.835+0000 7f9cc405c640 1 -- 172.21.15.135:0/1762208683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cbc1a78a0 con 0x7f9cbc1094a0 2024-04-20T12:24:50.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.835+0000 7f9cb2ffd640 1 -- 172.21.15.135:0/1762208683 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cac0054e0 con 0x7f9cbc1094a0 2024-04-20T12:24:50.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.835+0000 7f9cb2ffd640 1 -- 172.21.15.135:0/1762208683 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cac034440 con 0x7f9cbc1094a0 2024-04-20T12:24:50.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.836+0000 7f9cc405c640 1 -- 172.21.15.135:0/1762208683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cbc1058a0 con 0x7f9cbc1094a0 2024-04-20T12:24:50.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.837+0000 7f9cb2ffd640 1 -- 172.21.15.135:0/1762208683 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f9cac044070 con 0x7f9cbc1094a0 2024-04-20T12:24:50.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.838+0000 7f9cb2ffd640 1 --2- 172.21.15.135:0/1762208683 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9ca80a3da0 0x7f9ca80a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:50.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.838+0000 7f9cc1df8640 1 --2- 172.21.15.135:0/1762208683 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9ca80a3da0 0x7f9ca80a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:50.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.838+0000 7f9cb2ffd640 1 -- 172.21.15.135:0/1762208683 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9cac0f2610 con 0x7f9cbc1094a0 2024-04-20T12:24:50.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.838+0000 7f9cc1df8640 1 --2- 172.21.15.135:0/1762208683 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9ca80a3da0 0x7f9ca80a6260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8005d00 tx=0x7f9cb8005c70 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:50.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:50.843+0000 7f9cb2ffd640 1 -- 172.21.15.135:0/1762208683 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f9cac0bead0 con 0x7f9cbc1094a0 2024-04-20T12:24:50.857 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-04-20T12:24:50.857 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4197376 len 1024 2024-04-20T12:24:50.857 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197376 len 1024 2024-04-20T12:24:50.857 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4197376 len 2048 2024-04-20T12:24:50.857 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-04-20T12:24:50.857 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4197376 len 2048 2024-04-20T12:24:50.857 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197376 len 2048 2024-04-20T12:24:50.857 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4197376 len 4096 2024-04-20T12:24:50.857 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-04-20T12:24:50.857 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4197376 len 4096 2024-04-20T12:24:50.857 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197376 len 4096 2024-04-20T12:24:50.857 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4197376 len 8192 2024-04-20T12:24:50.858 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-04-20T12:24:50.858 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4197376 len 8192 2024-04-20T12:24:50.858 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197376 len 8192 2024-04-20T12:24:50.858 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4197376 len 16384 2024-04-20T12:24:50.858 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-04-20T12:24:50.858 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4197376 len 16384 2024-04-20T12:24:50.858 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197376 len 16384 2024-04-20T12:24:50.858 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4197888 len 1024 2024-04-20T12:24:50.858 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-04-20T12:24:50.858 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4197888 len 1024 2024-04-20T12:24:50.858 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197888 len 1024 2024-04-20T12:24:50.858 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4197888 len 2048 2024-04-20T12:24:50.858 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-04-20T12:24:50.858 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4197888 len 2048 2024-04-20T12:24:50.858 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197888 len 2048 2024-04-20T12:24:50.859 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4197888 len 4096 2024-04-20T12:24:50.859 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-04-20T12:24:50.859 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4197888 len 4096 2024-04-20T12:24:50.859 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197888 len 4096 2024-04-20T12:24:50.859 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4197888 len 8192 2024-04-20T12:24:50.859 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-04-20T12:24:50.859 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4197888 len 8192 2024-04-20T12:24:50.859 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197888 len 8192 2024-04-20T12:24:50.859 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 512 offset 4197888 len 16384 2024-04-20T12:24:50.859 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-04-20T12:24:50.859 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 512 offset 4197888 len 16384 2024-04-20T12:24:50.859 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 512 offset 4197888 len 16384 2024-04-20T12:24:50.859 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4190208 len 1024 2024-04-20T12:24:50.859 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-04-20T12:24:50.859 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4190208 len 1024 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190208 len 1024 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4190208 len 2048 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4190208 len 2048 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190208 len 2048 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4190208 len 4096 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4190208 len 4096 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190208 len 4096 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4190208 len 8192 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4190208 len 8192 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190208 len 8192 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4190208 len 16384 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-04-20T12:24:50.860 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4190208 len 16384 2024-04-20T12:24:50.861 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190208 len 16384 2024-04-20T12:24:50.861 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4190720 len 1024 2024-04-20T12:24:50.861 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-04-20T12:24:50.861 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4190720 len 1024 2024-04-20T12:24:50.861 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190720 len 1024 2024-04-20T12:24:50.861 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4190720 len 2048 2024-04-20T12:24:50.861 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-04-20T12:24:50.861 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4190720 len 2048 2024-04-20T12:24:50.861 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190720 len 2048 2024-04-20T12:24:50.861 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4190720 len 4096 2024-04-20T12:24:50.861 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-04-20T12:24:50.862 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4190720 len 4096 2024-04-20T12:24:50.862 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190720 len 4096 2024-04-20T12:24:50.862 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4190720 len 8192 2024-04-20T12:24:50.862 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-04-20T12:24:50.862 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4190720 len 8192 2024-04-20T12:24:50.862 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190720 len 8192 2024-04-20T12:24:50.862 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4190720 len 16384 2024-04-20T12:24:50.862 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-04-20T12:24:50.862 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4190720 len 16384 2024-04-20T12:24:50.862 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4190720 len 16384 2024-04-20T12:24:50.862 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4191232 len 1024 2024-04-20T12:24:50.862 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-04-20T12:24:50.862 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4191232 len 1024 2024-04-20T12:24:50.862 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191232 len 1024 2024-04-20T12:24:50.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:50 smithi135 ceph-mon[18264]: pgmap v54: 129 pgs: 129 active+clean; 1.8 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.4 MiB/s wr, 1.03k op/s 2024-04-20T12:24:50.895 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4191232 len 2048 2024-04-20T12:24:50.895 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-04-20T12:24:50.895 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4191232 len 2048 2024-04-20T12:24:50.896 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191232 len 2048 2024-04-20T12:24:50.896 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4191232 len 4096 2024-04-20T12:24:50.896 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-04-20T12:24:50.896 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4191232 len 4096 2024-04-20T12:24:50.896 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191232 len 4096 2024-04-20T12:24:50.896 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4191232 len 8192 2024-04-20T12:24:50.896 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-04-20T12:24:50.896 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4191232 len 8192 2024-04-20T12:24:50.896 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191232 len 8192 2024-04-20T12:24:50.896 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4191232 len 16384 2024-04-20T12:24:50.896 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-04-20T12:24:50.896 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4191232 len 16384 2024-04-20T12:24:50.896 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191232 len 16384 2024-04-20T12:24:50.896 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4191744 len 1024 2024-04-20T12:24:50.897 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-04-20T12:24:50.897 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4191744 len 1024 2024-04-20T12:24:50.897 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191744 len 1024 2024-04-20T12:24:50.897 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4191744 len 2048 2024-04-20T12:24:50.897 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-04-20T12:24:50.897 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4191744 len 2048 2024-04-20T12:24:50.897 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191744 len 2048 2024-04-20T12:24:50.897 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4191744 len 4096 2024-04-20T12:24:50.897 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-04-20T12:24:50.897 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4191744 len 4096 2024-04-20T12:24:50.897 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191744 len 4096 2024-04-20T12:24:50.897 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4191744 len 8192 2024-04-20T12:24:50.897 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-04-20T12:24:50.897 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4191744 len 8192 2024-04-20T12:24:50.897 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191744 len 8192 2024-04-20T12:24:50.898 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4191744 len 16384 2024-04-20T12:24:50.898 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-04-20T12:24:50.898 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4191744 len 16384 2024-04-20T12:24:50.898 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4191744 len 16384 2024-04-20T12:24:50.898 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4192256 len 1024 2024-04-20T12:24:50.898 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-04-20T12:24:50.898 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4192256 len 1024 2024-04-20T12:24:50.898 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192256 len 1024 2024-04-20T12:24:50.898 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4192256 len 2048 2024-04-20T12:24:50.898 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-04-20T12:24:50.898 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4192256 len 2048 2024-04-20T12:24:50.898 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192256 len 2048 2024-04-20T12:24:50.898 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4192256 len 4096 2024-04-20T12:24:50.898 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-04-20T12:24:50.899 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4192256 len 4096 2024-04-20T12:24:50.899 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192256 len 4096 2024-04-20T12:24:50.899 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4192256 len 8192 2024-04-20T12:24:50.899 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-04-20T12:24:50.899 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4192256 len 8192 2024-04-20T12:24:50.899 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192256 len 8192 2024-04-20T12:24:50.899 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4192256 len 16384 2024-04-20T12:24:50.899 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-04-20T12:24:50.899 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4192256 len 16384 2024-04-20T12:24:50.899 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192256 len 16384 2024-04-20T12:24:50.899 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4192768 len 1024 2024-04-20T12:24:50.899 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-04-20T12:24:50.899 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4192768 len 1024 2024-04-20T12:24:50.899 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192768 len 1024 2024-04-20T12:24:50.899 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4192768 len 2048 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4192768 len 2048 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192768 len 2048 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4192768 len 4096 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4192768 len 4096 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192768 len 4096 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4192768 len 8192 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4192768 len 8192 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192768 len 8192 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4192768 len 16384 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4192768 len 16384 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4192768 len 16384 2024-04-20T12:24:50.900 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4193280 len 1024 2024-04-20T12:24:50.901 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-04-20T12:24:50.901 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4193280 len 1024 2024-04-20T12:24:50.901 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193280 len 1024 2024-04-20T12:24:50.901 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4193280 len 2048 2024-04-20T12:24:50.901 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-04-20T12:24:50.901 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4193280 len 2048 2024-04-20T12:24:50.927 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193280 len 2048 2024-04-20T12:24:50.928 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4193280 len 4096 2024-04-20T12:24:50.928 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-04-20T12:24:50.928 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4193280 len 4096 2024-04-20T12:24:50.928 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193280 len 4096 2024-04-20T12:24:50.928 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4193280 len 8192 2024-04-20T12:24:50.928 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-04-20T12:24:50.928 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4193280 len 8192 2024-04-20T12:24:50.928 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193280 len 8192 2024-04-20T12:24:50.928 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4193280 len 16384 2024-04-20T12:24:50.928 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-04-20T12:24:50.928 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4193280 len 16384 2024-04-20T12:24:50.928 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193280 len 16384 2024-04-20T12:24:50.928 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4193792 len 1024 2024-04-20T12:24:50.929 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-04-20T12:24:50.929 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4193792 len 1024 2024-04-20T12:24:50.929 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193792 len 1024 2024-04-20T12:24:50.929 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4193792 len 2048 2024-04-20T12:24:50.929 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-04-20T12:24:50.929 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4193792 len 2048 2024-04-20T12:24:50.929 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193792 len 2048 2024-04-20T12:24:50.929 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4193792 len 4096 2024-04-20T12:24:50.929 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-04-20T12:24:50.929 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4193792 len 4096 2024-04-20T12:24:50.929 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193792 len 4096 2024-04-20T12:24:50.929 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4193792 len 8192 2024-04-20T12:24:50.929 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-04-20T12:24:50.929 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4193792 len 8192 2024-04-20T12:24:50.930 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193792 len 8192 2024-04-20T12:24:50.930 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4193792 len 16384 2024-04-20T12:24:50.930 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-04-20T12:24:50.930 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4193792 len 16384 2024-04-20T12:24:50.930 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4193792 len 16384 2024-04-20T12:24:50.930 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4194304 len 1024 2024-04-20T12:24:50.930 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-04-20T12:24:50.930 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4194304 len 1024 2024-04-20T12:24:50.930 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194304 len 1024 2024-04-20T12:24:50.930 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4194304 len 2048 2024-04-20T12:24:50.930 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-04-20T12:24:50.930 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4194304 len 2048 2024-04-20T12:24:50.930 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194304 len 2048 2024-04-20T12:24:50.930 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4194304 len 4096 2024-04-20T12:24:50.931 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-04-20T12:24:50.931 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4194304 len 4096 2024-04-20T12:24:50.931 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194304 len 4096 2024-04-20T12:24:50.931 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4194304 len 8192 2024-04-20T12:24:50.931 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-04-20T12:24:50.931 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4194304 len 8192 2024-04-20T12:24:50.931 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194304 len 8192 2024-04-20T12:24:50.931 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4194304 len 16384 2024-04-20T12:24:50.931 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-04-20T12:24:50.931 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4194304 len 16384 2024-04-20T12:24:50.931 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194304 len 16384 2024-04-20T12:24:50.931 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4194816 len 1024 2024-04-20T12:24:50.931 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-04-20T12:24:50.931 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4194816 len 1024 2024-04-20T12:24:50.931 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194816 len 1024 2024-04-20T12:24:50.932 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4194816 len 2048 2024-04-20T12:24:50.932 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-04-20T12:24:50.932 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4194816 len 2048 2024-04-20T12:24:50.932 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194816 len 2048 2024-04-20T12:24:50.932 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4194816 len 4096 2024-04-20T12:24:50.932 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-04-20T12:24:50.932 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4194816 len 4096 2024-04-20T12:24:50.932 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194816 len 4096 2024-04-20T12:24:50.932 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4194816 len 8192 2024-04-20T12:24:50.932 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-04-20T12:24:50.932 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4194816 len 8192 2024-04-20T12:24:50.932 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194816 len 8192 2024-04-20T12:24:50.932 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4194816 len 16384 2024-04-20T12:24:50.932 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-04-20T12:24:50.932 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4194816 len 16384 2024-04-20T12:24:50.933 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4194816 len 16384 2024-04-20T12:24:50.933 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4195328 len 1024 2024-04-20T12:24:50.933 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-04-20T12:24:50.933 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4195328 len 1024 2024-04-20T12:24:50.933 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195328 len 1024 2024-04-20T12:24:50.933 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4195328 len 2048 2024-04-20T12:24:50.933 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-04-20T12:24:50.933 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4195328 len 2048 2024-04-20T12:24:50.933 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195328 len 2048 2024-04-20T12:24:50.933 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4195328 len 4096 2024-04-20T12:24:50.949 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-04-20T12:24:50.950 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4195328 len 4096 2024-04-20T12:24:50.950 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195328 len 4096 2024-04-20T12:24:50.950 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4195328 len 8192 2024-04-20T12:24:50.950 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-04-20T12:24:50.950 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4195328 len 8192 2024-04-20T12:24:50.950 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195328 len 8192 2024-04-20T12:24:50.950 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4195328 len 16384 2024-04-20T12:24:50.950 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-04-20T12:24:50.950 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4195328 len 16384 2024-04-20T12:24:50.950 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195328 len 16384 2024-04-20T12:24:50.950 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4195840 len 1024 2024-04-20T12:24:50.950 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4195840 len 1024 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195840 len 1024 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4195840 len 2048 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4195840 len 2048 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195840 len 2048 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4195840 len 4096 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4195840 len 4096 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195840 len 4096 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4195840 len 8192 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4195840 len 8192 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195840 len 8192 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4195840 len 16384 2024-04-20T12:24:50.951 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-04-20T12:24:50.952 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4195840 len 16384 2024-04-20T12:24:50.952 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4195840 len 16384 2024-04-20T12:24:50.952 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4196352 len 1024 2024-04-20T12:24:50.952 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-04-20T12:24:50.952 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4196352 len 1024 2024-04-20T12:24:50.952 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196352 len 1024 2024-04-20T12:24:50.952 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4196352 len 2048 2024-04-20T12:24:50.952 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-04-20T12:24:50.952 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4196352 len 2048 2024-04-20T12:24:50.952 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196352 len 2048 2024-04-20T12:24:50.952 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4196352 len 4096 2024-04-20T12:24:50.952 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-04-20T12:24:50.952 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4196352 len 4096 2024-04-20T12:24:50.952 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196352 len 4096 2024-04-20T12:24:50.952 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4196352 len 8192 2024-04-20T12:24:50.953 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-04-20T12:24:50.953 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4196352 len 8192 2024-04-20T12:24:50.953 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196352 len 8192 2024-04-20T12:24:50.953 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4196352 len 16384 2024-04-20T12:24:50.953 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-04-20T12:24:50.953 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4196352 len 16384 2024-04-20T12:24:50.953 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196352 len 16384 2024-04-20T12:24:50.953 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4196864 len 1024 2024-04-20T12:24:50.953 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-04-20T12:24:50.953 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4196864 len 1024 2024-04-20T12:24:50.953 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196864 len 1024 2024-04-20T12:24:50.953 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4196864 len 2048 2024-04-20T12:24:50.953 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-04-20T12:24:50.953 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4196864 len 2048 2024-04-20T12:24:50.953 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196864 len 2048 2024-04-20T12:24:50.954 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4196864 len 4096 2024-04-20T12:24:50.954 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-04-20T12:24:50.954 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4196864 len 4096 2024-04-20T12:24:50.954 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196864 len 4096 2024-04-20T12:24:50.954 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4196864 len 8192 2024-04-20T12:24:50.954 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-04-20T12:24:50.954 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4196864 len 8192 2024-04-20T12:24:50.954 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196864 len 8192 2024-04-20T12:24:50.954 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4196864 len 16384 2024-04-20T12:24:50.954 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-04-20T12:24:50.954 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4196864 len 16384 2024-04-20T12:24:50.954 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4196864 len 16384 2024-04-20T12:24:50.954 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4197376 len 1024 2024-04-20T12:24:50.954 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-04-20T12:24:50.954 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4197376 len 1024 2024-04-20T12:24:50.955 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197376 len 1024 2024-04-20T12:24:50.955 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4197376 len 2048 2024-04-20T12:24:50.955 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-04-20T12:24:50.955 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4197376 len 2048 2024-04-20T12:24:50.955 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197376 len 2048 2024-04-20T12:24:50.955 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4197376 len 4096 2024-04-20T12:24:50.955 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-04-20T12:24:50.955 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4197376 len 4096 2024-04-20T12:24:50.955 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197376 len 4096 2024-04-20T12:24:50.979 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4197376 len 8192 2024-04-20T12:24:50.979 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-04-20T12:24:50.979 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4197376 len 8192 2024-04-20T12:24:50.979 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197376 len 8192 2024-04-20T12:24:50.979 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4197376 len 16384 2024-04-20T12:24:50.979 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-04-20T12:24:50.979 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4197376 len 16384 2024-04-20T12:24:50.979 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197376 len 16384 2024-04-20T12:24:50.980 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4197888 len 1024 2024-04-20T12:24:50.980 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-04-20T12:24:50.980 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4197888 len 1024 2024-04-20T12:24:50.980 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197888 len 1024 2024-04-20T12:24:50.980 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4197888 len 2048 2024-04-20T12:24:50.980 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-04-20T12:24:50.980 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4197888 len 2048 2024-04-20T12:24:50.980 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197888 len 2048 2024-04-20T12:24:50.980 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4197888 len 4096 2024-04-20T12:24:50.980 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-04-20T12:24:50.980 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4197888 len 4096 2024-04-20T12:24:50.980 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197888 len 4096 2024-04-20T12:24:50.980 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4197888 len 8192 2024-04-20T12:24:50.980 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-04-20T12:24:50.980 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4197888 len 8192 2024-04-20T12:24:50.981 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197888 len 8192 2024-04-20T12:24:50.981 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1024 offset 4197888 len 16384 2024-04-20T12:24:50.981 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-04-20T12:24:50.981 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1024 offset 4197888 len 16384 2024-04-20T12:24:50.981 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1024 offset 4197888 len 16384 2024-04-20T12:24:50.981 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4190208 len 1024 2024-04-20T12:24:50.981 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-04-20T12:24:50.981 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4190208 len 1024 2024-04-20T12:24:50.981 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190208 len 1024 2024-04-20T12:24:50.981 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4190208 len 2048 2024-04-20T12:24:50.981 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-04-20T12:24:50.981 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4190208 len 2048 2024-04-20T12:24:50.981 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190208 len 2048 2024-04-20T12:24:50.981 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4190208 len 4096 2024-04-20T12:24:50.981 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-04-20T12:24:50.982 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4190208 len 4096 2024-04-20T12:24:50.982 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190208 len 4096 2024-04-20T12:24:50.982 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4190208 len 8192 2024-04-20T12:24:50.982 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-04-20T12:24:50.982 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4190208 len 8192 2024-04-20T12:24:50.982 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190208 len 8192 2024-04-20T12:24:50.982 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4190208 len 16384 2024-04-20T12:24:50.982 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-04-20T12:24:50.982 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4190208 len 16384 2024-04-20T12:24:50.982 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190208 len 16384 2024-04-20T12:24:50.982 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4190720 len 1024 2024-04-20T12:24:50.982 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-04-20T12:24:50.982 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4190720 len 1024 2024-04-20T12:24:50.982 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190720 len 1024 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4190720 len 2048 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4190720 len 2048 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190720 len 2048 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4190720 len 4096 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4190720 len 4096 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190720 len 4096 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4190720 len 8192 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4190720 len 8192 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190720 len 8192 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4190720 len 16384 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4190720 len 16384 2024-04-20T12:24:50.983 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4190720 len 16384 2024-04-20T12:24:50.984 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4191232 len 1024 2024-04-20T12:24:50.984 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-04-20T12:24:50.984 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4191232 len 1024 2024-04-20T12:24:50.984 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191232 len 1024 2024-04-20T12:24:50.984 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4191232 len 2048 2024-04-20T12:24:50.984 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-04-20T12:24:50.984 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4191232 len 2048 2024-04-20T12:24:50.984 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191232 len 2048 2024-04-20T12:24:50.984 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4191232 len 4096 2024-04-20T12:24:50.984 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-04-20T12:24:50.984 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4191232 len 4096 2024-04-20T12:24:50.984 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191232 len 4096 2024-04-20T12:24:50.984 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4191232 len 8192 2024-04-20T12:24:50.984 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-04-20T12:24:51.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:50 smithi154 ceph-mon[22073]: pgmap v54: 129 pgs: 129 active+clean; 1.8 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.4 MiB/s wr, 1.03k op/s 2024-04-20T12:24:51.016 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4191232 len 8192 2024-04-20T12:24:51.016 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191232 len 8192 2024-04-20T12:24:51.016 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4191232 len 16384 2024-04-20T12:24:51.016 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-04-20T12:24:51.016 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4191232 len 16384 2024-04-20T12:24:51.016 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191232 len 16384 2024-04-20T12:24:51.016 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4191744 len 1024 2024-04-20T12:24:51.016 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-04-20T12:24:51.016 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4191744 len 1024 2024-04-20T12:24:51.016 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191744 len 1024 2024-04-20T12:24:51.016 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4191744 len 2048 2024-04-20T12:24:51.016 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-04-20T12:24:51.016 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4191744 len 2048 2024-04-20T12:24:51.016 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191744 len 2048 2024-04-20T12:24:51.017 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4191744 len 4096 2024-04-20T12:24:51.017 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-04-20T12:24:51.017 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4191744 len 4096 2024-04-20T12:24:51.017 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191744 len 4096 2024-04-20T12:24:51.017 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4191744 len 8192 2024-04-20T12:24:51.017 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-04-20T12:24:51.017 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4191744 len 8192 2024-04-20T12:24:51.017 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191744 len 8192 2024-04-20T12:24:51.017 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4191744 len 16384 2024-04-20T12:24:51.017 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-04-20T12:24:51.017 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4191744 len 16384 2024-04-20T12:24:51.017 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4191744 len 16384 2024-04-20T12:24:51.017 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4192256 len 1024 2024-04-20T12:24:51.017 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-04-20T12:24:51.017 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4192256 len 1024 2024-04-20T12:24:51.018 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192256 len 1024 2024-04-20T12:24:51.018 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4192256 len 2048 2024-04-20T12:24:51.018 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-04-20T12:24:51.018 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4192256 len 2048 2024-04-20T12:24:51.018 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192256 len 2048 2024-04-20T12:24:51.018 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4192256 len 4096 2024-04-20T12:24:51.018 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-04-20T12:24:51.018 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4192256 len 4096 2024-04-20T12:24:51.018 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192256 len 4096 2024-04-20T12:24:51.018 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4192256 len 8192 2024-04-20T12:24:51.018 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-04-20T12:24:51.018 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4192256 len 8192 2024-04-20T12:24:51.018 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192256 len 8192 2024-04-20T12:24:51.018 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4192256 len 16384 2024-04-20T12:24:51.018 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4192256 len 16384 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192256 len 16384 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4192768 len 1024 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4192768 len 1024 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192768 len 1024 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4192768 len 2048 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4192768 len 2048 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192768 len 2048 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4192768 len 4096 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4192768 len 4096 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192768 len 4096 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4192768 len 8192 2024-04-20T12:24:51.019 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4192768 len 8192 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192768 len 8192 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4192768 len 16384 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4192768 len 16384 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4192768 len 16384 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4193280 len 1024 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4193280 len 1024 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193280 len 1024 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4193280 len 2048 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4193280 len 2048 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193280 len 2048 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4193280 len 4096 2024-04-20T12:24:51.020 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-04-20T12:24:51.021 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4193280 len 4096 2024-04-20T12:24:51.021 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193280 len 4096 2024-04-20T12:24:51.021 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4193280 len 8192 2024-04-20T12:24:51.021 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-04-20T12:24:51.021 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4193280 len 8192 2024-04-20T12:24:51.021 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193280 len 8192 2024-04-20T12:24:51.045 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4193280 len 16384 2024-04-20T12:24:51.045 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-04-20T12:24:51.045 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4193280 len 16384 2024-04-20T12:24:51.045 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193280 len 16384 2024-04-20T12:24:51.045 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4193792 len 1024 2024-04-20T12:24:51.045 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-04-20T12:24:51.045 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4193792 len 1024 2024-04-20T12:24:51.045 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193792 len 1024 2024-04-20T12:24:51.045 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4193792 len 2048 2024-04-20T12:24:51.046 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-04-20T12:24:51.046 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4193792 len 2048 2024-04-20T12:24:51.046 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193792 len 2048 2024-04-20T12:24:51.046 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4193792 len 4096 2024-04-20T12:24:51.046 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-04-20T12:24:51.046 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4193792 len 4096 2024-04-20T12:24:51.046 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193792 len 4096 2024-04-20T12:24:51.046 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4193792 len 8192 2024-04-20T12:24:51.046 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-04-20T12:24:51.046 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4193792 len 8192 2024-04-20T12:24:51.046 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193792 len 8192 2024-04-20T12:24:51.046 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4193792 len 16384 2024-04-20T12:24:51.046 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-04-20T12:24:51.047 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4193792 len 16384 2024-04-20T12:24:51.047 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4193792 len 16384 2024-04-20T12:24:51.047 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4194304 len 1024 2024-04-20T12:24:51.047 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-04-20T12:24:51.047 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4194304 len 1024 2024-04-20T12:24:51.047 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194304 len 1024 2024-04-20T12:24:51.047 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4194304 len 2048 2024-04-20T12:24:51.047 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-04-20T12:24:51.047 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4194304 len 2048 2024-04-20T12:24:51.047 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194304 len 2048 2024-04-20T12:24:51.047 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4194304 len 4096 2024-04-20T12:24:51.047 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-04-20T12:24:51.047 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4194304 len 4096 2024-04-20T12:24:51.047 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194304 len 4096 2024-04-20T12:24:51.047 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4194304 len 8192 2024-04-20T12:24:51.048 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-04-20T12:24:51.048 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4194304 len 8192 2024-04-20T12:24:51.048 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194304 len 8192 2024-04-20T12:24:51.048 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4194304 len 16384 2024-04-20T12:24:51.048 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-04-20T12:24:51.048 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4194304 len 16384 2024-04-20T12:24:51.048 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194304 len 16384 2024-04-20T12:24:51.048 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4194816 len 1024 2024-04-20T12:24:51.048 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-04-20T12:24:51.048 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4194816 len 1024 2024-04-20T12:24:51.048 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194816 len 1024 2024-04-20T12:24:51.048 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4194816 len 2048 2024-04-20T12:24:51.048 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-04-20T12:24:51.048 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4194816 len 2048 2024-04-20T12:24:51.048 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194816 len 2048 2024-04-20T12:24:51.049 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4194816 len 4096 2024-04-20T12:24:51.049 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-04-20T12:24:51.049 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4194816 len 4096 2024-04-20T12:24:51.049 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194816 len 4096 2024-04-20T12:24:51.049 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4194816 len 8192 2024-04-20T12:24:51.049 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-04-20T12:24:51.049 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4194816 len 8192 2024-04-20T12:24:51.049 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194816 len 8192 2024-04-20T12:24:51.049 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4194816 len 16384 2024-04-20T12:24:51.049 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-04-20T12:24:51.049 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4194816 len 16384 2024-04-20T12:24:51.049 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4194816 len 16384 2024-04-20T12:24:51.049 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4195328 len 1024 2024-04-20T12:24:51.049 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-04-20T12:24:51.049 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4195328 len 1024 2024-04-20T12:24:51.050 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195328 len 1024 2024-04-20T12:24:51.050 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4195328 len 2048 2024-04-20T12:24:51.050 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-04-20T12:24:51.050 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4195328 len 2048 2024-04-20T12:24:51.050 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195328 len 2048 2024-04-20T12:24:51.050 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4195328 len 4096 2024-04-20T12:24:51.050 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-04-20T12:24:51.050 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4195328 len 4096 2024-04-20T12:24:51.050 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195328 len 4096 2024-04-20T12:24:51.050 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4195328 len 8192 2024-04-20T12:24:51.050 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-04-20T12:24:51.051 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4195328 len 8192 2024-04-20T12:24:51.051 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195328 len 8192 2024-04-20T12:24:51.051 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4195328 len 16384 2024-04-20T12:24:51.051 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-04-20T12:24:51.051 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4195328 len 16384 2024-04-20T12:24:51.069 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195328 len 16384 2024-04-20T12:24:51.070 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4195840 len 1024 2024-04-20T12:24:51.070 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-04-20T12:24:51.070 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4195840 len 1024 2024-04-20T12:24:51.070 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195840 len 1024 2024-04-20T12:24:51.070 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4195840 len 2048 2024-04-20T12:24:51.070 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-04-20T12:24:51.070 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4195840 len 2048 2024-04-20T12:24:51.070 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195840 len 2048 2024-04-20T12:24:51.070 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4195840 len 4096 2024-04-20T12:24:51.070 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-04-20T12:24:51.070 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4195840 len 4096 2024-04-20T12:24:51.070 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195840 len 4096 2024-04-20T12:24:51.071 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4195840 len 8192 2024-04-20T12:24:51.071 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-04-20T12:24:51.071 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4195840 len 8192 2024-04-20T12:24:51.071 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195840 len 8192 2024-04-20T12:24:51.071 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4195840 len 16384 2024-04-20T12:24:51.071 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-04-20T12:24:51.071 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4195840 len 16384 2024-04-20T12:24:51.071 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4195840 len 16384 2024-04-20T12:24:51.071 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4196352 len 1024 2024-04-20T12:24:51.071 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-04-20T12:24:51.071 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4196352 len 1024 2024-04-20T12:24:51.072 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196352 len 1024 2024-04-20T12:24:51.072 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4196352 len 2048 2024-04-20T12:24:51.072 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-04-20T12:24:51.072 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4196352 len 2048 2024-04-20T12:24:51.072 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196352 len 2048 2024-04-20T12:24:51.072 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4196352 len 4096 2024-04-20T12:24:51.072 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-04-20T12:24:51.072 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4196352 len 4096 2024-04-20T12:24:51.072 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196352 len 4096 2024-04-20T12:24:51.072 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4196352 len 8192 2024-04-20T12:24:51.072 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-04-20T12:24:51.072 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4196352 len 8192 2024-04-20T12:24:51.072 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196352 len 8192 2024-04-20T12:24:51.072 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4196352 len 16384 2024-04-20T12:24:51.072 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-04-20T12:24:51.073 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4196352 len 16384 2024-04-20T12:24:51.073 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196352 len 16384 2024-04-20T12:24:51.073 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4196864 len 1024 2024-04-20T12:24:51.073 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-04-20T12:24:51.073 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4196864 len 1024 2024-04-20T12:24:51.073 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196864 len 1024 2024-04-20T12:24:51.073 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4196864 len 2048 2024-04-20T12:24:51.073 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-04-20T12:24:51.073 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4196864 len 2048 2024-04-20T12:24:51.073 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196864 len 2048 2024-04-20T12:24:51.073 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4196864 len 4096 2024-04-20T12:24:51.073 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-04-20T12:24:51.073 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4196864 len 4096 2024-04-20T12:24:51.073 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196864 len 4096 2024-04-20T12:24:51.073 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4196864 len 8192 2024-04-20T12:24:51.074 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-04-20T12:24:51.074 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4196864 len 8192 2024-04-20T12:24:51.074 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196864 len 8192 2024-04-20T12:24:51.074 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4196864 len 16384 2024-04-20T12:24:51.074 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-04-20T12:24:51.074 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4196864 len 16384 2024-04-20T12:24:51.074 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4196864 len 16384 2024-04-20T12:24:51.074 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4197376 len 1024 2024-04-20T12:24:51.074 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-04-20T12:24:51.074 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4197376 len 1024 2024-04-20T12:24:51.074 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197376 len 1024 2024-04-20T12:24:51.074 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4197376 len 2048 2024-04-20T12:24:51.074 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-04-20T12:24:51.074 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4197376 len 2048 2024-04-20T12:24:51.075 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197376 len 2048 2024-04-20T12:24:51.075 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4197376 len 4096 2024-04-20T12:24:51.075 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-04-20T12:24:51.075 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4197376 len 4096 2024-04-20T12:24:51.075 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197376 len 4096 2024-04-20T12:24:51.075 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4197376 len 8192 2024-04-20T12:24:51.075 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-04-20T12:24:51.075 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4197376 len 8192 2024-04-20T12:24:51.075 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197376 len 8192 2024-04-20T12:24:51.075 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4197376 len 16384 2024-04-20T12:24:51.075 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-04-20T12:24:51.075 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4197376 len 16384 2024-04-20T12:24:51.075 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197376 len 16384 2024-04-20T12:24:51.075 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4197888 len 1024 2024-04-20T12:24:51.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:50 smithi139 ceph-mon[21834]: pgmap v54: 129 pgs: 129 active+clean; 1.8 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.4 MiB/s wr, 1.03k op/s 2024-04-20T12:24:51.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.085+0000 7f9cc405c640 1 -- 172.21.15.135:0/1762208683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cbc10c6d0 con 0x7f9cbc1094a0 2024-04-20T12:24:51.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.086+0000 7f9cb2ffd640 1 -- 172.21.15.135:0/1762208683 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7f9cac004c50 con 0x7f9cbc1094a0 2024-04-20T12:24:51.086 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:24:51.086 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:24:51.087 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:24:51.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.088+0000 7f9cc405c640 1 -- 172.21.15.135:0/1762208683 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9ca80a3da0 msgr2=0x7f9ca80a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.088+0000 7f9cc405c640 1 --2- 172.21.15.135:0/1762208683 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9ca80a3da0 0x7f9ca80a6260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8005d00 tx=0x7f9cb8005c70 comp rx=0 tx=0).stop 2024-04-20T12:24:51.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.088+0000 7f9cc405c640 1 -- 172.21.15.135:0/1762208683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cbc1094a0 msgr2=0x7f9cbc1a0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.088+0000 7f9cc405c640 1 --2- 172.21.15.135:0/1762208683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cbc1094a0 0x7f9cbc1a0c30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9cac036040 tx=0x7f9cac02ce20 comp rx=0 tx=0).stop 2024-04-20T12:24:51.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.088+0000 7f9cc405c640 1 -- 172.21.15.135:0/1762208683 shutdown_connections 2024-04-20T12:24:51.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.088+0000 7f9cc405c640 1 --2- 172.21.15.135:0/1762208683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9cbc19a8f0 0x7f9cbc19ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.088+0000 7f9cc405c640 1 --2- 172.21.15.135:0/1762208683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cbc1094a0 0x7f9cbc1a0c30 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.088+0000 7f9cc405c640 1 --2- 172.21.15.135:0/1762208683 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9ca80a3da0 0x7f9ca80a6260 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.088+0000 7f9cc405c640 1 --2- 172.21.15.135:0/1762208683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cbc1043d0 0x7f9cbc1a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.089+0000 7f9cc405c640 1 -- 172.21.15.135:0/1762208683 >> 172.21.15.135:0/1762208683 conn(0x7f9cbc0ffc50 msgr2=0x7f9cbc101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.089+0000 7f9cc405c640 1 -- 172.21.15.135:0/1762208683 shutdown_connections 2024-04-20T12:24:51.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.089+0000 7f9cc405c640 1 -- 172.21.15.135:0/1762208683 wait complete. 2024-04-20T12:24:51.100 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:24:51.103 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-04-20T12:24:51.103 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4197888 len 1024 2024-04-20T12:24:51.103 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197888 len 1024 2024-04-20T12:24:51.103 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4197888 len 2048 2024-04-20T12:24:51.103 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-04-20T12:24:51.103 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4197888 len 2048 2024-04-20T12:24:51.104 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197888 len 2048 2024-04-20T12:24:51.104 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4197888 len 4096 2024-04-20T12:24:51.104 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-04-20T12:24:51.104 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4197888 len 4096 2024-04-20T12:24:51.104 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197888 len 4096 2024-04-20T12:24:51.104 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4197888 len 8192 2024-04-20T12:24:51.104 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-04-20T12:24:51.104 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4197888 len 8192 2024-04-20T12:24:51.104 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197888 len 8192 2024-04-20T12:24:51.104 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 1536 offset 4197888 len 16384 2024-04-20T12:24:51.104 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-04-20T12:24:51.104 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 1536 offset 4197888 len 16384 2024-04-20T12:24:51.104 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 1536 offset 4197888 len 16384 2024-04-20T12:24:51.105 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4190208 len 1024 2024-04-20T12:24:51.105 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-04-20T12:24:51.105 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4190208 len 1024 2024-04-20T12:24:51.105 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190208 len 1024 2024-04-20T12:24:51.105 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4190208 len 2048 2024-04-20T12:24:51.105 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-04-20T12:24:51.105 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4190208 len 2048 2024-04-20T12:24:51.105 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190208 len 2048 2024-04-20T12:24:51.105 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4190208 len 4096 2024-04-20T12:24:51.105 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-04-20T12:24:51.105 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4190208 len 4096 2024-04-20T12:24:51.105 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190208 len 4096 2024-04-20T12:24:51.105 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4190208 len 8192 2024-04-20T12:24:51.105 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-04-20T12:24:51.105 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4190208 len 8192 2024-04-20T12:24:51.106 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190208 len 8192 2024-04-20T12:24:51.106 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4190208 len 16384 2024-04-20T12:24:51.106 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-04-20T12:24:51.106 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4190208 len 16384 2024-04-20T12:24:51.106 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190208 len 16384 2024-04-20T12:24:51.106 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4190720 len 1024 2024-04-20T12:24:51.106 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-04-20T12:24:51.106 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4190720 len 1024 2024-04-20T12:24:51.106 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190720 len 1024 2024-04-20T12:24:51.106 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4190720 len 2048 2024-04-20T12:24:51.106 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-04-20T12:24:51.106 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4190720 len 2048 2024-04-20T12:24:51.106 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190720 len 2048 2024-04-20T12:24:51.106 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4190720 len 4096 2024-04-20T12:24:51.107 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-04-20T12:24:51.107 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4190720 len 4096 2024-04-20T12:24:51.107 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190720 len 4096 2024-04-20T12:24:51.107 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4190720 len 8192 2024-04-20T12:24:51.107 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-04-20T12:24:51.107 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4190720 len 8192 2024-04-20T12:24:51.107 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190720 len 8192 2024-04-20T12:24:51.107 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4190720 len 16384 2024-04-20T12:24:51.107 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-04-20T12:24:51.107 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4190720 len 16384 2024-04-20T12:24:51.107 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4190720 len 16384 2024-04-20T12:24:51.107 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4191232 len 1024 2024-04-20T12:24:51.107 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-04-20T12:24:51.107 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4191232 len 1024 2024-04-20T12:24:51.107 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191232 len 1024 2024-04-20T12:24:51.108 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4191232 len 2048 2024-04-20T12:24:51.108 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-04-20T12:24:51.108 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4191232 len 2048 2024-04-20T12:24:51.108 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191232 len 2048 2024-04-20T12:24:51.108 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4191232 len 4096 2024-04-20T12:24:51.108 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-04-20T12:24:51.108 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4191232 len 4096 2024-04-20T12:24:51.108 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191232 len 4096 2024-04-20T12:24:51.108 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4191232 len 8192 2024-04-20T12:24:51.108 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-04-20T12:24:51.108 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4191232 len 8192 2024-04-20T12:24:51.108 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191232 len 8192 2024-04-20T12:24:51.108 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4191232 len 16384 2024-04-20T12:24:51.108 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-04-20T12:24:51.109 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4191232 len 16384 2024-04-20T12:24:51.109 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191232 len 16384 2024-04-20T12:24:51.109 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4191744 len 1024 2024-04-20T12:24:51.109 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-04-20T12:24:51.109 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4191744 len 1024 2024-04-20T12:24:51.109 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191744 len 1024 2024-04-20T12:24:51.146 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4191744 len 2048 2024-04-20T12:24:51.146 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-04-20T12:24:51.146 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4191744 len 2048 2024-04-20T12:24:51.146 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191744 len 2048 2024-04-20T12:24:51.147 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4191744 len 4096 2024-04-20T12:24:51.147 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-04-20T12:24:51.147 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4191744 len 4096 2024-04-20T12:24:51.147 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191744 len 4096 2024-04-20T12:24:51.147 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4191744 len 8192 2024-04-20T12:24:51.147 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-04-20T12:24:51.147 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4191744 len 8192 2024-04-20T12:24:51.147 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191744 len 8192 2024-04-20T12:24:51.147 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4191744 len 16384 2024-04-20T12:24:51.147 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-04-20T12:24:51.147 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4191744 len 16384 2024-04-20T12:24:51.147 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4191744 len 16384 2024-04-20T12:24:51.147 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4192256 len 1024 2024-04-20T12:24:51.147 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-04-20T12:24:51.148 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4192256 len 1024 2024-04-20T12:24:51.148 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192256 len 1024 2024-04-20T12:24:51.148 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4192256 len 2048 2024-04-20T12:24:51.148 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-04-20T12:24:51.148 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4192256 len 2048 2024-04-20T12:24:51.148 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192256 len 2048 2024-04-20T12:24:51.148 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4192256 len 4096 2024-04-20T12:24:51.148 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-04-20T12:24:51.148 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4192256 len 4096 2024-04-20T12:24:51.148 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192256 len 4096 2024-04-20T12:24:51.148 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4192256 len 8192 2024-04-20T12:24:51.148 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-04-20T12:24:51.148 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4192256 len 8192 2024-04-20T12:24:51.148 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192256 len 8192 2024-04-20T12:24:51.148 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4192256 len 16384 2024-04-20T12:24:51.149 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-04-20T12:24:51.149 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4192256 len 16384 2024-04-20T12:24:51.149 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192256 len 16384 2024-04-20T12:24:51.149 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4192768 len 1024 2024-04-20T12:24:51.149 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-04-20T12:24:51.149 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4192768 len 1024 2024-04-20T12:24:51.149 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192768 len 1024 2024-04-20T12:24:51.149 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4192768 len 2048 2024-04-20T12:24:51.149 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-04-20T12:24:51.149 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4192768 len 2048 2024-04-20T12:24:51.149 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192768 len 2048 2024-04-20T12:24:51.149 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4192768 len 4096 2024-04-20T12:24:51.149 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-04-20T12:24:51.149 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4192768 len 4096 2024-04-20T12:24:51.149 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192768 len 4096 2024-04-20T12:24:51.150 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4192768 len 8192 2024-04-20T12:24:51.150 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-04-20T12:24:51.150 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4192768 len 8192 2024-04-20T12:24:51.150 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192768 len 8192 2024-04-20T12:24:51.150 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4192768 len 16384 2024-04-20T12:24:51.150 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-04-20T12:24:51.150 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4192768 len 16384 2024-04-20T12:24:51.150 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4192768 len 16384 2024-04-20T12:24:51.150 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4193280 len 1024 2024-04-20T12:24:51.150 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-04-20T12:24:51.150 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4193280 len 1024 2024-04-20T12:24:51.150 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193280 len 1024 2024-04-20T12:24:51.151 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4193280 len 2048 2024-04-20T12:24:51.151 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-04-20T12:24:51.151 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4193280 len 2048 2024-04-20T12:24:51.151 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193280 len 2048 2024-04-20T12:24:51.151 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4193280 len 4096 2024-04-20T12:24:51.151 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-04-20T12:24:51.151 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4193280 len 4096 2024-04-20T12:24:51.151 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193280 len 4096 2024-04-20T12:24:51.151 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4193280 len 8192 2024-04-20T12:24:51.151 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-04-20T12:24:51.151 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4193280 len 8192 2024-04-20T12:24:51.151 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193280 len 8192 2024-04-20T12:24:51.151 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4193280 len 16384 2024-04-20T12:24:51.152 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-04-20T12:24:51.152 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4193280 len 16384 2024-04-20T12:24:51.152 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193280 len 16384 2024-04-20T12:24:51.152 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4193792 len 1024 2024-04-20T12:24:51.152 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-04-20T12:24:51.152 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4193792 len 1024 2024-04-20T12:24:51.152 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193792 len 1024 2024-04-20T12:24:51.152 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4193792 len 2048 2024-04-20T12:24:51.152 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-04-20T12:24:51.173 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4193792 len 2048 2024-04-20T12:24:51.173 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193792 len 2048 2024-04-20T12:24:51.173 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4193792 len 4096 2024-04-20T12:24:51.173 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-04-20T12:24:51.173 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4193792 len 4096 2024-04-20T12:24:51.173 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193792 len 4096 2024-04-20T12:24:51.173 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4193792 len 8192 2024-04-20T12:24:51.174 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-04-20T12:24:51.174 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4193792 len 8192 2024-04-20T12:24:51.174 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193792 len 8192 2024-04-20T12:24:51.174 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4193792 len 16384 2024-04-20T12:24:51.174 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-04-20T12:24:51.174 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4193792 len 16384 2024-04-20T12:24:51.174 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4193792 len 16384 2024-04-20T12:24:51.174 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4194304 len 1024 2024-04-20T12:24:51.174 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-04-20T12:24:51.174 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4194304 len 1024 2024-04-20T12:24:51.174 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194304 len 1024 2024-04-20T12:24:51.174 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4194304 len 2048 2024-04-20T12:24:51.174 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-04-20T12:24:51.174 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4194304 len 2048 2024-04-20T12:24:51.175 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194304 len 2048 2024-04-20T12:24:51.175 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4194304 len 4096 2024-04-20T12:24:51.175 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-04-20T12:24:51.175 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4194304 len 4096 2024-04-20T12:24:51.175 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194304 len 4096 2024-04-20T12:24:51.175 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4194304 len 8192 2024-04-20T12:24:51.175 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-04-20T12:24:51.175 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4194304 len 8192 2024-04-20T12:24:51.175 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194304 len 8192 2024-04-20T12:24:51.175 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4194304 len 16384 2024-04-20T12:24:51.175 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-04-20T12:24:51.175 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4194304 len 16384 2024-04-20T12:24:51.175 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194304 len 16384 2024-04-20T12:24:51.175 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4194816 len 1024 2024-04-20T12:24:51.175 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-04-20T12:24:51.176 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4194816 len 1024 2024-04-20T12:24:51.176 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194816 len 1024 2024-04-20T12:24:51.176 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4194816 len 2048 2024-04-20T12:24:51.176 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-04-20T12:24:51.176 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4194816 len 2048 2024-04-20T12:24:51.176 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194816 len 2048 2024-04-20T12:24:51.176 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4194816 len 4096 2024-04-20T12:24:51.176 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-04-20T12:24:51.176 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4194816 len 4096 2024-04-20T12:24:51.176 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194816 len 4096 2024-04-20T12:24:51.176 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4194816 len 8192 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4194816 len 8192 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194816 len 8192 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4194816 len 16384 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4194816 len 16384 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4194816 len 16384 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4195328 len 1024 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4195328 len 1024 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195328 len 1024 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4195328 len 2048 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4195328 len 2048 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195328 len 2048 2024-04-20T12:24:51.177 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4195328 len 4096 2024-04-20T12:24:51.178 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-04-20T12:24:51.178 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4195328 len 4096 2024-04-20T12:24:51.178 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195328 len 4096 2024-04-20T12:24:51.178 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4195328 len 8192 2024-04-20T12:24:51.178 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-04-20T12:24:51.178 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4195328 len 8192 2024-04-20T12:24:51.178 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195328 len 8192 2024-04-20T12:24:51.178 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4195328 len 16384 2024-04-20T12:24:51.178 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-04-20T12:24:51.178 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4195328 len 16384 2024-04-20T12:24:51.178 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195328 len 16384 2024-04-20T12:24:51.178 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4195840 len 1024 2024-04-20T12:24:51.178 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-04-20T12:24:51.178 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4195840 len 1024 2024-04-20T12:24:51.179 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195840 len 1024 2024-04-20T12:24:51.179 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4195840 len 2048 2024-04-20T12:24:51.179 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-04-20T12:24:51.179 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4195840 len 2048 2024-04-20T12:24:51.179 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195840 len 2048 2024-04-20T12:24:51.195 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4195840 len 4096 2024-04-20T12:24:51.195 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-04-20T12:24:51.195 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4195840 len 4096 2024-04-20T12:24:51.195 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195840 len 4096 2024-04-20T12:24:51.196 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4195840 len 8192 2024-04-20T12:24:51.196 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-04-20T12:24:51.196 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4195840 len 8192 2024-04-20T12:24:51.196 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195840 len 8192 2024-04-20T12:24:51.196 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4195840 len 16384 2024-04-20T12:24:51.196 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-04-20T12:24:51.196 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4195840 len 16384 2024-04-20T12:24:51.196 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4195840 len 16384 2024-04-20T12:24:51.196 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4196352 len 1024 2024-04-20T12:24:51.196 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-04-20T12:24:51.196 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4196352 len 1024 2024-04-20T12:24:51.196 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196352 len 1024 2024-04-20T12:24:51.196 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4196352 len 2048 2024-04-20T12:24:51.196 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-04-20T12:24:51.196 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4196352 len 2048 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196352 len 2048 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4196352 len 4096 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4196352 len 4096 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196352 len 4096 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4196352 len 8192 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4196352 len 8192 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196352 len 8192 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4196352 len 16384 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4196352 len 16384 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196352 len 16384 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4196864 len 1024 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-04-20T12:24:51.197 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4196864 len 1024 2024-04-20T12:24:51.198 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196864 len 1024 2024-04-20T12:24:51.198 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4196864 len 2048 2024-04-20T12:24:51.198 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-04-20T12:24:51.198 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4196864 len 2048 2024-04-20T12:24:51.198 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196864 len 2048 2024-04-20T12:24:51.198 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4196864 len 4096 2024-04-20T12:24:51.198 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-04-20T12:24:51.198 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4196864 len 4096 2024-04-20T12:24:51.198 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196864 len 4096 2024-04-20T12:24:51.198 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4196864 len 8192 2024-04-20T12:24:51.198 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-04-20T12:24:51.198 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4196864 len 8192 2024-04-20T12:24:51.198 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196864 len 8192 2024-04-20T12:24:51.198 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4196864 len 16384 2024-04-20T12:24:51.198 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-04-20T12:24:51.199 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4196864 len 16384 2024-04-20T12:24:51.199 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4196864 len 16384 2024-04-20T12:24:51.199 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4197376 len 1024 2024-04-20T12:24:51.199 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-04-20T12:24:51.199 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4197376 len 1024 2024-04-20T12:24:51.199 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197376 len 1024 2024-04-20T12:24:51.199 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4197376 len 2048 2024-04-20T12:24:51.199 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-04-20T12:24:51.199 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4197376 len 2048 2024-04-20T12:24:51.199 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197376 len 2048 2024-04-20T12:24:51.199 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4197376 len 4096 2024-04-20T12:24:51.199 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-04-20T12:24:51.199 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4197376 len 4096 2024-04-20T12:24:51.199 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197376 len 4096 2024-04-20T12:24:51.199 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4197376 len 8192 2024-04-20T12:24:51.200 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-04-20T12:24:51.200 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4197376 len 8192 2024-04-20T12:24:51.200 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197376 len 8192 2024-04-20T12:24:51.200 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4197376 len 16384 2024-04-20T12:24:51.200 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-04-20T12:24:51.200 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4197376 len 16384 2024-04-20T12:24:51.200 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197376 len 16384 2024-04-20T12:24:51.200 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4197888 len 1024 2024-04-20T12:24:51.200 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-04-20T12:24:51.200 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4197888 len 1024 2024-04-20T12:24:51.200 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197888 len 1024 2024-04-20T12:24:51.200 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4197888 len 2048 2024-04-20T12:24:51.200 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-04-20T12:24:51.200 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4197888 len 2048 2024-04-20T12:24:51.201 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197888 len 2048 2024-04-20T12:24:51.201 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4197888 len 4096 2024-04-20T12:24:51.201 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-04-20T12:24:51.201 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4197888 len 4096 2024-04-20T12:24:51.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.217+0000 7f3295d2c640 1 -- 172.21.15.135:0/947223328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3290109480 msgr2=0x7f3290111050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.217+0000 7f3295d2c640 1 --2- 172.21.15.135:0/947223328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3290109480 0x7f3290111050 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f3288009ca0 tx=0x7f328802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.217+0000 7f3295d2c640 1 -- 172.21.15.135:0/947223328 shutdown_connections 2024-04-20T12:24:51.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.217+0000 7f3295d2c640 1 --2- 172.21.15.135:0/947223328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3290109480 0x7f3290111050 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.217+0000 7f3295d2c640 1 --2- 172.21.15.135:0/947223328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3290104d60 0x7f3290108da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.217+0000 7f3295d2c640 1 --2- 172.21.15.135:0/947223328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f32901043b0 0x7f3290104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.217+0000 7f3295d2c640 1 -- 172.21.15.135:0/947223328 >> 172.21.15.135:0/947223328 conn(0x7f32900ffc50 msgr2=0x7f3290102070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.218+0000 7f3295d2c640 1 -- 172.21.15.135:0/947223328 shutdown_connections 2024-04-20T12:24:51.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.218+0000 7f3295d2c640 1 -- 172.21.15.135:0/947223328 wait complete. 2024-04-20T12:24:51.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.218+0000 7f3295d2c640 1 Processor -- start 2024-04-20T12:24:51.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.218+0000 7f3295d2c640 1 -- start start 2024-04-20T12:24:51.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f3295d2c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32901043b0 0x7f32901a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f3295d2c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3290109480 0x7f32901a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f3295d2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f329019a720 0x7f329019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f3295d2c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3290114520 con 0x7f32901043b0 2024-04-20T12:24:51.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f3295d2c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f32901143a0 con 0x7f3290109480 2024-04-20T12:24:51.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f3295d2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f32901146a0 con 0x7f329019a720 2024-04-20T12:24:51.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f328f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32901043b0 0x7f32901a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f328effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3290109480 0x7f32901a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f328f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32901043b0 0x7f32901a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36116/0 (socket says 172.21.15.135:36116) 2024-04-20T12:24:51.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f328f7fe640 1 -- 172.21.15.135:0/3028939156 learned_addr learned my addr 172.21.15.135:0/3028939156 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f328ffff640 1 --2- 172.21.15.135:0/3028939156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f329019a720 0x7f329019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f328effd640 1 -- 172.21.15.135:0/3028939156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f329019a720 msgr2=0x7f329019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f328effd640 1 --2- 172.21.15.135:0/3028939156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f329019a720 0x7f329019aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f328effd640 1 -- 172.21.15.135:0/3028939156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32901043b0 msgr2=0x7f32901a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f328effd640 1 --2- 172.21.15.135:0/3028939156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32901043b0 0x7f32901a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f328effd640 1 -- 172.21.15.135:0/3028939156 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329019b320 con 0x7f3290109480 2024-04-20T12:24:51.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f328effd640 1 --2- 172.21.15.135:0/3028939156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3290109480 0x7f32901a0ba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f328400e9c0 tx=0x7f328400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f328cff9640 1 -- 172.21.15.135:0/3028939156 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328400ccc0 con 0x7f3290109480 2024-04-20T12:24:51.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f3295d2c640 1 -- 172.21.15.135:0/3028939156 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32901a7400 con 0x7f3290109480 2024-04-20T12:24:51.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f328cff9640 1 -- 172.21.15.135:0/3028939156 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3284010910 con 0x7f3290109480 2024-04-20T12:24:51.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f328cff9640 1 -- 172.21.15.135:0/3028939156 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284018880 con 0x7f3290109480 2024-04-20T12:24:51.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.219+0000 7f3295d2c640 1 -- 172.21.15.135:0/3028939156 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32901a7860 con 0x7f3290109480 2024-04-20T12:24:51.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.222+0000 7f328cff9640 1 -- 172.21.15.135:0/3028939156 <== mon.2 v2:172.21.15.139:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f3284010ac0 con 0x7f3290109480 2024-04-20T12:24:51.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.222+0000 7f32989f1740 1 Processor -- start 2024-04-20T12:24:51.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.222+0000 7f32989f1740 1 -- start start 2024-04-20T12:24:51.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.222+0000 7f328cff9640 1 --2- 172.21.15.135:0/3028939156 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32780a3d20 0x7f32780a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f32989f1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006383e10 0x5590063841f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f32989f1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559006384730 0x55900638cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f32989f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55900638d310 0x55900638f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f32989f1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5590062e9110 con 0x559006384730 2024-04-20T12:24:51.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f32989f1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559006286550 con 0x559006383e10 2024-04-20T12:24:51.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f32989f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5590062e50d0 con 0x55900638d310 2024-04-20T12:24:51.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328ffff640 1 --2- 172.21.15.135:0/3028939156 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32780a3d20 0x7f32780a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328cff9640 1 -- 172.21.15.135:0/3028939156 <== mon.2 v2:172.21.15.139:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f32840d0f10 con 0x7f3290109480 2024-04-20T12:24:51.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559006384730 0x55900638cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006383e10 0x5590063841f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559006384730 0x55900638cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36128/0 (socket says 172.21.15.135:36128) 2024-04-20T12:24:51.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006383e10 0x5590063841f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:38956/0 (socket says 172.21.15.135:38956) 2024-04-20T12:24:51.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328effd640 1 -- 172.21.15.135:0/3372891557 learned_addr learned my addr 172.21.15.135:0/3372891557 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328ffff640 1 --2- 172.21.15.135:0/3372891557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55900638d310 0x55900638f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328f7fe640 1 -- 172.21.15.135:0/3372891557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55900638d310 msgr2=0x55900638f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328f7fe640 1 --2- 172.21.15.135:0/3372891557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55900638d310 0x55900638f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328f7fe640 1 -- 172.21.15.135:0/3372891557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559006384730 msgr2=0x55900638cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328f7fe640 1 --2- 172.21.15.135:0/3372891557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559006384730 0x55900638cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328f7fe640 1 -- 172.21.15.135:0/3372891557 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590062ae900 con 0x559006383e10 2024-04-20T12:24:51.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328effd640 1 --2- 172.21.15.135:0/3372891557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559006384730 0x55900638cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328ffff640 1 --2- 172.21.15.135:0/3028939156 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32780a3d20 0x7f32780a61e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3288005cc0 tx=0x7f328802cee0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f328f7fe640 1 --2- 172.21.15.135:0/3372891557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006383e10 0x5590063841f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f328000aca0 tx=0x7f328000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74a1294baeb993d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.223+0000 7f3275ffb640 1 -- 172.21.15.135:0/3372891557 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280005220 con 0x559006383e10 2024-04-20T12:24:51.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.224+0000 7f3275ffb640 1 -- 172.21.15.135:0/3372891557 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3280004c80 con 0x559006383e10 2024-04-20T12:24:51.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.224+0000 7f3275ffb640 1 -- 172.21.15.135:0/3372891557 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32800187e0 con 0x559006383e10 2024-04-20T12:24:51.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.224+0000 7f32989f1740 1 -- 172.21.15.135:0/3372891557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006383e10 msgr2=0x5590063841f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.224+0000 7f32989f1740 1 --2- 172.21.15.135:0/3372891557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006383e10 0x5590063841f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f328000aca0 tx=0x7f328000f790 comp rx=0 tx=0).stop 2024-04-20T12:24:51.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.224+0000 7f32989f1740 1 -- 172.21.15.135:0/3372891557 shutdown_connections 2024-04-20T12:24:51.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.224+0000 7f32989f1740 1 --2- 172.21.15.135:0/3372891557 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55900638d310 0x55900638f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.224+0000 7f32989f1740 1 --2- 172.21.15.135:0/3372891557 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559006384730 0x55900638cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.224+0000 7f32989f1740 1 --2- 172.21.15.135:0/3372891557 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006383e10 0x5590063841f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.224+0000 7f32989f1740 1 -- 172.21.15.135:0/3372891557 >> 172.21.15.135:0/3372891557 conn(0x55900637e540 msgr2=0x55900637e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.224+0000 7f32989f1740 1 -- 172.21.15.135:0/3372891557 shutdown_connections 2024-04-20T12:24:51.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.224+0000 7f32989f1740 1 -- 172.21.15.135:0/3372891557 wait complete. 2024-04-20T12:24:51.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.225+0000 7f32989f1740 1 -- start start 2024-04-20T12:24:51.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.225+0000 7f32989f1740 1 Processor -- start 2024-04-20T12:24:51.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.225+0000 7f32989f1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006383e10 0x55900638a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.225+0000 7f32989f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559006384730 0x55900638a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.225+0000 7f32989f1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55900638d310 0x55900638aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.225+0000 7f32989f1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559006390040 con 0x55900638d310 2024-04-20T12:24:51.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.225+0000 7f32989f1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5590062a2500 con 0x559006383e10 2024-04-20T12:24:51.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.225+0000 7f32989f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5590063901c0 con 0x559006384730 2024-04-20T12:24:51.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.225+0000 7f32989f1740 10 client.0 _ll_register_callbacks cb 0x5590062872f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:51.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.225+0000 7f328ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55900638d310 0x55900638aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.225+0000 7f328f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006383e10 0x55900638a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.225+0000 7f328ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55900638d310 0x55900638aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36134/0 (socket says 172.21.15.135:36134) 2024-04-20T12:24:51.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.225+0000 7f328ffff640 1 -- 172.21.15.135:0/2983018673 learned_addr learned my addr 172.21.15.135:0/2983018673 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f328effd640 1 --2- 172.21.15.135:0/2983018673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559006384730 0x55900638a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f328ffff640 1 -- 172.21.15.135:0/2983018673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559006384730 msgr2=0x55900638a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f328ffff640 1 --2- 172.21.15.135:0/2983018673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559006384730 0x55900638a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f328ffff640 1 -- 172.21.15.135:0/2983018673 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006383e10 msgr2=0x55900638a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f328ffff640 1 --2- 172.21.15.135:0/2983018673 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006383e10 0x55900638a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f328ffff640 1 -- 172.21.15.135:0/2983018673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559005ffb3f0 con 0x55900638d310 2024-04-20T12:24:51.232 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f328f7fe640 1 --2- 172.21.15.135:0/2983018673 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006383e10 0x55900638a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f328ffff640 1 --2- 172.21.15.135:0/2983018673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55900638d310 0x55900638aeb0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3288036000 tx=0x7f328802c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8537aaab7e6f6c44 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f326effd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:51.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f326effd640 1 -- 172.21.15.135:0/2983018673 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288052060 con 0x55900638d310 2024-04-20T12:24:51.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f326effd640 1 -- 172.21.15.135:0/2983018673 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f3288004240 con 0x55900638d310 2024-04-20T12:24:51.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f32989f1740 1 -- 172.21.15.135:0/2983018673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3280004c80 con 0x55900638d310 2024-04-20T12:24:51.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f326effd640 1 -- 172.21.15.135:0/2983018673 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3288059050 con 0x55900638d310 2024-04-20T12:24:51.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f32989f1740 10 client.16275 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:51.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f32989f1740 1 -- 172.21.15.135:0/2983018673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5590060c57d0 con 0x55900638d310 2024-04-20T12:24:51.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.226+0000 7f326effd640 1 -- 172.21.15.135:0/2983018673 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3280004c80 con 0x55900638d310 2024-04-20T12:24:51.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.227+0000 7f326effd640 1 -- 172.21.15.135:0/2983018673 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f328804d840 con 0x55900638d310 2024-04-20T12:24:51.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.227+0000 7f32989f1740 10 client.16275 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:51.233 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.227+0000 7f32989f1740 10 client.16275 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:24:51.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.227+0000 7f32989f1740 20 client.16275 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:51.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.227+0000 7f32989f1740 1 --2- 172.21.15.135:0/2983018673 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55900639d970 0x55900639fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.227+0000 7f32989f1740 4 client.16275 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:51.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.227+0000 7f32989f1740 1 -- 172.21.15.135:0/2983018673 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590062f6b30 con 0x55900639d970 2024-04-20T12:24:51.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.227+0000 7f328f7fe640 1 --2- 172.21.15.135:0/2983018673 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55900639d970 0x55900639fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.227+0000 7f326effd640 10 client.16275 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:24:51.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.227+0000 7f328f7fe640 1 --2- 172.21.15.135:0/2983018673 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55900639d970 0x55900639fd60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c2759e3de5fc8e3b server_cookie=1d80063a8a325df8 in_seq=0 out_seq=0 2024-04-20T12:24:51.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.228+0000 7f326effd640 1 -- 172.21.15.135:0/2983018673 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5590062f6b30 con 0x55900639d970 2024-04-20T12:24:51.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.228+0000 7f326effd640 10 client.16275 handle_command_reply: tid=0 2024-04-20T12:24:51.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.228+0000 7f32989f1740 1 client.16275 shutdown 2024-04-20T12:24:51.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.228+0000 7f32989f1740 1 -- 172.21.15.135:0/2983018673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55900638d310 msgr2=0x55900638aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.228+0000 7f32989f1740 1 --2- 172.21.15.135:0/2983018673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55900638d310 0x55900638aeb0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3288036000 tx=0x7f328802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.234 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.228+0000 7f32989f1740 1 -- 172.21.15.135:0/2983018673 shutdown_connections 2024-04-20T12:24:51.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.228+0000 7f32989f1740 1 --2- 172.21.15.135:0/2983018673 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55900639d970 0x55900639fd60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.228+0000 7f32989f1740 1 --2- 172.21.15.135:0/2983018673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55900638d310 0x55900638aeb0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.228+0000 7f32989f1740 1 --2- 172.21.15.135:0/2983018673 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559006384730 0x55900638a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.228+0000 7f32989f1740 1 --2- 172.21.15.135:0/2983018673 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006383e10 0x55900638a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.228+0000 7f326effd640 0 client.16275 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:24:51.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.228+0000 7f32989f1740 1 -- 172.21.15.135:0/2983018673 >> 172.21.15.135:0/2983018673 conn(0x55900637e540 msgr2=0x559006380290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.228+0000 7f32989f1740 1 -- 172.21.15.135:0/2983018673 shutdown_connections 2024-04-20T12:24:51.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.228+0000 7f32989f1740 1 -- 172.21.15.135:0/2983018673 wait complete. 2024-04-20T12:24:51.235 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.228+0000 7f32989f1740 20 client.16275 trim_cache size 0 max 16384 2024-04-20T12:24:51.235 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197888 len 4096 2024-04-20T12:24:51.235 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4197888 len 8192 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4197888 len 8192 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197888 len 8192 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2048 offset 4197888 len 16384 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2048 offset 4197888 len 16384 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2048 offset 4197888 len 16384 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4190208 len 1024 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4190208 len 1024 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190208 len 1024 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4190208 len 2048 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4190208 len 2048 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190208 len 2048 2024-04-20T12:24:51.236 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4190208 len 4096 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4190208 len 4096 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190208 len 4096 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4190208 len 8192 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4190208 len 8192 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190208 len 8192 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4190208 len 16384 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4190208 len 16384 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190208 len 16384 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4190720 len 1024 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4190720 len 1024 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190720 len 1024 2024-04-20T12:24:51.237 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4190720 len 2048 2024-04-20T12:24:51.238 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-04-20T12:24:51.238 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4190720 len 2048 2024-04-20T12:24:51.238 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190720 len 2048 2024-04-20T12:24:51.238 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4190720 len 4096 2024-04-20T12:24:51.238 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-04-20T12:24:51.238 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4190720 len 4096 2024-04-20T12:24:51.238 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190720 len 4096 2024-04-20T12:24:51.238 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4190720 len 8192 2024-04-20T12:24:51.238 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-04-20T12:24:51.238 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4190720 len 8192 2024-04-20T12:24:51.238 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190720 len 8192 2024-04-20T12:24:51.238 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4190720 len 16384 2024-04-20T12:24:51.238 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-04-20T12:24:51.238 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4190720 len 16384 2024-04-20T12:24:51.239 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4190720 len 16384 2024-04-20T12:24:51.239 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4191232 len 1024 2024-04-20T12:24:51.239 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-04-20T12:24:51.239 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4191232 len 1024 2024-04-20T12:24:51.239 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191232 len 1024 2024-04-20T12:24:51.239 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4191232 len 2048 2024-04-20T12:24:51.239 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-04-20T12:24:51.239 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4191232 len 2048 2024-04-20T12:24:51.239 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191232 len 2048 2024-04-20T12:24:51.239 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4191232 len 4096 2024-04-20T12:24:51.239 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-04-20T12:24:51.239 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4191232 len 4096 2024-04-20T12:24:51.239 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191232 len 4096 2024-04-20T12:24:51.240 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4191232 len 8192 2024-04-20T12:24:51.240 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-04-20T12:24:51.240 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4191232 len 8192 2024-04-20T12:24:51.240 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191232 len 8192 2024-04-20T12:24:51.240 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4191232 len 16384 2024-04-20T12:24:51.240 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-04-20T12:24:51.240 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4191232 len 16384 2024-04-20T12:24:51.240 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191232 len 16384 2024-04-20T12:24:51.240 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4191744 len 1024 2024-04-20T12:24:51.240 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-04-20T12:24:51.240 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4191744 len 1024 2024-04-20T12:24:51.240 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191744 len 1024 2024-04-20T12:24:51.240 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4191744 len 2048 2024-04-20T12:24:51.240 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-04-20T12:24:51.241 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4191744 len 2048 2024-04-20T12:24:51.241 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191744 len 2048 2024-04-20T12:24:51.241 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4191744 len 4096 2024-04-20T12:24:51.241 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-04-20T12:24:51.241 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4191744 len 4096 2024-04-20T12:24:51.241 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191744 len 4096 2024-04-20T12:24:51.241 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4191744 len 8192 2024-04-20T12:24:51.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.245+0000 7f32989f1740 1 Processor -- start 2024-04-20T12:24:51.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.245+0000 7f32989f1740 1 -- start start 2024-04-20T12:24:51.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.245+0000 7f32989f1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559006383e10 0x55900638cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.245+0000 7f32989f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559006384730 0x5590063a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.245+0000 7f32989f1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55900638d310 0x5590063a5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.245+0000 7f32989f1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f32901b15e0 con 0x559006383e10 2024-04-20T12:24:51.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.245+0000 7f32989f1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f32901b3120 con 0x55900638d310 2024-04-20T12:24:51.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.245+0000 7f32989f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f32901b1cb0 con 0x559006384730 2024-04-20T12:24:51.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.245+0000 7f328f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559006383e10 0x55900638cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.245+0000 7f328ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55900638d310 0x5590063a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.245+0000 7f328f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559006383e10 0x55900638cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36150/0 (socket says 172.21.15.135:36150) 2024-04-20T12:24:51.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.245+0000 7f328f7fe640 1 -- 172.21.15.135:0/508369968 learned_addr learned my addr 172.21.15.135:0/508369968 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.245+0000 7f328effd640 1 --2- 172.21.15.135:0/508369968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559006384730 0x5590063a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.246+0000 7f328ffff640 1 -- 172.21.15.135:0/508369968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559006384730 msgr2=0x5590063a53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.246+0000 7f328ffff640 1 --2- 172.21.15.135:0/508369968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559006384730 0x5590063a53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.246+0000 7f328ffff640 1 -- 172.21.15.135:0/508369968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559006383e10 msgr2=0x55900638cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.246+0000 7f328ffff640 1 --2- 172.21.15.135:0/508369968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559006383e10 0x55900638cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.246+0000 7f328ffff640 1 -- 172.21.15.135:0/508369968 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559006379be0 con 0x55900638d310 2024-04-20T12:24:51.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.246+0000 7f328f7fe640 1 --2- 172.21.15.135:0/508369968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559006383e10 0x55900638cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.246+0000 7f328ffff640 1 --2- 172.21.15.135:0/508369968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55900638d310 0x5590063a5930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f328802f020 tx=0x7f328802ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1772b0d4f7a47646 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.246+0000 7f32757fa640 1 -- 172.21.15.135:0/508369968 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288052050 con 0x55900638d310 2024-04-20T12:24:51.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.246+0000 7f32757fa640 1 -- 172.21.15.135:0/508369968 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3288032e60 con 0x55900638d310 2024-04-20T12:24:51.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.246+0000 7f32757fa640 1 -- 172.21.15.135:0/508369968 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288039040 con 0x55900638d310 2024-04-20T12:24:51.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.247+0000 7f32989f1740 1 -- 172.21.15.135:0/508369968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55900638d310 msgr2=0x5590063a5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.247+0000 7f32989f1740 1 --2- 172.21.15.135:0/508369968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55900638d310 0x5590063a5930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f328802f020 tx=0x7f328802ce00 comp rx=0 tx=0).stop 2024-04-20T12:24:51.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.247+0000 7f32989f1740 1 -- 172.21.15.135:0/508369968 shutdown_connections 2024-04-20T12:24:51.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.247+0000 7f32989f1740 1 --2- 172.21.15.135:0/508369968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55900638d310 0x5590063a5930 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.247+0000 7f32989f1740 1 --2- 172.21.15.135:0/508369968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559006384730 0x5590063a53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.247+0000 7f32989f1740 1 --2- 172.21.15.135:0/508369968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559006383e10 0x55900638cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.247+0000 7f32989f1740 1 -- 172.21.15.135:0/508369968 >> 172.21.15.135:0/508369968 conn(0x55900637e540 msgr2=0x559006385790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.247+0000 7f32989f1740 1 -- 172.21.15.135:0/508369968 shutdown_connections 2024-04-20T12:24:51.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.247+0000 7f32989f1740 1 -- 172.21.15.135:0/508369968 wait complete. 2024-04-20T12:24:51.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.247+0000 7f32989f1740 1 -- start start 2024-04-20T12:24:51.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f32989f1740 1 Processor -- start 2024-04-20T12:24:51.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f32989f1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559006383e10 0x559006395470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f32989f1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006384730 0x5590063959b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f32989f1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55900638d310 0x5590063867e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f32989f1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f32901b2a50 con 0x55900638d310 2024-04-20T12:24:51.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f32989f1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f32901b2380 con 0x559006384730 2024-04-20T12:24:51.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f32989f1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f32901af5b0 con 0x559006383e10 2024-04-20T12:24:51.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f32989f1740 10 client.0 _ll_register_callbacks cb 0x7f3288047070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:51.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f328ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55900638d310 0x5590063867e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f328effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006384730 0x5590063959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f328ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55900638d310 0x5590063867e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36162/0 (socket says 172.21.15.135:36162) 2024-04-20T12:24:51.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f328effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006384730 0x5590063959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:38984/0 (socket says 172.21.15.135:38984) 2024-04-20T12:24:51.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f328ffff640 1 -- 172.21.15.135:0/1951773825 learned_addr learned my addr 172.21.15.135:0/1951773825 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f328f7fe640 1 --2- 172.21.15.135:0/1951773825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559006383e10 0x559006395470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f328effd640 1 -- 172.21.15.135:0/1951773825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559006383e10 msgr2=0x559006395470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f328effd640 1 --2- 172.21.15.135:0/1951773825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559006383e10 0x559006395470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f328effd640 1 -- 172.21.15.135:0/1951773825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55900638d310 msgr2=0x5590063867e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f328effd640 1 --2- 172.21.15.135:0/1951773825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55900638d310 0x5590063867e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f328effd640 1 -- 172.21.15.135:0/1951773825 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559006386ed0 con 0x559006384730 2024-04-20T12:24:51.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f328ffff640 1 --2- 172.21.15.135:0/1951773825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55900638d310 0x5590063867e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f328effd640 1 --2- 172.21.15.135:0/1951773825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006384730 0x5590063959b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3284098f90 tx=0x7f3284053180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1420a0de03c07078 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.248+0000 7f326effd640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-20T12:24:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.249+0000 7f326effd640 1 -- 172.21.15.135:0/1951773825 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328409de60 con 0x559006384730 2024-04-20T12:24:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.249+0000 7f326effd640 1 -- 172.21.15.135:0/1951773825 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f32840991a0 con 0x559006384730 2024-04-20T12:24:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.249+0000 7f32989f1740 1 -- 172.21.15.135:0/1951773825 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3288032e60 con 0x559006384730 2024-04-20T12:24:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.249+0000 7f326effd640 1 -- 172.21.15.135:0/1951773825 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f32840b6050 con 0x559006384730 2024-04-20T12:24:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.249+0000 7f32989f1740 10 client.25688 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.249+0000 7f32989f1740 1 -- 172.21.15.135:0/1951773825 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5590064036a0 con 0x559006384730 2024-04-20T12:24:51.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.249+0000 7f326effd640 1 -- 172.21.15.135:0/1951773825 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3288032e60 con 0x559006384730 2024-04-20T12:24:51.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.249+0000 7f326effd640 1 -- 172.21.15.135:0/1951773825 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f3284098880 con 0x559006384730 2024-04-20T12:24:51.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.249+0000 7f32989f1740 10 client.25688 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:51.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.249+0000 7f32989f1740 10 client.25688 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:24:51.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.249+0000 7f32989f1740 20 client.25688 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:51.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.249+0000 7f32989f1740 1 --2- 172.21.15.135:0/1951773825 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x559006403e50 0x559006406270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.249+0000 7f32989f1740 4 client.25688 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:24:51.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.249+0000 7f32989f1740 1 -- 172.21.15.135:0/1951773825 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5590062f09a0 con 0x559006403e50 2024-04-20T12:24:51.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.249+0000 7f328f7fe640 1 --2- 172.21.15.135:0/1951773825 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x559006403e50 0x559006406270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f326effd640 10 client.25688 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:24:51.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f328f7fe640 1 --2- 172.21.15.135:0/1951773825 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x559006403e50 0x559006406270 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6a97ce187e59d22a server_cookie=e92ab53c411913c in_seq=0 out_seq=0 2024-04-20T12:24:51.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f326effd640 1 -- 172.21.15.135:0/1951773825 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5590062f09a0 con 0x559006403e50 2024-04-20T12:24:51.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f326effd640 10 client.25688 handle_command_reply: tid=0 2024-04-20T12:24:51.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f32989f1740 1 client.25688 shutdown 2024-04-20T12:24:51.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f32989f1740 1 -- 172.21.15.135:0/1951773825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006384730 msgr2=0x5590063959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f32989f1740 1 --2- 172.21.15.135:0/1951773825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006384730 0x5590063959b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3284098f90 tx=0x7f3284053180 comp rx=0 tx=0).stop 2024-04-20T12:24:51.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f32989f1740 1 -- 172.21.15.135:0/1951773825 shutdown_connections 2024-04-20T12:24:51.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f32989f1740 1 --2- 172.21.15.135:0/1951773825 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x559006403e50 0x559006406270 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f32989f1740 1 --2- 172.21.15.135:0/1951773825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55900638d310 0x5590063867e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f32989f1740 1 --2- 172.21.15.135:0/1951773825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559006384730 0x5590063959b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f32989f1740 1 --2- 172.21.15.135:0/1951773825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559006383e10 0x559006395470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f326effd640 0 client.25688 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:24:51.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f32989f1740 1 -- 172.21.15.135:0/1951773825 >> 172.21.15.135:0/1951773825 conn(0x55900637e540 msgr2=0x55900637ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f32989f1740 1 -- 172.21.15.135:0/1951773825 shutdown_connections 2024-04-20T12:24:51.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f32989f1740 1 -- 172.21.15.135:0/1951773825 wait complete. 2024-04-20T12:24:51.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.250+0000 7f32989f1740 20 client.25688 trim_cache size 0 max 16384 2024-04-20T12:24:51.268 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:24:51.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.251+0000 7f3295d2c640 1 -- 172.21.15.135:0/3028939156 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32780a3d20 msgr2=0x7f32780a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.251+0000 7f3295d2c640 1 --2- 172.21.15.135:0/3028939156 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32780a3d20 0x7f32780a61e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3288005cc0 tx=0x7f328802cee0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.251+0000 7f3295d2c640 1 -- 172.21.15.135:0/3028939156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3290109480 msgr2=0x7f32901a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.251+0000 7f3295d2c640 1 --2- 172.21.15.135:0/3028939156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3290109480 0x7f32901a0ba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f328400e9c0 tx=0x7f328400ee80 comp rx=0 tx=0).stop 2024-04-20T12:24:51.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.251+0000 7f3295d2c640 1 -- 172.21.15.135:0/3028939156 shutdown_connections 2024-04-20T12:24:51.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.251+0000 7f3295d2c640 1 --2- 172.21.15.135:0/3028939156 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32780a3d20 0x7f32780a61e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.251+0000 7f3295d2c640 1 --2- 172.21.15.135:0/3028939156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f329019a720 0x7f329019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.251+0000 7f3295d2c640 1 --2- 172.21.15.135:0/3028939156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3290109480 0x7f32901a0ba0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.251+0000 7f3295d2c640 1 --2- 172.21.15.135:0/3028939156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32901043b0 0x7f32901a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.251+0000 7f3295d2c640 1 -- 172.21.15.135:0/3028939156 >> 172.21.15.135:0/3028939156 conn(0x7f32900ffc50 msgr2=0x7f3290100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.251+0000 7f3295d2c640 1 -- 172.21.15.135:0/3028939156 shutdown_connections 2024-04-20T12:24:51.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.251+0000 7f3295d2c640 1 -- 172.21.15.135:0/3028939156 wait complete. 2024-04-20T12:24:51.271 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:24:51.276 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-04-20T12:24:51.276 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4191744 len 8192 2024-04-20T12:24:51.276 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191744 len 8192 2024-04-20T12:24:51.276 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4191744 len 16384 2024-04-20T12:24:51.276 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-04-20T12:24:51.276 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4191744 len 16384 2024-04-20T12:24:51.276 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4191744 len 16384 2024-04-20T12:24:51.276 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4192256 len 1024 2024-04-20T12:24:51.276 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-04-20T12:24:51.276 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4192256 len 1024 2024-04-20T12:24:51.277 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192256 len 1024 2024-04-20T12:24:51.277 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4192256 len 2048 2024-04-20T12:24:51.277 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-04-20T12:24:51.277 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4192256 len 2048 2024-04-20T12:24:51.277 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192256 len 2048 2024-04-20T12:24:51.277 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4192256 len 4096 2024-04-20T12:24:51.277 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-04-20T12:24:51.277 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4192256 len 4096 2024-04-20T12:24:51.277 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192256 len 4096 2024-04-20T12:24:51.277 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4192256 len 8192 2024-04-20T12:24:51.277 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-04-20T12:24:51.277 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4192256 len 8192 2024-04-20T12:24:51.277 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192256 len 8192 2024-04-20T12:24:51.278 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4192256 len 16384 2024-04-20T12:24:51.278 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-04-20T12:24:51.278 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4192256 len 16384 2024-04-20T12:24:51.278 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192256 len 16384 2024-04-20T12:24:51.278 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4192768 len 1024 2024-04-20T12:24:51.278 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-04-20T12:24:51.278 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4192768 len 1024 2024-04-20T12:24:51.278 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192768 len 1024 2024-04-20T12:24:51.278 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4192768 len 2048 2024-04-20T12:24:51.278 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-04-20T12:24:51.278 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4192768 len 2048 2024-04-20T12:24:51.278 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192768 len 2048 2024-04-20T12:24:51.278 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4192768 len 4096 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4192768 len 4096 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192768 len 4096 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4192768 len 8192 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4192768 len 8192 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192768 len 8192 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4192768 len 16384 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4192768 len 16384 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4192768 len 16384 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4193280 len 1024 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4193280 len 1024 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193280 len 1024 2024-04-20T12:24:51.279 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4193280 len 2048 2024-04-20T12:24:51.280 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-04-20T12:24:51.280 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4193280 len 2048 2024-04-20T12:24:51.280 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193280 len 2048 2024-04-20T12:24:51.280 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4193280 len 4096 2024-04-20T12:24:51.280 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-04-20T12:24:51.280 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4193280 len 4096 2024-04-20T12:24:51.280 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193280 len 4096 2024-04-20T12:24:51.280 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4193280 len 8192 2024-04-20T12:24:51.280 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-04-20T12:24:51.280 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4193280 len 8192 2024-04-20T12:24:51.280 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193280 len 8192 2024-04-20T12:24:51.280 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4193280 len 16384 2024-04-20T12:24:51.280 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-04-20T12:24:51.280 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4193280 len 16384 2024-04-20T12:24:51.280 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193280 len 16384 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4193792 len 1024 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4193792 len 1024 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193792 len 1024 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4193792 len 2048 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4193792 len 2048 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193792 len 2048 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4193792 len 4096 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4193792 len 4096 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193792 len 4096 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4193792 len 8192 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4193792 len 8192 2024-04-20T12:24:51.281 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193792 len 8192 2024-04-20T12:24:51.303 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4193792 len 16384 2024-04-20T12:24:51.303 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-04-20T12:24:51.303 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4193792 len 16384 2024-04-20T12:24:51.303 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4193792 len 16384 2024-04-20T12:24:51.304 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4194304 len 1024 2024-04-20T12:24:51.304 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-04-20T12:24:51.304 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4194304 len 1024 2024-04-20T12:24:51.304 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194304 len 1024 2024-04-20T12:24:51.304 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4194304 len 2048 2024-04-20T12:24:51.304 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-04-20T12:24:51.304 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4194304 len 2048 2024-04-20T12:24:51.304 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194304 len 2048 2024-04-20T12:24:51.304 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4194304 len 4096 2024-04-20T12:24:51.304 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-04-20T12:24:51.304 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4194304 len 4096 2024-04-20T12:24:51.304 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194304 len 4096 2024-04-20T12:24:51.304 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4194304 len 8192 2024-04-20T12:24:51.304 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-04-20T12:24:51.304 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4194304 len 8192 2024-04-20T12:24:51.305 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194304 len 8192 2024-04-20T12:24:51.305 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4194304 len 16384 2024-04-20T12:24:51.305 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-04-20T12:24:51.305 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4194304 len 16384 2024-04-20T12:24:51.305 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194304 len 16384 2024-04-20T12:24:51.305 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4194816 len 1024 2024-04-20T12:24:51.305 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-04-20T12:24:51.305 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4194816 len 1024 2024-04-20T12:24:51.305 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194816 len 1024 2024-04-20T12:24:51.305 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4194816 len 2048 2024-04-20T12:24:51.305 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-04-20T12:24:51.305 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4194816 len 2048 2024-04-20T12:24:51.305 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194816 len 2048 2024-04-20T12:24:51.305 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4194816 len 4096 2024-04-20T12:24:51.305 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-04-20T12:24:51.306 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4194816 len 4096 2024-04-20T12:24:51.306 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194816 len 4096 2024-04-20T12:24:51.306 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4194816 len 8192 2024-04-20T12:24:51.306 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-04-20T12:24:51.306 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4194816 len 8192 2024-04-20T12:24:51.306 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194816 len 8192 2024-04-20T12:24:51.306 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4194816 len 16384 2024-04-20T12:24:51.306 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-04-20T12:24:51.306 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4194816 len 16384 2024-04-20T12:24:51.306 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4194816 len 16384 2024-04-20T12:24:51.306 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4195328 len 1024 2024-04-20T12:24:51.306 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-04-20T12:24:51.306 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4195328 len 1024 2024-04-20T12:24:51.306 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195328 len 1024 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4195328 len 2048 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4195328 len 2048 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195328 len 2048 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4195328 len 4096 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4195328 len 4096 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195328 len 4096 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4195328 len 8192 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4195328 len 8192 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195328 len 8192 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4195328 len 16384 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4195328 len 16384 2024-04-20T12:24:51.307 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195328 len 16384 2024-04-20T12:24:51.308 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4195840 len 1024 2024-04-20T12:24:51.308 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-04-20T12:24:51.308 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4195840 len 1024 2024-04-20T12:24:51.308 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195840 len 1024 2024-04-20T12:24:51.308 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4195840 len 2048 2024-04-20T12:24:51.308 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-04-20T12:24:51.308 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4195840 len 2048 2024-04-20T12:24:51.308 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195840 len 2048 2024-04-20T12:24:51.308 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4195840 len 4096 2024-04-20T12:24:51.308 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-04-20T12:24:51.308 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4195840 len 4096 2024-04-20T12:24:51.308 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195840 len 4096 2024-04-20T12:24:51.308 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4195840 len 8192 2024-04-20T12:24:51.308 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-04-20T12:24:51.308 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4195840 len 8192 2024-04-20T12:24:51.309 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195840 len 8192 2024-04-20T12:24:51.309 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4195840 len 16384 2024-04-20T12:24:51.309 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-04-20T12:24:51.330 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4195840 len 16384 2024-04-20T12:24:51.330 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4195840 len 16384 2024-04-20T12:24:51.330 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4196352 len 1024 2024-04-20T12:24:51.330 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-04-20T12:24:51.330 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4196352 len 1024 2024-04-20T12:24:51.330 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196352 len 1024 2024-04-20T12:24:51.330 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4196352 len 2048 2024-04-20T12:24:51.330 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-04-20T12:24:51.330 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4196352 len 2048 2024-04-20T12:24:51.331 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196352 len 2048 2024-04-20T12:24:51.331 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4196352 len 4096 2024-04-20T12:24:51.331 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-04-20T12:24:51.331 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4196352 len 4096 2024-04-20T12:24:51.331 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196352 len 4096 2024-04-20T12:24:51.331 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4196352 len 8192 2024-04-20T12:24:51.331 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-04-20T12:24:51.331 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4196352 len 8192 2024-04-20T12:24:51.331 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196352 len 8192 2024-04-20T12:24:51.331 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4196352 len 16384 2024-04-20T12:24:51.331 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-04-20T12:24:51.331 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4196352 len 16384 2024-04-20T12:24:51.331 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196352 len 16384 2024-04-20T12:24:51.331 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4196864 len 1024 2024-04-20T12:24:51.331 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-04-20T12:24:51.332 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4196864 len 1024 2024-04-20T12:24:51.332 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196864 len 1024 2024-04-20T12:24:51.332 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4196864 len 2048 2024-04-20T12:24:51.332 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-04-20T12:24:51.332 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4196864 len 2048 2024-04-20T12:24:51.332 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196864 len 2048 2024-04-20T12:24:51.332 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4196864 len 4096 2024-04-20T12:24:51.332 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-04-20T12:24:51.332 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4196864 len 4096 2024-04-20T12:24:51.332 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196864 len 4096 2024-04-20T12:24:51.332 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4196864 len 8192 2024-04-20T12:24:51.332 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-04-20T12:24:51.332 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4196864 len 8192 2024-04-20T12:24:51.332 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196864 len 8192 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4196864 len 16384 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4196864 len 16384 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4196864 len 16384 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4197376 len 1024 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4197376 len 1024 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197376 len 1024 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4197376 len 2048 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4197376 len 2048 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197376 len 2048 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4197376 len 4096 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4197376 len 4096 2024-04-20T12:24:51.333 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197376 len 4096 2024-04-20T12:24:51.334 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4197376 len 8192 2024-04-20T12:24:51.334 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-04-20T12:24:51.334 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4197376 len 8192 2024-04-20T12:24:51.334 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197376 len 8192 2024-04-20T12:24:51.334 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4197376 len 16384 2024-04-20T12:24:51.334 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-04-20T12:24:51.334 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4197376 len 16384 2024-04-20T12:24:51.334 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197376 len 16384 2024-04-20T12:24:51.334 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4197888 len 1024 2024-04-20T12:24:51.334 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-04-20T12:24:51.334 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4197888 len 1024 2024-04-20T12:24:51.334 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197888 len 1024 2024-04-20T12:24:51.334 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4197888 len 2048 2024-04-20T12:24:51.334 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-04-20T12:24:51.335 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4197888 len 2048 2024-04-20T12:24:51.335 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197888 len 2048 2024-04-20T12:24:51.335 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4197888 len 4096 2024-04-20T12:24:51.335 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-04-20T12:24:51.335 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4197888 len 4096 2024-04-20T12:24:51.335 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197888 len 4096 2024-04-20T12:24:51.335 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4197888 len 8192 2024-04-20T12:24:51.335 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-04-20T12:24:51.335 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4197888 len 8192 2024-04-20T12:24:51.335 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197888 len 8192 2024-04-20T12:24:51.335 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 2560 offset 4197888 len 16384 2024-04-20T12:24:51.335 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-04-20T12:24:51.335 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 2560 offset 4197888 len 16384 2024-04-20T12:24:51.335 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 2560 offset 4197888 len 16384 2024-04-20T12:24:51.365 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4190208 len 1024 2024-04-20T12:24:51.365 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-04-20T12:24:51.365 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4190208 len 1024 2024-04-20T12:24:51.365 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190208 len 1024 2024-04-20T12:24:51.366 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4190208 len 2048 2024-04-20T12:24:51.366 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-04-20T12:24:51.366 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4190208 len 2048 2024-04-20T12:24:51.366 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190208 len 2048 2024-04-20T12:24:51.366 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4190208 len 4096 2024-04-20T12:24:51.366 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-04-20T12:24:51.366 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4190208 len 4096 2024-04-20T12:24:51.366 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190208 len 4096 2024-04-20T12:24:51.366 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4190208 len 8192 2024-04-20T12:24:51.366 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-04-20T12:24:51.366 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4190208 len 8192 2024-04-20T12:24:51.366 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190208 len 8192 2024-04-20T12:24:51.366 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4190208 len 16384 2024-04-20T12:24:51.367 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-04-20T12:24:51.367 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4190208 len 16384 2024-04-20T12:24:51.367 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190208 len 16384 2024-04-20T12:24:51.367 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4190720 len 1024 2024-04-20T12:24:51.367 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-04-20T12:24:51.367 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4190720 len 1024 2024-04-20T12:24:51.367 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190720 len 1024 2024-04-20T12:24:51.367 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4190720 len 2048 2024-04-20T12:24:51.367 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-04-20T12:24:51.367 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4190720 len 2048 2024-04-20T12:24:51.367 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190720 len 2048 2024-04-20T12:24:51.367 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4190720 len 4096 2024-04-20T12:24:51.367 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-04-20T12:24:51.367 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4190720 len 4096 2024-04-20T12:24:51.367 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190720 len 4096 2024-04-20T12:24:51.368 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4190720 len 8192 2024-04-20T12:24:51.368 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-04-20T12:24:51.368 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4190720 len 8192 2024-04-20T12:24:51.368 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190720 len 8192 2024-04-20T12:24:51.368 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4190720 len 16384 2024-04-20T12:24:51.368 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-04-20T12:24:51.368 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4190720 len 16384 2024-04-20T12:24:51.368 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4190720 len 16384 2024-04-20T12:24:51.368 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4191232 len 1024 2024-04-20T12:24:51.368 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-04-20T12:24:51.368 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4191232 len 1024 2024-04-20T12:24:51.368 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191232 len 1024 2024-04-20T12:24:51.368 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4191232 len 2048 2024-04-20T12:24:51.368 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-04-20T12:24:51.369 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4191232 len 2048 2024-04-20T12:24:51.369 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191232 len 2048 2024-04-20T12:24:51.369 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4191232 len 4096 2024-04-20T12:24:51.369 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-04-20T12:24:51.369 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4191232 len 4096 2024-04-20T12:24:51.369 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191232 len 4096 2024-04-20T12:24:51.369 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4191232 len 8192 2024-04-20T12:24:51.369 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-04-20T12:24:51.369 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4191232 len 8192 2024-04-20T12:24:51.369 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191232 len 8192 2024-04-20T12:24:51.369 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4191232 len 16384 2024-04-20T12:24:51.369 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-04-20T12:24:51.369 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4191232 len 16384 2024-04-20T12:24:51.369 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191232 len 16384 2024-04-20T12:24:51.369 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4191744 len 1024 2024-04-20T12:24:51.370 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-04-20T12:24:51.370 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4191744 len 1024 2024-04-20T12:24:51.370 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191744 len 1024 2024-04-20T12:24:51.370 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4191744 len 2048 2024-04-20T12:24:51.370 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-04-20T12:24:51.370 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4191744 len 2048 2024-04-20T12:24:51.370 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191744 len 2048 2024-04-20T12:24:51.370 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4191744 len 4096 2024-04-20T12:24:51.370 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-04-20T12:24:51.370 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4191744 len 4096 2024-04-20T12:24:51.370 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191744 len 4096 2024-04-20T12:24:51.370 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4191744 len 8192 2024-04-20T12:24:51.370 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-04-20T12:24:51.370 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4191744 len 8192 2024-04-20T12:24:51.371 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191744 len 8192 2024-04-20T12:24:51.371 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4191744 len 16384 2024-04-20T12:24:51.371 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-04-20T12:24:51.371 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4191744 len 16384 2024-04-20T12:24:51.371 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4191744 len 16384 2024-04-20T12:24:51.371 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4192256 len 1024 2024-04-20T12:24:51.371 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-04-20T12:24:51.371 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4192256 len 1024 2024-04-20T12:24:51.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.389+0000 7fbd7c538640 1 -- 172.21.15.135:0/1439262772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd741021a0 msgr2=0x7fbd74102580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.389+0000 7fbd7c538640 1 --2- 172.21.15.135:0/1439262772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd741021a0 0x7fbd74102580 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009900 tx=0x7fbd7002bc30 comp rx=0 tx=0).stop 2024-04-20T12:24:51.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.389+0000 7fbd7c538640 1 -- 172.21.15.135:0/1439262772 shutdown_connections 2024-04-20T12:24:51.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.389+0000 7fbd7c538640 1 --2- 172.21.15.135:0/1439262772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd74107270 0x7fbd7410ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.389+0000 7fbd7c538640 1 --2- 172.21.15.135:0/1439262772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd74102b50 0x7fbd74106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.389+0000 7fbd7c538640 1 --2- 172.21.15.135:0/1439262772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd741021a0 0x7fbd74102580 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.389+0000 7fbd7c538640 1 -- 172.21.15.135:0/1439262772 >> 172.21.15.135:0/1439262772 conn(0x7fbd740fda40 msgr2=0x7fbd740ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.389+0000 7fbd7c538640 1 -- 172.21.15.135:0/1439262772 shutdown_connections 2024-04-20T12:24:51.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.389+0000 7fbd7c538640 1 -- 172.21.15.135:0/1439262772 wait complete. 2024-04-20T12:24:51.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.389+0000 7fbd7c538640 1 Processor -- start 2024-04-20T12:24:51.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.389+0000 7fbd7c538640 1 -- start start 2024-04-20T12:24:51.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7c538640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd741021a0 0x7fbd741a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7c538640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd74107270 0x7fbd741a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7c538640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd7419a860 0x7fbd7419ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7c538640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd74112320 con 0x7fbd7419a860 2024-04-20T12:24:51.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7c538640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbd741121a0 con 0x7fbd741021a0 2024-04-20T12:24:51.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7c538640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd741124a0 con 0x7fbd74107270 2024-04-20T12:24:51.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7aad5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd7419a860 0x7fbd7419ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7a2d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd741021a0 0x7fbd741a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7aad5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd7419a860 0x7fbd7419ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36182/0 (socket says 172.21.15.135:36182) 2024-04-20T12:24:51.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7a2d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd741021a0 0x7fbd741a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:39014/0 (socket says 172.21.15.135:39014) 2024-04-20T12:24:51.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7aad5640 1 -- 172.21.15.135:0/2156768147 learned_addr learned my addr 172.21.15.135:0/2156768147 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/2156768147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd74107270 0x7fbd741a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7aad5640 1 -- 172.21.15.135:0/2156768147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd74107270 msgr2=0x7fbd741a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7aad5640 1 --2- 172.21.15.135:0/2156768147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd74107270 0x7fbd741a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7aad5640 1 -- 172.21.15.135:0/2156768147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd741021a0 msgr2=0x7fbd741a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7aad5640 1 --2- 172.21.15.135:0/2156768147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd741021a0 0x7fbd741a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7aad5640 1 -- 172.21.15.135:0/2156768147 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7419b380 con 0x7fbd7419a860 2024-04-20T12:24:51.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7a2d4640 1 --2- 172.21.15.135:0/2156768147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd741021a0 0x7fbd741a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/2156768147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd74107270 0x7fbd741a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:24:51.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd7aad5640 1 --2- 172.21.15.135:0/2156768147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd7419a860 0x7fbd7419ad10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00efd0 tx=0x7fbd6c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.390+0000 7fbd6b7fe640 1 -- 172.21.15.135:0/2156768147 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c003b70 con 0x7fbd7419a860 2024-04-20T12:24:51.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.391+0000 7fbd7c538640 1 -- 172.21.15.135:0/2156768147 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd7419b670 con 0x7fbd7419a860 2024-04-20T12:24:51.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.391+0000 7fbd6b7fe640 1 -- 172.21.15.135:0/2156768147 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd6c003d10 con 0x7fbd7419a860 2024-04-20T12:24:51.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.391+0000 7fbd6b7fe640 1 -- 172.21.15.135:0/2156768147 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c0109f0 con 0x7fbd7419a860 2024-04-20T12:24:51.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.391+0000 7fbd7c538640 1 -- 172.21.15.135:0/2156768147 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd741a7870 con 0x7fbd7419a860 2024-04-20T12:24:51.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.393+0000 7fbd6b7fe640 1 -- 172.21.15.135:0/2156768147 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fbd6c004020 con 0x7fbd7419a860 2024-04-20T12:24:51.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.394+0000 7fbd7f1fd740 1 Processor -- start 2024-04-20T12:24:51.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.394+0000 7fbd7f1fd740 1 -- start start 2024-04-20T12:24:51.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.394+0000 7fbd7f1fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f3e10 0x5594bd3f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.394+0000 7fbd7f1fd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3f4730 0x5594bd3fcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.394+0000 7fbd7f1fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3fd310 0x5594bd3ff700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.394+0000 7fbd7f1fd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5594bd359110 con 0x5594bd3fd310 2024-04-20T12:24:51.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.394+0000 7fbd7f1fd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5594bd2f6550 con 0x5594bd3f4730 2024-04-20T12:24:51.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.394+0000 7fbd7f1fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5594bd3550d0 con 0x5594bd3f3e10 2024-04-20T12:24:51.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.394+0000 7fbd6b7fe640 1 --2- 172.21.15.135:0/2156768147 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbd600a3d20 0x7fbd600a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd7a2d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3f4730 0x5594bd3fcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd7a2d4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3f4730 0x5594bd3fcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:39022/0 (socket says 172.21.15.135:39022) 2024-04-20T12:24:51.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd7a2d4640 1 -- 172.21.15.135:0/2151513004 learned_addr learned my addr 172.21.15.135:0/2151513004 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/2151513004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3fd310 0x5594bd3ff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd7aad5640 1 --2- 172.21.15.135:0/2156768147 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbd600a3d20 0x7fbd600a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/2151513004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f3e10 0x5594bd3f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd6b7fe640 1 -- 172.21.15.135:0/2156768147 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fbd6c0d0ff0 con 0x7fbd7419a860 2024-04-20T12:24:51.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd7a2d4640 1 -- 172.21.15.135:0/2151513004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f3e10 msgr2=0x5594bd3f41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd7a2d4640 1 --2- 172.21.15.135:0/2151513004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f3e10 0x5594bd3f41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd7a2d4640 1 -- 172.21.15.135:0/2151513004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3fd310 msgr2=0x5594bd3ff700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd7a2d4640 1 --2- 172.21.15.135:0/2151513004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3fd310 0x5594bd3ff700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd7a2d4640 1 -- 172.21.15.135:0/2151513004 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594bd31e900 con 0x5594bd3f4730 2024-04-20T12:24:51.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/2151513004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f3e10 0x5594bd3f41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:51.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd7a2d4640 1 --2- 172.21.15.135:0/2151513004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3f4730 0x5594bd3fcdd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd7002c170 tx=0x7fbd70005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=726c632c0a15ec55 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd7aad5640 1 --2- 172.21.15.135:0/2156768147 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbd600a3d20 0x7fbd600a61e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0ce470 tx=0x7fbd6c0104c0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd68bfe640 1 -- 172.21.15.135:0/2151513004 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd70042070 con 0x5594bd3f4730 2024-04-20T12:24:51.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd68bfe640 1 -- 172.21.15.135:0/2151513004 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd70004a70 con 0x5594bd3f4730 2024-04-20T12:24:51.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.395+0000 7fbd68bfe640 1 -- 172.21.15.135:0/2151513004 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd700052a0 con 0x5594bd3f4730 2024-04-20T12:24:51.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.396+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/2151513004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3f4730 msgr2=0x5594bd3fcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.396+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/2151513004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3f4730 0x5594bd3fcdd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbd7002c170 tx=0x7fbd70005e80 comp rx=0 tx=0).stop 2024-04-20T12:24:51.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.396+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/2151513004 shutdown_connections 2024-04-20T12:24:51.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.396+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/2151513004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3fd310 0x5594bd3ff700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.396+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/2151513004 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3f4730 0x5594bd3fcdd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.396+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/2151513004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f3e10 0x5594bd3f41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.396+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/2151513004 >> 172.21.15.135:0/2151513004 conn(0x5594bd3ee540 msgr2=0x5594bd3ee920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.396+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/2151513004 shutdown_connections 2024-04-20T12:24:51.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.396+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/2151513004 wait complete. 2024-04-20T12:24:51.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd7f1fd740 1 -- start start 2024-04-20T12:24:51.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd7f1fd740 1 Processor -- start 2024-04-20T12:24:51.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd7f1fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f3e10 0x5594bd3fa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd7f1fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f4730 0x5594bd3faa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd7f1fd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 0x5594bd3faf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd7f1fd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5594bd3fffe0 con 0x5594bd3f3e10 2024-04-20T12:24:51.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd7f1fd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5594bd312500 con 0x5594bd3fd310 2024-04-20T12:24:51.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd7f1fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5594bd400160 con 0x5594bd3f4730 2024-04-20T12:24:51.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd7f1fd740 10 client.0 _ll_register_callbacks cb 0x5594bd2f72f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:51.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd79ad3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f3e10 0x5594bd3fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd79ad3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f3e10 0x5594bd3fa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36204/0 (socket says 172.21.15.135:36204) 2024-04-20T12:24:51.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd79ad3640 1 -- 172.21.15.135:0/2706138603 learned_addr learned my addr 172.21.15.135:0/2706138603 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/2706138603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 0x5594bd3faf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd7a2d4640 1 --2- 172.21.15.135:0/2706138603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f4730 0x5594bd3faa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd79ad3640 1 -- 172.21.15.135:0/2706138603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f4730 msgr2=0x5594bd3faa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/2706138603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f4730 0x5594bd3faa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd79ad3640 1 -- 172.21.15.135:0/2706138603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 msgr2=0x5594bd3faf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.397+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/2706138603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 0x5594bd3faf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.398+0000 7fbd79ad3640 1 -- 172.21.15.135:0/2706138603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594bd06b3f0 con 0x5594bd3f3e10 2024-04-20T12:24:51.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.398+0000 7fbd7a2d4640 1 --2- 172.21.15.135:0/2706138603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f4730 0x5594bd3faa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:51.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.398+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/2706138603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f3e10 0x5594bd3fa4c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbd7406b5c0 tx=0x7fbd64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc4349ceda5f7b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.398+0000 7fbd5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:51.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.398+0000 7fbd5dffb640 1 -- 172.21.15.135:0/2706138603 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd64004050 con 0x5594bd3f3e10 2024-04-20T12:24:51.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.398+0000 7fbd5dffb640 1 -- 172.21.15.135:0/2706138603 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fbd640041f0 con 0x5594bd3f3e10 2024-04-20T12:24:51.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.398+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/2706138603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd70004a70 con 0x5594bd3f3e10 2024-04-20T12:24:51.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.398+0000 7fbd5dffb640 1 -- 172.21.15.135:0/2706138603 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbd64027050 con 0x5594bd3f3e10 2024-04-20T12:24:51.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.398+0000 7fbd7f1fd740 10 client.16293 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:51.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.398+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/2706138603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5594bd1357d0 con 0x5594bd3f3e10 2024-04-20T12:24:51.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.398+0000 7fbd5dffb640 1 -- 172.21.15.135:0/2706138603 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd70004a70 con 0x5594bd3f3e10 2024-04-20T12:24:51.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.398+0000 7fbd5dffb640 1 -- 172.21.15.135:0/2706138603 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fbd640223e0 con 0x5594bd3f3e10 2024-04-20T12:24:51.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.398+0000 7fbd7f1fd740 10 client.16293 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:51.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.398+0000 7fbd7f1fd740 10 client.16293 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:24:51.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.398+0000 7fbd7f1fd740 20 client.16293 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:51.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.399+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/2706138603 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5594bd40d6b0 0x5594bd40fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.399+0000 7fbd7f1fd740 4 client.16293 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:51.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.399+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/2706138603 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594bd366b30 con 0x5594bd40d6b0 2024-04-20T12:24:51.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.399+0000 7fbd7a2d4640 1 --2- 172.21.15.135:0/2706138603 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5594bd40d6b0 0x5594bd40fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.399+0000 7fbd5dffb640 10 client.16293 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:24:51.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.399+0000 7fbd7a2d4640 1 --2- 172.21.15.135:0/2706138603 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5594bd40d6b0 0x5594bd40fb30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fd364c3ffabaa05e server_cookie=99f1b4f32f7df1 in_seq=0 out_seq=0 2024-04-20T12:24:51.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.400+0000 7fbd5dffb640 1 -- 172.21.15.135:0/2706138603 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5594bd366b30 con 0x5594bd40d6b0 2024-04-20T12:24:51.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.400+0000 7fbd5dffb640 10 client.16293 handle_command_reply: tid=0 2024-04-20T12:24:51.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.400+0000 7fbd7f1fd740 1 client.16293 shutdown 2024-04-20T12:24:51.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.400+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/2706138603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f3e10 msgr2=0x5594bd3fa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.400+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/2706138603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f3e10 0x5594bd3fa4c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbd7406b5c0 tx=0x7fbd64004730 comp rx=0 tx=0).stop 2024-04-20T12:24:51.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.400+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/2706138603 shutdown_connections 2024-04-20T12:24:51.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.400+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/2706138603 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5594bd40d6b0 0x5594bd40fb30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.400+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/2706138603 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 0x5594bd3faf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.400+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/2706138603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f4730 0x5594bd3faa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.400+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/2706138603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f3e10 0x5594bd3fa4c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.400+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/2706138603 >> 172.21.15.135:0/2706138603 conn(0x5594bd3ee540 msgr2=0x5594bd3f0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.400+0000 7fbd5dffb640 0 client.16293 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:24:51.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.400+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/2706138603 shutdown_connections 2024-04-20T12:24:51.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.400+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/2706138603 wait complete. 2024-04-20T12:24:51.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.400+0000 7fbd7f1fd740 20 client.16293 trim_cache size 0 max 16384 2024-04-20T12:24:51.409 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192256 len 1024 2024-04-20T12:24:51.409 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4192256 len 2048 2024-04-20T12:24:51.409 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-04-20T12:24:51.409 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4192256 len 2048 2024-04-20T12:24:51.409 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192256 len 2048 2024-04-20T12:24:51.409 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4192256 len 4096 2024-04-20T12:24:51.409 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-04-20T12:24:51.409 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4192256 len 4096 2024-04-20T12:24:51.409 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192256 len 4096 2024-04-20T12:24:51.409 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4192256 len 8192 2024-04-20T12:24:51.410 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-04-20T12:24:51.410 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4192256 len 8192 2024-04-20T12:24:51.410 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192256 len 8192 2024-04-20T12:24:51.410 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4192256 len 16384 2024-04-20T12:24:51.410 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-04-20T12:24:51.410 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4192256 len 16384 2024-04-20T12:24:51.410 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192256 len 16384 2024-04-20T12:24:51.410 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4192768 len 1024 2024-04-20T12:24:51.410 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-04-20T12:24:51.410 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4192768 len 1024 2024-04-20T12:24:51.410 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192768 len 1024 2024-04-20T12:24:51.410 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4192768 len 2048 2024-04-20T12:24:51.410 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-04-20T12:24:51.410 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4192768 len 2048 2024-04-20T12:24:51.411 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192768 len 2048 2024-04-20T12:24:51.411 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4192768 len 4096 2024-04-20T12:24:51.411 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-04-20T12:24:51.411 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4192768 len 4096 2024-04-20T12:24:51.411 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192768 len 4096 2024-04-20T12:24:51.411 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4192768 len 8192 2024-04-20T12:24:51.411 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-04-20T12:24:51.411 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4192768 len 8192 2024-04-20T12:24:51.411 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192768 len 8192 2024-04-20T12:24:51.411 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4192768 len 16384 2024-04-20T12:24:51.411 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-04-20T12:24:51.411 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4192768 len 16384 2024-04-20T12:24:51.411 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4192768 len 16384 2024-04-20T12:24:51.411 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4193280 len 1024 2024-04-20T12:24:51.411 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-04-20T12:24:51.412 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4193280 len 1024 2024-04-20T12:24:51.412 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193280 len 1024 2024-04-20T12:24:51.412 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4193280 len 2048 2024-04-20T12:24:51.412 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-04-20T12:24:51.412 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4193280 len 2048 2024-04-20T12:24:51.412 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193280 len 2048 2024-04-20T12:24:51.412 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4193280 len 4096 2024-04-20T12:24:51.412 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-04-20T12:24:51.412 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4193280 len 4096 2024-04-20T12:24:51.412 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193280 len 4096 2024-04-20T12:24:51.412 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4193280 len 8192 2024-04-20T12:24:51.412 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-04-20T12:24:51.412 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4193280 len 8192 2024-04-20T12:24:51.412 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193280 len 8192 2024-04-20T12:24:51.412 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4193280 len 16384 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4193280 len 16384 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193280 len 16384 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4193792 len 1024 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4193792 len 1024 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193792 len 1024 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4193792 len 2048 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4193792 len 2048 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193792 len 2048 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4193792 len 4096 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4193792 len 4096 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193792 len 4096 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4193792 len 8192 2024-04-20T12:24:51.413 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-04-20T12:24:51.414 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4193792 len 8192 2024-04-20T12:24:51.414 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193792 len 8192 2024-04-20T12:24:51.414 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4193792 len 16384 2024-04-20T12:24:51.414 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-04-20T12:24:51.414 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4193792 len 16384 2024-04-20T12:24:51.414 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4193792 len 16384 2024-04-20T12:24:51.414 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4194304 len 1024 2024-04-20T12:24:51.414 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-04-20T12:24:51.414 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4194304 len 1024 2024-04-20T12:24:51.414 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194304 len 1024 2024-04-20T12:24:51.414 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4194304 len 2048 2024-04-20T12:24:51.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd7f1fd740 1 Processor -- start 2024-04-20T12:24:51.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd7f1fd740 1 -- start start 2024-04-20T12:24:51.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd7f1fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f3e10 0x5594bd3fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd7f1fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f4730 0x5594bd408ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd7f1fd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 0x5594bd40f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd7f1fd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd741b1540 con 0x5594bd3f3e10 2024-04-20T12:24:51.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd7f1fd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbd741b3080 con 0x5594bd3fd310 2024-04-20T12:24:51.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd7f1fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd741b1c10 con 0x5594bd3f4730 2024-04-20T12:24:51.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd79ad3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f3e10 0x5594bd3fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd79ad3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f3e10 0x5594bd3fcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36210/0 (socket says 172.21.15.135:36210) 2024-04-20T12:24:51.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd79ad3640 1 -- 172.21.15.135:0/957257171 learned_addr learned my addr 172.21.15.135:0/957257171 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd7a2d4640 1 --2- 172.21.15.135:0/957257171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f4730 0x5594bd408ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/957257171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 0x5594bd40f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd79ad3640 1 -- 172.21.15.135:0/957257171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f4730 msgr2=0x5594bd408ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/957257171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f4730 0x5594bd408ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd79ad3640 1 -- 172.21.15.135:0/957257171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 msgr2=0x5594bd40f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/957257171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 0x5594bd40f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.415+0000 7fbd79ad3640 1 -- 172.21.15.135:0/957257171 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594bd3e8af0 con 0x5594bd3f3e10 2024-04-20T12:24:51.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.416+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/957257171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f3e10 0x5594bd3fcbf0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbd64012c10 tx=0x7fbd64005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f80d51e0879372 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.416+0000 7fbd5ffff640 1 -- 172.21.15.135:0/957257171 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd640097f0 con 0x5594bd3f3e10 2024-04-20T12:24:51.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.416+0000 7fbd5ffff640 1 -- 172.21.15.135:0/957257171 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd64005d30 con 0x5594bd3f3e10 2024-04-20T12:24:51.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.416+0000 7fbd5ffff640 1 -- 172.21.15.135:0/957257171 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd640047a0 con 0x5594bd3f3e10 2024-04-20T12:24:51.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/957257171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f3e10 msgr2=0x5594bd3fcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/957257171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f3e10 0x5594bd3fcbf0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbd64012c10 tx=0x7fbd64005f90 comp rx=0 tx=0).stop 2024-04-20T12:24:51.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/957257171 shutdown_connections 2024-04-20T12:24:51.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/957257171 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 0x5594bd40f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/957257171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f4730 0x5594bd408ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/957257171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f3e10 0x5594bd3fcbf0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/957257171 >> 172.21.15.135:0/957257171 conn(0x5594bd3ee540 msgr2=0x5594bd3fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/957257171 shutdown_connections 2024-04-20T12:24:51.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/957257171 wait complete. 2024-04-20T12:24:51.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 -- start start 2024-04-20T12:24:51.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 Processor -- start 2024-04-20T12:24:51.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f3e10 0x5594bd405350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f4730 0x5594bd405890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 0x5594bd4007c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd741b29b0 con 0x5594bd3f4730 2024-04-20T12:24:51.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbd741b22e0 con 0x5594bd3fd310 2024-04-20T12:24:51.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbd741af510 con 0x5594bd3f3e10 2024-04-20T12:24:51.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7f1fd740 10 client.0 _ll_register_callbacks cb 0x7fbd64009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:51.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.417+0000 7fbd7a2d4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f4730 0x5594bd405890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd7a2d4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f4730 0x5594bd405890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36226/0 (socket says 172.21.15.135:36226) 2024-04-20T12:24:51.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd7a2d4640 1 -- 172.21.15.135:0/1156390976 learned_addr learned my addr 172.21.15.135:0/1156390976 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/1156390976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f3e10 0x5594bd405350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/1156390976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 0x5594bd4007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd7a2d4640 1 -- 172.21.15.135:0/1156390976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f3e10 msgr2=0x5594bd405350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd7a2d4640 1 --2- 172.21.15.135:0/1156390976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f3e10 0x5594bd405350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd7a2d4640 1 -- 172.21.15.135:0/1156390976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 msgr2=0x5594bd4007c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd7a2d4640 1 --2- 172.21.15.135:0/1156390976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 0x5594bd4007c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd7a2d4640 1 -- 172.21.15.135:0/1156390976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594bd400ff0 con 0x5594bd3f4730 2024-04-20T12:24:51.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/1156390976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 0x5594bd4007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:51.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd7a2d4640 1 --2- 172.21.15.135:0/1156390976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f4730 0x5594bd405890 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009850 tx=0x7fbd700095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921b09a511c29a1b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:51.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd5dffb640 1 -- 172.21.15.135:0/1156390976 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd70053060 con 0x5594bd3f4730 2024-04-20T12:24:51.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd5dffb640 1 -- 172.21.15.135:0/1156390976 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fbd7002cc90 con 0x5594bd3f4730 2024-04-20T12:24:51.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/1156390976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd64005d30 con 0x5594bd3f4730 2024-04-20T12:24:51.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd5dffb640 1 -- 172.21.15.135:0/1156390976 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbd7005a050 con 0x5594bd3f4730 2024-04-20T12:24:51.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd7f1fd740 10 client.16299 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:51.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.418+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/1156390976 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5594bd473790 con 0x5594bd3f4730 2024-04-20T12:24:51.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.419+0000 7fbd5dffb640 1 -- 172.21.15.135:0/1156390976 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd64005d30 con 0x5594bd3f4730 2024-04-20T12:24:51.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.419+0000 7fbd5dffb640 1 -- 172.21.15.135:0/1156390976 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fbd70004f90 con 0x5594bd3f4730 2024-04-20T12:24:51.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.419+0000 7fbd7f1fd740 10 client.16299 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:51.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.419+0000 7fbd7f1fd740 10 client.16299 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:24:51.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.419+0000 7fbd7f1fd740 20 client.16299 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:51.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.419+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/1156390976 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5594bd473ad0 0x5594bd475ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.419+0000 7fbd7f1fd740 4 client.16299 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:24:51.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.419+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/1156390976 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5594bd3609a0 con 0x5594bd473ad0 2024-04-20T12:24:51.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.419+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/1156390976 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5594bd473ad0 0x5594bd475ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd79ad3640 1 --2- 172.21.15.135:0/1156390976 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5594bd473ad0 0x5594bd475ec0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=57545df46a78a65a server_cookie=59bad09988c03b82 in_seq=0 out_seq=0 2024-04-20T12:24:51.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd5dffb640 10 client.16299 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:24:51.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd5dffb640 1 -- 172.21.15.135:0/1156390976 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5594bd3609a0 con 0x5594bd473ad0 2024-04-20T12:24:51.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd5dffb640 10 client.16299 handle_command_reply: tid=0 2024-04-20T12:24:51.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd7f1fd740 1 client.16299 shutdown 2024-04-20T12:24:51.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/1156390976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f4730 msgr2=0x5594bd405890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/1156390976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f4730 0x5594bd405890 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009850 tx=0x7fbd700095e0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/1156390976 shutdown_connections 2024-04-20T12:24:51.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/1156390976 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5594bd473ad0 0x5594bd475ec0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/1156390976 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5594bd3fd310 0x5594bd4007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/1156390976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5594bd3f4730 0x5594bd405890 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd7f1fd740 1 --2- 172.21.15.135:0/1156390976 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5594bd3f3e10 0x5594bd405350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/1156390976 >> 172.21.15.135:0/1156390976 conn(0x5594bd3ee540 msgr2=0x5594bd3fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd5dffb640 0 client.16299 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:24:51.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/1156390976 shutdown_connections 2024-04-20T12:24:51.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd7f1fd740 1 -- 172.21.15.135:0/1156390976 wait complete. 2024-04-20T12:24:51.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.420+0000 7fbd7f1fd740 20 client.16299 trim_cache size 0 max 16384 2024-04-20T12:24:51.427 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:24:51.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.421+0000 7fbd7c538640 1 -- 172.21.15.135:0/2156768147 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbd600a3d20 msgr2=0x7fbd600a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.421+0000 7fbd7c538640 1 --2- 172.21.15.135:0/2156768147 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbd600a3d20 0x7fbd600a61e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c0ce470 tx=0x7fbd6c0104c0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.421+0000 7fbd7c538640 1 -- 172.21.15.135:0/2156768147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd7419a860 msgr2=0x7fbd7419ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.421+0000 7fbd7c538640 1 --2- 172.21.15.135:0/2156768147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd7419a860 0x7fbd7419ad10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00efd0 tx=0x7fbd6c00c6a0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.421+0000 7fbd7c538640 1 -- 172.21.15.135:0/2156768147 shutdown_connections 2024-04-20T12:24:51.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.421+0000 7fbd7c538640 1 --2- 172.21.15.135:0/2156768147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd7419a860 0x7fbd7419ad10 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.421+0000 7fbd7c538640 1 --2- 172.21.15.135:0/2156768147 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbd600a3d20 0x7fbd600a61e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.421+0000 7fbd7c538640 1 --2- 172.21.15.135:0/2156768147 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbd74107270 0x7fbd741a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.421+0000 7fbd7c538640 1 --2- 172.21.15.135:0/2156768147 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbd741021a0 0x7fbd741a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.421+0000 7fbd7c538640 1 -- 172.21.15.135:0/2156768147 >> 172.21.15.135:0/2156768147 conn(0x7fbd740fda40 msgr2=0x7fbd740fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.421+0000 7fbd7c538640 1 -- 172.21.15.135:0/2156768147 shutdown_connections 2024-04-20T12:24:51.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.421+0000 7fbd7c538640 1 -- 172.21.15.135:0/2156768147 wait complete. 2024-04-20T12:24:51.432 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:24:51.436 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-04-20T12:24:51.436 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4194304 len 2048 2024-04-20T12:24:51.436 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194304 len 2048 2024-04-20T12:24:51.436 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4194304 len 4096 2024-04-20T12:24:51.436 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-04-20T12:24:51.436 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4194304 len 4096 2024-04-20T12:24:51.436 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194304 len 4096 2024-04-20T12:24:51.436 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4194304 len 8192 2024-04-20T12:24:51.437 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-04-20T12:24:51.437 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4194304 len 8192 2024-04-20T12:24:51.437 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194304 len 8192 2024-04-20T12:24:51.437 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4194304 len 16384 2024-04-20T12:24:51.437 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-04-20T12:24:51.437 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4194304 len 16384 2024-04-20T12:24:51.437 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194304 len 16384 2024-04-20T12:24:51.437 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4194816 len 1024 2024-04-20T12:24:51.437 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-04-20T12:24:51.437 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4194816 len 1024 2024-04-20T12:24:51.437 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194816 len 1024 2024-04-20T12:24:51.437 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4194816 len 2048 2024-04-20T12:24:51.437 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-04-20T12:24:51.437 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4194816 len 2048 2024-04-20T12:24:51.437 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194816 len 2048 2024-04-20T12:24:51.438 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4194816 len 4096 2024-04-20T12:24:51.438 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-04-20T12:24:51.438 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4194816 len 4096 2024-04-20T12:24:51.438 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194816 len 4096 2024-04-20T12:24:51.438 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4194816 len 8192 2024-04-20T12:24:51.438 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-04-20T12:24:51.438 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4194816 len 8192 2024-04-20T12:24:51.438 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194816 len 8192 2024-04-20T12:24:51.438 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4194816 len 16384 2024-04-20T12:24:51.438 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-04-20T12:24:51.438 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4194816 len 16384 2024-04-20T12:24:51.438 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4194816 len 16384 2024-04-20T12:24:51.438 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4195328 len 1024 2024-04-20T12:24:51.438 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-04-20T12:24:51.439 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4195328 len 1024 2024-04-20T12:24:51.439 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195328 len 1024 2024-04-20T12:24:51.439 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4195328 len 2048 2024-04-20T12:24:51.439 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-04-20T12:24:51.439 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4195328 len 2048 2024-04-20T12:24:51.439 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195328 len 2048 2024-04-20T12:24:51.439 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4195328 len 4096 2024-04-20T12:24:51.439 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-04-20T12:24:51.439 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4195328 len 4096 2024-04-20T12:24:51.439 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195328 len 4096 2024-04-20T12:24:51.439 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4195328 len 8192 2024-04-20T12:24:51.439 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-04-20T12:24:51.439 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4195328 len 8192 2024-04-20T12:24:51.439 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195328 len 8192 2024-04-20T12:24:51.440 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4195328 len 16384 2024-04-20T12:24:51.440 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-04-20T12:24:51.440 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4195328 len 16384 2024-04-20T12:24:51.440 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195328 len 16384 2024-04-20T12:24:51.440 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4195840 len 1024 2024-04-20T12:24:51.440 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-04-20T12:24:51.440 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4195840 len 1024 2024-04-20T12:24:51.440 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195840 len 1024 2024-04-20T12:24:51.440 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4195840 len 2048 2024-04-20T12:24:51.440 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-04-20T12:24:51.440 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4195840 len 2048 2024-04-20T12:24:51.440 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195840 len 2048 2024-04-20T12:24:51.440 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4195840 len 4096 2024-04-20T12:24:51.440 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-04-20T12:24:51.440 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4195840 len 4096 2024-04-20T12:24:51.441 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195840 len 4096 2024-04-20T12:24:51.441 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4195840 len 8192 2024-04-20T12:24:51.441 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-04-20T12:24:51.441 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4195840 len 8192 2024-04-20T12:24:51.441 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195840 len 8192 2024-04-20T12:24:51.441 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4195840 len 16384 2024-04-20T12:24:51.441 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-04-20T12:24:51.441 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4195840 len 16384 2024-04-20T12:24:51.441 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4195840 len 16384 2024-04-20T12:24:51.441 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4196352 len 1024 2024-04-20T12:24:51.441 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-04-20T12:24:51.441 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4196352 len 1024 2024-04-20T12:24:51.441 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196352 len 1024 2024-04-20T12:24:51.441 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4196352 len 2048 2024-04-20T12:24:51.442 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-04-20T12:24:51.442 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4196352 len 2048 2024-04-20T12:24:51.442 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196352 len 2048 2024-04-20T12:24:51.459 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4196352 len 4096 2024-04-20T12:24:51.459 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-04-20T12:24:51.459 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4196352 len 4096 2024-04-20T12:24:51.459 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196352 len 4096 2024-04-20T12:24:51.460 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4196352 len 8192 2024-04-20T12:24:51.460 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-04-20T12:24:51.460 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4196352 len 8192 2024-04-20T12:24:51.460 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196352 len 8192 2024-04-20T12:24:51.460 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4196352 len 16384 2024-04-20T12:24:51.460 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-04-20T12:24:51.460 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4196352 len 16384 2024-04-20T12:24:51.460 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196352 len 16384 2024-04-20T12:24:51.460 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4196864 len 1024 2024-04-20T12:24:51.460 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-04-20T12:24:51.460 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4196864 len 1024 2024-04-20T12:24:51.460 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196864 len 1024 2024-04-20T12:24:51.460 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4196864 len 2048 2024-04-20T12:24:51.460 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-04-20T12:24:51.461 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4196864 len 2048 2024-04-20T12:24:51.461 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196864 len 2048 2024-04-20T12:24:51.461 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4196864 len 4096 2024-04-20T12:24:51.461 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-04-20T12:24:51.461 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4196864 len 4096 2024-04-20T12:24:51.461 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196864 len 4096 2024-04-20T12:24:51.461 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4196864 len 8192 2024-04-20T12:24:51.461 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-04-20T12:24:51.461 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4196864 len 8192 2024-04-20T12:24:51.461 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196864 len 8192 2024-04-20T12:24:51.461 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4196864 len 16384 2024-04-20T12:24:51.461 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-04-20T12:24:51.461 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4196864 len 16384 2024-04-20T12:24:51.461 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4196864 len 16384 2024-04-20T12:24:51.461 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4197376 len 1024 2024-04-20T12:24:51.462 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-04-20T12:24:51.462 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4197376 len 1024 2024-04-20T12:24:51.462 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197376 len 1024 2024-04-20T12:24:51.462 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4197376 len 2048 2024-04-20T12:24:51.462 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-04-20T12:24:51.462 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4197376 len 2048 2024-04-20T12:24:51.462 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197376 len 2048 2024-04-20T12:24:51.462 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4197376 len 4096 2024-04-20T12:24:51.462 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-04-20T12:24:51.462 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4197376 len 4096 2024-04-20T12:24:51.462 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197376 len 4096 2024-04-20T12:24:51.462 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4197376 len 8192 2024-04-20T12:24:51.462 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4197376 len 8192 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197376 len 8192 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4197376 len 16384 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4197376 len 16384 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197376 len 16384 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4197888 len 1024 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4197888 len 1024 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197888 len 1024 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4197888 len 2048 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4197888 len 2048 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197888 len 2048 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4197888 len 4096 2024-04-20T12:24:51.463 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-04-20T12:24:51.464 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4197888 len 4096 2024-04-20T12:24:51.464 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197888 len 4096 2024-04-20T12:24:51.464 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4197888 len 8192 2024-04-20T12:24:51.464 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-04-20T12:24:51.464 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4197888 len 8192 2024-04-20T12:24:51.464 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197888 len 8192 2024-04-20T12:24:51.464 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3072 offset 4197888 len 16384 2024-04-20T12:24:51.464 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-04-20T12:24:51.464 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3072 offset 4197888 len 16384 2024-04-20T12:24:51.464 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3072 offset 4197888 len 16384 2024-04-20T12:24:51.464 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4190208 len 1024 2024-04-20T12:24:51.464 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-04-20T12:24:51.464 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4190208 len 1024 2024-04-20T12:24:51.464 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190208 len 1024 2024-04-20T12:24:51.465 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4190208 len 2048 2024-04-20T12:24:51.465 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-04-20T12:24:51.465 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4190208 len 2048 2024-04-20T12:24:51.465 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190208 len 2048 2024-04-20T12:24:51.465 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4190208 len 4096 2024-04-20T12:24:51.465 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-04-20T12:24:51.496 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4190208 len 4096 2024-04-20T12:24:51.496 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190208 len 4096 2024-04-20T12:24:51.496 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4190208 len 8192 2024-04-20T12:24:51.496 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-04-20T12:24:51.497 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4190208 len 8192 2024-04-20T12:24:51.497 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190208 len 8192 2024-04-20T12:24:51.497 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4190208 len 16384 2024-04-20T12:24:51.497 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-04-20T12:24:51.497 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4190208 len 16384 2024-04-20T12:24:51.497 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190208 len 16384 2024-04-20T12:24:51.497 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4190720 len 1024 2024-04-20T12:24:51.497 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-04-20T12:24:51.497 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4190720 len 1024 2024-04-20T12:24:51.497 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190720 len 1024 2024-04-20T12:24:51.497 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4190720 len 2048 2024-04-20T12:24:51.497 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-04-20T12:24:51.497 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4190720 len 2048 2024-04-20T12:24:51.497 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190720 len 2048 2024-04-20T12:24:51.497 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4190720 len 4096 2024-04-20T12:24:51.498 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-04-20T12:24:51.498 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4190720 len 4096 2024-04-20T12:24:51.498 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190720 len 4096 2024-04-20T12:24:51.498 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4190720 len 8192 2024-04-20T12:24:51.498 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-04-20T12:24:51.498 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4190720 len 8192 2024-04-20T12:24:51.498 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190720 len 8192 2024-04-20T12:24:51.498 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4190720 len 16384 2024-04-20T12:24:51.498 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-04-20T12:24:51.498 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4190720 len 16384 2024-04-20T12:24:51.498 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4190720 len 16384 2024-04-20T12:24:51.498 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4191232 len 1024 2024-04-20T12:24:51.498 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-04-20T12:24:51.498 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4191232 len 1024 2024-04-20T12:24:51.498 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191232 len 1024 2024-04-20T12:24:51.499 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4191232 len 2048 2024-04-20T12:24:51.499 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-04-20T12:24:51.499 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4191232 len 2048 2024-04-20T12:24:51.499 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191232 len 2048 2024-04-20T12:24:51.499 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4191232 len 4096 2024-04-20T12:24:51.499 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-04-20T12:24:51.499 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4191232 len 4096 2024-04-20T12:24:51.499 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191232 len 4096 2024-04-20T12:24:51.499 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4191232 len 8192 2024-04-20T12:24:51.499 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-04-20T12:24:51.499 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4191232 len 8192 2024-04-20T12:24:51.499 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191232 len 8192 2024-04-20T12:24:51.499 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4191232 len 16384 2024-04-20T12:24:51.499 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-04-20T12:24:51.500 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4191232 len 16384 2024-04-20T12:24:51.500 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191232 len 16384 2024-04-20T12:24:51.500 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4191744 len 1024 2024-04-20T12:24:51.500 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-04-20T12:24:51.500 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4191744 len 1024 2024-04-20T12:24:51.500 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191744 len 1024 2024-04-20T12:24:51.500 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4191744 len 2048 2024-04-20T12:24:51.500 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-04-20T12:24:51.500 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4191744 len 2048 2024-04-20T12:24:51.500 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191744 len 2048 2024-04-20T12:24:51.500 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4191744 len 4096 2024-04-20T12:24:51.500 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-04-20T12:24:51.500 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4191744 len 4096 2024-04-20T12:24:51.500 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191744 len 4096 2024-04-20T12:24:51.501 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4191744 len 8192 2024-04-20T12:24:51.501 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-04-20T12:24:51.501 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4191744 len 8192 2024-04-20T12:24:51.501 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191744 len 8192 2024-04-20T12:24:51.501 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4191744 len 16384 2024-04-20T12:24:51.501 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-04-20T12:24:51.501 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4191744 len 16384 2024-04-20T12:24:51.501 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4191744 len 16384 2024-04-20T12:24:51.501 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4192256 len 1024 2024-04-20T12:24:51.501 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-04-20T12:24:51.501 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4192256 len 1024 2024-04-20T12:24:51.501 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192256 len 1024 2024-04-20T12:24:51.501 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4192256 len 2048 2024-04-20T12:24:51.501 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-04-20T12:24:51.501 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4192256 len 2048 2024-04-20T12:24:51.502 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192256 len 2048 2024-04-20T12:24:51.502 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4192256 len 4096 2024-04-20T12:24:51.502 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-04-20T12:24:51.502 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4192256 len 4096 2024-04-20T12:24:51.502 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192256 len 4096 2024-04-20T12:24:51.502 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4192256 len 8192 2024-04-20T12:24:51.540 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-04-20T12:24:51.540 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4192256 len 8192 2024-04-20T12:24:51.540 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192256 len 8192 2024-04-20T12:24:51.540 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4192256 len 16384 2024-04-20T12:24:51.540 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-04-20T12:24:51.540 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4192256 len 16384 2024-04-20T12:24:51.540 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192256 len 16384 2024-04-20T12:24:51.540 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4192768 len 1024 2024-04-20T12:24:51.540 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-04-20T12:24:51.540 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4192768 len 1024 2024-04-20T12:24:51.540 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192768 len 1024 2024-04-20T12:24:51.541 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4192768 len 2048 2024-04-20T12:24:51.541 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-04-20T12:24:51.541 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4192768 len 2048 2024-04-20T12:24:51.541 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192768 len 2048 2024-04-20T12:24:51.541 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4192768 len 4096 2024-04-20T12:24:51.541 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-04-20T12:24:51.541 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4192768 len 4096 2024-04-20T12:24:51.541 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192768 len 4096 2024-04-20T12:24:51.541 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4192768 len 8192 2024-04-20T12:24:51.541 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-04-20T12:24:51.541 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4192768 len 8192 2024-04-20T12:24:51.541 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192768 len 8192 2024-04-20T12:24:51.541 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4192768 len 16384 2024-04-20T12:24:51.541 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-04-20T12:24:51.542 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4192768 len 16384 2024-04-20T12:24:51.542 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4192768 len 16384 2024-04-20T12:24:51.542 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4193280 len 1024 2024-04-20T12:24:51.542 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-04-20T12:24:51.542 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4193280 len 1024 2024-04-20T12:24:51.542 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193280 len 1024 2024-04-20T12:24:51.542 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4193280 len 2048 2024-04-20T12:24:51.542 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-04-20T12:24:51.542 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4193280 len 2048 2024-04-20T12:24:51.542 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193280 len 2048 2024-04-20T12:24:51.542 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4193280 len 4096 2024-04-20T12:24:51.542 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-04-20T12:24:51.542 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4193280 len 4096 2024-04-20T12:24:51.542 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193280 len 4096 2024-04-20T12:24:51.542 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4193280 len 8192 2024-04-20T12:24:51.543 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-04-20T12:24:51.543 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4193280 len 8192 2024-04-20T12:24:51.543 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193280 len 8192 2024-04-20T12:24:51.543 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4193280 len 16384 2024-04-20T12:24:51.543 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-04-20T12:24:51.543 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4193280 len 16384 2024-04-20T12:24:51.543 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193280 len 16384 2024-04-20T12:24:51.543 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4193792 len 1024 2024-04-20T12:24:51.543 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-04-20T12:24:51.543 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4193792 len 1024 2024-04-20T12:24:51.543 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193792 len 1024 2024-04-20T12:24:51.543 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4193792 len 2048 2024-04-20T12:24:51.543 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-04-20T12:24:51.543 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4193792 len 2048 2024-04-20T12:24:51.543 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193792 len 2048 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4193792 len 4096 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4193792 len 4096 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193792 len 4096 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4193792 len 8192 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4193792 len 8192 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193792 len 8192 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4193792 len 16384 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4193792 len 16384 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4193792 len 16384 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4194304 len 1024 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4194304 len 1024 2024-04-20T12:24:51.544 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194304 len 1024 2024-04-20T12:24:51.545 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4194304 len 2048 2024-04-20T12:24:51.545 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-04-20T12:24:51.545 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4194304 len 2048 2024-04-20T12:24:51.545 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194304 len 2048 2024-04-20T12:24:51.545 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4194304 len 4096 2024-04-20T12:24:51.545 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-04-20T12:24:51.545 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4194304 len 4096 2024-04-20T12:24:51.545 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194304 len 4096 2024-04-20T12:24:51.545 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4194304 len 8192 2024-04-20T12:24:51.545 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-04-20T12:24:51.545 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4194304 len 8192 2024-04-20T12:24:51.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.551+0000 7fe09c532640 1 -- 172.21.15.135:0/3644571487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0941031d0 msgr2=0x7fe0941035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.551+0000 7fe09c532640 1 --2- 172.21.15.135:0/3644571487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0941031d0 0x7fe0941035b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe090009900 tx=0x7fe09002bd60 comp rx=0 tx=0).stop 2024-04-20T12:24:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.551+0000 7fe09c532640 1 -- 172.21.15.135:0/3644571487 shutdown_connections 2024-04-20T12:24:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.551+0000 7fe09c532640 1 --2- 172.21.15.135:0/3644571487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe09410c510 0x7fe09410e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.551+0000 7fe09c532640 1 --2- 172.21.15.135:0/3644571487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe094103af0 0x7fe09410bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.551+0000 7fe09c532640 1 --2- 172.21.15.135:0/3644571487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0941031d0 0x7fe0941035b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.551+0000 7fe09c532640 1 -- 172.21.15.135:0/3644571487 >> 172.21.15.135:0/3644571487 conn(0x7fe094078010 msgr2=0x7fe094078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.551+0000 7fe09c532640 1 -- 172.21.15.135:0/3644571487 shutdown_connections 2024-04-20T12:24:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.551+0000 7fe09c532640 1 -- 172.21.15.135:0/3644571487 wait complete. 2024-04-20T12:24:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.551+0000 7fe09c532640 1 Processor -- start 2024-04-20T12:24:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.551+0000 7fe09c532640 1 -- start start 2024-04-20T12:24:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09c532640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0941031d0 0x7fe094100e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09c532640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe094103af0 0x7fe094101360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09c532640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe09410c510 0x7fe0941018a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09c532640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe094112340 con 0x7fe09410c510 2024-04-20T12:24:51.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09c532640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe0941121c0 con 0x7fe094103af0 2024-04-20T12:24:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09c532640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0941124c0 con 0x7fe0941031d0 2024-04-20T12:24:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09aacf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe09410c510 0x7fe0941018a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09aacf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe09410c510 0x7fe0941018a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36236/0 (socket says 172.21.15.135:36236) 2024-04-20T12:24:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09aacf640 1 -- 172.21.15.135:0/3548982540 learned_addr learned my addr 172.21.15.135:0/3548982540 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe099acd640 1 --2- 172.21.15.135:0/3548982540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe094103af0 0x7fe094101360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09a2ce640 1 --2- 172.21.15.135:0/3548982540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0941031d0 0x7fe094100e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09aacf640 1 -- 172.21.15.135:0/3548982540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0941031d0 msgr2=0x7fe094100e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09aacf640 1 --2- 172.21.15.135:0/3548982540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0941031d0 0x7fe094100e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09aacf640 1 -- 172.21.15.135:0/3548982540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe094103af0 msgr2=0x7fe094101360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09aacf640 1 --2- 172.21.15.135:0/3548982540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe094103af0 0x7fe094101360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09aacf640 1 -- 172.21.15.135:0/3548982540 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0941a6ce0 con 0x7fe09410c510 2024-04-20T12:24:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09aacf640 1 --2- 172.21.15.135:0/3548982540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe09410c510 0x7fe0941018a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00eb10 tx=0x7fe08c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe08b7fe640 1 -- 172.21.15.135:0/3548982540 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c004b20 con 0x7fe09410c510 2024-04-20T12:24:51.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe08b7fe640 1 -- 172.21.15.135:0/3548982540 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe08c004cc0 con 0x7fe09410c510 2024-04-20T12:24:51.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe08b7fe640 1 -- 172.21.15.135:0/3548982540 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c010760 con 0x7fe09410c510 2024-04-20T12:24:51.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.552+0000 7fe09c532640 1 -- 172.21.15.135:0/3548982540 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0941a6fd0 con 0x7fe09410c510 2024-04-20T12:24:51.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.553+0000 7fe09c532640 1 -- 172.21.15.135:0/3548982540 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0941a74f0 con 0x7fe09410c510 2024-04-20T12:24:51.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.555+0000 7fe09f200740 1 Processor -- start 2024-04-20T12:24:51.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.556+0000 7fe08b7fe640 1 -- 172.21.15.135:0/3548982540 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fe08c005020 con 0x7fe09410c510 2024-04-20T12:24:51.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.556+0000 7fe09f200740 1 -- start start 2024-04-20T12:24:51.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.556+0000 7fe09f200740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3493e10 0x5569c34941f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.556+0000 7fe09f200740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3494730 0x5569c349cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.556+0000 7fe09f200740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c349d310 0x5569c349f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.556+0000 7fe09f200740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5569c33f9110 con 0x5569c3493e10 2024-04-20T12:24:51.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.556+0000 7fe09f200740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5569c3396550 con 0x5569c349d310 2024-04-20T12:24:51.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.556+0000 7fe09f200740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5569c33f50d0 con 0x5569c3494730 2024-04-20T12:24:51.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.556+0000 7fe099acd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3493e10 0x5569c34941f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.556+0000 7fe09a2ce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3494730 0x5569c349cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.556+0000 7fe099acd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3493e10 0x5569c34941f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36250/0 (socket says 172.21.15.135:36250) 2024-04-20T12:24:51.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.556+0000 7fe099acd640 1 -- 172.21.15.135:0/1673701075 learned_addr learned my addr 172.21.15.135:0/1673701075 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.556+0000 7fe099acd640 1 --2- 172.21.15.135:0/1673701075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c349d310 0x5569c349f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.557+0000 7fe08b7fe640 1 --2- 172.21.15.135:0/3548982540 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe0800a3d20 0x7fe0800a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.557+0000 7fe09a2ce640 1 -- 172.21.15.135:0/1673701075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c349d310 msgr2=0x5569c349f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.557+0000 7fe09a2ce640 1 --2- 172.21.15.135:0/1673701075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c349d310 0x5569c349f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.557+0000 7fe09a2ce640 1 -- 172.21.15.135:0/1673701075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3493e10 msgr2=0x5569c34941f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.557+0000 7fe09a2ce640 1 --2- 172.21.15.135:0/1673701075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3493e10 0x5569c34941f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.557+0000 7fe09a2ce640 1 -- 172.21.15.135:0/1673701075 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569c33be900 con 0x5569c3494730 2024-04-20T12:24:51.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.557+0000 7fe099acd640 1 --2- 172.21.15.135:0/1673701075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3493e10 0x5569c34941f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.557+0000 7fe09aacf640 1 --2- 172.21.15.135:0/3548982540 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe0800a3d20 0x7fe0800a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.557+0000 7fe09a2ce640 1 --2- 172.21.15.135:0/1673701075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3494730 0x5569c349cdd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe090009230 tx=0x7fe090009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b3889784cb1ca80 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.557+0000 7fe08b7fe640 1 -- 172.21.15.135:0/3548982540 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe08c0d11a0 con 0x7fe09410c510 2024-04-20T12:24:51.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.557+0000 7fe088bfe640 1 -- 172.21.15.135:0/1673701075 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090043070 con 0x5569c3494730 2024-04-20T12:24:51.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.557+0000 7fe088bfe640 1 -- 172.21.15.135:0/1673701075 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe09002c780 con 0x5569c3494730 2024-04-20T12:24:51.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.557+0000 7fe088bfe640 1 -- 172.21.15.135:0/1673701075 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090004a40 con 0x5569c3494730 2024-04-20T12:24:51.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.558+0000 7fe09f200740 1 -- 172.21.15.135:0/1673701075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3494730 msgr2=0x5569c349cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.558+0000 7fe09aacf640 1 --2- 172.21.15.135:0/3548982540 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe0800a3d20 0x7fe0800a61e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe08c099220 tx=0x7fe08c0989c0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.558+0000 7fe09f200740 1 --2- 172.21.15.135:0/1673701075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3494730 0x5569c349cdd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe090009230 tx=0x7fe090009560 comp rx=0 tx=0).stop 2024-04-20T12:24:51.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.558+0000 7fe09f200740 1 -- 172.21.15.135:0/1673701075 shutdown_connections 2024-04-20T12:24:51.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.558+0000 7fe09f200740 1 --2- 172.21.15.135:0/1673701075 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c349d310 0x5569c349f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.558+0000 7fe09f200740 1 --2- 172.21.15.135:0/1673701075 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3494730 0x5569c349cdd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.558+0000 7fe09f200740 1 --2- 172.21.15.135:0/1673701075 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3493e10 0x5569c34941f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.558+0000 7fe09f200740 1 -- 172.21.15.135:0/1673701075 >> 172.21.15.135:0/1673701075 conn(0x5569c348e540 msgr2=0x5569c348e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.558+0000 7fe09f200740 1 -- 172.21.15.135:0/1673701075 shutdown_connections 2024-04-20T12:24:51.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.558+0000 7fe09f200740 1 -- 172.21.15.135:0/1673701075 wait complete. 2024-04-20T12:24:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe09f200740 1 -- start start 2024-04-20T12:24:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe09f200740 1 Processor -- start 2024-04-20T12:24:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe09f200740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3493e10 0x5569c349a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe09f200740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3494730 0x5569c349a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe09f200740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c349d310 0x5569c349ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe09f200740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5569c34a00a0 con 0x5569c349d310 2024-04-20T12:24:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe09f200740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5569c33b2500 con 0x5569c3494730 2024-04-20T12:24:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe09f200740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5569c34a0220 con 0x5569c3493e10 2024-04-20T12:24:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe09f200740 10 client.0 _ll_register_callbacks cb 0x5569c33972f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe099acd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c349d310 0x5569c349ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe09a2ce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3494730 0x5569c349a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe099acd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c349d310 0x5569c349ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36256/0 (socket says 172.21.15.135:36256) 2024-04-20T12:24:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe099acd640 1 -- 172.21.15.135:0/2696212679 learned_addr learned my addr 172.21.15.135:0/2696212679 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe099acd640 1 --2- 172.21.15.135:0/2696212679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3493e10 0x5569c349a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe099acd640 1 -- 172.21.15.135:0/2696212679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3493e10 msgr2=0x5569c349a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe099acd640 1 --2- 172.21.15.135:0/2696212679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3493e10 0x5569c349a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe099acd640 1 -- 172.21.15.135:0/2696212679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3494730 msgr2=0x5569c349a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.559+0000 7fe099acd640 1 --2- 172.21.15.135:0/2696212679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3494730 0x5569c349a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.560+0000 7fe099acd640 1 -- 172.21.15.135:0/2696212679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569c310b3f0 con 0x5569c349d310 2024-04-20T12:24:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.560+0000 7fe09a2ce640 1 --2- 172.21.15.135:0/2696212679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3494730 0x5569c349a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.560+0000 7fe099acd640 1 --2- 172.21.15.135:0/2696212679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c349d310 0x5569c349ae60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe084013270 tx=0x7fe084009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353b075897d322fb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.560+0000 7fe07dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.560+0000 7fe07dffb640 1 -- 172.21.15.135:0/2696212679 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0840042f0 con 0x5569c349d310 2024-04-20T12:24:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.560+0000 7fe09f200740 1 -- 172.21.15.135:0/2696212679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe09002c780 con 0x5569c349d310 2024-04-20T12:24:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.560+0000 7fe07dffb640 1 -- 172.21.15.135:0/2696212679 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe084005020 con 0x5569c349d310 2024-04-20T12:24:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.560+0000 7fe07dffb640 1 -- 172.21.15.135:0/2696212679 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe084029050 con 0x5569c349d310 2024-04-20T12:24:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.560+0000 7fe09f200740 10 client.16311 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.560+0000 7fe09f200740 1 -- 172.21.15.135:0/2696212679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5569c31d57d0 con 0x5569c349d310 2024-04-20T12:24:51.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.560+0000 7fe07dffb640 1 -- 172.21.15.135:0/2696212679 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe09002c780 con 0x5569c349d310 2024-04-20T12:24:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.560+0000 7fe07dffb640 1 -- 172.21.15.135:0/2696212679 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe084004bb0 con 0x5569c349d310 2024-04-20T12:24:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.561+0000 7fe09f200740 10 client.16311 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.561+0000 7fe09f200740 10 client.16311 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:24:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.561+0000 7fe09f200740 20 client.16311 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.561+0000 7fe09f200740 1 --2- 172.21.15.135:0/2696212679 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5569c34ad680 0x5569c34afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.561+0000 7fe09f200740 4 client.16311 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.561+0000 7fe09f200740 1 -- 172.21.15.135:0/2696212679 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569c3406b30 con 0x5569c34ad680 2024-04-20T12:24:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.561+0000 7fe09a2ce640 1 --2- 172.21.15.135:0/2696212679 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5569c34ad680 0x5569c34afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.561+0000 7fe09a2ce640 1 --2- 172.21.15.135:0/2696212679 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5569c34ad680 0x5569c34afa90 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1c15f9575cf23841 server_cookie=86988527f43c4b2b in_seq=0 out_seq=0 2024-04-20T12:24:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.561+0000 7fe07dffb640 10 client.16311 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:24:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.562+0000 7fe07dffb640 1 -- 172.21.15.135:0/2696212679 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5569c3406b30 con 0x5569c34ad680 2024-04-20T12:24:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.562+0000 7fe07dffb640 10 client.16311 handle_command_reply: tid=0 2024-04-20T12:24:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.562+0000 7fe09f200740 1 client.16311 shutdown 2024-04-20T12:24:51.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.562+0000 7fe09f200740 1 -- 172.21.15.135:0/2696212679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c349d310 msgr2=0x5569c349ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.562+0000 7fe09f200740 1 --2- 172.21.15.135:0/2696212679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c349d310 0x5569c349ae60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe084013270 tx=0x7fe084009960 comp rx=0 tx=0).stop 2024-04-20T12:24:51.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.562+0000 7fe09f200740 1 -- 172.21.15.135:0/2696212679 shutdown_connections 2024-04-20T12:24:51.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.562+0000 7fe09f200740 1 --2- 172.21.15.135:0/2696212679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c349d310 0x5569c349ae60 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.562+0000 7fe09f200740 1 --2- 172.21.15.135:0/2696212679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3494730 0x5569c349a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.562+0000 7fe09f200740 1 --2- 172.21.15.135:0/2696212679 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5569c34ad680 0x5569c34afa90 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.562+0000 7fe09f200740 1 --2- 172.21.15.135:0/2696212679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3493e10 0x5569c349a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.562+0000 7fe09f200740 1 -- 172.21.15.135:0/2696212679 >> 172.21.15.135:0/2696212679 conn(0x5569c348e540 msgr2=0x5569c3490290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.562+0000 7fe07dffb640 0 client.16311 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:24:51.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.562+0000 7fe09f200740 1 -- 172.21.15.135:0/2696212679 shutdown_connections 2024-04-20T12:24:51.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.562+0000 7fe09f200740 1 -- 172.21.15.135:0/2696212679 wait complete. 2024-04-20T12:24:51.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.562+0000 7fe09f200740 20 client.16311 trim_cache size 0 max 16384 2024-04-20T12:24:51.568 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194304 len 8192 2024-04-20T12:24:51.568 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4194304 len 16384 2024-04-20T12:24:51.568 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-04-20T12:24:51.568 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4194304 len 16384 2024-04-20T12:24:51.568 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194304 len 16384 2024-04-20T12:24:51.568 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4194816 len 1024 2024-04-20T12:24:51.568 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-04-20T12:24:51.568 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4194816 len 1024 2024-04-20T12:24:51.568 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194816 len 1024 2024-04-20T12:24:51.568 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4194816 len 2048 2024-04-20T12:24:51.568 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-04-20T12:24:51.568 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4194816 len 2048 2024-04-20T12:24:51.568 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194816 len 2048 2024-04-20T12:24:51.568 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4194816 len 4096 2024-04-20T12:24:51.569 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-04-20T12:24:51.569 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4194816 len 4096 2024-04-20T12:24:51.569 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194816 len 4096 2024-04-20T12:24:51.569 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4194816 len 8192 2024-04-20T12:24:51.569 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-04-20T12:24:51.569 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4194816 len 8192 2024-04-20T12:24:51.569 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194816 len 8192 2024-04-20T12:24:51.569 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4194816 len 16384 2024-04-20T12:24:51.569 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-04-20T12:24:51.569 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4194816 len 16384 2024-04-20T12:24:51.569 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4194816 len 16384 2024-04-20T12:24:51.569 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4195328 len 1024 2024-04-20T12:24:51.569 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-04-20T12:24:51.569 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4195328 len 1024 2024-04-20T12:24:51.569 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195328 len 1024 2024-04-20T12:24:51.570 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4195328 len 2048 2024-04-20T12:24:51.570 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-04-20T12:24:51.570 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4195328 len 2048 2024-04-20T12:24:51.570 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195328 len 2048 2024-04-20T12:24:51.570 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4195328 len 4096 2024-04-20T12:24:51.570 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-04-20T12:24:51.570 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4195328 len 4096 2024-04-20T12:24:51.570 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195328 len 4096 2024-04-20T12:24:51.570 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4195328 len 8192 2024-04-20T12:24:51.570 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-04-20T12:24:51.570 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4195328 len 8192 2024-04-20T12:24:51.570 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195328 len 8192 2024-04-20T12:24:51.570 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4195328 len 16384 2024-04-20T12:24:51.570 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-04-20T12:24:51.571 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4195328 len 16384 2024-04-20T12:24:51.571 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195328 len 16384 2024-04-20T12:24:51.571 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4195840 len 1024 2024-04-20T12:24:51.571 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-04-20T12:24:51.571 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4195840 len 1024 2024-04-20T12:24:51.571 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195840 len 1024 2024-04-20T12:24:51.571 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4195840 len 2048 2024-04-20T12:24:51.571 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-04-20T12:24:51.571 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4195840 len 2048 2024-04-20T12:24:51.571 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195840 len 2048 2024-04-20T12:24:51.571 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4195840 len 4096 2024-04-20T12:24:51.571 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-04-20T12:24:51.571 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4195840 len 4096 2024-04-20T12:24:51.571 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195840 len 4096 2024-04-20T12:24:51.571 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4195840 len 8192 2024-04-20T12:24:51.572 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-04-20T12:24:51.572 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4195840 len 8192 2024-04-20T12:24:51.572 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195840 len 8192 2024-04-20T12:24:51.572 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4195840 len 16384 2024-04-20T12:24:51.572 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-04-20T12:24:51.572 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4195840 len 16384 2024-04-20T12:24:51.572 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4195840 len 16384 2024-04-20T12:24:51.572 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4196352 len 1024 2024-04-20T12:24:51.572 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-04-20T12:24:51.572 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4196352 len 1024 2024-04-20T12:24:51.572 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196352 len 1024 2024-04-20T12:24:51.572 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4196352 len 2048 2024-04-20T12:24:51.572 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-04-20T12:24:51.572 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4196352 len 2048 2024-04-20T12:24:51.572 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196352 len 2048 2024-04-20T12:24:51.573 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4196352 len 4096 2024-04-20T12:24:51.573 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-04-20T12:24:51.573 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4196352 len 4096 2024-04-20T12:24:51.573 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196352 len 4096 2024-04-20T12:24:51.573 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4196352 len 8192 2024-04-20T12:24:51.573 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-04-20T12:24:51.573 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4196352 len 8192 2024-04-20T12:24:51.573 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196352 len 8192 2024-04-20T12:24:51.573 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4196352 len 16384 2024-04-20T12:24:51.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09f200740 1 Processor -- start 2024-04-20T12:24:51.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09f200740 1 -- start start 2024-04-20T12:24:51.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09f200740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3493e10 0x5569c349cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09f200740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3494730 0x5569c34a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09f200740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3499cc0 0x5569c34b5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09f200740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe0941b15f0 con 0x5569c3494730 2024-04-20T12:24:51.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09f200740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe0941b3130 con 0x5569c3493e10 2024-04-20T12:24:51.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09f200740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0941b1cc0 con 0x5569c3499cc0 2024-04-20T12:24:51.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09a2ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3494730 0x5569c34a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09a2ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3494730 0x5569c34a8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36268/0 (socket says 172.21.15.135:36268) 2024-04-20T12:24:51.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09a2ce640 1 -- 172.21.15.135:0/2164131977 learned_addr learned my addr 172.21.15.135:0/2164131977 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe099acd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3493e10 0x5569c349cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe099acd640 1 --2- 172.21.15.135:0/2164131977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3499cc0 0x5569c34b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09a2ce640 1 -- 172.21.15.135:0/2164131977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3499cc0 msgr2=0x5569c34b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09a2ce640 1 --2- 172.21.15.135:0/2164131977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3499cc0 0x5569c34b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09a2ce640 1 -- 172.21.15.135:0/2164131977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3493e10 msgr2=0x5569c349cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09a2ce640 1 --2- 172.21.15.135:0/2164131977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3493e10 0x5569c349cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09a2ce640 1 -- 172.21.15.135:0/2164131977 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569c3494530 con 0x5569c3494730 2024-04-20T12:24:51.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe099acd640 1 --2- 172.21.15.135:0/2164131977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3493e10 0x5569c349cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.578+0000 7fe09a2ce640 1 --2- 172.21.15.135:0/2164131977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3494730 0x5569c34a8f60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe090009900 tx=0x7fe090041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b60c4f0eeeb301 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.579+0000 7fe07ffff640 1 -- 172.21.15.135:0/2164131977 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090056070 con 0x5569c3494730 2024-04-20T12:24:51.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.579+0000 7fe07ffff640 1 -- 172.21.15.135:0/2164131977 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe090050bc0 con 0x5569c3494730 2024-04-20T12:24:51.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.579+0000 7fe07ffff640 1 -- 172.21.15.135:0/2164131977 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09004f030 con 0x5569c3494730 2024-04-20T12:24:51.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.579+0000 7fe09f200740 1 -- 172.21.15.135:0/2164131977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3494730 msgr2=0x5569c34a8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.579+0000 7fe09f200740 1 --2- 172.21.15.135:0/2164131977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3494730 0x5569c34a8f60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe090009900 tx=0x7fe090041040 comp rx=0 tx=0).stop 2024-04-20T12:24:51.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 1 -- 172.21.15.135:0/2164131977 shutdown_connections 2024-04-20T12:24:51.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 1 --2- 172.21.15.135:0/2164131977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3499cc0 0x5569c34b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 1 --2- 172.21.15.135:0/2164131977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3494730 0x5569c34a8f60 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 1 --2- 172.21.15.135:0/2164131977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3493e10 0x5569c349cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 1 -- 172.21.15.135:0/2164131977 >> 172.21.15.135:0/2164131977 conn(0x5569c348e540 msgr2=0x5569c348d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 1 -- 172.21.15.135:0/2164131977 shutdown_connections 2024-04-20T12:24:51.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 1 -- 172.21.15.135:0/2164131977 wait complete. 2024-04-20T12:24:51.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 1 -- start start 2024-04-20T12:24:51.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 1 Processor -- start 2024-04-20T12:24:51.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3493e10 0x5569c34a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3494730 0x5569c34a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3499cc0 0x5569c34a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe0941b2a60 con 0x5569c3499cc0 2024-04-20T12:24:51.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe0941b2390 con 0x5569c3493e10 2024-04-20T12:24:51.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe0941af5c0 con 0x5569c3494730 2024-04-20T12:24:51.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09f200740 10 client.0 _ll_register_callbacks cb 0x7fe0840130c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:51.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe099acd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3499cc0 0x5569c34a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe099acd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3499cc0 0x5569c34a0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36282/0 (socket says 172.21.15.135:36282) 2024-04-20T12:24:51.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe099acd640 1 -- 172.21.15.135:0/3096672923 learned_addr learned my addr 172.21.15.135:0/3096672923 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe099acd640 1 --2- 172.21.15.135:0/3096672923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3493e10 0x5569c34a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.580+0000 7fe09a2ce640 1 --2- 172.21.15.135:0/3096672923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3494730 0x5569c34a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.581+0000 7fe099acd640 1 -- 172.21.15.135:0/3096672923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3494730 msgr2=0x5569c34a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.581+0000 7fe099acd640 1 --2- 172.21.15.135:0/3096672923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3494730 0x5569c34a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.581+0000 7fe099acd640 1 -- 172.21.15.135:0/3096672923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3493e10 msgr2=0x5569c34a55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.581+0000 7fe099acd640 1 --2- 172.21.15.135:0/3096672923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3493e10 0x5569c34a55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.581+0000 7fe099acd640 1 -- 172.21.15.135:0/3096672923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569c34a1550 con 0x5569c3499cc0 2024-04-20T12:24:51.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.581+0000 7fe099acd640 1 --2- 172.21.15.135:0/3096672923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3499cc0 0x5569c34a0f90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe084004f80 tx=0x7fe08401c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e9a58d1144ce16 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.581+0000 7fe07dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.581+0000 7fe07dffb640 1 -- 172.21.15.135:0/3096672923 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0840040f0 con 0x5569c3499cc0 2024-04-20T12:24:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.581+0000 7fe07dffb640 1 -- 172.21.15.135:0/3096672923 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe084004290 con 0x5569c3499cc0 2024-04-20T12:24:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.581+0000 7fe09f200740 1 -- 172.21.15.135:0/3096672923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe090050bc0 con 0x5569c3499cc0 2024-04-20T12:24:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.581+0000 7fe07dffb640 1 -- 172.21.15.135:0/3096672923 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe084004490 con 0x5569c3499cc0 2024-04-20T12:24:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.581+0000 7fe09f200740 10 client.16317 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.581+0000 7fe09f200740 1 -- 172.21.15.135:0/3096672923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5569c3513980 con 0x5569c3499cc0 2024-04-20T12:24:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.581+0000 7fe07dffb640 1 -- 172.21.15.135:0/3096672923 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe090050bc0 con 0x5569c3499cc0 2024-04-20T12:24:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.582+0000 7fe07dffb640 1 -- 172.21.15.135:0/3096672923 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe0840054c0 con 0x5569c3499cc0 2024-04-20T12:24:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.582+0000 7fe09f200740 10 client.16317 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.582+0000 7fe09f200740 10 client.16317 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:24:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.582+0000 7fe09f200740 20 client.16317 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.582+0000 7fe09f200740 1 --2- 172.21.15.135:0/3096672923 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5569c3513fe0 0x5569c3516400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.582+0000 7fe09f200740 4 client.16317 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:24:51.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.582+0000 7fe09f200740 1 -- 172.21.15.135:0/3096672923 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5569c34009a0 con 0x5569c3513fe0 2024-04-20T12:24:51.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.582+0000 7fe09a2ce640 1 --2- 172.21.15.135:0/3096672923 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5569c3513fe0 0x5569c3516400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.582+0000 7fe09a2ce640 1 --2- 172.21.15.135:0/3096672923 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5569c3513fe0 0x5569c3516400 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ef3014e0bea5010 server_cookie=b88e238b154931ad in_seq=0 out_seq=0 2024-04-20T12:24:51.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.582+0000 7fe07dffb640 10 client.16317 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:24:51.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe07dffb640 1 -- 172.21.15.135:0/3096672923 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5569c34009a0 con 0x5569c3513fe0 2024-04-20T12:24:51.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe07dffb640 10 client.16317 handle_command_reply: tid=0 2024-04-20T12:24:51.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe09f200740 1 client.16317 shutdown 2024-04-20T12:24:51.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe09f200740 1 -- 172.21.15.135:0/3096672923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3499cc0 msgr2=0x5569c34a0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe09f200740 1 --2- 172.21.15.135:0/3096672923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3499cc0 0x5569c34a0f90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe084004f80 tx=0x7fe08401c040 comp rx=0 tx=0).stop 2024-04-20T12:24:51.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe09f200740 1 -- 172.21.15.135:0/3096672923 shutdown_connections 2024-04-20T12:24:51.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe09f200740 1 --2- 172.21.15.135:0/3096672923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c3499cc0 0x5569c34a0f90 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe09f200740 1 --2- 172.21.15.135:0/3096672923 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5569c3513fe0 0x5569c3516400 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe09f200740 1 --2- 172.21.15.135:0/3096672923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5569c3494730 0x5569c34a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe09f200740 1 --2- 172.21.15.135:0/3096672923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5569c3493e10 0x5569c34a55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe09f200740 1 -- 172.21.15.135:0/3096672923 >> 172.21.15.135:0/3096672923 conn(0x5569c348e540 msgr2=0x5569c3498cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe07dffb640 0 client.16317 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:24:51.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe09f200740 1 -- 172.21.15.135:0/3096672923 shutdown_connections 2024-04-20T12:24:51.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe09f200740 1 -- 172.21.15.135:0/3096672923 wait complete. 2024-04-20T12:24:51.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe09f200740 20 client.16317 trim_cache size 0 max 16384 2024-04-20T12:24:51.589 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:24:51.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.583+0000 7fe09c532640 1 -- 172.21.15.135:0/3548982540 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe0800a3d20 msgr2=0x7fe0800a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.584+0000 7fe09c532640 1 --2- 172.21.15.135:0/3548982540 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe0800a3d20 0x7fe0800a61e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe08c099220 tx=0x7fe08c0989c0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.584+0000 7fe09c532640 1 -- 172.21.15.135:0/3548982540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe09410c510 msgr2=0x7fe0941018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.584+0000 7fe09c532640 1 --2- 172.21.15.135:0/3548982540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe09410c510 0x7fe0941018a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00eb10 tx=0x7fe08c00c2d0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.584+0000 7fe09c532640 1 -- 172.21.15.135:0/3548982540 shutdown_connections 2024-04-20T12:24:51.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.584+0000 7fe09c532640 1 --2- 172.21.15.135:0/3548982540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe09410c510 0x7fe0941018a0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.584+0000 7fe09c532640 1 --2- 172.21.15.135:0/3548982540 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe094103af0 0x7fe094101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.584+0000 7fe09c532640 1 --2- 172.21.15.135:0/3548982540 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe0800a3d20 0x7fe0800a61e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.584+0000 7fe09c532640 1 --2- 172.21.15.135:0/3548982540 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0941031d0 0x7fe094100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.584+0000 7fe09c532640 1 -- 172.21.15.135:0/3548982540 >> 172.21.15.135:0/3548982540 conn(0x7fe094078010 msgr2=0x7fe0940fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.584+0000 7fe09c532640 1 -- 172.21.15.135:0/3548982540 shutdown_connections 2024-04-20T12:24:51.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.584+0000 7fe09c532640 1 -- 172.21.15.135:0/3548982540 wait complete. 2024-04-20T12:24:51.594 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:24:51.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.750+0000 7fe2a4584640 1 -- 172.21.15.135:0/4143711598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c1021b0 msgr2=0x7fe29c102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.750+0000 7fe2a4584640 1 --2- 172.21.15.135:0/4143711598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c1021b0 0x7fe29c102590 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe298009900 tx=0x7fe29802bc30 comp rx=0 tx=0).stop 2024-04-20T12:24:51.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.750+0000 7fe2a4584640 1 -- 172.21.15.135:0/4143711598 shutdown_connections 2024-04-20T12:24:51.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.750+0000 7fe2a4584640 1 --2- 172.21.15.135:0/4143711598 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe29c107280 0x7fe29c10ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.750+0000 7fe2a4584640 1 --2- 172.21.15.135:0/4143711598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe29c102b60 0x7fe29c106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.750+0000 7fe2a4584640 1 --2- 172.21.15.135:0/4143711598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c1021b0 0x7fe29c102590 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.750+0000 7fe2a4584640 1 -- 172.21.15.135:0/4143711598 >> 172.21.15.135:0/4143711598 conn(0x7fe29c0793f0 msgr2=0x7fe29c079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.750+0000 7fe2a4584640 1 -- 172.21.15.135:0/4143711598 shutdown_connections 2024-04-20T12:24:51.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.750+0000 7fe2a4584640 1 -- 172.21.15.135:0/4143711598 wait complete. 2024-04-20T12:24:51.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.751+0000 7fe2a4584640 1 Processor -- start 2024-04-20T12:24:51.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.751+0000 7fe2a4584640 1 -- start start 2024-04-20T12:24:51.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.751+0000 7fe2a4584640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe29c1021b0 0x7fe29c19e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.751+0000 7fe2a4584640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe29c107280 0x7fe29c19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.751+0000 7fe2a4584640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c1985f0 0x7fe29c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.751+0000 7fe2a4584640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c112310 con 0x7fe29c1985f0 2024-04-20T12:24:51.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.751+0000 7fe2a4584640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c112190 con 0x7fe29c107280 2024-04-20T12:24:51.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.751+0000 7fe2a4584640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c112490 con 0x7fe29c1021b0 2024-04-20T12:24:51.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.751+0000 7fe2a2b21640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c1985f0 0x7fe29c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.751+0000 7fe2a2b21640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c1985f0 0x7fe29c198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36308/0 (socket says 172.21.15.135:36308) 2024-04-20T12:24:51.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.751+0000 7fe2a2320640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe29c1021b0 0x7fe29c19e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.751+0000 7fe2a2b21640 1 -- 172.21.15.135:0/3770994534 learned_addr learned my addr 172.21.15.135:0/3770994534 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.751+0000 7fe2a1b1f640 1 --2- 172.21.15.135:0/3770994534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe29c107280 0x7fe29c19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.752+0000 7fe2a2320640 1 -- 172.21.15.135:0/3770994534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe29c107280 msgr2=0x7fe29c19e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.752+0000 7fe2a2320640 1 --2- 172.21.15.135:0/3770994534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe29c107280 0x7fe29c19e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.752+0000 7fe2a2320640 1 -- 172.21.15.135:0/3770994534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c1985f0 msgr2=0x7fe29c198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.752+0000 7fe2a2320640 1 --2- 172.21.15.135:0/3770994534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c1985f0 0x7fe29c198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.752+0000 7fe2a2320640 1 -- 172.21.15.135:0/3770994534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29c199110 con 0x7fe29c1021b0 2024-04-20T12:24:51.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.752+0000 7fe2a2b21640 1 --2- 172.21.15.135:0/3770994534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c1985f0 0x7fe29c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.752+0000 7fe2a2320640 1 --2- 172.21.15.135:0/3770994534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe29c1021b0 0x7fe29c19e440 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe298036040 tx=0x7fe29802cb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.752+0000 7fe2937fe640 1 -- 172.21.15.135:0/3770994534 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298041070 con 0x7fe29c1021b0 2024-04-20T12:24:51.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.752+0000 7fe2a4584640 1 -- 172.21.15.135:0/3770994534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe29c1993a0 con 0x7fe29c1021b0 2024-04-20T12:24:51.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.752+0000 7fe2937fe640 1 -- 172.21.15.135:0/3770994534 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe298004450 con 0x7fe29c1021b0 2024-04-20T12:24:51.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.752+0000 7fe2a4584640 1 -- 172.21.15.135:0/3770994534 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe29c1a55f0 con 0x7fe29c1021b0 2024-04-20T12:24:51.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.752+0000 7fe2937fe640 1 -- 172.21.15.135:0/3770994534 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298003d90 con 0x7fe29c1021b0 2024-04-20T12:24:51.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.754+0000 7fe2937fe640 1 -- 172.21.15.135:0/3770994534 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fe298044070 con 0x7fe29c1021b0 2024-04-20T12:24:51.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.755+0000 7fe2a717b740 1 Processor -- start 2024-04-20T12:24:51.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.755+0000 7fe2a717b740 1 -- start start 2024-04-20T12:24:51.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.755+0000 7fe2a717b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 0x55826b03e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.755+0000 7fe2a717b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b03e730 0x55826b046dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.755+0000 7fe2a717b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b047310 0x55826b049700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.755+0000 7fe2a717b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55826afa3110 con 0x55826b047310 2024-04-20T12:24:51.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.755+0000 7fe2a717b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55826af40550 con 0x55826b03e730 2024-04-20T12:24:51.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.755+0000 7fe2a717b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55826af9f0d0 con 0x55826b03de10 2024-04-20T12:24:51.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2a2320640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b03e730 0x55826b046dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2a1b1f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b047310 0x55826b049700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2937fe640 1 --2- 172.21.15.135:0/3770994534 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe2880a3d20 0x7fe2880a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2a2320640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b03e730 0x55826b046dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:39120/0 (socket says 172.21.15.135:39120) 2024-04-20T12:24:51.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2a1b1f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b047310 0x55826b049700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36310/0 (socket says 172.21.15.135:36310) 2024-04-20T12:24:51.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2a2320640 1 -- 172.21.15.135:0/1224629205 learned_addr learned my addr 172.21.15.135:0/1224629205 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2a2b21640 1 --2- 172.21.15.135:0/1224629205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 0x55826b03e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2a2b21640 1 --2- 172.21.15.135:0/3770994534 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe2880a3d20 0x7fe2880a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2a2320640 1 -- 172.21.15.135:0/1224629205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 msgr2=0x55826b03e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2a2320640 1 --2- 172.21.15.135:0/1224629205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 0x55826b03e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2a2320640 1 -- 172.21.15.135:0/1224629205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b047310 msgr2=0x55826b049700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2a2320640 1 --2- 172.21.15.135:0/1224629205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b047310 0x55826b049700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2937fe640 1 -- 172.21.15.135:0/3770994534 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe2980f2460 con 0x7fe29c1021b0 2024-04-20T12:24:51.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2a2320640 1 -- 172.21.15.135:0/1224629205 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55826af68900 con 0x55826b03e730 2024-04-20T12:24:51.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2a1b1f640 1 --2- 172.21.15.135:0/1224629205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b047310 0x55826b049700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2a2b21640 1 --2- 172.21.15.135:0/3770994534 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe2880a3d20 0x7fe2880a61e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe294009aa0 tx=0x7fe294009500 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.756+0000 7fe2a2320640 1 --2- 172.21.15.135:0/1224629205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b03e730 0x55826b046dd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe2980bac00 tx=0x7fe298000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74b355d180c4d04 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.757+0000 7fe290bfe640 1 -- 172.21.15.135:0/1224629205 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29804b070 con 0x55826b03e730 2024-04-20T12:24:51.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.757+0000 7fe290bfe640 1 -- 172.21.15.135:0/1224629205 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2980be230 con 0x55826b03e730 2024-04-20T12:24:51.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.757+0000 7fe290bfe640 1 -- 172.21.15.135:0/1224629205 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2980c25e0 con 0x55826b03e730 2024-04-20T12:24:51.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.757+0000 7fe2a717b740 1 -- 172.21.15.135:0/1224629205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b03e730 msgr2=0x55826b046dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.757+0000 7fe2a717b740 1 --2- 172.21.15.135:0/1224629205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b03e730 0x55826b046dd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe2980bac00 tx=0x7fe298000bc0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.757+0000 7fe2a717b740 1 -- 172.21.15.135:0/1224629205 shutdown_connections 2024-04-20T12:24:51.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.757+0000 7fe2a717b740 1 --2- 172.21.15.135:0/1224629205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b047310 0x55826b049700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.757+0000 7fe2a717b740 1 --2- 172.21.15.135:0/1224629205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b03e730 0x55826b046dd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.757+0000 7fe2a717b740 1 --2- 172.21.15.135:0/1224629205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 0x55826b03e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.757+0000 7fe2a717b740 1 -- 172.21.15.135:0/1224629205 >> 172.21.15.135:0/1224629205 conn(0x55826b038540 msgr2=0x55826b038920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a717b740 1 -- 172.21.15.135:0/1224629205 shutdown_connections 2024-04-20T12:24:51.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a717b740 1 -- 172.21.15.135:0/1224629205 wait complete. 2024-04-20T12:24:51.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a717b740 1 -- start start 2024-04-20T12:24:51.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a717b740 1 Processor -- start 2024-04-20T12:24:51.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a717b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 0x55826b0443d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a717b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03e730 0x55826b044910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a717b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 0x55826b044e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a717b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55826af40550 con 0x55826b03e730 2024-04-20T12:24:51.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a717b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55826af5c500 con 0x55826b047310 2024-04-20T12:24:51.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a717b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55826b049ec0 con 0x55826b03de10 2024-04-20T12:24:51.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a717b740 10 client.0 _ll_register_callbacks cb 0x55826af412f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:51.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a1b1f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03e730 0x55826b044910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a2b21640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 0x55826b044e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a2320640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 0x55826b0443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a1b1f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03e730 0x55826b044910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36320/0 (socket says 172.21.15.135:36320) 2024-04-20T12:24:51.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.758+0000 7fe2a1b1f640 1 -- 172.21.15.135:0/982300211 learned_addr learned my addr 172.21.15.135:0/982300211 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.759+0000 7fe2a2320640 1 -- 172.21.15.135:0/982300211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 msgr2=0x55826b044e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.759+0000 7fe2a2320640 1 --2- 172.21.15.135:0/982300211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 0x55826b044e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.759+0000 7fe2a2320640 1 -- 172.21.15.135:0/982300211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03e730 msgr2=0x55826b044910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.759+0000 7fe2a2320640 1 --2- 172.21.15.135:0/982300211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03e730 0x55826b044910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.759+0000 7fe2a2320640 1 -- 172.21.15.135:0/982300211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55826acb53f0 con 0x55826b03de10 2024-04-20T12:24:51.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.759+0000 7fe2a2b21640 1 --2- 172.21.15.135:0/982300211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 0x55826b044e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.759+0000 7fe2a1b1f640 1 --2- 172.21.15.135:0/982300211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03e730 0x55826b044910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.759+0000 7fe2a2320640 1 --2- 172.21.15.135:0/982300211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 0x55826b0443d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe2980bdee0 tx=0x7fe298003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39fd27b4ce7fd81a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.759+0000 7fe285ffb640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-20T12:24:51.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.759+0000 7fe285ffb640 1 -- 172.21.15.135:0/982300211 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29804b040 con 0x55826b03de10 2024-04-20T12:24:51.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.759+0000 7fe285ffb640 1 -- 172.21.15.135:0/982300211 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe2980ba8a0 con 0x55826b03de10 2024-04-20T12:24:51.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.759+0000 7fe2a717b740 1 -- 172.21.15.135:0/982300211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55826afb0b30 con 0x55826b03de10 2024-04-20T12:24:51.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.759+0000 7fe285ffb640 1 -- 172.21.15.135:0/982300211 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe2980d7050 con 0x55826b03de10 2024-04-20T12:24:51.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.759+0000 7fe2a717b740 10 client.25723 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:51.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.759+0000 7fe2a717b740 1 -- 172.21.15.135:0/982300211 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55826ad7f7d0 con 0x55826b03de10 2024-04-20T12:24:51.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.760+0000 7fe285ffb640 1 -- 172.21.15.135:0/982300211 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55826afb0b30 con 0x55826b03de10 2024-04-20T12:24:51.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.760+0000 7fe285ffb640 1 -- 172.21.15.135:0/982300211 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe2980c2170 con 0x55826b03de10 2024-04-20T12:24:51.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.760+0000 7fe2a717b740 10 client.25723 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:51.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.760+0000 7fe2a717b740 10 client.25723 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:24:51.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.760+0000 7fe2a717b740 20 client.25723 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:51.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.760+0000 7fe2a717b740 1 --2- 172.21.15.135:0/982300211 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55826b057210 0x55826b059600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.760+0000 7fe2a717b740 4 client.25723 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:51.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.760+0000 7fe2a717b740 1 -- 172.21.15.135:0/982300211 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55826afaa9a0 con 0x55826b057210 2024-04-20T12:24:51.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.760+0000 7fe2a1b1f640 1 --2- 172.21.15.135:0/982300211 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55826b057210 0x55826b059600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.760+0000 7fe285ffb640 10 client.25723 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:24:51.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.760+0000 7fe2a1b1f640 1 --2- 172.21.15.135:0/982300211 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55826b057210 0x55826b059600 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=effd8ac21d4f2a62 server_cookie=a431bdd86a891e0c in_seq=0 out_seq=0 2024-04-20T12:24:51.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.761+0000 7fe285ffb640 1 -- 172.21.15.135:0/982300211 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55826afaa9a0 con 0x55826b057210 2024-04-20T12:24:51.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.761+0000 7fe285ffb640 10 client.25723 handle_command_reply: tid=0 2024-04-20T12:24:51.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.761+0000 7fe2a717b740 1 client.25723 shutdown 2024-04-20T12:24:51.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.761+0000 7fe2a717b740 1 -- 172.21.15.135:0/982300211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 msgr2=0x55826b0443d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.761+0000 7fe2a717b740 1 --2- 172.21.15.135:0/982300211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 0x55826b0443d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe2980bdee0 tx=0x7fe298003820 comp rx=0 tx=0).stop 2024-04-20T12:24:51.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.761+0000 7fe2a717b740 1 -- 172.21.15.135:0/982300211 shutdown_connections 2024-04-20T12:24:51.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.761+0000 7fe2a717b740 1 --2- 172.21.15.135:0/982300211 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55826b057210 0x55826b059600 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.761+0000 7fe2a717b740 1 --2- 172.21.15.135:0/982300211 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 0x55826b044e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.761+0000 7fe2a717b740 1 --2- 172.21.15.135:0/982300211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03e730 0x55826b044910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.761+0000 7fe2a717b740 1 --2- 172.21.15.135:0/982300211 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 0x55826b0443d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.761+0000 7fe285ffb640 0 client.25723 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:24:51.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.761+0000 7fe2a717b740 1 -- 172.21.15.135:0/982300211 >> 172.21.15.135:0/982300211 conn(0x55826b038540 msgr2=0x55826b03a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.761+0000 7fe2a717b740 1 -- 172.21.15.135:0/982300211 shutdown_connections 2024-04-20T12:24:51.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.761+0000 7fe2a717b740 1 -- 172.21.15.135:0/982300211 wait complete. 2024-04-20T12:24:51.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.761+0000 7fe2a717b740 20 client.25723 trim_cache size 0 max 16384 2024-04-20T12:24:51.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.776+0000 7fe2a717b740 1 Processor -- start 2024-04-20T12:24:51.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.776+0000 7fe2a717b740 1 -- start start 2024-04-20T12:24:51.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.776+0000 7fe2a717b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 0x55826b05ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.776+0000 7fe2a717b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03e730 0x55826b05f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.776+0000 7fe2a717b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 0x55826b036e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.776+0000 7fe2a717b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1af2f0 con 0x55826b03e730 2024-04-20T12:24:51.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.776+0000 7fe2a717b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1b0e30 con 0x55826b047310 2024-04-20T12:24:51.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.776+0000 7fe2a717b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1af9c0 con 0x55826b03de10 2024-04-20T12:24:51.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.776+0000 7fe2a2b21640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 0x55826b036e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.776+0000 7fe2a2320640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 0x55826b05ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.776+0000 7fe2a1b1f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03e730 0x55826b05f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.776+0000 7fe2a2b21640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 0x55826b036e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:39146/0 (socket says 172.21.15.135:39146) 2024-04-20T12:24:51.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.776+0000 7fe2a2b21640 1 -- 172.21.15.135:0/2342527337 learned_addr learned my addr 172.21.15.135:0/2342527337 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.777+0000 7fe2a2320640 1 -- 172.21.15.135:0/2342527337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 msgr2=0x55826b036e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.777+0000 7fe2a2320640 1 --2- 172.21.15.135:0/2342527337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 0x55826b036e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.777+0000 7fe2a2320640 1 -- 172.21.15.135:0/2342527337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03e730 msgr2=0x55826b05f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.777+0000 7fe2a2320640 1 --2- 172.21.15.135:0/2342527337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03e730 0x55826b05f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.777+0000 7fe2a2320640 1 -- 172.21.15.135:0/2342527337 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55826b059970 con 0x55826b03de10 2024-04-20T12:24:51.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.777+0000 7fe2a1b1f640 1 --2- 172.21.15.135:0/2342527337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03e730 0x55826b05f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.777+0000 7fe2a2320640 1 --2- 172.21.15.135:0/2342527337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 0x55826b05ebd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe2980ba690 tx=0x7fe29802bc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0bea6ac466987ea server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.777+0000 7fe287fff640 1 -- 172.21.15.135:0/2342527337 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29804b070 con 0x55826b03de10 2024-04-20T12:24:51.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.777+0000 7fe287fff640 1 -- 172.21.15.135:0/2342527337 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2980be930 con 0x55826b03de10 2024-04-20T12:24:51.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.777+0000 7fe287fff640 1 -- 172.21.15.135:0/2342527337 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2980c6ea0 con 0x55826b03de10 2024-04-20T12:24:51.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.778+0000 7fe2a717b740 1 -- 172.21.15.135:0/2342527337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 msgr2=0x55826b05ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.778+0000 7fe2a717b740 1 --2- 172.21.15.135:0/2342527337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 0x55826b05ebd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe2980ba690 tx=0x7fe29802bc30 comp rx=0 tx=0).stop 2024-04-20T12:24:51.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.778+0000 7fe2a717b740 1 -- 172.21.15.135:0/2342527337 shutdown_connections 2024-04-20T12:24:51.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.778+0000 7fe2a717b740 1 --2- 172.21.15.135:0/2342527337 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 0x55826b036e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.778+0000 7fe2a717b740 1 --2- 172.21.15.135:0/2342527337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03e730 0x55826b05f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.778+0000 7fe2a717b740 1 --2- 172.21.15.135:0/2342527337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03de10 0x55826b05ebd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.778+0000 7fe2a717b740 1 -- 172.21.15.135:0/2342527337 >> 172.21.15.135:0/2342527337 conn(0x55826b038540 msgr2=0x55826b033570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.778+0000 7fe2a717b740 1 -- 172.21.15.135:0/2342527337 shutdown_connections 2024-04-20T12:24:51.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.778+0000 7fe2a717b740 1 -- 172.21.15.135:0/2342527337 wait complete. 2024-04-20T12:24:51.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a717b740 1 -- start start 2024-04-20T12:24:51.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a717b740 1 Processor -- start 2024-04-20T12:24:51.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a717b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03de10 0x55826b041d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a717b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03e730 0x55826b040800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a717b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 0x55826b040d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a717b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1b0760 con 0x55826b03de10 2024-04-20T12:24:51.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a717b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1b0090 con 0x55826b047310 2024-04-20T12:24:51.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a717b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1ad2c0 con 0x55826b03e730 2024-04-20T12:24:51.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a717b740 10 client.0 _ll_register_callbacks cb 0x7fe28c009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:51.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a2320640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03de10 0x55826b041d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a2320640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03de10 0x55826b041d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36330/0 (socket says 172.21.15.135:36330) 2024-04-20T12:24:51.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a2320640 1 -- 172.21.15.135:0/1387454121 learned_addr learned my addr 172.21.15.135:0/1387454121 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a1b1f640 1 --2- 172.21.15.135:0/1387454121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03e730 0x55826b040800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a2b21640 1 --2- 172.21.15.135:0/1387454121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 0x55826b040d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a2320640 1 -- 172.21.15.135:0/1387454121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03e730 msgr2=0x55826b040800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a2320640 1 --2- 172.21.15.135:0/1387454121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03e730 0x55826b040800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a2320640 1 -- 172.21.15.135:0/1387454121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 msgr2=0x55826b040d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a2320640 1 --2- 172.21.15.135:0/1387454121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 0x55826b040d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a2320640 1 -- 172.21.15.135:0/1387454121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55826b041300 con 0x55826b03de10 2024-04-20T12:24:51.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a2b21640 1 --2- 172.21.15.135:0/1387454121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 0x55826b040d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:24:51.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.779+0000 7fe2a1b1f640 1 --2- 172.21.15.135:0/1387454121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03e730 0x55826b040800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe2a2320640 1 --2- 172.21.15.135:0/1387454121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03de10 0x55826b041d10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe2980bc4e0 tx=0x7fe2980f2840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463398bdb2146de2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe285ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:51.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe285ffb640 1 -- 172.21.15.135:0/1387454121 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29804b040 con 0x55826b03de10 2024-04-20T12:24:51.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe285ffb640 1 -- 172.21.15.135:0/1387454121 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe2980bc530 con 0x55826b03de10 2024-04-20T12:24:51.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe2a717b740 1 -- 172.21.15.135:0/1387454121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2980be930 con 0x55826b03de10 2024-04-20T12:24:51.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe285ffb640 1 -- 172.21.15.135:0/1387454121 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe2980ba4d0 con 0x55826b03de10 2024-04-20T12:24:51.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe2a717b740 10 client.16335 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:51.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe2a717b740 1 -- 172.21.15.135:0/1387454121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55826b041300 con 0x55826b03de10 2024-04-20T12:24:51.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe285ffb640 1 -- 172.21.15.135:0/1387454121 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2980be930 con 0x55826b03de10 2024-04-20T12:24:51.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe285ffb640 1 -- 172.21.15.135:0/1387454121 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe2980bd680 con 0x55826b03de10 2024-04-20T12:24:51.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe2a717b740 10 client.16335 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:51.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe2a717b740 10 client.16335 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:24:51.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe2a717b740 20 client.16335 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:51.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe2a717b740 1 --2- 172.21.15.135:0/1387454121 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55826b0c1500 0x55826b0c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe2a717b740 4 client.16335 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:24:51.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.780+0000 7fe2a717b740 1 -- 172.21.15.135:0/1387454121 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55826af266e0 con 0x55826b0c1500 2024-04-20T12:24:51.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.781+0000 7fe2a1b1f640 1 --2- 172.21.15.135:0/1387454121 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55826b0c1500 0x55826b0c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.781+0000 7fe2a1b1f640 1 --2- 172.21.15.135:0/1387454121 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55826b0c1500 0x55826b0c38f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c19f473cf981e415 server_cookie=8e0eaab41199d14a in_seq=0 out_seq=0 2024-04-20T12:24:51.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.781+0000 7fe285ffb640 10 client.16335 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:24:51.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.781+0000 7fe285ffb640 1 -- 172.21.15.135:0/1387454121 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55826af266e0 con 0x55826b0c1500 2024-04-20T12:24:51.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.781+0000 7fe285ffb640 10 client.16335 handle_command_reply: tid=0 2024-04-20T12:24:51.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.781+0000 7fe2a717b740 1 client.16335 shutdown 2024-04-20T12:24:51.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.781+0000 7fe2a717b740 1 -- 172.21.15.135:0/1387454121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03de10 msgr2=0x55826b041d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.781+0000 7fe2a717b740 1 --2- 172.21.15.135:0/1387454121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03de10 0x55826b041d10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe2980bc4e0 tx=0x7fe2980f2840 comp rx=0 tx=0).stop 2024-04-20T12:24:51.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.781+0000 7fe2a717b740 1 -- 172.21.15.135:0/1387454121 shutdown_connections 2024-04-20T12:24:51.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.781+0000 7fe2a717b740 1 --2- 172.21.15.135:0/1387454121 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55826b0c1500 0x55826b0c38f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.781+0000 7fe2a717b740 1 --2- 172.21.15.135:0/1387454121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55826b047310 0x55826b040d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.781+0000 7fe2a717b740 1 --2- 172.21.15.135:0/1387454121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55826b03e730 0x55826b040800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.781+0000 7fe285ffb640 0 client.16335 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:24:51.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.781+0000 7fe2a717b740 1 --2- 172.21.15.135:0/1387454121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55826b03de10 0x55826b041d10 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.781+0000 7fe2a717b740 1 -- 172.21.15.135:0/1387454121 >> 172.21.15.135:0/1387454121 conn(0x55826b038540 msgr2=0x55826b036e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.782+0000 7fe2a717b740 1 -- 172.21.15.135:0/1387454121 shutdown_connections 2024-04-20T12:24:51.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.782+0000 7fe2a717b740 1 -- 172.21.15.135:0/1387454121 wait complete. 2024-04-20T12:24:51.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.782+0000 7fe2a717b740 20 client.16335 trim_cache size 0 max 16384 2024-04-20T12:24:51.792 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:24:51.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.782+0000 7fe2a4584640 1 -- 172.21.15.135:0/3770994534 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe2880a3d20 msgr2=0x7fe2880a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.782+0000 7fe2a4584640 1 --2- 172.21.15.135:0/3770994534 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe2880a3d20 0x7fe2880a61e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe294009aa0 tx=0x7fe294009500 comp rx=0 tx=0).stop 2024-04-20T12:24:51.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.782+0000 7fe2a4584640 1 -- 172.21.15.135:0/3770994534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe29c1021b0 msgr2=0x7fe29c19e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.782+0000 7fe2a4584640 1 --2- 172.21.15.135:0/3770994534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe29c1021b0 0x7fe29c19e440 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe298036040 tx=0x7fe29802cb20 comp rx=0 tx=0).stop 2024-04-20T12:24:51.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.782+0000 7fe2a4584640 1 -- 172.21.15.135:0/3770994534 shutdown_connections 2024-04-20T12:24:51.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.782+0000 7fe2a4584640 1 --2- 172.21.15.135:0/3770994534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c1985f0 0x7fe29c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.782+0000 7fe2a4584640 1 --2- 172.21.15.135:0/3770994534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe29c107280 0x7fe29c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.782+0000 7fe2a4584640 1 --2- 172.21.15.135:0/3770994534 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe2880a3d20 0x7fe2880a61e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.782+0000 7fe2a4584640 1 --2- 172.21.15.135:0/3770994534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe29c1021b0 0x7fe29c19e440 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.782+0000 7fe2a4584640 1 -- 172.21.15.135:0/3770994534 >> 172.21.15.135:0/3770994534 conn(0x7fe29c0793f0 msgr2=0x7fe29c0ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.782+0000 7fe2a4584640 1 -- 172.21.15.135:0/3770994534 shutdown_connections 2024-04-20T12:24:51.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.782+0000 7fe2a4584640 1 -- 172.21.15.135:0/3770994534 wait complete. 2024-04-20T12:24:51.794 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:51 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1762208683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:24:51.795 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:24:51.881 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-04-20T12:24:51.881 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4196352 len 16384 2024-04-20T12:24:51.881 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196352 len 16384 2024-04-20T12:24:51.881 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4196864 len 1024 2024-04-20T12:24:51.881 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-04-20T12:24:51.882 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4196864 len 1024 2024-04-20T12:24:51.882 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196864 len 1024 2024-04-20T12:24:51.882 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4196864 len 2048 2024-04-20T12:24:51.882 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-04-20T12:24:51.882 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4196864 len 2048 2024-04-20T12:24:51.882 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196864 len 2048 2024-04-20T12:24:51.882 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4196864 len 4096 2024-04-20T12:24:51.882 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-04-20T12:24:51.882 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4196864 len 4096 2024-04-20T12:24:51.882 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196864 len 4096 2024-04-20T12:24:51.882 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4196864 len 8192 2024-04-20T12:24:51.882 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-04-20T12:24:51.882 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4196864 len 8192 2024-04-20T12:24:51.883 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196864 len 8192 2024-04-20T12:24:51.883 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4196864 len 16384 2024-04-20T12:24:51.883 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-04-20T12:24:51.883 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4196864 len 16384 2024-04-20T12:24:51.883 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4196864 len 16384 2024-04-20T12:24:51.883 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4197376 len 1024 2024-04-20T12:24:51.883 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-04-20T12:24:51.883 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4197376 len 1024 2024-04-20T12:24:51.883 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197376 len 1024 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4197376 len 2048 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4197376 len 2048 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197376 len 2048 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4197376 len 4096 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4197376 len 4096 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197376 len 4096 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4197376 len 8192 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4197376 len 8192 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197376 len 8192 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4197376 len 16384 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4197376 len 16384 2024-04-20T12:24:51.884 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197376 len 16384 2024-04-20T12:24:51.885 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4197888 len 1024 2024-04-20T12:24:51.885 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-04-20T12:24:51.885 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4197888 len 1024 2024-04-20T12:24:51.885 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197888 len 1024 2024-04-20T12:24:51.885 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4197888 len 2048 2024-04-20T12:24:51.885 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-04-20T12:24:51.885 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4197888 len 2048 2024-04-20T12:24:51.885 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197888 len 2048 2024-04-20T12:24:51.885 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4197888 len 4096 2024-04-20T12:24:51.885 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-04-20T12:24:51.885 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4197888 len 4096 2024-04-20T12:24:51.885 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197888 len 4096 2024-04-20T12:24:51.885 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4197888 len 8192 2024-04-20T12:24:51.885 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-04-20T12:24:51.885 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4197888 len 8192 2024-04-20T12:24:51.886 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197888 len 8192 2024-04-20T12:24:51.886 INFO:tasks.workunit.client.0.smithi135.stdout:read_direct buf_align 3584 offset 4197888 len 16384 2024-04-20T12:24:51.886 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-04-20T12:24:51.886 INFO:tasks.workunit.client.0.smithi135.stdout:read_sync buf_align 3584 offset 4197888 len 16384 2024-04-20T12:24:51.886 INFO:tasks.workunit.client.0.smithi135.stdout:read_file buf_align 3584 offset 4197888 len 16384 2024-04-20T12:24:51.886 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4190720 len 1024 2024-04-20T12:24:51.886 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-04-20T12:24:51.886 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4190720 len 1024 2024-04-20T12:24:51.886 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4190720 len 1024 2024-04-20T12:24:51.886 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4190720 len 2048 2024-04-20T12:24:51.886 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-04-20T12:24:51.886 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4190720 len 2048 2024-04-20T12:24:51.886 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4190720 len 2048 2024-04-20T12:24:51.886 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4190720 len 4096 2024-04-20T12:24:51.886 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-04-20T12:24:51.887 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4190720 len 4096 2024-04-20T12:24:51.887 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4190720 len 4096 2024-04-20T12:24:51.887 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4190720 len 8192 2024-04-20T12:24:51.887 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-04-20T12:24:51.887 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4190720 len 8192 2024-04-20T12:24:51.887 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4190720 len 8192 2024-04-20T12:24:51.887 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4190720 len 16384 2024-04-20T12:24:51.887 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-04-20T12:24:51.887 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4190720 len 16384 2024-04-20T12:24:51.887 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4190720 len 16384 2024-04-20T12:24:51.887 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4191232 len 1024 2024-04-20T12:24:51.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.908+0000 7f5d1ce31640 1 -- 172.21.15.135:0/664986610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d18101090 msgr2=0x7f5d18101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.908+0000 7f5d1ce31640 1 --2- 172.21.15.135:0/664986610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d18101090 0x7f5d18101470 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5d08009900 tx=0x7f5d0802bc30 comp rx=0 tx=0).stop 2024-04-20T12:24:51.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.908+0000 7f5d1ce31640 1 -- 172.21.15.135:0/664986610 shutdown_connections 2024-04-20T12:24:51.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.908+0000 7f5d1ce31640 1 --2- 172.21.15.135:0/664986610 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d18106160 0x7f5d1810dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.908+0000 7f5d1ce31640 1 --2- 172.21.15.135:0/664986610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d18101a40 0x7f5d18105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.908+0000 7f5d1ce31640 1 --2- 172.21.15.135:0/664986610 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d18101090 0x7f5d18101470 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.908+0000 7f5d1ce31640 1 -- 172.21.15.135:0/664986610 >> 172.21.15.135:0/664986610 conn(0x7f5d18078010 msgr2=0x7f5d18078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.908+0000 7f5d1ce31640 1 -- 172.21.15.135:0/664986610 shutdown_connections 2024-04-20T12:24:51.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.908+0000 7f5d1ce31640 1 -- 172.21.15.135:0/664986610 wait complete. 2024-04-20T12:24:51.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.909+0000 7f5d1ce31640 1 Processor -- start 2024-04-20T12:24:51.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.909+0000 7f5d1ce31640 1 -- start start 2024-04-20T12:24:51.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.909+0000 7f5d1ce31640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d18101090 0x7f5d18197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.909+0000 7f5d1ce31640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d18106160 0x7f5d18197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.909+0000 7f5d1ce31640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d1819bff0 0x7f5d1819c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.909+0000 7f5d1ce31640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d18111210 con 0x7f5d18101090 2024-04-20T12:24:51.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.909+0000 7f5d1ce31640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5d18111090 con 0x7f5d1819bff0 2024-04-20T12:24:51.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.909+0000 7f5d1ce31640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5d18111390 con 0x7f5d18106160 2024-04-20T12:24:51.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.909+0000 7f5d1659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d18101090 0x7f5d18197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.909+0000 7f5d15d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d18106160 0x7f5d18197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.909+0000 7f5d1659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d18101090 0x7f5d18197730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36342/0 (socket says 172.21.15.135:36342) 2024-04-20T12:24:51.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.909+0000 7f5d1659c640 1 -- 172.21.15.135:0/851290266 learned_addr learned my addr 172.21.15.135:0/851290266 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.909+0000 7f5d16d9d640 1 --2- 172.21.15.135:0/851290266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d1819bff0 0x7f5d1819c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.910+0000 7f5d15d9b640 1 -- 172.21.15.135:0/851290266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d1819bff0 msgr2=0x7f5d1819c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.910+0000 7f5d15d9b640 1 --2- 172.21.15.135:0/851290266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d1819bff0 0x7f5d1819c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.910+0000 7f5d15d9b640 1 -- 172.21.15.135:0/851290266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d18101090 msgr2=0x7f5d18197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.910+0000 7f5d15d9b640 1 --2- 172.21.15.135:0/851290266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d18101090 0x7f5d18197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.910+0000 7f5d15d9b640 1 -- 172.21.15.135:0/851290266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1819cae0 con 0x7f5d18106160 2024-04-20T12:24:51.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.910+0000 7f5d15d9b640 1 --2- 172.21.15.135:0/851290266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d18106160 0x7f5d18197c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c00e9c0 tx=0x7f5d0c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.910+0000 7f5d077fe640 1 -- 172.21.15.135:0/851290266 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c00ccc0 con 0x7f5d18106160 2024-04-20T12:24:51.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.910+0000 7f5d077fe640 1 -- 172.21.15.135:0/851290266 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d0c005020 con 0x7f5d18106160 2024-04-20T12:24:51.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.910+0000 7f5d077fe640 1 -- 172.21.15.135:0/851290266 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c004a00 con 0x7f5d18106160 2024-04-20T12:24:51.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.910+0000 7f5d1ce31640 1 -- 172.21.15.135:0/851290266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d1819cdd0 con 0x7f5d18106160 2024-04-20T12:24:51.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.910+0000 7f5d1ce31640 1 -- 172.21.15.135:0/851290266 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d180693c0 con 0x7f5d18106160 2024-04-20T12:24:51.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.912+0000 7f5d077fe640 1 -- 172.21.15.135:0/851290266 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f5d0c0051d0 con 0x7f5d18106160 2024-04-20T12:24:51.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.913+0000 7f5d077fe640 1 --2- 172.21.15.135:0/851290266 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5d000a3da0 0x7f5d000a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.913+0000 7f5d077fe640 1 -- 172.21.15.135:0/851290266 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5d0c0d0a30 con 0x7f5d18106160 2024-04-20T12:24:51.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.913+0000 7f5d1659c640 1 --2- 172.21.15.135:0/851290266 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5d000a3da0 0x7f5d000a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.913+0000 7f5d1659c640 1 --2- 172.21.15.135:0/851290266 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5d000a3da0 0x7f5d000a6260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5d0802cfd0 tx=0x7f5d080058d0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.914+0000 7f5d1fa23740 1 Processor -- start 2024-04-20T12:24:51.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.914+0000 7f5d1fa23740 1 -- start start 2024-04-20T12:24:51.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.914+0000 7f5d1fa23740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 0x55d9f114b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.914+0000 7f5d1fa23740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f114b730 0x55d9f1153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.914+0000 7f5d1fa23740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f1154310 0x55d9f1156700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.914+0000 7f5d1fa23740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d9f10b0110 con 0x55d9f1154310 2024-04-20T12:24:51.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.914+0000 7f5d1fa23740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d9f104d550 con 0x55d9f114b730 2024-04-20T12:24:51.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.914+0000 7f5d1fa23740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d9f10ac0d0 con 0x55d9f114ae10 2024-04-20T12:24:51.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.915+0000 7f5d16d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f1154310 0x55d9f1156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.915+0000 7f5d16d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f1154310 0x55d9f1156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36358/0 (socket says 172.21.15.135:36358) 2024-04-20T12:24:51.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.915+0000 7f5d16d9d640 1 -- 172.21.15.135:0/213980549 learned_addr learned my addr 172.21.15.135:0/213980549 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.915+0000 7f5d15d9b640 1 --2- 172.21.15.135:0/213980549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f114b730 0x55d9f1153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.915+0000 7f5d1659c640 1 --2- 172.21.15.135:0/213980549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 0x55d9f114b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.915+0000 7f5d16d9d640 1 -- 172.21.15.135:0/213980549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 msgr2=0x55d9f114b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.915+0000 7f5d16d9d640 1 --2- 172.21.15.135:0/213980549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 0x55d9f114b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.915+0000 7f5d16d9d640 1 -- 172.21.15.135:0/213980549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f114b730 msgr2=0x55d9f1153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.915+0000 7f5d16d9d640 1 --2- 172.21.15.135:0/213980549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f114b730 0x55d9f1153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.915+0000 7f5d16d9d640 1 -- 172.21.15.135:0/213980549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9f1075900 con 0x55d9f1154310 2024-04-20T12:24:51.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.915+0000 7f5d16d9d640 1 --2- 172.21.15.135:0/213980549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f1154310 0x55d9f1156700 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009f50 tx=0x7f5d100118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fec4ee606afd910 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.915+0000 7f5d04ff9640 1 -- 172.21.15.135:0/213980549 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10004d20 con 0x55d9f1154310 2024-04-20T12:24:51.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.915+0000 7f5d04ff9640 1 -- 172.21.15.135:0/213980549 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d10004050 con 0x55d9f1154310 2024-04-20T12:24:51.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.915+0000 7f5d04ff9640 1 -- 172.21.15.135:0/213980549 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10005240 con 0x55d9f1154310 2024-04-20T12:24:51.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.916+0000 7f5d1fa23740 1 -- 172.21.15.135:0/213980549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f1154310 msgr2=0x55d9f1156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.916+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/213980549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f1154310 0x55d9f1156700 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009f50 tx=0x7f5d100118d0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.916+0000 7f5d1fa23740 1 -- 172.21.15.135:0/213980549 shutdown_connections 2024-04-20T12:24:51.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.916+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/213980549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f1154310 0x55d9f1156700 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.917+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/213980549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f114b730 0x55d9f1153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.917+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/213980549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 0x55d9f114b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.917+0000 7f5d1fa23740 1 -- 172.21.15.135:0/213980549 >> 172.21.15.135:0/213980549 conn(0x55d9f1145540 msgr2=0x55d9f1145920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.917+0000 7f5d1fa23740 1 -- 172.21.15.135:0/213980549 shutdown_connections 2024-04-20T12:24:51.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.917+0000 7f5d1fa23740 1 -- 172.21.15.135:0/213980549 wait complete. 2024-04-20T12:24:51.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.918+0000 7f5d1fa23740 1 -- start start 2024-04-20T12:24:51.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.918+0000 7f5d1fa23740 1 Processor -- start 2024-04-20T12:24:51.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.918+0000 7f5d1fa23740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114ae10 0x55d9f11514f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.918+0000 7f5d1fa23740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114b730 0x55d9f1151a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.918+0000 7f5d1fa23740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f1154310 0x55d9f1151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.918+0000 7f5d1fa23740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d9f1156fe0 con 0x55d9f114ae10 2024-04-20T12:24:51.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.918+0000 7f5d1fa23740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d9f1069500 con 0x55d9f1154310 2024-04-20T12:24:51.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5d1fa23740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d9f1157160 con 0x55d9f114b730 2024-04-20T12:24:51.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5d15d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114b730 0x55d9f1151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5d1659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114ae10 0x55d9f11514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5d15d9b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114b730 0x55d9f1151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.135:39586/0 (socket says 172.21.15.135:39586) 2024-04-20T12:24:51.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5d15d9b640 1 -- 172.21.15.135:0/3968004129 learned_addr learned my addr 172.21.15.135:0/3968004129 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5d1fa23740 10 client.0 _ll_register_callbacks cb 0x55d9f104e2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:51.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5d16d9d640 1 --2- 172.21.15.135:0/3968004129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f1154310 0x55d9f1151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5d15d9b640 1 -- 172.21.15.135:0/3968004129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f1154310 msgr2=0x55d9f1151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5d15d9b640 1 --2- 172.21.15.135:0/3968004129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f1154310 0x55d9f1151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5d15d9b640 1 -- 172.21.15.135:0/3968004129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114ae10 msgr2=0x55d9f11514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5d15d9b640 1 --2- 172.21.15.135:0/3968004129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114ae10 0x55d9f11514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5d15d9b640 1 -- 172.21.15.135:0/3968004129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9f0dc23f0 con 0x55d9f114b730 2024-04-20T12:24:51.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5d1659c640 1 --2- 172.21.15.135:0/3968004129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114ae10 0x55d9f11514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5d15d9b640 1 --2- 172.21.15.135:0/3968004129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114b730 0x55d9f1151a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0ce400 tx=0x7f5d0c087110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba1953a1c120dee9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5cfdffb640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-20T12:24:51.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5cfdffb640 1 -- 172.21.15.135:0/3968004129 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c01c040 con 0x55d9f114b730 2024-04-20T12:24:51.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5cfdffb640 1 -- 172.21.15.135:0/3968004129 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5d0c0a4e30 con 0x55d9f114b730 2024-04-20T12:24:51.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.919+0000 7f5d1fa23740 1 -- 172.21.15.135:0/3968004129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d10004050 con 0x55d9f114b730 2024-04-20T12:24:51.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.920+0000 7f5cfdffb640 1 -- 172.21.15.135:0/3968004129 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5d0c0a52c0 con 0x55d9f114b730 2024-04-20T12:24:51.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.920+0000 7f5d1fa23740 10 client.25741 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:51.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.920+0000 7f5d1fa23740 1 -- 172.21.15.135:0/3968004129 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d9f0e8c7d0 con 0x55d9f114b730 2024-04-20T12:24:51.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.920+0000 7f5cfdffb640 1 -- 172.21.15.135:0/3968004129 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d10004050 con 0x55d9f114b730 2024-04-20T12:24:51.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.920+0000 7f5cfdffb640 1 -- 172.21.15.135:0/3968004129 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f5d0c085b90 con 0x55d9f114b730 2024-04-20T12:24:51.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.920+0000 7f5d1fa23740 10 client.25741 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:51.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.920+0000 7f5d1fa23740 10 client.25741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:51.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.920+0000 7f5d1fa23740 20 client.25741 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:51.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.920+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/3968004129 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d9f116ce60 0x55d9f116f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.920+0000 7f5d1fa23740 4 client.25741 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:51.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.920+0000 7f5d1fa23740 1 -- 172.21.15.135:0/3968004129 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9f10bdb30 con 0x55d9f116ce60 2024-04-20T12:24:51.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.920+0000 7f5d1659c640 1 --2- 172.21.15.135:0/3968004129 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d9f116ce60 0x55d9f116f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.921+0000 7f5cfdffb640 10 client.25741 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:51.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.921+0000 7f5d1659c640 1 --2- 172.21.15.135:0/3968004129 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d9f116ce60 0x55d9f116f2d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7012c98d029324f6 server_cookie=757e0af0f60a3d6d in_seq=0 out_seq=0 2024-04-20T12:24:51.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.921+0000 7f5cfdffb640 1 -- 172.21.15.135:0/3968004129 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d9f10bdb30 con 0x55d9f116ce60 2024-04-20T12:24:51.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.921+0000 7f5cfdffb640 10 client.25741 handle_command_reply: tid=0 2024-04-20T12:24:51.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.922+0000 7f5d1fa23740 1 client.25741 shutdown 2024-04-20T12:24:51.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.922+0000 7f5d1fa23740 1 -- 172.21.15.135:0/3968004129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114b730 msgr2=0x55d9f1151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.922+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/3968004129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114b730 0x55d9f1151a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0ce400 tx=0x7f5d0c087110 comp rx=0 tx=0).stop 2024-04-20T12:24:51.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.922+0000 7f5d1fa23740 1 -- 172.21.15.135:0/3968004129 shutdown_connections 2024-04-20T12:24:51.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.922+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/3968004129 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d9f116ce60 0x55d9f116f2d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.922+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/3968004129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f1154310 0x55d9f1151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.922+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/3968004129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114b730 0x55d9f1151a30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.922+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/3968004129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114ae10 0x55d9f11514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.922+0000 7f5cfdffb640 0 client.25741 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:51.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.922+0000 7f5d1fa23740 1 -- 172.21.15.135:0/3968004129 >> 172.21.15.135:0/3968004129 conn(0x55d9f1145540 msgr2=0x55d9f1147290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.922+0000 7f5d1fa23740 1 -- 172.21.15.135:0/3968004129 shutdown_connections 2024-04-20T12:24:51.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.922+0000 7f5d1fa23740 1 -- 172.21.15.135:0/3968004129 wait complete. 2024-04-20T12:24:51.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.922+0000 7f5d1fa23740 20 client.25741 trim_cache size 0 max 16384 2024-04-20T12:24:51.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.938+0000 7f5d1fa23740 1 Processor -- start 2024-04-20T12:24:51.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.938+0000 7f5d1fa23740 1 -- start start 2024-04-20T12:24:51.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.938+0000 7f5d1fa23740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 0x55d9f1153c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.938+0000 7f5d1fa23740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114b730 0x55d9f1144560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.938+0000 7f5d1fa23740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f1154310 0x55d9f1174bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.938+0000 7f5d1fa23740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d181ad240 con 0x55d9f114b730 2024-04-20T12:24:51.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.938+0000 7f5d1fa23740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5d181aed80 con 0x55d9f1154310 2024-04-20T12:24:51.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.938+0000 7f5d1fa23740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5d181ad910 con 0x55d9f114ae10 2024-04-20T12:24:51.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.938+0000 7f5d15d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114b730 0x55d9f1144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.938+0000 7f5d1659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 0x55d9f1153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.938+0000 7f5d15d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114b730 0x55d9f1144560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36368/0 (socket says 172.21.15.135:36368) 2024-04-20T12:24:51.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.938+0000 7f5d15d9b640 1 -- 172.21.15.135:0/112976205 learned_addr learned my addr 172.21.15.135:0/112976205 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.938+0000 7f5d1659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 0x55d9f1153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.135:39592/0 (socket says 172.21.15.135:39592) 2024-04-20T12:24:51.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.939+0000 7f5d16d9d640 1 --2- 172.21.15.135:0/112976205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f1154310 0x55d9f1174bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.939+0000 7f5d15d9b640 1 -- 172.21.15.135:0/112976205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 msgr2=0x55d9f1153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.939+0000 7f5d15d9b640 1 --2- 172.21.15.135:0/112976205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 0x55d9f1153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.939+0000 7f5d15d9b640 1 -- 172.21.15.135:0/112976205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f1154310 msgr2=0x55d9f1174bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.939+0000 7f5d15d9b640 1 --2- 172.21.15.135:0/112976205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f1154310 0x55d9f1174bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.939+0000 7f5d15d9b640 1 -- 172.21.15.135:0/112976205 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9f116f950 con 0x55d9f114b730 2024-04-20T12:24:51.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.939+0000 7f5d1659c640 1 --2- 172.21.15.135:0/112976205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 0x55d9f1153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:51.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.939+0000 7f5d15d9b640 1 --2- 172.21.15.135:0/112976205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114b730 0x55d9f1144560 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c099020 tx=0x7f5d0c09ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba8373ed2e6fc4c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.939+0000 7f5cfffff640 1 -- 172.21.15.135:0/112976205 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c01c050 con 0x55d9f114b730 2024-04-20T12:24:51.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.939+0000 7f5cfffff640 1 -- 172.21.15.135:0/112976205 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d0c082020 con 0x55d9f114b730 2024-04-20T12:24:51.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.939+0000 7f5cfffff640 1 -- 172.21.15.135:0/112976205 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c085b90 con 0x55d9f114b730 2024-04-20T12:24:51.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.940+0000 7f5d1fa23740 1 -- 172.21.15.135:0/112976205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114b730 msgr2=0x55d9f1144560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.940+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/112976205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114b730 0x55d9f1144560 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c099020 tx=0x7f5d0c09ab60 comp rx=0 tx=0).stop 2024-04-20T12:24:51.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.940+0000 7f5d1fa23740 1 -- 172.21.15.135:0/112976205 shutdown_connections 2024-04-20T12:24:51.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.940+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/112976205 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f1154310 0x55d9f1174bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.940+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/112976205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114b730 0x55d9f1144560 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.940+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/112976205 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 0x55d9f1153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.940+0000 7f5d1fa23740 1 -- 172.21.15.135:0/112976205 >> 172.21.15.135:0/112976205 conn(0x55d9f1145540 msgr2=0x55d9f1143e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.941+0000 7f5d1fa23740 1 -- 172.21.15.135:0/112976205 shutdown_connections 2024-04-20T12:24:51.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.941+0000 7f5d1fa23740 1 -- 172.21.15.135:0/112976205 wait complete. 2024-04-20T12:24:51.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.941+0000 7f5d1fa23740 1 -- start start 2024-04-20T12:24:51.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.941+0000 7f5d1fa23740 1 Processor -- start 2024-04-20T12:24:51.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d1fa23740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 0x55d9f115c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d1fa23740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114b730 0x55d9f115c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d1fa23740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f1154310 0x55d9f114dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d1fa23740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5d181ae6b0 con 0x55d9f114b730 2024-04-20T12:24:51.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d1fa23740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5d181adfe0 con 0x55d9f1154310 2024-04-20T12:24:51.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d1fa23740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5d181ab210 con 0x55d9f114ae10 2024-04-20T12:24:51.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d1fa23740 10 client.0 _ll_register_callbacks cb 0x7f5d0c09c460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:51.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d15d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114b730 0x55d9f115c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d15d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114b730 0x55d9f115c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36372/0 (socket says 172.21.15.135:36372) 2024-04-20T12:24:51.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d15d9b640 1 -- 172.21.15.135:0/2487966095 learned_addr learned my addr 172.21.15.135:0/2487966095 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:51.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d15d9b640 1 -- 172.21.15.135:0/2487966095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 msgr2=0x55d9f115c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d15d9b640 1 --2- 172.21.15.135:0/2487966095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 0x55d9f115c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d15d9b640 1 -- 172.21.15.135:0/2487966095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f1154310 msgr2=0x55d9f114dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:51.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d15d9b640 1 --2- 172.21.15.135:0/2487966095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f1154310 0x55d9f114dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d15d9b640 1 -- 172.21.15.135:0/2487966095 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9f114e570 con 0x55d9f114b730 2024-04-20T12:24:51.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d15d9b640 1 --2- 172.21.15.135:0/2487966095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114b730 0x55d9f115c8f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c09c350 tx=0x7f5d0c09c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b155d7f6305f4d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:51.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5cfdffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:51.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5cfdffb640 1 -- 172.21.15.135:0/2487966095 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c0a9020 con 0x55d9f114b730 2024-04-20T12:24:51.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5cfdffb640 1 -- 172.21.15.135:0/2487966095 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5d0c004db0 con 0x55d9f114b730 2024-04-20T12:24:51.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.942+0000 7f5d1fa23740 1 -- 172.21.15.135:0/2487966095 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d0c082020 con 0x55d9f114b730 2024-04-20T12:24:51.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.943+0000 7f5cfdffb640 1 -- 172.21.15.135:0/2487966095 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5d0c01c070 con 0x55d9f114b730 2024-04-20T12:24:51.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.943+0000 7f5d1fa23740 10 client.16353 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:51.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.943+0000 7f5d1fa23740 1 -- 172.21.15.135:0/2487966095 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d9f11d30c0 con 0x55d9f114b730 2024-04-20T12:24:51.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.943+0000 7f5cfdffb640 1 -- 172.21.15.135:0/2487966095 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d0c082020 con 0x55d9f114b730 2024-04-20T12:24:51.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.943+0000 7f5cfdffb640 1 -- 172.21.15.135:0/2487966095 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f5d0c0983a0 con 0x55d9f114b730 2024-04-20T12:24:51.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.943+0000 7f5d1fa23740 10 client.16353 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:51.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.943+0000 7f5d1fa23740 10 client.16353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:51.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.943+0000 7f5d1fa23740 20 client.16353 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:51.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.943+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/2487966095 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d9f11d34a0 0x55d9f11d5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:51.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.943+0000 7f5d1fa23740 4 client.16353 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:24:51.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.943+0000 7f5d1fa23740 1 -- 172.21.15.135:0/2487966095 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d9f10b79a0 con 0x55d9f11d34a0 2024-04-20T12:24:51.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.944+0000 7f5d1659c640 1 --2- 172.21.15.135:0/2487966095 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d9f11d34a0 0x55d9f11d5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:51.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.945+0000 7f5d1659c640 1 --2- 172.21.15.135:0/2487966095 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d9f11d34a0 0x55d9f11d5900 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1238c7a35292b41b server_cookie=440a83788c51f6b9 in_seq=0 out_seq=0 2024-04-20T12:24:51.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.945+0000 7f5cfdffb640 10 client.16353 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:51.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.945+0000 7f5cfdffb640 1 -- 172.21.15.135:0/2487966095 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d9f10b79a0 con 0x55d9f11d34a0 2024-04-20T12:24:51.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.945+0000 7f5cfdffb640 10 client.16353 handle_command_reply: tid=0 2024-04-20T12:24:51.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.945+0000 7f5d1fa23740 1 client.16353 shutdown 2024-04-20T12:24:51.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.945+0000 7f5d1fa23740 1 -- 172.21.15.135:0/2487966095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114b730 msgr2=0x55d9f115c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.945+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/2487966095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114b730 0x55d9f115c8f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c09c350 tx=0x7f5d0c09c1d0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.945+0000 7f5d1fa23740 1 -- 172.21.15.135:0/2487966095 shutdown_connections 2024-04-20T12:24:51.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.945+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/2487966095 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d9f11d34a0 0x55d9f11d5900 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.945+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/2487966095 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d9f1154310 0x55d9f114dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.945+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/2487966095 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d9f114b730 0x55d9f115c8f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.945+0000 7f5cfdffb640 0 client.16353 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:51.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.945+0000 7f5d1fa23740 1 --2- 172.21.15.135:0/2487966095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d9f114ae10 0x55d9f115c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.945+0000 7f5d1fa23740 1 -- 172.21.15.135:0/2487966095 >> 172.21.15.135:0/2487966095 conn(0x55d9f1145540 msgr2=0x55d9f11446e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.946+0000 7f5d1fa23740 1 -- 172.21.15.135:0/2487966095 shutdown_connections 2024-04-20T12:24:51.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.946+0000 7f5d1fa23740 1 -- 172.21.15.135:0/2487966095 wait complete. 2024-04-20T12:24:51.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.946+0000 7f5d1fa23740 20 client.16353 trim_cache size 0 max 16384 2024-04-20T12:24:51.955 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:24:51.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.946+0000 7f5d1ce31640 1 -- 172.21.15.135:0/851290266 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5d000a3da0 msgr2=0x7f5d000a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.946+0000 7f5d1ce31640 1 --2- 172.21.15.135:0/851290266 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5d000a3da0 0x7f5d000a6260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5d0802cfd0 tx=0x7f5d080058d0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.946+0000 7f5d1ce31640 1 -- 172.21.15.135:0/851290266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d18106160 msgr2=0x7f5d18197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:51.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.946+0000 7f5d1ce31640 1 --2- 172.21.15.135:0/851290266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d18106160 0x7f5d18197c70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c00e9c0 tx=0x7f5d0c00ee80 comp rx=0 tx=0).stop 2024-04-20T12:24:51.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.946+0000 7f5d1ce31640 1 -- 172.21.15.135:0/851290266 shutdown_connections 2024-04-20T12:24:51.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.946+0000 7f5d1ce31640 1 --2- 172.21.15.135:0/851290266 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5d1819bff0 0x7f5d1819c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.946+0000 7f5d1ce31640 1 --2- 172.21.15.135:0/851290266 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5d000a3da0 0x7f5d000a6260 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.946+0000 7f5d1ce31640 1 --2- 172.21.15.135:0/851290266 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d18106160 0x7f5d18197c70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.946+0000 7f5d1ce31640 1 --2- 172.21.15.135:0/851290266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5d18101090 0x7f5d18197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:51.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.946+0000 7f5d1ce31640 1 -- 172.21.15.135:0/851290266 >> 172.21.15.135:0/851290266 conn(0x7f5d18078010 msgr2=0x7f5d180fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:51.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.946+0000 7f5d1ce31640 1 -- 172.21.15.135:0/851290266 shutdown_connections 2024-04-20T12:24:51.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:51.946+0000 7f5d1ce31640 1 -- 172.21.15.135:0/851290266 wait complete. 2024-04-20T12:24:52.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:51 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1762208683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:24:52.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:51 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1762208683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:24:52.959 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:24:52.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:24:52.959 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:24:52.981 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:52 smithi139 ceph-mon[21834]: pgmap v55: 129 pgs: 129 active+clean; 1.8 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.4 MiB/s wr, 1.03k op/s 2024-04-20T12:24:52.983 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:52 smithi135 ceph-mon[18264]: pgmap v55: 129 pgs: 129 active+clean; 1.8 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.4 MiB/s wr, 1.03k op/s 2024-04-20T12:24:53.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:52 smithi154 ceph-mon[22073]: pgmap v55: 129 pgs: 129 active+clean; 1.8 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 1.4 MiB/s wr, 1.03k op/s 2024-04-20T12:24:53.005 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-04-20T12:24:53.005 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4191232 len 1024 2024-04-20T12:24:53.005 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191232 len 1024 2024-04-20T12:24:53.005 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4191232 len 2048 2024-04-20T12:24:53.005 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-04-20T12:24:53.005 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4191232 len 2048 2024-04-20T12:24:53.005 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191232 len 2048 2024-04-20T12:24:53.005 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4191232 len 4096 2024-04-20T12:24:53.005 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-04-20T12:24:53.005 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4191232 len 4096 2024-04-20T12:24:53.005 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191232 len 4096 2024-04-20T12:24:53.005 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4191232 len 8192 2024-04-20T12:24:53.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-04-20T12:24:53.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4191232 len 8192 2024-04-20T12:24:53.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191232 len 8192 2024-04-20T12:24:53.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4191232 len 16384 2024-04-20T12:24:53.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-04-20T12:24:53.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4191232 len 16384 2024-04-20T12:24:53.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191232 len 16384 2024-04-20T12:24:53.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4191744 len 1024 2024-04-20T12:24:53.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-04-20T12:24:53.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4191744 len 1024 2024-04-20T12:24:53.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191744 len 1024 2024-04-20T12:24:53.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4191744 len 2048 2024-04-20T12:24:53.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-04-20T12:24:53.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4191744 len 2048 2024-04-20T12:24:53.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191744 len 2048 2024-04-20T12:24:53.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4191744 len 4096 2024-04-20T12:24:53.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-04-20T12:24:53.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4191744 len 4096 2024-04-20T12:24:53.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191744 len 4096 2024-04-20T12:24:53.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4191744 len 8192 2024-04-20T12:24:53.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-04-20T12:24:53.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4191744 len 8192 2024-04-20T12:24:53.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191744 len 8192 2024-04-20T12:24:53.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4191744 len 16384 2024-04-20T12:24:53.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-04-20T12:24:53.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4191744 len 16384 2024-04-20T12:24:53.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4191744 len 16384 2024-04-20T12:24:53.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4192256 len 1024 2024-04-20T12:24:53.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-04-20T12:24:53.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4192256 len 1024 2024-04-20T12:24:53.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192256 len 1024 2024-04-20T12:24:53.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4192256 len 2048 2024-04-20T12:24:53.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-04-20T12:24:53.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4192256 len 2048 2024-04-20T12:24:53.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192256 len 2048 2024-04-20T12:24:53.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4192256 len 4096 2024-04-20T12:24:53.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-04-20T12:24:53.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4192256 len 4096 2024-04-20T12:24:53.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192256 len 4096 2024-04-20T12:24:53.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4192256 len 8192 2024-04-20T12:24:53.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-04-20T12:24:53.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4192256 len 8192 2024-04-20T12:24:53.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192256 len 8192 2024-04-20T12:24:53.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4192256 len 16384 2024-04-20T12:24:53.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-04-20T12:24:53.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4192256 len 16384 2024-04-20T12:24:53.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192256 len 16384 2024-04-20T12:24:53.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4192768 len 1024 2024-04-20T12:24:53.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-04-20T12:24:53.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4192768 len 1024 2024-04-20T12:24:53.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192768 len 1024 2024-04-20T12:24:53.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4192768 len 2048 2024-04-20T12:24:53.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-04-20T12:24:53.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4192768 len 2048 2024-04-20T12:24:53.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192768 len 2048 2024-04-20T12:24:53.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4192768 len 4096 2024-04-20T12:24:53.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-04-20T12:24:53.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4192768 len 4096 2024-04-20T12:24:53.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192768 len 4096 2024-04-20T12:24:53.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4192768 len 8192 2024-04-20T12:24:53.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-04-20T12:24:53.012 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4192768 len 8192 2024-04-20T12:24:53.012 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192768 len 8192 2024-04-20T12:24:53.012 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4192768 len 16384 2024-04-20T12:24:53.012 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-04-20T12:24:53.012 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4192768 len 16384 2024-04-20T12:24:53.012 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4192768 len 16384 2024-04-20T12:24:53.012 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4193280 len 1024 2024-04-20T12:24:53.012 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-04-20T12:24:53.012 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4193280 len 1024 2024-04-20T12:24:53.013 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193280 len 1024 2024-04-20T12:24:53.013 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4193280 len 2048 2024-04-20T12:24:53.013 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-04-20T12:24:53.013 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4193280 len 2048 2024-04-20T12:24:53.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.077+0000 7f3055443640 1 -- 172.21.15.135:0/3882370876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3050101f60 msgr2=0x7f3050105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.077+0000 7f3055443640 1 --2- 172.21.15.135:0/3882370876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3050101f60 0x7f3050105a80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3044009900 tx=0x7f304402bc50 comp rx=0 tx=0).stop 2024-04-20T12:24:53.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.077+0000 7f3055443640 1 -- 172.21.15.135:0/3882370876 shutdown_connections 2024-04-20T12:24:53.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.077+0000 7f3055443640 1 --2- 172.21.15.135:0/3882370876 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3050106160 0x7f305010dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.077+0000 7f3055443640 1 --2- 172.21.15.135:0/3882370876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3050101f60 0x7f3050105a80 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.077+0000 7f3055443640 1 --2- 172.21.15.135:0/3882370876 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30501015b0 0x7f3050101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.077+0000 7f3055443640 1 -- 172.21.15.135:0/3882370876 >> 172.21.15.135:0/3882370876 conn(0x7f30500769e0 msgr2=0x7f3050076df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:53.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.077+0000 7f3055443640 1 -- 172.21.15.135:0/3882370876 shutdown_connections 2024-04-20T12:24:53.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.077+0000 7f3055443640 1 -- 172.21.15.135:0/3882370876 wait complete. 2024-04-20T12:24:53.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.078+0000 7f3055443640 1 Processor -- start 2024-04-20T12:24:53.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.078+0000 7f3055443640 1 -- start start 2024-04-20T12:24:53.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.078+0000 7f3055443640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30501015b0 0x7f305019e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.078+0000 7f3055443640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3050106160 0x7f305019eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.078+0000 7f3055443640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30501987d0 0x7f3050198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.078+0000 7f3055443640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f30501123d0 con 0x7f30501015b0 2024-04-20T12:24:53.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.078+0000 7f3055443640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3050112250 con 0x7f30501987d0 2024-04-20T12:24:53.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.078+0000 7f3055443640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3050112550 con 0x7f3050106160 2024-04-20T12:24:53.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.079+0000 7f304effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30501015b0 0x7f305019e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.079+0000 7f304e7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3050106160 0x7f305019eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.079+0000 7f304effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30501015b0 0x7f305019e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36390/0 (socket says 172.21.15.135:36390) 2024-04-20T12:24:53.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.079+0000 7f304effd640 1 -- 172.21.15.135:0/3426848788 learned_addr learned my addr 172.21.15.135:0/3426848788 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:53.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.079+0000 7f304f7fe640 1 --2- 172.21.15.135:0/3426848788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30501987d0 0x7f3050198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.079+0000 7f304e7fc640 1 -- 172.21.15.135:0/3426848788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30501987d0 msgr2=0x7f3050198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.079+0000 7f304e7fc640 1 --2- 172.21.15.135:0/3426848788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30501987d0 0x7f3050198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.079+0000 7f304e7fc640 1 -- 172.21.15.135:0/3426848788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30501015b0 msgr2=0x7f305019e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.079+0000 7f304e7fc640 1 --2- 172.21.15.135:0/3426848788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30501015b0 0x7f305019e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.081 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.079+0000 7f304e7fc640 1 -- 172.21.15.135:0/3426848788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3050199360 con 0x7f3050106160 2024-04-20T12:24:53.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.079+0000 7f304e7fc640 1 --2- 172.21.15.135:0/3426848788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3050106160 0x7f305019eba0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3044036040 tx=0x7f304402cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:53.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.079+0000 7f3037fff640 1 -- 172.21.15.135:0/3426848788 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3044042020 con 0x7f3050106160 2024-04-20T12:24:53.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.080+0000 7f3037fff640 1 -- 172.21.15.135:0/3426848788 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3044004450 con 0x7f3050106160 2024-04-20T12:24:53.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.080+0000 7f3037fff640 1 -- 172.21.15.135:0/3426848788 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304403e460 con 0x7f3050106160 2024-04-20T12:24:53.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.080+0000 7f3055443640 1 -- 172.21.15.135:0/3426848788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30501995f0 con 0x7f3050106160 2024-04-20T12:24:53.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.080+0000 7f3055443640 1 -- 172.21.15.135:0/3426848788 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30501a5780 con 0x7f3050106160 2024-04-20T12:24:53.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.082+0000 7f3037fff640 1 -- 172.21.15.135:0/3426848788 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f3044045020 con 0x7f3050106160 2024-04-20T12:24:53.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.082+0000 7f3058037740 1 Processor -- start 2024-04-20T12:24:53.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.082+0000 7f3058037740 1 -- start start 2024-04-20T12:24:53.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.082+0000 7f3037fff640 1 --2- 172.21.15.135:0/3426848788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f30380a3da0 0x7f30380a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.082+0000 7f3058037740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556022584fe0 0x5560225853c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.082+0000 7f3058037740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022585900 0x55602258dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f3058037740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602258e4e0 0x5560225908d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f3058037740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5560224e9f00 con 0x556022585900 2024-04-20T12:24:53.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f3058037740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556022487530 con 0x55602258e4e0 2024-04-20T12:24:53.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f3058037740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5560224e5ec0 con 0x556022584fe0 2024-04-20T12:24:53.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f304f7fe640 1 --2- 172.21.15.135:0/3426848788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f30380a3da0 0x7f30380a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f304e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022585900 0x55602258dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f304effd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556022584fe0 0x5560225853c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f304e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022585900 0x55602258dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36396/0 (socket says 172.21.15.135:36396) 2024-04-20T12:24:53.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f304e7fc640 1 -- 172.21.15.135:0/2340444101 learned_addr learned my addr 172.21.15.135:0/2340444101 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:53.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f3037fff640 1 -- 172.21.15.135:0/3426848788 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f30440f27f0 con 0x7f3050106160 2024-04-20T12:24:53.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f304f7fe640 1 --2- 172.21.15.135:0/2340444101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602258e4e0 0x5560225908d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f304effd640 1 -- 172.21.15.135:0/2340444101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602258e4e0 msgr2=0x5560225908d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:53.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f304effd640 1 --2- 172.21.15.135:0/2340444101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602258e4e0 0x5560225908d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f304effd640 1 -- 172.21.15.135:0/2340444101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022585900 msgr2=0x55602258dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:53.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f304effd640 1 --2- 172.21.15.135:0/2340444101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022585900 0x55602258dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f304effd640 1 -- 172.21.15.135:0/2340444101 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560222c47e0 con 0x556022584fe0 2024-04-20T12:24:53.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f304e7fc640 1 --2- 172.21.15.135:0/2340444101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022585900 0x55602258dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:53.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f304f7fe640 1 --2- 172.21.15.135:0/3426848788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f30380a3da0 0x7f30380a6260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3048005fd0 tx=0x7f3048009e60 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:53.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f304effd640 1 --2- 172.21.15.135:0/2340444101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556022584fe0 0x5560225853c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3040009a40 tx=0x7f3040009f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff5e2fad83a3aa61 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:53.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.083+0000 7f30357fa640 1 -- 172.21.15.135:0/2340444101 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040017070 con 0x556022584fe0 2024-04-20T12:24:53.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.084+0000 7f30357fa640 1 -- 172.21.15.135:0/2340444101 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3040013470 con 0x556022584fe0 2024-04-20T12:24:53.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.084+0000 7f30357fa640 1 -- 172.21.15.135:0/2340444101 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040012630 con 0x556022584fe0 2024-04-20T12:24:53.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.084+0000 7f3058037740 1 -- 172.21.15.135:0/2340444101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556022584fe0 msgr2=0x5560225853c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.084+0000 7f3058037740 1 --2- 172.21.15.135:0/2340444101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556022584fe0 0x5560225853c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3040009a40 tx=0x7f3040009f00 comp rx=0 tx=0).stop 2024-04-20T12:24:53.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.084+0000 7f3058037740 1 -- 172.21.15.135:0/2340444101 shutdown_connections 2024-04-20T12:24:53.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.084+0000 7f3058037740 1 --2- 172.21.15.135:0/2340444101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602258e4e0 0x5560225908d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.084+0000 7f3058037740 1 --2- 172.21.15.135:0/2340444101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022585900 0x55602258dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.084+0000 7f3058037740 1 --2- 172.21.15.135:0/2340444101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556022584fe0 0x5560225853c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.084+0000 7f3058037740 1 -- 172.21.15.135:0/2340444101 >> 172.21.15.135:0/2340444101 conn(0x55602257f710 msgr2=0x55602257faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:53.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.084+0000 7f3058037740 1 -- 172.21.15.135:0/2340444101 shutdown_connections 2024-04-20T12:24:53.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.084+0000 7f3058037740 1 -- 172.21.15.135:0/2340444101 wait complete. 2024-04-20T12:24:53.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f3058037740 1 -- start start 2024-04-20T12:24:53.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f3058037740 1 Processor -- start 2024-04-20T12:24:53.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f3058037740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022584fe0 0x55602258de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f3058037740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022585900 0x55602258b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f3058037740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602258e4e0 0x55602258b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f3058037740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5560225912d0 con 0x556022584fe0 2024-04-20T12:24:53.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f3058037740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556022472480 con 0x556022585900 2024-04-20T12:24:53.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f3058037740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556022591450 con 0x55602258e4e0 2024-04-20T12:24:53.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f3058037740 10 client.0 _ll_register_callbacks cb 0x556022471e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:53.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f304effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022584fe0 0x55602258de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f304effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022584fe0 0x55602258de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36402/0 (socket says 172.21.15.135:36402) 2024-04-20T12:24:53.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f304effd640 1 -- 172.21.15.135:0/938655185 learned_addr learned my addr 172.21.15.135:0/938655185 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:53.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f304f7fe640 1 --2- 172.21.15.135:0/938655185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602258e4e0 0x55602258b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f304effd640 1 -- 172.21.15.135:0/938655185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602258e4e0 msgr2=0x55602258b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:53.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f304effd640 1 --2- 172.21.15.135:0/938655185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602258e4e0 0x55602258b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f304effd640 1 -- 172.21.15.135:0/938655185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022585900 msgr2=0x55602258b1a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-20T12:24:53.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f304effd640 1 --2- 172.21.15.135:0/938655185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022585900 0x55602258b1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.085+0000 7f304effd640 1 -- 172.21.15.135:0/938655185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556022324f70 con 0x556022584fe0 2024-04-20T12:24:53.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f304effd640 1 --2- 172.21.15.135:0/938655185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022584fe0 0x55602258de10 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f3040009380 tx=0x7f30400046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950e5e12f04d4eee server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:53.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f3032ff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:53.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f3032ff5640 1 -- 172.21.15.135:0/938655185 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040017050 con 0x556022584fe0 2024-04-20T12:24:53.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f3032ff5640 1 -- 172.21.15.135:0/938655185 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f304001c450 con 0x556022584fe0 2024-04-20T12:24:53.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f3058037740 1 -- 172.21.15.135:0/938655185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3040013470 con 0x556022584fe0 2024-04-20T12:24:53.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f3032ff5640 1 -- 172.21.15.135:0/938655185 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f304001c650 con 0x556022584fe0 2024-04-20T12:24:53.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f3058037740 10 client.16365 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:53.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f3058037740 1 -- 172.21.15.135:0/938655185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5560221bc170 con 0x556022584fe0 2024-04-20T12:24:53.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f3032ff5640 1 -- 172.21.15.135:0/938655185 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3040013470 con 0x556022584fe0 2024-04-20T12:24:53.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f3032ff5640 1 -- 172.21.15.135:0/938655185 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f3040026960 con 0x556022584fe0 2024-04-20T12:24:53.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f3058037740 10 client.16365 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:53.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f3058037740 10 client.16365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:53.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f3058037740 20 client.16365 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:53.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f3058037740 1 --2- 172.21.15.135:0/938655185 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5560225a2860 0x5560225a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f3058037740 4 client.16365 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:53.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.086+0000 7f3058037740 1 -- 172.21.15.135:0/938655185 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560224f7920 con 0x5560225a2860 2024-04-20T12:24:53.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.087+0000 7f304e7fc640 1 --2- 172.21.15.135:0/938655185 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5560225a2860 0x5560225a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.087+0000 7f304e7fc640 1 --2- 172.21.15.135:0/938655185 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5560225a2860 0x5560225a4c50 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6baeb24705bb9439 server_cookie=1d3ac65b867e8895 in_seq=0 out_seq=0 2024-04-20T12:24:53.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.087+0000 7f3032ff5640 10 client.16365 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:53.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.088+0000 7f3032ff5640 1 -- 172.21.15.135:0/938655185 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5560224f7920 con 0x5560225a2860 2024-04-20T12:24:53.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.088+0000 7f3032ff5640 10 client.16365 handle_command_reply: tid=0 2024-04-20T12:24:53.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.088+0000 7f3058037740 1 client.16365 shutdown 2024-04-20T12:24:53.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.088+0000 7f3058037740 1 -- 172.21.15.135:0/938655185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022584fe0 msgr2=0x55602258de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.088+0000 7f3058037740 1 --2- 172.21.15.135:0/938655185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022584fe0 0x55602258de10 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f3040009380 tx=0x7f30400046e0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.088+0000 7f3058037740 1 -- 172.21.15.135:0/938655185 shutdown_connections 2024-04-20T12:24:53.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.088+0000 7f3058037740 1 --2- 172.21.15.135:0/938655185 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5560225a2860 0x5560225a4c50 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.088+0000 7f3058037740 1 --2- 172.21.15.135:0/938655185 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602258e4e0 0x55602258b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.088+0000 7f3058037740 1 --2- 172.21.15.135:0/938655185 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022585900 0x55602258b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.088+0000 7f3058037740 1 --2- 172.21.15.135:0/938655185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022584fe0 0x55602258de10 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.088+0000 7f3032ff5640 0 client.16365 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:53.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.088+0000 7f3058037740 1 -- 172.21.15.135:0/938655185 >> 172.21.15.135:0/938655185 conn(0x55602257f710 msgr2=0x556022581460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:53.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.088+0000 7f3058037740 1 -- 172.21.15.135:0/938655185 shutdown_connections 2024-04-20T12:24:53.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.088+0000 7f3058037740 1 -- 172.21.15.135:0/938655185 wait complete. 2024-04-20T12:24:53.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.088+0000 7f3058037740 20 client.16365 trim_cache size 0 max 16384 2024-04-20T12:24:53.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.107+0000 7f3058037740 1 Processor -- start 2024-04-20T12:24:53.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.107+0000 7f3058037740 1 -- start start 2024-04-20T12:24:53.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.107+0000 7f3058037740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556022584fe0 0x55602259a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.107+0000 7f3058037740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022585900 0x55602258d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.107+0000 7f3058037740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602258e4e0 0x55602258de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.107+0000 7f3058037740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f30501ad2b0 con 0x55602258e4e0 2024-04-20T12:24:53.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.107+0000 7f3058037740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f30501aedf0 con 0x556022585900 2024-04-20T12:24:53.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.107+0000 7f3058037740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30501ad980 con 0x556022584fe0 2024-04-20T12:24:53.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.108+0000 7f304f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602258e4e0 0x55602258de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.108+0000 7f304f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602258e4e0 0x55602258de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36412/0 (socket says 172.21.15.135:36412) 2024-04-20T12:24:53.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.108+0000 7f304f7fe640 1 -- 172.21.15.135:0/4157335711 learned_addr learned my addr 172.21.15.135:0/4157335711 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:53.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.108+0000 7f304e7fc640 1 --2- 172.21.15.135:0/4157335711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022585900 0x55602258d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.108+0000 7f304effd640 1 --2- 172.21.15.135:0/4157335711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556022584fe0 0x55602259a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.108+0000 7f304f7fe640 1 -- 172.21.15.135:0/4157335711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556022584fe0 msgr2=0x55602259a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:53.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.108+0000 7f304f7fe640 1 --2- 172.21.15.135:0/4157335711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556022584fe0 0x55602259a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.108+0000 7f304f7fe640 1 -- 172.21.15.135:0/4157335711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022585900 msgr2=0x55602258d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:53.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.108+0000 7f304f7fe640 1 --2- 172.21.15.135:0/4157335711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022585900 0x55602258d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.108+0000 7f304f7fe640 1 -- 172.21.15.135:0/4157335711 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556022589730 con 0x55602258e4e0 2024-04-20T12:24:53.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.108+0000 7f304e7fc640 1 --2- 172.21.15.135:0/4157335711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022585900 0x55602258d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:53.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.108+0000 7f304f7fe640 1 --2- 172.21.15.135:0/4157335711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602258e4e0 0x55602258de10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x5560225808a0 tx=0x7f3048016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87afe754bc3b72a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:53.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.108+0000 7f3034ff9640 1 -- 172.21.15.135:0/4157335711 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3048012aa0 con 0x55602258e4e0 2024-04-20T12:24:53.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.108+0000 7f3034ff9640 1 -- 172.21.15.135:0/4157335711 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3048003e50 con 0x55602258e4e0 2024-04-20T12:24:53.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.108+0000 7f3034ff9640 1 -- 172.21.15.135:0/4157335711 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30480045a0 con 0x55602258e4e0 2024-04-20T12:24:53.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.109+0000 7f3058037740 1 -- 172.21.15.135:0/4157335711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602258e4e0 msgr2=0x55602258de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.109+0000 7f3058037740 1 --2- 172.21.15.135:0/4157335711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602258e4e0 0x55602258de10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x5560225808a0 tx=0x7f3048016040 comp rx=0 tx=0).stop 2024-04-20T12:24:53.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.109+0000 7f3058037740 1 -- 172.21.15.135:0/4157335711 shutdown_connections 2024-04-20T12:24:53.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.109+0000 7f3058037740 1 --2- 172.21.15.135:0/4157335711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602258e4e0 0x55602258de10 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.109+0000 7f3058037740 1 --2- 172.21.15.135:0/4157335711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022585900 0x55602258d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.109+0000 7f3058037740 1 --2- 172.21.15.135:0/4157335711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556022584fe0 0x55602259a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.109+0000 7f3058037740 1 -- 172.21.15.135:0/4157335711 >> 172.21.15.135:0/4157335711 conn(0x55602257f710 msgr2=0x55602257e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:53.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.109+0000 7f3058037740 1 -- 172.21.15.135:0/4157335711 shutdown_connections 2024-04-20T12:24:53.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.109+0000 7f3058037740 1 -- 172.21.15.135:0/4157335711 wait complete. 2024-04-20T12:24:53.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.109+0000 7f3058037740 1 -- start start 2024-04-20T12:24:53.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.109+0000 7f3058037740 1 Processor -- start 2024-04-20T12:24:53.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f3058037740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022584fe0 0x5560225885c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f3058037740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022585900 0x556022588b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f3058037740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602258e4e0 0x556022607be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f3058037740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f30501ae720 con 0x556022585900 2024-04-20T12:24:53.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f3058037740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f30501ae050 con 0x556022584fe0 2024-04-20T12:24:53.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f3058037740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30501ab280 con 0x55602258e4e0 2024-04-20T12:24:53.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f3058037740 10 client.0 _ll_register_callbacks cb 0x7f3040009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:53.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f304effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022584fe0 0x5560225885c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f304effd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022584fe0 0x5560225885c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:39262/0 (socket says 172.21.15.135:39262) 2024-04-20T12:24:53.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f304effd640 1 -- 172.21.15.135:0/774492671 learned_addr learned my addr 172.21.15.135:0/774492671 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:53.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f304f7fe640 1 --2- 172.21.15.135:0/774492671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602258e4e0 0x556022607be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f304e7fc640 1 --2- 172.21.15.135:0/774492671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022585900 0x556022588b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f304effd640 1 -- 172.21.15.135:0/774492671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602258e4e0 msgr2=0x556022607be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:53.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f304effd640 1 --2- 172.21.15.135:0/774492671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602258e4e0 0x556022607be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f304effd640 1 -- 172.21.15.135:0/774492671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022585900 msgr2=0x556022588b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:53.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f304effd640 1 --2- 172.21.15.135:0/774492671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022585900 0x556022588b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f304effd640 1 -- 172.21.15.135:0/774492671 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556022608120 con 0x556022584fe0 2024-04-20T12:24:53.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f304e7fc640 1 --2- 172.21.15.135:0/774492671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022585900 0x556022588b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:53.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f304effd640 1 --2- 172.21.15.135:0/774492671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022584fe0 0x5560225885c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3040026e20 tx=0x7f3040013a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65fe0987fa510a2d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:53.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f3032ff5640 10 client.0 ms_handle_connect on v2:172.21.15.139:3300/0 2024-04-20T12:24:53.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.110+0000 7f3032ff5640 1 -- 172.21.15.135:0/774492671 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040017040 con 0x556022584fe0 2024-04-20T12:24:53.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.111+0000 7f3032ff5640 1 -- 172.21.15.135:0/774492671 <== mon.2 v2:172.21.15.139:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f3040005b80 con 0x556022584fe0 2024-04-20T12:24:53.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.111+0000 7f3058037740 1 -- 172.21.15.135:0/774492671 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3048003e50 con 0x556022584fe0 2024-04-20T12:24:53.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.111+0000 7f3032ff5640 1 -- 172.21.15.135:0/774492671 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3040013cd0 con 0x556022584fe0 2024-04-20T12:24:53.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.111+0000 7f3058037740 10 client.25769 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:53.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.111+0000 7f3058037740 1 -- 172.21.15.135:0/774492671 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556022609460 con 0x556022584fe0 2024-04-20T12:24:53.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.111+0000 7f3032ff5640 1 -- 172.21.15.135:0/774492671 <== mon.2 v2:172.21.15.139:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3048003e50 con 0x556022584fe0 2024-04-20T12:24:53.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.111+0000 7f3032ff5640 1 -- 172.21.15.135:0/774492671 <== mon.2 v2:172.21.15.139:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f304001c7f0 con 0x556022584fe0 2024-04-20T12:24:53.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.111+0000 7f3058037740 10 client.25769 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:53.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.111+0000 7f3058037740 10 client.25769 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:53.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.111+0000 7f3058037740 20 client.25769 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:53.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.111+0000 7f3058037740 1 --2- 172.21.15.135:0/774492671 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556022609bc0 0x55602260bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.111+0000 7f3058037740 4 client.25769 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:24:53.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.111+0000 7f3058037740 1 -- 172.21.15.135:0/774492671 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5560224f1790 con 0x556022609bc0 2024-04-20T12:24:53.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.112+0000 7f304e7fc640 1 --2- 172.21.15.135:0/774492671 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556022609bc0 0x55602260bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.112+0000 7f3032ff5640 10 client.25769 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:53.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.112+0000 7f304e7fc640 1 --2- 172.21.15.135:0/774492671 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556022609bc0 0x55602260bfe0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f75e9ce7eba7e2f0 server_cookie=e5f1fa3a4b01c0c4 in_seq=0 out_seq=0 2024-04-20T12:24:53.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.113+0000 7f3032ff5640 1 -- 172.21.15.135:0/774492671 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5560224f1790 con 0x556022609bc0 2024-04-20T12:24:53.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.113+0000 7f3032ff5640 10 client.25769 handle_command_reply: tid=0 2024-04-20T12:24:53.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.113+0000 7f3058037740 1 client.25769 shutdown 2024-04-20T12:24:53.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.113+0000 7f3058037740 1 -- 172.21.15.135:0/774492671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022584fe0 msgr2=0x5560225885c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.113+0000 7f3058037740 1 --2- 172.21.15.135:0/774492671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022584fe0 0x5560225885c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3040026e20 tx=0x7f3040013a60 comp rx=0 tx=0).stop 2024-04-20T12:24:53.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.114+0000 7f3058037740 1 -- 172.21.15.135:0/774492671 shutdown_connections 2024-04-20T12:24:53.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.114+0000 7f3058037740 1 --2- 172.21.15.135:0/774492671 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556022609bc0 0x55602260bfe0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.114+0000 7f3058037740 1 --2- 172.21.15.135:0/774492671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602258e4e0 0x556022607be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.114+0000 7f3058037740 1 --2- 172.21.15.135:0/774492671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556022585900 0x556022588b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.114+0000 7f3058037740 1 --2- 172.21.15.135:0/774492671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556022584fe0 0x5560225885c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.114+0000 7f3032ff5640 0 client.25769 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:53.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.114+0000 7f3058037740 1 -- 172.21.15.135:0/774492671 >> 172.21.15.135:0/774492671 conn(0x55602257f710 msgr2=0x556022585f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:53.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.114+0000 7f3058037740 1 -- 172.21.15.135:0/774492671 shutdown_connections 2024-04-20T12:24:53.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.114+0000 7f3058037740 1 -- 172.21.15.135:0/774492671 wait complete. 2024-04-20T12:24:53.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.114+0000 7f3058037740 20 client.25769 trim_cache size 0 max 16384 2024-04-20T12:24:53.122 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:24:53.123 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:24:53.123 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "0819eeeb-56f4-4628-b3f8-260f00a3a11a", 2024-04-20T12:24:53.123 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:24:53.123 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:24:53.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.115+0000 7f3055443640 1 -- 172.21.15.135:0/3426848788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f30380a3da0 msgr2=0x7f30380a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.115+0000 7f3055443640 1 --2- 172.21.15.135:0/3426848788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f30380a3da0 0x7f30380a6260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3048005fd0 tx=0x7f3048009e60 comp rx=0 tx=0).stop 2024-04-20T12:24:53.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.115+0000 7f3055443640 1 -- 172.21.15.135:0/3426848788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3050106160 msgr2=0x7f305019eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.115+0000 7f3055443640 1 --2- 172.21.15.135:0/3426848788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3050106160 0x7f305019eba0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3044036040 tx=0x7f304402cc10 comp rx=0 tx=0).stop 2024-04-20T12:24:53.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.115+0000 7f3055443640 1 -- 172.21.15.135:0/3426848788 shutdown_connections 2024-04-20T12:24:53.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.115+0000 7f3055443640 1 --2- 172.21.15.135:0/3426848788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f30501987d0 0x7f3050198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.115+0000 7f3055443640 1 --2- 172.21.15.135:0/3426848788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f30380a3da0 0x7f30380a6260 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.115+0000 7f3055443640 1 --2- 172.21.15.135:0/3426848788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3050106160 0x7f305019eba0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.115+0000 7f3055443640 1 --2- 172.21.15.135:0/3426848788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f30501015b0 0x7f305019e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.115+0000 7f3055443640 1 -- 172.21.15.135:0/3426848788 >> 172.21.15.135:0/3426848788 conn(0x7f30500769e0 msgr2=0x7f30500ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:53.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.115+0000 7f3055443640 1 -- 172.21.15.135:0/3426848788 shutdown_connections 2024-04-20T12:24:53.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.115+0000 7f3055443640 1 -- 172.21.15.135:0/3426848788 wait complete. 2024-04-20T12:24:53.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:24:53.127 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:24:53.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.283+0000 7faa2164e640 1 -- 172.21.15.135:0/2645216860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa1c10c520 msgr2=0x7faa1c10e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.283+0000 7faa2164e640 1 --2- 172.21.15.135:0/2645216860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa1c10c520 0x7faa1c10e9c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7faa14009ca0 tx=0x7faa1402c230 comp rx=0 tx=0).stop 2024-04-20T12:24:53.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.283+0000 7faa2164e640 1 -- 172.21.15.135:0/2645216860 shutdown_connections 2024-04-20T12:24:53.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.283+0000 7faa2164e640 1 --2- 172.21.15.135:0/2645216860 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa1c10c520 0x7faa1c10e9c0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.283+0000 7faa2164e640 1 --2- 172.21.15.135:0/2645216860 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa1c103b00 0x7faa1c10bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.283+0000 7faa2164e640 1 --2- 172.21.15.135:0/2645216860 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c1031e0 0x7faa1c1035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.283+0000 7faa2164e640 1 -- 172.21.15.135:0/2645216860 >> 172.21.15.135:0/2645216860 conn(0x7faa1c077f60 msgr2=0x7faa1c078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:53.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.283+0000 7faa2164e640 1 -- 172.21.15.135:0/2645216860 shutdown_connections 2024-04-20T12:24:53.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.283+0000 7faa2164e640 1 -- 172.21.15.135:0/2645216860 wait complete. 2024-04-20T12:24:53.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.284+0000 7faa2164e640 1 Processor -- start 2024-04-20T12:24:53.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.284+0000 7faa2164e640 1 -- start start 2024-04-20T12:24:53.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.284+0000 7faa2164e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c1031e0 0x7faa1c19e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.284+0000 7faa2164e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa1c103b00 0x7faa1c19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.284+0000 7faa2164e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa1c10c520 0x7faa1c1986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.284+0000 7faa2164e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c112380 con 0x7faa1c10c520 2024-04-20T12:24:53.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.284+0000 7faa2164e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c112200 con 0x7faa1c103b00 2024-04-20T12:24:53.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.284+0000 7faa2164e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c112500 con 0x7faa1c1031e0 2024-04-20T12:24:53.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.284+0000 7faa1b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa1c10c520 0x7faa1c1986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.284+0000 7faa1b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa1c10c520 0x7faa1c1986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36438/0 (socket says 172.21.15.135:36438) 2024-04-20T12:24:53.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.284+0000 7faa1b7fe640 1 -- 172.21.15.135:0/2716187700 learned_addr learned my addr 172.21.15.135:0/2716187700 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:53.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.284+0000 7faa13fff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa1c103b00 0x7faa1c19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.284+0000 7faa1affd640 1 --2- 172.21.15.135:0/2716187700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c1031e0 0x7faa1c19e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.285+0000 7faa1b7fe640 1 -- 172.21.15.135:0/2716187700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c1031e0 msgr2=0x7faa1c19e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.285+0000 7faa1b7fe640 1 --2- 172.21.15.135:0/2716187700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c1031e0 0x7faa1c19e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.285+0000 7faa1b7fe640 1 -- 172.21.15.135:0/2716187700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa1c103b00 msgr2=0x7faa1c19eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.285+0000 7faa1b7fe640 1 --2- 172.21.15.135:0/2716187700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa1c103b00 0x7faa1c19eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.285+0000 7faa1b7fe640 1 -- 172.21.15.135:0/2716187700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1c198fa0 con 0x7faa1c10c520 2024-04-20T12:24:53.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.285+0000 7faa1b7fe640 1 --2- 172.21.15.135:0/2716187700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa1c10c520 0x7faa1c1986e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7faa1402c840 tx=0x7faa14035d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:53.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.285+0000 7faa18ff9640 1 -- 172.21.15.135:0/2716187700 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14039040 con 0x7faa1c10c520 2024-04-20T12:24:53.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.285+0000 7faa2164e640 1 -- 172.21.15.135:0/2716187700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa1c199230 con 0x7faa1c10c520 2024-04-20T12:24:53.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.285+0000 7faa18ff9640 1 -- 172.21.15.135:0/2716187700 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa14044070 con 0x7faa1c10c520 2024-04-20T12:24:53.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.285+0000 7faa18ff9640 1 -- 172.21.15.135:0/2716187700 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa140042a0 con 0x7faa1c10c520 2024-04-20T12:24:53.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.285+0000 7faa2164e640 1 -- 172.21.15.135:0/2716187700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa1c1a5370 con 0x7faa1c10c520 2024-04-20T12:24:53.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.288+0000 7faa18ff9640 1 -- 172.21.15.135:0/2716187700 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7faa14004440 con 0x7faa1c10c520 2024-04-20T12:24:53.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.288+0000 7faa24242740 1 Processor -- start 2024-04-20T12:24:53.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.288+0000 7faa24242740 1 -- start start 2024-04-20T12:24:53.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.288+0000 7faa24242740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 0x56365e106100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.288+0000 7faa24242740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.288+0000 7faa24242740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 0x56365e111610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.288+0000 7faa24242740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56365e06b1b0 con 0x56365e10f220 2024-04-20T12:24:53.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.288+0000 7faa24242740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56365e008390 con 0x56365e106640 2024-04-20T12:24:53.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.288+0000 7faa24242740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56365e067170 con 0x56365e105d20 2024-04-20T12:24:53.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.288+0000 7faa1affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.288+0000 7faa13fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 0x56365e111610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa18ff9640 1 --2- 172.21.15.135:0/2716187700 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7faa080a3d20 0x7faa080a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa1affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:39288/0 (socket says 172.21.15.135:39288) 2024-04-20T12:24:53.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa13fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 0x56365e111610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36440/0 (socket says 172.21.15.135:36440) 2024-04-20T12:24:53.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa1affd640 1 -- 172.21.15.135:0/744102497 learned_addr learned my addr 172.21.15.135:0/744102497 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:53.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa13fff640 1 --2- 172.21.15.135:0/744102497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 0x56365e106100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa1b7fe640 1 --2- 172.21.15.135:0/2716187700 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7faa080a3d20 0x7faa080a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa1affd640 1 -- 172.21.15.135:0/744102497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 msgr2=0x56365e106100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:53.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa1affd640 1 --2- 172.21.15.135:0/744102497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 0x56365e106100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa1affd640 1 -- 172.21.15.135:0/744102497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 msgr2=0x56365e111610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:53.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa1affd640 1 --2- 172.21.15.135:0/744102497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 0x56365e111610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa1affd640 1 -- 172.21.15.135:0/744102497 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56365de477d0 con 0x56365e106640 2024-04-20T12:24:53.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa13fff640 1 --2- 172.21.15.135:0/744102497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 0x56365e106100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:53.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa18ff9640 1 -- 172.21.15.135:0/2716187700 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7faa140f2ed0 con 0x7faa1c10c520 2024-04-20T12:24:53.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa1affd640 1 --2- 172.21.15.135:0/744102497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10ece0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009d20 tx=0x7faa0c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb0f51596912a76 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:53.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa1b7fe640 1 --2- 172.21.15.135:0/2716187700 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7faa080a3d20 0x7faa080a61e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faa140beb90 tx=0x7faa140916f0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:53.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa117fa640 1 -- 172.21.15.135:0/744102497 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c01e070 con 0x56365e106640 2024-04-20T12:24:53.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa117fa640 1 -- 172.21.15.135:0/744102497 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa0c019b10 con 0x56365e106640 2024-04-20T12:24:53.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.289+0000 7faa117fa640 1 -- 172.21.15.135:0/744102497 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c00eb40 con 0x56365e106640 2024-04-20T12:24:53.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.290+0000 7faa24242740 1 -- 172.21.15.135:0/744102497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 msgr2=0x56365e10ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.290+0000 7faa24242740 1 --2- 172.21.15.135:0/744102497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10ece0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009d20 tx=0x7faa0c011810 comp rx=0 tx=0).stop 2024-04-20T12:24:53.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.290+0000 7faa24242740 1 -- 172.21.15.135:0/744102497 shutdown_connections 2024-04-20T12:24:53.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.290+0000 7faa24242740 1 --2- 172.21.15.135:0/744102497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 0x56365e111610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.290+0000 7faa24242740 1 --2- 172.21.15.135:0/744102497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10ece0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.290+0000 7faa24242740 1 --2- 172.21.15.135:0/744102497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 0x56365e106100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.290+0000 7faa24242740 1 -- 172.21.15.135:0/744102497 >> 172.21.15.135:0/744102497 conn(0x56365e100450 msgr2=0x56365e100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:53.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.290+0000 7faa24242740 1 -- 172.21.15.135:0/744102497 shutdown_connections 2024-04-20T12:24:53.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.290+0000 7faa24242740 1 -- 172.21.15.135:0/744102497 wait complete. 2024-04-20T12:24:53.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa24242740 1 -- start start 2024-04-20T12:24:53.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa24242740 1 Processor -- start 2024-04-20T12:24:53.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa24242740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 0x56365e10c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa24242740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa24242740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 0x56365e10cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa24242740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56365e112010 con 0x56365e10f220 2024-04-20T12:24:53.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa24242740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56365e0242f0 con 0x56365e106640 2024-04-20T12:24:53.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa24242740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56365e112190 con 0x56365e105d20 2024-04-20T12:24:53.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa24242740 10 client.0 _ll_register_callbacks cb 0x56365dfee4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:53.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa13fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 0x56365e10cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa1affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa13fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 0x56365e10c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa1affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:39294/0 (socket says 172.21.15.135:39294) 2024-04-20T12:24:53.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa1affd640 1 -- 172.21.15.135:0/2558438674 learned_addr learned my addr 172.21.15.135:0/2558438674 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:53.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa13fff640 1 -- 172.21.15.135:0/2558438674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 msgr2=0x56365e10c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:53.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa13fff640 1 --2- 172.21.15.135:0/2558438674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa13fff640 1 -- 172.21.15.135:0/2558438674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 msgr2=0x56365e10cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:53.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa13fff640 1 --2- 172.21.15.135:0/2558438674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 0x56365e10cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa13fff640 1 -- 172.21.15.135:0/2558438674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56365dd7d3f0 con 0x56365e105d20 2024-04-20T12:24:53.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa1affd640 1 --2- 172.21.15.135:0/2558438674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:53.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa13fff640 1 --2- 172.21.15.135:0/2558438674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 0x56365e10c290 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faa04019e50 tx=0x7faa04009470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10b9a985d76ae58b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:53.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.291+0000 7faa027fc640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-20T12:24:53.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.292+0000 7faa027fc640 1 -- 172.21.15.135:0/2558438674 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04017e80 con 0x56365e105d20 2024-04-20T12:24:53.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.292+0000 7faa24242740 1 -- 172.21.15.135:0/2558438674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa0c019b10 con 0x56365e105d20 2024-04-20T12:24:53.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.292+0000 7faa027fc640 1 -- 172.21.15.135:0/2558438674 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7faa04019020 con 0x56365e105d20 2024-04-20T12:24:53.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.292+0000 7faa027fc640 1 -- 172.21.15.135:0/2558438674 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faa0402c050 con 0x56365e105d20 2024-04-20T12:24:53.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.292+0000 7faa24242740 10 client.25774 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:53.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.292+0000 7faa24242740 1 -- 172.21.15.135:0/2558438674 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56365dd3d0f0 con 0x56365e105d20 2024-04-20T12:24:53.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.292+0000 7faa027fc640 1 -- 172.21.15.135:0/2558438674 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa0c019b10 con 0x56365e105d20 2024-04-20T12:24:53.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.292+0000 7faa027fc640 1 -- 172.21.15.135:0/2558438674 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7faa04024430 con 0x56365e105d20 2024-04-20T12:24:53.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.292+0000 7faa24242740 10 client.25774 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:53.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.292+0000 7faa24242740 10 client.25774 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:53.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.292+0000 7faa24242740 20 client.25774 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:53.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.292+0000 7faa24242740 1 --2- 172.21.15.135:0/2558438674 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56365e11f620 0x56365e121a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.292+0000 7faa24242740 4 client.25774 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:24:53.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.292+0000 7faa24242740 1 -- 172.21.15.135:0/2558438674 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56365e078bd0 con 0x56365e11f620 2024-04-20T12:24:53.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.292+0000 7faa1affd640 1 --2- 172.21.15.135:0/2558438674 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56365e11f620 0x56365e121a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.293+0000 7faa027fc640 10 client.25774 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:53.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.293+0000 7faa1affd640 1 --2- 172.21.15.135:0/2558438674 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56365e11f620 0x56365e121a60 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ce7c1e97338e94c server_cookie=5f63bbf81c05e7c7 in_seq=0 out_seq=0 2024-04-20T12:24:53.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.293+0000 7faa027fc640 1 -- 172.21.15.135:0/2558438674 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56365e078bd0 con 0x56365e11f620 2024-04-20T12:24:53.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.293+0000 7faa027fc640 10 client.25774 handle_command_reply: tid=0 2024-04-20T12:24:53.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.294+0000 7faa24242740 1 client.25774 shutdown 2024-04-20T12:24:53.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.294+0000 7faa24242740 1 -- 172.21.15.135:0/2558438674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 msgr2=0x56365e10c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.294+0000 7faa24242740 1 --2- 172.21.15.135:0/2558438674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 0x56365e10c290 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faa04019e50 tx=0x7faa04009470 comp rx=0 tx=0).stop 2024-04-20T12:24:53.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.294+0000 7faa24242740 1 -- 172.21.15.135:0/2558438674 shutdown_connections 2024-04-20T12:24:53.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.294+0000 7faa24242740 1 --2- 172.21.15.135:0/2558438674 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56365e11f620 0x56365e121a60 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.294+0000 7faa24242740 1 --2- 172.21.15.135:0/2558438674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 0x56365e10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.294+0000 7faa027fc640 0 client.25774 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:53.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.294+0000 7faa24242740 1 --2- 172.21.15.135:0/2558438674 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.294+0000 7faa24242740 1 --2- 172.21.15.135:0/2558438674 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 0x56365e10c290 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.294+0000 7faa24242740 1 -- 172.21.15.135:0/2558438674 >> 172.21.15.135:0/2558438674 conn(0x56365e100450 msgr2=0x56365e1021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:53.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.294+0000 7faa24242740 1 -- 172.21.15.135:0/2558438674 shutdown_connections 2024-04-20T12:24:53.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.294+0000 7faa24242740 1 -- 172.21.15.135:0/2558438674 wait complete. 2024-04-20T12:24:53.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.294+0000 7faa24242740 20 client.25774 trim_cache size 0 max 16384 2024-04-20T12:24:53.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.314+0000 7faa24242740 1 Processor -- start 2024-04-20T12:24:53.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.314+0000 7faa24242740 1 -- start start 2024-04-20T12:24:53.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.314+0000 7faa24242740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e105d20 0x56365e11af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.314+0000 7faa24242740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.314+0000 7faa24242740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e10f220 0x56365e10cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.314+0000 7faa24242740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c1af380 con 0x56365e105d20 2024-04-20T12:24:53.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.314+0000 7faa24242740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c1b0ec0 con 0x56365e106640 2024-04-20T12:24:53.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.314+0000 7faa24242740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c1afa50 con 0x56365e10f220 2024-04-20T12:24:53.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.315+0000 7faa13fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e105d20 0x56365e11af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.315+0000 7faa1affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.315+0000 7faa13fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e105d20 0x56365e11af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36458/0 (socket says 172.21.15.135:36458) 2024-04-20T12:24:53.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.315+0000 7faa13fff640 1 -- 172.21.15.135:0/2828638862 learned_addr learned my addr 172.21.15.135:0/2828638862 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:53.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.315+0000 7faa13fff640 1 --2- 172.21.15.135:0/2828638862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e10f220 0x56365e10cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.315+0000 7faa13fff640 1 -- 172.21.15.135:0/2828638862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e10f220 msgr2=0x56365e10cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:53.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.315+0000 7faa13fff640 1 --2- 172.21.15.135:0/2828638862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e10f220 0x56365e10cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.315+0000 7faa13fff640 1 -- 172.21.15.135:0/2828638862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 msgr2=0x56365e10b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:53.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.315+0000 7faa13fff640 1 --2- 172.21.15.135:0/2828638862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.315+0000 7faa13fff640 1 -- 172.21.15.135:0/2828638862 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56365e107090 con 0x56365e105d20 2024-04-20T12:24:53.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.315+0000 7faa1affd640 1 --2- 172.21.15.135:0/2828638862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:24:53.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.315+0000 7faa13fff640 1 --2- 172.21.15.135:0/2828638862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e105d20 0x56365e11af00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7faa04004700 tx=0x7faa0401b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815d8a96c2f7633e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:53.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.315+0000 7faa10ff9640 1 -- 172.21.15.135:0/2828638862 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04028030 con 0x56365e105d20 2024-04-20T12:24:53.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.315+0000 7faa10ff9640 1 -- 172.21.15.135:0/2828638862 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa04017e80 con 0x56365e105d20 2024-04-20T12:24:53.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.315+0000 7faa10ff9640 1 -- 172.21.15.135:0/2828638862 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04006040 con 0x56365e105d20 2024-04-20T12:24:53.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.316+0000 7faa24242740 1 -- 172.21.15.135:0/2828638862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e105d20 msgr2=0x56365e11af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.316+0000 7faa24242740 1 --2- 172.21.15.135:0/2828638862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e105d20 0x56365e11af00 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7faa04004700 tx=0x7faa0401b040 comp rx=0 tx=0).stop 2024-04-20T12:24:53.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.316+0000 7faa24242740 1 -- 172.21.15.135:0/2828638862 shutdown_connections 2024-04-20T12:24:53.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.316+0000 7faa24242740 1 --2- 172.21.15.135:0/2828638862 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e10f220 0x56365e10cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.316+0000 7faa24242740 1 --2- 172.21.15.135:0/2828638862 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e10b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.316+0000 7faa24242740 1 --2- 172.21.15.135:0/2828638862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e105d20 0x56365e11af00 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.316+0000 7faa24242740 1 -- 172.21.15.135:0/2828638862 >> 172.21.15.135:0/2828638862 conn(0x56365e100450 msgr2=0x56365e101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:53.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.316+0000 7faa24242740 1 -- 172.21.15.135:0/2828638862 shutdown_connections 2024-04-20T12:24:53.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.316+0000 7faa24242740 1 -- 172.21.15.135:0/2828638862 wait complete. 2024-04-20T12:24:53.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.316+0000 7faa24242740 1 -- start start 2024-04-20T12:24:53.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.316+0000 7faa24242740 1 Processor -- start 2024-04-20T12:24:53.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa24242740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 0x56365e1143e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa24242740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e114920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa24242740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 0x56365e114e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa24242740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c1b07f0 con 0x56365e10f220 2024-04-20T12:24:53.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa24242740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c1b0120 con 0x56365e106640 2024-04-20T12:24:53.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa24242740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa1c1ad350 con 0x56365e105d20 2024-04-20T12:24:53.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa24242740 10 client.0 _ll_register_callbacks cb 0x7faa04009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:24:53.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa13fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 0x56365e114e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa13fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 0x56365e114e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36468/0 (socket says 172.21.15.135:36468) 2024-04-20T12:24:53.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa13fff640 1 -- 172.21.15.135:0/1444141620 learned_addr learned my addr 172.21.15.135:0/1444141620 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:24:53.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa1affd640 1 --2- 172.21.15.135:0/1444141620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e114920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa13fff640 1 --2- 172.21.15.135:0/1444141620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 0x56365e1143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa13fff640 1 -- 172.21.15.135:0/1444141620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 msgr2=0x56365e1143e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:53.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa13fff640 1 --2- 172.21.15.135:0/1444141620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 0x56365e1143e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa13fff640 1 -- 172.21.15.135:0/1444141620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 msgr2=0x56365e114920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:24:53.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa13fff640 1 --2- 172.21.15.135:0/1444141620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e114920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa13fff640 1 -- 172.21.15.135:0/1444141620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56365e183e70 con 0x56365e10f220 2024-04-20T12:24:53.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa13fff640 1 --2- 172.21.15.135:0/1444141620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 0x56365e114e80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7faa04024880 tx=0x7faa040249d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56ff63e3d61f0de server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:24:53.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa027fc640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:24:53.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa027fc640 1 -- 172.21.15.135:0/1444141620 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04028040 con 0x56365e10f220 2024-04-20T12:24:53.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa027fc640 1 -- 172.21.15.135:0/1444141620 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7faa04024430 con 0x56365e10f220 2024-04-20T12:24:53.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa24242740 1 -- 172.21.15.135:0/1444141620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56365e072a40 con 0x56365e10f220 2024-04-20T12:24:53.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa027fc640 1 -- 172.21.15.135:0/1444141620 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faa04024630 con 0x56365e10f220 2024-04-20T12:24:53.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa24242740 10 client.16389 fetch_fsmap learned FSMap version 29 2024-04-20T12:24:53.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.317+0000 7faa24242740 1 -- 172.21.15.135:0/1444141620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56365e1850f0 con 0x56365e10f220 2024-04-20T12:24:53.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.318+0000 7faa027fc640 1 -- 172.21.15.135:0/1444141620 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56365e072a40 con 0x56365e10f220 2024-04-20T12:24:53.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.318+0000 7faa027fc640 1 -- 172.21.15.135:0/1444141620 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7faa0403d040 con 0x56365e10f220 2024-04-20T12:24:53.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.318+0000 7faa24242740 10 client.16389 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:24:53.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.318+0000 7faa24242740 10 client.16389 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:24:53.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.318+0000 7faa24242740 20 client.16389 populate_metadata read hostname 'smithi135' 2024-04-20T12:24:53.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.318+0000 7faa24242740 1 --2- 172.21.15.135:0/1444141620 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56365e185760 0x56365e187b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:24:53.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.318+0000 7faa24242740 4 client.16389 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:24:53.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.318+0000 7faa24242740 1 -- 172.21.15.135:0/1444141620 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56365dfee590 con 0x56365e185760 2024-04-20T12:24:53.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.318+0000 7faa1affd640 1 --2- 172.21.15.135:0/1444141620 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56365e185760 0x56365e187b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:24:53.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.318+0000 7faa1affd640 1 --2- 172.21.15.135:0/1444141620 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56365e185760 0x56365e187b80 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b475ddb9fa8b0c10 server_cookie=f3ca0f7a5e57f51d in_seq=0 out_seq=0 2024-04-20T12:24:53.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.318+0000 7faa027fc640 10 client.16389 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:53.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.319+0000 7faa027fc640 1 -- 172.21.15.135:0/1444141620 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56365dfee590 con 0x56365e185760 2024-04-20T12:24:53.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.319+0000 7faa027fc640 10 client.16389 handle_command_reply: tid=0 2024-04-20T12:24:53.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.319+0000 7faa24242740 1 client.16389 shutdown 2024-04-20T12:24:53.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.319+0000 7faa24242740 1 -- 172.21.15.135:0/1444141620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 msgr2=0x56365e114e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.319+0000 7faa24242740 1 --2- 172.21.15.135:0/1444141620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 0x56365e114e80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7faa04024880 tx=0x7faa040249d0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.319+0000 7faa24242740 1 -- 172.21.15.135:0/1444141620 shutdown_connections 2024-04-20T12:24:53.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.319+0000 7faa24242740 1 --2- 172.21.15.135:0/1444141620 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56365e185760 0x56365e187b80 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.319+0000 7faa24242740 1 --2- 172.21.15.135:0/1444141620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56365e10f220 0x56365e114e80 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.319+0000 7faa24242740 1 --2- 172.21.15.135:0/1444141620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56365e106640 0x56365e114920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.319+0000 7faa24242740 1 --2- 172.21.15.135:0/1444141620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56365e105d20 0x56365e1143e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.319+0000 7faa027fc640 0 client.16389 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:24:53.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.319+0000 7faa24242740 1 -- 172.21.15.135:0/1444141620 >> 172.21.15.135:0/1444141620 conn(0x56365e100450 msgr2=0x56365e0ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:53.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.319+0000 7faa24242740 1 -- 172.21.15.135:0/1444141620 shutdown_connections 2024-04-20T12:24:53.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.319+0000 7faa24242740 1 -- 172.21.15.135:0/1444141620 wait complete. 2024-04-20T12:24:53.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.319+0000 7faa24242740 20 client.16389 trim_cache size 0 max 16384 2024-04-20T12:24:53.326 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:24:53.326 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:24:53.326 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:24:53.326 INFO:teuthology.orchestra.run.smithi135.stdout: "0819eeeb-56f4-4628-b3f8-260f00a3a11a": { 2024-04-20T12:24:53.326 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:24:53.326 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "0819eeeb-56f4-4628-b3f8-260f00a3a11a", 2024-04-20T12:24:53.326 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:24:53.326 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:24:53.326 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:24:53.326 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:24:53.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.320+0000 7faa2164e640 1 -- 172.21.15.135:0/2716187700 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7faa080a3d20 msgr2=0x7faa080a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.320+0000 7faa2164e640 1 --2- 172.21.15.135:0/2716187700 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7faa080a3d20 0x7faa080a61e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faa140beb90 tx=0x7faa140916f0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.320+0000 7faa2164e640 1 -- 172.21.15.135:0/2716187700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa1c10c520 msgr2=0x7faa1c1986e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:24:53.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.320+0000 7faa2164e640 1 --2- 172.21.15.135:0/2716187700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa1c10c520 0x7faa1c1986e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7faa1402c840 tx=0x7faa14035d90 comp rx=0 tx=0).stop 2024-04-20T12:24:53.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.320+0000 7faa2164e640 1 -- 172.21.15.135:0/2716187700 shutdown_connections 2024-04-20T12:24:53.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.320+0000 7faa2164e640 1 --2- 172.21.15.135:0/2716187700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa1c10c520 0x7faa1c1986e0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.320+0000 7faa2164e640 1 --2- 172.21.15.135:0/2716187700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa1c103b00 0x7faa1c19eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.320+0000 7faa2164e640 1 --2- 172.21.15.135:0/2716187700 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7faa080a3d20 0x7faa080a61e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.320+0000 7faa2164e640 1 --2- 172.21.15.135:0/2716187700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa1c1031e0 0x7faa1c19e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:24:53.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.320+0000 7faa2164e640 1 -- 172.21.15.135:0/2716187700 >> 172.21.15.135:0/2716187700 conn(0x7faa1c077f60 msgr2=0x7faa1c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:24:53.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.320+0000 7faa2164e640 1 -- 172.21.15.135:0/2716187700 shutdown_connections 2024-04-20T12:24:53.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:24:53.320+0000 7faa2164e640 1 -- 172.21.15.135:0/2716187700 wait complete. 2024-04-20T12:24:53.332 INFO:tasks.cephfs.filesystem:scrub status for tag:0819eeeb-56f4-4628-b3f8-260f00a3a11a - {'path': '/', 'tag': '0819eeeb-56f4-4628-b3f8-260f00a3a11a', 'options': 'recursive,force'} 2024-04-20T12:24:53.791 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193280 len 2048 2024-04-20T12:24:53.791 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4193280 len 4096 2024-04-20T12:24:53.791 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-04-20T12:24:53.791 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4193280 len 4096 2024-04-20T12:24:53.791 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193280 len 4096 2024-04-20T12:24:53.791 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4193280 len 8192 2024-04-20T12:24:53.791 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-04-20T12:24:53.791 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4193280 len 8192 2024-04-20T12:24:53.791 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193280 len 8192 2024-04-20T12:24:53.791 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4193280 len 16384 2024-04-20T12:24:53.792 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-04-20T12:24:53.792 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4193280 len 16384 2024-04-20T12:24:53.792 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193280 len 16384 2024-04-20T12:24:53.792 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4193792 len 1024 2024-04-20T12:24:53.792 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-04-20T12:24:53.792 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4193792 len 1024 2024-04-20T12:24:53.792 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193792 len 1024 2024-04-20T12:24:53.792 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4193792 len 2048 2024-04-20T12:24:53.792 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-04-20T12:24:53.792 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4193792 len 2048 2024-04-20T12:24:53.792 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193792 len 2048 2024-04-20T12:24:53.792 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4193792 len 4096 2024-04-20T12:24:53.792 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-04-20T12:24:53.792 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4193792 len 4096 2024-04-20T12:24:53.793 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193792 len 4096 2024-04-20T12:24:53.793 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4193792 len 8192 2024-04-20T12:24:53.793 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-04-20T12:24:53.793 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4193792 len 8192 2024-04-20T12:24:53.793 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193792 len 8192 2024-04-20T12:24:53.793 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4193792 len 16384 2024-04-20T12:24:53.793 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-04-20T12:24:53.793 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4193792 len 16384 2024-04-20T12:24:53.793 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4193792 len 16384 2024-04-20T12:24:53.793 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4194304 len 1024 2024-04-20T12:24:53.793 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-04-20T12:24:53.793 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4194304 len 1024 2024-04-20T12:24:53.793 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194304 len 1024 2024-04-20T12:24:53.793 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4194304 len 2048 2024-04-20T12:24:53.793 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-04-20T12:24:53.794 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4194304 len 2048 2024-04-20T12:24:53.794 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194304 len 2048 2024-04-20T12:24:53.794 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4194304 len 4096 2024-04-20T12:24:53.794 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-04-20T12:24:53.794 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4194304 len 4096 2024-04-20T12:24:53.794 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194304 len 4096 2024-04-20T12:24:53.794 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4194304 len 8192 2024-04-20T12:24:53.794 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-04-20T12:24:53.794 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4194304 len 8192 2024-04-20T12:24:53.794 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194304 len 8192 2024-04-20T12:24:53.794 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4194304 len 16384 2024-04-20T12:24:53.794 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-04-20T12:24:53.794 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4194304 len 16384 2024-04-20T12:24:53.794 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194304 len 16384 2024-04-20T12:24:53.794 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4194816 len 1024 2024-04-20T12:24:53.795 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-04-20T12:24:53.795 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4194816 len 1024 2024-04-20T12:24:53.795 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194816 len 1024 2024-04-20T12:24:53.795 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4194816 len 2048 2024-04-20T12:24:53.795 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-04-20T12:24:53.795 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4194816 len 2048 2024-04-20T12:24:53.795 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194816 len 2048 2024-04-20T12:24:53.795 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4194816 len 4096 2024-04-20T12:24:53.795 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-04-20T12:24:53.795 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4194816 len 4096 2024-04-20T12:24:53.795 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194816 len 4096 2024-04-20T12:24:53.795 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4194816 len 8192 2024-04-20T12:24:53.795 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-04-20T12:24:53.795 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4194816 len 8192 2024-04-20T12:24:53.795 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194816 len 8192 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4194816 len 16384 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4194816 len 16384 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4194816 len 16384 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4195328 len 1024 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4195328 len 1024 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195328 len 1024 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4195328 len 2048 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4195328 len 2048 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195328 len 2048 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4195328 len 4096 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4195328 len 4096 2024-04-20T12:24:53.796 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195328 len 4096 2024-04-20T12:24:54.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:53 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:24:54.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:53 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:24:54.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:53 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:24:54.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:53 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:24:54.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:53 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:24:54.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:53 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:24:54.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:53 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:24:54.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:53 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:24:54.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:53 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:24:54.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:53 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:24:54.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:53 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:24:54.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:53 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:24:54.261 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4195328 len 8192 2024-04-20T12:24:54.261 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-04-20T12:24:54.261 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4195328 len 8192 2024-04-20T12:24:54.261 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195328 len 8192 2024-04-20T12:24:54.261 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4195328 len 16384 2024-04-20T12:24:54.261 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-04-20T12:24:54.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4195328 len 16384 2024-04-20T12:24:54.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195328 len 16384 2024-04-20T12:24:54.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4195840 len 1024 2024-04-20T12:24:54.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-04-20T12:24:54.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4195840 len 1024 2024-04-20T12:24:54.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195840 len 1024 2024-04-20T12:24:54.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4195840 len 2048 2024-04-20T12:24:54.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-04-20T12:24:54.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4195840 len 2048 2024-04-20T12:24:54.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195840 len 2048 2024-04-20T12:24:54.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4195840 len 4096 2024-04-20T12:24:54.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-04-20T12:24:54.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4195840 len 4096 2024-04-20T12:24:54.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195840 len 4096 2024-04-20T12:24:54.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4195840 len 8192 2024-04-20T12:24:54.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-04-20T12:24:54.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4195840 len 8192 2024-04-20T12:24:54.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195840 len 8192 2024-04-20T12:24:54.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4195840 len 16384 2024-04-20T12:24:54.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-04-20T12:24:54.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4195840 len 16384 2024-04-20T12:24:54.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4195840 len 16384 2024-04-20T12:24:54.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4196352 len 1024 2024-04-20T12:24:54.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-04-20T12:24:54.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4196352 len 1024 2024-04-20T12:24:54.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196352 len 1024 2024-04-20T12:24:54.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4196352 len 2048 2024-04-20T12:24:54.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-04-20T12:24:54.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4196352 len 2048 2024-04-20T12:24:54.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196352 len 2048 2024-04-20T12:24:54.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4196352 len 4096 2024-04-20T12:24:54.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-04-20T12:24:54.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4196352 len 4096 2024-04-20T12:24:54.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196352 len 4096 2024-04-20T12:24:54.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4196352 len 8192 2024-04-20T12:24:54.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-04-20T12:24:54.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4196352 len 8192 2024-04-20T12:24:54.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196352 len 8192 2024-04-20T12:24:54.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4196352 len 16384 2024-04-20T12:24:54.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-04-20T12:24:54.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4196352 len 16384 2024-04-20T12:24:54.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196352 len 16384 2024-04-20T12:24:54.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4196864 len 1024 2024-04-20T12:24:54.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-04-20T12:24:54.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4196864 len 1024 2024-04-20T12:24:54.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196864 len 1024 2024-04-20T12:24:54.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4196864 len 2048 2024-04-20T12:24:54.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-04-20T12:24:54.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4196864 len 2048 2024-04-20T12:24:54.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196864 len 2048 2024-04-20T12:24:54.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4196864 len 4096 2024-04-20T12:24:54.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-04-20T12:24:54.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4196864 len 4096 2024-04-20T12:24:54.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196864 len 4096 2024-04-20T12:24:54.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4196864 len 8192 2024-04-20T12:24:54.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-04-20T12:24:54.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4196864 len 8192 2024-04-20T12:24:54.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196864 len 8192 2024-04-20T12:24:54.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4196864 len 16384 2024-04-20T12:24:54.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-04-20T12:24:54.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4196864 len 16384 2024-04-20T12:24:54.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4196864 len 16384 2024-04-20T12:24:54.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4197376 len 1024 2024-04-20T12:24:54.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-04-20T12:24:54.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4197376 len 1024 2024-04-20T12:24:54.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197376 len 1024 2024-04-20T12:24:54.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4197376 len 2048 2024-04-20T12:24:54.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-04-20T12:24:54.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4197376 len 2048 2024-04-20T12:24:54.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197376 len 2048 2024-04-20T12:24:54.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4197376 len 4096 2024-04-20T12:24:54.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-04-20T12:24:54.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4197376 len 4096 2024-04-20T12:24:54.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197376 len 4096 2024-04-20T12:24:54.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4197376 len 8192 2024-04-20T12:24:54.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-04-20T12:24:54.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4197376 len 8192 2024-04-20T12:24:54.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197376 len 8192 2024-04-20T12:24:54.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4197376 len 16384 2024-04-20T12:24:54.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-04-20T12:24:55.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:54 smithi154 ceph-mon[22073]: pgmap v56: 129 pgs: 129 active+clean; 238 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 2.1 MiB/s wr, 1.32k op/s 2024-04-20T12:24:55.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:54 smithi139 ceph-mon[21834]: pgmap v56: 129 pgs: 129 active+clean; 238 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 2.1 MiB/s wr, 1.32k op/s 2024-04-20T12:24:55.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:54 smithi135 ceph-mon[18264]: pgmap v56: 129 pgs: 129 active+clean; 238 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 MiB/s rd, 2.1 MiB/s wr, 1.32k op/s 2024-04-20T12:24:55.254 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4197376 len 16384 2024-04-20T12:24:55.254 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197376 len 16384 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4197888 len 1024 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4197888 len 1024 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197888 len 1024 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4197888 len 2048 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4197888 len 2048 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197888 len 2048 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4197888 len 4096 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4197888 len 4096 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197888 len 4096 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4197888 len 8192 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4197888 len 8192 2024-04-20T12:24:55.255 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197888 len 8192 2024-04-20T12:24:55.256 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 0 offset 4197888 len 16384 2024-04-20T12:24:55.256 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-04-20T12:24:55.256 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 0 offset 4197888 len 16384 2024-04-20T12:24:55.256 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 0 offset 4197888 len 16384 2024-04-20T12:24:55.256 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4190720 len 1024 2024-04-20T12:24:55.256 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-04-20T12:24:55.256 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4190720 len 1024 2024-04-20T12:24:55.256 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4190720 len 1024 2024-04-20T12:24:55.256 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4190720 len 2048 2024-04-20T12:24:55.256 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-04-20T12:24:55.256 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4190720 len 2048 2024-04-20T12:24:55.256 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4190720 len 2048 2024-04-20T12:24:55.256 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4190720 len 4096 2024-04-20T12:24:55.256 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-04-20T12:24:55.256 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4190720 len 4096 2024-04-20T12:24:55.257 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4190720 len 4096 2024-04-20T12:24:55.257 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4190720 len 8192 2024-04-20T12:24:55.257 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-04-20T12:24:55.257 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4190720 len 8192 2024-04-20T12:24:55.257 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4190720 len 8192 2024-04-20T12:24:55.257 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4190720 len 16384 2024-04-20T12:24:55.257 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-04-20T12:24:55.257 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4190720 len 16384 2024-04-20T12:24:55.257 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4190720 len 16384 2024-04-20T12:24:55.257 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4191232 len 1024 2024-04-20T12:24:55.257 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-04-20T12:24:55.257 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4191232 len 1024 2024-04-20T12:24:55.257 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191232 len 1024 2024-04-20T12:24:55.257 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4191232 len 2048 2024-04-20T12:24:55.258 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-04-20T12:24:55.258 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4191232 len 2048 2024-04-20T12:24:55.258 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191232 len 2048 2024-04-20T12:24:55.258 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4191232 len 4096 2024-04-20T12:24:55.258 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-04-20T12:24:55.258 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4191232 len 4096 2024-04-20T12:24:55.258 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191232 len 4096 2024-04-20T12:24:55.258 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4191232 len 8192 2024-04-20T12:24:55.258 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-04-20T12:24:55.258 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4191232 len 8192 2024-04-20T12:24:55.258 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191232 len 8192 2024-04-20T12:24:55.258 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4191232 len 16384 2024-04-20T12:24:55.258 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-04-20T12:24:55.258 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4191232 len 16384 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191232 len 16384 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4191744 len 1024 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4191744 len 1024 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191744 len 1024 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4191744 len 2048 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4191744 len 2048 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191744 len 2048 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4191744 len 4096 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4191744 len 4096 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191744 len 4096 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4191744 len 8192 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-04-20T12:24:55.259 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4191744 len 8192 2024-04-20T12:24:55.260 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191744 len 8192 2024-04-20T12:24:55.260 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4191744 len 16384 2024-04-20T12:24:55.260 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-04-20T12:24:55.260 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4191744 len 16384 2024-04-20T12:24:55.260 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4191744 len 16384 2024-04-20T12:24:55.260 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4192256 len 1024 2024-04-20T12:24:55.260 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-04-20T12:24:56.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4192256 len 1024 2024-04-20T12:24:56.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192256 len 1024 2024-04-20T12:24:56.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4192256 len 2048 2024-04-20T12:24:56.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4192256 len 2048 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192256 len 2048 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4192256 len 4096 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4192256 len 4096 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192256 len 4096 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4192256 len 8192 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4192256 len 8192 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192256 len 8192 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4192256 len 16384 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4192256 len 16384 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192256 len 16384 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4192768 len 1024 2024-04-20T12:24:56.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-04-20T12:24:56.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4192768 len 1024 2024-04-20T12:24:56.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192768 len 1024 2024-04-20T12:24:56.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4192768 len 2048 2024-04-20T12:24:56.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-04-20T12:24:56.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4192768 len 2048 2024-04-20T12:24:56.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192768 len 2048 2024-04-20T12:24:56.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4192768 len 4096 2024-04-20T12:24:56.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-04-20T12:24:56.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4192768 len 4096 2024-04-20T12:24:56.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192768 len 4096 2024-04-20T12:24:56.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4192768 len 8192 2024-04-20T12:24:56.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-04-20T12:24:56.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4192768 len 8192 2024-04-20T12:24:56.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192768 len 8192 2024-04-20T12:24:56.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4192768 len 16384 2024-04-20T12:24:56.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-04-20T12:24:56.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4192768 len 16384 2024-04-20T12:24:56.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4192768 len 16384 2024-04-20T12:24:56.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4193280 len 1024 2024-04-20T12:24:56.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-04-20T12:24:56.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4193280 len 1024 2024-04-20T12:24:56.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193280 len 1024 2024-04-20T12:24:56.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4193280 len 2048 2024-04-20T12:24:56.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-04-20T12:24:56.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4193280 len 2048 2024-04-20T12:24:56.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193280 len 2048 2024-04-20T12:24:56.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4193280 len 4096 2024-04-20T12:24:56.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-04-20T12:24:56.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4193280 len 4096 2024-04-20T12:24:56.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193280 len 4096 2024-04-20T12:24:56.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4193280 len 8192 2024-04-20T12:24:56.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-04-20T12:24:56.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4193280 len 8192 2024-04-20T12:24:56.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193280 len 8192 2024-04-20T12:24:56.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4193280 len 16384 2024-04-20T12:24:56.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-04-20T12:24:56.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4193280 len 16384 2024-04-20T12:24:56.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193280 len 16384 2024-04-20T12:24:56.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4193792 len 1024 2024-04-20T12:24:56.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-04-20T12:24:56.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4193792 len 1024 2024-04-20T12:24:56.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193792 len 1024 2024-04-20T12:24:56.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4193792 len 2048 2024-04-20T12:24:56.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-04-20T12:24:56.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4193792 len 2048 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193792 len 2048 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4193792 len 4096 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4193792 len 4096 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193792 len 4096 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4193792 len 8192 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4193792 len 8192 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193792 len 8192 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4193792 len 16384 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4193792 len 16384 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4193792 len 16384 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4194304 len 1024 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-04-20T12:24:56.387 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4194304 len 1024 2024-04-20T12:24:56.388 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194304 len 1024 2024-04-20T12:24:56.799 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4194304 len 2048 2024-04-20T12:24:56.799 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-04-20T12:24:56.799 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4194304 len 2048 2024-04-20T12:24:56.799 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194304 len 2048 2024-04-20T12:24:56.799 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4194304 len 4096 2024-04-20T12:24:56.799 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-04-20T12:24:56.799 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4194304 len 4096 2024-04-20T12:24:56.799 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194304 len 4096 2024-04-20T12:24:56.799 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4194304 len 8192 2024-04-20T12:24:56.800 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-04-20T12:24:56.800 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4194304 len 8192 2024-04-20T12:24:56.800 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194304 len 8192 2024-04-20T12:24:56.800 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4194304 len 16384 2024-04-20T12:24:56.800 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-04-20T12:24:56.800 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4194304 len 16384 2024-04-20T12:24:56.800 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194304 len 16384 2024-04-20T12:24:56.800 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4194816 len 1024 2024-04-20T12:24:56.800 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-04-20T12:24:56.800 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4194816 len 1024 2024-04-20T12:24:56.800 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194816 len 1024 2024-04-20T12:24:56.800 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4194816 len 2048 2024-04-20T12:24:56.800 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-04-20T12:24:56.800 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4194816 len 2048 2024-04-20T12:24:56.801 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194816 len 2048 2024-04-20T12:24:56.801 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4194816 len 4096 2024-04-20T12:24:56.801 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-04-20T12:24:56.801 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4194816 len 4096 2024-04-20T12:24:56.801 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194816 len 4096 2024-04-20T12:24:56.801 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4194816 len 8192 2024-04-20T12:24:56.801 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-04-20T12:24:56.801 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4194816 len 8192 2024-04-20T12:24:56.801 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194816 len 8192 2024-04-20T12:24:56.801 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4194816 len 16384 2024-04-20T12:24:56.801 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-04-20T12:24:56.801 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4194816 len 16384 2024-04-20T12:24:56.801 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4194816 len 16384 2024-04-20T12:24:56.801 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4195328 len 1024 2024-04-20T12:24:56.801 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-04-20T12:24:56.802 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4195328 len 1024 2024-04-20T12:24:56.802 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195328 len 1024 2024-04-20T12:24:56.802 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4195328 len 2048 2024-04-20T12:24:56.802 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-04-20T12:24:56.802 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4195328 len 2048 2024-04-20T12:24:56.802 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195328 len 2048 2024-04-20T12:24:56.802 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4195328 len 4096 2024-04-20T12:24:56.802 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-04-20T12:24:56.802 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4195328 len 4096 2024-04-20T12:24:56.802 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195328 len 4096 2024-04-20T12:24:56.802 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4195328 len 8192 2024-04-20T12:24:56.802 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-04-20T12:24:56.802 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4195328 len 8192 2024-04-20T12:24:56.802 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195328 len 8192 2024-04-20T12:24:56.803 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4195328 len 16384 2024-04-20T12:24:56.803 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-04-20T12:24:56.803 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4195328 len 16384 2024-04-20T12:24:56.803 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195328 len 16384 2024-04-20T12:24:56.803 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4195840 len 1024 2024-04-20T12:24:56.803 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-04-20T12:24:56.803 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4195840 len 1024 2024-04-20T12:24:56.803 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195840 len 1024 2024-04-20T12:24:56.803 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4195840 len 2048 2024-04-20T12:24:56.803 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-04-20T12:24:56.803 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4195840 len 2048 2024-04-20T12:24:56.803 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195840 len 2048 2024-04-20T12:24:56.803 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4195840 len 4096 2024-04-20T12:24:56.803 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-04-20T12:24:56.804 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4195840 len 4096 2024-04-20T12:24:56.804 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195840 len 4096 2024-04-20T12:24:56.804 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4195840 len 8192 2024-04-20T12:24:56.804 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-04-20T12:24:56.804 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4195840 len 8192 2024-04-20T12:24:56.804 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195840 len 8192 2024-04-20T12:24:56.804 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4195840 len 16384 2024-04-20T12:24:56.804 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-04-20T12:24:56.804 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4195840 len 16384 2024-04-20T12:24:56.804 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4195840 len 16384 2024-04-20T12:24:56.804 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4196352 len 1024 2024-04-20T12:24:56.804 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-04-20T12:24:56.804 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4196352 len 1024 2024-04-20T12:24:56.804 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196352 len 1024 2024-04-20T12:24:56.805 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4196352 len 2048 2024-04-20T12:24:56.805 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-04-20T12:24:57.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:56 smithi154 ceph-mon[22073]: pgmap v57: 129 pgs: 129 active+clean; 238 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 777 KiB/s wr, 910 op/s 2024-04-20T12:24:57.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:56 smithi139 ceph-mon[21834]: pgmap v57: 129 pgs: 129 active+clean; 238 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 777 KiB/s wr, 910 op/s 2024-04-20T12:24:57.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:56 smithi135 ceph-mon[18264]: pgmap v57: 129 pgs: 129 active+clean; 238 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 777 KiB/s wr, 910 op/s 2024-04-20T12:24:57.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4196352 len 2048 2024-04-20T12:24:57.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196352 len 2048 2024-04-20T12:24:57.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4196352 len 4096 2024-04-20T12:24:57.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-04-20T12:24:57.262 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4196352 len 4096 2024-04-20T12:24:57.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196352 len 4096 2024-04-20T12:24:57.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4196352 len 8192 2024-04-20T12:24:57.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-04-20T12:24:57.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4196352 len 8192 2024-04-20T12:24:57.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196352 len 8192 2024-04-20T12:24:57.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4196352 len 16384 2024-04-20T12:24:57.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-04-20T12:24:57.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4196352 len 16384 2024-04-20T12:24:57.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196352 len 16384 2024-04-20T12:24:57.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4196864 len 1024 2024-04-20T12:24:57.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-04-20T12:24:57.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4196864 len 1024 2024-04-20T12:24:57.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196864 len 1024 2024-04-20T12:24:57.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4196864 len 2048 2024-04-20T12:24:57.263 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-04-20T12:24:57.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4196864 len 2048 2024-04-20T12:24:57.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196864 len 2048 2024-04-20T12:24:57.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4196864 len 4096 2024-04-20T12:24:57.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-04-20T12:24:57.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4196864 len 4096 2024-04-20T12:24:57.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196864 len 4096 2024-04-20T12:24:57.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4196864 len 8192 2024-04-20T12:24:57.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-04-20T12:24:57.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4196864 len 8192 2024-04-20T12:24:57.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196864 len 8192 2024-04-20T12:24:57.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4196864 len 16384 2024-04-20T12:24:57.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-04-20T12:24:57.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4196864 len 16384 2024-04-20T12:24:57.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4196864 len 16384 2024-04-20T12:24:57.264 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4197376 len 1024 2024-04-20T12:24:57.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-04-20T12:24:57.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4197376 len 1024 2024-04-20T12:24:57.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197376 len 1024 2024-04-20T12:24:57.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4197376 len 2048 2024-04-20T12:24:57.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-04-20T12:24:57.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4197376 len 2048 2024-04-20T12:24:57.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197376 len 2048 2024-04-20T12:24:57.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4197376 len 4096 2024-04-20T12:24:57.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-04-20T12:24:57.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4197376 len 4096 2024-04-20T12:24:57.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197376 len 4096 2024-04-20T12:24:57.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4197376 len 8192 2024-04-20T12:24:57.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-04-20T12:24:57.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4197376 len 8192 2024-04-20T12:24:57.265 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197376 len 8192 2024-04-20T12:24:57.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4197376 len 16384 2024-04-20T12:24:57.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-04-20T12:24:57.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4197376 len 16384 2024-04-20T12:24:57.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197376 len 16384 2024-04-20T12:24:57.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4197888 len 1024 2024-04-20T12:24:57.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-04-20T12:24:57.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4197888 len 1024 2024-04-20T12:24:57.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197888 len 1024 2024-04-20T12:24:57.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4197888 len 2048 2024-04-20T12:24:57.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-04-20T12:24:57.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4197888 len 2048 2024-04-20T12:24:57.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197888 len 2048 2024-04-20T12:24:57.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4197888 len 4096 2024-04-20T12:24:57.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-04-20T12:24:57.266 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4197888 len 4096 2024-04-20T12:24:57.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197888 len 4096 2024-04-20T12:24:57.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4197888 len 8192 2024-04-20T12:24:57.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-04-20T12:24:57.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4197888 len 8192 2024-04-20T12:24:57.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197888 len 8192 2024-04-20T12:24:57.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 512 offset 4197888 len 16384 2024-04-20T12:24:57.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-04-20T12:24:57.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 512 offset 4197888 len 16384 2024-04-20T12:24:57.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 512 offset 4197888 len 16384 2024-04-20T12:24:57.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4190720 len 1024 2024-04-20T12:24:57.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-04-20T12:24:57.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4190720 len 1024 2024-04-20T12:24:57.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4190720 len 1024 2024-04-20T12:24:57.267 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4190720 len 2048 2024-04-20T12:24:57.268 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-04-20T12:24:57.268 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4190720 len 2048 2024-04-20T12:24:57.268 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4190720 len 2048 2024-04-20T12:24:57.268 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4190720 len 4096 2024-04-20T12:24:58.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:57 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:24:58.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:57 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:24:58.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:57 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:24:58.316 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-04-20T12:24:58.316 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4190720 len 4096 2024-04-20T12:24:58.316 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4190720 len 4096 2024-04-20T12:24:58.316 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4190720 len 8192 2024-04-20T12:24:58.316 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-04-20T12:24:58.316 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4190720 len 8192 2024-04-20T12:24:58.316 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4190720 len 8192 2024-04-20T12:24:58.317 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4190720 len 16384 2024-04-20T12:24:58.317 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-04-20T12:24:58.317 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4190720 len 16384 2024-04-20T12:24:58.317 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4190720 len 16384 2024-04-20T12:24:58.317 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4191232 len 1024 2024-04-20T12:24:58.317 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-04-20T12:24:58.317 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4191232 len 1024 2024-04-20T12:24:58.317 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191232 len 1024 2024-04-20T12:24:58.317 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4191232 len 2048 2024-04-20T12:24:58.317 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-04-20T12:24:58.317 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4191232 len 2048 2024-04-20T12:24:58.317 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191232 len 2048 2024-04-20T12:24:58.317 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4191232 len 4096 2024-04-20T12:24:58.317 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-04-20T12:24:58.317 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4191232 len 4096 2024-04-20T12:24:58.318 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191232 len 4096 2024-04-20T12:24:58.318 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4191232 len 8192 2024-04-20T12:24:58.318 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-04-20T12:24:58.318 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4191232 len 8192 2024-04-20T12:24:58.318 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191232 len 8192 2024-04-20T12:24:58.318 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4191232 len 16384 2024-04-20T12:24:58.318 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-04-20T12:24:58.318 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4191232 len 16384 2024-04-20T12:24:58.318 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191232 len 16384 2024-04-20T12:24:58.318 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4191744 len 1024 2024-04-20T12:24:58.318 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-04-20T12:24:58.318 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4191744 len 1024 2024-04-20T12:24:58.318 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191744 len 1024 2024-04-20T12:24:58.318 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4191744 len 2048 2024-04-20T12:24:58.318 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4191744 len 2048 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191744 len 2048 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4191744 len 4096 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4191744 len 4096 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191744 len 4096 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4191744 len 8192 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4191744 len 8192 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191744 len 8192 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4191744 len 16384 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4191744 len 16384 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4191744 len 16384 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4192256 len 1024 2024-04-20T12:24:58.319 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-04-20T12:24:58.320 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4192256 len 1024 2024-04-20T12:24:58.320 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192256 len 1024 2024-04-20T12:24:58.320 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4192256 len 2048 2024-04-20T12:24:58.320 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-04-20T12:24:58.320 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4192256 len 2048 2024-04-20T12:24:58.320 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192256 len 2048 2024-04-20T12:24:58.320 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4192256 len 4096 2024-04-20T12:24:58.320 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-04-20T12:24:58.320 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4192256 len 4096 2024-04-20T12:24:58.320 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192256 len 4096 2024-04-20T12:24:58.320 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4192256 len 8192 2024-04-20T12:24:58.320 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-04-20T12:24:58.320 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4192256 len 8192 2024-04-20T12:24:58.320 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192256 len 8192 2024-04-20T12:24:58.320 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4192256 len 16384 2024-04-20T12:24:58.321 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-04-20T12:24:58.321 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4192256 len 16384 2024-04-20T12:24:58.321 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192256 len 16384 2024-04-20T12:24:58.321 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4192768 len 1024 2024-04-20T12:24:58.321 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-04-20T12:24:58.321 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4192768 len 1024 2024-04-20T12:24:58.321 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192768 len 1024 2024-04-20T12:24:58.321 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4192768 len 2048 2024-04-20T12:24:58.321 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-04-20T12:24:58.321 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4192768 len 2048 2024-04-20T12:24:58.321 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192768 len 2048 2024-04-20T12:24:58.321 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4192768 len 4096 2024-04-20T12:24:59.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:24:58 smithi154 ceph-mon[22073]: pgmap v58: 129 pgs: 129 active+clean; 238 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 777 KiB/s wr, 910 op/s 2024-04-20T12:24:59.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:24:58 smithi139 ceph-mon[21834]: pgmap v58: 129 pgs: 129 active+clean; 238 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 777 KiB/s wr, 910 op/s 2024-04-20T12:24:59.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:24:58 smithi135 ceph-mon[18264]: pgmap v58: 129 pgs: 129 active+clean; 238 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 23 MiB/s rd, 777 KiB/s wr, 910 op/s 2024-04-20T12:24:59.202 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-04-20T12:24:59.202 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4192768 len 4096 2024-04-20T12:24:59.202 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192768 len 4096 2024-04-20T12:24:59.203 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4192768 len 8192 2024-04-20T12:24:59.203 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-04-20T12:24:59.203 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4192768 len 8192 2024-04-20T12:24:59.203 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192768 len 8192 2024-04-20T12:24:59.203 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4192768 len 16384 2024-04-20T12:24:59.203 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-04-20T12:24:59.203 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4192768 len 16384 2024-04-20T12:24:59.203 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4192768 len 16384 2024-04-20T12:24:59.203 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4193280 len 1024 2024-04-20T12:24:59.203 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-04-20T12:24:59.203 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4193280 len 1024 2024-04-20T12:24:59.203 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193280 len 1024 2024-04-20T12:24:59.203 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4193280 len 2048 2024-04-20T12:24:59.203 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-04-20T12:24:59.204 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4193280 len 2048 2024-04-20T12:24:59.204 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193280 len 2048 2024-04-20T12:24:59.204 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4193280 len 4096 2024-04-20T12:24:59.204 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-04-20T12:24:59.204 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4193280 len 4096 2024-04-20T12:24:59.204 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193280 len 4096 2024-04-20T12:24:59.204 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4193280 len 8192 2024-04-20T12:24:59.204 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-04-20T12:24:59.204 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4193280 len 8192 2024-04-20T12:24:59.204 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193280 len 8192 2024-04-20T12:24:59.204 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4193280 len 16384 2024-04-20T12:24:59.204 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-04-20T12:24:59.204 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4193280 len 16384 2024-04-20T12:24:59.204 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193280 len 16384 2024-04-20T12:24:59.205 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4193792 len 1024 2024-04-20T12:24:59.205 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-04-20T12:24:59.205 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4193792 len 1024 2024-04-20T12:24:59.205 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193792 len 1024 2024-04-20T12:24:59.205 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4193792 len 2048 2024-04-20T12:24:59.205 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-04-20T12:24:59.205 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4193792 len 2048 2024-04-20T12:24:59.205 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193792 len 2048 2024-04-20T12:24:59.205 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4193792 len 4096 2024-04-20T12:24:59.205 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-04-20T12:24:59.205 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4193792 len 4096 2024-04-20T12:24:59.205 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193792 len 4096 2024-04-20T12:24:59.205 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4193792 len 8192 2024-04-20T12:24:59.205 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-04-20T12:24:59.205 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4193792 len 8192 2024-04-20T12:24:59.206 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193792 len 8192 2024-04-20T12:24:59.206 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4193792 len 16384 2024-04-20T12:24:59.206 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-04-20T12:24:59.206 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4193792 len 16384 2024-04-20T12:24:59.206 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4193792 len 16384 2024-04-20T12:24:59.206 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4194304 len 1024 2024-04-20T12:24:59.206 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-04-20T12:24:59.206 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4194304 len 1024 2024-04-20T12:24:59.206 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194304 len 1024 2024-04-20T12:24:59.206 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4194304 len 2048 2024-04-20T12:24:59.206 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-04-20T12:24:59.206 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4194304 len 2048 2024-04-20T12:24:59.206 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194304 len 2048 2024-04-20T12:24:59.206 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4194304 len 4096 2024-04-20T12:24:59.206 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4194304 len 4096 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194304 len 4096 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4194304 len 8192 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4194304 len 8192 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194304 len 8192 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4194304 len 16384 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4194304 len 16384 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194304 len 16384 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4194816 len 1024 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4194816 len 1024 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194816 len 1024 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4194816 len 2048 2024-04-20T12:24:59.207 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-04-20T12:24:59.208 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4194816 len 2048 2024-04-20T12:24:59.208 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194816 len 2048 2024-04-20T12:24:59.208 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4194816 len 4096 2024-04-20T12:24:59.208 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-04-20T12:24:59.654 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4194816 len 4096 2024-04-20T12:24:59.654 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194816 len 4096 2024-04-20T12:24:59.654 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4194816 len 8192 2024-04-20T12:24:59.654 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-04-20T12:24:59.654 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4194816 len 8192 2024-04-20T12:24:59.654 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194816 len 8192 2024-04-20T12:24:59.654 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4194816 len 16384 2024-04-20T12:24:59.654 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-04-20T12:24:59.654 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4194816 len 16384 2024-04-20T12:24:59.654 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4194816 len 16384 2024-04-20T12:24:59.654 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4195328 len 1024 2024-04-20T12:24:59.654 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-04-20T12:24:59.655 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4195328 len 1024 2024-04-20T12:24:59.655 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195328 len 1024 2024-04-20T12:24:59.655 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4195328 len 2048 2024-04-20T12:24:59.655 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-04-20T12:24:59.655 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4195328 len 2048 2024-04-20T12:24:59.655 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195328 len 2048 2024-04-20T12:24:59.655 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4195328 len 4096 2024-04-20T12:24:59.655 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-04-20T12:24:59.655 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4195328 len 4096 2024-04-20T12:24:59.655 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195328 len 4096 2024-04-20T12:24:59.655 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4195328 len 8192 2024-04-20T12:24:59.655 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-04-20T12:24:59.655 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4195328 len 8192 2024-04-20T12:24:59.655 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195328 len 8192 2024-04-20T12:24:59.655 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4195328 len 16384 2024-04-20T12:24:59.656 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-04-20T12:24:59.656 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4195328 len 16384 2024-04-20T12:24:59.656 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195328 len 16384 2024-04-20T12:24:59.656 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4195840 len 1024 2024-04-20T12:24:59.656 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-04-20T12:24:59.656 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4195840 len 1024 2024-04-20T12:24:59.656 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195840 len 1024 2024-04-20T12:24:59.656 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4195840 len 2048 2024-04-20T12:24:59.656 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-04-20T12:24:59.656 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4195840 len 2048 2024-04-20T12:24:59.656 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195840 len 2048 2024-04-20T12:24:59.656 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4195840 len 4096 2024-04-20T12:24:59.656 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-04-20T12:24:59.656 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4195840 len 4096 2024-04-20T12:24:59.656 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195840 len 4096 2024-04-20T12:24:59.657 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4195840 len 8192 2024-04-20T12:24:59.657 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-04-20T12:24:59.657 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4195840 len 8192 2024-04-20T12:24:59.657 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195840 len 8192 2024-04-20T12:24:59.657 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4195840 len 16384 2024-04-20T12:24:59.657 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-04-20T12:24:59.657 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4195840 len 16384 2024-04-20T12:24:59.657 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4195840 len 16384 2024-04-20T12:24:59.657 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4196352 len 1024 2024-04-20T12:24:59.657 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-04-20T12:24:59.657 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4196352 len 1024 2024-04-20T12:24:59.657 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196352 len 1024 2024-04-20T12:24:59.657 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4196352 len 2048 2024-04-20T12:24:59.657 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-04-20T12:24:59.657 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4196352 len 2048 2024-04-20T12:24:59.658 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196352 len 2048 2024-04-20T12:24:59.658 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4196352 len 4096 2024-04-20T12:24:59.658 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-04-20T12:24:59.658 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4196352 len 4096 2024-04-20T12:24:59.658 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196352 len 4096 2024-04-20T12:24:59.658 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4196352 len 8192 2024-04-20T12:24:59.658 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-04-20T12:24:59.658 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4196352 len 8192 2024-04-20T12:24:59.658 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196352 len 8192 2024-04-20T12:24:59.658 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4196352 len 16384 2024-04-20T12:24:59.658 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-04-20T12:24:59.658 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4196352 len 16384 2024-04-20T12:24:59.658 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196352 len 16384 2024-04-20T12:24:59.658 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4196864 len 1024 2024-04-20T12:24:59.658 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-04-20T12:24:59.659 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4196864 len 1024 2024-04-20T12:24:59.659 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196864 len 1024 2024-04-20T12:24:59.659 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4196864 len 2048 2024-04-20T12:24:59.659 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-04-20T12:24:59.659 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4196864 len 2048 2024-04-20T12:24:59.659 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196864 len 2048 2024-04-20T12:24:59.659 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4196864 len 4096 2024-04-20T12:24:59.659 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-04-20T12:24:59.659 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4196864 len 4096 2024-04-20T12:25:00.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196864 len 4096 2024-04-20T12:25:00.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4196864 len 8192 2024-04-20T12:25:00.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-04-20T12:25:00.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4196864 len 8192 2024-04-20T12:25:00.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196864 len 8192 2024-04-20T12:25:00.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4196864 len 16384 2024-04-20T12:25:00.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-04-20T12:25:00.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4196864 len 16384 2024-04-20T12:25:00.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4196864 len 16384 2024-04-20T12:25:00.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4197376 len 1024 2024-04-20T12:25:00.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-04-20T12:25:00.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4197376 len 1024 2024-04-20T12:25:00.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197376 len 1024 2024-04-20T12:25:00.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4197376 len 2048 2024-04-20T12:25:00.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-04-20T12:25:00.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4197376 len 2048 2024-04-20T12:25:00.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197376 len 2048 2024-04-20T12:25:00.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4197376 len 4096 2024-04-20T12:25:00.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-04-20T12:25:00.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4197376 len 4096 2024-04-20T12:25:00.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197376 len 4096 2024-04-20T12:25:00.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4197376 len 8192 2024-04-20T12:25:00.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-04-20T12:25:00.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4197376 len 8192 2024-04-20T12:25:00.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197376 len 8192 2024-04-20T12:25:00.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4197376 len 16384 2024-04-20T12:25:00.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-04-20T12:25:00.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4197376 len 16384 2024-04-20T12:25:00.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197376 len 16384 2024-04-20T12:25:00.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4197888 len 1024 2024-04-20T12:25:00.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-04-20T12:25:00.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4197888 len 1024 2024-04-20T12:25:00.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197888 len 1024 2024-04-20T12:25:00.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4197888 len 2048 2024-04-20T12:25:00.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-04-20T12:25:00.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4197888 len 2048 2024-04-20T12:25:00.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197888 len 2048 2024-04-20T12:25:00.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4197888 len 4096 2024-04-20T12:25:00.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-04-20T12:25:00.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4197888 len 4096 2024-04-20T12:25:00.336 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197888 len 4096 2024-04-20T12:25:00.336 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4197888 len 8192 2024-04-20T12:25:00.336 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-04-20T12:25:00.336 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4197888 len 8192 2024-04-20T12:25:00.336 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197888 len 8192 2024-04-20T12:25:00.336 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1024 offset 4197888 len 16384 2024-04-20T12:25:00.336 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-04-20T12:25:00.336 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1024 offset 4197888 len 16384 2024-04-20T12:25:00.336 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1024 offset 4197888 len 16384 2024-04-20T12:25:00.336 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4190720 len 1024 2024-04-20T12:25:00.336 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-04-20T12:25:00.336 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4190720 len 1024 2024-04-20T12:25:00.336 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4190720 len 1024 2024-04-20T12:25:00.337 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4190720 len 2048 2024-04-20T12:25:00.337 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-04-20T12:25:00.337 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4190720 len 2048 2024-04-20T12:25:00.337 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4190720 len 2048 2024-04-20T12:25:00.337 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4190720 len 4096 2024-04-20T12:25:00.337 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-04-20T12:25:00.337 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4190720 len 4096 2024-04-20T12:25:00.337 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4190720 len 4096 2024-04-20T12:25:00.337 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4190720 len 8192 2024-04-20T12:25:00.337 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-04-20T12:25:00.337 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4190720 len 8192 2024-04-20T12:25:00.337 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4190720 len 8192 2024-04-20T12:25:00.337 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4190720 len 16384 2024-04-20T12:25:00.337 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-04-20T12:25:00.337 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4190720 len 16384 2024-04-20T12:25:00.338 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4190720 len 16384 2024-04-20T12:25:00.338 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4191232 len 1024 2024-04-20T12:25:00.338 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-04-20T12:25:00.338 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4191232 len 1024 2024-04-20T12:25:00.338 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191232 len 1024 2024-04-20T12:25:00.338 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4191232 len 2048 2024-04-20T12:25:00.338 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-04-20T12:25:00.338 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4191232 len 2048 2024-04-20T12:25:00.338 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191232 len 2048 2024-04-20T12:25:00.338 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4191232 len 4096 2024-04-20T12:25:00.338 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-04-20T12:25:00.338 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4191232 len 4096 2024-04-20T12:25:00.338 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191232 len 4096 2024-04-20T12:25:01.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:00 smithi154 ceph-mon[22073]: pgmap v59: 129 pgs: 129 active+clean; 262 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 1.2 MiB/s wr, 1.05k op/s 2024-04-20T12:25:01.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:00 smithi139 ceph-mon[21834]: pgmap v59: 129 pgs: 129 active+clean; 262 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 1.2 MiB/s wr, 1.05k op/s 2024-04-20T12:25:01.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:00 smithi135 ceph-mon[18264]: pgmap v59: 129 pgs: 129 active+clean; 262 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 63 MiB/s rd, 1.2 MiB/s wr, 1.05k op/s 2024-04-20T12:25:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4191232 len 8192 2024-04-20T12:25:01.451 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-04-20T12:25:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4191232 len 8192 2024-04-20T12:25:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191232 len 8192 2024-04-20T12:25:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4191232 len 16384 2024-04-20T12:25:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-04-20T12:25:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4191232 len 16384 2024-04-20T12:25:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191232 len 16384 2024-04-20T12:25:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4191744 len 1024 2024-04-20T12:25:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-04-20T12:25:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4191744 len 1024 2024-04-20T12:25:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191744 len 1024 2024-04-20T12:25:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4191744 len 2048 2024-04-20T12:25:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-04-20T12:25:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4191744 len 2048 2024-04-20T12:25:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191744 len 2048 2024-04-20T12:25:01.452 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4191744 len 4096 2024-04-20T12:25:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-04-20T12:25:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4191744 len 4096 2024-04-20T12:25:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191744 len 4096 2024-04-20T12:25:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4191744 len 8192 2024-04-20T12:25:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-04-20T12:25:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4191744 len 8192 2024-04-20T12:25:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191744 len 8192 2024-04-20T12:25:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4191744 len 16384 2024-04-20T12:25:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-04-20T12:25:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4191744 len 16384 2024-04-20T12:25:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4191744 len 16384 2024-04-20T12:25:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4192256 len 1024 2024-04-20T12:25:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-04-20T12:25:01.453 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4192256 len 1024 2024-04-20T12:25:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192256 len 1024 2024-04-20T12:25:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4192256 len 2048 2024-04-20T12:25:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-04-20T12:25:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4192256 len 2048 2024-04-20T12:25:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192256 len 2048 2024-04-20T12:25:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4192256 len 4096 2024-04-20T12:25:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-04-20T12:25:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4192256 len 4096 2024-04-20T12:25:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192256 len 4096 2024-04-20T12:25:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4192256 len 8192 2024-04-20T12:25:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-04-20T12:25:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4192256 len 8192 2024-04-20T12:25:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192256 len 8192 2024-04-20T12:25:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4192256 len 16384 2024-04-20T12:25:01.454 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4192256 len 16384 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192256 len 16384 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4192768 len 1024 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4192768 len 1024 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192768 len 1024 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4192768 len 2048 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4192768 len 2048 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192768 len 2048 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4192768 len 4096 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4192768 len 4096 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192768 len 4096 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4192768 len 8192 2024-04-20T12:25:01.455 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-04-20T12:25:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4192768 len 8192 2024-04-20T12:25:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192768 len 8192 2024-04-20T12:25:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4192768 len 16384 2024-04-20T12:25:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-04-20T12:25:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4192768 len 16384 2024-04-20T12:25:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4192768 len 16384 2024-04-20T12:25:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4193280 len 1024 2024-04-20T12:25:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-04-20T12:25:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4193280 len 1024 2024-04-20T12:25:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193280 len 1024 2024-04-20T12:25:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4193280 len 2048 2024-04-20T12:25:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-04-20T12:25:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4193280 len 2048 2024-04-20T12:25:01.456 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193280 len 2048 2024-04-20T12:25:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4193280 len 4096 2024-04-20T12:25:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-04-20T12:25:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4193280 len 4096 2024-04-20T12:25:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193280 len 4096 2024-04-20T12:25:01.457 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4193280 len 8192 2024-04-20T12:25:01.739 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.736+0000 7f9c7e315640 1 -- 172.21.15.135:0/2766476917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c781072b0 msgr2=0x7f9c7810ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:01.739 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.736+0000 7f9c7e315640 1 --2- 172.21.15.135:0/2766476917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c781072b0 0x7f9c7810ee80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9c70009ca0 tx=0x7f9c7002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.739 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.736+0000 7f9c7e315640 1 -- 172.21.15.135:0/2766476917 shutdown_connections 2024-04-20T12:25:01.739 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.736+0000 7f9c7e315640 1 --2- 172.21.15.135:0/2766476917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c781072b0 0x7f9c7810ee80 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.739 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.736+0000 7f9c7e315640 1 --2- 172.21.15.135:0/2766476917 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c78102b90 0x7f9c78106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.739 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.736+0000 7f9c7e315640 1 --2- 172.21.15.135:0/2766476917 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c781021e0 0x7f9c781025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.736+0000 7f9c7e315640 1 -- 172.21.15.135:0/2766476917 >> 172.21.15.135:0/2766476917 conn(0x7f9c780793f0 msgr2=0x7f9c78079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.736+0000 7f9c7e315640 1 -- 172.21.15.135:0/2766476917 shutdown_connections 2024-04-20T12:25:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.736+0000 7f9c7e315640 1 -- 172.21.15.135:0/2766476917 wait complete. 2024-04-20T12:25:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.737+0000 7f9c7e315640 1 Processor -- start 2024-04-20T12:25:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.737+0000 7f9c7e315640 1 -- start start 2024-04-20T12:25:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.737+0000 7f9c7e315640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c781021e0 0x7f9c7819e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.737+0000 7f9c7e315640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c781072b0 0x7f9c7819e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.737+0000 7f9c7e315640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c78198600 0x7f9c78198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.737+0000 7f9c7e315640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c781123e0 con 0x7f9c78198600 2024-04-20T12:25:01.740 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.737+0000 7f9c7e315640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9c78112260 con 0x7f9c781072b0 2024-04-20T12:25:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.737+0000 7f9c7e315640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c78112560 con 0x7f9c781021e0 2024-04-20T12:25:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.737+0000 7f9c7c8b2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c78198600 0x7f9c78198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.737+0000 7f9c7c8b2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c78198600 0x7f9c78198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38482/0 (socket says 172.21.15.135:38482) 2024-04-20T12:25:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.738+0000 7f9c7c8b2640 1 -- 172.21.15.135:0/4039046010 learned_addr learned my addr 172.21.15.135:0/4039046010 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.738+0000 7f9c77fff640 1 --2- 172.21.15.135:0/4039046010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c781021e0 0x7f9c7819e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.738+0000 7f9c777fe640 1 --2- 172.21.15.135:0/4039046010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c781072b0 0x7f9c7819e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.738+0000 7f9c7c8b2640 1 -- 172.21.15.135:0/4039046010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c781021e0 msgr2=0x7f9c7819e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.738+0000 7f9c7c8b2640 1 --2- 172.21.15.135:0/4039046010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c781021e0 0x7f9c7819e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.741 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.738+0000 7f9c7c8b2640 1 -- 172.21.15.135:0/4039046010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c781072b0 msgr2=0x7f9c7819e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:01.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.738+0000 7f9c7c8b2640 1 --2- 172.21.15.135:0/4039046010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c781072b0 0x7f9c7819e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.738+0000 7f9c7c8b2640 1 -- 172.21.15.135:0/4039046010 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c78199120 con 0x7f9c78198600 2024-04-20T12:25:01.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.738+0000 7f9c7c8b2640 1 --2- 172.21.15.135:0/4039046010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c78198600 0x7f9c78198ab0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9c7002c700 tx=0x7f9c70032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:01.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.738+0000 7f9c757fa640 1 -- 172.21.15.135:0/4039046010 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c70041020 con 0x7f9c78198600 2024-04-20T12:25:01.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.738+0000 7f9c757fa640 1 -- 172.21.15.135:0/4039046010 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c70034cd0 con 0x7f9c78198600 2024-04-20T12:25:01.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.738+0000 7f9c757fa640 1 -- 172.21.15.135:0/4039046010 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c70039040 con 0x7f9c78198600 2024-04-20T12:25:01.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.738+0000 7f9c7e315640 1 -- 172.21.15.135:0/4039046010 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c781993b0 con 0x7f9c78198600 2024-04-20T12:25:01.742 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.738+0000 7f9c7e315640 1 -- 172.21.15.135:0/4039046010 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c781a55a0 con 0x7f9c78198600 2024-04-20T12:25:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.741+0000 7f9c757fa640 1 -- 172.21.15.135:0/4039046010 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f9c70044020 con 0x7f9c78198600 2024-04-20T12:25:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.741+0000 7f9c80fe3740 1 Processor -- start 2024-04-20T12:25:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.741+0000 7f9c80fe3740 1 -- start start 2024-04-20T12:25:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c80fe3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583d110 0x55775583d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c80fe3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583da30 0x5577558462c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c80fe3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557755846800 0x557755848bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c80fe3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5577557a2820 con 0x55775583d110 2024-04-20T12:25:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c80fe3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55775573ffc0 con 0x557755846800 2024-04-20T12:25:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c80fe3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55775579e7e0 con 0x55775583da30 2024-04-20T12:25:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c77fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583da30 0x5577558462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c777fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583d110 0x55775583d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.750 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c757fa640 1 --2- 172.21.15.135:0/4039046010 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9c600a3dc0 0x7f9c600a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c77fff640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583da30 0x5577558462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.135:55968/0 (socket says 172.21.15.135:55968) 2024-04-20T12:25:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c77fff640 1 -- 172.21.15.135:0/1880032276 learned_addr learned my addr 172.21.15.135:0/1880032276 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c777fe640 1 --2- 172.21.15.135:0/1880032276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557755846800 0x557755848bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c77fff640 1 -- 172.21.15.135:0/1880032276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557755846800 msgr2=0x557755848bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c77fff640 1 --2- 172.21.15.135:0/1880032276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557755846800 0x557755848bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c7c8b2640 1 --2- 172.21.15.135:0/4039046010 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9c600a3dc0 0x7f9c600a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c757fa640 1 -- 172.21.15.135:0/4039046010 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9c700f26e0 con 0x7f9c78198600 2024-04-20T12:25:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c77fff640 1 -- 172.21.15.135:0/1880032276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583d110 msgr2=0x55775583d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c77fff640 1 --2- 172.21.15.135:0/1880032276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583d110 0x55775583d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c77fff640 1 -- 172.21.15.135:0/1880032276 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577554b5210 con 0x55775583da30 2024-04-20T12:25:01.751 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.742+0000 7f9c777fe640 1 --2- 172.21.15.135:0/1880032276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583d110 0x55775583d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:25:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.743+0000 7f9c77fff640 1 --2- 172.21.15.135:0/1880032276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583da30 0x5577558462c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009a70 tx=0x7f9c68009f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4997581d37d7a177 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.743+0000 7f9c7c8b2640 1 --2- 172.21.15.135:0/4039046010 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9c600a3dc0 0x7f9c600a6280 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9c700efc70 tx=0x7f9c7004d000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.743+0000 7f9c5e7fc640 1 -- 172.21.15.135:0/1880032276 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68017070 con 0x55775583da30 2024-04-20T12:25:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.743+0000 7f9c5e7fc640 1 -- 172.21.15.135:0/1880032276 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c68013470 con 0x55775583da30 2024-04-20T12:25:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.743+0000 7f9c5e7fc640 1 -- 172.21.15.135:0/1880032276 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c680125f0 con 0x55775583da30 2024-04-20T12:25:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.743+0000 7f9c80fe3740 1 -- 172.21.15.135:0/1880032276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583da30 msgr2=0x5577558462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.743+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/1880032276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583da30 0x5577558462c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c68009a70 tx=0x7f9c68009f30 comp rx=0 tx=0).stop 2024-04-20T12:25:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.743+0000 7f9c80fe3740 1 -- 172.21.15.135:0/1880032276 shutdown_connections 2024-04-20T12:25:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.743+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/1880032276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557755846800 0x557755848bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.743+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/1880032276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583da30 0x5577558462c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.743+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/1880032276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583d110 0x55775583d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.743+0000 7f9c80fe3740 1 -- 172.21.15.135:0/1880032276 >> 172.21.15.135:0/1880032276 conn(0x557755837a30 msgr2=0x557755837e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.743+0000 7f9c80fe3740 1 -- 172.21.15.135:0/1880032276 shutdown_connections 2024-04-20T12:25:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.744+0000 7f9c80fe3740 1 -- 172.21.15.135:0/1880032276 wait complete. 2024-04-20T12:25:01.752 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.744+0000 7f9c80fe3740 1 -- start start 2024-04-20T12:25:01.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.744+0000 7f9c80fe3740 1 Processor -- start 2024-04-20T12:25:01.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.744+0000 7f9c80fe3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583d110 0x557755850840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.744+0000 7f9c80fe3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583da30 0x557755850d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.744+0000 7f9c80fe3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557755846800 0x55775584ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.744+0000 7f9c80fe3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557755849430 con 0x55775583da30 2024-04-20T12:25:01.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.744+0000 7f9c80fe3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55775572aee0 con 0x557755846800 2024-04-20T12:25:01.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.744+0000 7f9c80fe3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5577558495b0 con 0x55775583d110 2024-04-20T12:25:01.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.744+0000 7f9c80fe3740 10 client.0 _ll_register_callbacks cb 0x557755740d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:01.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.744+0000 7f9c77fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583da30 0x557755850d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.744+0000 7f9c77fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583da30 0x557755850d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38502/0 (socket says 172.21.15.135:38502) 2024-04-20T12:25:01.753 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.744+0000 7f9c77fff640 1 -- 172.21.15.135:0/3722940852 learned_addr learned my addr 172.21.15.135:0/3722940852 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.745+0000 7f9c777fe640 1 --2- 172.21.15.135:0/3722940852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557755846800 0x55775584ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.745+0000 7f9c77fff640 1 -- 172.21.15.135:0/3722940852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583d110 msgr2=0x557755850840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.745+0000 7f9c77fff640 1 --2- 172.21.15.135:0/3722940852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583d110 0x557755850840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.745+0000 7f9c77fff640 1 -- 172.21.15.135:0/3722940852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557755846800 msgr2=0x55775584ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.745+0000 7f9c77fff640 1 --2- 172.21.15.135:0/3722940852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557755846800 0x55775584ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.745+0000 7f9c77fff640 1 -- 172.21.15.135:0/3722940852 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557755581620 con 0x55775583da30 2024-04-20T12:25:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.745+0000 7f9c77fff640 1 --2- 172.21.15.135:0/3722940852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583da30 0x557755850d80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9c68013c70 tx=0x7f9c6800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2e379029cf3bb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.745+0000 7f9c577fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.745+0000 7f9c577fe640 1 -- 172.21.15.135:0/3722940852 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68017040 con 0x55775583da30 2024-04-20T12:25:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.745+0000 7f9c577fe640 1 -- 172.21.15.135:0/3722940852 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9c6801c450 con 0x55775583da30 2024-04-20T12:25:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.745+0000 7f9c80fe3740 1 -- 172.21.15.135:0/3722940852 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c68013470 con 0x55775583da30 2024-04-20T12:25:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.745+0000 7f9c577fe640 1 -- 172.21.15.135:0/3722940852 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9c6801c650 con 0x55775583da30 2024-04-20T12:25:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.745+0000 7f9c80fe3740 10 client.16401 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:01.754 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.745+0000 7f9c80fe3740 1 -- 172.21.15.135:0/3722940852 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557755859ac0 con 0x55775583da30 2024-04-20T12:25:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.745+0000 7f9c577fe640 1 -- 172.21.15.135:0/3722940852 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c68013470 con 0x55775583da30 2024-04-20T12:25:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.746+0000 7f9c577fe640 1 -- 172.21.15.135:0/3722940852 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f9c680268a0 con 0x55775583da30 2024-04-20T12:25:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.746+0000 7f9c80fe3740 10 client.16401 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.746+0000 7f9c80fe3740 10 client.16401 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.746+0000 7f9c80fe3740 20 client.16401 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.746+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/3722940852 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55775585ae70 0x55775585d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.746+0000 7f9c80fe3740 4 client.16401 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.746+0000 7f9c80fe3740 1 -- 172.21.15.135:0/3722940852 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577557b0240 con 0x55775585ae70 2024-04-20T12:25:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.746+0000 7f9c777fe640 1 --2- 172.21.15.135:0/3722940852 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55775585ae70 0x55775585d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.746+0000 7f9c577fe640 10 client.16401 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.746+0000 7f9c777fe640 1 --2- 172.21.15.135:0/3722940852 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55775585ae70 0x55775585d260 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20ce4fa58e655b4a server_cookie=b5668332e4c7cd01 in_seq=0 out_seq=0 2024-04-20T12:25:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.747+0000 7f9c577fe640 1 -- 172.21.15.135:0/3722940852 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5577557b0240 con 0x55775585ae70 2024-04-20T12:25:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.747+0000 7f9c577fe640 10 client.16401 handle_command_reply: tid=0 2024-04-20T12:25:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.747+0000 7f9c80fe3740 1 client.16401 shutdown 2024-04-20T12:25:01.755 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.747+0000 7f9c80fe3740 1 -- 172.21.15.135:0/3722940852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583da30 msgr2=0x557755850d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.747+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/3722940852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583da30 0x557755850d80 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9c68013c70 tx=0x7f9c6800ed50 comp rx=0 tx=0).stop 2024-04-20T12:25:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.747+0000 7f9c80fe3740 1 -- 172.21.15.135:0/3722940852 shutdown_connections 2024-04-20T12:25:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.747+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/3722940852 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55775585ae70 0x55775585d260 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.747+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/3722940852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557755846800 0x55775584ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.747+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/3722940852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583da30 0x557755850d80 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.747+0000 7f9c577fe640 0 client.16401 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.747+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/3722940852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583d110 0x557755850840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.747+0000 7f9c80fe3740 1 -- 172.21.15.135:0/3722940852 >> 172.21.15.135:0/3722940852 conn(0x557755837a30 msgr2=0x557755839780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.747+0000 7f9c80fe3740 1 -- 172.21.15.135:0/3722940852 shutdown_connections 2024-04-20T12:25:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.747+0000 7f9c80fe3740 1 -- 172.21.15.135:0/3722940852 wait complete. 2024-04-20T12:25:01.756 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.747+0000 7f9c80fe3740 20 client.16401 trim_cache size 0 max 16384 2024-04-20T12:25:01.764 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.763+0000 7f9c80fe3740 1 Processor -- start 2024-04-20T12:25:01.765 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.763+0000 7f9c80fe3740 1 -- start start 2024-04-20T12:25:01.765 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c80fe3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583d110 0x55775584abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.765 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c80fe3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55775583da30 0x557755862860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.765 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c80fe3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557755846800 0x557755862da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.765 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c80fe3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c781ad0f0 con 0x557755846800 2024-04-20T12:25:01.765 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c80fe3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9c781aec30 con 0x55775583da30 2024-04-20T12:25:01.765 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c80fe3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c781ad7c0 con 0x55775583d110 2024-04-20T12:25:01.765 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c777fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557755846800 0x557755862da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.765 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c777fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557755846800 0x557755862da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38508/0 (socket says 172.21.15.135:38508) 2024-04-20T12:25:01.766 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c777fe640 1 -- 172.21.15.135:0/1453530693 learned_addr learned my addr 172.21.15.135:0/1453530693 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:01.766 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c777fe640 1 --2- 172.21.15.135:0/1453530693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583d110 0x55775584abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.766 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c777fe640 1 -- 172.21.15.135:0/1453530693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583d110 msgr2=0x55775584abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:01.766 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c777fe640 1 --2- 172.21.15.135:0/1453530693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583d110 0x55775584abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.766 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c777fe640 1 -- 172.21.15.135:0/1453530693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55775583da30 msgr2=0x557755862860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-20T12:25:01.766 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c777fe640 1 --2- 172.21.15.135:0/1453530693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55775583da30 0x557755862860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.766 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c777fe640 1 -- 172.21.15.135:0/1453530693 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557755831f60 con 0x557755846800 2024-04-20T12:25:01.766 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c777fe640 1 --2- 172.21.15.135:0/1453530693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557755846800 0x557755862da0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009710 tx=0x7f9c6c009af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f2db5ce8755fab server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:01.766 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.764+0000 7f9c5dffb640 1 -- 172.21.15.135:0/1453530693 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c011070 con 0x557755846800 2024-04-20T12:25:01.766 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.765+0000 7f9c5dffb640 1 -- 172.21.15.135:0/1453530693 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c6c011210 con 0x557755846800 2024-04-20T12:25:01.766 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.765+0000 7f9c5dffb640 1 -- 172.21.15.135:0/1453530693 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c0047a0 con 0x557755846800 2024-04-20T12:25:01.769 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.765+0000 7f9c80fe3740 1 -- 172.21.15.135:0/1453530693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557755846800 msgr2=0x557755862da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.765+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/1453530693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557755846800 0x557755862da0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009710 tx=0x7f9c6c009af0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.765+0000 7f9c80fe3740 1 -- 172.21.15.135:0/1453530693 shutdown_connections 2024-04-20T12:25:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.765+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/1453530693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557755846800 0x557755862da0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.765+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/1453530693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55775583da30 0x557755862860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.765+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/1453530693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583d110 0x55775584abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.765+0000 7f9c80fe3740 1 -- 172.21.15.135:0/1453530693 >> 172.21.15.135:0/1453530693 conn(0x557755837a30 msgr2=0x55775584a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.766+0000 7f9c80fe3740 1 -- 172.21.15.135:0/1453530693 shutdown_connections 2024-04-20T12:25:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.766+0000 7f9c80fe3740 1 -- 172.21.15.135:0/1453530693 wait complete. 2024-04-20T12:25:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.766+0000 7f9c80fe3740 1 -- start start 2024-04-20T12:25:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.766+0000 7f9c80fe3740 1 Processor -- start 2024-04-20T12:25:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.766+0000 7f9c80fe3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583d110 0x5577558b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.766+0000 7f9c80fe3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583da30 0x5577558b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.766+0000 7f9c80fe3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557755846800 0x5577558540a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.770 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.766+0000 7f9c80fe3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c781ae560 con 0x55775583da30 2024-04-20T12:25:01.771 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.766+0000 7f9c80fe3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9c781ade90 con 0x557755846800 2024-04-20T12:25:01.771 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.766+0000 7f9c80fe3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c781ab0c0 con 0x55775583d110 2024-04-20T12:25:01.771 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.766+0000 7f9c80fe3740 10 client.0 _ll_register_callbacks cb 0x7f9c6c009a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:01.771 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c77fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583da30 0x5577558b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.771 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c77fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583da30 0x5577558b9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38516/0 (socket says 172.21.15.135:38516) 2024-04-20T12:25:01.771 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c77fff640 1 -- 172.21.15.135:0/2776645647 learned_addr learned my addr 172.21.15.135:0/2776645647 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:01.771 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c777fe640 1 --2- 172.21.15.135:0/2776645647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583d110 0x5577558b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.771 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c777fe640 1 --2- 172.21.15.135:0/2776645647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557755846800 0x5577558540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.771 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c777fe640 1 -- 172.21.15.135:0/2776645647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557755846800 msgr2=0x5577558540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c777fe640 1 --2- 172.21.15.135:0/2776645647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557755846800 0x5577558540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c777fe640 1 -- 172.21.15.135:0/2776645647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583da30 msgr2=0x5577558b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c777fe640 1 --2- 172.21.15.135:0/2776645647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583da30 0x5577558b9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c777fe640 1 -- 172.21.15.135:0/2776645647 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557755854790 con 0x55775583d110 2024-04-20T12:25:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c77fff640 1 --2- 172.21.15.135:0/2776645647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583da30 0x5577558b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:25:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c777fe640 1 --2- 172.21.15.135:0/2776645647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583d110 0x5577558b94d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0119d0 tx=0x7f9c6c0052f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fadbfe9316f6f26 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c577fe640 10 client.0 ms_handle_connect on v2:172.21.15.154:3300/0 2024-04-20T12:25:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c577fe640 1 -- 172.21.15.135:0/2776645647 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c00fe20 con 0x55775583d110 2024-04-20T12:25:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c577fe640 1 -- 172.21.15.135:0/2776645647 <== mon.1 v2:172.21.15.154:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9c6c009da0 con 0x55775583d110 2024-04-20T12:25:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.767+0000 7f9c80fe3740 1 -- 172.21.15.135:0/2776645647 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c6c011210 con 0x55775583d110 2024-04-20T12:25:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.768+0000 7f9c577fe640 1 -- 172.21.15.135:0/2776645647 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9c6c005490 con 0x55775583d110 2024-04-20T12:25:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.768+0000 7f9c80fe3740 10 client.25795 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.768+0000 7f9c80fe3740 1 -- 172.21.15.135:0/2776645647 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5577558c0c60 con 0x55775583d110 2024-04-20T12:25:01.772 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.768+0000 7f9c577fe640 1 -- 172.21.15.135:0/2776645647 <== mon.1 v2:172.21.15.154:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c6c005630 con 0x55775583d110 2024-04-20T12:25:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.768+0000 7f9c577fe640 1 -- 172.21.15.135:0/2776645647 <== mon.1 v2:172.21.15.154:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f9c6c0217a0 con 0x55775583d110 2024-04-20T12:25:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.768+0000 7f9c80fe3740 10 client.25795 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.768+0000 7f9c80fe3740 10 client.25795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.768+0000 7f9c80fe3740 20 client.25795 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.768+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/2776645647 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5577558c1260 0x5577558c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.768+0000 7f9c80fe3740 4 client.25795 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-20T12:25:01.773 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.768+0000 7f9c80fe3740 1 -- 172.21.15.135:0/2776645647 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f9c6c011210 con 0x5577558c1260 2024-04-20T12:25:01.774 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.768+0000 7f9c77fff640 1 --2- 172.21.15.135:0/2776645647 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5577558c1260 0x5577558c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:01.774 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.769+0000 7f9c577fe640 10 client.25795 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:01.774 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.769+0000 7f9c77fff640 1 --2- 172.21.15.135:0/2776645647 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5577558c1260 0x5577558c3650 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b64de4488e7350 server_cookie=8006ddee858f814f in_seq=0 out_seq=0 2024-04-20T12:25:01.801 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.801+0000 7f9c577fe640 1 -- 172.21.15.135:0/2776645647 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f9c6c011210 con 0x5577558c1260 2024-04-20T12:25:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.801+0000 7f9c577fe640 10 client.25795 handle_command_reply: tid=0 2024-04-20T12:25:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.801+0000 7f9c80fe3740 1 client.25795 shutdown 2024-04-20T12:25:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.801+0000 7f9c80fe3740 1 -- 172.21.15.135:0/2776645647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583d110 msgr2=0x5577558b94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.801+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/2776645647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583d110 0x5577558b94d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c0119d0 tx=0x7f9c6c0052f0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.801+0000 7f9c80fe3740 1 -- 172.21.15.135:0/2776645647 shutdown_connections 2024-04-20T12:25:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.801+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/2776645647 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5577558c1260 0x5577558c3650 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.801+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/2776645647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557755846800 0x5577558540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.802 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.801+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/2776645647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55775583da30 0x5577558b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.801+0000 7f9c80fe3740 1 --2- 172.21.15.135:0/2776645647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55775583d110 0x5577558b94d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.801+0000 7f9c577fe640 0 client.25795 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.801+0000 7f9c80fe3740 1 -- 172.21.15.135:0/2776645647 >> 172.21.15.135:0/2776645647 conn(0x557755837a30 msgr2=0x557755850390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.801+0000 7f9c80fe3740 1 -- 172.21.15.135:0/2776645647 shutdown_connections 2024-04-20T12:25:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.801+0000 7f9c80fe3740 1 -- 172.21.15.135:0/2776645647 wait complete. 2024-04-20T12:25:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.801+0000 7f9c80fe3740 20 client.25795 trim_cache size 0 max 16384 2024-04-20T12:25:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:{ 2024-04-20T12:25:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "message": "", 2024-04-20T12:25:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout: "return_code": 0 2024-04-20T12:25:01.803 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stdout:} 2024-04-20T12:25:01.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.802+0000 7f9c7e315640 1 -- 172.21.15.135:0/4039046010 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9c600a3dc0 msgr2=0x7f9c600a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:01.804 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.802+0000 7f9c7e315640 1 --2- 172.21.15.135:0/4039046010 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9c600a3dc0 0x7f9c600a6280 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9c700efc70 tx=0x7f9c7004d000 comp rx=0 tx=0).stop 2024-04-20T12:25:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.802+0000 7f9c7e315640 1 -- 172.21.15.135:0/4039046010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c78198600 msgr2=0x7f9c78198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.802+0000 7f9c7e315640 1 --2- 172.21.15.135:0/4039046010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c78198600 0x7f9c78198ab0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9c7002c700 tx=0x7f9c70032f20 comp rx=0 tx=0).stop 2024-04-20T12:25:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.802+0000 7f9c7e315640 1 -- 172.21.15.135:0/4039046010 shutdown_connections 2024-04-20T12:25:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.802+0000 7f9c7e315640 1 --2- 172.21.15.135:0/4039046010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c78198600 0x7f9c78198ab0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.802+0000 7f9c7e315640 1 --2- 172.21.15.135:0/4039046010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c781072b0 0x7f9c7819e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.802+0000 7f9c7e315640 1 --2- 172.21.15.135:0/4039046010 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9c600a3dc0 0x7f9c600a6280 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.802+0000 7f9c7e315640 1 --2- 172.21.15.135:0/4039046010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c781021e0 0x7f9c7819e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.802+0000 7f9c7e315640 1 -- 172.21.15.135:0/4039046010 >> 172.21.15.135:0/4039046010 conn(0x7f9c780793f0 msgr2=0x7f9c780ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.802+0000 7f9c7e315640 1 -- 172.21.15.135:0/4039046010 shutdown_connections 2024-04-20T12:25:01.805 INFO:teuthology.task.background_exec.ubuntu@smithi135.front.sepia.ceph.com.smithi135.stderr:2024-04-20T12:25:01.802+0000 7f9c7e315640 1 -- 172.21.15.135:0/4039046010 wait complete. 2024-04-20T12:25:02.107 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-04-20T12:25:02.108 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4193280 len 8192 2024-04-20T12:25:02.108 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193280 len 8192 2024-04-20T12:25:02.108 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4193280 len 16384 2024-04-20T12:25:02.108 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-04-20T12:25:02.108 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4193280 len 16384 2024-04-20T12:25:02.108 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193280 len 16384 2024-04-20T12:25:02.108 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4193792 len 1024 2024-04-20T12:25:02.108 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-04-20T12:25:02.108 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4193792 len 1024 2024-04-20T12:25:02.108 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193792 len 1024 2024-04-20T12:25:02.108 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4193792 len 2048 2024-04-20T12:25:02.108 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-04-20T12:25:02.109 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4193792 len 2048 2024-04-20T12:25:02.109 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193792 len 2048 2024-04-20T12:25:02.109 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4193792 len 4096 2024-04-20T12:25:02.109 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-04-20T12:25:02.109 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4193792 len 4096 2024-04-20T12:25:02.109 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193792 len 4096 2024-04-20T12:25:02.109 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4193792 len 8192 2024-04-20T12:25:02.109 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-04-20T12:25:02.109 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4193792 len 8192 2024-04-20T12:25:02.109 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193792 len 8192 2024-04-20T12:25:02.109 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4193792 len 16384 2024-04-20T12:25:02.109 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-04-20T12:25:02.109 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4193792 len 16384 2024-04-20T12:25:02.109 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4193792 len 16384 2024-04-20T12:25:02.109 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4194304 len 1024 2024-04-20T12:25:02.110 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-04-20T12:25:02.110 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4194304 len 1024 2024-04-20T12:25:02.110 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194304 len 1024 2024-04-20T12:25:02.110 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4194304 len 2048 2024-04-20T12:25:02.110 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-04-20T12:25:02.110 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4194304 len 2048 2024-04-20T12:25:02.110 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194304 len 2048 2024-04-20T12:25:02.110 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4194304 len 4096 2024-04-20T12:25:02.110 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-04-20T12:25:02.110 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4194304 len 4096 2024-04-20T12:25:02.110 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194304 len 4096 2024-04-20T12:25:02.110 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4194304 len 8192 2024-04-20T12:25:02.110 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-04-20T12:25:02.110 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4194304 len 8192 2024-04-20T12:25:02.110 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194304 len 8192 2024-04-20T12:25:02.111 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4194304 len 16384 2024-04-20T12:25:02.111 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-04-20T12:25:02.111 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4194304 len 16384 2024-04-20T12:25:02.111 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194304 len 16384 2024-04-20T12:25:02.111 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4194816 len 1024 2024-04-20T12:25:02.111 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-04-20T12:25:02.111 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4194816 len 1024 2024-04-20T12:25:02.111 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194816 len 1024 2024-04-20T12:25:02.111 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4194816 len 2048 2024-04-20T12:25:02.111 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-04-20T12:25:02.111 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4194816 len 2048 2024-04-20T12:25:02.111 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194816 len 2048 2024-04-20T12:25:02.111 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4194816 len 4096 2024-04-20T12:25:02.111 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-04-20T12:25:02.112 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4194816 len 4096 2024-04-20T12:25:02.112 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194816 len 4096 2024-04-20T12:25:02.112 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4194816 len 8192 2024-04-20T12:25:02.112 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-04-20T12:25:02.112 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4194816 len 8192 2024-04-20T12:25:02.112 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194816 len 8192 2024-04-20T12:25:02.112 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4194816 len 16384 2024-04-20T12:25:02.112 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-04-20T12:25:02.112 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4194816 len 16384 2024-04-20T12:25:02.112 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4194816 len 16384 2024-04-20T12:25:02.112 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4195328 len 1024 2024-04-20T12:25:02.113 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-04-20T12:25:02.113 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4195328 len 1024 2024-04-20T12:25:02.113 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195328 len 1024 2024-04-20T12:25:02.113 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4195328 len 2048 2024-04-20T12:25:02.113 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-04-20T12:25:02.113 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4195328 len 2048 2024-04-20T12:25:02.113 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195328 len 2048 2024-04-20T12:25:02.113 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4195328 len 4096 2024-04-20T12:25:02.113 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-04-20T12:25:02.113 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4195328 len 4096 2024-04-20T12:25:02.113 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195328 len 4096 2024-04-20T12:25:02.113 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4195328 len 8192 2024-04-20T12:25:02.532 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-04-20T12:25:02.532 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4195328 len 8192 2024-04-20T12:25:02.532 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195328 len 8192 2024-04-20T12:25:02.532 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4195328 len 16384 2024-04-20T12:25:02.532 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-04-20T12:25:02.532 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4195328 len 16384 2024-04-20T12:25:02.532 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195328 len 16384 2024-04-20T12:25:02.532 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4195840 len 1024 2024-04-20T12:25:02.533 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-04-20T12:25:02.533 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4195840 len 1024 2024-04-20T12:25:02.533 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195840 len 1024 2024-04-20T12:25:02.533 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4195840 len 2048 2024-04-20T12:25:02.533 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-04-20T12:25:02.533 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4195840 len 2048 2024-04-20T12:25:02.533 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195840 len 2048 2024-04-20T12:25:02.533 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4195840 len 4096 2024-04-20T12:25:02.533 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-04-20T12:25:02.533 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4195840 len 4096 2024-04-20T12:25:02.533 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195840 len 4096 2024-04-20T12:25:02.533 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4195840 len 8192 2024-04-20T12:25:02.534 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-04-20T12:25:02.534 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4195840 len 8192 2024-04-20T12:25:02.534 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195840 len 8192 2024-04-20T12:25:02.534 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4195840 len 16384 2024-04-20T12:25:02.534 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-04-20T12:25:02.534 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4195840 len 16384 2024-04-20T12:25:02.534 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4195840 len 16384 2024-04-20T12:25:02.534 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4196352 len 1024 2024-04-20T12:25:02.534 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-04-20T12:25:02.534 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4196352 len 1024 2024-04-20T12:25:02.534 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196352 len 1024 2024-04-20T12:25:02.534 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4196352 len 2048 2024-04-20T12:25:02.535 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-04-20T12:25:02.535 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4196352 len 2048 2024-04-20T12:25:02.535 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196352 len 2048 2024-04-20T12:25:02.535 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4196352 len 4096 2024-04-20T12:25:02.535 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-04-20T12:25:02.535 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4196352 len 4096 2024-04-20T12:25:02.535 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196352 len 4096 2024-04-20T12:25:02.535 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4196352 len 8192 2024-04-20T12:25:02.535 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-04-20T12:25:02.535 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4196352 len 8192 2024-04-20T12:25:02.535 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196352 len 8192 2024-04-20T12:25:02.536 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4196352 len 16384 2024-04-20T12:25:02.536 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-04-20T12:25:02.536 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4196352 len 16384 2024-04-20T12:25:02.536 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196352 len 16384 2024-04-20T12:25:02.536 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4196864 len 1024 2024-04-20T12:25:02.536 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-04-20T12:25:02.536 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4196864 len 1024 2024-04-20T12:25:02.536 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196864 len 1024 2024-04-20T12:25:02.536 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4196864 len 2048 2024-04-20T12:25:02.536 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-04-20T12:25:02.536 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4196864 len 2048 2024-04-20T12:25:02.536 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196864 len 2048 2024-04-20T12:25:02.537 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4196864 len 4096 2024-04-20T12:25:02.537 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-04-20T12:25:02.537 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4196864 len 4096 2024-04-20T12:25:02.537 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196864 len 4096 2024-04-20T12:25:02.537 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4196864 len 8192 2024-04-20T12:25:02.537 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-04-20T12:25:02.537 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4196864 len 8192 2024-04-20T12:25:02.537 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196864 len 8192 2024-04-20T12:25:02.537 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4196864 len 16384 2024-04-20T12:25:02.537 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-04-20T12:25:02.537 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4196864 len 16384 2024-04-20T12:25:02.537 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4196864 len 16384 2024-04-20T12:25:02.538 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4197376 len 1024 2024-04-20T12:25:02.538 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-04-20T12:25:02.538 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4197376 len 1024 2024-04-20T12:25:02.538 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197376 len 1024 2024-04-20T12:25:02.538 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4197376 len 2048 2024-04-20T12:25:02.538 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-04-20T12:25:02.538 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4197376 len 2048 2024-04-20T12:25:02.538 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197376 len 2048 2024-04-20T12:25:02.538 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4197376 len 4096 2024-04-20T12:25:02.538 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-04-20T12:25:02.538 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4197376 len 4096 2024-04-20T12:25:02.538 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197376 len 4096 2024-04-20T12:25:02.539 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4197376 len 8192 2024-04-20T12:25:02.539 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-04-20T12:25:03.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:02 smithi154 ceph-mon[22073]: pgmap v60: 129 pgs: 129 active+clean; 262 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 60 MiB/s rd, 1.2 MiB/s wr, 424 op/s 2024-04-20T12:25:03.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:02 smithi139 ceph-mon[21834]: pgmap v60: 129 pgs: 129 active+clean; 262 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 60 MiB/s rd, 1.2 MiB/s wr, 424 op/s 2024-04-20T12:25:03.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:02 smithi135 ceph-mon[18264]: pgmap v60: 129 pgs: 129 active+clean; 262 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 60 MiB/s rd, 1.2 MiB/s wr, 424 op/s 2024-04-20T12:25:03.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4197376 len 8192 2024-04-20T12:25:03.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197376 len 8192 2024-04-20T12:25:03.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4197376 len 16384 2024-04-20T12:25:03.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-04-20T12:25:03.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4197376 len 16384 2024-04-20T12:25:03.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197376 len 16384 2024-04-20T12:25:03.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4197888 len 1024 2024-04-20T12:25:03.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-04-20T12:25:03.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4197888 len 1024 2024-04-20T12:25:03.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197888 len 1024 2024-04-20T12:25:03.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4197888 len 2048 2024-04-20T12:25:03.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-04-20T12:25:03.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4197888 len 2048 2024-04-20T12:25:03.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197888 len 2048 2024-04-20T12:25:03.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4197888 len 4096 2024-04-20T12:25:03.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-04-20T12:25:03.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4197888 len 4096 2024-04-20T12:25:03.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197888 len 4096 2024-04-20T12:25:03.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4197888 len 8192 2024-04-20T12:25:03.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-04-20T12:25:03.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4197888 len 8192 2024-04-20T12:25:03.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197888 len 8192 2024-04-20T12:25:03.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 1536 offset 4197888 len 16384 2024-04-20T12:25:03.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-04-20T12:25:03.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 1536 offset 4197888 len 16384 2024-04-20T12:25:03.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 1536 offset 4197888 len 16384 2024-04-20T12:25:03.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4190720 len 1024 2024-04-20T12:25:03.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-04-20T12:25:03.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4190720 len 1024 2024-04-20T12:25:03.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4190720 len 1024 2024-04-20T12:25:03.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4190720 len 2048 2024-04-20T12:25:03.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-04-20T12:25:03.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4190720 len 2048 2024-04-20T12:25:03.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4190720 len 2048 2024-04-20T12:25:03.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4190720 len 4096 2024-04-20T12:25:03.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-04-20T12:25:03.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4190720 len 4096 2024-04-20T12:25:03.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4190720 len 4096 2024-04-20T12:25:03.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4190720 len 8192 2024-04-20T12:25:03.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-04-20T12:25:03.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4190720 len 8192 2024-04-20T12:25:03.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4190720 len 8192 2024-04-20T12:25:03.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4190720 len 16384 2024-04-20T12:25:03.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-04-20T12:25:03.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4190720 len 16384 2024-04-20T12:25:03.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4190720 len 16384 2024-04-20T12:25:03.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4191232 len 1024 2024-04-20T12:25:03.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-04-20T12:25:03.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4191232 len 1024 2024-04-20T12:25:03.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191232 len 1024 2024-04-20T12:25:03.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4191232 len 2048 2024-04-20T12:25:03.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-04-20T12:25:03.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4191232 len 2048 2024-04-20T12:25:03.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191232 len 2048 2024-04-20T12:25:03.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4191232 len 4096 2024-04-20T12:25:03.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-04-20T12:25:03.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4191232 len 4096 2024-04-20T12:25:03.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191232 len 4096 2024-04-20T12:25:03.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4191232 len 8192 2024-04-20T12:25:03.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-04-20T12:25:03.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4191232 len 8192 2024-04-20T12:25:03.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191232 len 8192 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4191232 len 16384 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4191232 len 16384 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191232 len 16384 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4191744 len 1024 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4191744 len 1024 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191744 len 1024 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4191744 len 2048 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4191744 len 2048 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191744 len 2048 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4191744 len 4096 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4191744 len 4096 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191744 len 4096 2024-04-20T12:25:03.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4191744 len 8192 2024-04-20T12:25:03.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-04-20T12:25:03.386 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4191744 len 8192 2024-04-20T12:25:04.564 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191744 len 8192 2024-04-20T12:25:04.564 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4191744 len 16384 2024-04-20T12:25:04.564 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-04-20T12:25:04.564 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4191744 len 16384 2024-04-20T12:25:04.564 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4191744 len 16384 2024-04-20T12:25:04.564 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4192256 len 1024 2024-04-20T12:25:04.564 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4192256 len 1024 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192256 len 1024 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4192256 len 2048 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4192256 len 2048 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192256 len 2048 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4192256 len 4096 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4192256 len 4096 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192256 len 4096 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4192256 len 8192 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4192256 len 8192 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192256 len 8192 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4192256 len 16384 2024-04-20T12:25:04.565 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-04-20T12:25:04.566 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4192256 len 16384 2024-04-20T12:25:04.566 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192256 len 16384 2024-04-20T12:25:04.566 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4192768 len 1024 2024-04-20T12:25:04.566 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-04-20T12:25:04.566 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4192768 len 1024 2024-04-20T12:25:04.566 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192768 len 1024 2024-04-20T12:25:04.566 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4192768 len 2048 2024-04-20T12:25:04.566 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-04-20T12:25:04.566 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4192768 len 2048 2024-04-20T12:25:04.566 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192768 len 2048 2024-04-20T12:25:04.566 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4192768 len 4096 2024-04-20T12:25:04.566 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-04-20T12:25:04.566 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4192768 len 4096 2024-04-20T12:25:04.566 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192768 len 4096 2024-04-20T12:25:04.567 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4192768 len 8192 2024-04-20T12:25:04.567 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-04-20T12:25:04.567 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4192768 len 8192 2024-04-20T12:25:04.567 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192768 len 8192 2024-04-20T12:25:04.567 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4192768 len 16384 2024-04-20T12:25:04.567 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-04-20T12:25:04.567 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4192768 len 16384 2024-04-20T12:25:04.567 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4192768 len 16384 2024-04-20T12:25:04.567 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4193280 len 1024 2024-04-20T12:25:04.567 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-04-20T12:25:04.567 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4193280 len 1024 2024-04-20T12:25:04.567 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193280 len 1024 2024-04-20T12:25:04.567 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4193280 len 2048 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4193280 len 2048 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193280 len 2048 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4193280 len 4096 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4193280 len 4096 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193280 len 4096 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4193280 len 8192 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4193280 len 8192 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193280 len 8192 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4193280 len 16384 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4193280 len 16384 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193280 len 16384 2024-04-20T12:25:04.568 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4193792 len 1024 2024-04-20T12:25:04.569 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-04-20T12:25:04.569 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4193792 len 1024 2024-04-20T12:25:04.569 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193792 len 1024 2024-04-20T12:25:04.569 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4193792 len 2048 2024-04-20T12:25:04.569 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-04-20T12:25:04.569 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4193792 len 2048 2024-04-20T12:25:04.569 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193792 len 2048 2024-04-20T12:25:04.569 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4193792 len 4096 2024-04-20T12:25:04.569 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-04-20T12:25:04.569 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4193792 len 4096 2024-04-20T12:25:04.569 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193792 len 4096 2024-04-20T12:25:04.569 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4193792 len 8192 2024-04-20T12:25:04.569 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-04-20T12:25:04.569 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4193792 len 8192 2024-04-20T12:25:04.569 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193792 len 8192 2024-04-20T12:25:05.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:04 smithi154 ceph-mon[22073]: pgmap v61: 129 pgs: 129 active+clean; 233 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s rd, 1.7 MiB/s wr, 600 op/s 2024-04-20T12:25:05.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4193792 len 16384 2024-04-20T12:25:05.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-04-20T12:25:05.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4193792 len 16384 2024-04-20T12:25:05.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4193792 len 16384 2024-04-20T12:25:05.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4194304 len 1024 2024-04-20T12:25:05.006 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-04-20T12:25:05.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4194304 len 1024 2024-04-20T12:25:05.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194304 len 1024 2024-04-20T12:25:05.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4194304 len 2048 2024-04-20T12:25:05.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-04-20T12:25:05.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4194304 len 2048 2024-04-20T12:25:05.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194304 len 2048 2024-04-20T12:25:05.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4194304 len 4096 2024-04-20T12:25:05.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-04-20T12:25:05.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4194304 len 4096 2024-04-20T12:25:05.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194304 len 4096 2024-04-20T12:25:05.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4194304 len 8192 2024-04-20T12:25:05.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-04-20T12:25:05.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4194304 len 8192 2024-04-20T12:25:05.007 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194304 len 8192 2024-04-20T12:25:05.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4194304 len 16384 2024-04-20T12:25:05.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-04-20T12:25:05.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4194304 len 16384 2024-04-20T12:25:05.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194304 len 16384 2024-04-20T12:25:05.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4194816 len 1024 2024-04-20T12:25:05.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-04-20T12:25:05.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4194816 len 1024 2024-04-20T12:25:05.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194816 len 1024 2024-04-20T12:25:05.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4194816 len 2048 2024-04-20T12:25:05.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-04-20T12:25:05.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4194816 len 2048 2024-04-20T12:25:05.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194816 len 2048 2024-04-20T12:25:05.008 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4194816 len 4096 2024-04-20T12:25:05.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-04-20T12:25:05.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4194816 len 4096 2024-04-20T12:25:05.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194816 len 4096 2024-04-20T12:25:05.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4194816 len 8192 2024-04-20T12:25:05.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-04-20T12:25:05.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4194816 len 8192 2024-04-20T12:25:05.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194816 len 8192 2024-04-20T12:25:05.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4194816 len 16384 2024-04-20T12:25:05.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-04-20T12:25:05.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4194816 len 16384 2024-04-20T12:25:05.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4194816 len 16384 2024-04-20T12:25:05.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4195328 len 1024 2024-04-20T12:25:05.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-04-20T12:25:05.009 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4195328 len 1024 2024-04-20T12:25:05.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195328 len 1024 2024-04-20T12:25:05.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4195328 len 2048 2024-04-20T12:25:05.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-04-20T12:25:05.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4195328 len 2048 2024-04-20T12:25:05.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195328 len 2048 2024-04-20T12:25:05.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4195328 len 4096 2024-04-20T12:25:05.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-04-20T12:25:05.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4195328 len 4096 2024-04-20T12:25:05.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195328 len 4096 2024-04-20T12:25:05.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4195328 len 8192 2024-04-20T12:25:05.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-04-20T12:25:05.010 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4195328 len 8192 2024-04-20T12:25:05.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195328 len 8192 2024-04-20T12:25:05.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4195328 len 16384 2024-04-20T12:25:05.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-04-20T12:25:05.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4195328 len 16384 2024-04-20T12:25:05.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195328 len 16384 2024-04-20T12:25:05.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4195840 len 1024 2024-04-20T12:25:05.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-04-20T12:25:05.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4195840 len 1024 2024-04-20T12:25:05.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195840 len 1024 2024-04-20T12:25:05.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4195840 len 2048 2024-04-20T12:25:05.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-04-20T12:25:05.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4195840 len 2048 2024-04-20T12:25:05.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195840 len 2048 2024-04-20T12:25:05.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4195840 len 4096 2024-04-20T12:25:05.011 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-04-20T12:25:05.012 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4195840 len 4096 2024-04-20T12:25:05.012 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195840 len 4096 2024-04-20T12:25:05.012 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4195840 len 8192 2024-04-20T12:25:05.012 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-04-20T12:25:05.012 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4195840 len 8192 2024-04-20T12:25:05.012 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195840 len 8192 2024-04-20T12:25:05.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:04 smithi139 ceph-mon[21834]: pgmap v61: 129 pgs: 129 active+clean; 233 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s rd, 1.7 MiB/s wr, 600 op/s 2024-04-20T12:25:05.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:04 smithi135 ceph-mon[18264]: pgmap v61: 129 pgs: 129 active+clean; 233 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 101 MiB/s rd, 1.7 MiB/s wr, 600 op/s 2024-04-20T12:25:05.405 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4195840 len 16384 2024-04-20T12:25:05.405 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-04-20T12:25:05.405 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4195840 len 16384 2024-04-20T12:25:05.405 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4195840 len 16384 2024-04-20T12:25:05.405 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4196352 len 1024 2024-04-20T12:25:05.405 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-04-20T12:25:05.406 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4196352 len 1024 2024-04-20T12:25:05.406 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196352 len 1024 2024-04-20T12:25:05.406 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4196352 len 2048 2024-04-20T12:25:05.406 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-04-20T12:25:05.406 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4196352 len 2048 2024-04-20T12:25:05.406 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196352 len 2048 2024-04-20T12:25:05.406 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4196352 len 4096 2024-04-20T12:25:05.406 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-04-20T12:25:05.406 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4196352 len 4096 2024-04-20T12:25:05.406 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196352 len 4096 2024-04-20T12:25:05.406 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4196352 len 8192 2024-04-20T12:25:05.406 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-04-20T12:25:05.406 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4196352 len 8192 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196352 len 8192 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4196352 len 16384 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4196352 len 16384 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196352 len 16384 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4196864 len 1024 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4196864 len 1024 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196864 len 1024 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4196864 len 2048 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4196864 len 2048 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196864 len 2048 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4196864 len 4096 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-04-20T12:25:05.407 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4196864 len 4096 2024-04-20T12:25:05.408 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196864 len 4096 2024-04-20T12:25:05.408 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4196864 len 8192 2024-04-20T12:25:05.408 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-04-20T12:25:05.408 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4196864 len 8192 2024-04-20T12:25:05.408 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196864 len 8192 2024-04-20T12:25:05.408 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4196864 len 16384 2024-04-20T12:25:05.408 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-04-20T12:25:05.408 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4196864 len 16384 2024-04-20T12:25:05.408 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4196864 len 16384 2024-04-20T12:25:05.408 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4197376 len 1024 2024-04-20T12:25:05.408 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-04-20T12:25:05.408 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4197376 len 1024 2024-04-20T12:25:05.408 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197376 len 1024 2024-04-20T12:25:05.408 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4197376 len 2048 2024-04-20T12:25:05.408 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4197376 len 2048 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197376 len 2048 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4197376 len 4096 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4197376 len 4096 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197376 len 4096 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4197376 len 8192 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4197376 len 8192 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197376 len 8192 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4197376 len 16384 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4197376 len 16384 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197376 len 16384 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4197888 len 1024 2024-04-20T12:25:05.409 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-04-20T12:25:05.410 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4197888 len 1024 2024-04-20T12:25:05.410 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197888 len 1024 2024-04-20T12:25:05.410 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4197888 len 2048 2024-04-20T12:25:05.410 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-04-20T12:25:05.410 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4197888 len 2048 2024-04-20T12:25:05.410 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197888 len 2048 2024-04-20T12:25:05.410 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4197888 len 4096 2024-04-20T12:25:05.410 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-04-20T12:25:05.410 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4197888 len 4096 2024-04-20T12:25:05.410 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197888 len 4096 2024-04-20T12:25:05.410 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4197888 len 8192 2024-04-20T12:25:05.410 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-04-20T12:25:05.410 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4197888 len 8192 2024-04-20T12:25:05.410 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197888 len 8192 2024-04-20T12:25:05.411 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2048 offset 4197888 len 16384 2024-04-20T12:25:06.458 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-04-20T12:25:06.458 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2048 offset 4197888 len 16384 2024-04-20T12:25:06.458 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2048 offset 4197888 len 16384 2024-04-20T12:25:06.458 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4190720 len 1024 2024-04-20T12:25:06.458 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-04-20T12:25:06.458 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4190720 len 1024 2024-04-20T12:25:06.458 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4190720 len 1024 2024-04-20T12:25:06.459 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4190720 len 2048 2024-04-20T12:25:06.459 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-04-20T12:25:06.459 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4190720 len 2048 2024-04-20T12:25:06.459 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4190720 len 2048 2024-04-20T12:25:06.459 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4190720 len 4096 2024-04-20T12:25:06.459 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-04-20T12:25:06.459 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4190720 len 4096 2024-04-20T12:25:06.459 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4190720 len 4096 2024-04-20T12:25:06.459 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4190720 len 8192 2024-04-20T12:25:06.459 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-04-20T12:25:06.459 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4190720 len 8192 2024-04-20T12:25:06.459 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4190720 len 8192 2024-04-20T12:25:06.460 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4190720 len 16384 2024-04-20T12:25:06.460 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-04-20T12:25:06.460 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4190720 len 16384 2024-04-20T12:25:06.460 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4190720 len 16384 2024-04-20T12:25:06.460 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4191232 len 1024 2024-04-20T12:25:06.460 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-04-20T12:25:06.460 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4191232 len 1024 2024-04-20T12:25:06.460 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191232 len 1024 2024-04-20T12:25:06.460 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4191232 len 2048 2024-04-20T12:25:06.460 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-04-20T12:25:06.460 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4191232 len 2048 2024-04-20T12:25:06.460 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191232 len 2048 2024-04-20T12:25:06.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4191232 len 4096 2024-04-20T12:25:06.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-04-20T12:25:06.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4191232 len 4096 2024-04-20T12:25:06.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191232 len 4096 2024-04-20T12:25:06.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4191232 len 8192 2024-04-20T12:25:06.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-04-20T12:25:06.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4191232 len 8192 2024-04-20T12:25:06.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191232 len 8192 2024-04-20T12:25:06.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4191232 len 16384 2024-04-20T12:25:06.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-04-20T12:25:06.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4191232 len 16384 2024-04-20T12:25:06.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191232 len 16384 2024-04-20T12:25:06.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4191744 len 1024 2024-04-20T12:25:06.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-04-20T12:25:06.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4191744 len 1024 2024-04-20T12:25:06.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191744 len 1024 2024-04-20T12:25:06.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4191744 len 2048 2024-04-20T12:25:06.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-04-20T12:25:06.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4191744 len 2048 2024-04-20T12:25:06.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191744 len 2048 2024-04-20T12:25:06.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4191744 len 4096 2024-04-20T12:25:06.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-04-20T12:25:06.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4191744 len 4096 2024-04-20T12:25:06.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191744 len 4096 2024-04-20T12:25:06.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4191744 len 8192 2024-04-20T12:25:06.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-04-20T12:25:06.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4191744 len 8192 2024-04-20T12:25:06.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191744 len 8192 2024-04-20T12:25:06.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4191744 len 16384 2024-04-20T12:25:06.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-04-20T12:25:06.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4191744 len 16384 2024-04-20T12:25:06.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4191744 len 16384 2024-04-20T12:25:06.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4192256 len 1024 2024-04-20T12:25:06.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-04-20T12:25:06.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4192256 len 1024 2024-04-20T12:25:06.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192256 len 1024 2024-04-20T12:25:06.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4192256 len 2048 2024-04-20T12:25:06.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-04-20T12:25:06.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4192256 len 2048 2024-04-20T12:25:06.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192256 len 2048 2024-04-20T12:25:06.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4192256 len 4096 2024-04-20T12:25:06.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-04-20T12:25:06.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4192256 len 4096 2024-04-20T12:25:06.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192256 len 4096 2024-04-20T12:25:06.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4192256 len 8192 2024-04-20T12:25:06.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-04-20T12:25:06.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4192256 len 8192 2024-04-20T12:25:06.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192256 len 8192 2024-04-20T12:25:06.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4192256 len 16384 2024-04-20T12:25:06.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-04-20T12:25:07.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:06 smithi154 ceph-mon[22073]: pgmap v62: 129 pgs: 129 active+clean; 233 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s rd, 926 KiB/s wr, 311 op/s 2024-04-20T12:25:07.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:06 smithi139 ceph-mon[21834]: pgmap v62: 129 pgs: 129 active+clean; 233 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s rd, 926 KiB/s wr, 311 op/s 2024-04-20T12:25:07.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:06 smithi135 ceph-mon[18264]: pgmap v62: 129 pgs: 129 active+clean; 233 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s rd, 926 KiB/s wr, 311 op/s 2024-04-20T12:25:07.377 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4192256 len 16384 2024-04-20T12:25:07.377 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192256 len 16384 2024-04-20T12:25:07.377 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4192768 len 1024 2024-04-20T12:25:07.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-04-20T12:25:07.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4192768 len 1024 2024-04-20T12:25:07.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192768 len 1024 2024-04-20T12:25:07.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4192768 len 2048 2024-04-20T12:25:07.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-04-20T12:25:07.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4192768 len 2048 2024-04-20T12:25:07.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192768 len 2048 2024-04-20T12:25:07.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4192768 len 4096 2024-04-20T12:25:07.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-04-20T12:25:07.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4192768 len 4096 2024-04-20T12:25:07.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192768 len 4096 2024-04-20T12:25:07.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4192768 len 8192 2024-04-20T12:25:07.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-04-20T12:25:07.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4192768 len 8192 2024-04-20T12:25:07.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192768 len 8192 2024-04-20T12:25:07.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4192768 len 16384 2024-04-20T12:25:07.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-04-20T12:25:07.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4192768 len 16384 2024-04-20T12:25:07.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4192768 len 16384 2024-04-20T12:25:07.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4193280 len 1024 2024-04-20T12:25:07.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-04-20T12:25:07.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4193280 len 1024 2024-04-20T12:25:07.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193280 len 1024 2024-04-20T12:25:07.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4193280 len 2048 2024-04-20T12:25:07.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-04-20T12:25:07.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4193280 len 2048 2024-04-20T12:25:07.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193280 len 2048 2024-04-20T12:25:07.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4193280 len 4096 2024-04-20T12:25:07.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-04-20T12:25:07.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4193280 len 4096 2024-04-20T12:25:07.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193280 len 4096 2024-04-20T12:25:07.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4193280 len 8192 2024-04-20T12:25:07.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-04-20T12:25:07.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4193280 len 8192 2024-04-20T12:25:07.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193280 len 8192 2024-04-20T12:25:07.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4193280 len 16384 2024-04-20T12:25:07.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-04-20T12:25:07.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4193280 len 16384 2024-04-20T12:25:07.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193280 len 16384 2024-04-20T12:25:07.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4193792 len 1024 2024-04-20T12:25:07.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-04-20T12:25:07.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4193792 len 1024 2024-04-20T12:25:07.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193792 len 1024 2024-04-20T12:25:07.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4193792 len 2048 2024-04-20T12:25:07.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-04-20T12:25:07.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4193792 len 2048 2024-04-20T12:25:07.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193792 len 2048 2024-04-20T12:25:07.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4193792 len 4096 2024-04-20T12:25:07.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-04-20T12:25:07.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4193792 len 4096 2024-04-20T12:25:07.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193792 len 4096 2024-04-20T12:25:07.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4193792 len 8192 2024-04-20T12:25:07.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-04-20T12:25:07.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4193792 len 8192 2024-04-20T12:25:07.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193792 len 8192 2024-04-20T12:25:07.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4193792 len 16384 2024-04-20T12:25:07.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-04-20T12:25:07.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4193792 len 16384 2024-04-20T12:25:07.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4193792 len 16384 2024-04-20T12:25:07.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4194304 len 1024 2024-04-20T12:25:07.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-04-20T12:25:07.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4194304 len 1024 2024-04-20T12:25:07.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194304 len 1024 2024-04-20T12:25:07.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4194304 len 2048 2024-04-20T12:25:07.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-04-20T12:25:07.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4194304 len 2048 2024-04-20T12:25:07.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194304 len 2048 2024-04-20T12:25:07.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4194304 len 4096 2024-04-20T12:25:07.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-04-20T12:25:07.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4194304 len 4096 2024-04-20T12:25:07.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194304 len 4096 2024-04-20T12:25:07.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4194304 len 8192 2024-04-20T12:25:07.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-04-20T12:25:07.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4194304 len 8192 2024-04-20T12:25:07.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194304 len 8192 2024-04-20T12:25:07.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4194304 len 16384 2024-04-20T12:25:07.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-04-20T12:25:07.385 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4194304 len 16384 2024-04-20T12:25:07.780 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194304 len 16384 2024-04-20T12:25:07.780 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4194816 len 1024 2024-04-20T12:25:07.781 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-04-20T12:25:07.781 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4194816 len 1024 2024-04-20T12:25:07.781 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194816 len 1024 2024-04-20T12:25:07.781 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4194816 len 2048 2024-04-20T12:25:07.781 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-04-20T12:25:07.781 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4194816 len 2048 2024-04-20T12:25:07.781 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194816 len 2048 2024-04-20T12:25:07.781 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4194816 len 4096 2024-04-20T12:25:07.781 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-04-20T12:25:07.781 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4194816 len 4096 2024-04-20T12:25:07.781 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194816 len 4096 2024-04-20T12:25:07.781 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4194816 len 8192 2024-04-20T12:25:07.781 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-04-20T12:25:07.781 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4194816 len 8192 2024-04-20T12:25:07.781 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194816 len 8192 2024-04-20T12:25:07.782 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4194816 len 16384 2024-04-20T12:25:07.782 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-04-20T12:25:07.782 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4194816 len 16384 2024-04-20T12:25:07.782 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4194816 len 16384 2024-04-20T12:25:07.782 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4195328 len 1024 2024-04-20T12:25:07.782 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-04-20T12:25:07.782 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4195328 len 1024 2024-04-20T12:25:07.782 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195328 len 1024 2024-04-20T12:25:07.782 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4195328 len 2048 2024-04-20T12:25:07.782 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-04-20T12:25:07.782 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4195328 len 2048 2024-04-20T12:25:07.782 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195328 len 2048 2024-04-20T12:25:07.782 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4195328 len 4096 2024-04-20T12:25:07.782 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-04-20T12:25:07.782 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4195328 len 4096 2024-04-20T12:25:07.783 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195328 len 4096 2024-04-20T12:25:07.783 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4195328 len 8192 2024-04-20T12:25:07.783 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-04-20T12:25:07.783 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4195328 len 8192 2024-04-20T12:25:07.783 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195328 len 8192 2024-04-20T12:25:07.783 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4195328 len 16384 2024-04-20T12:25:07.783 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-04-20T12:25:07.783 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4195328 len 16384 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195328 len 16384 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4195840 len 1024 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4195840 len 1024 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195840 len 1024 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4195840 len 2048 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4195840 len 2048 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195840 len 2048 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4195840 len 4096 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4195840 len 4096 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195840 len 4096 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4195840 len 8192 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-04-20T12:25:07.784 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4195840 len 8192 2024-04-20T12:25:07.785 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195840 len 8192 2024-04-20T12:25:07.785 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4195840 len 16384 2024-04-20T12:25:07.785 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-04-20T12:25:07.785 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4195840 len 16384 2024-04-20T12:25:07.785 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4195840 len 16384 2024-04-20T12:25:07.785 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4196352 len 1024 2024-04-20T12:25:07.785 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-04-20T12:25:07.785 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4196352 len 1024 2024-04-20T12:25:07.785 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196352 len 1024 2024-04-20T12:25:07.785 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4196352 len 2048 2024-04-20T12:25:07.785 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-04-20T12:25:07.785 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4196352 len 2048 2024-04-20T12:25:07.785 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196352 len 2048 2024-04-20T12:25:07.785 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4196352 len 4096 2024-04-20T12:25:07.785 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-04-20T12:25:07.786 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4196352 len 4096 2024-04-20T12:25:07.786 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196352 len 4096 2024-04-20T12:25:07.786 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4196352 len 8192 2024-04-20T12:25:07.786 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-04-20T12:25:07.786 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4196352 len 8192 2024-04-20T12:25:07.786 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196352 len 8192 2024-04-20T12:25:07.786 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4196352 len 16384 2024-04-20T12:25:07.786 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-04-20T12:25:07.786 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4196352 len 16384 2024-04-20T12:25:07.786 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196352 len 16384 2024-04-20T12:25:08.329 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4196864 len 1024 2024-04-20T12:25:08.329 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-04-20T12:25:08.329 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4196864 len 1024 2024-04-20T12:25:08.330 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196864 len 1024 2024-04-20T12:25:08.330 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4196864 len 2048 2024-04-20T12:25:08.330 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-04-20T12:25:08.330 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4196864 len 2048 2024-04-20T12:25:08.330 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196864 len 2048 2024-04-20T12:25:08.330 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4196864 len 4096 2024-04-20T12:25:08.330 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-04-20T12:25:08.330 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4196864 len 4096 2024-04-20T12:25:08.330 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196864 len 4096 2024-04-20T12:25:08.330 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4196864 len 8192 2024-04-20T12:25:08.330 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-04-20T12:25:08.330 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4196864 len 8192 2024-04-20T12:25:08.330 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196864 len 8192 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4196864 len 16384 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4196864 len 16384 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4196864 len 16384 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4197376 len 1024 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4197376 len 1024 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197376 len 1024 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4197376 len 2048 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4197376 len 2048 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197376 len 2048 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4197376 len 4096 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4197376 len 4096 2024-04-20T12:25:08.331 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197376 len 4096 2024-04-20T12:25:08.332 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4197376 len 8192 2024-04-20T12:25:08.332 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-04-20T12:25:08.332 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4197376 len 8192 2024-04-20T12:25:08.332 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197376 len 8192 2024-04-20T12:25:08.332 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4197376 len 16384 2024-04-20T12:25:08.332 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-04-20T12:25:08.332 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4197376 len 16384 2024-04-20T12:25:08.332 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197376 len 16384 2024-04-20T12:25:08.332 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4197888 len 1024 2024-04-20T12:25:08.332 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-04-20T12:25:08.332 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4197888 len 1024 2024-04-20T12:25:08.332 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197888 len 1024 2024-04-20T12:25:08.332 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4197888 len 2048 2024-04-20T12:25:08.332 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-04-20T12:25:08.332 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4197888 len 2048 2024-04-20T12:25:08.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197888 len 2048 2024-04-20T12:25:08.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4197888 len 4096 2024-04-20T12:25:08.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-04-20T12:25:08.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4197888 len 4096 2024-04-20T12:25:08.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197888 len 4096 2024-04-20T12:25:08.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4197888 len 8192 2024-04-20T12:25:08.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-04-20T12:25:08.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4197888 len 8192 2024-04-20T12:25:08.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197888 len 8192 2024-04-20T12:25:08.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 2560 offset 4197888 len 16384 2024-04-20T12:25:08.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-04-20T12:25:08.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 2560 offset 4197888 len 16384 2024-04-20T12:25:08.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 2560 offset 4197888 len 16384 2024-04-20T12:25:08.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4190720 len 1024 2024-04-20T12:25:08.333 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-04-20T12:25:08.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4190720 len 1024 2024-04-20T12:25:08.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4190720 len 1024 2024-04-20T12:25:08.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4190720 len 2048 2024-04-20T12:25:08.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-04-20T12:25:08.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4190720 len 2048 2024-04-20T12:25:08.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4190720 len 2048 2024-04-20T12:25:08.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4190720 len 4096 2024-04-20T12:25:08.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-04-20T12:25:08.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4190720 len 4096 2024-04-20T12:25:08.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4190720 len 4096 2024-04-20T12:25:08.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4190720 len 8192 2024-04-20T12:25:08.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-04-20T12:25:08.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4190720 len 8192 2024-04-20T12:25:08.334 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4190720 len 8192 2024-04-20T12:25:08.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4190720 len 16384 2024-04-20T12:25:08.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-04-20T12:25:08.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4190720 len 16384 2024-04-20T12:25:08.335 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4190720 len 16384 2024-04-20T12:25:09.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:08 smithi154 ceph-mon[22073]: pgmap v63: 129 pgs: 129 active+clean; 233 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s rd, 926 KiB/s wr, 312 op/s 2024-04-20T12:25:09.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:08 smithi139 ceph-mon[21834]: pgmap v63: 129 pgs: 129 active+clean; 233 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s rd, 926 KiB/s wr, 312 op/s 2024-04-20T12:25:09.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:08 smithi135 ceph-mon[18264]: pgmap v63: 129 pgs: 129 active+clean; 233 MiB data, 478 MiB used, 1.0 TiB / 1.0 TiB avail; 81 MiB/s rd, 926 KiB/s wr, 312 op/s 2024-04-20T12:25:09.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4191232 len 1024 2024-04-20T12:25:09.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-04-20T12:25:09.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4191232 len 1024 2024-04-20T12:25:09.461 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191232 len 1024 2024-04-20T12:25:09.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4191232 len 2048 2024-04-20T12:25:09.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-04-20T12:25:09.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4191232 len 2048 2024-04-20T12:25:09.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191232 len 2048 2024-04-20T12:25:09.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4191232 len 4096 2024-04-20T12:25:09.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-04-20T12:25:09.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4191232 len 4096 2024-04-20T12:25:09.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191232 len 4096 2024-04-20T12:25:09.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4191232 len 8192 2024-04-20T12:25:09.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-04-20T12:25:09.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4191232 len 8192 2024-04-20T12:25:09.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191232 len 8192 2024-04-20T12:25:09.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4191232 len 16384 2024-04-20T12:25:09.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-04-20T12:25:09.462 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4191232 len 16384 2024-04-20T12:25:09.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191232 len 16384 2024-04-20T12:25:09.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4191744 len 1024 2024-04-20T12:25:09.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-04-20T12:25:09.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4191744 len 1024 2024-04-20T12:25:09.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191744 len 1024 2024-04-20T12:25:09.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4191744 len 2048 2024-04-20T12:25:09.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-04-20T12:25:09.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4191744 len 2048 2024-04-20T12:25:09.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191744 len 2048 2024-04-20T12:25:09.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4191744 len 4096 2024-04-20T12:25:09.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-04-20T12:25:09.463 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4191744 len 4096 2024-04-20T12:25:09.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191744 len 4096 2024-04-20T12:25:09.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4191744 len 8192 2024-04-20T12:25:09.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-04-20T12:25:09.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4191744 len 8192 2024-04-20T12:25:09.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191744 len 8192 2024-04-20T12:25:09.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4191744 len 16384 2024-04-20T12:25:09.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-04-20T12:25:09.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4191744 len 16384 2024-04-20T12:25:09.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4191744 len 16384 2024-04-20T12:25:09.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4192256 len 1024 2024-04-20T12:25:09.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-04-20T12:25:09.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4192256 len 1024 2024-04-20T12:25:09.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192256 len 1024 2024-04-20T12:25:09.464 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4192256 len 2048 2024-04-20T12:25:09.465 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-04-20T12:25:09.465 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4192256 len 2048 2024-04-20T12:25:09.465 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192256 len 2048 2024-04-20T12:25:09.465 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4192256 len 4096 2024-04-20T12:25:09.465 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-04-20T12:25:09.465 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4192256 len 4096 2024-04-20T12:25:09.465 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192256 len 4096 2024-04-20T12:25:09.465 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4192256 len 8192 2024-04-20T12:25:09.465 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-04-20T12:25:09.465 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4192256 len 8192 2024-04-20T12:25:09.465 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192256 len 8192 2024-04-20T12:25:09.465 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4192256 len 16384 2024-04-20T12:25:09.466 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-04-20T12:25:09.466 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4192256 len 16384 2024-04-20T12:25:09.466 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192256 len 16384 2024-04-20T12:25:09.466 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4192768 len 1024 2024-04-20T12:25:09.466 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-04-20T12:25:09.466 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4192768 len 1024 2024-04-20T12:25:09.466 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192768 len 1024 2024-04-20T12:25:09.466 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4192768 len 2048 2024-04-20T12:25:09.466 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-04-20T12:25:09.466 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4192768 len 2048 2024-04-20T12:25:09.466 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192768 len 2048 2024-04-20T12:25:09.466 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4192768 len 4096 2024-04-20T12:25:09.466 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-04-20T12:25:09.466 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4192768 len 4096 2024-04-20T12:25:09.467 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192768 len 4096 2024-04-20T12:25:09.467 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4192768 len 8192 2024-04-20T12:25:09.467 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-04-20T12:25:09.467 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4192768 len 8192 2024-04-20T12:25:09.467 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192768 len 8192 2024-04-20T12:25:09.467 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4192768 len 16384 2024-04-20T12:25:09.467 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-04-20T12:25:09.467 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4192768 len 16384 2024-04-20T12:25:09.467 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4192768 len 16384 2024-04-20T12:25:09.467 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4193280 len 1024 2024-04-20T12:25:10.210 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-04-20T12:25:10.210 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4193280 len 1024 2024-04-20T12:25:10.210 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193280 len 1024 2024-04-20T12:25:10.210 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4193280 len 2048 2024-04-20T12:25:10.210 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4193280 len 2048 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193280 len 2048 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4193280 len 4096 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4193280 len 4096 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193280 len 4096 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4193280 len 8192 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4193280 len 8192 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193280 len 8192 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4193280 len 16384 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4193280 len 16384 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193280 len 16384 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4193792 len 1024 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-04-20T12:25:10.211 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4193792 len 1024 2024-04-20T12:25:10.212 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193792 len 1024 2024-04-20T12:25:10.212 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4193792 len 2048 2024-04-20T12:25:10.212 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-04-20T12:25:10.212 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4193792 len 2048 2024-04-20T12:25:10.212 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193792 len 2048 2024-04-20T12:25:10.212 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4193792 len 4096 2024-04-20T12:25:10.212 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-04-20T12:25:10.212 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4193792 len 4096 2024-04-20T12:25:10.212 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193792 len 4096 2024-04-20T12:25:10.212 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4193792 len 8192 2024-04-20T12:25:10.212 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-04-20T12:25:10.212 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4193792 len 8192 2024-04-20T12:25:10.212 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193792 len 8192 2024-04-20T12:25:10.212 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4193792 len 16384 2024-04-20T12:25:10.213 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-04-20T12:25:10.213 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4193792 len 16384 2024-04-20T12:25:10.213 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4193792 len 16384 2024-04-20T12:25:10.213 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4194304 len 1024 2024-04-20T12:25:10.213 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-04-20T12:25:10.213 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4194304 len 1024 2024-04-20T12:25:10.213 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194304 len 1024 2024-04-20T12:25:10.213 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4194304 len 2048 2024-04-20T12:25:10.213 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-04-20T12:25:10.213 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4194304 len 2048 2024-04-20T12:25:10.213 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194304 len 2048 2024-04-20T12:25:10.213 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4194304 len 4096 2024-04-20T12:25:10.213 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-04-20T12:25:10.213 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4194304 len 4096 2024-04-20T12:25:10.213 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194304 len 4096 2024-04-20T12:25:10.214 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4194304 len 8192 2024-04-20T12:25:10.214 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-04-20T12:25:10.214 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4194304 len 8192 2024-04-20T12:25:10.214 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194304 len 8192 2024-04-20T12:25:10.214 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4194304 len 16384 2024-04-20T12:25:10.214 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-04-20T12:25:10.214 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4194304 len 16384 2024-04-20T12:25:10.214 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194304 len 16384 2024-04-20T12:25:10.214 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4194816 len 1024 2024-04-20T12:25:10.214 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-04-20T12:25:10.214 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4194816 len 1024 2024-04-20T12:25:10.214 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194816 len 1024 2024-04-20T12:25:10.214 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4194816 len 2048 2024-04-20T12:25:10.214 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-04-20T12:25:10.215 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4194816 len 2048 2024-04-20T12:25:10.215 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194816 len 2048 2024-04-20T12:25:10.215 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4194816 len 4096 2024-04-20T12:25:10.215 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-04-20T12:25:10.215 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4194816 len 4096 2024-04-20T12:25:10.215 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194816 len 4096 2024-04-20T12:25:10.215 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4194816 len 8192 2024-04-20T12:25:10.215 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-04-20T12:25:10.215 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4194816 len 8192 2024-04-20T12:25:10.215 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194816 len 8192 2024-04-20T12:25:10.215 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4194816 len 16384 2024-04-20T12:25:10.215 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-04-20T12:25:10.215 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4194816 len 16384 2024-04-20T12:25:10.215 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4194816 len 16384 2024-04-20T12:25:10.215 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4195328 len 1024 2024-04-20T12:25:10.216 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-04-20T12:25:10.613 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4195328 len 1024 2024-04-20T12:25:10.613 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195328 len 1024 2024-04-20T12:25:10.613 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4195328 len 2048 2024-04-20T12:25:10.613 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-04-20T12:25:10.614 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4195328 len 2048 2024-04-20T12:25:10.614 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195328 len 2048 2024-04-20T12:25:10.614 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4195328 len 4096 2024-04-20T12:25:10.614 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-04-20T12:25:10.614 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4195328 len 4096 2024-04-20T12:25:10.614 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195328 len 4096 2024-04-20T12:25:10.614 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4195328 len 8192 2024-04-20T12:25:10.614 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-04-20T12:25:10.614 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4195328 len 8192 2024-04-20T12:25:10.614 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195328 len 8192 2024-04-20T12:25:10.614 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4195328 len 16384 2024-04-20T12:25:10.614 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-04-20T12:25:10.614 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4195328 len 16384 2024-04-20T12:25:10.615 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195328 len 16384 2024-04-20T12:25:10.615 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4195840 len 1024 2024-04-20T12:25:10.615 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-04-20T12:25:10.615 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4195840 len 1024 2024-04-20T12:25:10.615 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195840 len 1024 2024-04-20T12:25:10.615 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4195840 len 2048 2024-04-20T12:25:10.615 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-04-20T12:25:10.615 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4195840 len 2048 2024-04-20T12:25:10.615 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195840 len 2048 2024-04-20T12:25:10.615 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4195840 len 4096 2024-04-20T12:25:10.615 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-04-20T12:25:10.615 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4195840 len 4096 2024-04-20T12:25:10.615 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195840 len 4096 2024-04-20T12:25:10.615 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4195840 len 8192 2024-04-20T12:25:10.615 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4195840 len 8192 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195840 len 8192 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4195840 len 16384 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4195840 len 16384 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4195840 len 16384 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4196352 len 1024 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4196352 len 1024 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196352 len 1024 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4196352 len 2048 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4196352 len 2048 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196352 len 2048 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4196352 len 4096 2024-04-20T12:25:10.616 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-04-20T12:25:10.617 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4196352 len 4096 2024-04-20T12:25:10.617 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196352 len 4096 2024-04-20T12:25:10.617 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4196352 len 8192 2024-04-20T12:25:10.617 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-04-20T12:25:10.617 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4196352 len 8192 2024-04-20T12:25:10.617 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196352 len 8192 2024-04-20T12:25:10.617 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4196352 len 16384 2024-04-20T12:25:10.617 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-04-20T12:25:10.617 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4196352 len 16384 2024-04-20T12:25:10.617 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196352 len 16384 2024-04-20T12:25:10.617 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4196864 len 1024 2024-04-20T12:25:10.617 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-04-20T12:25:10.617 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4196864 len 1024 2024-04-20T12:25:10.617 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196864 len 1024 2024-04-20T12:25:10.617 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4196864 len 2048 2024-04-20T12:25:10.618 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-04-20T12:25:10.618 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4196864 len 2048 2024-04-20T12:25:10.618 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196864 len 2048 2024-04-20T12:25:10.618 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4196864 len 4096 2024-04-20T12:25:10.618 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-04-20T12:25:10.618 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4196864 len 4096 2024-04-20T12:25:10.618 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196864 len 4096 2024-04-20T12:25:10.618 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4196864 len 8192 2024-04-20T12:25:10.618 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-04-20T12:25:10.618 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4196864 len 8192 2024-04-20T12:25:10.618 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196864 len 8192 2024-04-20T12:25:10.618 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4196864 len 16384 2024-04-20T12:25:10.618 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-04-20T12:25:10.618 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4196864 len 16384 2024-04-20T12:25:10.618 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4196864 len 16384 2024-04-20T12:25:10.619 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4197376 len 1024 2024-04-20T12:25:10.619 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-04-20T12:25:10.619 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4197376 len 1024 2024-04-20T12:25:11.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:10 smithi154 ceph-mon[22073]: pgmap v64: 129 pgs: 129 active+clean; 241 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s rd, 1.4 MiB/s wr, 463 op/s 2024-04-20T12:25:11.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:10 smithi139 ceph-mon[21834]: pgmap v64: 129 pgs: 129 active+clean; 241 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s rd, 1.4 MiB/s wr, 463 op/s 2024-04-20T12:25:11.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:10 smithi135 ceph-mon[18264]: pgmap v64: 129 pgs: 129 active+clean; 241 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 123 MiB/s rd, 1.4 MiB/s wr, 463 op/s 2024-04-20T12:25:11.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197376 len 1024 2024-04-20T12:25:11.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4197376 len 2048 2024-04-20T12:25:11.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-04-20T12:25:11.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4197376 len 2048 2024-04-20T12:25:11.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197376 len 2048 2024-04-20T12:25:11.378 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4197376 len 4096 2024-04-20T12:25:11.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-04-20T12:25:11.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4197376 len 4096 2024-04-20T12:25:11.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197376 len 4096 2024-04-20T12:25:11.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4197376 len 8192 2024-04-20T12:25:11.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-04-20T12:25:11.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4197376 len 8192 2024-04-20T12:25:11.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197376 len 8192 2024-04-20T12:25:11.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4197376 len 16384 2024-04-20T12:25:11.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-04-20T12:25:11.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4197376 len 16384 2024-04-20T12:25:11.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197376 len 16384 2024-04-20T12:25:11.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4197888 len 1024 2024-04-20T12:25:11.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-04-20T12:25:11.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4197888 len 1024 2024-04-20T12:25:11.379 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197888 len 1024 2024-04-20T12:25:11.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4197888 len 2048 2024-04-20T12:25:11.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-04-20T12:25:11.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4197888 len 2048 2024-04-20T12:25:11.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197888 len 2048 2024-04-20T12:25:11.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4197888 len 4096 2024-04-20T12:25:11.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-04-20T12:25:11.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4197888 len 4096 2024-04-20T12:25:11.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197888 len 4096 2024-04-20T12:25:11.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4197888 len 8192 2024-04-20T12:25:11.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-04-20T12:25:11.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4197888 len 8192 2024-04-20T12:25:11.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197888 len 8192 2024-04-20T12:25:11.380 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3072 offset 4197888 len 16384 2024-04-20T12:25:11.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-04-20T12:25:11.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3072 offset 4197888 len 16384 2024-04-20T12:25:11.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3072 offset 4197888 len 16384 2024-04-20T12:25:11.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4190720 len 1024 2024-04-20T12:25:11.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-04-20T12:25:11.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4190720 len 1024 2024-04-20T12:25:11.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4190720 len 1024 2024-04-20T12:25:11.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4190720 len 2048 2024-04-20T12:25:11.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-04-20T12:25:11.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4190720 len 2048 2024-04-20T12:25:11.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4190720 len 2048 2024-04-20T12:25:11.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4190720 len 4096 2024-04-20T12:25:11.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-04-20T12:25:11.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4190720 len 4096 2024-04-20T12:25:11.381 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4190720 len 4096 2024-04-20T12:25:11.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4190720 len 8192 2024-04-20T12:25:11.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-04-20T12:25:11.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4190720 len 8192 2024-04-20T12:25:11.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4190720 len 8192 2024-04-20T12:25:11.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4190720 len 16384 2024-04-20T12:25:11.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-04-20T12:25:11.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4190720 len 16384 2024-04-20T12:25:11.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4190720 len 16384 2024-04-20T12:25:11.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4191232 len 1024 2024-04-20T12:25:11.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-04-20T12:25:11.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4191232 len 1024 2024-04-20T12:25:11.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191232 len 1024 2024-04-20T12:25:11.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4191232 len 2048 2024-04-20T12:25:11.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-04-20T12:25:11.382 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4191232 len 2048 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191232 len 2048 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4191232 len 4096 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4191232 len 4096 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191232 len 4096 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4191232 len 8192 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4191232 len 8192 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191232 len 8192 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4191232 len 16384 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4191232 len 16384 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191232 len 16384 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4191744 len 1024 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-04-20T12:25:11.383 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4191744 len 1024 2024-04-20T12:25:11.384 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191744 len 1024 2024-04-20T12:25:12.506 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4191744 len 2048 2024-04-20T12:25:12.507 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-04-20T12:25:12.507 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4191744 len 2048 2024-04-20T12:25:12.507 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191744 len 2048 2024-04-20T12:25:12.507 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4191744 len 4096 2024-04-20T12:25:12.507 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-04-20T12:25:12.507 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4191744 len 4096 2024-04-20T12:25:12.507 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191744 len 4096 2024-04-20T12:25:12.507 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4191744 len 8192 2024-04-20T12:25:12.507 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-04-20T12:25:12.507 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4191744 len 8192 2024-04-20T12:25:12.508 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191744 len 8192 2024-04-20T12:25:12.508 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4191744 len 16384 2024-04-20T12:25:12.508 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-04-20T12:25:12.508 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4191744 len 16384 2024-04-20T12:25:12.508 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4191744 len 16384 2024-04-20T12:25:12.508 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4192256 len 1024 2024-04-20T12:25:12.508 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-04-20T12:25:12.508 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4192256 len 1024 2024-04-20T12:25:12.508 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192256 len 1024 2024-04-20T12:25:12.509 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4192256 len 2048 2024-04-20T12:25:12.509 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-04-20T12:25:12.509 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4192256 len 2048 2024-04-20T12:25:12.509 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192256 len 2048 2024-04-20T12:25:12.509 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4192256 len 4096 2024-04-20T12:25:12.509 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-04-20T12:25:12.509 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4192256 len 4096 2024-04-20T12:25:12.509 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192256 len 4096 2024-04-20T12:25:12.509 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4192256 len 8192 2024-04-20T12:25:12.510 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-04-20T12:25:12.510 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4192256 len 8192 2024-04-20T12:25:12.510 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192256 len 8192 2024-04-20T12:25:12.510 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4192256 len 16384 2024-04-20T12:25:12.510 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-04-20T12:25:12.510 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4192256 len 16384 2024-04-20T12:25:12.510 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192256 len 16384 2024-04-20T12:25:12.510 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4192768 len 1024 2024-04-20T12:25:12.510 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-04-20T12:25:12.511 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4192768 len 1024 2024-04-20T12:25:12.511 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192768 len 1024 2024-04-20T12:25:12.511 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4192768 len 2048 2024-04-20T12:25:12.511 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-04-20T12:25:12.511 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4192768 len 2048 2024-04-20T12:25:12.511 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192768 len 2048 2024-04-20T12:25:12.511 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4192768 len 4096 2024-04-20T12:25:12.511 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-04-20T12:25:12.511 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4192768 len 4096 2024-04-20T12:25:12.512 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192768 len 4096 2024-04-20T12:25:12.512 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4192768 len 8192 2024-04-20T12:25:12.512 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-04-20T12:25:12.512 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4192768 len 8192 2024-04-20T12:25:12.512 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192768 len 8192 2024-04-20T12:25:12.512 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4192768 len 16384 2024-04-20T12:25:12.512 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-04-20T12:25:12.512 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4192768 len 16384 2024-04-20T12:25:12.513 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4192768 len 16384 2024-04-20T12:25:12.513 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4193280 len 1024 2024-04-20T12:25:12.513 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-04-20T12:25:12.513 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4193280 len 1024 2024-04-20T12:25:12.513 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193280 len 1024 2024-04-20T12:25:12.513 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4193280 len 2048 2024-04-20T12:25:12.513 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-04-20T12:25:12.513 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4193280 len 2048 2024-04-20T12:25:12.513 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193280 len 2048 2024-04-20T12:25:12.513 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4193280 len 4096 2024-04-20T12:25:12.513 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-04-20T12:25:12.513 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4193280 len 4096 2024-04-20T12:25:12.514 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193280 len 4096 2024-04-20T12:25:12.514 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4193280 len 8192 2024-04-20T12:25:12.514 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-04-20T12:25:12.514 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4193280 len 8192 2024-04-20T12:25:12.514 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193280 len 8192 2024-04-20T12:25:12.514 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4193280 len 16384 2024-04-20T12:25:12.514 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-04-20T12:25:12.514 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4193280 len 16384 2024-04-20T12:25:12.514 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193280 len 16384 2024-04-20T12:25:12.514 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4193792 len 1024 2024-04-20T12:25:12.514 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-04-20T12:25:12.514 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4193792 len 1024 2024-04-20T12:25:12.514 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193792 len 1024 2024-04-20T12:25:13.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:12 smithi154 ceph-mon[22073]: pgmap v65: 129 pgs: 129 active+clean; 241 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s rd, 978 KiB/s wr, 327 op/s 2024-04-20T12:25:13.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:12 smithi139 ceph-mon[21834]: pgmap v65: 129 pgs: 129 active+clean; 241 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s rd, 978 KiB/s wr, 327 op/s 2024-04-20T12:25:13.081 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4193792 len 2048 2024-04-20T12:25:13.081 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-04-20T12:25:13.081 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4193792 len 2048 2024-04-20T12:25:13.081 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193792 len 2048 2024-04-20T12:25:13.081 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4193792 len 4096 2024-04-20T12:25:13.081 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-04-20T12:25:13.081 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4193792 len 4096 2024-04-20T12:25:13.081 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193792 len 4096 2024-04-20T12:25:13.081 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4193792 len 8192 2024-04-20T12:25:13.081 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-04-20T12:25:13.082 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4193792 len 8192 2024-04-20T12:25:13.082 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193792 len 8192 2024-04-20T12:25:13.082 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4193792 len 16384 2024-04-20T12:25:13.082 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-04-20T12:25:13.082 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4193792 len 16384 2024-04-20T12:25:13.082 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4193792 len 16384 2024-04-20T12:25:13.082 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4194304 len 1024 2024-04-20T12:25:13.082 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-04-20T12:25:13.082 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4194304 len 1024 2024-04-20T12:25:13.082 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194304 len 1024 2024-04-20T12:25:13.082 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4194304 len 2048 2024-04-20T12:25:13.082 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-04-20T12:25:13.082 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4194304 len 2048 2024-04-20T12:25:13.082 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194304 len 2048 2024-04-20T12:25:13.083 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4194304 len 4096 2024-04-20T12:25:13.083 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-04-20T12:25:13.083 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4194304 len 4096 2024-04-20T12:25:13.083 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194304 len 4096 2024-04-20T12:25:13.083 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4194304 len 8192 2024-04-20T12:25:13.083 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-04-20T12:25:13.083 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4194304 len 8192 2024-04-20T12:25:13.083 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194304 len 8192 2024-04-20T12:25:13.083 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4194304 len 16384 2024-04-20T12:25:13.083 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-04-20T12:25:13.083 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4194304 len 16384 2024-04-20T12:25:13.083 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194304 len 16384 2024-04-20T12:25:13.083 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4194816 len 1024 2024-04-20T12:25:13.083 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-04-20T12:25:13.084 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4194816 len 1024 2024-04-20T12:25:13.084 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194816 len 1024 2024-04-20T12:25:13.084 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4194816 len 2048 2024-04-20T12:25:13.084 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-04-20T12:25:13.084 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4194816 len 2048 2024-04-20T12:25:13.084 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194816 len 2048 2024-04-20T12:25:13.084 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4194816 len 4096 2024-04-20T12:25:13.084 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-04-20T12:25:13.084 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4194816 len 4096 2024-04-20T12:25:13.084 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194816 len 4096 2024-04-20T12:25:13.084 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4194816 len 8192 2024-04-20T12:25:13.084 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-04-20T12:25:13.085 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4194816 len 8192 2024-04-20T12:25:13.085 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194816 len 8192 2024-04-20T12:25:13.085 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4194816 len 16384 2024-04-20T12:25:13.085 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-04-20T12:25:13.085 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4194816 len 16384 2024-04-20T12:25:13.085 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4194816 len 16384 2024-04-20T12:25:13.085 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4195328 len 1024 2024-04-20T12:25:13.085 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-04-20T12:25:13.085 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4195328 len 1024 2024-04-20T12:25:13.086 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195328 len 1024 2024-04-20T12:25:13.086 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4195328 len 2048 2024-04-20T12:25:13.086 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-04-20T12:25:13.086 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4195328 len 2048 2024-04-20T12:25:13.086 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195328 len 2048 2024-04-20T12:25:13.086 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4195328 len 4096 2024-04-20T12:25:13.086 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-04-20T12:25:13.086 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4195328 len 4096 2024-04-20T12:25:13.087 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195328 len 4096 2024-04-20T12:25:13.087 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4195328 len 8192 2024-04-20T12:25:13.087 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-04-20T12:25:13.087 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4195328 len 8192 2024-04-20T12:25:13.087 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195328 len 8192 2024-04-20T12:25:13.087 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4195328 len 16384 2024-04-20T12:25:13.087 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-04-20T12:25:13.087 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4195328 len 16384 2024-04-20T12:25:13.087 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195328 len 16384 2024-04-20T12:25:13.088 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4195840 len 1024 2024-04-20T12:25:13.088 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-04-20T12:25:13.088 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4195840 len 1024 2024-04-20T12:25:13.088 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195840 len 1024 2024-04-20T12:25:13.088 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4195840 len 2048 2024-04-20T12:25:13.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:12 smithi135 ceph-mon[18264]: pgmap v65: 129 pgs: 129 active+clean; 241 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s rd, 978 KiB/s wr, 327 op/s 2024-04-20T12:25:13.487 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-04-20T12:25:13.487 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4195840 len 2048 2024-04-20T12:25:13.487 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195840 len 2048 2024-04-20T12:25:13.487 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4195840 len 4096 2024-04-20T12:25:13.488 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-04-20T12:25:13.488 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4195840 len 4096 2024-04-20T12:25:13.488 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195840 len 4096 2024-04-20T12:25:13.488 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4195840 len 8192 2024-04-20T12:25:13.488 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-04-20T12:25:13.488 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4195840 len 8192 2024-04-20T12:25:13.488 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195840 len 8192 2024-04-20T12:25:13.488 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4195840 len 16384 2024-04-20T12:25:13.488 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-04-20T12:25:13.488 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4195840 len 16384 2024-04-20T12:25:13.488 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4195840 len 16384 2024-04-20T12:25:13.488 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4196352 len 1024 2024-04-20T12:25:13.489 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-04-20T12:25:13.489 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4196352 len 1024 2024-04-20T12:25:13.489 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196352 len 1024 2024-04-20T12:25:13.489 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4196352 len 2048 2024-04-20T12:25:13.489 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-04-20T12:25:13.489 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4196352 len 2048 2024-04-20T12:25:13.489 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196352 len 2048 2024-04-20T12:25:13.489 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4196352 len 4096 2024-04-20T12:25:13.489 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-04-20T12:25:13.489 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4196352 len 4096 2024-04-20T12:25:13.489 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196352 len 4096 2024-04-20T12:25:13.489 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4196352 len 8192 2024-04-20T12:25:13.490 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-04-20T12:25:13.490 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4196352 len 8192 2024-04-20T12:25:13.490 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196352 len 8192 2024-04-20T12:25:13.490 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4196352 len 16384 2024-04-20T12:25:13.490 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-04-20T12:25:13.490 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4196352 len 16384 2024-04-20T12:25:13.490 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196352 len 16384 2024-04-20T12:25:13.490 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4196864 len 1024 2024-04-20T12:25:13.490 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-04-20T12:25:13.490 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4196864 len 1024 2024-04-20T12:25:13.490 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196864 len 1024 2024-04-20T12:25:13.490 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4196864 len 2048 2024-04-20T12:25:13.490 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-04-20T12:25:13.491 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4196864 len 2048 2024-04-20T12:25:13.491 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196864 len 2048 2024-04-20T12:25:13.491 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4196864 len 4096 2024-04-20T12:25:13.491 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-04-20T12:25:13.491 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4196864 len 4096 2024-04-20T12:25:13.491 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196864 len 4096 2024-04-20T12:25:13.491 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4196864 len 8192 2024-04-20T12:25:13.491 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-04-20T12:25:13.491 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4196864 len 8192 2024-04-20T12:25:13.491 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196864 len 8192 2024-04-20T12:25:13.491 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4196864 len 16384 2024-04-20T12:25:13.491 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-04-20T12:25:13.492 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4196864 len 16384 2024-04-20T12:25:13.492 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4196864 len 16384 2024-04-20T12:25:13.492 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4197376 len 1024 2024-04-20T12:25:13.492 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-04-20T12:25:13.492 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4197376 len 1024 2024-04-20T12:25:13.492 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197376 len 1024 2024-04-20T12:25:13.492 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4197376 len 2048 2024-04-20T12:25:13.492 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-04-20T12:25:13.492 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4197376 len 2048 2024-04-20T12:25:13.492 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197376 len 2048 2024-04-20T12:25:13.492 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4197376 len 4096 2024-04-20T12:25:13.492 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-04-20T12:25:13.493 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4197376 len 4096 2024-04-20T12:25:13.493 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197376 len 4096 2024-04-20T12:25:13.493 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4197376 len 8192 2024-04-20T12:25:13.493 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-04-20T12:25:13.493 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4197376 len 8192 2024-04-20T12:25:13.493 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197376 len 8192 2024-04-20T12:25:13.493 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4197376 len 16384 2024-04-20T12:25:13.493 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-04-20T12:25:13.493 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4197376 len 16384 2024-04-20T12:25:13.493 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197376 len 16384 2024-04-20T12:25:13.493 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4197888 len 1024 2024-04-20T12:25:13.494 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-04-20T12:25:13.494 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4197888 len 1024 2024-04-20T12:25:13.494 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197888 len 1024 2024-04-20T12:25:13.495 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4197888 len 2048 2024-04-20T12:25:13.495 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-04-20T12:25:13.556 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4197888 len 2048 2024-04-20T12:25:13.557 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197888 len 2048 2024-04-20T12:25:13.557 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4197888 len 4096 2024-04-20T12:25:13.557 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-04-20T12:25:13.557 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4197888 len 4096 2024-04-20T12:25:13.557 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197888 len 4096 2024-04-20T12:25:13.557 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4197888 len 8192 2024-04-20T12:25:13.557 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-04-20T12:25:13.557 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4197888 len 8192 2024-04-20T12:25:13.557 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197888 len 8192 2024-04-20T12:25:13.557 INFO:tasks.workunit.client.0.smithi135.stdout:write_direct buf_align 3584 offset 4197888 len 16384 2024-04-20T12:25:13.557 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-04-20T12:25:13.557 INFO:tasks.workunit.client.0.smithi135.stdout:write_sync buf_align 3584 offset 4197888 len 16384 2024-04-20T12:25:13.557 INFO:tasks.workunit.client.0.smithi135.stdout:write_file buf_align 3584 offset 4197888 len 16384 2024-04-20T12:25:13.558 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-20T12:25:13.558 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-20T12:25:13.587 INFO:tasks.workunit:Stopping ['direct_io'] on client.0... 2024-04-20T12:25:13.588 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-20T12:25:13.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:13 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:25:13.907 DEBUG:teuthology.parallel:result is None 2024-04-20T12:25:13.907 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-20T12:25:13.944 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-20T12:25:13.944 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-04-20T12:25:13.958 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi135.front.sepia.ceph.com 2024-04-20T12:25:13.993 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-04-20T12:25:14.004 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-04-20T12:25:14.004 INFO:teuthology.task.exec:Executing custom commands... 2024-04-20T12:25:14.004 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi135.front.sepia.ceph.com 2024-04-20T12:25:14.004 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-04-20T12:25:14.005 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:13 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:25:14.062 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-04-20T12:25:14.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:13 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:25:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:14 smithi154 ceph-mon[22073]: pgmap v66: 129 pgs: 129 active+clean; 111 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s rd, 1.4 MiB/s wr, 472 op/s 2024-04-20T12:25:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:14 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:25:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:14 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:25:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:14 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:25:15.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:14 smithi139 ceph-mon[21834]: pgmap v66: 129 pgs: 129 active+clean; 111 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s rd, 1.4 MiB/s wr, 472 op/s 2024-04-20T12:25:15.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:14 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:25:15.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:14 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:25:15.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:14 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:25:15.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:14 smithi135 ceph-mon[18264]: pgmap v66: 129 pgs: 129 active+clean; 111 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 129 MiB/s rd, 1.4 MiB/s wr, 472 op/s 2024-04-20T12:25:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:14 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:25:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:14 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:25:15.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:14 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:25:17.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:16 smithi154 ceph-mon[22073]: pgmap v67: 129 pgs: 129 active+clean; 111 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s rd, 920 KiB/s wr, 296 op/s 2024-04-20T12:25:17.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:16 smithi139 ceph-mon[21834]: pgmap v67: 129 pgs: 129 active+clean; 111 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s rd, 920 KiB/s wr, 296 op/s 2024-04-20T12:25:17.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:16 smithi135 ceph-mon[18264]: pgmap v67: 129 pgs: 129 active+clean; 111 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s rd, 920 KiB/s wr, 296 op/s 2024-04-20T12:25:19.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:18 smithi154 ceph-mon[22073]: pgmap v68: 129 pgs: 129 active+clean; 111 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s rd, 920 KiB/s wr, 296 op/s 2024-04-20T12:25:19.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:18 smithi139 ceph-mon[21834]: pgmap v68: 129 pgs: 129 active+clean; 111 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s rd, 920 KiB/s wr, 296 op/s 2024-04-20T12:25:19.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:18 smithi135 ceph-mon[18264]: pgmap v68: 129 pgs: 129 active+clean; 111 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s rd, 920 KiB/s wr, 296 op/s 2024-04-20T12:25:21.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:20 smithi154 ceph-mon[22073]: pgmap v69: 129 pgs: 129 active+clean; 112 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 89 MiB/s rd, 997 KiB/s wr, 317 op/s 2024-04-20T12:25:21.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:20 smithi139 ceph-mon[21834]: pgmap v69: 129 pgs: 129 active+clean; 112 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 89 MiB/s rd, 997 KiB/s wr, 317 op/s 2024-04-20T12:25:21.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:20 smithi135 ceph-mon[18264]: pgmap v69: 129 pgs: 129 active+clean; 112 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 89 MiB/s rd, 997 KiB/s wr, 317 op/s 2024-04-20T12:25:23.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:22 smithi154 ceph-mon[22073]: pgmap v70: 129 pgs: 129 active+clean; 112 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 513 KiB/s wr, 166 op/s 2024-04-20T12:25:23.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:22 smithi139 ceph-mon[21834]: pgmap v70: 129 pgs: 129 active+clean; 112 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 513 KiB/s wr, 166 op/s 2024-04-20T12:25:23.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:22 smithi135 ceph-mon[18264]: pgmap v70: 129 pgs: 129 active+clean; 112 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 513 KiB/s wr, 166 op/s 2024-04-20T12:25:23.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:25:23.333 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:25:23.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.446+0000 7f0374611640 1 -- 172.21.15.135:0/2233689611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f036c100d60 msgr2=0x7f036c101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.446+0000 7f0374611640 1 --2- 172.21.15.135:0/2233689611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f036c100d60 0x7f036c101140 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0364009900 tx=0x7f036402bc30 comp rx=0 tx=0).stop 2024-04-20T12:25:23.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.446+0000 7f0374611640 1 -- 172.21.15.135:0/2233689611 shutdown_connections 2024-04-20T12:25:23.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.446+0000 7f0374611640 1 --2- 172.21.15.135:0/2233689611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f036c10e910 0x7f036c110d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.446+0000 7f0374611640 1 --2- 172.21.15.135:0/2233689611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f036c101680 0x7f036c10e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.446+0000 7f0374611640 1 --2- 172.21.15.135:0/2233689611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f036c100d60 0x7f036c101140 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.446+0000 7f0374611640 1 -- 172.21.15.135:0/2233689611 >> 172.21.15.135:0/2233689611 conn(0x7f036c077f60 msgr2=0x7f036c078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:23.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.446+0000 7f0374611640 1 -- 172.21.15.135:0/2233689611 shutdown_connections 2024-04-20T12:25:23.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.446+0000 7f0374611640 1 -- 172.21.15.135:0/2233689611 wait complete. 2024-04-20T12:25:23.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.446+0000 7f0374611640 1 Processor -- start 2024-04-20T12:25:23.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.446+0000 7f0374611640 1 -- start start 2024-04-20T12:25:23.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.446+0000 7f0374611640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f036c100d60 0x7f036c1a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.446+0000 7f0374611640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f036c101680 0x7f036c1a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0374611640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f036c10e910 0x7f036c19a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0374611640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f036c114530 con 0x7f036c10e910 2024-04-20T12:25:23.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0374611640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f036c1143b0 con 0x7f036c100d60 2024-04-20T12:25:23.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0374611640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f036c1146b0 con 0x7f036c101680 2024-04-20T12:25:23.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0372bae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f036c10e910 0x7f036c19a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0372bae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f036c10e910 0x7f036c19a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50184/0 (socket says 172.21.15.135:50184) 2024-04-20T12:25:23.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0372bae640 1 -- 172.21.15.135:0/3489400931 learned_addr learned my addr 172.21.15.135:0/3489400931 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:23.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f03723ad640 1 --2- 172.21.15.135:0/3489400931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f036c100d60 0x7f036c1a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0371bac640 1 --2- 172.21.15.135:0/3489400931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f036c101680 0x7f036c1a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0372bae640 1 -- 172.21.15.135:0/3489400931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f036c101680 msgr2=0x7f036c1a0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0372bae640 1 --2- 172.21.15.135:0/3489400931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f036c101680 0x7f036c1a0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0372bae640 1 -- 172.21.15.135:0/3489400931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f036c100d60 msgr2=0x7f036c1a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0372bae640 1 --2- 172.21.15.135:0/3489400931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f036c100d60 0x7f036c1a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0372bae640 1 -- 172.21.15.135:0/3489400931 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036c19b010 con 0x7f036c10e910 2024-04-20T12:25:23.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0372bae640 1 --2- 172.21.15.135:0/3489400931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f036c10e910 0x7f036c19a890 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f036800eb40 tx=0x7f036800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:23.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f03637fe640 1 -- 172.21.15.135:0/3489400931 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368004b20 con 0x7f036c10e910 2024-04-20T12:25:23.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f03637fe640 1 -- 172.21.15.135:0/3489400931 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0368004cc0 con 0x7f036c10e910 2024-04-20T12:25:23.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0374611640 1 -- 172.21.15.135:0/3489400931 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f036c19b300 con 0x7f036c10e910 2024-04-20T12:25:23.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f03637fe640 1 -- 172.21.15.135:0/3489400931 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368010850 con 0x7f036c10e910 2024-04-20T12:25:23.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.447+0000 7f0374611640 1 -- 172.21.15.135:0/3489400931 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f036c1a75a0 con 0x7f036c10e910 2024-04-20T12:25:23.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.450+0000 7f03637fe640 1 -- 172.21.15.135:0/3489400931 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f0368005020 con 0x7f036c10e910 2024-04-20T12:25:23.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.450+0000 7f0377203740 1 Processor -- start 2024-04-20T12:25:23.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.450+0000 7f0377203740 1 -- start start 2024-04-20T12:25:23.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0377203740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 0x5577e23e3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0377203740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23e3640 0x5577e23ebce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0377203740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23ec220 0x5577e23ee610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0377203740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5577e23481b0 con 0x5577e23e3640 2024-04-20T12:25:23.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0377203740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5577e22e5390 con 0x5577e23e2d20 2024-04-20T12:25:23.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0377203740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5577e2344170 con 0x5577e23ec220 2024-04-20T12:25:23.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f03637fe640 1 --2- 172.21.15.135:0/3489400931 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f03580a3d20 0x7f03580a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f03723ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23e3640 0x5577e23ebce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0371bac640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 0x5577e23e3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0371bac640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 0x5577e23e3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:56666/0 (socket says 172.21.15.135:56666) 2024-04-20T12:25:23.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0371bac640 1 -- 172.21.15.135:0/3106881384 learned_addr learned my addr 172.21.15.135:0/3106881384 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:23.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0372bae640 1 --2- 172.21.15.135:0/3489400931 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f03580a3d20 0x7f03580a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0371bac640 1 --2- 172.21.15.135:0/3106881384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23ec220 0x5577e23ee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f03637fe640 1 -- 172.21.15.135:0/3489400931 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f03680d1300 con 0x7f036c10e910 2024-04-20T12:25:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0371bac640 1 -- 172.21.15.135:0/3106881384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23ec220 msgr2=0x5577e23ee610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0371bac640 1 --2- 172.21.15.135:0/3106881384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23ec220 0x5577e23ee610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0371bac640 1 -- 172.21.15.135:0/3106881384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23e3640 msgr2=0x5577e23ebce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0371bac640 1 --2- 172.21.15.135:0/3106881384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23e3640 0x5577e23ebce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.451+0000 7f0371bac640 1 -- 172.21.15.135:0/3106881384 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577e21247d0 con 0x5577e23e2d20 2024-04-20T12:25:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.452+0000 7f0372bae640 1 --2- 172.21.15.135:0/3489400931 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f03580a3d20 0x7f03580a61e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f03680ce780 tx=0x7f0368005a20 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.452+0000 7f0371bac640 1 --2- 172.21.15.135:0/3106881384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 0x5577e23e3100 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f035c012790 tx=0x7f035c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d9c6834d88b0769 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.452+0000 7f0360bfe640 1 -- 172.21.15.135:0/3106881384 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c012dd0 con 0x5577e23e2d20 2024-04-20T12:25:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.452+0000 7f0360bfe640 1 -- 172.21.15.135:0/3106881384 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f035c010770 con 0x5577e23e2d20 2024-04-20T12:25:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.452+0000 7f0360bfe640 1 -- 172.21.15.135:0/3106881384 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c003850 con 0x5577e23e2d20 2024-04-20T12:25:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 -- 172.21.15.135:0/3106881384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 msgr2=0x5577e23e3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 --2- 172.21.15.135:0/3106881384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 0x5577e23e3100 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f035c012790 tx=0x7f035c004730 comp rx=0 tx=0).stop 2024-04-20T12:25:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 -- 172.21.15.135:0/3106881384 shutdown_connections 2024-04-20T12:25:23.458 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 --2- 172.21.15.135:0/3106881384 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23ec220 0x5577e23ee610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 --2- 172.21.15.135:0/3106881384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23e3640 0x5577e23ebce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 --2- 172.21.15.135:0/3106881384 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 0x5577e23e3100 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 -- 172.21.15.135:0/3106881384 >> 172.21.15.135:0/3106881384 conn(0x5577e23dd450 msgr2=0x5577e23dd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 -- 172.21.15.135:0/3106881384 shutdown_connections 2024-04-20T12:25:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 -- 172.21.15.135:0/3106881384 wait complete. 2024-04-20T12:25:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 -- start start 2024-04-20T12:25:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 Processor -- start 2024-04-20T12:25:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 0x5577e23e9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23e3640 0x5577e23e9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23ec220 0x5577e23e9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5577e23ef010 con 0x5577e23ec220 2024-04-20T12:25:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5577e23012f0 con 0x5577e23e2d20 2024-04-20T12:25:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5577e23ef190 con 0x5577e23e3640 2024-04-20T12:25:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0377203740 10 client.0 _ll_register_callbacks cb 0x5577e22cb4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:23.459 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0371bac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23ec220 0x5577e23e9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.453+0000 7f0371bac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23ec220 0x5577e23e9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50200/0 (socket says 172.21.15.135:50200) 2024-04-20T12:25:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f0371bac640 1 -- 172.21.15.135:0/4106535893 learned_addr learned my addr 172.21.15.135:0/4106535893 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f0371bac640 1 --2- 172.21.15.135:0/4106535893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 0x5577e23e9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f03723ad640 1 --2- 172.21.15.135:0/4106535893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23e3640 0x5577e23e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f0371bac640 1 -- 172.21.15.135:0/4106535893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23e3640 msgr2=0x5577e23e9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f0371bac640 1 --2- 172.21.15.135:0/4106535893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23e3640 0x5577e23e9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f0371bac640 1 -- 172.21.15.135:0/4106535893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 msgr2=0x5577e23e9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f0371bac640 1 --2- 172.21.15.135:0/4106535893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 0x5577e23e9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f0371bac640 1 -- 172.21.15.135:0/4106535893 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577e205a3f0 con 0x5577e23ec220 2024-04-20T12:25:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f03723ad640 1 --2- 172.21.15.135:0/4106535893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23e3640 0x5577e23e9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f0371bac640 1 --2- 172.21.15.135:0/4106535893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23ec220 0x5577e23e9cb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f035c004650 tx=0x7f035c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e13b25805f65f01 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f0355ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f0355ffb640 1 -- 172.21.15.135:0/4106535893 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c01f410 con 0x5577e23ec220 2024-04-20T12:25:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f0355ffb640 1 -- 172.21.15.135:0/4106535893 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f035c01f5b0 con 0x5577e23ec220 2024-04-20T12:25:23.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f0377203740 1 -- 172.21.15.135:0/4106535893 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f035c010770 con 0x5577e23ec220 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f0355ffb640 1 -- 172.21.15.135:0/4106535893 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f035c036050 con 0x5577e23ec220 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f0377203740 10 client.16419 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.454+0000 7f0377203740 1 -- 172.21.15.135:0/4106535893 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5577e201a0f0 con 0x5577e23ec220 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.455+0000 7f0355ffb640 1 -- 172.21.15.135:0/4106535893 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f035c010770 con 0x5577e23ec220 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.455+0000 7f0355ffb640 1 -- 172.21.15.135:0/4106535893 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f035c01e6f0 con 0x5577e23ec220 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.455+0000 7f0377203740 10 client.16419 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.455+0000 7f0377203740 10 client.16419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.455+0000 7f0377203740 20 client.16419 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.455+0000 7f0377203740 1 --2- 172.21.15.135:0/4106535893 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5577e23fc440 0x5577e23fe830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.455+0000 7f0377203740 4 client.16419 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.455+0000 7f0377203740 1 -- 172.21.15.135:0/4106535893 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577e2355bd0 con 0x5577e23fc440 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.455+0000 7f03723ad640 1 --2- 172.21.15.135:0/4106535893 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5577e23fc440 0x5577e23fe830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.455+0000 7f0355ffb640 10 client.16419 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.455+0000 7f03723ad640 1 --2- 172.21.15.135:0/4106535893 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5577e23fc440 0x5577e23fe830 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42b859699f0c2008 server_cookie=6bab97486e058b25 in_seq=0 out_seq=0 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.456+0000 7f0355ffb640 1 -- 172.21.15.135:0/4106535893 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5577e2355bd0 con 0x5577e23fc440 2024-04-20T12:25:23.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.456+0000 7f0355ffb640 10 client.16419 handle_command_reply: tid=0 2024-04-20T12:25:23.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.456+0000 7f0377203740 1 client.16419 shutdown 2024-04-20T12:25:23.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.456+0000 7f0377203740 1 -- 172.21.15.135:0/4106535893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23ec220 msgr2=0x5577e23e9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.456+0000 7f0377203740 1 --2- 172.21.15.135:0/4106535893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23ec220 0x5577e23e9cb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f035c004650 tx=0x7f035c014040 comp rx=0 tx=0).stop 2024-04-20T12:25:23.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.456+0000 7f0377203740 1 -- 172.21.15.135:0/4106535893 shutdown_connections 2024-04-20T12:25:23.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.456+0000 7f0377203740 1 --2- 172.21.15.135:0/4106535893 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5577e23fc440 0x5577e23fe830 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.456+0000 7f0377203740 1 --2- 172.21.15.135:0/4106535893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23ec220 0x5577e23e9cb0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.456+0000 7f0377203740 1 --2- 172.21.15.135:0/4106535893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23e3640 0x5577e23e9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.456+0000 7f0377203740 1 --2- 172.21.15.135:0/4106535893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 0x5577e23e9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.456+0000 7f0355ffb640 0 client.16419 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:23.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.456+0000 7f0377203740 1 -- 172.21.15.135:0/4106535893 >> 172.21.15.135:0/4106535893 conn(0x5577e23dd450 msgr2=0x5577e23df1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:23.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.456+0000 7f0377203740 1 -- 172.21.15.135:0/4106535893 shutdown_connections 2024-04-20T12:25:23.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.456+0000 7f0377203740 1 -- 172.21.15.135:0/4106535893 wait complete. 2024-04-20T12:25:23.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.456+0000 7f0377203740 20 client.16419 trim_cache size 0 max 16384 2024-04-20T12:25:23.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0377203740 1 Processor -- start 2024-04-20T12:25:23.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0377203740 1 -- start start 2024-04-20T12:25:23.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0377203740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23e2d20 0x5577e23f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0377203740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e3640 0x5577e23e89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0377203740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23ec220 0x5577e2403fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0377203740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f036c1b1590 con 0x5577e23ec220 2024-04-20T12:25:23.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0377203740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f036c1b30d0 con 0x5577e23e3640 2024-04-20T12:25:23.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0377203740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f036c1b1c60 con 0x5577e23e2d20 2024-04-20T12:25:23.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0371bac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23ec220 0x5577e2403fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0371bac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23ec220 0x5577e2403fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50204/0 (socket says 172.21.15.135:50204) 2024-04-20T12:25:23.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0371bac640 1 -- 172.21.15.135:0/2580531601 learned_addr learned my addr 172.21.15.135:0/2580531601 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:23.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f03723ad640 1 --2- 172.21.15.135:0/2580531601 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e3640 0x5577e23e89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0371bac640 1 -- 172.21.15.135:0/2580531601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23e2d20 msgr2=0x5577e23f7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0371bac640 1 --2- 172.21.15.135:0/2580531601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23e2d20 0x5577e23f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0371bac640 1 -- 172.21.15.135:0/2580531601 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e3640 msgr2=0x5577e23e89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0371bac640 1 --2- 172.21.15.135:0/2580531601 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e3640 0x5577e23e89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0371bac640 1 -- 172.21.15.135:0/2580531601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577e23e3470 con 0x5577e23ec220 2024-04-20T12:25:23.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f03723ad640 1 --2- 172.21.15.135:0/2580531601 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e3640 0x5577e23e89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:23.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.474+0000 7f0371bac640 1 --2- 172.21.15.135:0/2580531601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23ec220 0x5577e2403fa0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f035c01eaf0 tx=0x7f035c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05b792e89773927 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:23.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.475+0000 7f0357fff640 1 -- 172.21.15.135:0/2580531601 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c00ba40 con 0x5577e23ec220 2024-04-20T12:25:23.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.475+0000 7f0357fff640 1 -- 172.21.15.135:0/2580531601 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f035c01e8a0 con 0x5577e23ec220 2024-04-20T12:25:23.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.475+0000 7f0357fff640 1 -- 172.21.15.135:0/2580531601 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c00b7e0 con 0x5577e23ec220 2024-04-20T12:25:23.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.475+0000 7f0377203740 1 -- 172.21.15.135:0/2580531601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23ec220 msgr2=0x5577e2403fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.475+0000 7f0377203740 1 --2- 172.21.15.135:0/2580531601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23ec220 0x5577e2403fa0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f035c01eaf0 tx=0x7f035c005c90 comp rx=0 tx=0).stop 2024-04-20T12:25:23.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.475+0000 7f0377203740 1 -- 172.21.15.135:0/2580531601 shutdown_connections 2024-04-20T12:25:23.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.475+0000 7f0377203740 1 --2- 172.21.15.135:0/2580531601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23ec220 0x5577e2403fa0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.475+0000 7f0377203740 1 --2- 172.21.15.135:0/2580531601 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e3640 0x5577e23e89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.475+0000 7f0377203740 1 --2- 172.21.15.135:0/2580531601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23e2d20 0x5577e23f7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.475+0000 7f0377203740 1 -- 172.21.15.135:0/2580531601 >> 172.21.15.135:0/2580531601 conn(0x5577e23dd450 msgr2=0x5577e23e9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:23.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.475+0000 7f0377203740 1 -- 172.21.15.135:0/2580531601 shutdown_connections 2024-04-20T12:25:23.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.475+0000 7f0377203740 1 -- 172.21.15.135:0/2580531601 wait complete. 2024-04-20T12:25:23.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.475+0000 7f0377203740 1 -- start start 2024-04-20T12:25:23.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f0377203740 1 Processor -- start 2024-04-20T12:25:23.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f0377203740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 0x5577e23f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f0377203740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23e3640 0x5577e23f4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f0377203740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23ec220 0x5577e23f1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f0377203740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f036c1b2a00 con 0x5577e23e3640 2024-04-20T12:25:23.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f0377203740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f036c1b2330 con 0x5577e23e2d20 2024-04-20T12:25:23.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f0377203740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f036c1af560 con 0x5577e23ec220 2024-04-20T12:25:23.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f0377203740 10 client.0 _ll_register_callbacks cb 0x7f0364009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:23.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f03723ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23e3640 0x5577e23f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f03723ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23e3640 0x5577e23f4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50220/0 (socket says 172.21.15.135:50220) 2024-04-20T12:25:23.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f03723ad640 1 -- 172.21.15.135:0/1017885992 learned_addr learned my addr 172.21.15.135:0/1017885992 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:23.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f0371bac640 1 --2- 172.21.15.135:0/1017885992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23ec220 0x5577e23f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f0371bac640 1 --2- 172.21.15.135:0/1017885992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 0x5577e23f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f03723ad640 1 -- 172.21.15.135:0/1017885992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23ec220 msgr2=0x5577e23f1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f03723ad640 1 --2- 172.21.15.135:0/1017885992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23ec220 0x5577e23f1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f03723ad640 1 -- 172.21.15.135:0/1017885992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 msgr2=0x5577e23f40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f03723ad640 1 --2- 172.21.15.135:0/1017885992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 0x5577e23f40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f03723ad640 1 -- 172.21.15.135:0/1017885992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577e23f1ed0 con 0x5577e23e3640 2024-04-20T12:25:23.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f03723ad640 1 --2- 172.21.15.135:0/1017885992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23e3640 0x5577e23f4620 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0364006010 tx=0x7f036402cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75823f3f9e0587a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:23.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f0355ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:23.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f0355ffb640 1 -- 172.21.15.135:0/1017885992 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036404c030 con 0x5577e23e3640 2024-04-20T12:25:23.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f0355ffb640 1 -- 172.21.15.135:0/1017885992 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f0364048bc0 con 0x5577e23e3640 2024-04-20T12:25:23.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.476+0000 7f0377203740 1 -- 172.21.15.135:0/1017885992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f035c01e8a0 con 0x5577e23e3640 2024-04-20T12:25:23.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.477+0000 7f0355ffb640 1 -- 172.21.15.135:0/1017885992 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0364059050 con 0x5577e23e3640 2024-04-20T12:25:23.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.477+0000 7f0377203740 10 client.16425 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:23.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.477+0000 7f0377203740 1 -- 172.21.15.135:0/1017885992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5577e2462240 con 0x5577e23e3640 2024-04-20T12:25:23.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.477+0000 7f0355ffb640 1 -- 172.21.15.135:0/1017885992 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f035c01e8a0 con 0x5577e23e3640 2024-04-20T12:25:23.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.477+0000 7f0355ffb640 1 -- 172.21.15.135:0/1017885992 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f03640046c0 con 0x5577e23e3640 2024-04-20T12:25:23.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.477+0000 7f0377203740 10 client.16425 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:23.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.477+0000 7f0377203740 10 client.16425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:23.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.477+0000 7f0377203740 20 client.16425 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:23.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.477+0000 7f0377203740 1 --2- 172.21.15.135:0/1017885992 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5577e24629f0 0x5577e2464e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.477+0000 7f0377203740 4 client.16425 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:25:23.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.477+0000 7f0377203740 1 -- 172.21.15.135:0/1017885992 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5577e234fa40 con 0x5577e24629f0 2024-04-20T12:25:23.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.477+0000 7f0371bac640 1 --2- 172.21.15.135:0/1017885992 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5577e24629f0 0x5577e2464e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0371bac640 1 --2- 172.21.15.135:0/1017885992 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5577e24629f0 0x5577e2464e10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24386db1d8723242 server_cookie=b1016b7d646d0d88 in_seq=0 out_seq=0 2024-04-20T12:25:23.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0355ffb640 10 client.16425 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:23.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0355ffb640 1 -- 172.21.15.135:0/1017885992 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5577e234fa40 con 0x5577e24629f0 2024-04-20T12:25:23.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0355ffb640 10 client.16425 handle_command_reply: tid=0 2024-04-20T12:25:23.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0377203740 1 client.16425 shutdown 2024-04-20T12:25:23.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0377203740 1 -- 172.21.15.135:0/1017885992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23e3640 msgr2=0x5577e23f4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0377203740 1 --2- 172.21.15.135:0/1017885992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23e3640 0x5577e23f4620 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0364006010 tx=0x7f036402cf90 comp rx=0 tx=0).stop 2024-04-20T12:25:23.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0377203740 1 -- 172.21.15.135:0/1017885992 shutdown_connections 2024-04-20T12:25:23.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0377203740 1 --2- 172.21.15.135:0/1017885992 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5577e24629f0 0x5577e2464e10 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0377203740 1 --2- 172.21.15.135:0/1017885992 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5577e23ec220 0x5577e23f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0355ffb640 0 client.16425 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:23.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0377203740 1 --2- 172.21.15.135:0/1017885992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5577e23e3640 0x5577e23f4620 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0377203740 1 --2- 172.21.15.135:0/1017885992 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5577e23e2d20 0x5577e23f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0377203740 1 -- 172.21.15.135:0/1017885992 >> 172.21.15.135:0/1017885992 conn(0x5577e23dd450 msgr2=0x5577e23de450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:23.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0377203740 1 -- 172.21.15.135:0/1017885992 shutdown_connections 2024-04-20T12:25:23.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0377203740 1 -- 172.21.15.135:0/1017885992 wait complete. 2024-04-20T12:25:23.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.478+0000 7f0377203740 20 client.16425 trim_cache size 0 max 16384 2024-04-20T12:25:23.486 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:25:23.486 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:25:23.486 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:25:23.486 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:25:23.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.479+0000 7f0374611640 1 -- 172.21.15.135:0/3489400931 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f03580a3d20 msgr2=0x7f03580a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.479+0000 7f0374611640 1 --2- 172.21.15.135:0/3489400931 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f03580a3d20 0x7f03580a61e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f03680ce780 tx=0x7f0368005a20 comp rx=0 tx=0).stop 2024-04-20T12:25:23.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.479+0000 7f0374611640 1 -- 172.21.15.135:0/3489400931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f036c10e910 msgr2=0x7f036c19a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.479+0000 7f0374611640 1 --2- 172.21.15.135:0/3489400931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f036c10e910 0x7f036c19a890 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f036800eb40 tx=0x7f036800c2d0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.479+0000 7f0374611640 1 -- 172.21.15.135:0/3489400931 shutdown_connections 2024-04-20T12:25:23.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.479+0000 7f0374611640 1 --2- 172.21.15.135:0/3489400931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f036c10e910 0x7f036c19a890 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.479+0000 7f0374611640 1 --2- 172.21.15.135:0/3489400931 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f03580a3d20 0x7f03580a61e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.479+0000 7f0374611640 1 --2- 172.21.15.135:0/3489400931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f036c101680 0x7f036c1a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.479+0000 7f0374611640 1 --2- 172.21.15.135:0/3489400931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f036c100d60 0x7f036c1a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.479+0000 7f0374611640 1 -- 172.21.15.135:0/3489400931 >> 172.21.15.135:0/3489400931 conn(0x7f036c077f60 msgr2=0x7f036c10ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:23.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.479+0000 7f0374611640 1 -- 172.21.15.135:0/3489400931 shutdown_connections 2024-04-20T12:25:23.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.479+0000 7f0374611640 1 -- 172.21.15.135:0/3489400931 wait complete. 2024-04-20T12:25:23.490 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:25:23.490 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:25:23.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.589+0000 7f1f009f4640 1 -- 172.21.15.135:0/2854855033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc106180 msgr2=0x7f1efc10dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.589+0000 7f1f009f4640 1 --2- 172.21.15.135:0/2854855033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc106180 0x7f1efc10dd50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009ca0 tx=0x7f1ef402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.589+0000 7f1f009f4640 1 -- 172.21.15.135:0/2854855033 shutdown_connections 2024-04-20T12:25:23.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.589+0000 7f1f009f4640 1 --2- 172.21.15.135:0/2854855033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc106180 0x7f1efc10dd50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.589+0000 7f1f009f4640 1 --2- 172.21.15.135:0/2854855033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1efc101a60 0x7f1efc105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.589+0000 7f1f009f4640 1 --2- 172.21.15.135:0/2854855033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1efc1010b0 0x7f1efc101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.589+0000 7f1f009f4640 1 -- 172.21.15.135:0/2854855033 >> 172.21.15.135:0/2854855033 conn(0x7f1efc077f60 msgr2=0x7f1efc078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:23.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.589+0000 7f1f009f4640 1 -- 172.21.15.135:0/2854855033 shutdown_connections 2024-04-20T12:25:23.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.589+0000 7f1f009f4640 1 -- 172.21.15.135:0/2854855033 wait complete. 2024-04-20T12:25:23.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.589+0000 7f1f009f4640 1 Processor -- start 2024-04-20T12:25:23.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.589+0000 7f1f009f4640 1 -- start start 2024-04-20T12:25:23.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1f009f4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc1010b0 0x7f1efc199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1f009f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1efc106180 0x7f1efc199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1f009f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1efc19a130 0x7f1efc1a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1f009f4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1efc111240 con 0x7f1efc1010b0 2024-04-20T12:25:23.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1f009f4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1efc1110c0 con 0x7f1efc106180 2024-04-20T12:25:23.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1f009f4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1efc1113c0 con 0x7f1efc19a130 2024-04-20T12:25:23.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1efa59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc1010b0 0x7f1efc199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1efa59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc1010b0 0x7f1efc199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50242/0 (socket says 172.21.15.135:50242) 2024-04-20T12:25:23.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1efa59c640 1 -- 172.21.15.135:0/3786574711 learned_addr learned my addr 172.21.15.135:0/3786574711 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:23.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1ef3fff640 1 --2- 172.21.15.135:0/3786574711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1efc106180 0x7f1efc199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1efa59c640 1 -- 172.21.15.135:0/3786574711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1efc19a130 msgr2=0x7f1efc1a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1efa59c640 1 --2- 172.21.15.135:0/3786574711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1efc19a130 0x7f1efc1a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1efa59c640 1 -- 172.21.15.135:0/3786574711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1efc106180 msgr2=0x7f1efc199ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1efa59c640 1 --2- 172.21.15.135:0/3786574711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1efc106180 0x7f1efc199ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1efa59c640 1 -- 172.21.15.135:0/3786574711 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1efc1a4eb0 con 0x7f1efc1010b0 2024-04-20T12:25:23.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1efa59c640 1 --2- 172.21.15.135:0/3786574711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc1010b0 0x7f1efc199660 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00d770 tx=0x7f1eec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:23.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1ef37fe640 1 -- 172.21.15.135:0/3786574711 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec017070 con 0x7f1efc1010b0 2024-04-20T12:25:23.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1ef37fe640 1 -- 172.21.15.135:0/3786574711 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1eec005500 con 0x7f1efc1010b0 2024-04-20T12:25:23.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1f009f4640 1 -- 172.21.15.135:0/3786574711 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1efc1a51a0 con 0x7f1efc1010b0 2024-04-20T12:25:23.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1ef37fe640 1 -- 172.21.15.135:0/3786574711 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec004e00 con 0x7f1efc1010b0 2024-04-20T12:25:23.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.590+0000 7f1f009f4640 1 -- 172.21.15.135:0/3786574711 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1efc1a56f0 con 0x7f1efc1010b0 2024-04-20T12:25:23.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.591+0000 7f1f009f4640 1 -- 172.21.15.135:0/3786574711 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1efc068d80 con 0x7f1efc1010b0 2024-04-20T12:25:23.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.592+0000 7f1ef37fe640 1 -- 172.21.15.135:0/3786574711 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f1eec004fa0 con 0x7f1efc1010b0 2024-04-20T12:25:23.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.593+0000 7f1ef37fe640 1 --2- 172.21.15.135:0/3786574711 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1ee80a3da0 0x7f1ee80a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.593+0000 7f1ef3fff640 1 --2- 172.21.15.135:0/3786574711 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1ee80a3da0 0x7f1ee80a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.593+0000 7f1ef37fe640 1 -- 172.21.15.135:0/3786574711 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f1eec0d0570 con 0x7f1efc1010b0 2024-04-20T12:25:23.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.593+0000 7f1ef3fff640 1 --2- 172.21.15.135:0/3786574711 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1ee80a3da0 0x7f1ee80a6260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1efc069c40 tx=0x7f1ee4005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:23.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.598+0000 7f1ef37fe640 1 -- 172.21.15.135:0/3786574711 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f1eec09c890 con 0x7f1efc1010b0 2024-04-20T12:25:23.812 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.813+0000 7f1f009f4640 1 -- 172.21.15.135:0/3786574711 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1efc101a60 con 0x7f1efc1010b0 2024-04-20T12:25:23.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.813+0000 7f1ef37fe640 1 -- 172.21.15.135:0/3786574711 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7f1eec09c190 con 0x7f1efc1010b0 2024-04-20T12:25:23.813 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:25:23.813 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:25:23.814 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:25:23.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.815+0000 7f1f009f4640 1 -- 172.21.15.135:0/3786574711 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1ee80a3da0 msgr2=0x7f1ee80a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.815+0000 7f1f009f4640 1 --2- 172.21.15.135:0/3786574711 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1ee80a3da0 0x7f1ee80a6260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1efc069c40 tx=0x7f1ee4005f90 comp rx=0 tx=0).stop 2024-04-20T12:25:23.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.815+0000 7f1f009f4640 1 -- 172.21.15.135:0/3786574711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc1010b0 msgr2=0x7f1efc199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.815+0000 7f1f009f4640 1 --2- 172.21.15.135:0/3786574711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc1010b0 0x7f1efc199660 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1eec00d770 tx=0x7f1eec00dc30 comp rx=0 tx=0).stop 2024-04-20T12:25:23.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.816+0000 7f1f009f4640 1 -- 172.21.15.135:0/3786574711 shutdown_connections 2024-04-20T12:25:23.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.816+0000 7f1f009f4640 1 --2- 172.21.15.135:0/3786574711 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1ee80a3da0 0x7f1ee80a6260 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.816+0000 7f1f009f4640 1 --2- 172.21.15.135:0/3786574711 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1efc19a130 0x7f1efc1a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.816+0000 7f1f009f4640 1 --2- 172.21.15.135:0/3786574711 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1efc106180 0x7f1efc199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.816+0000 7f1f009f4640 1 --2- 172.21.15.135:0/3786574711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1efc1010b0 0x7f1efc199660 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.816+0000 7f1f009f4640 1 -- 172.21.15.135:0/3786574711 >> 172.21.15.135:0/3786574711 conn(0x7f1efc077f60 msgr2=0x7f1efc0fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:23.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.816+0000 7f1f009f4640 1 -- 172.21.15.135:0/3786574711 shutdown_connections 2024-04-20T12:25:23.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.816+0000 7f1f009f4640 1 -- 172.21.15.135:0/3786574711 wait complete. 2024-04-20T12:25:23.827 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:25:23.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.927+0000 7ff59da93640 1 -- 172.21.15.135:0/3052162644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5981031d0 msgr2=0x7ff5981035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.927+0000 7ff59da93640 1 --2- 172.21.15.135:0/3052162644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5981031d0 0x7ff5981035b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7ff588009900 tx=0x7ff58802bcd0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff59da93640 1 -- 172.21.15.135:0/3052162644 shutdown_connections 2024-04-20T12:25:23.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff59da93640 1 --2- 172.21.15.135:0/3052162644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff59810c5a0 0x7ff59810e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff59da93640 1 --2- 172.21.15.135:0/3052162644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff598103af0 0x7ff59810bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff59da93640 1 --2- 172.21.15.135:0/3052162644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5981031d0 0x7ff5981035b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff59da93640 1 -- 172.21.15.135:0/3052162644 >> 172.21.15.135:0/3052162644 conn(0x7ff598077f80 msgr2=0x7ff598078390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:23.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff59da93640 1 -- 172.21.15.135:0/3052162644 shutdown_connections 2024-04-20T12:25:23.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff59da93640 1 -- 172.21.15.135:0/3052162644 wait complete. 2024-04-20T12:25:23.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff59da93640 1 Processor -- start 2024-04-20T12:25:23.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff59da93640 1 -- start start 2024-04-20T12:25:23.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff59da93640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5981031d0 0x7ff59819e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff59da93640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff598103af0 0x7ff59819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff59da93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff59810c5a0 0x7ff5981986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff59da93640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff598112340 con 0x7ff598103af0 2024-04-20T12:25:23.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff59da93640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff5981121c0 con 0x7ff5981031d0 2024-04-20T12:25:23.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff59da93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5981124c0 con 0x7ff59810c5a0 2024-04-20T12:25:23.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff58ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff598103af0 0x7ff59819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff58ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff598103af0 0x7ff59819eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50264/0 (socket says 172.21.15.135:50264) 2024-04-20T12:25:23.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.928+0000 7ff58ffff640 1 -- 172.21.15.135:0/3540834933 learned_addr learned my addr 172.21.15.135:0/3540834933 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:23.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.929+0000 7ff5977fe640 1 --2- 172.21.15.135:0/3540834933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5981031d0 0x7ff59819e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.929+0000 7ff597fff640 1 --2- 172.21.15.135:0/3540834933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff59810c5a0 0x7ff5981986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.929+0000 7ff58ffff640 1 -- 172.21.15.135:0/3540834933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff59810c5a0 msgr2=0x7ff5981986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.929+0000 7ff58ffff640 1 --2- 172.21.15.135:0/3540834933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff59810c5a0 0x7ff5981986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.929+0000 7ff58ffff640 1 -- 172.21.15.135:0/3540834933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5981031d0 msgr2=0x7ff59819e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.929+0000 7ff58ffff640 1 --2- 172.21.15.135:0/3540834933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5981031d0 0x7ff59819e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.929+0000 7ff58ffff640 1 -- 172.21.15.135:0/3540834933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff598198fa0 con 0x7ff598103af0 2024-04-20T12:25:23.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.929+0000 7ff58ffff640 1 --2- 172.21.15.135:0/3540834933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff598103af0 0x7ff59819eb10 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff58000d950 tx=0x7ff58000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:23.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.929+0000 7ff5957fa640 1 -- 172.21.15.135:0/3540834933 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580017070 con 0x7ff598103af0 2024-04-20T12:25:23.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.929+0000 7ff5957fa640 1 -- 172.21.15.135:0/3540834933 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff580009c30 con 0x7ff598103af0 2024-04-20T12:25:23.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.929+0000 7ff59da93640 1 -- 172.21.15.135:0/3540834933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff598199290 con 0x7ff598103af0 2024-04-20T12:25:23.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.929+0000 7ff5957fa640 1 -- 172.21.15.135:0/3540834933 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58000f6b0 con 0x7ff598103af0 2024-04-20T12:25:23.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.929+0000 7ff59da93640 1 -- 172.21.15.135:0/3540834933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5981a5550 con 0x7ff598103af0 2024-04-20T12:25:23.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.931+0000 7ff5957fa640 1 -- 172.21.15.135:0/3540834933 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7ff5800109d0 con 0x7ff598103af0 2024-04-20T12:25:23.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.931+0000 7ff5a0767740 1 Processor -- start 2024-04-20T12:25:23.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.931+0000 7ff5a0767740 1 -- start start 2024-04-20T12:25:23.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff5a0767740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fbac0 0x5564a33fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff5a0767740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fc3e0 0x5564a34091e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff5a0767740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a3409720 0x5564a340bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff5a0767740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5564a3361110 con 0x5564a33fbac0 2024-04-20T12:25:23.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff5a0767740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5564a32fe550 con 0x5564a3409720 2024-04-20T12:25:23.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff5a0767740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5564a335d0d0 con 0x5564a33fc3e0 2024-04-20T12:25:23.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff5957fa640 1 --2- 172.21.15.135:0/3540834933 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5840a3d20 0x7ff5840a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff597fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fbac0 0x5564a33fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff597fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fbac0 0x5564a33fbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50270/0 (socket says 172.21.15.135:50270) 2024-04-20T12:25:23.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff597fff640 1 -- 172.21.15.135:0/3700642333 learned_addr learned my addr 172.21.15.135:0/3700642333 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:23.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff597fff640 1 --2- 172.21.15.135:0/3540834933 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5840a3d20 0x7ff5840a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff5977fe640 1 --2- 172.21.15.135:0/3700642333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fc3e0 0x5564a34091e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff5957fa640 1 -- 172.21.15.135:0/3540834933 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff5800d07b0 con 0x7ff598103af0 2024-04-20T12:25:23.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff58ffff640 1 --2- 172.21.15.135:0/3700642333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a3409720 0x5564a340bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff597fff640 1 -- 172.21.15.135:0/3700642333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fc3e0 msgr2=0x5564a34091e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff597fff640 1 --2- 172.21.15.135:0/3700642333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fc3e0 0x5564a34091e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff597fff640 1 -- 172.21.15.135:0/3700642333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a3409720 msgr2=0x5564a340bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff597fff640 1 --2- 172.21.15.135:0/3700642333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a3409720 0x5564a340bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff597fff640 1 -- 172.21.15.135:0/3700642333 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564a3326900 con 0x5564a33fbac0 2024-04-20T12:25:23.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff597fff640 1 --2- 172.21.15.135:0/3700642333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fbac0 0x5564a33fbea0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff590012cf0 tx=0x7ff5900107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4bc7c5b3242e1e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:23.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff597fff640 1 --2- 172.21.15.135:0/3540834933 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5840a3d20 0x7ff5840a61e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff590005c40 tx=0x7ff59001d000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:23.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.932+0000 7ff58dffb640 1 -- 172.21.15.135:0/3700642333 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff590012ea0 con 0x5564a33fbac0 2024-04-20T12:25:23.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.933+0000 7ff58dffb640 1 -- 172.21.15.135:0/3700642333 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff590003e50 con 0x5564a33fbac0 2024-04-20T12:25:23.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.933+0000 7ff58dffb640 1 -- 172.21.15.135:0/3700642333 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff590004030 con 0x5564a33fbac0 2024-04-20T12:25:23.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.933+0000 7ff5a0767740 1 -- 172.21.15.135:0/3700642333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fbac0 msgr2=0x5564a33fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.933+0000 7ff5a0767740 1 --2- 172.21.15.135:0/3700642333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fbac0 0x5564a33fbea0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff590012cf0 tx=0x7ff5900107a0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.933+0000 7ff5a0767740 1 -- 172.21.15.135:0/3700642333 shutdown_connections 2024-04-20T12:25:23.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.933+0000 7ff5a0767740 1 --2- 172.21.15.135:0/3700642333 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a3409720 0x5564a340bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.933+0000 7ff5a0767740 1 --2- 172.21.15.135:0/3700642333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fc3e0 0x5564a34091e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.933+0000 7ff5a0767740 1 --2- 172.21.15.135:0/3700642333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fbac0 0x5564a33fbea0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.933+0000 7ff5a0767740 1 -- 172.21.15.135:0/3700642333 >> 172.21.15.135:0/3700642333 conn(0x5564a33f6540 msgr2=0x5564a33f6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:23.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.933+0000 7ff5a0767740 1 -- 172.21.15.135:0/3700642333 shutdown_connections 2024-04-20T12:25:23.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.933+0000 7ff5a0767740 1 -- 172.21.15.135:0/3700642333 wait complete. 2024-04-20T12:25:23.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.933+0000 7ff5a0767740 1 -- start start 2024-04-20T12:25:23.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5a0767740 1 Processor -- start 2024-04-20T12:25:23.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5a0767740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fbac0 0x5564a3406750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5a0767740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fc3e0 0x5564a3406c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5a0767740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a3409720 0x5564a34071d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5a0767740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5564a340c500 con 0x5564a33fbac0 2024-04-20T12:25:23.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5a0767740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5564a331a500 con 0x5564a3409720 2024-04-20T12:25:23.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5a0767740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5564a340c680 con 0x5564a33fc3e0 2024-04-20T12:25:23.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5a0767740 10 client.0 _ll_register_callbacks cb 0x5564a32ff2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:23.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fbac0 0x5564a3406750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fbac0 0x5564a3406750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50272/0 (socket says 172.21.15.135:50272) 2024-04-20T12:25:23.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5977fe640 1 -- 172.21.15.135:0/141319868 learned_addr learned my addr 172.21.15.135:0/141319868 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:23.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff597fff640 1 --2- 172.21.15.135:0/141319868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a3409720 0x5564a34071d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff58ffff640 1 --2- 172.21.15.135:0/141319868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fc3e0 0x5564a3406c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5977fe640 1 -- 172.21.15.135:0/141319868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fc3e0 msgr2=0x5564a3406c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5977fe640 1 --2- 172.21.15.135:0/141319868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fc3e0 0x5564a3406c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5977fe640 1 -- 172.21.15.135:0/141319868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a3409720 msgr2=0x5564a34071d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5977fe640 1 --2- 172.21.15.135:0/141319868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a3409720 0x5564a34071d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5977fe640 1 -- 172.21.15.135:0/141319868 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564a30733f0 con 0x5564a33fbac0 2024-04-20T12:25:23.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.934+0000 7ff5977fe640 1 --2- 172.21.15.135:0/141319868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fbac0 0x5564a3406750 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff58802c210 tx=0x7ff58802ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1949127bb3f345 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:23.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff576ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:23.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff576ffd640 1 -- 172.21.15.135:0/141319868 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff588004240 con 0x5564a33fbac0 2024-04-20T12:25:23.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff576ffd640 1 -- 172.21.15.135:0/141319868 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff5880043e0 con 0x5564a33fbac0 2024-04-20T12:25:23.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff5a0767740 1 -- 172.21.15.135:0/141319868 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff590003e50 con 0x5564a33fbac0 2024-04-20T12:25:23.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff576ffd640 1 -- 172.21.15.135:0/141319868 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff5880046c0 con 0x5564a33fbac0 2024-04-20T12:25:23.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff5a0767740 10 client.16443 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:23.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff5a0767740 1 -- 172.21.15.135:0/141319868 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564a313d7d0 con 0x5564a33fbac0 2024-04-20T12:25:23.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff576ffd640 1 -- 172.21.15.135:0/141319868 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff590003e50 con 0x5564a33fbac0 2024-04-20T12:25:23.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff576ffd640 1 -- 172.21.15.135:0/141319868 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7ff5880035f0 con 0x5564a33fbac0 2024-04-20T12:25:23.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff5a0767740 10 client.16443 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:23.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff5a0767740 10 client.16443 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:25:23.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff5a0767740 20 client.16443 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:23.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff5a0767740 1 --2- 172.21.15.135:0/141319868 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5564a3419af0 0x5564a341bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff5a0767740 4 client.16443 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:23.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff5a0767740 1 -- 172.21.15.135:0/141319868 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564a336eb30 con 0x5564a3419af0 2024-04-20T12:25:23.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.935+0000 7ff58ffff640 1 --2- 172.21.15.135:0/141319868 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5564a3419af0 0x5564a341bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.936+0000 7ff58ffff640 1 --2- 172.21.15.135:0/141319868 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5564a3419af0 0x5564a341bf40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=68966e83360bf6b server_cookie=e97e940ac45bec2d in_seq=0 out_seq=0 2024-04-20T12:25:23.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.936+0000 7ff576ffd640 10 client.16443 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:25:23.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.936+0000 7ff576ffd640 1 -- 172.21.15.135:0/141319868 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5564a336eb30 con 0x5564a3419af0 2024-04-20T12:25:23.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.936+0000 7ff576ffd640 10 client.16443 handle_command_reply: tid=0 2024-04-20T12:25:23.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.936+0000 7ff5a0767740 1 client.16443 shutdown 2024-04-20T12:25:23.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.936+0000 7ff5a0767740 1 -- 172.21.15.135:0/141319868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fbac0 msgr2=0x5564a3406750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.936+0000 7ff5a0767740 1 --2- 172.21.15.135:0/141319868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fbac0 0x5564a3406750 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff58802c210 tx=0x7ff58802ce20 comp rx=0 tx=0).stop 2024-04-20T12:25:23.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.936+0000 7ff5a0767740 1 -- 172.21.15.135:0/141319868 shutdown_connections 2024-04-20T12:25:23.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.936+0000 7ff5a0767740 1 --2- 172.21.15.135:0/141319868 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5564a3419af0 0x5564a341bf40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.936+0000 7ff5a0767740 1 --2- 172.21.15.135:0/141319868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a3409720 0x5564a34071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.936+0000 7ff5a0767740 1 --2- 172.21.15.135:0/141319868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fc3e0 0x5564a3406c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.937+0000 7ff576ffd640 0 client.16443 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:25:23.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.937+0000 7ff5a0767740 1 --2- 172.21.15.135:0/141319868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fbac0 0x5564a3406750 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.937+0000 7ff5a0767740 1 -- 172.21.15.135:0/141319868 >> 172.21.15.135:0/141319868 conn(0x5564a33f6540 msgr2=0x5564a33f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:23.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.937+0000 7ff5a0767740 1 -- 172.21.15.135:0/141319868 shutdown_connections 2024-04-20T12:25:23.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.937+0000 7ff5a0767740 1 -- 172.21.15.135:0/141319868 wait complete. 2024-04-20T12:25:23.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.937+0000 7ff5a0767740 20 client.16443 trim_cache size 0 max 16384 2024-04-20T12:25:23.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff5a0767740 1 Processor -- start 2024-04-20T12:25:23.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff5a0767740 1 -- start start 2024-04-20T12:25:23.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff5a0767740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a33fbac0 0x5564a3408e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff5a0767740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fc3e0 0x5564a3415460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff5a0767740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a3409720 0x5564a34058b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff5a0767740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff5981ad220 con 0x5564a3409720 2024-04-20T12:25:23.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff5a0767740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff5981aed60 con 0x5564a33fbac0 2024-04-20T12:25:23.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff5a0767740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5981ad8f0 con 0x5564a33fc3e0 2024-04-20T12:25:23.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff597fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a3409720 0x5564a34058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff597fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a3409720 0x5564a34058b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50284/0 (socket says 172.21.15.135:50284) 2024-04-20T12:25:23.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff597fff640 1 -- 172.21.15.135:0/3419334419 learned_addr learned my addr 172.21.15.135:0/3419334419 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:23.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff5977fe640 1 --2- 172.21.15.135:0/3419334419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a33fbac0 0x5564a3408e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff597fff640 1 -- 172.21.15.135:0/3419334419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fc3e0 msgr2=0x5564a3415460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff597fff640 1 --2- 172.21.15.135:0/3419334419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fc3e0 0x5564a3415460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff597fff640 1 -- 172.21.15.135:0/3419334419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a33fbac0 msgr2=0x5564a3408e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff597fff640 1 --2- 172.21.15.135:0/3419334419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a33fbac0 0x5564a3408e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff597fff640 1 -- 172.21.15.135:0/3419334419 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564a33fc210 con 0x5564a3409720 2024-04-20T12:25:23.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff5977fe640 1 --2- 172.21.15.135:0/3419334419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a33fbac0 0x5564a3408e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:23.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff597fff640 1 --2- 172.21.15.135:0/3419334419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a3409720 0x5564a34058b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff590012cf0 tx=0x7ff5900127d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754a9d6996203d8d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:23.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff58d7fa640 1 -- 172.21.15.135:0/3419334419 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59001b040 con 0x5564a3409720 2024-04-20T12:25:23.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff58d7fa640 1 -- 172.21.15.135:0/3419334419 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff590009ce0 con 0x5564a3409720 2024-04-20T12:25:23.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.950+0000 7ff58d7fa640 1 -- 172.21.15.135:0/3419334419 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59000dba0 con 0x5564a3409720 2024-04-20T12:25:23.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.951+0000 7ff5a0767740 1 -- 172.21.15.135:0/3419334419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a3409720 msgr2=0x5564a34058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.951+0000 7ff5a0767740 1 --2- 172.21.15.135:0/3419334419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a3409720 0x5564a34058b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff590012cf0 tx=0x7ff5900127d0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.951+0000 7ff5a0767740 1 -- 172.21.15.135:0/3419334419 shutdown_connections 2024-04-20T12:25:23.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.951+0000 7ff5a0767740 1 --2- 172.21.15.135:0/3419334419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a3409720 0x5564a34058b0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.951+0000 7ff5a0767740 1 --2- 172.21.15.135:0/3419334419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fc3e0 0x5564a3415460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.951+0000 7ff5a0767740 1 --2- 172.21.15.135:0/3419334419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a33fbac0 0x5564a3408e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.951+0000 7ff5a0767740 1 -- 172.21.15.135:0/3419334419 >> 172.21.15.135:0/3419334419 conn(0x5564a33f6540 msgr2=0x5564a33f7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:23.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.951+0000 7ff5a0767740 1 -- 172.21.15.135:0/3419334419 shutdown_connections 2024-04-20T12:25:23.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.951+0000 7ff5a0767740 1 -- 172.21.15.135:0/3419334419 wait complete. 2024-04-20T12:25:23.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.951+0000 7ff5a0767740 1 -- start start 2024-04-20T12:25:23.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff5a0767740 1 Processor -- start 2024-04-20T12:25:23.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff5a0767740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fbac0 0x5564a3411dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff5a0767740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fc3e0 0x5564a340d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff5a0767740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a3409720 0x5564a340d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff5a0767740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff5981ae690 con 0x5564a33fc3e0 2024-04-20T12:25:23.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff5a0767740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff5981adfc0 con 0x5564a3409720 2024-04-20T12:25:23.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff5a0767740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5981ab1f0 con 0x5564a33fbac0 2024-04-20T12:25:23.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff5a0767740 10 client.0 _ll_register_callbacks cb 0x7ff588009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:23.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff58ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fc3e0 0x5564a340d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff58ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fc3e0 0x5564a340d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50286/0 (socket says 172.21.15.135:50286) 2024-04-20T12:25:23.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff58ffff640 1 -- 172.21.15.135:0/145826502 learned_addr learned my addr 172.21.15.135:0/145826502 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:23.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff597fff640 1 --2- 172.21.15.135:0/145826502 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a3409720 0x5564a340d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff5977fe640 1 --2- 172.21.15.135:0/145826502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fbac0 0x5564a3411dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff58ffff640 1 -- 172.21.15.135:0/145826502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fbac0 msgr2=0x5564a3411dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff58ffff640 1 --2- 172.21.15.135:0/145826502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fbac0 0x5564a3411dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff58ffff640 1 -- 172.21.15.135:0/145826502 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a3409720 msgr2=0x5564a340d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:23.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff58ffff640 1 --2- 172.21.15.135:0/145826502 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a3409720 0x5564a340d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff58ffff640 1 -- 172.21.15.135:0/145826502 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564a340dee0 con 0x5564a33fc3e0 2024-04-20T12:25:23.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff5977fe640 1 --2- 172.21.15.135:0/145826502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fbac0 0x5564a3411dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:23.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff58ffff640 1 --2- 172.21.15.135:0/145826502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fc3e0 0x5564a340d130 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff580010fd0 tx=0x7ff58000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35dbcac28a4ade44 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:23.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff576ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:23.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.952+0000 7ff576ffd640 1 -- 172.21.15.135:0/145826502 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580020040 con 0x5564a33fc3e0 2024-04-20T12:25:23.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff576ffd640 1 -- 172.21.15.135:0/145826502 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff580098a40 con 0x5564a33fc3e0 2024-04-20T12:25:23.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff5a0767740 1 -- 172.21.15.135:0/145826502 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff590009ce0 con 0x5564a33fc3e0 2024-04-20T12:25:23.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff576ffd640 1 -- 172.21.15.135:0/145826502 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff5800a5040 con 0x5564a33fc3e0 2024-04-20T12:25:23.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff5a0767740 10 client.16449 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:23.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff5a0767740 1 -- 172.21.15.135:0/145826502 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564a3480090 con 0x5564a33fc3e0 2024-04-20T12:25:23.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff576ffd640 1 -- 172.21.15.135:0/145826502 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff590009ce0 con 0x5564a33fc3e0 2024-04-20T12:25:23.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff576ffd640 1 -- 172.21.15.135:0/145826502 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7ff5800b5b50 con 0x5564a33fc3e0 2024-04-20T12:25:23.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff5a0767740 10 client.16449 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:23.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff5a0767740 10 client.16449 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:25:23.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff5a0767740 20 client.16449 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:23.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff5a0767740 1 --2- 172.21.15.135:0/145826502 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5564a3480710 0x5564a3482b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff5a0767740 4 client.16449 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:25:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff5a0767740 1 -- 172.21.15.135:0/145826502 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5564a33689a0 con 0x5564a3480710 2024-04-20T12:25:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff5977fe640 1 --2- 172.21.15.135:0/145826502 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5564a3480710 0x5564a3482b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff5977fe640 1 --2- 172.21.15.135:0/145826502 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5564a3480710 0x5564a3482b30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4cd51f4bc4a003bb server_cookie=bfa43edd71a8564b in_seq=0 out_seq=0 2024-04-20T12:25:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.953+0000 7ff576ffd640 10 client.16449 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:25:23.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff576ffd640 1 -- 172.21.15.135:0/145826502 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5564a33689a0 con 0x5564a3480710 2024-04-20T12:25:23.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff576ffd640 10 client.16449 handle_command_reply: tid=0 2024-04-20T12:25:23.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff5a0767740 1 client.16449 shutdown 2024-04-20T12:25:23.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff5a0767740 1 -- 172.21.15.135:0/145826502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fc3e0 msgr2=0x5564a340d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff5a0767740 1 --2- 172.21.15.135:0/145826502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fc3e0 0x5564a340d130 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff580010fd0 tx=0x7ff58000bf60 comp rx=0 tx=0).stop 2024-04-20T12:25:23.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff5a0767740 1 -- 172.21.15.135:0/145826502 shutdown_connections 2024-04-20T12:25:23.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff5a0767740 1 --2- 172.21.15.135:0/145826502 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5564a3480710 0x5564a3482b30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff5a0767740 1 --2- 172.21.15.135:0/145826502 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5564a3409720 0x5564a340d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff576ffd640 0 client.16449 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:25:23.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff5a0767740 1 --2- 172.21.15.135:0/145826502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5564a33fc3e0 0x5564a340d130 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff5a0767740 1 --2- 172.21.15.135:0/145826502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5564a33fbac0 0x5564a3411dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff5a0767740 1 -- 172.21.15.135:0/145826502 >> 172.21.15.135:0/145826502 conn(0x5564a33f6540 msgr2=0x5564a33f4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:23.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff5a0767740 1 -- 172.21.15.135:0/145826502 shutdown_connections 2024-04-20T12:25:23.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff5a0767740 1 -- 172.21.15.135:0/145826502 wait complete. 2024-04-20T12:25:23.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff5a0767740 20 client.16449 trim_cache size 0 max 16384 2024-04-20T12:25:23.981 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:25:23.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff59da93640 1 -- 172.21.15.135:0/3540834933 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5840a3d20 msgr2=0x7ff5840a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff59da93640 1 --2- 172.21.15.135:0/3540834933 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5840a3d20 0x7ff5840a61e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff590005c40 tx=0x7ff59001d000 comp rx=0 tx=0).stop 2024-04-20T12:25:23.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff59da93640 1 -- 172.21.15.135:0/3540834933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff598103af0 msgr2=0x7ff59819eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:23.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff59da93640 1 --2- 172.21.15.135:0/3540834933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff598103af0 0x7ff59819eb10 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff58000d950 tx=0x7ff58000de10 comp rx=0 tx=0).stop 2024-04-20T12:25:23.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff59da93640 1 -- 172.21.15.135:0/3540834933 shutdown_connections 2024-04-20T12:25:23.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff59da93640 1 --2- 172.21.15.135:0/3540834933 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5840a3d20 0x7ff5840a61e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff59da93640 1 --2- 172.21.15.135:0/3540834933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff59810c5a0 0x7ff5981986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff59da93640 1 --2- 172.21.15.135:0/3540834933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff598103af0 0x7ff59819eb10 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff59da93640 1 --2- 172.21.15.135:0/3540834933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5981031d0 0x7ff59819e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:23.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff59da93640 1 -- 172.21.15.135:0/3540834933 >> 172.21.15.135:0/3540834933 conn(0x7ff598077f80 msgr2=0x7ff5980ff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:23.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff59da93640 1 -- 172.21.15.135:0/3540834933 shutdown_connections 2024-04-20T12:25:23.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:23.954+0000 7ff59da93640 1 -- 172.21.15.135:0/3540834933 wait complete. 2024-04-20T12:25:23.986 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:25:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.086+0000 7fe640350640 1 -- 172.21.15.135:0/3307570606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638107fa0 msgr2=0x7fe638108380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.086+0000 7fe640350640 1 --2- 172.21.15.135:0/3307570606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638107fa0 0x7fe638108380 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe634009930 tx=0x7fe63402bc30 comp rx=0 tx=0).stop 2024-04-20T12:25:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.086+0000 7fe640350640 1 -- 172.21.15.135:0/3307570606 shutdown_connections 2024-04-20T12:25:24.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.086+0000 7fe640350640 1 --2- 172.21.15.135:0/3307570606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe63806af80 0x7fe63810edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.086+0000 7fe640350640 1 --2- 172.21.15.135:0/3307570606 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe63806a600 0x7fe63806aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.086+0000 7fe640350640 1 --2- 172.21.15.135:0/3307570606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638107fa0 0x7fe638108380 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.086+0000 7fe640350640 1 -- 172.21.15.135:0/3307570606 >> 172.21.15.135:0/3307570606 conn(0x7fe638077e40 msgr2=0x7fe638078250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.086+0000 7fe640350640 1 -- 172.21.15.135:0/3307570606 shutdown_connections 2024-04-20T12:25:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.086+0000 7fe640350640 1 -- 172.21.15.135:0/3307570606 wait complete. 2024-04-20T12:25:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe640350640 1 Processor -- start 2024-04-20T12:25:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe640350640 1 -- start start 2024-04-20T12:25:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe640350640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe63806a600 0x7fe63819e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe640350640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe63806af80 0x7fe63819e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe640350640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638107fa0 0x7fe6381985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe640350640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe6381122d0 con 0x7fe638107fa0 2024-04-20T12:25:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe640350640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe638112150 con 0x7fe63806af80 2024-04-20T12:25:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe640350640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe638112450 con 0x7fe63806a600 2024-04-20T12:25:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe63e8ed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638107fa0 0x7fe6381985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe63e8ed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638107fa0 0x7fe6381985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50296/0 (socket says 172.21.15.135:50296) 2024-04-20T12:25:24.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe63e8ed640 1 -- 172.21.15.135:0/2400441681 learned_addr learned my addr 172.21.15.135:0/2400441681 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe63e0ec640 1 --2- 172.21.15.135:0/2400441681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe63806a600 0x7fe63819e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe63d8eb640 1 --2- 172.21.15.135:0/2400441681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe63806af80 0x7fe63819e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe63e8ed640 1 -- 172.21.15.135:0/2400441681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe63806a600 msgr2=0x7fe63819e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe63e8ed640 1 --2- 172.21.15.135:0/2400441681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe63806a600 0x7fe63819e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe63e8ed640 1 -- 172.21.15.135:0/2400441681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe63806af80 msgr2=0x7fe63819e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe63e8ed640 1 --2- 172.21.15.135:0/2400441681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe63806af80 0x7fe63819e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe63e8ed640 1 -- 172.21.15.135:0/2400441681 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe638198d50 con 0x7fe638107fa0 2024-04-20T12:25:24.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe63d8eb640 1 --2- 172.21.15.135:0/2400441681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe63806af80 0x7fe63819e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:24.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.087+0000 7fe63e8ed640 1 --2- 172.21.15.135:0/2400441681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638107fa0 0x7fe6381985d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe63000eaa0 tx=0x7fe63000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.088+0000 7fe62f7fe640 1 -- 172.21.15.135:0/2400441681 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63000cdb0 con 0x7fe638107fa0 2024-04-20T12:25:24.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.088+0000 7fe62f7fe640 1 -- 172.21.15.135:0/2400441681 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe630005020 con 0x7fe638107fa0 2024-04-20T12:25:24.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.088+0000 7fe640350640 1 -- 172.21.15.135:0/2400441681 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe638199040 con 0x7fe638107fa0 2024-04-20T12:25:24.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.088+0000 7fe62f7fe640 1 -- 172.21.15.135:0/2400441681 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300116d0 con 0x7fe638107fa0 2024-04-20T12:25:24.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.088+0000 7fe640350640 1 -- 172.21.15.135:0/2400441681 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6381a52e0 con 0x7fe638107fa0 2024-04-20T12:25:24.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.090+0000 7fe62f7fe640 1 -- 172.21.15.135:0/2400441681 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fe6300054d0 con 0x7fe638107fa0 2024-04-20T12:25:24.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.090+0000 7fe643019740 1 Processor -- start 2024-04-20T12:25:24.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe643019740 1 -- start start 2024-04-20T12:25:24.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe643019740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b977ce10 0x5591b977d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe643019740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b977d730 0x5591b9785dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe62f7fe640 1 --2- 172.21.15.135:0/2400441681 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe6240a3d20 0x7fe6240a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe643019740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b9786310 0x5591b9788700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe643019740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5591b96e2110 con 0x5591b977d730 2024-04-20T12:25:24.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe643019740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5591b967f550 con 0x5591b977ce10 2024-04-20T12:25:24.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe643019740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5591b96de0d0 con 0x5591b9786310 2024-04-20T12:25:24.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe63e0ec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b977d730 0x5591b9785dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe62f7fe640 1 -- 172.21.15.135:0/2400441681 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe6300d0d50 con 0x7fe638107fa0 2024-04-20T12:25:24.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe63e0ec640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b977d730 0x5591b9785dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50310/0 (socket says 172.21.15.135:50310) 2024-04-20T12:25:24.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe63d8eb640 1 --2- 172.21.15.135:0/2400441681 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe6240a3d20 0x7fe6240a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe63e0ec640 1 -- 172.21.15.135:0/1776371695 learned_addr learned my addr 172.21.15.135:0/1776371695 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe63e8ed640 1 --2- 172.21.15.135:0/1776371695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b9786310 0x5591b9788700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe63d8eb640 1 --2- 172.21.15.135:0/1776371695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b977ce10 0x5591b977d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe63e0ec640 1 -- 172.21.15.135:0/1776371695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b9786310 msgr2=0x5591b9788700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe63e0ec640 1 --2- 172.21.15.135:0/1776371695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b9786310 0x5591b9788700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe63e0ec640 1 -- 172.21.15.135:0/1776371695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b977ce10 msgr2=0x5591b977d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe63e0ec640 1 --2- 172.21.15.135:0/1776371695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b977ce10 0x5591b977d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe63e0ec640 1 -- 172.21.15.135:0/1776371695 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591b96a7900 con 0x5591b977d730 2024-04-20T12:25:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe63e0ec640 1 --2- 172.21.15.135:0/1776371695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b977d730 0x5591b9785dd0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe63402cfd0 tx=0x7fe63402c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88fb0da410b671b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.091+0000 7fe63d8eb640 1 --2- 172.21.15.135:0/2400441681 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe6240a3d20 0x7fe6240a61e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe6381076e0 tx=0x7fe62800b7e0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.092+0000 7fe62cbfe640 1 -- 172.21.15.135:0/1776371695 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634042070 con 0x5591b977d730 2024-04-20T12:25:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.092+0000 7fe62cbfe640 1 -- 172.21.15.135:0/1776371695 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe63402ca80 con 0x5591b977d730 2024-04-20T12:25:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.092+0000 7fe62cbfe640 1 -- 172.21.15.135:0/1776371695 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634004f50 con 0x5591b977d730 2024-04-20T12:25:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.092+0000 7fe643019740 1 -- 172.21.15.135:0/1776371695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b977d730 msgr2=0x5591b9785dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.092+0000 7fe643019740 1 --2- 172.21.15.135:0/1776371695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b977d730 0x5591b9785dd0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe63402cfd0 tx=0x7fe63402c5d0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.092+0000 7fe643019740 1 -- 172.21.15.135:0/1776371695 shutdown_connections 2024-04-20T12:25:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.092+0000 7fe643019740 1 --2- 172.21.15.135:0/1776371695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b9786310 0x5591b9788700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.092+0000 7fe643019740 1 --2- 172.21.15.135:0/1776371695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b977d730 0x5591b9785dd0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.092+0000 7fe643019740 1 --2- 172.21.15.135:0/1776371695 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b977ce10 0x5591b977d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.092+0000 7fe643019740 1 -- 172.21.15.135:0/1776371695 >> 172.21.15.135:0/1776371695 conn(0x5591b9777540 msgr2=0x5591b9777920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.092+0000 7fe643019740 1 -- 172.21.15.135:0/1776371695 shutdown_connections 2024-04-20T12:25:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.092+0000 7fe643019740 1 -- 172.21.15.135:0/1776371695 wait complete. 2024-04-20T12:25:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe643019740 1 -- start start 2024-04-20T12:25:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe643019740 1 Processor -- start 2024-04-20T12:25:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe643019740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977ce10 0x5591b9783330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe643019740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b977d730 0x5591b9783870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe643019740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b9786310 0x5591b9783db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe643019740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5591b9789040 con 0x5591b977d730 2024-04-20T12:25:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe643019740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5591b969b500 con 0x5591b9786310 2024-04-20T12:25:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe643019740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5591b97891c0 con 0x5591b977ce10 2024-04-20T12:25:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe643019740 10 client.0 _ll_register_callbacks cb 0x5591b96802f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe63d8eb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b977d730 0x5591b9783870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe63d8eb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b977d730 0x5591b9783870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50326/0 (socket says 172.21.15.135:50326) 2024-04-20T12:25:24.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe63d8eb640 1 -- 172.21.15.135:0/3590155278 learned_addr learned my addr 172.21.15.135:0/3590155278 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe63e0ec640 1 --2- 172.21.15.135:0/3590155278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977ce10 0x5591b9783330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe63d8eb640 1 -- 172.21.15.135:0/3590155278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977ce10 msgr2=0x5591b9783330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe63d8eb640 1 --2- 172.21.15.135:0/3590155278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977ce10 0x5591b9783330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe63d8eb640 1 -- 172.21.15.135:0/3590155278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b9786310 msgr2=0x5591b9783db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe63e8ed640 1 --2- 172.21.15.135:0/3590155278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b9786310 0x5591b9783db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe63d8eb640 1 --2- 172.21.15.135:0/3590155278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b9786310 0x5591b9783db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.093+0000 7fe63d8eb640 1 -- 172.21.15.135:0/3590155278 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591b93f43f0 con 0x5591b977d730 2024-04-20T12:25:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe63d8eb640 1 --2- 172.21.15.135:0/3590155278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b977d730 0x5591b9783870 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe628003920 tx=0x7fe628005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd128a46a4222340 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe621ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe621ffb640 1 -- 172.21.15.135:0/3590155278 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe628022030 con 0x5591b977d730 2024-04-20T12:25:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe621ffb640 1 -- 172.21.15.135:0/3590155278 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe628010ad0 con 0x5591b977d730 2024-04-20T12:25:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe643019740 1 -- 172.21.15.135:0/3590155278 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe63402ca80 con 0x5591b977d730 2024-04-20T12:25:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe621ffb640 1 -- 172.21.15.135:0/3590155278 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe62802f050 con 0x5591b977d730 2024-04-20T12:25:24.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe643019740 10 client.16461 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe643019740 1 -- 172.21.15.135:0/3590155278 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5591b94be7d0 con 0x5591b977d730 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe621ffb640 1 -- 172.21.15.135:0/3590155278 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe63402ca80 con 0x5591b977d730 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe621ffb640 1 -- 172.21.15.135:0/3590155278 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe62801ece0 con 0x5591b977d730 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe643019740 10 client.16461 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe643019740 10 client.16461 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe643019740 20 client.16461 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe643019740 1 --2- 172.21.15.135:0/3590155278 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5591b97966d0 0x5591b9798b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe643019740 4 client.16461 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.094+0000 7fe643019740 1 -- 172.21.15.135:0/3590155278 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591b96efb30 con 0x5591b97966d0 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.095+0000 7fe63e0ec640 1 --2- 172.21.15.135:0/3590155278 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5591b97966d0 0x5591b9798b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.095+0000 7fe621ffb640 10 client.16461 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.095+0000 7fe63e0ec640 1 --2- 172.21.15.135:0/3590155278 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5591b97966d0 0x5591b9798b10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=88cd7350ad67dea3 server_cookie=c678ac7f9f2a776d in_seq=0 out_seq=0 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.096+0000 7fe621ffb640 1 -- 172.21.15.135:0/3590155278 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5591b96efb30 con 0x5591b97966d0 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.096+0000 7fe621ffb640 10 client.16461 handle_command_reply: tid=0 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.096+0000 7fe643019740 1 client.16461 shutdown 2024-04-20T12:25:24.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.096+0000 7fe643019740 1 -- 172.21.15.135:0/3590155278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b977d730 msgr2=0x5591b9783870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.096+0000 7fe643019740 1 --2- 172.21.15.135:0/3590155278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b977d730 0x5591b9783870 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe628003920 tx=0x7fe628005f90 comp rx=0 tx=0).stop 2024-04-20T12:25:24.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.096+0000 7fe643019740 1 -- 172.21.15.135:0/3590155278 shutdown_connections 2024-04-20T12:25:24.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.096+0000 7fe643019740 1 --2- 172.21.15.135:0/3590155278 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5591b97966d0 0x5591b9798b10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.096+0000 7fe643019740 1 --2- 172.21.15.135:0/3590155278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b9786310 0x5591b9783db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.096+0000 7fe643019740 1 --2- 172.21.15.135:0/3590155278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b977d730 0x5591b9783870 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.096+0000 7fe621ffb640 0 client.16461 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:25:24.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.096+0000 7fe643019740 1 --2- 172.21.15.135:0/3590155278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977ce10 0x5591b9783330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.096+0000 7fe643019740 1 -- 172.21.15.135:0/3590155278 >> 172.21.15.135:0/3590155278 conn(0x5591b9777540 msgr2=0x5591b9779290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.096+0000 7fe643019740 1 -- 172.21.15.135:0/3590155278 shutdown_connections 2024-04-20T12:25:24.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.096+0000 7fe643019740 1 -- 172.21.15.135:0/3590155278 wait complete. 2024-04-20T12:25:24.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.096+0000 7fe643019740 20 client.16461 trim_cache size 0 max 16384 2024-04-20T12:25:24.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe643019740 1 Processor -- start 2024-04-20T12:25:24.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe643019740 1 -- start start 2024-04-20T12:25:24.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe643019740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b977ce10 0x5591b9785a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe643019740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977d730 0x5591b9791fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe643019740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b9786310 0x5591b979e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe643019740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe6381af310 con 0x5591b9786310 2024-04-20T12:25:24.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe643019740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe6381b0e50 con 0x5591b977ce10 2024-04-20T12:25:24.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe643019740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6381af9e0 con 0x5591b977d730 2024-04-20T12:25:24.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe63e8ed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b9786310 0x5591b979e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe63e8ed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b9786310 0x5591b979e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50336/0 (socket says 172.21.15.135:50336) 2024-04-20T12:25:24.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe63e8ed640 1 -- 172.21.15.135:0/1594456536 learned_addr learned my addr 172.21.15.135:0/1594456536 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe63e0ec640 1 --2- 172.21.15.135:0/1594456536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b977ce10 0x5591b9785a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe63d8eb640 1 --2- 172.21.15.135:0/1594456536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977d730 0x5591b9791fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe63e8ed640 1 -- 172.21.15.135:0/1594456536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977d730 msgr2=0x5591b9791fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe63e8ed640 1 --2- 172.21.15.135:0/1594456536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977d730 0x5591b9791fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe63e8ed640 1 -- 172.21.15.135:0/1594456536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b977ce10 msgr2=0x5591b9785a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe63e8ed640 1 --2- 172.21.15.135:0/1594456536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b977ce10 0x5591b9785a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.109+0000 7fe63e8ed640 1 -- 172.21.15.135:0/1594456536 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591b9788700 con 0x5591b9786310 2024-04-20T12:25:24.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.110+0000 7fe63d8eb640 1 --2- 172.21.15.135:0/1594456536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977d730 0x5591b9791fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:24.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.110+0000 7fe63e8ed640 1 --2- 172.21.15.135:0/1594456536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b9786310 0x5591b979e3e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe6300ce180 tx=0x7fe6300bd050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27113e2f1dfacd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.110+0000 7fe623fff640 1 -- 172.21.15.135:0/1594456536 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63001f040 con 0x5591b9786310 2024-04-20T12:25:24.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.110+0000 7fe623fff640 1 -- 172.21.15.135:0/1594456536 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe63009d070 con 0x5591b9786310 2024-04-20T12:25:24.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.110+0000 7fe623fff640 1 -- 172.21.15.135:0/1594456536 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6300a0d20 con 0x5591b9786310 2024-04-20T12:25:24.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.110+0000 7fe643019740 1 -- 172.21.15.135:0/1594456536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b9786310 msgr2=0x5591b979e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.110+0000 7fe643019740 1 --2- 172.21.15.135:0/1594456536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b9786310 0x5591b979e3e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe6300ce180 tx=0x7fe6300bd050 comp rx=0 tx=0).stop 2024-04-20T12:25:24.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.110+0000 7fe643019740 1 -- 172.21.15.135:0/1594456536 shutdown_connections 2024-04-20T12:25:24.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.110+0000 7fe643019740 1 --2- 172.21.15.135:0/1594456536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b9786310 0x5591b979e3e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.110+0000 7fe643019740 1 --2- 172.21.15.135:0/1594456536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977d730 0x5591b9791fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.110+0000 7fe643019740 1 --2- 172.21.15.135:0/1594456536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b977ce10 0x5591b9785a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.110+0000 7fe643019740 1 -- 172.21.15.135:0/1594456536 >> 172.21.15.135:0/1594456536 conn(0x5591b9777540 msgr2=0x5591b9772570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.110+0000 7fe643019740 1 -- 172.21.15.135:0/1594456536 shutdown_connections 2024-04-20T12:25:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.110+0000 7fe643019740 1 -- 172.21.15.135:0/1594456536 wait complete. 2024-04-20T12:25:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe643019740 1 -- start start 2024-04-20T12:25:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe643019740 1 Processor -- start 2024-04-20T12:25:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe643019740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b977ce10 0x5591b978ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe643019740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977d730 0x5591b977fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe643019740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b9786310 0x5591b97805b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe643019740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe6381b0780 con 0x5591b9786310 2024-04-20T12:25:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe643019740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe6381b00b0 con 0x5591b977ce10 2024-04-20T12:25:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe643019740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe6381ad2e0 con 0x5591b977d730 2024-04-20T12:25:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe643019740 10 client.0 _ll_register_callbacks cb 0x7fe62800ba30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:24.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe63e8ed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b9786310 0x5591b97805b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe63e8ed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b9786310 0x5591b97805b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50338/0 (socket says 172.21.15.135:50338) 2024-04-20T12:25:24.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe63e8ed640 1 -- 172.21.15.135:0/593085083 learned_addr learned my addr 172.21.15.135:0/593085083 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe63e0ec640 1 --2- 172.21.15.135:0/593085083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b977ce10 0x5591b978ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe63d8eb640 1 --2- 172.21.15.135:0/593085083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977d730 0x5591b977fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe63e8ed640 1 -- 172.21.15.135:0/593085083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977d730 msgr2=0x5591b977fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe63e8ed640 1 --2- 172.21.15.135:0/593085083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977d730 0x5591b977fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe63e8ed640 1 -- 172.21.15.135:0/593085083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b977ce10 msgr2=0x5591b978ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe63e8ed640 1 --2- 172.21.15.135:0/593085083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b977ce10 0x5591b978ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe63e8ed640 1 -- 172.21.15.135:0/593085083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591b97fbc50 con 0x5591b9786310 2024-04-20T12:25:24.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe63e8ed640 1 --2- 172.21.15.135:0/593085083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b9786310 0x5591b97805b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe6300ce720 tx=0x7fe630005440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ab23c8c0caa99b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.111+0000 7fe621ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:24.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.112+0000 7fe621ffb640 1 -- 172.21.15.135:0/593085083 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63001f070 con 0x5591b9786310 2024-04-20T12:25:24.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.112+0000 7fe621ffb640 1 -- 172.21.15.135:0/593085083 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe6300b10b0 con 0x5591b9786310 2024-04-20T12:25:24.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.112+0000 7fe643019740 1 -- 172.21.15.135:0/593085083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe63009d070 con 0x5591b9786310 2024-04-20T12:25:24.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.112+0000 7fe621ffb640 1 -- 172.21.15.135:0/593085083 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe63006ea90 con 0x5591b9786310 2024-04-20T12:25:24.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.112+0000 7fe643019740 10 client.16467 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:24.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.112+0000 7fe643019740 1 -- 172.21.15.135:0/593085083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5591b97fcd00 con 0x5591b9786310 2024-04-20T12:25:24.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.112+0000 7fe621ffb640 1 -- 172.21.15.135:0/593085083 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6300b8030 con 0x5591b9786310 2024-04-20T12:25:24.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.112+0000 7fe621ffb640 1 -- 172.21.15.135:0/593085083 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe63000f040 con 0x5591b9786310 2024-04-20T12:25:24.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.112+0000 7fe643019740 10 client.16467 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:24.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.112+0000 7fe643019740 10 client.16467 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:25:24.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.112+0000 7fe643019740 20 client.16467 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:24.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.112+0000 7fe643019740 1 --2- 172.21.15.135:0/593085083 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5591b97fd3a0 0x5591b97ff7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.112+0000 7fe643019740 4 client.16467 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:25:24.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.112+0000 7fe643019740 1 -- 172.21.15.135:0/593085083 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5591b96e99a0 con 0x5591b97fd3a0 2024-04-20T12:25:24.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.112+0000 7fe63e0ec640 1 --2- 172.21.15.135:0/593085083 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5591b97fd3a0 0x5591b97ff7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe621ffb640 10 client.16467 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:25:24.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe63e0ec640 1 --2- 172.21.15.135:0/593085083 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5591b97fd3a0 0x5591b97ff7c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2825266b9d66ca0d server_cookie=28e2103cffa895de in_seq=0 out_seq=0 2024-04-20T12:25:24.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe621ffb640 1 -- 172.21.15.135:0/593085083 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5591b96e99a0 con 0x5591b97fd3a0 2024-04-20T12:25:24.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe621ffb640 10 client.16467 handle_command_reply: tid=0 2024-04-20T12:25:24.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe643019740 1 client.16467 shutdown 2024-04-20T12:25:24.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe643019740 1 -- 172.21.15.135:0/593085083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b9786310 msgr2=0x5591b97805b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe643019740 1 --2- 172.21.15.135:0/593085083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b9786310 0x5591b97805b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe6300ce720 tx=0x7fe630005440 comp rx=0 tx=0).stop 2024-04-20T12:25:24.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe643019740 1 -- 172.21.15.135:0/593085083 shutdown_connections 2024-04-20T12:25:24.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe643019740 1 --2- 172.21.15.135:0/593085083 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5591b97fd3a0 0x5591b97ff7c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe643019740 1 --2- 172.21.15.135:0/593085083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591b9786310 0x5591b97805b0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe643019740 1 --2- 172.21.15.135:0/593085083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591b977d730 0x5591b977fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe643019740 1 --2- 172.21.15.135:0/593085083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591b977ce10 0x5591b978ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe621ffb640 0 client.16467 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:25:24.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe643019740 1 -- 172.21.15.135:0/593085083 >> 172.21.15.135:0/593085083 conn(0x5591b9777540 msgr2=0x5591b9778970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe643019740 1 -- 172.21.15.135:0/593085083 shutdown_connections 2024-04-20T12:25:24.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe643019740 1 -- 172.21.15.135:0/593085083 wait complete. 2024-04-20T12:25:24.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.113+0000 7fe643019740 20 client.16467 trim_cache size 0 max 16384 2024-04-20T12:25:24.121 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:25:24.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.114+0000 7fe640350640 1 -- 172.21.15.135:0/2400441681 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe6240a3d20 msgr2=0x7fe6240a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.114+0000 7fe640350640 1 --2- 172.21.15.135:0/2400441681 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe6240a3d20 0x7fe6240a61e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe6381076e0 tx=0x7fe62800b7e0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.114+0000 7fe640350640 1 -- 172.21.15.135:0/2400441681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638107fa0 msgr2=0x7fe6381985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.114+0000 7fe640350640 1 --2- 172.21.15.135:0/2400441681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638107fa0 0x7fe6381985d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe63000eaa0 tx=0x7fe63000ef60 comp rx=0 tx=0).stop 2024-04-20T12:25:24.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.114+0000 7fe640350640 1 -- 172.21.15.135:0/2400441681 shutdown_connections 2024-04-20T12:25:24.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.114+0000 7fe640350640 1 --2- 172.21.15.135:0/2400441681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe638107fa0 0x7fe6381985d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.114+0000 7fe640350640 1 --2- 172.21.15.135:0/2400441681 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe63806af80 0x7fe63819e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.114+0000 7fe640350640 1 --2- 172.21.15.135:0/2400441681 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe6240a3d20 0x7fe6240a61e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.114+0000 7fe640350640 1 --2- 172.21.15.135:0/2400441681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe63806a600 0x7fe63819e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.114+0000 7fe640350640 1 -- 172.21.15.135:0/2400441681 >> 172.21.15.135:0/2400441681 conn(0x7fe638077e40 msgr2=0x7fe6380ffd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.114+0000 7fe640350640 1 -- 172.21.15.135:0/2400441681 shutdown_connections 2024-04-20T12:25:24.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.114+0000 7fe640350640 1 -- 172.21.15.135:0/2400441681 wait complete. 2024-04-20T12:25:24.124 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:25:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.225+0000 7fca9a6e0640 1 -- 172.21.15.135:0/4260758838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca941011b0 msgr2=0x7fca94101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.225+0000 7fca9a6e0640 1 --2- 172.21.15.135:0/4260758838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca941011b0 0x7fca94101610 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fca88009900 tx=0x7fca8802bc30 comp rx=0 tx=0).stop 2024-04-20T12:25:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.225+0000 7fca9a6e0640 1 -- 172.21.15.135:0/4260758838 shutdown_connections 2024-04-20T12:25:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.225+0000 7fca9a6e0640 1 --2- 172.21.15.135:0/4260758838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca94101b50 0x7fca9410dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.225+0000 7fca9a6e0640 1 --2- 172.21.15.135:0/4260758838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca941011b0 0x7fca94101610 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.225+0000 7fca9a6e0640 1 --2- 172.21.15.135:0/4260758838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca94106fa0 0x7fca94107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.225+0000 7fca9a6e0640 1 -- 172.21.15.135:0/4260758838 >> 172.21.15.135:0/4260758838 conn(0x7fca94076c60 msgr2=0x7fca94077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.225+0000 7fca9a6e0640 1 -- 172.21.15.135:0/4260758838 shutdown_connections 2024-04-20T12:25:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.225+0000 7fca9a6e0640 1 -- 172.21.15.135:0/4260758838 wait complete. 2024-04-20T12:25:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.226+0000 7fca9a6e0640 1 Processor -- start 2024-04-20T12:25:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.226+0000 7fca9a6e0640 1 -- start start 2024-04-20T12:25:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.226+0000 7fca9a6e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca941011b0 0x7fca9419e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.226+0000 7fca9a6e0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca94101b50 0x7fca9419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.226+0000 7fca9a6e0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca94106fa0 0x7fca94198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.226+0000 7fca9a6e0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca94111250 con 0x7fca941011b0 2024-04-20T12:25:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.226+0000 7fca9a6e0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fca941110d0 con 0x7fca94106fa0 2024-04-20T12:25:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.226+0000 7fca9a6e0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca941113d0 con 0x7fca94101b50 2024-04-20T12:25:24.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.226+0000 7fca93fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca941011b0 0x7fca9419e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.226+0000 7fca93fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca941011b0 0x7fca9419e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50352/0 (socket says 172.21.15.135:50352) 2024-04-20T12:25:24.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.226+0000 7fca93fff640 1 -- 172.21.15.135:0/2680586916 learned_addr learned my addr 172.21.15.135:0/2680586916 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.227+0000 7fca937fe640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca94101b50 0x7fca9419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.227+0000 7fca98c7d640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca94106fa0 0x7fca94198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.227+0000 7fca93fff640 1 -- 172.21.15.135:0/2680586916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca94101b50 msgr2=0x7fca9419eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.227+0000 7fca93fff640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca94101b50 0x7fca9419eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.227+0000 7fca93fff640 1 -- 172.21.15.135:0/2680586916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca94106fa0 msgr2=0x7fca94198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.227+0000 7fca93fff640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca94106fa0 0x7fca94198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.227+0000 7fca93fff640 1 -- 172.21.15.135:0/2680586916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca94198f20 con 0x7fca941011b0 2024-04-20T12:25:24.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.227+0000 7fca937fe640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca94101b50 0x7fca9419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:24.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.227+0000 7fca98c7d640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca94106fa0 0x7fca94198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:24.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.227+0000 7fca93fff640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca941011b0 0x7fca9419e5a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fca8400d950 tx=0x7fca8400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.227+0000 7fca917fa640 1 -- 172.21.15.135:0/2680586916 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca84017070 con 0x7fca941011b0 2024-04-20T12:25:24.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.227+0000 7fca917fa640 1 -- 172.21.15.135:0/2680586916 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca84009c30 con 0x7fca941011b0 2024-04-20T12:25:24.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.227+0000 7fca9a6e0640 1 -- 172.21.15.135:0/2680586916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca94199210 con 0x7fca941011b0 2024-04-20T12:25:24.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.227+0000 7fca917fa640 1 -- 172.21.15.135:0/2680586916 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8400f6b0 con 0x7fca941011b0 2024-04-20T12:25:24.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.227+0000 7fca9a6e0640 1 -- 172.21.15.135:0/2680586916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca941a5520 con 0x7fca941011b0 2024-04-20T12:25:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.229+0000 7fca917fa640 1 -- 172.21.15.135:0/2680586916 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fca840109d0 con 0x7fca941011b0 2024-04-20T12:25:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.229+0000 7fca9d3ad740 1 Processor -- start 2024-04-20T12:25:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.229+0000 7fca9d3ad740 1 -- start start 2024-04-20T12:25:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.229+0000 7fca9d3ad740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56075884be10 0x56075884c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.229+0000 7fca9d3ad740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884c730 0x560758854dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca9d3ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758855310 0x560758857700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca9d3ad740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5607587b1110 con 0x56075884be10 2024-04-20T12:25:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca9d3ad740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56075874e550 con 0x56075884c730 2024-04-20T12:25:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca9d3ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5607587ad0d0 con 0x560758855310 2024-04-20T12:25:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca98c7d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56075884be10 0x56075884c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca98c7d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56075884be10 0x56075884c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50358/0 (socket says 172.21.15.135:50358) 2024-04-20T12:25:24.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca98c7d640 1 -- 172.21.15.135:0/2765701769 learned_addr learned my addr 172.21.15.135:0/2765701769 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca917fa640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fca7c0a3d20 0x7fca7c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca93fff640 1 --2- 172.21.15.135:0/2765701769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884c730 0x560758854dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca98c7d640 1 -- 172.21.15.135:0/2765701769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758855310 msgr2=0x560758857700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca98c7d640 1 --2- 172.21.15.135:0/2765701769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758855310 0x560758857700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca98c7d640 1 -- 172.21.15.135:0/2765701769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884c730 msgr2=0x560758854dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca98c7d640 1 --2- 172.21.15.135:0/2765701769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884c730 0x560758854dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca98c7d640 1 -- 172.21.15.135:0/2765701769 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560758776900 con 0x56075884be10 2024-04-20T12:25:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca93fff640 1 --2- 172.21.15.135:0/2765701769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884c730 0x560758854dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca917fa640 1 -- 172.21.15.135:0/2680586916 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fca840d07e0 con 0x7fca941011b0 2024-04-20T12:25:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca98c7d640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fca7c0a3d20 0x7fca7c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca98c7d640 1 --2- 172.21.15.135:0/2765701769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56075884be10 0x56075884c1f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00f410 tx=0x7fca8c00f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9e2ce176b32c59 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca7a7fc640 1 -- 172.21.15.135:0/2765701769 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c012950 con 0x56075884be10 2024-04-20T12:25:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca7a7fc640 1 -- 172.21.15.135:0/2765701769 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca8c012dd0 con 0x56075884be10 2024-04-20T12:25:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.230+0000 7fca7a7fc640 1 -- 172.21.15.135:0/2765701769 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c023a80 con 0x56075884be10 2024-04-20T12:25:24.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.231+0000 7fca9d3ad740 1 -- 172.21.15.135:0/2765701769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56075884be10 msgr2=0x56075884c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.231+0000 7fca98c7d640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fca7c0a3d20 0x7fca7c0a61e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fca8c01e000 tx=0x7fca8c01b000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.231+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/2765701769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56075884be10 0x56075884c1f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00f410 tx=0x7fca8c00f8d0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.231+0000 7fca9d3ad740 1 -- 172.21.15.135:0/2765701769 shutdown_connections 2024-04-20T12:25:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.231+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/2765701769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560758855310 0x560758857700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.231+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/2765701769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884c730 0x560758854dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.231+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/2765701769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56075884be10 0x56075884c1f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.231+0000 7fca9d3ad740 1 -- 172.21.15.135:0/2765701769 >> 172.21.15.135:0/2765701769 conn(0x560758846540 msgr2=0x560758846920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.231+0000 7fca9d3ad740 1 -- 172.21.15.135:0/2765701769 shutdown_connections 2024-04-20T12:25:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.231+0000 7fca9d3ad740 1 -- 172.21.15.135:0/2765701769 wait complete. 2024-04-20T12:25:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.231+0000 7fca9d3ad740 1 -- start start 2024-04-20T12:25:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca9d3ad740 1 Processor -- start 2024-04-20T12:25:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca9d3ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884be10 0x560758852310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca9d3ad740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884c730 0x560758852850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca9d3ad740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560758855310 0x560758852d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca9d3ad740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5607588580a0 con 0x560758855310 2024-04-20T12:25:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca9d3ad740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56075876a500 con 0x56075884c730 2024-04-20T12:25:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca9d3ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560758858220 con 0x56075884be10 2024-04-20T12:25:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca9d3ad740 10 client.0 _ll_register_callbacks cb 0x56075874f2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca98c7d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560758855310 0x560758852d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca98c7d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560758855310 0x560758852d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50368/0 (socket says 172.21.15.135:50368) 2024-04-20T12:25:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca98c7d640 1 -- 172.21.15.135:0/4185359347 learned_addr learned my addr 172.21.15.135:0/4185359347 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca937fe640 1 --2- 172.21.15.135:0/4185359347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884c730 0x560758852850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca93fff640 1 --2- 172.21.15.135:0/4185359347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884be10 0x560758852310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca98c7d640 1 -- 172.21.15.135:0/4185359347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884be10 msgr2=0x560758852310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca98c7d640 1 --2- 172.21.15.135:0/4185359347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884be10 0x560758852310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca98c7d640 1 -- 172.21.15.135:0/4185359347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884c730 msgr2=0x560758852850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca98c7d640 1 --2- 172.21.15.135:0/4185359347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884c730 0x560758852850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca98c7d640 1 -- 172.21.15.135:0/4185359347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607584c33f0 con 0x560758855310 2024-04-20T12:25:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca937fe640 1 --2- 172.21.15.135:0/4185359347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884c730 0x560758852850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:24.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca98c7d640 1 --2- 172.21.15.135:0/4185359347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560758855310 0x560758852d90 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fca8c004a40 tx=0x7fca8c004a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7c35e9df7fbb28 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca737fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:24.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca737fe640 1 -- 172.21.15.135:0/4185359347 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c033060 con 0x560758855310 2024-04-20T12:25:24.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca737fe640 1 -- 172.21.15.135:0/4185359347 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fca8c0237a0 con 0x560758855310 2024-04-20T12:25:24.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.232+0000 7fca9d3ad740 1 -- 172.21.15.135:0/4185359347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca8c012dd0 con 0x560758855310 2024-04-20T12:25:24.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.233+0000 7fca737fe640 1 -- 172.21.15.135:0/4185359347 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fca8c03a050 con 0x560758855310 2024-04-20T12:25:24.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.233+0000 7fca9d3ad740 10 client.16479 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:24.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.233+0000 7fca9d3ad740 1 -- 172.21.15.135:0/4185359347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56075858d7d0 con 0x560758855310 2024-04-20T12:25:24.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.233+0000 7fca737fe640 1 -- 172.21.15.135:0/4185359347 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca8c012dd0 con 0x560758855310 2024-04-20T12:25:24.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.233+0000 7fca737fe640 1 -- 172.21.15.135:0/4185359347 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fca8c024570 con 0x560758855310 2024-04-20T12:25:24.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.233+0000 7fca9d3ad740 10 client.16479 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:24.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.233+0000 7fca9d3ad740 10 client.16479 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:25:24.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.233+0000 7fca9d3ad740 20 client.16479 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:24.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.233+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/4185359347 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x560758865550 0x560758867940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.233+0000 7fca9d3ad740 4 client.16479 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:24.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.233+0000 7fca9d3ad740 1 -- 172.21.15.135:0/4185359347 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607587beb30 con 0x560758865550 2024-04-20T12:25:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.233+0000 7fca93fff640 1 --2- 172.21.15.135:0/4185359347 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x560758865550 0x560758867940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.234+0000 7fca737fe640 10 client.16479 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:25:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.234+0000 7fca93fff640 1 --2- 172.21.15.135:0/4185359347 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x560758865550 0x560758867940 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=847dec783c6a1622 server_cookie=404b7980b4ff2931 in_seq=0 out_seq=0 2024-04-20T12:25:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.234+0000 7fca737fe640 1 -- 172.21.15.135:0/4185359347 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5607587beb30 con 0x560758865550 2024-04-20T12:25:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.234+0000 7fca737fe640 10 client.16479 handle_command_reply: tid=0 2024-04-20T12:25:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.234+0000 7fca9d3ad740 1 client.16479 shutdown 2024-04-20T12:25:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.235+0000 7fca9d3ad740 1 -- 172.21.15.135:0/4185359347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560758855310 msgr2=0x560758852d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.235+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/4185359347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560758855310 0x560758852d90 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fca8c004a40 tx=0x7fca8c004a70 comp rx=0 tx=0).stop 2024-04-20T12:25:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.235+0000 7fca9d3ad740 1 -- 172.21.15.135:0/4185359347 shutdown_connections 2024-04-20T12:25:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.235+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/4185359347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560758855310 0x560758852d90 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.235+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/4185359347 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884c730 0x560758852850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.235+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/4185359347 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x560758865550 0x560758867940 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.235+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/4185359347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884be10 0x560758852310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.235+0000 7fca737fe640 0 client.16479 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:25:24.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.235+0000 7fca9d3ad740 1 -- 172.21.15.135:0/4185359347 >> 172.21.15.135:0/4185359347 conn(0x560758846540 msgr2=0x560758848290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.235+0000 7fca9d3ad740 1 -- 172.21.15.135:0/4185359347 shutdown_connections 2024-04-20T12:25:24.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.235+0000 7fca9d3ad740 1 -- 172.21.15.135:0/4185359347 wait complete. 2024-04-20T12:25:24.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.235+0000 7fca9d3ad740 20 client.16479 trim_cache size 0 max 16384 2024-04-20T12:25:24.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca9d3ad740 1 Processor -- start 2024-04-20T12:25:24.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca9d3ad740 1 -- start start 2024-04-20T12:25:24.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca9d3ad740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56075884be10 0x560758860ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca9d3ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884c730 0x560758851470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca9d3ad740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560758855310 0x560758852bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca9d3ad740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca941af450 con 0x56075884be10 2024-04-20T12:25:24.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca9d3ad740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fca941b0f90 con 0x560758855310 2024-04-20T12:25:24.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca9d3ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca941afb20 con 0x56075884c730 2024-04-20T12:25:24.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca93fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56075884be10 0x560758860ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca93fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56075884be10 0x560758860ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50370/0 (socket says 172.21.15.135:50370) 2024-04-20T12:25:24.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca93fff640 1 -- 172.21.15.135:0/1197971705 learned_addr learned my addr 172.21.15.135:0/1197971705 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca937fe640 1 --2- 172.21.15.135:0/1197971705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884c730 0x560758851470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca98c7d640 1 --2- 172.21.15.135:0/1197971705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560758855310 0x560758852bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca93fff640 1 -- 172.21.15.135:0/1197971705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884c730 msgr2=0x560758851470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca93fff640 1 --2- 172.21.15.135:0/1197971705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884c730 0x560758851470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca93fff640 1 -- 172.21.15.135:0/1197971705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560758855310 msgr2=0x560758852bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca93fff640 1 --2- 172.21.15.135:0/1197971705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560758855310 0x560758852bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca93fff640 1 -- 172.21.15.135:0/1197971705 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560758858250 con 0x56075884be10 2024-04-20T12:25:24.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca98c7d640 1 --2- 172.21.15.135:0/1197971705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560758855310 0x560758852bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:24.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.248+0000 7fca93fff640 1 --2- 172.21.15.135:0/1197971705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56075884be10 0x560758860ff0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fca8409c390 tx=0x7fca84098040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ac288728842539 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.249+0000 7fca79ffb640 1 -- 172.21.15.135:0/1197971705 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca84020040 con 0x56075884be10 2024-04-20T12:25:24.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.249+0000 7fca79ffb640 1 -- 172.21.15.135:0/1197971705 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca840a5070 con 0x56075884be10 2024-04-20T12:25:24.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.249+0000 7fca79ffb640 1 -- 172.21.15.135:0/1197971705 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca840d03f0 con 0x56075884be10 2024-04-20T12:25:24.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.249+0000 7fca9d3ad740 1 -- 172.21.15.135:0/1197971705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56075884be10 msgr2=0x560758860ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.249+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/1197971705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56075884be10 0x560758860ff0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fca8409c390 tx=0x7fca84098040 comp rx=0 tx=0).stop 2024-04-20T12:25:24.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.249+0000 7fca9d3ad740 1 -- 172.21.15.135:0/1197971705 shutdown_connections 2024-04-20T12:25:24.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.249+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/1197971705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560758855310 0x560758852bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.249+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/1197971705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884c730 0x560758851470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.249+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/1197971705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56075884be10 0x560758860ff0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.249+0000 7fca9d3ad740 1 -- 172.21.15.135:0/1197971705 >> 172.21.15.135:0/1197971705 conn(0x560758846540 msgr2=0x560758844e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.249+0000 7fca9d3ad740 1 -- 172.21.15.135:0/1197971705 shutdown_connections 2024-04-20T12:25:24.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.249+0000 7fca9d3ad740 1 -- 172.21.15.135:0/1197971705 wait complete. 2024-04-20T12:25:24.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.249+0000 7fca9d3ad740 1 -- start start 2024-04-20T12:25:24.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca9d3ad740 1 Processor -- start 2024-04-20T12:25:24.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca9d3ad740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884be10 0x56075885d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca9d3ad740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884c730 0x56075885da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca9d3ad740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560758855310 0x560758858cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca9d3ad740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca941b08c0 con 0x560758855310 2024-04-20T12:25:24.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca9d3ad740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fca941b01f0 con 0x56075884be10 2024-04-20T12:25:24.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca9d3ad740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca941ad420 con 0x56075884c730 2024-04-20T12:25:24.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca9d3ad740 10 client.0 _ll_register_callbacks cb 0x7fca8c01d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:24.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca98c7d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560758855310 0x560758858cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca98c7d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560758855310 0x560758858cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50372/0 (socket says 172.21.15.135:50372) 2024-04-20T12:25:24.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca98c7d640 1 -- 172.21.15.135:0/3920016130 learned_addr learned my addr 172.21.15.135:0/3920016130 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca93fff640 1 --2- 172.21.15.135:0/3920016130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884be10 0x56075885d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca937fe640 1 --2- 172.21.15.135:0/3920016130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884c730 0x56075885da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca98c7d640 1 -- 172.21.15.135:0/3920016130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884c730 msgr2=0x56075885da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca98c7d640 1 --2- 172.21.15.135:0/3920016130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884c730 0x56075885da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca98c7d640 1 -- 172.21.15.135:0/3920016130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884be10 msgr2=0x56075885d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca98c7d640 1 --2- 172.21.15.135:0/3920016130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884be10 0x56075885d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca98c7d640 1 -- 172.21.15.135:0/3920016130 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607588594c0 con 0x560758855310 2024-04-20T12:25:24.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca93fff640 1 --2- 172.21.15.135:0/3920016130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884be10 0x56075885d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:24.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca937fe640 1 --2- 172.21.15.135:0/3920016130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884c730 0x56075885da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:24.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca98c7d640 1 --2- 172.21.15.135:0/3920016130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560758855310 0x560758858cc0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fca8c000f80 tx=0x7fca8c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2344f805fcdb6b36 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.250+0000 7fca737fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:24.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.251+0000 7fca737fe640 1 -- 172.21.15.135:0/3920016130 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c033040 con 0x560758855310 2024-04-20T12:25:24.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.251+0000 7fca737fe640 1 -- 172.21.15.135:0/3920016130 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fca8c009e00 con 0x560758855310 2024-04-20T12:25:24.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.251+0000 7fca9d3ad740 1 -- 172.21.15.135:0/3920016130 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca840a5070 con 0x560758855310 2024-04-20T12:25:24.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.251+0000 7fca737fe640 1 -- 172.21.15.135:0/3920016130 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fca8c04e050 con 0x560758855310 2024-04-20T12:25:24.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.251+0000 7fca9d3ad740 10 client.16485 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:24.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.251+0000 7fca9d3ad740 1 -- 172.21.15.135:0/3920016130 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5607588cb500 con 0x560758855310 2024-04-20T12:25:24.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.251+0000 7fca737fe640 1 -- 172.21.15.135:0/3920016130 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca840a5070 con 0x560758855310 2024-04-20T12:25:24.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.251+0000 7fca737fe640 1 -- 172.21.15.135:0/3920016130 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fca8c01a7d0 con 0x560758855310 2024-04-20T12:25:24.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.251+0000 7fca9d3ad740 10 client.16485 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:24.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.251+0000 7fca9d3ad740 10 client.16485 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:25:24.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.251+0000 7fca9d3ad740 20 client.16485 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:24.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.251+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/3920016130 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5607588cbbf0 0x5607588ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.251+0000 7fca9d3ad740 4 client.16485 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:25:24.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.251+0000 7fca9d3ad740 1 -- 172.21.15.135:0/3920016130 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5607587b89a0 con 0x5607588cbbf0 2024-04-20T12:25:24.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.251+0000 7fca93fff640 1 --2- 172.21.15.135:0/3920016130 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5607588cbbf0 0x5607588ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca737fe640 10 client.16485 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:25:24.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca93fff640 1 --2- 172.21.15.135:0/3920016130 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5607588cbbf0 0x5607588ce010 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c974210b287d8d4f server_cookie=b27c0b7591bb34bc in_seq=0 out_seq=0 2024-04-20T12:25:24.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca737fe640 1 -- 172.21.15.135:0/3920016130 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5607587b89a0 con 0x5607588cbbf0 2024-04-20T12:25:24.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca737fe640 10 client.16485 handle_command_reply: tid=0 2024-04-20T12:25:24.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca9d3ad740 1 client.16485 shutdown 2024-04-20T12:25:24.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca9d3ad740 1 -- 172.21.15.135:0/3920016130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560758855310 msgr2=0x560758858cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/3920016130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560758855310 0x560758858cc0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fca8c000f80 tx=0x7fca8c009800 comp rx=0 tx=0).stop 2024-04-20T12:25:24.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca9d3ad740 1 -- 172.21.15.135:0/3920016130 shutdown_connections 2024-04-20T12:25:24.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/3920016130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560758855310 0x560758858cc0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/3920016130 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5607588cbbf0 0x5607588ce010 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/3920016130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56075884c730 0x56075885da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca737fe640 0 client.16485 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:25:24.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca9d3ad740 1 --2- 172.21.15.135:0/3920016130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56075884be10 0x56075885d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca9d3ad740 1 -- 172.21.15.135:0/3920016130 >> 172.21.15.135:0/3920016130 conn(0x560758846540 msgr2=0x5607588456e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca9d3ad740 1 -- 172.21.15.135:0/3920016130 shutdown_connections 2024-04-20T12:25:24.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca9d3ad740 1 -- 172.21.15.135:0/3920016130 wait complete. 2024-04-20T12:25:24.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.252+0000 7fca9d3ad740 20 client.16485 trim_cache size 0 max 16384 2024-04-20T12:25:24.261 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:25:24.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.253+0000 7fca9a6e0640 1 -- 172.21.15.135:0/2680586916 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fca7c0a3d20 msgr2=0x7fca7c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.253+0000 7fca9a6e0640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fca7c0a3d20 0x7fca7c0a61e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fca8c01e000 tx=0x7fca8c01b000 comp rx=0 tx=0).stop 2024-04-20T12:25:24.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.253+0000 7fca9a6e0640 1 -- 172.21.15.135:0/2680586916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca941011b0 msgr2=0x7fca9419e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.253+0000 7fca9a6e0640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca941011b0 0x7fca9419e5a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fca8400d950 tx=0x7fca8400de10 comp rx=0 tx=0).stop 2024-04-20T12:25:24.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.253+0000 7fca9a6e0640 1 -- 172.21.15.135:0/2680586916 shutdown_connections 2024-04-20T12:25:24.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.253+0000 7fca9a6e0640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca94106fa0 0x7fca94198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.253+0000 7fca9a6e0640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fca7c0a3d20 0x7fca7c0a61e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.253+0000 7fca9a6e0640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca94101b50 0x7fca9419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.253+0000 7fca9a6e0640 1 --2- 172.21.15.135:0/2680586916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca941011b0 0x7fca9419e5a0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.253+0000 7fca9a6e0640 1 -- 172.21.15.135:0/2680586916 >> 172.21.15.135:0/2680586916 conn(0x7fca94076c60 msgr2=0x7fca94105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.253+0000 7fca9a6e0640 1 -- 172.21.15.135:0/2680586916 shutdown_connections 2024-04-20T12:25:24.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.253+0000 7fca9a6e0640 1 -- 172.21.15.135:0/2680586916 wait complete. 2024-04-20T12:25:24.265 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:25:24.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.365+0000 7f7b0d88c640 1 -- 172.21.15.135:0/3029133832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08101090 msgr2=0x7f7b08101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.365+0000 7f7b0d88c640 1 --2- 172.21.15.135:0/3029133832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08101090 0x7f7b08101470 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009900 tx=0x7f7af802bc30 comp rx=0 tx=0).stop 2024-04-20T12:25:24.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.365+0000 7f7b0d88c640 1 -- 172.21.15.135:0/3029133832 shutdown_connections 2024-04-20T12:25:24.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.365+0000 7f7b0d88c640 1 --2- 172.21.15.135:0/3029133832 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b08106160 0x7f7b0810dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.365+0000 7f7b0d88c640 1 --2- 172.21.15.135:0/3029133832 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b08101a40 0x7f7b08105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.365+0000 7f7b0d88c640 1 --2- 172.21.15.135:0/3029133832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08101090 0x7f7b08101470 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.365+0000 7f7b0d88c640 1 -- 172.21.15.135:0/3029133832 >> 172.21.15.135:0/3029133832 conn(0x7f7b08078010 msgr2=0x7f7b08078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.365+0000 7f7b0d88c640 1 -- 172.21.15.135:0/3029133832 shutdown_connections 2024-04-20T12:25:24.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.365+0000 7f7b0d88c640 1 -- 172.21.15.135:0/3029133832 wait complete. 2024-04-20T12:25:24.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.365+0000 7f7b0d88c640 1 Processor -- start 2024-04-20T12:25:24.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7b0d88c640 1 -- start start 2024-04-20T12:25:24.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7b0d88c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b08101090 0x7f7b08197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7b0d88c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08106160 0x7f7b08197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7b0d88c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b0819bfc0 0x7f7b0819c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7b0d88c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b08111220 con 0x7f7b08106160 2024-04-20T12:25:24.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7b0d88c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7b081110a0 con 0x7f7b08101090 2024-04-20T12:25:24.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7b0d88c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b081113a0 con 0x7f7b0819bfc0 2024-04-20T12:25:24.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7afffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08106160 0x7f7b08197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7afffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08106160 0x7f7b08197c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50394/0 (socket says 172.21.15.135:50394) 2024-04-20T12:25:24.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7afffff640 1 -- 172.21.15.135:0/3889089450 learned_addr learned my addr 172.21.15.135:0/3889089450 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7b06ffd640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b08101090 0x7f7b08197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7b077fe640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b0819bfc0 0x7f7b0819c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7afffff640 1 -- 172.21.15.135:0/3889089450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b0819bfc0 msgr2=0x7f7b0819c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7afffff640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b0819bfc0 0x7f7b0819c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7afffff640 1 -- 172.21.15.135:0/3889089450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b08101090 msgr2=0x7f7b08197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7afffff640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b08101090 0x7f7b08197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7afffff640 1 -- 172.21.15.135:0/3889089450 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0819cab0 con 0x7f7b08106160 2024-04-20T12:25:24.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7b06ffd640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b08101090 0x7f7b08197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:24.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7b077fe640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b0819bfc0 0x7f7b0819c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:24.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7afffff640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08106160 0x7f7b08197c40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7af000e9c0 tx=0x7f7af000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7b0c88a640 1 -- 172.21.15.135:0/3889089450 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af000cd80 con 0x7f7b08106160 2024-04-20T12:25:24.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7b0d88c640 1 -- 172.21.15.135:0/3889089450 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b0819cda0 con 0x7f7b08106160 2024-04-20T12:25:24.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7b0c88a640 1 -- 172.21.15.135:0/3889089450 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7af0005500 con 0x7f7b08106160 2024-04-20T12:25:24.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.366+0000 7f7b0c88a640 1 -- 172.21.15.135:0/3889089450 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af0010690 con 0x7f7b08106160 2024-04-20T12:25:24.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.367+0000 7f7b0d88c640 1 -- 172.21.15.135:0/3889089450 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b081a4590 con 0x7f7b08106160 2024-04-20T12:25:24.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.368+0000 7f7b0c88a640 1 -- 172.21.15.135:0/3889089450 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f7af00046c0 con 0x7f7b08106160 2024-04-20T12:25:24.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.369+0000 7f7b10480740 1 Processor -- start 2024-04-20T12:25:24.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.369+0000 7f7b10480740 1 -- start start 2024-04-20T12:25:24.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.369+0000 7f7b0c88a640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7af40a3d20 0x7f7af40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.369+0000 7f7b10480740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec4e10 0x55be8bec51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.369+0000 7f7b10480740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec5730 0x55be8becddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.369+0000 7f7b10480740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bece310 0x55be8bed0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.369+0000 7f7b10480740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55be8be2a110 con 0x55be8bec5730 2024-04-20T12:25:24.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.369+0000 7f7b10480740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55be8bdc7550 con 0x55be8bece310 2024-04-20T12:25:24.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.369+0000 7f7b10480740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55be8be260d0 con 0x55be8bec4e10 2024-04-20T12:25:24.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.369+0000 7f7b077fe640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7af40a3d20 0x7f7af40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.369+0000 7f7b0c88a640 1 -- 172.21.15.135:0/3889089450 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f7af00d10a0 con 0x7f7b08106160 2024-04-20T12:25:24.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.369+0000 7f7afffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec5730 0x55be8becddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.369+0000 7f7afffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec5730 0x55be8becddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50406/0 (socket says 172.21.15.135:50406) 2024-04-20T12:25:24.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.369+0000 7f7afffff640 1 -- 172.21.15.135:0/2328738615 learned_addr learned my addr 172.21.15.135:0/2328738615 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.369+0000 7f7b06ffd640 1 --2- 172.21.15.135:0/2328738615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec4e10 0x55be8bec51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.370+0000 7f7b077fe640 1 --2- 172.21.15.135:0/2328738615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bece310 0x55be8bed0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.370+0000 7f7afffff640 1 -- 172.21.15.135:0/2328738615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec4e10 msgr2=0x55be8bec51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.370+0000 7f7afffff640 1 --2- 172.21.15.135:0/2328738615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec4e10 0x55be8bec51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.370+0000 7f7afffff640 1 -- 172.21.15.135:0/2328738615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bece310 msgr2=0x55be8bed0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.370+0000 7f7afffff640 1 --2- 172.21.15.135:0/2328738615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bece310 0x55be8bed0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.370+0000 7f7afffff640 1 -- 172.21.15.135:0/2328738615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be8bdef900 con 0x55be8bec5730 2024-04-20T12:25:24.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.370+0000 7f7b077fe640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7af40a3d20 0x7f7af40a61e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b00005fd0 tx=0x7f7b00014a30 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.370+0000 7f7afffff640 1 --2- 172.21.15.135:0/2328738615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec5730 0x55be8becddd0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7af0099630 tx=0x7f7af0098fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63dc3a528fbbb00 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.370+0000 7f7afdffb640 1 -- 172.21.15.135:0/2328738615 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af009c5c0 con 0x55be8bec5730 2024-04-20T12:25:24.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.370+0000 7f7afdffb640 1 -- 172.21.15.135:0/2328738615 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7af009d360 con 0x55be8bec5730 2024-04-20T12:25:24.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.370+0000 7f7afdffb640 1 -- 172.21.15.135:0/2328738615 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af000f3c0 con 0x55be8bec5730 2024-04-20T12:25:24.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 -- 172.21.15.135:0/2328738615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec5730 msgr2=0x55be8becddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 --2- 172.21.15.135:0/2328738615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec5730 0x55be8becddd0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7af0099630 tx=0x7f7af0098fc0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 -- 172.21.15.135:0/2328738615 shutdown_connections 2024-04-20T12:25:24.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 --2- 172.21.15.135:0/2328738615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bece310 0x55be8bed0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 --2- 172.21.15.135:0/2328738615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec5730 0x55be8becddd0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 --2- 172.21.15.135:0/2328738615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec4e10 0x55be8bec51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 -- 172.21.15.135:0/2328738615 >> 172.21.15.135:0/2328738615 conn(0x55be8bebf540 msgr2=0x55be8bebf920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 -- 172.21.15.135:0/2328738615 shutdown_connections 2024-04-20T12:25:24.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 -- 172.21.15.135:0/2328738615 wait complete. 2024-04-20T12:25:24.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 -- start start 2024-04-20T12:25:24.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 Processor -- start 2024-04-20T12:25:24.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec4e10 0x55be8becb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bec5730 0x55be8becb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bece310 0x55be8becbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55be8bed1040 con 0x55be8bece310 2024-04-20T12:25:24.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55be8bde3500 con 0x55be8bec5730 2024-04-20T12:25:24.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.371+0000 7f7b10480740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55be8bed11c0 con 0x55be8bec4e10 2024-04-20T12:25:24.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7b10480740 10 client.0 _ll_register_callbacks cb 0x55be8bdc82f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:24.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7b077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bece310 0x55be8becbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7b077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bece310 0x55be8becbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50410/0 (socket says 172.21.15.135:50410) 2024-04-20T12:25:24.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7b077fe640 1 -- 172.21.15.135:0/393917005 learned_addr learned my addr 172.21.15.135:0/393917005 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7afffff640 1 --2- 172.21.15.135:0/393917005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bec5730 0x55be8becb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7b06ffd640 1 --2- 172.21.15.135:0/393917005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec4e10 0x55be8becb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7b077fe640 1 -- 172.21.15.135:0/393917005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec4e10 msgr2=0x55be8becb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7b077fe640 1 --2- 172.21.15.135:0/393917005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec4e10 0x55be8becb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7b077fe640 1 -- 172.21.15.135:0/393917005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bec5730 msgr2=0x55be8becb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7b077fe640 1 --2- 172.21.15.135:0/393917005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bec5730 0x55be8becb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7b077fe640 1 -- 172.21.15.135:0/393917005 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be8bb3c3f0 con 0x55be8bece310 2024-04-20T12:25:24.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7b077fe640 1 --2- 172.21.15.135:0/393917005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bece310 0x55be8becbdf0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7b00011c70 tx=0x7f7b00004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1d686a16f12b67 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7ae6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:24.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7ae6ffd640 1 -- 172.21.15.135:0/393917005 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00023070 con 0x55be8bece310 2024-04-20T12:25:24.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7ae6ffd640 1 -- 172.21.15.135:0/393917005 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f7b0001f5f0 con 0x55be8bece310 2024-04-20T12:25:24.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7b10480740 1 -- 172.21.15.135:0/393917005 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7af009d360 con 0x55be8bece310 2024-04-20T12:25:24.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7ae6ffd640 1 -- 172.21.15.135:0/393917005 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7b0002f050 con 0x55be8bece310 2024-04-20T12:25:24.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7b10480740 10 client.16497 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:24.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.372+0000 7f7b10480740 1 -- 172.21.15.135:0/393917005 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55be8bc067d0 con 0x55be8bece310 2024-04-20T12:25:24.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.373+0000 7f7ae6ffd640 1 -- 172.21.15.135:0/393917005 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7af009d360 con 0x55be8bece310 2024-04-20T12:25:24.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.373+0000 7f7ae6ffd640 1 -- 172.21.15.135:0/393917005 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f7b0001e070 con 0x55be8bece310 2024-04-20T12:25:24.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.373+0000 7f7b10480740 10 client.16497 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:24.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.373+0000 7f7b10480740 10 client.16497 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:25:24.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.373+0000 7f7b10480740 20 client.16497 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:24.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.373+0000 7f7b10480740 1 --2- 172.21.15.135:0/393917005 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55be8bede5e0 0x55be8bee0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.373+0000 7f7b10480740 4 client.16497 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:24.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.373+0000 7f7b10480740 1 -- 172.21.15.135:0/393917005 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be8be37b30 con 0x55be8bede5e0 2024-04-20T12:25:24.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.373+0000 7f7b06ffd640 1 --2- 172.21.15.135:0/393917005 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55be8bede5e0 0x55be8bee0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.373+0000 7f7ae6ffd640 10 client.16497 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:25:24.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.373+0000 7f7b06ffd640 1 --2- 172.21.15.135:0/393917005 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55be8bede5e0 0x55be8bee0a40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a25c0ff40ac92c43 server_cookie=49a5585fe605fde4 in_seq=0 out_seq=0 2024-04-20T12:25:24.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.374+0000 7f7ae6ffd640 1 -- 172.21.15.135:0/393917005 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55be8be37b30 con 0x55be8bede5e0 2024-04-20T12:25:24.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.374+0000 7f7ae6ffd640 10 client.16497 handle_command_reply: tid=0 2024-04-20T12:25:24.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.374+0000 7f7b10480740 1 client.16497 shutdown 2024-04-20T12:25:24.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.374+0000 7f7b10480740 1 -- 172.21.15.135:0/393917005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bece310 msgr2=0x55be8becbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.374+0000 7f7b10480740 1 --2- 172.21.15.135:0/393917005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bece310 0x55be8becbdf0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7b00011c70 tx=0x7f7b00004ab0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.374+0000 7f7b10480740 1 -- 172.21.15.135:0/393917005 shutdown_connections 2024-04-20T12:25:24.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.374+0000 7f7b10480740 1 --2- 172.21.15.135:0/393917005 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55be8bede5e0 0x55be8bee0a40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.374+0000 7f7b10480740 1 --2- 172.21.15.135:0/393917005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bece310 0x55be8becbdf0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.374+0000 7f7b10480740 1 --2- 172.21.15.135:0/393917005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bec5730 0x55be8becb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.374+0000 7f7ae6ffd640 0 client.16497 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:25:24.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.374+0000 7f7b10480740 1 --2- 172.21.15.135:0/393917005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec4e10 0x55be8becb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.374+0000 7f7b10480740 1 -- 172.21.15.135:0/393917005 >> 172.21.15.135:0/393917005 conn(0x55be8bebf540 msgr2=0x55be8bec1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.374+0000 7f7b10480740 1 -- 172.21.15.135:0/393917005 shutdown_connections 2024-04-20T12:25:24.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.374+0000 7f7b10480740 1 -- 172.21.15.135:0/393917005 wait complete. 2024-04-20T12:25:24.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.374+0000 7f7b10480740 20 client.16497 trim_cache size 0 max 16384 2024-04-20T12:25:24.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.387+0000 7f7b10480740 1 Processor -- start 2024-04-20T12:25:24.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.387+0000 7f7b10480740 1 -- start start 2024-04-20T12:25:24.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.387+0000 7f7b10480740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec4e10 0x55be8bed9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7b10480740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bec5730 0x55be8bebe560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7b10480740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bece310 0x55be8bee6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7b10480740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b081ad210 con 0x55be8bec4e10 2024-04-20T12:25:24.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7b10480740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7b081aed50 con 0x55be8bec5730 2024-04-20T12:25:24.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7b10480740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b081ad8e0 con 0x55be8bece310 2024-04-20T12:25:24.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7b06ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec4e10 0x55be8bed9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7b06ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec4e10 0x55be8bed9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50416/0 (socket says 172.21.15.135:50416) 2024-04-20T12:25:24.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7b06ffd640 1 -- 172.21.15.135:0/4085916215 learned_addr learned my addr 172.21.15.135:0/4085916215 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7afffff640 1 --2- 172.21.15.135:0/4085916215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bec5730 0x55be8bebe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7b06ffd640 1 -- 172.21.15.135:0/4085916215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bece310 msgr2=0x55be8bee6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7b06ffd640 1 --2- 172.21.15.135:0/4085916215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bece310 0x55be8bee6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7b06ffd640 1 -- 172.21.15.135:0/4085916215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bec5730 msgr2=0x55be8bebe560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7b06ffd640 1 --2- 172.21.15.135:0/4085916215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bec5730 0x55be8bebe560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7b06ffd640 1 -- 172.21.15.135:0/4085916215 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be8bec5560 con 0x55be8bec4e10 2024-04-20T12:25:24.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7b06ffd640 1 --2- 172.21.15.135:0/4085916215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec4e10 0x55be8bed9fc0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7af802cfd0 tx=0x7f7af8005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e27f10e87ed14c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7afd7fa640 1 -- 172.21.15.135:0/4085916215 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af802ccd0 con 0x55be8bec4e10 2024-04-20T12:25:24.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7afd7fa640 1 -- 172.21.15.135:0/4085916215 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7af8045bc0 con 0x55be8bec4e10 2024-04-20T12:25:24.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.388+0000 7f7afd7fa640 1 -- 172.21.15.135:0/4085916215 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af8005040 con 0x55be8bec4e10 2024-04-20T12:25:24.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 -- 172.21.15.135:0/4085916215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec4e10 msgr2=0x55be8bed9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 --2- 172.21.15.135:0/4085916215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec4e10 0x55be8bed9fc0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7af802cfd0 tx=0x7f7af8005a20 comp rx=0 tx=0).stop 2024-04-20T12:25:24.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 -- 172.21.15.135:0/4085916215 shutdown_connections 2024-04-20T12:25:24.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 --2- 172.21.15.135:0/4085916215 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bece310 0x55be8bee6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 --2- 172.21.15.135:0/4085916215 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bec5730 0x55be8bebe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 --2- 172.21.15.135:0/4085916215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec4e10 0x55be8bed9fc0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 -- 172.21.15.135:0/4085916215 >> 172.21.15.135:0/4085916215 conn(0x55be8bebf540 msgr2=0x55be8bebde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 -- 172.21.15.135:0/4085916215 shutdown_connections 2024-04-20T12:25:24.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 -- 172.21.15.135:0/4085916215 wait complete. 2024-04-20T12:25:24.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 -- start start 2024-04-20T12:25:24.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 Processor -- start 2024-04-20T12:25:24.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec4e10 0x55be8bed2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec5730 0x55be8bed2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bece310 0x55be8bf43b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7b081ae680 con 0x55be8bec4e10 2024-04-20T12:25:24.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7b081adfb0 con 0x55be8bece310 2024-04-20T12:25:24.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.389+0000 7f7b10480740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7b081ab1e0 con 0x55be8bec5730 2024-04-20T12:25:24.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7b10480740 10 client.0 _ll_register_callbacks cb 0x7f7b00011940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:24.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7b06ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec4e10 0x55be8bed2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7b06ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec4e10 0x55be8bed2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50426/0 (socket says 172.21.15.135:50426) 2024-04-20T12:25:24.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7b06ffd640 1 -- 172.21.15.135:0/3930259481 learned_addr learned my addr 172.21.15.135:0/3930259481 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7b077fe640 1 --2- 172.21.15.135:0/3930259481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bece310 0x55be8bf43b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7afffff640 1 --2- 172.21.15.135:0/3930259481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec5730 0x55be8bed2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.401 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7b06ffd640 1 -- 172.21.15.135:0/3930259481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec5730 msgr2=0x55be8bed2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7b06ffd640 1 --2- 172.21.15.135:0/3930259481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec5730 0x55be8bed2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7b06ffd640 1 -- 172.21.15.135:0/3930259481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bece310 msgr2=0x55be8bf43b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7b06ffd640 1 --2- 172.21.15.135:0/3930259481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bece310 0x55be8bf43b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7b06ffd640 1 -- 172.21.15.135:0/3930259481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be8bf440c0 con 0x55be8bec4e10 2024-04-20T12:25:24.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7b077fe640 1 --2- 172.21.15.135:0/3930259481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bece310 0x55be8bf43b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:24.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7afffff640 1 --2- 172.21.15.135:0/3930259481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec5730 0x55be8bed2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:24.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7b06ffd640 1 --2- 172.21.15.135:0/3930259481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec4e10 0x55be8bed2310 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7af8005ab0 tx=0x7f7af802c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc47b451be30169 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7ae6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:24.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7ae6ffd640 1 -- 172.21.15.135:0/3930259481 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af8054060 con 0x55be8bec4e10 2024-04-20T12:25:24.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7ae6ffd640 1 -- 172.21.15.135:0/3930259481 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f7af8005040 con 0x55be8bec4e10 2024-04-20T12:25:24.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7b10480740 1 -- 172.21.15.135:0/3930259481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7af8045bc0 con 0x55be8bec4e10 2024-04-20T12:25:24.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7ae6ffd640 1 -- 172.21.15.135:0/3930259481 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7af8005240 con 0x55be8bec4e10 2024-04-20T12:25:24.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7b10480740 10 client.16503 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:24.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.390+0000 7f7b10480740 1 -- 172.21.15.135:0/3930259481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55be8bf45280 con 0x55be8bec4e10 2024-04-20T12:25:24.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.391+0000 7f7ae6ffd640 1 -- 172.21.15.135:0/3930259481 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7af8045bc0 con 0x55be8bec4e10 2024-04-20T12:25:24.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.391+0000 7f7ae6ffd640 1 -- 172.21.15.135:0/3930259481 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f7b00014150 con 0x55be8bec4e10 2024-04-20T12:25:24.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.391+0000 7f7b10480740 10 client.16503 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:24.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.391+0000 7f7b10480740 10 client.16503 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:25:24.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.391+0000 7f7b10480740 20 client.16503 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:24.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.391+0000 7f7b10480740 1 --2- 172.21.15.135:0/3930259481 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55be8bf45970 0x55be8bf47d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.391+0000 7f7b10480740 4 client.16503 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:25:24.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.391+0000 7f7b10480740 1 -- 172.21.15.135:0/3930259481 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55be8be319a0 con 0x55be8bf45970 2024-04-20T12:25:24.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.391+0000 7f7afffff640 1 --2- 172.21.15.135:0/3930259481 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55be8bf45970 0x55be8bf47d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.391+0000 7f7afffff640 1 --2- 172.21.15.135:0/3930259481 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55be8bf45970 0x55be8bf47d90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2748e56ea87a8909 server_cookie=6a3d733027b69118 in_seq=0 out_seq=0 2024-04-20T12:25:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.391+0000 7f7ae6ffd640 10 client.16503 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:25:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7ae6ffd640 1 -- 172.21.15.135:0/3930259481 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55be8be319a0 con 0x55be8bf45970 2024-04-20T12:25:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7ae6ffd640 10 client.16503 handle_command_reply: tid=0 2024-04-20T12:25:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b10480740 1 client.16503 shutdown 2024-04-20T12:25:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b10480740 1 -- 172.21.15.135:0/3930259481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec4e10 msgr2=0x55be8bed2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b10480740 1 --2- 172.21.15.135:0/3930259481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec4e10 0x55be8bed2310 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7af8005ab0 tx=0x7f7af802c3e0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b10480740 1 -- 172.21.15.135:0/3930259481 shutdown_connections 2024-04-20T12:25:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b10480740 1 --2- 172.21.15.135:0/3930259481 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55be8bf45970 0x55be8bf47d90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b10480740 1 --2- 172.21.15.135:0/3930259481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55be8bece310 0x55be8bf43b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b10480740 1 --2- 172.21.15.135:0/3930259481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55be8bec5730 0x55be8bed2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b10480740 1 --2- 172.21.15.135:0/3930259481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be8bec4e10 0x55be8bed2310 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7ae6ffd640 0 client.16503 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:25:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b10480740 1 -- 172.21.15.135:0/3930259481 >> 172.21.15.135:0/3930259481 conn(0x55be8bebf540 msgr2=0x55be8becbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b10480740 1 -- 172.21.15.135:0/3930259481 shutdown_connections 2024-04-20T12:25:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b10480740 1 -- 172.21.15.135:0/3930259481 wait complete. 2024-04-20T12:25:24.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b10480740 20 client.16503 trim_cache size 0 max 16384 2024-04-20T12:25:24.405 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:25:24.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b0d88c640 1 -- 172.21.15.135:0/3889089450 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7af40a3d20 msgr2=0x7f7af40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b0d88c640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7af40a3d20 0x7f7af40a61e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b00005fd0 tx=0x7f7b00014a30 comp rx=0 tx=0).stop 2024-04-20T12:25:24.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b0d88c640 1 -- 172.21.15.135:0/3889089450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08106160 msgr2=0x7f7b08197c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b0d88c640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08106160 0x7f7b08197c40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7af000e9c0 tx=0x7f7af000ee80 comp rx=0 tx=0).stop 2024-04-20T12:25:24.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b0d88c640 1 -- 172.21.15.135:0/3889089450 shutdown_connections 2024-04-20T12:25:24.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b0d88c640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7af40a3d20 0x7f7af40a61e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b0d88c640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b0819bfc0 0x7f7b0819c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b0d88c640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7b08106160 0x7f7b08197c40 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b0d88c640 1 --2- 172.21.15.135:0/3889089450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7b08101090 0x7f7b08197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.392+0000 7f7b0d88c640 1 -- 172.21.15.135:0/3889089450 >> 172.21.15.135:0/3889089450 conn(0x7f7b08078010 msgr2=0x7f7b080fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.393+0000 7f7b0d88c640 1 -- 172.21.15.135:0/3889089450 shutdown_connections 2024-04-20T12:25:24.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.393+0000 7f7b0d88c640 1 -- 172.21.15.135:0/3889089450 wait complete. 2024-04-20T12:25:24.408 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:25:24.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.507+0000 7fb616dce640 1 -- 172.21.15.135:0/2512116362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6101010a0 msgr2=0x7fb610101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.507+0000 7fb616dce640 1 --2- 172.21.15.135:0/2512116362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6101010a0 0x7fb610101480 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb608009ca0 tx=0x7fb60802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb616dce640 1 -- 172.21.15.135:0/2512116362 shutdown_connections 2024-04-20T12:25:24.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb616dce640 1 --2- 172.21.15.135:0/2512116362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb610106170 0x7fb61010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb616dce640 1 --2- 172.21.15.135:0/2512116362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb610101a50 0x7fb610105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb616dce640 1 --2- 172.21.15.135:0/2512116362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6101010a0 0x7fb610101480 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb616dce640 1 -- 172.21.15.135:0/2512116362 >> 172.21.15.135:0/2512116362 conn(0x7fb6100771e0 msgr2=0x7fb6100775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb616dce640 1 -- 172.21.15.135:0/2512116362 shutdown_connections 2024-04-20T12:25:24.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb616dce640 1 -- 172.21.15.135:0/2512116362 wait complete. 2024-04-20T12:25:24.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb616dce640 1 Processor -- start 2024-04-20T12:25:24.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb616dce640 1 -- start start 2024-04-20T12:25:24.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb616dce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6101010a0 0x7fb610199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb616dce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb610106170 0x7fb610199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb616dce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb61019a120 0x7fb6101a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb616dce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb610111230 con 0x7fb6101010a0 2024-04-20T12:25:24.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb616dce640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb6101110b0 con 0x7fb610106170 2024-04-20T12:25:24.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb616dce640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6101113b0 con 0x7fb61019a120 2024-04-20T12:25:24.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb614b6a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6101010a0 0x7fb610199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.508+0000 7fb614b6a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6101010a0 0x7fb610199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50436/0 (socket says 172.21.15.135:50436) 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.509+0000 7fb614b6a640 1 -- 172.21.15.135:0/3685883048 learned_addr learned my addr 172.21.15.135:0/3685883048 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.509+0000 7fb60ffff640 1 --2- 172.21.15.135:0/3685883048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb610106170 0x7fb610199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.509+0000 7fb61536b640 1 --2- 172.21.15.135:0/3685883048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb61019a120 0x7fb6101a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.509+0000 7fb614b6a640 1 -- 172.21.15.135:0/3685883048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb61019a120 msgr2=0x7fb6101a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.509+0000 7fb614b6a640 1 --2- 172.21.15.135:0/3685883048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb61019a120 0x7fb6101a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.509+0000 7fb614b6a640 1 -- 172.21.15.135:0/3685883048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb610106170 msgr2=0x7fb610199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.509+0000 7fb614b6a640 1 --2- 172.21.15.135:0/3685883048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb610106170 0x7fb610199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.509+0000 7fb614b6a640 1 -- 172.21.15.135:0/3685883048 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6101a4ea0 con 0x7fb6101010a0 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.509+0000 7fb60ffff640 1 --2- 172.21.15.135:0/3685883048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb610106170 0x7fb610199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.509+0000 7fb614b6a640 1 --2- 172.21.15.135:0/3685883048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6101010a0 0x7fb610199650 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb608005e30 tx=0x7fb608032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.509+0000 7fb60dffb640 1 -- 172.21.15.135:0/3685883048 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608041020 con 0x7fb6101010a0 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.509+0000 7fb60dffb640 1 -- 172.21.15.135:0/3685883048 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb608034d90 con 0x7fb6101010a0 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.509+0000 7fb60dffb640 1 -- 172.21.15.135:0/3685883048 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608039040 con 0x7fb6101010a0 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.509+0000 7fb616dce640 1 -- 172.21.15.135:0/3685883048 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6101a5130 con 0x7fb6101010a0 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.509+0000 7fb616dce640 1 -- 172.21.15.135:0/3685883048 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6101a5670 con 0x7fb6101010a0 2024-04-20T12:25:24.513 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.512+0000 7fb60dffb640 1 -- 172.21.15.135:0/3685883048 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fb608044020 con 0x7fb6101010a0 2024-04-20T12:25:24.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.512+0000 7fb6199be740 1 Processor -- start 2024-04-20T12:25:24.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.512+0000 7fb6199be740 1 -- start start 2024-04-20T12:25:24.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.512+0000 7fb6199be740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823addac0 0x555823addea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.512+0000 7fb6199be740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823ade3e0 0x555823aeb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.512+0000 7fb6199be740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823aeb720 0x555823aedb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.512+0000 7fb6199be740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555823a43110 con 0x555823addac0 2024-04-20T12:25:24.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.512+0000 7fb6199be740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5558239e0550 con 0x555823ade3e0 2024-04-20T12:25:24.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.512+0000 7fb6199be740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555823a3f0d0 con 0x555823aeb720 2024-04-20T12:25:24.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.512+0000 7fb60dffb640 1 --2- 172.21.15.135:0/3685883048 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5fc0a3da0 0x7fb5fc0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.512+0000 7fb61536b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823addac0 0x555823addea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.512+0000 7fb61536b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823addac0 0x555823addea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50452/0 (socket says 172.21.15.135:50452) 2024-04-20T12:25:24.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.512+0000 7fb61536b640 1 -- 172.21.15.135:0/4124879375 learned_addr learned my addr 172.21.15.135:0/4124879375 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.513+0000 7fb61536b640 1 --2- 172.21.15.135:0/3685883048 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5fc0a3da0 0x7fb5fc0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.513+0000 7fb60dffb640 1 -- 172.21.15.135:0/3685883048 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fb6080f2930 con 0x7fb6101010a0 2024-04-20T12:25:24.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.513+0000 7fb614b6a640 1 --2- 172.21.15.135:0/4124879375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823ade3e0 0x555823aeb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.513+0000 7fb60ffff640 1 --2- 172.21.15.135:0/4124879375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823aeb720 0x555823aedb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.513+0000 7fb61536b640 1 -- 172.21.15.135:0/4124879375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823aeb720 msgr2=0x555823aedb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.513+0000 7fb61536b640 1 --2- 172.21.15.135:0/4124879375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823aeb720 0x555823aedb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.513+0000 7fb61536b640 1 -- 172.21.15.135:0/4124879375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823ade3e0 msgr2=0x555823aeb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.513+0000 7fb61536b640 1 --2- 172.21.15.135:0/4124879375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823ade3e0 0x555823aeb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.513+0000 7fb61536b640 1 -- 172.21.15.135:0/4124879375 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555823a08900 con 0x555823addac0 2024-04-20T12:25:24.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.513+0000 7fb60ffff640 1 --2- 172.21.15.135:0/4124879375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823aeb720 0x555823aedb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:24.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.513+0000 7fb61536b640 1 --2- 172.21.15.135:0/4124879375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823addac0 0x555823addea0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80137c0 tx=0x7fb5f8013c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f867545c2e0d892d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.513+0000 7fb606ffd640 1 -- 172.21.15.135:0/4124879375 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f801d7c0 con 0x555823addac0 2024-04-20T12:25:24.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.513+0000 7fb606ffd640 1 -- 172.21.15.135:0/4124879375 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5f8022070 con 0x555823addac0 2024-04-20T12:25:24.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.513+0000 7fb606ffd640 1 -- 172.21.15.135:0/4124879375 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f801c990 con 0x555823addac0 2024-04-20T12:25:24.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.514+0000 7fb6199be740 1 -- 172.21.15.135:0/4124879375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823addac0 msgr2=0x555823addea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.514+0000 7fb61536b640 1 --2- 172.21.15.135:0/3685883048 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5fc0a3da0 0x7fb5fc0a6260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8021000 tx=0x7fb5f801f000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.514+0000 7fb6199be740 1 --2- 172.21.15.135:0/4124879375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823addac0 0x555823addea0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb5f80137c0 tx=0x7fb5f8013c80 comp rx=0 tx=0).stop 2024-04-20T12:25:24.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.514+0000 7fb6199be740 1 -- 172.21.15.135:0/4124879375 shutdown_connections 2024-04-20T12:25:24.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.514+0000 7fb6199be740 1 --2- 172.21.15.135:0/4124879375 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823aeb720 0x555823aedb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.514+0000 7fb6199be740 1 --2- 172.21.15.135:0/4124879375 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823ade3e0 0x555823aeb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.514+0000 7fb6199be740 1 --2- 172.21.15.135:0/4124879375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823addac0 0x555823addea0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.514+0000 7fb6199be740 1 -- 172.21.15.135:0/4124879375 >> 172.21.15.135:0/4124879375 conn(0x555823ad8540 msgr2=0x555823ad8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.514+0000 7fb6199be740 1 -- 172.21.15.135:0/4124879375 shutdown_connections 2024-04-20T12:25:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.514+0000 7fb6199be740 1 -- 172.21.15.135:0/4124879375 wait complete. 2024-04-20T12:25:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.514+0000 7fb6199be740 1 -- start start 2024-04-20T12:25:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.514+0000 7fb6199be740 1 Processor -- start 2024-04-20T12:25:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb6199be740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823addac0 0x555823ae86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb6199be740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823ade3e0 0x555823ae8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb6199be740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823aeb720 0x555823ae9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb6199be740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555823aee560 con 0x555823ade3e0 2024-04-20T12:25:24.526 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb6199be740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5558239fc500 con 0x555823aeb720 2024-04-20T12:25:24.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb6199be740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555823aee6e0 con 0x555823addac0 2024-04-20T12:25:24.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb6199be740 10 client.0 _ll_register_callbacks cb 0x5558239e12f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:24.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb60ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823ade3e0 0x555823ae8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb60ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823ade3e0 0x555823ae8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50462/0 (socket says 172.21.15.135:50462) 2024-04-20T12:25:24.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb60ffff640 1 -- 172.21.15.135:0/4070998324 learned_addr learned my addr 172.21.15.135:0/4070998324 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb61536b640 1 --2- 172.21.15.135:0/4070998324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823aeb720 0x555823ae9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.527 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb614b6a640 1 --2- 172.21.15.135:0/4070998324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823addac0 0x555823ae86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb60ffff640 1 -- 172.21.15.135:0/4070998324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823addac0 msgr2=0x555823ae86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb60ffff640 1 --2- 172.21.15.135:0/4070998324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823addac0 0x555823ae86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb60ffff640 1 -- 172.21.15.135:0/4070998324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823aeb720 msgr2=0x555823ae9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb60ffff640 1 --2- 172.21.15.135:0/4070998324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823aeb720 0x555823ae9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb60ffff640 1 -- 172.21.15.135:0/4070998324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558237553f0 con 0x555823ade3e0 2024-04-20T12:25:24.528 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb61536b640 1 --2- 172.21.15.135:0/4070998324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823aeb720 0x555823ae9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:24.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb60ffff640 1 --2- 172.21.15.135:0/4070998324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823ade3e0 0x555823ae8c10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb6000127b0 tx=0x7fb600012c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a728441aec803975 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb5effff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:24.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb5effff640 1 -- 172.21.15.135:0/4070998324 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60001f060 con 0x555823ade3e0 2024-04-20T12:25:24.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb5effff640 1 -- 172.21.15.135:0/4070998324 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fb600010dc0 con 0x555823ade3e0 2024-04-20T12:25:24.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb6199be740 1 -- 172.21.15.135:0/4070998324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5f8022070 con 0x555823ade3e0 2024-04-20T12:25:24.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.515+0000 7fb5effff640 1 -- 172.21.15.135:0/4070998324 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb600026050 con 0x555823ade3e0 2024-04-20T12:25:24.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.516+0000 7fb6199be740 10 client.16515 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:24.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.516+0000 7fb6199be740 1 -- 172.21.15.135:0/4070998324 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55582381f7d0 con 0x555823ade3e0 2024-04-20T12:25:24.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.516+0000 7fb5effff640 1 -- 172.21.15.135:0/4070998324 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5f8022070 con 0x555823ade3e0 2024-04-20T12:25:24.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.516+0000 7fb5effff640 1 -- 172.21.15.135:0/4070998324 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fb600018530 con 0x555823ade3e0 2024-04-20T12:25:24.529 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.516+0000 7fb6199be740 10 client.16515 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:24.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.516+0000 7fb6199be740 10 client.16515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:24.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.516+0000 7fb6199be740 20 client.16515 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:24.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.516+0000 7fb6199be740 1 --2- 172.21.15.135:0/4070998324 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x555823afbbb0 0x555823afdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.516+0000 7fb6199be740 4 client.16515 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:24.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.516+0000 7fb6199be740 1 -- 172.21.15.135:0/4070998324 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555823a50b30 con 0x555823afbbb0 2024-04-20T12:25:24.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.516+0000 7fb614b6a640 1 --2- 172.21.15.135:0/4070998324 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x555823afbbb0 0x555823afdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.517+0000 7fb5effff640 10 client.16515 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:24.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.517+0000 7fb614b6a640 1 --2- 172.21.15.135:0/4070998324 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x555823afbbb0 0x555823afdfd0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f07c9135425422c8 server_cookie=2dc0b273d505a3c3 in_seq=0 out_seq=0 2024-04-20T12:25:24.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.517+0000 7fb5effff640 1 -- 172.21.15.135:0/4070998324 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555823a50b30 con 0x555823afbbb0 2024-04-20T12:25:24.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.517+0000 7fb5effff640 10 client.16515 handle_command_reply: tid=0 2024-04-20T12:25:24.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.517+0000 7fb6199be740 1 client.16515 shutdown 2024-04-20T12:25:24.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.517+0000 7fb6199be740 1 -- 172.21.15.135:0/4070998324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823ade3e0 msgr2=0x555823ae8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.530 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.517+0000 7fb6199be740 1 --2- 172.21.15.135:0/4070998324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823ade3e0 0x555823ae8c10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb6000127b0 tx=0x7fb600012c70 comp rx=0 tx=0).stop 2024-04-20T12:25:24.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.517+0000 7fb6199be740 1 -- 172.21.15.135:0/4070998324 shutdown_connections 2024-04-20T12:25:24.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.517+0000 7fb6199be740 1 --2- 172.21.15.135:0/4070998324 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x555823afbbb0 0x555823afdfd0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.517+0000 7fb6199be740 1 --2- 172.21.15.135:0/4070998324 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823aeb720 0x555823ae9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.517+0000 7fb6199be740 1 --2- 172.21.15.135:0/4070998324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823ade3e0 0x555823ae8c10 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.517+0000 7fb5effff640 0 client.16515 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:24.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.517+0000 7fb6199be740 1 --2- 172.21.15.135:0/4070998324 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823addac0 0x555823ae86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.517+0000 7fb6199be740 1 -- 172.21.15.135:0/4070998324 >> 172.21.15.135:0/4070998324 conn(0x555823ad8540 msgr2=0x555823ada290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.518+0000 7fb6199be740 1 -- 172.21.15.135:0/4070998324 shutdown_connections 2024-04-20T12:25:24.531 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.518+0000 7fb6199be740 1 -- 172.21.15.135:0/4070998324 wait complete. 2024-04-20T12:25:24.532 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.518+0000 7fb6199be740 20 client.16515 trim_cache size 0 max 16384 2024-04-20T12:25:24.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb6199be740 1 Processor -- start 2024-04-20T12:25:24.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb6199be740 1 -- start start 2024-04-20T12:25:24.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb6199be740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823addac0 0x555823aeae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb6199be740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823ade3e0 0x555823af74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb6199be740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823aeb720 0x555823ad3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb6199be740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb6101ad1a0 con 0x555823ade3e0 2024-04-20T12:25:24.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb6199be740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb6101aece0 con 0x555823aeb720 2024-04-20T12:25:24.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb6199be740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6101ad870 con 0x555823addac0 2024-04-20T12:25:24.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb60ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823ade3e0 0x555823af74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb60ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823ade3e0 0x555823af74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50470/0 (socket says 172.21.15.135:50470) 2024-04-20T12:25:24.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb60ffff640 1 -- 172.21.15.135:0/2135982377 learned_addr learned my addr 172.21.15.135:0/2135982377 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb61536b640 1 --2- 172.21.15.135:0/2135982377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823aeb720 0x555823ad3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb60ffff640 1 -- 172.21.15.135:0/2135982377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823addac0 msgr2=0x555823aeae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb60ffff640 1 --2- 172.21.15.135:0/2135982377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823addac0 0x555823aeae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb60ffff640 1 -- 172.21.15.135:0/2135982377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823aeb720 msgr2=0x555823ad3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb60ffff640 1 --2- 172.21.15.135:0/2135982377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823aeb720 0x555823ad3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb60ffff640 1 -- 172.21.15.135:0/2135982377 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555823aedb10 con 0x555823ade3e0 2024-04-20T12:25:24.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb61536b640 1 --2- 172.21.15.135:0/2135982377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823aeb720 0x555823ad3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:24.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb60ffff640 1 --2- 172.21.15.135:0/2135982377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823ade3e0 0x555823af74f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb6000095a0 tx=0x7fb600009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14699d79f2525f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb6067fc640 1 -- 172.21.15.135:0/2135982377 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb600018d70 con 0x555823ade3e0 2024-04-20T12:25:24.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.531+0000 7fb6067fc640 1 -- 172.21.15.135:0/2135982377 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb600010bc0 con 0x555823ade3e0 2024-04-20T12:25:24.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.532+0000 7fb6067fc640 1 -- 172.21.15.135:0/2135982377 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60001a690 con 0x555823ade3e0 2024-04-20T12:25:24.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.532+0000 7fb6199be740 1 -- 172.21.15.135:0/2135982377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823ade3e0 msgr2=0x555823af74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.532+0000 7fb6199be740 1 --2- 172.21.15.135:0/2135982377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823ade3e0 0x555823af74f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb6000095a0 tx=0x7fb600009d30 comp rx=0 tx=0).stop 2024-04-20T12:25:24.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.532+0000 7fb6199be740 1 -- 172.21.15.135:0/2135982377 shutdown_connections 2024-04-20T12:25:24.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.532+0000 7fb6199be740 1 --2- 172.21.15.135:0/2135982377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823aeb720 0x555823ad3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.532+0000 7fb6199be740 1 --2- 172.21.15.135:0/2135982377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823ade3e0 0x555823af74f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.532+0000 7fb6199be740 1 --2- 172.21.15.135:0/2135982377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823addac0 0x555823aeae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.532+0000 7fb6199be740 1 -- 172.21.15.135:0/2135982377 >> 172.21.15.135:0/2135982377 conn(0x555823ad8540 msgr2=0x555823ae7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.532+0000 7fb6199be740 1 -- 172.21.15.135:0/2135982377 shutdown_connections 2024-04-20T12:25:24.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.532+0000 7fb6199be740 1 -- 172.21.15.135:0/2135982377 wait complete. 2024-04-20T12:25:24.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.532+0000 7fb6199be740 1 -- start start 2024-04-20T12:25:24.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.532+0000 7fb6199be740 1 Processor -- start 2024-04-20T12:25:24.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb6199be740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823addac0 0x555823af3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb6199be740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823ade3e0 0x555823af3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb6199be740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823aeb720 0x555823ae4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb6199be740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb6101ae610 con 0x555823aeb720 2024-04-20T12:25:24.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb6199be740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb6101adf40 con 0x555823ade3e0 2024-04-20T12:25:24.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb6199be740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb6101ab170 con 0x555823addac0 2024-04-20T12:25:24.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb6199be740 10 client.0 _ll_register_callbacks cb 0x7fb6000095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:24.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb61536b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823aeb720 0x555823ae4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb61536b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823aeb720 0x555823ae4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50480/0 (socket says 172.21.15.135:50480) 2024-04-20T12:25:24.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb61536b640 1 -- 172.21.15.135:0/1952453413 learned_addr learned my addr 172.21.15.135:0/1952453413 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:24.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb614b6a640 1 --2- 172.21.15.135:0/1952453413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823addac0 0x555823af3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb60ffff640 1 --2- 172.21.15.135:0/1952453413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823ade3e0 0x555823af3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb61536b640 1 -- 172.21.15.135:0/1952453413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823addac0 msgr2=0x555823af3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb61536b640 1 --2- 172.21.15.135:0/1952453413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823addac0 0x555823af3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb61536b640 1 -- 172.21.15.135:0/1952453413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823ade3e0 msgr2=0x555823af3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb61536b640 1 --2- 172.21.15.135:0/1952453413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823ade3e0 0x555823af3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb61536b640 1 -- 172.21.15.135:0/1952453413 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555823ae5720 con 0x555823aeb720 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb61536b640 1 --2- 172.21.15.135:0/1952453413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823aeb720 0x555823ae4f20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800b870 tx=0x7fb5f800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c9142b2f748fc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.533+0000 7fb5effff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.534+0000 7fb5effff640 1 -- 172.21.15.135:0/1952453413 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8033020 con 0x555823aeb720 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.534+0000 7fb5effff640 1 -- 172.21.15.135:0/1952453413 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fb5f801ce60 con 0x555823aeb720 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.534+0000 7fb6199be740 1 -- 172.21.15.135:0/1952453413 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb600010bc0 con 0x555823aeb720 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.534+0000 7fb5effff640 1 -- 172.21.15.135:0/1952453413 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb5f803e050 con 0x555823aeb720 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.534+0000 7fb6199be740 10 client.16521 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.534+0000 7fb6199be740 1 -- 172.21.15.135:0/1952453413 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555823b61c80 con 0x555823aeb720 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.534+0000 7fb5effff640 1 -- 172.21.15.135:0/1952453413 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb600010bc0 con 0x555823aeb720 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.534+0000 7fb5effff640 1 -- 172.21.15.135:0/1952453413 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fb5f801d7c0 con 0x555823aeb720 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.534+0000 7fb6199be740 10 client.16521 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.534+0000 7fb6199be740 10 client.16521 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.534+0000 7fb6199be740 20 client.16521 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:24.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.534+0000 7fb6199be740 1 --2- 172.21.15.135:0/1952453413 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x555823b620c0 0x555823b644e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.534+0000 7fb6199be740 4 client.16521 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:25:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.534+0000 7fb6199be740 1 -- 172.21.15.135:0/1952453413 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555823a4a9a0 con 0x555823b620c0 2024-04-20T12:25:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.534+0000 7fb614b6a640 1 --2- 172.21.15.135:0/1952453413 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x555823b620c0 0x555823b644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb614b6a640 1 --2- 172.21.15.135:0/1952453413 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x555823b620c0 0x555823b644e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8507d4bb7621c4b3 server_cookie=50316691f5c5b50f in_seq=0 out_seq=0 2024-04-20T12:25:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb5effff640 10 client.16521 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb5effff640 1 -- 172.21.15.135:0/1952453413 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555823a4a9a0 con 0x555823b620c0 2024-04-20T12:25:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb5effff640 10 client.16521 handle_command_reply: tid=0 2024-04-20T12:25:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb6199be740 1 client.16521 shutdown 2024-04-20T12:25:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb6199be740 1 -- 172.21.15.135:0/1952453413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823aeb720 msgr2=0x555823ae4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb6199be740 1 --2- 172.21.15.135:0/1952453413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823aeb720 0x555823ae4f20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800b870 tx=0x7fb5f800b8a0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb6199be740 1 -- 172.21.15.135:0/1952453413 shutdown_connections 2024-04-20T12:25:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb6199be740 1 --2- 172.21.15.135:0/1952453413 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x555823b620c0 0x555823b644e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb6199be740 1 --2- 172.21.15.135:0/1952453413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555823aeb720 0x555823ae4f20 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb6199be740 1 --2- 172.21.15.135:0/1952453413 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555823ade3e0 0x555823af3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb5effff640 0 client.16521 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:24.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb6199be740 1 --2- 172.21.15.135:0/1952453413 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555823addac0 0x555823af3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb6199be740 1 -- 172.21.15.135:0/1952453413 >> 172.21.15.135:0/1952453413 conn(0x555823ad8540 msgr2=0x555823ad9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb6199be740 1 -- 172.21.15.135:0/1952453413 shutdown_connections 2024-04-20T12:25:24.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb6199be740 1 -- 172.21.15.135:0/1952453413 wait complete. 2024-04-20T12:25:24.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.535+0000 7fb6199be740 20 client.16521 trim_cache size 0 max 16384 2024-04-20T12:25:24.546 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:25:24.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.536+0000 7fb616dce640 1 -- 172.21.15.135:0/3685883048 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5fc0a3da0 msgr2=0x7fb5fc0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.536+0000 7fb616dce640 1 --2- 172.21.15.135:0/3685883048 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5fc0a3da0 0x7fb5fc0a6260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8021000 tx=0x7fb5f801f000 comp rx=0 tx=0).stop 2024-04-20T12:25:24.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.536+0000 7fb616dce640 1 -- 172.21.15.135:0/3685883048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6101010a0 msgr2=0x7fb610199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:24.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.536+0000 7fb616dce640 1 --2- 172.21.15.135:0/3685883048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6101010a0 0x7fb610199650 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb608005e30 tx=0x7fb608032f20 comp rx=0 tx=0).stop 2024-04-20T12:25:24.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.536+0000 7fb616dce640 1 -- 172.21.15.135:0/3685883048 shutdown_connections 2024-04-20T12:25:24.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.536+0000 7fb616dce640 1 --2- 172.21.15.135:0/3685883048 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5fc0a3da0 0x7fb5fc0a6260 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.536+0000 7fb616dce640 1 --2- 172.21.15.135:0/3685883048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb61019a120 0x7fb6101a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.536+0000 7fb616dce640 1 --2- 172.21.15.135:0/3685883048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb610106170 0x7fb610199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.536+0000 7fb616dce640 1 --2- 172.21.15.135:0/3685883048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb6101010a0 0x7fb610199650 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:24.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.536+0000 7fb616dce640 1 -- 172.21.15.135:0/3685883048 >> 172.21.15.135:0/3685883048 conn(0x7fb6100771e0 msgr2=0x7fb6100feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:24.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.536+0000 7fb616dce640 1 -- 172.21.15.135:0/3685883048 shutdown_connections 2024-04-20T12:25:24.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:24.536+0000 7fb616dce640 1 -- 172.21.15.135:0/3685883048 wait complete. 2024-04-20T12:25:25.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:24 smithi154 ceph-mon[22073]: pgmap v71: 129 pgs: 129 active+clean; 16 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 519 KiB/s wr, 182 op/s 2024-04-20T12:25:25.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:24 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3786574711' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:25:25.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:24 smithi139 ceph-mon[21834]: pgmap v71: 129 pgs: 129 active+clean; 16 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 519 KiB/s wr, 182 op/s 2024-04-20T12:25:25.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:24 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3786574711' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:25:25.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:24 smithi135 ceph-mon[18264]: pgmap v71: 129 pgs: 129 active+clean; 16 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 47 MiB/s rd, 519 KiB/s wr, 182 op/s 2024-04-20T12:25:25.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:24 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3786574711' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:25:25.550 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:25:25.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:25:25.550 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:25:25.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.665+0000 7f01ff5ef640 1 -- 172.21.15.135:0/1053838409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01f8103b00 msgr2=0x7f01f810bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.665+0000 7f01ff5ef640 1 --2- 172.21.15.135:0/1053838409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01f8103b00 0x7f01f810bfe0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009900 tx=0x7f01e802bd60 comp rx=0 tx=0).stop 2024-04-20T12:25:25.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.665+0000 7f01ff5ef640 1 -- 172.21.15.135:0/1053838409 shutdown_connections 2024-04-20T12:25:25.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.665+0000 7f01ff5ef640 1 --2- 172.21.15.135:0/1053838409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01f810c520 0x7f01f810e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.665+0000 7f01ff5ef640 1 --2- 172.21.15.135:0/1053838409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01f8103b00 0x7f01f810bfe0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.665+0000 7f01ff5ef640 1 --2- 172.21.15.135:0/1053838409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f81031e0 0x7f01f81035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.665+0000 7f01ff5ef640 1 -- 172.21.15.135:0/1053838409 >> 172.21.15.135:0/1053838409 conn(0x7f01f8077f60 msgr2=0x7f01f8078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:25.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.665+0000 7f01ff5ef640 1 -- 172.21.15.135:0/1053838409 shutdown_connections 2024-04-20T12:25:25.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.665+0000 7f01ff5ef640 1 -- 172.21.15.135:0/1053838409 wait complete. 2024-04-20T12:25:25.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01ff5ef640 1 Processor -- start 2024-04-20T12:25:25.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01ff5ef640 1 -- start start 2024-04-20T12:25:25.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01ff5ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01f81031e0 0x7f01f8100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01ff5ef640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01f8103b00 0x7f01f8101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01ff5ef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f810c520 0x7f01f81018b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01ff5ef640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01f81123b0 con 0x7f01f81031e0 2024-04-20T12:25:25.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01ff5ef640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f01f8112230 con 0x7f01f8103b00 2024-04-20T12:25:25.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01ff5ef640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f01f8112530 con 0x7f01f810c520 2024-04-20T12:25:25.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01fd38b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01f81031e0 0x7f01f8100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01fd38b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01f81031e0 0x7f01f8100e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50500/0 (socket says 172.21.15.135:50500) 2024-04-20T12:25:25.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01fd38b640 1 -- 172.21.15.135:0/2710742109 learned_addr learned my addr 172.21.15.135:0/2710742109 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:25.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01fdb8c640 1 --2- 172.21.15.135:0/2710742109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f810c520 0x7f01f81018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01fd38b640 1 -- 172.21.15.135:0/2710742109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f810c520 msgr2=0x7f01f81018b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01fd38b640 1 --2- 172.21.15.135:0/2710742109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f810c520 0x7f01f81018b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01fd38b640 1 -- 172.21.15.135:0/2710742109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01f8103b00 msgr2=0x7f01f8101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01fcb8a640 1 --2- 172.21.15.135:0/2710742109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01f8103b00 0x7f01f8101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01fd38b640 1 --2- 172.21.15.135:0/2710742109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01f8103b00 0x7f01f8101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01fd38b640 1 -- 172.21.15.135:0/2710742109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f81a6dd0 con 0x7f01f81031e0 2024-04-20T12:25:25.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01fd38b640 1 --2- 172.21.15.135:0/2710742109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01f81031e0 0x7f01f8100e30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f01f400b4a0 tx=0x7f01f400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:25.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.666+0000 7f01ee7fc640 1 -- 172.21.15.135:0/2710742109 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4014070 con 0x7f01f81031e0 2024-04-20T12:25:25.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.667+0000 7f01ff5ef640 1 -- 172.21.15.135:0/2710742109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f81a70c0 con 0x7f01f81031e0 2024-04-20T12:25:25.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.667+0000 7f01ee7fc640 1 -- 172.21.15.135:0/2710742109 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01f4010af0 con 0x7f01f81031e0 2024-04-20T12:25:25.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.667+0000 7f01ee7fc640 1 -- 172.21.15.135:0/2710742109 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4017d10 con 0x7f01f81031e0 2024-04-20T12:25:25.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.667+0000 7f01ff5ef640 1 -- 172.21.15.135:0/2710742109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f81a75c0 con 0x7f01f81031e0 2024-04-20T12:25:25.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.669+0000 7f01ee7fc640 1 -- 172.21.15.135:0/2710742109 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f01f4017070 con 0x7f01f81031e0 2024-04-20T12:25:25.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.669+0000 7f02021d7740 1 Processor -- start 2024-04-20T12:25:25.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.669+0000 7f02021d7740 1 -- start start 2024-04-20T12:25:25.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f02021d7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967dfe0 0x55fc6967e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f02021d7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 0x55fc69686fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f02021d7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc696874e0 0x55fc696898d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f02021d7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fc695e2f00 con 0x55fc696874e0 2024-04-20T12:25:25.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f02021d7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fc69580530 con 0x55fc6967dfe0 2024-04-20T12:25:25.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f02021d7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fc695deec0 con 0x55fc6967e900 2024-04-20T12:25:25.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01ee7fc640 1 --2- 172.21.15.135:0/2710742109 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f01e40a3d20 0x7f01e40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01fcb8a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc696874e0 0x55fc696898d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01fcb8a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc696874e0 0x55fc696898d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50512/0 (socket says 172.21.15.135:50512) 2024-04-20T12:25:25.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01fcb8a640 1 -- 172.21.15.135:0/1179607489 learned_addr learned my addr 172.21.15.135:0/1179607489 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:25.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01fdb8c640 1 --2- 172.21.15.135:0/1179607489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967dfe0 0x55fc6967e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01fdb8c640 1 --2- 172.21.15.135:0/2710742109 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f01e40a3d20 0x7f01e40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01ee7fc640 1 -- 172.21.15.135:0/2710742109 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f01f40cff70 con 0x7f01f81031e0 2024-04-20T12:25:25.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01fd38b640 1 --2- 172.21.15.135:0/1179607489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 0x55fc69686fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01fcb8a640 1 -- 172.21.15.135:0/1179607489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 msgr2=0x55fc69686fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01fcb8a640 1 --2- 172.21.15.135:0/1179607489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 0x55fc69686fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01fcb8a640 1 -- 172.21.15.135:0/1179607489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967dfe0 msgr2=0x55fc6967e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01fcb8a640 1 --2- 172.21.15.135:0/1179607489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967dfe0 0x55fc6967e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01fcb8a640 1 -- 172.21.15.135:0/1179607489 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc693bd7e0 con 0x55fc696874e0 2024-04-20T12:25:25.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01fd38b640 1 --2- 172.21.15.135:0/1179607489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 0x55fc69686fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:25.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01fcb8a640 1 --2- 172.21.15.135:0/1179607489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc696874e0 0x55fc696898d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f01e8006010 tx=0x7f01e802c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9cbf6a1946ac9e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:25.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01fdb8c640 1 --2- 172.21.15.135:0/2710742109 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f01e40a3d20 0x7f01e40a61e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009370 tx=0x7f01f0009520 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:25.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.670+0000 7f01e37fe640 1 -- 172.21.15.135:0/1179607489 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8041020 con 0x55fc696874e0 2024-04-20T12:25:25.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.671+0000 7f01e37fe640 1 -- 172.21.15.135:0/1179607489 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01e802c9b0 con 0x55fc696874e0 2024-04-20T12:25:25.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.671+0000 7f01e37fe640 1 -- 172.21.15.135:0/1179607489 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e80055f0 con 0x55fc696874e0 2024-04-20T12:25:25.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.671+0000 7f02021d7740 1 -- 172.21.15.135:0/1179607489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc696874e0 msgr2=0x55fc696898d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.671+0000 7f02021d7740 1 --2- 172.21.15.135:0/1179607489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc696874e0 0x55fc696898d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f01e8006010 tx=0x7f01e802c700 comp rx=0 tx=0).stop 2024-04-20T12:25:25.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.671+0000 7f02021d7740 1 -- 172.21.15.135:0/1179607489 shutdown_connections 2024-04-20T12:25:25.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.671+0000 7f02021d7740 1 --2- 172.21.15.135:0/1179607489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc696874e0 0x55fc696898d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.671+0000 7f02021d7740 1 --2- 172.21.15.135:0/1179607489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 0x55fc69686fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.671+0000 7f02021d7740 1 --2- 172.21.15.135:0/1179607489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967dfe0 0x55fc6967e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.671+0000 7f02021d7740 1 -- 172.21.15.135:0/1179607489 >> 172.21.15.135:0/1179607489 conn(0x55fc69678710 msgr2=0x55fc69678af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:25.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.671+0000 7f02021d7740 1 -- 172.21.15.135:0/1179607489 shutdown_connections 2024-04-20T12:25:25.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.671+0000 7f02021d7740 1 -- 172.21.15.135:0/1179607489 wait complete. 2024-04-20T12:25:25.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.672+0000 7f02021d7740 1 -- start start 2024-04-20T12:25:25.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.672+0000 7f02021d7740 1 Processor -- start 2024-04-20T12:25:25.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.672+0000 7f02021d7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6967dfe0 0x55fc69686e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.672+0000 7f02021d7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967e900 0x55fc696841f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.672+0000 7f02021d7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc696874e0 0x55fc69684770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.672+0000 7f02021d7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fc6968a270 con 0x55fc6967dfe0 2024-04-20T12:25:25.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.672+0000 7f02021d7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fc6956b480 con 0x55fc6967e900 2024-04-20T12:25:25.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.672+0000 7f02021d7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fc6968a3f0 con 0x55fc696874e0 2024-04-20T12:25:25.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.672+0000 7f02021d7740 10 client.0 _ll_register_callbacks cb 0x55fc6956ae70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:25.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.672+0000 7f01fd38b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6967dfe0 0x55fc69686e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.672+0000 7f01fd38b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6967dfe0 0x55fc69686e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50522/0 (socket says 172.21.15.135:50522) 2024-04-20T12:25:25.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.672+0000 7f01fd38b640 1 -- 172.21.15.135:0/2037172503 learned_addr learned my addr 172.21.15.135:0/2037172503 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:25.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.672+0000 7f01fdb8c640 1 --2- 172.21.15.135:0/2037172503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc696874e0 0x55fc69684770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.672+0000 7f01fcb8a640 1 --2- 172.21.15.135:0/2037172503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967e900 0x55fc696841f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.672+0000 7f01fd38b640 1 -- 172.21.15.135:0/2037172503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc696874e0 msgr2=0x55fc69684770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f01fd38b640 1 --2- 172.21.15.135:0/2037172503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc696874e0 0x55fc69684770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f01fd38b640 1 -- 172.21.15.135:0/2037172503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967e900 msgr2=0x55fc696841f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f01fd38b640 1 --2- 172.21.15.135:0/2037172503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967e900 0x55fc696841f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f01fd38b640 1 -- 172.21.15.135:0/2037172503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc6941df70 con 0x55fc6967dfe0 2024-04-20T12:25:25.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f01fcb8a640 1 --2- 172.21.15.135:0/2037172503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967e900 0x55fc696841f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:25.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f01fd38b640 1 --2- 172.21.15.135:0/2037172503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6967dfe0 0x55fc69686e60 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f01f40980a0 tx=0x7f01f406a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce833d08da2ea3ec server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:25.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f01e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:25.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f01e0ff9640 1 -- 172.21.15.135:0/2037172503 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f401e070 con 0x55fc6967dfe0 2024-04-20T12:25:25.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f01e0ff9640 1 -- 172.21.15.135:0/2037172503 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f01f40982b0 con 0x55fc6967dfe0 2024-04-20T12:25:25.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f02021d7740 1 -- 172.21.15.135:0/2037172503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01e802c9b0 con 0x55fc6967dfe0 2024-04-20T12:25:25.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f01e0ff9640 1 -- 172.21.15.135:0/2037172503 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f01f4066750 con 0x55fc6967dfe0 2024-04-20T12:25:25.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f02021d7740 10 client.16533 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:25.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f02021d7740 1 -- 172.21.15.135:0/2037172503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fc692b5170 con 0x55fc6967dfe0 2024-04-20T12:25:25.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f01e0ff9640 1 -- 172.21.15.135:0/2037172503 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01e802c9b0 con 0x55fc6967dfe0 2024-04-20T12:25:25.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f01e0ff9640 1 -- 172.21.15.135:0/2037172503 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f01f40cd560 con 0x55fc6967dfe0 2024-04-20T12:25:25.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f02021d7740 10 client.16533 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:25.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f02021d7740 10 client.16533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:25.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f02021d7740 20 client.16533 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:25.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f02021d7740 1 --2- 172.21.15.135:0/2037172503 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fc696974c0 0x55fc69699950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f02021d7740 4 client.16533 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:25.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.673+0000 7f02021d7740 1 -- 172.21.15.135:0/2037172503 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc695f0920 con 0x55fc696974c0 2024-04-20T12:25:25.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.674+0000 7f01fcb8a640 1 --2- 172.21.15.135:0/2037172503 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fc696974c0 0x55fc69699950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.674+0000 7f01e0ff9640 10 client.16533 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:25.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.674+0000 7f01fcb8a640 1 --2- 172.21.15.135:0/2037172503 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fc696974c0 0x55fc69699950 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56b1e0c89572f2fb server_cookie=e677478128156cd3 in_seq=0 out_seq=0 2024-04-20T12:25:25.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.675+0000 7f01e0ff9640 1 -- 172.21.15.135:0/2037172503 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fc695f0920 con 0x55fc696974c0 2024-04-20T12:25:25.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.675+0000 7f01e0ff9640 10 client.16533 handle_command_reply: tid=0 2024-04-20T12:25:25.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.675+0000 7f02021d7740 1 client.16533 shutdown 2024-04-20T12:25:25.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.675+0000 7f02021d7740 1 -- 172.21.15.135:0/2037172503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6967dfe0 msgr2=0x55fc69686e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.675+0000 7f02021d7740 1 --2- 172.21.15.135:0/2037172503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6967dfe0 0x55fc69686e60 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f01f40980a0 tx=0x7f01f406a5f0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.675+0000 7f02021d7740 1 -- 172.21.15.135:0/2037172503 shutdown_connections 2024-04-20T12:25:25.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.675+0000 7f02021d7740 1 --2- 172.21.15.135:0/2037172503 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fc696974c0 0x55fc69699950 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.675+0000 7f02021d7740 1 --2- 172.21.15.135:0/2037172503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc696874e0 0x55fc69684770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.675+0000 7f02021d7740 1 --2- 172.21.15.135:0/2037172503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967e900 0x55fc696841f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.675+0000 7f01e0ff9640 0 client.16533 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:25.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.675+0000 7f02021d7740 1 --2- 172.21.15.135:0/2037172503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6967dfe0 0x55fc69686e60 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.675+0000 7f02021d7740 1 -- 172.21.15.135:0/2037172503 >> 172.21.15.135:0/2037172503 conn(0x55fc69678710 msgr2=0x55fc6967a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:25.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.675+0000 7f02021d7740 1 -- 172.21.15.135:0/2037172503 shutdown_connections 2024-04-20T12:25:25.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.675+0000 7f02021d7740 1 -- 172.21.15.135:0/2037172503 wait complete. 2024-04-20T12:25:25.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.675+0000 7f02021d7740 20 client.16533 trim_cache size 0 max 16384 2024-04-20T12:25:25.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.693+0000 7f02021d7740 1 Processor -- start 2024-04-20T12:25:25.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.693+0000 7f02021d7740 1 -- start start 2024-04-20T12:25:25.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.693+0000 7f02021d7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967dfe0 0x55fc6967a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.693+0000 7f02021d7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 0x55fc6967f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.693+0000 7f02021d7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc696874e0 0x55fc69686920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.693+0000 7f02021d7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01f81b1600 con 0x55fc696874e0 2024-04-20T12:25:25.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.693+0000 7f02021d7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f01f81b3140 con 0x55fc6967dfe0 2024-04-20T12:25:25.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.693+0000 7f02021d7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f01f81b1cd0 con 0x55fc6967e900 2024-04-20T12:25:25.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.694+0000 7f01fdb8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc696874e0 0x55fc69686920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.694+0000 7f01fcb8a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 0x55fc6967f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.694+0000 7f01fcb8a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 0x55fc6967f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.135:58890/0 (socket says 172.21.15.135:58890) 2024-04-20T12:25:25.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.694+0000 7f01fd38b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967dfe0 0x55fc6967a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.694+0000 7f01fcb8a640 1 -- 172.21.15.135:0/2067050428 learned_addr learned my addr 172.21.15.135:0/2067050428 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:25.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.694+0000 7f01fdb8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc696874e0 0x55fc69686920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50528/0 (socket says 172.21.15.135:50528) 2024-04-20T12:25:25.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.694+0000 7f01fcb8a640 1 -- 172.21.15.135:0/2067050428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967dfe0 msgr2=0x55fc6967a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.694+0000 7f01fcb8a640 1 --2- 172.21.15.135:0/2067050428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967dfe0 0x55fc6967a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.694+0000 7f01fcb8a640 1 -- 172.21.15.135:0/2067050428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc696874e0 msgr2=0x55fc69686920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.694+0000 7f01fcb8a640 1 --2- 172.21.15.135:0/2067050428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc696874e0 0x55fc69686920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.694+0000 7f01fcb8a640 1 -- 172.21.15.135:0/2067050428 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc6967e730 con 0x55fc6967e900 2024-04-20T12:25:25.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.694+0000 7f01fdb8c640 1 --2- 172.21.15.135:0/2067050428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc696874e0 0x55fc69686920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:25:25.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.694+0000 7f01fcb8a640 1 --2- 172.21.15.135:0/2067050428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 0x55fc6967f530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009900 tx=0x7f01e802bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f21e9cde2722bca9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:25.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.697+0000 7f01e2ffd640 1 -- 172.21.15.135:0/2067050428 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8041040 con 0x55fc6967e900 2024-04-20T12:25:25.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.697+0000 7f01e2ffd640 1 -- 172.21.15.135:0/2067050428 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01e804a030 con 0x55fc6967e900 2024-04-20T12:25:25.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.697+0000 7f01e2ffd640 1 -- 172.21.15.135:0/2067050428 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8004c20 con 0x55fc6967e900 2024-04-20T12:25:25.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.698+0000 7f02021d7740 1 -- 172.21.15.135:0/2067050428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 msgr2=0x55fc6967f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.698+0000 7f02021d7740 1 --2- 172.21.15.135:0/2067050428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 0x55fc6967f530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f01e8009900 tx=0x7f01e802bd60 comp rx=0 tx=0).stop 2024-04-20T12:25:25.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.698+0000 7f02021d7740 1 -- 172.21.15.135:0/2067050428 shutdown_connections 2024-04-20T12:25:25.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.698+0000 7f02021d7740 1 --2- 172.21.15.135:0/2067050428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc696874e0 0x55fc69686920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.698+0000 7f02021d7740 1 --2- 172.21.15.135:0/2067050428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 0x55fc6967f530 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.698+0000 7f02021d7740 1 --2- 172.21.15.135:0/2067050428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc6967dfe0 0x55fc6967a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.698+0000 7f02021d7740 1 -- 172.21.15.135:0/2067050428 >> 172.21.15.135:0/2067050428 conn(0x55fc69678710 msgr2=0x55fc6967ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:25.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.698+0000 7f02021d7740 1 -- 172.21.15.135:0/2067050428 shutdown_connections 2024-04-20T12:25:25.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.698+0000 7f02021d7740 1 -- 172.21.15.135:0/2067050428 wait complete. 2024-04-20T12:25:25.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.698+0000 7f02021d7740 1 -- start start 2024-04-20T12:25:25.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.698+0000 7f02021d7740 1 Processor -- start 2024-04-20T12:25:25.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f02021d7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6967dfe0 0x55fc6968f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f02021d7740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 0x55fc6968ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f02021d7740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc696874e0 0x55fc6968bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f02021d7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f01f81b2a70 con 0x55fc6967dfe0 2024-04-20T12:25:25.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f02021d7740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f01f81b23a0 con 0x55fc696874e0 2024-04-20T12:25:25.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f02021d7740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f01f81af5d0 con 0x55fc6967e900 2024-04-20T12:25:25.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f02021d7740 10 client.0 _ll_register_callbacks cb 0x7f01f409ba10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:25.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f01fd38b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6967dfe0 0x55fc6968f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f01fd38b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6967dfe0 0x55fc6968f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50540/0 (socket says 172.21.15.135:50540) 2024-04-20T12:25:25.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f01fd38b640 1 -- 172.21.15.135:0/2905725930 learned_addr learned my addr 172.21.15.135:0/2905725930 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:25.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f01fdb8c640 1 --2- 172.21.15.135:0/2905725930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc696874e0 0x55fc6968bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f01fcb8a640 1 --2- 172.21.15.135:0/2905725930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 0x55fc6968ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f01fd38b640 1 -- 172.21.15.135:0/2905725930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 msgr2=0x55fc6968ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f01fd38b640 1 --2- 172.21.15.135:0/2905725930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 0x55fc6968ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f01fd38b640 1 -- 172.21.15.135:0/2905725930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc696874e0 msgr2=0x55fc6968bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f01fd38b640 1 --2- 172.21.15.135:0/2905725930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc696874e0 0x55fc6968bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f01fd38b640 1 -- 172.21.15.135:0/2905725930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc6968c4b0 con 0x55fc6967dfe0 2024-04-20T12:25:25.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f01fd38b640 1 --2- 172.21.15.135:0/2905725930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6967dfe0 0x55fc6968f6b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f01f4098050 tx=0x7f01f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99211311b05421d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:25.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f01e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:25.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f01e0ff9640 1 -- 172.21.15.135:0/2905725930 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f401e040 con 0x55fc6967dfe0 2024-04-20T12:25:25.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f01e0ff9640 1 -- 172.21.15.135:0/2905725930 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f01f406a1c0 con 0x55fc6967dfe0 2024-04-20T12:25:25.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f02021d7740 1 -- 172.21.15.135:0/2905725930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01e804a030 con 0x55fc6967dfe0 2024-04-20T12:25:25.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.699+0000 7f01e0ff9640 1 -- 172.21.15.135:0/2905725930 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f01f40bc2c0 con 0x55fc6967dfe0 2024-04-20T12:25:25.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.700+0000 7f02021d7740 10 client.16539 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:25.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.700+0000 7f02021d7740 1 -- 172.21.15.135:0/2905725930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fc696fe790 con 0x55fc6967dfe0 2024-04-20T12:25:25.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.700+0000 7f01e0ff9640 1 -- 172.21.15.135:0/2905725930 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01e804a030 con 0x55fc6967dfe0 2024-04-20T12:25:25.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.700+0000 7f01e0ff9640 1 -- 172.21.15.135:0/2905725930 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f01f40a4420 con 0x55fc6967dfe0 2024-04-20T12:25:25.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.700+0000 7f02021d7740 10 client.16539 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:25.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.700+0000 7f02021d7740 10 client.16539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:25.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.700+0000 7f02021d7740 20 client.16539 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:25.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.700+0000 7f02021d7740 1 --2- 172.21.15.135:0/2905725930 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fc696fedf0 0x55fc69701210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.700+0000 7f02021d7740 4 client.16539 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:25:25.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.700+0000 7f02021d7740 1 -- 172.21.15.135:0/2905725930 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fc695ea790 con 0x55fc696fedf0 2024-04-20T12:25:25.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.700+0000 7f01fcb8a640 1 --2- 172.21.15.135:0/2905725930 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fc696fedf0 0x55fc69701210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.701+0000 7f01e0ff9640 10 client.16539 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:25.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.701+0000 7f01fcb8a640 1 --2- 172.21.15.135:0/2905725930 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fc696fedf0 0x55fc69701210 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baeebb35b2d18c8c server_cookie=7e73aa643da27881 in_seq=0 out_seq=0 2024-04-20T12:25:25.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.702+0000 7f01e0ff9640 1 -- 172.21.15.135:0/2905725930 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fc695ea790 con 0x55fc696fedf0 2024-04-20T12:25:25.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.702+0000 7f01e0ff9640 10 client.16539 handle_command_reply: tid=0 2024-04-20T12:25:25.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.702+0000 7f02021d7740 1 client.16539 shutdown 2024-04-20T12:25:25.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.702+0000 7f02021d7740 1 -- 172.21.15.135:0/2905725930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6967dfe0 msgr2=0x55fc6968f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.702+0000 7f02021d7740 1 --2- 172.21.15.135:0/2905725930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6967dfe0 0x55fc6968f6b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f01f4098050 tx=0x7f01f40046c0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.702+0000 7f02021d7740 1 -- 172.21.15.135:0/2905725930 shutdown_connections 2024-04-20T12:25:25.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.702+0000 7f02021d7740 1 --2- 172.21.15.135:0/2905725930 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fc696fedf0 0x55fc69701210 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.702+0000 7f02021d7740 1 --2- 172.21.15.135:0/2905725930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fc696874e0 0x55fc6968bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.702+0000 7f01e0ff9640 0 client.16539 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:25.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.702+0000 7f02021d7740 1 --2- 172.21.15.135:0/2905725930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fc6967e900 0x55fc6968ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.702+0000 7f02021d7740 1 --2- 172.21.15.135:0/2905725930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fc6967dfe0 0x55fc6968f6b0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.702+0000 7f02021d7740 1 -- 172.21.15.135:0/2905725930 >> 172.21.15.135:0/2905725930 conn(0x55fc69678710 msgr2=0x55fc69676cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:25.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.702+0000 7f02021d7740 1 -- 172.21.15.135:0/2905725930 shutdown_connections 2024-04-20T12:25:25.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.702+0000 7f02021d7740 1 -- 172.21.15.135:0/2905725930 wait complete. 2024-04-20T12:25:25.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.702+0000 7f02021d7740 20 client.16539 trim_cache size 0 max 16384 2024-04-20T12:25:25.706 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:25:25.706 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:25:25.706 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "8bec75f6-815c-4294-b50a-bb27e245cb3f", 2024-04-20T12:25:25.707 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:25:25.707 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:25:25.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.703+0000 7f01ff5ef640 1 -- 172.21.15.135:0/2710742109 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f01e40a3d20 msgr2=0x7f01e40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.703+0000 7f01ff5ef640 1 --2- 172.21.15.135:0/2710742109 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f01e40a3d20 0x7f01e40a61e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f01f0009370 tx=0x7f01f0009520 comp rx=0 tx=0).stop 2024-04-20T12:25:25.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.703+0000 7f01ff5ef640 1 -- 172.21.15.135:0/2710742109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01f81031e0 msgr2=0x7f01f8100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.703+0000 7f01ff5ef640 1 --2- 172.21.15.135:0/2710742109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01f81031e0 0x7f01f8100e30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f01f400b4a0 tx=0x7f01f400b960 comp rx=0 tx=0).stop 2024-04-20T12:25:25.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.703+0000 7f01ff5ef640 1 -- 172.21.15.135:0/2710742109 shutdown_connections 2024-04-20T12:25:25.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.703+0000 7f01ff5ef640 1 --2- 172.21.15.135:0/2710742109 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f01e40a3d20 0x7f01e40a61e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.703+0000 7f01ff5ef640 1 --2- 172.21.15.135:0/2710742109 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f01f810c520 0x7f01f81018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.703+0000 7f01ff5ef640 1 --2- 172.21.15.135:0/2710742109 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f01f8103b00 0x7f01f8101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.703+0000 7f01ff5ef640 1 --2- 172.21.15.135:0/2710742109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f01f81031e0 0x7f01f8100e30 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.703+0000 7f01ff5ef640 1 -- 172.21.15.135:0/2710742109 >> 172.21.15.135:0/2710742109 conn(0x7f01f8077f60 msgr2=0x7f01f80fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:25.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.703+0000 7f01ff5ef640 1 -- 172.21.15.135:0/2710742109 shutdown_connections 2024-04-20T12:25:25.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.703+0000 7f01ff5ef640 1 -- 172.21.15.135:0/2710742109 wait complete. 2024-04-20T12:25:25.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:25:25.714 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:25:25.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.814+0000 7fc893115640 1 -- 172.21.15.135:0/1825716705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc88c105e70 msgr2=0x7fc88c106250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.814+0000 7fc893115640 1 --2- 172.21.15.135:0/1825716705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc88c105e70 0x7fc88c106250 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc880009900 tx=0x7fc88002bc30 comp rx=0 tx=0).stop 2024-04-20T12:25:25.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.814+0000 7fc893115640 1 -- 172.21.15.135:0/1825716705 shutdown_connections 2024-04-20T12:25:25.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.814+0000 7fc893115640 1 --2- 172.21.15.135:0/1825716705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc88c101f50 0x7fc88c10dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.814+0000 7fc893115640 1 --2- 172.21.15.135:0/1825716705 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc88c101590 0x7fc88c101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.814+0000 7fc893115640 1 --2- 172.21.15.135:0/1825716705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc88c105e70 0x7fc88c106250 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.814+0000 7fc893115640 1 -- 172.21.15.135:0/1825716705 >> 172.21.15.135:0/1825716705 conn(0x7fc88c077420 msgr2=0x7fc88c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:25.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.814+0000 7fc893115640 1 -- 172.21.15.135:0/1825716705 shutdown_connections 2024-04-20T12:25:25.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.814+0000 7fc893115640 1 -- 172.21.15.135:0/1825716705 wait complete. 2024-04-20T12:25:25.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc893115640 1 Processor -- start 2024-04-20T12:25:25.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc893115640 1 -- start start 2024-04-20T12:25:25.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc893115640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc88c101590 0x7fc88c19e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc893115640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc88c101f50 0x7fc88c19e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc893115640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc88c105e70 0x7fc88c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc893115640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c1111d0 con 0x7fc88c101590 2024-04-20T12:25:25.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc893115640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c111050 con 0x7fc88c105e70 2024-04-20T12:25:25.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc893115640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c111350 con 0x7fc88c101f50 2024-04-20T12:25:25.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc890eb1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc88c101590 0x7fc88c19e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc890eb1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc88c101590 0x7fc88c19e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50570/0 (socket says 172.21.15.135:50570) 2024-04-20T12:25:25.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc890eb1640 1 -- 172.21.15.135:0/3403219339 learned_addr learned my addr 172.21.15.135:0/3403219339 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:25.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc890eb1640 1 -- 172.21.15.135:0/3403219339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc88c101f50 msgr2=0x7fc88c19e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc890eb1640 1 --2- 172.21.15.135:0/3403219339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc88c101f50 0x7fc88c19e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc890eb1640 1 -- 172.21.15.135:0/3403219339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc88c105e70 msgr2=0x7fc88c1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc890eb1640 1 --2- 172.21.15.135:0/3403219339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc88c105e70 0x7fc88c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc890eb1640 1 -- 172.21.15.135:0/3403219339 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c198d40 con 0x7fc88c101590 2024-04-20T12:25:25.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.815+0000 7fc890eb1640 1 --2- 172.21.15.135:0/3403219339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc88c101590 0x7fc88c19e410 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc880005940 tx=0x7fc8800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:25.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.816+0000 7fc889ffb640 1 -- 172.21.15.135:0/3403219339 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc880041070 con 0x7fc88c101590 2024-04-20T12:25:25.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.816+0000 7fc893115640 1 -- 172.21.15.135:0/3403219339 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88c198fd0 con 0x7fc88c101590 2024-04-20T12:25:25.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.816+0000 7fc889ffb640 1 -- 172.21.15.135:0/3403219339 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc88002ccc0 con 0x7fc88c101590 2024-04-20T12:25:25.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.816+0000 7fc889ffb640 1 -- 172.21.15.135:0/3403219339 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc880003d80 con 0x7fc88c101590 2024-04-20T12:25:25.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.816+0000 7fc893115640 1 -- 172.21.15.135:0/3403219339 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc88c1a52d0 con 0x7fc88c101590 2024-04-20T12:25:25.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.818+0000 7fc889ffb640 1 -- 172.21.15.135:0/3403219339 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fc880044070 con 0x7fc88c101590 2024-04-20T12:25:25.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.818+0000 7fc895de3740 1 Processor -- start 2024-04-20T12:25:25.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.818+0000 7fc895de3740 1 -- start start 2024-04-20T12:25:25.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.818+0000 7fc895de3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d7d20 0x561ba30d8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.818+0000 7fc895de3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d8640 0x561ba30e0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.818+0000 7fc889ffb640 1 --2- 172.21.15.135:0/3403219339 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc87c0a3d20 0x7fc87c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.818+0000 7fc895de3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30e1220 0x561ba30e3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc895de3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561ba303d1b0 con 0x561ba30d8640 2024-04-20T12:25:25.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc895de3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561ba2fda390 con 0x561ba30d7d20 2024-04-20T12:25:25.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc895de3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561ba3039170 con 0x561ba30e1220 2024-04-20T12:25:25.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc890eb1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d8640 0x561ba30e0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc88bfff640 1 --2- 172.21.15.135:0/3403219339 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc87c0a3d20 0x7fc87c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc890eb1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d8640 0x561ba30e0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50580/0 (socket says 172.21.15.135:50580) 2024-04-20T12:25:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc890eb1640 1 -- 172.21.15.135:0/1322686971 learned_addr learned my addr 172.21.15.135:0/1322686971 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc8916b2640 1 --2- 172.21.15.135:0/1322686971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d7d20 0x561ba30d8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc8916b2640 1 --2- 172.21.15.135:0/1322686971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30e1220 0x561ba30e3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc889ffb640 1 -- 172.21.15.135:0/3403219339 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc8800f2a10 con 0x7fc88c101590 2024-04-20T12:25:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc890eb1640 1 -- 172.21.15.135:0/1322686971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30e1220 msgr2=0x561ba30e3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc890eb1640 1 --2- 172.21.15.135:0/1322686971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30e1220 0x561ba30e3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc890eb1640 1 -- 172.21.15.135:0/1322686971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d7d20 msgr2=0x561ba30d8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc890eb1640 1 --2- 172.21.15.135:0/1322686971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d7d20 0x561ba30d8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc890eb1640 1 -- 172.21.15.135:0/1322686971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ba2e197d0 con 0x561ba30d8640 2024-04-20T12:25:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc8916b2640 1 --2- 172.21.15.135:0/1322686971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d7d20 0x561ba30d8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc88bfff640 1 --2- 172.21.15.135:0/3403219339 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc87c0a3d20 0x7fc87c0a61e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc8780058c0 tx=0x7fc878005850 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc890eb1640 1 --2- 172.21.15.135:0/1322686971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d8640 0x561ba30e0ce0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc8800bb110 tx=0x7fc88008d0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e9c404c8e1f519 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc876ffd640 1 -- 172.21.15.135:0/1322686971 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88004b070 con 0x561ba30d8640 2024-04-20T12:25:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc876ffd640 1 -- 172.21.15.135:0/1322686971 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc880004c80 con 0x561ba30d8640 2024-04-20T12:25:25.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.819+0000 7fc876ffd640 1 -- 172.21.15.135:0/1322686971 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc880089250 con 0x561ba30d8640 2024-04-20T12:25:25.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.820+0000 7fc895de3740 1 -- 172.21.15.135:0/1322686971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d8640 msgr2=0x561ba30e0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.820+0000 7fc895de3740 1 --2- 172.21.15.135:0/1322686971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d8640 0x561ba30e0ce0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc8800bb110 tx=0x7fc88008d0f0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.820+0000 7fc895de3740 1 -- 172.21.15.135:0/1322686971 shutdown_connections 2024-04-20T12:25:25.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.820+0000 7fc895de3740 1 --2- 172.21.15.135:0/1322686971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30e1220 0x561ba30e3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.820+0000 7fc895de3740 1 --2- 172.21.15.135:0/1322686971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d8640 0x561ba30e0ce0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.820+0000 7fc895de3740 1 --2- 172.21.15.135:0/1322686971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d7d20 0x561ba30d8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.820+0000 7fc895de3740 1 -- 172.21.15.135:0/1322686971 >> 172.21.15.135:0/1322686971 conn(0x561ba30d2450 msgr2=0x561ba30d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:25.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.820+0000 7fc895de3740 1 -- 172.21.15.135:0/1322686971 shutdown_connections 2024-04-20T12:25:25.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.820+0000 7fc895de3740 1 -- 172.21.15.135:0/1322686971 wait complete. 2024-04-20T12:25:25.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.820+0000 7fc895de3740 1 -- start start 2024-04-20T12:25:25.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.820+0000 7fc895de3740 1 Processor -- start 2024-04-20T12:25:25.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc895de3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d7d20 0x561ba30de220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc895de3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d8640 0x561ba30de760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc895de3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30e1220 0x561ba30deca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.827 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc895de3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561ba30e3dd0 con 0x561ba30d7d20 2024-04-20T12:25:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc895de3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561ba2ff62f0 con 0x561ba30d8640 2024-04-20T12:25:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc895de3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561ba30e3f50 con 0x561ba30e1220 2024-04-20T12:25:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc895de3740 10 client.0 _ll_register_callbacks cb 0x561ba2fc04e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc890eb1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d7d20 0x561ba30de220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc890eb1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d7d20 0x561ba30de220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50594/0 (socket says 172.21.15.135:50594) 2024-04-20T12:25:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc890eb1640 1 -- 172.21.15.135:0/659606179 learned_addr learned my addr 172.21.15.135:0/659606179 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc8916b2640 1 --2- 172.21.15.135:0/659606179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30e1220 0x561ba30deca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc88bfff640 1 --2- 172.21.15.135:0/659606179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d8640 0x561ba30de760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc890eb1640 1 -- 172.21.15.135:0/659606179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30e1220 msgr2=0x561ba30deca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc890eb1640 1 --2- 172.21.15.135:0/659606179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30e1220 0x561ba30deca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc890eb1640 1 -- 172.21.15.135:0/659606179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d8640 msgr2=0x561ba30de760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc890eb1640 1 --2- 172.21.15.135:0/659606179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d8640 0x561ba30de760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc890eb1640 1 -- 172.21.15.135:0/659606179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ba2d4f3f0 con 0x561ba30d7d20 2024-04-20T12:25:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc8916b2640 1 --2- 172.21.15.135:0/659606179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30e1220 0x561ba30deca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:25.828 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc88bfff640 1 --2- 172.21.15.135:0/659606179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d8640 0x561ba30de760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc890eb1640 1 --2- 172.21.15.135:0/659606179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d7d20 0x561ba30de220 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc8800f03e0 tx=0x7fc880004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7527d03abd122279 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.821+0000 7fc86bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.822+0000 7fc86bfff640 1 -- 172.21.15.135:0/659606179 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc88004b040 con 0x561ba30d7d20 2024-04-20T12:25:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.822+0000 7fc86bfff640 1 -- 172.21.15.135:0/659606179 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc8800bca40 con 0x561ba30d7d20 2024-04-20T12:25:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.822+0000 7fc895de3740 1 -- 172.21.15.135:0/659606179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc880004c80 con 0x561ba30d7d20 2024-04-20T12:25:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.822+0000 7fc86bfff640 1 -- 172.21.15.135:0/659606179 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc880087300 con 0x561ba30d7d20 2024-04-20T12:25:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.822+0000 7fc895de3740 10 client.16551 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.822+0000 7fc895de3740 1 -- 172.21.15.135:0/659606179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561ba2d0f0f0 con 0x561ba30d7d20 2024-04-20T12:25:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.822+0000 7fc86bfff640 1 -- 172.21.15.135:0/659606179 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc880004c80 con 0x561ba30d7d20 2024-04-20T12:25:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.822+0000 7fc86bfff640 1 -- 172.21.15.135:0/659606179 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc8800badb0 con 0x561ba30d7d20 2024-04-20T12:25:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.822+0000 7fc895de3740 10 client.16551 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:25.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.822+0000 7fc895de3740 10 client.16551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.822+0000 7fc895de3740 20 client.16551 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.822+0000 7fc895de3740 1 --2- 172.21.15.135:0/659606179 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561ba30f1120 0x561ba30f3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.822+0000 7fc895de3740 4 client.16551 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.822+0000 7fc895de3740 1 -- 172.21.15.135:0/659606179 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ba304abd0 con 0x561ba30f1120 2024-04-20T12:25:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.822+0000 7fc88bfff640 1 --2- 172.21.15.135:0/659606179 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561ba30f1120 0x561ba30f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.823+0000 7fc86bfff640 10 client.16551 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.823+0000 7fc88bfff640 1 --2- 172.21.15.135:0/659606179 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561ba30f1120 0x561ba30f3510 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a335a1439f1987d server_cookie=f5b5d93514bab67e in_seq=0 out_seq=0 2024-04-20T12:25:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.823+0000 7fc86bfff640 1 -- 172.21.15.135:0/659606179 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561ba304abd0 con 0x561ba30f1120 2024-04-20T12:25:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.823+0000 7fc86bfff640 10 client.16551 handle_command_reply: tid=0 2024-04-20T12:25:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.823+0000 7fc895de3740 1 client.16551 shutdown 2024-04-20T12:25:25.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.824+0000 7fc895de3740 1 -- 172.21.15.135:0/659606179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d7d20 msgr2=0x561ba30de220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.824+0000 7fc895de3740 1 --2- 172.21.15.135:0/659606179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d7d20 0x561ba30de220 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc8800f03e0 tx=0x7fc880004590 comp rx=0 tx=0).stop 2024-04-20T12:25:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.824+0000 7fc895de3740 1 -- 172.21.15.135:0/659606179 shutdown_connections 2024-04-20T12:25:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.824+0000 7fc895de3740 1 --2- 172.21.15.135:0/659606179 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561ba30f1120 0x561ba30f3510 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.824+0000 7fc895de3740 1 --2- 172.21.15.135:0/659606179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30e1220 0x561ba30deca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.824+0000 7fc895de3740 1 --2- 172.21.15.135:0/659606179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d8640 0x561ba30de760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.824+0000 7fc86bfff640 0 client.16551 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.824+0000 7fc895de3740 1 --2- 172.21.15.135:0/659606179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d7d20 0x561ba30de220 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.824+0000 7fc895de3740 1 -- 172.21.15.135:0/659606179 >> 172.21.15.135:0/659606179 conn(0x561ba30d2450 msgr2=0x561ba30d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.824+0000 7fc895de3740 1 -- 172.21.15.135:0/659606179 shutdown_connections 2024-04-20T12:25:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.824+0000 7fc895de3740 1 -- 172.21.15.135:0/659606179 wait complete. 2024-04-20T12:25:25.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.824+0000 7fc895de3740 20 client.16551 trim_cache size 0 max 16384 2024-04-20T12:25:25.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.841+0000 7fc895de3740 1 Processor -- start 2024-04-20T12:25:25.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.841+0000 7fc895de3740 1 -- start start 2024-04-20T12:25:25.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.841+0000 7fc895de3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30d7d20 0x561ba30ecbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.841+0000 7fc895de3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d8640 0x561ba30deac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.841+0000 7fc895de3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30e1220 0x561ba30d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.841+0000 7fc895de3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c1af2c0 con 0x561ba30e1220 2024-04-20T12:25:25.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.841+0000 7fc895de3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c1b0e00 con 0x561ba30d8640 2024-04-20T12:25:25.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.841+0000 7fc895de3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c1af990 con 0x561ba30d7d20 2024-04-20T12:25:25.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.841+0000 7fc8916b2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30e1220 0x561ba30d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.841+0000 7fc8916b2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30e1220 0x561ba30d14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50596/0 (socket says 172.21.15.135:50596) 2024-04-20T12:25:25.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.841+0000 7fc8916b2640 1 -- 172.21.15.135:0/4019010993 learned_addr learned my addr 172.21.15.135:0/4019010993 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:25.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.842+0000 7fc890eb1640 1 --2- 172.21.15.135:0/4019010993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30d7d20 0x561ba30ecbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.842+0000 7fc88bfff640 1 --2- 172.21.15.135:0/4019010993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d8640 0x561ba30deac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.842+0000 7fc8916b2640 1 -- 172.21.15.135:0/4019010993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30d7d20 msgr2=0x561ba30ecbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.842+0000 7fc8916b2640 1 --2- 172.21.15.135:0/4019010993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30d7d20 0x561ba30ecbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.842+0000 7fc8916b2640 1 -- 172.21.15.135:0/4019010993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d8640 msgr2=0x561ba30deac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.842+0000 7fc8916b2640 1 --2- 172.21.15.135:0/4019010993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d8640 0x561ba30deac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.848 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.842+0000 7fc8916b2640 1 -- 172.21.15.135:0/4019010993 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ba30e3610 con 0x561ba30e1220 2024-04-20T12:25:25.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.842+0000 7fc88bfff640 1 --2- 172.21.15.135:0/4019010993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d8640 0x561ba30deac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:25.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.842+0000 7fc8916b2640 1 --2- 172.21.15.135:0/4019010993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30e1220 0x561ba30d14b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc8840126e0 tx=0x7fc884009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f310877db83a566 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:25.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.842+0000 7fc8767fc640 1 -- 172.21.15.135:0/4019010993 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc884004d20 con 0x561ba30e1220 2024-04-20T12:25:25.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.842+0000 7fc8767fc640 1 -- 172.21.15.135:0/4019010993 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc884003970 con 0x561ba30e1220 2024-04-20T12:25:25.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.842+0000 7fc8767fc640 1 -- 172.21.15.135:0/4019010993 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8840045d0 con 0x561ba30e1220 2024-04-20T12:25:25.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 -- 172.21.15.135:0/4019010993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30e1220 msgr2=0x561ba30d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 --2- 172.21.15.135:0/4019010993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30e1220 0x561ba30d14b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc8840126e0 tx=0x7fc884009c40 comp rx=0 tx=0).stop 2024-04-20T12:25:25.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 -- 172.21.15.135:0/4019010993 shutdown_connections 2024-04-20T12:25:25.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 --2- 172.21.15.135:0/4019010993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30e1220 0x561ba30d14b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 --2- 172.21.15.135:0/4019010993 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30d8640 0x561ba30deac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 --2- 172.21.15.135:0/4019010993 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30d7d20 0x561ba30ecbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 -- 172.21.15.135:0/4019010993 >> 172.21.15.135:0/4019010993 conn(0x561ba30d2450 msgr2=0x561ba30d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:25.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 -- 172.21.15.135:0/4019010993 shutdown_connections 2024-04-20T12:25:25.849 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 -- 172.21.15.135:0/4019010993 wait complete. 2024-04-20T12:25:25.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 -- start start 2024-04-20T12:25:25.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 Processor -- start 2024-04-20T12:25:25.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30d7d20 0x561ba30e9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d8640 0x561ba30e67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30e1220 0x561ba30e6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c1b0730 con 0x561ba30d8640 2024-04-20T12:25:25.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c1b0060 con 0x561ba30e1220 2024-04-20T12:25:25.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c1ad290 con 0x561ba30d7d20 2024-04-20T12:25:25.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc895de3740 10 client.0 _ll_register_callbacks cb 0x7fc884009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:25.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.843+0000 7fc88bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d8640 0x561ba30e67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc88bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d8640 0x561ba30e67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:50608/0 (socket says 172.21.15.135:50608) 2024-04-20T12:25:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc88bfff640 1 -- 172.21.15.135:0/4033490578 learned_addr learned my addr 172.21.15.135:0/4033490578 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc8916b2640 1 --2- 172.21.15.135:0/4033490578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30e1220 0x561ba30e6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc890eb1640 1 --2- 172.21.15.135:0/4033490578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30d7d20 0x561ba30e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc88bfff640 1 -- 172.21.15.135:0/4033490578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30d7d20 msgr2=0x561ba30e9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc88bfff640 1 --2- 172.21.15.135:0/4033490578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30d7d20 0x561ba30e9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc88bfff640 1 -- 172.21.15.135:0/4033490578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30e1220 msgr2=0x561ba30e6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc88bfff640 1 --2- 172.21.15.135:0/4033490578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30e1220 0x561ba30e6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc88bfff640 1 -- 172.21.15.135:0/4033490578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ba30e7520 con 0x561ba30d8640 2024-04-20T12:25:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc88bfff640 1 --2- 172.21.15.135:0/4033490578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d8640 0x561ba30e67e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x561ba30dda80 tx=0x7fc878005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992b6e007fda764d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc86bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc86bfff640 1 -- 172.21.15.135:0/4033490578 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc878029070 con 0x561ba30d8640 2024-04-20T12:25:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc86bfff640 1 -- 172.21.15.135:0/4033490578 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc878025300 con 0x561ba30d8640 2024-04-20T12:25:25.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc895de3740 1 -- 172.21.15.135:0/4033490578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc884003970 con 0x561ba30d8640 2024-04-20T12:25:25.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc86bfff640 1 -- 172.21.15.135:0/4033490578 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc878037050 con 0x561ba30d8640 2024-04-20T12:25:25.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc895de3740 10 client.16557 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:25.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc895de3740 1 -- 172.21.15.135:0/4033490578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561ba31574d0 con 0x561ba30d8640 2024-04-20T12:25:25.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.844+0000 7fc86bfff640 1 -- 172.21.15.135:0/4033490578 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc884003970 con 0x561ba30d8640 2024-04-20T12:25:25.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.845+0000 7fc86bfff640 1 -- 172.21.15.135:0/4033490578 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc87802ea30 con 0x561ba30d8640 2024-04-20T12:25:25.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.845+0000 7fc895de3740 10 client.16557 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:25.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.845+0000 7fc895de3740 10 client.16557 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:25.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.845+0000 7fc895de3740 20 client.16557 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:25.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.845+0000 7fc895de3740 1 --2- 172.21.15.135:0/4033490578 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561ba3157c30 0x561ba315a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:25.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.845+0000 7fc895de3740 4 client.16557 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:25:25.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.845+0000 7fc895de3740 1 -- 172.21.15.135:0/4033490578 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561ba30f3a30 con 0x561ba3157c30 2024-04-20T12:25:25.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.845+0000 7fc890eb1640 1 --2- 172.21.15.135:0/4033490578 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561ba3157c30 0x561ba315a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:25.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.845+0000 7fc890eb1640 1 --2- 172.21.15.135:0/4033490578 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561ba3157c30 0x561ba315a050 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13254f6fa06f5a05 server_cookie=a792e9481dd9ffe4 in_seq=0 out_seq=0 2024-04-20T12:25:25.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.845+0000 7fc86bfff640 10 client.16557 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:25.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.845+0000 7fc86bfff640 1 -- 172.21.15.135:0/4033490578 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x561ba30f3a30 con 0x561ba3157c30 2024-04-20T12:25:25.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.845+0000 7fc86bfff640 10 client.16557 handle_command_reply: tid=0 2024-04-20T12:25:25.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.845+0000 7fc895de3740 1 client.16557 shutdown 2024-04-20T12:25:25.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.845+0000 7fc895de3740 1 -- 172.21.15.135:0/4033490578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d8640 msgr2=0x561ba30e67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.845+0000 7fc895de3740 1 --2- 172.21.15.135:0/4033490578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d8640 0x561ba30e67e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x561ba30dda80 tx=0x7fc878005f90 comp rx=0 tx=0).stop 2024-04-20T12:25:25.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc895de3740 1 -- 172.21.15.135:0/4033490578 shutdown_connections 2024-04-20T12:25:25.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc895de3740 1 --2- 172.21.15.135:0/4033490578 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561ba3157c30 0x561ba315a050 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc895de3740 1 --2- 172.21.15.135:0/4033490578 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561ba30e1220 0x561ba30e6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc86bfff640 0 client.16557 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:25.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc895de3740 1 --2- 172.21.15.135:0/4033490578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561ba30d8640 0x561ba30e67e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc895de3740 1 --2- 172.21.15.135:0/4033490578 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561ba30d7d20 0x561ba30e9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc895de3740 1 -- 172.21.15.135:0/4033490578 >> 172.21.15.135:0/4033490578 conn(0x561ba30d2450 msgr2=0x561ba30d1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:25.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc895de3740 1 -- 172.21.15.135:0/4033490578 shutdown_connections 2024-04-20T12:25:25.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc895de3740 1 -- 172.21.15.135:0/4033490578 wait complete. 2024-04-20T12:25:25.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc895de3740 20 client.16557 trim_cache size 0 max 16384 2024-04-20T12:25:25.854 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:25:25.854 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:25:25.854 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:25:25.854 INFO:teuthology.orchestra.run.smithi135.stdout: "8bec75f6-815c-4294-b50a-bb27e245cb3f": { 2024-04-20T12:25:25.854 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:25:25.854 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "8bec75f6-815c-4294-b50a-bb27e245cb3f", 2024-04-20T12:25:25.854 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:25:25.854 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:25:25.855 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:25:25.855 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:25:25.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc893115640 1 -- 172.21.15.135:0/3403219339 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc87c0a3d20 msgr2=0x7fc87c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc893115640 1 --2- 172.21.15.135:0/3403219339 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc87c0a3d20 0x7fc87c0a61e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc8780058c0 tx=0x7fc878005850 comp rx=0 tx=0).stop 2024-04-20T12:25:25.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc893115640 1 -- 172.21.15.135:0/3403219339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc88c101590 msgr2=0x7fc88c19e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:25.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc893115640 1 --2- 172.21.15.135:0/3403219339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc88c101590 0x7fc88c19e410 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc880005940 tx=0x7fc8800042f0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc893115640 1 -- 172.21.15.135:0/3403219339 shutdown_connections 2024-04-20T12:25:25.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc893115640 1 --2- 172.21.15.135:0/3403219339 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc88c105e70 0x7fc88c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc893115640 1 --2- 172.21.15.135:0/3403219339 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc87c0a3d20 0x7fc87c0a61e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc893115640 1 --2- 172.21.15.135:0/3403219339 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc88c101f50 0x7fc88c19e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc893115640 1 --2- 172.21.15.135:0/3403219339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc88c101590 0x7fc88c19e410 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:25.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc893115640 1 -- 172.21.15.135:0/3403219339 >> 172.21.15.135:0/3403219339 conn(0x7fc88c077420 msgr2=0x7fc88c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:25.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc893115640 1 -- 172.21.15.135:0/3403219339 shutdown_connections 2024-04-20T12:25:25.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:25.846+0000 7fc893115640 1 -- 172.21.15.135:0/3403219339 wait complete. 2024-04-20T12:25:25.857 INFO:tasks.cephfs.filesystem:scrub status for tag:8bec75f6-815c-4294-b50a-bb27e245cb3f - {'path': '/', 'tag': '8bec75f6-815c-4294-b50a-bb27e245cb3f', 'options': 'recursive,force'} 2024-04-20T12:25:27.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:26 smithi154 ceph-mon[22073]: pgmap v72: 129 pgs: 129 active+clean; 16 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 84 KiB/s wr, 36 op/s 2024-04-20T12:25:27.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:26 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:25:27.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:26 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:25:27.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:26 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:25:27.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:26 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:25:27.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:26 smithi139 ceph-mon[21834]: pgmap v72: 129 pgs: 129 active+clean; 16 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 84 KiB/s wr, 36 op/s 2024-04-20T12:25:27.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:26 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:25:27.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:26 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:25:27.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:26 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:25:27.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:26 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:25:27.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:26 smithi135 ceph-mon[18264]: pgmap v72: 129 pgs: 129 active+clean; 16 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 84 KiB/s wr, 36 op/s 2024-04-20T12:25:27.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:26 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:25:27.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:26 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:25:27.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:26 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:25:27.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:26 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:25:28.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:27 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:25:28.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:27 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:25:28.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:27 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:25:29.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:28 smithi154 ceph-mon[22073]: pgmap v73: 129 pgs: 129 active+clean; 16 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 84 KiB/s wr, 36 op/s 2024-04-20T12:25:29.082 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:28 smithi139 ceph-mon[21834]: pgmap v73: 129 pgs: 129 active+clean; 16 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 84 KiB/s wr, 36 op/s 2024-04-20T12:25:29.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:28 smithi135 ceph-mon[18264]: pgmap v73: 129 pgs: 129 active+clean; 16 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 84 KiB/s wr, 36 op/s 2024-04-20T12:25:31.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:30 smithi154 ceph-mon[22073]: pgmap v74: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 85 KiB/s wr, 42 op/s 2024-04-20T12:25:31.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:30 smithi139 ceph-mon[21834]: pgmap v74: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 85 KiB/s wr, 42 op/s 2024-04-20T12:25:31.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:30 smithi135 ceph-mon[18264]: pgmap v74: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 85 KiB/s wr, 42 op/s 2024-04-20T12:25:33.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:32 smithi154 ceph-mon[22073]: pgmap v75: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.1 KiB/s wr, 20 op/s 2024-04-20T12:25:33.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:32 smithi139 ceph-mon[21834]: pgmap v75: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.1 KiB/s wr, 20 op/s 2024-04-20T12:25:33.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:32 smithi135 ceph-mon[18264]: pgmap v75: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.1 KiB/s wr, 20 op/s 2024-04-20T12:25:35.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:34 smithi154 ceph-mon[22073]: pgmap v76: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.1 KiB/s wr, 25 op/s 2024-04-20T12:25:35.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:34 smithi139 ceph-mon[21834]: pgmap v76: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.1 KiB/s wr, 25 op/s 2024-04-20T12:25:35.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:34 smithi135 ceph-mon[18264]: pgmap v76: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.1 KiB/s wr, 25 op/s 2024-04-20T12:25:37.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:36 smithi154 ceph-mon[22073]: pgmap v77: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 9 op/s 2024-04-20T12:25:37.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:36 smithi139 ceph-mon[21834]: pgmap v77: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 9 op/s 2024-04-20T12:25:37.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:36 smithi135 ceph-mon[18264]: pgmap v77: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 9 op/s 2024-04-20T12:25:39.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:38 smithi154 ceph-mon[22073]: pgmap v78: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 9 op/s 2024-04-20T12:25:39.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:38 smithi139 ceph-mon[21834]: pgmap v78: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 9 op/s 2024-04-20T12:25:39.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:38 smithi135 ceph-mon[18264]: pgmap v78: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 853 B/s wr, 9 op/s 2024-04-20T12:25:41.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:40 smithi154 ceph-mon[22073]: pgmap v79: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 853 B/s wr, 13 op/s 2024-04-20T12:25:41.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:40 smithi139 ceph-mon[21834]: pgmap v79: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 853 B/s wr, 13 op/s 2024-04-20T12:25:41.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:40 smithi135 ceph-mon[18264]: pgmap v79: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 853 B/s wr, 13 op/s 2024-04-20T12:25:43.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:42 smithi154 ceph-mon[22073]: pgmap v80: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:43.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:42 smithi139 ceph-mon[21834]: pgmap v80: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:43.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:42 smithi135 ceph-mon[18264]: pgmap v80: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:45.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:44 smithi154 ceph-mon[22073]: pgmap v81: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:25:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:44 smithi139 ceph-mon[21834]: pgmap v81: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:25:45.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:44 smithi135 ceph-mon[18264]: pgmap v81: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:25:47.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:46 smithi154 ceph-mon[22073]: pgmap v82: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:47.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:46 smithi139 ceph-mon[21834]: pgmap v82: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:47.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:46 smithi135 ceph-mon[18264]: pgmap v82: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:49.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:48 smithi154 ceph-mon[22073]: pgmap v83: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:49.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:48 smithi139 ceph-mon[21834]: pgmap v83: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:49.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:48 smithi135 ceph-mon[18264]: pgmap v83: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:51.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:50 smithi154 ceph-mon[22073]: pgmap v84: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:25:51.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:50 smithi139 ceph-mon[21834]: pgmap v84: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:25:51.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:50 smithi135 ceph-mon[18264]: pgmap v84: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:25:53.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:52 smithi154 ceph-mon[22073]: pgmap v85: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:53.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:52 smithi139 ceph-mon[21834]: pgmap v85: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:53.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:52 smithi135 ceph-mon[18264]: pgmap v85: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:55.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:54 smithi154 ceph-mon[22073]: pgmap v86: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:25:55.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:54 smithi139 ceph-mon[21834]: pgmap v86: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:25:55.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:54 smithi135 ceph-mon[18264]: pgmap v86: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:25:55.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:25:55.858 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:25:55.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.973+0000 7f4d8bdb2640 1 -- 172.21.15.135:0/2407586591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d84107270 msgr2=0x7f4d8410ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:55.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.973+0000 7f4d8bdb2640 1 --2- 172.21.15.135:0/2407586591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d84107270 0x7f4d8410ee40 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c009900 tx=0x7f4d7c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:25:55.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.973+0000 7f4d8bdb2640 1 -- 172.21.15.135:0/2407586591 shutdown_connections 2024-04-20T12:25:55.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.973+0000 7f4d8bdb2640 1 --2- 172.21.15.135:0/2407586591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d84107270 0x7f4d8410ee40 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.973+0000 7f4d8bdb2640 1 --2- 172.21.15.135:0/2407586591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d84102b50 0x7f4d84106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.987 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.973+0000 7f4d8bdb2640 1 --2- 172.21.15.135:0/2407586591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d841021a0 0x7f4d84102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.973+0000 7f4d8bdb2640 1 -- 172.21.15.135:0/2407586591 >> 172.21.15.135:0/2407586591 conn(0x7f4d840fd9a0 msgr2=0x7f4d840ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:55.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.973+0000 7f4d8bdb2640 1 -- 172.21.15.135:0/2407586591 shutdown_connections 2024-04-20T12:25:55.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.973+0000 7f4d8bdb2640 1 -- 172.21.15.135:0/2407586591 wait complete. 2024-04-20T12:25:55.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.973+0000 7f4d8bdb2640 1 Processor -- start 2024-04-20T12:25:55.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.973+0000 7f4d8bdb2640 1 -- start start 2024-04-20T12:25:55.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.973+0000 7f4d8bdb2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d841021a0 0x7f4d8419e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:55.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.973+0000 7f4d8bdb2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d84107270 0x7f4d8419e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:55.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8bdb2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d84198610 0x7f4d84198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:55.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8bdb2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4d84112310 con 0x7f4d84107270 2024-04-20T12:25:55.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8bdb2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4d84112190 con 0x7f4d841021a0 2024-04-20T12:25:55.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8bdb2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d84112490 con 0x7f4d84198610 2024-04-20T12:25:55.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8934d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d84107270 0x7f4d8419e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:55.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8934d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d84107270 0x7f4d8419e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43662/0 (socket says 172.21.15.135:43662) 2024-04-20T12:25:55.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8934d640 1 -- 172.21.15.135:0/3255068599 learned_addr learned my addr 172.21.15.135:0/3255068599 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:55.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d89b4e640 1 --2- 172.21.15.135:0/3255068599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d841021a0 0x7f4d8419e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:55.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8a34f640 1 --2- 172.21.15.135:0/3255068599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d84198610 0x7f4d84198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:55.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8934d640 1 -- 172.21.15.135:0/3255068599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d84198610 msgr2=0x7f4d84198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:55.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8934d640 1 --2- 172.21.15.135:0/3255068599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d84198610 0x7f4d84198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8934d640 1 -- 172.21.15.135:0/3255068599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d841021a0 msgr2=0x7f4d8419e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:55.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8934d640 1 --2- 172.21.15.135:0/3255068599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d841021a0 0x7f4d8419e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8934d640 1 -- 172.21.15.135:0/3255068599 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d84199130 con 0x7f4d84107270 2024-04-20T12:25:55.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8934d640 1 --2- 172.21.15.135:0/3255068599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d84107270 0x7f4d8419e9a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400d770 tx=0x7f4d7400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:55.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d7affd640 1 -- 172.21.15.135:0/3255068599 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d74017070 con 0x7f4d84107270 2024-04-20T12:25:55.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d7affd640 1 -- 172.21.15.135:0/3255068599 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d74009c30 con 0x7f4d84107270 2024-04-20T12:25:55.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8bdb2640 1 -- 172.21.15.135:0/3255068599 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d84199420 con 0x7f4d84107270 2024-04-20T12:25:55.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d7affd640 1 -- 172.21.15.135:0/3255068599 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400f620 con 0x7f4d84107270 2024-04-20T12:25:55.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.974+0000 7f4d8bdb2640 1 -- 172.21.15.135:0/3255068599 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d841a5670 con 0x7f4d84107270 2024-04-20T12:25:55.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.977+0000 7f4d7affd640 1 -- 172.21.15.135:0/3255068599 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f4d7401a070 con 0x7f4d84107270 2024-04-20T12:25:55.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.977+0000 7f4d8e9a6740 1 Processor -- start 2024-04-20T12:25:55.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8e9a6740 1 -- start start 2024-04-20T12:25:55.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8e9a6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e59d0 0x5566466e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:55.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8e9a6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466e62f0 0x5566466f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:55.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8e9a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466f3630 0x5566466f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:55.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8e9a6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55664664b1b0 con 0x5566466e59d0 2024-04-20T12:25:55.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8e9a6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5566465e8390 con 0x5566466e62f0 2024-04-20T12:25:55.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8e9a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556646647170 con 0x5566466f3630 2024-04-20T12:25:55.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d7affd640 1 --2- 172.21.15.135:0/3255068599 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4d700a3d20 0x7f4d700a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:55.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8a34f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e59d0 0x5566466e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:55.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8a34f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e59d0 0x5566466e5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43674/0 (socket says 172.21.15.135:43674) 2024-04-20T12:25:55.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8a34f640 1 -- 172.21.15.135:0/1986058311 learned_addr learned my addr 172.21.15.135:0/1986058311 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:55.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8a34f640 1 --2- 172.21.15.135:0/3255068599 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4d700a3d20 0x7f4d700a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:55.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8934d640 1 --2- 172.21.15.135:0/1986058311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466f3630 0x5566466f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:55.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d89b4e640 1 --2- 172.21.15.135:0/1986058311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466e62f0 0x5566466f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:55.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d7affd640 1 -- 172.21.15.135:0/3255068599 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f4d740d0670 con 0x7f4d84107270 2024-04-20T12:25:55.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8a34f640 1 -- 172.21.15.135:0/1986058311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466f3630 msgr2=0x5566466f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:55.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8a34f640 1 --2- 172.21.15.135:0/1986058311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466f3630 0x5566466f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8a34f640 1 -- 172.21.15.135:0/1986058311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466e62f0 msgr2=0x5566466f30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:55.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8a34f640 1 --2- 172.21.15.135:0/1986058311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466e62f0 0x5566466f30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d8a34f640 1 -- 172.21.15.135:0/1986058311 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566464277d0 con 0x5566466e59d0 2024-04-20T12:25:55.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.978+0000 7f4d89b4e640 1 --2- 172.21.15.135:0/1986058311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466e62f0 0x5566466f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:25:55.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.979+0000 7f4d8a34f640 1 --2- 172.21.15.135:0/1986058311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e59d0 0x5566466e5db0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0057c0 tx=0x7f4d7c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7f499ca976fe4b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:55.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.979+0000 7f4d8a34f640 1 --2- 172.21.15.135:0/3255068599 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4d700a3d20 0x7f4d700a61e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c036040 tx=0x7f4d7c03a000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:55.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.979+0000 7f4d6ffff640 1 -- 172.21.15.135:0/1986058311 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c02cab0 con 0x5566466e59d0 2024-04-20T12:25:55.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.979+0000 7f4d6ffff640 1 -- 172.21.15.135:0/1986058311 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d7c050070 con 0x5566466e59d0 2024-04-20T12:25:55.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.979+0000 7f4d6ffff640 1 -- 172.21.15.135:0/1986058311 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c02c2b0 con 0x5566466e59d0 2024-04-20T12:25:55.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.980+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/1986058311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e59d0 msgr2=0x5566466e5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:55.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.980+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/1986058311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e59d0 0x5566466e5db0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0057c0 tx=0x7f4d7c004040 comp rx=0 tx=0).stop 2024-04-20T12:25:55.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.980+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/1986058311 shutdown_connections 2024-04-20T12:25:55.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.980+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/1986058311 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466f3630 0x5566466f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.980+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/1986058311 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466e62f0 0x5566466f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.980+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/1986058311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e59d0 0x5566466e5db0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.980+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/1986058311 >> 172.21.15.135:0/1986058311 conn(0x5566466e0450 msgr2=0x5566466e0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:55.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.980+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/1986058311 shutdown_connections 2024-04-20T12:25:55.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.980+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/1986058311 wait complete. 2024-04-20T12:25:55.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.980+0000 7f4d8e9a6740 1 -- start start 2024-04-20T12:25:55.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.980+0000 7f4d8e9a6740 1 Processor -- start 2024-04-20T12:25:55.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8e9a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466e59d0 0x5566466f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:55.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8e9a6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e62f0 0x5566466f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:55.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8e9a6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466f3630 0x5566466f1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:55.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8e9a6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5566466f6410 con 0x5566466e62f0 2024-04-20T12:25:55.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8e9a6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5566466042f0 con 0x5566466f3630 2024-04-20T12:25:55.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8e9a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5566466f6590 con 0x5566466e59d0 2024-04-20T12:25:55.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8e9a6740 10 client.0 _ll_register_callbacks cb 0x5566465ce4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:55.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8934d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e62f0 0x5566466f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:55.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8934d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e62f0 0x5566466f0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43690/0 (socket says 172.21.15.135:43690) 2024-04-20T12:25:55.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8934d640 1 -- 172.21.15.135:0/865014990 learned_addr learned my addr 172.21.15.135:0/865014990 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:55.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8a34f640 1 --2- 172.21.15.135:0/865014990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466f3630 0x5566466f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:55.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8934d640 1 -- 172.21.15.135:0/865014990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466e59d0 msgr2=0x5566466f06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:55.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d89b4e640 1 --2- 172.21.15.135:0/865014990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466e59d0 0x5566466f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:55.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8934d640 1 --2- 172.21.15.135:0/865014990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466e59d0 0x5566466f06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8934d640 1 -- 172.21.15.135:0/865014990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466f3630 msgr2=0x5566466f1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:55.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8934d640 1 --2- 172.21.15.135:0/865014990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466f3630 0x5566466f1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8934d640 1 -- 172.21.15.135:0/865014990 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55664635d3f0 con 0x5566466e62f0 2024-04-20T12:25:55.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8934d640 1 --2- 172.21.15.135:0/865014990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e62f0 0x5566466f0c00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4d740cda40 tx=0x7f4d7400def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80990069f7726a72 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:55.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:55.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d6d7fa640 1 -- 172.21.15.135:0/865014990 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d74021040 con 0x5566466e62f0 2024-04-20T12:25:55.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d6d7fa640 1 -- 172.21.15.135:0/865014990 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f4d740cdc60 con 0x5566466e62f0 2024-04-20T12:25:55.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/865014990 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d7c050070 con 0x5566466e62f0 2024-04-20T12:25:55.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.981+0000 7f4d6d7fa640 1 -- 172.21.15.135:0/865014990 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4d740cde60 con 0x5566466e62f0 2024-04-20T12:25:55.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.982+0000 7f4d8e9a6740 10 client.16569 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:55.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.982+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/865014990 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55664631d0f0 con 0x5566466e62f0 2024-04-20T12:25:55.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.982+0000 7f4d6d7fa640 1 -- 172.21.15.135:0/865014990 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d7c050070 con 0x5566466e62f0 2024-04-20T12:25:55.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.982+0000 7f4d6d7fa640 1 -- 172.21.15.135:0/865014990 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f4d740d02d0 con 0x5566466e62f0 2024-04-20T12:25:55.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.982+0000 7f4d8e9a6740 10 client.16569 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:55.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.982+0000 7f4d8e9a6740 10 client.16569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:55.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.982+0000 7f4d8e9a6740 20 client.16569 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:55.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.982+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/865014990 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556646703aa0 0x556646705e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:55.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.982+0000 7f4d8e9a6740 4 client.16569 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:55.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.982+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/865014990 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556646658bd0 con 0x556646703aa0 2024-04-20T12:25:55.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.982+0000 7f4d89b4e640 1 --2- 172.21.15.135:0/865014990 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556646703aa0 0x556646705e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:55.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.983+0000 7f4d6d7fa640 10 client.16569 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:55.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.983+0000 7f4d89b4e640 1 --2- 172.21.15.135:0/865014990 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556646703aa0 0x556646705e90 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=792410cbf9070379 server_cookie=843976b4a05d00d9 in_seq=0 out_seq=0 2024-04-20T12:25:55.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.983+0000 7f4d6d7fa640 1 -- 172.21.15.135:0/865014990 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556646658bd0 con 0x556646703aa0 2024-04-20T12:25:55.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.983+0000 7f4d6d7fa640 10 client.16569 handle_command_reply: tid=0 2024-04-20T12:25:55.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.983+0000 7f4d8e9a6740 1 client.16569 shutdown 2024-04-20T12:25:55.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.984+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/865014990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e62f0 msgr2=0x5566466f0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:55.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.984+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/865014990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e62f0 0x5566466f0c00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4d740cda40 tx=0x7f4d7400def0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.984+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/865014990 shutdown_connections 2024-04-20T12:25:55.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.984+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/865014990 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556646703aa0 0x556646705e90 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.984+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/865014990 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466f3630 0x5566466f1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.984+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/865014990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e62f0 0x5566466f0c00 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.984+0000 7f4d6d7fa640 0 client.16569 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:55.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.984+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/865014990 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466e59d0 0x5566466f06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:55.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.984+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/865014990 >> 172.21.15.135:0/865014990 conn(0x5566466e0450 msgr2=0x5566466e21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:55.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.984+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/865014990 shutdown_connections 2024-04-20T12:25:55.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.984+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/865014990 wait complete. 2024-04-20T12:25:55.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:55.984+0000 7f4d8e9a6740 20 client.16569 trim_cache size 0 max 16384 2024-04-20T12:25:56.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8e9a6740 1 Processor -- start 2024-04-20T12:25:56.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8e9a6740 1 -- start start 2024-04-20T12:25:56.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8e9a6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466e59d0 0x5566466f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8e9a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466e62f0 0x5566466ff310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8e9a6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466f3630 0x55664670b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8e9a6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4d841ad230 con 0x5566466f3630 2024-04-20T12:25:56.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8e9a6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4d841aed70 con 0x5566466e59d0 2024-04-20T12:25:56.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8e9a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d841ad900 con 0x5566466e62f0 2024-04-20T12:25:56.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8a34f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466f3630 0x55664670b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8a34f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466f3630 0x55664670b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43698/0 (socket says 172.21.15.135:43698) 2024-04-20T12:25:56.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8a34f640 1 -- 172.21.15.135:0/3674930366 learned_addr learned my addr 172.21.15.135:0/3674930366 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8a34f640 1 -- 172.21.15.135:0/3674930366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466e62f0 msgr2=0x5566466ff310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8a34f640 1 --2- 172.21.15.135:0/3674930366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466e62f0 0x5566466ff310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d89b4e640 1 --2- 172.21.15.135:0/3674930366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466e59d0 0x5566466f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8a34f640 1 -- 172.21.15.135:0/3674930366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466e59d0 msgr2=0x5566466f2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8a34f640 1 --2- 172.21.15.135:0/3674930366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466e59d0 0x5566466f2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8a34f640 1 -- 172.21.15.135:0/3674930366 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566466eec70 con 0x5566466f3630 2024-04-20T12:25:56.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d8a34f640 1 --2- 172.21.15.135:0/3674930366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466f3630 0x55664670b760 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0098a0 tx=0x7f4d7c02bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cb613d958ef872 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d6f7fe640 1 -- 172.21.15.135:0/3674930366 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c05a070 con 0x5566466f3630 2024-04-20T12:25:56.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.002+0000 7f4d6f7fe640 1 -- 172.21.15.135:0/3674930366 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d7c050050 con 0x5566466f3630 2024-04-20T12:25:56.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.003+0000 7f4d6f7fe640 1 -- 172.21.15.135:0/3674930366 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c043780 con 0x5566466f3630 2024-04-20T12:25:56.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.003+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/3674930366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466f3630 msgr2=0x55664670b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.003+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/3674930366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466f3630 0x55664670b760 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0098a0 tx=0x7f4d7c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:25:56.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.003+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/3674930366 shutdown_connections 2024-04-20T12:25:56.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.003+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/3674930366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466f3630 0x55664670b760 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.003+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/3674930366 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466e62f0 0x5566466ff310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.003+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/3674930366 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466e59d0 0x5566466f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.003+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/3674930366 >> 172.21.15.135:0/3674930366 conn(0x5566466e0450 msgr2=0x5566466df630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.003+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/3674930366 shutdown_connections 2024-04-20T12:25:56.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.003+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/3674930366 wait complete. 2024-04-20T12:25:56.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.003+0000 7f4d8e9a6740 1 -- start start 2024-04-20T12:25:56.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d8e9a6740 1 Processor -- start 2024-04-20T12:25:56.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d8e9a6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e59d0 0x5566466fb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d8e9a6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466e62f0 0x5566466fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d8e9a6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466f3630 0x5566466f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d8e9a6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4d841ae6a0 con 0x5566466e59d0 2024-04-20T12:25:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d8e9a6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4d841adfd0 con 0x5566466f3630 2024-04-20T12:25:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d8e9a6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4d841ab200 con 0x5566466e62f0 2024-04-20T12:25:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d8e9a6740 10 client.0 _ll_register_callbacks cb 0x7f4d740985a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d89b4e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e59d0 0x5566466fb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d89b4e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e59d0 0x5566466fb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43710/0 (socket says 172.21.15.135:43710) 2024-04-20T12:25:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d89b4e640 1 -- 172.21.15.135:0/4113445488 learned_addr learned my addr 172.21.15.135:0/4113445488 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d89b4e640 1 -- 172.21.15.135:0/4113445488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466e62f0 msgr2=0x5566466fbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d8934d640 1 --2- 172.21.15.135:0/4113445488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466e62f0 0x5566466fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d89b4e640 1 --2- 172.21.15.135:0/4113445488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466e62f0 0x5566466fbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d89b4e640 1 -- 172.21.15.135:0/4113445488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466f3630 msgr2=0x5566466f9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d8a34f640 1 --2- 172.21.15.135:0/4113445488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466f3630 0x5566466f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d89b4e640 1 --2- 172.21.15.135:0/4113445488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466f3630 0x5566466f9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d89b4e640 1 -- 172.21.15.135:0/4113445488 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566466fa5b0 con 0x5566466e59d0 2024-04-20T12:25:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d8934d640 1 --2- 172.21.15.135:0/4113445488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466e62f0 0x5566466fbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d89b4e640 1 --2- 172.21.15.135:0/4113445488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e59d0 0x5566466fb810 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4d80000f80 tx=0x7f4d80003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2185a4da13fddab3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.004+0000 7f4d6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.005+0000 7f4d6d7fa640 1 -- 172.21.15.135:0/4113445488 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8001f070 con 0x5566466e59d0 2024-04-20T12:25:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.005+0000 7f4d6d7fa640 1 -- 172.21.15.135:0/4113445488 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f4d80013b90 con 0x5566466e59d0 2024-04-20T12:25:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.005+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/4113445488 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d7c050050 con 0x5566466e59d0 2024-04-20T12:25:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.005+0000 7f4d6d7fa640 1 -- 172.21.15.135:0/4113445488 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4d8002b050 con 0x5566466e59d0 2024-04-20T12:25:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.005+0000 7f4d8e9a6740 10 client.16575 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.005+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/4113445488 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55664676acf0 con 0x5566466e59d0 2024-04-20T12:25:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.005+0000 7f4d6d7fa640 1 -- 172.21.15.135:0/4113445488 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d7c050050 con 0x5566466e59d0 2024-04-20T12:25:56.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.005+0000 7f4d6d7fa640 1 -- 172.21.15.135:0/4113445488 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f4d8000f040 con 0x5566466e59d0 2024-04-20T12:25:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.005+0000 7f4d8e9a6740 10 client.16575 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.005+0000 7f4d8e9a6740 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.005+0000 7f4d8e9a6740 20 client.16575 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.005+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/4113445488 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55664676b3f0 0x55664676d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.005+0000 7f4d8e9a6740 4 client.16575 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:25:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.005+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/4113445488 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556646652a40 con 0x55664676b3f0 2024-04-20T12:25:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.005+0000 7f4d8934d640 1 --2- 172.21.15.135:0/4113445488 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55664676b3f0 0x55664676d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d6d7fa640 10 client.16575 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:56.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d8934d640 1 --2- 172.21.15.135:0/4113445488 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55664676b3f0 0x55664676d810 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3582937849360485 server_cookie=71ea17b4b7cdf4c4 in_seq=0 out_seq=0 2024-04-20T12:25:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d6d7fa640 1 -- 172.21.15.135:0/4113445488 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556646652a40 con 0x55664676b3f0 2024-04-20T12:25:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d6d7fa640 10 client.16575 handle_command_reply: tid=0 2024-04-20T12:25:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d8e9a6740 1 client.16575 shutdown 2024-04-20T12:25:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/4113445488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e59d0 msgr2=0x5566466fb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/4113445488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e59d0 0x5566466fb810 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4d80000f80 tx=0x7f4d80003d40 comp rx=0 tx=0).stop 2024-04-20T12:25:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/4113445488 shutdown_connections 2024-04-20T12:25:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/4113445488 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55664676b3f0 0x55664676d810 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/4113445488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566466f3630 0x5566466f9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/4113445488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566466e62f0 0x5566466fbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d8e9a6740 1 --2- 172.21.15.135:0/4113445488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566466e59d0 0x5566466fb810 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d6d7fa640 0 client.16575 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:56.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/4113445488 >> 172.21.15.135:0/4113445488 conn(0x5566466e0450 msgr2=0x5566466deda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/4113445488 shutdown_connections 2024-04-20T12:25:56.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d8e9a6740 1 -- 172.21.15.135:0/4113445488 wait complete. 2024-04-20T12:25:56.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.006+0000 7f4d8e9a6740 20 client.16575 trim_cache size 0 max 16384 2024-04-20T12:25:56.019 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:25:56.019 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:25:56.019 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:25:56.019 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:25:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.007+0000 7f4d8bdb2640 1 -- 172.21.15.135:0/3255068599 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4d700a3d20 msgr2=0x7f4d700a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.007+0000 7f4d8bdb2640 1 --2- 172.21.15.135:0/3255068599 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4d700a3d20 0x7f4d700a61e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c036040 tx=0x7f4d7c03a000 comp rx=0 tx=0).stop 2024-04-20T12:25:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.007+0000 7f4d8bdb2640 1 -- 172.21.15.135:0/3255068599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d84107270 msgr2=0x7f4d8419e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.007+0000 7f4d8bdb2640 1 --2- 172.21.15.135:0/3255068599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d84107270 0x7f4d8419e9a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400d770 tx=0x7f4d7400dc30 comp rx=0 tx=0).stop 2024-04-20T12:25:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.007+0000 7f4d8bdb2640 1 -- 172.21.15.135:0/3255068599 shutdown_connections 2024-04-20T12:25:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.007+0000 7f4d8bdb2640 1 --2- 172.21.15.135:0/3255068599 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4d700a3d20 0x7f4d700a61e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.007+0000 7f4d8bdb2640 1 --2- 172.21.15.135:0/3255068599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d84198610 0x7f4d84198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.007+0000 7f4d8bdb2640 1 --2- 172.21.15.135:0/3255068599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4d84107270 0x7f4d8419e9a0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.007+0000 7f4d8bdb2640 1 --2- 172.21.15.135:0/3255068599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4d841021a0 0x7f4d8419e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.021 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.007+0000 7f4d8bdb2640 1 -- 172.21.15.135:0/3255068599 >> 172.21.15.135:0/3255068599 conn(0x7f4d840fd9a0 msgr2=0x7f4d840ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.007+0000 7f4d8bdb2640 1 -- 172.21.15.135:0/3255068599 shutdown_connections 2024-04-20T12:25:56.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.007+0000 7f4d8bdb2640 1 -- 172.21.15.135:0/3255068599 wait complete. 2024-04-20T12:25:56.022 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:25:56.022 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:25:56.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.121+0000 7fe1e4d85640 1 -- 172.21.15.135:0/1016926493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e0106170 msgr2=0x7fe1e010dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.121+0000 7fe1e4d85640 1 --2- 172.21.15.135:0/1016926493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e0106170 0x7fe1e010dd40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009900 tx=0x7fe1d002bc30 comp rx=0 tx=0).stop 2024-04-20T12:25:56.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.121+0000 7fe1e4d85640 1 -- 172.21.15.135:0/1016926493 shutdown_connections 2024-04-20T12:25:56.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.121+0000 7fe1e4d85640 1 --2- 172.21.15.135:0/1016926493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e0106170 0x7fe1e010dd40 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.121+0000 7fe1e4d85640 1 --2- 172.21.15.135:0/1016926493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1e0101a50 0x7fe1e0105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.121+0000 7fe1e4d85640 1 --2- 172.21.15.135:0/1016926493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1e01010a0 0x7fe1e0101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.121+0000 7fe1e4d85640 1 -- 172.21.15.135:0/1016926493 >> 172.21.15.135:0/1016926493 conn(0x7fe1e00771e0 msgr2=0x7fe1e00775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.121+0000 7fe1e4d85640 1 -- 172.21.15.135:0/1016926493 shutdown_connections 2024-04-20T12:25:56.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.121+0000 7fe1e4d85640 1 -- 172.21.15.135:0/1016926493 wait complete. 2024-04-20T12:25:56.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.122+0000 7fe1e4d85640 1 Processor -- start 2024-04-20T12:25:56.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.122+0000 7fe1e4d85640 1 -- start start 2024-04-20T12:25:56.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.122+0000 7fe1e4d85640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e01010a0 0x7fe1e01995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.122+0000 7fe1e4d85640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1e0106170 0x7fe1e0199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.122+0000 7fe1e4d85640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1e019a080 0x7fe1e01a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.122+0000 7fe1e4d85640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0111210 con 0x7fe1e01010a0 2024-04-20T12:25:56.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.122+0000 7fe1e4d85640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0111090 con 0x7fe1e0106170 2024-04-20T12:25:56.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.122+0000 7fe1e4d85640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e0111390 con 0x7fe1e019a080 2024-04-20T12:25:56.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.122+0000 7fe1de59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e01010a0 0x7fe1e01995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.122+0000 7fe1de59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e01010a0 0x7fe1e01995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43720/0 (socket says 172.21.15.135:43720) 2024-04-20T12:25:56.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.122+0000 7fe1de59c640 1 -- 172.21.15.135:0/3465831583 learned_addr learned my addr 172.21.15.135:0/3465831583 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.123+0000 7fe1ded9d640 1 --2- 172.21.15.135:0/3465831583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1e019a080 0x7fe1e01a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.123+0000 7fe1ddd9b640 1 --2- 172.21.15.135:0/3465831583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1e0106170 0x7fe1e0199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.123+0000 7fe1de59c640 1 -- 172.21.15.135:0/3465831583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1e019a080 msgr2=0x7fe1e01a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.123+0000 7fe1de59c640 1 --2- 172.21.15.135:0/3465831583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1e019a080 0x7fe1e01a4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.123+0000 7fe1de59c640 1 -- 172.21.15.135:0/3465831583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1e0106170 msgr2=0x7fe1e0199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.123+0000 7fe1de59c640 1 --2- 172.21.15.135:0/3465831583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1e0106170 0x7fe1e0199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.123+0000 7fe1de59c640 1 -- 172.21.15.135:0/3465831583 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e01a4e00 con 0x7fe1e01010a0 2024-04-20T12:25:56.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.123+0000 7fe1de59c640 1 --2- 172.21.15.135:0/3465831583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e01010a0 0x7fe1e01995b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800cce0 tx=0x7fe1d800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.123+0000 7fe1cf7fe640 1 -- 172.21.15.135:0/3465831583 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8004b20 con 0x7fe1e01010a0 2024-04-20T12:25:56.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.123+0000 7fe1e4d85640 1 -- 172.21.15.135:0/3465831583 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e01a50f0 con 0x7fe1e01010a0 2024-04-20T12:25:56.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.123+0000 7fe1cf7fe640 1 -- 172.21.15.135:0/3465831583 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe1d8004cc0 con 0x7fe1e01010a0 2024-04-20T12:25:56.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.123+0000 7fe1cf7fe640 1 -- 172.21.15.135:0/3465831583 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800f7d0 con 0x7fe1e01010a0 2024-04-20T12:25:56.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.123+0000 7fe1e4d85640 1 -- 172.21.15.135:0/3465831583 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e01a5690 con 0x7fe1e01010a0 2024-04-20T12:25:56.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.124+0000 7fe1e4d85640 1 -- 172.21.15.135:0/3465831583 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e0102570 con 0x7fe1e01010a0 2024-04-20T12:25:56.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.125+0000 7fe1cf7fe640 1 -- 172.21.15.135:0/3465831583 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fe1d800f970 con 0x7fe1e01010a0 2024-04-20T12:25:56.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.126+0000 7fe1cf7fe640 1 --2- 172.21.15.135:0/3465831583 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe1c80a3d20 0x7fe1c80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.126+0000 7fe1ddd9b640 1 --2- 172.21.15.135:0/3465831583 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe1c80a3d20 0x7fe1c80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.126+0000 7fe1cf7fe640 1 -- 172.21.15.135:0/3465831583 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe1d80d0c60 con 0x7fe1e01010a0 2024-04-20T12:25:56.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.126+0000 7fe1ddd9b640 1 --2- 172.21.15.135:0/3465831583 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe1c80a3d20 0x7fe1c80a61e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe1e006b110 tx=0x7fe1d400c4a0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.130+0000 7fe1cf7fe640 1 -- 172.21.15.135:0/3465831583 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fe1d8014030 con 0x7fe1e01010a0 2024-04-20T12:25:56.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.347+0000 7fe1e4d85640 1 -- 172.21.15.135:0/3465831583 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1e0109400 con 0x7fe1e01010a0 2024-04-20T12:25:56.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.348+0000 7fe1cf7fe640 1 -- 172.21.15.135:0/3465831583 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7fe1d809cf80 con 0x7fe1e01010a0 2024-04-20T12:25:56.348 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:25:56.348 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:25:56.348 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:25:56.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.350+0000 7fe1e4d85640 1 -- 172.21.15.135:0/3465831583 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe1c80a3d20 msgr2=0x7fe1c80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.350+0000 7fe1e4d85640 1 --2- 172.21.15.135:0/3465831583 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe1c80a3d20 0x7fe1c80a61e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe1e006b110 tx=0x7fe1d400c4a0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.350+0000 7fe1e4d85640 1 -- 172.21.15.135:0/3465831583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e01010a0 msgr2=0x7fe1e01995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.350+0000 7fe1e4d85640 1 --2- 172.21.15.135:0/3465831583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e01010a0 0x7fe1e01995b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800cce0 tx=0x7fe1d800a620 comp rx=0 tx=0).stop 2024-04-20T12:25:56.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.350+0000 7fe1e4d85640 1 -- 172.21.15.135:0/3465831583 shutdown_connections 2024-04-20T12:25:56.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.350+0000 7fe1e4d85640 1 --2- 172.21.15.135:0/3465831583 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe1c80a3d20 0x7fe1c80a61e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.350+0000 7fe1e4d85640 1 --2- 172.21.15.135:0/3465831583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1e019a080 0x7fe1e01a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.350+0000 7fe1e4d85640 1 --2- 172.21.15.135:0/3465831583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe1e0106170 0x7fe1e0199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.350+0000 7fe1e4d85640 1 --2- 172.21.15.135:0/3465831583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe1e01010a0 0x7fe1e01995b0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.350+0000 7fe1e4d85640 1 -- 172.21.15.135:0/3465831583 >> 172.21.15.135:0/3465831583 conn(0x7fe1e00771e0 msgr2=0x7fe1e00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.350+0000 7fe1e4d85640 1 -- 172.21.15.135:0/3465831583 shutdown_connections 2024-04-20T12:25:56.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.350+0000 7fe1e4d85640 1 -- 172.21.15.135:0/3465831583 wait complete. 2024-04-20T12:25:56.362 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:25:56.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 -- 172.21.15.135:0/3338144283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa9c106160 msgr2=0x7faa9c10dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 --2- 172.21.15.135:0/3338144283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa9c106160 0x7faa9c10dd30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7faa94009ca0 tx=0x7faa9402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 -- 172.21.15.135:0/3338144283 shutdown_connections 2024-04-20T12:25:56.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 --2- 172.21.15.135:0/3338144283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa9c106160 0x7faa9c10dd30 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 --2- 172.21.15.135:0/3338144283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa9c101a40 0x7faa9c105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 --2- 172.21.15.135:0/3338144283 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa9c101090 0x7faa9c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 -- 172.21.15.135:0/3338144283 >> 172.21.15.135:0/3338144283 conn(0x7faa9c078010 msgr2=0x7faa9c078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 -- 172.21.15.135:0/3338144283 shutdown_connections 2024-04-20T12:25:56.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 -- 172.21.15.135:0/3338144283 wait complete. 2024-04-20T12:25:56.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 Processor -- start 2024-04-20T12:25:56.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 -- start start 2024-04-20T12:25:56.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa9c101090 0x7faa9c197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.465 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa9c106160 0x7faa9c197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa9c19bf40 0x7faa9c19c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c111220 con 0x7faa9c19bf40 2024-04-20T12:25:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c1110a0 con 0x7faa9c106160 2024-04-20T12:25:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.463+0000 7faaa31e6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c1113a0 con 0x7faa9c101090 2024-04-20T12:25:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faaa1783640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa9c19bf40 0x7faa9c19c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faaa1783640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa9c19bf40 0x7faa9c19c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43736/0 (socket says 172.21.15.135:43736) 2024-04-20T12:25:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faaa1783640 1 -- 172.21.15.135:0/430540246 learned_addr learned my addr 172.21.15.135:0/430540246 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faa9bfff640 1 --2- 172.21.15.135:0/430540246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa9c106160 0x7faa9c197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faaa0f82640 1 --2- 172.21.15.135:0/430540246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa9c101090 0x7faa9c197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faaa1783640 1 -- 172.21.15.135:0/430540246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa9c101090 msgr2=0x7faa9c197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faaa1783640 1 --2- 172.21.15.135:0/430540246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa9c101090 0x7faa9c197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faaa1783640 1 -- 172.21.15.135:0/430540246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa9c106160 msgr2=0x7faa9c197bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.466 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faaa1783640 1 --2- 172.21.15.135:0/430540246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa9c106160 0x7faa9c197bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faaa1783640 1 -- 172.21.15.135:0/430540246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9c19ca30 con 0x7faa9c19bf40 2024-04-20T12:25:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faaa1783640 1 --2- 172.21.15.135:0/430540246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa9c19bf40 0x7faa9c19c3f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7faa9402c700 tx=0x7faa94032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faa99ffb640 1 -- 172.21.15.135:0/430540246 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94041020 con 0x7faa9c19bf40 2024-04-20T12:25:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faaa31e6640 1 -- 172.21.15.135:0/430540246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9c19ccc0 con 0x7faa9c19bf40 2024-04-20T12:25:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faa99ffb640 1 -- 172.21.15.135:0/430540246 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa94034cd0 con 0x7faa9c19bf40 2024-04-20T12:25:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faa99ffb640 1 -- 172.21.15.135:0/430540246 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94039040 con 0x7faa9c19bf40 2024-04-20T12:25:56.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.464+0000 7faaa31e6640 1 -- 172.21.15.135:0/430540246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa9c1a44e0 con 0x7faa9c19bf40 2024-04-20T12:25:56.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faa99ffb640 1 -- 172.21.15.135:0/430540246 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7faa94044020 con 0x7faa9c19bf40 2024-04-20T12:25:56.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faaa5dd3740 1 Processor -- start 2024-04-20T12:25:56.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faaa5dd3740 1 -- start start 2024-04-20T12:25:56.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faa99ffb640 1 --2- 172.21.15.135:0/430540246 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7faa8c0a3d20 0x7faa8c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faaa5dd3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20069e10 0x563f2006a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faaa5dd3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f20072dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faaa5dd3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20073310 0x563f20075700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faaa5dd3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563f1ffcf110 con 0x563f20073310 2024-04-20T12:25:56.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faaa5dd3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563f1ff6c550 con 0x563f2006a730 2024-04-20T12:25:56.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faaa5dd3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563f1ffcb0d0 con 0x563f20069e10 2024-04-20T12:25:56.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faa9bfff640 1 --2- 172.21.15.135:0/430540246 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7faa8c0a3d20 0x7faa8c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faa99ffb640 1 -- 172.21.15.135:0/430540246 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7faa940f2890 con 0x7faa9c19bf40 2024-04-20T12:25:56.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faaa1783640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20073310 0x563f20075700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faaa0f82640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20069e10 0x563f2006a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faaa1783640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20073310 0x563f20075700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43744/0 (socket says 172.21.15.135:43744) 2024-04-20T12:25:56.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.467+0000 7faaa1783640 1 -- 172.21.15.135:0/1641532355 learned_addr learned my addr 172.21.15.135:0/1641532355 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.468+0000 7faa9bfff640 1 --2- 172.21.15.135:0/1641532355 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f20072dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.468+0000 7faaa1783640 1 -- 172.21.15.135:0/1641532355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20069e10 msgr2=0x563f2006a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.468+0000 7faaa1783640 1 --2- 172.21.15.135:0/1641532355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20069e10 0x563f2006a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.468+0000 7faaa1783640 1 -- 172.21.15.135:0/1641532355 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 msgr2=0x563f20072dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.468+0000 7faaa1783640 1 --2- 172.21.15.135:0/1641532355 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f20072dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.468+0000 7faaa1783640 1 -- 172.21.15.135:0/1641532355 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f1ff94900 con 0x563f20073310 2024-04-20T12:25:56.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.468+0000 7faaa0f82640 1 --2- 172.21.15.135:0/1641532355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20069e10 0x563f2006a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:25:56.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.468+0000 7faa9bfff640 1 --2- 172.21.15.135:0/430540246 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7faa8c0a3d20 0x7faa8c0a61e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0fe540 tx=0x7faa8800bdf0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.468+0000 7faaa1783640 1 --2- 172.21.15.135:0/1641532355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20073310 0x563f20075700 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7faa940baf90 tx=0x7faa940ba860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964ff0ce5b57aceb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.468+0000 7faa86ffd640 1 -- 172.21.15.135:0/1641532355 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa940bdf20 con 0x563f20073310 2024-04-20T12:25:56.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.468+0000 7faa86ffd640 1 -- 172.21.15.135:0/1641532355 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa94044310 con 0x563f20073310 2024-04-20T12:25:56.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.468+0000 7faa86ffd640 1 -- 172.21.15.135:0/1641532355 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa940f0030 con 0x563f20073310 2024-04-20T12:25:56.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.469+0000 7faaa5dd3740 1 -- 172.21.15.135:0/1641532355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20073310 msgr2=0x563f20075700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.469+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/1641532355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20073310 0x563f20075700 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7faa940baf90 tx=0x7faa940ba860 comp rx=0 tx=0).stop 2024-04-20T12:25:56.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.469+0000 7faaa5dd3740 1 -- 172.21.15.135:0/1641532355 shutdown_connections 2024-04-20T12:25:56.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.469+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/1641532355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20073310 0x563f20075700 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.469+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/1641532355 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f20072dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.469+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/1641532355 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20069e10 0x563f2006a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.469+0000 7faaa5dd3740 1 -- 172.21.15.135:0/1641532355 >> 172.21.15.135:0/1641532355 conn(0x563f20064540 msgr2=0x563f20064920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.469+0000 7faaa5dd3740 1 -- 172.21.15.135:0/1641532355 shutdown_connections 2024-04-20T12:25:56.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.469+0000 7faaa5dd3740 1 -- 172.21.15.135:0/1641532355 wait complete. 2024-04-20T12:25:56.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.469+0000 7faaa5dd3740 1 -- start start 2024-04-20T12:25:56.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.469+0000 7faaa5dd3740 1 Processor -- start 2024-04-20T12:25:56.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.469+0000 7faaa5dd3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20069e10 0x563f200703d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.469+0000 7faaa5dd3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f20070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa5dd3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20073310 0x563f20070e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa5dd3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563f20075ec0 con 0x563f20073310 2024-04-20T12:25:56.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa5dd3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563f1ff88500 con 0x563f2006a730 2024-04-20T12:25:56.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa5dd3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563f20076040 con 0x563f20069e10 2024-04-20T12:25:56.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa5dd3740 10 client.0 _ll_register_callbacks cb 0x563f1ff6d2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:56.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa1783640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20073310 0x563f20070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa1783640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20073310 0x563f20070e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43748/0 (socket says 172.21.15.135:43748) 2024-04-20T12:25:56.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa1783640 1 -- 172.21.15.135:0/3038414820 learned_addr learned my addr 172.21.15.135:0/3038414820 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faa9bfff640 1 --2- 172.21.15.135:0/3038414820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f20070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa0f82640 1 --2- 172.21.15.135:0/3038414820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20069e10 0x563f200703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa1783640 1 -- 172.21.15.135:0/3038414820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20069e10 msgr2=0x563f200703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa1783640 1 --2- 172.21.15.135:0/3038414820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20069e10 0x563f200703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa1783640 1 -- 172.21.15.135:0/3038414820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 msgr2=0x563f20070910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa1783640 1 --2- 172.21.15.135:0/3038414820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f20070910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa1783640 1 -- 172.21.15.135:0/3038414820 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f1fce13f0 con 0x563f20073310 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa0f82640 1 --2- 172.21.15.135:0/3038414820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20069e10 0x563f200703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa1783640 1 --2- 172.21.15.135:0/3038414820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20073310 0x563f20070e50 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7faa940be550 tx=0x7faa94003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5c8160a6f5e11d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faa7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faa7bfff640 1 -- 172.21.15.135:0/3038414820 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa940be5c0 con 0x563f20073310 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faa7bfff640 1 -- 172.21.15.135:0/3038414820 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7faa940c6fb0 con 0x563f20073310 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa5dd3740 1 -- 172.21.15.135:0/3038414820 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa94044310 con 0x563f20073310 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faa7bfff640 1 -- 172.21.15.135:0/3038414820 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faa940f0030 con 0x563f20073310 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa5dd3740 10 client.16593 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.470+0000 7faaa5dd3740 1 -- 172.21.15.135:0/3038414820 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563f1fdab7d0 con 0x563f20073310 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.471+0000 7faa7bfff640 1 -- 172.21.15.135:0/3038414820 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa94044310 con 0x563f20073310 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.471+0000 7faa7bfff640 1 -- 172.21.15.135:0/3038414820 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7faa9403c030 con 0x563f20073310 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.471+0000 7faaa5dd3740 10 client.16593 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:56.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.471+0000 7faaa5dd3740 10 client.16593 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:25:56.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.471+0000 7faaa5dd3740 20 client.16593 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:56.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.471+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/3038414820 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x563f20083250 0x563f20085660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.471+0000 7faaa5dd3740 4 client.16593 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:56.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.471+0000 7faaa5dd3740 1 -- 172.21.15.135:0/3038414820 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f1ffdcb30 con 0x563f20083250 2024-04-20T12:25:56.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.471+0000 7faaa0f82640 1 --2- 172.21.15.135:0/3038414820 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x563f20083250 0x563f20085660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.471+0000 7faa7bfff640 10 client.16593 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:25:56.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.471+0000 7faaa0f82640 1 --2- 172.21.15.135:0/3038414820 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x563f20083250 0x563f20085660 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c4c8d0e0a4f29cbc server_cookie=a0797de60e8dc848 in_seq=0 out_seq=0 2024-04-20T12:25:56.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.472+0000 7faa7bfff640 1 -- 172.21.15.135:0/3038414820 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563f1ffdcb30 con 0x563f20083250 2024-04-20T12:25:56.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.472+0000 7faa7bfff640 10 client.16593 handle_command_reply: tid=0 2024-04-20T12:25:56.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.472+0000 7faaa5dd3740 1 client.16593 shutdown 2024-04-20T12:25:56.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.472+0000 7faaa5dd3740 1 -- 172.21.15.135:0/3038414820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20073310 msgr2=0x563f20070e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.472+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/3038414820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20073310 0x563f20070e50 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7faa940be550 tx=0x7faa94003ba0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.472+0000 7faaa5dd3740 1 -- 172.21.15.135:0/3038414820 shutdown_connections 2024-04-20T12:25:56.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.472+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/3038414820 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x563f20083250 0x563f20085660 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.472+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/3038414820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20073310 0x563f20070e50 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.472+0000 7faa7bfff640 0 client.16593 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:25:56.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.472+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/3038414820 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f20070910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.472+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/3038414820 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20069e10 0x563f200703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.472+0000 7faaa5dd3740 1 -- 172.21.15.135:0/3038414820 >> 172.21.15.135:0/3038414820 conn(0x563f20064540 msgr2=0x563f20066290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.472+0000 7faaa5dd3740 1 -- 172.21.15.135:0/3038414820 shutdown_connections 2024-04-20T12:25:56.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.472+0000 7faaa5dd3740 1 -- 172.21.15.135:0/3038414820 wait complete. 2024-04-20T12:25:56.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.472+0000 7faaa5dd3740 20 client.16593 trim_cache size 0 max 16384 2024-04-20T12:25:56.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.485+0000 7faaa5dd3740 1 Processor -- start 2024-04-20T12:25:56.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.485+0000 7faaa5dd3740 1 -- start start 2024-04-20T12:25:56.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.485+0000 7faaa5dd3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20069e10 0x563f2006fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.485+0000 7faaa5dd3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f2007b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faaa5dd3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20073310 0x563f20070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faaa5dd3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c1ae1d0 con 0x563f20069e10 2024-04-20T12:25:56.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faaa5dd3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c1afd10 con 0x563f2006a730 2024-04-20T12:25:56.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faaa5dd3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c1ae8a0 con 0x563f20073310 2024-04-20T12:25:56.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faaa0f82640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20069e10 0x563f2006fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faaa0f82640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20069e10 0x563f2006fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43752/0 (socket says 172.21.15.135:43752) 2024-04-20T12:25:56.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faaa0f82640 1 -- 172.21.15.135:0/3686381918 learned_addr learned my addr 172.21.15.135:0/3686381918 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faa9bfff640 1 --2- 172.21.15.135:0/3686381918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f2007b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faaa0f82640 1 -- 172.21.15.135:0/3686381918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20073310 msgr2=0x563f20070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faaa0f82640 1 --2- 172.21.15.135:0/3686381918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20073310 0x563f20070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faaa0f82640 1 -- 172.21.15.135:0/3686381918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 msgr2=0x563f2007b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faaa0f82640 1 --2- 172.21.15.135:0/3686381918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f2007b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faaa0f82640 1 -- 172.21.15.135:0/3686381918 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f20069190 con 0x563f20069e10 2024-04-20T12:25:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faaa0f82640 1 --2- 172.21.15.135:0/3686381918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20069e10 0x563f2006fb80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x563f20085ea0 tx=0x7faa90014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693e19beb321a0c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faa867fc640 1 -- 172.21.15.135:0/3686381918 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa900142d0 con 0x563f20069e10 2024-04-20T12:25:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faa867fc640 1 -- 172.21.15.135:0/3686381918 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa9001e430 con 0x563f20069e10 2024-04-20T12:25:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.486+0000 7faa867fc640 1 -- 172.21.15.135:0/3686381918 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90003c50 con 0x563f20069e10 2024-04-20T12:25:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 -- 172.21.15.135:0/3686381918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20069e10 msgr2=0x563f2006fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/3686381918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20069e10 0x563f2006fb80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x563f20085ea0 tx=0x7faa90014840 comp rx=0 tx=0).stop 2024-04-20T12:25:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 -- 172.21.15.135:0/3686381918 shutdown_connections 2024-04-20T12:25:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/3686381918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20073310 0x563f20070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/3686381918 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f2007b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/3686381918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20069e10 0x563f2006fb80 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 -- 172.21.15.135:0/3686381918 >> 172.21.15.135:0/3686381918 conn(0x563f20064540 msgr2=0x563f20072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 -- 172.21.15.135:0/3686381918 shutdown_connections 2024-04-20T12:25:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 -- 172.21.15.135:0/3686381918 wait complete. 2024-04-20T12:25:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 -- start start 2024-04-20T12:25:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 Processor -- start 2024-04-20T12:25:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20069e10 0x563f2006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f2006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20073310 0x563f2006f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c1af640 con 0x563f20069e10 2024-04-20T12:25:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c1aef70 con 0x563f2006a730 2024-04-20T12:25:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.487+0000 7faaa5dd3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7faa9c1ac1a0 con 0x563f20073310 2024-04-20T12:25:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faaa5dd3740 10 client.0 _ll_register_callbacks cb 0x7faa90009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faaa0f82640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20069e10 0x563f2006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faaa0f82640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20069e10 0x563f2006eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43766/0 (socket says 172.21.15.135:43766) 2024-04-20T12:25:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faaa0f82640 1 -- 172.21.15.135:0/656829460 learned_addr learned my addr 172.21.15.135:0/656829460 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faa9bfff640 1 --2- 172.21.15.135:0/656829460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f2006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faaa1783640 1 --2- 172.21.15.135:0/656829460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20073310 0x563f2006f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faaa0f82640 1 -- 172.21.15.135:0/656829460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20073310 msgr2=0x563f2006f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faaa0f82640 1 --2- 172.21.15.135:0/656829460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20073310 0x563f2006f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faaa0f82640 1 -- 172.21.15.135:0/656829460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 msgr2=0x563f2006f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faaa0f82640 1 --2- 172.21.15.135:0/656829460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f2006f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faaa0f82640 1 -- 172.21.15.135:0/656829460 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f200ea7c0 con 0x563f20069e10 2024-04-20T12:25:56.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faaa0f82640 1 --2- 172.21.15.135:0/656829460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20069e10 0x563f2006eb70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7faa90000c00 tx=0x7faa900142c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c611cfce62cb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faa7bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:56.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faa7bfff640 1 -- 172.21.15.135:0/656829460 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa90004250 con 0x563f20069e10 2024-04-20T12:25:56.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faa7bfff640 1 -- 172.21.15.135:0/656829460 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7faa900043f0 con 0x563f20069e10 2024-04-20T12:25:56.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faaa5dd3740 1 -- 172.21.15.135:0/656829460 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa9001e430 con 0x563f20069e10 2024-04-20T12:25:56.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faa7bfff640 1 -- 172.21.15.135:0/656829460 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7faa90037050 con 0x563f20069e10 2024-04-20T12:25:56.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faaa5dd3740 10 client.16599 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:56.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faaa5dd3740 1 -- 172.21.15.135:0/656829460 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563f200eba20 con 0x563f20069e10 2024-04-20T12:25:56.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.488+0000 7faa7bfff640 1 -- 172.21.15.135:0/656829460 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa9001e430 con 0x563f20069e10 2024-04-20T12:25:56.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.489+0000 7faa7bfff640 1 -- 172.21.15.135:0/656829460 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7faa90004700 con 0x563f20069e10 2024-04-20T12:25:56.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.489+0000 7faaa5dd3740 10 client.16599 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:56.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.489+0000 7faaa5dd3740 10 client.16599 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.489+0000 7faaa5dd3740 20 client.16599 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.489+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/656829460 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x563f200ec100 0x563f200ee520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.489+0000 7faaa5dd3740 4 client.16599 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.489+0000 7faaa5dd3740 1 -- 172.21.15.135:0/656829460 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563f1ffd69a0 con 0x563f200ec100 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.489+0000 7faa9bfff640 1 --2- 172.21.15.135:0/656829460 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x563f200ec100 0x563f200ee520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.489+0000 7faa7bfff640 10 client.16599 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.489+0000 7faa9bfff640 1 --2- 172.21.15.135:0/656829460 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x563f200ec100 0x563f200ee520 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9e27297a418e1aae server_cookie=631c582ca751f045 in_seq=0 out_seq=0 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.489+0000 7faa7bfff640 1 -- 172.21.15.135:0/656829460 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563f1ffd69a0 con 0x563f200ec100 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.489+0000 7faa7bfff640 10 client.16599 handle_command_reply: tid=0 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.489+0000 7faaa5dd3740 1 client.16599 shutdown 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.489+0000 7faaa5dd3740 1 -- 172.21.15.135:0/656829460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20069e10 msgr2=0x563f2006eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.489+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/656829460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20069e10 0x563f2006eb70 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7faa90000c00 tx=0x7faa900142c0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa5dd3740 1 -- 172.21.15.135:0/656829460 shutdown_connections 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/656829460 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x563f200ec100 0x563f200ee520 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/656829460 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563f20073310 0x563f2006f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/656829460 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563f2006a730 0x563f2006f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faa7bfff640 0 client.16599 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:25:56.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa5dd3740 1 --2- 172.21.15.135:0/656829460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f20069e10 0x563f2006eb70 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa5dd3740 1 -- 172.21.15.135:0/656829460 >> 172.21.15.135:0/656829460 conn(0x563f20064540 msgr2=0x563f20071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa5dd3740 1 -- 172.21.15.135:0/656829460 shutdown_connections 2024-04-20T12:25:56.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa5dd3740 1 -- 172.21.15.135:0/656829460 wait complete. 2024-04-20T12:25:56.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa5dd3740 20 client.16599 trim_cache size 0 max 16384 2024-04-20T12:25:56.496 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:25:56.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa31e6640 1 -- 172.21.15.135:0/430540246 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7faa8c0a3d20 msgr2=0x7faa8c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa31e6640 1 --2- 172.21.15.135:0/430540246 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7faa8c0a3d20 0x7faa8c0a61e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0fe540 tx=0x7faa8800bdf0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa31e6640 1 -- 172.21.15.135:0/430540246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa9c19bf40 msgr2=0x7faa9c19c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa31e6640 1 --2- 172.21.15.135:0/430540246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa9c19bf40 0x7faa9c19c3f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7faa9402c700 tx=0x7faa94032f20 comp rx=0 tx=0).stop 2024-04-20T12:25:56.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa31e6640 1 -- 172.21.15.135:0/430540246 shutdown_connections 2024-04-20T12:25:56.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa31e6640 1 --2- 172.21.15.135:0/430540246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa9c19bf40 0x7faa9c19c3f0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa31e6640 1 --2- 172.21.15.135:0/430540246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7faa9c106160 0x7faa9c197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa31e6640 1 --2- 172.21.15.135:0/430540246 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7faa8c0a3d20 0x7faa8c0a61e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa31e6640 1 --2- 172.21.15.135:0/430540246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faa9c101090 0x7faa9c197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa31e6640 1 -- 172.21.15.135:0/430540246 >> 172.21.15.135:0/430540246 conn(0x7faa9c078010 msgr2=0x7faa9c0fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa31e6640 1 -- 172.21.15.135:0/430540246 shutdown_connections 2024-04-20T12:25:56.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.490+0000 7faaa31e6640 1 -- 172.21.15.135:0/430540246 wait complete. 2024-04-20T12:25:56.501 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:25:56.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.601+0000 7fbe7fc93640 1 -- 172.21.15.135:0/806175439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7810ec60 msgr2=0x7fbe78111050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.601+0000 7fbe7fc93640 1 --2- 172.21.15.135:0/806175439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7810ec60 0x7fbe78111050 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009ca0 tx=0x7fbe7002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.601+0000 7fbe7fc93640 1 -- 172.21.15.135:0/806175439 shutdown_connections 2024-04-20T12:25:56.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.601+0000 7fbe7fc93640 1 --2- 172.21.15.135:0/806175439 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7810ec60 0x7fbe78111050 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.601+0000 7fbe7fc93640 1 --2- 172.21.15.135:0/806175439 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe7806af00 0x7fbe7810e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.601+0000 7fbe7fc93640 1 --2- 172.21.15.135:0/806175439 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe7806a5e0 0x7fbe7806a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.601+0000 7fbe7fc93640 1 -- 172.21.15.135:0/806175439 >> 172.21.15.135:0/806175439 conn(0x7fbe78077c50 msgr2=0x7fbe78078060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.601+0000 7fbe7fc93640 1 -- 172.21.15.135:0/806175439 shutdown_connections 2024-04-20T12:25:56.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.601+0000 7fbe7fc93640 1 -- 172.21.15.135:0/806175439 wait complete. 2024-04-20T12:25:56.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7fc93640 1 Processor -- start 2024-04-20T12:25:56.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7fc93640 1 -- start start 2024-04-20T12:25:56.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7fc93640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe7806a5e0 0x7fbe781a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7fc93640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7806af00 0x7fbe781a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7fc93640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe7810ec60 0x7fbe7819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7fc93640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbe78114590 con 0x7fbe7806af00 2024-04-20T12:25:56.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7fc93640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbe78114410 con 0x7fbe7810ec60 2024-04-20T12:25:56.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7fc93640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbe78114710 con 0x7fbe7806a5e0 2024-04-20T12:25:56.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7d22e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7806af00 0x7fbe781a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7d22e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7806af00 0x7fbe781a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43776/0 (socket says 172.21.15.135:43776) 2024-04-20T12:25:56.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7d22e640 1 -- 172.21.15.135:0/2189700634 learned_addr learned my addr 172.21.15.135:0/2189700634 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7e230640 1 --2- 172.21.15.135:0/2189700634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe7810ec60 0x7fbe7819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7da2f640 1 --2- 172.21.15.135:0/2189700634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe7806a5e0 0x7fbe781a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7d22e640 1 -- 172.21.15.135:0/2189700634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe7806a5e0 msgr2=0x7fbe781a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7d22e640 1 --2- 172.21.15.135:0/2189700634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe7806a5e0 0x7fbe781a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7d22e640 1 -- 172.21.15.135:0/2189700634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe7810ec60 msgr2=0x7fbe7819a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7d22e640 1 --2- 172.21.15.135:0/2189700634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe7810ec60 0x7fbe7819a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.602+0000 7fbe7d22e640 1 -- 172.21.15.135:0/2189700634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe7819af60 con 0x7fbe7806af00 2024-04-20T12:25:56.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.603+0000 7fbe7d22e640 1 --2- 172.21.15.135:0/2189700634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7806af00 0x7fbe781a0b60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800e9f0 tx=0x7fbe6800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.603+0000 7fbe6effd640 1 -- 172.21.15.135:0/2189700634 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6800cd80 con 0x7fbe7806af00 2024-04-20T12:25:56.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.603+0000 7fbe6effd640 1 -- 172.21.15.135:0/2189700634 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe68010910 con 0x7fbe7806af00 2024-04-20T12:25:56.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.603+0000 7fbe7fc93640 1 -- 172.21.15.135:0/2189700634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe7819b250 con 0x7fbe7806af00 2024-04-20T12:25:56.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.603+0000 7fbe6effd640 1 -- 172.21.15.135:0/2189700634 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe68018990 con 0x7fbe7806af00 2024-04-20T12:25:56.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.603+0000 7fbe7fc93640 1 -- 172.21.15.135:0/2189700634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe781a7470 con 0x7fbe7806af00 2024-04-20T12:25:56.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.605+0000 7fbe6effd640 1 -- 172.21.15.135:0/2189700634 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fbe68010ac0 con 0x7fbe7806af00 2024-04-20T12:25:56.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.605+0000 7fbe82966740 1 Processor -- start 2024-04-20T12:25:56.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.605+0000 7fbe82966740 1 -- start start 2024-04-20T12:25:56.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe82966740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30ae10 0x55d07e30b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe82966740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30b730 0x55d07e313dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe82966740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e314310 0x55d07e316700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe82966740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d07e270110 con 0x55d07e30ae10 2024-04-20T12:25:56.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe82966740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d07e20d550 con 0x55d07e314310 2024-04-20T12:25:56.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe82966740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d07e26c0d0 con 0x55d07e30b730 2024-04-20T12:25:56.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe6effd640 1 --2- 172.21.15.135:0/2189700634 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbe640a3d20 0x7fbe640a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe7e230640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30ae10 0x55d07e30b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe7e230640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30ae10 0x55d07e30b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43784/0 (socket says 172.21.15.135:43784) 2024-04-20T12:25:56.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe7e230640 1 -- 172.21.15.135:0/54729887 learned_addr learned my addr 172.21.15.135:0/54729887 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe7d22e640 1 --2- 172.21.15.135:0/54729887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e314310 0x55d07e316700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe7da2f640 1 --2- 172.21.15.135:0/54729887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30b730 0x55d07e313dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe7e230640 1 --2- 172.21.15.135:0/2189700634 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbe640a3d20 0x7fbe640a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe6effd640 1 -- 172.21.15.135:0/2189700634 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fbe680d0f60 con 0x7fbe7806af00 2024-04-20T12:25:56.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe7da2f640 1 -- 172.21.15.135:0/54729887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e314310 msgr2=0x55d07e316700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe7da2f640 1 --2- 172.21.15.135:0/54729887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e314310 0x55d07e316700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe7da2f640 1 -- 172.21.15.135:0/54729887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30ae10 msgr2=0x55d07e30b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe7da2f640 1 --2- 172.21.15.135:0/54729887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30ae10 0x55d07e30b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe7da2f640 1 -- 172.21.15.135:0/54729887 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d07e235900 con 0x55d07e30b730 2024-04-20T12:25:56.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe7e230640 1 --2- 172.21.15.135:0/54729887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30ae10 0x55d07e30b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:25:56.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.606+0000 7fbe7da2f640 1 --2- 172.21.15.135:0/54729887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30b730 0x55d07e313dd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400bb90 tx=0x7fbe7400f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93a08a10d310fee3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.607+0000 7fbe7e230640 1 --2- 172.21.15.135:0/2189700634 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbe640a3d20 0x7fbe640a61e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009430 tx=0x7fbe7002c0f0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.607+0000 7fbe63fff640 1 -- 172.21.15.135:0/54729887 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74015070 con 0x55d07e30b730 2024-04-20T12:25:56.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.607+0000 7fbe63fff640 1 -- 172.21.15.135:0/54729887 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe74011920 con 0x55d07e30b730 2024-04-20T12:25:56.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.607+0000 7fbe63fff640 1 -- 172.21.15.135:0/54729887 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe740107f0 con 0x55d07e30b730 2024-04-20T12:25:56.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.607+0000 7fbe82966740 1 -- 172.21.15.135:0/54729887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30b730 msgr2=0x55d07e313dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.607+0000 7fbe82966740 1 --2- 172.21.15.135:0/54729887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30b730 0x55d07e313dd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400bb90 tx=0x7fbe7400f730 comp rx=0 tx=0).stop 2024-04-20T12:25:56.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.607+0000 7fbe82966740 1 -- 172.21.15.135:0/54729887 shutdown_connections 2024-04-20T12:25:56.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.607+0000 7fbe82966740 1 --2- 172.21.15.135:0/54729887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e314310 0x55d07e316700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.607+0000 7fbe82966740 1 --2- 172.21.15.135:0/54729887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30b730 0x55d07e313dd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.607+0000 7fbe82966740 1 --2- 172.21.15.135:0/54729887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30ae10 0x55d07e30b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.607+0000 7fbe82966740 1 -- 172.21.15.135:0/54729887 >> 172.21.15.135:0/54729887 conn(0x55d07e305540 msgr2=0x55d07e305920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.608+0000 7fbe82966740 1 -- 172.21.15.135:0/54729887 shutdown_connections 2024-04-20T12:25:56.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.608+0000 7fbe82966740 1 -- 172.21.15.135:0/54729887 wait complete. 2024-04-20T12:25:56.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.608+0000 7fbe82966740 1 -- start start 2024-04-20T12:25:56.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.608+0000 7fbe82966740 1 Processor -- start 2024-04-20T12:25:56.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.608+0000 7fbe82966740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30ae10 0x55d07e3112c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.608+0000 7fbe82966740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e30b730 0x55d07e311800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.608+0000 7fbe82966740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e314310 0x55d07e311d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.608+0000 7fbe82966740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d07e317100 con 0x55d07e30ae10 2024-04-20T12:25:56.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.608+0000 7fbe82966740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d07e229500 con 0x55d07e30b730 2024-04-20T12:25:56.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.608+0000 7fbe82966740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d07e317280 con 0x55d07e314310 2024-04-20T12:25:56.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.608+0000 7fbe82966740 10 client.0 _ll_register_callbacks cb 0x55d07e20e2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:56.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.608+0000 7fbe7da2f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30ae10 0x55d07e3112c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.608+0000 7fbe7da2f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30ae10 0x55d07e3112c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43788/0 (socket says 172.21.15.135:43788) 2024-04-20T12:25:56.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.608+0000 7fbe7da2f640 1 -- 172.21.15.135:0/739334682 learned_addr learned my addr 172.21.15.135:0/739334682 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe7d22e640 1 --2- 172.21.15.135:0/739334682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e30b730 0x55d07e311800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe7e230640 1 --2- 172.21.15.135:0/739334682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e314310 0x55d07e311d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe7da2f640 1 -- 172.21.15.135:0/739334682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e314310 msgr2=0x55d07e311d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe7da2f640 1 --2- 172.21.15.135:0/739334682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e314310 0x55d07e311d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe7da2f640 1 -- 172.21.15.135:0/739334682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e30b730 msgr2=0x55d07e311800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe7da2f640 1 --2- 172.21.15.135:0/739334682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e30b730 0x55d07e311800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe7da2f640 1 -- 172.21.15.135:0/739334682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d07df823f0 con 0x55d07e30ae10 2024-04-20T12:25:56.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe7e230640 1 --2- 172.21.15.135:0/739334682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e314310 0x55d07e311d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:56.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe7da2f640 1 --2- 172.21.15.135:0/739334682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30ae10 0x55d07e3112c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fbe74000c00 tx=0x7fbe7400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cf5b0c098b3355 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe617fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:56.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe617fa640 1 -- 172.21.15.135:0/739334682 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74015070 con 0x55d07e30ae10 2024-04-20T12:25:56.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe617fa640 1 -- 172.21.15.135:0/739334682 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fbe74011ad0 con 0x55d07e30ae10 2024-04-20T12:25:56.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe82966740 1 -- 172.21.15.135:0/739334682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe74011920 con 0x55d07e30ae10 2024-04-20T12:25:56.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe617fa640 1 -- 172.21.15.135:0/739334682 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbe74011cd0 con 0x55d07e30ae10 2024-04-20T12:25:56.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe82966740 10 client.16611 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:56.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe82966740 1 -- 172.21.15.135:0/739334682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d07e04c7d0 con 0x55d07e30ae10 2024-04-20T12:25:56.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.609+0000 7fbe617fa640 1 -- 172.21.15.135:0/739334682 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe74011920 con 0x55d07e30ae10 2024-04-20T12:25:56.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.610+0000 7fbe617fa640 1 -- 172.21.15.135:0/739334682 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fbe74004b60 con 0x55d07e30ae10 2024-04-20T12:25:56.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.610+0000 7fbe82966740 10 client.16611 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:56.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.610+0000 7fbe82966740 10 client.16611 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:25:56.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.610+0000 7fbe82966740 20 client.16611 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:56.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.610+0000 7fbe82966740 1 --2- 172.21.15.135:0/739334682 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d07e3245e0 0x55d07e3269d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.610+0000 7fbe82966740 4 client.16611 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:56.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.610+0000 7fbe82966740 1 -- 172.21.15.135:0/739334682 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d07e27db30 con 0x55d07e3245e0 2024-04-20T12:25:56.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.610+0000 7fbe7d22e640 1 --2- 172.21.15.135:0/739334682 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d07e3245e0 0x55d07e3269d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.610+0000 7fbe617fa640 10 client.16611 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:25:56.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.610+0000 7fbe7d22e640 1 --2- 172.21.15.135:0/739334682 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d07e3245e0 0x55d07e3269d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=960a8fe146b06122 server_cookie=c5bfa31eb9e11da5 in_seq=0 out_seq=0 2024-04-20T12:25:56.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.611+0000 7fbe617fa640 1 -- 172.21.15.135:0/739334682 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d07e27db30 con 0x55d07e3245e0 2024-04-20T12:25:56.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.611+0000 7fbe617fa640 10 client.16611 handle_command_reply: tid=0 2024-04-20T12:25:56.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.611+0000 7fbe82966740 1 client.16611 shutdown 2024-04-20T12:25:56.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.611+0000 7fbe82966740 1 -- 172.21.15.135:0/739334682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30ae10 msgr2=0x55d07e3112c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.611+0000 7fbe82966740 1 --2- 172.21.15.135:0/739334682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30ae10 0x55d07e3112c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fbe74000c00 tx=0x7fbe7400b900 comp rx=0 tx=0).stop 2024-04-20T12:25:56.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.611+0000 7fbe82966740 1 -- 172.21.15.135:0/739334682 shutdown_connections 2024-04-20T12:25:56.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.611+0000 7fbe82966740 1 --2- 172.21.15.135:0/739334682 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d07e3245e0 0x55d07e3269d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.611+0000 7fbe82966740 1 --2- 172.21.15.135:0/739334682 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e314310 0x55d07e311d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.611+0000 7fbe82966740 1 --2- 172.21.15.135:0/739334682 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e30b730 0x55d07e311800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.611+0000 7fbe82966740 1 --2- 172.21.15.135:0/739334682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30ae10 0x55d07e3112c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.611+0000 7fbe617fa640 0 client.16611 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:25:56.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.611+0000 7fbe82966740 1 -- 172.21.15.135:0/739334682 >> 172.21.15.135:0/739334682 conn(0x55d07e305540 msgr2=0x55d07e307290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.611+0000 7fbe82966740 1 -- 172.21.15.135:0/739334682 shutdown_connections 2024-04-20T12:25:56.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.611+0000 7fbe82966740 1 -- 172.21.15.135:0/739334682 wait complete. 2024-04-20T12:25:56.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.611+0000 7fbe82966740 20 client.16611 trim_cache size 0 max 16384 2024-04-20T12:25:56.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe82966740 1 Processor -- start 2024-04-20T12:25:56.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe82966740 1 -- start start 2024-04-20T12:25:56.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe82966740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30ae10 0x55d07e3139f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe82966740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30b730 0x55d07e31fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe82966740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e314310 0x55d07e310420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe82966740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781b15b0 con 0x55d07e30b730 2024-04-20T12:25:56.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe82966740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781b30f0 con 0x55d07e314310 2024-04-20T12:25:56.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe82966740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781b1c80 con 0x55d07e30ae10 2024-04-20T12:25:56.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe7d22e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30b730 0x55d07e31fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe7d22e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30b730 0x55d07e31fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43792/0 (socket says 172.21.15.135:43792) 2024-04-20T12:25:56.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe7d22e640 1 -- 172.21.15.135:0/2636283777 learned_addr learned my addr 172.21.15.135:0/2636283777 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe7da2f640 1 --2- 172.21.15.135:0/2636283777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30ae10 0x55d07e3139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe7d22e640 1 -- 172.21.15.135:0/2636283777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30ae10 msgr2=0x55d07e3139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe7d22e640 1 --2- 172.21.15.135:0/2636283777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30ae10 0x55d07e3139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe7d22e640 1 -- 172.21.15.135:0/2636283777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e314310 msgr2=0x55d07e310420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe7e230640 1 --2- 172.21.15.135:0/2636283777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e314310 0x55d07e310420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe7d22e640 1 --2- 172.21.15.135:0/2636283777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e314310 0x55d07e310420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.625+0000 7fbe7d22e640 1 -- 172.21.15.135:0/2636283777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d07e326f60 con 0x55d07e30b730 2024-04-20T12:25:56.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.626+0000 7fbe7d22e640 1 --2- 172.21.15.135:0/2636283777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30b730 0x55d07e31fff0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fbe680ce390 tx=0x7fbe680d3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c301c54f467dce5a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.626+0000 7fbe637fe640 1 -- 172.21.15.135:0/2636283777 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe680a57f0 con 0x55d07e30b730 2024-04-20T12:25:56.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.626+0000 7fbe637fe640 1 -- 172.21.15.135:0/2636283777 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe6809ae80 con 0x55d07e30b730 2024-04-20T12:25:56.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.626+0000 7fbe637fe640 1 -- 172.21.15.135:0/2636283777 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe68099380 con 0x55d07e30b730 2024-04-20T12:25:56.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.626+0000 7fbe82966740 1 -- 172.21.15.135:0/2636283777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30b730 msgr2=0x55d07e31fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.626+0000 7fbe82966740 1 --2- 172.21.15.135:0/2636283777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30b730 0x55d07e31fff0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fbe680ce390 tx=0x7fbe680d3040 comp rx=0 tx=0).stop 2024-04-20T12:25:56.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.626+0000 7fbe82966740 1 -- 172.21.15.135:0/2636283777 shutdown_connections 2024-04-20T12:25:56.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.626+0000 7fbe82966740 1 --2- 172.21.15.135:0/2636283777 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e314310 0x55d07e310420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.626+0000 7fbe82966740 1 --2- 172.21.15.135:0/2636283777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e30b730 0x55d07e31fff0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.626+0000 7fbe82966740 1 --2- 172.21.15.135:0/2636283777 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30ae10 0x55d07e3139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.626+0000 7fbe82966740 1 -- 172.21.15.135:0/2636283777 >> 172.21.15.135:0/2636283777 conn(0x55d07e305540 msgr2=0x55d07e300570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.626+0000 7fbe82966740 1 -- 172.21.15.135:0/2636283777 shutdown_connections 2024-04-20T12:25:56.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.626+0000 7fbe82966740 1 -- 172.21.15.135:0/2636283777 wait complete. 2024-04-20T12:25:56.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe82966740 1 -- start start 2024-04-20T12:25:56.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe82966740 1 Processor -- start 2024-04-20T12:25:56.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe82966740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e30ae10 0x55d07e31c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe82966740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30b730 0x55d07e31ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe82966740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e314310 0x55d07e30d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe82966740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781b2a20 con 0x55d07e314310 2024-04-20T12:25:56.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe82966740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781b2350 con 0x55d07e30ae10 2024-04-20T12:25:56.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe82966740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781af580 con 0x55d07e30b730 2024-04-20T12:25:56.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe82966740 10 client.0 _ll_register_callbacks cb 0x7fbe68005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:56.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe7e230640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e314310 0x55d07e30d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe7e230640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e314310 0x55d07e30d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43796/0 (socket says 172.21.15.135:43796) 2024-04-20T12:25:56.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe7e230640 1 -- 172.21.15.135:0/395120241 learned_addr learned my addr 172.21.15.135:0/395120241 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe7d22e640 1 --2- 172.21.15.135:0/395120241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30b730 0x55d07e31ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe7da2f640 1 --2- 172.21.15.135:0/395120241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e30ae10 0x55d07e31c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe7e230640 1 -- 172.21.15.135:0/395120241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30b730 msgr2=0x55d07e31ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe7e230640 1 --2- 172.21.15.135:0/395120241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30b730 0x55d07e31ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe7e230640 1 -- 172.21.15.135:0/395120241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e30ae10 msgr2=0x55d07e31c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe7e230640 1 --2- 172.21.15.135:0/395120241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e30ae10 0x55d07e31c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.627+0000 7fbe7e230640 1 -- 172.21.15.135:0/395120241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d07e305370 con 0x55d07e314310 2024-04-20T12:25:56.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe7e230640 1 --2- 172.21.15.135:0/395120241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e314310 0x55d07e30d530 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fbe70037040 tx=0x7fbe700095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36637b7aa12cd58 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe617fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:56.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe617fa640 1 -- 172.21.15.135:0/395120241 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70053020 con 0x55d07e314310 2024-04-20T12:25:56.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe617fa640 1 -- 172.21.15.135:0/395120241 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fbe70004240 con 0x55d07e314310 2024-04-20T12:25:56.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe82966740 1 -- 172.21.15.135:0/395120241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe6809ae80 con 0x55d07e314310 2024-04-20T12:25:56.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe617fa640 1 -- 172.21.15.135:0/395120241 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbe7005e050 con 0x55d07e314310 2024-04-20T12:25:56.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe82966740 10 client.16617 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:56.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe82966740 1 -- 172.21.15.135:0/395120241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d07e38a030 con 0x55d07e314310 2024-04-20T12:25:56.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe617fa640 1 -- 172.21.15.135:0/395120241 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe6809ae80 con 0x55d07e314310 2024-04-20T12:25:56.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe617fa640 1 -- 172.21.15.135:0/395120241 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fbe7003f070 con 0x55d07e314310 2024-04-20T12:25:56.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe82966740 10 client.16617 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:56.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe82966740 10 client.16617 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:25:56.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe82966740 20 client.16617 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:56.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe82966740 1 --2- 172.21.15.135:0/395120241 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d07e38a800 0x55d07e38cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe82966740 4 client.16617 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:25:56.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.628+0000 7fbe82966740 1 -- 172.21.15.135:0/395120241 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d07e2779a0 con 0x55d07e38a800 2024-04-20T12:25:56.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe7da2f640 1 --2- 172.21.15.135:0/395120241 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d07e38a800 0x55d07e38cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe617fa640 10 client.16617 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:25:56.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe7da2f640 1 --2- 172.21.15.135:0/395120241 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d07e38a800 0x55d07e38cc20 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f51bbce50bb196c0 server_cookie=24d9207642606d34 in_seq=0 out_seq=0 2024-04-20T12:25:56.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe617fa640 1 -- 172.21.15.135:0/395120241 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d07e2779a0 con 0x55d07e38a800 2024-04-20T12:25:56.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe617fa640 10 client.16617 handle_command_reply: tid=0 2024-04-20T12:25:56.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe82966740 1 client.16617 shutdown 2024-04-20T12:25:56.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe82966740 1 -- 172.21.15.135:0/395120241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e314310 msgr2=0x55d07e30d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe82966740 1 --2- 172.21.15.135:0/395120241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e314310 0x55d07e30d530 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fbe70037040 tx=0x7fbe700095c0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe82966740 1 -- 172.21.15.135:0/395120241 shutdown_connections 2024-04-20T12:25:56.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe82966740 1 --2- 172.21.15.135:0/395120241 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55d07e38a800 0x55d07e38cc20 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe82966740 1 --2- 172.21.15.135:0/395120241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d07e314310 0x55d07e30d530 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe82966740 1 --2- 172.21.15.135:0/395120241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d07e30b730 0x55d07e31ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe82966740 1 --2- 172.21.15.135:0/395120241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d07e30ae10 0x55d07e31c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe617fa640 0 client.16617 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:25:56.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe82966740 1 -- 172.21.15.135:0/395120241 >> 172.21.15.135:0/395120241 conn(0x55d07e305540 msgr2=0x55d07e310420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe82966740 1 -- 172.21.15.135:0/395120241 shutdown_connections 2024-04-20T12:25:56.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.629+0000 7fbe82966740 1 -- 172.21.15.135:0/395120241 wait complete. 2024-04-20T12:25:56.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.630+0000 7fbe82966740 20 client.16617 trim_cache size 0 max 16384 2024-04-20T12:25:56.637 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:25:56.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.630+0000 7fbe7fc93640 1 -- 172.21.15.135:0/2189700634 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbe640a3d20 msgr2=0x7fbe640a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.630+0000 7fbe7fc93640 1 --2- 172.21.15.135:0/2189700634 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbe640a3d20 0x7fbe640a61e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009430 tx=0x7fbe7002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.630+0000 7fbe7fc93640 1 -- 172.21.15.135:0/2189700634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7806af00 msgr2=0x7fbe781a0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.630+0000 7fbe7fc93640 1 --2- 172.21.15.135:0/2189700634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7806af00 0x7fbe781a0b60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800e9f0 tx=0x7fbe6800eeb0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.630+0000 7fbe7fc93640 1 -- 172.21.15.135:0/2189700634 shutdown_connections 2024-04-20T12:25:56.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.630+0000 7fbe7fc93640 1 --2- 172.21.15.135:0/2189700634 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbe7810ec60 0x7fbe7819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.630+0000 7fbe7fc93640 1 --2- 172.21.15.135:0/2189700634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbe7806af00 0x7fbe781a0b60 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.630+0000 7fbe7fc93640 1 --2- 172.21.15.135:0/2189700634 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbe640a3d20 0x7fbe640a61e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.630+0000 7fbe7fc93640 1 --2- 172.21.15.135:0/2189700634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbe7806a5e0 0x7fbe781a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.630+0000 7fbe7fc93640 1 -- 172.21.15.135:0/2189700634 >> 172.21.15.135:0/2189700634 conn(0x7fbe78077c50 msgr2=0x7fbe7810ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.630+0000 7fbe7fc93640 1 -- 172.21.15.135:0/2189700634 shutdown_connections 2024-04-20T12:25:56.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.630+0000 7fbe7fc93640 1 -- 172.21.15.135:0/2189700634 wait complete. 2024-04-20T12:25:56.641 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:25:56.743 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.741+0000 7fb21d281640 1 -- 172.21.15.135:0/2768185522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2181021b0 msgr2=0x7fb218102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.741+0000 7fb21d281640 1 --2- 172.21.15.135:0/2768185522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2181021b0 0x7fb218102590 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb208009900 tx=0x7fb20802bc30 comp rx=0 tx=0).stop 2024-04-20T12:25:56.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.741+0000 7fb21d281640 1 -- 172.21.15.135:0/2768185522 shutdown_connections 2024-04-20T12:25:56.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.741+0000 7fb21d281640 1 --2- 172.21.15.135:0/2768185522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb218107280 0x7fb21810ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.741+0000 7fb21d281640 1 --2- 172.21.15.135:0/2768185522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb218102b60 0x7fb218106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.741+0000 7fb21d281640 1 --2- 172.21.15.135:0/2768185522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2181021b0 0x7fb218102590 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.741+0000 7fb21d281640 1 -- 172.21.15.135:0/2768185522 >> 172.21.15.135:0/2768185522 conn(0x7fb2180793f0 msgr2=0x7fb218079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.741+0000 7fb21d281640 1 -- 172.21.15.135:0/2768185522 shutdown_connections 2024-04-20T12:25:56.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.741+0000 7fb21d281640 1 -- 172.21.15.135:0/2768185522 wait complete. 2024-04-20T12:25:56.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb21d281640 1 Processor -- start 2024-04-20T12:25:56.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb21d281640 1 -- start start 2024-04-20T12:25:56.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb21d281640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2181021b0 0x7fb218074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.744 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb21d281640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb218107280 0x7fb2180747a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb21d281640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb218074ce0 0x7fb2181a6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb21d281640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb218112330 con 0x7fb2181021b0 2024-04-20T12:25:56.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb21d281640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb2181121b0 con 0x7fb218074ce0 2024-04-20T12:25:56.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb21d281640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2181124b0 con 0x7fb218107280 2024-04-20T12:25:56.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb216ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2181021b0 0x7fb218074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb216ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2181021b0 0x7fb218074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43816/0 (socket says 172.21.15.135:43816) 2024-04-20T12:25:56.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb216ffd640 1 -- 172.21.15.135:0/1482586251 learned_addr learned my addr 172.21.15.135:0/1482586251 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb2167fc640 1 --2- 172.21.15.135:0/1482586251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb218107280 0x7fb2180747a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb2177fe640 1 --2- 172.21.15.135:0/1482586251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb218074ce0 0x7fb2181a6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb216ffd640 1 -- 172.21.15.135:0/1482586251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb218107280 msgr2=0x7fb2180747a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb216ffd640 1 --2- 172.21.15.135:0/1482586251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb218107280 0x7fb2180747a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb216ffd640 1 -- 172.21.15.135:0/1482586251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb218074ce0 msgr2=0x7fb2181a6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.745 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb216ffd640 1 --2- 172.21.15.135:0/1482586251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb218074ce0 0x7fb2181a6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb216ffd640 1 -- 172.21.15.135:0/1482586251 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2181a7100 con 0x7fb2181021b0 2024-04-20T12:25:56.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.742+0000 7fb2177fe640 1 --2- 172.21.15.135:0/1482586251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb218074ce0 0x7fb2181a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:56.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.743+0000 7fb216ffd640 1 --2- 172.21.15.135:0/1482586251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2181021b0 0x7fb218074260 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb208006010 tx=0x7fb20802cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.743+0000 7fb1fffff640 1 -- 172.21.15.135:0/1482586251 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208041070 con 0x7fb2181021b0 2024-04-20T12:25:56.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.743+0000 7fb1fffff640 1 -- 172.21.15.135:0/1482586251 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb208004450 con 0x7fb2181021b0 2024-04-20T12:25:56.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.743+0000 7fb21d281640 1 -- 172.21.15.135:0/1482586251 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2181a7390 con 0x7fb2181021b0 2024-04-20T12:25:56.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.743+0000 7fb1fffff640 1 -- 172.21.15.135:0/1482586251 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208034440 con 0x7fb2181021b0 2024-04-20T12:25:56.746 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.743+0000 7fb21d281640 1 -- 172.21.15.135:0/1482586251 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2181a7880 con 0x7fb2181021b0 2024-04-20T12:25:56.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.745+0000 7fb1fffff640 1 -- 172.21.15.135:0/1482586251 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fb208044070 con 0x7fb2181021b0 2024-04-20T12:25:56.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.745+0000 7fb21fe70740 1 Processor -- start 2024-04-20T12:25:56.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.745+0000 7fb21fe70740 1 -- start start 2024-04-20T12:25:56.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.745+0000 7fb21fe70740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7ae10 0x5615d1b7b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.745+0000 7fb21fe70740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7b730 0x5615d1b83dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb21fe70740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b84310 0x5615d1b86700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb21fe70740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5615d1ae0110 con 0x5615d1b7ae10 2024-04-20T12:25:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb21fe70740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5615d1a7d550 con 0x5615d1b7b730 2024-04-20T12:25:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb21fe70740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5615d1adc0d0 con 0x5615d1b84310 2024-04-20T12:25:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb2177fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7ae10 0x5615d1b7b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb2177fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7ae10 0x5615d1b7b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43830/0 (socket says 172.21.15.135:43830) 2024-04-20T12:25:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb2177fe640 1 -- 172.21.15.135:0/455123955 learned_addr learned my addr 172.21.15.135:0/455123955 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb216ffd640 1 --2- 172.21.15.135:0/455123955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7b730 0x5615d1b83dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb2167fc640 1 --2- 172.21.15.135:0/455123955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b84310 0x5615d1b86700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb2177fe640 1 -- 172.21.15.135:0/455123955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b84310 msgr2=0x5615d1b86700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb2177fe640 1 --2- 172.21.15.135:0/455123955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b84310 0x5615d1b86700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb2177fe640 1 -- 172.21.15.135:0/455123955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7b730 msgr2=0x5615d1b83dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb2177fe640 1 --2- 172.21.15.135:0/455123955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7b730 0x5615d1b83dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb2177fe640 1 -- 172.21.15.135:0/455123955 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615d1aa5900 con 0x5615d1b7ae10 2024-04-20T12:25:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb1fffff640 1 --2- 172.21.15.135:0/1482586251 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb2000a3d50 0x7fb2000a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb2177fe640 1 --2- 172.21.15.135:0/455123955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7ae10 0x5615d1b7b1f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb210009fd0 tx=0x7fb21000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee098129ac07f7a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb216ffd640 1 --2- 172.21.15.135:0/1482586251 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb2000a3d50 0x7fb2000a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.746+0000 7fb216ffd640 1 --2- 172.21.15.135:0/1482586251 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb2000a3d50 0x7fb2000a6210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5615d1b7a8e0 tx=0x7fb2080f37d0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.748+0000 7fb1fffff640 1 -- 172.21.15.135:0/1482586251 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fb2080bc410 con 0x7fb2181021b0 2024-04-20T12:25:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.748+0000 7fb1fd7fa640 1 -- 172.21.15.135:0/455123955 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210015070 con 0x5615d1b7ae10 2024-04-20T12:25:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.748+0000 7fb1fd7fa640 1 -- 172.21.15.135:0/455123955 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb210011be0 con 0x5615d1b7ae10 2024-04-20T12:25:56.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.748+0000 7fb1fd7fa640 1 -- 172.21.15.135:0/455123955 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210010c30 con 0x5615d1b7ae10 2024-04-20T12:25:56.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.749+0000 7fb21fe70740 1 -- 172.21.15.135:0/455123955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7ae10 msgr2=0x5615d1b7b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.749+0000 7fb21fe70740 1 --2- 172.21.15.135:0/455123955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7ae10 0x5615d1b7b1f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb210009fd0 tx=0x7fb21000f7f0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.749+0000 7fb21fe70740 1 -- 172.21.15.135:0/455123955 shutdown_connections 2024-04-20T12:25:56.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.749+0000 7fb21fe70740 1 --2- 172.21.15.135:0/455123955 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b84310 0x5615d1b86700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.749+0000 7fb21fe70740 1 --2- 172.21.15.135:0/455123955 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7b730 0x5615d1b83dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.749+0000 7fb21fe70740 1 --2- 172.21.15.135:0/455123955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7ae10 0x5615d1b7b1f0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.749+0000 7fb21fe70740 1 -- 172.21.15.135:0/455123955 >> 172.21.15.135:0/455123955 conn(0x5615d1b75540 msgr2=0x5615d1b75920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.749+0000 7fb21fe70740 1 -- 172.21.15.135:0/455123955 shutdown_connections 2024-04-20T12:25:56.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.749+0000 7fb21fe70740 1 -- 172.21.15.135:0/455123955 wait complete. 2024-04-20T12:25:56.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.749+0000 7fb21fe70740 1 -- start start 2024-04-20T12:25:56.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.749+0000 7fb21fe70740 1 Processor -- start 2024-04-20T12:25:56.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb21fe70740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b7ae10 0x5615d1b81430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb21fe70740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7b730 0x5615d1b81970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb21fe70740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b84310 0x5615d1b81eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb21fe70740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5615d1b870a0 con 0x5615d1b7b730 2024-04-20T12:25:56.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb21fe70740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5615d1a99500 con 0x5615d1b84310 2024-04-20T12:25:56.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb21fe70740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5615d1b87220 con 0x5615d1b7ae10 2024-04-20T12:25:56.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb21fe70740 10 client.0 _ll_register_callbacks cb 0x5615d1a7e2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:56.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb2167fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7b730 0x5615d1b81970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb2167fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7b730 0x5615d1b81970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43832/0 (socket says 172.21.15.135:43832) 2024-04-20T12:25:56.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb2167fc640 1 -- 172.21.15.135:0/3648370330 learned_addr learned my addr 172.21.15.135:0/3648370330 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb2177fe640 1 --2- 172.21.15.135:0/3648370330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b84310 0x5615d1b81eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb2177fe640 1 --2- 172.21.15.135:0/3648370330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b7ae10 0x5615d1b81430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb2167fc640 1 -- 172.21.15.135:0/3648370330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b7ae10 msgr2=0x5615d1b81430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb2167fc640 1 --2- 172.21.15.135:0/3648370330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b7ae10 0x5615d1b81430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb2167fc640 1 -- 172.21.15.135:0/3648370330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b84310 msgr2=0x5615d1b81eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb2167fc640 1 --2- 172.21.15.135:0/3648370330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b84310 0x5615d1b81eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb2167fc640 1 -- 172.21.15.135:0/3648370330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615d17f23f0 con 0x5615d1b7b730 2024-04-20T12:25:56.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb2177fe640 1 --2- 172.21.15.135:0/3648370330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b7ae10 0x5615d1b81430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:56.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb2167fc640 1 --2- 172.21.15.135:0/3648370330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7b730 0x5615d1b81970 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00b920 tx=0x7fb20c00bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd3b44560720ac9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb1faff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:56.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb1faff5640 1 -- 172.21.15.135:0/3648370330 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c005020 con 0x5615d1b7b730 2024-04-20T12:25:56.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb1faff5640 1 -- 172.21.15.135:0/3648370330 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fb20c0051c0 con 0x5615d1b7b730 2024-04-20T12:25:56.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.750+0000 7fb21fe70740 1 -- 172.21.15.135:0/3648370330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb210011be0 con 0x5615d1b7b730 2024-04-20T12:25:56.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.751+0000 7fb1faff5640 1 -- 172.21.15.135:0/3648370330 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb20c024050 con 0x5615d1b7b730 2024-04-20T12:25:56.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.751+0000 7fb21fe70740 10 client.16629 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:56.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.751+0000 7fb21fe70740 1 -- 172.21.15.135:0/3648370330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5615d18bc7d0 con 0x5615d1b7b730 2024-04-20T12:25:56.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.751+0000 7fb1faff5640 1 -- 172.21.15.135:0/3648370330 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb210011be0 con 0x5615d1b7b730 2024-04-20T12:25:56.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.751+0000 7fb1faff5640 1 -- 172.21.15.135:0/3648370330 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fb20c01b470 con 0x5615d1b7b730 2024-04-20T12:25:56.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.751+0000 7fb21fe70740 10 client.16629 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:56.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.751+0000 7fb21fe70740 10 client.16629 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:25:56.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.751+0000 7fb21fe70740 20 client.16629 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:56.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.751+0000 7fb21fe70740 1 --2- 172.21.15.135:0/3648370330 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5615d1b94750 0x5615d1b96b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.751+0000 7fb21fe70740 4 client.16629 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:56.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.751+0000 7fb21fe70740 1 -- 172.21.15.135:0/3648370330 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615d1aedb30 con 0x5615d1b94750 2024-04-20T12:25:56.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.751+0000 7fb2177fe640 1 --2- 172.21.15.135:0/3648370330 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5615d1b94750 0x5615d1b96b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb1faff5640 10 client.16629 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:25:56.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb2177fe640 1 --2- 172.21.15.135:0/3648370330 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5615d1b94750 0x5615d1b96b70 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5f4fc2025d56c496 server_cookie=ed9302efe7036f34 in_seq=0 out_seq=0 2024-04-20T12:25:56.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb1faff5640 1 -- 172.21.15.135:0/3648370330 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5615d1aedb30 con 0x5615d1b94750 2024-04-20T12:25:56.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb1faff5640 10 client.16629 handle_command_reply: tid=0 2024-04-20T12:25:56.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb21fe70740 1 client.16629 shutdown 2024-04-20T12:25:56.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb21fe70740 1 -- 172.21.15.135:0/3648370330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7b730 msgr2=0x5615d1b81970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb21fe70740 1 --2- 172.21.15.135:0/3648370330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7b730 0x5615d1b81970 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00b920 tx=0x7fb20c00bde0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb21fe70740 1 -- 172.21.15.135:0/3648370330 shutdown_connections 2024-04-20T12:25:56.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb21fe70740 1 --2- 172.21.15.135:0/3648370330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b84310 0x5615d1b81eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb21fe70740 1 --2- 172.21.15.135:0/3648370330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7b730 0x5615d1b81970 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb21fe70740 1 --2- 172.21.15.135:0/3648370330 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5615d1b94750 0x5615d1b96b70 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb21fe70740 1 --2- 172.21.15.135:0/3648370330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b7ae10 0x5615d1b81430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb1faff5640 0 client.16629 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:25:56.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb21fe70740 1 -- 172.21.15.135:0/3648370330 >> 172.21.15.135:0/3648370330 conn(0x5615d1b75540 msgr2=0x5615d1b77290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb21fe70740 1 -- 172.21.15.135:0/3648370330 shutdown_connections 2024-04-20T12:25:56.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.752+0000 7fb21fe70740 1 -- 172.21.15.135:0/3648370330 wait complete. 2024-04-20T12:25:56.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.753+0000 7fb21fe70740 20 client.16629 trim_cache size 0 max 16384 2024-04-20T12:25:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb21fe70740 1 Processor -- start 2024-04-20T12:25:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb21fe70740 1 -- start start 2024-04-20T12:25:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb21fe70740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7ae10 0x5615d1b81cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb21fe70740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b7b730 0x5615d1b9c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb21fe70740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b84310 0x5615d1b9c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb21fe70740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2181b1560 con 0x5615d1b84310 2024-04-20T12:25:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb21fe70740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb2181b30a0 con 0x5615d1b7ae10 2024-04-20T12:25:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb21fe70740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2181b1c30 con 0x5615d1b7b730 2024-04-20T12:25:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb2177fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7ae10 0x5615d1b81cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb2177fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7ae10 0x5615d1b81cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:58284/0 (socket says 172.21.15.135:58284) 2024-04-20T12:25:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb2177fe640 1 -- 172.21.15.135:0/3525324463 learned_addr learned my addr 172.21.15.135:0/3525324463 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb2167fc640 1 --2- 172.21.15.135:0/3525324463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b7b730 0x5615d1b9c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb2177fe640 1 --2- 172.21.15.135:0/3525324463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b84310 0x5615d1b9c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb2177fe640 1 -- 172.21.15.135:0/3525324463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b7b730 msgr2=0x5615d1b9c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb2177fe640 1 --2- 172.21.15.135:0/3525324463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b7b730 0x5615d1b9c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb2177fe640 1 -- 172.21.15.135:0/3525324463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b84310 msgr2=0x5615d1b9c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb2177fe640 1 --2- 172.21.15.135:0/3525324463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b84310 0x5615d1b9c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb2177fe640 1 -- 172.21.15.135:0/3525324463 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615d1b86a70 con 0x5615d1b7ae10 2024-04-20T12:25:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.766+0000 7fb2177fe640 1 --2- 172.21.15.135:0/3525324463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7ae10 0x5615d1b81cd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb210014040 tx=0x7fb210010940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c080f594a2f55060 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.767+0000 7fb1fcff9640 1 -- 172.21.15.135:0/3525324463 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210015040 con 0x5615d1b7ae10 2024-04-20T12:25:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.767+0000 7fb1fcff9640 1 -- 172.21.15.135:0/3525324463 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb210003e50 con 0x5615d1b7ae10 2024-04-20T12:25:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.767+0000 7fb1fcff9640 1 -- 172.21.15.135:0/3525324463 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210010c60 con 0x5615d1b7ae10 2024-04-20T12:25:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.767+0000 7fb21fe70740 1 -- 172.21.15.135:0/3525324463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7ae10 msgr2=0x5615d1b81cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.767+0000 7fb21fe70740 1 --2- 172.21.15.135:0/3525324463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7ae10 0x5615d1b81cd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb210014040 tx=0x7fb210010940 comp rx=0 tx=0).stop 2024-04-20T12:25:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.767+0000 7fb21fe70740 1 -- 172.21.15.135:0/3525324463 shutdown_connections 2024-04-20T12:25:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.767+0000 7fb21fe70740 1 --2- 172.21.15.135:0/3525324463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b84310 0x5615d1b9c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.767+0000 7fb21fe70740 1 --2- 172.21.15.135:0/3525324463 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b7b730 0x5615d1b9c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.767+0000 7fb21fe70740 1 --2- 172.21.15.135:0/3525324463 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7ae10 0x5615d1b81cd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.767+0000 7fb21fe70740 1 -- 172.21.15.135:0/3525324463 >> 172.21.15.135:0/3525324463 conn(0x5615d1b75540 msgr2=0x5615d1b75920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.767+0000 7fb21fe70740 1 -- 172.21.15.135:0/3525324463 shutdown_connections 2024-04-20T12:25:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.767+0000 7fb21fe70740 1 -- 172.21.15.135:0/3525324463 wait complete. 2024-04-20T12:25:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb21fe70740 1 -- start start 2024-04-20T12:25:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb21fe70740 1 Processor -- start 2024-04-20T12:25:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb21fe70740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7ae10 0x5615d1b8c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb21fe70740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7b730 0x5615d1b7dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb21fe70740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b84310 0x5615d1b7e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb21fe70740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2181b29d0 con 0x5615d1b7ae10 2024-04-20T12:25:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb21fe70740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb2181b2300 con 0x5615d1b7b730 2024-04-20T12:25:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb21fe70740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb2181af530 con 0x5615d1b84310 2024-04-20T12:25:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb21fe70740 10 client.0 _ll_register_callbacks cb 0x7fb20c0042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:56.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb2177fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7ae10 0x5615d1b8c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb2177fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7ae10 0x5615d1b8c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43852/0 (socket says 172.21.15.135:43852) 2024-04-20T12:25:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb2177fe640 1 -- 172.21.15.135:0/1450212131 learned_addr learned my addr 172.21.15.135:0/1450212131 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb2177fe640 1 --2- 172.21.15.135:0/1450212131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b84310 0x5615d1b7e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb2167fc640 1 --2- 172.21.15.135:0/1450212131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7b730 0x5615d1b7dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb2177fe640 1 -- 172.21.15.135:0/1450212131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b84310 msgr2=0x5615d1b7e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb2177fe640 1 --2- 172.21.15.135:0/1450212131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b84310 0x5615d1b7e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb2177fe640 1 -- 172.21.15.135:0/1450212131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7b730 msgr2=0x5615d1b7dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb2177fe640 1 --2- 172.21.15.135:0/1450212131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7b730 0x5615d1b7dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb2177fe640 1 -- 172.21.15.135:0/1450212131 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615d1b7e850 con 0x5615d1b7ae10 2024-04-20T12:25:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb2177fe640 1 --2- 172.21.15.135:0/1450212131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7ae10 0x5615d1b8c660 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb210010a60 tx=0x7fb2100109f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba41bb497a01ced server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.768+0000 7fb1faff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.769+0000 7fb1faff5640 1 -- 172.21.15.135:0/1450212131 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210015030 con 0x5615d1b7ae10 2024-04-20T12:25:56.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.769+0000 7fb1faff5640 1 -- 172.21.15.135:0/1450212131 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fb210003970 con 0x5615d1b7ae10 2024-04-20T12:25:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.769+0000 7fb21fe70740 1 -- 172.21.15.135:0/1450212131 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb210003e50 con 0x5615d1b7ae10 2024-04-20T12:25:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.769+0000 7fb1faff5640 1 -- 172.21.15.135:0/1450212131 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb210003b70 con 0x5615d1b7ae10 2024-04-20T12:25:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.769+0000 7fb21fe70740 10 client.16635 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.769+0000 7fb21fe70740 1 -- 172.21.15.135:0/1450212131 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5615d1bfab60 con 0x5615d1b7ae10 2024-04-20T12:25:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.769+0000 7fb1faff5640 1 -- 172.21.15.135:0/1450212131 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb210003e50 con 0x5615d1b7ae10 2024-04-20T12:25:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.769+0000 7fb1faff5640 1 -- 172.21.15.135:0/1450212131 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fb21002ace0 con 0x5615d1b7ae10 2024-04-20T12:25:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.769+0000 7fb21fe70740 10 client.16635 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.769+0000 7fb21fe70740 10 client.16635 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:25:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.769+0000 7fb21fe70740 20 client.16635 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.769+0000 7fb21fe70740 1 --2- 172.21.15.135:0/1450212131 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5615d1bfb0c0 0x5615d1bfd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.769+0000 7fb21fe70740 4 client.16635 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:25:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.769+0000 7fb21fe70740 1 -- 172.21.15.135:0/1450212131 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5615d1ae79a0 con 0x5615d1bfb0c0 2024-04-20T12:25:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.769+0000 7fb2167fc640 1 --2- 172.21.15.135:0/1450212131 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5615d1bfb0c0 0x5615d1bfd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb2167fc640 1 --2- 172.21.15.135:0/1450212131 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5615d1bfb0c0 0x5615d1bfd4e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9f98dc3c5ae50e3d server_cookie=c89c1f4ae127caf2 in_seq=0 out_seq=0 2024-04-20T12:25:56.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb1faff5640 10 client.16635 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:25:56.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb1faff5640 1 -- 172.21.15.135:0/1450212131 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5615d1ae79a0 con 0x5615d1bfb0c0 2024-04-20T12:25:56.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb1faff5640 10 client.16635 handle_command_reply: tid=0 2024-04-20T12:25:56.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb21fe70740 1 client.16635 shutdown 2024-04-20T12:25:56.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb21fe70740 1 -- 172.21.15.135:0/1450212131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7ae10 msgr2=0x5615d1b8c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb21fe70740 1 --2- 172.21.15.135:0/1450212131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7ae10 0x5615d1b8c660 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb210010a60 tx=0x7fb2100109f0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb21fe70740 1 -- 172.21.15.135:0/1450212131 shutdown_connections 2024-04-20T12:25:56.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb21fe70740 1 --2- 172.21.15.135:0/1450212131 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5615d1bfb0c0 0x5615d1bfd4e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb21fe70740 1 --2- 172.21.15.135:0/1450212131 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5615d1b84310 0x5615d1b7e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb1faff5640 0 client.16635 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:25:56.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb21fe70740 1 --2- 172.21.15.135:0/1450212131 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5615d1b7b730 0x5615d1b7dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb21fe70740 1 --2- 172.21.15.135:0/1450212131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5615d1b7ae10 0x5615d1b8c660 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb21fe70740 1 -- 172.21.15.135:0/1450212131 >> 172.21.15.135:0/1450212131 conn(0x5615d1b75540 msgr2=0x5615d1b76770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb21fe70740 1 -- 172.21.15.135:0/1450212131 shutdown_connections 2024-04-20T12:25:56.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb21fe70740 1 -- 172.21.15.135:0/1450212131 wait complete. 2024-04-20T12:25:56.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.770+0000 7fb21fe70740 20 client.16635 trim_cache size 0 max 16384 2024-04-20T12:25:56.777 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:25:56.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.771+0000 7fb21d281640 1 -- 172.21.15.135:0/1482586251 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb2000a3d50 msgr2=0x7fb2000a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.771+0000 7fb21d281640 1 --2- 172.21.15.135:0/1482586251 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb2000a3d50 0x7fb2000a6210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5615d1b7a8e0 tx=0x7fb2080f37d0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.771+0000 7fb21d281640 1 -- 172.21.15.135:0/1482586251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2181021b0 msgr2=0x7fb218074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.771+0000 7fb21d281640 1 --2- 172.21.15.135:0/1482586251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2181021b0 0x7fb218074260 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb208006010 tx=0x7fb20802cc70 comp rx=0 tx=0).stop 2024-04-20T12:25:56.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.771+0000 7fb21d281640 1 -- 172.21.15.135:0/1482586251 shutdown_connections 2024-04-20T12:25:56.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.771+0000 7fb21d281640 1 --2- 172.21.15.135:0/1482586251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb218074ce0 0x7fb2181a6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.771+0000 7fb21d281640 1 --2- 172.21.15.135:0/1482586251 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb2000a3d50 0x7fb2000a6210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.771+0000 7fb21d281640 1 --2- 172.21.15.135:0/1482586251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb218107280 0x7fb2180747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.771+0000 7fb21d281640 1 --2- 172.21.15.135:0/1482586251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2181021b0 0x7fb218074260 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.771+0000 7fb21d281640 1 -- 172.21.15.135:0/1482586251 >> 172.21.15.135:0/1482586251 conn(0x7fb2180793f0 msgr2=0x7fb2180ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.771+0000 7fb21d281640 1 -- 172.21.15.135:0/1482586251 shutdown_connections 2024-04-20T12:25:56.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.771+0000 7fb21d281640 1 -- 172.21.15.135:0/1482586251 wait complete. 2024-04-20T12:25:56.782 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:25:56.884 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.882+0000 7fa051585640 1 -- 172.21.15.135:0/3511716202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04c106140 msgr2=0x7fa04c10dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.882+0000 7fa051585640 1 --2- 172.21.15.135:0/3511716202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04c106140 0x7fa04c10dd10 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa044009ca0 tx=0x7fa04402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.882+0000 7fa051585640 1 -- 172.21.15.135:0/3511716202 shutdown_connections 2024-04-20T12:25:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.882+0000 7fa051585640 1 --2- 172.21.15.135:0/3511716202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04c106140 0x7fa04c10dd10 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.882+0000 7fa051585640 1 --2- 172.21.15.135:0/3511716202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa04c101a20 0x7fa04c105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.882+0000 7fa051585640 1 --2- 172.21.15.135:0/3511716202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa04c101070 0x7fa04c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.882+0000 7fa051585640 1 -- 172.21.15.135:0/3511716202 >> 172.21.15.135:0/3511716202 conn(0x7fa04c0771e0 msgr2=0x7fa04c0775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.882+0000 7fa051585640 1 -- 172.21.15.135:0/3511716202 shutdown_connections 2024-04-20T12:25:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.882+0000 7fa051585640 1 -- 172.21.15.135:0/3511716202 wait complete. 2024-04-20T12:25:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.883+0000 7fa051585640 1 Processor -- start 2024-04-20T12:25:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.883+0000 7fa051585640 1 -- start start 2024-04-20T12:25:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.883+0000 7fa051585640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa04c101070 0x7fa04c199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.883+0000 7fa051585640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04c106140 0x7fa04c199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.885 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.883+0000 7fa051585640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa04c19a100 0x7fa04c1a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.883+0000 7fa051585640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c111200 con 0x7fa04c106140 2024-04-20T12:25:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.883+0000 7fa051585640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c111080 con 0x7fa04c101070 2024-04-20T12:25:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.883+0000 7fa051585640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c111380 con 0x7fa04c19a100 2024-04-20T12:25:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.883+0000 7fa043fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04c106140 0x7fa04c199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.883+0000 7fa043fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04c106140 0x7fa04c199bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43870/0 (socket says 172.21.15.135:43870) 2024-04-20T12:25:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.883+0000 7fa043fff640 1 -- 172.21.15.135:0/3834814267 learned_addr learned my addr 172.21.15.135:0/3834814267 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.883+0000 7fa04affd640 1 --2- 172.21.15.135:0/3834814267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa04c101070 0x7fa04c199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.884+0000 7fa04b7fe640 1 --2- 172.21.15.135:0/3834814267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa04c19a100 0x7fa04c1a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.884+0000 7fa043fff640 1 -- 172.21.15.135:0/3834814267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa04c19a100 msgr2=0x7fa04c1a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.884+0000 7fa043fff640 1 --2- 172.21.15.135:0/3834814267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa04c19a100 0x7fa04c1a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.884+0000 7fa043fff640 1 -- 172.21.15.135:0/3834814267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa04c101070 msgr2=0x7fa04c199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.884+0000 7fa043fff640 1 --2- 172.21.15.135:0/3834814267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa04c101070 0x7fa04c199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.884+0000 7fa043fff640 1 -- 172.21.15.135:0/3834814267 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04c1a4e80 con 0x7fa04c106140 2024-04-20T12:25:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.884+0000 7fa04affd640 1 --2- 172.21.15.135:0/3834814267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa04c101070 0x7fa04c199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.884+0000 7fa043fff640 1 --2- 172.21.15.135:0/3834814267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04c106140 0x7fa04c199bc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa03400d740 tx=0x7fa03400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.884+0000 7fa048ff9640 1 -- 172.21.15.135:0/3834814267 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa034017070 con 0x7fa04c106140 2024-04-20T12:25:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.884+0000 7fa051585640 1 -- 172.21.15.135:0/3834814267 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa04c1a5170 con 0x7fa04c106140 2024-04-20T12:25:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.884+0000 7fa048ff9640 1 -- 172.21.15.135:0/3834814267 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa03400de50 con 0x7fa04c106140 2024-04-20T12:25:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.884+0000 7fa048ff9640 1 -- 172.21.15.135:0/3834814267 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa034004e00 con 0x7fa04c106140 2024-04-20T12:25:56.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.884+0000 7fa051585640 1 -- 172.21.15.135:0/3834814267 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa04c1a56c0 con 0x7fa04c106140 2024-04-20T12:25:56.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.886+0000 7fa048ff9640 1 -- 172.21.15.135:0/3834814267 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fa034004fa0 con 0x7fa04c106140 2024-04-20T12:25:56.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.886+0000 7fa054172740 1 Processor -- start 2024-04-20T12:25:56.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa054172740 1 -- start start 2024-04-20T12:25:56.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa048ff9640 1 --2- 172.21.15.135:0/3834814267 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa0380a3e20 0x7fa0380a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa04b7fe640 1 --2- 172.21.15.135:0/3834814267 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa0380a3e20 0x7fa0380a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa048ff9640 1 -- 172.21.15.135:0/3834814267 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fa0340d0560 con 0x7fa04c106140 2024-04-20T12:25:56.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa054172740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586ecb40 0x5634586ecf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa054172740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586ed460 0x5634586fa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa054172740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586fa720 0x5634586fcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa054172740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563458652110 con 0x5634586fa720 2024-04-20T12:25:56.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa054172740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5634585ef550 con 0x5634586ed460 2024-04-20T12:25:56.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa054172740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56345864e0d0 con 0x5634586ecb40 2024-04-20T12:25:56.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa04b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586fa720 0x5634586fcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa04b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586fa720 0x5634586fcb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43878/0 (socket says 172.21.15.135:43878) 2024-04-20T12:25:56.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa04b7fe640 1 -- 172.21.15.135:0/2013021199 learned_addr learned my addr 172.21.15.135:0/2013021199 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa04b7fe640 1 --2- 172.21.15.135:0/3834814267 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa0380a3e20 0x7fa0380a62e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa044037040 tx=0x7fa044009800 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa043fff640 1 --2- 172.21.15.135:0/2013021199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586ed460 0x5634586fa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa04affd640 1 --2- 172.21.15.135:0/2013021199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586ecb40 0x5634586ecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa04b7fe640 1 -- 172.21.15.135:0/2013021199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586ecb40 msgr2=0x5634586ecf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa04b7fe640 1 --2- 172.21.15.135:0/2013021199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586ecb40 0x5634586ecf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa04b7fe640 1 -- 172.21.15.135:0/2013021199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586ed460 msgr2=0x5634586fa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa04b7fe640 1 --2- 172.21.15.135:0/2013021199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586ed460 0x5634586fa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa04b7fe640 1 -- 172.21.15.135:0/2013021199 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563458617900 con 0x5634586fa720 2024-04-20T12:25:56.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.887+0000 7fa04b7fe640 1 --2- 172.21.15.135:0/2013021199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586fa720 0x5634586fcb10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa044032d20 tx=0x7fa044044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9272f6072d3605 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.888+0000 7fa0417fa640 1 -- 172.21.15.135:0/2013021199 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044046040 con 0x5634586fa720 2024-04-20T12:25:56.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.888+0000 7fa0417fa640 1 -- 172.21.15.135:0/2013021199 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa04404f070 con 0x5634586fa720 2024-04-20T12:25:56.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.888+0000 7fa0417fa640 1 -- 172.21.15.135:0/2013021199 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044042450 con 0x5634586fa720 2024-04-20T12:25:56.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.888+0000 7fa054172740 1 -- 172.21.15.135:0/2013021199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586fa720 msgr2=0x5634586fcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.888+0000 7fa054172740 1 --2- 172.21.15.135:0/2013021199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586fa720 0x5634586fcb10 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa044032d20 tx=0x7fa044044000 comp rx=0 tx=0).stop 2024-04-20T12:25:56.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.888+0000 7fa054172740 1 -- 172.21.15.135:0/2013021199 shutdown_connections 2024-04-20T12:25:56.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.888+0000 7fa054172740 1 --2- 172.21.15.135:0/2013021199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586fa720 0x5634586fcb10 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.888+0000 7fa054172740 1 --2- 172.21.15.135:0/2013021199 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586ed460 0x5634586fa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.888+0000 7fa054172740 1 --2- 172.21.15.135:0/2013021199 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586ecb40 0x5634586ecf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.888+0000 7fa054172740 1 -- 172.21.15.135:0/2013021199 >> 172.21.15.135:0/2013021199 conn(0x5634586e7540 msgr2=0x5634586e7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.888+0000 7fa054172740 1 -- 172.21.15.135:0/2013021199 shutdown_connections 2024-04-20T12:25:56.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.888+0000 7fa054172740 1 -- 172.21.15.135:0/2013021199 wait complete. 2024-04-20T12:25:56.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa054172740 1 -- start start 2024-04-20T12:25:56.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa054172740 1 Processor -- start 2024-04-20T12:25:56.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa054172740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586ecb40 0x5634586f7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa054172740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586ed460 0x5634586f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa054172740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586fa720 0x5634586f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa054172740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5634586fd480 con 0x5634586ed460 2024-04-20T12:25:56.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa054172740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56345860b500 con 0x5634586fa720 2024-04-20T12:25:56.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa054172740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5634586fd600 con 0x5634586ecb40 2024-04-20T12:25:56.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa054172740 10 client.0 _ll_register_callbacks cb 0x5634585f02f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:56.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa043fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586ed460 0x5634586f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa043fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586ed460 0x5634586f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43886/0 (socket says 172.21.15.135:43886) 2024-04-20T12:25:56.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa043fff640 1 -- 172.21.15.135:0/3965885016 learned_addr learned my addr 172.21.15.135:0/3965885016 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa04affd640 1 --2- 172.21.15.135:0/3965885016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586ecb40 0x5634586f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa043fff640 1 -- 172.21.15.135:0/3965885016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586ecb40 msgr2=0x5634586f7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa043fff640 1 --2- 172.21.15.135:0/3965885016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586ecb40 0x5634586f7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa043fff640 1 -- 172.21.15.135:0/3965885016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586fa720 msgr2=0x5634586f81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa043fff640 1 --2- 172.21.15.135:0/3965885016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586fa720 0x5634586f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.889+0000 7fa043fff640 1 -- 172.21.15.135:0/3965885016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634583643f0 con 0x5634586ed460 2024-04-20T12:25:56.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa043fff640 1 --2- 172.21.15.135:0/3965885016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586ed460 0x5634586f7c70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa034005d80 tx=0x7fa03409c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3fc07a33ecc2fa server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa0327fc640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:56.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa0327fc640 1 -- 172.21.15.135:0/3965885016 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa034020040 con 0x5634586ed460 2024-04-20T12:25:56.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa0327fc640 1 -- 172.21.15.135:0/3965885016 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fa034098790 con 0x5634586ed460 2024-04-20T12:25:56.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa054172740 1 -- 172.21.15.135:0/3965885016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa04404f070 con 0x5634586ed460 2024-04-20T12:25:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa0327fc640 1 -- 172.21.15.135:0/3965885016 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa0340cdb50 con 0x5634586ed460 2024-04-20T12:25:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa054172740 10 client.16647 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa054172740 1 -- 172.21.15.135:0/3965885016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56345842e7d0 con 0x5634586ed460 2024-04-20T12:25:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa0327fc640 1 -- 172.21.15.135:0/3965885016 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa04404f070 con 0x5634586ed460 2024-04-20T12:25:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa0327fc640 1 -- 172.21.15.135:0/3965885016 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fa0340b0bc0 con 0x5634586ed460 2024-04-20T12:25:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa054172740 10 client.16647 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa054172740 10 client.16647 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:25:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa054172740 20 client.16647 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa054172740 1 --2- 172.21.15.135:0/3965885016 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56345870aae0 0x56345870cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa054172740 4 client.16647 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:56.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.890+0000 7fa054172740 1 -- 172.21.15.135:0/3965885016 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56345865fb30 con 0x56345870aae0 2024-04-20T12:25:56.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.891+0000 7fa04affd640 1 --2- 172.21.15.135:0/3965885016 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56345870aae0 0x56345870cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.891+0000 7fa0327fc640 10 client.16647 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:25:56.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.891+0000 7fa04affd640 1 --2- 172.21.15.135:0/3965885016 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56345870aae0 0x56345870cf40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=673a9c9555133433 server_cookie=f0dc9d7f04614ce9 in_seq=0 out_seq=0 2024-04-20T12:25:56.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.892+0000 7fa0327fc640 1 -- 172.21.15.135:0/3965885016 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56345865fb30 con 0x56345870aae0 2024-04-20T12:25:56.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.892+0000 7fa0327fc640 10 client.16647 handle_command_reply: tid=0 2024-04-20T12:25:56.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.892+0000 7fa054172740 1 client.16647 shutdown 2024-04-20T12:25:56.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.892+0000 7fa054172740 1 -- 172.21.15.135:0/3965885016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586ed460 msgr2=0x5634586f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.892+0000 7fa054172740 1 --2- 172.21.15.135:0/3965885016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586ed460 0x5634586f7c70 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa034005d80 tx=0x7fa03409c260 comp rx=0 tx=0).stop 2024-04-20T12:25:56.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.892+0000 7fa054172740 1 -- 172.21.15.135:0/3965885016 shutdown_connections 2024-04-20T12:25:56.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.892+0000 7fa054172740 1 --2- 172.21.15.135:0/3965885016 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56345870aae0 0x56345870cf40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.892+0000 7fa054172740 1 --2- 172.21.15.135:0/3965885016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586fa720 0x5634586f81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.892+0000 7fa054172740 1 --2- 172.21.15.135:0/3965885016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586ed460 0x5634586f7c70 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.892+0000 7fa0327fc640 0 client.16647 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:25:56.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.892+0000 7fa054172740 1 --2- 172.21.15.135:0/3965885016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586ecb40 0x5634586f7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.892+0000 7fa054172740 1 -- 172.21.15.135:0/3965885016 >> 172.21.15.135:0/3965885016 conn(0x5634586e7540 msgr2=0x5634586e9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.892+0000 7fa054172740 1 -- 172.21.15.135:0/3965885016 shutdown_connections 2024-04-20T12:25:56.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.892+0000 7fa054172740 1 -- 172.21.15.135:0/3965885016 wait complete. 2024-04-20T12:25:56.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.892+0000 7fa054172740 20 client.16647 trim_cache size 0 max 16384 2024-04-20T12:25:56.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.905+0000 7fa054172740 1 Processor -- start 2024-04-20T12:25:56.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.905+0000 7fa054172740 1 -- start start 2024-04-20T12:25:56.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.905+0000 7fa054172740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586ecb40 0x5634586f9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.905+0000 7fa054172740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586ed460 0x5634586f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.905+0000 7fa054172740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586fa720 0x563458706380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.905+0000 7fa054172740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1ad0f0 con 0x5634586fa720 2024-04-20T12:25:56.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.905+0000 7fa054172740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1aec30 con 0x5634586ecb40 2024-04-20T12:25:56.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.905+0000 7fa054172740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1ad7c0 con 0x5634586ed460 2024-04-20T12:25:56.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.905+0000 7fa04b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586fa720 0x563458706380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.906+0000 7fa04b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586fa720 0x563458706380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43898/0 (socket says 172.21.15.135:43898) 2024-04-20T12:25:56.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.906+0000 7fa04b7fe640 1 -- 172.21.15.135:0/1020977470 learned_addr learned my addr 172.21.15.135:0/1020977470 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.906+0000 7fa04b7fe640 1 -- 172.21.15.135:0/1020977470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586ed460 msgr2=0x5634586f1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.906+0000 7fa04affd640 1 --2- 172.21.15.135:0/1020977470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586ecb40 0x5634586f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.906+0000 7fa04b7fe640 1 --2- 172.21.15.135:0/1020977470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586ed460 0x5634586f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.906+0000 7fa04b7fe640 1 -- 172.21.15.135:0/1020977470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586ecb40 msgr2=0x5634586f9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.906+0000 7fa04b7fe640 1 --2- 172.21.15.135:0/1020977470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586ecb40 0x5634586f9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.906+0000 7fa04b7fe640 1 -- 172.21.15.135:0/1020977470 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563458709680 con 0x5634586fa720 2024-04-20T12:25:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.906+0000 7fa04affd640 1 --2- 172.21.15.135:0/1020977470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586ecb40 0x5634586f9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.906+0000 7fa04b7fe640 1 --2- 172.21.15.135:0/1020977470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586fa720 0x563458706380 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fa04402c700 tx=0x7fa044005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fa17fdac950fa6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.906+0000 7fa040ff9640 1 -- 172.21.15.135:0/1020977470 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044059020 con 0x5634586fa720 2024-04-20T12:25:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.906+0000 7fa040ff9640 1 -- 172.21.15.135:0/1020977470 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa04404f040 con 0x5634586fa720 2024-04-20T12:25:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.906+0000 7fa040ff9640 1 -- 172.21.15.135:0/1020977470 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044046040 con 0x5634586fa720 2024-04-20T12:25:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 -- 172.21.15.135:0/1020977470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586fa720 msgr2=0x563458706380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 --2- 172.21.15.135:0/1020977470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586fa720 0x563458706380 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fa04402c700 tx=0x7fa044005bf0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 -- 172.21.15.135:0/1020977470 shutdown_connections 2024-04-20T12:25:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 --2- 172.21.15.135:0/1020977470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586fa720 0x563458706380 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 --2- 172.21.15.135:0/1020977470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586ed460 0x5634586f1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 --2- 172.21.15.135:0/1020977470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586ecb40 0x5634586f9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 -- 172.21.15.135:0/1020977470 >> 172.21.15.135:0/1020977470 conn(0x5634586e7540 msgr2=0x5634586e5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 -- 172.21.15.135:0/1020977470 shutdown_connections 2024-04-20T12:25:56.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 -- 172.21.15.135:0/1020977470 wait complete. 2024-04-20T12:25:56.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 -- start start 2024-04-20T12:25:56.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 Processor -- start 2024-04-20T12:25:56.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586ecb40 0x563458702890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586ed460 0x563458702dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586fa720 0x5634586f1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1ae560 con 0x5634586ecb40 2024-04-20T12:25:56.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1ade90 con 0x5634586ed460 2024-04-20T12:25:56.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c1ab0c0 con 0x5634586fa720 2024-04-20T12:25:56.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa054172740 10 client.0 _ll_register_callbacks cb 0x7fa03409bf90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:56.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa04affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586ecb40 0x563458702890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa04affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586ecb40 0x563458702890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43914/0 (socket says 172.21.15.135:43914) 2024-04-20T12:25:56.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.907+0000 7fa04affd640 1 -- 172.21.15.135:0/800521718 learned_addr learned my addr 172.21.15.135:0/800521718 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa04affd640 1 -- 172.21.15.135:0/800521718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586fa720 msgr2=0x5634586f1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa04affd640 1 --2- 172.21.15.135:0/800521718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586fa720 0x5634586f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa04affd640 1 -- 172.21.15.135:0/800521718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586ed460 msgr2=0x563458702dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa04affd640 1 --2- 172.21.15.135:0/800521718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586ed460 0x563458702dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa04affd640 1 -- 172.21.15.135:0/800521718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634586ee960 con 0x5634586ecb40 2024-04-20T12:25:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa04affd640 1 --2- 172.21.15.135:0/800521718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586ecb40 0x563458702890 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x56345870d780 tx=0x7fa03c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551e3bb5134c3f3a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa0327fc640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa0327fc640 1 -- 172.21.15.135:0/800521718 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c004220 con 0x5634586ecb40 2024-04-20T12:25:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa0327fc640 1 -- 172.21.15.135:0/800521718 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fa03c0043c0 con 0x5634586ecb40 2024-04-20T12:25:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa054172740 1 -- 172.21.15.135:0/800521718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa04404f040 con 0x5634586ecb40 2024-04-20T12:25:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa0327fc640 1 -- 172.21.15.135:0/800521718 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa03c02b050 con 0x5634586ecb40 2024-04-20T12:25:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa054172740 10 client.16653 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa054172740 1 -- 172.21.15.135:0/800521718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5634587759c0 con 0x5634586ecb40 2024-04-20T12:25:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa0327fc640 1 -- 172.21.15.135:0/800521718 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa04404f040 con 0x5634586ecb40 2024-04-20T12:25:56.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa0327fc640 1 -- 172.21.15.135:0/800521718 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fa03c003950 con 0x5634586ecb40 2024-04-20T12:25:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa054172740 10 client.16653 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa054172740 10 client.16653 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:25:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa054172740 20 client.16653 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa054172740 1 --2- 172.21.15.135:0/800521718 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x563458776140 0x563458778580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.908+0000 7fa054172740 4 client.16653 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:25:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa054172740 1 -- 172.21.15.135:0/800521718 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5634586599a0 con 0x563458776140 2024-04-20T12:25:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa043fff640 1 --2- 172.21.15.135:0/800521718 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x563458776140 0x563458778580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa043fff640 1 --2- 172.21.15.135:0/800521718 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x563458776140 0x563458778580 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ca7a8ad8bc7c4c43 server_cookie=648d221c4941df7a in_seq=0 out_seq=0 2024-04-20T12:25:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa0327fc640 10 client.16653 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:25:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa0327fc640 1 -- 172.21.15.135:0/800521718 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5634586599a0 con 0x563458776140 2024-04-20T12:25:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa0327fc640 10 client.16653 handle_command_reply: tid=0 2024-04-20T12:25:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa054172740 1 client.16653 shutdown 2024-04-20T12:25:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa054172740 1 -- 172.21.15.135:0/800521718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586ecb40 msgr2=0x563458702890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa054172740 1 --2- 172.21.15.135:0/800521718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586ecb40 0x563458702890 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x56345870d780 tx=0x7fa03c012820 comp rx=0 tx=0).stop 2024-04-20T12:25:56.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa054172740 1 -- 172.21.15.135:0/800521718 shutdown_connections 2024-04-20T12:25:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa054172740 1 --2- 172.21.15.135:0/800521718 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x563458776140 0x563458778580 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa054172740 1 --2- 172.21.15.135:0/800521718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5634586fa720 0x5634586f1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa0327fc640 0 client.16653 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:25:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa054172740 1 --2- 172.21.15.135:0/800521718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5634586ed460 0x563458702dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa054172740 1 --2- 172.21.15.135:0/800521718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5634586ecb40 0x563458702890 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa054172740 1 -- 172.21.15.135:0/800521718 >> 172.21.15.135:0/800521718 conn(0x5634586e7540 msgr2=0x5634586e66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa054172740 1 -- 172.21.15.135:0/800521718 shutdown_connections 2024-04-20T12:25:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.909+0000 7fa054172740 1 -- 172.21.15.135:0/800521718 wait complete. 2024-04-20T12:25:56.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.910+0000 7fa054172740 20 client.16653 trim_cache size 0 max 16384 2024-04-20T12:25:56.917 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:25:56.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.910+0000 7fa051585640 1 -- 172.21.15.135:0/3834814267 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa0380a3e20 msgr2=0x7fa0380a62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.910+0000 7fa051585640 1 --2- 172.21.15.135:0/3834814267 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa0380a3e20 0x7fa0380a62e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa044037040 tx=0x7fa044009800 comp rx=0 tx=0).stop 2024-04-20T12:25:56.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.910+0000 7fa051585640 1 -- 172.21.15.135:0/3834814267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04c106140 msgr2=0x7fa04c199bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:56.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.910+0000 7fa051585640 1 --2- 172.21.15.135:0/3834814267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04c106140 0x7fa04c199bc0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa03400d740 tx=0x7fa03400dc00 comp rx=0 tx=0).stop 2024-04-20T12:25:56.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.910+0000 7fa051585640 1 -- 172.21.15.135:0/3834814267 shutdown_connections 2024-04-20T12:25:56.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.910+0000 7fa051585640 1 --2- 172.21.15.135:0/3834814267 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa0380a3e20 0x7fa0380a62e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.910+0000 7fa051585640 1 --2- 172.21.15.135:0/3834814267 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa04c19a100 0x7fa04c1a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.910+0000 7fa051585640 1 --2- 172.21.15.135:0/3834814267 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa04c106140 0x7fa04c199bc0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.910+0000 7fa051585640 1 --2- 172.21.15.135:0/3834814267 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa04c101070 0x7fa04c199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:56.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.910+0000 7fa051585640 1 -- 172.21.15.135:0/3834814267 >> 172.21.15.135:0/3834814267 conn(0x7fa04c0771e0 msgr2=0x7fa04c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:56.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.910+0000 7fa051585640 1 -- 172.21.15.135:0/3834814267 shutdown_connections 2024-04-20T12:25:56.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:56.910+0000 7fa051585640 1 -- 172.21.15.135:0/3834814267 wait complete. 2024-04-20T12:25:56.920 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:56 smithi135 ceph-mon[18264]: pgmap v87: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:56.920 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:56 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3465831583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:25:56.921 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:25:57.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:56 smithi154 ceph-mon[22073]: pgmap v87: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:57.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:56 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3465831583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:25:57.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.022+0000 7f075ca81640 1 -- 172.21.15.135:0/427060604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0758101090 msgr2=0x7f0758101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:57.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.022+0000 7f075ca81640 1 --2- 172.21.15.135:0/427060604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0758101090 0x7f0758101470 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f074c009900 tx=0x7f074c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:25:57.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.022+0000 7f075ca81640 1 -- 172.21.15.135:0/427060604 shutdown_connections 2024-04-20T12:25:57.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.022+0000 7f075ca81640 1 --2- 172.21.15.135:0/427060604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0758106160 0x7f075810dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.022+0000 7f075ca81640 1 --2- 172.21.15.135:0/427060604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0758101a40 0x7f0758105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.022+0000 7f075ca81640 1 --2- 172.21.15.135:0/427060604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0758101090 0x7f0758101470 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.022+0000 7f075ca81640 1 -- 172.21.15.135:0/427060604 >> 172.21.15.135:0/427060604 conn(0x7f0758078010 msgr2=0x7f0758078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:57.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.022+0000 7f075ca81640 1 -- 172.21.15.135:0/427060604 shutdown_connections 2024-04-20T12:25:57.022 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.022+0000 7f075ca81640 1 -- 172.21.15.135:0/427060604 wait complete. 2024-04-20T12:25:57.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.022+0000 7f075ca81640 1 Processor -- start 2024-04-20T12:25:57.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.022+0000 7f075ca81640 1 -- start start 2024-04-20T12:25:57.024 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f075ca81640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0758101090 0x7f075819e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f075ca81640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0758106160 0x7f075819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f075ca81640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0758198670 0x7f0758198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f075ca81640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0758112330 con 0x7f0758106160 2024-04-20T12:25:57.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f075ca81640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f07581121b0 con 0x7f0758198670 2024-04-20T12:25:57.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f075ca81640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07581124b0 con 0x7f0758101090 2024-04-20T12:25:57.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f0755d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0758106160 0x7f075819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f0755d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0758106160 0x7f075819e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43922/0 (socket says 172.21.15.135:43922) 2024-04-20T12:25:57.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f0755d9b640 1 -- 172.21.15.135:0/1874710302 learned_addr learned my addr 172.21.15.135:0/1874710302 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:57.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f0756d9d640 1 --2- 172.21.15.135:0/1874710302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0758198670 0x7f0758198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f075659c640 1 --2- 172.21.15.135:0/1874710302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0758101090 0x7f075819e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f0755d9b640 1 -- 172.21.15.135:0/1874710302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0758101090 msgr2=0x7f075819e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:57.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f0755d9b640 1 --2- 172.21.15.135:0/1874710302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0758101090 0x7f075819e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f0755d9b640 1 -- 172.21.15.135:0/1874710302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0758198670 msgr2=0x7f0758198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:57.025 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f0755d9b640 1 --2- 172.21.15.135:0/1874710302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0758198670 0x7f0758198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f0755d9b640 1 -- 172.21.15.135:0/1874710302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0758199190 con 0x7f0758106160 2024-04-20T12:25:57.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f0755d9b640 1 --2- 172.21.15.135:0/1874710302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0758106160 0x7f075819e9b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f074800d740 tx=0x7f074800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:57.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f07477fe640 1 -- 172.21.15.135:0/1874710302 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748017070 con 0x7f0758106160 2024-04-20T12:25:57.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f075ca81640 1 -- 172.21.15.135:0/1874710302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0758199480 con 0x7f0758106160 2024-04-20T12:25:57.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f07477fe640 1 -- 172.21.15.135:0/1874710302 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f074800de50 con 0x7f0758106160 2024-04-20T12:25:57.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f07477fe640 1 -- 172.21.15.135:0/1874710302 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748004e00 con 0x7f0758106160 2024-04-20T12:25:57.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.023+0000 7f075ca81640 1 -- 172.21.15.135:0/1874710302 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07581a5680 con 0x7f0758106160 2024-04-20T12:25:57.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.026+0000 7f07477fe640 1 -- 172.21.15.135:0/1874710302 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f0748004fa0 con 0x7f0758106160 2024-04-20T12:25:57.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.026+0000 7f075f677740 1 Processor -- start 2024-04-20T12:25:57.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075f677740 1 -- start start 2024-04-20T12:25:57.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075f677740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa03e10 0x5604afa041f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075f677740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa04730 0x5604afa0cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075f677740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa0d310 0x5604afa0f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075f677740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5604af969110 con 0x5604afa04730 2024-04-20T12:25:57.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075f677740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5604af906550 con 0x5604afa03e10 2024-04-20T12:25:57.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075f677740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5604af9650d0 con 0x5604afa0d310 2024-04-20T12:25:57.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa04730 0x5604afa0cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa04730 0x5604afa0cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43938/0 (socket says 172.21.15.135:43938) 2024-04-20T12:25:57.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075659c640 1 -- 172.21.15.135:0/906710529 learned_addr learned my addr 172.21.15.135:0/906710529 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:57.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f07477fe640 1 --2- 172.21.15.135:0/1874710302 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f07400a3d20 0x7f07400a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f0756d9d640 1 --2- 172.21.15.135:0/906710529 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa03e10 0x5604afa041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f0756d9d640 1 --2- 172.21.15.135:0/1874710302 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f07400a3d20 0x7f07400a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075659c640 1 -- 172.21.15.135:0/906710529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa0d310 msgr2=0x5604afa0f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:57.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075659c640 1 --2- 172.21.15.135:0/906710529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa0d310 0x5604afa0f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075659c640 1 -- 172.21.15.135:0/906710529 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa03e10 msgr2=0x5604afa041f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:57.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075659c640 1 --2- 172.21.15.135:0/906710529 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa03e10 0x5604afa041f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075659c640 1 -- 172.21.15.135:0/906710529 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604af92e900 con 0x5604afa04730 2024-04-20T12:25:57.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f07477fe640 1 -- 172.21.15.135:0/1874710302 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f07480d0540 con 0x7f0758106160 2024-04-20T12:25:57.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.027+0000 7f075659c640 1 --2- 172.21.15.135:0/906710529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa04730 0x5604afa0cdd0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f074c006010 tx=0x7f074c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4545a2a0a88f86d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:57.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.028+0000 7f0744ff9640 1 -- 172.21.15.135:0/906710529 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c02ca80 con 0x5604afa04730 2024-04-20T12:25:57.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.028+0000 7f0756d9d640 1 --2- 172.21.15.135:0/1874710302 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f07400a3d20 0x7f07400a61e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0750005fd0 tx=0x7f0750009600 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:57.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.028+0000 7f0744ff9640 1 -- 172.21.15.135:0/906710529 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f074c02cc20 con 0x5604afa04730 2024-04-20T12:25:57.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.028+0000 7f0744ff9640 1 -- 172.21.15.135:0/906710529 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c004920 con 0x5604afa04730 2024-04-20T12:25:57.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.028+0000 7f075f677740 1 -- 172.21.15.135:0/906710529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa04730 msgr2=0x5604afa0cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:57.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.028+0000 7f075f677740 1 --2- 172.21.15.135:0/906710529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa04730 0x5604afa0cdd0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f074c006010 tx=0x7f074c005e80 comp rx=0 tx=0).stop 2024-04-20T12:25:57.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.028+0000 7f075f677740 1 -- 172.21.15.135:0/906710529 shutdown_connections 2024-04-20T12:25:57.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.028+0000 7f075f677740 1 --2- 172.21.15.135:0/906710529 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa0d310 0x5604afa0f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.028+0000 7f075f677740 1 --2- 172.21.15.135:0/906710529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa04730 0x5604afa0cdd0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.028+0000 7f075f677740 1 --2- 172.21.15.135:0/906710529 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa03e10 0x5604afa041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.028+0000 7f075f677740 1 -- 172.21.15.135:0/906710529 >> 172.21.15.135:0/906710529 conn(0x5604af9fe540 msgr2=0x5604af9fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:57.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.028+0000 7f075f677740 1 -- 172.21.15.135:0/906710529 shutdown_connections 2024-04-20T12:25:57.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.028+0000 7f075f677740 1 -- 172.21.15.135:0/906710529 wait complete. 2024-04-20T12:25:57.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f075f677740 1 -- start start 2024-04-20T12:25:57.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f075f677740 1 Processor -- start 2024-04-20T12:25:57.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f075f677740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa03e10 0x5604afa17590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f075f677740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa04730 0x5604afa17ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f075f677740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa0d310 0x5604afa119a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f075f677740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5604afa10040 con 0x5604afa0d310 2024-04-20T12:25:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f075f677740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5604af922500 con 0x5604afa04730 2024-04-20T12:25:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f075f677740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5604afa101c0 con 0x5604afa03e10 2024-04-20T12:25:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f075f677740 10 client.0 _ll_register_callbacks cb 0x5604af9072f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f0756d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa0d310 0x5604afa119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f0756d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa0d310 0x5604afa119a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43946/0 (socket says 172.21.15.135:43946) 2024-04-20T12:25:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f0756d9d640 1 -- 172.21.15.135:0/1866253670 learned_addr learned my addr 172.21.15.135:0/1866253670 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f075659c640 1 --2- 172.21.15.135:0/1866253670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa03e10 0x5604afa17590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f0755d9b640 1 --2- 172.21.15.135:0/1866253670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa04730 0x5604afa17ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f0756d9d640 1 -- 172.21.15.135:0/1866253670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa03e10 msgr2=0x5604afa17590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f0756d9d640 1 --2- 172.21.15.135:0/1866253670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa03e10 0x5604afa17590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f0756d9d640 1 -- 172.21.15.135:0/1866253670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa04730 msgr2=0x5604afa17ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f0756d9d640 1 --2- 172.21.15.135:0/1866253670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa04730 0x5604afa17ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f0756d9d640 1 -- 172.21.15.135:0/1866253670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604af67b3f0 con 0x5604afa0d310 2024-04-20T12:25:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.029+0000 7f0755d9b640 1 --2- 172.21.15.135:0/1866253670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa04730 0x5604afa17ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:57.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f0756d9d640 1 --2- 172.21.15.135:0/1866253670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa0d310 0x5604afa119a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f07500109b0 tx=0x7f0750004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41835c5b2a277 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f073dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f073dffb640 1 -- 172.21.15.135:0/1866253670 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0750024070 con 0x5604afa0d310 2024-04-20T12:25:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f073dffb640 1 -- 172.21.15.135:0/1866253670 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f075000ccf0 con 0x5604afa0d310 2024-04-20T12:25:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f075f677740 1 -- 172.21.15.135:0/1866253670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f074c02cc20 con 0x5604afa0d310 2024-04-20T12:25:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f073dffb640 1 -- 172.21.15.135:0/1866253670 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0750032050 con 0x5604afa0d310 2024-04-20T12:25:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f075f677740 10 client.16665 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f075f677740 1 -- 172.21.15.135:0/1866253670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5604af7457d0 con 0x5604afa0d310 2024-04-20T12:25:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f073dffb640 1 -- 172.21.15.135:0/1866253670 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f074c02cc20 con 0x5604afa0d310 2024-04-20T12:25:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f073dffb640 1 -- 172.21.15.135:0/1866253670 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f075000f040 con 0x5604afa0d310 2024-04-20T12:25:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f075f677740 10 client.16665 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f075f677740 10 client.16665 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f075f677740 20 client.16665 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f075f677740 1 --2- 172.21.15.135:0/1866253670 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5604afa21bb0 0x5604afa23fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f075f677740 4 client.16665 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:57.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.030+0000 7f075f677740 1 -- 172.21.15.135:0/1866253670 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604af976b30 con 0x5604afa21bb0 2024-04-20T12:25:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.031+0000 7f075659c640 1 --2- 172.21.15.135:0/1866253670 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5604afa21bb0 0x5604afa23fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.031+0000 7f073dffb640 10 client.16665 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.031+0000 7f075659c640 1 --2- 172.21.15.135:0/1866253670 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5604afa21bb0 0x5604afa23fe0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e020f8c6a8d934ea server_cookie=414116682b48fb98 in_seq=0 out_seq=0 2024-04-20T12:25:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.032+0000 7f073dffb640 1 -- 172.21.15.135:0/1866253670 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5604af976b30 con 0x5604afa21bb0 2024-04-20T12:25:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.032+0000 7f073dffb640 10 client.16665 handle_command_reply: tid=0 2024-04-20T12:25:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.032+0000 7f075f677740 1 client.16665 shutdown 2024-04-20T12:25:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.032+0000 7f075f677740 1 -- 172.21.15.135:0/1866253670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa0d310 msgr2=0x5604afa119a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.032+0000 7f075f677740 1 --2- 172.21.15.135:0/1866253670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa0d310 0x5604afa119a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f07500109b0 tx=0x7f0750004a40 comp rx=0 tx=0).stop 2024-04-20T12:25:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.032+0000 7f075f677740 1 -- 172.21.15.135:0/1866253670 shutdown_connections 2024-04-20T12:25:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.032+0000 7f075f677740 1 --2- 172.21.15.135:0/1866253670 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5604afa21bb0 0x5604afa23fe0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.032+0000 7f075f677740 1 --2- 172.21.15.135:0/1866253670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa0d310 0x5604afa119a0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.032+0000 7f075f677740 1 --2- 172.21.15.135:0/1866253670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa04730 0x5604afa17ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.032+0000 7f075f677740 1 --2- 172.21.15.135:0/1866253670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa03e10 0x5604afa17590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.032+0000 7f073dffb640 0 client.16665 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:57.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.032+0000 7f075f677740 1 -- 172.21.15.135:0/1866253670 >> 172.21.15.135:0/1866253670 conn(0x5604af9fe540 msgr2=0x5604afa00290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:57.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.032+0000 7f075f677740 1 -- 172.21.15.135:0/1866253670 shutdown_connections 2024-04-20T12:25:57.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.032+0000 7f075f677740 1 -- 172.21.15.135:0/1866253670 wait complete. 2024-04-20T12:25:57.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.032+0000 7f075f677740 20 client.16665 trim_cache size 0 max 16384 2024-04-20T12:25:57.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.045+0000 7f075f677740 1 Processor -- start 2024-04-20T12:25:57.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.045+0000 7f075f677740 1 -- start start 2024-04-20T12:25:57.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.045+0000 7f075f677740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa03e10 0x5604afa10cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.045+0000 7f075f677740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa04730 0x5604afa11940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.045+0000 7f075f677740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa0d310 0x5604afa298b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.051 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.045+0000 7f075f677740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07581ad1a0 con 0x5604afa03e10 2024-04-20T12:25:57.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.045+0000 7f075f677740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f07581aece0 con 0x5604afa0d310 2024-04-20T12:25:57.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.045+0000 7f075f677740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07581ad870 con 0x5604afa04730 2024-04-20T12:25:57.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.046+0000 7f075659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa03e10 0x5604afa10cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.046+0000 7f075659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa03e10 0x5604afa10cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43958/0 (socket says 172.21.15.135:43958) 2024-04-20T12:25:57.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.046+0000 7f075659c640 1 -- 172.21.15.135:0/754190352 learned_addr learned my addr 172.21.15.135:0/754190352 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:57.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.046+0000 7f0755d9b640 1 --2- 172.21.15.135:0/754190352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa04730 0x5604afa11940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.046+0000 7f075659c640 1 -- 172.21.15.135:0/754190352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa04730 msgr2=0x5604afa11940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:57.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.046+0000 7f075659c640 1 --2- 172.21.15.135:0/754190352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa04730 0x5604afa11940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.046+0000 7f075659c640 1 -- 172.21.15.135:0/754190352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa0d310 msgr2=0x5604afa298b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:57.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.046+0000 7f075659c640 1 --2- 172.21.15.135:0/754190352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa0d310 0x5604afa298b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.046+0000 7f075659c640 1 -- 172.21.15.135:0/754190352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604afa20750 con 0x5604afa03e10 2024-04-20T12:25:57.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.046+0000 7f075659c640 1 --2- 172.21.15.135:0/754190352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa03e10 0x5604afa10cc0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f074c005940 tx=0x7f074c02e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37b4e689ac77cb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:57.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.046+0000 7f073ffff640 1 -- 172.21.15.135:0/754190352 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c04d070 con 0x5604afa03e10 2024-04-20T12:25:57.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.046+0000 7f073ffff640 1 -- 172.21.15.135:0/754190352 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f074c005040 con 0x5604afa03e10 2024-04-20T12:25:57.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.046+0000 7f073ffff640 1 -- 172.21.15.135:0/754190352 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c04e4c0 con 0x5604afa03e10 2024-04-20T12:25:57.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 -- 172.21.15.135:0/754190352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa03e10 msgr2=0x5604afa10cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:57.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 --2- 172.21.15.135:0/754190352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa03e10 0x5604afa10cc0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f074c005940 tx=0x7f074c02e040 comp rx=0 tx=0).stop 2024-04-20T12:25:57.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 -- 172.21.15.135:0/754190352 shutdown_connections 2024-04-20T12:25:57.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 --2- 172.21.15.135:0/754190352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa0d310 0x5604afa298b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 --2- 172.21.15.135:0/754190352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa04730 0x5604afa11940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 --2- 172.21.15.135:0/754190352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa03e10 0x5604afa10cc0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 -- 172.21.15.135:0/754190352 >> 172.21.15.135:0/754190352 conn(0x5604af9fe540 msgr2=0x5604afa11230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:57.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 -- 172.21.15.135:0/754190352 shutdown_connections 2024-04-20T12:25:57.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 -- 172.21.15.135:0/754190352 wait complete. 2024-04-20T12:25:57.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 -- start start 2024-04-20T12:25:57.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 Processor -- start 2024-04-20T12:25:57.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa03e10 0x5604afa1d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa04730 0x5604afa1de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa0d310 0x5604afa1ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f07581ae610 con 0x5604afa03e10 2024-04-20T12:25:57.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f07581adf40 con 0x5604afa0d310 2024-04-20T12:25:57.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f07581ab170 con 0x5604afa04730 2024-04-20T12:25:57.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075f677740 10 client.0 _ll_register_callbacks cb 0x7f0750009b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:57.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa03e10 0x5604afa1d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa03e10 0x5604afa1d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43968/0 (socket says 172.21.15.135:43968) 2024-04-20T12:25:57.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f075659c640 1 -- 172.21.15.135:0/876462991 learned_addr learned my addr 172.21.15.135:0/876462991 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:57.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f0755d9b640 1 --2- 172.21.15.135:0/876462991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa04730 0x5604afa1de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.047+0000 7f0756d9d640 1 --2- 172.21.15.135:0/876462991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa0d310 0x5604afa1ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f075659c640 1 -- 172.21.15.135:0/876462991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa04730 msgr2=0x5604afa1de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:57.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f075659c640 1 --2- 172.21.15.135:0/876462991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa04730 0x5604afa1de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f075659c640 1 -- 172.21.15.135:0/876462991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa0d310 msgr2=0x5604afa1ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:57.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f075659c640 1 --2- 172.21.15.135:0/876462991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa0d310 0x5604afa1ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f075659c640 1 -- 172.21.15.135:0/876462991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604afa0f700 con 0x5604afa03e10 2024-04-20T12:25:57.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f075659c640 1 --2- 172.21.15.135:0/876462991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa03e10 0x5604afa1d920 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f074c000c00 tx=0x7f074c005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e70375838cc68a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:57.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f073dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:57.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f073dffb640 1 -- 172.21.15.135:0/876462991 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c04d040 con 0x5604afa03e10 2024-04-20T12:25:57.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f073dffb640 1 -- 172.21.15.135:0/876462991 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f074c0053f0 con 0x5604afa03e10 2024-04-20T12:25:57.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f075f677740 1 -- 172.21.15.135:0/876462991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f074c005040 con 0x5604afa03e10 2024-04-20T12:25:57.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f073dffb640 1 -- 172.21.15.135:0/876462991 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f074c004030 con 0x5604afa03e10 2024-04-20T12:25:57.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f075f677740 10 client.16671 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:57.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f075f677740 1 -- 172.21.15.135:0/876462991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5604afa87bd0 con 0x5604afa03e10 2024-04-20T12:25:57.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f073dffb640 1 -- 172.21.15.135:0/876462991 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f074c005040 con 0x5604afa03e10 2024-04-20T12:25:57.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f073dffb640 1 -- 172.21.15.135:0/876462991 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f074c0035f0 con 0x5604afa03e10 2024-04-20T12:25:57.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f075f677740 10 client.16671 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:57.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f075f677740 10 client.16671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:57.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f075f677740 20 client.16671 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:57.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f075f677740 1 --2- 172.21.15.135:0/876462991 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5604afa87ea0 0x5604afa8a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:57.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f075f677740 4 client.16671 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:25:57.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.048+0000 7f075f677740 1 -- 172.21.15.135:0/876462991 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5604af9709a0 con 0x5604afa87ea0 2024-04-20T12:25:57.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.049+0000 7f0755d9b640 1 --2- 172.21.15.135:0/876462991 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5604afa87ea0 0x5604afa8a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:57.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.049+0000 7f073dffb640 10 client.16671 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:57.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.049+0000 7f0755d9b640 1 --2- 172.21.15.135:0/876462991 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5604afa87ea0 0x5604afa8a290 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b0d19c005f8157e server_cookie=424fabd3eff63040 in_seq=0 out_seq=0 2024-04-20T12:25:57.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.049+0000 7f073dffb640 1 -- 172.21.15.135:0/876462991 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5604af9709a0 con 0x5604afa87ea0 2024-04-20T12:25:57.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.049+0000 7f073dffb640 10 client.16671 handle_command_reply: tid=0 2024-04-20T12:25:57.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.049+0000 7f075f677740 1 client.16671 shutdown 2024-04-20T12:25:57.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075f677740 1 -- 172.21.15.135:0/876462991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa03e10 msgr2=0x5604afa1d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:57.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075f677740 1 --2- 172.21.15.135:0/876462991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa03e10 0x5604afa1d920 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f074c000c00 tx=0x7f074c005be0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075f677740 1 -- 172.21.15.135:0/876462991 shutdown_connections 2024-04-20T12:25:57.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075f677740 1 --2- 172.21.15.135:0/876462991 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5604afa87ea0 0x5604afa8a290 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075f677740 1 --2- 172.21.15.135:0/876462991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5604afa0d310 0x5604afa1ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075f677740 1 --2- 172.21.15.135:0/876462991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5604afa04730 0x5604afa1de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f073dffb640 0 client.16671 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:57.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075f677740 1 --2- 172.21.15.135:0/876462991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604afa03e10 0x5604afa1d920 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075f677740 1 -- 172.21.15.135:0/876462991 >> 172.21.15.135:0/876462991 conn(0x5604af9fe540 msgr2=0x5604af9fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:57.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075f677740 1 -- 172.21.15.135:0/876462991 shutdown_connections 2024-04-20T12:25:57.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075f677740 1 -- 172.21.15.135:0/876462991 wait complete. 2024-04-20T12:25:57.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075f677740 20 client.16671 trim_cache size 0 max 16384 2024-04-20T12:25:57.057 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:25:57.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075ca81640 1 -- 172.21.15.135:0/1874710302 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f07400a3d20 msgr2=0x7f07400a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:57.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075ca81640 1 --2- 172.21.15.135:0/1874710302 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f07400a3d20 0x7f07400a61e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0750005fd0 tx=0x7f0750009600 comp rx=0 tx=0).stop 2024-04-20T12:25:57.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075ca81640 1 -- 172.21.15.135:0/1874710302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0758106160 msgr2=0x7f075819e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:57.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075ca81640 1 --2- 172.21.15.135:0/1874710302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0758106160 0x7f075819e9b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f074800d740 tx=0x7f074800dc00 comp rx=0 tx=0).stop 2024-04-20T12:25:57.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075ca81640 1 -- 172.21.15.135:0/1874710302 shutdown_connections 2024-04-20T12:25:57.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075ca81640 1 --2- 172.21.15.135:0/1874710302 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0758198670 0x7f0758198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075ca81640 1 --2- 172.21.15.135:0/1874710302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0758106160 0x7f075819e9b0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075ca81640 1 --2- 172.21.15.135:0/1874710302 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f07400a3d20 0x7f07400a61e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075ca81640 1 --2- 172.21.15.135:0/1874710302 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0758101090 0x7f075819e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:57.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075ca81640 1 -- 172.21.15.135:0/1874710302 >> 172.21.15.135:0/1874710302 conn(0x7f0758078010 msgr2=0x7f07580fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:57.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075ca81640 1 -- 172.21.15.135:0/1874710302 shutdown_connections 2024-04-20T12:25:57.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:57.050+0000 7f075ca81640 1 -- 172.21.15.135:0/1874710302 wait complete. 2024-04-20T12:25:57.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:56 smithi139 ceph-mon[21834]: pgmap v87: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:57.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:56 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3465831583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:25:58.062 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:25:58.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:25:58.062 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:25:58.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.179+0000 7f7d13011640 1 -- 172.21.15.135:0/2545336900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c1031e0 msgr2=0x7f7d0c1035c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.179+0000 7f7d13011640 1 --2- 172.21.15.135:0/2545336900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c1031e0 0x7f7d0c1035c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009900 tx=0x7f7d0002bd60 comp rx=0 tx=0).stop 2024-04-20T12:25:58.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.179+0000 7f7d13011640 1 -- 172.21.15.135:0/2545336900 shutdown_connections 2024-04-20T12:25:58.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.179+0000 7f7d13011640 1 --2- 172.21.15.135:0/2545336900 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d0c10c520 0x7f7d0c10e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.179+0000 7f7d13011640 1 --2- 172.21.15.135:0/2545336900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d0c103b00 0x7f7d0c10bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.179+0000 7f7d13011640 1 --2- 172.21.15.135:0/2545336900 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c1031e0 0x7f7d0c1035c0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.179+0000 7f7d13011640 1 -- 172.21.15.135:0/2545336900 >> 172.21.15.135:0/2545336900 conn(0x7f7d0c077f60 msgr2=0x7f7d0c078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.179+0000 7f7d13011640 1 -- 172.21.15.135:0/2545336900 shutdown_connections 2024-04-20T12:25:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.179+0000 7f7d13011640 1 -- 172.21.15.135:0/2545336900 wait complete. 2024-04-20T12:25:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d13011640 1 Processor -- start 2024-04-20T12:25:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d13011640 1 -- start start 2024-04-20T12:25:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d13011640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d0c1031e0 0x7f7d0c19e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d13011640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c103b00 0x7f7d0c19eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d13011640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d0c10c520 0x7f7d0c198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d13011640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c112350 con 0x7f7d0c103b00 2024-04-20T12:25:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d13011640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c1121d0 con 0x7f7d0c1031e0 2024-04-20T12:25:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d13011640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c1124d0 con 0x7f7d0c10c520 2024-04-20T12:25:58.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d0bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c103b00 0x7f7d0c19eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d0bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c103b00 0x7f7d0c19eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43978/0 (socket says 172.21.15.135:43978) 2024-04-20T12:25:58.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d0bfff640 1 -- 172.21.15.135:0/1902187635 learned_addr learned my addr 172.21.15.135:0/1902187635 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:58.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d10dad640 1 --2- 172.21.15.135:0/1902187635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d0c1031e0 0x7f7d0c19e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d115ae640 1 --2- 172.21.15.135:0/1902187635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d0c10c520 0x7f7d0c198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d0bfff640 1 -- 172.21.15.135:0/1902187635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d0c10c520 msgr2=0x7f7d0c198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d0bfff640 1 --2- 172.21.15.135:0/1902187635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d0c10c520 0x7f7d0c198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d0bfff640 1 -- 172.21.15.135:0/1902187635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d0c1031e0 msgr2=0x7f7d0c19e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d0bfff640 1 --2- 172.21.15.135:0/1902187635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d0c1031e0 0x7f7d0c19e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d0bfff640 1 -- 172.21.15.135:0/1902187635 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0c198f30 con 0x7f7d0c103b00 2024-04-20T12:25:58.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.180+0000 7f7d115ae640 1 --2- 172.21.15.135:0/1902187635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d0c10c520 0x7f7d0c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:58.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.181+0000 7f7d0bfff640 1 --2- 172.21.15.135:0/1902187635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c103b00 0x7f7d0c19eaf0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800d770 tx=0x7f7cf800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:58.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.181+0000 7f7d09ffb640 1 -- 172.21.15.135:0/1902187635 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8017070 con 0x7f7d0c103b00 2024-04-20T12:25:58.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.181+0000 7f7d09ffb640 1 -- 172.21.15.135:0/1902187635 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cf8005500 con 0x7f7d0c103b00 2024-04-20T12:25:58.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.181+0000 7f7d13011640 1 -- 172.21.15.135:0/1902187635 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d0c199220 con 0x7f7d0c103b00 2024-04-20T12:25:58.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.181+0000 7f7d09ffb640 1 -- 172.21.15.135:0/1902187635 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8004e00 con 0x7f7d0c103b00 2024-04-20T12:25:58.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.181+0000 7f7d13011640 1 -- 172.21.15.135:0/1902187635 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d0c1a5530 con 0x7f7d0c103b00 2024-04-20T12:25:58.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.183+0000 7f7d09ffb640 1 -- 172.21.15.135:0/1902187635 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f7cf8004fa0 con 0x7f7d0c103b00 2024-04-20T12:25:58.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d15c03740 1 Processor -- start 2024-04-20T12:25:58.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d15c03740 1 -- start start 2024-04-20T12:25:58.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d09ffb640 1 --2- 172.21.15.135:0/1902187635 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7cfc0a3d20 0x7f7cfc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d15c03740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db2fe0 0x55c807db33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d15c03740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807db3900 0x55c807dbbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d15c03740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807dbc4e0 0x55c807dbe8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d15c03740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c807d17f00 con 0x55c807dbc4e0 2024-04-20T12:25:58.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d15c03740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c807cb5530 con 0x55c807db3900 2024-04-20T12:25:58.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d15c03740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c807d13ec0 con 0x55c807db2fe0 2024-04-20T12:25:58.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d09ffb640 1 -- 172.21.15.135:0/1902187635 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f7cf80d0600 con 0x7f7d0c103b00 2024-04-20T12:25:58.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d115ae640 1 --2- 172.21.15.135:0/1902187635 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7cfc0a3d20 0x7f7cfc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d115ae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807dbc4e0 0x55c807dbe8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d115ae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807dbc4e0 0x55c807dbe8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43982/0 (socket says 172.21.15.135:43982) 2024-04-20T12:25:58.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d115ae640 1 -- 172.21.15.135:0/2749041930 learned_addr learned my addr 172.21.15.135:0/2749041930 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:58.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d0bfff640 1 --2- 172.21.15.135:0/2749041930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807db3900 0x55c807dbbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d10dad640 1 --2- 172.21.15.135:0/2749041930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db2fe0 0x55c807db33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d115ae640 1 -- 172.21.15.135:0/2749041930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db2fe0 msgr2=0x55c807db33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d115ae640 1 --2- 172.21.15.135:0/2749041930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db2fe0 0x55c807db33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d115ae640 1 -- 172.21.15.135:0/2749041930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807db3900 msgr2=0x55c807dbbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d115ae640 1 --2- 172.21.15.135:0/2749041930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807db3900 0x55c807dbbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d115ae640 1 -- 172.21.15.135:0/2749041930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c807af27e0 con 0x55c807dbc4e0 2024-04-20T12:25:58.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.184+0000 7f7d0bfff640 1 --2- 172.21.15.135:0/2749041930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807db3900 0x55c807dbbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:25:58.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.185+0000 7f7d115ae640 1 --2- 172.21.15.135:0/1902187635 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7cfc0a3d20 0x7f7cfc0a61e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009950 tx=0x7f7d04009e40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:58.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.185+0000 7f7d115ae640 1 --2- 172.21.15.135:0/2749041930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807dbc4e0 0x55c807dbe8d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7d04010c30 tx=0x7f7d0401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa88fbcfe476f63e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:58.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.185+0000 7f7cf6ffd640 1 -- 172.21.15.135:0/2749041930 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04024070 con 0x55c807dbc4e0 2024-04-20T12:25:58.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.185+0000 7f7cf6ffd640 1 -- 172.21.15.135:0/2749041930 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d0401fc00 con 0x55c807dbc4e0 2024-04-20T12:25:58.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.185+0000 7f7cf6ffd640 1 -- 172.21.15.135:0/2749041930 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0401e3f0 con 0x55c807dbc4e0 2024-04-20T12:25:58.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.185+0000 7f7d15c03740 1 -- 172.21.15.135:0/2749041930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807dbc4e0 msgr2=0x55c807dbe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.185+0000 7f7d15c03740 1 --2- 172.21.15.135:0/2749041930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807dbc4e0 0x55c807dbe8d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f7d04010c30 tx=0x7f7d0401c000 comp rx=0 tx=0).stop 2024-04-20T12:25:58.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 1 -- 172.21.15.135:0/2749041930 shutdown_connections 2024-04-20T12:25:58.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 1 --2- 172.21.15.135:0/2749041930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807dbc4e0 0x55c807dbe8d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 1 --2- 172.21.15.135:0/2749041930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807db3900 0x55c807dbbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 1 --2- 172.21.15.135:0/2749041930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db2fe0 0x55c807db33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 1 -- 172.21.15.135:0/2749041930 >> 172.21.15.135:0/2749041930 conn(0x55c807dad710 msgr2=0x55c807dadaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:58.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 1 -- 172.21.15.135:0/2749041930 shutdown_connections 2024-04-20T12:25:58.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 1 -- 172.21.15.135:0/2749041930 wait complete. 2024-04-20T12:25:58.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 1 -- start start 2024-04-20T12:25:58.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 1 Processor -- start 2024-04-20T12:25:58.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db2fe0 0x55c807dbbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807db3900 0x55c807db9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807dbc4e0 0x55c807db9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c807dbf270 con 0x55c807db3900 2024-04-20T12:25:58.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c807ca0480 con 0x55c807dbc4e0 2024-04-20T12:25:58.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c807dbf3f0 con 0x55c807db2fe0 2024-04-20T12:25:58.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d15c03740 10 client.0 _ll_register_callbacks cb 0x55c807c9fe70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:58.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.186+0000 7f7d0bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807db3900 0x55c807db9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7d0bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807db3900 0x55c807db9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:43998/0 (socket says 172.21.15.135:43998) 2024-04-20T12:25:58.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7d0bfff640 1 -- 172.21.15.135:0/4104326910 learned_addr learned my addr 172.21.15.135:0/4104326910 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:58.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7d115ae640 1 --2- 172.21.15.135:0/4104326910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807dbc4e0 0x55c807db9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7d10dad640 1 --2- 172.21.15.135:0/4104326910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db2fe0 0x55c807dbbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7d0bfff640 1 -- 172.21.15.135:0/4104326910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db2fe0 msgr2=0x55c807dbbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7d0bfff640 1 --2- 172.21.15.135:0/4104326910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db2fe0 0x55c807dbbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7d0bfff640 1 -- 172.21.15.135:0/4104326910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807dbc4e0 msgr2=0x55c807db9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7d0bfff640 1 --2- 172.21.15.135:0/4104326910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807dbc4e0 0x55c807db9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7d0bfff640 1 -- 172.21.15.135:0/4104326910 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c807b52f70 con 0x55c807db3900 2024-04-20T12:25:58.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7d0bfff640 1 --2- 172.21.15.135:0/4104326910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807db3900 0x55c807db9230 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8098bf0 tx=0x7f7cf809c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931dca344517b320 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:58.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7cebfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:58.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7cebfff640 1 -- 172.21.15.135:0/4104326910 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf801e7b0 con 0x55c807db3900 2024-04-20T12:25:58.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7cebfff640 1 -- 172.21.15.135:0/4104326910 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f7cf8009cc0 con 0x55c807db3900 2024-04-20T12:25:58.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7d15c03740 1 -- 172.21.15.135:0/4104326910 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d0401fc00 con 0x55c807db3900 2024-04-20T12:25:58.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7cebfff640 1 -- 172.21.15.135:0/4104326910 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7cf801e9f0 con 0x55c807db3900 2024-04-20T12:25:58.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7d15c03740 10 client.16683 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7d15c03740 1 -- 172.21.15.135:0/4104326910 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c8079ea170 con 0x55c807db3900 2024-04-20T12:25:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.187+0000 7f7cebfff640 1 -- 172.21.15.135:0/4104326910 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d0401fc00 con 0x55c807db3900 2024-04-20T12:25:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.188+0000 7f7cebfff640 1 -- 172.21.15.135:0/4104326910 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f7cf8098890 con 0x55c807db3900 2024-04-20T12:25:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.188+0000 7f7d15c03740 10 client.16683 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.188+0000 7f7d15c03740 10 client.16683 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.188+0000 7f7d15c03740 20 client.16683 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.188+0000 7f7d15c03740 1 --2- 172.21.15.135:0/4104326910 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c807dcc510 0x55c807dce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.188+0000 7f7d15c03740 4 client.16683 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.188+0000 7f7d15c03740 1 -- 172.21.15.135:0/4104326910 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c807d25920 con 0x55c807dcc510 2024-04-20T12:25:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.188+0000 7f7d10dad640 1 --2- 172.21.15.135:0/4104326910 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c807dcc510 0x55c807dce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.188+0000 7f7d10dad640 1 --2- 172.21.15.135:0/4104326910 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c807dcc510 0x55c807dce920 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5171b0acb878b30 server_cookie=5d7c75c2b63e39dc in_seq=0 out_seq=0 2024-04-20T12:25:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.188+0000 7f7cebfff640 10 client.16683 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.189+0000 7f7cebfff640 1 -- 172.21.15.135:0/4104326910 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c807d25920 con 0x55c807dcc510 2024-04-20T12:25:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.189+0000 7f7cebfff640 10 client.16683 handle_command_reply: tid=0 2024-04-20T12:25:58.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.189+0000 7f7d15c03740 1 client.16683 shutdown 2024-04-20T12:25:58.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.189+0000 7f7d15c03740 1 -- 172.21.15.135:0/4104326910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807db3900 msgr2=0x55c807db9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.189+0000 7f7d15c03740 1 --2- 172.21.15.135:0/4104326910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807db3900 0x55c807db9230 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8098bf0 tx=0x7f7cf809c100 comp rx=0 tx=0).stop 2024-04-20T12:25:58.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.189+0000 7f7d15c03740 1 -- 172.21.15.135:0/4104326910 shutdown_connections 2024-04-20T12:25:58.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.189+0000 7f7d15c03740 1 --2- 172.21.15.135:0/4104326910 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c807dcc510 0x55c807dce920 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.189+0000 7f7d15c03740 1 --2- 172.21.15.135:0/4104326910 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807dbc4e0 0x55c807db9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.189+0000 7f7d15c03740 1 --2- 172.21.15.135:0/4104326910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807db3900 0x55c807db9230 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.189+0000 7f7cebfff640 0 client.16683 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:58.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.189+0000 7f7d15c03740 1 --2- 172.21.15.135:0/4104326910 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db2fe0 0x55c807dbbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.189+0000 7f7d15c03740 1 -- 172.21.15.135:0/4104326910 >> 172.21.15.135:0/4104326910 conn(0x55c807dad710 msgr2=0x55c807daf460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:58.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.189+0000 7f7d15c03740 1 -- 172.21.15.135:0/4104326910 shutdown_connections 2024-04-20T12:25:58.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.189+0000 7f7d15c03740 1 -- 172.21.15.135:0/4104326910 wait complete. 2024-04-20T12:25:58.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.189+0000 7f7d15c03740 20 client.16683 trim_cache size 0 max 16384 2024-04-20T12:25:58.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d15c03740 1 Processor -- start 2024-04-20T12:25:58.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d15c03740 1 -- start start 2024-04-20T12:25:58.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d15c03740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db2fe0 0x55c807daf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d15c03740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807db3900 0x55c807dbb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d15c03740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807dbc4e0 0x55c807dbbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d15c03740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c1af390 con 0x55c807dbc4e0 2024-04-20T12:25:58.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d15c03740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c1b0ed0 con 0x55c807db3900 2024-04-20T12:25:58.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d15c03740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c1afa60 con 0x55c807db2fe0 2024-04-20T12:25:58.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d115ae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807dbc4e0 0x55c807dbbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d115ae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807dbc4e0 0x55c807dbbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44008/0 (socket says 172.21.15.135:44008) 2024-04-20T12:25:58.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d115ae640 1 -- 172.21.15.135:0/1911722831 learned_addr learned my addr 172.21.15.135:0/1911722831 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:58.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d0bfff640 1 --2- 172.21.15.135:0/1911722831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807db3900 0x55c807dbb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d115ae640 1 -- 172.21.15.135:0/1911722831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db2fe0 msgr2=0x55c807daf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d115ae640 1 --2- 172.21.15.135:0/1911722831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db2fe0 0x55c807daf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d115ae640 1 -- 172.21.15.135:0/1911722831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807db3900 msgr2=0x55c807dbb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d115ae640 1 --2- 172.21.15.135:0/1911722831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807db3900 0x55c807dbb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d115ae640 1 -- 172.21.15.135:0/1911722831 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c807db4e30 con 0x55c807dbc4e0 2024-04-20T12:25:58.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.207+0000 7f7d115ae640 1 --2- 172.21.15.135:0/1911722831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807dbc4e0 0x55c807dbbea0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7d04020b10 tx=0x7f7d04012570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d079f119a9a32434 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:58.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.208+0000 7f7cf67fc640 1 -- 172.21.15.135:0/1911722831 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04024040 con 0x55c807dbc4e0 2024-04-20T12:25:58.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.208+0000 7f7cf67fc640 1 -- 172.21.15.135:0/1911722831 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d0402d070 con 0x55c807dbc4e0 2024-04-20T12:25:58.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.208+0000 7f7cf67fc640 1 -- 172.21.15.135:0/1911722831 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04020e10 con 0x55c807dbc4e0 2024-04-20T12:25:58.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.208+0000 7f7d15c03740 1 -- 172.21.15.135:0/1911722831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807dbc4e0 msgr2=0x55c807dbbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.208+0000 7f7d15c03740 1 --2- 172.21.15.135:0/1911722831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807dbc4e0 0x55c807dbbea0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7d04020b10 tx=0x7f7d04012570 comp rx=0 tx=0).stop 2024-04-20T12:25:58.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.208+0000 7f7d15c03740 1 -- 172.21.15.135:0/1911722831 shutdown_connections 2024-04-20T12:25:58.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.208+0000 7f7d15c03740 1 --2- 172.21.15.135:0/1911722831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807dbc4e0 0x55c807dbbea0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.208+0000 7f7d15c03740 1 --2- 172.21.15.135:0/1911722831 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807db3900 0x55c807dbb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.208+0000 7f7d15c03740 1 --2- 172.21.15.135:0/1911722831 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db2fe0 0x55c807daf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.208+0000 7f7d15c03740 1 -- 172.21.15.135:0/1911722831 >> 172.21.15.135:0/1911722831 conn(0x55c807dad710 msgr2=0x55c807daeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:58.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.208+0000 7f7d15c03740 1 -- 172.21.15.135:0/1911722831 shutdown_connections 2024-04-20T12:25:58.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.208+0000 7f7d15c03740 1 -- 172.21.15.135:0/1911722831 wait complete. 2024-04-20T12:25:58.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.208+0000 7f7d15c03740 1 -- start start 2024-04-20T12:25:58.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d15c03740 1 Processor -- start 2024-04-20T12:25:58.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d15c03740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807db2fe0 0x55c807dc4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d15c03740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db3900 0x55c807dc1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d15c03740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807dbc4e0 0x55c807dc1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d15c03740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c1b0800 con 0x55c807db2fe0 2024-04-20T12:25:58.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d15c03740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c1b0130 con 0x55c807dbc4e0 2024-04-20T12:25:58.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d15c03740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c1ad360 con 0x55c807db3900 2024-04-20T12:25:58.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d15c03740 10 client.0 _ll_register_callbacks cb 0x7f7cf800fe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:58.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d10dad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807db2fe0 0x55c807dc4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d10dad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807db2fe0 0x55c807dc4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44020/0 (socket says 172.21.15.135:44020) 2024-04-20T12:25:58.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d10dad640 1 -- 172.21.15.135:0/759559631 learned_addr learned my addr 172.21.15.135:0/759559631 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:58.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d115ae640 1 --2- 172.21.15.135:0/759559631 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807dbc4e0 0x55c807dc1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d0bfff640 1 --2- 172.21.15.135:0/759559631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db3900 0x55c807dc1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d10dad640 1 -- 172.21.15.135:0/759559631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db3900 msgr2=0x55c807dc1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d10dad640 1 --2- 172.21.15.135:0/759559631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db3900 0x55c807dc1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d10dad640 1 -- 172.21.15.135:0/759559631 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807dbc4e0 msgr2=0x55c807dc1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d10dad640 1 --2- 172.21.15.135:0/759559631 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807dbc4e0 0x55c807dc1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.209+0000 7f7d10dad640 1 -- 172.21.15.135:0/759559631 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c807dc20e0 con 0x55c807db2fe0 2024-04-20T12:25:58.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7d10dad640 1 --2- 172.21.15.135:0/759559631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807db2fe0 0x55c807dc4880 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7d00006010 tx=0x7f7d00004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a15c94910759d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:58.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7cebfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:58.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7cebfff640 1 -- 172.21.15.135:0/759559631 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0004b020 con 0x55c807db2fe0 2024-04-20T12:25:58.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7cebfff640 1 -- 172.21.15.135:0/759559631 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f7d0003a040 con 0x55c807db2fe0 2024-04-20T12:25:58.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7d15c03740 1 -- 172.21.15.135:0/759559631 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d0402d070 con 0x55c807db2fe0 2024-04-20T12:25:58.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7cebfff640 1 -- 172.21.15.135:0/759559631 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7d00056050 con 0x55c807db2fe0 2024-04-20T12:25:58.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7d15c03740 10 client.16689 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:58.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7d15c03740 1 -- 172.21.15.135:0/759559631 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c807e337f0 con 0x55c807db2fe0 2024-04-20T12:25:58.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7cebfff640 1 -- 172.21.15.135:0/759559631 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d0402d070 con 0x55c807db2fe0 2024-04-20T12:25:58.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7cebfff640 1 -- 172.21.15.135:0/759559631 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f7d00047250 con 0x55c807db2fe0 2024-04-20T12:25:58.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7d15c03740 10 client.16689 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:58.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7d15c03740 10 client.16689 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:58.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7d15c03740 20 client.16689 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:58.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7d15c03740 1 --2- 172.21.15.135:0/759559631 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c807e33f70 0x55c807e36390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7d15c03740 4 client.16689 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:25:58.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.210+0000 7f7d15c03740 1 -- 172.21.15.135:0/759559631 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c807d1f790 con 0x55c807e33f70 2024-04-20T12:25:58.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.211+0000 7f7d0bfff640 1 --2- 172.21.15.135:0/759559631 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c807e33f70 0x55c807e36390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.211+0000 7f7d0bfff640 1 --2- 172.21.15.135:0/759559631 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c807e33f70 0x55c807e36390 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b54f7c5e15a0d457 server_cookie=3416ae7e29d9a326 in_seq=0 out_seq=0 2024-04-20T12:25:58.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.211+0000 7f7cebfff640 10 client.16689 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:58.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.212+0000 7f7cebfff640 1 -- 172.21.15.135:0/759559631 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c807d1f790 con 0x55c807e33f70 2024-04-20T12:25:58.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.212+0000 7f7cebfff640 10 client.16689 handle_command_reply: tid=0 2024-04-20T12:25:58.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.212+0000 7f7d15c03740 1 client.16689 shutdown 2024-04-20T12:25:58.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.212+0000 7f7d15c03740 1 -- 172.21.15.135:0/759559631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807db2fe0 msgr2=0x55c807dc4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.212+0000 7f7d15c03740 1 --2- 172.21.15.135:0/759559631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807db2fe0 0x55c807dc4880 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7d00006010 tx=0x7f7d00004430 comp rx=0 tx=0).stop 2024-04-20T12:25:58.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.212+0000 7f7d15c03740 1 -- 172.21.15.135:0/759559631 shutdown_connections 2024-04-20T12:25:58.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.212+0000 7f7d15c03740 1 --2- 172.21.15.135:0/759559631 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c807e33f70 0x55c807e36390 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.212+0000 7f7d15c03740 1 --2- 172.21.15.135:0/759559631 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c807dbc4e0 0x55c807dc1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.212+0000 7f7d15c03740 1 --2- 172.21.15.135:0/759559631 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c807db3900 0x55c807dc1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.212+0000 7f7cebfff640 0 client.16689 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:58.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.212+0000 7f7d15c03740 1 --2- 172.21.15.135:0/759559631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c807db2fe0 0x55c807dc4880 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.212+0000 7f7d15c03740 1 -- 172.21.15.135:0/759559631 >> 172.21.15.135:0/759559631 conn(0x55c807dad710 msgr2=0x55c807db46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:58.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.213+0000 7f7d15c03740 1 -- 172.21.15.135:0/759559631 shutdown_connections 2024-04-20T12:25:58.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.213+0000 7f7d15c03740 1 -- 172.21.15.135:0/759559631 wait complete. 2024-04-20T12:25:58.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.213+0000 7f7d15c03740 20 client.16689 trim_cache size 0 max 16384 2024-04-20T12:25:58.217 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:25:58.217 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:25:58.217 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "f638003d-27ba-465c-8e84-dbe3782daf46", 2024-04-20T12:25:58.217 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:25:58.217 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:25:58.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.213+0000 7f7d13011640 1 -- 172.21.15.135:0/1902187635 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7cfc0a3d20 msgr2=0x7f7cfc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.213+0000 7f7d13011640 1 --2- 172.21.15.135:0/1902187635 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7cfc0a3d20 0x7f7cfc0a61e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009950 tx=0x7f7d04009e40 comp rx=0 tx=0).stop 2024-04-20T12:25:58.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.213+0000 7f7d13011640 1 -- 172.21.15.135:0/1902187635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c103b00 msgr2=0x7f7d0c19eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.213+0000 7f7d13011640 1 --2- 172.21.15.135:0/1902187635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c103b00 0x7f7d0c19eaf0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800d770 tx=0x7f7cf800dc30 comp rx=0 tx=0).stop 2024-04-20T12:25:58.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.213+0000 7f7d13011640 1 -- 172.21.15.135:0/1902187635 shutdown_connections 2024-04-20T12:25:58.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.213+0000 7f7d13011640 1 --2- 172.21.15.135:0/1902187635 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7cfc0a3d20 0x7f7cfc0a61e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.213+0000 7f7d13011640 1 --2- 172.21.15.135:0/1902187635 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d0c10c520 0x7f7d0c198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.213+0000 7f7d13011640 1 --2- 172.21.15.135:0/1902187635 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d0c103b00 0x7f7d0c19eaf0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.213+0000 7f7d13011640 1 --2- 172.21.15.135:0/1902187635 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d0c1031e0 0x7f7d0c19e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.213+0000 7f7d13011640 1 -- 172.21.15.135:0/1902187635 >> 172.21.15.135:0/1902187635 conn(0x7f7d0c077f60 msgr2=0x7f7d0c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:58.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.213+0000 7f7d13011640 1 -- 172.21.15.135:0/1902187635 shutdown_connections 2024-04-20T12:25:58.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.213+0000 7f7d13011640 1 -- 172.21.15.135:0/1902187635 wait complete. 2024-04-20T12:25:58.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:25:58.223 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:25:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.324+0000 7f7dc84b3640 1 -- 172.21.15.135:0/1822056899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc0100460 msgr2=0x7f7dc01008e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.324+0000 7f7dc84b3640 1 --2- 172.21.15.135:0/1822056899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc0100460 0x7f7dc01008e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7db0009930 tx=0x7f7db002bc30 comp rx=0 tx=0).stop 2024-04-20T12:25:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.324+0000 7f7dc84b3640 1 -- 172.21.15.135:0/1822056899 shutdown_connections 2024-04-20T12:25:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.324+0000 7f7dc84b3640 1 --2- 172.21.15.135:0/1822056899 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7dc0100e20 0x7f7dc010edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.324+0000 7f7dc84b3640 1 --2- 172.21.15.135:0/1822056899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc0100460 0x7f7dc01008e0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.324+0000 7f7dc84b3640 1 --2- 172.21.15.135:0/1822056899 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc0106f40 0x7f7dc0107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.324+0000 7f7dc84b3640 1 -- 172.21.15.135:0/1822056899 >> 172.21.15.135:0/1822056899 conn(0x7f7dc0077420 msgr2=0x7f7dc00fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.324+0000 7f7dc84b3640 1 -- 172.21.15.135:0/1822056899 shutdown_connections 2024-04-20T12:25:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.324+0000 7f7dc84b3640 1 -- 172.21.15.135:0/1822056899 wait complete. 2024-04-20T12:25:58.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc84b3640 1 Processor -- start 2024-04-20T12:25:58.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc84b3640 1 -- start start 2024-04-20T12:25:58.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc84b3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7dc0100460 0x7f7dc019e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc84b3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc0100e20 0x7f7dc019eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc84b3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc0106f40 0x7f7dc0198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc84b3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01123f0 con 0x7f7dc0106f40 2024-04-20T12:25:58.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc84b3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc0112270 con 0x7f7dc0100460 2024-04-20T12:25:58.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc84b3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc0112570 con 0x7f7dc0100e20 2024-04-20T12:25:58.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc6a50640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc0106f40 0x7f7dc0198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc6a50640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc0106f40 0x7f7dc0198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44042/0 (socket says 172.21.15.135:44042) 2024-04-20T12:25:58.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc6a50640 1 -- 172.21.15.135:0/1916625481 learned_addr learned my addr 172.21.15.135:0/1916625481 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:58.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc624f640 1 --2- 172.21.15.135:0/1916625481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7dc0100460 0x7f7dc019e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/1916625481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc0100e20 0x7f7dc019eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc6a50640 1 -- 172.21.15.135:0/1916625481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc0100e20 msgr2=0x7f7dc019eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc6a50640 1 --2- 172.21.15.135:0/1916625481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc0100e20 0x7f7dc019eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc6a50640 1 -- 172.21.15.135:0/1916625481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7dc0100460 msgr2=0x7f7dc019e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc6a50640 1 --2- 172.21.15.135:0/1916625481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7dc0100460 0x7f7dc019e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc6a50640 1 -- 172.21.15.135:0/1916625481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc0198f50 con 0x7f7dc0106f40 2024-04-20T12:25:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/1916625481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc0100e20 0x7f7dc019eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:25:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7dc6a50640 1 --2- 172.21.15.135:0/1916625481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc0106f40 0x7f7dc0198690 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7db800cce0 tx=0x7f7db800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.325+0000 7f7db77fe640 1 -- 172.21.15.135:0/1916625481 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db800f450 con 0x7f7dc0106f40 2024-04-20T12:25:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.326+0000 7f7dc84b3640 1 -- 172.21.15.135:0/1916625481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc0199240 con 0x7f7dc0106f40 2024-04-20T12:25:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.326+0000 7f7db77fe640 1 -- 172.21.15.135:0/1916625481 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7db800fad0 con 0x7f7dc0106f40 2024-04-20T12:25:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.326+0000 7f7db77fe640 1 -- 172.21.15.135:0/1916625481 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db8018c10 con 0x7f7dc0106f40 2024-04-20T12:25:58.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.326+0000 7f7dc84b3640 1 -- 172.21.15.135:0/1916625481 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc01a5550 con 0x7f7dc0106f40 2024-04-20T12:25:58.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.328+0000 7f7db77fe640 1 -- 172.21.15.135:0/1916625481 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f7db800f5f0 con 0x7f7dc0106f40 2024-04-20T12:25:58.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.328+0000 7f7dcb17c740 1 Processor -- start 2024-04-20T12:25:58.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dcb17c740 1 -- start start 2024-04-20T12:25:58.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dcb17c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eaed20 0x556276eaf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dcb17c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaf640 0x556276eb7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dcb17c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eb8220 0x556276eba610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dcb17c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556276e141b0 con 0x556276eaf640 2024-04-20T12:25:58.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dcb17c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556276db1390 con 0x556276eaed20 2024-04-20T12:25:58.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dcb17c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556276e10170 con 0x556276eb8220 2024-04-20T12:25:58.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dc624f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaf640 0x556276eb7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dc624f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaf640 0x556276eb7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44050/0 (socket says 172.21.15.135:44050) 2024-04-20T12:25:58.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dc624f640 1 -- 172.21.15.135:0/2930825242 learned_addr learned my addr 172.21.15.135:0/2930825242 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:58.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7db77fe640 1 --2- 172.21.15.135:0/1916625481 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7dac0a3d20 0x7f7dac0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/2930825242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eaed20 0x556276eaf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/2930825242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eb8220 0x556276eba610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dc6a50640 1 --2- 172.21.15.135:0/1916625481 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7dac0a3d20 0x7f7dac0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dc624f640 1 -- 172.21.15.135:0/2930825242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eb8220 msgr2=0x556276eba610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dc624f640 1 --2- 172.21.15.135:0/2930825242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eb8220 0x556276eba610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dc624f640 1 -- 172.21.15.135:0/2930825242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eaed20 msgr2=0x556276eaf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7db77fe640 1 -- 172.21.15.135:0/1916625481 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f7db80d1310 con 0x7f7dc0106f40 2024-04-20T12:25:58.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dc624f640 1 --2- 172.21.15.135:0/2930825242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eaed20 0x556276eaf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dc624f640 1 -- 172.21.15.135:0/2930825242 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556276bf07d0 con 0x556276eaf640 2024-04-20T12:25:58.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/2930825242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eb8220 0x556276eba610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:25:58.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.329+0000 7f7dc624f640 1 --2- 172.21.15.135:0/2930825242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaf640 0x556276eb7ce0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00cbe0 tx=0x7f7dbc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51b24263d5aed97 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:58.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.330+0000 7f7dc6a50640 1 --2- 172.21.15.135:0/1916625481 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7dac0a3d20 0x7f7dac0a61e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7db80ce790 tx=0x7f7db806fa20 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:58.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.330+0000 7f7db4bfe640 1 -- 172.21.15.135:0/2930825242 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc010630 con 0x556276eaf640 2024-04-20T12:25:58.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.330+0000 7f7db4bfe640 1 -- 172.21.15.135:0/2930825242 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dbc010cb0 con 0x556276eaf640 2024-04-20T12:25:58.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.330+0000 7f7db4bfe640 1 -- 172.21.15.135:0/2930825242 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc01ac20 con 0x556276eaf640 2024-04-20T12:25:58.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.330+0000 7f7dcb17c740 1 -- 172.21.15.135:0/2930825242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaf640 msgr2=0x556276eb7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.330+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/2930825242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaf640 0x556276eb7ce0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00cbe0 tx=0x7f7dbc00e720 comp rx=0 tx=0).stop 2024-04-20T12:25:58.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 1 -- 172.21.15.135:0/2930825242 shutdown_connections 2024-04-20T12:25:58.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/2930825242 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eb8220 0x556276eba610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/2930825242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaf640 0x556276eb7ce0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/2930825242 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eaed20 0x556276eaf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 1 -- 172.21.15.135:0/2930825242 >> 172.21.15.135:0/2930825242 conn(0x556276ea9450 msgr2=0x556276ea9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:58.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 1 -- 172.21.15.135:0/2930825242 shutdown_connections 2024-04-20T12:25:58.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 1 -- 172.21.15.135:0/2930825242 wait complete. 2024-04-20T12:25:58.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 1 -- start start 2024-04-20T12:25:58.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 1 Processor -- start 2024-04-20T12:25:58.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eaed20 0x556276eb5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eaf640 0x556276eb5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eb8220 0x556276eb5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556276ebb010 con 0x556276eb8220 2024-04-20T12:25:58.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556276dcd2f0 con 0x556276eaf640 2024-04-20T12:25:58.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556276ebb190 con 0x556276eaed20 2024-04-20T12:25:58.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dcb17c740 10 client.0 _ll_register_callbacks cb 0x556276d974e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:58.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dc5a4e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eb8220 0x556276eb5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dc5a4e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eb8220 0x556276eb5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44062/0 (socket says 172.21.15.135:44062) 2024-04-20T12:25:58.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.331+0000 7f7dc5a4e640 1 -- 172.21.15.135:0/2124954343 learned_addr learned my addr 172.21.15.135:0/2124954343 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:58.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.332+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/2124954343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eaed20 0x556276eb5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.332+0000 7f7dc624f640 1 --2- 172.21.15.135:0/2124954343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eaf640 0x556276eb5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.332+0000 7f7dc5a4e640 1 -- 172.21.15.135:0/2124954343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eaed20 msgr2=0x556276eb5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.332+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/2124954343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eaed20 0x556276eb5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.332+0000 7f7dc5a4e640 1 -- 172.21.15.135:0/2124954343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eaf640 msgr2=0x556276eb5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.332+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/2124954343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eaf640 0x556276eb5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.332+0000 7f7dc5a4e640 1 -- 172.21.15.135:0/2124954343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556276b263f0 con 0x556276eb8220 2024-04-20T12:25:58.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.332+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/2124954343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eb8220 0x556276eb5cd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7db0036040 tx=0x7f7db002bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f650bb0483b14b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:58.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.332+0000 7f7da9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:58.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.332+0000 7f7da9ffb640 1 -- 172.21.15.135:0/2124954343 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db004a070 con 0x556276eb8220 2024-04-20T12:25:58.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.332+0000 7f7da9ffb640 1 -- 172.21.15.135:0/2124954343 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f7db0003800 con 0x556276eb8220 2024-04-20T12:25:58.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.332+0000 7f7dcb17c740 1 -- 172.21.15.135:0/2124954343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dbc010cb0 con 0x556276eb8220 2024-04-20T12:25:58.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.332+0000 7f7da9ffb640 1 -- 172.21.15.135:0/2124954343 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7db0003a00 con 0x556276eb8220 2024-04-20T12:25:58.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.332+0000 7f7dcb17c740 10 client.16701 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:58.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.332+0000 7f7dcb17c740 1 -- 172.21.15.135:0/2124954343 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556276ae60f0 con 0x556276eb8220 2024-04-20T12:25:58.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.333+0000 7f7da9ffb640 1 -- 172.21.15.135:0/2124954343 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dbc010cb0 con 0x556276eb8220 2024-04-20T12:25:58.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.333+0000 7f7da9ffb640 1 -- 172.21.15.135:0/2124954343 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f7db004d020 con 0x556276eb8220 2024-04-20T12:25:58.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.333+0000 7f7dcb17c740 10 client.16701 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:58.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.333+0000 7f7dcb17c740 10 client.16701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:58.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.333+0000 7f7dcb17c740 20 client.16701 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:58.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.333+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/2124954343 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556276ec85a0 0x556276eca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.333+0000 7f7dcb17c740 4 client.16701 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:25:58.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.333+0000 7f7dcb17c740 1 -- 172.21.15.135:0/2124954343 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556276e21bd0 con 0x556276ec85a0 2024-04-20T12:25:58.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.333+0000 7f7dc624f640 1 --2- 172.21.15.135:0/2124954343 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556276ec85a0 0x556276eca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.334+0000 7f7da9ffb640 10 client.16701 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:58.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.334+0000 7f7dc624f640 1 --2- 172.21.15.135:0/2124954343 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556276ec85a0 0x556276eca9b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=412a2da86b8f7400 server_cookie=289bff4990bb14b3 in_seq=0 out_seq=0 2024-04-20T12:25:58.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.335+0000 7f7da9ffb640 1 -- 172.21.15.135:0/2124954343 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556276e21bd0 con 0x556276ec85a0 2024-04-20T12:25:58.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.335+0000 7f7da9ffb640 10 client.16701 handle_command_reply: tid=0 2024-04-20T12:25:58.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.335+0000 7f7dcb17c740 1 client.16701 shutdown 2024-04-20T12:25:58.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.335+0000 7f7dcb17c740 1 -- 172.21.15.135:0/2124954343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eb8220 msgr2=0x556276eb5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.335+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/2124954343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eb8220 0x556276eb5cd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7db0036040 tx=0x7f7db002bc30 comp rx=0 tx=0).stop 2024-04-20T12:25:58.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.335+0000 7f7dcb17c740 1 -- 172.21.15.135:0/2124954343 shutdown_connections 2024-04-20T12:25:58.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.335+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/2124954343 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556276ec85a0 0x556276eca9b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.335+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/2124954343 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eb8220 0x556276eb5cd0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.335+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/2124954343 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eaf640 0x556276eb5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.335+0000 7f7da9ffb640 0 client.16701 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:58.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.335+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/2124954343 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eaed20 0x556276eb5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.335+0000 7f7dcb17c740 1 -- 172.21.15.135:0/2124954343 >> 172.21.15.135:0/2124954343 conn(0x556276ea9450 msgr2=0x556276eab1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:58.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.335+0000 7f7dcb17c740 1 -- 172.21.15.135:0/2124954343 shutdown_connections 2024-04-20T12:25:58.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.335+0000 7f7dcb17c740 1 -- 172.21.15.135:0/2124954343 wait complete. 2024-04-20T12:25:58.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.335+0000 7f7dcb17c740 20 client.16701 trim_cache size 0 max 16384 2024-04-20T12:25:58.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dcb17c740 1 Processor -- start 2024-04-20T12:25:58.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dcb17c740 1 -- start start 2024-04-20T12:25:58.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dcb17c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaed20 0x556276eb7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dcb17c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eaf640 0x556276ec3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dcb17c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eb8220 0x556276ea84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dcb17c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01af320 con 0x556276eaed20 2024-04-20T12:25:58.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dcb17c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01b0e60 con 0x556276eb8220 2024-04-20T12:25:58.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dcb17c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01af9f0 con 0x556276eaf640 2024-04-20T12:25:58.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dc5a4e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaed20 0x556276eb7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dc5a4e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaed20 0x556276eb7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44068/0 (socket says 172.21.15.135:44068) 2024-04-20T12:25:58.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dc5a4e640 1 -- 172.21.15.135:0/1557858047 learned_addr learned my addr 172.21.15.135:0/1557858047 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:58.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dc624f640 1 --2- 172.21.15.135:0/1557858047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eaf640 0x556276ec3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/1557858047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eb8220 0x556276ea84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dc5a4e640 1 -- 172.21.15.135:0/1557858047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eaf640 msgr2=0x556276ec3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/1557858047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eaf640 0x556276ec3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dc5a4e640 1 -- 172.21.15.135:0/1557858047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eb8220 msgr2=0x556276ea84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/1557858047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eb8220 0x556276ea84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.353+0000 7f7dc5a4e640 1 -- 172.21.15.135:0/1557858047 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556276ecb030 con 0x556276eaed20 2024-04-20T12:25:58.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.354+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/1557858047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaed20 0x556276eb7980 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7db0009850 tx=0x7f7db0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e714f4b486dcf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:58.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.354+0000 7f7dabfff640 1 -- 172.21.15.135:0/1557858047 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db004a070 con 0x556276eaed20 2024-04-20T12:25:58.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.354+0000 7f7dabfff640 1 -- 172.21.15.135:0/1557858047 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7db0043d30 con 0x556276eaed20 2024-04-20T12:25:58.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.354+0000 7f7dabfff640 1 -- 172.21.15.135:0/1557858047 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db0042600 con 0x556276eaed20 2024-04-20T12:25:58.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.354+0000 7f7dcb17c740 1 -- 172.21.15.135:0/1557858047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaed20 msgr2=0x556276eb7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.354+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/1557858047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaed20 0x556276eb7980 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7db0009850 tx=0x7f7db0005fd0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.354+0000 7f7dcb17c740 1 -- 172.21.15.135:0/1557858047 shutdown_connections 2024-04-20T12:25:58.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.354+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/1557858047 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eb8220 0x556276ea84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.354+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/1557858047 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eaf640 0x556276ec3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.354+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/1557858047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaed20 0x556276eb7980 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.354+0000 7f7dcb17c740 1 -- 172.21.15.135:0/1557858047 >> 172.21.15.135:0/1557858047 conn(0x556276ea9450 msgr2=0x556276ea7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:58.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dcb17c740 1 -- 172.21.15.135:0/1557858047 shutdown_connections 2024-04-20T12:25:58.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dcb17c740 1 -- 172.21.15.135:0/1557858047 wait complete. 2024-04-20T12:25:58.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dcb17c740 1 -- start start 2024-04-20T12:25:58.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dcb17c740 1 Processor -- start 2024-04-20T12:25:58.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dcb17c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eaed20 0x556276ec0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dcb17c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaf640 0x556276ebdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dcb17c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eb8220 0x556276ebe210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dcb17c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01b0790 con 0x556276eaf640 2024-04-20T12:25:58.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dcb17c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01b00c0 con 0x556276eaed20 2024-04-20T12:25:58.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dcb17c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01ad2f0 con 0x556276eb8220 2024-04-20T12:25:58.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dcb17c740 10 client.0 _ll_register_callbacks cb 0x7f7db0004270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:25:58.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dc624f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaf640 0x556276ebdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dc624f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaf640 0x556276ebdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:44082/0 (socket says 172.21.15.135:44082) 2024-04-20T12:25:58.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dc624f640 1 -- 172.21.15.135:0/581418859 learned_addr learned my addr 172.21.15.135:0/581418859 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:25:58.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/581418859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eb8220 0x556276ebe210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/581418859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eaed20 0x556276ec0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dc624f640 1 -- 172.21.15.135:0/581418859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eb8220 msgr2=0x556276ebe210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dc624f640 1 --2- 172.21.15.135:0/581418859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eb8220 0x556276ebe210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dc624f640 1 -- 172.21.15.135:0/581418859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eaed20 msgr2=0x556276ec0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:25:58.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dc624f640 1 --2- 172.21.15.135:0/581418859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eaed20 0x556276ec0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.355+0000 7f7dc624f640 1 -- 172.21.15.135:0/581418859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556276ebea10 con 0x556276eaf640 2024-04-20T12:25:58.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7dc624f640 1 --2- 172.21.15.135:0/581418859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaf640 0x556276ebdc00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc005fd0 tx=0x7f7dbc01a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1b35a04c533ba server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:25:58.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7da9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:25:58.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7da9ffb640 1 -- 172.21.15.135:0/581418859 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc010e60 con 0x556276eaf640 2024-04-20T12:25:58.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7da9ffb640 1 -- 172.21.15.135:0/581418859 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f7dbc004220 con 0x556276eaf640 2024-04-20T12:25:58.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7dcb17c740 1 -- 172.21.15.135:0/581418859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7db0043d30 con 0x556276eaf640 2024-04-20T12:25:58.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7da9ffb640 1 -- 172.21.15.135:0/581418859 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7dbc037050 con 0x556276eaf640 2024-04-20T12:25:58.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7dcb17c740 10 client.16707 fetch_fsmap learned FSMap version 29 2024-04-20T12:25:58.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7dcb17c740 1 -- 172.21.15.135:0/581418859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556276f2ebe0 con 0x556276eaf640 2024-04-20T12:25:58.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7da9ffb640 1 -- 172.21.15.135:0/581418859 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7db0043d30 con 0x556276eaf640 2024-04-20T12:25:58.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7da9ffb640 1 -- 172.21.15.135:0/581418859 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f7dbc005330 con 0x556276eaf640 2024-04-20T12:25:58.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7dcb17c740 10 client.16707 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:25:58.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7dcb17c740 10 client.16707 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:25:58.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7dcb17c740 20 client.16707 populate_metadata read hostname 'smithi135' 2024-04-20T12:25:58.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/581418859 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556276f2f0d0 0x556276f314f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:25:58.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7dcb17c740 4 client.16707 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:25:58.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.356+0000 7f7dcb17c740 1 -- 172.21.15.135:0/581418859 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556276e1ba40 con 0x556276f2f0d0 2024-04-20T12:25:58.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/581418859 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556276f2f0d0 0x556276f314f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:25:58.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7da9ffb640 10 client.16707 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:58.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7dc5a4e640 1 --2- 172.21.15.135:0/581418859 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556276f2f0d0 0x556276f314f0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c7cb88e4e7f0609 server_cookie=c8b23975b6ef1ad1 in_seq=0 out_seq=0 2024-04-20T12:25:58.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7da9ffb640 1 -- 172.21.15.135:0/581418859 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556276e1ba40 con 0x556276f2f0d0 2024-04-20T12:25:58.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7da9ffb640 10 client.16707 handle_command_reply: tid=0 2024-04-20T12:25:58.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7dcb17c740 1 client.16707 shutdown 2024-04-20T12:25:58.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7dcb17c740 1 -- 172.21.15.135:0/581418859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaf640 msgr2=0x556276ebdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/581418859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaf640 0x556276ebdc00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc005fd0 tx=0x7f7dbc01a900 comp rx=0 tx=0).stop 2024-04-20T12:25:58.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7dcb17c740 1 -- 172.21.15.135:0/581418859 shutdown_connections 2024-04-20T12:25:58.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/581418859 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556276f2f0d0 0x556276f314f0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/581418859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556276eb8220 0x556276ebe210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/581418859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556276eaf640 0x556276ebdc00 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7da9ffb640 0 client.16707 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:25:58.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7dcb17c740 1 --2- 172.21.15.135:0/581418859 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556276eaed20 0x556276ec0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7dcb17c740 1 -- 172.21.15.135:0/581418859 >> 172.21.15.135:0/581418859 conn(0x556276ea9450 msgr2=0x556276ea8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:58.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7dcb17c740 1 -- 172.21.15.135:0/581418859 shutdown_connections 2024-04-20T12:25:58.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7dcb17c740 1 -- 172.21.15.135:0/581418859 wait complete. 2024-04-20T12:25:58.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.357+0000 7f7dcb17c740 20 client.16707 trim_cache size 0 max 16384 2024-04-20T12:25:58.363 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:25:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:25:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:25:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: "f638003d-27ba-465c-8e84-dbe3782daf46": { 2024-04-20T12:25:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:25:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "f638003d-27ba-465c-8e84-dbe3782daf46", 2024-04-20T12:25:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:25:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:25:58.364 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:25:58.364 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:25:58.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.358+0000 7f7dc84b3640 1 -- 172.21.15.135:0/1916625481 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7dac0a3d20 msgr2=0x7f7dac0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.358+0000 7f7dc84b3640 1 --2- 172.21.15.135:0/1916625481 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7dac0a3d20 0x7f7dac0a61e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7db80ce790 tx=0x7f7db806fa20 comp rx=0 tx=0).stop 2024-04-20T12:25:58.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.358+0000 7f7dc84b3640 1 -- 172.21.15.135:0/1916625481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc0106f40 msgr2=0x7f7dc0198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:25:58.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.358+0000 7f7dc84b3640 1 --2- 172.21.15.135:0/1916625481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc0106f40 0x7f7dc0198690 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7db800cce0 tx=0x7f7db800a620 comp rx=0 tx=0).stop 2024-04-20T12:25:58.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.358+0000 7f7dc84b3640 1 -- 172.21.15.135:0/1916625481 shutdown_connections 2024-04-20T12:25:58.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.358+0000 7f7dc84b3640 1 --2- 172.21.15.135:0/1916625481 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dc0106f40 0x7f7dc0198690 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.358+0000 7f7dc84b3640 1 --2- 172.21.15.135:0/1916625481 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7dac0a3d20 0x7f7dac0a61e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.358+0000 7f7dc84b3640 1 --2- 172.21.15.135:0/1916625481 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7dc0100e20 0x7f7dc019eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.358+0000 7f7dc84b3640 1 --2- 172.21.15.135:0/1916625481 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7dc0100460 0x7f7dc019e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:25:58.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.358+0000 7f7dc84b3640 1 -- 172.21.15.135:0/1916625481 >> 172.21.15.135:0/1916625481 conn(0x7f7dc0077420 msgr2=0x7f7dc0104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:25:58.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.358+0000 7f7dc84b3640 1 -- 172.21.15.135:0/1916625481 shutdown_connections 2024-04-20T12:25:58.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:25:58.358+0000 7f7dc84b3640 1 -- 172.21.15.135:0/1916625481 wait complete. 2024-04-20T12:25:58.368 INFO:tasks.cephfs.filesystem:scrub status for tag:f638003d-27ba-465c-8e84-dbe3782daf46 - {'path': '/', 'tag': 'f638003d-27ba-465c-8e84-dbe3782daf46', 'options': 'recursive,force'} 2024-04-20T12:25:59.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:58 smithi154 ceph-mon[22073]: pgmap v88: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:59.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:58 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:25:59.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:58 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:25:59.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:58 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:25:59.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:25:58 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:25:59.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:58 smithi139 ceph-mon[21834]: pgmap v88: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:59.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:58 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:25:59.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:58 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:25:59.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:58 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:25:59.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:25:58 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:25:59.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:58 smithi135 ceph-mon[18264]: pgmap v88: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:25:59.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:58 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:25:59.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:58 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:25:59.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:58 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:25:59.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:25:58 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:26:01.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:00 smithi154 ceph-mon[22073]: pgmap v89: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:26:01.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:00 smithi139 ceph-mon[21834]: pgmap v89: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:26:01.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:00 smithi135 ceph-mon[18264]: pgmap v89: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:26:03.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:02 smithi139 ceph-mon[21834]: pgmap v90: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:03.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:02 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:26:03.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:02 smithi135 ceph-mon[18264]: pgmap v90: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:03.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:02 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:26:03.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:02 smithi154 ceph-mon[22073]: pgmap v90: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:03.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:02 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:26:05.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:04 smithi139 ceph-mon[21834]: pgmap v91: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 KiB/s wr, 29 op/s 2024-04-20T12:26:05.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:04 smithi135 ceph-mon[18264]: pgmap v91: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 KiB/s wr, 29 op/s 2024-04-20T12:26:05.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:04 smithi154 ceph-mon[22073]: pgmap v91: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 KiB/s wr, 29 op/s 2024-04-20T12:26:07.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:06 smithi139 ceph-mon[21834]: pgmap v92: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-20T12:26:07.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:06 smithi135 ceph-mon[18264]: pgmap v92: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-20T12:26:07.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:06 smithi154 ceph-mon[22073]: pgmap v92: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-20T12:26:09.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:08 smithi139 ceph-mon[21834]: pgmap v93: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-20T12:26:09.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:08 smithi135 ceph-mon[18264]: pgmap v93: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-20T12:26:09.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:08 smithi154 ceph-mon[22073]: pgmap v93: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-04-20T12:26:11.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:10 smithi139 ceph-mon[21834]: pgmap v94: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 29 op/s 2024-04-20T12:26:11.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:10 smithi135 ceph-mon[18264]: pgmap v94: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 29 op/s 2024-04-20T12:26:11.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:10 smithi154 ceph-mon[22073]: pgmap v94: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 29 op/s 2024-04-20T12:26:13.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:12 smithi139 ceph-mon[21834]: pgmap v95: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-04-20T12:26:13.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:12 smithi135 ceph-mon[18264]: pgmap v95: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-04-20T12:26:13.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:12 smithi154 ceph-mon[22073]: pgmap v95: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-04-20T12:26:15.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:14 smithi139 ceph-mon[21834]: pgmap v96: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 29 op/s 2024-04-20T12:26:15.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:14 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:26:15.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:14 smithi135 ceph-mon[18264]: pgmap v96: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 29 op/s 2024-04-20T12:26:15.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:14 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:26:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:14 smithi154 ceph-mon[22073]: pgmap v96: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 KiB/s wr, 29 op/s 2024-04-20T12:26:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:14 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:26:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:15 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:26:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:15 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:26:16.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:15 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:26:16.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:15 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:26:16.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:15 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:26:16.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:15 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:26:16.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:15 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:26:16.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:15 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:26:16.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:15 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:26:17.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:17 smithi139 ceph-mon[21834]: pgmap v97: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-20T12:26:17.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:17 smithi135 ceph-mon[18264]: pgmap v97: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-20T12:26:17.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:17 smithi154 ceph-mon[22073]: pgmap v97: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-20T12:26:18.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:18 smithi135 ceph-mon[18264]: pgmap v98: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-20T12:26:18.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:18 smithi154 ceph-mon[22073]: pgmap v98: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-20T12:26:18.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:18 smithi139 ceph-mon[21834]: pgmap v98: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-20T12:26:20.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:20 smithi154 ceph-mon[22073]: pgmap v99: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-20T12:26:20.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:20 smithi139 ceph-mon[21834]: pgmap v99: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-20T12:26:20.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:20 smithi135 ceph-mon[18264]: pgmap v99: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 85 B/s wr, 12 op/s 2024-04-20T12:26:22.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:22 smithi154 ceph-mon[22073]: pgmap v100: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:22.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:22 smithi139 ceph-mon[21834]: pgmap v100: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:22.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:22 smithi135 ceph-mon[18264]: pgmap v100: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:24.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:24 smithi154 ceph-mon[22073]: pgmap v101: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:26:24.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:24 smithi139 ceph-mon[21834]: pgmap v101: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:26:24.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:24 smithi135 ceph-mon[18264]: pgmap v101: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:26:26.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:26 smithi154 ceph-mon[22073]: pgmap v102: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:26.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:26 smithi139 ceph-mon[21834]: pgmap v102: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:26.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:26 smithi135 ceph-mon[18264]: pgmap v102: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:28.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:26:28.369 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:26:28.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.482+0000 7f0549c11640 1 -- 172.21.15.135:0/1612495500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05441072f0 msgr2=0x7f054410eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.482+0000 7f0549c11640 1 --2- 172.21.15.135:0/1612495500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05441072f0 0x7f054410eec0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f053c009900 tx=0x7f053c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:26:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.482+0000 7f0549c11640 1 -- 172.21.15.135:0/1612495500 shutdown_connections 2024-04-20T12:26:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.482+0000 7f0549c11640 1 --2- 172.21.15.135:0/1612495500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05441072f0 0x7f054410eec0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.482+0000 7f0549c11640 1 --2- 172.21.15.135:0/1612495500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0544102bd0 0x7f0544106c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.482+0000 7f0549c11640 1 --2- 172.21.15.135:0/1612495500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0544102220 0x7f0544102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.482+0000 7f0549c11640 1 -- 172.21.15.135:0/1612495500 >> 172.21.15.135:0/1612495500 conn(0x7f05440fdac0 msgr2=0x7f05440ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.482+0000 7f0549c11640 1 -- 172.21.15.135:0/1612495500 shutdown_connections 2024-04-20T12:26:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.482+0000 7f0549c11640 1 -- 172.21.15.135:0/1612495500 wait complete. 2024-04-20T12:26:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.483+0000 7f0549c11640 1 Processor -- start 2024-04-20T12:26:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.483+0000 7f0549c11640 1 -- start start 2024-04-20T12:26:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.483+0000 7f0549c11640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0544102220 0x7f054419e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.483+0000 7f0549c11640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05441072f0 0x7f054419ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.483+0000 7f0549c11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0544198790 0x7f0544198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.483+0000 7f0549c11640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f05441123b0 con 0x7f0544102220 2024-04-20T12:26:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.483+0000 7f0549c11640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0544112230 con 0x7f05441072f0 2024-04-20T12:26:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.483+0000 7f0549c11640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0544112530 con 0x7f0544198790 2024-04-20T12:26:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.483+0000 7f05437fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0544102220 0x7f054419e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.483+0000 7f05437fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0544102220 0x7f054419e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41470/0 (socket says 172.21.15.135:41470) 2024-04-20T12:26:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.483+0000 7f05437fe640 1 -- 172.21.15.135:0/2704729841 learned_addr learned my addr 172.21.15.135:0/2704729841 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.483+0000 7f0542ffd640 1 --2- 172.21.15.135:0/2704729841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05441072f0 0x7f054419ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.484+0000 7f0543fff640 1 --2- 172.21.15.135:0/2704729841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0544198790 0x7f0544198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.484+0000 7f05437fe640 1 -- 172.21.15.135:0/2704729841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0544198790 msgr2=0x7f0544198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.484+0000 7f05437fe640 1 --2- 172.21.15.135:0/2704729841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0544198790 0x7f0544198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.484+0000 7f05437fe640 1 -- 172.21.15.135:0/2704729841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05441072f0 msgr2=0x7f054419ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.484+0000 7f05437fe640 1 --2- 172.21.15.135:0/2704729841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05441072f0 0x7f054419ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.484+0000 7f05437fe640 1 -- 172.21.15.135:0/2704729841 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0544199390 con 0x7f0544102220 2024-04-20T12:26:28.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.484+0000 7f05437fe640 1 --2- 172.21.15.135:0/2704729841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0544102220 0x7f054419e680 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f053400d770 tx=0x7f053400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:28.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.484+0000 7f0540ff9640 1 -- 172.21.15.135:0/2704729841 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0534017070 con 0x7f0544102220 2024-04-20T12:26:28.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.484+0000 7f0540ff9640 1 -- 172.21.15.135:0/2704729841 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0534005500 con 0x7f0544102220 2024-04-20T12:26:28.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.484+0000 7f0549c11640 1 -- 172.21.15.135:0/2704729841 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05441a5420 con 0x7f0544102220 2024-04-20T12:26:28.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.484+0000 7f0540ff9640 1 -- 172.21.15.135:0/2704729841 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0534004e00 con 0x7f0544102220 2024-04-20T12:26:28.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.484+0000 7f0549c11640 1 -- 172.21.15.135:0/2704729841 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05441a57d0 con 0x7f0544102220 2024-04-20T12:26:28.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f0540ff9640 1 -- 172.21.15.135:0/2704729841 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f0534004fa0 con 0x7f0544102220 2024-04-20T12:26:28.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f054c7ff740 1 Processor -- start 2024-04-20T12:26:28.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f054c7ff740 1 -- start start 2024-04-20T12:26:28.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f054c7ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c2d20 0x56510b7c3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f054c7ff740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7c3640 0x56510b7cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f054c7ff740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7cc220 0x56510b7ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f054c7ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56510b7281b0 con 0x56510b7c2d20 2024-04-20T12:26:28.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f054c7ff740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56510b6c5390 con 0x56510b7cc220 2024-04-20T12:26:28.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f054c7ff740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56510b724170 con 0x56510b7c3640 2024-04-20T12:26:28.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f0540ff9640 1 --2- 172.21.15.135:0/2704729841 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f05300a3d20 0x7f05300a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f0543fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c2d20 0x56510b7c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f0543fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c2d20 0x56510b7c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41476/0 (socket says 172.21.15.135:41476) 2024-04-20T12:26:28.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f0543fff640 1 -- 172.21.15.135:0/2620960392 learned_addr learned my addr 172.21.15.135:0/2620960392 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:28.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f0543fff640 1 --2- 172.21.15.135:0/2704729841 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f05300a3d20 0x7f05300a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f0540ff9640 1 -- 172.21.15.135:0/2704729841 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f05340d0550 con 0x7f0544102220 2024-04-20T12:26:28.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f05437fe640 1 --2- 172.21.15.135:0/2620960392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7c3640 0x56510b7cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.487+0000 7f0542ffd640 1 --2- 172.21.15.135:0/2620960392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7cc220 0x56510b7ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.488+0000 7f0543fff640 1 -- 172.21.15.135:0/2620960392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7c3640 msgr2=0x56510b7cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.488+0000 7f0543fff640 1 --2- 172.21.15.135:0/2620960392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7c3640 0x56510b7cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.488+0000 7f0543fff640 1 -- 172.21.15.135:0/2620960392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7cc220 msgr2=0x56510b7ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.488+0000 7f0543fff640 1 --2- 172.21.15.135:0/2620960392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7cc220 0x56510b7ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.488+0000 7f0543fff640 1 -- 172.21.15.135:0/2620960392 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56510b5047d0 con 0x56510b7c2d20 2024-04-20T12:26:28.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.488+0000 7f0542ffd640 1 --2- 172.21.15.135:0/2620960392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7cc220 0x56510b7ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:26:28.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.488+0000 7f0543fff640 1 --2- 172.21.15.135:0/2620960392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c2d20 0x56510b7c3100 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f053c0096c0 tx=0x7f053c02ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f3291e7454e1c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:28.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.488+0000 7f0543fff640 1 --2- 172.21.15.135:0/2704729841 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f05300a3d20 0x7f05300a61e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f053c005c40 tx=0x7f053c043000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:28.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.488+0000 7f0539ffb640 1 -- 172.21.15.135:0/2620960392 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0046c0 con 0x56510b7c2d20 2024-04-20T12:26:28.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.488+0000 7f0539ffb640 1 -- 172.21.15.135:0/2620960392 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f053c050070 con 0x56510b7c2d20 2024-04-20T12:26:28.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.488+0000 7f0539ffb640 1 -- 172.21.15.135:0/2620960392 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0055e0 con 0x56510b7c2d20 2024-04-20T12:26:28.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.489+0000 7f054c7ff740 1 -- 172.21.15.135:0/2620960392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c2d20 msgr2=0x56510b7c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.489+0000 7f054c7ff740 1 --2- 172.21.15.135:0/2620960392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c2d20 0x56510b7c3100 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f053c0096c0 tx=0x7f053c02ce30 comp rx=0 tx=0).stop 2024-04-20T12:26:28.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.489+0000 7f054c7ff740 1 -- 172.21.15.135:0/2620960392 shutdown_connections 2024-04-20T12:26:28.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.489+0000 7f054c7ff740 1 --2- 172.21.15.135:0/2620960392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7cc220 0x56510b7ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.489+0000 7f054c7ff740 1 --2- 172.21.15.135:0/2620960392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7c3640 0x56510b7cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.489+0000 7f054c7ff740 1 --2- 172.21.15.135:0/2620960392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c2d20 0x56510b7c3100 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.489+0000 7f054c7ff740 1 -- 172.21.15.135:0/2620960392 >> 172.21.15.135:0/2620960392 conn(0x56510b7bd450 msgr2=0x56510b7bd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:28.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.489+0000 7f054c7ff740 1 -- 172.21.15.135:0/2620960392 shutdown_connections 2024-04-20T12:26:28.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.489+0000 7f054c7ff740 1 -- 172.21.15.135:0/2620960392 wait complete. 2024-04-20T12:26:28.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.489+0000 7f054c7ff740 1 -- start start 2024-04-20T12:26:28.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.489+0000 7f054c7ff740 1 Processor -- start 2024-04-20T12:26:28.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f054c7ff740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7c2d20 0x56510b7c9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f054c7ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7c9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f054c7ff740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7cc220 0x56510b7c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f054c7ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56510b7cefb0 con 0x56510b7c3640 2024-04-20T12:26:28.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f054c7ff740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56510b6e12f0 con 0x56510b7cc220 2024-04-20T12:26:28.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f054c7ff740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56510b7cf130 con 0x56510b7c2d20 2024-04-20T12:26:28.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f054c7ff740 10 client.0 _ll_register_callbacks cb 0x56510b6ab4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:28.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f0542ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f0542ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7c9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41490/0 (socket says 172.21.15.135:41490) 2024-04-20T12:26:28.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f0542ffd640 1 -- 172.21.15.135:0/2412699504 learned_addr learned my addr 172.21.15.135:0/2412699504 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:28.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f0543fff640 1 --2- 172.21.15.135:0/2412699504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7cc220 0x56510b7c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f05437fe640 1 --2- 172.21.15.135:0/2412699504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7c2d20 0x56510b7c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f0542ffd640 1 -- 172.21.15.135:0/2412699504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7c2d20 msgr2=0x56510b7c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f0542ffd640 1 --2- 172.21.15.135:0/2412699504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7c2d20 0x56510b7c9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f0542ffd640 1 -- 172.21.15.135:0/2412699504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7cc220 msgr2=0x56510b7c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f0542ffd640 1 --2- 172.21.15.135:0/2412699504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7cc220 0x56510b7c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f0542ffd640 1 -- 172.21.15.135:0/2412699504 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56510b43a3f0 con 0x56510b7c3640 2024-04-20T12:26:28.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f0542ffd640 1 --2- 172.21.15.135:0/2412699504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7c9860 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f052c011660 tx=0x7f052c011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97520dc23ac4e87c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:28.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f0522ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f0522ffd640 1 -- 172.21.15.135:0/2412699504 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c003b70 con 0x56510b7c3640 2024-04-20T12:26:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f0522ffd640 1 -- 172.21.15.135:0/2412699504 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f052c003d10 con 0x56510b7c3640 2024-04-20T12:26:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.490+0000 7f054c7ff740 1 -- 172.21.15.135:0/2412699504 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f053c050070 con 0x56510b7c3640 2024-04-20T12:26:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.491+0000 7f0522ffd640 1 -- 172.21.15.135:0/2412699504 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f052c004b20 con 0x56510b7c3640 2024-04-20T12:26:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.491+0000 7f054c7ff740 10 client.16719 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.491+0000 7f054c7ff740 1 -- 172.21.15.135:0/2412699504 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56510b3fa0f0 con 0x56510b7c3640 2024-04-20T12:26:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.491+0000 7f0522ffd640 1 -- 172.21.15.135:0/2412699504 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f053c050070 con 0x56510b7c3640 2024-04-20T12:26:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.491+0000 7f0522ffd640 1 -- 172.21.15.135:0/2412699504 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f052c00f040 con 0x56510b7c3640 2024-04-20T12:26:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.491+0000 7f054c7ff740 10 client.16719 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.491+0000 7f054c7ff740 10 client.16719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:26:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.491+0000 7f054c7ff740 20 client.16719 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.491+0000 7f054c7ff740 1 --2- 172.21.15.135:0/2412699504 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56510b7dc710 0x56510b7deb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.491+0000 7f054c7ff740 4 client.16719 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:26:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.491+0000 7f054c7ff740 1 -- 172.21.15.135:0/2412699504 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56510b735bd0 con 0x56510b7dc710 2024-04-20T12:26:28.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.491+0000 7f05437fe640 1 --2- 172.21.15.135:0/2412699504 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56510b7dc710 0x56510b7deb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.492+0000 7f05437fe640 1 --2- 172.21.15.135:0/2412699504 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56510b7dc710 0x56510b7deb30 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=594cc22e178f0d7e server_cookie=bbe82fbfa18fdb70 in_seq=0 out_seq=0 2024-04-20T12:26:28.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.492+0000 7f0522ffd640 10 client.16719 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:28.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.492+0000 7f0522ffd640 1 -- 172.21.15.135:0/2412699504 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56510b735bd0 con 0x56510b7dc710 2024-04-20T12:26:28.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.492+0000 7f0522ffd640 10 client.16719 handle_command_reply: tid=0 2024-04-20T12:26:28.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.492+0000 7f054c7ff740 1 client.16719 shutdown 2024-04-20T12:26:28.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.493+0000 7f054c7ff740 1 -- 172.21.15.135:0/2412699504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 msgr2=0x56510b7c9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.493+0000 7f054c7ff740 1 --2- 172.21.15.135:0/2412699504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7c9860 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f052c011660 tx=0x7f052c011b20 comp rx=0 tx=0).stop 2024-04-20T12:26:28.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.493+0000 7f054c7ff740 1 -- 172.21.15.135:0/2412699504 shutdown_connections 2024-04-20T12:26:28.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.493+0000 7f054c7ff740 1 --2- 172.21.15.135:0/2412699504 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56510b7dc710 0x56510b7deb30 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.493+0000 7f054c7ff740 1 --2- 172.21.15.135:0/2412699504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7cc220 0x56510b7c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.493+0000 7f054c7ff740 1 --2- 172.21.15.135:0/2412699504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7c9860 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.493+0000 7f054c7ff740 1 --2- 172.21.15.135:0/2412699504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7c2d20 0x56510b7c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.493+0000 7f0522ffd640 0 client.16719 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:28.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.493+0000 7f054c7ff740 1 -- 172.21.15.135:0/2412699504 >> 172.21.15.135:0/2412699504 conn(0x56510b7bd450 msgr2=0x56510b7bf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:28.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.493+0000 7f054c7ff740 1 -- 172.21.15.135:0/2412699504 shutdown_connections 2024-04-20T12:26:28.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.493+0000 7f054c7ff740 1 -- 172.21.15.135:0/2412699504 wait complete. 2024-04-20T12:26:28.501 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.493+0000 7f054c7ff740 20 client.16719 trim_cache size 0 max 16384 2024-04-20T12:26:28.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:28 smithi154 ceph-mon[22073]: pgmap v103: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:28.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.510+0000 7f054c7ff740 1 Processor -- start 2024-04-20T12:26:28.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.510+0000 7f054c7ff740 1 -- start start 2024-04-20T12:26:28.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.510+0000 7f054c7ff740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7c2d20 0x56510b7cba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.510+0000 7f054c7ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7d7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.510+0000 7f054c7ff740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7cc220 0x56510b7b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.510+0000 7f054c7ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f05441af350 con 0x56510b7c3640 2024-04-20T12:26:28.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.510+0000 7f054c7ff740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f05441b0e90 con 0x56510b7c2d20 2024-04-20T12:26:28.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.510+0000 7f054c7ff740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f05441afa20 con 0x56510b7cc220 2024-04-20T12:26:28.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.510+0000 7f0542ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7d7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.510+0000 7f0542ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7d7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41506/0 (socket says 172.21.15.135:41506) 2024-04-20T12:26:28.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.510+0000 7f0542ffd640 1 -- 172.21.15.135:0/1172708454 learned_addr learned my addr 172.21.15.135:0/1172708454 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:28.516 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.510+0000 7f0543fff640 1 --2- 172.21.15.135:0/1172708454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7cc220 0x56510b7b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.510+0000 7f05437fe640 1 --2- 172.21.15.135:0/1172708454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7c2d20 0x56510b7cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.510+0000 7f0542ffd640 1 -- 172.21.15.135:0/1172708454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7cc220 msgr2=0x56510b7b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.511+0000 7f0542ffd640 1 --2- 172.21.15.135:0/1172708454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7cc220 0x56510b7b84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.511+0000 7f0542ffd640 1 -- 172.21.15.135:0/1172708454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7c2d20 msgr2=0x56510b7cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.511+0000 7f0542ffd640 1 --2- 172.21.15.135:0/1172708454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7c2d20 0x56510b7cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.511+0000 7f0542ffd640 1 -- 172.21.15.135:0/1172708454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56510b7c82d0 con 0x56510b7c3640 2024-04-20T12:26:28.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.511+0000 7f0542ffd640 1 --2- 172.21.15.135:0/1172708454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7d7e70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f052c00a010 tx=0x7f052c005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339b6c2ef34a0ad2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:28.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.511+0000 7f05397fa640 1 -- 172.21.15.135:0/1172708454 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c004860 con 0x56510b7c3640 2024-04-20T12:26:28.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.511+0000 7f05397fa640 1 -- 172.21.15.135:0/1172708454 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f052c02c070 con 0x56510b7c3640 2024-04-20T12:26:28.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.511+0000 7f05397fa640 1 -- 172.21.15.135:0/1172708454 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c004160 con 0x56510b7c3640 2024-04-20T12:26:28.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.511+0000 7f054c7ff740 1 -- 172.21.15.135:0/1172708454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 msgr2=0x56510b7d7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.511+0000 7f054c7ff740 1 --2- 172.21.15.135:0/1172708454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7d7e70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f052c00a010 tx=0x7f052c005fb0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.511+0000 7f054c7ff740 1 -- 172.21.15.135:0/1172708454 shutdown_connections 2024-04-20T12:26:28.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.511+0000 7f054c7ff740 1 --2- 172.21.15.135:0/1172708454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7cc220 0x56510b7b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.511+0000 7f054c7ff740 1 --2- 172.21.15.135:0/1172708454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7d7e70 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.511+0000 7f054c7ff740 1 --2- 172.21.15.135:0/1172708454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7c2d20 0x56510b7cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f054c7ff740 1 -- 172.21.15.135:0/1172708454 >> 172.21.15.135:0/1172708454 conn(0x56510b7bd450 msgr2=0x56510b7bf130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:28.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f054c7ff740 1 -- 172.21.15.135:0/1172708454 shutdown_connections 2024-04-20T12:26:28.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f054c7ff740 1 -- 172.21.15.135:0/1172708454 wait complete. 2024-04-20T12:26:28.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f054c7ff740 1 -- start start 2024-04-20T12:26:28.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f054c7ff740 1 Processor -- start 2024-04-20T12:26:28.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f054c7ff740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7c2d20 0x56510b7d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f054c7ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f054c7ff740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7cc220 0x56510b841c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f054c7ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f05441b07c0 con 0x56510b7c3640 2024-04-20T12:26:28.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f054c7ff740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f05441b00f0 con 0x56510b7c2d20 2024-04-20T12:26:28.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f054c7ff740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f05441ad320 con 0x56510b7cc220 2024-04-20T12:26:28.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f054c7ff740 10 client.0 _ll_register_callbacks cb 0x7f052c009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:28.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f0542ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f0542ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7d2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41520/0 (socket says 172.21.15.135:41520) 2024-04-20T12:26:28.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f0542ffd640 1 -- 172.21.15.135:0/4158112572 learned_addr learned my addr 172.21.15.135:0/4158112572 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:28.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.512+0000 7f05437fe640 1 --2- 172.21.15.135:0/4158112572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7c2d20 0x56510b7d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f0543fff640 1 --2- 172.21.15.135:0/4158112572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7cc220 0x56510b841c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f0542ffd640 1 -- 172.21.15.135:0/4158112572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7cc220 msgr2=0x56510b841c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f0542ffd640 1 --2- 172.21.15.135:0/4158112572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7cc220 0x56510b841c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f0542ffd640 1 -- 172.21.15.135:0/4158112572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7c2d20 msgr2=0x56510b7d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f0542ffd640 1 --2- 172.21.15.135:0/4158112572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7c2d20 0x56510b7d2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f0542ffd640 1 -- 172.21.15.135:0/4158112572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56510b8421f0 con 0x56510b7c3640 2024-04-20T12:26:28.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f0542ffd640 1 --2- 172.21.15.135:0/4158112572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7d2a50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f052c000f80 tx=0x7f052c00f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffa28a3011e3be0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:28.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f0522ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:28.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f0522ffd640 1 -- 172.21.15.135:0/4158112572 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c03e060 con 0x56510b7c3640 2024-04-20T12:26:28.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f0522ffd640 1 -- 172.21.15.135:0/4158112572 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f052c00f940 con 0x56510b7c3640 2024-04-20T12:26:28.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f054c7ff740 1 -- 172.21.15.135:0/4158112572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f052c02c070 con 0x56510b7c3640 2024-04-20T12:26:28.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f0522ffd640 1 -- 172.21.15.135:0/4158112572 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f052c045050 con 0x56510b7c3640 2024-04-20T12:26:28.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f054c7ff740 10 client.16725 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:28.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f054c7ff740 1 -- 172.21.15.135:0/4158112572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56510b843500 con 0x56510b7c3640 2024-04-20T12:26:28.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f0522ffd640 1 -- 172.21.15.135:0/4158112572 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f052c02c070 con 0x56510b7c3640 2024-04-20T12:26:28.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.513+0000 7f0522ffd640 1 -- 172.21.15.135:0/4158112572 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f052c039cb0 con 0x56510b7c3640 2024-04-20T12:26:28.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.514+0000 7f054c7ff740 10 client.16725 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:28.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.514+0000 7f054c7ff740 10 client.16725 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:26:28.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.514+0000 7f054c7ff740 20 client.16725 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:28.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.514+0000 7f054c7ff740 1 --2- 172.21.15.135:0/4158112572 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56510b843b60 0x56510b845f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.514+0000 7f054c7ff740 4 client.16725 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:26:28.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.514+0000 7f054c7ff740 1 -- 172.21.15.135:0/4158112572 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56510b72fa40 con 0x56510b843b60 2024-04-20T12:26:28.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.514+0000 7f05437fe640 1 --2- 172.21.15.135:0/4158112572 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56510b843b60 0x56510b845f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.514+0000 7f0522ffd640 10 client.16725 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:28.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.514+0000 7f05437fe640 1 --2- 172.21.15.135:0/4158112572 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56510b843b60 0x56510b845f80 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42022833af3343b1 server_cookie=3afff4a988303550 in_seq=0 out_seq=0 2024-04-20T12:26:28.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.514+0000 7f0522ffd640 1 -- 172.21.15.135:0/4158112572 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56510b72fa40 con 0x56510b843b60 2024-04-20T12:26:28.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.514+0000 7f0522ffd640 10 client.16725 handle_command_reply: tid=0 2024-04-20T12:26:28.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.514+0000 7f054c7ff740 1 client.16725 shutdown 2024-04-20T12:26:28.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f054c7ff740 1 -- 172.21.15.135:0/4158112572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 msgr2=0x56510b7d2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f054c7ff740 1 --2- 172.21.15.135:0/4158112572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7d2a50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f052c000f80 tx=0x7f052c00f870 comp rx=0 tx=0).stop 2024-04-20T12:26:28.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f054c7ff740 1 -- 172.21.15.135:0/4158112572 shutdown_connections 2024-04-20T12:26:28.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f054c7ff740 1 --2- 172.21.15.135:0/4158112572 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56510b843b60 0x56510b845f80 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f054c7ff740 1 --2- 172.21.15.135:0/4158112572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56510b7cc220 0x56510b841c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f054c7ff740 1 --2- 172.21.15.135:0/4158112572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56510b7c3640 0x56510b7d2a50 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f0522ffd640 0 client.16725 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:28.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f054c7ff740 1 --2- 172.21.15.135:0/4158112572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56510b7c2d20 0x56510b7d2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f054c7ff740 1 -- 172.21.15.135:0/4158112572 >> 172.21.15.135:0/4158112572 conn(0x56510b7bd450 msgr2=0x56510b7be840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:28.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f054c7ff740 1 -- 172.21.15.135:0/4158112572 shutdown_connections 2024-04-20T12:26:28.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f054c7ff740 1 -- 172.21.15.135:0/4158112572 wait complete. 2024-04-20T12:26:28.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f054c7ff740 20 client.16725 trim_cache size 0 max 16384 2024-04-20T12:26:28.522 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:26:28.522 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:26:28.522 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:26:28.522 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:26:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f0549c11640 1 -- 172.21.15.135:0/2704729841 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f05300a3d20 msgr2=0x7f05300a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f0549c11640 1 --2- 172.21.15.135:0/2704729841 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f05300a3d20 0x7f05300a61e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f053c005c40 tx=0x7f053c043000 comp rx=0 tx=0).stop 2024-04-20T12:26:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f0549c11640 1 -- 172.21.15.135:0/2704729841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0544102220 msgr2=0x7f054419e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f0549c11640 1 --2- 172.21.15.135:0/2704729841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0544102220 0x7f054419e680 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f053400d770 tx=0x7f053400dc30 comp rx=0 tx=0).stop 2024-04-20T12:26:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f0549c11640 1 -- 172.21.15.135:0/2704729841 shutdown_connections 2024-04-20T12:26:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f0549c11640 1 --2- 172.21.15.135:0/2704729841 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f05300a3d20 0x7f05300a61e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f0549c11640 1 --2- 172.21.15.135:0/2704729841 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0544198790 0x7f0544198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f0549c11640 1 --2- 172.21.15.135:0/2704729841 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f05441072f0 0x7f054419ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f0549c11640 1 --2- 172.21.15.135:0/2704729841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0544102220 0x7f054419e680 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f0549c11640 1 -- 172.21.15.135:0/2704729841 >> 172.21.15.135:0/2704729841 conn(0x7f05440fdac0 msgr2=0x7f05440ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:28.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f0549c11640 1 -- 172.21.15.135:0/2704729841 shutdown_connections 2024-04-20T12:26:28.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.515+0000 7f0549c11640 1 -- 172.21.15.135:0/2704729841 wait complete. 2024-04-20T12:26:28.525 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:28 smithi135 ceph-mon[18264]: pgmap v103: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:28.526 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:26:28.526 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:26:28.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:28 smithi139 ceph-mon[21834]: pgmap v103: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.625+0000 7fa464414640 1 -- 172.21.15.135:0/3978292622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c102b50 msgr2=0x7fa45c106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.625+0000 7fa464414640 1 --2- 172.21.15.135:0/3978292622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c102b50 0x7fa45c106b90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa458009900 tx=0x7fa45802bc30 comp rx=0 tx=0).stop 2024-04-20T12:26:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.625+0000 7fa464414640 1 -- 172.21.15.135:0/3978292622 shutdown_connections 2024-04-20T12:26:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.625+0000 7fa464414640 1 --2- 172.21.15.135:0/3978292622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa45c107270 0x7fa45c10ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.625+0000 7fa464414640 1 --2- 172.21.15.135:0/3978292622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c102b50 0x7fa45c106b90 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.625+0000 7fa464414640 1 --2- 172.21.15.135:0/3978292622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa45c1021a0 0x7fa45c102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.625+0000 7fa464414640 1 -- 172.21.15.135:0/3978292622 >> 172.21.15.135:0/3978292622 conn(0x7fa45c079320 msgr2=0x7fa45c079730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.625+0000 7fa464414640 1 -- 172.21.15.135:0/3978292622 shutdown_connections 2024-04-20T12:26:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.625+0000 7fa464414640 1 -- 172.21.15.135:0/3978292622 wait complete. 2024-04-20T12:26:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.625+0000 7fa464414640 1 Processor -- start 2024-04-20T12:26:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.625+0000 7fa464414640 1 -- start start 2024-04-20T12:26:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa464414640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa45c1021a0 0x7fa45c19e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa464414640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa45c107270 0x7fa45c19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa464414640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c198660 0x7fa45c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa464414640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c112300 con 0x7fa45c198660 2024-04-20T12:26:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa464414640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c112180 con 0x7fa45c1021a0 2024-04-20T12:26:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa464414640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa45c112480 con 0x7fa45c107270 2024-04-20T12:26:28.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa4629b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c198660 0x7fa45c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa4629b1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c198660 0x7fa45c198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41542/0 (socket says 172.21.15.135:41542) 2024-04-20T12:26:28.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa4629b1640 1 -- 172.21.15.135:0/2406845966 learned_addr learned my addr 172.21.15.135:0/2406845966 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:28.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa4619af640 1 --2- 172.21.15.135:0/2406845966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa45c107270 0x7fa45c19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa4621b0640 1 --2- 172.21.15.135:0/2406845966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa45c1021a0 0x7fa45c19e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa4629b1640 1 -- 172.21.15.135:0/2406845966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa45c107270 msgr2=0x7fa45c19eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa4629b1640 1 --2- 172.21.15.135:0/2406845966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa45c107270 0x7fa45c19eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa4629b1640 1 -- 172.21.15.135:0/2406845966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa45c1021a0 msgr2=0x7fa45c19e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa4629b1640 1 --2- 172.21.15.135:0/2406845966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa45c1021a0 0x7fa45c19e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa4629b1640 1 -- 172.21.15.135:0/2406845966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45c199260 con 0x7fa45c198660 2024-04-20T12:26:28.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa4621b0640 1 --2- 172.21.15.135:0/2406845966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa45c1021a0 0x7fa45c19e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:26:28.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa4629b1640 1 --2- 172.21.15.135:0/2406845966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c198660 0x7fa45c198ae0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa45400eb10 tx=0x7fa45400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:28.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa4537fe640 1 -- 172.21.15.135:0/2406845966 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454004b20 con 0x7fa45c198660 2024-04-20T12:26:28.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa464414640 1 -- 172.21.15.135:0/2406845966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa45c1a5340 con 0x7fa45c198660 2024-04-20T12:26:28.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa4537fe640 1 -- 172.21.15.135:0/2406845966 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa454004cc0 con 0x7fa45c198660 2024-04-20T12:26:28.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa4537fe640 1 -- 172.21.15.135:0/2406845966 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa454010760 con 0x7fa45c198660 2024-04-20T12:26:28.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.626+0000 7fa464414640 1 -- 172.21.15.135:0/2406845966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa45c1a56f0 con 0x7fa45c198660 2024-04-20T12:26:28.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.627+0000 7fa464414640 1 -- 172.21.15.135:0/2406845966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa45c103670 con 0x7fa45c198660 2024-04-20T12:26:28.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.628+0000 7fa4537fe640 1 -- 172.21.15.135:0/2406845966 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fa454005020 con 0x7fa45c198660 2024-04-20T12:26:28.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.629+0000 7fa4537fe640 1 --2- 172.21.15.135:0/2406845966 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa4480a3d20 0x7fa4480a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.629+0000 7fa4621b0640 1 --2- 172.21.15.135:0/2406845966 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa4480a3d20 0x7fa4480a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.629+0000 7fa4537fe640 1 -- 172.21.15.135:0/2406845966 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fa4540d1260 con 0x7fa45c198660 2024-04-20T12:26:28.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.629+0000 7fa4621b0640 1 --2- 172.21.15.135:0/2406845966 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa4480a3d20 0x7fa4480a61e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009b40 tx=0x7fa44c005e50 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:28.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.633+0000 7fa4537fe640 1 -- 172.21.15.135:0/2406845966 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fa45409d580 con 0x7fa45c198660 2024-04-20T12:26:28.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.850+0000 7fa464414640 1 -- 172.21.15.135:0/2406845966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa45c10a4a0 con 0x7fa45c198660 2024-04-20T12:26:28.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.851+0000 7fa4537fe640 1 -- 172.21.15.135:0/2406845966 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7fa45409ce80 con 0x7fa45c198660 2024-04-20T12:26:28.851 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:26:28.851 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:26:28.851 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:26:28.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.853+0000 7fa464414640 1 -- 172.21.15.135:0/2406845966 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa4480a3d20 msgr2=0x7fa4480a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.853+0000 7fa464414640 1 --2- 172.21.15.135:0/2406845966 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa4480a3d20 0x7fa4480a61e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009b40 tx=0x7fa44c005e50 comp rx=0 tx=0).stop 2024-04-20T12:26:28.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.853+0000 7fa464414640 1 -- 172.21.15.135:0/2406845966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c198660 msgr2=0x7fa45c198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.853+0000 7fa464414640 1 --2- 172.21.15.135:0/2406845966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c198660 0x7fa45c198ae0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa45400eb10 tx=0x7fa45400c2d0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.853+0000 7fa464414640 1 -- 172.21.15.135:0/2406845966 shutdown_connections 2024-04-20T12:26:28.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.853+0000 7fa464414640 1 --2- 172.21.15.135:0/2406845966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa45c198660 0x7fa45c198ae0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.853+0000 7fa464414640 1 --2- 172.21.15.135:0/2406845966 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa4480a3d20 0x7fa4480a61e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.853+0000 7fa464414640 1 --2- 172.21.15.135:0/2406845966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa45c107270 0x7fa45c19eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.853+0000 7fa464414640 1 --2- 172.21.15.135:0/2406845966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa45c1021a0 0x7fa45c19e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.853+0000 7fa464414640 1 -- 172.21.15.135:0/2406845966 >> 172.21.15.135:0/2406845966 conn(0x7fa45c079320 msgr2=0x7fa45c100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:28.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.853+0000 7fa464414640 1 -- 172.21.15.135:0/2406845966 shutdown_connections 2024-04-20T12:26:28.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.853+0000 7fa464414640 1 -- 172.21.15.135:0/2406845966 wait complete. 2024-04-20T12:26:28.864 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:26:28.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.965+0000 7f7845f7e640 1 -- 172.21.15.135:0/429137975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78401021e0 msgr2=0x7f7840105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.965+0000 7f7845f7e640 1 --2- 172.21.15.135:0/429137975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78401021e0 0x7f7840105a90 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7834009900 tx=0x7f783402bc30 comp rx=0 tx=0).stop 2024-04-20T12:26:28.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.965+0000 7f7845f7e640 1 -- 172.21.15.135:0/429137975 shutdown_connections 2024-04-20T12:26:28.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.965+0000 7f7845f7e640 1 --2- 172.21.15.135:0/429137975 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7840106170 0x7f784010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.965+0000 7f7845f7e640 1 --2- 172.21.15.135:0/429137975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78401021e0 0x7f7840105a90 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.965+0000 7f7845f7e640 1 --2- 172.21.15.135:0/429137975 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7840101830 0x7f7840101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.965+0000 7f7845f7e640 1 -- 172.21.15.135:0/429137975 >> 172.21.15.135:0/429137975 conn(0x7f7840077370 msgr2=0x7f78400fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:28.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.965+0000 7f7845f7e640 1 -- 172.21.15.135:0/429137975 shutdown_connections 2024-04-20T12:26:28.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.965+0000 7f7845f7e640 1 -- 172.21.15.135:0/429137975 wait complete. 2024-04-20T12:26:28.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.965+0000 7f7845f7e640 1 Processor -- start 2024-04-20T12:26:28.967 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f7845f7e640 1 -- start start 2024-04-20T12:26:28.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f7845f7e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7840101830 0x7f784019e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f7845f7e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840106170 0x7f784019eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f7845f7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7840198700 0x7f7840198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f7845f7e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7840112340 con 0x7f7840106170 2024-04-20T12:26:28.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f7845f7e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f78401121c0 con 0x7f7840101830 2024-04-20T12:26:28.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f7845f7e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78401124c0 con 0x7f7840198700 2024-04-20T12:26:28.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f783effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840106170 0x7f784019eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f783effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840106170 0x7f784019eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41570/0 (socket says 172.21.15.135:41570) 2024-04-20T12:26:28.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f783effd640 1 -- 172.21.15.135:0/1557691719 learned_addr learned my addr 172.21.15.135:0/1557691719 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:28.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f783f7fe640 1 --2- 172.21.15.135:0/1557691719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7840101830 0x7f784019e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f783ffff640 1 --2- 172.21.15.135:0/1557691719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7840198700 0x7f7840198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f783effd640 1 -- 172.21.15.135:0/1557691719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7840198700 msgr2=0x7f7840198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f783effd640 1 --2- 172.21.15.135:0/1557691719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7840198700 0x7f7840198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f783effd640 1 -- 172.21.15.135:0/1557691719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7840101830 msgr2=0x7f784019e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f783effd640 1 --2- 172.21.15.135:0/1557691719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7840101830 0x7f784019e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f783effd640 1 -- 172.21.15.135:0/1557691719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7840199300 con 0x7f7840106170 2024-04-20T12:26:28.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.966+0000 7f783effd640 1 --2- 172.21.15.135:0/1557691719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840106170 0x7f784019eae0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7834036040 tx=0x7f783402ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:28.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.967+0000 7f783cff9640 1 -- 172.21.15.135:0/1557691719 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834041070 con 0x7f7840106170 2024-04-20T12:26:28.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.967+0000 7f7845f7e640 1 -- 172.21.15.135:0/1557691719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7840199590 con 0x7f7840106170 2024-04-20T12:26:28.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.967+0000 7f783cff9640 1 -- 172.21.15.135:0/1557691719 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78340054e0 con 0x7f7840106170 2024-04-20T12:26:28.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.967+0000 7f783cff9640 1 -- 172.21.15.135:0/1557691719 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834034440 con 0x7f7840106170 2024-04-20T12:26:28.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.967+0000 7f7845f7e640 1 -- 172.21.15.135:0/1557691719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78401a5630 con 0x7f7840106170 2024-04-20T12:26:28.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.969+0000 7f783cff9640 1 -- 172.21.15.135:0/1557691719 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f7834044070 con 0x7f7840106170 2024-04-20T12:26:28.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.969+0000 7f7848b68740 1 Processor -- start 2024-04-20T12:26:28.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.969+0000 7f7848b68740 1 -- start start 2024-04-20T12:26:28.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.969+0000 7f783cff9640 1 --2- 172.21.15.135:0/1557691719 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78280a3d20 0x7f78280a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f7848b68740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb3e10 0x562a95fb41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f7848b68740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fb4730 0x562a95fbcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f7848b68740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fbd310 0x562a95fbf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f7848b68740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562a95f19110 con 0x562a95fb3e10 2024-04-20T12:26:28.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f7848b68740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562a95eb6550 con 0x562a95fbd310 2024-04-20T12:26:28.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f7848b68740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562a95f150d0 con 0x562a95fb4730 2024-04-20T12:26:28.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f783ffff640 1 --2- 172.21.15.135:0/1557691719 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78280a3d20 0x7f78280a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f783f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb3e10 0x562a95fb41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f783cff9640 1 -- 172.21.15.135:0/1557691719 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f78340f2740 con 0x7f7840106170 2024-04-20T12:26:28.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f783f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb3e10 0x562a95fb41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41586/0 (socket says 172.21.15.135:41586) 2024-04-20T12:26:28.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f783f7fe640 1 -- 172.21.15.135:0/3251811620 learned_addr learned my addr 172.21.15.135:0/3251811620 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:28.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f783effd640 1 --2- 172.21.15.135:0/3251811620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fb4730 0x562a95fbcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f783ffff640 1 --2- 172.21.15.135:0/3251811620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fbd310 0x562a95fbf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f783f7fe640 1 -- 172.21.15.135:0/3251811620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fb4730 msgr2=0x562a95fbcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f783f7fe640 1 --2- 172.21.15.135:0/3251811620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fb4730 0x562a95fbcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f783f7fe640 1 -- 172.21.15.135:0/3251811620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fbd310 msgr2=0x562a95fbf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f783f7fe640 1 --2- 172.21.15.135:0/3251811620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fbd310 0x562a95fbf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f783f7fe640 1 -- 172.21.15.135:0/3251811620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a95ede900 con 0x562a95fb3e10 2024-04-20T12:26:28.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f783ffff640 1 --2- 172.21.15.135:0/1557691719 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78280a3d20 0x7f78280a61e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7838005cc0 tx=0x7f7838012960 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:28.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f783f7fe640 1 --2- 172.21.15.135:0/3251811620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb3e10 0x562a95fb41f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f783000bcb0 tx=0x7f783000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5bf057b294ec4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:28.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f7825ffb640 1 -- 172.21.15.135:0/3251811620 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830015070 con 0x562a95fb3e10 2024-04-20T12:26:28.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f7825ffb640 1 -- 172.21.15.135:0/3251811620 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f783001a940 con 0x562a95fb3e10 2024-04-20T12:26:28.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.970+0000 7f7825ffb640 1 -- 172.21.15.135:0/3251811620 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830011900 con 0x562a95fb3e10 2024-04-20T12:26:28.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.971+0000 7f7848b68740 1 -- 172.21.15.135:0/3251811620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb3e10 msgr2=0x562a95fb41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.971+0000 7f7848b68740 1 --2- 172.21.15.135:0/3251811620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb3e10 0x562a95fb41f0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f783000bcb0 tx=0x7f783000f730 comp rx=0 tx=0).stop 2024-04-20T12:26:28.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.971+0000 7f7848b68740 1 -- 172.21.15.135:0/3251811620 shutdown_connections 2024-04-20T12:26:28.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.971+0000 7f7848b68740 1 --2- 172.21.15.135:0/3251811620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fbd310 0x562a95fbf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.971+0000 7f7848b68740 1 --2- 172.21.15.135:0/3251811620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fb4730 0x562a95fbcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.971+0000 7f7848b68740 1 --2- 172.21.15.135:0/3251811620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb3e10 0x562a95fb41f0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.971+0000 7f7848b68740 1 -- 172.21.15.135:0/3251811620 >> 172.21.15.135:0/3251811620 conn(0x562a95fae540 msgr2=0x562a95fae920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:28.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.971+0000 7f7848b68740 1 -- 172.21.15.135:0/3251811620 shutdown_connections 2024-04-20T12:26:28.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.971+0000 7f7848b68740 1 -- 172.21.15.135:0/3251811620 wait complete. 2024-04-20T12:26:28.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.971+0000 7f7848b68740 1 -- start start 2024-04-20T12:26:28.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f7848b68740 1 Processor -- start 2024-04-20T12:26:28.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f7848b68740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fb3e10 0x562a95fba450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f7848b68740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb4730 0x562a95fba990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f7848b68740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fbd310 0x562a95fbaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f7848b68740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562a95fc00a0 con 0x562a95fb4730 2024-04-20T12:26:28.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f7848b68740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562a95ed2500 con 0x562a95fb3e10 2024-04-20T12:26:28.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f7848b68740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562a95fc0220 con 0x562a95fbd310 2024-04-20T12:26:28.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f7848b68740 10 client.0 _ll_register_callbacks cb 0x562a95eb72f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:28.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f783effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb4730 0x562a95fba990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f783effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb4730 0x562a95fba990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41588/0 (socket says 172.21.15.135:41588) 2024-04-20T12:26:28.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f783effd640 1 -- 172.21.15.135:0/3968366822 learned_addr learned my addr 172.21.15.135:0/3968366822 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:28.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f783f7fe640 1 --2- 172.21.15.135:0/3968366822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fb3e10 0x562a95fba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f783ffff640 1 --2- 172.21.15.135:0/3968366822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fbd310 0x562a95fbaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f783effd640 1 -- 172.21.15.135:0/3968366822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fbd310 msgr2=0x562a95fbaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f783effd640 1 --2- 172.21.15.135:0/3968366822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fbd310 0x562a95fbaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f783effd640 1 -- 172.21.15.135:0/3968366822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fb3e10 msgr2=0x562a95fba450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f783effd640 1 --2- 172.21.15.135:0/3968366822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fb3e10 0x562a95fba450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f783effd640 1 -- 172.21.15.135:0/3968366822 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a95c2b3f0 con 0x562a95fb4730 2024-04-20T12:26:28.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f783ffff640 1 --2- 172.21.15.135:0/3968366822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fbd310 0x562a95fbaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:26:28.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f783effd640 1 --2- 172.21.15.135:0/3968366822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb4730 0x562a95fba990 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f78340efc80 tx=0x7f78340be040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddc148f0025ee46 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:28.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.972+0000 7f781effd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:28.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.973+0000 7f781effd640 1 -- 172.21.15.135:0/3968366822 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783404b070 con 0x562a95fb4730 2024-04-20T12:26:28.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.973+0000 7f781effd640 1 -- 172.21.15.135:0/3968366822 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f78340a23c0 con 0x562a95fb4730 2024-04-20T12:26:28.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.973+0000 7f7848b68740 1 -- 172.21.15.135:0/3968366822 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f783001a940 con 0x562a95fb4730 2024-04-20T12:26:28.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.973+0000 7f781effd640 1 -- 172.21.15.135:0/3968366822 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7834005690 con 0x562a95fb4730 2024-04-20T12:26:28.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.973+0000 7f7848b68740 10 client.16743 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:28.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.973+0000 7f7848b68740 1 -- 172.21.15.135:0/3968366822 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562a95cf57d0 con 0x562a95fb4730 2024-04-20T12:26:28.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.973+0000 7f781effd640 1 -- 172.21.15.135:0/3968366822 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f783001a940 con 0x562a95fb4730 2024-04-20T12:26:28.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.973+0000 7f781effd640 1 -- 172.21.15.135:0/3968366822 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f78340035f0 con 0x562a95fb4730 2024-04-20T12:26:28.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.973+0000 7f7848b68740 10 client.16743 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:28.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.973+0000 7f7848b68740 10 client.16743 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:26:28.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.973+0000 7f7848b68740 20 client.16743 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:28.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.973+0000 7f7848b68740 1 --2- 172.21.15.135:0/3968366822 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x562a95fcd6a0 0x562a95fcfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.973+0000 7f7848b68740 4 client.16743 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:26:28.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.973+0000 7f7848b68740 1 -- 172.21.15.135:0/3968366822 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a95f26b30 con 0x562a95fcd6a0 2024-04-20T12:26:28.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.973+0000 7f783f7fe640 1 --2- 172.21.15.135:0/3968366822 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x562a95fcd6a0 0x562a95fcfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f783f7fe640 1 --2- 172.21.15.135:0/3968366822 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x562a95fcd6a0 0x562a95fcfab0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d75bddaec3020efb server_cookie=c2c2ce507be62d09 in_seq=0 out_seq=0 2024-04-20T12:26:28.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f781effd640 10 client.16743 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:26:28.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f781effd640 1 -- 172.21.15.135:0/3968366822 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562a95f26b30 con 0x562a95fcd6a0 2024-04-20T12:26:28.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f781effd640 10 client.16743 handle_command_reply: tid=0 2024-04-20T12:26:28.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f7848b68740 1 client.16743 shutdown 2024-04-20T12:26:28.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f7848b68740 1 -- 172.21.15.135:0/3968366822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb4730 msgr2=0x562a95fba990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f7848b68740 1 --2- 172.21.15.135:0/3968366822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb4730 0x562a95fba990 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f78340efc80 tx=0x7f78340be040 comp rx=0 tx=0).stop 2024-04-20T12:26:28.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f7848b68740 1 -- 172.21.15.135:0/3968366822 shutdown_connections 2024-04-20T12:26:28.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f7848b68740 1 --2- 172.21.15.135:0/3968366822 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x562a95fcd6a0 0x562a95fcfab0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f7848b68740 1 --2- 172.21.15.135:0/3968366822 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fbd310 0x562a95fbaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f7848b68740 1 --2- 172.21.15.135:0/3968366822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb4730 0x562a95fba990 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f781effd640 0 client.16743 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:26:28.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f7848b68740 1 --2- 172.21.15.135:0/3968366822 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fb3e10 0x562a95fba450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f7848b68740 1 -- 172.21.15.135:0/3968366822 >> 172.21.15.135:0/3968366822 conn(0x562a95fae540 msgr2=0x562a95fb0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:28.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f7848b68740 1 -- 172.21.15.135:0/3968366822 shutdown_connections 2024-04-20T12:26:28.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.974+0000 7f7848b68740 1 -- 172.21.15.135:0/3968366822 wait complete. 2024-04-20T12:26:28.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.975+0000 7f7848b68740 20 client.16743 trim_cache size 0 max 16384 2024-04-20T12:26:28.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f7848b68740 1 Processor -- start 2024-04-20T12:26:28.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f7848b68740 1 -- start start 2024-04-20T12:26:28.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f7848b68740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fb3e10 0x562a95fc8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f7848b68740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb4730 0x562a95fd53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f7848b68740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fbd310 0x562a95fd5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f7848b68740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f78401af380 con 0x562a95fb4730 2024-04-20T12:26:28.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f7848b68740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f78401b0ec0 con 0x562a95fbd310 2024-04-20T12:26:28.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f7848b68740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78401afa50 con 0x562a95fb3e10 2024-04-20T12:26:28.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f783effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb4730 0x562a95fd53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f783effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb4730 0x562a95fd53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41594/0 (socket says 172.21.15.135:41594) 2024-04-20T12:26:28.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f783effd640 1 -- 172.21.15.135:0/1843773865 learned_addr learned my addr 172.21.15.135:0/1843773865 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:28.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f783effd640 1 -- 172.21.15.135:0/1843773865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fb3e10 msgr2=0x562a95fc8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f783effd640 1 --2- 172.21.15.135:0/1843773865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fb3e10 0x562a95fc8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f783effd640 1 -- 172.21.15.135:0/1843773865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fbd310 msgr2=0x562a95fd5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f783effd640 1 --2- 172.21.15.135:0/1843773865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fbd310 0x562a95fd5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f783effd640 1 -- 172.21.15.135:0/1843773865 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a95fa9e10 con 0x562a95fb4730 2024-04-20T12:26:28.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f783effd640 1 --2- 172.21.15.135:0/1843773865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb4730 0x562a95fd53c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f78340f0110 tx=0x7f7834041f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b679902773eaaa48 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:28.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.988+0000 7f78257fa640 1 -- 172.21.15.135:0/1843773865 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783404b070 con 0x562a95fb4730 2024-04-20T12:26:28.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.989+0000 7f78257fa640 1 -- 172.21.15.135:0/1843773865 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78340bec00 con 0x562a95fb4730 2024-04-20T12:26:28.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.989+0000 7f78257fa640 1 -- 172.21.15.135:0/1843773865 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78340be500 con 0x562a95fb4730 2024-04-20T12:26:28.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.989+0000 7f7848b68740 1 -- 172.21.15.135:0/1843773865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb4730 msgr2=0x562a95fd53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.989+0000 7f7848b68740 1 --2- 172.21.15.135:0/1843773865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb4730 0x562a95fd53c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f78340f0110 tx=0x7f7834041f80 comp rx=0 tx=0).stop 2024-04-20T12:26:28.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.989+0000 7f7848b68740 1 -- 172.21.15.135:0/1843773865 shutdown_connections 2024-04-20T12:26:28.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.989+0000 7f7848b68740 1 --2- 172.21.15.135:0/1843773865 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fbd310 0x562a95fd5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.989+0000 7f7848b68740 1 --2- 172.21.15.135:0/1843773865 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fb4730 0x562a95fd53c0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.989+0000 7f7848b68740 1 --2- 172.21.15.135:0/1843773865 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fb3e10 0x562a95fc8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.989+0000 7f7848b68740 1 -- 172.21.15.135:0/1843773865 >> 172.21.15.135:0/1843773865 conn(0x562a95fae540 msgr2=0x562a95fa9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:28.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.989+0000 7f7848b68740 1 -- 172.21.15.135:0/1843773865 shutdown_connections 2024-04-20T12:26:28.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.989+0000 7f7848b68740 1 -- 172.21.15.135:0/1843773865 wait complete. 2024-04-20T12:26:28.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.989+0000 7f7848b68740 1 -- start start 2024-04-20T12:26:28.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f7848b68740 1 Processor -- start 2024-04-20T12:26:28.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f7848b68740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fb3e10 0x562a95fc5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f7848b68740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fb4730 0x562a95fc59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f7848b68740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fbd310 0x562a95fb6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f7848b68740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f78401b07f0 con 0x562a95fbd310 2024-04-20T12:26:28.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f7848b68740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f78401b0120 con 0x562a95fb3e10 2024-04-20T12:26:28.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f7848b68740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78401ad350 con 0x562a95fb4730 2024-04-20T12:26:28.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f7848b68740 10 client.0 _ll_register_callbacks cb 0x7f78340ba0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:28.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f783ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fbd310 0x562a95fb6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f783ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fbd310 0x562a95fb6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41606/0 (socket says 172.21.15.135:41606) 2024-04-20T12:26:28.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f783ffff640 1 -- 172.21.15.135:0/3735831679 learned_addr learned my addr 172.21.15.135:0/3735831679 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:28.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f783effd640 1 --2- 172.21.15.135:0/3735831679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fb4730 0x562a95fc59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f783f7fe640 1 --2- 172.21.15.135:0/3735831679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fb3e10 0x562a95fc5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f783ffff640 1 -- 172.21.15.135:0/3735831679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fb4730 msgr2=0x562a95fc59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f783ffff640 1 --2- 172.21.15.135:0/3735831679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fb4730 0x562a95fc59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f783ffff640 1 -- 172.21.15.135:0/3735831679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fb3e10 msgr2=0x562a95fc5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:28.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f783ffff640 1 --2- 172.21.15.135:0/3735831679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fb3e10 0x562a95fc5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f783ffff640 1 -- 172.21.15.135:0/3735831679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a95fb71f0 con 0x562a95fbd310 2024-04-20T12:26:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f783f7fe640 1 --2- 172.21.15.135:0/3735831679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fb3e10 0x562a95fc5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:26:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f783ffff640 1 --2- 172.21.15.135:0/3735831679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fbd310 0x562a95fb6ab0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7838012e60 tx=0x7f7838004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7dacc32bbc03b96 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.990+0000 7f781effd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.991+0000 7f781effd640 1 -- 172.21.15.135:0/3735831679 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838024070 con 0x562a95fbd310 2024-04-20T12:26:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.991+0000 7f781effd640 1 -- 172.21.15.135:0/3735831679 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f7838003970 con 0x562a95fbd310 2024-04-20T12:26:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.991+0000 7f7848b68740 1 -- 172.21.15.135:0/3735831679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78340bec00 con 0x562a95fbd310 2024-04-20T12:26:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.991+0000 7f781effd640 1 -- 172.21.15.135:0/3735831679 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7838003b70 con 0x562a95fbd310 2024-04-20T12:26:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.991+0000 7f7848b68740 10 client.16749 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.991+0000 7f7848b68740 1 -- 172.21.15.135:0/3735831679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562a96033630 con 0x562a95fbd310 2024-04-20T12:26:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.991+0000 7f781effd640 1 -- 172.21.15.135:0/3735831679 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78340bec00 con 0x562a95fbd310 2024-04-20T12:26:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.991+0000 7f781effd640 1 -- 172.21.15.135:0/3735831679 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f7838020490 con 0x562a95fbd310 2024-04-20T12:26:28.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.991+0000 7f7848b68740 10 client.16749 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.991+0000 7f7848b68740 10 client.16749 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:26:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.991+0000 7f7848b68740 20 client.16749 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.991+0000 7f7848b68740 1 --2- 172.21.15.135:0/3735831679 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x562a96033db0 0x562a960361d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.991+0000 7f7848b68740 4 client.16749 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:26:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.991+0000 7f7848b68740 1 -- 172.21.15.135:0/3735831679 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562a95f209a0 con 0x562a96033db0 2024-04-20T12:26:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.991+0000 7f783f7fe640 1 --2- 172.21.15.135:0/3735831679 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x562a96033db0 0x562a960361d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f781effd640 10 client.16749 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:26:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f783f7fe640 1 --2- 172.21.15.135:0/3735831679 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x562a96033db0 0x562a960361d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7a52b517ae9566a8 server_cookie=dc0a6cb6f0a88418 in_seq=0 out_seq=0 2024-04-20T12:26:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f781effd640 1 -- 172.21.15.135:0/3735831679 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562a95f209a0 con 0x562a96033db0 2024-04-20T12:26:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f781effd640 10 client.16749 handle_command_reply: tid=0 2024-04-20T12:26:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f7848b68740 1 client.16749 shutdown 2024-04-20T12:26:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f7848b68740 1 -- 172.21.15.135:0/3735831679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fbd310 msgr2=0x562a95fb6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f7848b68740 1 --2- 172.21.15.135:0/3735831679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fbd310 0x562a95fb6ab0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7838012e60 tx=0x7f7838004ab0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f7848b68740 1 -- 172.21.15.135:0/3735831679 shutdown_connections 2024-04-20T12:26:28.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f7848b68740 1 --2- 172.21.15.135:0/3735831679 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x562a96033db0 0x562a960361d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f7848b68740 1 --2- 172.21.15.135:0/3735831679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562a95fbd310 0x562a95fb6ab0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f781effd640 0 client.16749 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:26:28.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f7848b68740 1 --2- 172.21.15.135:0/3735831679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562a95fb4730 0x562a95fc59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f7848b68740 1 --2- 172.21.15.135:0/3735831679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562a95fb3e10 0x562a95fc5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:28.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f7848b68740 1 -- 172.21.15.135:0/3735831679 >> 172.21.15.135:0/3735831679 conn(0x562a95fae540 msgr2=0x562a95fb8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:28.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f7848b68740 1 -- 172.21.15.135:0/3735831679 shutdown_connections 2024-04-20T12:26:28.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f7848b68740 1 -- 172.21.15.135:0/3735831679 wait complete. 2024-04-20T12:26:28.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.992+0000 7f7848b68740 20 client.16749 trim_cache size 0 max 16384 2024-04-20T12:26:28.999 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:26:29.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.993+0000 7f7845f7e640 1 -- 172.21.15.135:0/1557691719 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78280a3d20 msgr2=0x7f78280a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.993+0000 7f7845f7e640 1 --2- 172.21.15.135:0/1557691719 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78280a3d20 0x7f78280a61e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7838005cc0 tx=0x7f7838012960 comp rx=0 tx=0).stop 2024-04-20T12:26:29.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.993+0000 7f7845f7e640 1 -- 172.21.15.135:0/1557691719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840106170 msgr2=0x7f784019eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.993+0000 7f7845f7e640 1 --2- 172.21.15.135:0/1557691719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840106170 0x7f784019eae0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f7834036040 tx=0x7f783402ce20 comp rx=0 tx=0).stop 2024-04-20T12:26:29.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.993+0000 7f7845f7e640 1 -- 172.21.15.135:0/1557691719 shutdown_connections 2024-04-20T12:26:29.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.993+0000 7f7845f7e640 1 --2- 172.21.15.135:0/1557691719 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78280a3d20 0x7f78280a61e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.993+0000 7f7845f7e640 1 --2- 172.21.15.135:0/1557691719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7840198700 0x7f7840198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.993+0000 7f7845f7e640 1 --2- 172.21.15.135:0/1557691719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7840106170 0x7f784019eae0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.993+0000 7f7845f7e640 1 --2- 172.21.15.135:0/1557691719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7840101830 0x7f784019e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.993+0000 7f7845f7e640 1 -- 172.21.15.135:0/1557691719 >> 172.21.15.135:0/1557691719 conn(0x7f7840077370 msgr2=0x7f7840104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.993+0000 7f7845f7e640 1 -- 172.21.15.135:0/1557691719 shutdown_connections 2024-04-20T12:26:29.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:28.993+0000 7f7845f7e640 1 -- 172.21.15.135:0/1557691719 wait complete. 2024-04-20T12:26:29.003 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:26:29.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.104+0000 7fe87c500640 1 -- 172.21.15.135:0/789605788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe874101090 msgr2=0x7fe874101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.104+0000 7fe87c500640 1 --2- 172.21.15.135:0/789605788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe874101090 0x7fe874101470 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fe870009900 tx=0x7fe87002bc30 comp rx=0 tx=0).stop 2024-04-20T12:26:29.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.105+0000 7fe87c500640 1 -- 172.21.15.135:0/789605788 shutdown_connections 2024-04-20T12:26:29.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.105+0000 7fe87c500640 1 --2- 172.21.15.135:0/789605788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe874106160 0x7fe87410dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.105+0000 7fe87c500640 1 --2- 172.21.15.135:0/789605788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe874101a40 0x7fe874105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.105+0000 7fe87c500640 1 --2- 172.21.15.135:0/789605788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe874101090 0x7fe874101470 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.105+0000 7fe87c500640 1 -- 172.21.15.135:0/789605788 >> 172.21.15.135:0/789605788 conn(0x7fe874078010 msgr2=0x7fe874078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.105+0000 7fe87c500640 1 -- 172.21.15.135:0/789605788 shutdown_connections 2024-04-20T12:26:29.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.105+0000 7fe87c500640 1 -- 172.21.15.135:0/789605788 wait complete. 2024-04-20T12:26:29.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.105+0000 7fe87c500640 1 Processor -- start 2024-04-20T12:26:29.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.105+0000 7fe87c500640 1 -- start start 2024-04-20T12:26:29.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.105+0000 7fe87c500640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe874101090 0x7fe874197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.105+0000 7fe87c500640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe874106160 0x7fe874197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.105+0000 7fe87c500640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87419bf00 0x7fe87419c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.105+0000 7fe87c500640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe874111220 con 0x7fe874106160 2024-04-20T12:26:29.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.105+0000 7fe87c500640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe8741110a0 con 0x7fe874101090 2024-04-20T12:26:29.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.105+0000 7fe87c500640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8741113a0 con 0x7fe87419bf00 2024-04-20T12:26:29.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe879a9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe874106160 0x7fe874197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe879a9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe874106160 0x7fe874197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41638/0 (socket says 172.21.15.135:41638) 2024-04-20T12:26:29.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe879a9b640 1 -- 172.21.15.135:0/3252843450 learned_addr learned my addr 172.21.15.135:0/3252843450 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe87a29c640 1 --2- 172.21.15.135:0/3252843450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe874101090 0x7fe874197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe87aa9d640 1 --2- 172.21.15.135:0/3252843450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87419bf00 0x7fe87419c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe879a9b640 1 -- 172.21.15.135:0/3252843450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87419bf00 msgr2=0x7fe87419c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe879a9b640 1 --2- 172.21.15.135:0/3252843450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87419bf00 0x7fe87419c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe879a9b640 1 -- 172.21.15.135:0/3252843450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe874101090 msgr2=0x7fe874197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe879a9b640 1 --2- 172.21.15.135:0/3252843450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe874101090 0x7fe874197640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe879a9b640 1 -- 172.21.15.135:0/3252843450 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87419c9f0 con 0x7fe874106160 2024-04-20T12:26:29.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe879a9b640 1 --2- 172.21.15.135:0/3252843450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe874106160 0x7fe874197b80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe86400c970 tx=0x7fe86400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe86b7fe640 1 -- 172.21.15.135:0/3252843450 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe864014070 con 0x7fe874106160 2024-04-20T12:26:29.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe86b7fe640 1 -- 172.21.15.135:0/3252843450 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe864004440 con 0x7fe874106160 2024-04-20T12:26:29.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe87c500640 1 -- 172.21.15.135:0/3252843450 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87419cce0 con 0x7fe874106160 2024-04-20T12:26:29.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe86b7fe640 1 -- 172.21.15.135:0/3252843450 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86400f450 con 0x7fe874106160 2024-04-20T12:26:29.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.106+0000 7fe87c500640 1 -- 172.21.15.135:0/3252843450 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8741a44d0 con 0x7fe874106160 2024-04-20T12:26:29.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.109+0000 7fe86b7fe640 1 -- 172.21.15.135:0/3252843450 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fe864017070 con 0x7fe874106160 2024-04-20T12:26:29.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.109+0000 7fe87f1cd740 1 Processor -- start 2024-04-20T12:26:29.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.109+0000 7fe87f1cd740 1 -- start start 2024-04-20T12:26:29.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.109+0000 7fe87f1cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9e970 0x558579c9ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.109+0000 7fe87f1cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9f290 0x558579caa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.109+0000 7fe87f1cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579cacd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.109+0000 7fe87f1cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558579c02110 con 0x558579caa910 2024-04-20T12:26:29.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.109+0000 7fe87f1cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558579b9f550 con 0x558579c9f290 2024-04-20T12:26:29.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.109+0000 7fe87f1cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558579bfe0d0 con 0x558579c9e970 2024-04-20T12:26:29.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.109+0000 7fe879a9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579cacd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe879a9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579cacd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41646/0 (socket says 172.21.15.135:41646) 2024-04-20T12:26:29.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe879a9b640 1 -- 172.21.15.135:0/1017488500 learned_addr learned my addr 172.21.15.135:0/1017488500 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe87aa9d640 1 --2- 172.21.15.135:0/1017488500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9e970 0x558579c9ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe87a29c640 1 --2- 172.21.15.135:0/1017488500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9f290 0x558579caa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe86b7fe640 1 --2- 172.21.15.135:0/3252843450 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe8600a3da0 0x7fe8600a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe879a9b640 1 -- 172.21.15.135:0/1017488500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9e970 msgr2=0x558579c9ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe879a9b640 1 --2- 172.21.15.135:0/1017488500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9e970 0x558579c9ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe879a9b640 1 -- 172.21.15.135:0/1017488500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9f290 msgr2=0x558579caa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe879a9b640 1 --2- 172.21.15.135:0/1017488500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9f290 0x558579caa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe879a9b640 1 -- 172.21.15.135:0/1017488500 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558579bc7900 con 0x558579caa910 2024-04-20T12:26:29.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe87aa9d640 1 --2- 172.21.15.135:0/3252843450 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe8600a3da0 0x7fe8600a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe86b7fe640 1 -- 172.21.15.135:0/3252843450 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe8640d0a10 con 0x7fe874106160 2024-04-20T12:26:29.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe879a9b640 1 --2- 172.21.15.135:0/1017488500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579cacd00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe8640cdcc0 tx=0x7fe8640c76e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece3989070dfd065 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe868bfe640 1 -- 172.21.15.135:0/1017488500 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86409c110 con 0x558579caa910 2024-04-20T12:26:29.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe87aa9d640 1 --2- 172.21.15.135:0/3252843450 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe8600a3da0 0x7fe8600a6260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe86c005fd0 tx=0x7fe86c004a40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe868bfe640 1 -- 172.21.15.135:0/1017488500 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8640667b0 con 0x558579caa910 2024-04-20T12:26:29.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.110+0000 7fe868bfe640 1 -- 172.21.15.135:0/1017488500 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8640a5490 con 0x558579caa910 2024-04-20T12:26:29.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.111+0000 7fe87f1cd740 1 -- 172.21.15.135:0/1017488500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 msgr2=0x558579cacd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.111+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/1017488500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579cacd00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe8640cdcc0 tx=0x7fe8640c76e0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.111+0000 7fe87f1cd740 1 -- 172.21.15.135:0/1017488500 shutdown_connections 2024-04-20T12:26:29.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.111+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/1017488500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579cacd00 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.111+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/1017488500 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9f290 0x558579caa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.111+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/1017488500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9e970 0x558579c9ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.111+0000 7fe87f1cd740 1 -- 172.21.15.135:0/1017488500 >> 172.21.15.135:0/1017488500 conn(0x558579c99750 msgr2=0x558579c99b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.111+0000 7fe87f1cd740 1 -- 172.21.15.135:0/1017488500 shutdown_connections 2024-04-20T12:26:29.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.111+0000 7fe87f1cd740 1 -- 172.21.15.135:0/1017488500 wait complete. 2024-04-20T12:26:29.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.111+0000 7fe87f1cd740 1 -- start start 2024-04-20T12:26:29.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.111+0000 7fe87f1cd740 1 Processor -- start 2024-04-20T12:26:29.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87f1cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9e970 0x558579ca7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87f1cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9f290 0x558579ca7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87f1cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579ca8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87f1cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558579cad480 con 0x558579caa910 2024-04-20T12:26:29.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87f1cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558579bbb500 con 0x558579c9e970 2024-04-20T12:26:29.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87f1cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558579cad600 con 0x558579c9f290 2024-04-20T12:26:29.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87f1cd740 10 client.0 _ll_register_callbacks cb 0x558579ba02f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:29.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87aa9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579ca8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87aa9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579ca8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41648/0 (socket says 172.21.15.135:41648) 2024-04-20T12:26:29.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87aa9d640 1 -- 172.21.15.135:0/3399474803 learned_addr learned my addr 172.21.15.135:0/3399474803 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87a29c640 1 --2- 172.21.15.135:0/3399474803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9e970 0x558579ca7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe879a9b640 1 --2- 172.21.15.135:0/3399474803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9f290 0x558579ca7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87aa9d640 1 -- 172.21.15.135:0/3399474803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9f290 msgr2=0x558579ca7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87aa9d640 1 --2- 172.21.15.135:0/3399474803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9f290 0x558579ca7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87aa9d640 1 -- 172.21.15.135:0/3399474803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9e970 msgr2=0x558579ca7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87aa9d640 1 --2- 172.21.15.135:0/3399474803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9e970 0x558579ca7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87aa9d640 1 -- 172.21.15.135:0/3399474803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585799143f0 con 0x558579caa910 2024-04-20T12:26:29.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe879a9b640 1 --2- 172.21.15.135:0/3399474803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9f290 0x558579ca7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:26:29.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87aa9d640 1 --2- 172.21.15.135:0/3399474803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579ca8390 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe86c012940 tx=0x7fe86c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c953336dc56b457 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe85dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:29.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe85dffb640 1 -- 172.21.15.135:0/3399474803 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c023070 con 0x558579caa910 2024-04-20T12:26:29.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe85dffb640 1 -- 172.21.15.135:0/3399474803 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe86c011cf0 con 0x558579caa910 2024-04-20T12:26:29.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.112+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3399474803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558579c0fb30 con 0x558579caa910 2024-04-20T12:26:29.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.113+0000 7fe85dffb640 1 -- 172.21.15.135:0/3399474803 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe86c02f050 con 0x558579caa910 2024-04-20T12:26:29.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.113+0000 7fe87f1cd740 10 client.16761 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:29.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.113+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3399474803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5585799de7d0 con 0x558579caa910 2024-04-20T12:26:29.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.113+0000 7fe85dffb640 1 -- 172.21.15.135:0/3399474803 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558579c0fb30 con 0x558579caa910 2024-04-20T12:26:29.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.113+0000 7fe85dffb640 1 -- 172.21.15.135:0/3399474803 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe86c00f040 con 0x558579caa910 2024-04-20T12:26:29.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.113+0000 7fe87f1cd740 10 client.16761 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:29.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.113+0000 7fe87f1cd740 10 client.16761 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:26:29.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.113+0000 7fe87f1cd740 20 client.16761 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:29.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.113+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/3399474803 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558579cbaa20 0x558579cbce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.113+0000 7fe87f1cd740 4 client.16761 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:26:29.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.113+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3399474803 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558579c099a0 con 0x558579cbaa20 2024-04-20T12:26:29.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.113+0000 7fe87a29c640 1 --2- 172.21.15.135:0/3399474803 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558579cbaa20 0x558579cbce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.114+0000 7fe87a29c640 1 --2- 172.21.15.135:0/3399474803 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558579cbaa20 0x558579cbce10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a043d5ee8a179406 server_cookie=65c63bc0dbe277c8 in_seq=0 out_seq=0 2024-04-20T12:26:29.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.114+0000 7fe85dffb640 10 client.16761 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:26:29.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.114+0000 7fe85dffb640 1 -- 172.21.15.135:0/3399474803 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558579c099a0 con 0x558579cbaa20 2024-04-20T12:26:29.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.114+0000 7fe85dffb640 10 client.16761 handle_command_reply: tid=0 2024-04-20T12:26:29.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.114+0000 7fe87f1cd740 1 client.16761 shutdown 2024-04-20T12:26:29.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.115+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3399474803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 msgr2=0x558579ca8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.115+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/3399474803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579ca8390 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe86c012940 tx=0x7fe86c004ab0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.115+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3399474803 shutdown_connections 2024-04-20T12:26:29.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.115+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/3399474803 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558579cbaa20 0x558579cbce10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.115+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/3399474803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579ca8390 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.115+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/3399474803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9f290 0x558579ca7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.115+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/3399474803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9e970 0x558579ca7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.115+0000 7fe85dffb640 0 client.16761 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:26:29.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.115+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3399474803 >> 172.21.15.135:0/3399474803 conn(0x558579c99750 msgr2=0x558579c9b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.115+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3399474803 shutdown_connections 2024-04-20T12:26:29.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.115+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3399474803 wait complete. 2024-04-20T12:26:29.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.115+0000 7fe87f1cd740 20 client.16761 trim_cache size 0 max 16384 2024-04-20T12:26:29.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87f1cd740 1 Processor -- start 2024-04-20T12:26:29.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87f1cd740 1 -- start start 2024-04-20T12:26:29.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87f1cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9e970 0x558579caa040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87f1cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9f290 0x558579cb6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87f1cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579ca53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87f1cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe8741ad120 con 0x558579caa910 2024-04-20T12:26:29.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87f1cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe8741aec60 con 0x558579c9e970 2024-04-20T12:26:29.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87f1cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8741ad7f0 con 0x558579c9f290 2024-04-20T12:26:29.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87aa9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579ca53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87aa9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579ca53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41654/0 (socket says 172.21.15.135:41654) 2024-04-20T12:26:29.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87aa9d640 1 -- 172.21.15.135:0/1128448658 learned_addr learned my addr 172.21.15.135:0/1128448658 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87a29c640 1 --2- 172.21.15.135:0/1128448658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9e970 0x558579caa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87aa9d640 1 -- 172.21.15.135:0/1128448658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9f290 msgr2=0x558579cb6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87aa9d640 1 --2- 172.21.15.135:0/1128448658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9f290 0x558579cb6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87aa9d640 1 -- 172.21.15.135:0/1128448658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9e970 msgr2=0x558579caa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87aa9d640 1 --2- 172.21.15.135:0/1128448658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9e970 0x558579caa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87aa9d640 1 -- 172.21.15.135:0/1128448658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558579c9a980 con 0x558579caa910 2024-04-20T12:26:29.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87a29c640 1 --2- 172.21.15.135:0/1128448658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9e970 0x558579caa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:26:29.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.128+0000 7fe87aa9d640 1 --2- 172.21.15.135:0/1128448658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579ca53a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe86c012910 tx=0x7fe86c009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2d9ea6116076d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.129+0000 7fe85ffff640 1 -- 172.21.15.135:0/1128448658 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c037020 con 0x558579caa910 2024-04-20T12:26:29.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.129+0000 7fe85ffff640 1 -- 172.21.15.135:0/1128448658 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe86c017070 con 0x558579caa910 2024-04-20T12:26:29.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.129+0000 7fe85ffff640 1 -- 172.21.15.135:0/1128448658 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c023040 con 0x558579caa910 2024-04-20T12:26:29.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.129+0000 7fe87f1cd740 1 -- 172.21.15.135:0/1128448658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 msgr2=0x558579ca53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.129+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/1128448658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579ca53a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe86c012910 tx=0x7fe86c009fd0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.129+0000 7fe87f1cd740 1 -- 172.21.15.135:0/1128448658 shutdown_connections 2024-04-20T12:26:29.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.129+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/1128448658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579ca53a0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/1128448658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9f290 0x558579cb6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/1128448658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9e970 0x558579caa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87f1cd740 1 -- 172.21.15.135:0/1128448658 >> 172.21.15.135:0/1128448658 conn(0x558579c99750 msgr2=0x558579c985d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87f1cd740 1 -- 172.21.15.135:0/1128448658 shutdown_connections 2024-04-20T12:26:29.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87f1cd740 1 -- 172.21.15.135:0/1128448658 wait complete. 2024-04-20T12:26:29.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87f1cd740 1 -- start start 2024-04-20T12:26:29.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87f1cd740 1 Processor -- start 2024-04-20T12:26:29.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87f1cd740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9e970 0x558579cb2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87f1cd740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9f290 0x558579cb2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87f1cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579cc1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87f1cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe8741ae590 con 0x558579caa910 2024-04-20T12:26:29.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87f1cd740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe8741adec0 con 0x558579c9f290 2024-04-20T12:26:29.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87f1cd740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe8741ab0f0 con 0x558579c9e970 2024-04-20T12:26:29.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87f1cd740 10 client.0 _ll_register_callbacks cb 0x7fe86c009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:29.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87aa9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579cc1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87aa9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579cc1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41660/0 (socket says 172.21.15.135:41660) 2024-04-20T12:26:29.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87aa9d640 1 -- 172.21.15.135:0/3760446188 learned_addr learned my addr 172.21.15.135:0/3760446188 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87a29c640 1 --2- 172.21.15.135:0/3760446188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9e970 0x558579cb2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe879a9b640 1 --2- 172.21.15.135:0/3760446188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9f290 0x558579cb2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87aa9d640 1 -- 172.21.15.135:0/3760446188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9e970 msgr2=0x558579cb2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87aa9d640 1 --2- 172.21.15.135:0/3760446188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9e970 0x558579cb2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.130+0000 7fe87aa9d640 1 -- 172.21.15.135:0/3760446188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9f290 msgr2=0x558579cb2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe87aa9d640 1 --2- 172.21.15.135:0/3760446188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9f290 0x558579cb2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe87aa9d640 1 -- 172.21.15.135:0/3760446188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558579cc20b0 con 0x558579caa910 2024-04-20T12:26:29.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe879a9b640 1 --2- 172.21.15.135:0/3760446188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9f290 0x558579cb2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:26:29.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe87aa9d640 1 --2- 172.21.15.135:0/3760446188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579cc1880 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe86c010d50 tx=0x7fe86c011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5381033e27f5062c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe85dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:29.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe85dffb640 1 -- 172.21.15.135:0/3760446188 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c037070 con 0x558579caa910 2024-04-20T12:26:29.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe85dffb640 1 -- 172.21.15.135:0/3760446188 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe86c027940 con 0x558579caa910 2024-04-20T12:26:29.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3760446188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe86c017070 con 0x558579caa910 2024-04-20T12:26:29.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe85dffb640 1 -- 172.21.15.135:0/3760446188 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe86c04a050 con 0x558579caa910 2024-04-20T12:26:29.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe87f1cd740 10 client.16767 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:29.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3760446188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558579d20b20 con 0x558579caa910 2024-04-20T12:26:29.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe85dffb640 1 -- 172.21.15.135:0/3760446188 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe86c017070 con 0x558579caa910 2024-04-20T12:26:29.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe85dffb640 1 -- 172.21.15.135:0/3760446188 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe86c028560 con 0x558579caa910 2024-04-20T12:26:29.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe87f1cd740 10 client.16767 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:29.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe87f1cd740 10 client.16767 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:26:29.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe87f1cd740 20 client.16767 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:29.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/3760446188 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558579d210d0 0x558579d234c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe87f1cd740 4 client.16767 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:26:29.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.131+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3760446188 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558579b856e0 con 0x558579d210d0 2024-04-20T12:26:29.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe87a29c640 1 --2- 172.21.15.135:0/3760446188 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558579d210d0 0x558579d234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe85dffb640 10 client.16767 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:26:29.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe87a29c640 1 --2- 172.21.15.135:0/3760446188 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558579d210d0 0x558579d234c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=65f6125a64870cd8 server_cookie=da7b63ef4bd1e254 in_seq=0 out_seq=0 2024-04-20T12:26:29.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe85dffb640 1 -- 172.21.15.135:0/3760446188 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558579b856e0 con 0x558579d210d0 2024-04-20T12:26:29.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe85dffb640 10 client.16767 handle_command_reply: tid=0 2024-04-20T12:26:29.138 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe87f1cd740 1 client.16767 shutdown 2024-04-20T12:26:29.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3760446188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 msgr2=0x558579cc1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/3760446188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579cc1880 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe86c010d50 tx=0x7fe86c011af0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3760446188 shutdown_connections 2024-04-20T12:26:29.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/3760446188 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558579d210d0 0x558579d234c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/3760446188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558579caa910 0x558579cc1880 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/3760446188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558579c9f290 0x558579cb2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe87f1cd740 1 --2- 172.21.15.135:0/3760446188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558579c9e970 0x558579cb2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe85dffb640 0 client.16767 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:26:29.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3760446188 >> 172.21.15.135:0/3760446188 conn(0x558579c99750 msgr2=0x558579c9aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3760446188 shutdown_connections 2024-04-20T12:26:29.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe87f1cd740 1 -- 172.21.15.135:0/3760446188 wait complete. 2024-04-20T12:26:29.139 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.132+0000 7fe87f1cd740 20 client.16767 trim_cache size 0 max 16384 2024-04-20T12:26:29.140 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:26:29.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.133+0000 7fe87c500640 1 -- 172.21.15.135:0/3252843450 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe8600a3da0 msgr2=0x7fe8600a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.133+0000 7fe87c500640 1 --2- 172.21.15.135:0/3252843450 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe8600a3da0 0x7fe8600a6260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe86c005fd0 tx=0x7fe86c004a40 comp rx=0 tx=0).stop 2024-04-20T12:26:29.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.133+0000 7fe87c500640 1 -- 172.21.15.135:0/3252843450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe874106160 msgr2=0x7fe874197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.133+0000 7fe87c500640 1 --2- 172.21.15.135:0/3252843450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe874106160 0x7fe874197b80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe86400c970 tx=0x7fe86400ce30 comp rx=0 tx=0).stop 2024-04-20T12:26:29.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.133+0000 7fe87c500640 1 -- 172.21.15.135:0/3252843450 shutdown_connections 2024-04-20T12:26:29.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.133+0000 7fe87c500640 1 --2- 172.21.15.135:0/3252843450 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe8600a3da0 0x7fe8600a6260 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.133+0000 7fe87c500640 1 --2- 172.21.15.135:0/3252843450 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87419bf00 0x7fe87419c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.133+0000 7fe87c500640 1 --2- 172.21.15.135:0/3252843450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe874106160 0x7fe874197b80 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.133+0000 7fe87c500640 1 --2- 172.21.15.135:0/3252843450 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe874101090 0x7fe874197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.133+0000 7fe87c500640 1 -- 172.21.15.135:0/3252843450 >> 172.21.15.135:0/3252843450 conn(0x7fe874078010 msgr2=0x7fe8740fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.133+0000 7fe87c500640 1 -- 172.21.15.135:0/3252843450 shutdown_connections 2024-04-20T12:26:29.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.133+0000 7fe87c500640 1 -- 172.21.15.135:0/3252843450 wait complete. 2024-04-20T12:26:29.144 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:26:29.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.248+0000 7f555988c640 1 -- 172.21.15.135:0/3197240930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55541011b0 msgr2=0x7f5554101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.248+0000 7f555988c640 1 --2- 172.21.15.135:0/3197240930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55541011b0 0x7f5554101610 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f5548009900 tx=0x7f554802bc30 comp rx=0 tx=0).stop 2024-04-20T12:26:29.250 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.248+0000 7f555988c640 1 -- 172.21.15.135:0/3197240930 shutdown_connections 2024-04-20T12:26:29.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.248+0000 7f555988c640 1 --2- 172.21.15.135:0/3197240930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5554101b50 0x7f555410dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.248+0000 7f555988c640 1 --2- 172.21.15.135:0/3197240930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55541011b0 0x7f5554101610 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.248+0000 7f555988c640 1 --2- 172.21.15.135:0/3197240930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5554106fa0 0x7f5554107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.248+0000 7f555988c640 1 -- 172.21.15.135:0/3197240930 >> 172.21.15.135:0/3197240930 conn(0x7f5554076c60 msgr2=0x7f5554077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.248+0000 7f555988c640 1 -- 172.21.15.135:0/3197240930 shutdown_connections 2024-04-20T12:26:29.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.248+0000 7f555988c640 1 -- 172.21.15.135:0/3197240930 wait complete. 2024-04-20T12:26:29.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.249+0000 7f555988c640 1 Processor -- start 2024-04-20T12:26:29.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.249+0000 7f555988c640 1 -- start start 2024-04-20T12:26:29.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.249+0000 7f555988c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55541011b0 0x7f5554197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.249+0000 7f555988c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5554101b50 0x7f5554197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.249+0000 7f555988c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5554106fa0 0x7f5554197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.249+0000 7f555988c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5554111220 con 0x7f55541011b0 2024-04-20T12:26:29.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.249+0000 7f555988c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f55541110a0 con 0x7f5554101b50 2024-04-20T12:26:29.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.249+0000 7f555988c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55541113a0 con 0x7f5554106fa0 2024-04-20T12:26:29.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.249+0000 7f5552ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55541011b0 0x7f5554197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.249+0000 7f5552ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55541011b0 0x7f5554197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41674/0 (socket says 172.21.15.135:41674) 2024-04-20T12:26:29.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.249+0000 7f5552ffd640 1 -- 172.21.15.135:0/1628996102 learned_addr learned my addr 172.21.15.135:0/1628996102 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.249+0000 7f55537fe640 1 --2- 172.21.15.135:0/1628996102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5554106fa0 0x7f5554197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.250+0000 7f55527fc640 1 --2- 172.21.15.135:0/1628996102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5554101b50 0x7f5554197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.250+0000 7f5552ffd640 1 -- 172.21.15.135:0/1628996102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5554106fa0 msgr2=0x7f5554197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.250+0000 7f5552ffd640 1 --2- 172.21.15.135:0/1628996102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5554106fa0 0x7f5554197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.250+0000 7f5552ffd640 1 -- 172.21.15.135:0/1628996102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5554101b50 msgr2=0x7f5554197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.250+0000 7f5552ffd640 1 --2- 172.21.15.135:0/1628996102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5554101b50 0x7f5554197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.250+0000 7f5552ffd640 1 -- 172.21.15.135:0/1628996102 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55541a6d80 con 0x7f55541011b0 2024-04-20T12:26:29.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.250+0000 7f55527fc640 1 --2- 172.21.15.135:0/1628996102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5554101b50 0x7f5554197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:26:29.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.250+0000 7f5552ffd640 1 --2- 172.21.15.135:0/1628996102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55541011b0 0x7f5554197510 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f554400d950 tx=0x7f554400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.250+0000 7f555888a640 1 -- 172.21.15.135:0/1628996102 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544017070 con 0x7f55541011b0 2024-04-20T12:26:29.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.250+0000 7f555988c640 1 -- 172.21.15.135:0/1628996102 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55541a7070 con 0x7f55541011b0 2024-04-20T12:26:29.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.250+0000 7f555888a640 1 -- 172.21.15.135:0/1628996102 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5544009c30 con 0x7f55541011b0 2024-04-20T12:26:29.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.250+0000 7f555888a640 1 -- 172.21.15.135:0/1628996102 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554400f6b0 con 0x7f55541011b0 2024-04-20T12:26:29.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.250+0000 7f555988c640 1 -- 172.21.15.135:0/1628996102 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55541a7610 con 0x7f55541011b0 2024-04-20T12:26:29.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f555888a640 1 -- 172.21.15.135:0/1628996102 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f55440109d0 con 0x7f55541011b0 2024-04-20T12:26:29.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f555c484740 1 Processor -- start 2024-04-20T12:26:29.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f555c484740 1 -- start start 2024-04-20T12:26:29.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f555c484740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d1e10 0x5605843d21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f555c484740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843d2730 0x5605843dadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f555c484740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843db310 0x5605843dd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f555c484740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560584337110 con 0x5605843db310 2024-04-20T12:26:29.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f555c484740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5605842d4550 con 0x5605843d1e10 2024-04-20T12:26:29.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f555c484740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5605843330d0 con 0x5605843d2730 2024-04-20T12:26:29.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f55527fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843db310 0x5605843dd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f55527fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843db310 0x5605843dd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41686/0 (socket says 172.21.15.135:41686) 2024-04-20T12:26:29.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f55527fc640 1 -- 172.21.15.135:0/3635248799 learned_addr learned my addr 172.21.15.135:0/3635248799 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f55537fe640 1 --2- 172.21.15.135:0/3635248799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d1e10 0x5605843d21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f555888a640 1 --2- 172.21.15.135:0/1628996102 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f553c0a3d20 0x7f553c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f5552ffd640 1 --2- 172.21.15.135:0/3635248799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843d2730 0x5605843dadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f55527fc640 1 -- 172.21.15.135:0/3635248799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843d2730 msgr2=0x5605843dadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f55527fc640 1 --2- 172.21.15.135:0/3635248799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843d2730 0x5605843dadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f55527fc640 1 -- 172.21.15.135:0/3635248799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d1e10 msgr2=0x5605843d21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f55527fc640 1 --2- 172.21.15.135:0/3635248799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d1e10 0x5605843d21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.253+0000 7f55527fc640 1 -- 172.21.15.135:0/3635248799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605842fc900 con 0x5605843db310 2024-04-20T12:26:29.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.254+0000 7f55537fe640 1 --2- 172.21.15.135:0/1628996102 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f553c0a3d20 0x7f553c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.254+0000 7f555888a640 1 -- 172.21.15.135:0/1628996102 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f55440d0820 con 0x7f55541011b0 2024-04-20T12:26:29.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.254+0000 7f55527fc640 1 --2- 172.21.15.135:0/3635248799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843db310 0x5605843dd700 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5548006010 tx=0x7f554802c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217e8b30efceb32c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.254+0000 7f5539ffb640 1 -- 172.21.15.135:0/3635248799 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554802cb40 con 0x5605843db310 2024-04-20T12:26:29.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.254+0000 7f55537fe640 1 --2- 172.21.15.135:0/1628996102 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f553c0a3d20 0x7f553c0a61e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f554c005c40 tx=0x7f554c004a40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.254+0000 7f5539ffb640 1 -- 172.21.15.135:0/3635248799 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f554802cce0 con 0x5605843db310 2024-04-20T12:26:29.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.254+0000 7f5539ffb640 1 -- 172.21.15.135:0/3635248799 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548004920 con 0x5605843db310 2024-04-20T12:26:29.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 -- 172.21.15.135:0/3635248799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843db310 msgr2=0x5605843dd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 --2- 172.21.15.135:0/3635248799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843db310 0x5605843dd700 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5548006010 tx=0x7f554802c5d0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 -- 172.21.15.135:0/3635248799 shutdown_connections 2024-04-20T12:26:29.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 --2- 172.21.15.135:0/3635248799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843db310 0x5605843dd700 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 --2- 172.21.15.135:0/3635248799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843d2730 0x5605843dadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 --2- 172.21.15.135:0/3635248799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d1e10 0x5605843d21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 -- 172.21.15.135:0/3635248799 >> 172.21.15.135:0/3635248799 conn(0x5605843cc540 msgr2=0x5605843cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 -- 172.21.15.135:0/3635248799 shutdown_connections 2024-04-20T12:26:29.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 -- 172.21.15.135:0/3635248799 wait complete. 2024-04-20T12:26:29.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 -- start start 2024-04-20T12:26:29.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 Processor -- start 2024-04-20T12:26:29.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d1e10 0x5605843d83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843d2730 0x5605843d88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843db310 0x5605843d8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5605843ddfe0 con 0x5605843d2730 2024-04-20T12:26:29.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.255+0000 7f555c484740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5605842f0500 con 0x5605843d1e10 2024-04-20T12:26:29.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f555c484740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5605843de160 con 0x5605843db310 2024-04-20T12:26:29.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f555c484740 10 client.0 _ll_register_callbacks cb 0x5605842d52f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:29.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f55527fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843d2730 0x5605843d88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f55527fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843d2730 0x5605843d88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41702/0 (socket says 172.21.15.135:41702) 2024-04-20T12:26:29.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f55527fc640 1 -- 172.21.15.135:0/10911998 learned_addr learned my addr 172.21.15.135:0/10911998 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f5552ffd640 1 --2- 172.21.15.135:0/10911998 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d1e10 0x5605843d83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f55537fe640 1 --2- 172.21.15.135:0/10911998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843db310 0x5605843d8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f55527fc640 1 -- 172.21.15.135:0/10911998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843db310 msgr2=0x5605843d8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f55527fc640 1 --2- 172.21.15.135:0/10911998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843db310 0x5605843d8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f55527fc640 1 -- 172.21.15.135:0/10911998 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d1e10 msgr2=0x5605843d83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f55527fc640 1 --2- 172.21.15.135:0/10911998 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d1e10 0x5605843d83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f55527fc640 1 -- 172.21.15.135:0/10911998 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605840493f0 con 0x5605843d2730 2024-04-20T12:26:29.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f55527fc640 1 --2- 172.21.15.135:0/10911998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843d2730 0x5605843d88f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f554802cfd0 tx=0x7f55480042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e35f4a257e160b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f5532ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:29.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f5532ffd640 1 -- 172.21.15.135:0/10911998 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554802c2b0 con 0x5605843d2730 2024-04-20T12:26:29.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f5532ffd640 1 -- 172.21.15.135:0/10911998 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5548003a00 con 0x5605843d2730 2024-04-20T12:26:29.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f555c484740 1 -- 172.21.15.135:0/10911998 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560584344b30 con 0x5605843d2730 2024-04-20T12:26:29.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f5532ffd640 1 -- 172.21.15.135:0/10911998 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5548056050 con 0x5605843d2730 2024-04-20T12:26:29.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f555c484740 10 client.16779 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:29.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.256+0000 7f555c484740 1 -- 172.21.15.135:0/10911998 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5605841137d0 con 0x5605843d2730 2024-04-20T12:26:29.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.257+0000 7f5532ffd640 1 -- 172.21.15.135:0/10911998 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x560584344b30 con 0x5605843d2730 2024-04-20T12:26:29.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.257+0000 7f5532ffd640 1 -- 172.21.15.135:0/10911998 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f554803d430 con 0x5605843d2730 2024-04-20T12:26:29.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.257+0000 7f555c484740 10 client.16779 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:29.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.257+0000 7f555c484740 10 client.16779 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:26:29.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.257+0000 7f555c484740 20 client.16779 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:29.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.257+0000 7f555c484740 1 --2- 172.21.15.135:0/10911998 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5605843eb3e0 0x5605843ed7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.257+0000 7f555c484740 4 client.16779 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:26:29.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.257+0000 7f555c484740 1 -- 172.21.15.135:0/10911998 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56058433e9a0 con 0x5605843eb3e0 2024-04-20T12:26:29.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.257+0000 7f5552ffd640 1 --2- 172.21.15.135:0/10911998 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5605843eb3e0 0x5605843ed7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.257+0000 7f5532ffd640 10 client.16779 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:26:29.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.257+0000 7f5552ffd640 1 --2- 172.21.15.135:0/10911998 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5605843eb3e0 0x5605843ed7d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=803c4fa36e31bd32 server_cookie=2b25406688b9c0af in_seq=0 out_seq=0 2024-04-20T12:26:29.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.258+0000 7f5532ffd640 1 -- 172.21.15.135:0/10911998 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56058433e9a0 con 0x5605843eb3e0 2024-04-20T12:26:29.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.258+0000 7f5532ffd640 10 client.16779 handle_command_reply: tid=0 2024-04-20T12:26:29.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.258+0000 7f555c484740 1 client.16779 shutdown 2024-04-20T12:26:29.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.258+0000 7f555c484740 1 -- 172.21.15.135:0/10911998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843d2730 msgr2=0x5605843d88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.258+0000 7f555c484740 1 --2- 172.21.15.135:0/10911998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843d2730 0x5605843d88f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f554802cfd0 tx=0x7f55480042c0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.258+0000 7f555c484740 1 -- 172.21.15.135:0/10911998 shutdown_connections 2024-04-20T12:26:29.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.258+0000 7f555c484740 1 --2- 172.21.15.135:0/10911998 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5605843eb3e0 0x5605843ed7d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.258+0000 7f555c484740 1 --2- 172.21.15.135:0/10911998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843db310 0x5605843d8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.258+0000 7f5532ffd640 0 client.16779 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:26:29.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.258+0000 7f555c484740 1 --2- 172.21.15.135:0/10911998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843d2730 0x5605843d88f0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.258+0000 7f555c484740 1 --2- 172.21.15.135:0/10911998 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d1e10 0x5605843d83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.258+0000 7f555c484740 1 -- 172.21.15.135:0/10911998 >> 172.21.15.135:0/10911998 conn(0x5605843cc540 msgr2=0x5605843ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.259+0000 7f555c484740 1 -- 172.21.15.135:0/10911998 shutdown_connections 2024-04-20T12:26:29.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.259+0000 7f555c484740 1 -- 172.21.15.135:0/10911998 wait complete. 2024-04-20T12:26:29.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.259+0000 7f555c484740 20 client.16779 trim_cache size 0 max 16384 2024-04-20T12:26:29.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f555c484740 1 Processor -- start 2024-04-20T12:26:29.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f555c484740 1 -- start start 2024-04-20T12:26:29.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f555c484740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843d1e10 0x5605843daae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f555c484740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d2730 0x5605843e6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f555c484740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843db310 0x5605843c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f555c484740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55541b1530 con 0x5605843db310 2024-04-20T12:26:29.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f555c484740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f55541b3070 con 0x5605843d2730 2024-04-20T12:26:29.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f555c484740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55541b1c00 con 0x5605843d1e10 2024-04-20T12:26:29.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f55537fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843db310 0x5605843c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f55537fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843db310 0x5605843c7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41716/0 (socket says 172.21.15.135:41716) 2024-04-20T12:26:29.277 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f55537fe640 1 -- 172.21.15.135:0/544109897 learned_addr learned my addr 172.21.15.135:0/544109897 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f55527fc640 1 --2- 172.21.15.135:0/544109897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d2730 0x5605843e6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f55537fe640 1 -- 172.21.15.135:0/544109897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843d1e10 msgr2=0x5605843daae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f55537fe640 1 --2- 172.21.15.135:0/544109897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843d1e10 0x5605843daae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f55537fe640 1 -- 172.21.15.135:0/544109897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d2730 msgr2=0x5605843e6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f55537fe640 1 --2- 172.21.15.135:0/544109897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d2730 0x5605843e6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f55537fe640 1 -- 172.21.15.135:0/544109897 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605843d7380 con 0x5605843db310 2024-04-20T12:26:29.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f55527fc640 1 --2- 172.21.15.135:0/544109897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d2730 0x5605843e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:26:29.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f55537fe640 1 --2- 172.21.15.135:0/544109897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843db310 0x5605843c7570 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f554c012880 tx=0x7f554c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cadee5e6b42fa8a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.272+0000 7f55397fa640 1 -- 172.21.15.135:0/544109897 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c01e910 con 0x5605843db310 2024-04-20T12:26:29.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.273+0000 7f55397fa640 1 -- 172.21.15.135:0/544109897 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f554c027440 con 0x5605843db310 2024-04-20T12:26:29.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.273+0000 7f55397fa640 1 -- 172.21.15.135:0/544109897 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c019620 con 0x5605843db310 2024-04-20T12:26:29.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.273+0000 7f555c484740 1 -- 172.21.15.135:0/544109897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843db310 msgr2=0x5605843c7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.273+0000 7f555c484740 1 --2- 172.21.15.135:0/544109897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843db310 0x5605843c7570 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f554c012880 tx=0x7f554c014000 comp rx=0 tx=0).stop 2024-04-20T12:26:29.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.273+0000 7f555c484740 1 -- 172.21.15.135:0/544109897 shutdown_connections 2024-04-20T12:26:29.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.273+0000 7f555c484740 1 --2- 172.21.15.135:0/544109897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843db310 0x5605843c7570 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.273+0000 7f555c484740 1 --2- 172.21.15.135:0/544109897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d2730 0x5605843e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.273+0000 7f555c484740 1 --2- 172.21.15.135:0/544109897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843d1e10 0x5605843daae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.273+0000 7f555c484740 1 -- 172.21.15.135:0/544109897 >> 172.21.15.135:0/544109897 conn(0x5605843cc540 msgr2=0x5605843cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.273+0000 7f555c484740 1 -- 172.21.15.135:0/544109897 shutdown_connections 2024-04-20T12:26:29.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.273+0000 7f555c484740 1 -- 172.21.15.135:0/544109897 wait complete. 2024-04-20T12:26:29.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.273+0000 7f555c484740 1 -- start start 2024-04-20T12:26:29.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f555c484740 1 Processor -- start 2024-04-20T12:26:29.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f555c484740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d1e10 0x5605843e33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f555c484740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843d2730 0x5605843e38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f555c484740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843db310 0x5605843e0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f555c484740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55541b29a0 con 0x5605843d2730 2024-04-20T12:26:29.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f555c484740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f55541b22d0 con 0x5605843d1e10 2024-04-20T12:26:29.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f555c484740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55541af500 con 0x5605843db310 2024-04-20T12:26:29.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f555c484740 10 client.0 _ll_register_callbacks cb 0x7f5548005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:29.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f55527fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843d2730 0x5605843e38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f55527fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843d2730 0x5605843e38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41730/0 (socket says 172.21.15.135:41730) 2024-04-20T12:26:29.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f55527fc640 1 -- 172.21.15.135:0/3791114767 learned_addr learned my addr 172.21.15.135:0/3791114767 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f55537fe640 1 --2- 172.21.15.135:0/3791114767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843db310 0x5605843e0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f5552ffd640 1 --2- 172.21.15.135:0/3791114767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d1e10 0x5605843e33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f55527fc640 1 -- 172.21.15.135:0/3791114767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843db310 msgr2=0x5605843e0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f55527fc640 1 --2- 172.21.15.135:0/3791114767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843db310 0x5605843e0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f55527fc640 1 -- 172.21.15.135:0/3791114767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d1e10 msgr2=0x5605843e33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f55527fc640 1 --2- 172.21.15.135:0/3791114767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d1e10 0x5605843e33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f55527fc640 1 -- 172.21.15.135:0/3791114767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605843e0c40 con 0x5605843d2730 2024-04-20T12:26:29.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f55527fc640 1 --2- 172.21.15.135:0/3791114767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843d2730 0x5605843e38f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f5548006010 tx=0x7f554802c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8039395258e31f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.274+0000 7f5532ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:29.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.275+0000 7f5532ffd640 1 -- 172.21.15.135:0/3791114767 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55480044e0 con 0x5605843d2730 2024-04-20T12:26:29.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.275+0000 7f555c484740 1 -- 172.21.15.135:0/3791114767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f554c027440 con 0x5605843d2730 2024-04-20T12:26:29.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.275+0000 7f5532ffd640 1 -- 172.21.15.135:0/3791114767 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f554803da70 con 0x5605843d2730 2024-04-20T12:26:29.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.275+0000 7f5532ffd640 1 -- 172.21.15.135:0/3791114767 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f554803dc70 con 0x5605843d2730 2024-04-20T12:26:29.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.275+0000 7f555c484740 10 client.16785 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:29.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.275+0000 7f555c484740 1 -- 172.21.15.135:0/3791114767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5605844522a0 con 0x5605843d2730 2024-04-20T12:26:29.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.275+0000 7f5532ffd640 1 -- 172.21.15.135:0/3791114767 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f554c027440 con 0x5605843d2730 2024-04-20T12:26:29.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.275+0000 7f5532ffd640 1 -- 172.21.15.135:0/3791114767 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f554805b770 con 0x5605843d2730 2024-04-20T12:26:29.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.275+0000 7f555c484740 10 client.16785 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:29.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.275+0000 7f555c484740 10 client.16785 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:26:29.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.275+0000 7f555c484740 20 client.16785 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:29.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.275+0000 7f555c484740 1 --2- 172.21.15.135:0/3791114767 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5605844529e0 0x560584454e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.275+0000 7f555c484740 4 client.16785 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:26:29.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.275+0000 7f555c484740 1 -- 172.21.15.135:0/3791114767 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5605842ba6e0 con 0x5605844529e0 2024-04-20T12:26:29.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.275+0000 7f5552ffd640 1 --2- 172.21.15.135:0/3791114767 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5605844529e0 0x560584454e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f5532ffd640 10 client.16785 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:26:29.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f5552ffd640 1 --2- 172.21.15.135:0/3791114767 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5605844529e0 0x560584454e00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f98e213cde1ba4c0 server_cookie=946f7b89f473b7b1 in_seq=0 out_seq=0 2024-04-20T12:26:29.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f5532ffd640 1 -- 172.21.15.135:0/3791114767 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5605842ba6e0 con 0x5605844529e0 2024-04-20T12:26:29.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f5532ffd640 10 client.16785 handle_command_reply: tid=0 2024-04-20T12:26:29.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f555c484740 1 client.16785 shutdown 2024-04-20T12:26:29.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f555c484740 1 -- 172.21.15.135:0/3791114767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843d2730 msgr2=0x5605843e38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f555c484740 1 --2- 172.21.15.135:0/3791114767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843d2730 0x5605843e38f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f5548006010 tx=0x7f554802c7e0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f555c484740 1 -- 172.21.15.135:0/3791114767 shutdown_connections 2024-04-20T12:26:29.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f555c484740 1 --2- 172.21.15.135:0/3791114767 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5605844529e0 0x560584454e00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f555c484740 1 --2- 172.21.15.135:0/3791114767 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5605843db310 0x5605843e0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f555c484740 1 --2- 172.21.15.135:0/3791114767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5605843d2730 0x5605843e38f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f5532ffd640 0 client.16785 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:26:29.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f555c484740 1 --2- 172.21.15.135:0/3791114767 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5605843d1e10 0x5605843e33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f555c484740 1 -- 172.21.15.135:0/3791114767 >> 172.21.15.135:0/3791114767 conn(0x5605843cc540 msgr2=0x5605843d8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f555c484740 1 -- 172.21.15.135:0/3791114767 shutdown_connections 2024-04-20T12:26:29.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f555c484740 1 -- 172.21.15.135:0/3791114767 wait complete. 2024-04-20T12:26:29.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.276+0000 7f555c484740 20 client.16785 trim_cache size 0 max 16384 2024-04-20T12:26:29.283 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:26:29.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.277+0000 7f555988c640 1 -- 172.21.15.135:0/1628996102 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f553c0a3d20 msgr2=0x7f553c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.277+0000 7f555988c640 1 --2- 172.21.15.135:0/1628996102 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f553c0a3d20 0x7f553c0a61e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f554c005c40 tx=0x7f554c004a40 comp rx=0 tx=0).stop 2024-04-20T12:26:29.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.277+0000 7f555988c640 1 -- 172.21.15.135:0/1628996102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55541011b0 msgr2=0x7f5554197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.277+0000 7f555988c640 1 --2- 172.21.15.135:0/1628996102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55541011b0 0x7f5554197510 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f554400d950 tx=0x7f554400de10 comp rx=0 tx=0).stop 2024-04-20T12:26:29.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.277+0000 7f555988c640 1 -- 172.21.15.135:0/1628996102 shutdown_connections 2024-04-20T12:26:29.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.277+0000 7f555988c640 1 --2- 172.21.15.135:0/1628996102 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f553c0a3d20 0x7f553c0a61e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.277+0000 7f555988c640 1 --2- 172.21.15.135:0/1628996102 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5554106fa0 0x7f5554197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.277+0000 7f555988c640 1 --2- 172.21.15.135:0/1628996102 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5554101b50 0x7f5554197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.277+0000 7f555988c640 1 --2- 172.21.15.135:0/1628996102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55541011b0 0x7f5554197510 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.277+0000 7f555988c640 1 -- 172.21.15.135:0/1628996102 >> 172.21.15.135:0/1628996102 conn(0x7f5554076c60 msgr2=0x7f55540fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.277+0000 7f555988c640 1 -- 172.21.15.135:0/1628996102 shutdown_connections 2024-04-20T12:26:29.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.277+0000 7f555988c640 1 -- 172.21.15.135:0/1628996102 wait complete. 2024-04-20T12:26:29.287 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:26:29.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.388+0000 7f9d0c0d2640 1 -- 172.21.15.135:0/3955990188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d04106160 msgr2=0x7f9d0410dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.388+0000 7f9d0c0d2640 1 --2- 172.21.15.135:0/3955990188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d04106160 0x7f9d0410dd30 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009ca0 tx=0x7f9cfc02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.388+0000 7f9d0c0d2640 1 -- 172.21.15.135:0/3955990188 shutdown_connections 2024-04-20T12:26:29.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.388+0000 7f9d0c0d2640 1 --2- 172.21.15.135:0/3955990188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d04106160 0x7f9d0410dd30 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.388+0000 7f9d0c0d2640 1 --2- 172.21.15.135:0/3955990188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d04101a40 0x7f9d04105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.388+0000 7f9d0c0d2640 1 --2- 172.21.15.135:0/3955990188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d04101090 0x7f9d04101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.388+0000 7f9d0c0d2640 1 -- 172.21.15.135:0/3955990188 >> 172.21.15.135:0/3955990188 conn(0x7f9d04077fe0 msgr2=0x7f9d040783f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.388+0000 7f9d0c0d2640 1 -- 172.21.15.135:0/3955990188 shutdown_connections 2024-04-20T12:26:29.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.388+0000 7f9d0c0d2640 1 -- 172.21.15.135:0/3955990188 wait complete. 2024-04-20T12:26:29.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.388+0000 7f9d0c0d2640 1 Processor -- start 2024-04-20T12:26:29.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.388+0000 7f9d0c0d2640 1 -- start start 2024-04-20T12:26:29.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d0c0d2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d04101090 0x7f9d04199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d0c0d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d04106160 0x7f9d04199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d0c0d2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d0419a0f0 0x7f9d041a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d0c0d2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d04111220 con 0x7f9d04101090 2024-04-20T12:26:29.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d0c0d2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d041110a0 con 0x7f9d0419a0f0 2024-04-20T12:26:29.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d0c0d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d041113a0 con 0x7f9d04106160 2024-04-20T12:26:29.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d09e6e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d04101090 0x7f9d04199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d09e6e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d04101090 0x7f9d04199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41752/0 (socket says 172.21.15.135:41752) 2024-04-20T12:26:29.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d09e6e640 1 -- 172.21.15.135:0/1201060748 learned_addr learned my addr 172.21.15.135:0/1201060748 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d0a66f640 1 --2- 172.21.15.135:0/1201060748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d0419a0f0 0x7f9d041a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d09e6e640 1 -- 172.21.15.135:0/1201060748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d04106160 msgr2=0x7f9d04199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d09e6e640 1 --2- 172.21.15.135:0/1201060748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d04106160 0x7f9d04199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d09e6e640 1 -- 172.21.15.135:0/1201060748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d0419a0f0 msgr2=0x7f9d041a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d09e6e640 1 --2- 172.21.15.135:0/1201060748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d0419a0f0 0x7f9d041a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d09e6e640 1 -- 172.21.15.135:0/1201060748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d041a4e70 con 0x7f9d04101090 2024-04-20T12:26:29.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d09e6e640 1 --2- 172.21.15.135:0/1201060748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d04101090 0x7f9d04199620 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000e9f0 tx=0x7f9d0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9cfaffd640 1 -- 172.21.15.135:0/1201060748 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0000cd80 con 0x7f9d04101090 2024-04-20T12:26:29.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9cfaffd640 1 -- 172.21.15.135:0/1201060748 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d00010910 con 0x7f9d04101090 2024-04-20T12:26:29.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d0c0d2640 1 -- 172.21.15.135:0/1201060748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d041a5160 con 0x7f9d04101090 2024-04-20T12:26:29.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9cfaffd640 1 -- 172.21.15.135:0/1201060748 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d000188f0 con 0x7f9d04101090 2024-04-20T12:26:29.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.389+0000 7f9d0c0d2640 1 -- 172.21.15.135:0/1201060748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d041a56b0 con 0x7f9d04101090 2024-04-20T12:26:29.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9cfaffd640 1 -- 172.21.15.135:0/1201060748 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f9d00010ac0 con 0x7f9d04101090 2024-04-20T12:26:29.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9d0eda5740 1 Processor -- start 2024-04-20T12:26:29.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9d0eda5740 1 -- start start 2024-04-20T12:26:29.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9d0eda5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e40747bc20 0x55e40747c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9d0eda5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e40747c5d0 0x55e4074891e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9d0eda5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e407489720 0x55e40748bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9d0eda5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e4073e1110 con 0x55e40747c5d0 2024-04-20T12:26:29.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9d0eda5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e40737e550 con 0x55e407489720 2024-04-20T12:26:29.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9d0eda5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e4073dd0d0 con 0x55e40747bc20 2024-04-20T12:26:29.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9d09e6e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e40747c5d0 0x55e4074891e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9d09e6e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e40747c5d0 0x55e4074891e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41754/0 (socket says 172.21.15.135:41754) 2024-04-20T12:26:29.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9d09e6e640 1 -- 172.21.15.135:0/3521592430 learned_addr learned my addr 172.21.15.135:0/3521592430 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9d0966d640 1 --2- 172.21.15.135:0/3521592430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e407489720 0x55e40748bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9cfaffd640 1 --2- 172.21.15.135:0/1201060748 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9cf00a3d20 0x7f9cf00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9d0a66f640 1 --2- 172.21.15.135:0/3521592430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e40747bc20 0x55e40747c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.392+0000 7f9d0a66f640 1 --2- 172.21.15.135:0/1201060748 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9cf00a3d20 0x7f9cf00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.393+0000 7f9d09e6e640 1 -- 172.21.15.135:0/3521592430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e40747bc20 msgr2=0x55e40747c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.393+0000 7f9d09e6e640 1 --2- 172.21.15.135:0/3521592430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e40747bc20 0x55e40747c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.393+0000 7f9d09e6e640 1 -- 172.21.15.135:0/3521592430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e407489720 msgr2=0x55e40748bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.393+0000 7f9d09e6e640 1 --2- 172.21.15.135:0/3521592430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e407489720 0x55e40748bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.393+0000 7f9cfaffd640 1 -- 172.21.15.135:0/1201060748 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9d000d0fd0 con 0x7f9d04101090 2024-04-20T12:26:29.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.393+0000 7f9d09e6e640 1 -- 172.21.15.135:0/3521592430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4073a6900 con 0x55e40747c5d0 2024-04-20T12:26:29.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.393+0000 7f9d0966d640 1 --2- 172.21.15.135:0/3521592430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e407489720 0x55e40748bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:26:29.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.393+0000 7f9d09e6e640 1 --2- 172.21.15.135:0/3521592430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e40747c5d0 0x55e4074891e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9d0009c8f0 tx=0x7f9d0001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c10235fbed4cfb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.393+0000 7f9d0a66f640 1 --2- 172.21.15.135:0/1201060748 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9cf00a3d20 0x7f9cf00a61e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc004af0 tx=0x7f9cfc005c50 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.393+0000 7f9ceffff640 1 -- 172.21.15.135:0/3521592430 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0009cbf0 con 0x55e40747c5d0 2024-04-20T12:26:29.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.393+0000 7f9ceffff640 1 -- 172.21.15.135:0/3521592430 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d000a0fa0 con 0x55e40747c5d0 2024-04-20T12:26:29.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.393+0000 7f9ceffff640 1 -- 172.21.15.135:0/3521592430 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0005dd90 con 0x55e40747c5d0 2024-04-20T12:26:29.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.394+0000 7f9d0eda5740 1 -- 172.21.15.135:0/3521592430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e40747c5d0 msgr2=0x55e4074891e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.394+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/3521592430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e40747c5d0 0x55e4074891e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9d0009c8f0 tx=0x7f9d0001f000 comp rx=0 tx=0).stop 2024-04-20T12:26:29.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.394+0000 7f9d0eda5740 1 -- 172.21.15.135:0/3521592430 shutdown_connections 2024-04-20T12:26:29.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.394+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/3521592430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e407489720 0x55e40748bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.394+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/3521592430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e40747c5d0 0x55e4074891e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.394+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/3521592430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e40747bc20 0x55e40747c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.394+0000 7f9d0eda5740 1 -- 172.21.15.135:0/3521592430 >> 172.21.15.135:0/3521592430 conn(0x55e407476540 msgr2=0x55e407476920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.394+0000 7f9d0eda5740 1 -- 172.21.15.135:0/3521592430 shutdown_connections 2024-04-20T12:26:29.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.394+0000 7f9d0eda5740 1 -- 172.21.15.135:0/3521592430 wait complete. 2024-04-20T12:26:29.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.394+0000 7f9d0eda5740 1 -- start start 2024-04-20T12:26:29.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.394+0000 7f9d0eda5740 1 Processor -- start 2024-04-20T12:26:29.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d0eda5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e40747bc20 0x55e407486760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d0eda5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747c5d0 0x55e407486ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d0eda5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e407489720 0x55e4074871e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d0eda5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e40748c480 con 0x55e40747bc20 2024-04-20T12:26:29.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d0eda5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e40739a500 con 0x55e40747c5d0 2024-04-20T12:26:29.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d0eda5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e40748c600 con 0x55e407489720 2024-04-20T12:26:29.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d0eda5740 10 client.0 _ll_register_callbacks cb 0x55e40737f2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:29.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d09e6e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e40747bc20 0x55e407486760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d09e6e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e40747bc20 0x55e407486760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41770/0 (socket says 172.21.15.135:41770) 2024-04-20T12:26:29.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d09e6e640 1 -- 172.21.15.135:0/4069557847 learned_addr learned my addr 172.21.15.135:0/4069557847 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d0966d640 1 --2- 172.21.15.135:0/4069557847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747c5d0 0x55e407486ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d0a66f640 1 --2- 172.21.15.135:0/4069557847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e407489720 0x55e4074871e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d09e6e640 1 -- 172.21.15.135:0/4069557847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e407489720 msgr2=0x55e4074871e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d09e6e640 1 --2- 172.21.15.135:0/4069557847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e407489720 0x55e4074871e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d09e6e640 1 -- 172.21.15.135:0/4069557847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747c5d0 msgr2=0x55e407486ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d09e6e640 1 --2- 172.21.15.135:0/4069557847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747c5d0 0x55e407486ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d09e6e640 1 -- 172.21.15.135:0/4069557847 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4070f33f0 con 0x55e40747bc20 2024-04-20T12:26:29.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d09e6e640 1 --2- 172.21.15.135:0/4069557847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e40747bc20 0x55e407486760 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9d000ce450 tx=0x7f9d000ce850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e027ae8b19cd4d3e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9ced7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:29.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9ced7fa640 1 -- 172.21.15.135:0/4069557847 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d000d3110 con 0x55e40747bc20 2024-04-20T12:26:29.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9ced7fa640 1 -- 172.21.15.135:0/4069557847 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9d0005dcf0 con 0x55e40747bc20 2024-04-20T12:26:29.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d0eda5740 1 -- 172.21.15.135:0/4069557847 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d000a0fa0 con 0x55e40747bc20 2024-04-20T12:26:29.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9ced7fa640 1 -- 172.21.15.135:0/4069557847 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9d000d32b0 con 0x55e40747bc20 2024-04-20T12:26:29.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d0eda5740 10 client.16797 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:29.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9d0eda5740 1 -- 172.21.15.135:0/4069557847 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e4071bd7d0 con 0x55e40747bc20 2024-04-20T12:26:29.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.395+0000 7f9ced7fa640 1 -- 172.21.15.135:0/4069557847 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d000a0fa0 con 0x55e40747bc20 2024-04-20T12:26:29.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.396+0000 7f9ced7fa640 1 -- 172.21.15.135:0/4069557847 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f9d000ceb80 con 0x55e40747bc20 2024-04-20T12:26:29.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.396+0000 7f9d0eda5740 10 client.16797 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:29.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.396+0000 7f9d0eda5740 10 client.16797 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:26:29.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.396+0000 7f9d0eda5740 20 client.16797 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:29.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.396+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/4069557847 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55e407499900 0x55e40749bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.396+0000 7f9d0eda5740 4 client.16797 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:26:29.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.396+0000 7f9d0eda5740 1 -- 172.21.15.135:0/4069557847 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4073eeb30 con 0x55e407499900 2024-04-20T12:26:29.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.396+0000 7f9d0966d640 1 --2- 172.21.15.135:0/4069557847 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55e407499900 0x55e40749bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.397+0000 7f9ced7fa640 10 client.16797 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:26:29.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.397+0000 7f9d0966d640 1 --2- 172.21.15.135:0/4069557847 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55e407499900 0x55e40749bcf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3fdf771ed08e10c7 server_cookie=ae560cfb6d873337 in_seq=0 out_seq=0 2024-04-20T12:26:29.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.397+0000 7f9ced7fa640 1 -- 172.21.15.135:0/4069557847 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e4073eeb30 con 0x55e407499900 2024-04-20T12:26:29.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.397+0000 7f9ced7fa640 10 client.16797 handle_command_reply: tid=0 2024-04-20T12:26:29.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.397+0000 7f9d0eda5740 1 client.16797 shutdown 2024-04-20T12:26:29.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.397+0000 7f9d0eda5740 1 -- 172.21.15.135:0/4069557847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e40747bc20 msgr2=0x55e407486760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.397+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/4069557847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e40747bc20 0x55e407486760 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9d000ce450 tx=0x7f9d000ce850 comp rx=0 tx=0).stop 2024-04-20T12:26:29.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.398+0000 7f9d0eda5740 1 -- 172.21.15.135:0/4069557847 shutdown_connections 2024-04-20T12:26:29.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.398+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/4069557847 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55e407499900 0x55e40749bcf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.398+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/4069557847 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e407489720 0x55e4074871e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.398+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/4069557847 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747c5d0 0x55e407486ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.398+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/4069557847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e40747bc20 0x55e407486760 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.398+0000 7f9ced7fa640 0 client.16797 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:26:29.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.398+0000 7f9d0eda5740 1 -- 172.21.15.135:0/4069557847 >> 172.21.15.135:0/4069557847 conn(0x55e407476540 msgr2=0x55e407478290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.398+0000 7f9d0eda5740 1 -- 172.21.15.135:0/4069557847 shutdown_connections 2024-04-20T12:26:29.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.398+0000 7f9d0eda5740 1 -- 172.21.15.135:0/4069557847 wait complete. 2024-04-20T12:26:29.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.398+0000 7f9d0eda5740 20 client.16797 trim_cache size 0 max 16384 2024-04-20T12:26:29.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0eda5740 1 Processor -- start 2024-04-20T12:26:29.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0eda5740 1 -- start start 2024-04-20T12:26:29.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0eda5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e40747bc20 0x55e407495380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0eda5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747c5d0 0x55e407486040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0eda5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e407489720 0x55e407478220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0eda5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d041ad1e0 con 0x55e407489720 2024-04-20T12:26:29.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0eda5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d041aed20 con 0x55e40747c5d0 2024-04-20T12:26:29.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0eda5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d041ad8b0 con 0x55e40747bc20 2024-04-20T12:26:29.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0a66f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e407489720 0x55e407478220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0a66f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e407489720 0x55e407478220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41774/0 (socket says 172.21.15.135:41774) 2024-04-20T12:26:29.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0a66f640 1 -- 172.21.15.135:0/276849646 learned_addr learned my addr 172.21.15.135:0/276849646 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d09e6e640 1 --2- 172.21.15.135:0/276849646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e40747bc20 0x55e407495380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0966d640 1 --2- 172.21.15.135:0/276849646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747c5d0 0x55e407486040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0a66f640 1 -- 172.21.15.135:0/276849646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e40747bc20 msgr2=0x55e407495380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0a66f640 1 --2- 172.21.15.135:0/276849646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e40747bc20 0x55e407495380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0a66f640 1 -- 172.21.15.135:0/276849646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747c5d0 msgr2=0x55e407486040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0a66f640 1 --2- 172.21.15.135:0/276849646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747c5d0 0x55e407486040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.411+0000 7f9d0a66f640 1 -- 172.21.15.135:0/276849646 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e407471be0 con 0x55e407489720 2024-04-20T12:26:29.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.412+0000 7f9d0a66f640 1 --2- 172.21.15.135:0/276849646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e407489720 0x55e407478220 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc036000 tx=0x7f9cfc02e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448fb0c058fca46c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.412+0000 7f9cef7fe640 1 -- 172.21.15.135:0/276849646 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc039040 con 0x55e407489720 2024-04-20T12:26:29.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.412+0000 7f9cef7fe640 1 -- 172.21.15.135:0/276849646 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cfc003e50 con 0x55e407489720 2024-04-20T12:26:29.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.412+0000 7f9cef7fe640 1 -- 172.21.15.135:0/276849646 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc034440 con 0x55e407489720 2024-04-20T12:26:29.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.412+0000 7f9d0eda5740 1 -- 172.21.15.135:0/276849646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e407489720 msgr2=0x55e407478220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.412+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/276849646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e407489720 0x55e407478220 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc036000 tx=0x7f9cfc02e040 comp rx=0 tx=0).stop 2024-04-20T12:26:29.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.412+0000 7f9d0eda5740 1 -- 172.21.15.135:0/276849646 shutdown_connections 2024-04-20T12:26:29.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.412+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/276849646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e407489720 0x55e407478220 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.412+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/276849646 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747c5d0 0x55e407486040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.412+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/276849646 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e40747bc20 0x55e407495380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.412+0000 7f9d0eda5740 1 -- 172.21.15.135:0/276849646 >> 172.21.15.135:0/276849646 conn(0x55e407476540 msgr2=0x55e407474e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.412+0000 7f9d0eda5740 1 -- 172.21.15.135:0/276849646 shutdown_connections 2024-04-20T12:26:29.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.412+0000 7f9d0eda5740 1 -- 172.21.15.135:0/276849646 wait complete. 2024-04-20T12:26:29.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0eda5740 1 -- start start 2024-04-20T12:26:29.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0eda5740 1 Processor -- start 2024-04-20T12:26:29.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0eda5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747bc20 0x55e407491890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0eda5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e40747c5d0 0x55e407491dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0eda5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e407489720 0x55e40748cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0eda5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d041ae650 con 0x55e407489720 2024-04-20T12:26:29.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0eda5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d041adf80 con 0x55e40747bc20 2024-04-20T12:26:29.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0eda5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d041ab1b0 con 0x55e40747c5d0 2024-04-20T12:26:29.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0eda5740 10 client.0 _ll_register_callbacks cb 0x7f9cf4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:29.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0a66f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e407489720 0x55e40748cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0a66f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e407489720 0x55e40748cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41786/0 (socket says 172.21.15.135:41786) 2024-04-20T12:26:29.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0a66f640 1 -- 172.21.15.135:0/306105991 learned_addr learned my addr 172.21.15.135:0/306105991 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0966d640 1 --2- 172.21.15.135:0/306105991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e40747c5d0 0x55e407491dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0a66f640 1 -- 172.21.15.135:0/306105991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e40747c5d0 msgr2=0x55e407491dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0a66f640 1 --2- 172.21.15.135:0/306105991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e40747c5d0 0x55e407491dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0a66f640 1 -- 172.21.15.135:0/306105991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747bc20 msgr2=0x55e407491890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d09e6e640 1 --2- 172.21.15.135:0/306105991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747bc20 0x55e407491890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0a66f640 1 --2- 172.21.15.135:0/306105991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747bc20 0x55e407491890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d0a66f640 1 -- 172.21.15.135:0/306105991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e40748d7e0 con 0x55e407489720 2024-04-20T12:26:29.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.413+0000 7f9d09e6e640 1 --2- 172.21.15.135:0/306105991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747bc20 0x55e407491890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:26:29.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9d0a66f640 1 --2- 172.21.15.135:0/306105991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e407489720 0x55e40748cfe0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc004580 tx=0x7f9cfc009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18566625bf3f539a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9ced7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:29.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9ced7fa640 1 -- 172.21.15.135:0/306105991 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc039070 con 0x55e407489720 2024-04-20T12:26:29.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9ced7fa640 1 -- 172.21.15.135:0/306105991 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9cfc003b70 con 0x55e407489720 2024-04-20T12:26:29.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9d0eda5740 1 -- 172.21.15.135:0/306105991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cfc003e50 con 0x55e407489720 2024-04-20T12:26:29.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9ced7fa640 1 -- 172.21.15.135:0/306105991 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9cfc061050 con 0x55e407489720 2024-04-20T12:26:29.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9d0eda5740 10 client.16803 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:29.433 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9d0eda5740 1 -- 172.21.15.135:0/306105991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e4074ff7a0 con 0x55e407489720 2024-04-20T12:26:29.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9ced7fa640 1 -- 172.21.15.135:0/306105991 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cfc003e50 con 0x55e407489720 2024-04-20T12:26:29.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9ced7fa640 1 -- 172.21.15.135:0/306105991 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f9cfc04d070 con 0x55e407489720 2024-04-20T12:26:29.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9d0eda5740 10 client.16803 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:29.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9d0eda5740 10 client.16803 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:26:29.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9d0eda5740 20 client.16803 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:29.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/306105991 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55e4074fff20 0x55e407502340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9d0eda5740 4 client.16803 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:26:29.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.414+0000 7f9d0eda5740 1 -- 172.21.15.135:0/306105991 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e4073e89a0 con 0x55e4074fff20 2024-04-20T12:26:29.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9d09e6e640 1 --2- 172.21.15.135:0/306105991 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55e4074fff20 0x55e407502340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9ced7fa640 10 client.16803 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:26:29.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9d09e6e640 1 --2- 172.21.15.135:0/306105991 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55e4074fff20 0x55e407502340 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4d96f8d4aefa011c server_cookie=360be2c4347ad50a in_seq=0 out_seq=0 2024-04-20T12:26:29.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9ced7fa640 1 -- 172.21.15.135:0/306105991 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e4073e89a0 con 0x55e4074fff20 2024-04-20T12:26:29.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9ced7fa640 10 client.16803 handle_command_reply: tid=0 2024-04-20T12:26:29.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9d0eda5740 1 client.16803 shutdown 2024-04-20T12:26:29.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9d0eda5740 1 -- 172.21.15.135:0/306105991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e407489720 msgr2=0x55e40748cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/306105991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e407489720 0x55e40748cfe0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc004580 tx=0x7f9cfc009540 comp rx=0 tx=0).stop 2024-04-20T12:26:29.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9d0eda5740 1 -- 172.21.15.135:0/306105991 shutdown_connections 2024-04-20T12:26:29.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/306105991 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55e4074fff20 0x55e407502340 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/306105991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e407489720 0x55e40748cfe0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/306105991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e40747c5d0 0x55e407491dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9d0eda5740 1 --2- 172.21.15.135:0/306105991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e40747bc20 0x55e407491890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9ced7fa640 0 client.16803 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:26:29.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9d0eda5740 1 -- 172.21.15.135:0/306105991 >> 172.21.15.135:0/306105991 conn(0x55e407476540 msgr2=0x55e4074756e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9d0eda5740 1 -- 172.21.15.135:0/306105991 shutdown_connections 2024-04-20T12:26:29.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9d0eda5740 1 -- 172.21.15.135:0/306105991 wait complete. 2024-04-20T12:26:29.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.415+0000 7f9d0eda5740 20 client.16803 trim_cache size 0 max 16384 2024-04-20T12:26:29.438 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:26:29.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.416+0000 7f9d0c0d2640 1 -- 172.21.15.135:0/1201060748 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9cf00a3d20 msgr2=0x7f9cf00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.416+0000 7f9d0c0d2640 1 --2- 172.21.15.135:0/1201060748 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9cf00a3d20 0x7f9cf00a61e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc004af0 tx=0x7f9cfc005c50 comp rx=0 tx=0).stop 2024-04-20T12:26:29.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.416+0000 7f9d0c0d2640 1 -- 172.21.15.135:0/1201060748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d04101090 msgr2=0x7f9d04199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.416+0000 7f9d0c0d2640 1 --2- 172.21.15.135:0/1201060748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d04101090 0x7f9d04199620 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000e9f0 tx=0x7f9d0000eeb0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.416+0000 7f9d0c0d2640 1 -- 172.21.15.135:0/1201060748 shutdown_connections 2024-04-20T12:26:29.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.416+0000 7f9d0c0d2640 1 --2- 172.21.15.135:0/1201060748 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d0419a0f0 0x7f9d041a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.416+0000 7f9d0c0d2640 1 --2- 172.21.15.135:0/1201060748 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9cf00a3d20 0x7f9cf00a61e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.416+0000 7f9d0c0d2640 1 --2- 172.21.15.135:0/1201060748 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d04106160 0x7f9d04199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.416+0000 7f9d0c0d2640 1 --2- 172.21.15.135:0/1201060748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d04101090 0x7f9d04199620 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.416+0000 7f9d0c0d2640 1 -- 172.21.15.135:0/1201060748 >> 172.21.15.135:0/1201060748 conn(0x7f9d04077fe0 msgr2=0x7f9d040fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.416+0000 7f9d0c0d2640 1 -- 172.21.15.135:0/1201060748 shutdown_connections 2024-04-20T12:26:29.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.416+0000 7f9d0c0d2640 1 -- 172.21.15.135:0/1201060748 wait complete. 2024-04-20T12:26:29.445 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:29 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2406845966' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:26:29.446 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:26:29.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:29 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2406845966' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:26:29.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.547+0000 7fc1dbc25640 1 -- 172.21.15.135:0/3501505924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d4106190 msgr2=0x7fc1d410dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.547+0000 7fc1dbc25640 1 --2- 172.21.15.135:0/3501505924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d4106190 0x7fc1d410dd60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc009ca0 tx=0x7fc1cc02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.547+0000 7fc1dbc25640 1 -- 172.21.15.135:0/3501505924 shutdown_connections 2024-04-20T12:26:29.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.547+0000 7fc1dbc25640 1 --2- 172.21.15.135:0/3501505924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d4106190 0x7fc1d410dd60 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.547+0000 7fc1dbc25640 1 --2- 172.21.15.135:0/3501505924 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1d4101a70 0x7fc1d4105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.547+0000 7fc1dbc25640 1 --2- 172.21.15.135:0/3501505924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1d41010c0 0x7fc1d41014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.547+0000 7fc1dbc25640 1 -- 172.21.15.135:0/3501505924 >> 172.21.15.135:0/3501505924 conn(0x7fc1d40771e0 msgr2=0x7fc1d40775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.547+0000 7fc1dbc25640 1 -- 172.21.15.135:0/3501505924 shutdown_connections 2024-04-20T12:26:29.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.547+0000 7fc1dbc25640 1 -- 172.21.15.135:0/3501505924 wait complete. 2024-04-20T12:26:29.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.548+0000 7fc1dbc25640 1 Processor -- start 2024-04-20T12:26:29.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.548+0000 7fc1dbc25640 1 -- start start 2024-04-20T12:26:29.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.548+0000 7fc1dbc25640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1d41010c0 0x7fc1d4198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.548+0000 7fc1dbc25640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1d4106190 0x7fc1d4198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.548+0000 7fc1dbc25640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d419cfc0 0x7fc1d419d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.548+0000 7fc1dbc25640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d4112350 con 0x7fc1d419cfc0 2024-04-20T12:26:29.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.548+0000 7fc1dbc25640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d41121d0 con 0x7fc1d41010c0 2024-04-20T12:26:29.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.548+0000 7fc1dbc25640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d41124d0 con 0x7fc1d4106190 2024-04-20T12:26:29.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.548+0000 7fc1da1c2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d419cfc0 0x7fc1d419d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.548+0000 7fc1da1c2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d419cfc0 0x7fc1d419d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41808/0 (socket says 172.21.15.135:41808) 2024-04-20T12:26:29.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.548+0000 7fc1da1c2640 1 -- 172.21.15.135:0/3446757567 learned_addr learned my addr 172.21.15.135:0/3446757567 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.553 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.548+0000 7fc1d99c1640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1d41010c0 0x7fc1d4198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.548+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1d4106190 0x7fc1d4198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.548+0000 7fc1da1c2640 1 -- 172.21.15.135:0/3446757567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1d4106190 msgr2=0x7fc1d4198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.549+0000 7fc1da1c2640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1d4106190 0x7fc1d4198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.549+0000 7fc1da1c2640 1 -- 172.21.15.135:0/3446757567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1d41010c0 msgr2=0x7fc1d4198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.549+0000 7fc1da1c2640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1d41010c0 0x7fc1d4198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.549+0000 7fc1da1c2640 1 -- 172.21.15.135:0/3446757567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d419dab0 con 0x7fc1d419cfc0 2024-04-20T12:26:29.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.549+0000 7fc1d99c1640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1d41010c0 0x7fc1d4198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:26:29.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.549+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1d4106190 0x7fc1d4198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:26:29.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.549+0000 7fc1da1c2640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d419cfc0 0x7fc1d419d470 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc02c700 tx=0x7fc1cc032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.549+0000 7fc1caffd640 1 -- 172.21.15.135:0/3446757567 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc039040 con 0x7fc1d419cfc0 2024-04-20T12:26:29.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.549+0000 7fc1caffd640 1 -- 172.21.15.135:0/3446757567 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1cc044070 con 0x7fc1d419cfc0 2024-04-20T12:26:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.549+0000 7fc1dbc25640 1 -- 172.21.15.135:0/3446757567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d419dd40 con 0x7fc1d419cfc0 2024-04-20T12:26:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.549+0000 7fc1caffd640 1 -- 172.21.15.135:0/3446757567 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0042a0 con 0x7fc1d419cfc0 2024-04-20T12:26:29.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.549+0000 7fc1dbc25640 1 -- 172.21.15.135:0/3446757567 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d41a5500 con 0x7fc1d419cfc0 2024-04-20T12:26:29.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.552+0000 7fc1caffd640 1 -- 172.21.15.135:0/3446757567 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fc1cc004440 con 0x7fc1d419cfc0 2024-04-20T12:26:29.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.552+0000 7fc1de813740 1 Processor -- start 2024-04-20T12:26:29.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.552+0000 7fc1de813740 1 -- start start 2024-04-20T12:26:29.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.552+0000 7fc1de813740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d328de10 0x5592d328e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.552+0000 7fc1de813740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328e730 0x5592d3296dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.552+0000 7fc1de813740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d3297310 0x5592d3299700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.552+0000 7fc1de813740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5592d31f3110 con 0x5592d328e730 2024-04-20T12:26:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.552+0000 7fc1de813740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5592d3190550 con 0x5592d3297310 2024-04-20T12:26:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.552+0000 7fc1de813740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5592d31ef0d0 con 0x5592d328de10 2024-04-20T12:26:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.552+0000 7fc1caffd640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1c00a3d20 0x7fc1c00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1d99c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328e730 0x5592d3296dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1d99c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328e730 0x5592d3296dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41812/0 (socket says 172.21.15.135:41812) 2024-04-20T12:26:29.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1da1c2640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1c00a3d20 0x7fc1c00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1d99c1640 1 -- 172.21.15.135:0/2717934764 learned_addr learned my addr 172.21.15.135:0/2717934764 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/2717934764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d3297310 0x5592d3299700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1caffd640 1 -- 172.21.15.135:0/3446757567 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc1cc0f2ed0 con 0x7fc1d419cfc0 2024-04-20T12:26:29.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/2717934764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d328de10 0x5592d328e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1d99c1640 1 -- 172.21.15.135:0/2717934764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d328de10 msgr2=0x5592d328e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1d99c1640 1 --2- 172.21.15.135:0/2717934764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d328de10 0x5592d328e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1d99c1640 1 -- 172.21.15.135:0/2717934764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d3297310 msgr2=0x5592d3299700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1d99c1640 1 --2- 172.21.15.135:0/2717934764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d3297310 0x5592d3299700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1d99c1640 1 -- 172.21.15.135:0/2717934764 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592d31b8900 con 0x5592d328e730 2024-04-20T12:26:29.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/2717934764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d3297310 0x5592d3299700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:26:29.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1da1c2640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1c00a3d20 0x7fc1c00a61e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0f0460 tx=0x7fc1cc0095c0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1d99c1640 1 --2- 172.21.15.135:0/2717934764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328e730 0x5592d3296dd0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0008c60 tx=0x7fc1d000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7fd134af02614c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1bffff640 1 -- 172.21.15.135:0/2717934764 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0014070 con 0x5592d328e730 2024-04-20T12:26:29.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1bffff640 1 -- 172.21.15.135:0/2717934764 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1d00047a0 con 0x5592d328e730 2024-04-20T12:26:29.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.553+0000 7fc1bffff640 1 -- 172.21.15.135:0/2717934764 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0010760 con 0x5592d328e730 2024-04-20T12:26:29.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.554+0000 7fc1de813740 1 -- 172.21.15.135:0/2717934764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328e730 msgr2=0x5592d3296dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.554+0000 7fc1de813740 1 --2- 172.21.15.135:0/2717934764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328e730 0x5592d3296dd0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0008c60 tx=0x7fc1d000e720 comp rx=0 tx=0).stop 2024-04-20T12:26:29.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.554+0000 7fc1de813740 1 -- 172.21.15.135:0/2717934764 shutdown_connections 2024-04-20T12:26:29.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.554+0000 7fc1de813740 1 --2- 172.21.15.135:0/2717934764 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d3297310 0x5592d3299700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.554+0000 7fc1de813740 1 --2- 172.21.15.135:0/2717934764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328e730 0x5592d3296dd0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.554+0000 7fc1de813740 1 --2- 172.21.15.135:0/2717934764 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d328de10 0x5592d328e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.554+0000 7fc1de813740 1 -- 172.21.15.135:0/2717934764 >> 172.21.15.135:0/2717934764 conn(0x5592d3288540 msgr2=0x5592d3288920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.554+0000 7fc1de813740 1 -- 172.21.15.135:0/2717934764 shutdown_connections 2024-04-20T12:26:29.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.554+0000 7fc1de813740 1 -- 172.21.15.135:0/2717934764 wait complete. 2024-04-20T12:26:29.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.554+0000 7fc1de813740 1 -- start start 2024-04-20T12:26:29.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1de813740 1 Processor -- start 2024-04-20T12:26:29.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1de813740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d328de10 0x5592d32943d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1de813740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328e730 0x5592d3294910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1de813740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d3297310 0x5592d3294e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1de813740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5592d329a040 con 0x5592d328e730 2024-04-20T12:26:29.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1de813740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5592d31ac500 con 0x5592d328de10 2024-04-20T12:26:29.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1de813740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5592d329a1c0 con 0x5592d3297310 2024-04-20T12:26:29.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1de813740 10 client.0 _ll_register_callbacks cb 0x5592d31912f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:29.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1d99c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328e730 0x5592d3294910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1d99c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328e730 0x5592d3294910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41814/0 (socket says 172.21.15.135:41814) 2024-04-20T12:26:29.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1d99c1640 1 -- 172.21.15.135:0/3272055696 learned_addr learned my addr 172.21.15.135:0/3272055696 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/3272055696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d3297310 0x5592d3294e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/3272055696 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d328de10 0x5592d32943d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1d99c1640 1 -- 172.21.15.135:0/3272055696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d3297310 msgr2=0x5592d3294e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1d99c1640 1 --2- 172.21.15.135:0/3272055696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d3297310 0x5592d3294e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1d99c1640 1 -- 172.21.15.135:0/3272055696 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d328de10 msgr2=0x5592d32943d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1d99c1640 1 --2- 172.21.15.135:0/3272055696 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d328de10 0x5592d32943d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1d99c1640 1 -- 172.21.15.135:0/3272055696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592d2f053f0 con 0x5592d328e730 2024-04-20T12:26:29.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.555+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/3272055696 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d328de10 0x5592d32943d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:26:29.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1d99c1640 1 --2- 172.21.15.135:0/3272055696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328e730 0x5592d3294910 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000ec20 tx=0x7fc1d0005160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cc649a8292eee8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:29.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1bd7fa640 1 -- 172.21.15.135:0/3272055696 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0014070 con 0x5592d328e730 2024-04-20T12:26:29.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1bd7fa640 1 -- 172.21.15.135:0/3272055696 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc1d00054e0 con 0x5592d328e730 2024-04-20T12:26:29.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1de813740 1 -- 172.21.15.135:0/3272055696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1d00047a0 con 0x5592d328e730 2024-04-20T12:26:29.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1bd7fa640 1 -- 172.21.15.135:0/3272055696 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc1d0004030 con 0x5592d328e730 2024-04-20T12:26:29.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1de813740 10 client.16815 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:29.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1de813740 1 -- 172.21.15.135:0/3272055696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5592d2fcf7d0 con 0x5592d328e730 2024-04-20T12:26:29.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1bd7fa640 1 -- 172.21.15.135:0/3272055696 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1d00047a0 con 0x5592d328e730 2024-04-20T12:26:29.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1bd7fa640 1 -- 172.21.15.135:0/3272055696 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc1d0003c60 con 0x5592d328e730 2024-04-20T12:26:29.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1de813740 10 client.16815 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:29.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1de813740 10 client.16815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:26:29.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1de813740 20 client.16815 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:29.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1de813740 1 --2- 172.21.15.135:0/3272055696 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592d32a7730 0x5592d32a9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1de813740 4 client.16815 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:26:29.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.556+0000 7fc1de813740 1 -- 172.21.15.135:0/3272055696 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592d3200b30 con 0x5592d32a7730 2024-04-20T12:26:29.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.557+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/3272055696 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592d32a7730 0x5592d32a9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.557+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/3272055696 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592d32a7730 0x5592d32a9b20 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8da6f7dae31b1326 server_cookie=abf1849c4aaee6a7 in_seq=0 out_seq=0 2024-04-20T12:26:29.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.557+0000 7fc1bd7fa640 10 client.16815 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:29.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.558+0000 7fc1bd7fa640 1 -- 172.21.15.135:0/3272055696 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5592d3200b30 con 0x5592d32a7730 2024-04-20T12:26:29.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.558+0000 7fc1bd7fa640 10 client.16815 handle_command_reply: tid=0 2024-04-20T12:26:29.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.558+0000 7fc1de813740 1 client.16815 shutdown 2024-04-20T12:26:29.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.558+0000 7fc1de813740 1 -- 172.21.15.135:0/3272055696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328e730 msgr2=0x5592d3294910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.558+0000 7fc1de813740 1 --2- 172.21.15.135:0/3272055696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328e730 0x5592d3294910 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000ec20 tx=0x7fc1d0005160 comp rx=0 tx=0).stop 2024-04-20T12:26:29.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.558+0000 7fc1de813740 1 -- 172.21.15.135:0/3272055696 shutdown_connections 2024-04-20T12:26:29.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.558+0000 7fc1de813740 1 --2- 172.21.15.135:0/3272055696 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592d32a7730 0x5592d32a9b20 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.558+0000 7fc1de813740 1 --2- 172.21.15.135:0/3272055696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d3297310 0x5592d3294e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.558+0000 7fc1de813740 1 --2- 172.21.15.135:0/3272055696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328e730 0x5592d3294910 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.558+0000 7fc1de813740 1 --2- 172.21.15.135:0/3272055696 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d328de10 0x5592d32943d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.558+0000 7fc1bd7fa640 0 client.16815 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:29.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.558+0000 7fc1de813740 1 -- 172.21.15.135:0/3272055696 >> 172.21.15.135:0/3272055696 conn(0x5592d3288540 msgr2=0x5592d328a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.558+0000 7fc1de813740 1 -- 172.21.15.135:0/3272055696 shutdown_connections 2024-04-20T12:26:29.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.558+0000 7fc1de813740 1 -- 172.21.15.135:0/3272055696 wait complete. 2024-04-20T12:26:29.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.558+0000 7fc1de813740 20 client.16815 trim_cache size 0 max 16384 2024-04-20T12:26:29.581 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:29 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2406845966' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:26:29.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.571+0000 7fc1de813740 1 Processor -- start 2024-04-20T12:26:29.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.571+0000 7fc1de813740 1 -- start start 2024-04-20T12:26:29.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.571+0000 7fc1de813740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d328de10 0x5592d3296b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.571+0000 7fc1de813740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d328e730 0x5592d32a3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.571+0000 7fc1de813740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d3297310 0x5592d32af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.571+0000 7fc1de813740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d41af210 con 0x5592d3297310 2024-04-20T12:26:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.571+0000 7fc1de813740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d41b0d50 con 0x5592d328de10 2024-04-20T12:26:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.571+0000 7fc1de813740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d41af8e0 con 0x5592d328e730 2024-04-20T12:26:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.571+0000 7fc1d91c0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d3297310 0x5592d32af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.571+0000 7fc1d91c0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d3297310 0x5592d32af2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41818/0 (socket says 172.21.15.135:41818) 2024-04-20T12:26:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.571+0000 7fc1d91c0640 1 -- 172.21.15.135:0/2053494714 learned_addr learned my addr 172.21.15.135:0/2053494714 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.572+0000 7fc1d99c1640 1 --2- 172.21.15.135:0/2053494714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d328e730 0x5592d32a3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.572+0000 7fc1d91c0640 1 -- 172.21.15.135:0/2053494714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d328e730 msgr2=0x5592d32a3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.572+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/2053494714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d328e730 0x5592d32a3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.572+0000 7fc1d91c0640 1 -- 172.21.15.135:0/2053494714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d328de10 msgr2=0x5592d3296b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.572+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/2053494714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d328de10 0x5592d3296b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.572+0000 7fc1d91c0640 1 -- 172.21.15.135:0/2053494714 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592d3292940 con 0x5592d3297310 2024-04-20T12:26:29.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.572+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/2053494714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d3297310 0x5592d32af2f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c8e0 tx=0x7fc1c4016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc03af977c125fa server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.572+0000 7fc1bf7fe640 1 -- 172.21.15.135:0/2053494714 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4024020 con 0x5592d3297310 2024-04-20T12:26:29.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.572+0000 7fc1bf7fe640 1 -- 172.21.15.135:0/2053494714 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1c4020810 con 0x5592d3297310 2024-04-20T12:26:29.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.572+0000 7fc1bf7fe640 1 -- 172.21.15.135:0/2053494714 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4014af0 con 0x5592d3297310 2024-04-20T12:26:29.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 -- 172.21.15.135:0/2053494714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d3297310 msgr2=0x5592d32af2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 --2- 172.21.15.135:0/2053494714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d3297310 0x5592d32af2f0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c8e0 tx=0x7fc1c4016040 comp rx=0 tx=0).stop 2024-04-20T12:26:29.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 -- 172.21.15.135:0/2053494714 shutdown_connections 2024-04-20T12:26:29.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 --2- 172.21.15.135:0/2053494714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d3297310 0x5592d32af2f0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 --2- 172.21.15.135:0/2053494714 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d328e730 0x5592d32a3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 --2- 172.21.15.135:0/2053494714 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d328de10 0x5592d3296b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 -- 172.21.15.135:0/2053494714 >> 172.21.15.135:0/2053494714 conn(0x5592d3288540 msgr2=0x5592d32876e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 -- 172.21.15.135:0/2053494714 shutdown_connections 2024-04-20T12:26:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 -- 172.21.15.135:0/2053494714 wait complete. 2024-04-20T12:26:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 -- start start 2024-04-20T12:26:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 Processor -- start 2024-04-20T12:26:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328de10 0x5592d329f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d328e730 0x5592d329fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d3297310 0x5592d329c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d41b0680 con 0x5592d328de10 2024-04-20T12:26:29.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d41affb0 con 0x5592d3297310 2024-04-20T12:26:29.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d41ad1e0 con 0x5592d328e730 2024-04-20T12:26:29.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1de813740 10 client.0 _ll_register_callbacks cb 0x7fc1c400ca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:29.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1d91c0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328de10 0x5592d329f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1d91c0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328de10 0x5592d329f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41830/0 (socket says 172.21.15.135:41830) 2024-04-20T12:26:29.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.573+0000 7fc1d91c0640 1 -- 172.21.15.135:0/375591504 learned_addr learned my addr 172.21.15.135:0/375591504 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:29.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1d99c1640 1 --2- 172.21.15.135:0/375591504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d328e730 0x5592d329fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1d91c0640 1 -- 172.21.15.135:0/375591504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d328e730 msgr2=0x5592d329fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/375591504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d328e730 0x5592d329fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1d91c0640 1 -- 172.21.15.135:0/375591504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d3297310 msgr2=0x5592d329c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:29.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/375591504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d3297310 0x5592d329c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1d91c0640 1 -- 172.21.15.135:0/375591504 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592d329cdf0 con 0x5592d328de10 2024-04-20T12:26:29.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1d91c0640 1 --2- 172.21.15.135:0/375591504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328de10 0x5592d329f530 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4000c00 tx=0x7fc1c40145f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e207312b05d2c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:29.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:29.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1bd7fa640 1 -- 172.21.15.135:0/375591504 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4024070 con 0x5592d328de10 2024-04-20T12:26:29.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1bd7fa640 1 -- 172.21.15.135:0/375591504 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc1c4003bc0 con 0x5592d328de10 2024-04-20T12:26:29.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1de813740 1 -- 172.21.15.135:0/375591504 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1c4020810 con 0x5592d328de10 2024-04-20T12:26:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1bd7fa640 1 -- 172.21.15.135:0/375591504 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc1c4003dc0 con 0x5592d328de10 2024-04-20T12:26:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1de813740 10 client.16821 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1de813740 1 -- 172.21.15.135:0/375591504 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5592d330e750 con 0x5592d328de10 2024-04-20T12:26:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1bd7fa640 1 -- 172.21.15.135:0/375591504 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1c4020810 con 0x5592d328de10 2024-04-20T12:26:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1bd7fa640 1 -- 172.21.15.135:0/375591504 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc1c4029990 con 0x5592d328de10 2024-04-20T12:26:29.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1de813740 10 client.16821 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1de813740 10 client.16821 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:26:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1de813740 20 client.16821 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.574+0000 7fc1de813740 1 --2- 172.21.15.135:0/375591504 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592d330ee10 0x5592d3311230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1de813740 4 client.16821 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:26:29.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1de813740 1 -- 172.21.15.135:0/375591504 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5592d31fa9a0 con 0x5592d330ee10 2024-04-20T12:26:29.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1d99c1640 1 --2- 172.21.15.135:0/375591504 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592d330ee10 0x5592d3311230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:29.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1bd7fa640 10 client.16821 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:29.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1d99c1640 1 --2- 172.21.15.135:0/375591504 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592d330ee10 0x5592d3311230 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1cbc19108f5da11 server_cookie=1520ca93e324a21b in_seq=0 out_seq=0 2024-04-20T12:26:29.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1bd7fa640 1 -- 172.21.15.135:0/375591504 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5592d31fa9a0 con 0x5592d330ee10 2024-04-20T12:26:29.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1bd7fa640 10 client.16821 handle_command_reply: tid=0 2024-04-20T12:26:29.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1de813740 1 client.16821 shutdown 2024-04-20T12:26:29.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1de813740 1 -- 172.21.15.135:0/375591504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328de10 msgr2=0x5592d329f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1de813740 1 --2- 172.21.15.135:0/375591504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328de10 0x5592d329f530 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4000c00 tx=0x7fc1c40145f0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1de813740 1 -- 172.21.15.135:0/375591504 shutdown_connections 2024-04-20T12:26:29.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1de813740 1 --2- 172.21.15.135:0/375591504 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592d330ee10 0x5592d3311230 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1de813740 1 --2- 172.21.15.135:0/375591504 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592d3297310 0x5592d329c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1bd7fa640 0 client.16821 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1de813740 1 --2- 172.21.15.135:0/375591504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592d328e730 0x5592d329fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1de813740 1 --2- 172.21.15.135:0/375591504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592d328de10 0x5592d329f530 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.575+0000 7fc1de813740 1 -- 172.21.15.135:0/375591504 >> 172.21.15.135:0/375591504 conn(0x5592d3288540 msgr2=0x5592d3294370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.576+0000 7fc1de813740 1 -- 172.21.15.135:0/375591504 shutdown_connections 2024-04-20T12:26:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.576+0000 7fc1de813740 1 -- 172.21.15.135:0/375591504 wait complete. 2024-04-20T12:26:29.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.576+0000 7fc1de813740 20 client.16821 trim_cache size 0 max 16384 2024-04-20T12:26:29.600 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:26:29.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.576+0000 7fc1dbc25640 1 -- 172.21.15.135:0/3446757567 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1c00a3d20 msgr2=0x7fc1c00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.576+0000 7fc1dbc25640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1c00a3d20 0x7fc1c00a61e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0f0460 tx=0x7fc1cc0095c0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.576+0000 7fc1dbc25640 1 -- 172.21.15.135:0/3446757567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d419cfc0 msgr2=0x7fc1d419d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:29.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.576+0000 7fc1dbc25640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d419cfc0 0x7fc1d419d470 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc02c700 tx=0x7fc1cc032f20 comp rx=0 tx=0).stop 2024-04-20T12:26:29.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.576+0000 7fc1dbc25640 1 -- 172.21.15.135:0/3446757567 shutdown_connections 2024-04-20T12:26:29.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.576+0000 7fc1dbc25640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1d419cfc0 0x7fc1d419d470 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.576+0000 7fc1dbc25640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1c00a3d20 0x7fc1c00a61e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.576+0000 7fc1dbc25640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1d4106190 0x7fc1d4198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.576+0000 7fc1dbc25640 1 --2- 172.21.15.135:0/3446757567 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1d41010c0 0x7fc1d4198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:29.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.576+0000 7fc1dbc25640 1 -- 172.21.15.135:0/3446757567 >> 172.21.15.135:0/3446757567 conn(0x7fc1d40771e0 msgr2=0x7fc1d40feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:29.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.576+0000 7fc1dbc25640 1 -- 172.21.15.135:0/3446757567 shutdown_connections 2024-04-20T12:26:29.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:29.576+0000 7fc1dbc25640 1 -- 172.21.15.135:0/3446757567 wait complete. 2024-04-20T12:26:30.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:30 smithi154 ceph-mon[22073]: pgmap v104: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:26:30.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:30 smithi139 ceph-mon[21834]: pgmap v104: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:26:30.605 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:26:30.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:26:30.606 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:26:30.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:30 smithi135 ceph-mon[18264]: pgmap v104: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:26:30.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.719+0000 7fcd5dad2640 1 -- 172.21.15.135:0/3328572442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd58107040 msgr2=0x7fcd58107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.719+0000 7fcd5dad2640 1 --2- 172.21.15.135:0/3328572442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd58107040 0x7fcd58107420 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009930 tx=0x7fcd4c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:26:30.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.719+0000 7fcd5dad2640 1 -- 172.21.15.135:0/3328572442 shutdown_connections 2024-04-20T12:26:30.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.719+0000 7fcd5dad2640 1 --2- 172.21.15.135:0/3328572442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd58101b50 0x7fcd5810dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.719+0000 7fcd5dad2640 1 --2- 172.21.15.135:0/3328572442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd581011b0 0x7fcd58101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.719+0000 7fcd5dad2640 1 --2- 172.21.15.135:0/3328572442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd58107040 0x7fcd58107420 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.719+0000 7fcd5dad2640 1 -- 172.21.15.135:0/3328572442 >> 172.21.15.135:0/3328572442 conn(0x7fcd58076c60 msgr2=0x7fcd58077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:30.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.719+0000 7fcd5dad2640 1 -- 172.21.15.135:0/3328572442 shutdown_connections 2024-04-20T12:26:30.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.719+0000 7fcd5dad2640 1 -- 172.21.15.135:0/3328572442 wait complete. 2024-04-20T12:26:30.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.720+0000 7fcd5dad2640 1 Processor -- start 2024-04-20T12:26:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.720+0000 7fcd5dad2640 1 -- start start 2024-04-20T12:26:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.720+0000 7fcd5dad2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd581011b0 0x7fcd5819e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.720+0000 7fcd5dad2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd58101b50 0x7fcd5819ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.720+0000 7fcd5dad2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd58107040 0x7fcd581986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.720+0000 7fcd5dad2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd58111240 con 0x7fcd58107040 2024-04-20T12:26:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.720+0000 7fcd5dad2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcd581110c0 con 0x7fcd581011b0 2024-04-20T12:26:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.720+0000 7fcd5dad2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd581113c0 con 0x7fcd58101b50 2024-04-20T12:26:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.720+0000 7fcd57fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd58107040 0x7fcd581986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.720+0000 7fcd57fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd58107040 0x7fcd581986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49736/0 (socket says 172.21.15.135:49736) 2024-04-20T12:26:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.720+0000 7fcd57fff640 1 -- 172.21.15.135:0/424517361 learned_addr learned my addr 172.21.15.135:0/424517361 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.720+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/424517361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd58101b50 0x7fcd5819ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.721+0000 7fcd577fe640 1 --2- 172.21.15.135:0/424517361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd581011b0 0x7fcd5819e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.721+0000 7fcd57fff640 1 -- 172.21.15.135:0/424517361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd58101b50 msgr2=0x7fcd5819ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.721+0000 7fcd57fff640 1 --2- 172.21.15.135:0/424517361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd58101b50 0x7fcd5819ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.721+0000 7fcd57fff640 1 -- 172.21.15.135:0/424517361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd581011b0 msgr2=0x7fcd5819e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.721+0000 7fcd57fff640 1 --2- 172.21.15.135:0/424517361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd581011b0 0x7fcd5819e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.721+0000 7fcd57fff640 1 -- 172.21.15.135:0/424517361 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd58198f60 con 0x7fcd58107040 2024-04-20T12:26:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.721+0000 7fcd577fe640 1 --2- 172.21.15.135:0/424517361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd581011b0 0x7fcd5819e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:26:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.721+0000 7fcd57fff640 1 --2- 172.21.15.135:0/424517361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd58107040 0x7fcd581986a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000eaa0 tx=0x7fcd5000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.721+0000 7fcd54ff9640 1 -- 172.21.15.135:0/424517361 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5000cdb0 con 0x7fcd58107040 2024-04-20T12:26:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.721+0000 7fcd5dad2640 1 -- 172.21.15.135:0/424517361 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd58199250 con 0x7fcd58107040 2024-04-20T12:26:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.721+0000 7fcd54ff9640 1 -- 172.21.15.135:0/424517361 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd50005020 con 0x7fcd58107040 2024-04-20T12:26:30.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.721+0000 7fcd54ff9640 1 -- 172.21.15.135:0/424517361 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd500116b0 con 0x7fcd58107040 2024-04-20T12:26:30.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.721+0000 7fcd5dad2640 1 -- 172.21.15.135:0/424517361 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd581a5510 con 0x7fcd58107040 2024-04-20T12:26:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.723+0000 7fcd54ff9640 1 -- 172.21.15.135:0/424517361 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fcd50005560 con 0x7fcd58107040 2024-04-20T12:26:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd607a5740 1 Processor -- start 2024-04-20T12:26:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd607a5740 1 -- start start 2024-04-20T12:26:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd607a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b4063fe0 0x5592b40643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd607a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b4064900 0x5592b406cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd607a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b406d4e0 0x5592b406f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd607a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5592b3fc8f00 con 0x5592b406d4e0 2024-04-20T12:26:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd607a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5592b3f66530 con 0x5592b4064900 2024-04-20T12:26:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd607a5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5592b3fc4ec0 con 0x5592b4063fe0 2024-04-20T12:26:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd54ff9640 1 --2- 172.21.15.135:0/424517361 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd400a3d20 0x7fcd400a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd56ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b406d4e0 0x5592b406f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd56ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b406d4e0 0x5592b406f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49748/0 (socket says 172.21.15.135:49748) 2024-04-20T12:26:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd56ffd640 1 -- 172.21.15.135:0/1323700544 learned_addr learned my addr 172.21.15.135:0/1323700544 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/1323700544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b4063fe0 0x5592b40643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd57fff640 1 --2- 172.21.15.135:0/424517361 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd400a3d20 0x7fcd400a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd577fe640 1 --2- 172.21.15.135:0/1323700544 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b4064900 0x5592b406cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd54ff9640 1 -- 172.21.15.135:0/424517361 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fcd500d0dd0 con 0x7fcd58107040 2024-04-20T12:26:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd56ffd640 1 -- 172.21.15.135:0/1323700544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b4063fe0 msgr2=0x5592b40643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/1323700544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b4063fe0 0x5592b40643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd56ffd640 1 -- 172.21.15.135:0/1323700544 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b4064900 msgr2=0x5592b406cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/1323700544 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b4064900 0x5592b406cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.724+0000 7fcd56ffd640 1 -- 172.21.15.135:0/1323700544 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b3da37e0 con 0x5592b406d4e0 2024-04-20T12:26:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.725+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/1323700544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b406d4e0 0x5592b406f8d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fcd480127a0 tx=0x7fcd4800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b931c000fda4ce71 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.725+0000 7fcd57fff640 1 --2- 172.21.15.135:0/424517361 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd400a3d20 0x7fcd400a61e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcd5009c6f0 tx=0x7fcd5008e040 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.725+0000 7fcd3dffb640 1 -- 172.21.15.135:0/1323700544 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48012d20 con 0x5592b406d4e0 2024-04-20T12:26:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.725+0000 7fcd3dffb640 1 -- 172.21.15.135:0/1323700544 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd48005020 con 0x5592b406d4e0 2024-04-20T12:26:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.725+0000 7fcd3dffb640 1 -- 172.21.15.135:0/1323700544 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48004b20 con 0x5592b406d4e0 2024-04-20T12:26:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.725+0000 7fcd607a5740 1 -- 172.21.15.135:0/1323700544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b406d4e0 msgr2=0x5592b406f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.725+0000 7fcd607a5740 1 --2- 172.21.15.135:0/1323700544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b406d4e0 0x5592b406f8d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fcd480127a0 tx=0x7fcd4800b7c0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 1 -- 172.21.15.135:0/1323700544 shutdown_connections 2024-04-20T12:26:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 1 --2- 172.21.15.135:0/1323700544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b406d4e0 0x5592b406f8d0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 1 --2- 172.21.15.135:0/1323700544 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b4064900 0x5592b406cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 1 --2- 172.21.15.135:0/1323700544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b4063fe0 0x5592b40643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 1 -- 172.21.15.135:0/1323700544 >> 172.21.15.135:0/1323700544 conn(0x5592b405e710 msgr2=0x5592b405eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 1 -- 172.21.15.135:0/1323700544 shutdown_connections 2024-04-20T12:26:30.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 1 -- 172.21.15.135:0/1323700544 wait complete. 2024-04-20T12:26:30.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 1 -- start start 2024-04-20T12:26:30.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 1 Processor -- start 2024-04-20T12:26:30.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b4063fe0 0x5592b406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b4064900 0x5592b406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b406d4e0 0x5592b406a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5592b40702d0 con 0x5592b4063fe0 2024-04-20T12:26:30.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5592b3f51480 con 0x5592b406d4e0 2024-04-20T12:26:30.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5592b4070450 con 0x5592b4064900 2024-04-20T12:26:30.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.726+0000 7fcd607a5740 10 client.0 _ll_register_callbacks cb 0x5592b3f50e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:30.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd56ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b4063fe0 0x5592b406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd56ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b4063fe0 0x5592b406ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49752/0 (socket says 172.21.15.135:49752) 2024-04-20T12:26:30.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd56ffd640 1 -- 172.21.15.135:0/3136155584 learned_addr learned my addr 172.21.15.135:0/3136155584 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:30.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd577fe640 1 --2- 172.21.15.135:0/3136155584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b4064900 0x5592b406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/3136155584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b406d4e0 0x5592b406a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd56ffd640 1 -- 172.21.15.135:0/3136155584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b4064900 msgr2=0x5592b406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/3136155584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b4064900 0x5592b406a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd56ffd640 1 -- 172.21.15.135:0/3136155584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b406d4e0 msgr2=0x5592b406a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/3136155584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b406d4e0 0x5592b406a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd56ffd640 1 -- 172.21.15.135:0/3136155584 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592b3e03f70 con 0x5592b4063fe0 2024-04-20T12:26:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/3136155584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b4063fe0 0x5592b406ce90 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcd48012f50 tx=0x7fcd48005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410d12c5fe64088f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd36ffd640 1 -- 172.21.15.135:0/3136155584 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48004aa0 con 0x5592b4063fe0 2024-04-20T12:26:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd36ffd640 1 -- 172.21.15.135:0/3136155584 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fcd48004c40 con 0x5592b4063fe0 2024-04-20T12:26:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd607a5740 1 -- 172.21.15.135:0/3136155584 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd48005020 con 0x5592b4063fe0 2024-04-20T12:26:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd36ffd640 1 -- 172.21.15.135:0/3136155584 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd48004e40 con 0x5592b4063fe0 2024-04-20T12:26:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd607a5740 10 client.16833 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd607a5740 1 -- 172.21.15.135:0/3136155584 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5592b3c9b170 con 0x5592b4063fe0 2024-04-20T12:26:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.727+0000 7fcd36ffd640 1 -- 172.21.15.135:0/3136155584 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd48005020 con 0x5592b4063fe0 2024-04-20T12:26:30.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.728+0000 7fcd36ffd640 1 -- 172.21.15.135:0/3136155584 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fcd4802a020 con 0x5592b4063fe0 2024-04-20T12:26:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.728+0000 7fcd607a5740 10 client.16833 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.728+0000 7fcd607a5740 10 client.16833 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:26:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.728+0000 7fcd607a5740 20 client.16833 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.728+0000 7fcd607a5740 1 --2- 172.21.15.135:0/3136155584 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592b407d400 0x5592b407f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.728+0000 7fcd607a5740 4 client.16833 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:26:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.728+0000 7fcd607a5740 1 -- 172.21.15.135:0/3136155584 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592b3fd6920 con 0x5592b407d400 2024-04-20T12:26:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.728+0000 7fcd577fe640 1 --2- 172.21.15.135:0/3136155584 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592b407d400 0x5592b407f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.729+0000 7fcd36ffd640 10 client.16833 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.729+0000 7fcd577fe640 1 --2- 172.21.15.135:0/3136155584 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592b407d400 0x5592b407f7f0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b553df02556671f server_cookie=ef252758a3e37085 in_seq=0 out_seq=0 2024-04-20T12:26:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.729+0000 7fcd36ffd640 1 -- 172.21.15.135:0/3136155584 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5592b3fd6920 con 0x5592b407d400 2024-04-20T12:26:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.729+0000 7fcd36ffd640 10 client.16833 handle_command_reply: tid=0 2024-04-20T12:26:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.729+0000 7fcd607a5740 1 client.16833 shutdown 2024-04-20T12:26:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.730+0000 7fcd607a5740 1 -- 172.21.15.135:0/3136155584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b4063fe0 msgr2=0x5592b406ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.730+0000 7fcd607a5740 1 --2- 172.21.15.135:0/3136155584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b4063fe0 0x5592b406ce90 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcd48012f50 tx=0x7fcd48005f30 comp rx=0 tx=0).stop 2024-04-20T12:26:30.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.730+0000 7fcd607a5740 1 -- 172.21.15.135:0/3136155584 shutdown_connections 2024-04-20T12:26:30.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.730+0000 7fcd607a5740 1 --2- 172.21.15.135:0/3136155584 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592b407d400 0x5592b407f7f0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.730+0000 7fcd607a5740 1 --2- 172.21.15.135:0/3136155584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b406d4e0 0x5592b406a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.730+0000 7fcd607a5740 1 --2- 172.21.15.135:0/3136155584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b4064900 0x5592b406a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.730+0000 7fcd36ffd640 0 client.16833 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:30.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.730+0000 7fcd607a5740 1 --2- 172.21.15.135:0/3136155584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b4063fe0 0x5592b406ce90 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.730+0000 7fcd607a5740 1 -- 172.21.15.135:0/3136155584 >> 172.21.15.135:0/3136155584 conn(0x5592b405e710 msgr2=0x5592b4060460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:30.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.730+0000 7fcd607a5740 1 -- 172.21.15.135:0/3136155584 shutdown_connections 2024-04-20T12:26:30.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.730+0000 7fcd607a5740 1 -- 172.21.15.135:0/3136155584 wait complete. 2024-04-20T12:26:30.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.730+0000 7fcd607a5740 20 client.16833 trim_cache size 0 max 16384 2024-04-20T12:26:30.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.747+0000 7fcd607a5740 1 Processor -- start 2024-04-20T12:26:30.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.747+0000 7fcd607a5740 1 -- start start 2024-04-20T12:26:30.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd607a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b4063fe0 0x5592b405eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd607a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b4064900 0x5592b405fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd607a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b406d4e0 0x5592b406c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd607a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd581af3e0 con 0x5592b406d4e0 2024-04-20T12:26:30.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd607a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcd581b0f20 con 0x5592b4064900 2024-04-20T12:26:30.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd607a5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd581afab0 con 0x5592b4063fe0 2024-04-20T12:26:30.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd56ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b406d4e0 0x5592b406c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd56ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b406d4e0 0x5592b406c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49754/0 (socket says 172.21.15.135:49754) 2024-04-20T12:26:30.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd56ffd640 1 -- 172.21.15.135:0/4275343484 learned_addr learned my addr 172.21.15.135:0/4275343484 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd577fe640 1 --2- 172.21.15.135:0/4275343484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b4064900 0x5592b405fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd56ffd640 1 -- 172.21.15.135:0/4275343484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b4063fe0 msgr2=0x5592b405eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/4275343484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b4063fe0 0x5592b405eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd56ffd640 1 -- 172.21.15.135:0/4275343484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b4064900 msgr2=0x5592b405fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/4275343484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b4064900 0x5592b405fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd56ffd640 1 -- 172.21.15.135:0/4275343484 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b406ab30 con 0x5592b406d4e0 2024-04-20T12:26:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/4275343484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b406d4e0 0x5592b406c950 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcd4802c8c0 tx=0x7fcd4800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82274889b97ba54b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd3d7fa640 1 -- 172.21.15.135:0/4275343484 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4802c990 con 0x5592b406d4e0 2024-04-20T12:26:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd3d7fa640 1 -- 172.21.15.135:0/4275343484 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd48016040 con 0x5592b406d4e0 2024-04-20T12:26:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.748+0000 7fcd3d7fa640 1 -- 172.21.15.135:0/4275343484 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48010740 con 0x5592b406d4e0 2024-04-20T12:26:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.749+0000 7fcd607a5740 1 -- 172.21.15.135:0/4275343484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b406d4e0 msgr2=0x5592b406c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.749+0000 7fcd607a5740 1 --2- 172.21.15.135:0/4275343484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b406d4e0 0x5592b406c950 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcd4802c8c0 tx=0x7fcd4800b7c0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.749+0000 7fcd607a5740 1 -- 172.21.15.135:0/4275343484 shutdown_connections 2024-04-20T12:26:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.749+0000 7fcd607a5740 1 --2- 172.21.15.135:0/4275343484 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b406d4e0 0x5592b406c950 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.749+0000 7fcd607a5740 1 --2- 172.21.15.135:0/4275343484 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b4064900 0x5592b405fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.749+0000 7fcd607a5740 1 --2- 172.21.15.135:0/4275343484 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b4063fe0 0x5592b405eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.749+0000 7fcd607a5740 1 -- 172.21.15.135:0/4275343484 >> 172.21.15.135:0/4275343484 conn(0x5592b405e710 msgr2=0x5592b4068770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.749+0000 7fcd607a5740 1 -- 172.21.15.135:0/4275343484 shutdown_connections 2024-04-20T12:26:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.749+0000 7fcd607a5740 1 -- 172.21.15.135:0/4275343484 wait complete. 2024-04-20T12:26:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.749+0000 7fcd607a5740 1 -- start start 2024-04-20T12:26:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.749+0000 7fcd607a5740 1 Processor -- start 2024-04-20T12:26:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd607a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b4063fe0 0x5592b4067260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd607a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b4064900 0x5592b40677a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd607a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b406d4e0 0x5592b40e27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd607a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd581b0850 con 0x5592b4064900 2024-04-20T12:26:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd607a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcd581b0180 con 0x5592b4063fe0 2024-04-20T12:26:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd607a5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd581ad3b0 con 0x5592b406d4e0 2024-04-20T12:26:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd607a5740 10 client.0 _ll_register_callbacks cb 0x7fcd480046a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd577fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b4064900 0x5592b40677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd577fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b4064900 0x5592b40677a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49768/0 (socket says 172.21.15.135:49768) 2024-04-20T12:26:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd577fe640 1 -- 172.21.15.135:0/492692965 learned_addr learned my addr 172.21.15.135:0/492692965 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/492692965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b4063fe0 0x5592b4067260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/492692965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b406d4e0 0x5592b40e27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd577fe640 1 -- 172.21.15.135:0/492692965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b406d4e0 msgr2=0x5592b40e27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd577fe640 1 --2- 172.21.15.135:0/492692965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b406d4e0 0x5592b40e27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd577fe640 1 -- 172.21.15.135:0/492692965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b4063fe0 msgr2=0x5592b4067260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd577fe640 1 --2- 172.21.15.135:0/492692965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b4063fe0 0x5592b4067260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd577fe640 1 -- 172.21.15.135:0/492692965 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592b4068070 con 0x5592b4064900 2024-04-20T12:26:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/492692965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b406d4e0 0x5592b40e27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:26:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd577fe640 1 --2- 172.21.15.135:0/492692965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b4064900 0x5592b40677a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c005ec0 tx=0x7fcd4c02cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb802bb9c96f9f49 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd36ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd36ffd640 1 -- 172.21.15.135:0/492692965 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c04b030 con 0x5592b4064900 2024-04-20T12:26:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd36ffd640 1 -- 172.21.15.135:0/492692965 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fcd4c044030 con 0x5592b4064900 2024-04-20T12:26:30.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd607a5740 1 -- 172.21.15.135:0/492692965 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd48016040 con 0x5592b4064900 2024-04-20T12:26:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.750+0000 7fcd36ffd640 1 -- 172.21.15.135:0/492692965 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd4c055050 con 0x5592b4064900 2024-04-20T12:26:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.751+0000 7fcd607a5740 10 client.16839 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.751+0000 7fcd607a5740 1 -- 172.21.15.135:0/492692965 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5592b40e3eb0 con 0x5592b4064900 2024-04-20T12:26:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.751+0000 7fcd36ffd640 1 -- 172.21.15.135:0/492692965 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd48016040 con 0x5592b4064900 2024-04-20T12:26:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.751+0000 7fcd36ffd640 1 -- 172.21.15.135:0/492692965 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fcd4c047520 con 0x5592b4064900 2024-04-20T12:26:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.751+0000 7fcd607a5740 10 client.16839 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.751+0000 7fcd607a5740 10 client.16839 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:26:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.751+0000 7fcd607a5740 20 client.16839 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.751+0000 7fcd607a5740 1 --2- 172.21.15.135:0/492692965 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592b40e4680 0x5592b40e6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.751+0000 7fcd607a5740 4 client.16839 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:26:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.751+0000 7fcd607a5740 1 -- 172.21.15.135:0/492692965 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5592b3fd0790 con 0x5592b40e4680 2024-04-20T12:26:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.751+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/492692965 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592b40e4680 0x5592b40e6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.751+0000 7fcd56ffd640 1 --2- 172.21.15.135:0/492692965 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592b40e4680 0x5592b40e6aa0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1033a1131a82e43 server_cookie=68cfb9c0983a31 in_seq=0 out_seq=0 2024-04-20T12:26:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.751+0000 7fcd36ffd640 10 client.16839 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:30.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.753+0000 7fcd36ffd640 1 -- 172.21.15.135:0/492692965 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5592b3fd0790 con 0x5592b40e4680 2024-04-20T12:26:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.753+0000 7fcd36ffd640 10 client.16839 handle_command_reply: tid=0 2024-04-20T12:26:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.753+0000 7fcd607a5740 1 client.16839 shutdown 2024-04-20T12:26:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.753+0000 7fcd607a5740 1 -- 172.21.15.135:0/492692965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b4064900 msgr2=0x5592b40677a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.753+0000 7fcd607a5740 1 --2- 172.21.15.135:0/492692965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b4064900 0x5592b40677a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c005ec0 tx=0x7fcd4c02cb90 comp rx=0 tx=0).stop 2024-04-20T12:26:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.753+0000 7fcd607a5740 1 -- 172.21.15.135:0/492692965 shutdown_connections 2024-04-20T12:26:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.753+0000 7fcd607a5740 1 --2- 172.21.15.135:0/492692965 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5592b40e4680 0x5592b40e6aa0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.753+0000 7fcd607a5740 1 --2- 172.21.15.135:0/492692965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5592b406d4e0 0x5592b40e27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.753+0000 7fcd607a5740 1 --2- 172.21.15.135:0/492692965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592b4064900 0x5592b40677a0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.753+0000 7fcd607a5740 1 --2- 172.21.15.135:0/492692965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5592b4063fe0 0x5592b4067260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.753+0000 7fcd607a5740 1 -- 172.21.15.135:0/492692965 >> 172.21.15.135:0/492692965 conn(0x5592b405e710 msgr2=0x5592b4069000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.753+0000 7fcd36ffd640 0 client.16839 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.753+0000 7fcd607a5740 1 -- 172.21.15.135:0/492692965 shutdown_connections 2024-04-20T12:26:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.753+0000 7fcd607a5740 1 -- 172.21.15.135:0/492692965 wait complete. 2024-04-20T12:26:30.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.753+0000 7fcd607a5740 20 client.16839 trim_cache size 0 max 16384 2024-04-20T12:26:30.760 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:26:30.760 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:26:30.760 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "b2d14a14-00c4-44f1-a06d-00730c206a1e", 2024-04-20T12:26:30.760 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:26:30.760 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:26:30.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.754+0000 7fcd5dad2640 1 -- 172.21.15.135:0/424517361 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd400a3d20 msgr2=0x7fcd400a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.754+0000 7fcd5dad2640 1 --2- 172.21.15.135:0/424517361 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd400a3d20 0x7fcd400a61e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcd5009c6f0 tx=0x7fcd5008e040 comp rx=0 tx=0).stop 2024-04-20T12:26:30.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.754+0000 7fcd5dad2640 1 -- 172.21.15.135:0/424517361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd58107040 msgr2=0x7fcd581986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.754+0000 7fcd5dad2640 1 --2- 172.21.15.135:0/424517361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd58107040 0x7fcd581986a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000eaa0 tx=0x7fcd5000ef60 comp rx=0 tx=0).stop 2024-04-20T12:26:30.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.754+0000 7fcd5dad2640 1 -- 172.21.15.135:0/424517361 shutdown_connections 2024-04-20T12:26:30.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.754+0000 7fcd5dad2640 1 --2- 172.21.15.135:0/424517361 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd58107040 0x7fcd581986a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.754+0000 7fcd5dad2640 1 --2- 172.21.15.135:0/424517361 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd400a3d20 0x7fcd400a61e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.754+0000 7fcd5dad2640 1 --2- 172.21.15.135:0/424517361 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd58101b50 0x7fcd5819ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.754+0000 7fcd5dad2640 1 --2- 172.21.15.135:0/424517361 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd581011b0 0x7fcd5819e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.754+0000 7fcd5dad2640 1 -- 172.21.15.135:0/424517361 >> 172.21.15.135:0/424517361 conn(0x7fcd58076c60 msgr2=0x7fcd58100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:30.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.754+0000 7fcd5dad2640 1 -- 172.21.15.135:0/424517361 shutdown_connections 2024-04-20T12:26:30.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.754+0000 7fcd5dad2640 1 -- 172.21.15.135:0/424517361 wait complete. 2024-04-20T12:26:30.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:26:30.765 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:26:30.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.906+0000 7f0f08026640 1 -- 172.21.15.135:0/2429935459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00101a50 msgr2=0x7f0f00105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.906+0000 7f0f08026640 1 --2- 172.21.15.135:0/2429935459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00101a50 0x7f0f00105a90 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009900 tx=0x7f0ef002bc30 comp rx=0 tx=0).stop 2024-04-20T12:26:30.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.906+0000 7f0f08026640 1 -- 172.21.15.135:0/2429935459 shutdown_connections 2024-04-20T12:26:30.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.906+0000 7f0f08026640 1 --2- 172.21.15.135:0/2429935459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f00106170 0x7f0f0010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.906+0000 7f0f08026640 1 --2- 172.21.15.135:0/2429935459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00101a50 0x7f0f00105a90 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.906+0000 7f0f08026640 1 --2- 172.21.15.135:0/2429935459 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f001010a0 0x7f0f00101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.906+0000 7f0f08026640 1 -- 172.21.15.135:0/2429935459 >> 172.21.15.135:0/2429935459 conn(0x7f0f000771e0 msgr2=0x7f0f000775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:30.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.906+0000 7f0f08026640 1 -- 172.21.15.135:0/2429935459 shutdown_connections 2024-04-20T12:26:30.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.906+0000 7f0f08026640 1 -- 172.21.15.135:0/2429935459 wait complete. 2024-04-20T12:26:30.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f08026640 1 Processor -- start 2024-04-20T12:26:30.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f08026640 1 -- start start 2024-04-20T12:26:30.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f08026640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f001010a0 0x7f0f00102b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f08026640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00106170 0x7f0f00103070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f08026640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f001035b0 0x7f0f001a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f08026640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00111200 con 0x7f0f00106170 2024-04-20T12:26:30.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f08026640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00111080 con 0x7f0f001035b0 2024-04-20T12:26:30.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f08026640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00111380 con 0x7f0f001010a0 2024-04-20T12:26:30.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f055c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00106170 0x7f0f00103070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f055c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00106170 0x7f0f00103070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49786/0 (socket says 172.21.15.135:49786) 2024-04-20T12:26:30.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f055c1640 1 -- 172.21.15.135:0/1787471848 learned_addr learned my addr 172.21.15.135:0/1787471848 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:30.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f065c3640 1 --2- 172.21.15.135:0/1787471848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f001035b0 0x7f0f001a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f05dc2640 1 --2- 172.21.15.135:0/1787471848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f001010a0 0x7f0f00102b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f055c1640 1 -- 172.21.15.135:0/1787471848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f001010a0 msgr2=0x7f0f00102b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f055c1640 1 --2- 172.21.15.135:0/1787471848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f001010a0 0x7f0f00102b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f055c1640 1 -- 172.21.15.135:0/1787471848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f001035b0 msgr2=0x7f0f001a6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f055c1640 1 --2- 172.21.15.135:0/1787471848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f001035b0 0x7f0f001a6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f055c1640 1 -- 172.21.15.135:0/1787471848 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f001a7180 con 0x7f0f00106170 2024-04-20T12:26:30.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.907+0000 7f0f05dc2640 1 --2- 172.21.15.135:0/1787471848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f001010a0 0x7f0f00102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:26:30.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.908+0000 7f0f055c1640 1 --2- 172.21.15.135:0/1787471848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00106170 0x7f0f00103070 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0036040 tx=0x7f0ef002cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:30.910 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.908+0000 7f0ef6ffd640 1 -- 172.21.15.135:0/1787471848 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0041070 con 0x7f0f00106170 2024-04-20T12:26:30.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.908+0000 7f0f08026640 1 -- 172.21.15.135:0/1787471848 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f001a7410 con 0x7f0f00106170 2024-04-20T12:26:30.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.908+0000 7f0ef6ffd640 1 -- 172.21.15.135:0/1787471848 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ef00054e0 con 0x7f0f00106170 2024-04-20T12:26:30.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.908+0000 7f0ef6ffd640 1 -- 172.21.15.135:0/1787471848 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0034440 con 0x7f0f00106170 2024-04-20T12:26:30.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.908+0000 7f0f08026640 1 -- 172.21.15.135:0/1787471848 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f001a7900 con 0x7f0f00106170 2024-04-20T12:26:30.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.910+0000 7f0ef6ffd640 1 -- 172.21.15.135:0/1787471848 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f0ef0044070 con 0x7f0f00106170 2024-04-20T12:26:30.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.910+0000 7f0f0ac0e740 1 Processor -- start 2024-04-20T12:26:30.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.910+0000 7f0f0ac0e740 1 -- start start 2024-04-20T12:26:30.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.910+0000 7f0f0ac0e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06d5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.910+0000 7f0f0ac0e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06d5640 0x560fc06ddce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.910+0000 7f0f0ac0e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06de220 0x560fc06e0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.910+0000 7f0ef6ffd640 1 --2- 172.21.15.135:0/1787471848 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0eec0a3d50 0x7f0eec0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.910+0000 7f0f0ac0e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560fc063a1b0 con 0x560fc06d4d20 2024-04-20T12:26:30.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.910+0000 7f0f0ac0e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560fc05d7390 con 0x560fc06d5640 2024-04-20T12:26:30.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.910+0000 7f0f0ac0e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560fc0636170 con 0x560fc06de220 2024-04-20T12:26:30.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f065c3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06d5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f05dc2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06d5640 0x560fc06ddce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f05dc2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06d5640 0x560fc06ddce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:41166/0 (socket says 172.21.15.135:41166) 2024-04-20T12:26:30.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f065c3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06d5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49788/0 (socket says 172.21.15.135:49788) 2024-04-20T12:26:30.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f05dc2640 1 -- 172.21.15.135:0/2090648908 learned_addr learned my addr 172.21.15.135:0/2090648908 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:30.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0ef6ffd640 1 -- 172.21.15.135:0/1787471848 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f0ef00f2590 con 0x7f0f00106170 2024-04-20T12:26:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f065c3640 1 --2- 172.21.15.135:0/1787471848 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0eec0a3d50 0x7f0eec0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f055c1640 1 --2- 172.21.15.135:0/2090648908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06de220 0x560fc06e0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f065c3640 1 -- 172.21.15.135:0/2090648908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06de220 msgr2=0x560fc06e0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f065c3640 1 --2- 172.21.15.135:0/2090648908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06de220 0x560fc06e0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f065c3640 1 -- 172.21.15.135:0/2090648908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06d5640 msgr2=0x560fc06ddce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f065c3640 1 --2- 172.21.15.135:0/2090648908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06d5640 0x560fc06ddce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f065c3640 1 -- 172.21.15.135:0/2090648908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fc04167d0 con 0x560fc06d4d20 2024-04-20T12:26:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f055c1640 1 --2- 172.21.15.135:0/2090648908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06de220 0x560fc06e0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:26:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f05dc2640 1 --2- 172.21.15.135:0/2090648908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06d5640 0x560fc06ddce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:26:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f065c3640 1 --2- 172.21.15.135:0/2090648908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06d5100 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8005fd0 tx=0x7f0ef8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4c6ff02962dbf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0f065c3640 1 --2- 172.21.15.135:0/1787471848 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0eec0a3d50 0x7f0eec0a6210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8010c40 tx=0x7f0ef800c000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0eebfff640 1 -- 172.21.15.135:0/2090648908 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8024070 con 0x560fc06d4d20 2024-04-20T12:26:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0eebfff640 1 -- 172.21.15.135:0/2090648908 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ef8012df0 con 0x560fc06d4d20 2024-04-20T12:26:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.911+0000 7f0eebfff640 1 -- 172.21.15.135:0/2090648908 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8005280 con 0x560fc06d4d20 2024-04-20T12:26:30.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.912+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/2090648908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 msgr2=0x560fc06d5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.912+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/2090648908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06d5100 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8005fd0 tx=0x7f0ef8010740 comp rx=0 tx=0).stop 2024-04-20T12:26:30.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.912+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/2090648908 shutdown_connections 2024-04-20T12:26:30.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.912+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/2090648908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06de220 0x560fc06e0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.912+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/2090648908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06d5640 0x560fc06ddce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.912+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/2090648908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06d5100 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.912+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/2090648908 >> 172.21.15.135:0/2090648908 conn(0x560fc06cf450 msgr2=0x560fc06cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:30.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.912+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/2090648908 shutdown_connections 2024-04-20T12:26:30.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.912+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/2090648908 wait complete. 2024-04-20T12:26:30.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.912+0000 7f0f0ac0e740 1 -- start start 2024-04-20T12:26:30.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f0ac0e740 1 Processor -- start 2024-04-20T12:26:30.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f0ac0e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06db2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f0ac0e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06d5640 0x560fc06db830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f0ac0e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06de220 0x560fc06dbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f0ac0e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560fc06e0fb0 con 0x560fc06d4d20 2024-04-20T12:26:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f0ac0e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560fc05f32f0 con 0x560fc06d5640 2024-04-20T12:26:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f0ac0e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560fc06e1130 con 0x560fc06de220 2024-04-20T12:26:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f0ac0e740 10 client.0 _ll_register_callbacks cb 0x560fc05bd4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f05dc2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06db2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f05dc2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06db2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49804/0 (socket says 172.21.15.135:49804) 2024-04-20T12:26:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f05dc2640 1 -- 172.21.15.135:0/3133647691 learned_addr learned my addr 172.21.15.135:0/3133647691 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f05dc2640 1 -- 172.21.15.135:0/3133647691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06de220 msgr2=0x560fc06dbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f05dc2640 1 --2- 172.21.15.135:0/3133647691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06de220 0x560fc06dbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f05dc2640 1 -- 172.21.15.135:0/3133647691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06d5640 msgr2=0x560fc06db830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f055c1640 1 --2- 172.21.15.135:0/3133647691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06d5640 0x560fc06db830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f05dc2640 1 --2- 172.21.15.135:0/3133647691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06d5640 0x560fc06db830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.913+0000 7f0f05dc2640 1 -- 172.21.15.135:0/3133647691 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fc034c3f0 con 0x560fc06d4d20 2024-04-20T12:26:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0f05dc2640 1 --2- 172.21.15.135:0/3133647691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06db2f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0efc013780 tx=0x7f0efc013c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6168a56234e2a07d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:30.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0ee97fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0ee97fa640 1 -- 172.21.15.135:0/3133647691 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0efc011dd0 con 0x560fc06d4d20 2024-04-20T12:26:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0ee97fa640 1 -- 172.21.15.135:0/3133647691 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f0efc01b3f0 con 0x560fc06d4d20 2024-04-20T12:26:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/3133647691 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ef8012df0 con 0x560fc06d4d20 2024-04-20T12:26:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0ee97fa640 1 -- 172.21.15.135:0/3133647691 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0efc026050 con 0x560fc06d4d20 2024-04-20T12:26:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0f0ac0e740 10 client.16851 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/3133647691 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560fc030c0f0 con 0x560fc06d4d20 2024-04-20T12:26:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0ee97fa640 1 -- 172.21.15.135:0/3133647691 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ef8012df0 con 0x560fc06d4d20 2024-04-20T12:26:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0ee97fa640 1 -- 172.21.15.135:0/3133647691 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f0efc01a030 con 0x560fc06d4d20 2024-04-20T12:26:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0f0ac0e740 10 client.16851 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0f0ac0e740 10 client.16851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:26:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0f0ac0e740 20 client.16851 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/3133647691 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x560fc06ee680 0x560fc06f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0f0ac0e740 4 client.16851 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:26:30.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/3133647691 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fc0647bd0 con 0x560fc06ee680 2024-04-20T12:26:30.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.914+0000 7f0f055c1640 1 --2- 172.21.15.135:0/3133647691 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x560fc06ee680 0x560fc06f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.915+0000 7f0ee97fa640 10 client.16851 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:30.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.915+0000 7f0f055c1640 1 --2- 172.21.15.135:0/3133647691 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x560fc06ee680 0x560fc06f0af0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e46d8e2417862bf server_cookie=c2ae3ed5f088c265 in_seq=0 out_seq=0 2024-04-20T12:26:30.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.915+0000 7f0ee97fa640 1 -- 172.21.15.135:0/3133647691 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560fc0647bd0 con 0x560fc06ee680 2024-04-20T12:26:30.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.915+0000 7f0ee97fa640 10 client.16851 handle_command_reply: tid=0 2024-04-20T12:26:30.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.915+0000 7f0f0ac0e740 1 client.16851 shutdown 2024-04-20T12:26:30.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.916+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/3133647691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 msgr2=0x560fc06db2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.916+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/3133647691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06db2f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0efc013780 tx=0x7f0efc013c40 comp rx=0 tx=0).stop 2024-04-20T12:26:30.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.916+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/3133647691 shutdown_connections 2024-04-20T12:26:30.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.916+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/3133647691 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x560fc06ee680 0x560fc06f0af0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.916+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/3133647691 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06de220 0x560fc06dbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.916+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/3133647691 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06d5640 0x560fc06db830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.916+0000 7f0ee97fa640 0 client.16851 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:30.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.916+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/3133647691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06db2f0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.916+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/3133647691 >> 172.21.15.135:0/3133647691 conn(0x560fc06cf450 msgr2=0x560fc06d11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:30.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.916+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/3133647691 shutdown_connections 2024-04-20T12:26:30.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.916+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/3133647691 wait complete. 2024-04-20T12:26:30.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.916+0000 7f0f0ac0e740 20 client.16851 trim_cache size 0 max 16384 2024-04-20T12:26:30.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f0ac0e740 1 Processor -- start 2024-04-20T12:26:30.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f0ac0e740 1 -- start start 2024-04-20T12:26:30.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f0ac0e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06e9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f0ac0e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06d5640 0x560fc06da250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f0ac0e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06de220 0x560fc06dbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f0ac0e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f001b15f0 con 0x560fc06d4d20 2024-04-20T12:26:30.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f0ac0e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0f001b3130 con 0x560fc06de220 2024-04-20T12:26:30.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f0ac0e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f001b1cc0 con 0x560fc06d5640 2024-04-20T12:26:30.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f05dc2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06e9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f05dc2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06e9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49820/0 (socket says 172.21.15.135:49820) 2024-04-20T12:26:30.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f05dc2640 1 -- 172.21.15.135:0/293159569 learned_addr learned my addr 172.21.15.135:0/293159569 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:30.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f065c3640 1 --2- 172.21.15.135:0/293159569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06de220 0x560fc06dbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f05dc2640 1 -- 172.21.15.135:0/293159569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06d5640 msgr2=0x560fc06da250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f055c1640 1 --2- 172.21.15.135:0/293159569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06d5640 0x560fc06da250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f05dc2640 1 --2- 172.21.15.135:0/293159569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06d5640 0x560fc06da250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f05dc2640 1 -- 172.21.15.135:0/293159569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06de220 msgr2=0x560fc06dbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f05dc2640 1 --2- 172.21.15.135:0/293159569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06de220 0x560fc06dbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f05dc2640 1 -- 172.21.15.135:0/293159569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fc06d1740 con 0x560fc06d4d20 2024-04-20T12:26:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.933+0000 7f0f055c1640 1 --2- 172.21.15.135:0/293159569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06d5640 0x560fc06da250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:26:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.934+0000 7f0f05dc2640 1 --2- 172.21.15.135:0/293159569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06e9e70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0efc010fa0 tx=0x7f0efc009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4babbe2741f4407d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.934+0000 7f0eeb7fe640 1 -- 172.21.15.135:0/293159569 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0efc02e030 con 0x560fc06d4d20 2024-04-20T12:26:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.934+0000 7f0eeb7fe640 1 -- 172.21.15.135:0/293159569 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0efc009530 con 0x560fc06d4d20 2024-04-20T12:26:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.934+0000 7f0eeb7fe640 1 -- 172.21.15.135:0/293159569 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0efc011ea0 con 0x560fc06d4d20 2024-04-20T12:26:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.934+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/293159569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 msgr2=0x560fc06e9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.934+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/293159569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06e9e70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0efc010fa0 tx=0x7f0efc009f30 comp rx=0 tx=0).stop 2024-04-20T12:26:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.934+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/293159569 shutdown_connections 2024-04-20T12:26:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.934+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/293159569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06de220 0x560fc06dbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.934+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/293159569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06d5640 0x560fc06da250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.934+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/293159569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d4d20 0x560fc06e9e70 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.934+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/293159569 >> 172.21.15.135:0/293159569 conn(0x560fc06cf450 msgr2=0x560fc06ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:30.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.934+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/293159569 shutdown_connections 2024-04-20T12:26:30.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.934+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/293159569 wait complete. 2024-04-20T12:26:30.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f0ac0e740 1 -- start start 2024-04-20T12:26:30.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f0ac0e740 1 Processor -- start 2024-04-20T12:26:30.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f0ac0e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06d4d20 0x560fc06e3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f0ac0e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d5640 0x560fc06e4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f0ac0e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06de220 0x560fc06e4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f0ac0e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f001b2a60 con 0x560fc06d5640 2024-04-20T12:26:30.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f0ac0e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0f001b2390 con 0x560fc06de220 2024-04-20T12:26:30.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f0ac0e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0f001af5c0 con 0x560fc06d4d20 2024-04-20T12:26:30.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f0ac0e740 10 client.0 _ll_register_callbacks cb 0x7f0efc009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:26:30.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f055c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d5640 0x560fc06e4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f055c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d5640 0x560fc06e4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49830/0 (socket says 172.21.15.135:49830) 2024-04-20T12:26:30.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f055c1640 1 -- 172.21.15.135:0/2217811287 learned_addr learned my addr 172.21.15.135:0/2217811287 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:26:30.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f05dc2640 1 --2- 172.21.15.135:0/2217811287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06d4d20 0x560fc06e3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f065c3640 1 --2- 172.21.15.135:0/2217811287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06de220 0x560fc06e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f055c1640 1 -- 172.21.15.135:0/2217811287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06d4d20 msgr2=0x560fc06e3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f055c1640 1 --2- 172.21.15.135:0/2217811287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06d4d20 0x560fc06e3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f055c1640 1 -- 172.21.15.135:0/2217811287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06de220 msgr2=0x560fc06e4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:26:30.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f055c1640 1 --2- 172.21.15.135:0/2217811287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06de220 0x560fc06e4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f055c1640 1 -- 172.21.15.135:0/2217811287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fc0753d40 con 0x560fc06d5640 2024-04-20T12:26:30.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f05dc2640 1 --2- 172.21.15.135:0/2217811287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06d4d20 0x560fc06e3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:26:30.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.935+0000 7f0f065c3640 1 --2- 172.21.15.135:0/2217811287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06de220 0x560fc06e4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:26:30.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0f055c1640 1 --2- 172.21.15.135:0/2217811287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d5640 0x560fc06e4400 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00efad0 tx=0x7f0ef00bdec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b910b77d0cbccc27 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:26:30.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0ee97fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:26:30.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0ee97fa640 1 -- 172.21.15.135:0/2217811287 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef004b040 con 0x560fc06d5640 2024-04-20T12:26:30.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0ee97fa640 1 -- 172.21.15.135:0/2217811287 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f0ef00ba930 con 0x560fc06d5640 2024-04-20T12:26:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/2217811287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560fc0641a40 con 0x560fc06d5640 2024-04-20T12:26:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0ee97fa640 1 -- 172.21.15.135:0/2217811287 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0ef0005690 con 0x560fc06d5640 2024-04-20T12:26:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0f0ac0e740 10 client.16857 fetch_fsmap learned FSMap version 29 2024-04-20T12:26:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/2217811287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560fc0754fc0 con 0x560fc06d5640 2024-04-20T12:26:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0ee97fa640 1 -- 172.21.15.135:0/2217811287 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x560fc0641a40 con 0x560fc06d5640 2024-04-20T12:26:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0ee97fa640 1 -- 172.21.15.135:0/2217811287 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f0ef00035f0 con 0x560fc06d5640 2024-04-20T12:26:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0f0ac0e740 10 client.16857 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:26:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0f0ac0e740 10 client.16857 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:26:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0f0ac0e740 20 client.16857 populate_metadata read hostname 'smithi135' 2024-04-20T12:26:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/2217811287 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x560fc0755640 0x560fc0757a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:26:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0f0ac0e740 4 client.16857 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:26:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/2217811287 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560fc05bd590 con 0x560fc0755640 2024-04-20T12:26:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.936+0000 7f0f05dc2640 1 --2- 172.21.15.135:0/2217811287 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x560fc0755640 0x560fc0757a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:26:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0f05dc2640 1 --2- 172.21.15.135:0/2217811287 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x560fc0755640 0x560fc0757a60 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=644f81102e082dc3 server_cookie=939a05d27b83cff in_seq=0 out_seq=0 2024-04-20T12:26:30.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0ee97fa640 10 client.16857 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0ee97fa640 1 -- 172.21.15.135:0/2217811287 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x560fc05bd590 con 0x560fc0755640 2024-04-20T12:26:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0ee97fa640 10 client.16857 handle_command_reply: tid=0 2024-04-20T12:26:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0f0ac0e740 1 client.16857 shutdown 2024-04-20T12:26:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/2217811287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d5640 msgr2=0x560fc06e4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/2217811287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d5640 0x560fc06e4400 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00efad0 tx=0x7f0ef00bdec0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/2217811287 shutdown_connections 2024-04-20T12:26:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/2217811287 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x560fc0755640 0x560fc0757a60 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/2217811287 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560fc06de220 0x560fc06e4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0ee97fa640 0 client.16857 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:26:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/2217811287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560fc06d5640 0x560fc06e4400 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0f0ac0e740 1 --2- 172.21.15.135:0/2217811287 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560fc06d4d20 0x560fc06e3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/2217811287 >> 172.21.15.135:0/2217811287 conn(0x560fc06cf450 msgr2=0x560fc06cdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/2217811287 shutdown_connections 2024-04-20T12:26:30.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0f0ac0e740 1 -- 172.21.15.135:0/2217811287 wait complete. 2024-04-20T12:26:30.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.937+0000 7f0f0ac0e740 20 client.16857 trim_cache size 0 max 16384 2024-04-20T12:26:30.945 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:26:30.945 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:26:30.945 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:26:30.945 INFO:teuthology.orchestra.run.smithi135.stdout: "b2d14a14-00c4-44f1-a06d-00730c206a1e": { 2024-04-20T12:26:30.945 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:26:30.945 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "b2d14a14-00c4-44f1-a06d-00730c206a1e", 2024-04-20T12:26:30.945 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:26:30.945 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:26:30.945 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:26:30.946 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:26:30.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.938+0000 7f0f08026640 1 -- 172.21.15.135:0/1787471848 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0eec0a3d50 msgr2=0x7f0eec0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.938+0000 7f0f08026640 1 --2- 172.21.15.135:0/1787471848 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0eec0a3d50 0x7f0eec0a6210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8010c40 tx=0x7f0ef800c000 comp rx=0 tx=0).stop 2024-04-20T12:26:30.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.938+0000 7f0f08026640 1 -- 172.21.15.135:0/1787471848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00106170 msgr2=0x7f0f00103070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:26:30.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.938+0000 7f0f08026640 1 --2- 172.21.15.135:0/1787471848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00106170 0x7f0f00103070 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0036040 tx=0x7f0ef002cbf0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.938+0000 7f0f08026640 1 -- 172.21.15.135:0/1787471848 shutdown_connections 2024-04-20T12:26:30.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.938+0000 7f0f08026640 1 --2- 172.21.15.135:0/1787471848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0f001035b0 0x7f0f001a6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.938+0000 7f0f08026640 1 --2- 172.21.15.135:0/1787471848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f00106170 0x7f0f00103070 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.938+0000 7f0f08026640 1 --2- 172.21.15.135:0/1787471848 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0eec0a3d50 0x7f0eec0a6210 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.938+0000 7f0f08026640 1 --2- 172.21.15.135:0/1787471848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f001010a0 0x7f0f00102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:26:30.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.938+0000 7f0f08026640 1 -- 172.21.15.135:0/1787471848 >> 172.21.15.135:0/1787471848 conn(0x7f0f000771e0 msgr2=0x7f0f00104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:26:30.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.938+0000 7f0f08026640 1 -- 172.21.15.135:0/1787471848 shutdown_connections 2024-04-20T12:26:30.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:26:30.938+0000 7f0f08026640 1 -- 172.21.15.135:0/1787471848 wait complete. 2024-04-20T12:26:30.949 INFO:tasks.cephfs.filesystem:scrub status for tag:b2d14a14-00c4-44f1-a06d-00730c206a1e - {'path': '/', 'tag': 'b2d14a14-00c4-44f1-a06d-00730c206a1e', 'options': 'recursive,force'} 2024-04-20T12:26:32.502 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:32 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:26:32.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:32 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:26:32.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:32 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:26:32.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:32 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:26:32.503 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:32 smithi154 ceph-mon[22073]: pgmap v105: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:32.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:32 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:26:32.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:32 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:26:32.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:32 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:26:32.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:32 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:26:32.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:32 smithi139 ceph-mon[21834]: pgmap v105: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:32.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:32 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:26:32.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:32 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:26:32.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:32 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:26:32.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:32 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:26:32.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:32 smithi135 ceph-mon[18264]: pgmap v105: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:33.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:33 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:26:33.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:33 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:26:33.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:33 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:26:34.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:34 smithi154 ceph-mon[22073]: pgmap v106: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:26:34.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:34 smithi139 ceph-mon[21834]: pgmap v106: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:26:34.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:34 smithi135 ceph-mon[18264]: pgmap v106: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:26:36.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:36 smithi154 ceph-mon[22073]: pgmap v107: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:26:36.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:36 smithi139 ceph-mon[21834]: pgmap v107: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:26:36.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:36 smithi135 ceph-mon[18264]: pgmap v107: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:26:38.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:38 smithi154 ceph-mon[22073]: pgmap v108: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:26:38.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:38 smithi139 ceph-mon[21834]: pgmap v108: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:26:38.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:38 smithi135 ceph-mon[18264]: pgmap v108: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:26:40.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:40 smithi154 ceph-mon[22073]: pgmap v109: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:26:40.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:40 smithi139 ceph-mon[21834]: pgmap v109: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:26:40.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:40 smithi135 ceph-mon[18264]: pgmap v109: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:26:42.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:42 smithi154 ceph-mon[22073]: pgmap v110: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:26:42.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:42 smithi139 ceph-mon[21834]: pgmap v110: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:26:42.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:42 smithi135 ceph-mon[18264]: pgmap v110: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:26:44.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:44 smithi139 ceph-mon[21834]: pgmap v111: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:26:44.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:44 smithi135 ceph-mon[18264]: pgmap v111: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:26:44.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:44 smithi154 ceph-mon[22073]: pgmap v111: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:26:46.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:46 smithi139 ceph-mon[21834]: pgmap v112: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:46.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:46 smithi135 ceph-mon[18264]: pgmap v112: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:46.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:46 smithi154 ceph-mon[22073]: pgmap v112: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:48.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:48 smithi139 ceph-mon[21834]: pgmap v113: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:48.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:48 smithi135 ceph-mon[18264]: pgmap v113: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:48.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:48 smithi154 ceph-mon[22073]: pgmap v113: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:50.553 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:50 smithi154 ceph-mon[22073]: pgmap v114: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:26:50.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:50 smithi139 ceph-mon[21834]: pgmap v114: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:26:50.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:50 smithi135 ceph-mon[18264]: pgmap v114: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:26:52.590 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:52 smithi139 ceph-mon[21834]: pgmap v115: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:52.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:52 smithi135 ceph-mon[18264]: pgmap v115: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:52.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:52 smithi154 ceph-mon[22073]: pgmap v115: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:54.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:54 smithi139 ceph-mon[21834]: pgmap v116: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:26:54.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:54 smithi135 ceph-mon[18264]: pgmap v116: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:26:54.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:54 smithi154 ceph-mon[22073]: pgmap v116: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:26:56.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:56 smithi139 ceph-mon[21834]: pgmap v117: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:56.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:56 smithi135 ceph-mon[18264]: pgmap v117: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:56.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:56 smithi154 ceph-mon[22073]: pgmap v117: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:58.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:26:58 smithi139 ceph-mon[21834]: pgmap v118: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:58.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:26:58 smithi135 ceph-mon[18264]: pgmap v118: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:26:58.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:26:58 smithi154 ceph-mon[22073]: pgmap v118: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:00.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:00 smithi139 ceph-mon[21834]: pgmap v119: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:27:00.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:00 smithi135 ceph-mon[18264]: pgmap v119: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:27:00.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:00 smithi154 ceph-mon[22073]: pgmap v119: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:27:00.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:27:00.950 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:27:01.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.063+0000 7f5b0e1ce640 1 -- 172.21.15.135:0/3447372612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b08100e20 msgr2=0x7f5b0810edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.063+0000 7f5b0e1ce640 1 --2- 172.21.15.135:0/3447372612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b08100e20 0x7f5b0810edf0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009cd0 tx=0x7f5b0002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.063+0000 7f5b0e1ce640 1 -- 172.21.15.135:0/3447372612 shutdown_connections 2024-04-20T12:27:01.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.063+0000 7f5b0e1ce640 1 --2- 172.21.15.135:0/3447372612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b08100e20 0x7f5b0810edf0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.063+0000 7f5b0e1ce640 1 --2- 172.21.15.135:0/3447372612 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b08100460 0x7f5b081008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.063+0000 7f5b0e1ce640 1 --2- 172.21.15.135:0/3447372612 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b08106f40 0x7f5b08107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.063+0000 7f5b0e1ce640 1 -- 172.21.15.135:0/3447372612 >> 172.21.15.135:0/3447372612 conn(0x7f5b08077420 msgr2=0x7f5b080fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.063+0000 7f5b0e1ce640 1 -- 172.21.15.135:0/3447372612 shutdown_connections 2024-04-20T12:27:01.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.063+0000 7f5b0e1ce640 1 -- 172.21.15.135:0/3447372612 wait complete. 2024-04-20T12:27:01.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.064+0000 7f5b0e1ce640 1 Processor -- start 2024-04-20T12:27:01.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.064+0000 7f5b0e1ce640 1 -- start start 2024-04-20T12:27:01.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.064+0000 7f5b0e1ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b08100460 0x7f5b0819e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.064+0000 7f5b0e1ce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b08100e20 0x7f5b0819eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.064+0000 7f5b0e1ce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b08106f40 0x7f5b08198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.064+0000 7f5b0e1ce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081123d0 con 0x7f5b08100460 2024-04-20T12:27:01.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.064+0000 7f5b0e1ce640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5b08112250 con 0x7f5b08106f40 2024-04-20T12:27:01.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.064+0000 7f5b0e1ce640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b08112550 con 0x7f5b08100e20 2024-04-20T12:27:01.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.064+0000 7f5b077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b08100460 0x7f5b0819e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.064+0000 7f5b077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b08100460 0x7f5b0819e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39752/0 (socket says 172.21.15.135:39752) 2024-04-20T12:27:01.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.064+0000 7f5b077fe640 1 -- 172.21.15.135:0/1895183181 learned_addr learned my addr 172.21.15.135:0/1895183181 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.064+0000 7f5b06ffd640 1 --2- 172.21.15.135:0/1895183181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b08100e20 0x7f5b0819eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.065+0000 7f5b07fff640 1 --2- 172.21.15.135:0/1895183181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b08106f40 0x7f5b08198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.065+0000 7f5b077fe640 1 -- 172.21.15.135:0/1895183181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b08100e20 msgr2=0x7f5b0819eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.065+0000 7f5b077fe640 1 --2- 172.21.15.135:0/1895183181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b08100e20 0x7f5b0819eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.065+0000 7f5b077fe640 1 -- 172.21.15.135:0/1895183181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b08106f40 msgr2=0x7f5b08198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.065+0000 7f5b077fe640 1 --2- 172.21.15.135:0/1895183181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b08106f40 0x7f5b08198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.065+0000 7f5b077fe640 1 -- 172.21.15.135:0/1895183181 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b08198f30 con 0x7f5b08100460 2024-04-20T12:27:01.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.065+0000 7f5b077fe640 1 --2- 172.21.15.135:0/1895183181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b08100460 0x7f5b0819e5b0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f5af800d950 tx=0x7f5af800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.065+0000 7f5b04ff9640 1 -- 172.21.15.135:0/1895183181 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af8017070 con 0x7f5b08100460 2024-04-20T12:27:01.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.065+0000 7f5b04ff9640 1 -- 172.21.15.135:0/1895183181 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5af8009c30 con 0x7f5b08100460 2024-04-20T12:27:01.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.065+0000 7f5b0e1ce640 1 -- 172.21.15.135:0/1895183181 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b08199220 con 0x7f5b08100460 2024-04-20T12:27:01.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.065+0000 7f5b04ff9640 1 -- 172.21.15.135:0/1895183181 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af800f6b0 con 0x7f5b08100460 2024-04-20T12:27:01.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.065+0000 7f5b0e1ce640 1 -- 172.21.15.135:0/1895183181 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b081a5530 con 0x7f5b08100460 2024-04-20T12:27:01.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.067+0000 7f5b04ff9640 1 -- 172.21.15.135:0/1895183181 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f5af80109d0 con 0x7f5b08100460 2024-04-20T12:27:01.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b10dc1740 1 Processor -- start 2024-04-20T12:27:01.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b10dc1740 1 -- start start 2024-04-20T12:27:01.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b04ff9640 1 --2- 172.21.15.135:0/1895183181 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5af00a3d20 0x7f5af00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b10dc1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c79a50 0x564a53c79e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b10dc1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c7a370 0x564a53c870f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b10dc1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c87630 0x564a53c89a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b10dc1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564a53bdf1b0 con 0x564a53c87630 2024-04-20T12:27:01.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b10dc1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x564a53b7c390 con 0x564a53c79a50 2024-04-20T12:27:01.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b10dc1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564a53bdb170 con 0x564a53c7a370 2024-04-20T12:27:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b04ff9640 1 -- 172.21.15.135:0/1895183181 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5af80d07b0 con 0x7f5b08100460 2024-04-20T12:27:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b07fff640 1 --2- 172.21.15.135:0/1895183181 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5af00a3d20 0x7f5af00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b07fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c87630 0x564a53c89a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b07fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c87630 0x564a53c89a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39768/0 (socket says 172.21.15.135:39768) 2024-04-20T12:27:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b07fff640 1 -- 172.21.15.135:0/1196665689 learned_addr learned my addr 172.21.15.135:0/1196665689 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b077fe640 1 --2- 172.21.15.135:0/1196665689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c79a50 0x564a53c79e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.068+0000 7f5b06ffd640 1 --2- 172.21.15.135:0/1196665689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c7a370 0x564a53c870f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.069+0000 7f5b07fff640 1 -- 172.21.15.135:0/1196665689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c7a370 msgr2=0x564a53c870f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.069+0000 7f5b07fff640 1 --2- 172.21.15.135:0/1196665689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c7a370 0x564a53c870f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.069+0000 7f5b07fff640 1 -- 172.21.15.135:0/1196665689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c79a50 msgr2=0x564a53c79e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.069+0000 7f5b07fff640 1 --2- 172.21.15.135:0/1196665689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c79a50 0x564a53c79e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.069+0000 7f5b07fff640 1 -- 172.21.15.135:0/1196665689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a539bb7d0 con 0x564a53c87630 2024-04-20T12:27:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.069+0000 7f5b06ffd640 1 --2- 172.21.15.135:0/1196665689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c7a370 0x564a53c870f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:27:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.069+0000 7f5b077fe640 1 --2- 172.21.15.135:0/1196665689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c79a50 0x564a53c79e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:27:01.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.069+0000 7f5b07fff640 1 --2- 172.21.15.135:0/1895183181 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5af00a3d20 0x7f5af00a61e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009a60 tx=0x7f5b000324f0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.069+0000 7f5b07fff640 1 --2- 172.21.15.135:0/1196665689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c87630 0x564a53c89a20 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5b00037040 tx=0x7f5b00045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb35b9327b86810 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.069+0000 7f5aedffb640 1 -- 172.21.15.135:0/1196665689 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00039070 con 0x564a53c87630 2024-04-20T12:27:01.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.069+0000 7f5aedffb640 1 -- 172.21.15.135:0/1196665689 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b00050070 con 0x564a53c87630 2024-04-20T12:27:01.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.069+0000 7f5aedffb640 1 -- 172.21.15.135:0/1196665689 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00034640 con 0x564a53c87630 2024-04-20T12:27:01.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 -- 172.21.15.135:0/1196665689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c87630 msgr2=0x564a53c89a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/1196665689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c87630 0x564a53c89a20 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5b00037040 tx=0x7f5b00045000 comp rx=0 tx=0).stop 2024-04-20T12:27:01.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 -- 172.21.15.135:0/1196665689 shutdown_connections 2024-04-20T12:27:01.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/1196665689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c87630 0x564a53c89a20 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/1196665689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c7a370 0x564a53c870f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/1196665689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c79a50 0x564a53c79e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 -- 172.21.15.135:0/1196665689 >> 172.21.15.135:0/1196665689 conn(0x564a53c74450 msgr2=0x564a53c74830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 -- 172.21.15.135:0/1196665689 shutdown_connections 2024-04-20T12:27:01.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 -- 172.21.15.135:0/1196665689 wait complete. 2024-04-20T12:27:01.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 -- start start 2024-04-20T12:27:01.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 Processor -- start 2024-04-20T12:27:01.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c79a50 0x564a53c846a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c7a370 0x564a53c84be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c87630 0x564a53c85120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564a53c8a390 con 0x564a53c7a370 2024-04-20T12:27:01.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x564a53b982f0 con 0x564a53c87630 2024-04-20T12:27:01.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564a53c8a510 con 0x564a53c79a50 2024-04-20T12:27:01.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.070+0000 7f5b10dc1740 10 client.0 _ll_register_callbacks cb 0x564a53b624e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:01.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5b06ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c7a370 0x564a53c84be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5b06ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c7a370 0x564a53c84be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39770/0 (socket says 172.21.15.135:39770) 2024-04-20T12:27:01.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5b06ffd640 1 -- 172.21.15.135:0/4167263344 learned_addr learned my addr 172.21.15.135:0/4167263344 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5b07fff640 1 --2- 172.21.15.135:0/4167263344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c87630 0x564a53c85120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5b077fe640 1 --2- 172.21.15.135:0/4167263344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c79a50 0x564a53c846a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5b06ffd640 1 -- 172.21.15.135:0/4167263344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c79a50 msgr2=0x564a53c846a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5b06ffd640 1 --2- 172.21.15.135:0/4167263344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c79a50 0x564a53c846a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5b06ffd640 1 -- 172.21.15.135:0/4167263344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c87630 msgr2=0x564a53c85120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5b06ffd640 1 --2- 172.21.15.135:0/4167263344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c87630 0x564a53c85120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5b06ffd640 1 -- 172.21.15.135:0/4167263344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a538f13f0 con 0x564a53c7a370 2024-04-20T12:27:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5b06ffd640 1 --2- 172.21.15.135:0/4167263344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c7a370 0x564a53c84be0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00bad0 tx=0x7f5afc00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0e689051ac9916 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5ae6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5ae6ffd640 1 -- 172.21.15.135:0/4167263344 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc011440 con 0x564a53c7a370 2024-04-20T12:27:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5ae6ffd640 1 -- 172.21.15.135:0/4167263344 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5afc0115e0 con 0x564a53c7a370 2024-04-20T12:27:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5b10dc1740 1 -- 172.21.15.135:0/4167263344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b00050070 con 0x564a53c7a370 2024-04-20T12:27:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5ae6ffd640 1 -- 172.21.15.135:0/4167263344 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5afc0117e0 con 0x564a53c7a370 2024-04-20T12:27:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5b10dc1740 10 client.16869 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.071+0000 7f5b10dc1740 1 -- 172.21.15.135:0/4167263344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564a538b10f0 con 0x564a53c7a370 2024-04-20T12:27:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.072+0000 7f5ae6ffd640 1 -- 172.21.15.135:0/4167263344 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b00050070 con 0x564a53c7a370 2024-04-20T12:27:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.072+0000 7f5ae6ffd640 1 -- 172.21.15.135:0/4167263344 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f5afc01b990 con 0x564a53c7a370 2024-04-20T12:27:01.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.072+0000 7f5b10dc1740 10 client.16869 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.072+0000 7f5b10dc1740 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.072+0000 7f5b10dc1740 20 client.16869 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.072+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/4167263344 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x564a53c97a90 0x564a53c99ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.072+0000 7f5b10dc1740 4 client.16869 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.072+0000 7f5b10dc1740 1 -- 172.21.15.135:0/4167263344 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a53becbd0 con 0x564a53c97a90 2024-04-20T12:27:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.072+0000 7f5b077fe640 1 --2- 172.21.15.135:0/4167263344 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x564a53c97a90 0x564a53c99ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.073+0000 7f5b077fe640 1 --2- 172.21.15.135:0/4167263344 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x564a53c97a90 0x564a53c99ee0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cace05b40c9129c server_cookie=8366b65b8b03db47 in_seq=0 out_seq=0 2024-04-20T12:27:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.073+0000 7f5ae6ffd640 10 client.16869 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.073+0000 7f5ae6ffd640 1 -- 172.21.15.135:0/4167263344 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564a53becbd0 con 0x564a53c97a90 2024-04-20T12:27:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.073+0000 7f5ae6ffd640 10 client.16869 handle_command_reply: tid=0 2024-04-20T12:27:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.073+0000 7f5b10dc1740 1 client.16869 shutdown 2024-04-20T12:27:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.074+0000 7f5b10dc1740 1 -- 172.21.15.135:0/4167263344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c7a370 msgr2=0x564a53c84be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.074+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/4167263344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c7a370 0x564a53c84be0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00bad0 tx=0x7f5afc00bf90 comp rx=0 tx=0).stop 2024-04-20T12:27:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.074+0000 7f5b10dc1740 1 -- 172.21.15.135:0/4167263344 shutdown_connections 2024-04-20T12:27:01.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.074+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/4167263344 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x564a53c97a90 0x564a53c99ee0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.074+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/4167263344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c87630 0x564a53c85120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.074+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/4167263344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c7a370 0x564a53c84be0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.074+0000 7f5ae6ffd640 0 client.16869 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:01.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.074+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/4167263344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c79a50 0x564a53c846a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.074+0000 7f5b10dc1740 1 -- 172.21.15.135:0/4167263344 >> 172.21.15.135:0/4167263344 conn(0x564a53c74450 msgr2=0x564a53c761a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.074+0000 7f5b10dc1740 1 -- 172.21.15.135:0/4167263344 shutdown_connections 2024-04-20T12:27:01.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.074+0000 7f5b10dc1740 1 -- 172.21.15.135:0/4167263344 wait complete. 2024-04-20T12:27:01.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.074+0000 7f5b10dc1740 20 client.16869 trim_cache size 0 max 16384 2024-04-20T12:27:01.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.091+0000 7f5b10dc1740 1 Processor -- start 2024-04-20T12:27:01.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.091+0000 7f5b10dc1740 1 -- start start 2024-04-20T12:27:01.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.091+0000 7f5b10dc1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c79a50 0x564a53c86dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.091+0000 7f5b10dc1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c7a370 0x564a53c93310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.091+0000 7f5b10dc1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c87630 0x564a53c9f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.091+0000 7f5b10dc1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081ad0e0 con 0x564a53c7a370 2024-04-20T12:27:01.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.091+0000 7f5b10dc1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081aec20 con 0x564a53c87630 2024-04-20T12:27:01.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.091+0000 7f5b10dc1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081ad7b0 con 0x564a53c79a50 2024-04-20T12:27:01.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.091+0000 7f5b06ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c7a370 0x564a53c93310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.091+0000 7f5b06ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c7a370 0x564a53c93310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39784/0 (socket says 172.21.15.135:39784) 2024-04-20T12:27:01.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.091+0000 7f5b06ffd640 1 -- 172.21.15.135:0/4246663594 learned_addr learned my addr 172.21.15.135:0/4246663594 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.091+0000 7f5b077fe640 1 --2- 172.21.15.135:0/4246663594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c79a50 0x564a53c86dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.092+0000 7f5b07fff640 1 --2- 172.21.15.135:0/4246663594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c87630 0x564a53c9f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.092+0000 7f5b06ffd640 1 -- 172.21.15.135:0/4246663594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c79a50 msgr2=0x564a53c86dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.092+0000 7f5b06ffd640 1 --2- 172.21.15.135:0/4246663594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c79a50 0x564a53c86dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.092+0000 7f5b06ffd640 1 -- 172.21.15.135:0/4246663594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c87630 msgr2=0x564a53c9f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.092+0000 7f5b06ffd640 1 --2- 172.21.15.135:0/4246663594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c87630 0x564a53c9f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.092+0000 7f5b06ffd640 1 -- 172.21.15.135:0/4246663594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a53c78e10 con 0x564a53c7a370 2024-04-20T12:27:01.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.092+0000 7f5b07fff640 1 --2- 172.21.15.135:0/4246663594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c87630 0x564a53c9f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:27:01.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.092+0000 7f5b06ffd640 1 --2- 172.21.15.135:0/4246663594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c7a370 0x564a53c93310 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5afc01bd80 tx=0x7f5afc0044a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120a06c0585e607 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.092+0000 7f5aed7fa640 1 -- 172.21.15.135:0/4246663594 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc02d020 con 0x564a53c7a370 2024-04-20T12:27:01.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.092+0000 7f5aed7fa640 1 -- 172.21.15.135:0/4246663594 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5afc011440 con 0x564a53c7a370 2024-04-20T12:27:01.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.092+0000 7f5aed7fa640 1 -- 172.21.15.135:0/4246663594 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0056f0 con 0x564a53c7a370 2024-04-20T12:27:01.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 -- 172.21.15.135:0/4246663594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c7a370 msgr2=0x564a53c93310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/4246663594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c7a370 0x564a53c93310 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5afc01bd80 tx=0x7f5afc0044a0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 -- 172.21.15.135:0/4246663594 shutdown_connections 2024-04-20T12:27:01.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/4246663594 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c87630 0x564a53c9f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/4246663594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c7a370 0x564a53c93310 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/4246663594 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c79a50 0x564a53c86dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 -- 172.21.15.135:0/4246663594 >> 172.21.15.135:0/4246663594 conn(0x564a53c74450 msgr2=0x564a53c73630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 -- 172.21.15.135:0/4246663594 shutdown_connections 2024-04-20T12:27:01.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 -- 172.21.15.135:0/4246663594 wait complete. 2024-04-20T12:27:01.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 -- start start 2024-04-20T12:27:01.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 Processor -- start 2024-04-20T12:27:01.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c79a50 0x564a53c8d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c7a370 0x564a53c8dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c87630 0x564a53cfd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081ae550 con 0x564a53c87630 2024-04-20T12:27:01.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081ade80 con 0x564a53c7a370 2024-04-20T12:27:01.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5b081ab0b0 con 0x564a53c79a50 2024-04-20T12:27:01.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b10dc1740 10 client.0 _ll_register_callbacks cb 0x7f5afc004060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:01.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b07fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c87630 0x564a53cfd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.093+0000 7f5b07fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c87630 0x564a53cfd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39800/0 (socket says 172.21.15.135:39800) 2024-04-20T12:27:01.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5b07fff640 1 -- 172.21.15.135:0/281371700 learned_addr learned my addr 172.21.15.135:0/281371700 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5b077fe640 1 --2- 172.21.15.135:0/281371700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c79a50 0x564a53c8d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5b06ffd640 1 --2- 172.21.15.135:0/281371700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c7a370 0x564a53c8dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5b07fff640 1 -- 172.21.15.135:0/281371700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c79a50 msgr2=0x564a53c8d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5b07fff640 1 --2- 172.21.15.135:0/281371700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c79a50 0x564a53c8d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5b07fff640 1 -- 172.21.15.135:0/281371700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c7a370 msgr2=0x564a53c8dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5b07fff640 1 --2- 172.21.15.135:0/281371700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c7a370 0x564a53c8dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5b07fff640 1 -- 172.21.15.135:0/281371700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a53cfd5b0 con 0x564a53c87630 2024-04-20T12:27:01.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5b07fff640 1 --2- 172.21.15.135:0/281371700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c87630 0x564a53cfd070 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5b00037040 tx=0x7f5b000095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acb14adea49c3e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5ae6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:01.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5ae6ffd640 1 -- 172.21.15.135:0/281371700 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00039040 con 0x564a53c87630 2024-04-20T12:27:01.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5ae6ffd640 1 -- 172.21.15.135:0/281371700 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5b000044b0 con 0x564a53c87630 2024-04-20T12:27:01.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5b10dc1740 1 -- 172.21.15.135:0/281371700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5afc011440 con 0x564a53c87630 2024-04-20T12:27:01.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5ae6ffd640 1 -- 172.21.15.135:0/281371700 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5b00067050 con 0x564a53c87630 2024-04-20T12:27:01.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5b10dc1740 10 client.16875 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:01.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5b10dc1740 1 -- 172.21.15.135:0/281371700 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564a53cfe830 con 0x564a53c87630 2024-04-20T12:27:01.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.094+0000 7f5ae6ffd640 1 -- 172.21.15.135:0/281371700 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5afc011440 con 0x564a53c87630 2024-04-20T12:27:01.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.095+0000 7f5ae6ffd640 1 -- 172.21.15.135:0/281371700 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f5b0004a070 con 0x564a53c87630 2024-04-20T12:27:01.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.095+0000 7f5b10dc1740 10 client.16875 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:01.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.095+0000 7f5b10dc1740 10 client.16875 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:01.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.095+0000 7f5b10dc1740 20 client.16875 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:01.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.095+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/281371700 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x564a53cfeb30 0x564a53d00f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.095+0000 7f5b10dc1740 4 client.16875 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:27:01.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.095+0000 7f5b10dc1740 1 -- 172.21.15.135:0/281371700 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564a53be6a40 con 0x564a53cfeb30 2024-04-20T12:27:01.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.095+0000 7f5b077fe640 1 --2- 172.21.15.135:0/281371700 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x564a53cfeb30 0x564a53d00f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.095+0000 7f5b077fe640 1 --2- 172.21.15.135:0/281371700 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x564a53cfeb30 0x564a53d00f50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f249c1cbc7a662b server_cookie=c5cb01920e7f8594 in_seq=0 out_seq=0 2024-04-20T12:27:01.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.095+0000 7f5ae6ffd640 10 client.16875 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:01.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.095+0000 7f5ae6ffd640 1 -- 172.21.15.135:0/281371700 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564a53be6a40 con 0x564a53cfeb30 2024-04-20T12:27:01.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.095+0000 7f5ae6ffd640 10 client.16875 handle_command_reply: tid=0 2024-04-20T12:27:01.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.095+0000 7f5b10dc1740 1 client.16875 shutdown 2024-04-20T12:27:01.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b10dc1740 1 -- 172.21.15.135:0/281371700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c87630 msgr2=0x564a53cfd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/281371700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c87630 0x564a53cfd070 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f5b00037040 tx=0x7f5b000095c0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b10dc1740 1 -- 172.21.15.135:0/281371700 shutdown_connections 2024-04-20T12:27:01.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/281371700 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x564a53cfeb30 0x564a53d00f50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/281371700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a53c87630 0x564a53cfd070 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/281371700 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a53c7a370 0x564a53c8dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5ae6ffd640 0 client.16875 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:01.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b10dc1740 1 --2- 172.21.15.135:0/281371700 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a53c79a50 0x564a53c8d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b10dc1740 1 -- 172.21.15.135:0/281371700 >> 172.21.15.135:0/281371700 conn(0x564a53c74450 msgr2=0x564a53c758a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b10dc1740 1 -- 172.21.15.135:0/281371700 shutdown_connections 2024-04-20T12:27:01.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b10dc1740 1 -- 172.21.15.135:0/281371700 wait complete. 2024-04-20T12:27:01.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b10dc1740 20 client.16875 trim_cache size 0 max 16384 2024-04-20T12:27:01.103 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:27:01.103 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:27:01.103 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:27:01.103 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:27:01.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b0e1ce640 1 -- 172.21.15.135:0/1895183181 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5af00a3d20 msgr2=0x7f5af00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b0e1ce640 1 --2- 172.21.15.135:0/1895183181 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5af00a3d20 0x7f5af00a61e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009a60 tx=0x7f5b000324f0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b0e1ce640 1 -- 172.21.15.135:0/1895183181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b08100460 msgr2=0x7f5b0819e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b0e1ce640 1 --2- 172.21.15.135:0/1895183181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b08100460 0x7f5b0819e5b0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f5af800d950 tx=0x7f5af800de10 comp rx=0 tx=0).stop 2024-04-20T12:27:01.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b0e1ce640 1 -- 172.21.15.135:0/1895183181 shutdown_connections 2024-04-20T12:27:01.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b0e1ce640 1 --2- 172.21.15.135:0/1895183181 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5b08106f40 0x7f5b08198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b0e1ce640 1 --2- 172.21.15.135:0/1895183181 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5af00a3d20 0x7f5af00a61e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b0e1ce640 1 --2- 172.21.15.135:0/1895183181 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b08100e20 0x7f5b0819eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b0e1ce640 1 --2- 172.21.15.135:0/1895183181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b08100460 0x7f5b0819e5b0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b0e1ce640 1 -- 172.21.15.135:0/1895183181 >> 172.21.15.135:0/1895183181 conn(0x7f5b08077420 msgr2=0x7f5b08104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b0e1ce640 1 -- 172.21.15.135:0/1895183181 shutdown_connections 2024-04-20T12:27:01.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.096+0000 7f5b0e1ce640 1 -- 172.21.15.135:0/1895183181 wait complete. 2024-04-20T12:27:01.107 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:27:01.107 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:27:01.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.206+0000 7fc2c7b15640 1 -- 172.21.15.135:0/2640002482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2c010c530 msgr2=0x7fc2c010e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.206+0000 7fc2c7b15640 1 --2- 172.21.15.135:0/2640002482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2c010c530 0x7fc2c010e9d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009ca0 tx=0x7fc2b802c230 comp rx=0 tx=0).stop 2024-04-20T12:27:01.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.206+0000 7fc2c7b15640 1 -- 172.21.15.135:0/2640002482 shutdown_connections 2024-04-20T12:27:01.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.206+0000 7fc2c7b15640 1 --2- 172.21.15.135:0/2640002482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2c010c530 0x7fc2c010e9d0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.206+0000 7fc2c7b15640 1 --2- 172.21.15.135:0/2640002482 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2c0103b10 0x7fc2c010bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.206+0000 7fc2c7b15640 1 --2- 172.21.15.135:0/2640002482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2c01031f0 0x7fc2c01035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.206+0000 7fc2c7b15640 1 -- 172.21.15.135:0/2640002482 >> 172.21.15.135:0/2640002482 conn(0x7fc2c0077f60 msgr2=0x7fc2c0078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.206+0000 7fc2c7b15640 1 -- 172.21.15.135:0/2640002482 shutdown_connections 2024-04-20T12:27:01.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.206+0000 7fc2c7b15640 1 -- 172.21.15.135:0/2640002482 wait complete. 2024-04-20T12:27:01.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c7b15640 1 Processor -- start 2024-04-20T12:27:01.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c7b15640 1 -- start start 2024-04-20T12:27:01.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c7b15640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2c01031f0 0x7fc2c019e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c7b15640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2c0103b10 0x7fc2c019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c7b15640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2c010c530 0x7fc2c01985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c7b15640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c0112310 con 0x7fc2c0103b10 2024-04-20T12:27:01.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c7b15640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c0112190 con 0x7fc2c010c530 2024-04-20T12:27:01.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c7b15640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c0112490 con 0x7fc2c01031f0 2024-04-20T12:27:01.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c50b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2c0103b10 0x7fc2c019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c50b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2c0103b10 0x7fc2c019e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39824/0 (socket says 172.21.15.135:39824) 2024-04-20T12:27:01.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c50b0640 1 -- 172.21.15.135:0/1590171789 learned_addr learned my addr 172.21.15.135:0/1590171789 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c60b2640 1 --2- 172.21.15.135:0/1590171789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2c010c530 0x7fc2c01985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c58b1640 1 --2- 172.21.15.135:0/1590171789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2c01031f0 0x7fc2c019e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c50b0640 1 -- 172.21.15.135:0/1590171789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2c01031f0 msgr2=0x7fc2c019e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c50b0640 1 --2- 172.21.15.135:0/1590171789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2c01031f0 0x7fc2c019e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c50b0640 1 -- 172.21.15.135:0/1590171789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2c010c530 msgr2=0x7fc2c01985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c50b0640 1 --2- 172.21.15.135:0/1590171789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2c010c530 0x7fc2c01985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c50b0640 1 -- 172.21.15.135:0/1590171789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c0198d50 con 0x7fc2c0103b10 2024-04-20T12:27:01.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c58b1640 1 --2- 172.21.15.135:0/1590171789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2c01031f0 0x7fc2c019e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:01.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.207+0000 7fc2c50b0640 1 --2- 172.21.15.135:0/1590171789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2c0103b10 0x7fc2c019e960 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000e9f0 tx=0x7fc2b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.208+0000 7fc2b6ffd640 1 -- 172.21.15.135:0/1590171789 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b000cd80 con 0x7fc2c0103b10 2024-04-20T12:27:01.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.208+0000 7fc2c7b15640 1 -- 172.21.15.135:0/1590171789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c0199040 con 0x7fc2c0103b10 2024-04-20T12:27:01.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.208+0000 7fc2b6ffd640 1 -- 172.21.15.135:0/1590171789 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2b0010910 con 0x7fc2c0103b10 2024-04-20T12:27:01.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.208+0000 7fc2b6ffd640 1 -- 172.21.15.135:0/1590171789 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b00188f0 con 0x7fc2c0103b10 2024-04-20T12:27:01.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.208+0000 7fc2c7b15640 1 -- 172.21.15.135:0/1590171789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c01a52e0 con 0x7fc2c0103b10 2024-04-20T12:27:01.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.209+0000 7fc2c7b15640 1 -- 172.21.15.135:0/1590171789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2c0068d80 con 0x7fc2c0103b10 2024-04-20T12:27:01.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.210+0000 7fc2b6ffd640 1 -- 172.21.15.135:0/1590171789 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fc2b0010ac0 con 0x7fc2c0103b10 2024-04-20T12:27:01.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.210+0000 7fc2b6ffd640 1 --2- 172.21.15.135:0/1590171789 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc2ac0a3d20 0x7fc2ac0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.210+0000 7fc2c58b1640 1 --2- 172.21.15.135:0/1590171789 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc2ac0a3d20 0x7fc2ac0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.210+0000 7fc2b6ffd640 1 -- 172.21.15.135:0/1590171789 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc2b00d1300 con 0x7fc2c0103b10 2024-04-20T12:27:01.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.211+0000 7fc2c58b1640 1 --2- 172.21.15.135:0/1590171789 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc2ac0a3d20 0x7fc2ac0a61e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc005fd0 tx=0x7fc2bc005ea0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.214+0000 7fc2b6ffd640 1 -- 172.21.15.135:0/1590171789 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fc2b009d620 con 0x7fc2c0103b10 2024-04-20T12:27:01.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.428+0000 7fc2c7b15640 1 -- 172.21.15.135:0/1590171789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2c01076e0 con 0x7fc2c0103b10 2024-04-20T12:27:01.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.429+0000 7fc2b6ffd640 1 -- 172.21.15.135:0/1590171789 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7fc2b009cf20 con 0x7fc2c0103b10 2024-04-20T12:27:01.429 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:27:01.429 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:27:01.429 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:27:01.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.431+0000 7fc2c7b15640 1 -- 172.21.15.135:0/1590171789 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc2ac0a3d20 msgr2=0x7fc2ac0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.431+0000 7fc2c7b15640 1 --2- 172.21.15.135:0/1590171789 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc2ac0a3d20 0x7fc2ac0a61e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc005fd0 tx=0x7fc2bc005ea0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.431+0000 7fc2c7b15640 1 -- 172.21.15.135:0/1590171789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2c0103b10 msgr2=0x7fc2c019e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.431+0000 7fc2c7b15640 1 --2- 172.21.15.135:0/1590171789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2c0103b10 0x7fc2c019e960 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000e9f0 tx=0x7fc2b000eeb0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.431+0000 7fc2c7b15640 1 -- 172.21.15.135:0/1590171789 shutdown_connections 2024-04-20T12:27:01.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.431+0000 7fc2c7b15640 1 --2- 172.21.15.135:0/1590171789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2c010c530 0x7fc2c01985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.431+0000 7fc2c7b15640 1 --2- 172.21.15.135:0/1590171789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2c0103b10 0x7fc2c019e960 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.431+0000 7fc2c7b15640 1 --2- 172.21.15.135:0/1590171789 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc2ac0a3d20 0x7fc2ac0a61e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.431+0000 7fc2c7b15640 1 --2- 172.21.15.135:0/1590171789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc2c01031f0 0x7fc2c019e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.431+0000 7fc2c7b15640 1 -- 172.21.15.135:0/1590171789 >> 172.21.15.135:0/1590171789 conn(0x7fc2c0077f60 msgr2=0x7fc2c00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.431+0000 7fc2c7b15640 1 -- 172.21.15.135:0/1590171789 shutdown_connections 2024-04-20T12:27:01.432 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.431+0000 7fc2c7b15640 1 -- 172.21.15.135:0/1590171789 wait complete. 2024-04-20T12:27:01.443 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:27:01.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.543+0000 7f5a5c52e640 1 -- 172.21.15.135:0/2025279213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54103200 msgr2=0x7f5a541035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.543+0000 7f5a5c52e640 1 --2- 172.21.15.135:0/2025279213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54103200 0x7f5a541035e0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009900 tx=0x7f5a5002bd60 comp rx=0 tx=0).stop 2024-04-20T12:27:01.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.543+0000 7f5a5c52e640 1 -- 172.21.15.135:0/2025279213 shutdown_connections 2024-04-20T12:27:01.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.543+0000 7f5a5c52e640 1 --2- 172.21.15.135:0/2025279213 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a5410c540 0x7f5a5410e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.543+0000 7f5a5c52e640 1 --2- 172.21.15.135:0/2025279213 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a54103b20 0x7f5a5410c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.543+0000 7f5a5c52e640 1 --2- 172.21.15.135:0/2025279213 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54103200 0x7f5a541035e0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.543+0000 7f5a5c52e640 1 -- 172.21.15.135:0/2025279213 >> 172.21.15.135:0/2025279213 conn(0x7f5a540771e0 msgr2=0x7f5a540775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.543+0000 7f5a5c52e640 1 -- 172.21.15.135:0/2025279213 shutdown_connections 2024-04-20T12:27:01.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.543+0000 7f5a5c52e640 1 -- 172.21.15.135:0/2025279213 wait complete. 2024-04-20T12:27:01.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5c52e640 1 Processor -- start 2024-04-20T12:27:01.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5c52e640 1 -- start start 2024-04-20T12:27:01.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5c52e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54103200 0x7f5a54100e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5c52e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a54103b20 0x7f5a54101390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5c52e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a5410c540 0x7f5a541018d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5c52e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a54112370 con 0x7f5a54103200 2024-04-20T12:27:01.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5c52e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5a541121f0 con 0x7f5a54103b20 2024-04-20T12:27:01.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5c52e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5a541124f0 con 0x7f5a5410c540 2024-04-20T12:27:01.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5a2ca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54103200 0x7f5a54100e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5a2ca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54103200 0x7f5a54100e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39840/0 (socket says 172.21.15.135:39840) 2024-04-20T12:27:01.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5a2ca640 1 -- 172.21.15.135:0/3688765100 learned_addr learned my addr 172.21.15.135:0/3688765100 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5a2ca640 1 -- 172.21.15.135:0/3688765100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a5410c540 msgr2=0x7f5a541018d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5a2ca640 1 --2- 172.21.15.135:0/3688765100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a5410c540 0x7f5a541018d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5a2ca640 1 -- 172.21.15.135:0/3688765100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a54103b20 msgr2=0x7f5a54101390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a59ac9640 1 --2- 172.21.15.135:0/3688765100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a54103b20 0x7f5a54101390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5a2ca640 1 --2- 172.21.15.135:0/3688765100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a54103b20 0x7f5a54101390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.544+0000 7f5a5a2ca640 1 -- 172.21.15.135:0/3688765100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a541a6c70 con 0x7f5a54103200 2024-04-20T12:27:01.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.545+0000 7f5a5a2ca640 1 --2- 172.21.15.135:0/3688765100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54103200 0x7f5a54100e50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009a20 tx=0x7f5a5002df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.545+0000 7f5a4b7fe640 1 -- 172.21.15.135:0/3688765100 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50043020 con 0x7f5a54103200 2024-04-20T12:27:01.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.545+0000 7f5a4b7fe640 1 -- 172.21.15.135:0/3688765100 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a500054e0 con 0x7f5a54103200 2024-04-20T12:27:01.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.545+0000 7f5a5c52e640 1 -- 172.21.15.135:0/3688765100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a541a6f00 con 0x7f5a54103200 2024-04-20T12:27:01.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.545+0000 7f5a4b7fe640 1 -- 172.21.15.135:0/3688765100 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50003ce0 con 0x7f5a54103200 2024-04-20T12:27:01.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.545+0000 7f5a5c52e640 1 -- 172.21.15.135:0/3688765100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a541a73c0 con 0x7f5a54103200 2024-04-20T12:27:01.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.547+0000 7f5a5f1f5740 1 Processor -- start 2024-04-20T12:27:01.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.547+0000 7f5a4b7fe640 1 -- 172.21.15.135:0/3688765100 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f5a50046020 con 0x7f5a54103200 2024-04-20T12:27:01.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.547+0000 7f5a5f1f5740 1 -- start start 2024-04-20T12:27:01.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a5f1f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d6e10 0x5593670d71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a5f1f5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d7730 0x5593670dfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a5f1f5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670e2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a5f1f5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55936703c110 con 0x5593670e0310 2024-04-20T12:27:01.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a5f1f5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559366fd9550 con 0x5593670d7730 2024-04-20T12:27:01.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a5f1f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5593670380d0 con 0x5593670d6e10 2024-04-20T12:27:01.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a59ac9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670e2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a59ac9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670e2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39844/0 (socket says 172.21.15.135:39844) 2024-04-20T12:27:01.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a59ac9640 1 -- 172.21.15.135:0/2509099035 learned_addr learned my addr 172.21.15.135:0/2509099035 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a5a2ca640 1 --2- 172.21.15.135:0/2509099035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d7730 0x5593670dfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a5aacb640 1 --2- 172.21.15.135:0/2509099035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d6e10 0x5593670d71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a4b7fe640 1 --2- 172.21.15.135:0/3688765100 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5a400a3d50 0x7f5a400a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a59ac9640 1 -- 172.21.15.135:0/2509099035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d6e10 msgr2=0x5593670d71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a59ac9640 1 --2- 172.21.15.135:0/2509099035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d6e10 0x5593670d71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a59ac9640 1 -- 172.21.15.135:0/2509099035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d7730 msgr2=0x5593670dfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a59ac9640 1 --2- 172.21.15.135:0/2509099035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d7730 0x5593670dfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a59ac9640 1 -- 172.21.15.135:0/2509099035 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559367001900 con 0x5593670e0310 2024-04-20T12:27:01.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a5aacb640 1 --2- 172.21.15.135:0/3688765100 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5a400a3d50 0x7f5a400a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a4b7fe640 1 -- 172.21.15.135:0/3688765100 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5a500f2cc0 con 0x7f5a54103200 2024-04-20T12:27:01.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a59ac9640 1 --2- 172.21.15.135:0/2509099035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670e2700 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009b60 tx=0x7f5a4400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604301291cf7fbd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.548+0000 7f5a48bfe640 1 -- 172.21.15.135:0/2509099035 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a44016070 con 0x5593670e0310 2024-04-20T12:27:01.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.549+0000 7f5a48bfe640 1 -- 172.21.15.135:0/2509099035 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a44009e50 con 0x5593670e0310 2024-04-20T12:27:01.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.549+0000 7f5a48bfe640 1 -- 172.21.15.135:0/2509099035 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a44011470 con 0x5593670e0310 2024-04-20T12:27:01.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.549+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/2509099035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 msgr2=0x5593670e2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.549+0000 7f5a5aacb640 1 --2- 172.21.15.135:0/3688765100 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5a400a3d50 0x7f5a400a6210 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c005c40 tx=0x7f5a4c004a40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.549+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/2509099035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670e2700 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009b60 tx=0x7f5a4400e6c0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.549+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/2509099035 shutdown_connections 2024-04-20T12:27:01.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.549+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/2509099035 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670e2700 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.549+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/2509099035 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d7730 0x5593670dfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.549+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/2509099035 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d6e10 0x5593670d71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.549+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/2509099035 >> 172.21.15.135:0/2509099035 conn(0x5593670d1540 msgr2=0x5593670d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.549+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/2509099035 shutdown_connections 2024-04-20T12:27:01.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.549+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/2509099035 wait complete. 2024-04-20T12:27:01.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5f1f5740 1 -- start start 2024-04-20T12:27:01.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5f1f5740 1 Processor -- start 2024-04-20T12:27:01.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5f1f5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670d6e10 0x5593670dd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5f1f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d7730 0x5593670dd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5f1f5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670e0310 0x5593670dde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5f1f5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5593670e30a0 con 0x5593670d6e10 2024-04-20T12:27:01.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5f1f5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559366ff5500 con 0x5593670e0310 2024-04-20T12:27:01.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5f1f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5593670e3220 con 0x5593670d7730 2024-04-20T12:27:01.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5f1f5740 10 client.0 _ll_register_callbacks cb 0x559366fda2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:01.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5a2ca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670d6e10 0x5593670dd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5a2ca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670d6e10 0x5593670dd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39854/0 (socket says 172.21.15.135:39854) 2024-04-20T12:27:01.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5a2ca640 1 -- 172.21.15.135:0/3063046379 learned_addr learned my addr 172.21.15.135:0/3063046379 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a59ac9640 1 --2- 172.21.15.135:0/3063046379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d7730 0x5593670dd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5a2ca640 1 -- 172.21.15.135:0/3063046379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d7730 msgr2=0x5593670dd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5a2ca640 1 --2- 172.21.15.135:0/3063046379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d7730 0x5593670dd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5a2ca640 1 -- 172.21.15.135:0/3063046379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670e0310 msgr2=0x5593670dde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5a2ca640 1 --2- 172.21.15.135:0/3063046379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670e0310 0x5593670dde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5a2ca640 1 -- 172.21.15.135:0/3063046379 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559366d4e3f0 con 0x5593670d6e10 2024-04-20T12:27:01.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a59ac9640 1 --2- 172.21.15.135:0/3063046379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d7730 0x5593670dd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:01.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a5a2ca640 1 --2- 172.21.15.135:0/3063046379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670d6e10 0x5593670dd410 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f5a500f0690 tx=0x7f5a50003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557beea720f3cf8e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.550+0000 7f5a3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:01.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.551+0000 7f5a3dffb640 1 -- 172.21.15.135:0/3063046379 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a500f4070 con 0x5593670d6e10 2024-04-20T12:27:01.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.551+0000 7f5a3dffb640 1 -- 172.21.15.135:0/3063046379 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5a500bb0f0 con 0x5593670d6e10 2024-04-20T12:27:01.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.551+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/3063046379 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a44009e50 con 0x5593670d6e10 2024-04-20T12:27:01.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.551+0000 7f5a3dffb640 1 -- 172.21.15.135:0/3063046379 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5a500be850 con 0x5593670d6e10 2024-04-20T12:27:01.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.551+0000 7f5a5f1f5740 10 client.16893 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:01.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.551+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/3063046379 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559366e187d0 con 0x5593670d6e10 2024-04-20T12:27:01.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.551+0000 7f5a3dffb640 1 -- 172.21.15.135:0/3063046379 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a44009e50 con 0x5593670d6e10 2024-04-20T12:27:01.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.551+0000 7f5a3dffb640 1 -- 172.21.15.135:0/3063046379 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f5a500bece0 con 0x5593670d6e10 2024-04-20T12:27:01.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.551+0000 7f5a5f1f5740 10 client.16893 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:01.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.551+0000 7f5a5f1f5740 10 client.16893 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:27:01.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.551+0000 7f5a5f1f5740 20 client.16893 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:01.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.551+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/3063046379 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5593670f0600 0x5593670f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.551+0000 7f5a5f1f5740 4 client.16893 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:01.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.551+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/3063046379 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559367049b30 con 0x5593670f0600 2024-04-20T12:27:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.551+0000 7f5a59ac9640 1 --2- 172.21.15.135:0/3063046379 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5593670f0600 0x5593670f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.552+0000 7f5a59ac9640 1 --2- 172.21.15.135:0/3063046379 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5593670f0600 0x5593670f2a90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c6a1a88e24014fd server_cookie=268c0cf3cf1d03b9 in_seq=0 out_seq=0 2024-04-20T12:27:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.552+0000 7f5a3dffb640 10 client.16893 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:27:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.552+0000 7f5a3dffb640 1 -- 172.21.15.135:0/3063046379 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559367049b30 con 0x5593670f0600 2024-04-20T12:27:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.552+0000 7f5a3dffb640 10 client.16893 handle_command_reply: tid=0 2024-04-20T12:27:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.552+0000 7f5a5f1f5740 1 client.16893 shutdown 2024-04-20T12:27:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.552+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/3063046379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670d6e10 msgr2=0x5593670dd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.552+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/3063046379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670d6e10 0x5593670dd410 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f5a500f0690 tx=0x7f5a50003f40 comp rx=0 tx=0).stop 2024-04-20T12:27:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.552+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/3063046379 shutdown_connections 2024-04-20T12:27:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.552+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/3063046379 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5593670f0600 0x5593670f2a90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.552+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/3063046379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670e0310 0x5593670dde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.552+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/3063046379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d7730 0x5593670dd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.552+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/3063046379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670d6e10 0x5593670dd410 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.552+0000 7f5a3dffb640 0 client.16893 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:27:01.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.552+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/3063046379 >> 172.21.15.135:0/3063046379 conn(0x5593670d1540 msgr2=0x5593670d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.552+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/3063046379 shutdown_connections 2024-04-20T12:27:01.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.553+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/3063046379 wait complete. 2024-04-20T12:27:01.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.553+0000 7f5a5f1f5740 20 client.16893 trim_cache size 0 max 16384 2024-04-20T12:27:01.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5f1f5740 1 Processor -- start 2024-04-20T12:27:01.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5f1f5740 1 -- start start 2024-04-20T12:27:01.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5f1f5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d6e10 0x5593670dfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5f1f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d7730 0x5593670ebf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5f1f5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670f8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5f1f5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a541b15a0 con 0x5593670e0310 2024-04-20T12:27:01.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5f1f5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5a541b30e0 con 0x5593670d6e10 2024-04-20T12:27:01.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5f1f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5a541b1c70 con 0x5593670d7730 2024-04-20T12:27:01.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5aacb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5aacb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670f8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39862/0 (socket says 172.21.15.135:39862) 2024-04-20T12:27:01.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5aacb640 1 -- 172.21.15.135:0/442580419 learned_addr learned my addr 172.21.15.135:0/442580419 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5a2ca640 1 --2- 172.21.15.135:0/442580419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d6e10 0x5593670dfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5aacb640 1 -- 172.21.15.135:0/442580419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d7730 msgr2=0x5593670ebf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5aacb640 1 --2- 172.21.15.135:0/442580419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d7730 0x5593670ebf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5aacb640 1 -- 172.21.15.135:0/442580419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d6e10 msgr2=0x5593670dfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5aacb640 1 --2- 172.21.15.135:0/442580419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d6e10 0x5593670dfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5aacb640 1 -- 172.21.15.135:0/442580419 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593670d8fe0 con 0x5593670e0310 2024-04-20T12:27:01.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5a2ca640 1 --2- 172.21.15.135:0/442580419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d6e10 0x5593670dfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:27:01.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.566+0000 7f5a5aacb640 1 --2- 172.21.15.135:0/442580419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670f8370 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c01d470 tx=0x7f5a4c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73bd07712f9f08a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.567+0000 7f5a3ffff640 1 -- 172.21.15.135:0/442580419 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c01b650 con 0x5593670e0310 2024-04-20T12:27:01.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.567+0000 7f5a3ffff640 1 -- 172.21.15.135:0/442580419 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a4c01bcd0 con 0x5593670e0310 2024-04-20T12:27:01.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.567+0000 7f5a3ffff640 1 -- 172.21.15.135:0/442580419 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c0123f0 con 0x5593670e0310 2024-04-20T12:27:01.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.567+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/442580419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 msgr2=0x5593670f8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.567+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/442580419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670f8370 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c01d470 tx=0x7f5a4c005bd0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.567+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/442580419 shutdown_connections 2024-04-20T12:27:01.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.567+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/442580419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670f8370 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.567+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/442580419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d7730 0x5593670ebf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.567+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/442580419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d6e10 0x5593670dfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.567+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/442580419 >> 172.21.15.135:0/442580419 conn(0x5593670d1540 msgr2=0x5593670d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.567+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/442580419 shutdown_connections 2024-04-20T12:27:01.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.567+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/442580419 wait complete. 2024-04-20T12:27:01.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.567+0000 7f5a5f1f5740 1 -- start start 2024-04-20T12:27:01.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5f1f5740 1 Processor -- start 2024-04-20T12:27:01.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5f1f5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d6e10 0x5593670e41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5f1f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d7730 0x5593670e4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5f1f5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670e4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5f1f5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a541b2a10 con 0x5593670e0310 2024-04-20T12:27:01.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5f1f5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5a541b2340 con 0x5593670d6e10 2024-04-20T12:27:01.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5f1f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5a541af570 con 0x5593670d7730 2024-04-20T12:27:01.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5f1f5740 10 client.0 _ll_register_callbacks cb 0x7f5a50004310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:01.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5aacb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670e4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5aacb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670e4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39866/0 (socket says 172.21.15.135:39866) 2024-04-20T12:27:01.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5aacb640 1 -- 172.21.15.135:0/1255198101 learned_addr learned my addr 172.21.15.135:0/1255198101 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a59ac9640 1 --2- 172.21.15.135:0/1255198101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d7730 0x5593670e4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5a2ca640 1 --2- 172.21.15.135:0/1255198101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d6e10 0x5593670e41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5aacb640 1 -- 172.21.15.135:0/1255198101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d7730 msgr2=0x5593670e4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5aacb640 1 --2- 172.21.15.135:0/1255198101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d7730 0x5593670e4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5aacb640 1 -- 172.21.15.135:0/1255198101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d6e10 msgr2=0x5593670e41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5aacb640 1 --2- 172.21.15.135:0/1255198101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d6e10 0x5593670e41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5aacb640 1 -- 172.21.15.135:0/1255198101 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559367155e80 con 0x5593670e0310 2024-04-20T12:27:01.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a5aacb640 1 --2- 172.21.15.135:0/1255198101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670e4c50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009cc0 tx=0x7f5a4c026f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154483b03531b9fd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:01.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.568+0000 7f5a3dffb640 1 -- 172.21.15.135:0/1255198101 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c026910 con 0x5593670e0310 2024-04-20T12:27:01.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a3dffb640 1 -- 172.21.15.135:0/1255198101 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5a4c01b450 con 0x5593670e0310 2024-04-20T12:27:01.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/1255198101 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a4c01bcd0 con 0x5593670e0310 2024-04-20T12:27:01.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a3dffb640 1 -- 172.21.15.135:0/1255198101 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5a4c03d050 con 0x5593670e0310 2024-04-20T12:27:01.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a5f1f5740 10 client.16899 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:01.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/1255198101 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5593671570f0 con 0x5593670e0310 2024-04-20T12:27:01.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a3dffb640 1 -- 172.21.15.135:0/1255198101 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a4c01bcd0 con 0x5593670e0310 2024-04-20T12:27:01.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a3dffb640 1 -- 172.21.15.135:0/1255198101 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f5a4c024020 con 0x5593670e0310 2024-04-20T12:27:01.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a5f1f5740 10 client.16899 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:01.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a5f1f5740 10 client.16899 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:27:01.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a5f1f5740 20 client.16899 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:01.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/1255198101 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x559367157780 0x559367159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a5f1f5740 4 client.16899 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:27:01.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/1255198101 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5593670439a0 con 0x559367157780 2024-04-20T12:27:01.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a5a2ca640 1 --2- 172.21.15.135:0/1255198101 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x559367157780 0x559367159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a3dffb640 10 client.16899 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:27:01.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.569+0000 7f5a5a2ca640 1 --2- 172.21.15.135:0/1255198101 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x559367157780 0x559367159ba0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f5cd76d731386f10 server_cookie=95531b3b30f7b66a in_seq=0 out_seq=0 2024-04-20T12:27:01.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a3dffb640 1 -- 172.21.15.135:0/1255198101 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5593670439a0 con 0x559367157780 2024-04-20T12:27:01.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a3dffb640 10 client.16899 handle_command_reply: tid=0 2024-04-20T12:27:01.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5f1f5740 1 client.16899 shutdown 2024-04-20T12:27:01.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/1255198101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 msgr2=0x5593670e4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/1255198101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670e4c50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009cc0 tx=0x7f5a4c026f10 comp rx=0 tx=0).stop 2024-04-20T12:27:01.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/1255198101 shutdown_connections 2024-04-20T12:27:01.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/1255198101 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x559367157780 0x559367159ba0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/1255198101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5593670e0310 0x5593670e4c50 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a3dffb640 0 client.16899 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:27:01.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/1255198101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5593670d7730 0x5593670e4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5f1f5740 1 --2- 172.21.15.135:0/1255198101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5593670d6e10 0x5593670e41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/1255198101 >> 172.21.15.135:0/1255198101 conn(0x5593670d1540 msgr2=0x5593670cfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/1255198101 shutdown_connections 2024-04-20T12:27:01.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5f1f5740 1 -- 172.21.15.135:0/1255198101 wait complete. 2024-04-20T12:27:01.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5f1f5740 20 client.16899 trim_cache size 0 max 16384 2024-04-20T12:27:01.580 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:27:01.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5c52e640 1 -- 172.21.15.135:0/3688765100 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5a400a3d50 msgr2=0x7f5a400a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5c52e640 1 --2- 172.21.15.135:0/3688765100 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5a400a3d50 0x7f5a400a6210 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c005c40 tx=0x7f5a4c004a40 comp rx=0 tx=0).stop 2024-04-20T12:27:01.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5c52e640 1 -- 172.21.15.135:0/3688765100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54103200 msgr2=0x7f5a54100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5c52e640 1 --2- 172.21.15.135:0/3688765100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54103200 0x7f5a54100e50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009a20 tx=0x7f5a5002df60 comp rx=0 tx=0).stop 2024-04-20T12:27:01.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5c52e640 1 -- 172.21.15.135:0/3688765100 shutdown_connections 2024-04-20T12:27:01.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5c52e640 1 --2- 172.21.15.135:0/3688765100 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5a400a3d50 0x7f5a400a6210 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5c52e640 1 --2- 172.21.15.135:0/3688765100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a5410c540 0x7f5a541018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5c52e640 1 --2- 172.21.15.135:0/3688765100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a54103b20 0x7f5a54101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5c52e640 1 --2- 172.21.15.135:0/3688765100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a54103200 0x7f5a54100e50 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.570+0000 7f5a5c52e640 1 -- 172.21.15.135:0/3688765100 >> 172.21.15.135:0/3688765100 conn(0x7f5a540771e0 msgr2=0x7f5a540fdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.571+0000 7f5a5c52e640 1 -- 172.21.15.135:0/3688765100 shutdown_connections 2024-04-20T12:27:01.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.571+0000 7f5a5c52e640 1 -- 172.21.15.135:0/3688765100 wait complete. 2024-04-20T12:27:01.582 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:27:01.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 -- 172.21.15.135:0/3572526651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc280101a50 msgr2=0x7fc28010dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 --2- 172.21.15.135:0/3572526651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc280101a50 0x7fc28010dc90 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc278009ca0 tx=0x7fc27802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 -- 172.21.15.135:0/3572526651 shutdown_connections 2024-04-20T12:27:01.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 --2- 172.21.15.135:0/3572526651 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc280101a50 0x7fc28010dc90 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 --2- 172.21.15.135:0/3572526651 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2801010b0 0x7fc280101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 --2- 172.21.15.135:0/3572526651 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc280105de0 0x7fc2801061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 -- 172.21.15.135:0/3572526651 >> 172.21.15.135:0/3572526651 conn(0x7fc280077c50 msgr2=0x7fc280078060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 -- 172.21.15.135:0/3572526651 shutdown_connections 2024-04-20T12:27:01.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 -- 172.21.15.135:0/3572526651 wait complete. 2024-04-20T12:27:01.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 Processor -- start 2024-04-20T12:27:01.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 -- start start 2024-04-20T12:27:01.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2801010b0 0x7fc28019e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc280101a50 0x7fc28019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc280105de0 0x7fc2801985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc280112410 con 0x7fc280101a50 2024-04-20T12:27:01.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc280112290 con 0x7fc2801010b0 2024-04-20T12:27:01.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.683+0000 7fc287e2e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc280112590 con 0x7fc280105de0 2024-04-20T12:27:01.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc2853c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc280101a50 0x7fc28019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc2853c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc280101a50 0x7fc28019e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39874/0 (socket says 172.21.15.135:39874) 2024-04-20T12:27:01.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc2853c9640 1 -- 172.21.15.135:0/3962361154 learned_addr learned my addr 172.21.15.135:0/3962361154 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc285bca640 1 --2- 172.21.15.135:0/3962361154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2801010b0 0x7fc28019e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc2863cb640 1 --2- 172.21.15.135:0/3962361154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc280105de0 0x7fc2801985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc2853c9640 1 -- 172.21.15.135:0/3962361154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc280105de0 msgr2=0x7fc2801985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc2853c9640 1 --2- 172.21.15.135:0/3962361154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc280105de0 0x7fc2801985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc2853c9640 1 -- 172.21.15.135:0/3962361154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2801010b0 msgr2=0x7fc28019e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc2853c9640 1 --2- 172.21.15.135:0/3962361154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2801010b0 0x7fc28019e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc2853c9640 1 -- 172.21.15.135:0/3962361154 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc280198d30 con 0x7fc280101a50 2024-04-20T12:27:01.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc2853c9640 1 --2- 172.21.15.135:0/3962361154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc280101a50 0x7fc28019e940 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc27000c920 tx=0x7fc27000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc276ffd640 1 -- 172.21.15.135:0/3962361154 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc270007c70 con 0x7fc280101a50 2024-04-20T12:27:01.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc287e2e640 1 -- 172.21.15.135:0/3962361154 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc280199020 con 0x7fc280101a50 2024-04-20T12:27:01.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc276ffd640 1 -- 172.21.15.135:0/3962361154 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc270007e10 con 0x7fc280101a50 2024-04-20T12:27:01.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc276ffd640 1 -- 172.21.15.135:0/3962361154 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc270018890 con 0x7fc280101a50 2024-04-20T12:27:01.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.684+0000 7fc287e2e640 1 -- 172.21.15.135:0/3962361154 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2801a52c0 con 0x7fc280101a50 2024-04-20T12:27:01.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.686+0000 7fc276ffd640 1 -- 172.21.15.135:0/3962361154 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fc270018a70 con 0x7fc280101a50 2024-04-20T12:27:01.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.687+0000 7fc28aa16740 1 Processor -- start 2024-04-20T12:27:01.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.687+0000 7fc28aa16740 1 -- start start 2024-04-20T12:27:01.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.687+0000 7fc28aa16740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0ae10 0x56016ff0b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.687+0000 7fc28aa16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff0b730 0x56016ff13dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.687+0000 7fc28aa16740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff14310 0x56016ff16700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.687+0000 7fc28aa16740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56016fe70110 con 0x56016ff0ae10 2024-04-20T12:27:01.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.687+0000 7fc28aa16740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56016fe0d550 con 0x56016ff14310 2024-04-20T12:27:01.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.687+0000 7fc28aa16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56016fe6c0d0 con 0x56016ff0b730 2024-04-20T12:27:01.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.687+0000 7fc2863cb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0ae10 0x56016ff0b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.687+0000 7fc2863cb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0ae10 0x56016ff0b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39888/0 (socket says 172.21.15.135:39888) 2024-04-20T12:27:01.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.687+0000 7fc2863cb640 1 -- 172.21.15.135:0/779499278 learned_addr learned my addr 172.21.15.135:0/779499278 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.687+0000 7fc276ffd640 1 --2- 172.21.15.135:0/3962361154 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc26c0a3d20 0x7fc26c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.687+0000 7fc2853c9640 1 --2- 172.21.15.135:0/779499278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff14310 0x56016ff16700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.687+0000 7fc285bca640 1 --2- 172.21.15.135:0/779499278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff0b730 0x56016ff13dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.687+0000 7fc2863cb640 1 --2- 172.21.15.135:0/3962361154 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc26c0a3d20 0x7fc26c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.688+0000 7fc2863cb640 1 -- 172.21.15.135:0/779499278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff0b730 msgr2=0x56016ff13dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.688+0000 7fc2863cb640 1 --2- 172.21.15.135:0/779499278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff0b730 0x56016ff13dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.688+0000 7fc2863cb640 1 -- 172.21.15.135:0/779499278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff14310 msgr2=0x56016ff16700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.688+0000 7fc2863cb640 1 --2- 172.21.15.135:0/779499278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff14310 0x56016ff16700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.688+0000 7fc2863cb640 1 -- 172.21.15.135:0/779499278 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56016fe35900 con 0x56016ff0ae10 2024-04-20T12:27:01.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.688+0000 7fc276ffd640 1 -- 172.21.15.135:0/3962361154 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc2700d0c00 con 0x7fc280101a50 2024-04-20T12:27:01.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.688+0000 7fc2863cb640 1 --2- 172.21.15.135:0/779499278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0ae10 0x56016ff0b1f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc278009a60 tx=0x7fc278032d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43359ec4ddbfbdd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.688+0000 7fc26bfff640 1 -- 172.21.15.135:0/779499278 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278050070 con 0x56016ff0ae10 2024-04-20T12:27:01.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.688+0000 7fc2863cb640 1 --2- 172.21.15.135:0/3962361154 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc26c0a3d20 0x7fc26c0a61e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc278032530 tx=0x7fc278048000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.688+0000 7fc26bfff640 1 -- 172.21.15.135:0/779499278 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc278003c30 con 0x56016ff0ae10 2024-04-20T12:27:01.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.688+0000 7fc26bfff640 1 -- 172.21.15.135:0/779499278 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278039040 con 0x56016ff0ae10 2024-04-20T12:27:01.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.689+0000 7fc28aa16740 1 -- 172.21.15.135:0/779499278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0ae10 msgr2=0x56016ff0b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.689+0000 7fc28aa16740 1 --2- 172.21.15.135:0/779499278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0ae10 0x56016ff0b1f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc278009a60 tx=0x7fc278032d90 comp rx=0 tx=0).stop 2024-04-20T12:27:01.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.689+0000 7fc28aa16740 1 -- 172.21.15.135:0/779499278 shutdown_connections 2024-04-20T12:27:01.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.689+0000 7fc28aa16740 1 --2- 172.21.15.135:0/779499278 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff14310 0x56016ff16700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.689+0000 7fc28aa16740 1 --2- 172.21.15.135:0/779499278 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff0b730 0x56016ff13dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.689+0000 7fc28aa16740 1 --2- 172.21.15.135:0/779499278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0ae10 0x56016ff0b1f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.689+0000 7fc28aa16740 1 -- 172.21.15.135:0/779499278 >> 172.21.15.135:0/779499278 conn(0x56016ff05540 msgr2=0x56016ff05920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.689+0000 7fc28aa16740 1 -- 172.21.15.135:0/779499278 shutdown_connections 2024-04-20T12:27:01.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.689+0000 7fc28aa16740 1 -- 172.21.15.135:0/779499278 wait complete. 2024-04-20T12:27:01.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.689+0000 7fc28aa16740 1 -- start start 2024-04-20T12:27:01.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.689+0000 7fc28aa16740 1 Processor -- start 2024-04-20T12:27:01.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc28aa16740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff0ae10 0x56016ff114b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc28aa16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff0b730 0x56016ff119f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc28aa16740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff14310 0x56016ff11f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc28aa16740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56016ff16fe0 con 0x56016ff14310 2024-04-20T12:27:01.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc28aa16740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56016fe29500 con 0x56016ff0ae10 2024-04-20T12:27:01.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc28aa16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56016ff17160 con 0x56016ff0b730 2024-04-20T12:27:01.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc28aa16740 10 client.0 _ll_register_callbacks cb 0x56016fe0e2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:01.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc2863cb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff14310 0x56016ff11f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc2863cb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff14310 0x56016ff11f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39900/0 (socket says 172.21.15.135:39900) 2024-04-20T12:27:01.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc2863cb640 1 -- 172.21.15.135:0/1224825552 learned_addr learned my addr 172.21.15.135:0/1224825552 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc2853c9640 1 --2- 172.21.15.135:0/1224825552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff0b730 0x56016ff119f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc285bca640 1 --2- 172.21.15.135:0/1224825552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff0ae10 0x56016ff114b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc2863cb640 1 -- 172.21.15.135:0/1224825552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff0b730 msgr2=0x56016ff119f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc2863cb640 1 --2- 172.21.15.135:0/1224825552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff0b730 0x56016ff119f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc2863cb640 1 -- 172.21.15.135:0/1224825552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff0ae10 msgr2=0x56016ff114b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc2863cb640 1 --2- 172.21.15.135:0/1224825552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff0ae10 0x56016ff114b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc2863cb640 1 -- 172.21.15.135:0/1224825552 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56016fb823f0 con 0x56016ff14310 2024-04-20T12:27:01.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc2863cb640 1 --2- 172.21.15.135:0/1224825552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff14310 0x56016ff11f30 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc278006010 tx=0x7fc278004820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917d446d283badb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc2697fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:01.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc2697fa640 1 -- 172.21.15.135:0/1224825552 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278039070 con 0x56016ff14310 2024-04-20T12:27:01.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc28aa16740 1 -- 172.21.15.135:0/1224825552 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc278003c30 con 0x56016ff14310 2024-04-20T12:27:01.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc2697fa640 1 -- 172.21.15.135:0/1224825552 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc278054460 con 0x56016ff14310 2024-04-20T12:27:01.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc2697fa640 1 -- 172.21.15.135:0/1224825552 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc278062050 con 0x56016ff14310 2024-04-20T12:27:01.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.690+0000 7fc28aa16740 10 client.16911 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:01.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.691+0000 7fc28aa16740 1 -- 172.21.15.135:0/1224825552 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56016fc4c7d0 con 0x56016ff14310 2024-04-20T12:27:01.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.691+0000 7fc2697fa640 1 -- 172.21.15.135:0/1224825552 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc278003c30 con 0x56016ff14310 2024-04-20T12:27:01.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.691+0000 7fc2697fa640 1 -- 172.21.15.135:0/1224825552 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc27803f070 con 0x56016ff14310 2024-04-20T12:27:01.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.691+0000 7fc28aa16740 10 client.16911 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:01.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.691+0000 7fc28aa16740 10 client.16911 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:27:01.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.691+0000 7fc28aa16740 20 client.16911 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:01.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.691+0000 7fc28aa16740 1 --2- 172.21.15.135:0/1224825552 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56016ff24560 0x56016ff26950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.691+0000 7fc28aa16740 4 client.16911 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:01.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.691+0000 7fc28aa16740 1 -- 172.21.15.135:0/1224825552 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56016fe7db30 con 0x56016ff24560 2024-04-20T12:27:01.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.691+0000 7fc285bca640 1 --2- 172.21.15.135:0/1224825552 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56016ff24560 0x56016ff26950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.692+0000 7fc2697fa640 10 client.16911 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:27:01.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.692+0000 7fc285bca640 1 --2- 172.21.15.135:0/1224825552 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56016ff24560 0x56016ff26950 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c2019b1ee6dd18b server_cookie=629d8ea7218c5eac in_seq=0 out_seq=0 2024-04-20T12:27:01.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.692+0000 7fc2697fa640 1 -- 172.21.15.135:0/1224825552 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56016fe7db30 con 0x56016ff24560 2024-04-20T12:27:01.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.692+0000 7fc2697fa640 10 client.16911 handle_command_reply: tid=0 2024-04-20T12:27:01.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.692+0000 7fc28aa16740 1 client.16911 shutdown 2024-04-20T12:27:01.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.693+0000 7fc28aa16740 1 -- 172.21.15.135:0/1224825552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff14310 msgr2=0x56016ff11f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.693+0000 7fc28aa16740 1 --2- 172.21.15.135:0/1224825552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff14310 0x56016ff11f30 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc278006010 tx=0x7fc278004820 comp rx=0 tx=0).stop 2024-04-20T12:27:01.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.693+0000 7fc28aa16740 1 -- 172.21.15.135:0/1224825552 shutdown_connections 2024-04-20T12:27:01.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.693+0000 7fc28aa16740 1 --2- 172.21.15.135:0/1224825552 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56016ff24560 0x56016ff26950 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.693+0000 7fc28aa16740 1 --2- 172.21.15.135:0/1224825552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff14310 0x56016ff11f30 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.693+0000 7fc28aa16740 1 --2- 172.21.15.135:0/1224825552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff0b730 0x56016ff119f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.693+0000 7fc2697fa640 0 client.16911 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:27:01.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.693+0000 7fc28aa16740 1 --2- 172.21.15.135:0/1224825552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff0ae10 0x56016ff114b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.693+0000 7fc28aa16740 1 -- 172.21.15.135:0/1224825552 >> 172.21.15.135:0/1224825552 conn(0x56016ff05540 msgr2=0x56016ff07290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.693+0000 7fc28aa16740 1 -- 172.21.15.135:0/1224825552 shutdown_connections 2024-04-20T12:27:01.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.693+0000 7fc28aa16740 1 -- 172.21.15.135:0/1224825552 wait complete. 2024-04-20T12:27:01.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.693+0000 7fc28aa16740 20 client.16911 trim_cache size 0 max 16384 2024-04-20T12:27:01.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc28aa16740 1 Processor -- start 2024-04-20T12:27:01.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc28aa16740 1 -- start start 2024-04-20T12:27:01.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc28aa16740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff0ae10 0x56016ff13be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc28aa16740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0b730 0x56016ff2bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc28aa16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff14310 0x56016ff2c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc28aa16740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2801af190 con 0x56016ff0b730 2024-04-20T12:27:01.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc28aa16740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc2801b0cd0 con 0x56016ff0ae10 2024-04-20T12:27:01.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc28aa16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2801af860 con 0x56016ff14310 2024-04-20T12:27:01.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc2853c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0b730 0x56016ff2bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc2853c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0b730 0x56016ff2bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39904/0 (socket says 172.21.15.135:39904) 2024-04-20T12:27:01.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc2853c9640 1 -- 172.21.15.135:0/2878613321 learned_addr learned my addr 172.21.15.135:0/2878613321 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc2853c9640 1 -- 172.21.15.135:0/2878613321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff14310 msgr2=0x56016ff2c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc2853c9640 1 --2- 172.21.15.135:0/2878613321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff14310 0x56016ff2c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc2853c9640 1 -- 172.21.15.135:0/2878613321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff0ae10 msgr2=0x56016ff13be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc285bca640 1 --2- 172.21.15.135:0/2878613321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff0ae10 0x56016ff13be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc2853c9640 1 --2- 172.21.15.135:0/2878613321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff0ae10 0x56016ff13be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc2853c9640 1 -- 172.21.15.135:0/2878613321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56016ff05e80 con 0x56016ff0b730 2024-04-20T12:27:01.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc285bca640 1 --2- 172.21.15.135:0/2878613321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff0ae10 0x56016ff13be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:27:01.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.706+0000 7fc2853c9640 1 --2- 172.21.15.135:0/2878613321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0b730 0x56016ff2bfe0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc270007590 tx=0x7fc2700bcfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427b6a935f375248 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.707+0000 7fc26b7fe640 1 -- 172.21.15.135:0/2878613321 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2700a0bd0 con 0x56016ff0b730 2024-04-20T12:27:01.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.707+0000 7fc26b7fe640 1 -- 172.21.15.135:0/2878613321 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2700a5490 con 0x56016ff0b730 2024-04-20T12:27:01.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.707+0000 7fc26b7fe640 1 -- 172.21.15.135:0/2878613321 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc270098e90 con 0x56016ff0b730 2024-04-20T12:27:01.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.707+0000 7fc28aa16740 1 -- 172.21.15.135:0/2878613321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0b730 msgr2=0x56016ff2bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.707+0000 7fc28aa16740 1 --2- 172.21.15.135:0/2878613321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0b730 0x56016ff2bfe0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc270007590 tx=0x7fc2700bcfd0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.707+0000 7fc28aa16740 1 -- 172.21.15.135:0/2878613321 shutdown_connections 2024-04-20T12:27:01.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.707+0000 7fc28aa16740 1 --2- 172.21.15.135:0/2878613321 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff14310 0x56016ff2c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.707+0000 7fc28aa16740 1 --2- 172.21.15.135:0/2878613321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0b730 0x56016ff2bfe0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.707+0000 7fc28aa16740 1 --2- 172.21.15.135:0/2878613321 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff0ae10 0x56016ff13be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.707+0000 7fc28aa16740 1 -- 172.21.15.135:0/2878613321 >> 172.21.15.135:0/2878613321 conn(0x56016ff05540 msgr2=0x56016ff10500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.707+0000 7fc28aa16740 1 -- 172.21.15.135:0/2878613321 shutdown_connections 2024-04-20T12:27:01.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.707+0000 7fc28aa16740 1 -- 172.21.15.135:0/2878613321 wait complete. 2024-04-20T12:27:01.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.707+0000 7fc28aa16740 1 -- start start 2024-04-20T12:27:01.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc28aa16740 1 Processor -- start 2024-04-20T12:27:01.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc28aa16740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0ae10 0x56016ff0e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc28aa16740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff0b730 0x56016ff0ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc28aa16740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff14310 0x56016ff89850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc28aa16740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2801b0600 con 0x56016ff0ae10 2024-04-20T12:27:01.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc28aa16740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc2801aff30 con 0x56016ff0b730 2024-04-20T12:27:01.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc28aa16740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc2801ad160 con 0x56016ff14310 2024-04-20T12:27:01.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc28aa16740 10 client.0 _ll_register_callbacks cb 0x7fc27804e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:01.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc285bca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0ae10 0x56016ff0e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc285bca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0ae10 0x56016ff0e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39916/0 (socket says 172.21.15.135:39916) 2024-04-20T12:27:01.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc285bca640 1 -- 172.21.15.135:0/3912405416 learned_addr learned my addr 172.21.15.135:0/3912405416 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc2863cb640 1 --2- 172.21.15.135:0/3912405416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff14310 0x56016ff89850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc285bca640 1 -- 172.21.15.135:0/3912405416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff14310 msgr2=0x56016ff89850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc285bca640 1 --2- 172.21.15.135:0/3912405416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff14310 0x56016ff89850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc285bca640 1 -- 172.21.15.135:0/3912405416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff0b730 msgr2=0x56016ff0ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc285bca640 1 --2- 172.21.15.135:0/3912405416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff0b730 0x56016ff0ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc285bca640 1 -- 172.21.15.135:0/3912405416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56016ff89d90 con 0x56016ff0ae10 2024-04-20T12:27:01.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc285bca640 1 --2- 172.21.15.135:0/3912405416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0ae10 0x56016ff0e800 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00b800 tx=0x7fc27c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca70b04e2ece40b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.708+0000 7fc2697fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:01.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.709+0000 7fc2697fa640 1 -- 172.21.15.135:0/3912405416 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27c01f070 con 0x56016ff0ae10 2024-04-20T12:27:01.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.709+0000 7fc2697fa640 1 -- 172.21.15.135:0/3912405416 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc27c01f210 con 0x56016ff0ae10 2024-04-20T12:27:01.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.709+0000 7fc28aa16740 1 -- 172.21.15.135:0/3912405416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2700a5490 con 0x56016ff0ae10 2024-04-20T12:27:01.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.709+0000 7fc2697fa640 1 -- 172.21.15.135:0/3912405416 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc27c030050 con 0x56016ff0ae10 2024-04-20T12:27:01.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.709+0000 7fc28aa16740 10 client.16917 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:01.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.709+0000 7fc28aa16740 1 -- 172.21.15.135:0/3912405416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56016ff8afc0 con 0x56016ff0ae10 2024-04-20T12:27:01.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.709+0000 7fc2697fa640 1 -- 172.21.15.135:0/3912405416 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2700a5490 con 0x56016ff0ae10 2024-04-20T12:27:01.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.709+0000 7fc2697fa640 1 -- 172.21.15.135:0/3912405416 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc27c011b40 con 0x56016ff0ae10 2024-04-20T12:27:01.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.709+0000 7fc28aa16740 10 client.16917 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:01.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.709+0000 7fc28aa16740 10 client.16917 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:27:01.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.709+0000 7fc28aa16740 20 client.16917 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:01.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.709+0000 7fc28aa16740 1 --2- 172.21.15.135:0/3912405416 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56016ff8b710 0x56016ff8db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.709+0000 7fc28aa16740 4 client.16917 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:27:01.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.709+0000 7fc28aa16740 1 -- 172.21.15.135:0/3912405416 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56016fe779a0 con 0x56016ff8b710 2024-04-20T12:27:01.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.709+0000 7fc2853c9640 1 --2- 172.21.15.135:0/3912405416 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56016ff8b710 0x56016ff8db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc2697fa640 10 client.16917 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:27:01.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc2853c9640 1 --2- 172.21.15.135:0/3912405416 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56016ff8b710 0x56016ff8db70 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d9cd05d15f4152f5 server_cookie=c915fd1360df80e4 in_seq=0 out_seq=0 2024-04-20T12:27:01.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc2697fa640 1 -- 172.21.15.135:0/3912405416 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56016fe779a0 con 0x56016ff8b710 2024-04-20T12:27:01.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc2697fa640 10 client.16917 handle_command_reply: tid=0 2024-04-20T12:27:01.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc28aa16740 1 client.16917 shutdown 2024-04-20T12:27:01.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc28aa16740 1 -- 172.21.15.135:0/3912405416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0ae10 msgr2=0x56016ff0e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc28aa16740 1 --2- 172.21.15.135:0/3912405416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0ae10 0x56016ff0e800 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00b800 tx=0x7fc27c00bda0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc28aa16740 1 -- 172.21.15.135:0/3912405416 shutdown_connections 2024-04-20T12:27:01.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc28aa16740 1 --2- 172.21.15.135:0/3912405416 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56016ff8b710 0x56016ff8db70 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc28aa16740 1 --2- 172.21.15.135:0/3912405416 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56016ff14310 0x56016ff89850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc2697fa640 0 client.16917 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:27:01.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc28aa16740 1 --2- 172.21.15.135:0/3912405416 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56016ff0b730 0x56016ff0ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc28aa16740 1 --2- 172.21.15.135:0/3912405416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56016ff0ae10 0x56016ff0e800 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc28aa16740 1 -- 172.21.15.135:0/3912405416 >> 172.21.15.135:0/3912405416 conn(0x56016ff05540 msgr2=0x56016ff0fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc28aa16740 1 -- 172.21.15.135:0/3912405416 shutdown_connections 2024-04-20T12:27:01.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc28aa16740 1 -- 172.21.15.135:0/3912405416 wait complete. 2024-04-20T12:27:01.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.710+0000 7fc28aa16740 20 client.16917 trim_cache size 0 max 16384 2024-04-20T12:27:01.718 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:27:01.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.711+0000 7fc287e2e640 1 -- 172.21.15.135:0/3962361154 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc26c0a3d20 msgr2=0x7fc26c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.711+0000 7fc287e2e640 1 --2- 172.21.15.135:0/3962361154 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc26c0a3d20 0x7fc26c0a61e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc278032530 tx=0x7fc278048000 comp rx=0 tx=0).stop 2024-04-20T12:27:01.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.711+0000 7fc287e2e640 1 -- 172.21.15.135:0/3962361154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc280101a50 msgr2=0x7fc28019e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.711+0000 7fc287e2e640 1 --2- 172.21.15.135:0/3962361154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc280101a50 0x7fc28019e940 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc27000c920 tx=0x7fc27000cde0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.711+0000 7fc287e2e640 1 -- 172.21.15.135:0/3962361154 shutdown_connections 2024-04-20T12:27:01.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.711+0000 7fc287e2e640 1 --2- 172.21.15.135:0/3962361154 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc26c0a3d20 0x7fc26c0a61e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.719 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.711+0000 7fc287e2e640 1 --2- 172.21.15.135:0/3962361154 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc280105de0 0x7fc2801985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.711+0000 7fc287e2e640 1 --2- 172.21.15.135:0/3962361154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc280101a50 0x7fc28019e940 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.711+0000 7fc287e2e640 1 --2- 172.21.15.135:0/3962361154 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc2801010b0 0x7fc28019e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.711+0000 7fc287e2e640 1 -- 172.21.15.135:0/3962361154 >> 172.21.15.135:0/3962361154 conn(0x7fc280077c50 msgr2=0x7fc2800fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.711+0000 7fc287e2e640 1 -- 172.21.15.135:0/3962361154 shutdown_connections 2024-04-20T12:27:01.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.711+0000 7fc287e2e640 1 -- 172.21.15.135:0/3962361154 wait complete. 2024-04-20T12:27:01.721 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:27:01.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.821+0000 7fa4d9881640 1 -- 172.21.15.135:0/2872343058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d4100fe0 msgr2=0x7fa4d410d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.821+0000 7fa4d9881640 1 --2- 172.21.15.135:0/2872343058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d4100fe0 0x7fa4d410d450 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400aa10 tx=0x7fa4c402cf70 comp rx=0 tx=0).stop 2024-04-20T12:27:01.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.821+0000 7fa4d9881640 1 -- 172.21.15.135:0/2872343058 shutdown_connections 2024-04-20T12:27:01.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.821+0000 7fa4d9881640 1 --2- 172.21.15.135:0/2872343058 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d4100fe0 0x7fa4d410d450 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.821+0000 7fa4d9881640 1 --2- 172.21.15.135:0/2872343058 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4d4100620 0x7fa4d4100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.821+0000 7fa4d9881640 1 --2- 172.21.15.135:0/2872343058 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d4106690 0x7fa4d4106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.821+0000 7fa4d9881640 1 -- 172.21.15.135:0/2872343058 >> 172.21.15.135:0/2872343058 conn(0x7fa4d4077370 msgr2=0x7fa4d40fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.821+0000 7fa4d9881640 1 -- 172.21.15.135:0/2872343058 shutdown_connections 2024-04-20T12:27:01.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.821+0000 7fa4d9881640 1 -- 172.21.15.135:0/2872343058 wait complete. 2024-04-20T12:27:01.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.822+0000 7fa4d9881640 1 Processor -- start 2024-04-20T12:27:01.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.822+0000 7fa4d9881640 1 -- start start 2024-04-20T12:27:01.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.822+0000 7fa4d9881640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d4100620 0x7fa4d4198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.822+0000 7fa4d9881640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4d4100fe0 0x7fa4d4198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.822+0000 7fa4d9881640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d4106690 0x7fa4d419cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.822+0000 7fa4d9881640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d4110110 con 0x7fa4d4106690 2024-04-20T12:27:01.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.822+0000 7fa4d9881640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d410ff90 con 0x7fa4d4100fe0 2024-04-20T12:27:01.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.822+0000 7fa4d9881640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d4110290 con 0x7fa4d4100620 2024-04-20T12:27:01.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.822+0000 7fa4d37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d4106690 0x7fa4d419cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.822+0000 7fa4d37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d4106690 0x7fa4d419cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39938/0 (socket says 172.21.15.135:39938) 2024-04-20T12:27:01.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.822+0000 7fa4d37fe640 1 -- 172.21.15.135:0/512612493 learned_addr learned my addr 172.21.15.135:0/512612493 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.822+0000 7fa4d27fc640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4d4100fe0 0x7fa4d4198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.822+0000 7fa4d2ffd640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d4100620 0x7fa4d4198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.823+0000 7fa4d37fe640 1 -- 172.21.15.135:0/512612493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d4100620 msgr2=0x7fa4d4198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.823+0000 7fa4d37fe640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d4100620 0x7fa4d4198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.823+0000 7fa4d37fe640 1 -- 172.21.15.135:0/512612493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4d4100fe0 msgr2=0x7fa4d4198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.823+0000 7fa4d37fe640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4d4100fe0 0x7fa4d4198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.823+0000 7fa4d37fe640 1 -- 172.21.15.135:0/512612493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d419d700 con 0x7fa4d4106690 2024-04-20T12:27:01.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.823+0000 7fa4d2ffd640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d4100620 0x7fa4d4198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:27:01.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.823+0000 7fa4d27fc640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4d4100fe0 0x7fa4d4198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:01.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.823+0000 7fa4d37fe640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d4106690 0x7fa4d419cfd0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4005940 tx=0x7fa4c4035ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.823+0000 7fa4d887f640 1 -- 172.21.15.135:0/512612493 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4004450 con 0x7fa4d4106690 2024-04-20T12:27:01.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.823+0000 7fa4d9881640 1 -- 172.21.15.135:0/512612493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d419d990 con 0x7fa4d4106690 2024-04-20T12:27:01.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.823+0000 7fa4d887f640 1 -- 172.21.15.135:0/512612493 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4c4043070 con 0x7fa4d4106690 2024-04-20T12:27:01.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.823+0000 7fa4d887f640 1 -- 172.21.15.135:0/512612493 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40035f0 con 0x7fa4d4106690 2024-04-20T12:27:01.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.823+0000 7fa4d9881640 1 -- 172.21.15.135:0/512612493 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d41a5280 con 0x7fa4d4106690 2024-04-20T12:27:01.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.826+0000 7fa4dc478740 1 Processor -- start 2024-04-20T12:27:01.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.826+0000 7fa4d887f640 1 -- 172.21.15.135:0/512612493 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fa4c4004e40 con 0x7fa4d4106690 2024-04-20T12:27:01.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.826+0000 7fa4dc478740 1 -- start start 2024-04-20T12:27:01.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.826+0000 7fa4dc478740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 0x55f2564051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.826+0000 7fa4dc478740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f256405730 0x55f25640ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.826+0000 7fa4dc478740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f25640e310 0x55f256410700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.826+0000 7fa4dc478740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f25636a110 con 0x55f256405730 2024-04-20T12:27:01.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.826+0000 7fa4dc478740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f256307550 con 0x55f25640e310 2024-04-20T12:27:01.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.826+0000 7fa4dc478740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f2563660d0 con 0x55f256404e10 2024-04-20T12:27:01.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.826+0000 7fa4d2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f256405730 0x55f25640ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.826+0000 7fa4d2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f256405730 0x55f25640ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39942/0 (socket says 172.21.15.135:39942) 2024-04-20T12:27:01.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.826+0000 7fa4d2ffd640 1 -- 172.21.15.135:0/4027102902 learned_addr learned my addr 172.21.15.135:0/4027102902 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.826+0000 7fa4d27fc640 1 --2- 172.21.15.135:0/4027102902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 0x55f2564051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.827+0000 7fa4d2ffd640 1 -- 172.21.15.135:0/4027102902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 msgr2=0x55f2564051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.827+0000 7fa4d2ffd640 1 --2- 172.21.15.135:0/4027102902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 0x55f2564051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.827+0000 7fa4d2ffd640 1 -- 172.21.15.135:0/4027102902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f25640e310 msgr2=0x55f256410700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.827+0000 7fa4d2ffd640 1 --2- 172.21.15.135:0/4027102902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f25640e310 0x55f256410700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.827+0000 7fa4d2ffd640 1 -- 172.21.15.135:0/4027102902 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f25632f900 con 0x55f256405730 2024-04-20T12:27:01.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.827+0000 7fa4d27fc640 1 --2- 172.21.15.135:0/4027102902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 0x55f2564051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:01.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.827+0000 7fa4d887f640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa4bc0a3d20 0x7fa4bc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.827+0000 7fa4d2ffd640 1 --2- 172.21.15.135:0/4027102902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f256405730 0x55f25640ddd0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009c60 tx=0x7fa4cc010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbec5946441e19a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.827+0000 7fa4d27fc640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa4bc0a3d20 0x7fa4bc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.827+0000 7fa4d887f640 1 -- 172.21.15.135:0/512612493 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fa4c40f2ea0 con 0x7fa4d4106690 2024-04-20T12:27:01.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.827+0000 7fa4b9ffb640 1 -- 172.21.15.135:0/4027102902 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc005020 con 0x55f256405730 2024-04-20T12:27:01.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.827+0000 7fa4b9ffb640 1 -- 172.21.15.135:0/4027102902 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4cc0047a0 con 0x55f256405730 2024-04-20T12:27:01.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.827+0000 7fa4b9ffb640 1 -- 172.21.15.135:0/4027102902 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc0126b0 con 0x55f256405730 2024-04-20T12:27:01.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.828+0000 7fa4dc478740 1 -- 172.21.15.135:0/4027102902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f256405730 msgr2=0x55f25640ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.828+0000 7fa4d27fc640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa4bc0a3d20 0x7fa4bc0a61e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55f2564006d0 tx=0x7fa4c80099c0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.828+0000 7fa4dc478740 1 --2- 172.21.15.135:0/4027102902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f256405730 0x55f25640ddd0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc009c60 tx=0x7fa4cc010740 comp rx=0 tx=0).stop 2024-04-20T12:27:01.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.828+0000 7fa4dc478740 1 -- 172.21.15.135:0/4027102902 shutdown_connections 2024-04-20T12:27:01.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.828+0000 7fa4dc478740 1 --2- 172.21.15.135:0/4027102902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f25640e310 0x55f256410700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.828+0000 7fa4dc478740 1 --2- 172.21.15.135:0/4027102902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f256405730 0x55f25640ddd0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.828+0000 7fa4dc478740 1 --2- 172.21.15.135:0/4027102902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 0x55f2564051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.828+0000 7fa4dc478740 1 -- 172.21.15.135:0/4027102902 >> 172.21.15.135:0/4027102902 conn(0x55f2563ff540 msgr2=0x55f2563ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.828+0000 7fa4dc478740 1 -- 172.21.15.135:0/4027102902 shutdown_connections 2024-04-20T12:27:01.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.828+0000 7fa4dc478740 1 -- 172.21.15.135:0/4027102902 wait complete. 2024-04-20T12:27:01.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.828+0000 7fa4dc478740 1 -- start start 2024-04-20T12:27:01.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.828+0000 7fa4dc478740 1 Processor -- start 2024-04-20T12:27:01.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4dc478740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 0x55f25640b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4dc478740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f256405730 0x55f25640b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4dc478740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f25640e310 0x55f25640be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4dc478740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f256411100 con 0x55f25640e310 2024-04-20T12:27:01.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4dc478740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f256323500 con 0x55f256405730 2024-04-20T12:27:01.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4dc478740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f256411280 con 0x55f256404e10 2024-04-20T12:27:01.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4dc478740 10 client.0 _ll_register_callbacks cb 0x55f2563082f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:01.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4d37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f25640e310 0x55f25640be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4d37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f25640e310 0x55f25640be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39954/0 (socket says 172.21.15.135:39954) 2024-04-20T12:27:01.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4d37fe640 1 -- 172.21.15.135:0/3149509786 learned_addr learned my addr 172.21.15.135:0/3149509786 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4d27fc640 1 --2- 172.21.15.135:0/3149509786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f256405730 0x55f25640b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4d2ffd640 1 --2- 172.21.15.135:0/3149509786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 0x55f25640b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4d37fe640 1 -- 172.21.15.135:0/3149509786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 msgr2=0x55f25640b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4d37fe640 1 --2- 172.21.15.135:0/3149509786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 0x55f25640b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4d37fe640 1 -- 172.21.15.135:0/3149509786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f256405730 msgr2=0x55f25640b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4d37fe640 1 --2- 172.21.15.135:0/3149509786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f256405730 0x55f25640b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4d37fe640 1 -- 172.21.15.135:0/3149509786 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f25607c3f0 con 0x55f25640e310 2024-04-20T12:27:01.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4d37fe640 1 --2- 172.21.15.135:0/3149509786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f25640e310 0x55f25640be50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40c72b0 tx=0x7fa4c40be770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181423a3c40f93c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:01.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4b2ffd640 1 -- 172.21.15.135:0/3149509786 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4033340 con 0x55f25640e310 2024-04-20T12:27:01.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4b2ffd640 1 -- 172.21.15.135:0/3149509786 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fa4c40bb1e0 con 0x55f25640e310 2024-04-20T12:27:01.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4dc478740 1 -- 172.21.15.135:0/3149509786 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4cc0047a0 con 0x55f25640e310 2024-04-20T12:27:01.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4b2ffd640 1 -- 172.21.15.135:0/3149509786 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa4c40bf270 con 0x55f25640e310 2024-04-20T12:27:01.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4dc478740 10 client.16929 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:01.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.829+0000 7fa4dc478740 1 -- 172.21.15.135:0/3149509786 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f2561467d0 con 0x55f25640e310 2024-04-20T12:27:01.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.830+0000 7fa4b2ffd640 1 -- 172.21.15.135:0/3149509786 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4cc0047a0 con 0x55f25640e310 2024-04-20T12:27:01.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.830+0000 7fa4b2ffd640 1 -- 172.21.15.135:0/3149509786 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fa4c40d9070 con 0x55f25640e310 2024-04-20T12:27:01.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.830+0000 7fa4dc478740 10 client.16929 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:01.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.830+0000 7fa4dc478740 10 client.16929 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:27:01.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.830+0000 7fa4dc478740 20 client.16929 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:01.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.830+0000 7fa4dc478740 1 --2- 172.21.15.135:0/3149509786 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55f25641e5f0 0x55f256420a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.830+0000 7fa4dc478740 4 client.16929 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:01.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.830+0000 7fa4dc478740 1 -- 172.21.15.135:0/3149509786 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f256377b30 con 0x55f25641e5f0 2024-04-20T12:27:01.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.830+0000 7fa4d2ffd640 1 --2- 172.21.15.135:0/3149509786 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55f25641e5f0 0x55f256420a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.830+0000 7fa4b2ffd640 10 client.16929 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:27:01.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.830+0000 7fa4d2ffd640 1 --2- 172.21.15.135:0/3149509786 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55f25641e5f0 0x55f256420a00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8de897050a85938d server_cookie=cbd1e969d5221833 in_seq=0 out_seq=0 2024-04-20T12:27:01.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.831+0000 7fa4b2ffd640 1 -- 172.21.15.135:0/3149509786 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f256377b30 con 0x55f25641e5f0 2024-04-20T12:27:01.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.831+0000 7fa4b2ffd640 10 client.16929 handle_command_reply: tid=0 2024-04-20T12:27:01.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.831+0000 7fa4dc478740 1 client.16929 shutdown 2024-04-20T12:27:01.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.831+0000 7fa4dc478740 1 -- 172.21.15.135:0/3149509786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f25640e310 msgr2=0x55f25640be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.831+0000 7fa4dc478740 1 --2- 172.21.15.135:0/3149509786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f25640e310 0x55f25640be50 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40c72b0 tx=0x7fa4c40be770 comp rx=0 tx=0).stop 2024-04-20T12:27:01.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.831+0000 7fa4dc478740 1 -- 172.21.15.135:0/3149509786 shutdown_connections 2024-04-20T12:27:01.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.831+0000 7fa4dc478740 1 --2- 172.21.15.135:0/3149509786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f25640e310 0x55f25640be50 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.831+0000 7fa4dc478740 1 --2- 172.21.15.135:0/3149509786 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f256405730 0x55f25640b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.831+0000 7fa4dc478740 1 --2- 172.21.15.135:0/3149509786 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55f25641e5f0 0x55f256420a00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.831+0000 7fa4dc478740 1 --2- 172.21.15.135:0/3149509786 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 0x55f25640b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.831+0000 7fa4b2ffd640 0 client.16929 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:27:01.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.831+0000 7fa4dc478740 1 -- 172.21.15.135:0/3149509786 >> 172.21.15.135:0/3149509786 conn(0x55f2563ff540 msgr2=0x55f256401290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.831+0000 7fa4dc478740 1 -- 172.21.15.135:0/3149509786 shutdown_connections 2024-04-20T12:27:01.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.831+0000 7fa4dc478740 1 -- 172.21.15.135:0/3149509786 wait complete. 2024-04-20T12:27:01.840 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.832+0000 7fa4dc478740 20 client.16929 trim_cache size 0 max 16384 2024-04-20T12:27:01.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4dc478740 1 Processor -- start 2024-04-20T12:27:01.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4dc478740 1 -- start start 2024-04-20T12:27:01.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4dc478740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 0x55f25640db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4dc478740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f256405730 0x55f256419ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4dc478740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f25640e310 0x55f2564262c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4dc478740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d41af390 con 0x55f25640e310 2024-04-20T12:27:01.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4dc478740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d41b0ed0 con 0x55f256405730 2024-04-20T12:27:01.850 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4dc478740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d41afa60 con 0x55f256404e10 2024-04-20T12:27:01.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4d37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f25640e310 0x55f2564262c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4d37fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f25640e310 0x55f2564262c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39966/0 (socket says 172.21.15.135:39966) 2024-04-20T12:27:01.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4d37fe640 1 -- 172.21.15.135:0/945900159 learned_addr learned my addr 172.21.15.135:0/945900159 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4d2ffd640 1 --2- 172.21.15.135:0/945900159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 0x55f25640db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4d37fe640 1 -- 172.21.15.135:0/945900159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 msgr2=0x55f25640db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4d27fc640 1 --2- 172.21.15.135:0/945900159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f256405730 0x55f256419ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4d37fe640 1 --2- 172.21.15.135:0/945900159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 0x55f25640db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4d37fe640 1 -- 172.21.15.135:0/945900159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f256405730 msgr2=0x55f256419ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4d37fe640 1 --2- 172.21.15.135:0/945900159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f256405730 0x55f256419ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4d37fe640 1 -- 172.21.15.135:0/945900159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f256410a70 con 0x55f25640e310 2024-04-20T12:27:01.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.845+0000 7fa4d37fe640 1 --2- 172.21.15.135:0/945900159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f25640e310 0x55f2564262c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40beb00 tx=0x7fa4c40bea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf369f62d95d20a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.846+0000 7fa4b97fa640 1 -- 172.21.15.135:0/945900159 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40bae10 con 0x55f25640e310 2024-04-20T12:27:01.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.846+0000 7fa4b97fa640 1 -- 172.21.15.135:0/945900159 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4c4035e10 con 0x55f25640e310 2024-04-20T12:27:01.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.846+0000 7fa4b97fa640 1 -- 172.21.15.135:0/945900159 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40bb1e0 con 0x55f25640e310 2024-04-20T12:27:01.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.846+0000 7fa4dc478740 1 -- 172.21.15.135:0/945900159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f25640e310 msgr2=0x55f2564262c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.846+0000 7fa4dc478740 1 --2- 172.21.15.135:0/945900159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f25640e310 0x55f2564262c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40beb00 tx=0x7fa4c40bea40 comp rx=0 tx=0).stop 2024-04-20T12:27:01.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.846+0000 7fa4dc478740 1 -- 172.21.15.135:0/945900159 shutdown_connections 2024-04-20T12:27:01.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.846+0000 7fa4dc478740 1 --2- 172.21.15.135:0/945900159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f25640e310 0x55f2564262c0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.846+0000 7fa4dc478740 1 --2- 172.21.15.135:0/945900159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f256405730 0x55f256419ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.846+0000 7fa4dc478740 1 --2- 172.21.15.135:0/945900159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256404e10 0x55f25640db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.846+0000 7fa4dc478740 1 -- 172.21.15.135:0/945900159 >> 172.21.15.135:0/945900159 conn(0x55f2563ff540 msgr2=0x55f2563fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.846+0000 7fa4dc478740 1 -- 172.21.15.135:0/945900159 shutdown_connections 2024-04-20T12:27:01.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.846+0000 7fa4dc478740 1 -- 172.21.15.135:0/945900159 wait complete. 2024-04-20T12:27:01.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4dc478740 1 -- start start 2024-04-20T12:27:01.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4dc478740 1 Processor -- start 2024-04-20T12:27:01.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4dc478740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f256404e10 0x55f2564084f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4dc478740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256405730 0x55f256408a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4dc478740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f25640e310 0x55f256483b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4dc478740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d41b0800 con 0x55f256404e10 2024-04-20T12:27:01.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4dc478740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d41b0130 con 0x55f25640e310 2024-04-20T12:27:01.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4dc478740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d41ad360 con 0x55f256405730 2024-04-20T12:27:01.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4dc478740 10 client.0 _ll_register_callbacks cb 0x7fa4c4005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:01.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4d2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f256404e10 0x55f2564084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4d2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f256404e10 0x55f2564084f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39978/0 (socket says 172.21.15.135:39978) 2024-04-20T12:27:01.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4d2ffd640 1 -- 172.21.15.135:0/1395698668 learned_addr learned my addr 172.21.15.135:0/1395698668 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4d37fe640 1 --2- 172.21.15.135:0/1395698668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f25640e310 0x55f256483b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4d2ffd640 1 -- 172.21.15.135:0/1395698668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256405730 msgr2=0x55f256408a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4d2ffd640 1 --2- 172.21.15.135:0/1395698668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256405730 0x55f256408a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4d2ffd640 1 -- 172.21.15.135:0/1395698668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f25640e310 msgr2=0x55f256483b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4d2ffd640 1 --2- 172.21.15.135:0/1395698668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f25640e310 0x55f256483b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4d2ffd640 1 -- 172.21.15.135:0/1395698668 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f256484070 con 0x55f256404e10 2024-04-20T12:27:01.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.847+0000 7fa4d2ffd640 1 --2- 172.21.15.135:0/1395698668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f256404e10 0x55f2564084f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc011010 tx=0x7fa4cc0058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598b622c35894dd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:01.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4b2ffd640 1 -- 172.21.15.135:0/1395698668 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc005450 con 0x55f256404e10 2024-04-20T12:27:01.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4b2ffd640 1 -- 172.21.15.135:0/1395698668 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fa4cc0055f0 con 0x55f256404e10 2024-04-20T12:27:01.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4dc478740 1 -- 172.21.15.135:0/1395698668 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4c4035e10 con 0x55f256404e10 2024-04-20T12:27:01.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4b2ffd640 1 -- 172.21.15.135:0/1395698668 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa4cc009e90 con 0x55f256404e10 2024-04-20T12:27:01.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4dc478740 10 client.16935 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:01.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4dc478740 1 -- 172.21.15.135:0/1395698668 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f256485210 con 0x55f256404e10 2024-04-20T12:27:01.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4b2ffd640 1 -- 172.21.15.135:0/1395698668 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4c4035e10 con 0x55f256404e10 2024-04-20T12:27:01.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4b2ffd640 1 -- 172.21.15.135:0/1395698668 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fa4cc00f040 con 0x55f256404e10 2024-04-20T12:27:01.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4dc478740 10 client.16935 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:01.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4dc478740 10 client.16935 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:27:01.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4dc478740 20 client.16935 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:01.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4dc478740 1 --2- 172.21.15.135:0/1395698668 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55f256485880 0x55f256487ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4dc478740 4 client.16935 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:27:01.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4dc478740 1 -- 172.21.15.135:0/1395698668 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f2563719a0 con 0x55f256485880 2024-04-20T12:27:01.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.848+0000 7fa4d27fc640 1 --2- 172.21.15.135:0/1395698668 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55f256485880 0x55f256487ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4b2ffd640 10 client.16935 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:27:01.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4d27fc640 1 --2- 172.21.15.135:0/1395698668 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55f256485880 0x55f256487ca0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b580d12de249c8aa server_cookie=a6205b7d942e625f in_seq=0 out_seq=0 2024-04-20T12:27:01.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4b2ffd640 1 -- 172.21.15.135:0/1395698668 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f2563719a0 con 0x55f256485880 2024-04-20T12:27:01.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4b2ffd640 10 client.16935 handle_command_reply: tid=0 2024-04-20T12:27:01.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4dc478740 1 client.16935 shutdown 2024-04-20T12:27:01.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4dc478740 1 -- 172.21.15.135:0/1395698668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f256404e10 msgr2=0x55f2564084f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4dc478740 1 --2- 172.21.15.135:0/1395698668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f256404e10 0x55f2564084f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc011010 tx=0x7fa4cc0058d0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4dc478740 1 -- 172.21.15.135:0/1395698668 shutdown_connections 2024-04-20T12:27:01.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4dc478740 1 --2- 172.21.15.135:0/1395698668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f25640e310 0x55f256483b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4dc478740 1 --2- 172.21.15.135:0/1395698668 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55f256485880 0x55f256487ca0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4dc478740 1 --2- 172.21.15.135:0/1395698668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f256405730 0x55f256408a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4dc478740 1 --2- 172.21.15.135:0/1395698668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f256404e10 0x55f2564084f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4b2ffd640 0 client.16935 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:27:01.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4dc478740 1 -- 172.21.15.135:0/1395698668 >> 172.21.15.135:0/1395698668 conn(0x55f2563ff540 msgr2=0x55f25640b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4dc478740 1 -- 172.21.15.135:0/1395698668 shutdown_connections 2024-04-20T12:27:01.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4dc478740 1 -- 172.21.15.135:0/1395698668 wait complete. 2024-04-20T12:27:01.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.849+0000 7fa4dc478740 20 client.16935 trim_cache size 0 max 16384 2024-04-20T12:27:01.856 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:27:01.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.850+0000 7fa4d9881640 1 -- 172.21.15.135:0/512612493 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa4bc0a3d20 msgr2=0x7fa4bc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.850+0000 7fa4d9881640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa4bc0a3d20 0x7fa4bc0a61e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55f2564006d0 tx=0x7fa4c80099c0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.850+0000 7fa4d9881640 1 -- 172.21.15.135:0/512612493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d4106690 msgr2=0x7fa4d419cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.850+0000 7fa4d9881640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d4106690 0x7fa4d419cfd0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4005940 tx=0x7fa4c4035ca0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.850+0000 7fa4d9881640 1 -- 172.21.15.135:0/512612493 shutdown_connections 2024-04-20T12:27:01.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.850+0000 7fa4d9881640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa4d4106690 0x7fa4d419cfd0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.850+0000 7fa4d9881640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa4d4100fe0 0x7fa4d4198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.850+0000 7fa4d9881640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa4bc0a3d20 0x7fa4bc0a61e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.850+0000 7fa4d9881640 1 --2- 172.21.15.135:0/512612493 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa4d4100620 0x7fa4d4198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.850+0000 7fa4d9881640 1 -- 172.21.15.135:0/512612493 >> 172.21.15.135:0/512612493 conn(0x7fa4d4077370 msgr2=0x7fa4d4104770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.850+0000 7fa4d9881640 1 -- 172.21.15.135:0/512612493 shutdown_connections 2024-04-20T12:27:01.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.850+0000 7fa4d9881640 1 -- 172.21.15.135:0/512612493 wait complete. 2024-04-20T12:27:01.860 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:27:01.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.961+0000 7fd339cfb640 1 -- 172.21.15.135:0/2475005285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd334101090 msgr2=0x7fd334101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.961+0000 7fd339cfb640 1 --2- 172.21.15.135:0/2475005285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd334101090 0x7fd334101470 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fd324009900 tx=0x7fd32402bc30 comp rx=0 tx=0).stop 2024-04-20T12:27:01.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.961+0000 7fd339cfb640 1 -- 172.21.15.135:0/2475005285 shutdown_connections 2024-04-20T12:27:01.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.961+0000 7fd339cfb640 1 --2- 172.21.15.135:0/2475005285 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd334106160 0x7fd33410dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.961+0000 7fd339cfb640 1 --2- 172.21.15.135:0/2475005285 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd334101a40 0x7fd334105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.961+0000 7fd339cfb640 1 --2- 172.21.15.135:0/2475005285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd334101090 0x7fd334101470 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.961+0000 7fd339cfb640 1 -- 172.21.15.135:0/2475005285 >> 172.21.15.135:0/2475005285 conn(0x7fd334078010 msgr2=0x7fd334078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.961+0000 7fd339cfb640 1 -- 172.21.15.135:0/2475005285 shutdown_connections 2024-04-20T12:27:01.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.961+0000 7fd339cfb640 1 -- 172.21.15.135:0/2475005285 wait complete. 2024-04-20T12:27:01.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.961+0000 7fd339cfb640 1 Processor -- start 2024-04-20T12:27:01.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.961+0000 7fd339cfb640 1 -- start start 2024-04-20T12:27:01.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd339cfb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd334101090 0x7fd334199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd339cfb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd334106160 0x7fd334199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd339cfb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33419a120 0x7fd3341a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd339cfb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341111f0 con 0x7fd33419a120 2024-04-20T12:27:01.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd339cfb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd334111070 con 0x7fd334106160 2024-04-20T12:27:01.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd339cfb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd334111370 con 0x7fd334101090 2024-04-20T12:27:01.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd333fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33419a120 0x7fd3341a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd333fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33419a120 0x7fd3341a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39998/0 (socket says 172.21.15.135:39998) 2024-04-20T12:27:01.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd333fff640 1 -- 172.21.15.135:0/586699201 learned_addr learned my addr 172.21.15.135:0/586699201 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd3337fe640 1 --2- 172.21.15.135:0/586699201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd334101090 0x7fd334199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd32bfff640 1 --2- 172.21.15.135:0/586699201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd334106160 0x7fd334199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd333fff640 1 -- 172.21.15.135:0/586699201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd334101090 msgr2=0x7fd334199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd333fff640 1 --2- 172.21.15.135:0/586699201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd334101090 0x7fd334199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd333fff640 1 -- 172.21.15.135:0/586699201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd334106160 msgr2=0x7fd334199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd333fff640 1 --2- 172.21.15.135:0/586699201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd334106160 0x7fd334199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd333fff640 1 -- 172.21.15.135:0/586699201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3341a4ea0 con 0x7fd33419a120 2024-04-20T12:27:01.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd32bfff640 1 --2- 172.21.15.135:0/586699201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd334106160 0x7fd334199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:01.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd333fff640 1 --2- 172.21.15.135:0/586699201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33419a120 0x7fd3341a46d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009fd0 tx=0x7fd32c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd3317fa640 1 -- 172.21.15.135:0/586699201 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c017070 con 0x7fd33419a120 2024-04-20T12:27:01.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd3317fa640 1 -- 172.21.15.135:0/586699201 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd32c003e50 con 0x7fd33419a120 2024-04-20T12:27:01.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd339cfb640 1 -- 172.21.15.135:0/586699201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3341a5190 con 0x7fd33419a120 2024-04-20T12:27:01.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd3317fa640 1 -- 172.21.15.135:0/586699201 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c0106c0 con 0x7fd33419a120 2024-04-20T12:27:01.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.962+0000 7fd339cfb640 1 -- 172.21.15.135:0/586699201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3341a56e0 con 0x7fd33419a120 2024-04-20T12:27:01.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd3317fa640 1 -- 172.21.15.135:0/586699201 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fd32c003970 con 0x7fd33419a120 2024-04-20T12:27:01.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd33c9c5740 1 Processor -- start 2024-04-20T12:27:01.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd33c9c5740 1 -- start start 2024-04-20T12:27:01.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd33c9c5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0ee10 0x5563aca0f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd33c9c5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0f730 0x5563aca17dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd3317fa640 1 --2- 172.21.15.135:0/586699201 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3200a3da0 0x7fd3200a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd33c9c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca1a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd33c9c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5563ac974110 con 0x5563aca18310 2024-04-20T12:27:01.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd33c9c5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5563ac911550 con 0x5563aca0ee10 2024-04-20T12:27:01.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd33c9c5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5563ac9700d0 con 0x5563aca0f730 2024-04-20T12:27:01.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd333fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca1a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd333fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca1a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40012/0 (socket says 172.21.15.135:40012) 2024-04-20T12:27:01.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd3337fe640 1 --2- 172.21.15.135:0/586699201 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3200a3da0 0x7fd3200a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd333fff640 1 -- 172.21.15.135:0/3909246241 learned_addr learned my addr 172.21.15.135:0/3909246241 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd32bfff640 1 --2- 172.21.15.135:0/3909246241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0ee10 0x5563aca0f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd32bfff640 1 --2- 172.21.15.135:0/3909246241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0f730 0x5563aca17dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.965+0000 7fd3317fa640 1 -- 172.21.15.135:0/586699201 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fd32c0d0820 con 0x7fd33419a120 2024-04-20T12:27:01.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.966+0000 7fd333fff640 1 -- 172.21.15.135:0/3909246241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0f730 msgr2=0x5563aca17dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.966+0000 7fd333fff640 1 --2- 172.21.15.135:0/3909246241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0f730 0x5563aca17dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.966+0000 7fd333fff640 1 -- 172.21.15.135:0/3909246241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0ee10 msgr2=0x5563aca0f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.966+0000 7fd333fff640 1 --2- 172.21.15.135:0/3909246241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0ee10 0x5563aca0f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.966+0000 7fd333fff640 1 -- 172.21.15.135:0/3909246241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563ac939900 con 0x5563aca18310 2024-04-20T12:27:01.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.966+0000 7fd32bfff640 1 --2- 172.21.15.135:0/3909246241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0ee10 0x5563aca0f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:27:01.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.966+0000 7fd3337fe640 1 --2- 172.21.15.135:0/586699201 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3200a3da0 0x7fd3200a6260 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd324006010 tx=0x7fd324005dd0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.966+0000 7fd333fff640 1 --2- 172.21.15.135:0/3909246241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca1a700 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd32c098e10 tx=0x7fd32c06de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652d6f307f09a58c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.966+0000 7fd329ffb640 1 -- 172.21.15.135:0/3909246241 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c020040 con 0x5563aca18310 2024-04-20T12:27:01.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.966+0000 7fd329ffb640 1 -- 172.21.15.135:0/3909246241 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd32c085980 con 0x5563aca18310 2024-04-20T12:27:01.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.966+0000 7fd329ffb640 1 -- 172.21.15.135:0/3909246241 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c09c440 con 0x5563aca18310 2024-04-20T12:27:01.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 -- 172.21.15.135:0/3909246241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 msgr2=0x5563aca1a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/3909246241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca1a700 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd32c098e10 tx=0x7fd32c06de80 comp rx=0 tx=0).stop 2024-04-20T12:27:01.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 -- 172.21.15.135:0/3909246241 shutdown_connections 2024-04-20T12:27:01.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/3909246241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca1a700 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/3909246241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0f730 0x5563aca17dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/3909246241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0ee10 0x5563aca0f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 -- 172.21.15.135:0/3909246241 >> 172.21.15.135:0/3909246241 conn(0x5563aca09540 msgr2=0x5563aca09920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 -- 172.21.15.135:0/3909246241 shutdown_connections 2024-04-20T12:27:01.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 -- 172.21.15.135:0/3909246241 wait complete. 2024-04-20T12:27:01.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 -- start start 2024-04-20T12:27:01.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 Processor -- start 2024-04-20T12:27:01.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0ee10 0x5563aca15440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0f730 0x5563aca15980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca15ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5563aca1b0a0 con 0x5563aca18310 2024-04-20T12:27:01.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5563ac92d500 con 0x5563aca0f730 2024-04-20T12:27:01.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5563aca1b220 con 0x5563aca0ee10 2024-04-20T12:27:01.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.967+0000 7fd33c9c5740 10 client.0 _ll_register_callbacks cb 0x5563ac9122f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:01.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd333fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca15ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd333fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca15ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40028/0 (socket says 172.21.15.135:40028) 2024-04-20T12:27:01.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd333fff640 1 -- 172.21.15.135:0/2965336395 learned_addr learned my addr 172.21.15.135:0/2965336395 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd32bfff640 1 --2- 172.21.15.135:0/2965336395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0f730 0x5563aca15980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd3337fe640 1 --2- 172.21.15.135:0/2965336395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0ee10 0x5563aca15440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd333fff640 1 -- 172.21.15.135:0/2965336395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0ee10 msgr2=0x5563aca15440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd333fff640 1 --2- 172.21.15.135:0/2965336395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0ee10 0x5563aca15440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd333fff640 1 -- 172.21.15.135:0/2965336395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0f730 msgr2=0x5563aca15980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd333fff640 1 --2- 172.21.15.135:0/2965336395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0f730 0x5563aca15980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd333fff640 1 -- 172.21.15.135:0/2965336395 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563ac6863f0 con 0x5563aca18310 2024-04-20T12:27:01.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd333fff640 1 --2- 172.21.15.135:0/2965336395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca15ec0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd32c012040 tx=0x7fd32c0044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a5215437ca993a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd312ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:01.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd312ffd640 1 -- 172.21.15.135:0/2965336395 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c020070 con 0x5563aca18310 2024-04-20T12:27:01.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd312ffd640 1 -- 172.21.15.135:0/2965336395 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fd32c098ab0 con 0x5563aca18310 2024-04-20T12:27:01.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2965336395 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd32c085980 con 0x5563aca18310 2024-04-20T12:27:01.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd312ffd640 1 -- 172.21.15.135:0/2965336395 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd32c09cb40 con 0x5563aca18310 2024-04-20T12:27:01.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd33c9c5740 10 client.16947 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:01.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2965336395 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5563ac7507d0 con 0x5563aca18310 2024-04-20T12:27:01.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd312ffd640 1 -- 172.21.15.135:0/2965336395 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd32c085980 con 0x5563aca18310 2024-04-20T12:27:01.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.968+0000 7fd312ffd640 1 -- 172.21.15.135:0/2965336395 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fd32c0d0480 con 0x5563aca18310 2024-04-20T12:27:01.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.969+0000 7fd33c9c5740 10 client.16947 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:01.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.969+0000 7fd33c9c5740 10 client.16947 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:27:01.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.969+0000 7fd33c9c5740 20 client.16947 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:01.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.969+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/2965336395 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5563aca28580 0x5563aca2a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.969+0000 7fd33c9c5740 4 client.16947 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:01.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.969+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2965336395 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563ac981b30 con 0x5563aca28580 2024-04-20T12:27:01.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.969+0000 7fd3337fe640 1 --2- 172.21.15.135:0/2965336395 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5563aca28580 0x5563aca2a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.969+0000 7fd3337fe640 1 --2- 172.21.15.135:0/2965336395 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5563aca28580 0x5563aca2a970 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=793e32a25fe58f15 server_cookie=2074e376b2300858 in_seq=0 out_seq=0 2024-04-20T12:27:01.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.969+0000 7fd312ffd640 10 client.16947 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:27:01.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.970+0000 7fd312ffd640 1 -- 172.21.15.135:0/2965336395 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5563ac981b30 con 0x5563aca28580 2024-04-20T12:27:01.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.970+0000 7fd312ffd640 10 client.16947 handle_command_reply: tid=0 2024-04-20T12:27:01.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.970+0000 7fd33c9c5740 1 client.16947 shutdown 2024-04-20T12:27:01.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.970+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2965336395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 msgr2=0x5563aca15ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.970+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/2965336395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca15ec0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd32c012040 tx=0x7fd32c0044b0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.970+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2965336395 shutdown_connections 2024-04-20T12:27:01.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.970+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/2965336395 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5563aca28580 0x5563aca2a970 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.970+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/2965336395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca15ec0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.970+0000 7fd312ffd640 0 client.16947 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:27:01.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.970+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/2965336395 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0f730 0x5563aca15980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.970+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/2965336395 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0ee10 0x5563aca15440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.970+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2965336395 >> 172.21.15.135:0/2965336395 conn(0x5563aca09540 msgr2=0x5563aca0b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.970+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2965336395 shutdown_connections 2024-04-20T12:27:01.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.970+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2965336395 wait complete. 2024-04-20T12:27:01.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.970+0000 7fd33c9c5740 20 client.16947 trim_cache size 0 max 16384 2024-04-20T12:27:01.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.983+0000 7fd33c9c5740 1 Processor -- start 2024-04-20T12:27:01.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.983+0000 7fd33c9c5740 1 -- start start 2024-04-20T12:27:01.988 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.983+0000 7fd33c9c5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0ee10 0x5563aca23f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.983+0000 7fd33c9c5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0f730 0x5563aca20850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.983+0000 7fd33c9c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca2ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.983+0000 7fd33c9c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341af360 con 0x5563aca18310 2024-04-20T12:27:01.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.983+0000 7fd33c9c5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341b0ea0 con 0x5563aca0ee10 2024-04-20T12:27:01.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.983+0000 7fd33c9c5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341afa30 con 0x5563aca0f730 2024-04-20T12:27:01.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.983+0000 7fd333fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca2ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.983+0000 7fd333fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca2ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40030/0 (socket says 172.21.15.135:40030) 2024-04-20T12:27:01.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.983+0000 7fd333fff640 1 -- 172.21.15.135:0/4275636110 learned_addr learned my addr 172.21.15.135:0/4275636110 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.984+0000 7fd333fff640 1 -- 172.21.15.135:0/4275636110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0f730 msgr2=0x5563aca20850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.984+0000 7fd3337fe640 1 --2- 172.21.15.135:0/4275636110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0ee10 0x5563aca23f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.984+0000 7fd32bfff640 1 --2- 172.21.15.135:0/4275636110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0f730 0x5563aca20850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.984+0000 7fd333fff640 1 --2- 172.21.15.135:0/4275636110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0f730 0x5563aca20850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.989 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.984+0000 7fd333fff640 1 -- 172.21.15.135:0/4275636110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0ee10 msgr2=0x5563aca23f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.984+0000 7fd333fff640 1 --2- 172.21.15.135:0/4275636110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0ee10 0x5563aca23f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.984+0000 7fd333fff640 1 -- 172.21.15.135:0/4275636110 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563aca17b70 con 0x5563aca18310 2024-04-20T12:27:01.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.984+0000 7fd3337fe640 1 --2- 172.21.15.135:0/4275636110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0ee10 0x5563aca23f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:27:01.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.984+0000 7fd333fff640 1 --2- 172.21.15.135:0/4275636110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca2ff40 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd32c005c40 tx=0x7fd32c004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83bba3cd194dd65 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.984+0000 7fd3297fa640 1 -- 172.21.15.135:0/4275636110 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c06b070 con 0x5563aca18310 2024-04-20T12:27:01.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.984+0000 7fd3297fa640 1 -- 172.21.15.135:0/4275636110 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd32c0a07f0 con 0x5563aca18310 2024-04-20T12:27:01.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.984+0000 7fd3297fa640 1 -- 172.21.15.135:0/4275636110 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c020070 con 0x5563aca18310 2024-04-20T12:27:01.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 -- 172.21.15.135:0/4275636110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 msgr2=0x5563aca2ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/4275636110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca2ff40 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fd32c005c40 tx=0x7fd32c004850 comp rx=0 tx=0).stop 2024-04-20T12:27:01.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 -- 172.21.15.135:0/4275636110 shutdown_connections 2024-04-20T12:27:01.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/4275636110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca18310 0x5563aca2ff40 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/4275636110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0f730 0x5563aca20850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/4275636110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca0ee10 0x5563aca23f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 -- 172.21.15.135:0/4275636110 >> 172.21.15.135:0/4275636110 conn(0x5563aca09540 msgr2=0x5563aca04570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 -- 172.21.15.135:0/4275636110 shutdown_connections 2024-04-20T12:27:01.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 -- 172.21.15.135:0/4275636110 wait complete. 2024-04-20T12:27:01.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 -- start start 2024-04-20T12:27:01.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 Processor -- start 2024-04-20T12:27:01.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0ee10 0x5563aca120b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca0f730 0x5563aca125f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca18310 0x5563aca897a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341b07d0 con 0x5563aca0f730 2024-04-20T12:27:01.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341b0100 con 0x5563aca18310 2024-04-20T12:27:01.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341ad330 con 0x5563aca0ee10 2024-04-20T12:27:01.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd33c9c5740 10 client.0 _ll_register_callbacks cb 0x7fd31c00ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:01.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.985+0000 7fd32bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca0f730 0x5563aca125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd32bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca0f730 0x5563aca125f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40038/0 (socket says 172.21.15.135:40038) 2024-04-20T12:27:01.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd32bfff640 1 -- 172.21.15.135:0/2996992487 learned_addr learned my addr 172.21.15.135:0/2996992487 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:01.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd3337fe640 1 --2- 172.21.15.135:0/2996992487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0ee10 0x5563aca120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd32bfff640 1 -- 172.21.15.135:0/2996992487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0ee10 msgr2=0x5563aca120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd333fff640 1 --2- 172.21.15.135:0/2996992487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca18310 0x5563aca897a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd32bfff640 1 --2- 172.21.15.135:0/2996992487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0ee10 0x5563aca120b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd32bfff640 1 -- 172.21.15.135:0/2996992487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca18310 msgr2=0x5563aca897a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:01.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd32bfff640 1 --2- 172.21.15.135:0/2996992487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca18310 0x5563aca897a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd32bfff640 1 -- 172.21.15.135:0/2996992487 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563aca89de0 con 0x5563aca0f730 2024-04-20T12:27:01.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd3337fe640 1 --2- 172.21.15.135:0/2996992487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0ee10 0x5563aca120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:27:01.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd333fff640 1 --2- 172.21.15.135:0/2996992487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca18310 0x5563aca897a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:27:01.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd32bfff640 1 --2- 172.21.15.135:0/2996992487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca0f730 0x5563aca125f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fd334069c40 tx=0x7fd31c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61655699029cff60 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:01.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd312ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:01.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd312ffd640 1 -- 172.21.15.135:0/2996992487 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c005020 con 0x5563aca0f730 2024-04-20T12:27:01.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2996992487 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd32c0a07f0 con 0x5563aca0f730 2024-04-20T12:27:01.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd312ffd640 1 -- 172.21.15.135:0/2996992487 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fd31c0051c0 con 0x5563aca0f730 2024-04-20T12:27:01.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd312ffd640 1 -- 172.21.15.135:0/2996992487 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd31c029050 con 0x5563aca0f730 2024-04-20T12:27:01.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd33c9c5740 10 client.16953 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:01.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2996992487 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5563aca92340 con 0x5563aca0f730 2024-04-20T12:27:01.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.986+0000 7fd312ffd640 1 -- 172.21.15.135:0/2996992487 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd32c0a07f0 con 0x5563aca0f730 2024-04-20T12:27:01.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.987+0000 7fd312ffd640 1 -- 172.21.15.135:0/2996992487 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fd31c014470 con 0x5563aca0f730 2024-04-20T12:27:01.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.987+0000 7fd33c9c5740 10 client.16953 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:01.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.987+0000 7fd33c9c5740 10 client.16953 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:27:01.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.987+0000 7fd33c9c5740 20 client.16953 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:01.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.987+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/2996992487 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5563aca92b20 0x5563aca94f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:01.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.987+0000 7fd33c9c5740 4 client.16953 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:27:01.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.987+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2996992487 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5563ac97b9a0 con 0x5563aca92b20 2024-04-20T12:27:01.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.987+0000 7fd3337fe640 1 --2- 172.21.15.135:0/2996992487 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5563aca92b20 0x5563aca94f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:01.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.987+0000 7fd312ffd640 10 client.16953 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:27:01.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.987+0000 7fd3337fe640 1 --2- 172.21.15.135:0/2996992487 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5563aca92b20 0x5563aca94f40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ff4f6a777073c510 server_cookie=cedbd7cfcaff36cd in_seq=0 out_seq=0 2024-04-20T12:27:01.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.987+0000 7fd312ffd640 1 -- 172.21.15.135:0/2996992487 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5563ac97b9a0 con 0x5563aca92b20 2024-04-20T12:27:01.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.987+0000 7fd312ffd640 10 client.16953 handle_command_reply: tid=0 2024-04-20T12:27:01.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.987+0000 7fd33c9c5740 1 client.16953 shutdown 2024-04-20T12:27:01.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2996992487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca0f730 msgr2=0x5563aca125f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/2996992487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca0f730 0x5563aca125f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fd334069c40 tx=0x7fd31c0039c0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2996992487 shutdown_connections 2024-04-20T12:27:01.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/2996992487 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5563aca92b20 0x5563aca94f40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/2996992487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563aca18310 0x5563aca897a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/2996992487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563aca0f730 0x5563aca125f0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd312ffd640 0 client.16953 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:27:01.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd33c9c5740 1 --2- 172.21.15.135:0/2996992487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563aca0ee10 0x5563aca120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2996992487 >> 172.21.15.135:0/2996992487 conn(0x5563aca09540 msgr2=0x5563aca07e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2996992487 shutdown_connections 2024-04-20T12:27:01.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd33c9c5740 1 -- 172.21.15.135:0/2996992487 wait complete. 2024-04-20T12:27:01.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd33c9c5740 20 client.16953 trim_cache size 0 max 16384 2024-04-20T12:27:01.995 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:27:01.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd339cfb640 1 -- 172.21.15.135:0/586699201 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3200a3da0 msgr2=0x7fd3200a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd339cfb640 1 --2- 172.21.15.135:0/586699201 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3200a3da0 0x7fd3200a6260 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd324006010 tx=0x7fd324005dd0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd339cfb640 1 -- 172.21.15.135:0/586699201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33419a120 msgr2=0x7fd3341a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:01.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd339cfb640 1 --2- 172.21.15.135:0/586699201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33419a120 0x7fd3341a46d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009fd0 tx=0x7fd32c00b260 comp rx=0 tx=0).stop 2024-04-20T12:27:01.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd339cfb640 1 -- 172.21.15.135:0/586699201 shutdown_connections 2024-04-20T12:27:01.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd339cfb640 1 --2- 172.21.15.135:0/586699201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33419a120 0x7fd3341a46d0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd339cfb640 1 --2- 172.21.15.135:0/586699201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd334106160 0x7fd334199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd339cfb640 1 --2- 172.21.15.135:0/586699201 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3200a3da0 0x7fd3200a6260 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd339cfb640 1 --2- 172.21.15.135:0/586699201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd334101090 0x7fd334199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:01.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd339cfb640 1 -- 172.21.15.135:0/586699201 >> 172.21.15.135:0/586699201 conn(0x7fd334078010 msgr2=0x7fd3340ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:01.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd339cfb640 1 -- 172.21.15.135:0/586699201 shutdown_connections 2024-04-20T12:27:01.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:01.988+0000 7fd339cfb640 1 -- 172.21.15.135:0/586699201 wait complete. 2024-04-20T12:27:01.999 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:27:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.100+0000 7fe33b0b3640 1 -- 172.21.15.135:0/3664106146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe334101a50 msgr2=0x7fe33410dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.100+0000 7fe33b0b3640 1 --2- 172.21.15.135:0/3664106146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe334101a50 0x7fe33410dcb0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009ca0 tx=0x7fe32c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.100+0000 7fe33b0b3640 1 -- 172.21.15.135:0/3664106146 shutdown_connections 2024-04-20T12:27:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.100+0000 7fe33b0b3640 1 --2- 172.21.15.135:0/3664106146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe334101a50 0x7fe33410dcb0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.100+0000 7fe33b0b3640 1 --2- 172.21.15.135:0/3664106146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe3341010b0 0x7fe334101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.100+0000 7fe33b0b3640 1 --2- 172.21.15.135:0/3664106146 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe334105de0 0x7fe3341061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.100+0000 7fe33b0b3640 1 -- 172.21.15.135:0/3664106146 >> 172.21.15.135:0/3664106146 conn(0x7fe334077c50 msgr2=0x7fe334078060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.100+0000 7fe33b0b3640 1 -- 172.21.15.135:0/3664106146 shutdown_connections 2024-04-20T12:27:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.100+0000 7fe33b0b3640 1 -- 172.21.15.135:0/3664106146 wait complete. 2024-04-20T12:27:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe33b0b3640 1 Processor -- start 2024-04-20T12:27:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe33b0b3640 1 -- start start 2024-04-20T12:27:02.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe33b0b3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3341010b0 0x7fe334199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe33b0b3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe334101a50 0x7fe334199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe33b0b3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe334105de0 0x7fe3341a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe33b0b3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341112c0 con 0x7fe334105de0 2024-04-20T12:27:02.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe33b0b3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe334111140 con 0x7fe3341010b0 2024-04-20T12:27:02.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe33b0b3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe334111440 con 0x7fe334101a50 2024-04-20T12:27:02.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe339650640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe334105de0 0x7fe3341a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe339650640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe334105de0 0x7fe3341a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40066/0 (socket says 172.21.15.135:40066) 2024-04-20T12:27:02.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe339650640 1 -- 172.21.15.135:0/3636705396 learned_addr learned my addr 172.21.15.135:0/3636705396 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:02.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe338e4f640 1 --2- 172.21.15.135:0/3636705396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3341010b0 0x7fe334199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe333fff640 1 --2- 172.21.15.135:0/3636705396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe334101a50 0x7fe334199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe339650640 1 -- 172.21.15.135:0/3636705396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe334101a50 msgr2=0x7fe334199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:02.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe339650640 1 --2- 172.21.15.135:0/3636705396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe334101a50 0x7fe334199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe339650640 1 -- 172.21.15.135:0/3636705396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3341010b0 msgr2=0x7fe334199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:02.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe339650640 1 --2- 172.21.15.135:0/3636705396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3341010b0 0x7fe334199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe339650640 1 -- 172.21.15.135:0/3636705396 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3341a4c40 con 0x7fe334105de0 2024-04-20T12:27:02.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.101+0000 7fe338e4f640 1 --2- 172.21.15.135:0/3636705396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3341010b0 0x7fe334199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:02.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.102+0000 7fe339650640 1 --2- 172.21.15.135:0/3636705396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe334105de0 0x7fe3341a4700 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fe32c02c700 tx=0x7fe32c032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:02.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.102+0000 7fe331ffb640 1 -- 172.21.15.135:0/3636705396 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c041020 con 0x7fe334105de0 2024-04-20T12:27:02.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.102+0000 7fe331ffb640 1 -- 172.21.15.135:0/3636705396 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe32c034cd0 con 0x7fe334105de0 2024-04-20T12:27:02.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.102+0000 7fe331ffb640 1 -- 172.21.15.135:0/3636705396 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c039040 con 0x7fe334105de0 2024-04-20T12:27:02.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.102+0000 7fe33b0b3640 1 -- 172.21.15.135:0/3636705396 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3341a4e10 con 0x7fe334105de0 2024-04-20T12:27:02.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.102+0000 7fe33b0b3640 1 -- 172.21.15.135:0/3636705396 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3341a5270 con 0x7fe334105de0 2024-04-20T12:27:02.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.104+0000 7fe331ffb640 1 -- 172.21.15.135:0/3636705396 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fe32c044020 con 0x7fe334105de0 2024-04-20T12:27:02.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe33dd7d740 1 Processor -- start 2024-04-20T12:27:02.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe33dd7d740 1 -- start start 2024-04-20T12:27:02.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe331ffb640 1 --2- 172.21.15.135:0/3636705396 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe3200a3d20 0x7fe3200a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe33dd7d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7e11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe33dd7d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7e1730 0x55f1ab7e9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe33dd7d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7ea310 0x55f1ab7ec700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe33dd7d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f1ab746110 con 0x55f1ab7ea310 2024-04-20T12:27:02.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe33dd7d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f1ab6e3550 con 0x55f1ab7e0e10 2024-04-20T12:27:02.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe33dd7d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f1ab7420d0 con 0x55f1ab7e1730 2024-04-20T12:27:02.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe333fff640 1 --2- 172.21.15.135:0/3636705396 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe3200a3d20 0x7fe3200a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe339650640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7ea310 0x55f1ab7ec700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe339650640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7ea310 0x55f1ab7ec700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40078/0 (socket says 172.21.15.135:40078) 2024-04-20T12:27:02.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe339650640 1 -- 172.21.15.135:0/906163014 learned_addr learned my addr 172.21.15.135:0/906163014 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:02.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe331ffb640 1 -- 172.21.15.135:0/3636705396 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe32c0f2950 con 0x7fe334105de0 2024-04-20T12:27:02.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe338e4f640 1 --2- 172.21.15.135:0/906163014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7e11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe333fff640 1 --2- 172.21.15.135:0/906163014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7e1730 0x55f1ab7e9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe339650640 1 -- 172.21.15.135:0/906163014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7e1730 msgr2=0x55f1ab7e9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:02.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe339650640 1 --2- 172.21.15.135:0/906163014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7e1730 0x55f1ab7e9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe339650640 1 -- 172.21.15.135:0/906163014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e0e10 msgr2=0x55f1ab7e11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:02.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe339650640 1 --2- 172.21.15.135:0/906163014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7e11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe339650640 1 -- 172.21.15.135:0/906163014 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1ab70b900 con 0x55f1ab7ea310 2024-04-20T12:27:02.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe333fff640 1 --2- 172.21.15.135:0/3636705396 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe3200a3d20 0x7fe3200a61e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe33406b110 tx=0x7fe324009f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:02.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.105+0000 7fe339650640 1 --2- 172.21.15.135:0/906163014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7ea310 0x55f1ab7ec700 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0bb050 tx=0x7fe32c0ba9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788d58232cf86f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:02.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.106+0000 7fe32affd640 1 -- 172.21.15.135:0/906163014 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0bdfe0 con 0x55f1ab7ea310 2024-04-20T12:27:02.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.106+0000 7fe32affd640 1 -- 172.21.15.135:0/906163014 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe32c0bed80 con 0x55f1ab7ea310 2024-04-20T12:27:02.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.106+0000 7fe32affd640 1 -- 172.21.15.135:0/906163014 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0c72f0 con 0x55f1ab7ea310 2024-04-20T12:27:02.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.106+0000 7fe33dd7d740 1 -- 172.21.15.135:0/906163014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7ea310 msgr2=0x55f1ab7ec700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:02.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.106+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/906163014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7ea310 0x55f1ab7ec700 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0bb050 tx=0x7fe32c0ba9e0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.106+0000 7fe33dd7d740 1 -- 172.21.15.135:0/906163014 shutdown_connections 2024-04-20T12:27:02.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.106+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/906163014 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7ea310 0x55f1ab7ec700 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.106+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/906163014 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7e1730 0x55f1ab7e9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.106+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/906163014 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7e11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.106+0000 7fe33dd7d740 1 -- 172.21.15.135:0/906163014 >> 172.21.15.135:0/906163014 conn(0x55f1ab7db540 msgr2=0x55f1ab7db920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:02.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.106+0000 7fe33dd7d740 1 -- 172.21.15.135:0/906163014 shutdown_connections 2024-04-20T12:27:02.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.106+0000 7fe33dd7d740 1 -- 172.21.15.135:0/906163014 wait complete. 2024-04-20T12:27:02.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe33dd7d740 1 -- start start 2024-04-20T12:27:02.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe33dd7d740 1 Processor -- start 2024-04-20T12:27:02.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe33dd7d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7e7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe33dd7d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e1730 0x55f1ab7e77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe33dd7d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7ea310 0x55f1ab7e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe33dd7d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f1ab7ecec0 con 0x55f1ab7ea310 2024-04-20T12:27:02.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe33dd7d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f1ab6ff500 con 0x55f1ab7e1730 2024-04-20T12:27:02.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe33dd7d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f1ab7ed040 con 0x55f1ab7e0e10 2024-04-20T12:27:02.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe33dd7d740 10 client.0 _ll_register_callbacks cb 0x55f1ab6e42f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:02.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe339650640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7ea310 0x55f1ab7e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe339650640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7ea310 0x55f1ab7e7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40082/0 (socket says 172.21.15.135:40082) 2024-04-20T12:27:02.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe339650640 1 -- 172.21.15.135:0/1177530453 learned_addr learned my addr 172.21.15.135:0/1177530453 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:02.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe338e4f640 1 --2- 172.21.15.135:0/1177530453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7e7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe333fff640 1 --2- 172.21.15.135:0/1177530453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e1730 0x55f1ab7e77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe339650640 1 -- 172.21.15.135:0/1177530453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7e0e10 msgr2=0x55f1ab7e7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:02.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe339650640 1 --2- 172.21.15.135:0/1177530453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7e7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe339650640 1 -- 172.21.15.135:0/1177530453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e1730 msgr2=0x55f1ab7e77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:02.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe339650640 1 --2- 172.21.15.135:0/1177530453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e1730 0x55f1ab7e77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.107+0000 7fe339650640 1 -- 172.21.15.135:0/1177530453 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1ab4583f0 con 0x55f1ab7ea310 2024-04-20T12:27:02.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe339650640 1 --2- 172.21.15.135:0/1177530453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7ea310 0x55f1ab7e7cf0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0f0320 tx=0x7fe32c0be0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa3204d1eb16e32 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:02.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe313fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:02.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe313fff640 1 -- 172.21.15.135:0/1177530453 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0d5060 con 0x55f1ab7ea310 2024-04-20T12:27:02.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe313fff640 1 -- 172.21.15.135:0/1177530453 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe32c0bacf0 con 0x55f1ab7ea310 2024-04-20T12:27:02.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1177530453 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe32c0bed80 con 0x55f1ab7ea310 2024-04-20T12:27:02.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe313fff640 1 -- 172.21.15.135:0/1177530453 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe32c0dc050 con 0x55f1ab7ea310 2024-04-20T12:27:02.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe33dd7d740 10 client.16965 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:02.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1177530453 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f1ab5227d0 con 0x55f1ab7ea310 2024-04-20T12:27:02.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe313fff640 1 -- 172.21.15.135:0/1177530453 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe32c0bed80 con 0x55f1ab7ea310 2024-04-20T12:27:02.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe313fff640 1 -- 172.21.15.135:0/1177530453 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe32c03c030 con 0x55f1ab7ea310 2024-04-20T12:27:02.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe33dd7d740 10 client.16965 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:02.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe33dd7d740 10 client.16965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:02.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe33dd7d740 20 client.16965 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:02.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/1177530453 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f1ab7fa100 0x55f1ab7fc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe33dd7d740 4 client.16965 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:02.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.108+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1177530453 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1ab753b30 con 0x55f1ab7fa100 2024-04-20T12:27:02.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.109+0000 7fe338e4f640 1 --2- 172.21.15.135:0/1177530453 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f1ab7fa100 0x55f1ab7fc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.109+0000 7fe338e4f640 1 --2- 172.21.15.135:0/1177530453 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f1ab7fa100 0x55f1ab7fc4f0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e1829bf705a668f server_cookie=668ae182b58ca8a6 in_seq=0 out_seq=0 2024-04-20T12:27:02.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.109+0000 7fe313fff640 10 client.16965 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:02.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.110+0000 7fe313fff640 1 -- 172.21.15.135:0/1177530453 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f1ab753b30 con 0x55f1ab7fa100 2024-04-20T12:27:02.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.110+0000 7fe313fff640 10 client.16965 handle_command_reply: tid=0 2024-04-20T12:27:02.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.110+0000 7fe33dd7d740 1 client.16965 shutdown 2024-04-20T12:27:02.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.110+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1177530453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7ea310 msgr2=0x55f1ab7e7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:02.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.110+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/1177530453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7ea310 0x55f1ab7e7cf0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0f0320 tx=0x7fe32c0be0d0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.110+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1177530453 shutdown_connections 2024-04-20T12:27:02.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.110+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/1177530453 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f1ab7fa100 0x55f1ab7fc4f0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.110+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/1177530453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7ea310 0x55f1ab7e7cf0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.110+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/1177530453 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e1730 0x55f1ab7e77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.110+0000 7fe313fff640 0 client.16965 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:02.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.110+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/1177530453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7e7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.110+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1177530453 >> 172.21.15.135:0/1177530453 conn(0x55f1ab7db540 msgr2=0x55f1ab7dd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:02.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.110+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1177530453 shutdown_connections 2024-04-20T12:27:02.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.110+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1177530453 wait complete. 2024-04-20T12:27:02.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.110+0000 7fe33dd7d740 20 client.16965 trim_cache size 0 max 16384 2024-04-20T12:27:02.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.123+0000 7fe33dd7d740 1 Processor -- start 2024-04-20T12:27:02.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.123+0000 7fe33dd7d740 1 -- start start 2024-04-20T12:27:02.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.123+0000 7fe33dd7d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.123+0000 7fe33dd7d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e1730 0x55f1ab801d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.123+0000 7fe33dd7d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7ea310 0x55f1ab802290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.123+0000 7fe33dd7d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341af3a0 con 0x55f1ab7e0e10 2024-04-20T12:27:02.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.123+0000 7fe33dd7d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341b0ee0 con 0x55f1ab7e1730 2024-04-20T12:27:02.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.123+0000 7fe33dd7d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341afa70 con 0x55f1ab7ea310 2024-04-20T12:27:02.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.123+0000 7fe338e4f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.123+0000 7fe338e4f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7f5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40096/0 (socket says 172.21.15.135:40096) 2024-04-20T12:27:02.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.123+0000 7fe338e4f640 1 -- 172.21.15.135:0/3388564074 learned_addr learned my addr 172.21.15.135:0/3388564074 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:02.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.124+0000 7fe333fff640 1 --2- 172.21.15.135:0/3388564074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e1730 0x55f1ab801d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.124+0000 7fe338e4f640 1 -- 172.21.15.135:0/3388564074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7ea310 msgr2=0x55f1ab802290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:02.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.124+0000 7fe338e4f640 1 --2- 172.21.15.135:0/3388564074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7ea310 0x55f1ab802290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.124+0000 7fe338e4f640 1 -- 172.21.15.135:0/3388564074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e1730 msgr2=0x55f1ab801d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:02.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.124+0000 7fe338e4f640 1 --2- 172.21.15.135:0/3388564074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e1730 0x55f1ab801d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.124+0000 7fe338e4f640 1 -- 172.21.15.135:0/3388564074 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1ab7db370 con 0x55f1ab7e0e10 2024-04-20T12:27:02.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.124+0000 7fe338e4f640 1 --2- 172.21.15.135:0/3388564074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7f5cb0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe31c005d80 tx=0x7fe31c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58cb4d7db3a4a63 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:02.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.124+0000 7fe32a7fc640 1 -- 172.21.15.135:0/3388564074 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c0042f0 con 0x55f1ab7e0e10 2024-04-20T12:27:02.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.124+0000 7fe32a7fc640 1 -- 172.21.15.135:0/3388564074 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe31c022070 con 0x55f1ab7e0e10 2024-04-20T12:27:02.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.124+0000 7fe32a7fc640 1 -- 172.21.15.135:0/3388564074 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c003e20 con 0x55f1ab7e0e10 2024-04-20T12:27:02.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 -- 172.21.15.135:0/3388564074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7e0e10 msgr2=0x55f1ab7f5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:02.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/3388564074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7f5cb0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe31c005d80 tx=0x7fe31c0046c0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 -- 172.21.15.135:0/3388564074 shutdown_connections 2024-04-20T12:27:02.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/3388564074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7ea310 0x55f1ab802290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/3388564074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e1730 0x55f1ab801d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/3388564074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7f5cb0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 -- 172.21.15.135:0/3388564074 >> 172.21.15.135:0/3388564074 conn(0x55f1ab7db540 msgr2=0x55f1ab7dd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:02.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 -- 172.21.15.135:0/3388564074 shutdown_connections 2024-04-20T12:27:02.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 -- 172.21.15.135:0/3388564074 wait complete. 2024-04-20T12:27:02.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 -- start start 2024-04-20T12:27:02.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 Processor -- start 2024-04-20T12:27:02.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7edce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7e1730 0x55f1ab7ee220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7ea310 0x55f1ab7ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341b0810 con 0x55f1ab7e1730 2024-04-20T12:27:02.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341b0140 con 0x55f1ab7e0e10 2024-04-20T12:27:02.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341ad370 con 0x55f1ab7ea310 2024-04-20T12:27:02.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe33dd7d740 10 client.0 _ll_register_callbacks cb 0x7fe32c0bdfe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:02.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.125+0000 7fe333fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7e1730 0x55f1ab7ee220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe333fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7e1730 0x55f1ab7ee220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40102/0 (socket says 172.21.15.135:40102) 2024-04-20T12:27:02.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe333fff640 1 -- 172.21.15.135:0/1388280427 learned_addr learned my addr 172.21.15.135:0/1388280427 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:02.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe338e4f640 1 --2- 172.21.15.135:0/1388280427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7edce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe339650640 1 --2- 172.21.15.135:0/1388280427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7ea310 0x55f1ab7ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe333fff640 1 -- 172.21.15.135:0/1388280427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7ea310 msgr2=0x55f1ab7ee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:02.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe333fff640 1 --2- 172.21.15.135:0/1388280427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7ea310 0x55f1ab7ee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe333fff640 1 -- 172.21.15.135:0/1388280427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e0e10 msgr2=0x55f1ab7edce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:02.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe333fff640 1 --2- 172.21.15.135:0/1388280427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7edce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe333fff640 1 -- 172.21.15.135:0/1388280427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1ab85f6c0 con 0x55f1ab7e1730 2024-04-20T12:27:02.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe339650640 1 --2- 172.21.15.135:0/1388280427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7ea310 0x55f1ab7ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:02.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe333fff640 1 --2- 172.21.15.135:0/1388280427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7e1730 0x55f1ab7ee220 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x55f1ab7e08e0 tx=0x7fe324004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922b368ddd6ad086 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:02.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe313fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:02.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe313fff640 1 -- 172.21.15.135:0/1388280427 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe324022320 con 0x55f1ab7e1730 2024-04-20T12:27:02.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe313fff640 1 -- 172.21.15.135:0/1388280427 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe32400faf0 con 0x55f1ab7e1730 2024-04-20T12:27:02.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1388280427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe31c022070 con 0x55f1ab7e1730 2024-04-20T12:27:02.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe313fff640 1 -- 172.21.15.135:0/1388280427 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe32400fcf0 con 0x55f1ab7e1730 2024-04-20T12:27:02.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe33dd7d740 10 client.16971 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:02.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1388280427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f1ab8609f0 con 0x55f1ab7e1730 2024-04-20T12:27:02.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe313fff640 1 -- 172.21.15.135:0/1388280427 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe31c022070 con 0x55f1ab7e1730 2024-04-20T12:27:02.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.126+0000 7fe313fff640 1 -- 172.21.15.135:0/1388280427 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe324029070 con 0x55f1ab7e1730 2024-04-20T12:27:02.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.127+0000 7fe33dd7d740 10 client.16971 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:02.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.127+0000 7fe33dd7d740 10 client.16971 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:02.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.127+0000 7fe33dd7d740 20 client.16971 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:02.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.127+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/1388280427 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f1ab861220 0x55f1ab863640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:02.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.127+0000 7fe33dd7d740 4 client.16971 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:27:02.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.127+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1388280427 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f1ab74d9a0 con 0x55f1ab861220 2024-04-20T12:27:02.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.127+0000 7fe338e4f640 1 --2- 172.21.15.135:0/1388280427 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f1ab861220 0x55f1ab863640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:02.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.127+0000 7fe338e4f640 1 --2- 172.21.15.135:0/1388280427 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f1ab861220 0x55f1ab863640 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed48ce96d8c6c22e server_cookie=9eccd3e337a518b2 in_seq=0 out_seq=0 2024-04-20T12:27:02.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.127+0000 7fe313fff640 10 client.16971 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:02.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe313fff640 1 -- 172.21.15.135:0/1388280427 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f1ab74d9a0 con 0x55f1ab861220 2024-04-20T12:27:02.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe313fff640 10 client.16971 handle_command_reply: tid=0 2024-04-20T12:27:02.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33dd7d740 1 client.16971 shutdown 2024-04-20T12:27:02.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1388280427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7e1730 msgr2=0x55f1ab7ee220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:02.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/1388280427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7e1730 0x55f1ab7ee220 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x55f1ab7e08e0 tx=0x7fe324004730 comp rx=0 tx=0).stop 2024-04-20T12:27:02.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1388280427 shutdown_connections 2024-04-20T12:27:02.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/1388280427 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f1ab861220 0x55f1ab863640 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/1388280427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f1ab7ea310 0x55f1ab7ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/1388280427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f1ab7e1730 0x55f1ab7ee220 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe313fff640 0 client.16971 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:02.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33dd7d740 1 --2- 172.21.15.135:0/1388280427 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f1ab7e0e10 0x55f1ab7edce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1388280427 >> 172.21.15.135:0/1388280427 conn(0x55f1ab7db540 msgr2=0x55f1ab7d9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:02.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1388280427 shutdown_connections 2024-04-20T12:27:02.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33dd7d740 1 -- 172.21.15.135:0/1388280427 wait complete. 2024-04-20T12:27:02.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33dd7d740 20 client.16971 trim_cache size 0 max 16384 2024-04-20T12:27:02.135 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:27:02.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33b0b3640 1 -- 172.21.15.135:0/3636705396 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe3200a3d20 msgr2=0x7fe3200a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:02.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33b0b3640 1 --2- 172.21.15.135:0/3636705396 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe3200a3d20 0x7fe3200a61e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe33406b110 tx=0x7fe324009f90 comp rx=0 tx=0).stop 2024-04-20T12:27:02.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33b0b3640 1 -- 172.21.15.135:0/3636705396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe334105de0 msgr2=0x7fe3341a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:02.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33b0b3640 1 --2- 172.21.15.135:0/3636705396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe334105de0 0x7fe3341a4700 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fe32c02c700 tx=0x7fe32c032f20 comp rx=0 tx=0).stop 2024-04-20T12:27:02.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.128+0000 7fe33b0b3640 1 -- 172.21.15.135:0/3636705396 shutdown_connections 2024-04-20T12:27:02.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.129+0000 7fe33b0b3640 1 --2- 172.21.15.135:0/3636705396 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe334105de0 0x7fe3341a4700 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.129+0000 7fe33b0b3640 1 --2- 172.21.15.135:0/3636705396 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe3200a3d20 0x7fe3200a61e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.129+0000 7fe33b0b3640 1 --2- 172.21.15.135:0/3636705396 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe334101a50 0x7fe334199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.129+0000 7fe33b0b3640 1 --2- 172.21.15.135:0/3636705396 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe3341010b0 0x7fe334199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:02.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.129+0000 7fe33b0b3640 1 -- 172.21.15.135:0/3636705396 >> 172.21.15.135:0/3636705396 conn(0x7fe334077c50 msgr2=0x7fe3340fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:02.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.129+0000 7fe33b0b3640 1 -- 172.21.15.135:0/3636705396 shutdown_connections 2024-04-20T12:27:02.137 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:02.129+0000 7fe33b0b3640 1 -- 172.21.15.135:0/3636705396 wait complete. 2024-04-20T12:27:02.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:02 smithi139 ceph-mon[21834]: pgmap v120: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:02.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:02 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1590171789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:27:02.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:02 smithi135 ceph-mon[18264]: pgmap v120: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:02.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:02 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1590171789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:27:02.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:02 smithi154 ceph-mon[22073]: pgmap v120: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:02.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:02 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1590171789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:27:03.139 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:27:03.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:27:03.140 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:27:03.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.256+0000 7f1a0d469640 1 -- 172.21.15.135:0/4244448325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a081010a0 msgr2=0x7f1a08101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.256+0000 7f1a0d469640 1 --2- 172.21.15.135:0/4244448325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a081010a0 0x7f1a08101480 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009900 tx=0x7f19f802bc30 comp rx=0 tx=0).stop 2024-04-20T12:27:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.256+0000 7f1a0d469640 1 -- 172.21.15.135:0/4244448325 shutdown_connections 2024-04-20T12:27:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.256+0000 7f1a0d469640 1 --2- 172.21.15.135:0/4244448325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a08106170 0x7f1a0810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.256+0000 7f1a0d469640 1 --2- 172.21.15.135:0/4244448325 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a08101a50 0x7f1a08105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.256+0000 7f1a0d469640 1 --2- 172.21.15.135:0/4244448325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a081010a0 0x7f1a08101480 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.256+0000 7f1a0d469640 1 -- 172.21.15.135:0/4244448325 >> 172.21.15.135:0/4244448325 conn(0x7f1a08077f60 msgr2=0x7f1a08078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.256+0000 7f1a0d469640 1 -- 172.21.15.135:0/4244448325 shutdown_connections 2024-04-20T12:27:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.256+0000 7f1a0d469640 1 -- 172.21.15.135:0/4244448325 wait complete. 2024-04-20T12:27:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.256+0000 7f1a0d469640 1 Processor -- start 2024-04-20T12:27:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a0d469640 1 -- start start 2024-04-20T12:27:03.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a0d469640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a081010a0 0x7f1a08199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a0d469640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a08106170 0x7f1a08199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a0d469640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a0819a110 0x7f1a081a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a0d469640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a08111200 con 0x7f1a08106170 2024-04-20T12:27:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a0d469640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1a08111080 con 0x7f1a0819a110 2024-04-20T12:27:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a0d469640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1a08111380 con 0x7f1a081010a0 2024-04-20T12:27:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a067fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a08106170 0x7f1a08199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a067fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a08106170 0x7f1a08199b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40128/0 (socket says 172.21.15.135:40128) 2024-04-20T12:27:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a067fc640 1 -- 172.21.15.135:0/229676657 learned_addr learned my addr 172.21.15.135:0/229676657 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a077fe640 1 --2- 172.21.15.135:0/229676657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a0819a110 0x7f1a081a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a06ffd640 1 --2- 172.21.15.135:0/229676657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a081010a0 0x7f1a08199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a067fc640 1 -- 172.21.15.135:0/229676657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a081010a0 msgr2=0x7f1a08199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a067fc640 1 --2- 172.21.15.135:0/229676657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a081010a0 0x7f1a08199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a067fc640 1 -- 172.21.15.135:0/229676657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a0819a110 msgr2=0x7f1a081a46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a067fc640 1 --2- 172.21.15.135:0/229676657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a0819a110 0x7f1a081a46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a067fc640 1 -- 172.21.15.135:0/229676657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a081a4ec0 con 0x7f1a08106170 2024-04-20T12:27:03.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a067fc640 1 --2- 172.21.15.135:0/229676657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a08106170 0x7f1a08199b80 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00e9c0 tx=0x7f19fc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:03.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f19effff640 1 -- 172.21.15.135:0/229676657 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc00cd80 con 0x7f1a08106170 2024-04-20T12:27:03.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f19effff640 1 -- 172.21.15.135:0/229676657 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19fc005500 con 0x7f1a08106170 2024-04-20T12:27:03.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f1a0d469640 1 -- 172.21.15.135:0/229676657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a081a51b0 con 0x7f1a08106170 2024-04-20T12:27:03.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.257+0000 7f19effff640 1 -- 172.21.15.135:0/229676657 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc010690 con 0x7f1a08106170 2024-04-20T12:27:03.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.258+0000 7f1a0d469640 1 -- 172.21.15.135:0/229676657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a081a5700 con 0x7f1a08106170 2024-04-20T12:27:03.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.260+0000 7f19effff640 1 -- 172.21.15.135:0/229676657 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f19fc0046c0 con 0x7f1a08106170 2024-04-20T12:27:03.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.260+0000 7f1a10056740 1 Processor -- start 2024-04-20T12:27:03.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.260+0000 7f1a10056740 1 -- start start 2024-04-20T12:27:03.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.260+0000 7f1a10056740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df495fe0 0x5647df4963c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.260+0000 7f1a10056740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df496900 0x5647df49efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.260+0000 7f1a10056740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df49f4e0 0x5647df4a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.260+0000 7f1a10056740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5647df3faf00 con 0x5647df495fe0 2024-04-20T12:27:03.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.260+0000 7f1a10056740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5647df398530 con 0x5647df496900 2024-04-20T12:27:03.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.260+0000 7f1a10056740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647df3f6ec0 con 0x5647df49f4e0 2024-04-20T12:27:03.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.260+0000 7f19effff640 1 --2- 172.21.15.135:0/229676657 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f19f00a3d20 0x7f19f00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.260+0000 7f1a077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df495fe0 0x5647df4963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.260+0000 7f1a077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df495fe0 0x5647df4963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40144/0 (socket says 172.21.15.135:40144) 2024-04-20T12:27:03.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.260+0000 7f1a077fe640 1 -- 172.21.15.135:0/2587686177 learned_addr learned my addr 172.21.15.135:0/2587686177 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:03.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.260+0000 7f1a077fe640 1 --2- 172.21.15.135:0/229676657 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f19f00a3d20 0x7f19f00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.260+0000 7f1a06ffd640 1 --2- 172.21.15.135:0/2587686177 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df496900 0x5647df49efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.261+0000 7f1a067fc640 1 --2- 172.21.15.135:0/2587686177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df49f4e0 0x5647df4a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.261+0000 7f19effff640 1 -- 172.21.15.135:0/229676657 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f19fc0d0fa0 con 0x7f1a08106170 2024-04-20T12:27:03.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.261+0000 7f1a077fe640 1 -- 172.21.15.135:0/2587686177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df49f4e0 msgr2=0x5647df4a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.261+0000 7f1a077fe640 1 --2- 172.21.15.135:0/2587686177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df49f4e0 0x5647df4a18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.261+0000 7f1a077fe640 1 -- 172.21.15.135:0/2587686177 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df496900 msgr2=0x5647df49efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.261+0000 7f1a077fe640 1 --2- 172.21.15.135:0/2587686177 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df496900 0x5647df49efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.261+0000 7f1a077fe640 1 -- 172.21.15.135:0/2587686177 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647df1d57e0 con 0x5647df495fe0 2024-04-20T12:27:03.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.261+0000 7f1a077fe640 1 --2- 172.21.15.135:0/2587686177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df495fe0 0x5647df4963c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f1a00012d00 tx=0x7f1a00010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabb3a92691b464a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:03.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.261+0000 7f1a077fe640 1 --2- 172.21.15.135:0/229676657 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f19f00a3d20 0x7f19f00a61e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1a00010c40 tx=0x7f1a00017000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:03.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.261+0000 7f19ed7fa640 1 -- 172.21.15.135:0/2587686177 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a00024070 con 0x5647df495fe0 2024-04-20T12:27:03.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.261+0000 7f19ed7fa640 1 -- 172.21.15.135:0/2587686177 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a00009d00 con 0x5647df495fe0 2024-04-20T12:27:03.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.261+0000 7f19ed7fa640 1 -- 172.21.15.135:0/2587686177 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a00005280 con 0x5647df495fe0 2024-04-20T12:27:03.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 -- 172.21.15.135:0/2587686177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df495fe0 msgr2=0x5647df4963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 --2- 172.21.15.135:0/2587686177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df495fe0 0x5647df4963c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f1a00012d00 tx=0x7f1a00010740 comp rx=0 tx=0).stop 2024-04-20T12:27:03.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 -- 172.21.15.135:0/2587686177 shutdown_connections 2024-04-20T12:27:03.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 --2- 172.21.15.135:0/2587686177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df49f4e0 0x5647df4a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 --2- 172.21.15.135:0/2587686177 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df496900 0x5647df49efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 --2- 172.21.15.135:0/2587686177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df495fe0 0x5647df4963c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 -- 172.21.15.135:0/2587686177 >> 172.21.15.135:0/2587686177 conn(0x5647df490710 msgr2=0x5647df490af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:03.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 -- 172.21.15.135:0/2587686177 shutdown_connections 2024-04-20T12:27:03.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 -- 172.21.15.135:0/2587686177 wait complete. 2024-04-20T12:27:03.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 -- start start 2024-04-20T12:27:03.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 Processor -- start 2024-04-20T12:27:03.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df495fe0 0x5647df49ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df49c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df49f4e0 0x5647df49ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5647df4a2270 con 0x5647df496900 2024-04-20T12:27:03.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5647df383480 con 0x5647df495fe0 2024-04-20T12:27:03.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5647df4a23f0 con 0x5647df49f4e0 2024-04-20T12:27:03.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f1a067fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df49c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.262+0000 7f1a10056740 10 client.0 _ll_register_callbacks cb 0x5647df382e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:03.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f1a067fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df49c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40146/0 (socket says 172.21.15.135:40146) 2024-04-20T12:27:03.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f1a067fc640 1 -- 172.21.15.135:0/2320521193 learned_addr learned my addr 172.21.15.135:0/2320521193 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:03.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f1a06ffd640 1 --2- 172.21.15.135:0/2320521193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df495fe0 0x5647df49ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f1a077fe640 1 --2- 172.21.15.135:0/2320521193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df49f4e0 0x5647df49ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f1a067fc640 1 -- 172.21.15.135:0/2320521193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df49f4e0 msgr2=0x5647df49ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f1a067fc640 1 --2- 172.21.15.135:0/2320521193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df49f4e0 0x5647df49ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f1a067fc640 1 -- 172.21.15.135:0/2320521193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df495fe0 msgr2=0x5647df49ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f1a067fc640 1 --2- 172.21.15.135:0/2320521193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df495fe0 0x5647df49ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f1a067fc640 1 -- 172.21.15.135:0/2320521193 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647df235f70 con 0x5647df496900 2024-04-20T12:27:03.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f1a067fc640 1 --2- 172.21.15.135:0/2320521193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df49c2c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f19fc09cb50 tx=0x7f19fc01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f544224e4343e3e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:03.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f19eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:03.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f19eaff5640 1 -- 172.21.15.135:0/2320521193 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc09d2c0 con 0x5647df496900 2024-04-20T12:27:03.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f19eaff5640 1 -- 172.21.15.135:0/2320521193 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f19fc09ce20 con 0x5647df496900 2024-04-20T12:27:03.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f1a10056740 1 -- 172.21.15.135:0/2320521193 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a00009d00 con 0x5647df496900 2024-04-20T12:27:03.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f19eaff5640 1 -- 172.21.15.135:0/2320521193 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f19fc0b6140 con 0x5647df496900 2024-04-20T12:27:03.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f1a10056740 10 client.16983 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:03.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f1a10056740 1 -- 172.21.15.135:0/2320521193 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5647df0cd170 con 0x5647df496900 2024-04-20T12:27:03.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.263+0000 7f19eaff5640 1 -- 172.21.15.135:0/2320521193 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a00009d00 con 0x5647df496900 2024-04-20T12:27:03.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.264+0000 7f19eaff5640 1 -- 172.21.15.135:0/2320521193 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f19fc0a53a0 con 0x5647df496900 2024-04-20T12:27:03.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.264+0000 7f1a10056740 10 client.16983 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:03.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.264+0000 7f1a10056740 10 client.16983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:03.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.264+0000 7f1a10056740 20 client.16983 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:03.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.264+0000 7f1a10056740 1 --2- 172.21.15.135:0/2320521193 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5647df4af5c0 0x5647df4b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.264+0000 7f1a10056740 4 client.16983 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:03.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.264+0000 7f1a10056740 1 -- 172.21.15.135:0/2320521193 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647df408920 con 0x5647df4af5c0 2024-04-20T12:27:03.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.264+0000 7f1a06ffd640 1 --2- 172.21.15.135:0/2320521193 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5647df4af5c0 0x5647df4b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.264+0000 7f19eaff5640 10 client.16983 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:03.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.264+0000 7f1a06ffd640 1 --2- 172.21.15.135:0/2320521193 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5647df4af5c0 0x5647df4b19b0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fefcb94b080254 server_cookie=4c1d510200eec540 in_seq=0 out_seq=0 2024-04-20T12:27:03.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.265+0000 7f19eaff5640 1 -- 172.21.15.135:0/2320521193 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5647df408920 con 0x5647df4af5c0 2024-04-20T12:27:03.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.265+0000 7f19eaff5640 10 client.16983 handle_command_reply: tid=0 2024-04-20T12:27:03.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.265+0000 7f1a10056740 1 client.16983 shutdown 2024-04-20T12:27:03.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.265+0000 7f1a10056740 1 -- 172.21.15.135:0/2320521193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 msgr2=0x5647df49c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.265+0000 7f1a10056740 1 --2- 172.21.15.135:0/2320521193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df49c2c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f19fc09cb50 tx=0x7f19fc01d000 comp rx=0 tx=0).stop 2024-04-20T12:27:03.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.265+0000 7f1a10056740 1 -- 172.21.15.135:0/2320521193 shutdown_connections 2024-04-20T12:27:03.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.265+0000 7f1a10056740 1 --2- 172.21.15.135:0/2320521193 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5647df4af5c0 0x5647df4b19b0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.265+0000 7f1a10056740 1 --2- 172.21.15.135:0/2320521193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df49f4e0 0x5647df49ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.265+0000 7f1a10056740 1 --2- 172.21.15.135:0/2320521193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df49c2c0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.265+0000 7f19eaff5640 0 client.16983 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:03.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.265+0000 7f1a10056740 1 --2- 172.21.15.135:0/2320521193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df495fe0 0x5647df49ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.265+0000 7f1a10056740 1 -- 172.21.15.135:0/2320521193 >> 172.21.15.135:0/2320521193 conn(0x5647df490710 msgr2=0x5647df492460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:03.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.265+0000 7f1a10056740 1 -- 172.21.15.135:0/2320521193 shutdown_connections 2024-04-20T12:27:03.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.265+0000 7f1a10056740 1 -- 172.21.15.135:0/2320521193 wait complete. 2024-04-20T12:27:03.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.265+0000 7f1a10056740 20 client.16983 trim_cache size 0 max 16384 2024-04-20T12:27:03.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.283+0000 7f1a10056740 1 Processor -- start 2024-04-20T12:27:03.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.283+0000 7f1a10056740 1 -- start start 2024-04-20T12:27:03.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a10056740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df495fe0 0x5647df4b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a10056740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df4b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a10056740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df49f4e0 0x5647df492120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a10056740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a081af390 con 0x5647df496900 2024-04-20T12:27:03.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a10056740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1a081b0ed0 con 0x5647df49f4e0 2024-04-20T12:27:03.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a10056740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1a081afa60 con 0x5647df495fe0 2024-04-20T12:27:03.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a067fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df4b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a067fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df4b7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40154/0 (socket says 172.21.15.135:40154) 2024-04-20T12:27:03.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a067fc640 1 -- 172.21.15.135:0/2197581828 learned_addr learned my addr 172.21.15.135:0/2197581828 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:03.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a06ffd640 1 --2- 172.21.15.135:0/2197581828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df495fe0 0x5647df4b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a077fe640 1 --2- 172.21.15.135:0/2197581828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df49f4e0 0x5647df492120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a067fc640 1 -- 172.21.15.135:0/2197581828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df495fe0 msgr2=0x5647df4b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a067fc640 1 --2- 172.21.15.135:0/2197581828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df495fe0 0x5647df4b7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a067fc640 1 -- 172.21.15.135:0/2197581828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df49f4e0 msgr2=0x5647df492120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a067fc640 1 --2- 172.21.15.135:0/2197581828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df49f4e0 0x5647df492120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a067fc640 1 -- 172.21.15.135:0/2197581828 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647df4b1fe0 con 0x5647df496900 2024-04-20T12:27:03.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f1a067fc640 1 --2- 172.21.15.135:0/2197581828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df4b7750 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00c6a0 tx=0x7f19fc009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96226386fee13f91 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:03.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f19ecff9640 1 -- 172.21.15.135:0/2197581828 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc09c700 con 0x5647df496900 2024-04-20T12:27:03.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f19ecff9640 1 -- 172.21.15.135:0/2197581828 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19fc09d0a0 con 0x5647df496900 2024-04-20T12:27:03.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.284+0000 7f19ecff9640 1 -- 172.21.15.135:0/2197581828 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0bd0b0 con 0x5647df496900 2024-04-20T12:27:03.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.285+0000 7f1a10056740 1 -- 172.21.15.135:0/2197581828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 msgr2=0x5647df4b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.285+0000 7f1a10056740 1 --2- 172.21.15.135:0/2197581828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df4b7750 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00c6a0 tx=0x7f19fc009700 comp rx=0 tx=0).stop 2024-04-20T12:27:03.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.285+0000 7f1a10056740 1 -- 172.21.15.135:0/2197581828 shutdown_connections 2024-04-20T12:27:03.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.285+0000 7f1a10056740 1 --2- 172.21.15.135:0/2197581828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df49f4e0 0x5647df492120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.285+0000 7f1a10056740 1 --2- 172.21.15.135:0/2197581828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df4b7750 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.285+0000 7f1a10056740 1 --2- 172.21.15.135:0/2197581828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df495fe0 0x5647df4b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.285+0000 7f1a10056740 1 -- 172.21.15.135:0/2197581828 >> 172.21.15.135:0/2197581828 conn(0x5647df490710 msgr2=0x5647df491a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:03.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.285+0000 7f1a10056740 1 -- 172.21.15.135:0/2197581828 shutdown_connections 2024-04-20T12:27:03.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.285+0000 7f1a10056740 1 -- 172.21.15.135:0/2197581828 wait complete. 2024-04-20T12:27:03.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.285+0000 7f1a10056740 1 -- start start 2024-04-20T12:27:03.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.285+0000 7f1a10056740 1 Processor -- start 2024-04-20T12:27:03.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a10056740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df495fe0 0x5647df4a7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a10056740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df4a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a10056740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df49f4e0 0x5647df4a4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a10056740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a081b0800 con 0x5647df496900 2024-04-20T12:27:03.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a10056740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1a081b0130 con 0x5647df49f4e0 2024-04-20T12:27:03.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a10056740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1a081ad360 con 0x5647df495fe0 2024-04-20T12:27:03.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a10056740 10 client.0 _ll_register_callbacks cb 0x7f19fc098ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:03.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a067fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df4a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a067fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df4a3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40158/0 (socket says 172.21.15.135:40158) 2024-04-20T12:27:03.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a067fc640 1 -- 172.21.15.135:0/4046356444 learned_addr learned my addr 172.21.15.135:0/4046356444 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:03.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a077fe640 1 --2- 172.21.15.135:0/4046356444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df49f4e0 0x5647df4a4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a067fc640 1 -- 172.21.15.135:0/4046356444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df495fe0 msgr2=0x5647df4a7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a06ffd640 1 --2- 172.21.15.135:0/4046356444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df495fe0 0x5647df4a7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a067fc640 1 --2- 172.21.15.135:0/4046356444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df495fe0 0x5647df4a7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a067fc640 1 -- 172.21.15.135:0/4046356444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df49f4e0 msgr2=0x5647df4a4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a067fc640 1 --2- 172.21.15.135:0/4046356444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df49f4e0 0x5647df4a4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a067fc640 1 -- 172.21.15.135:0/4046356444 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647df515a90 con 0x5647df496900 2024-04-20T12:27:03.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a06ffd640 1 --2- 172.21.15.135:0/4046356444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df495fe0 0x5647df4a7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:27:03.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a067fc640 1 --2- 172.21.15.135:0/4046356444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df4a3ef0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f19fc09cb50 tx=0x7f19fc0975d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2474744e212e313d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:03.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f19eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:03.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f19eaff5640 1 -- 172.21.15.135:0/4046356444 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc09c700 con 0x5647df496900 2024-04-20T12:27:03.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f19eaff5640 1 -- 172.21.15.135:0/4046356444 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f19fc061b40 con 0x5647df496900 2024-04-20T12:27:03.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.286+0000 7f1a10056740 1 -- 172.21.15.135:0/4046356444 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19fc09d0a0 con 0x5647df496900 2024-04-20T12:27:03.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.287+0000 7f19eaff5640 1 -- 172.21.15.135:0/4046356444 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f19fc09cbc0 con 0x5647df496900 2024-04-20T12:27:03.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.287+0000 7f1a10056740 10 client.16989 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:03.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.287+0000 7f1a10056740 1 -- 172.21.15.135:0/4046356444 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5647df516c50 con 0x5647df496900 2024-04-20T12:27:03.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.287+0000 7f19eaff5640 1 -- 172.21.15.135:0/4046356444 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19fc09d0a0 con 0x5647df496900 2024-04-20T12:27:03.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.287+0000 7f19eaff5640 1 -- 172.21.15.135:0/4046356444 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f19fc0ceac0 con 0x5647df496900 2024-04-20T12:27:03.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.287+0000 7f1a10056740 10 client.16989 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:03.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.287+0000 7f1a10056740 10 client.16989 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:03.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.287+0000 7f1a10056740 20 client.16989 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:03.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.287+0000 7f1a10056740 1 --2- 172.21.15.135:0/4046356444 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5647df516f40 0x5647df519380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.287+0000 7f1a10056740 4 client.16989 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:27:03.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.287+0000 7f1a10056740 1 -- 172.21.15.135:0/4046356444 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5647df402790 con 0x5647df516f40 2024-04-20T12:27:03.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.287+0000 7f1a06ffd640 1 --2- 172.21.15.135:0/4046356444 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5647df516f40 0x5647df519380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.288+0000 7f1a06ffd640 1 --2- 172.21.15.135:0/4046356444 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5647df516f40 0x5647df519380 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c7437b4121b91a5 server_cookie=5aa791d6f41290bc in_seq=0 out_seq=0 2024-04-20T12:27:03.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.288+0000 7f19eaff5640 10 client.16989 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:03.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.289+0000 7f19eaff5640 1 -- 172.21.15.135:0/4046356444 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5647df402790 con 0x5647df516f40 2024-04-20T12:27:03.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.289+0000 7f19eaff5640 10 client.16989 handle_command_reply: tid=0 2024-04-20T12:27:03.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.289+0000 7f1a10056740 1 client.16989 shutdown 2024-04-20T12:27:03.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.289+0000 7f1a10056740 1 -- 172.21.15.135:0/4046356444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 msgr2=0x5647df4a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.289+0000 7f1a10056740 1 --2- 172.21.15.135:0/4046356444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df4a3ef0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f19fc09cb50 tx=0x7f19fc0975d0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.289+0000 7f1a10056740 1 -- 172.21.15.135:0/4046356444 shutdown_connections 2024-04-20T12:27:03.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.289+0000 7f1a10056740 1 --2- 172.21.15.135:0/4046356444 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5647df516f40 0x5647df519380 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.289+0000 7f1a10056740 1 --2- 172.21.15.135:0/4046356444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5647df49f4e0 0x5647df4a4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.289+0000 7f1a10056740 1 --2- 172.21.15.135:0/4046356444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647df496900 0x5647df4a3ef0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.289+0000 7f1a10056740 1 --2- 172.21.15.135:0/4046356444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5647df495fe0 0x5647df4a7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.289+0000 7f1a10056740 1 -- 172.21.15.135:0/4046356444 >> 172.21.15.135:0/4046356444 conn(0x5647df490710 msgr2=0x5647df492280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:03.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.289+0000 7f19eaff5640 0 client.16989 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:03.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.289+0000 7f1a10056740 1 -- 172.21.15.135:0/4046356444 shutdown_connections 2024-04-20T12:27:03.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.289+0000 7f1a10056740 1 -- 172.21.15.135:0/4046356444 wait complete. 2024-04-20T12:27:03.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.289+0000 7f1a10056740 20 client.16989 trim_cache size 0 max 16384 2024-04-20T12:27:03.296 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:27:03.296 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:27:03.296 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "3f24652b-4369-42aa-813f-0624fe6e40a3", 2024-04-20T12:27:03.296 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:27:03.296 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:27:03.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.290+0000 7f1a0d469640 1 -- 172.21.15.135:0/229676657 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f19f00a3d20 msgr2=0x7f19f00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.290+0000 7f1a0d469640 1 --2- 172.21.15.135:0/229676657 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f19f00a3d20 0x7f19f00a61e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1a00010c40 tx=0x7f1a00017000 comp rx=0 tx=0).stop 2024-04-20T12:27:03.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.290+0000 7f1a0d469640 1 -- 172.21.15.135:0/229676657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a08106170 msgr2=0x7f1a08199b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.290+0000 7f1a0d469640 1 --2- 172.21.15.135:0/229676657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a08106170 0x7f1a08199b80 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00e9c0 tx=0x7f19fc00ee80 comp rx=0 tx=0).stop 2024-04-20T12:27:03.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.290+0000 7f1a0d469640 1 -- 172.21.15.135:0/229676657 shutdown_connections 2024-04-20T12:27:03.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.290+0000 7f1a0d469640 1 --2- 172.21.15.135:0/229676657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1a0819a110 0x7f1a081a46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.290+0000 7f1a0d469640 1 --2- 172.21.15.135:0/229676657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a08106170 0x7f1a08199b80 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.297 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.290+0000 7f1a0d469640 1 --2- 172.21.15.135:0/229676657 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f19f00a3d20 0x7f19f00a61e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.290+0000 7f1a0d469640 1 --2- 172.21.15.135:0/229676657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a081010a0 0x7f1a08199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.290+0000 7f1a0d469640 1 -- 172.21.15.135:0/229676657 >> 172.21.15.135:0/229676657 conn(0x7f1a08077f60 msgr2=0x7f1a080fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:03.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.290+0000 7f1a0d469640 1 -- 172.21.15.135:0/229676657 shutdown_connections 2024-04-20T12:27:03.298 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.290+0000 7f1a0d469640 1 -- 172.21.15.135:0/229676657 wait complete. 2024-04-20T12:27:03.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:27:03.301 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:27:03.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.402+0000 7fc222952640 1 -- 172.21.15.135:0/3777332813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc21c101ab0 msgr2=0x7fc21c105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.402+0000 7fc222952640 1 --2- 172.21.15.135:0/3777332813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc21c101ab0 0x7fc21c105aa0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc210009900 tx=0x7fc21002bc30 comp rx=0 tx=0).stop 2024-04-20T12:27:03.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.402+0000 7fc222952640 1 -- 172.21.15.135:0/3777332813 shutdown_connections 2024-04-20T12:27:03.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.402+0000 7fc222952640 1 --2- 172.21.15.135:0/3777332813 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c106180 0x7fc21c10dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.402+0000 7fc222952640 1 --2- 172.21.15.135:0/3777332813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc21c101ab0 0x7fc21c105aa0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.402+0000 7fc222952640 1 --2- 172.21.15.135:0/3777332813 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc21c101100 0x7fc21c1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.402+0000 7fc222952640 1 -- 172.21.15.135:0/3777332813 >> 172.21.15.135:0/3777332813 conn(0x7fc21c077fc0 msgr2=0x7fc21c0783d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:03.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.402+0000 7fc222952640 1 -- 172.21.15.135:0/3777332813 shutdown_connections 2024-04-20T12:27:03.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.402+0000 7fc222952640 1 -- 172.21.15.135:0/3777332813 wait complete. 2024-04-20T12:27:03.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.402+0000 7fc222952640 1 Processor -- start 2024-04-20T12:27:03.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.402+0000 7fc222952640 1 -- start start 2024-04-20T12:27:03.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc222952640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c101100 0x7fc21c199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc222952640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc21c106180 0x7fc21c199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc222952640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc21c19a0f0 0x7fc21c1a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc222952640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c1111f0 con 0x7fc21c106180 2024-04-20T12:27:03.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc222952640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c111070 con 0x7fc21c19a0f0 2024-04-20T12:27:03.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc222952640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c111370 con 0x7fc21c101100 2024-04-20T12:27:03.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc21b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc21c106180 0x7fc21c199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc21b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc21c106180 0x7fc21c199bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40172/0 (socket says 172.21.15.135:40172) 2024-04-20T12:27:03.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc21b7fe640 1 -- 172.21.15.135:0/1393036083 learned_addr learned my addr 172.21.15.135:0/1393036083 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:03.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc21bfff640 1 --2- 172.21.15.135:0/1393036083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c101100 0x7fc21c199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc220eef640 1 --2- 172.21.15.135:0/1393036083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc21c19a0f0 0x7fc21c1a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc21b7fe640 1 -- 172.21.15.135:0/1393036083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c101100 msgr2=0x7fc21c199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc21b7fe640 1 --2- 172.21.15.135:0/1393036083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c101100 0x7fc21c199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc21b7fe640 1 -- 172.21.15.135:0/1393036083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc21c19a0f0 msgr2=0x7fc21c1a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc21b7fe640 1 --2- 172.21.15.135:0/1393036083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc21c19a0f0 0x7fc21c1a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc21b7fe640 1 -- 172.21.15.135:0/1393036083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21c1a4e90 con 0x7fc21c106180 2024-04-20T12:27:03.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc21b7fe640 1 --2- 172.21.15.135:0/1393036083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc21c106180 0x7fc21c199bb0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc210036040 tx=0x7fc21002ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:03.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.403+0000 7fc2197fa640 1 -- 172.21.15.135:0/1393036083 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210041070 con 0x7fc21c106180 2024-04-20T12:27:03.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.404+0000 7fc222952640 1 -- 172.21.15.135:0/1393036083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21c1a5120 con 0x7fc21c106180 2024-04-20T12:27:03.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.404+0000 7fc2197fa640 1 -- 172.21.15.135:0/1393036083 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2100054e0 con 0x7fc21c106180 2024-04-20T12:27:03.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.404+0000 7fc2197fa640 1 -- 172.21.15.135:0/1393036083 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210034440 con 0x7fc21c106180 2024-04-20T12:27:03.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.404+0000 7fc222952640 1 -- 172.21.15.135:0/1393036083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21c1a5660 con 0x7fc21c106180 2024-04-20T12:27:03.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc2197fa640 1 -- 172.21.15.135:0/1393036083 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fc210044070 con 0x7fc21c106180 2024-04-20T12:27:03.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc225622740 1 Processor -- start 2024-04-20T12:27:03.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc225622740 1 -- start start 2024-04-20T12:27:03.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc225622740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b336a50 0x55a01b336e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc225622740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b337370 0x55a01b3440f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc225622740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b344630 0x55a01b346a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc225622740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a01b29c1b0 con 0x55a01b344630 2024-04-20T12:27:03.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc225622740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a01b239390 con 0x55a01b337370 2024-04-20T12:27:03.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc225622740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a01b298170 con 0x55a01b336a50 2024-04-20T12:27:03.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc2197fa640 1 --2- 172.21.15.135:0/1393036083 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc2040a3d50 0x7fc2040a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc21b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b344630 0x55a01b346a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc220eef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b336a50 0x55a01b336e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc220eef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b336a50 0x55a01b336e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.135:41882/0 (socket says 172.21.15.135:41882) 2024-04-20T12:27:03.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc220eef640 1 -- 172.21.15.135:0/2029138163 learned_addr learned my addr 172.21.15.135:0/2029138163 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:03.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc21bfff640 1 --2- 172.21.15.135:0/2029138163 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b337370 0x55a01b3440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc220eef640 1 --2- 172.21.15.135:0/1393036083 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc2040a3d50 0x7fc2040a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.406+0000 7fc2197fa640 1 -- 172.21.15.135:0/1393036083 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc2100f2760 con 0x7fc21c106180 2024-04-20T12:27:03.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.407+0000 7fc220eef640 1 -- 172.21.15.135:0/2029138163 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b337370 msgr2=0x55a01b3440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.407+0000 7fc220eef640 1 --2- 172.21.15.135:0/2029138163 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b337370 0x55a01b3440f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.407+0000 7fc220eef640 1 -- 172.21.15.135:0/2029138163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b344630 msgr2=0x55a01b346a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.407+0000 7fc220eef640 1 --2- 172.21.15.135:0/2029138163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b344630 0x55a01b346a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.407+0000 7fc220eef640 1 -- 172.21.15.135:0/2029138163 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a01b0787d0 con 0x55a01b336a50 2024-04-20T12:27:03.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.407+0000 7fc220eef640 1 --2- 172.21.15.135:0/1393036083 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc2040a3d50 0x7fc2040a6210 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc214010c40 tx=0x7fc21400b000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:03.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.407+0000 7fc220eef640 1 --2- 172.21.15.135:0/2029138163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b336a50 0x55a01b336e30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc214012c40 tx=0x7fc214010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bfebd2db27300bb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:03.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.407+0000 7fc2027fc640 1 -- 172.21.15.135:0/2029138163 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214024070 con 0x55a01b336a50 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.407+0000 7fc2027fc640 1 -- 172.21.15.135:0/2029138163 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc214009c80 con 0x55a01b336a50 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.407+0000 7fc2027fc640 1 -- 172.21.15.135:0/2029138163 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214005280 con 0x55a01b336a50 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 -- 172.21.15.135:0/2029138163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b336a50 msgr2=0x55a01b336e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 --2- 172.21.15.135:0/2029138163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b336a50 0x55a01b336e30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc214012c40 tx=0x7fc214010740 comp rx=0 tx=0).stop 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 -- 172.21.15.135:0/2029138163 shutdown_connections 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 --2- 172.21.15.135:0/2029138163 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b344630 0x55a01b346a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 --2- 172.21.15.135:0/2029138163 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b337370 0x55a01b3440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 --2- 172.21.15.135:0/2029138163 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b336a50 0x55a01b336e30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 -- 172.21.15.135:0/2029138163 >> 172.21.15.135:0/2029138163 conn(0x55a01b331450 msgr2=0x55a01b331830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 -- 172.21.15.135:0/2029138163 shutdown_connections 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 -- 172.21.15.135:0/2029138163 wait complete. 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 -- start start 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 Processor -- start 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b336a50 0x55a01b341690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b337370 0x55a01b341bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b344630 0x55a01b342110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a01b347390 con 0x55a01b337370 2024-04-20T12:27:03.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.408+0000 7fc225622740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a01b2552f0 con 0x55a01b336a50 2024-04-20T12:27:03.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc225622740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a01b347510 con 0x55a01b344630 2024-04-20T12:27:03.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc225622740 10 client.0 _ll_register_callbacks cb 0x55a01b21f4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:03.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc21b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b337370 0x55a01b341bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc21b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b337370 0x55a01b341bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40180/0 (socket says 172.21.15.135:40180) 2024-04-20T12:27:03.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc21b7fe640 1 -- 172.21.15.135:0/258115313 learned_addr learned my addr 172.21.15.135:0/258115313 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:03.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc21bfff640 1 --2- 172.21.15.135:0/258115313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b336a50 0x55a01b341690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc220eef640 1 --2- 172.21.15.135:0/258115313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b344630 0x55a01b342110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc21b7fe640 1 -- 172.21.15.135:0/258115313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b344630 msgr2=0x55a01b342110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc21b7fe640 1 --2- 172.21.15.135:0/258115313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b344630 0x55a01b342110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc21b7fe640 1 -- 172.21.15.135:0/258115313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b336a50 msgr2=0x55a01b341690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc21b7fe640 1 --2- 172.21.15.135:0/258115313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b336a50 0x55a01b341690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc21b7fe640 1 -- 172.21.15.135:0/258115313 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a01afae3f0 con 0x55a01b337370 2024-04-20T12:27:03.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc21b7fe640 1 --2- 172.21.15.135:0/258115313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b337370 0x55a01b341bd0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc210005c20 tx=0x7fc21008ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3bfd12cfd93757 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:03.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc1fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:03.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc1fb7fe640 1 -- 172.21.15.135:0/258115313 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21004b050 con 0x55a01b337370 2024-04-20T12:27:03.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc1fb7fe640 1 -- 172.21.15.135:0/258115313 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc2100dc0f0 con 0x55a01b337370 2024-04-20T12:27:03.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc225622740 1 -- 172.21.15.135:0/258115313 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a01b2a9bd0 con 0x55a01b337370 2024-04-20T12:27:03.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc1fb7fe640 1 -- 172.21.15.135:0/258115313 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc2100bde80 con 0x55a01b337370 2024-04-20T12:27:03.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc225622740 10 client.17001 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:03.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc225622740 1 -- 172.21.15.135:0/258115313 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a01af6e0f0 con 0x55a01b337370 2024-04-20T12:27:03.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.409+0000 7fc1fb7fe640 1 -- 172.21.15.135:0/258115313 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a01b2a9bd0 con 0x55a01b337370 2024-04-20T12:27:03.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.410+0000 7fc1fb7fe640 1 -- 172.21.15.135:0/258115313 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc2100f2380 con 0x55a01b337370 2024-04-20T12:27:03.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.410+0000 7fc225622740 10 client.17001 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:03.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.410+0000 7fc225622740 10 client.17001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:03.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.410+0000 7fc225622740 20 client.17001 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:03.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.410+0000 7fc225622740 1 --2- 172.21.15.135:0/258115313 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a01b354820 0x55a01b356c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.410+0000 7fc225622740 4 client.17001 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:03.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.410+0000 7fc225622740 1 -- 172.21.15.135:0/258115313 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a01b2a3a40 con 0x55a01b354820 2024-04-20T12:27:03.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.410+0000 7fc21bfff640 1 --2- 172.21.15.135:0/258115313 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a01b354820 0x55a01b356c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.410+0000 7fc1fb7fe640 10 client.17001 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:03.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.410+0000 7fc21bfff640 1 --2- 172.21.15.135:0/258115313 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a01b354820 0x55a01b356c70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db6ca7860725704c server_cookie=54a7304f060dc144 in_seq=0 out_seq=0 2024-04-20T12:27:03.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.411+0000 7fc1fb7fe640 1 -- 172.21.15.135:0/258115313 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a01b2a3a40 con 0x55a01b354820 2024-04-20T12:27:03.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.411+0000 7fc1fb7fe640 10 client.17001 handle_command_reply: tid=0 2024-04-20T12:27:03.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.411+0000 7fc225622740 1 client.17001 shutdown 2024-04-20T12:27:03.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.411+0000 7fc225622740 1 -- 172.21.15.135:0/258115313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b337370 msgr2=0x55a01b341bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.411+0000 7fc225622740 1 --2- 172.21.15.135:0/258115313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b337370 0x55a01b341bd0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc210005c20 tx=0x7fc21008ced0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.411+0000 7fc225622740 1 -- 172.21.15.135:0/258115313 shutdown_connections 2024-04-20T12:27:03.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.411+0000 7fc225622740 1 --2- 172.21.15.135:0/258115313 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a01b354820 0x55a01b356c70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.411+0000 7fc225622740 1 --2- 172.21.15.135:0/258115313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b344630 0x55a01b342110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.411+0000 7fc225622740 1 --2- 172.21.15.135:0/258115313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b337370 0x55a01b341bd0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.411+0000 7fc1fb7fe640 0 client.17001 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:03.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.411+0000 7fc225622740 1 --2- 172.21.15.135:0/258115313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b336a50 0x55a01b341690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.411+0000 7fc225622740 1 -- 172.21.15.135:0/258115313 >> 172.21.15.135:0/258115313 conn(0x55a01b331450 msgr2=0x55a01b3331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:03.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.411+0000 7fc225622740 1 -- 172.21.15.135:0/258115313 shutdown_connections 2024-04-20T12:27:03.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.411+0000 7fc225622740 1 -- 172.21.15.135:0/258115313 wait complete. 2024-04-20T12:27:03.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.411+0000 7fc225622740 20 client.17001 trim_cache size 0 max 16384 2024-04-20T12:27:03.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.428+0000 7fc225622740 1 Processor -- start 2024-04-20T12:27:03.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.428+0000 7fc225622740 1 -- start start 2024-04-20T12:27:03.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.428+0000 7fc225622740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b336a50 0x55a01b343dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.428+0000 7fc225622740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b337370 0x55a01b32c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.428+0000 7fc225622740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b344630 0x55a01b350290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc225622740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c1ad120 con 0x55a01b344630 2024-04-20T12:27:03.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc225622740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c1aec60 con 0x55a01b337370 2024-04-20T12:27:03.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc225622740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c1ad7f0 con 0x55a01b336a50 2024-04-20T12:27:03.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc220eef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b344630 0x55a01b350290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc220eef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b344630 0x55a01b350290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40192/0 (socket says 172.21.15.135:40192) 2024-04-20T12:27:03.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc220eef640 1 -- 172.21.15.135:0/1523005968 learned_addr learned my addr 172.21.15.135:0/1523005968 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:03.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc21bfff640 1 --2- 172.21.15.135:0/1523005968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b336a50 0x55a01b343dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc21b7fe640 1 --2- 172.21.15.135:0/1523005968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b337370 0x55a01b32c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc220eef640 1 -- 172.21.15.135:0/1523005968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b336a50 msgr2=0x55a01b343dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc220eef640 1 --2- 172.21.15.135:0/1523005968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b336a50 0x55a01b343dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc220eef640 1 -- 172.21.15.135:0/1523005968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b337370 msgr2=0x55a01b32c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc220eef640 1 --2- 172.21.15.135:0/1523005968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b337370 0x55a01b32c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc220eef640 1 -- 172.21.15.135:0/1523005968 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a01b340660 con 0x55a01b344630 2024-04-20T12:27:03.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc220eef640 1 --2- 172.21.15.135:0/1523005968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b344630 0x55a01b350290 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc214012c40 tx=0x7fc21400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6caba5af3f68294c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:03.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc201ffb640 1 -- 172.21.15.135:0/1523005968 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214024040 con 0x55a01b344630 2024-04-20T12:27:03.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc201ffb640 1 -- 172.21.15.135:0/1523005968 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc214012720 con 0x55a01b344630 2024-04-20T12:27:03.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.429+0000 7fc201ffb640 1 -- 172.21.15.135:0/1523005968 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2140049e0 con 0x55a01b344630 2024-04-20T12:27:03.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.430+0000 7fc225622740 1 -- 172.21.15.135:0/1523005968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b344630 msgr2=0x55a01b350290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.430+0000 7fc225622740 1 --2- 172.21.15.135:0/1523005968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b344630 0x55a01b350290 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc214012c40 tx=0x7fc21400db40 comp rx=0 tx=0).stop 2024-04-20T12:27:03.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.430+0000 7fc225622740 1 -- 172.21.15.135:0/1523005968 shutdown_connections 2024-04-20T12:27:03.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.430+0000 7fc225622740 1 --2- 172.21.15.135:0/1523005968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b344630 0x55a01b350290 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.430+0000 7fc225622740 1 --2- 172.21.15.135:0/1523005968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b337370 0x55a01b32c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.430+0000 7fc225622740 1 --2- 172.21.15.135:0/1523005968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b336a50 0x55a01b343dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.430+0000 7fc225622740 1 -- 172.21.15.135:0/1523005968 >> 172.21.15.135:0/1523005968 conn(0x55a01b331450 msgr2=0x55a01b330630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:03.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.430+0000 7fc225622740 1 -- 172.21.15.135:0/1523005968 shutdown_connections 2024-04-20T12:27:03.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.430+0000 7fc225622740 1 -- 172.21.15.135:0/1523005968 wait complete. 2024-04-20T12:27:03.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.430+0000 7fc225622740 1 -- start start 2024-04-20T12:27:03.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.430+0000 7fc225622740 1 Processor -- start 2024-04-20T12:27:03.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc225622740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b336a50 0x55a01b34aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc225622740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b337370 0x55a01b34af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc225622740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b344630 0x55a01b3b9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc225622740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c1ae590 con 0x55a01b336a50 2024-04-20T12:27:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc225622740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c1adec0 con 0x55a01b344630 2024-04-20T12:27:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc225622740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc21c1ab0f0 con 0x55a01b337370 2024-04-20T12:27:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc225622740 10 client.0 _ll_register_callbacks cb 0x7fc2100ba100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc21bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b336a50 0x55a01b34aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc21bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b336a50 0x55a01b34aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:40208/0 (socket says 172.21.15.135:40208) 2024-04-20T12:27:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc21bfff640 1 -- 172.21.15.135:0/1287513619 learned_addr learned my addr 172.21.15.135:0/1287513619 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc220eef640 1 --2- 172.21.15.135:0/1287513619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b344630 0x55a01b3b9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc21bfff640 1 -- 172.21.15.135:0/1287513619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b337370 msgr2=0x55a01b34af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc21b7fe640 1 --2- 172.21.15.135:0/1287513619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b337370 0x55a01b34af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc21bfff640 1 --2- 172.21.15.135:0/1287513619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b337370 0x55a01b34af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc21bfff640 1 -- 172.21.15.135:0/1287513619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b344630 msgr2=0x55a01b3b9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc21bfff640 1 --2- 172.21.15.135:0/1287513619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b344630 0x55a01b3b9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc21bfff640 1 -- 172.21.15.135:0/1287513619 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a01b3371a0 con 0x55a01b336a50 2024-04-20T12:27:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc220eef640 1 --2- 172.21.15.135:0/1287513619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b344630 0x55a01b3b9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc21bfff640 1 --2- 172.21.15.135:0/1287513619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b336a50 0x55a01b34aa10 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x55a01b3574a0 tx=0x7fc20c004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcc76261d90ef7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc1fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc1fb7fe640 1 -- 172.21.15.135:0/1287513619 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c01c310 con 0x55a01b336a50 2024-04-20T12:27:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc225622740 1 -- 172.21.15.135:0/1287513619 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc214012720 con 0x55a01b336a50 2024-04-20T12:27:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.431+0000 7fc1fb7fe640 1 -- 172.21.15.135:0/1287513619 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc20c01c4b0 con 0x55a01b336a50 2024-04-20T12:27:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.432+0000 7fc1fb7fe640 1 -- 172.21.15.135:0/1287513619 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc20c02b050 con 0x55a01b336a50 2024-04-20T12:27:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.432+0000 7fc225622740 10 client.17007 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.432+0000 7fc225622740 1 -- 172.21.15.135:0/1287513619 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a01b3bb520 con 0x55a01b336a50 2024-04-20T12:27:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.432+0000 7fc1fb7fe640 1 -- 172.21.15.135:0/1287513619 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc214012720 con 0x55a01b336a50 2024-04-20T12:27:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.432+0000 7fc1fb7fe640 1 -- 172.21.15.135:0/1287513619 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc20c0103d0 con 0x55a01b336a50 2024-04-20T12:27:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.432+0000 7fc225622740 10 client.17007 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.432+0000 7fc225622740 10 client.17007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:03.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.432+0000 7fc225622740 20 client.17007 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.432+0000 7fc225622740 1 --2- 172.21.15.135:0/1287513619 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a01b3bbcd0 0x55a01b3be0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.432+0000 7fc225622740 4 client.17007 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:27:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.432+0000 7fc225622740 1 -- 172.21.15.135:0/1287513619 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a01b21f590 con 0x55a01b3bbcd0 2024-04-20T12:27:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.432+0000 7fc21b7fe640 1 --2- 172.21.15.135:0/1287513619 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a01b3bbcd0 0x55a01b3be0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc21b7fe640 1 --2- 172.21.15.135:0/1287513619 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a01b3bbcd0 0x55a01b3be0c0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e403e3ff66cf20bb server_cookie=400c3e3b47637659 in_seq=0 out_seq=0 2024-04-20T12:27:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc1fb7fe640 10 client.17007 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc1fb7fe640 1 -- 172.21.15.135:0/1287513619 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a01b21f590 con 0x55a01b3bbcd0 2024-04-20T12:27:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc1fb7fe640 10 client.17007 handle_command_reply: tid=0 2024-04-20T12:27:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc225622740 1 client.17007 shutdown 2024-04-20T12:27:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc225622740 1 -- 172.21.15.135:0/1287513619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b336a50 msgr2=0x55a01b34aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc225622740 1 --2- 172.21.15.135:0/1287513619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b336a50 0x55a01b34aa10 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x55a01b3574a0 tx=0x7fc20c004410 comp rx=0 tx=0).stop 2024-04-20T12:27:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc225622740 1 -- 172.21.15.135:0/1287513619 shutdown_connections 2024-04-20T12:27:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc225622740 1 --2- 172.21.15.135:0/1287513619 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a01b3bbcd0 0x55a01b3be0c0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc225622740 1 --2- 172.21.15.135:0/1287513619 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a01b344630 0x55a01b3b9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc225622740 1 --2- 172.21.15.135:0/1287513619 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a01b337370 0x55a01b34af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc1fb7fe640 0 client.17007 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:03.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc225622740 1 --2- 172.21.15.135:0/1287513619 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a01b336a50 0x55a01b34aa10 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc225622740 1 -- 172.21.15.135:0/1287513619 >> 172.21.15.135:0/1287513619 conn(0x55a01b331450 msgr2=0x55a01b332880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:03.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc225622740 1 -- 172.21.15.135:0/1287513619 shutdown_connections 2024-04-20T12:27:03.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc225622740 1 -- 172.21.15.135:0/1287513619 wait complete. 2024-04-20T12:27:03.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc225622740 20 client.17007 trim_cache size 0 max 16384 2024-04-20T12:27:03.440 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:27:03.440 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:27:03.440 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:27:03.440 INFO:teuthology.orchestra.run.smithi135.stdout: "3f24652b-4369-42aa-813f-0624fe6e40a3": { 2024-04-20T12:27:03.441 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:27:03.441 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "3f24652b-4369-42aa-813f-0624fe6e40a3", 2024-04-20T12:27:03.441 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:27:03.441 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:27:03.441 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:27:03.441 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:27:03.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc222952640 1 -- 172.21.15.135:0/1393036083 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc2040a3d50 msgr2=0x7fc2040a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc222952640 1 --2- 172.21.15.135:0/1393036083 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc2040a3d50 0x7fc2040a6210 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc214010c40 tx=0x7fc21400b000 comp rx=0 tx=0).stop 2024-04-20T12:27:03.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.433+0000 7fc222952640 1 -- 172.21.15.135:0/1393036083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc21c106180 msgr2=0x7fc21c199bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:03.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.434+0000 7fc222952640 1 --2- 172.21.15.135:0/1393036083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc21c106180 0x7fc21c199bb0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc210036040 tx=0x7fc21002ce20 comp rx=0 tx=0).stop 2024-04-20T12:27:03.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.434+0000 7fc222952640 1 -- 172.21.15.135:0/1393036083 shutdown_connections 2024-04-20T12:27:03.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.434+0000 7fc222952640 1 --2- 172.21.15.135:0/1393036083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc21c19a0f0 0x7fc21c1a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.434+0000 7fc222952640 1 --2- 172.21.15.135:0/1393036083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc21c106180 0x7fc21c199bb0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.434+0000 7fc222952640 1 --2- 172.21.15.135:0/1393036083 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc2040a3d50 0x7fc2040a6210 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.434+0000 7fc222952640 1 --2- 172.21.15.135:0/1393036083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc21c101100 0x7fc21c199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:03.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.434+0000 7fc222952640 1 -- 172.21.15.135:0/1393036083 >> 172.21.15.135:0/1393036083 conn(0x7fc21c077fc0 msgr2=0x7fc21c0ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:03.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.434+0000 7fc222952640 1 -- 172.21.15.135:0/1393036083 shutdown_connections 2024-04-20T12:27:03.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:03.434+0000 7fc222952640 1 -- 172.21.15.135:0/1393036083 wait complete. 2024-04-20T12:27:03.444 INFO:tasks.cephfs.filesystem:scrub status for tag:3f24652b-4369-42aa-813f-0624fe6e40a3 - {'path': '/', 'tag': '3f24652b-4369-42aa-813f-0624fe6e40a3', 'options': 'recursive,force'} 2024-04-20T12:27:04.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:04 smithi139 ceph-mon[21834]: pgmap v121: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:27:04.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:04 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:27:04.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:04 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:27:04.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:04 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:27:04.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:04 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:27:04.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:04 smithi135 ceph-mon[18264]: pgmap v121: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:27:04.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:04 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:27:04.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:04 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:27:04.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:04 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:27:04.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:04 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:27:04.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:04 smithi154 ceph-mon[22073]: pgmap v121: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:27:04.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:04 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:27:04.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:04 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:27:04.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:04 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:27:04.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:04 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:27:06.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:06 smithi139 ceph-mon[21834]: pgmap v122: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:27:06.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:06 smithi135 ceph-mon[18264]: pgmap v122: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:27:06.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:06 smithi154 ceph-mon[22073]: pgmap v122: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:27:08.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:08 smithi139 ceph-mon[21834]: pgmap v123: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:27:08.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:08 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:27:08.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:08 smithi135 ceph-mon[18264]: pgmap v123: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:27:08.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:08 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:27:08.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:08 smithi154 ceph-mon[22073]: pgmap v123: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:27:08.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:08 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:27:10.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:10 smithi139 ceph-mon[21834]: pgmap v124: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-20T12:27:10.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:10 smithi135 ceph-mon[18264]: pgmap v124: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-20T12:27:10.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:10 smithi154 ceph-mon[22073]: pgmap v124: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-20T12:27:12.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:12 smithi139 ceph-mon[21834]: pgmap v125: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-20T12:27:12.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:12 smithi135 ceph-mon[18264]: pgmap v125: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-20T12:27:12.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:12 smithi154 ceph-mon[22073]: pgmap v125: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-04-20T12:27:14.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:14 smithi139 ceph-mon[21834]: pgmap v126: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-20T12:27:14.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:14 smithi135 ceph-mon[18264]: pgmap v126: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-20T12:27:14.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:14 smithi154 ceph-mon[22073]: pgmap v126: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-20T12:27:15.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:15 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:27:15.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:15 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:27:15.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:15 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:27:16.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:16 smithi139 ceph-mon[21834]: pgmap v127: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-20T12:27:16.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:16 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:27:16.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:16 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:27:16.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:16 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:27:16.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:16 smithi135 ceph-mon[18264]: pgmap v127: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-20T12:27:16.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:16 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:27:16.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:16 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:27:16.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:16 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:27:16.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:16 smithi154 ceph-mon[22073]: pgmap v127: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-20T12:27:16.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:16 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:27:16.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:16 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:27:16.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:16 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:27:18.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:18 smithi139 ceph-mon[21834]: pgmap v128: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-20T12:27:18.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:18 smithi135 ceph-mon[18264]: pgmap v128: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-20T12:27:18.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:18 smithi154 ceph-mon[22073]: pgmap v128: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-20T12:27:20.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:20 smithi139 ceph-mon[21834]: pgmap v129: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-20T12:27:20.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:20 smithi135 ceph-mon[18264]: pgmap v129: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-20T12:27:20.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:20 smithi154 ceph-mon[22073]: pgmap v129: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-20T12:27:22.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:22 smithi139 ceph-mon[21834]: pgmap v130: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:22.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:22 smithi135 ceph-mon[18264]: pgmap v130: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:22.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:22 smithi154 ceph-mon[22073]: pgmap v130: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:24.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:24 smithi139 ceph-mon[21834]: pgmap v131: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:27:24.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:24 smithi135 ceph-mon[18264]: pgmap v131: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:27:24.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:24 smithi154 ceph-mon[22073]: pgmap v131: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:27:26.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:26 smithi139 ceph-mon[21834]: pgmap v132: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:26.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:26 smithi135 ceph-mon[18264]: pgmap v132: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:26.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:26 smithi154 ceph-mon[22073]: pgmap v132: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:28.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:28 smithi139 ceph-mon[21834]: pgmap v133: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:28.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:28 smithi135 ceph-mon[18264]: pgmap v133: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:28.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:28 smithi154 ceph-mon[22073]: pgmap v133: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:30.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:30 smithi139 ceph-mon[21834]: pgmap v134: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:27:30.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:30 smithi135 ceph-mon[18264]: pgmap v134: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:27:30.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:30 smithi154 ceph-mon[22073]: pgmap v134: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:27:32.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:32 smithi139 ceph-mon[21834]: pgmap v135: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:32.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:32 smithi135 ceph-mon[18264]: pgmap v135: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:32.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:32 smithi154 ceph-mon[22073]: pgmap v135: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:33.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:27:33.446 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:27:33.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.559+0000 7f4851481640 1 -- 172.21.15.135:0/3832212164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f484c102b50 msgr2=0x7f484c106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:33.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.559+0000 7f4851481640 1 --2- 172.21.15.135:0/3832212164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f484c102b50 0x7f484c106b90 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4840009900 tx=0x7f484002bc30 comp rx=0 tx=0).stop 2024-04-20T12:27:33.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.559+0000 7f4851481640 1 -- 172.21.15.135:0/3832212164 shutdown_connections 2024-04-20T12:27:33.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.559+0000 7f4851481640 1 --2- 172.21.15.135:0/3832212164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c107270 0x7f484c10ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.559+0000 7f4851481640 1 --2- 172.21.15.135:0/3832212164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f484c102b50 0x7f484c106b90 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.559+0000 7f4851481640 1 --2- 172.21.15.135:0/3832212164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f484c1021a0 0x7f484c102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.559+0000 7f4851481640 1 -- 172.21.15.135:0/3832212164 >> 172.21.15.135:0/3832212164 conn(0x7f484c0793b0 msgr2=0x7f484c0797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:33.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.559+0000 7f4851481640 1 -- 172.21.15.135:0/3832212164 shutdown_connections 2024-04-20T12:27:33.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.559+0000 7f4851481640 1 -- 172.21.15.135:0/3832212164 wait complete. 2024-04-20T12:27:33.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.560+0000 7f4851481640 1 Processor -- start 2024-04-20T12:27:33.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.560+0000 7f4851481640 1 -- start start 2024-04-20T12:27:33.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.560+0000 7f4851481640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c1021a0 0x7f484c19e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.560+0000 7f4851481640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f484c107270 0x7f484c19e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.560+0000 7f4851481640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f484c1985c0 0x7f484c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.560+0000 7f4851481640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f484c112300 con 0x7f484c1985c0 2024-04-20T12:27:33.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.560+0000 7f4851481640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f484c112180 con 0x7f484c107270 2024-04-20T12:27:33.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.560+0000 7f4851481640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f484c112480 con 0x7f484c1021a0 2024-04-20T12:27:33.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.560+0000 7f484b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f484c1985c0 0x7f484c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.560+0000 7f484b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f484c1985c0 0x7f484c198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56322/0 (socket says 172.21.15.135:56322) 2024-04-20T12:27:33.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.560+0000 7f484b7fe640 1 -- 172.21.15.135:0/3360523470 learned_addr learned my addr 172.21.15.135:0/3360523470 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:33.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.561+0000 7f484affd640 1 --2- 172.21.15.135:0/3360523470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c1021a0 0x7f484c19e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.561+0000 7f484a7fc640 1 --2- 172.21.15.135:0/3360523470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f484c107270 0x7f484c19e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.561+0000 7f484b7fe640 1 -- 172.21.15.135:0/3360523470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c1021a0 msgr2=0x7f484c19e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:33.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.561+0000 7f484b7fe640 1 --2- 172.21.15.135:0/3360523470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c1021a0 0x7f484c19e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.561+0000 7f484b7fe640 1 -- 172.21.15.135:0/3360523470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f484c107270 msgr2=0x7f484c19e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:33.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.561+0000 7f484b7fe640 1 --2- 172.21.15.135:0/3360523470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f484c107270 0x7f484c19e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.561+0000 7f484b7fe640 1 -- 172.21.15.135:0/3360523470 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f484c1990e0 con 0x7f484c1985c0 2024-04-20T12:27:33.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.561+0000 7f484a7fc640 1 --2- 172.21.15.135:0/3360523470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f484c107270 0x7f484c19e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:27:33.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.561+0000 7f484b7fe640 1 --2- 172.21.15.135:0/3360523470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f484c1985c0 0x7f484c198a70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f484400cad0 tx=0x7f484400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:33.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.561+0000 7f4833fff640 1 -- 172.21.15.135:0/3360523470 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484400ae20 con 0x7f484c1985c0 2024-04-20T12:27:33.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.561+0000 7f4833fff640 1 -- 172.21.15.135:0/3360523470 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4844005020 con 0x7f484c1985c0 2024-04-20T12:27:33.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.561+0000 7f4833fff640 1 -- 172.21.15.135:0/3360523470 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484400f6f0 con 0x7f484c1985c0 2024-04-20T12:27:33.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.561+0000 7f4851481640 1 -- 172.21.15.135:0/3360523470 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f484c1993d0 con 0x7f484c1985c0 2024-04-20T12:27:33.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.561+0000 7f4851481640 1 -- 172.21.15.135:0/3360523470 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f484c1a5620 con 0x7f484c1985c0 2024-04-20T12:27:33.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.563+0000 7f4833fff640 1 -- 172.21.15.135:0/3360523470 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f48440051d0 con 0x7f484c1985c0 2024-04-20T12:27:33.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f4854078740 1 Processor -- start 2024-04-20T12:27:33.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f4854078740 1 -- start start 2024-04-20T12:27:33.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f4833fff640 1 --2- 172.21.15.135:0/3360523470 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f48340a3d20 0x7f48340a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f4854078740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3367d20 0x55d0a3368100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f4854078740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3368640 0x55d0a3370ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f4854078740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a3373610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f4854078740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d0a32cd1b0 con 0x55d0a3371220 2024-04-20T12:27:33.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f4854078740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d0a326a390 con 0x55d0a3367d20 2024-04-20T12:27:33.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f4854078740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d0a32c9170 con 0x55d0a3368640 2024-04-20T12:27:33.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f484a7fc640 1 --2- 172.21.15.135:0/3360523470 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f48340a3d20 0x7f48340a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f4833fff640 1 -- 172.21.15.135:0/3360523470 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f48440d0f30 con 0x7f484c1985c0 2024-04-20T12:27:33.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f484b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a3373610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f484b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a3373610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56330/0 (socket says 172.21.15.135:56330) 2024-04-20T12:27:33.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f484a7fc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3368640 0x55d0a3370ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f484b7fe640 1 -- 172.21.15.135:0/3332884295 learned_addr learned my addr 172.21.15.135:0/3332884295 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:33.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f484affd640 1 --2- 172.21.15.135:0/3332884295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3367d20 0x55d0a3368100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f484b7fe640 1 -- 172.21.15.135:0/3332884295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3368640 msgr2=0x55d0a3370ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f484b7fe640 1 --2- 172.21.15.135:0/3332884295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3368640 0x55d0a3370ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f484b7fe640 1 -- 172.21.15.135:0/3332884295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3367d20 msgr2=0x55d0a3368100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f484b7fe640 1 --2- 172.21.15.135:0/3332884295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3367d20 0x55d0a3368100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f484b7fe640 1 -- 172.21.15.135:0/3332884295 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0a30a97d0 con 0x55d0a3371220 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f484affd640 1 --2- 172.21.15.135:0/3332884295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3367d20 0x55d0a3368100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f484a7fc640 1 --2- 172.21.15.135:0/3360523470 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f48340a3d20 0x7f48340a61e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4840006010 tx=0x7f4840005df0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f484b7fe640 1 --2- 172.21.15.135:0/3332884295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a3373610 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4844098fb0 tx=0x7f484409d250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec0e32197fc6f07 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f48317fa640 1 -- 172.21.15.135:0/3332884295 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484401d040 con 0x55d0a3371220 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f48317fa640 1 -- 172.21.15.135:0/3332884295 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48440a0f00 con 0x55d0a3371220 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.565+0000 7f48317fa640 1 -- 172.21.15.135:0/3332884295 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48440ce6d0 con 0x55d0a3371220 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 -- 172.21.15.135:0/3332884295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 msgr2=0x55d0a3373610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 --2- 172.21.15.135:0/3332884295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a3373610 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4844098fb0 tx=0x7f484409d250 comp rx=0 tx=0).stop 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 -- 172.21.15.135:0/3332884295 shutdown_connections 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 --2- 172.21.15.135:0/3332884295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a3373610 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 --2- 172.21.15.135:0/3332884295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3368640 0x55d0a3370ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 --2- 172.21.15.135:0/3332884295 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3367d20 0x55d0a3368100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 -- 172.21.15.135:0/3332884295 >> 172.21.15.135:0/3332884295 conn(0x55d0a3362450 msgr2=0x55d0a3362830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:33.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 -- 172.21.15.135:0/3332884295 shutdown_connections 2024-04-20T12:27:33.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 -- 172.21.15.135:0/3332884295 wait complete. 2024-04-20T12:27:33.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 -- start start 2024-04-20T12:27:33.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 Processor -- start 2024-04-20T12:27:33.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3367d20 0x55d0a336e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3368640 0x55d0a336e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3371220 0x55d0a336ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d0a3373fb0 con 0x55d0a3368640 2024-04-20T12:27:33.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d0a32862f0 con 0x55d0a3371220 2024-04-20T12:27:33.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d0a3374130 con 0x55d0a3367d20 2024-04-20T12:27:33.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f4854078740 10 client.0 _ll_register_callbacks cb 0x55d0a32504e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:33.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.566+0000 7f484a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3368640 0x55d0a336e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f484a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3368640 0x55d0a336e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56336/0 (socket says 172.21.15.135:56336) 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f484a7fc640 1 -- 172.21.15.135:0/1062955671 learned_addr learned my addr 172.21.15.135:0/1062955671 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f484b7fe640 1 --2- 172.21.15.135:0/1062955671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3371220 0x55d0a336ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f484a7fc640 1 -- 172.21.15.135:0/1062955671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3367d20 msgr2=0x55d0a336e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f484affd640 1 --2- 172.21.15.135:0/1062955671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3367d20 0x55d0a336e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f484a7fc640 1 --2- 172.21.15.135:0/1062955671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3367d20 0x55d0a336e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f484a7fc640 1 -- 172.21.15.135:0/1062955671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3371220 msgr2=0x55d0a336ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f484a7fc640 1 --2- 172.21.15.135:0/1062955671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3371220 0x55d0a336ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f484a7fc640 1 -- 172.21.15.135:0/1062955671 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0a2fdf3f0 con 0x55d0a3368640 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f484a7fc640 1 --2- 172.21.15.135:0/1062955671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3368640 0x55d0a336e7c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f48400096c0 tx=0x7f484002bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41355f3c292a84d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f482eff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f482eff5640 1 -- 172.21.15.135:0/1062955671 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48400048c0 con 0x55d0a3368640 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f482eff5640 1 -- 172.21.15.135:0/1062955671 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f4840004a60 con 0x55d0a3368640 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f4854078740 1 -- 172.21.15.135:0/1062955671 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48440a0f00 con 0x55d0a3368640 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f482eff5640 1 -- 172.21.15.135:0/1062955671 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f484005a050 con 0x55d0a3368640 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f4854078740 10 client.17019 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:33.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f4854078740 1 -- 172.21.15.135:0/1062955671 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d0a2f9f0f0 con 0x55d0a3368640 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.567+0000 7f482eff5640 1 -- 172.21.15.135:0/1062955671 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48440a0f00 con 0x55d0a3368640 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.568+0000 7f482eff5640 1 -- 172.21.15.135:0/1062955671 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f484004c720 con 0x55d0a3368640 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.568+0000 7f4854078740 10 client.17019 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.568+0000 7f4854078740 10 client.17019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.568+0000 7f4854078740 20 client.17019 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.568+0000 7f4854078740 1 --2- 172.21.15.135:0/1062955671 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0a3381610 0x55d0a3383a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.568+0000 7f4854078740 4 client.17019 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.568+0000 7f4854078740 1 -- 172.21.15.135:0/1062955671 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0a32dabd0 con 0x55d0a3381610 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.568+0000 7f484affd640 1 --2- 172.21.15.135:0/1062955671 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0a3381610 0x55d0a3383a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.568+0000 7f484affd640 1 --2- 172.21.15.135:0/1062955671 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0a3381610 0x55d0a3383a50 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ae0f8e20464469c server_cookie=d231d45a421519c2 in_seq=0 out_seq=0 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.568+0000 7f482eff5640 10 client.17019 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.569+0000 7f482eff5640 1 -- 172.21.15.135:0/1062955671 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d0a32dabd0 con 0x55d0a3381610 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.569+0000 7f482eff5640 10 client.17019 handle_command_reply: tid=0 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.569+0000 7f4854078740 1 client.17019 shutdown 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.569+0000 7f4854078740 1 -- 172.21.15.135:0/1062955671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3368640 msgr2=0x55d0a336e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:33.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.569+0000 7f4854078740 1 --2- 172.21.15.135:0/1062955671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3368640 0x55d0a336e7c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f48400096c0 tx=0x7f484002bc30 comp rx=0 tx=0).stop 2024-04-20T12:27:33.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.569+0000 7f4854078740 1 -- 172.21.15.135:0/1062955671 shutdown_connections 2024-04-20T12:27:33.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.569+0000 7f4854078740 1 --2- 172.21.15.135:0/1062955671 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0a3381610 0x55d0a3383a50 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.569+0000 7f4854078740 1 --2- 172.21.15.135:0/1062955671 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3371220 0x55d0a336ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.569+0000 7f4854078740 1 --2- 172.21.15.135:0/1062955671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3368640 0x55d0a336e7c0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.569+0000 7f482eff5640 0 client.17019 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:33.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.569+0000 7f4854078740 1 --2- 172.21.15.135:0/1062955671 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3367d20 0x55d0a336e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.569+0000 7f4854078740 1 -- 172.21.15.135:0/1062955671 >> 172.21.15.135:0/1062955671 conn(0x55d0a3362450 msgr2=0x55d0a33641a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:33.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.569+0000 7f4854078740 1 -- 172.21.15.135:0/1062955671 shutdown_connections 2024-04-20T12:27:33.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.569+0000 7f4854078740 1 -- 172.21.15.135:0/1062955671 wait complete. 2024-04-20T12:27:33.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.569+0000 7f4854078740 20 client.17019 trim_cache size 0 max 16384 2024-04-20T12:27:33.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f4854078740 1 Processor -- start 2024-04-20T12:27:33.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f4854078740 1 -- start start 2024-04-20T12:27:33.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f4854078740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3367d20 0x55d0a33709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f4854078740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3368640 0x55d0a337ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f4854078740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a33614b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f4854078740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f484c1af430 con 0x55d0a3371220 2024-04-20T12:27:33.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f4854078740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f484c1b0f70 con 0x55d0a3367d20 2024-04-20T12:27:33.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f4854078740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f484c1afb00 con 0x55d0a3368640 2024-04-20T12:27:33.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f484b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a33614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f484b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a33614b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56346/0 (socket says 172.21.15.135:56346) 2024-04-20T12:27:33.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f484b7fe640 1 -- 172.21.15.135:0/3718069028 learned_addr learned my addr 172.21.15.135:0/3718069028 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:33.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f484b7fe640 1 -- 172.21.15.135:0/3718069028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3368640 msgr2=0x55d0a337ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:33.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f484b7fe640 1 --2- 172.21.15.135:0/3718069028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3368640 0x55d0a337ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f484b7fe640 1 -- 172.21.15.135:0/3718069028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3367d20 msgr2=0x55d0a33709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:33.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f484b7fe640 1 --2- 172.21.15.135:0/3718069028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3367d20 0x55d0a33709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.587+0000 7f484b7fe640 1 -- 172.21.15.135:0/3718069028 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0a3368470 con 0x55d0a3371220 2024-04-20T12:27:33.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.588+0000 7f484b7fe640 1 --2- 172.21.15.135:0/3718069028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a33614b0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f48440ce3b0 tx=0x7f4844098e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a59d38775728ea server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:33.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.588+0000 7f4830ff9640 1 -- 172.21.15.135:0/3718069028 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48440b5070 con 0x55d0a3371220 2024-04-20T12:27:33.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.588+0000 7f4830ff9640 1 -- 172.21.15.135:0/3718069028 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48440bd0b0 con 0x55d0a3371220 2024-04-20T12:27:33.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.588+0000 7f4830ff9640 1 -- 172.21.15.135:0/3718069028 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484401d040 con 0x55d0a3371220 2024-04-20T12:27:33.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.588+0000 7f4854078740 1 -- 172.21.15.135:0/3718069028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 msgr2=0x55d0a33614b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:33.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.588+0000 7f4854078740 1 --2- 172.21.15.135:0/3718069028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a33614b0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f48440ce3b0 tx=0x7f4844098e60 comp rx=0 tx=0).stop 2024-04-20T12:27:33.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.588+0000 7f4854078740 1 -- 172.21.15.135:0/3718069028 shutdown_connections 2024-04-20T12:27:33.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.588+0000 7f4854078740 1 --2- 172.21.15.135:0/3718069028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a33614b0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.588+0000 7f4854078740 1 --2- 172.21.15.135:0/3718069028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3368640 0x55d0a337ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.588+0000 7f4854078740 1 --2- 172.21.15.135:0/3718069028 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3367d20 0x55d0a33709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.588+0000 7f4854078740 1 -- 172.21.15.135:0/3718069028 >> 172.21.15.135:0/3718069028 conn(0x55d0a3362450 msgr2=0x55d0a3360da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:33.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.588+0000 7f4854078740 1 -- 172.21.15.135:0/3718069028 shutdown_connections 2024-04-20T12:27:33.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.588+0000 7f4854078740 1 -- 172.21.15.135:0/3718069028 wait complete. 2024-04-20T12:27:33.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f4854078740 1 -- start start 2024-04-20T12:27:33.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f4854078740 1 Processor -- start 2024-04-20T12:27:33.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f4854078740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3367d20 0x55d0a33796a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f4854078740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3368640 0x55d0a3376a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f4854078740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a3376f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f4854078740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f484c1b08a0 con 0x55d0a3371220 2024-04-20T12:27:33.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f4854078740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f484c1b01d0 con 0x55d0a3367d20 2024-04-20T12:27:33.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f4854078740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f484c1ad400 con 0x55d0a3368640 2024-04-20T12:27:33.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f4854078740 10 client.0 _ll_register_callbacks cb 0x7f4840009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:33.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f484b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a3376f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f484b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a3376f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56362/0 (socket says 172.21.15.135:56362) 2024-04-20T12:27:33.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f484b7fe640 1 -- 172.21.15.135:0/1210752772 learned_addr learned my addr 172.21.15.135:0/1210752772 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:33.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f484b7fe640 1 -- 172.21.15.135:0/1210752772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3368640 msgr2=0x55d0a3376a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:33.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f484b7fe640 1 --2- 172.21.15.135:0/1210752772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3368640 0x55d0a3376a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f484b7fe640 1 -- 172.21.15.135:0/1210752772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3367d20 msgr2=0x55d0a33796a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f484b7fe640 1 --2- 172.21.15.135:0/1210752772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3367d20 0x55d0a33796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f484b7fe640 1 -- 172.21.15.135:0/1210752772 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0a33776b0 con 0x55d0a3371220 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f484b7fe640 1 --2- 172.21.15.135:0/1210752772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a3376f70 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f484409ca90 tx=0x7f48440a1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64ef8badc1f035f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f482eff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.589+0000 7f482eff5640 1 -- 172.21.15.135:0/1210752772 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484401d070 con 0x55d0a3371220 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.590+0000 7f482eff5640 1 -- 172.21.15.135:0/1210752772 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f48440a5530 con 0x55d0a3371220 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.590+0000 7f4854078740 1 -- 172.21.15.135:0/1210752772 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48440bd0b0 con 0x55d0a3371220 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.590+0000 7f482eff5640 1 -- 172.21.15.135:0/1210752772 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f48440b5050 con 0x55d0a3371220 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.590+0000 7f4854078740 10 client.17025 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.590+0000 7f4854078740 1 -- 172.21.15.135:0/1210752772 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d0a33e7ae0 con 0x55d0a3371220 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.590+0000 7f482eff5640 1 -- 172.21.15.135:0/1210752772 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48440bd0b0 con 0x55d0a3371220 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.590+0000 7f482eff5640 1 -- 172.21.15.135:0/1210752772 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f484409ba10 con 0x55d0a3371220 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.590+0000 7f4854078740 10 client.17025 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.590+0000 7f4854078740 10 client.17025 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.590+0000 7f4854078740 20 client.17025 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.590+0000 7f4854078740 1 --2- 172.21.15.135:0/1210752772 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0a33e7d60 0x55d0a33ea150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.590+0000 7f4854078740 4 client.17025 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:27:33.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.590+0000 7f4854078740 1 -- 172.21.15.135:0/1210752772 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d0a32d4a40 con 0x55d0a33e7d60 2024-04-20T12:27:33.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.590+0000 7f484affd640 1 --2- 172.21.15.135:0/1210752772 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0a33e7d60 0x55d0a33ea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f482eff5640 10 client.17025 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:33.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f484affd640 1 --2- 172.21.15.135:0/1210752772 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0a33e7d60 0x55d0a33ea150 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a96be9cf31f25f6 server_cookie=2604ad50620ab36b in_seq=0 out_seq=0 2024-04-20T12:27:33.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f482eff5640 1 -- 172.21.15.135:0/1210752772 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d0a32d4a40 con 0x55d0a33e7d60 2024-04-20T12:27:33.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f482eff5640 10 client.17025 handle_command_reply: tid=0 2024-04-20T12:27:33.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f4854078740 1 client.17025 shutdown 2024-04-20T12:27:33.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f4854078740 1 -- 172.21.15.135:0/1210752772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 msgr2=0x55d0a3376f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:33.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f4854078740 1 --2- 172.21.15.135:0/1210752772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a3376f70 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f484409ca90 tx=0x7f48440a1040 comp rx=0 tx=0).stop 2024-04-20T12:27:33.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f4854078740 1 -- 172.21.15.135:0/1210752772 shutdown_connections 2024-04-20T12:27:33.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f4854078740 1 --2- 172.21.15.135:0/1210752772 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0a33e7d60 0x55d0a33ea150 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f4854078740 1 --2- 172.21.15.135:0/1210752772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0a3371220 0x55d0a3376f70 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f482eff5640 0 client.17025 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:33.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f4854078740 1 --2- 172.21.15.135:0/1210752772 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0a3368640 0x55d0a3376a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f4854078740 1 --2- 172.21.15.135:0/1210752772 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0a3367d20 0x55d0a33796a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f4854078740 1 -- 172.21.15.135:0/1210752772 >> 172.21.15.135:0/1210752772 conn(0x55d0a3362450 msgr2=0x55d0a336eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:33.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f4854078740 1 -- 172.21.15.135:0/1210752772 shutdown_connections 2024-04-20T12:27:33.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f4854078740 1 -- 172.21.15.135:0/1210752772 wait complete. 2024-04-20T12:27:33.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.591+0000 7f4854078740 20 client.17025 trim_cache size 0 max 16384 2024-04-20T12:27:33.597 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:27:33.597 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:27:33.597 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:27:33.597 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:27:33.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.592+0000 7f4851481640 1 -- 172.21.15.135:0/3360523470 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f48340a3d20 msgr2=0x7f48340a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:33.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.592+0000 7f4851481640 1 --2- 172.21.15.135:0/3360523470 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f48340a3d20 0x7f48340a61e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4840006010 tx=0x7f4840005df0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.592+0000 7f4851481640 1 -- 172.21.15.135:0/3360523470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f484c1985c0 msgr2=0x7f484c198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:33.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.592+0000 7f4851481640 1 --2- 172.21.15.135:0/3360523470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f484c1985c0 0x7f484c198a70 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f484400cad0 tx=0x7f484400cf90 comp rx=0 tx=0).stop 2024-04-20T12:27:33.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.592+0000 7f4851481640 1 -- 172.21.15.135:0/3360523470 shutdown_connections 2024-04-20T12:27:33.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.592+0000 7f4851481640 1 --2- 172.21.15.135:0/3360523470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f484c1985c0 0x7f484c198a70 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.592+0000 7f4851481640 1 --2- 172.21.15.135:0/3360523470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f484c107270 0x7f484c19e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.592+0000 7f4851481640 1 --2- 172.21.15.135:0/3360523470 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f48340a3d20 0x7f48340a61e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.592+0000 7f4851481640 1 --2- 172.21.15.135:0/3360523470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f484c1021a0 0x7f484c19e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.592+0000 7f4851481640 1 -- 172.21.15.135:0/3360523470 >> 172.21.15.135:0/3360523470 conn(0x7f484c0793b0 msgr2=0x7f484c0ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:33.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.592+0000 7f4851481640 1 -- 172.21.15.135:0/3360523470 shutdown_connections 2024-04-20T12:27:33.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.592+0000 7f4851481640 1 -- 172.21.15.135:0/3360523470 wait complete. 2024-04-20T12:27:33.602 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:27:33.603 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:27:33.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.701+0000 7fcd023b6640 1 -- 172.21.15.135:0/3632851252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccfc100d70 msgr2=0x7fccfc101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:33.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.701+0000 7fcd023b6640 1 --2- 172.21.15.135:0/3632851252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccfc100d70 0x7fccfc101150 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009900 tx=0x7fccf002bc30 comp rx=0 tx=0).stop 2024-04-20T12:27:33.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.701+0000 7fcd023b6640 1 -- 172.21.15.135:0/3632851252 shutdown_connections 2024-04-20T12:27:33.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.701+0000 7fcd023b6640 1 --2- 172.21.15.135:0/3632851252 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc10e920 0x7fccfc110d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.701+0000 7fcd023b6640 1 --2- 172.21.15.135:0/3632851252 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccfc101690 0x7fccfc10e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.701+0000 7fcd023b6640 1 --2- 172.21.15.135:0/3632851252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccfc100d70 0x7fccfc101150 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.701+0000 7fcd023b6640 1 -- 172.21.15.135:0/3632851252 >> 172.21.15.135:0/3632851252 conn(0x7fccfc077f60 msgr2=0x7fccfc078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:33.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.701+0000 7fcd023b6640 1 -- 172.21.15.135:0/3632851252 shutdown_connections 2024-04-20T12:27:33.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.701+0000 7fcd023b6640 1 -- 172.21.15.135:0/3632851252 wait complete. 2024-04-20T12:27:33.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.701+0000 7fcd023b6640 1 Processor -- start 2024-04-20T12:27:33.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.701+0000 7fcd023b6640 1 -- start start 2024-04-20T12:27:33.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd023b6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccfc100d70 0x7fccfc1a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd023b6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc101690 0x7fccfc1a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd023b6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccfc10e920 0x7fccfc19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd023b6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc1145b0 con 0x7fccfc10e920 2024-04-20T12:27:33.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd023b6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc114430 con 0x7fccfc100d70 2024-04-20T12:27:33.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd023b6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc114730 con 0x7fccfc101690 2024-04-20T12:27:33.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd00953640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccfc10e920 0x7fccfc19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd00953640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccfc10e920 0x7fccfc19a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56372/0 (socket says 172.21.15.135:56372) 2024-04-20T12:27:33.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd00953640 1 -- 172.21.15.135:0/998263345 learned_addr learned my addr 172.21.15.135:0/998263345 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:33.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fccfb7fe640 1 --2- 172.21.15.135:0/998263345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc101690 0x7fccfc1a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fccfbfff640 1 --2- 172.21.15.135:0/998263345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccfc100d70 0x7fccfc1a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd00953640 1 -- 172.21.15.135:0/998263345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc101690 msgr2=0x7fccfc1a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:33.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd00953640 1 --2- 172.21.15.135:0/998263345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc101690 0x7fccfc1a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd00953640 1 -- 172.21.15.135:0/998263345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccfc100d70 msgr2=0x7fccfc1a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:33.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd00953640 1 --2- 172.21.15.135:0/998263345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccfc100d70 0x7fccfc1a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd00953640 1 -- 172.21.15.135:0/998263345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccfc19afc0 con 0x7fccfc10e920 2024-04-20T12:27:33.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fccfb7fe640 1 --2- 172.21.15.135:0/998263345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc101690 0x7fccfc1a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:33.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd00953640 1 --2- 172.21.15.135:0/998263345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccfc10e920 0x7fccfc19a7f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fccf400b9e0 tx=0x7fccf400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:33.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fccf97fa640 1 -- 172.21.15.135:0/998263345 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf4019070 con 0x7fccfc10e920 2024-04-20T12:27:33.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fccf97fa640 1 -- 172.21.15.135:0/998263345 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccf4014440 con 0x7fccfc10e920 2024-04-20T12:27:33.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fcd023b6640 1 -- 172.21.15.135:0/998263345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccfc19b2b0 con 0x7fccfc10e920 2024-04-20T12:27:33.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.702+0000 7fccf97fa640 1 -- 172.21.15.135:0/998263345 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf40125c0 con 0x7fccfc10e920 2024-04-20T12:27:33.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.703+0000 7fcd023b6640 1 -- 172.21.15.135:0/998263345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccfc1a74d0 con 0x7fccfc10e920 2024-04-20T12:27:33.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.704+0000 7fcd023b6640 1 -- 172.21.15.135:0/998263345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccfc0698f0 con 0x7fccfc10e920 2024-04-20T12:27:33.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.705+0000 7fccf97fa640 1 -- 172.21.15.135:0/998263345 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fccf401c070 con 0x7fccfc10e920 2024-04-20T12:27:33.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.705+0000 7fccf97fa640 1 --2- 172.21.15.135:0/998263345 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcce40a3d20 0x7fcce40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:33.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.706+0000 7fccfbfff640 1 --2- 172.21.15.135:0/998263345 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcce40a3d20 0x7fcce40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:33.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.706+0000 7fccf97fa640 1 -- 172.21.15.135:0/998263345 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fccf40d0680 con 0x7fccfc10e920 2024-04-20T12:27:33.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.706+0000 7fccfbfff640 1 --2- 172.21.15.135:0/998263345 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcce40a3d20 0x7fcce40a61e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fccf0000c00 tx=0x7fccf002cf90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:33.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.709+0000 7fccf97fa640 1 -- 172.21.15.135:0/998263345 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fccf409cab0 con 0x7fccfc10e920 2024-04-20T12:27:33.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.927+0000 7fcd023b6640 1 -- 172.21.15.135:0/998263345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fccfc1a77d0 con 0x7fccfc10e920 2024-04-20T12:27:33.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.927+0000 7fccf97fa640 1 -- 172.21.15.135:0/998263345 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7fccf409c3b0 con 0x7fccfc10e920 2024-04-20T12:27:33.927 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:27:33.927 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:27:33.928 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:27:33.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.929+0000 7fcd023b6640 1 -- 172.21.15.135:0/998263345 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcce40a3d20 msgr2=0x7fcce40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:33.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.929+0000 7fcd023b6640 1 --2- 172.21.15.135:0/998263345 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcce40a3d20 0x7fcce40a61e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fccf0000c00 tx=0x7fccf002cf90 comp rx=0 tx=0).stop 2024-04-20T12:27:33.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.929+0000 7fcd023b6640 1 -- 172.21.15.135:0/998263345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccfc10e920 msgr2=0x7fccfc19a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:33.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.929+0000 7fcd023b6640 1 --2- 172.21.15.135:0/998263345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccfc10e920 0x7fccfc19a7f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fccf400b9e0 tx=0x7fccf400bea0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.929+0000 7fcd023b6640 1 -- 172.21.15.135:0/998263345 shutdown_connections 2024-04-20T12:27:33.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.929+0000 7fcd023b6640 1 --2- 172.21.15.135:0/998263345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fccfc10e920 0x7fccfc19a7f0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.929+0000 7fcd023b6640 1 --2- 172.21.15.135:0/998263345 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcce40a3d20 0x7fcce40a61e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.929+0000 7fcd023b6640 1 --2- 172.21.15.135:0/998263345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fccfc101690 0x7fccfc1a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.929+0000 7fcd023b6640 1 --2- 172.21.15.135:0/998263345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fccfc100d70 0x7fccfc1a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:33.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.929+0000 7fcd023b6640 1 -- 172.21.15.135:0/998263345 >> 172.21.15.135:0/998263345 conn(0x7fccfc077f60 msgr2=0x7fccfc0ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:33.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.930+0000 7fcd023b6640 1 -- 172.21.15.135:0/998263345 shutdown_connections 2024-04-20T12:27:33.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:33.930+0000 7fcd023b6640 1 -- 172.21.15.135:0/998263345 wait complete. 2024-04-20T12:27:33.940 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:27:34.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.042+0000 7fae542a8640 1 -- 172.21.15.135:0/3643609044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4c1031d0 msgr2=0x7fae4c1035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.042+0000 7fae542a8640 1 --2- 172.21.15.135:0/3643609044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4c1031d0 0x7fae4c1035b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fae48009900 tx=0x7fae4802bd60 comp rx=0 tx=0).stop 2024-04-20T12:27:34.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.042+0000 7fae542a8640 1 -- 172.21.15.135:0/3643609044 shutdown_connections 2024-04-20T12:27:34.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.042+0000 7fae542a8640 1 --2- 172.21.15.135:0/3643609044 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae4c10c510 0x7fae4c10e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.042+0000 7fae542a8640 1 --2- 172.21.15.135:0/3643609044 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae4c103af0 0x7fae4c10bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.042+0000 7fae542a8640 1 --2- 172.21.15.135:0/3643609044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4c1031d0 0x7fae4c1035b0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.042+0000 7fae542a8640 1 -- 172.21.15.135:0/3643609044 >> 172.21.15.135:0/3643609044 conn(0x7fae4c078010 msgr2=0x7fae4c078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.042+0000 7fae542a8640 1 -- 172.21.15.135:0/3643609044 shutdown_connections 2024-04-20T12:27:34.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.042+0000 7fae542a8640 1 -- 172.21.15.135:0/3643609044 wait complete. 2024-04-20T12:27:34.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.043+0000 7fae542a8640 1 Processor -- start 2024-04-20T12:27:34.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.043+0000 7fae542a8640 1 -- start start 2024-04-20T12:27:34.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.043+0000 7fae542a8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae4c1031d0 0x7fae4c1a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.043+0000 7fae542a8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae4c103af0 0x7fae4c1a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.043+0000 7fae542a8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4c10c510 0x7fae4c19a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.043+0000 7fae542a8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fae4c112320 con 0x7fae4c10c510 2024-04-20T12:27:34.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.043+0000 7fae542a8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fae4c1121a0 con 0x7fae4c1031d0 2024-04-20T12:27:34.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.043+0000 7fae542a8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae4c1124a0 con 0x7fae4c103af0 2024-04-20T12:27:34.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.043+0000 7fae52845640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4c10c510 0x7fae4c19a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.043+0000 7fae52044640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae4c1031d0 0x7fae4c1a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.043+0000 7fae52845640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4c10c510 0x7fae4c19a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56394/0 (socket says 172.21.15.135:56394) 2024-04-20T12:27:34.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.043+0000 7fae52845640 1 -- 172.21.15.135:0/714464503 learned_addr learned my addr 172.21.15.135:0/714464503 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.044+0000 7fae51843640 1 --2- 172.21.15.135:0/714464503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae4c103af0 0x7fae4c1a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.044+0000 7fae52845640 1 -- 172.21.15.135:0/714464503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae4c103af0 msgr2=0x7fae4c1a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.044+0000 7fae52845640 1 --2- 172.21.15.135:0/714464503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae4c103af0 0x7fae4c1a0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.044+0000 7fae52845640 1 -- 172.21.15.135:0/714464503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae4c1031d0 msgr2=0x7fae4c1a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.044+0000 7fae52845640 1 --2- 172.21.15.135:0/714464503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae4c1031d0 0x7fae4c1a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.044+0000 7fae52845640 1 -- 172.21.15.135:0/714464503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4c19b020 con 0x7fae4c10c510 2024-04-20T12:27:34.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.044+0000 7fae52845640 1 --2- 172.21.15.135:0/714464503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4c10c510 0x7fae4c19a8a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fae4400cce0 tx=0x7fae4400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.044+0000 7fae437fe640 1 -- 172.21.15.135:0/714464503 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4400f450 con 0x7fae4c10c510 2024-04-20T12:27:34.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.044+0000 7fae437fe640 1 -- 172.21.15.135:0/714464503 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae4400fad0 con 0x7fae4c10c510 2024-04-20T12:27:34.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.044+0000 7fae542a8640 1 -- 172.21.15.135:0/714464503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae4c19b310 con 0x7fae4c10c510 2024-04-20T12:27:34.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.044+0000 7fae437fe640 1 -- 172.21.15.135:0/714464503 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae44018c10 con 0x7fae4c10c510 2024-04-20T12:27:34.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.044+0000 7fae542a8640 1 -- 172.21.15.135:0/714464503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae4c1a75b0 con 0x7fae4c10c510 2024-04-20T12:27:34.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.047+0000 7fae437fe640 1 -- 172.21.15.135:0/714464503 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fae4400f5f0 con 0x7fae4c10c510 2024-04-20T12:27:34.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.047+0000 7fae56f7a740 1 Processor -- start 2024-04-20T12:27:34.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.047+0000 7fae56f7a740 1 -- start start 2024-04-20T12:27:34.052 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.047+0000 7fae56f7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7143e10 0x55a2d71441f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.047+0000 7fae56f7a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d714cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.047+0000 7fae56f7a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d714d310 0x55a2d714f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.047+0000 7fae56f7a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a2d70a9110 con 0x55a2d7144730 2024-04-20T12:27:34.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.047+0000 7fae56f7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a2d7046550 con 0x55a2d7143e10 2024-04-20T12:27:34.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.047+0000 7fae56f7a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a2d70a50d0 con 0x55a2d714d310 2024-04-20T12:27:34.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.047+0000 7fae52044640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d714cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.047+0000 7fae52044640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d714cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56408/0 (socket says 172.21.15.135:56408) 2024-04-20T12:27:34.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.047+0000 7fae52044640 1 -- 172.21.15.135:0/1525192568 learned_addr learned my addr 172.21.15.135:0/1525192568 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.047+0000 7fae437fe640 1 --2- 172.21.15.135:0/714464503 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fae380a3d20 0x7fae380a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.048+0000 7fae51843640 1 --2- 172.21.15.135:0/1525192568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7143e10 0x55a2d71441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.048+0000 7fae51843640 1 --2- 172.21.15.135:0/1525192568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d714d310 0x55a2d714f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.048+0000 7fae52845640 1 --2- 172.21.15.135:0/714464503 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fae380a3d20 0x7fae380a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.048+0000 7fae52044640 1 -- 172.21.15.135:0/1525192568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d714d310 msgr2=0x55a2d714f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.048+0000 7fae52044640 1 --2- 172.21.15.135:0/1525192568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d714d310 0x55a2d714f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.048+0000 7fae437fe640 1 -- 172.21.15.135:0/714464503 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fae440d1210 con 0x7fae4c10c510 2024-04-20T12:27:34.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.048+0000 7fae52044640 1 -- 172.21.15.135:0/1525192568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7143e10 msgr2=0x55a2d71441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.048+0000 7fae52044640 1 --2- 172.21.15.135:0/1525192568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7143e10 0x55a2d71441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.048+0000 7fae52044640 1 -- 172.21.15.135:0/1525192568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2d706e900 con 0x55a2d7144730 2024-04-20T12:27:34.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.048+0000 7fae52044640 1 --2- 172.21.15.135:0/1525192568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d714cdd0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fae48036040 tx=0x7fae4802c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f72a3c8c113a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.048+0000 7fae52845640 1 --2- 172.21.15.135:0/714464503 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fae380a3d20 0x7fae380a61e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae440ce690 tx=0x7fae440922c0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.048+0000 7fae40bfe640 1 -- 172.21.15.135:0/1525192568 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48043070 con 0x55a2d7144730 2024-04-20T12:27:34.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.048+0000 7fae40bfe640 1 -- 172.21.15.135:0/1525192568 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae4802c9b0 con 0x55a2d7144730 2024-04-20T12:27:34.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.048+0000 7fae40bfe640 1 -- 172.21.15.135:0/1525192568 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48004c90 con 0x55a2d7144730 2024-04-20T12:27:34.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.049+0000 7fae56f7a740 1 -- 172.21.15.135:0/1525192568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 msgr2=0x55a2d714cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.049+0000 7fae56f7a740 1 --2- 172.21.15.135:0/1525192568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d714cdd0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fae48036040 tx=0x7fae4802c780 comp rx=0 tx=0).stop 2024-04-20T12:27:34.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.049+0000 7fae56f7a740 1 -- 172.21.15.135:0/1525192568 shutdown_connections 2024-04-20T12:27:34.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.049+0000 7fae56f7a740 1 --2- 172.21.15.135:0/1525192568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d714d310 0x55a2d714f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.049+0000 7fae56f7a740 1 --2- 172.21.15.135:0/1525192568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d714cdd0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.049+0000 7fae56f7a740 1 --2- 172.21.15.135:0/1525192568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7143e10 0x55a2d71441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.049+0000 7fae56f7a740 1 -- 172.21.15.135:0/1525192568 >> 172.21.15.135:0/1525192568 conn(0x55a2d713e540 msgr2=0x55a2d713e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.049+0000 7fae56f7a740 1 -- 172.21.15.135:0/1525192568 shutdown_connections 2024-04-20T12:27:34.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.049+0000 7fae56f7a740 1 -- 172.21.15.135:0/1525192568 wait complete. 2024-04-20T12:27:34.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.049+0000 7fae56f7a740 1 -- start start 2024-04-20T12:27:34.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.049+0000 7fae56f7a740 1 Processor -- start 2024-04-20T12:27:34.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae56f7a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d7143e10 0x55a2d714a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae56f7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7144730 0x55a2d714a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae56f7a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d714d310 0x55a2d714ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae56f7a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a2d7150040 con 0x55a2d714d310 2024-04-20T12:27:34.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae56f7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a2d7062500 con 0x55a2d7144730 2024-04-20T12:27:34.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae56f7a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a2d71501c0 con 0x55a2d7143e10 2024-04-20T12:27:34.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae56f7a740 10 client.0 _ll_register_callbacks cb 0x55a2d70472f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:34.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae51843640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d714d310 0x55a2d714ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae51843640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d714d310 0x55a2d714ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56412/0 (socket says 172.21.15.135:56412) 2024-04-20T12:27:34.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae51843640 1 -- 172.21.15.135:0/948010052 learned_addr learned my addr 172.21.15.135:0/948010052 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae52044640 1 --2- 172.21.15.135:0/948010052 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7144730 0x55a2d714a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae51843640 1 --2- 172.21.15.135:0/948010052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d7143e10 0x55a2d714a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae51843640 1 -- 172.21.15.135:0/948010052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d7143e10 msgr2=0x55a2d714a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae51843640 1 --2- 172.21.15.135:0/948010052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d7143e10 0x55a2d714a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae51843640 1 -- 172.21.15.135:0/948010052 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7144730 msgr2=0x55a2d714a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae51843640 1 --2- 172.21.15.135:0/948010052 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7144730 0x55a2d714a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae51843640 1 -- 172.21.15.135:0/948010052 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2d6dbb3f0 con 0x55a2d714d310 2024-04-20T12:27:34.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae51843640 1 --2- 172.21.15.135:0/948010052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d714d310 0x55a2d714ad90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00cff0 tx=0x7fae3c016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad582a98397f274 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:34.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae35ffb640 1 -- 172.21.15.135:0/948010052 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3c0140d0 con 0x55a2d714d310 2024-04-20T12:27:34.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae35ffb640 1 -- 172.21.15.135:0/948010052 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fae3c014270 con 0x55a2d714d310 2024-04-20T12:27:34.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.050+0000 7fae56f7a740 1 -- 172.21.15.135:0/948010052 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae4802c9b0 con 0x55a2d714d310 2024-04-20T12:27:34.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.051+0000 7fae35ffb640 1 -- 172.21.15.135:0/948010052 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fae3c028050 con 0x55a2d714d310 2024-04-20T12:27:34.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.051+0000 7fae56f7a740 10 client.17043 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:34.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.051+0000 7fae56f7a740 1 -- 172.21.15.135:0/948010052 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a2d6e857d0 con 0x55a2d714d310 2024-04-20T12:27:34.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.051+0000 7fae35ffb640 1 -- 172.21.15.135:0/948010052 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae4802c9b0 con 0x55a2d714d310 2024-04-20T12:27:34.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.051+0000 7fae35ffb640 1 -- 172.21.15.135:0/948010052 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fae3c003b20 con 0x55a2d714d310 2024-04-20T12:27:34.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.051+0000 7fae56f7a740 10 client.17043 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:34.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.051+0000 7fae56f7a740 10 client.17043 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:27:34.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.051+0000 7fae56f7a740 20 client.17043 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:34.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.051+0000 7fae56f7a740 1 --2- 172.21.15.135:0/948010052 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55a2d715d590 0x55a2d715f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.051+0000 7fae56f7a740 4 client.17043 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:34.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.051+0000 7fae56f7a740 1 -- 172.21.15.135:0/948010052 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2d70b6b30 con 0x55a2d715d590 2024-04-20T12:27:34.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.051+0000 7fae52044640 1 --2- 172.21.15.135:0/948010052 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55a2d715d590 0x55a2d715f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.051+0000 7fae52044640 1 --2- 172.21.15.135:0/948010052 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55a2d715d590 0x55a2d715f9e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=60f051b5ff496c4a server_cookie=f49e0745936a77a4 in_seq=0 out_seq=0 2024-04-20T12:27:34.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.051+0000 7fae35ffb640 10 client.17043 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:27:34.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.052+0000 7fae35ffb640 1 -- 172.21.15.135:0/948010052 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a2d70b6b30 con 0x55a2d715d590 2024-04-20T12:27:34.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.052+0000 7fae35ffb640 10 client.17043 handle_command_reply: tid=0 2024-04-20T12:27:34.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.052+0000 7fae56f7a740 1 client.17043 shutdown 2024-04-20T12:27:34.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.052+0000 7fae56f7a740 1 -- 172.21.15.135:0/948010052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d714d310 msgr2=0x55a2d714ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.052+0000 7fae56f7a740 1 --2- 172.21.15.135:0/948010052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d714d310 0x55a2d714ad90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00cff0 tx=0x7fae3c016040 comp rx=0 tx=0).stop 2024-04-20T12:27:34.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.052+0000 7fae56f7a740 1 -- 172.21.15.135:0/948010052 shutdown_connections 2024-04-20T12:27:34.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.052+0000 7fae56f7a740 1 --2- 172.21.15.135:0/948010052 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55a2d715d590 0x55a2d715f9e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.052+0000 7fae56f7a740 1 --2- 172.21.15.135:0/948010052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d714d310 0x55a2d714ad90 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.052+0000 7fae56f7a740 1 --2- 172.21.15.135:0/948010052 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7144730 0x55a2d714a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.052+0000 7fae35ffb640 0 client.17043 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:27:34.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.052+0000 7fae56f7a740 1 --2- 172.21.15.135:0/948010052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d7143e10 0x55a2d714a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.052+0000 7fae56f7a740 1 -- 172.21.15.135:0/948010052 >> 172.21.15.135:0/948010052 conn(0x55a2d713e540 msgr2=0x55a2d7140290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.052+0000 7fae56f7a740 1 -- 172.21.15.135:0/948010052 shutdown_connections 2024-04-20T12:27:34.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.052+0000 7fae56f7a740 1 -- 172.21.15.135:0/948010052 wait complete. 2024-04-20T12:27:34.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.052+0000 7fae56f7a740 20 client.17043 trim_cache size 0 max 16384 2024-04-20T12:27:34.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.065+0000 7fae56f7a740 1 Processor -- start 2024-04-20T12:27:34.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.065+0000 7fae56f7a740 1 -- start start 2024-04-20T12:27:34.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.065+0000 7fae56f7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7143e10 0x55a2d7158f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.065+0000 7fae56f7a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d7149470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.065+0000 7fae56f7a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d714d310 0x55a2d714c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.065+0000 7fae56f7a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fae4c1b1490 con 0x55a2d7144730 2024-04-20T12:27:34.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.065+0000 7fae56f7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fae4c1b2fd0 con 0x55a2d7143e10 2024-04-20T12:27:34.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.065+0000 7fae56f7a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae4c1b1b60 con 0x55a2d714d310 2024-04-20T12:27:34.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.065+0000 7fae52044640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d7149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.065+0000 7fae52044640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d7149470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56422/0 (socket says 172.21.15.135:56422) 2024-04-20T12:27:34.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.065+0000 7fae52044640 1 -- 172.21.15.135:0/2736709274 learned_addr learned my addr 172.21.15.135:0/2736709274 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.066+0000 7fae51843640 1 --2- 172.21.15.135:0/2736709274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7143e10 0x55a2d7158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.066+0000 7fae52044640 1 -- 172.21.15.135:0/2736709274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d714d310 msgr2=0x55a2d714c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.066+0000 7fae52044640 1 --2- 172.21.15.135:0/2736709274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d714d310 0x55a2d714c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.066+0000 7fae52044640 1 -- 172.21.15.135:0/2736709274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7143e10 msgr2=0x55a2d7158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.066+0000 7fae52044640 1 --2- 172.21.15.135:0/2736709274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7143e10 0x55a2d7158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.066+0000 7fae52044640 1 -- 172.21.15.135:0/2736709274 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2d7139be0 con 0x55a2d7144730 2024-04-20T12:27:34.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.066+0000 7fae51843640 1 --2- 172.21.15.135:0/2736709274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7143e10 0x55a2d7158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:34.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.066+0000 7fae52044640 1 --2- 172.21.15.135:0/2736709274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d7149470 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fae48006010 tx=0x7fae4802bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee3b7f454f7a84a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.066+0000 7fae37fff640 1 -- 172.21.15.135:0/2736709274 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48043040 con 0x55a2d7144730 2024-04-20T12:27:34.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.066+0000 7fae37fff640 1 -- 172.21.15.135:0/2736709274 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae48054070 con 0x55a2d7144730 2024-04-20T12:27:34.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.066+0000 7fae37fff640 1 -- 172.21.15.135:0/2736709274 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48048450 con 0x55a2d7144730 2024-04-20T12:27:34.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 -- 172.21.15.135:0/2736709274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 msgr2=0x55a2d7149470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 --2- 172.21.15.135:0/2736709274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d7149470 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fae48006010 tx=0x7fae4802bd60 comp rx=0 tx=0).stop 2024-04-20T12:27:34.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 -- 172.21.15.135:0/2736709274 shutdown_connections 2024-04-20T12:27:34.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 --2- 172.21.15.135:0/2736709274 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d714d310 0x55a2d714c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 --2- 172.21.15.135:0/2736709274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d7149470 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 --2- 172.21.15.135:0/2736709274 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d7143e10 0x55a2d7158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 -- 172.21.15.135:0/2736709274 >> 172.21.15.135:0/2736709274 conn(0x55a2d713e540 msgr2=0x55a2d714ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 -- 172.21.15.135:0/2736709274 shutdown_connections 2024-04-20T12:27:34.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 -- 172.21.15.135:0/2736709274 wait complete. 2024-04-20T12:27:34.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 -- start start 2024-04-20T12:27:34.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 Processor -- start 2024-04-20T12:27:34.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d7143e10 0x55a2d71551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d71556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d714d310 0x55a2d7150620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fae4c1b2900 con 0x55a2d7144730 2024-04-20T12:27:34.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fae4c1b2230 con 0x55a2d714d310 2024-04-20T12:27:34.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fae4c1af460 con 0x55a2d7143e10 2024-04-20T12:27:34.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae56f7a740 10 client.0 _ll_register_callbacks cb 0x7fae3c00cd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:34.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae52044640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d71556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae52044640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d71556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56430/0 (socket says 172.21.15.135:56430) 2024-04-20T12:27:34.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae52044640 1 -- 172.21.15.135:0/384082284 learned_addr learned my addr 172.21.15.135:0/384082284 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae51843640 1 --2- 172.21.15.135:0/384082284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d714d310 0x55a2d7150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae52044640 1 -- 172.21.15.135:0/384082284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d7143e10 msgr2=0x55a2d71551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae52044640 1 --2- 172.21.15.135:0/384082284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d7143e10 0x55a2d71551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae52044640 1 -- 172.21.15.135:0/384082284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d714d310 msgr2=0x55a2d7150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae52044640 1 --2- 172.21.15.135:0/384082284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d714d310 0x55a2d7150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.067+0000 7fae52044640 1 -- 172.21.15.135:0/384082284 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2d7150db0 con 0x55a2d7144730 2024-04-20T12:27:34.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae51843640 1 --2- 172.21.15.135:0/384082284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d714d310 0x55a2d7150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:27:34.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae52044640 1 --2- 172.21.15.135:0/384082284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d71556f0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fae4802c2a0 tx=0x7fae4802c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4940ee3766ac9448 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:34.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae35ffb640 1 -- 172.21.15.135:0/384082284 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48043040 con 0x55a2d7144730 2024-04-20T12:27:34.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae56f7a740 1 -- 172.21.15.135:0/384082284 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae48054070 con 0x55a2d7144730 2024-04-20T12:27:34.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae35ffb640 1 -- 172.21.15.135:0/384082284 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fae480046c0 con 0x55a2d7144730 2024-04-20T12:27:34.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae35ffb640 1 -- 172.21.15.135:0/384082284 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fae4804f040 con 0x55a2d7144730 2024-04-20T12:27:34.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae56f7a740 10 client.17049 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:34.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae56f7a740 1 -- 172.21.15.135:0/384082284 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a2d71cbd70 con 0x55a2d7144730 2024-04-20T12:27:34.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae35ffb640 1 -- 172.21.15.135:0/384082284 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae48054070 con 0x55a2d7144730 2024-04-20T12:27:34.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae35ffb640 1 -- 172.21.15.135:0/384082284 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fae48058890 con 0x55a2d7144730 2024-04-20T12:27:34.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae56f7a740 10 client.17049 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:34.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae56f7a740 10 client.17049 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:27:34.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae56f7a740 20 client.17049 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:34.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae56f7a740 1 --2- 172.21.15.135:0/384082284 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55a2d71cc0c0 0x55a2d71ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae56f7a740 4 client.17049 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:27:34.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.068+0000 7fae56f7a740 1 -- 172.21.15.135:0/384082284 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a2d70b09a0 con 0x55a2d71cc0c0 2024-04-20T12:27:34.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae51843640 1 --2- 172.21.15.135:0/384082284 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55a2d71cc0c0 0x55a2d71ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae35ffb640 10 client.17049 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:27:34.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae51843640 1 --2- 172.21.15.135:0/384082284 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55a2d71cc0c0 0x55a2d71ce4e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b2e0aaac2c4a1e64 server_cookie=83244823796956d3 in_seq=0 out_seq=0 2024-04-20T12:27:34.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae35ffb640 1 -- 172.21.15.135:0/384082284 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a2d70b09a0 con 0x55a2d71cc0c0 2024-04-20T12:27:34.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae35ffb640 10 client.17049 handle_command_reply: tid=0 2024-04-20T12:27:34.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae56f7a740 1 client.17049 shutdown 2024-04-20T12:27:34.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae56f7a740 1 -- 172.21.15.135:0/384082284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 msgr2=0x55a2d71556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae56f7a740 1 --2- 172.21.15.135:0/384082284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d71556f0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fae4802c2a0 tx=0x7fae4802c9b0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae56f7a740 1 -- 172.21.15.135:0/384082284 shutdown_connections 2024-04-20T12:27:34.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae56f7a740 1 --2- 172.21.15.135:0/384082284 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55a2d71cc0c0 0x55a2d71ce4e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae56f7a740 1 --2- 172.21.15.135:0/384082284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a2d714d310 0x55a2d7150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae56f7a740 1 --2- 172.21.15.135:0/384082284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2d7144730 0x55a2d71556f0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae35ffb640 0 client.17049 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:27:34.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae56f7a740 1 --2- 172.21.15.135:0/384082284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a2d7143e10 0x55a2d71551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae56f7a740 1 -- 172.21.15.135:0/384082284 >> 172.21.15.135:0/384082284 conn(0x55a2d713e540 msgr2=0x55a2d714a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae56f7a740 1 -- 172.21.15.135:0/384082284 shutdown_connections 2024-04-20T12:27:34.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae56f7a740 1 -- 172.21.15.135:0/384082284 wait complete. 2024-04-20T12:27:34.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.069+0000 7fae56f7a740 20 client.17049 trim_cache size 0 max 16384 2024-04-20T12:27:34.075 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:27:34.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.070+0000 7fae542a8640 1 -- 172.21.15.135:0/714464503 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fae380a3d20 msgr2=0x7fae380a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.070+0000 7fae542a8640 1 --2- 172.21.15.135:0/714464503 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fae380a3d20 0x7fae380a61e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae440ce690 tx=0x7fae440922c0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.070+0000 7fae542a8640 1 -- 172.21.15.135:0/714464503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4c10c510 msgr2=0x7fae4c19a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.070+0000 7fae542a8640 1 --2- 172.21.15.135:0/714464503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4c10c510 0x7fae4c19a8a0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fae4400cce0 tx=0x7fae4400a620 comp rx=0 tx=0).stop 2024-04-20T12:27:34.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.070+0000 7fae542a8640 1 -- 172.21.15.135:0/714464503 shutdown_connections 2024-04-20T12:27:34.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.070+0000 7fae542a8640 1 --2- 172.21.15.135:0/714464503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae4c10c510 0x7fae4c19a8a0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.070+0000 7fae542a8640 1 --2- 172.21.15.135:0/714464503 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fae380a3d20 0x7fae380a61e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.070+0000 7fae542a8640 1 --2- 172.21.15.135:0/714464503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fae4c103af0 0x7fae4c1a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.070+0000 7fae542a8640 1 --2- 172.21.15.135:0/714464503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fae4c1031d0 0x7fae4c1a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.070+0000 7fae542a8640 1 -- 172.21.15.135:0/714464503 >> 172.21.15.135:0/714464503 conn(0x7fae4c078010 msgr2=0x7fae4c102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.070+0000 7fae542a8640 1 -- 172.21.15.135:0/714464503 shutdown_connections 2024-04-20T12:27:34.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.070+0000 7fae542a8640 1 -- 172.21.15.135:0/714464503 wait complete. 2024-04-20T12:27:34.079 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:27:34.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.181+0000 7f6310552640 1 -- 172.21.15.135:0/384061552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6308103ae0 msgr2=0x7f630810bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.181+0000 7f6310552640 1 --2- 172.21.15.135:0/384061552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6308103ae0 0x7f630810bfc0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f62f8009900 tx=0x7f62f802bcd0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.181+0000 7f6310552640 1 -- 172.21.15.135:0/384061552 shutdown_connections 2024-04-20T12:27:34.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.181+0000 7f6310552640 1 --2- 172.21.15.135:0/384061552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630810c590 0x7f630810e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.181+0000 7f6310552640 1 --2- 172.21.15.135:0/384061552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6308103ae0 0x7f630810bfc0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.181+0000 7f6310552640 1 --2- 172.21.15.135:0/384061552 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f63081031c0 0x7f63081035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.181+0000 7f6310552640 1 -- 172.21.15.135:0/384061552 >> 172.21.15.135:0/384061552 conn(0x7f63080771e0 msgr2=0x7f63080775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.181+0000 7f6310552640 1 -- 172.21.15.135:0/384061552 shutdown_connections 2024-04-20T12:27:34.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.181+0000 7f6310552640 1 -- 172.21.15.135:0/384061552 wait complete. 2024-04-20T12:27:34.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.182+0000 7f6310552640 1 Processor -- start 2024-04-20T12:27:34.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.182+0000 7f6310552640 1 -- start start 2024-04-20T12:27:34.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.182+0000 7f6310552640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63081031c0 0x7f630819e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.182+0000 7f6310552640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6308103ae0 0x7f630819e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.182+0000 7f6310552640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630810c590 0x7f6308198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.182+0000 7f6310552640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6308112320 con 0x7f63081031c0 2024-04-20T12:27:34.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.182+0000 7f6310552640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f63081121a0 con 0x7f6308103ae0 2024-04-20T12:27:34.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.182+0000 7f6310552640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63081124a0 con 0x7f630810c590 2024-04-20T12:27:34.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.182+0000 7f630e2ee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63081031c0 0x7f630819e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.182+0000 7f630e2ee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63081031c0 0x7f630819e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56456/0 (socket says 172.21.15.135:56456) 2024-04-20T12:27:34.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.182+0000 7f630e2ee640 1 -- 172.21.15.135:0/2594273164 learned_addr learned my addr 172.21.15.135:0/2594273164 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.182+0000 7f630eaef640 1 --2- 172.21.15.135:0/2594273164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630810c590 0x7f6308198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.183+0000 7f630daed640 1 --2- 172.21.15.135:0/2594273164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6308103ae0 0x7f630819e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.183+0000 7f630e2ee640 1 -- 172.21.15.135:0/2594273164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630810c590 msgr2=0x7f6308198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.183+0000 7f630e2ee640 1 --2- 172.21.15.135:0/2594273164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630810c590 0x7f6308198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.183+0000 7f630e2ee640 1 -- 172.21.15.135:0/2594273164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6308103ae0 msgr2=0x7f630819e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.183+0000 7f630e2ee640 1 --2- 172.21.15.135:0/2594273164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6308103ae0 0x7f630819e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.183+0000 7f630e2ee640 1 -- 172.21.15.135:0/2594273164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6308198d80 con 0x7f63081031c0 2024-04-20T12:27:34.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.183+0000 7f630e2ee640 1 --2- 172.21.15.135:0/2594273164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63081031c0 0x7f630819e450 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f630400d950 tx=0x7f630400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.183+0000 7f62ff7fe640 1 -- 172.21.15.135:0/2594273164 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6304017070 con 0x7f63081031c0 2024-04-20T12:27:34.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.183+0000 7f6310552640 1 -- 172.21.15.135:0/2594273164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6308199070 con 0x7f63081031c0 2024-04-20T12:27:34.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.183+0000 7f62ff7fe640 1 -- 172.21.15.135:0/2594273164 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6304009c30 con 0x7f63081031c0 2024-04-20T12:27:34.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.183+0000 7f62ff7fe640 1 -- 172.21.15.135:0/2594273164 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630400f6b0 con 0x7f63081031c0 2024-04-20T12:27:34.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.183+0000 7f6310552640 1 -- 172.21.15.135:0/2594273164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63081a5310 con 0x7f63081031c0 2024-04-20T12:27:34.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.185+0000 7f62ff7fe640 1 -- 172.21.15.135:0/2594273164 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f63040109d0 con 0x7f63081031c0 2024-04-20T12:27:34.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.185+0000 7f6313225740 1 Processor -- start 2024-04-20T12:27:34.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f6313225740 1 -- start start 2024-04-20T12:27:34.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f6313225740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56309920ce10 0x56309920d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f6313225740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920d730 0x563099215dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f6313225740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563099216310 0x563099218700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f6313225740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563099172110 con 0x56309920ce10 2024-04-20T12:27:34.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f6313225740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56309910f550 con 0x563099216310 2024-04-20T12:27:34.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f6313225740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56309916e0d0 con 0x56309920d730 2024-04-20T12:27:34.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f62ff7fe640 1 --2- 172.21.15.135:0/2594273164 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f62f40a3d20 0x7f62f40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f630eaef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56309920ce10 0x56309920d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f630eaef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56309920ce10 0x56309920d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56460/0 (socket says 172.21.15.135:56460) 2024-04-20T12:27:34.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f630eaef640 1 -- 172.21.15.135:0/9717159 learned_addr learned my addr 172.21.15.135:0/9717159 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f630daed640 1 --2- 172.21.15.135:0/9717159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563099216310 0x563099218700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f630eaef640 1 --2- 172.21.15.135:0/2594273164 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f62f40a3d20 0x7f62f40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f62ff7fe640 1 -- 172.21.15.135:0/2594273164 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f63040d07d0 con 0x7f63081031c0 2024-04-20T12:27:34.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f630e2ee640 1 --2- 172.21.15.135:0/9717159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920d730 0x563099215dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f630eaef640 1 -- 172.21.15.135:0/9717159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920d730 msgr2=0x563099215dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f630eaef640 1 --2- 172.21.15.135:0/9717159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920d730 0x563099215dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f630eaef640 1 -- 172.21.15.135:0/9717159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563099216310 msgr2=0x563099218700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f630eaef640 1 --2- 172.21.15.135:0/9717159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563099216310 0x563099218700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.186+0000 7f630eaef640 1 -- 172.21.15.135:0/9717159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563099137900 con 0x56309920ce10 2024-04-20T12:27:34.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.187+0000 7f630eaef640 1 --2- 172.21.15.135:0/9717159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56309920ce10 0x56309920d1f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f6300014a20 tx=0x7f6300014ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9d068e2bc14b3e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.187+0000 7f62fcbfe640 1 -- 172.21.15.135:0/9717159 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300012c30 con 0x56309920ce10 2024-04-20T12:27:34.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.187+0000 7f62fcbfe640 1 -- 172.21.15.135:0/9717159 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6300023070 con 0x56309920ce10 2024-04-20T12:27:34.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.187+0000 7f62fcbfe640 1 -- 172.21.15.135:0/9717159 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63000139b0 con 0x56309920ce10 2024-04-20T12:27:34.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f630eaef640 1 --2- 172.21.15.135:0/2594273164 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f62f40a3d20 0x7f62f40a61e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6300022000 tx=0x7f6300020000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 -- 172.21.15.135:0/9717159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56309920ce10 msgr2=0x56309920d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 --2- 172.21.15.135:0/9717159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56309920ce10 0x56309920d1f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f6300014a20 tx=0x7f6300014ee0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 -- 172.21.15.135:0/9717159 shutdown_connections 2024-04-20T12:27:34.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 --2- 172.21.15.135:0/9717159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563099216310 0x563099218700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 --2- 172.21.15.135:0/9717159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920d730 0x563099215dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 --2- 172.21.15.135:0/9717159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56309920ce10 0x56309920d1f0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 -- 172.21.15.135:0/9717159 >> 172.21.15.135:0/9717159 conn(0x563099207540 msgr2=0x563099207920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 -- 172.21.15.135:0/9717159 shutdown_connections 2024-04-20T12:27:34.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 -- 172.21.15.135:0/9717159 wait complete. 2024-04-20T12:27:34.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 -- start start 2024-04-20T12:27:34.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 Processor -- start 2024-04-20T12:27:34.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920ce10 0x5630992134f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56309920d730 0x563099213a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563099216310 0x563099213f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563099218fe0 con 0x563099216310 2024-04-20T12:27:34.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56309912b500 con 0x56309920d730 2024-04-20T12:27:34.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563099219160 con 0x56309920ce10 2024-04-20T12:27:34.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f6313225740 10 client.0 _ll_register_callbacks cb 0x5630991102f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:34.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f630eaef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563099216310 0x563099213f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f630eaef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563099216310 0x563099213f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56466/0 (socket says 172.21.15.135:56466) 2024-04-20T12:27:34.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f630daed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56309920d730 0x563099213a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.188+0000 7f630eaef640 1 -- 172.21.15.135:0/1027658664 learned_addr learned my addr 172.21.15.135:0/1027658664 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.189+0000 7f630e2ee640 1 --2- 172.21.15.135:0/1027658664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920ce10 0x5630992134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.189+0000 7f630eaef640 1 -- 172.21.15.135:0/1027658664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920ce10 msgr2=0x5630992134f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.189+0000 7f630eaef640 1 --2- 172.21.15.135:0/1027658664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920ce10 0x5630992134f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.189+0000 7f630eaef640 1 -- 172.21.15.135:0/1027658664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56309920d730 msgr2=0x563099213a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.189+0000 7f630eaef640 1 --2- 172.21.15.135:0/1027658664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56309920d730 0x563099213a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.189+0000 7f630eaef640 1 -- 172.21.15.135:0/1027658664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563098e843f0 con 0x563099216310 2024-04-20T12:27:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.189+0000 7f630eaef640 1 --2- 172.21.15.135:0/1027658664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563099216310 0x563099213f70 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6300009640 tx=0x7f6300013400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70cf27a29d2ce26 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.189+0000 7f62f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.189+0000 7f62f1ffb640 1 -- 172.21.15.135:0/1027658664 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300037060 con 0x563099216310 2024-04-20T12:27:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.189+0000 7f6313225740 1 -- 172.21.15.135:0/1027658664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6300023070 con 0x563099216310 2024-04-20T12:27:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.189+0000 7f62f1ffb640 1 -- 172.21.15.135:0/1027658664 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f6300013cc0 con 0x563099216310 2024-04-20T12:27:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.189+0000 7f62f1ffb640 1 -- 172.21.15.135:0/1027658664 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f630003e050 con 0x563099216310 2024-04-20T12:27:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.189+0000 7f6313225740 10 client.17061 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.189+0000 7f6313225740 1 -- 172.21.15.135:0/1027658664 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563098f4e7d0 con 0x563099216310 2024-04-20T12:27:34.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.189+0000 7f62f1ffb640 1 -- 172.21.15.135:0/1027658664 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6300023070 con 0x563099216310 2024-04-20T12:27:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.190+0000 7f62f1ffb640 1 -- 172.21.15.135:0/1027658664 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f630000f040 con 0x563099216310 2024-04-20T12:27:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.190+0000 7f6313225740 10 client.17061 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.190+0000 7f6313225740 10 client.17061 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:27:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.190+0000 7f6313225740 20 client.17061 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.190+0000 7f6313225740 1 --2- 172.21.15.135:0/1027658664 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5630992265d0 0x5630992289c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.190+0000 7f6313225740 4 client.17061 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.190+0000 7f6313225740 1 -- 172.21.15.135:0/1027658664 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56309917fb30 con 0x5630992265d0 2024-04-20T12:27:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.190+0000 7f630e2ee640 1 --2- 172.21.15.135:0/1027658664 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5630992265d0 0x5630992289c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.190+0000 7f62f1ffb640 10 client.17061 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:27:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.190+0000 7f630e2ee640 1 --2- 172.21.15.135:0/1027658664 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5630992265d0 0x5630992289c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=37c3377803d12d2f server_cookie=b3e95315e6f90c18 in_seq=0 out_seq=0 2024-04-20T12:27:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.191+0000 7f62f1ffb640 1 -- 172.21.15.135:0/1027658664 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56309917fb30 con 0x5630992265d0 2024-04-20T12:27:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.191+0000 7f62f1ffb640 10 client.17061 handle_command_reply: tid=0 2024-04-20T12:27:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.191+0000 7f6313225740 1 client.17061 shutdown 2024-04-20T12:27:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.191+0000 7f6313225740 1 -- 172.21.15.135:0/1027658664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563099216310 msgr2=0x563099213f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.191+0000 7f6313225740 1 --2- 172.21.15.135:0/1027658664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563099216310 0x563099213f70 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6300009640 tx=0x7f6300013400 comp rx=0 tx=0).stop 2024-04-20T12:27:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.191+0000 7f6313225740 1 -- 172.21.15.135:0/1027658664 shutdown_connections 2024-04-20T12:27:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.191+0000 7f6313225740 1 --2- 172.21.15.135:0/1027658664 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5630992265d0 0x5630992289c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.191+0000 7f6313225740 1 --2- 172.21.15.135:0/1027658664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563099216310 0x563099213f70 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.191+0000 7f6313225740 1 --2- 172.21.15.135:0/1027658664 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56309920d730 0x563099213a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.191+0000 7f62f1ffb640 0 client.17061 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:27:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.191+0000 7f6313225740 1 --2- 172.21.15.135:0/1027658664 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920ce10 0x5630992134f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.191+0000 7f6313225740 1 -- 172.21.15.135:0/1027658664 >> 172.21.15.135:0/1027658664 conn(0x563099207540 msgr2=0x563099209290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.191+0000 7f6313225740 1 -- 172.21.15.135:0/1027658664 shutdown_connections 2024-04-20T12:27:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.191+0000 7f6313225740 1 -- 172.21.15.135:0/1027658664 wait complete. 2024-04-20T12:27:34.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.191+0000 7f6313225740 20 client.17061 trim_cache size 0 max 16384 2024-04-20T12:27:34.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f6313225740 1 Processor -- start 2024-04-20T12:27:34.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f6313225740 1 -- start start 2024-04-20T12:27:34.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f6313225740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56309920ce10 0x563099215c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f6313225740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920d730 0x563099213d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f6313225740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563099216310 0x56309922e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f6313225740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f63081af4a0 con 0x563099216310 2024-04-20T12:27:34.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f6313225740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f63081b0fe0 con 0x56309920ce10 2024-04-20T12:27:34.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f6313225740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63081afb70 con 0x56309920d730 2024-04-20T12:27:34.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f630eaef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563099216310 0x56309922e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f630eaef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563099216310 0x56309922e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56468/0 (socket says 172.21.15.135:56468) 2024-04-20T12:27:34.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f630eaef640 1 -- 172.21.15.135:0/1909528298 learned_addr learned my addr 172.21.15.135:0/1909528298 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f630daed640 1 --2- 172.21.15.135:0/1909528298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920d730 0x563099213d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f630e2ee640 1 --2- 172.21.15.135:0/1909528298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56309920ce10 0x563099215c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f630eaef640 1 -- 172.21.15.135:0/1909528298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920d730 msgr2=0x563099213d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f630eaef640 1 --2- 172.21.15.135:0/1909528298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920d730 0x563099213d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f630eaef640 1 -- 172.21.15.135:0/1909528298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56309920ce10 msgr2=0x563099215c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f630eaef640 1 --2- 172.21.15.135:0/1909528298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56309920ce10 0x563099215c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f630eaef640 1 -- 172.21.15.135:0/1909528298 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563099218a70 con 0x563099216310 2024-04-20T12:27:34.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.205+0000 7f630daed640 1 --2- 172.21.15.135:0/1909528298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920d730 0x563099213d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:27:34.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.206+0000 7f630eaef640 1 --2- 172.21.15.135:0/1909528298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563099216310 0x56309922e150 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6300004a20 tx=0x7f6300004c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f03f6647e3c0e9c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.206+0000 7f62f3fff640 1 -- 172.21.15.135:0/1909528298 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300037030 con 0x563099216310 2024-04-20T12:27:34.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.206+0000 7f62f3fff640 1 -- 172.21.15.135:0/1909528298 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6300023040 con 0x563099216310 2024-04-20T12:27:34.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.206+0000 7f62f3fff640 1 -- 172.21.15.135:0/1909528298 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6300013cc0 con 0x563099216310 2024-04-20T12:27:34.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.206+0000 7f6313225740 1 -- 172.21.15.135:0/1909528298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563099216310 msgr2=0x56309922e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.206+0000 7f6313225740 1 --2- 172.21.15.135:0/1909528298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563099216310 0x56309922e150 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6300004a20 tx=0x7f6300004c10 comp rx=0 tx=0).stop 2024-04-20T12:27:34.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.206+0000 7f6313225740 1 -- 172.21.15.135:0/1909528298 shutdown_connections 2024-04-20T12:27:34.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.206+0000 7f6313225740 1 --2- 172.21.15.135:0/1909528298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563099216310 0x56309922e150 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.206+0000 7f6313225740 1 --2- 172.21.15.135:0/1909528298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56309920d730 0x563099213d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.206+0000 7f6313225740 1 --2- 172.21.15.135:0/1909528298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56309920ce10 0x563099215c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.206+0000 7f6313225740 1 -- 172.21.15.135:0/1909528298 >> 172.21.15.135:0/1909528298 conn(0x563099207540 msgr2=0x5630992066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.206+0000 7f6313225740 1 -- 172.21.15.135:0/1909528298 shutdown_connections 2024-04-20T12:27:34.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.206+0000 7f6313225740 1 -- 172.21.15.135:0/1909528298 wait complete. 2024-04-20T12:27:34.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f6313225740 1 -- start start 2024-04-20T12:27:34.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f6313225740 1 Processor -- start 2024-04-20T12:27:34.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f6313225740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56309920ce10 0x56309921e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f6313225740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56309920d730 0x5630992199d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f6313225740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563099216310 0x563099219f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f6313225740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f63081b0910 con 0x56309920ce10 2024-04-20T12:27:34.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f6313225740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f63081b0240 con 0x56309920d730 2024-04-20T12:27:34.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f6313225740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f63081ad470 con 0x563099216310 2024-04-20T12:27:34.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f6313225740 10 client.0 _ll_register_callbacks cb 0x7f62f8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:34.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f630e2ee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56309920ce10 0x56309921e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f630e2ee640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56309920ce10 0x56309921e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56478/0 (socket says 172.21.15.135:56478) 2024-04-20T12:27:34.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f630e2ee640 1 -- 172.21.15.135:0/633014195 learned_addr learned my addr 172.21.15.135:0/633014195 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f630daed640 1 --2- 172.21.15.135:0/633014195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56309920d730 0x5630992199d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f630eaef640 1 --2- 172.21.15.135:0/633014195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563099216310 0x563099219f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f630e2ee640 1 -- 172.21.15.135:0/633014195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563099216310 msgr2=0x563099219f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f630e2ee640 1 --2- 172.21.15.135:0/633014195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563099216310 0x563099219f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f630e2ee640 1 -- 172.21.15.135:0/633014195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56309920d730 msgr2=0x5630992199d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f630e2ee640 1 --2- 172.21.15.135:0/633014195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56309920d730 0x5630992199d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f630e2ee640 1 -- 172.21.15.135:0/633014195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56309921a600 con 0x56309920ce10 2024-04-20T12:27:34.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f630e2ee640 1 --2- 172.21.15.135:0/633014195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56309920ce10 0x56309921e660 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f63040ce1a0 tx=0x7f6304005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbc3bee5714bc8b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.207+0000 7f62f1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:34.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.208+0000 7f62f1ffb640 1 -- 172.21.15.135:0/633014195 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6304020040 con 0x56309920ce10 2024-04-20T12:27:34.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.208+0000 7f62f1ffb640 1 -- 172.21.15.135:0/633014195 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f6304098a60 con 0x56309920ce10 2024-04-20T12:27:34.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.208+0000 7f6313225740 1 -- 172.21.15.135:0/633014195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6300023040 con 0x56309920ce10 2024-04-20T12:27:34.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.208+0000 7f62f1ffb640 1 -- 172.21.15.135:0/633014195 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f63040a07a0 con 0x56309920ce10 2024-04-20T12:27:34.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.208+0000 7f6313225740 10 client.17067 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.208+0000 7f6313225740 1 -- 172.21.15.135:0/633014195 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56309928c890 con 0x56309920ce10 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.208+0000 7f62f1ffb640 1 -- 172.21.15.135:0/633014195 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6300023040 con 0x56309920ce10 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.208+0000 7f62f1ffb640 1 -- 172.21.15.135:0/633014195 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f63040cf040 con 0x56309920ce10 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.208+0000 7f6313225740 10 client.17067 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.208+0000 7f6313225740 10 client.17067 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.208+0000 7f6313225740 20 client.17067 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.208+0000 7f6313225740 1 --2- 172.21.15.135:0/633014195 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5630992265d0 0x56309928eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.208+0000 7f6313225740 4 client.17067 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.208+0000 7f6313225740 1 -- 172.21.15.135:0/633014195 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5630991799a0 con 0x5630992265d0 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.208+0000 7f630daed640 1 --2- 172.21.15.135:0/633014195 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5630992265d0 0x56309928eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f630daed640 1 --2- 172.21.15.135:0/633014195 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5630992265d0 0x56309928eff0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2dfe23235772053d server_cookie=f42411de8795d261 in_seq=0 out_seq=0 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f62f1ffb640 10 client.17067 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f62f1ffb640 1 -- 172.21.15.135:0/633014195 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5630991799a0 con 0x5630992265d0 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f62f1ffb640 10 client.17067 handle_command_reply: tid=0 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f6313225740 1 client.17067 shutdown 2024-04-20T12:27:34.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f6313225740 1 -- 172.21.15.135:0/633014195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56309920ce10 msgr2=0x56309921e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f6313225740 1 --2- 172.21.15.135:0/633014195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56309920ce10 0x56309921e660 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f63040ce1a0 tx=0x7f6304005880 comp rx=0 tx=0).stop 2024-04-20T12:27:34.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f6313225740 1 -- 172.21.15.135:0/633014195 shutdown_connections 2024-04-20T12:27:34.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f6313225740 1 --2- 172.21.15.135:0/633014195 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5630992265d0 0x56309928eff0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f6313225740 1 --2- 172.21.15.135:0/633014195 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563099216310 0x563099219f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f62f1ffb640 0 client.17067 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:27:34.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f6313225740 1 --2- 172.21.15.135:0/633014195 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56309920d730 0x5630992199d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f6313225740 1 --2- 172.21.15.135:0/633014195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56309920ce10 0x56309921e660 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f6313225740 1 -- 172.21.15.135:0/633014195 >> 172.21.15.135:0/633014195 conn(0x563099207540 msgr2=0x5630992088c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f6313225740 1 -- 172.21.15.135:0/633014195 shutdown_connections 2024-04-20T12:27:34.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f6313225740 1 -- 172.21.15.135:0/633014195 wait complete. 2024-04-20T12:27:34.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.209+0000 7f6313225740 20 client.17067 trim_cache size 0 max 16384 2024-04-20T12:27:34.215 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:27:34.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.210+0000 7f6310552640 1 -- 172.21.15.135:0/2594273164 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f62f40a3d20 msgr2=0x7f62f40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.210+0000 7f6310552640 1 --2- 172.21.15.135:0/2594273164 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f62f40a3d20 0x7f62f40a61e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6300022000 tx=0x7f6300020000 comp rx=0 tx=0).stop 2024-04-20T12:27:34.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.210+0000 7f6310552640 1 -- 172.21.15.135:0/2594273164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63081031c0 msgr2=0x7f630819e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.210+0000 7f6310552640 1 --2- 172.21.15.135:0/2594273164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63081031c0 0x7f630819e450 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f630400d950 tx=0x7f630400de10 comp rx=0 tx=0).stop 2024-04-20T12:27:34.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.210+0000 7f6310552640 1 -- 172.21.15.135:0/2594273164 shutdown_connections 2024-04-20T12:27:34.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.210+0000 7f6310552640 1 --2- 172.21.15.135:0/2594273164 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f62f40a3d20 0x7f62f40a61e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.210+0000 7f6310552640 1 --2- 172.21.15.135:0/2594273164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630810c590 0x7f6308198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.210+0000 7f6310552640 1 --2- 172.21.15.135:0/2594273164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6308103ae0 0x7f630819e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.210+0000 7f6310552640 1 --2- 172.21.15.135:0/2594273164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f63081031c0 0x7f630819e450 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.210+0000 7f6310552640 1 -- 172.21.15.135:0/2594273164 >> 172.21.15.135:0/2594273164 conn(0x7f63080771e0 msgr2=0x7f63080fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.210+0000 7f6310552640 1 -- 172.21.15.135:0/2594273164 shutdown_connections 2024-04-20T12:27:34.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.210+0000 7f6310552640 1 -- 172.21.15.135:0/2594273164 wait complete. 2024-04-20T12:27:34.219 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:27:34.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.320+0000 7fca13932640 1 -- 172.21.15.135:0/1352553447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c102b60 msgr2=0x7fca0c106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.320+0000 7fca13932640 1 --2- 172.21.15.135:0/1352553447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c102b60 0x7fca0c106ba0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009900 tx=0x7fc9fc02bc30 comp rx=0 tx=0).stop 2024-04-20T12:27:34.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.320+0000 7fca13932640 1 -- 172.21.15.135:0/1352553447 shutdown_connections 2024-04-20T12:27:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.320+0000 7fca13932640 1 --2- 172.21.15.135:0/1352553447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca0c107280 0x7fca0c10ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.320+0000 7fca13932640 1 --2- 172.21.15.135:0/1352553447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c102b60 0x7fca0c106ba0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.320+0000 7fca13932640 1 --2- 172.21.15.135:0/1352553447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca0c1021b0 0x7fca0c102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.320+0000 7fca13932640 1 -- 172.21.15.135:0/1352553447 >> 172.21.15.135:0/1352553447 conn(0x7fca0c0793f0 msgr2=0x7fca0c079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.320+0000 7fca13932640 1 -- 172.21.15.135:0/1352553447 shutdown_connections 2024-04-20T12:27:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.320+0000 7fca13932640 1 -- 172.21.15.135:0/1352553447 wait complete. 2024-04-20T12:27:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca13932640 1 Processor -- start 2024-04-20T12:27:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca13932640 1 -- start start 2024-04-20T12:27:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca13932640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c1021b0 0x7fca0c19e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca13932640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca0c107280 0x7fca0c19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca13932640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca0c1985f0 0x7fca0c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca13932640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c1122f0 con 0x7fca0c1021b0 2024-04-20T12:27:34.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca13932640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c112170 con 0x7fca0c1985f0 2024-04-20T12:27:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca13932640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c112470 con 0x7fca0c107280 2024-04-20T12:27:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca116ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c1021b0 0x7fca0c19e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca116ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c1021b0 0x7fca0c19e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56504/0 (socket says 172.21.15.135:56504) 2024-04-20T12:27:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca116ce640 1 -- 172.21.15.135:0/657108312 learned_addr learned my addr 172.21.15.135:0/657108312 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca10ecd640 1 --2- 172.21.15.135:0/657108312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca0c107280 0x7fca0c19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca11ecf640 1 --2- 172.21.15.135:0/657108312 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca0c1985f0 0x7fca0c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca116ce640 1 -- 172.21.15.135:0/657108312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca0c107280 msgr2=0x7fca0c19e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca116ce640 1 --2- 172.21.15.135:0/657108312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca0c107280 0x7fca0c19e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca116ce640 1 -- 172.21.15.135:0/657108312 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca0c1985f0 msgr2=0x7fca0c198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca116ce640 1 --2- 172.21.15.135:0/657108312 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca0c1985f0 0x7fca0c198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.321+0000 7fca116ce640 1 -- 172.21.15.135:0/657108312 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0c199110 con 0x7fca0c1021b0 2024-04-20T12:27:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.322+0000 7fca116ce640 1 --2- 172.21.15.135:0/657108312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c1021b0 0x7fca0c19e440 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fca0800d950 tx=0x7fca0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.322+0000 7fca027fc640 1 -- 172.21.15.135:0/657108312 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08017070 con 0x7fca0c1021b0 2024-04-20T12:27:34.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.322+0000 7fca027fc640 1 -- 172.21.15.135:0/657108312 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca08009c30 con 0x7fca0c1021b0 2024-04-20T12:27:34.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.322+0000 7fca13932640 1 -- 172.21.15.135:0/657108312 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca0c199400 con 0x7fca0c1021b0 2024-04-20T12:27:34.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.322+0000 7fca027fc640 1 -- 172.21.15.135:0/657108312 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0800f6b0 con 0x7fca0c1021b0 2024-04-20T12:27:34.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.322+0000 7fca13932640 1 -- 172.21.15.135:0/657108312 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca0c1a56a0 con 0x7fca0c1021b0 2024-04-20T12:27:34.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.324+0000 7fca027fc640 1 -- 172.21.15.135:0/657108312 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fca080109d0 con 0x7fca0c1021b0 2024-04-20T12:27:34.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.324+0000 7fca16604740 1 Processor -- start 2024-04-20T12:27:34.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.324+0000 7fca16604740 1 -- start start 2024-04-20T12:27:34.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.324+0000 7fca16604740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b41361e10 0x557b413621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.324+0000 7fca16604740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41362730 0x557b4136add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.324+0000 7fca16604740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4136b310 0x557b4136d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca16604740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557b412c7110 con 0x557b4136b310 2024-04-20T12:27:34.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca16604740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557b41264550 con 0x557b41362730 2024-04-20T12:27:34.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca027fc640 1 --2- 172.21.15.135:0/657108312 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc9f80a3da0 0x7fc9f80a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca16604740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557b412c30d0 con 0x557b41361e10 2024-04-20T12:27:34.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca10ecd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4136b310 0x557b4136d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca11ecf640 1 --2- 172.21.15.135:0/657108312 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc9f80a3da0 0x7fc9f80a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca10ecd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4136b310 0x557b4136d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56510/0 (socket says 172.21.15.135:56510) 2024-04-20T12:27:34.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca10ecd640 1 -- 172.21.15.135:0/88829156 learned_addr learned my addr 172.21.15.135:0/88829156 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca116ce640 1 --2- 172.21.15.135:0/88829156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41362730 0x557b4136add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca11ecf640 1 --2- 172.21.15.135:0/88829156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b41361e10 0x557b413621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca027fc640 1 -- 172.21.15.135:0/657108312 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fca080d07e0 con 0x7fca0c1021b0 2024-04-20T12:27:34.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca10ecd640 1 -- 172.21.15.135:0/88829156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b41361e10 msgr2=0x557b413621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca10ecd640 1 --2- 172.21.15.135:0/88829156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b41361e10 0x557b413621f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca10ecd640 1 -- 172.21.15.135:0/88829156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41362730 msgr2=0x557b4136add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca10ecd640 1 --2- 172.21.15.135:0/88829156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41362730 0x557b4136add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca10ecd640 1 -- 172.21.15.135:0/88829156 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b4128c900 con 0x557b4136b310 2024-04-20T12:27:34.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca11ecf640 1 --2- 172.21.15.135:0/657108312 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc9f80a3da0 0x7fc9f80a6260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca040092f0 tx=0x7fca04009c30 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fca10ecd640 1 --2- 172.21.15.135:0/88829156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4136b310 0x557b4136d700 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fca0c06b680 tx=0x7fc9fc005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294a579efa545e9d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fc9f77fe640 1 -- 172.21.15.135:0/88829156 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc02ca80 con 0x557b4136b310 2024-04-20T12:27:34.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fc9f77fe640 1 -- 172.21.15.135:0/88829156 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9fc02cc20 con 0x557b4136b310 2024-04-20T12:27:34.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.325+0000 7fc9f77fe640 1 -- 172.21.15.135:0/88829156 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc0046c0 con 0x557b4136b310 2024-04-20T12:27:34.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.326+0000 7fca16604740 1 -- 172.21.15.135:0/88829156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4136b310 msgr2=0x557b4136d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.326+0000 7fca16604740 1 --2- 172.21.15.135:0/88829156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4136b310 0x557b4136d700 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fca0c06b680 tx=0x7fc9fc005e00 comp rx=0 tx=0).stop 2024-04-20T12:27:34.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.326+0000 7fca16604740 1 -- 172.21.15.135:0/88829156 shutdown_connections 2024-04-20T12:27:34.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.326+0000 7fca16604740 1 --2- 172.21.15.135:0/88829156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4136b310 0x557b4136d700 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.326+0000 7fca16604740 1 --2- 172.21.15.135:0/88829156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41362730 0x557b4136add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.326+0000 7fca16604740 1 --2- 172.21.15.135:0/88829156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b41361e10 0x557b413621f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.326+0000 7fca16604740 1 -- 172.21.15.135:0/88829156 >> 172.21.15.135:0/88829156 conn(0x557b4135c540 msgr2=0x557b4135c920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.326+0000 7fca16604740 1 -- 172.21.15.135:0/88829156 shutdown_connections 2024-04-20T12:27:34.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.326+0000 7fca16604740 1 -- 172.21.15.135:0/88829156 wait complete. 2024-04-20T12:27:34.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.326+0000 7fca16604740 1 -- start start 2024-04-20T12:27:34.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca16604740 1 Processor -- start 2024-04-20T12:27:34.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca16604740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 0x557b413682a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca16604740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b41362730 0x557b413687e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca16604740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b4136b310 0x557b41368d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca16604740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557b413724b0 con 0x557b41362730 2024-04-20T12:27:34.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca16604740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557b41280500 con 0x557b41361e10 2024-04-20T12:27:34.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca16604740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557b41372630 con 0x557b4136b310 2024-04-20T12:27:34.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca16604740 10 client.0 _ll_register_callbacks cb 0x557b412652f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:34.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca10ecd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b41362730 0x557b413687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca10ecd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b41362730 0x557b413687e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56514/0 (socket says 172.21.15.135:56514) 2024-04-20T12:27:34.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca10ecd640 1 -- 172.21.15.135:0/990458883 learned_addr learned my addr 172.21.15.135:0/990458883 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca116ce640 1 --2- 172.21.15.135:0/990458883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 0x557b413682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca11ecf640 1 --2- 172.21.15.135:0/990458883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b4136b310 0x557b41368d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca10ecd640 1 -- 172.21.15.135:0/990458883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b4136b310 msgr2=0x557b41368d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca10ecd640 1 --2- 172.21.15.135:0/990458883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b4136b310 0x557b41368d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca10ecd640 1 -- 172.21.15.135:0/990458883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 msgr2=0x557b413682a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca10ecd640 1 --2- 172.21.15.135:0/990458883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 0x557b413682a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.327+0000 7fca10ecd640 1 -- 172.21.15.135:0/990458883 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b40fd93f0 con 0x557b41362730 2024-04-20T12:27:34.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fca10ecd640 1 --2- 172.21.15.135:0/990458883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b41362730 0x557b413687e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc02cfd0 tx=0x7fc9fc02cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ff65d92ef1d0dd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fc9f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:34.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fc9f4ff9640 1 -- 172.21.15.135:0/990458883 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc0044c0 con 0x557b41362730 2024-04-20T12:27:34.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fc9f4ff9640 1 -- 172.21.15.135:0/990458883 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc9fc0035f0 con 0x557b41362730 2024-04-20T12:27:34.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fca16604740 1 -- 172.21.15.135:0/990458883 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9fc02cc20 con 0x557b41362730 2024-04-20T12:27:34.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fc9f4ff9640 1 -- 172.21.15.135:0/990458883 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc9fc058050 con 0x557b41362730 2024-04-20T12:27:34.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fca16604740 10 client.17079 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:34.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fca16604740 1 -- 172.21.15.135:0/990458883 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557b410a37d0 con 0x557b41362730 2024-04-20T12:27:34.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fc9f4ff9640 1 -- 172.21.15.135:0/990458883 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9fc02cc20 con 0x557b41362730 2024-04-20T12:27:34.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fc9f4ff9640 1 -- 172.21.15.135:0/990458883 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc9fc04fae0 con 0x557b41362730 2024-04-20T12:27:34.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fca16604740 10 client.17079 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:34.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fca16604740 10 client.17079 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:27:34.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fca16604740 20 client.17079 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:34.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fca16604740 1 --2- 172.21.15.135:0/990458883 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x557b4137f830 0x557b41381c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fca16604740 4 client.17079 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:34.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.328+0000 7fca16604740 1 -- 172.21.15.135:0/990458883 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b412d4b30 con 0x557b4137f830 2024-04-20T12:27:34.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.329+0000 7fca116ce640 1 --2- 172.21.15.135:0/990458883 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x557b4137f830 0x557b41381c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.329+0000 7fca116ce640 1 --2- 172.21.15.135:0/990458883 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x557b4137f830 0x557b41381c20 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cbcd58397d844ea9 server_cookie=8601b9fb1ead888e in_seq=0 out_seq=0 2024-04-20T12:27:34.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.329+0000 7fc9f4ff9640 10 client.17079 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:27:34.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.330+0000 7fc9f4ff9640 1 -- 172.21.15.135:0/990458883 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557b412d4b30 con 0x557b4137f830 2024-04-20T12:27:34.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.330+0000 7fc9f4ff9640 10 client.17079 handle_command_reply: tid=0 2024-04-20T12:27:34.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.330+0000 7fca16604740 1 client.17079 shutdown 2024-04-20T12:27:34.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.330+0000 7fca16604740 1 -- 172.21.15.135:0/990458883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b41362730 msgr2=0x557b413687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.330+0000 7fca16604740 1 --2- 172.21.15.135:0/990458883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b41362730 0x557b413687e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc02cfd0 tx=0x7fc9fc02cab0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.330+0000 7fca16604740 1 -- 172.21.15.135:0/990458883 shutdown_connections 2024-04-20T12:27:34.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.330+0000 7fca16604740 1 --2- 172.21.15.135:0/990458883 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x557b4137f830 0x557b41381c20 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.330+0000 7fca16604740 1 --2- 172.21.15.135:0/990458883 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b4136b310 0x557b41368d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.330+0000 7fca16604740 1 --2- 172.21.15.135:0/990458883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b41362730 0x557b413687e0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.330+0000 7fca16604740 1 --2- 172.21.15.135:0/990458883 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 0x557b413682a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.330+0000 7fc9f4ff9640 0 client.17079 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:27:34.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.330+0000 7fca16604740 1 -- 172.21.15.135:0/990458883 >> 172.21.15.135:0/990458883 conn(0x557b4135c540 msgr2=0x557b4135e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.330+0000 7fca16604740 1 -- 172.21.15.135:0/990458883 shutdown_connections 2024-04-20T12:27:34.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.330+0000 7fca16604740 1 -- 172.21.15.135:0/990458883 wait complete. 2024-04-20T12:27:34.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.330+0000 7fca16604740 20 client.17079 trim_cache size 0 max 16384 2024-04-20T12:27:34.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.345+0000 7fca16604740 1 Processor -- start 2024-04-20T12:27:34.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.345+0000 7fca16604740 1 -- start start 2024-04-20T12:27:34.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.345+0000 7fca16604740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 0x557b4136a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.345+0000 7fca16604740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b41362730 0x557b4137b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.345+0000 7fca16604740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b4136b310 0x557b413871f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.345+0000 7fca16604740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c1ad050 con 0x557b41362730 2024-04-20T12:27:34.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.345+0000 7fca16604740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c1aeb90 con 0x557b41361e10 2024-04-20T12:27:34.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.345+0000 7fca16604740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c1ad720 con 0x557b4136b310 2024-04-20T12:27:34.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.345+0000 7fca10ecd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b41362730 0x557b4137b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.345+0000 7fca10ecd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b41362730 0x557b4137b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56518/0 (socket says 172.21.15.135:56518) 2024-04-20T12:27:34.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.345+0000 7fca10ecd640 1 -- 172.21.15.135:0/1405619094 learned_addr learned my addr 172.21.15.135:0/1405619094 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.345+0000 7fca11ecf640 1 --2- 172.21.15.135:0/1405619094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b4136b310 0x557b413871f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.345+0000 7fca116ce640 1 --2- 172.21.15.135:0/1405619094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 0x557b4136a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.345+0000 7fca10ecd640 1 -- 172.21.15.135:0/1405619094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b4136b310 msgr2=0x557b413871f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.345+0000 7fca10ecd640 1 --2- 172.21.15.135:0/1405619094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b4136b310 0x557b413871f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.346+0000 7fca10ecd640 1 -- 172.21.15.135:0/1405619094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 msgr2=0x557b4136a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.346+0000 7fca10ecd640 1 --2- 172.21.15.135:0/1405619094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 0x557b4136a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.346+0000 7fca10ecd640 1 -- 172.21.15.135:0/1405619094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b41356af0 con 0x557b41362730 2024-04-20T12:27:34.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.346+0000 7fca116ce640 1 --2- 172.21.15.135:0/1405619094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 0x557b4136a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:34.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.346+0000 7fca10ecd640 1 --2- 172.21.15.135:0/1405619094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b41362730 0x557b4137b370 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009800 tx=0x7fc9fc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70ca229a0a64e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.346+0000 7fc9f6ffd640 1 -- 172.21.15.135:0/1405619094 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc0345c0 con 0x557b41362730 2024-04-20T12:27:34.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.346+0000 7fc9f6ffd640 1 -- 172.21.15.135:0/1405619094 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9fc04a070 con 0x557b41362730 2024-04-20T12:27:34.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.346+0000 7fc9f6ffd640 1 -- 172.21.15.135:0/1405619094 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc04f470 con 0x557b41362730 2024-04-20T12:27:34.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.347+0000 7fca16604740 1 -- 172.21.15.135:0/1405619094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b41362730 msgr2=0x557b4137b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.347+0000 7fca16604740 1 --2- 172.21.15.135:0/1405619094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b41362730 0x557b4137b370 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009800 tx=0x7fc9fc005fd0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.347+0000 7fca16604740 1 -- 172.21.15.135:0/1405619094 shutdown_connections 2024-04-20T12:27:34.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.347+0000 7fca16604740 1 --2- 172.21.15.135:0/1405619094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b4136b310 0x557b413871f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.347+0000 7fca16604740 1 --2- 172.21.15.135:0/1405619094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b41362730 0x557b4137b370 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.347+0000 7fca16604740 1 --2- 172.21.15.135:0/1405619094 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 0x557b4136a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.347+0000 7fca16604740 1 -- 172.21.15.135:0/1405619094 >> 172.21.15.135:0/1405619094 conn(0x557b4135c540 msgr2=0x557b4135b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.347+0000 7fca16604740 1 -- 172.21.15.135:0/1405619094 shutdown_connections 2024-04-20T12:27:34.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.347+0000 7fca16604740 1 -- 172.21.15.135:0/1405619094 wait complete. 2024-04-20T12:27:34.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.347+0000 7fca16604740 1 -- start start 2024-04-20T12:27:34.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.347+0000 7fca16604740 1 Processor -- start 2024-04-20T12:27:34.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.347+0000 7fca16604740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 0x557b41377870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.347+0000 7fca16604740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b41362730 0x557b41377db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca16604740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4136b310 0x557b41372e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca16604740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c1ae4c0 con 0x557b4136b310 2024-04-20T12:27:34.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca16604740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c1addf0 con 0x557b41361e10 2024-04-20T12:27:34.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca16604740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c1ab020 con 0x557b41362730 2024-04-20T12:27:34.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca16604740 10 client.0 _ll_register_callbacks cb 0x7fca08098030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:34.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca11ecf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4136b310 0x557b41372e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca11ecf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4136b310 0x557b41372e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56530/0 (socket says 172.21.15.135:56530) 2024-04-20T12:27:34.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca11ecf640 1 -- 172.21.15.135:0/3708477639 learned_addr learned my addr 172.21.15.135:0/3708477639 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca10ecd640 1 --2- 172.21.15.135:0/3708477639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b41362730 0x557b41377db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca116ce640 1 --2- 172.21.15.135:0/3708477639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 0x557b41377870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca11ecf640 1 -- 172.21.15.135:0/3708477639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b41362730 msgr2=0x557b41377db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca11ecf640 1 --2- 172.21.15.135:0/3708477639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b41362730 0x557b41377db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca11ecf640 1 -- 172.21.15.135:0/3708477639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 msgr2=0x557b41377870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca11ecf640 1 --2- 172.21.15.135:0/3708477639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 0x557b41377870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca11ecf640 1 -- 172.21.15.135:0/3708477639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b41373610 con 0x557b4136b310 2024-04-20T12:27:34.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca116ce640 1 --2- 172.21.15.135:0/3708477639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 0x557b41377870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:34.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca11ecf640 1 --2- 172.21.15.135:0/3708477639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4136b310 0x557b41372e10 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fca04014410 tx=0x7fca0401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0990f77bf2c578f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fc9f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:34.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fc9f4ff9640 1 -- 172.21.15.135:0/3708477639 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca04004b20 con 0x557b4136b310 2024-04-20T12:27:34.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca16604740 1 -- 172.21.15.135:0/3708477639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9fc04a070 con 0x557b4136b310 2024-04-20T12:27:34.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fc9f4ff9640 1 -- 172.21.15.135:0/3708477639 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fca04004cc0 con 0x557b4136b310 2024-04-20T12:27:34.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fc9f4ff9640 1 -- 172.21.15.135:0/3708477639 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fca04036050 con 0x557b4136b310 2024-04-20T12:27:34.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.348+0000 7fca16604740 10 client.17085 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:34.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.349+0000 7fca16604740 1 -- 172.21.15.135:0/3708477639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557b413e56e0 con 0x557b4136b310 2024-04-20T12:27:34.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.349+0000 7fc9f4ff9640 1 -- 172.21.15.135:0/3708477639 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9fc04a070 con 0x557b4136b310 2024-04-20T12:27:34.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.349+0000 7fc9f4ff9640 1 -- 172.21.15.135:0/3708477639 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fca0400f050 con 0x557b4136b310 2024-04-20T12:27:34.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.349+0000 7fca16604740 10 client.17085 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:34.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.349+0000 7fca16604740 10 client.17085 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:27:34.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.349+0000 7fca16604740 20 client.17085 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:34.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.349+0000 7fca16604740 1 --2- 172.21.15.135:0/3708477639 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x557b413e5e90 0x557b413e82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.349+0000 7fca16604740 4 client.17085 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:27:34.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.349+0000 7fca16604740 1 -- 172.21.15.135:0/3708477639 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557b412ce9a0 con 0x557b413e5e90 2024-04-20T12:27:34.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.349+0000 7fca116ce640 1 --2- 172.21.15.135:0/3708477639 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x557b413e5e90 0x557b413e82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fc9f4ff9640 10 client.17085 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:27:34.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fca116ce640 1 --2- 172.21.15.135:0/3708477639 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x557b413e5e90 0x557b413e82b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d705bfed98e37033 server_cookie=a9cbda7465b93cf in_seq=0 out_seq=0 2024-04-20T12:27:34.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fc9f4ff9640 1 -- 172.21.15.135:0/3708477639 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557b412ce9a0 con 0x557b413e5e90 2024-04-20T12:27:34.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fc9f4ff9640 10 client.17085 handle_command_reply: tid=0 2024-04-20T12:27:34.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fca16604740 1 client.17085 shutdown 2024-04-20T12:27:34.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fca16604740 1 -- 172.21.15.135:0/3708477639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4136b310 msgr2=0x557b41372e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fca16604740 1 --2- 172.21.15.135:0/3708477639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4136b310 0x557b41372e10 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fca04014410 tx=0x7fca0401b000 comp rx=0 tx=0).stop 2024-04-20T12:27:34.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fca16604740 1 -- 172.21.15.135:0/3708477639 shutdown_connections 2024-04-20T12:27:34.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fca16604740 1 --2- 172.21.15.135:0/3708477639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4136b310 0x557b41372e10 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fca16604740 1 --2- 172.21.15.135:0/3708477639 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x557b413e5e90 0x557b413e82b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fca16604740 1 --2- 172.21.15.135:0/3708477639 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b41362730 0x557b41377db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fca16604740 1 --2- 172.21.15.135:0/3708477639 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b41361e10 0x557b41377870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fca16604740 1 -- 172.21.15.135:0/3708477639 >> 172.21.15.135:0/3708477639 conn(0x557b4135c540 msgr2=0x557b4135ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fc9f4ff9640 0 client.17085 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:27:34.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fca16604740 1 -- 172.21.15.135:0/3708477639 shutdown_connections 2024-04-20T12:27:34.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fca16604740 1 -- 172.21.15.135:0/3708477639 wait complete. 2024-04-20T12:27:34.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.350+0000 7fca16604740 20 client.17085 trim_cache size 0 max 16384 2024-04-20T12:27:34.359 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:27:34.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.351+0000 7fca13932640 1 -- 172.21.15.135:0/657108312 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc9f80a3da0 msgr2=0x7fc9f80a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.351+0000 7fca13932640 1 --2- 172.21.15.135:0/657108312 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc9f80a3da0 0x7fc9f80a6260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca040092f0 tx=0x7fca04009c30 comp rx=0 tx=0).stop 2024-04-20T12:27:34.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.351+0000 7fca13932640 1 -- 172.21.15.135:0/657108312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c1021b0 msgr2=0x7fca0c19e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.351+0000 7fca13932640 1 --2- 172.21.15.135:0/657108312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c1021b0 0x7fca0c19e440 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fca0800d950 tx=0x7fca0800de10 comp rx=0 tx=0).stop 2024-04-20T12:27:34.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.351+0000 7fca13932640 1 -- 172.21.15.135:0/657108312 shutdown_connections 2024-04-20T12:27:34.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.351+0000 7fca13932640 1 --2- 172.21.15.135:0/657108312 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fca0c1985f0 0x7fca0c198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.351+0000 7fca13932640 1 --2- 172.21.15.135:0/657108312 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc9f80a3da0 0x7fc9f80a6260 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.351+0000 7fca13932640 1 --2- 172.21.15.135:0/657108312 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fca0c107280 0x7fca0c19e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.351+0000 7fca13932640 1 --2- 172.21.15.135:0/657108312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca0c1021b0 0x7fca0c19e440 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.351+0000 7fca13932640 1 -- 172.21.15.135:0/657108312 >> 172.21.15.135:0/657108312 conn(0x7fca0c0793f0 msgr2=0x7fca0c0ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.351+0000 7fca13932640 1 -- 172.21.15.135:0/657108312 shutdown_connections 2024-04-20T12:27:34.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.351+0000 7fca13932640 1 -- 172.21.15.135:0/657108312 wait complete. 2024-04-20T12:27:34.362 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:27:34.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.463+0000 7f387eb67640 1 -- 172.21.15.135:0/289607762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f387806a870 msgr2=0x7f387806ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.463+0000 7f387eb67640 1 --2- 172.21.15.135:0/289607762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f387806a870 0x7f387806ac50 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f386c009900 tx=0x7f386c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:27:34.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.463+0000 7f387eb67640 1 -- 172.21.15.135:0/289607762 shutdown_connections 2024-04-20T12:27:34.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.463+0000 7f387eb67640 1 --2- 172.21.15.135:0/289607762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3878107320 0x7f387810ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.463+0000 7f387eb67640 1 --2- 172.21.15.135:0/289607762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f387806b220 0x7f3878106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.463+0000 7f387eb67640 1 --2- 172.21.15.135:0/289607762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f387806a870 0x7f387806ac50 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.463+0000 7f387eb67640 1 -- 172.21.15.135:0/289607762 >> 172.21.15.135:0/289607762 conn(0x7f3878077c50 msgr2=0x7f3878078060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.463+0000 7f387eb67640 1 -- 172.21.15.135:0/289607762 shutdown_connections 2024-04-20T12:27:34.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.463+0000 7f387eb67640 1 -- 172.21.15.135:0/289607762 wait complete. 2024-04-20T12:27:34.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387eb67640 1 Processor -- start 2024-04-20T12:27:34.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387eb67640 1 -- start start 2024-04-20T12:27:34.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387eb67640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387806a870 0x7f387819e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387eb67640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3878107320 0x7f387819e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387eb67640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38781985d0 0x7f3878198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387eb67640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3878112370 con 0x7f38781985d0 2024-04-20T12:27:34.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387eb67640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f38781121f0 con 0x7f3878107320 2024-04-20T12:27:34.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387eb67640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38781124f0 con 0x7f387806a870 2024-04-20T12:27:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387d104640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38781985d0 0x7f3878198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387d104640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38781985d0 0x7f3878198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56538/0 (socket says 172.21.15.135:56538) 2024-04-20T12:27:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387d104640 1 -- 172.21.15.135:0/3255036758 learned_addr learned my addr 172.21.15.135:0/3255036758 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387c903640 1 --2- 172.21.15.135:0/3255036758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387806a870 0x7f387819e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f3877fff640 1 --2- 172.21.15.135:0/3255036758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3878107320 0x7f387819e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387d104640 1 -- 172.21.15.135:0/3255036758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387806a870 msgr2=0x7f387819e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387d104640 1 --2- 172.21.15.135:0/3255036758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387806a870 0x7f387819e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387d104640 1 -- 172.21.15.135:0/3255036758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3878107320 msgr2=0x7f387819e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387d104640 1 --2- 172.21.15.135:0/3255036758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3878107320 0x7f387819e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387d104640 1 -- 172.21.15.135:0/3255036758 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38781990f0 con 0x7f38781985d0 2024-04-20T12:27:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f3877fff640 1 --2- 172.21.15.135:0/3255036758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3878107320 0x7f387819e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f387d104640 1 --2- 172.21.15.135:0/3255036758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38781985d0 0x7f3878198a80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f387000eb10 tx=0x7f387000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.464+0000 7f3875ffb640 1 -- 172.21.15.135:0/3255036758 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3870004b20 con 0x7f38781985d0 2024-04-20T12:27:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.465+0000 7f3875ffb640 1 -- 172.21.15.135:0/3255036758 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3870004cc0 con 0x7f38781985d0 2024-04-20T12:27:34.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.465+0000 7f387eb67640 1 -- 172.21.15.135:0/3255036758 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38781993e0 con 0x7f38781985d0 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.465+0000 7f3875ffb640 1 -- 172.21.15.135:0/3255036758 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3870010760 con 0x7f38781985d0 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.465+0000 7f387eb67640 1 -- 172.21.15.135:0/3255036758 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38781a5630 con 0x7f38781985d0 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.467+0000 7f3875ffb640 1 -- 172.21.15.135:0/3255036758 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f3870005020 con 0x7f38781985d0 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.467+0000 7f388183a740 1 Processor -- start 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.467+0000 7f388183a740 1 -- start start 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.467+0000 7f388183a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c94fe10 0x55769c9501f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.467+0000 7f388183a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c950730 0x55769c958dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.467+0000 7f388183a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c959310 0x55769c95b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.467+0000 7f3875ffb640 1 --2- 172.21.15.135:0/3255036758 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38680a3d20 0x7f38680a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.467+0000 7f388183a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55769c8b5110 con 0x55769c950730 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.467+0000 7f388183a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55769c852550 con 0x55769c94fe10 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.467+0000 7f388183a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55769c8b10d0 con 0x55769c959310 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.467+0000 7f387c903640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c950730 0x55769c958dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.467+0000 7f387d104640 1 --2- 172.21.15.135:0/3255036758 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38680a3d20 0x7f38680a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.468+0000 7f387c903640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c950730 0x55769c958dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56550/0 (socket says 172.21.15.135:56550) 2024-04-20T12:27:34.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.468+0000 7f387c903640 1 -- 172.21.15.135:0/1080930091 learned_addr learned my addr 172.21.15.135:0/1080930091 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.468+0000 7f3877fff640 1 --2- 172.21.15.135:0/1080930091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c94fe10 0x55769c9501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.468+0000 7f3875ffb640 1 -- 172.21.15.135:0/3255036758 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f38700d1380 con 0x7f38781985d0 2024-04-20T12:27:34.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.468+0000 7f3877fff640 1 --2- 172.21.15.135:0/1080930091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c959310 0x55769c95b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.468+0000 7f387c903640 1 -- 172.21.15.135:0/1080930091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c959310 msgr2=0x55769c95b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.468+0000 7f387c903640 1 --2- 172.21.15.135:0/1080930091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c959310 0x55769c95b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.468+0000 7f387c903640 1 -- 172.21.15.135:0/1080930091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c94fe10 msgr2=0x55769c9501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.468+0000 7f387c903640 1 --2- 172.21.15.135:0/1080930091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c94fe10 0x55769c9501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.468+0000 7f387c903640 1 -- 172.21.15.135:0/1080930091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55769c87a900 con 0x55769c950730 2024-04-20T12:27:34.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.468+0000 7f387d104640 1 --2- 172.21.15.135:0/3255036758 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38680a3d20 0x7f38680a61e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3870099400 tx=0x7f387006e9e0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.468+0000 7f387c903640 1 --2- 172.21.15.135:0/1080930091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c950730 0x55769c958dd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f386c009900 tx=0x7f386c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bc7eeda772f15f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.468+0000 7f3862ffd640 1 -- 172.21.15.135:0/1080930091 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c02ca80 con 0x55769c950730 2024-04-20T12:27:34.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.468+0000 7f3862ffd640 1 -- 172.21.15.135:0/1080930091 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f386c02cc20 con 0x55769c950730 2024-04-20T12:27:34.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.468+0000 7f3862ffd640 1 -- 172.21.15.135:0/1080930091 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c0046c0 con 0x55769c950730 2024-04-20T12:27:34.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.469+0000 7f388183a740 1 -- 172.21.15.135:0/1080930091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c950730 msgr2=0x55769c958dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.469+0000 7f388183a740 1 --2- 172.21.15.135:0/1080930091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c950730 0x55769c958dd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f386c009900 tx=0x7f386c005d50 comp rx=0 tx=0).stop 2024-04-20T12:27:34.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.469+0000 7f388183a740 1 -- 172.21.15.135:0/1080930091 shutdown_connections 2024-04-20T12:27:34.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.469+0000 7f388183a740 1 --2- 172.21.15.135:0/1080930091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c959310 0x55769c95b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.469+0000 7f388183a740 1 --2- 172.21.15.135:0/1080930091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c950730 0x55769c958dd0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.469+0000 7f388183a740 1 --2- 172.21.15.135:0/1080930091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c94fe10 0x55769c9501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.469+0000 7f388183a740 1 -- 172.21.15.135:0/1080930091 >> 172.21.15.135:0/1080930091 conn(0x55769c94a540 msgr2=0x55769c94a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.469+0000 7f388183a740 1 -- 172.21.15.135:0/1080930091 shutdown_connections 2024-04-20T12:27:34.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.469+0000 7f388183a740 1 -- 172.21.15.135:0/1080930091 wait complete. 2024-04-20T12:27:34.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.469+0000 7f388183a740 1 -- start start 2024-04-20T12:27:34.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.469+0000 7f388183a740 1 Processor -- start 2024-04-20T12:27:34.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f388183a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c94fe10 0x55769c9563c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f388183a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c950730 0x55769c956900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f388183a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c959310 0x55769c956e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f388183a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55769c95c0a0 con 0x55769c94fe10 2024-04-20T12:27:34.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f388183a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55769c86e500 con 0x55769c950730 2024-04-20T12:27:34.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f388183a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55769c95c220 con 0x55769c959310 2024-04-20T12:27:34.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f388183a740 10 client.0 _ll_register_callbacks cb 0x55769c8532f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:34.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f3877fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c94fe10 0x55769c9563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f3877fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c94fe10 0x55769c9563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56558/0 (socket says 172.21.15.135:56558) 2024-04-20T12:27:34.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f3877fff640 1 -- 172.21.15.135:0/4037083914 learned_addr learned my addr 172.21.15.135:0/4037083914 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f387c903640 1 --2- 172.21.15.135:0/4037083914 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c950730 0x55769c956900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f3877fff640 1 -- 172.21.15.135:0/4037083914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c959310 msgr2=0x55769c956e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f3877fff640 1 --2- 172.21.15.135:0/4037083914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c959310 0x55769c956e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f3877fff640 1 -- 172.21.15.135:0/4037083914 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c950730 msgr2=0x55769c956900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f3877fff640 1 --2- 172.21.15.135:0/4037083914 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c950730 0x55769c956900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f3877fff640 1 -- 172.21.15.135:0/4037083914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55769c5c73f0 con 0x55769c94fe10 2024-04-20T12:27:34.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f3877fff640 1 --2- 172.21.15.135:0/4037083914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c94fe10 0x55769c9563c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f387806a460 tx=0x7f38640117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a33860e509b307 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f3857fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:34.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f3857fff640 1 -- 172.21.15.135:0/4037083914 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864019030 con 0x55769c94fe10 2024-04-20T12:27:34.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f3857fff640 1 -- 172.21.15.135:0/4037083914 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f3864012d00 con 0x55769c94fe10 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f388183a740 1 -- 172.21.15.135:0/4037083914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f386c02cc20 con 0x55769c94fe10 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f3857fff640 1 -- 172.21.15.135:0/4037083914 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3864026050 con 0x55769c94fe10 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f388183a740 10 client.17097 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.470+0000 7f388183a740 1 -- 172.21.15.135:0/4037083914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55769c6917d0 con 0x55769c94fe10 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.471+0000 7f3857fff640 1 -- 172.21.15.135:0/4037083914 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f386c02cc20 con 0x55769c94fe10 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.471+0000 7f3857fff640 1 -- 172.21.15.135:0/4037083914 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f3864003bb0 con 0x55769c94fe10 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.471+0000 7f388183a740 10 client.17097 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.471+0000 7f388183a740 10 client.17097 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.471+0000 7f388183a740 20 client.17097 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.471+0000 7f388183a740 1 --2- 172.21.15.135:0/4037083914 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55769c969630 0x55769c96ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.471+0000 7f388183a740 4 client.17097 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.471+0000 7f388183a740 1 -- 172.21.15.135:0/4037083914 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55769c8c2b30 con 0x55769c969630 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.471+0000 7f387c903640 1 --2- 172.21.15.135:0/4037083914 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55769c969630 0x55769c96ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.471+0000 7f3857fff640 10 client.17097 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.471+0000 7f387c903640 1 --2- 172.21.15.135:0/4037083914 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55769c969630 0x55769c96ba60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6904a423bb5750ba server_cookie=92edc70e259a164d in_seq=0 out_seq=0 2024-04-20T12:27:34.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.472+0000 7f3857fff640 1 -- 172.21.15.135:0/4037083914 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55769c8c2b30 con 0x55769c969630 2024-04-20T12:27:34.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.472+0000 7f3857fff640 10 client.17097 handle_command_reply: tid=0 2024-04-20T12:27:34.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.472+0000 7f388183a740 1 client.17097 shutdown 2024-04-20T12:27:34.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.472+0000 7f388183a740 1 -- 172.21.15.135:0/4037083914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c94fe10 msgr2=0x55769c9563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.472+0000 7f388183a740 1 --2- 172.21.15.135:0/4037083914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c94fe10 0x55769c9563c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f387806a460 tx=0x7f38640117b0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.472+0000 7f388183a740 1 -- 172.21.15.135:0/4037083914 shutdown_connections 2024-04-20T12:27:34.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.472+0000 7f388183a740 1 --2- 172.21.15.135:0/4037083914 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55769c969630 0x55769c96ba60 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.472+0000 7f388183a740 1 --2- 172.21.15.135:0/4037083914 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c959310 0x55769c956e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.472+0000 7f3857fff640 0 client.17097 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:27:34.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.472+0000 7f388183a740 1 --2- 172.21.15.135:0/4037083914 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c950730 0x55769c956900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.472+0000 7f388183a740 1 --2- 172.21.15.135:0/4037083914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c94fe10 0x55769c9563c0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.472+0000 7f388183a740 1 -- 172.21.15.135:0/4037083914 >> 172.21.15.135:0/4037083914 conn(0x55769c94a540 msgr2=0x55769c94c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.472+0000 7f388183a740 1 -- 172.21.15.135:0/4037083914 shutdown_connections 2024-04-20T12:27:34.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.472+0000 7f388183a740 1 -- 172.21.15.135:0/4037083914 wait complete. 2024-04-20T12:27:34.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.472+0000 7f388183a740 20 client.17097 trim_cache size 0 max 16384 2024-04-20T12:27:34.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f388183a740 1 Processor -- start 2024-04-20T12:27:34.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f388183a740 1 -- start start 2024-04-20T12:27:34.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f388183a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c94fe10 0x55769c958af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f388183a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c950730 0x55769c964f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f388183a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c959310 0x55769c949560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f388183a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f38781af3d0 con 0x55769c959310 2024-04-20T12:27:34.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f388183a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f38781b0f10 con 0x55769c950730 2024-04-20T12:27:34.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f388183a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38781afaa0 con 0x55769c94fe10 2024-04-20T12:27:34.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f3877fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c959310 0x55769c949560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f3877fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c959310 0x55769c949560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56566/0 (socket says 172.21.15.135:56566) 2024-04-20T12:27:34.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f3877fff640 1 -- 172.21.15.135:0/498808877 learned_addr learned my addr 172.21.15.135:0/498808877 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f387c903640 1 --2- 172.21.15.135:0/498808877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c950730 0x55769c964f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f3877fff640 1 -- 172.21.15.135:0/498808877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c94fe10 msgr2=0x55769c958af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f3877fff640 1 --2- 172.21.15.135:0/498808877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c94fe10 0x55769c958af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f3877fff640 1 -- 172.21.15.135:0/498808877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c950730 msgr2=0x55769c964f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f3877fff640 1 --2- 172.21.15.135:0/498808877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c950730 0x55769c964f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f3877fff640 1 -- 172.21.15.135:0/498808877 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55769c94a2a0 con 0x55769c959310 2024-04-20T12:27:34.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f3877fff640 1 --2- 172.21.15.135:0/498808877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c959310 0x55769c949560 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f386401e700 tx=0x7f386401e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed47989239cdf86 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f38627fc640 1 -- 172.21.15.135:0/498808877 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386402f070 con 0x55769c959310 2024-04-20T12:27:34.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f38627fc640 1 -- 172.21.15.135:0/498808877 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f386401eb90 con 0x55769c959310 2024-04-20T12:27:34.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.486+0000 7f38627fc640 1 -- 172.21.15.135:0/498808877 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864019040 con 0x55769c959310 2024-04-20T12:27:34.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.487+0000 7f388183a740 1 -- 172.21.15.135:0/498808877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c959310 msgr2=0x55769c949560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.487+0000 7f388183a740 1 --2- 172.21.15.135:0/498808877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c959310 0x55769c949560 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f386401e700 tx=0x7f386401e730 comp rx=0 tx=0).stop 2024-04-20T12:27:34.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.487+0000 7f388183a740 1 -- 172.21.15.135:0/498808877 shutdown_connections 2024-04-20T12:27:34.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.487+0000 7f388183a740 1 --2- 172.21.15.135:0/498808877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c959310 0x55769c949560 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.487+0000 7f388183a740 1 --2- 172.21.15.135:0/498808877 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c950730 0x55769c964f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.487+0000 7f388183a740 1 --2- 172.21.15.135:0/498808877 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c94fe10 0x55769c958af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.487+0000 7f388183a740 1 -- 172.21.15.135:0/498808877 >> 172.21.15.135:0/498808877 conn(0x55769c94a540 msgr2=0x55769c948e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.487+0000 7f388183a740 1 -- 172.21.15.135:0/498808877 shutdown_connections 2024-04-20T12:27:34.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.487+0000 7f388183a740 1 -- 172.21.15.135:0/498808877 wait complete. 2024-04-20T12:27:34.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.487+0000 7f388183a740 1 -- start start 2024-04-20T12:27:34.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.487+0000 7f388183a740 1 Processor -- start 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f388183a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c94fe10 0x55769c953160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f388183a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c950730 0x55769c9536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f388183a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c959310 0x55769c953be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f388183a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f38781b0840 con 0x55769c950730 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f388183a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f38781b0170 con 0x55769c94fe10 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f388183a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38781ad3a0 con 0x55769c959310 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f388183a740 10 client.0 _ll_register_callbacks cb 0x7f386400ccc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f387c903640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c950730 0x55769c9536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f387c903640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c950730 0x55769c9536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56572/0 (socket says 172.21.15.135:56572) 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f387c903640 1 -- 172.21.15.135:0/3571854742 learned_addr learned my addr 172.21.15.135:0/3571854742 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f3877fff640 1 --2- 172.21.15.135:0/3571854742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c94fe10 0x55769c953160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f387c903640 1 -- 172.21.15.135:0/3571854742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c959310 msgr2=0x55769c953be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f387c903640 1 --2- 172.21.15.135:0/3571854742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c959310 0x55769c953be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f387c903640 1 -- 172.21.15.135:0/3571854742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c94fe10 msgr2=0x55769c953160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f387c903640 1 --2- 172.21.15.135:0/3571854742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c94fe10 0x55769c953160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f387c903640 1 -- 172.21.15.135:0/3571854742 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55769c9cec70 con 0x55769c950730 2024-04-20T12:27:34.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f3877fff640 1 --2- 172.21.15.135:0/3571854742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c94fe10 0x55769c953160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:27:34.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f387c903640 1 --2- 172.21.15.135:0/3571854742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c950730 0x55769c9536a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f386c005ec0 tx=0x7f386c02c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974b3d4b3c1fc10f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f3857fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:34.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f3857fff640 1 -- 172.21.15.135:0/3571854742 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c004450 con 0x55769c950730 2024-04-20T12:27:34.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f3857fff640 1 -- 172.21.15.135:0/3571854742 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f386c04ebc0 con 0x55769c950730 2024-04-20T12:27:34.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.488+0000 7f388183a740 1 -- 172.21.15.135:0/3571854742 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f386401eb90 con 0x55769c950730 2024-04-20T12:27:34.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.489+0000 7f3857fff640 1 -- 172.21.15.135:0/3571854742 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f386c057050 con 0x55769c950730 2024-04-20T12:27:34.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.489+0000 7f388183a740 10 client.17103 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:34.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.489+0000 7f388183a740 1 -- 172.21.15.135:0/3571854742 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55769c9cffd0 con 0x55769c950730 2024-04-20T12:27:34.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.489+0000 7f3857fff640 1 -- 172.21.15.135:0/3571854742 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f386401eb90 con 0x55769c950730 2024-04-20T12:27:34.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.489+0000 7f3857fff640 1 -- 172.21.15.135:0/3571854742 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f386c04e7b0 con 0x55769c950730 2024-04-20T12:27:34.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.489+0000 7f388183a740 10 client.17103 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:34.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.489+0000 7f388183a740 10 client.17103 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:27:34.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.489+0000 7f388183a740 20 client.17103 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:34.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.489+0000 7f388183a740 1 --2- 172.21.15.135:0/3571854742 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55769c9d0310 0x55769c9d2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.489+0000 7f388183a740 4 client.17103 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:27:34.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.489+0000 7f388183a740 1 -- 172.21.15.135:0/3571854742 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55769c8bc9a0 con 0x55769c9d0310 2024-04-20T12:27:34.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.489+0000 7f3877fff640 1 --2- 172.21.15.135:0/3571854742 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55769c9d0310 0x55769c9d2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f3857fff640 10 client.17103 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:27:34.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f3877fff640 1 --2- 172.21.15.135:0/3571854742 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55769c9d0310 0x55769c9d2700 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dcb5568217b33c1b server_cookie=19d52b7e0ce06892 in_seq=0 out_seq=0 2024-04-20T12:27:34.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f3857fff640 1 -- 172.21.15.135:0/3571854742 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55769c8bc9a0 con 0x55769c9d0310 2024-04-20T12:27:34.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f3857fff640 10 client.17103 handle_command_reply: tid=0 2024-04-20T12:27:34.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f388183a740 1 client.17103 shutdown 2024-04-20T12:27:34.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f388183a740 1 -- 172.21.15.135:0/3571854742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c950730 msgr2=0x55769c9536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f388183a740 1 --2- 172.21.15.135:0/3571854742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c950730 0x55769c9536a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f386c005ec0 tx=0x7f386c02c650 comp rx=0 tx=0).stop 2024-04-20T12:27:34.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f388183a740 1 -- 172.21.15.135:0/3571854742 shutdown_connections 2024-04-20T12:27:34.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f388183a740 1 --2- 172.21.15.135:0/3571854742 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55769c9d0310 0x55769c9d2700 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f388183a740 1 --2- 172.21.15.135:0/3571854742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55769c959310 0x55769c953be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f388183a740 1 --2- 172.21.15.135:0/3571854742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55769c950730 0x55769c9536a0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f388183a740 1 --2- 172.21.15.135:0/3571854742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55769c94fe10 0x55769c953160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f3857fff640 0 client.17103 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:27:34.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f388183a740 1 -- 172.21.15.135:0/3571854742 >> 172.21.15.135:0/3571854742 conn(0x55769c94a540 msgr2=0x55769c9496e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f388183a740 1 -- 172.21.15.135:0/3571854742 shutdown_connections 2024-04-20T12:27:34.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f388183a740 1 -- 172.21.15.135:0/3571854742 wait complete. 2024-04-20T12:27:34.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.490+0000 7f388183a740 20 client.17103 trim_cache size 0 max 16384 2024-04-20T12:27:34.495 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:27:34.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.491+0000 7f387eb67640 1 -- 172.21.15.135:0/3255036758 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38680a3d20 msgr2=0x7f38680a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.491+0000 7f387eb67640 1 --2- 172.21.15.135:0/3255036758 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38680a3d20 0x7f38680a61e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3870099400 tx=0x7f387006e9e0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.491+0000 7f387eb67640 1 -- 172.21.15.135:0/3255036758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38781985d0 msgr2=0x7f3878198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.491+0000 7f387eb67640 1 --2- 172.21.15.135:0/3255036758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38781985d0 0x7f3878198a80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f387000eb10 tx=0x7f387000c2d0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.491+0000 7f387eb67640 1 -- 172.21.15.135:0/3255036758 shutdown_connections 2024-04-20T12:27:34.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.491+0000 7f387eb67640 1 --2- 172.21.15.135:0/3255036758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38781985d0 0x7f3878198a80 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.491+0000 7f387eb67640 1 --2- 172.21.15.135:0/3255036758 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3878107320 0x7f387819e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.491+0000 7f387eb67640 1 --2- 172.21.15.135:0/3255036758 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38680a3d20 0x7f38680a61e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.491+0000 7f387eb67640 1 --2- 172.21.15.135:0/3255036758 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f387806a870 0x7f387819e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.491+0000 7f387eb67640 1 -- 172.21.15.135:0/3255036758 >> 172.21.15.135:0/3255036758 conn(0x7f3878077c50 msgr2=0x7f38780ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.491+0000 7f387eb67640 1 -- 172.21.15.135:0/3255036758 shutdown_connections 2024-04-20T12:27:34.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.491+0000 7f387eb67640 1 -- 172.21.15.135:0/3255036758 wait complete. 2024-04-20T12:27:34.499 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:34 smithi135 ceph-mon[18264]: pgmap v136: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:27:34.499 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:34 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/998263345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:27:34.500 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:27:34.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.601+0000 7f42a0fce640 1 -- 172.21.15.135:0/539795315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c101090 msgr2=0x7f429c101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.601+0000 7f42a0fce640 1 --2- 172.21.15.135:0/539795315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c101090 0x7f429c101470 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f428c009900 tx=0x7f428c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:27:34.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.602+0000 7f42a0fce640 1 -- 172.21.15.135:0/539795315 shutdown_connections 2024-04-20T12:27:34.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.602+0000 7f42a0fce640 1 --2- 172.21.15.135:0/539795315 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f429c106160 0x7f429c10dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.602+0000 7f42a0fce640 1 --2- 172.21.15.135:0/539795315 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f429c101a40 0x7f429c105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.602+0000 7f42a0fce640 1 --2- 172.21.15.135:0/539795315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c101090 0x7f429c101470 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.602+0000 7f42a0fce640 1 -- 172.21.15.135:0/539795315 >> 172.21.15.135:0/539795315 conn(0x7f429c078010 msgr2=0x7f429c078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.602+0000 7f42a0fce640 1 -- 172.21.15.135:0/539795315 shutdown_connections 2024-04-20T12:27:34.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.602+0000 7f42a0fce640 1 -- 172.21.15.135:0/539795315 wait complete. 2024-04-20T12:27:34.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.602+0000 7f42a0fce640 1 Processor -- start 2024-04-20T12:27:34.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.602+0000 7f42a0fce640 1 -- start start 2024-04-20T12:27:34.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.602+0000 7f42a0fce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f429c101090 0x7f429c197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.602+0000 7f42a0fce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f429c106160 0x7f429c1979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.602+0000 7f42a0fce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c197f00 0x7f429c1a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f42a0fce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f429c111210 con 0x7f429c197f00 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f42a0fce640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f429c111090 con 0x7f429c101090 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f42a0fce640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f429c111390 con 0x7f429c106160 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f429ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c197f00 0x7f429c1a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f429ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c197f00 0x7f429c1a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56590/0 (socket says 172.21.15.135:56590) 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f429ad9d640 1 -- 172.21.15.135:0/711826290 learned_addr learned my addr 172.21.15.135:0/711826290 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f429a59c640 1 --2- 172.21.15.135:0/711826290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f429c101090 0x7f429c197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f429ad9d640 1 -- 172.21.15.135:0/711826290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f429c106160 msgr2=0x7f429c1979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f429ad9d640 1 --2- 172.21.15.135:0/711826290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f429c106160 0x7f429c1979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f429ad9d640 1 -- 172.21.15.135:0/711826290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f429c101090 msgr2=0x7f429c197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f429ad9d640 1 --2- 172.21.15.135:0/711826290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f429c101090 0x7f429c197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f429ad9d640 1 -- 172.21.15.135:0/711826290 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429c1a70c0 con 0x7f429c197f00 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f429a59c640 1 --2- 172.21.15.135:0/711826290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f429c101090 0x7f429c197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f429ad9d640 1 --2- 172.21.15.135:0/711826290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c197f00 0x7f429c1a6b00 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f429400eb40 tx=0x7f429400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f428b7fe640 1 -- 172.21.15.135:0/711826290 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294004b20 con 0x7f429c197f00 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f428b7fe640 1 -- 172.21.15.135:0/711826290 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4294004cc0 con 0x7f429c197f00 2024-04-20T12:27:34.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f42a0fce640 1 -- 172.21.15.135:0/711826290 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429c1a73b0 con 0x7f429c197f00 2024-04-20T12:27:34.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f428b7fe640 1 -- 172.21.15.135:0/711826290 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294010670 con 0x7f429c197f00 2024-04-20T12:27:34.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.603+0000 7f42a0fce640 1 -- 172.21.15.135:0/711826290 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f429c1a78b0 con 0x7f429c197f00 2024-04-20T12:27:34.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.605+0000 7f428b7fe640 1 -- 172.21.15.135:0/711826290 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f4294005020 con 0x7f429c197f00 2024-04-20T12:27:34.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.606+0000 7f42a3bbe740 1 Processor -- start 2024-04-20T12:27:34.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.606+0000 7f42a3bbe740 1 -- start start 2024-04-20T12:27:34.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.606+0000 7f428b7fe640 1 --2- 172.21.15.135:0/711826290 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f42840a3d20 0x7f42840a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.606+0000 7f42a3bbe740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f41278fe10 0x55f4127901f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.606+0000 7f42a3bbe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f412790730 0x55f412798dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.606+0000 7f42a3bbe740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f412799310 0x55f41279b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.606+0000 7f42a3bbe740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f4126f5110 con 0x55f41278fe10 2024-04-20T12:27:34.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.606+0000 7f42a3bbe740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f412692550 con 0x55f412799310 2024-04-20T12:27:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.606+0000 7f42a3bbe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f4126f10d0 con 0x55f412790730 2024-04-20T12:27:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.606+0000 7f428b7fe640 1 -- 172.21.15.135:0/711826290 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f42940d1210 con 0x7f429c197f00 2024-04-20T12:27:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.606+0000 7f429a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f41278fe10 0x55f4127901f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.606+0000 7f429a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f41278fe10 0x55f4127901f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56592/0 (socket says 172.21.15.135:56592) 2024-04-20T12:27:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.606+0000 7f429a59c640 1 -- 172.21.15.135:0/3694392973 learned_addr learned my addr 172.21.15.135:0/3694392973 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.606+0000 7f4299d9b640 1 --2- 172.21.15.135:0/711826290 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f42840a3d20 0x7f42840a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.606+0000 7f4299d9b640 1 --2- 172.21.15.135:0/3694392973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f412790730 0x55f412798dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.607+0000 7f429ad9d640 1 --2- 172.21.15.135:0/3694392973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f412799310 0x55f41279b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.607+0000 7f429a59c640 1 -- 172.21.15.135:0/3694392973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f412790730 msgr2=0x55f412798dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.607+0000 7f429a59c640 1 --2- 172.21.15.135:0/3694392973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f412790730 0x55f412798dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.607+0000 7f429a59c640 1 -- 172.21.15.135:0/3694392973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f412799310 msgr2=0x55f41279b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.607+0000 7f429a59c640 1 --2- 172.21.15.135:0/3694392973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f412799310 0x55f41279b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.607+0000 7f429a59c640 1 -- 172.21.15.135:0/3694392973 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4126ba900 con 0x55f41278fe10 2024-04-20T12:27:34.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.607+0000 7f429ad9d640 1 --2- 172.21.15.135:0/3694392973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f412799310 0x55f41279b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.607+0000 7f4299d9b640 1 --2- 172.21.15.135:0/711826290 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f42840a3d20 0x7f42840a61e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f429000afd0 tx=0x7f429000a9b0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.607+0000 7f429a59c640 1 --2- 172.21.15.135:0/3694392973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f41278fe10 0x55f4127901f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f428c000c00 tx=0x7f428c005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6915121c2b0b3e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.607+0000 7f4288ff9640 1 -- 172.21.15.135:0/3694392973 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c02ca80 con 0x55f41278fe10 2024-04-20T12:27:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.607+0000 7f4288ff9640 1 -- 172.21.15.135:0/3694392973 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f428c02cc20 con 0x55f41278fe10 2024-04-20T12:27:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.607+0000 7f4288ff9640 1 -- 172.21.15.135:0/3694392973 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c0048c0 con 0x55f41278fe10 2024-04-20T12:27:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 -- 172.21.15.135:0/3694392973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f41278fe10 msgr2=0x55f4127901f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/3694392973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f41278fe10 0x55f4127901f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f428c000c00 tx=0x7f428c005e00 comp rx=0 tx=0).stop 2024-04-20T12:27:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 -- 172.21.15.135:0/3694392973 shutdown_connections 2024-04-20T12:27:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/3694392973 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f412799310 0x55f41279b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/3694392973 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f412790730 0x55f412798dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/3694392973 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f41278fe10 0x55f4127901f0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 -- 172.21.15.135:0/3694392973 >> 172.21.15.135:0/3694392973 conn(0x55f41278a540 msgr2=0x55f41278a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 -- 172.21.15.135:0/3694392973 shutdown_connections 2024-04-20T12:27:34.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 -- 172.21.15.135:0/3694392973 wait complete. 2024-04-20T12:27:34.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 -- start start 2024-04-20T12:27:34.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 Processor -- start 2024-04-20T12:27:34.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f41278fe10 0x55f412796450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412790730 0x55f412796990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f412799310 0x55f412796ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f41279bfe0 con 0x55f412790730 2024-04-20T12:27:34.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f4126ae500 con 0x55f41278fe10 2024-04-20T12:27:34.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f41279c160 con 0x55f412799310 2024-04-20T12:27:34.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.608+0000 7f42a3bbe740 10 client.0 _ll_register_callbacks cb 0x55f4126932f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:34.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f4299d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412790730 0x55f412796990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f4299d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412790730 0x55f412796990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56604/0 (socket says 172.21.15.135:56604) 2024-04-20T12:27:34.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f4299d9b640 1 -- 172.21.15.135:0/3508750162 learned_addr learned my addr 172.21.15.135:0/3508750162 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f429a59c640 1 --2- 172.21.15.135:0/3508750162 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f41278fe10 0x55f412796450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f429ad9d640 1 --2- 172.21.15.135:0/3508750162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f412799310 0x55f412796ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f4299d9b640 1 -- 172.21.15.135:0/3508750162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f412799310 msgr2=0x55f412796ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f4299d9b640 1 --2- 172.21.15.135:0/3508750162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f412799310 0x55f412796ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f4299d9b640 1 -- 172.21.15.135:0/3508750162 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f41278fe10 msgr2=0x55f412796450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f4299d9b640 1 --2- 172.21.15.135:0/3508750162 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f41278fe10 0x55f412796450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f4299d9b640 1 -- 172.21.15.135:0/3508750162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4124073f0 con 0x55f412790730 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f429a59c640 1 --2- 172.21.15.135:0/3508750162 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f41278fe10 0x55f412796450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f4299d9b640 1 --2- 172.21.15.135:0/3508750162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412790730 0x55f412796990 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f4290004310 tx=0x7f4290005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd73055bbf00c22d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f4281ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f4281ffb640 1 -- 172.21.15.135:0/3508750162 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290024070 con 0x55f412790730 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f4281ffb640 1 -- 172.21.15.135:0/3508750162 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f4290005020 con 0x55f412790730 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f42a3bbe740 1 -- 172.21.15.135:0/3508750162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f428c02cc20 con 0x55f412790730 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f4281ffb640 1 -- 172.21.15.135:0/3508750162 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f429002f050 con 0x55f412790730 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f42a3bbe740 10 client.17115 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f42a3bbe740 1 -- 172.21.15.135:0/3508750162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f4124d17d0 con 0x55f412790730 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.609+0000 7f4281ffb640 1 -- 172.21.15.135:0/3508750162 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f428c02cc20 con 0x55f412790730 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.610+0000 7f4281ffb640 1 -- 172.21.15.135:0/3508750162 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f429001e040 con 0x55f412790730 2024-04-20T12:27:34.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.610+0000 7f42a3bbe740 10 client.17115 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.610+0000 7f42a3bbe740 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.610+0000 7f42a3bbe740 20 client.17115 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.610+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/3508750162 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4127a9550 0x55f4127ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.610+0000 7f42a3bbe740 4 client.17115 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.610+0000 7f42a3bbe740 1 -- 172.21.15.135:0/3508750162 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f412702b30 con 0x55f4127a9550 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.610+0000 7f429a59c640 1 --2- 172.21.15.135:0/3508750162 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4127a9550 0x55f4127ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.610+0000 7f4281ffb640 10 client.17115 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.610+0000 7f429a59c640 1 --2- 172.21.15.135:0/3508750162 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4127a9550 0x55f4127ab9e0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e88039c0d2a1f3c4 server_cookie=400a65aa5508a96d in_seq=0 out_seq=0 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.611+0000 7f4281ffb640 1 -- 172.21.15.135:0/3508750162 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f412702b30 con 0x55f4127a9550 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.611+0000 7f4281ffb640 10 client.17115 handle_command_reply: tid=0 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.611+0000 7f42a3bbe740 1 client.17115 shutdown 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.611+0000 7f42a3bbe740 1 -- 172.21.15.135:0/3508750162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412790730 msgr2=0x55f412796990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.611+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/3508750162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412790730 0x55f412796990 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f4290004310 tx=0x7f4290005850 comp rx=0 tx=0).stop 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.611+0000 7f42a3bbe740 1 -- 172.21.15.135:0/3508750162 shutdown_connections 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.611+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/3508750162 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4127a9550 0x55f4127ab9e0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.611+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/3508750162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f412799310 0x55f412796ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.611+0000 7f4281ffb640 0 client.17115 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:34.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.611+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/3508750162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412790730 0x55f412796990 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.611+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/3508750162 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f41278fe10 0x55f412796450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.611+0000 7f42a3bbe740 1 -- 172.21.15.135:0/3508750162 >> 172.21.15.135:0/3508750162 conn(0x55f41278a540 msgr2=0x55f41278c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.611+0000 7f42a3bbe740 1 -- 172.21.15.135:0/3508750162 shutdown_connections 2024-04-20T12:27:34.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.611+0000 7f42a3bbe740 1 -- 172.21.15.135:0/3508750162 wait complete. 2024-04-20T12:27:34.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.611+0000 7f42a3bbe740 20 client.17115 trim_cache size 0 max 16384 2024-04-20T12:27:34.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.624+0000 7f42a3bbe740 1 Processor -- start 2024-04-20T12:27:34.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.624+0000 7f42a3bbe740 1 -- start start 2024-04-20T12:27:34.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f42a3bbe740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f41278fe10 0x55f412798b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f42a3bbe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f412790730 0x55f412785570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f42a3bbe740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412799310 0x55f4127b1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f42a3bbe740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f429c1b15d0 con 0x55f412799310 2024-04-20T12:27:34.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f42a3bbe740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f429c1b3110 con 0x55f41278fe10 2024-04-20T12:27:34.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f42a3bbe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f429c1b1ca0 con 0x55f412790730 2024-04-20T12:27:34.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f429ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412799310 0x55f4127b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f429ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412799310 0x55f4127b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56606/0 (socket says 172.21.15.135:56606) 2024-04-20T12:27:34.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f429ad9d640 1 -- 172.21.15.135:0/397358273 learned_addr learned my addr 172.21.15.135:0/397358273 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f429a59c640 1 --2- 172.21.15.135:0/397358273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f41278fe10 0x55f412798b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f429ad9d640 1 -- 172.21.15.135:0/397358273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f412790730 msgr2=0x55f412785570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f429ad9d640 1 --2- 172.21.15.135:0/397358273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f412790730 0x55f412785570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f429ad9d640 1 -- 172.21.15.135:0/397358273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f41278fe10 msgr2=0x55f412798b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f429ad9d640 1 --2- 172.21.15.135:0/397358273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f41278fe10 0x55f412798b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f429ad9d640 1 -- 172.21.15.135:0/397358273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f412795400 con 0x55f412799310 2024-04-20T12:27:34.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f429a59c640 1 --2- 172.21.15.135:0/397358273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f41278fe10 0x55f412798b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:27:34.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f429ad9d640 1 --2- 172.21.15.135:0/397358273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412799310 0x55f4127b1300 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f429409cad0 tx=0x7f42940bbf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a08c216a1da8e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f4283fff640 1 -- 172.21.15.135:0/397358273 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429409c730 con 0x55f412799310 2024-04-20T12:27:34.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f4283fff640 1 -- 172.21.15.135:0/397358273 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f429409d4d0 con 0x55f412799310 2024-04-20T12:27:34.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.625+0000 7f4283fff640 1 -- 172.21.15.135:0/397358273 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294099440 con 0x55f412799310 2024-04-20T12:27:34.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 -- 172.21.15.135:0/397358273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412799310 msgr2=0x55f4127b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/397358273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412799310 0x55f4127b1300 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f429409cad0 tx=0x7f42940bbf90 comp rx=0 tx=0).stop 2024-04-20T12:27:34.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 -- 172.21.15.135:0/397358273 shutdown_connections 2024-04-20T12:27:34.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/397358273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412799310 0x55f4127b1300 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/397358273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f412790730 0x55f412785570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/397358273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f41278fe10 0x55f412798b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 -- 172.21.15.135:0/397358273 >> 172.21.15.135:0/397358273 conn(0x55f41278a540 msgr2=0x55f4127896e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 -- 172.21.15.135:0/397358273 shutdown_connections 2024-04-20T12:27:34.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 -- 172.21.15.135:0/397358273 wait complete. 2024-04-20T12:27:34.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 -- start start 2024-04-20T12:27:34.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 Processor -- start 2024-04-20T12:27:34.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f41278fe10 0x55f41279d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f412790730 0x55f41279d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412799310 0x55f41280eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f429c1b2a40 con 0x55f412799310 2024-04-20T12:27:34.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f429c1b2370 con 0x55f412790730 2024-04-20T12:27:34.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f429c1af5a0 con 0x55f41278fe10 2024-04-20T12:27:34.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f42a3bbe740 10 client.0 _ll_register_callbacks cb 0x7f429000ad00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:34.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f429ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412799310 0x55f41280eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f429ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412799310 0x55f41280eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56622/0 (socket says 172.21.15.135:56622) 2024-04-20T12:27:34.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.626+0000 7f429ad9d640 1 -- 172.21.15.135:0/303700683 learned_addr learned my addr 172.21.15.135:0/303700683 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:34.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f4299d9b640 1 --2- 172.21.15.135:0/303700683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f412790730 0x55f41279d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f429a59c640 1 --2- 172.21.15.135:0/303700683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f41278fe10 0x55f41279d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f429ad9d640 1 -- 172.21.15.135:0/303700683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f41278fe10 msgr2=0x55f41279d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f429ad9d640 1 --2- 172.21.15.135:0/303700683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f41278fe10 0x55f41279d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f429ad9d640 1 -- 172.21.15.135:0/303700683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f412790730 msgr2=0x55f41279d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:34.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f429ad9d640 1 --2- 172.21.15.135:0/303700683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f412790730 0x55f41279d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f429ad9d640 1 -- 172.21.15.135:0/303700683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f41280f0b0 con 0x55f412799310 2024-04-20T12:27:34.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f4299d9b640 1 --2- 172.21.15.135:0/303700683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f412790730 0x55f41279d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:34.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f429ad9d640 1 --2- 172.21.15.135:0/303700683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412799310 0x55f41280eb70 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f429400c7d0 tx=0x7f429400cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781e43d3b576dabd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:34.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f4281ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:34.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f4281ffb640 1 -- 172.21.15.135:0/303700683 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429409cdd0 con 0x55f412799310 2024-04-20T12:27:34.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f4281ffb640 1 -- 172.21.15.135:0/303700683 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f42940ce800 con 0x55f412799310 2024-04-20T12:27:34.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f42a3bbe740 1 -- 172.21.15.135:0/303700683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f429409d4d0 con 0x55f412799310 2024-04-20T12:27:34.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f4281ffb640 1 -- 172.21.15.135:0/303700683 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f42940cea00 con 0x55f412799310 2024-04-20T12:27:34.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f42a3bbe740 10 client.17121 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:34.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f42a3bbe740 1 -- 172.21.15.135:0/303700683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f412810220 con 0x55f412799310 2024-04-20T12:27:34.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f4281ffb640 1 -- 172.21.15.135:0/303700683 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f429409d4d0 con 0x55f412799310 2024-04-20T12:27:34.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f4281ffb640 1 -- 172.21.15.135:0/303700683 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f4294005310 con 0x55f412799310 2024-04-20T12:27:34.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f42a3bbe740 10 client.17121 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:34.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f42a3bbe740 10 client.17121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:34.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f42a3bbe740 20 client.17121 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:34.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/303700683 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4128106a0 0x55f412812a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:34.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f42a3bbe740 4 client.17121 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:27:34.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.627+0000 7f42a3bbe740 1 -- 172.21.15.135:0/303700683 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f4126fc9a0 con 0x55f4128106a0 2024-04-20T12:27:34.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.628+0000 7f429a59c640 1 --2- 172.21.15.135:0/303700683 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4128106a0 0x55f412812a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:34.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.628+0000 7f4281ffb640 10 client.17121 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:34.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.628+0000 7f429a59c640 1 --2- 172.21.15.135:0/303700683 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4128106a0 0x55f412812a90 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d2e4da6a11f46dc server_cookie=e377705e5f0a50a1 in_seq=0 out_seq=0 2024-04-20T12:27:34.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.628+0000 7f4281ffb640 1 -- 172.21.15.135:0/303700683 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f4126fc9a0 con 0x55f4128106a0 2024-04-20T12:27:34.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.628+0000 7f4281ffb640 10 client.17121 handle_command_reply: tid=0 2024-04-20T12:27:34.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.628+0000 7f42a3bbe740 1 client.17121 shutdown 2024-04-20T12:27:34.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.628+0000 7f42a3bbe740 1 -- 172.21.15.135:0/303700683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412799310 msgr2=0x55f41280eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.628+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/303700683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412799310 0x55f41280eb70 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f429400c7d0 tx=0x7f429400cfd0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.628+0000 7f42a3bbe740 1 -- 172.21.15.135:0/303700683 shutdown_connections 2024-04-20T12:27:34.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.628+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/303700683 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55f4128106a0 0x55f412812a90 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.628+0000 7f4281ffb640 0 client.17121 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:34.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.628+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/303700683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f412799310 0x55f41280eb70 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.628+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/303700683 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f412790730 0x55f41279d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.628+0000 7f42a3bbe740 1 --2- 172.21.15.135:0/303700683 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f41278fe10 0x55f41279d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.628+0000 7f42a3bbe740 1 -- 172.21.15.135:0/303700683 >> 172.21.15.135:0/303700683 conn(0x55f41278a540 msgr2=0x55f412796410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.629+0000 7f42a3bbe740 1 -- 172.21.15.135:0/303700683 shutdown_connections 2024-04-20T12:27:34.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.629+0000 7f42a3bbe740 1 -- 172.21.15.135:0/303700683 wait complete. 2024-04-20T12:27:34.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.629+0000 7f42a3bbe740 20 client.17121 trim_cache size 0 max 16384 2024-04-20T12:27:34.635 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:27:34.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.629+0000 7f42a0fce640 1 -- 172.21.15.135:0/711826290 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f42840a3d20 msgr2=0x7f42840a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.629+0000 7f42a0fce640 1 --2- 172.21.15.135:0/711826290 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f42840a3d20 0x7f42840a61e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f429000afd0 tx=0x7f429000a9b0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.629+0000 7f42a0fce640 1 -- 172.21.15.135:0/711826290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c197f00 msgr2=0x7f429c1a6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:34.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.629+0000 7f42a0fce640 1 --2- 172.21.15.135:0/711826290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c197f00 0x7f429c1a6b00 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f429400eb40 tx=0x7f429400c2d0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.629+0000 7f42a0fce640 1 -- 172.21.15.135:0/711826290 shutdown_connections 2024-04-20T12:27:34.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.629+0000 7f42a0fce640 1 --2- 172.21.15.135:0/711826290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f429c197f00 0x7f429c1a6b00 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.629+0000 7f42a0fce640 1 --2- 172.21.15.135:0/711826290 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f42840a3d20 0x7f42840a61e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.629+0000 7f42a0fce640 1 --2- 172.21.15.135:0/711826290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f429c106160 0x7f429c1979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.629+0000 7f42a0fce640 1 --2- 172.21.15.135:0/711826290 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f429c101090 0x7f429c197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:34.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.629+0000 7f42a0fce640 1 -- 172.21.15.135:0/711826290 >> 172.21.15.135:0/711826290 conn(0x7f429c078010 msgr2=0x7f429c0fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:34.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.629+0000 7f42a0fce640 1 -- 172.21.15.135:0/711826290 shutdown_connections 2024-04-20T12:27:34.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:34.629+0000 7f42a0fce640 1 -- 172.21.15.135:0/711826290 wait complete. 2024-04-20T12:27:34.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:34 smithi154 ceph-mon[22073]: pgmap v136: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:27:34.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:34 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/998263345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:27:34.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:34 smithi139 ceph-mon[21834]: pgmap v136: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:27:34.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:34 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/998263345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:27:35.640 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:27:35.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:27:35.640 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:27:35.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.756+0000 7f2161a77640 1 -- 172.21.15.135:0/701997726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c06a7d0 msgr2=0x7f215c06abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.756+0000 7f2161a77640 1 --2- 172.21.15.135:0/701997726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c06a7d0 0x7f215c06abb0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f214c009900 tx=0x7f214c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:27:35.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.756+0000 7f2161a77640 1 -- 172.21.15.135:0/701997726 shutdown_connections 2024-04-20T12:27:35.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.756+0000 7f2161a77640 1 --2- 172.21.15.135:0/701997726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f215c107290 0x7f215c10ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.756+0000 7f2161a77640 1 --2- 172.21.15.135:0/701997726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f215c06b180 0x7f215c106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.756+0000 7f2161a77640 1 --2- 172.21.15.135:0/701997726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c06a7d0 0x7f215c06abb0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.756+0000 7f2161a77640 1 -- 172.21.15.135:0/701997726 >> 172.21.15.135:0/701997726 conn(0x7f215c076c60 msgr2=0x7f215c077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:35.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.756+0000 7f2161a77640 1 -- 172.21.15.135:0/701997726 shutdown_connections 2024-04-20T12:27:35.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.756+0000 7f2161a77640 1 -- 172.21.15.135:0/701997726 wait complete. 2024-04-20T12:27:35.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.757+0000 7f2161a77640 1 Processor -- start 2024-04-20T12:27:35.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.757+0000 7f2161a77640 1 -- start start 2024-04-20T12:27:35.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.757+0000 7f2161a77640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c06a7d0 0x7f215c198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.757+0000 7f2161a77640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f215c107290 0x7f215c198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.757+0000 7f2161a77640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f215c19cfe0 0x7f215c19d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.757+0000 7f2161a77640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f215c112320 con 0x7f215c06a7d0 2024-04-20T12:27:35.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.757+0000 7f2161a77640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f215c1121a0 con 0x7f215c107290 2024-04-20T12:27:35.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.757+0000 7f2161a77640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f215c1124a0 con 0x7f215c19cfe0 2024-04-20T12:27:35.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.757+0000 7f215b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c06a7d0 0x7f215c198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.757+0000 7f215b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c06a7d0 0x7f215c198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56646/0 (socket says 172.21.15.135:56646) 2024-04-20T12:27:35.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.757+0000 7f215b7fe640 1 -- 172.21.15.135:0/1433648675 learned_addr learned my addr 172.21.15.135:0/1433648675 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:35.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.757+0000 7f215affd640 1 --2- 172.21.15.135:0/1433648675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f215c107290 0x7f215c198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.758+0000 7f215bfff640 1 --2- 172.21.15.135:0/1433648675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f215c19cfe0 0x7f215c19d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.758+0000 7f215b7fe640 1 -- 172.21.15.135:0/1433648675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f215c19cfe0 msgr2=0x7f215c19d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.758+0000 7f215b7fe640 1 --2- 172.21.15.135:0/1433648675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f215c19cfe0 0x7f215c19d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.758+0000 7f215b7fe640 1 -- 172.21.15.135:0/1433648675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f215c107290 msgr2=0x7f215c198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.758+0000 7f215b7fe640 1 --2- 172.21.15.135:0/1433648675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f215c107290 0x7f215c198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.758+0000 7f215b7fe640 1 -- 172.21.15.135:0/1433648675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c19dad0 con 0x7f215c06a7d0 2024-04-20T12:27:35.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.758+0000 7f215bfff640 1 --2- 172.21.15.135:0/1433648675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f215c19cfe0 0x7f215c19d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:35.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.758+0000 7f215b7fe640 1 --2- 172.21.15.135:0/1433648675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c06a7d0 0x7f215c198720 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f214c006010 tx=0x7f214c02cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:35.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.758+0000 7f2158ff9640 1 -- 172.21.15.135:0/1433648675 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c041070 con 0x7f215c06a7d0 2024-04-20T12:27:35.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.758+0000 7f2158ff9640 1 -- 172.21.15.135:0/1433648675 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f214c0054e0 con 0x7f215c06a7d0 2024-04-20T12:27:35.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.758+0000 7f2161a77640 1 -- 172.21.15.135:0/1433648675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215c19dd60 con 0x7f215c06a7d0 2024-04-20T12:27:35.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.758+0000 7f2158ff9640 1 -- 172.21.15.135:0/1433648675 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c003e60 con 0x7f215c06a7d0 2024-04-20T12:27:35.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.758+0000 7f2161a77640 1 -- 172.21.15.135:0/1433648675 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215c1a5520 con 0x7f215c06a7d0 2024-04-20T12:27:35.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.760+0000 7f2158ff9640 1 -- 172.21.15.135:0/1433648675 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f214c044070 con 0x7f215c06a7d0 2024-04-20T12:27:35.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.760+0000 7f2164661740 1 Processor -- start 2024-04-20T12:27:35.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f2164661740 1 -- start start 2024-04-20T12:27:35.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f2158ff9640 1 --2- 172.21.15.135:0/1433648675 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21440a3d20 0x7f21440a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f2164661740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c7a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f2164661740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c873b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f2164661740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c89ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f2164661740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d0c1bdef00 con 0x55d0c1c79c90 2024-04-20T12:27:35.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f2164661740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d0c1b7c530 con 0x55d0c1c7a5b0 2024-04-20T12:27:35.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f2164661740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d0c1bdaec0 con 0x55d0c1c878f0 2024-04-20T12:27:35.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f215bfff640 1 --2- 172.21.15.135:0/1433648675 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21440a3d20 0x7f21440a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f215b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c7a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f215b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c7a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56662/0 (socket says 172.21.15.135:56662) 2024-04-20T12:27:35.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f215b7fe640 1 -- 172.21.15.135:0/2495460391 learned_addr learned my addr 172.21.15.135:0/2495460391 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:35.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f215affd640 1 --2- 172.21.15.135:0/2495460391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c873b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f215bfff640 1 --2- 172.21.15.135:0/2495460391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c89ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f2158ff9640 1 -- 172.21.15.135:0/1433648675 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f214c0f2680 con 0x7f215c06a7d0 2024-04-20T12:27:35.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f215b7fe640 1 -- 172.21.15.135:0/2495460391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 msgr2=0x55d0c1c89ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f215b7fe640 1 --2- 172.21.15.135:0/2495460391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c89ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f215b7fe640 1 -- 172.21.15.135:0/2495460391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 msgr2=0x55d0c1c873b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f215b7fe640 1 --2- 172.21.15.135:0/2495460391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c873b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f215b7fe640 1 -- 172.21.15.135:0/2495460391 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c19b97e0 con 0x55d0c1c79c90 2024-04-20T12:27:35.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f215affd640 1 --2- 172.21.15.135:0/2495460391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c873b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:27:35.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f215bfff640 1 --2- 172.21.15.135:0/1433648675 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21440a3d20 0x7f21440a61e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2154013b90 tx=0x7f2154007d70 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:35.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.761+0000 7f215b7fe640 1 --2- 172.21.15.135:0/2495460391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c7a070 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f214c0bad80 tx=0x7f214c003920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7248d9125024f452 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:35.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.762+0000 7f2141ffb640 1 -- 172.21.15.135:0/2495460391 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c04b040 con 0x55d0c1c79c90 2024-04-20T12:27:35.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.762+0000 7f2141ffb640 1 -- 172.21.15.135:0/2495460391 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f214c005690 con 0x55d0c1c79c90 2024-04-20T12:27:35.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.762+0000 7f2141ffb640 1 -- 172.21.15.135:0/2495460391 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c0319a0 con 0x55d0c1c79c90 2024-04-20T12:27:35.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.762+0000 7f2164661740 1 -- 172.21.15.135:0/2495460391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 msgr2=0x55d0c1c7a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.762+0000 7f2164661740 1 --2- 172.21.15.135:0/2495460391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c7a070 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f214c0bad80 tx=0x7f214c003920 comp rx=0 tx=0).stop 2024-04-20T12:27:35.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.762+0000 7f2164661740 1 -- 172.21.15.135:0/2495460391 shutdown_connections 2024-04-20T12:27:35.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.762+0000 7f2164661740 1 --2- 172.21.15.135:0/2495460391 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c89ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.762+0000 7f2164661740 1 --2- 172.21.15.135:0/2495460391 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c873b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.762+0000 7f2164661740 1 --2- 172.21.15.135:0/2495460391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c7a070 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.762+0000 7f2164661740 1 -- 172.21.15.135:0/2495460391 >> 172.21.15.135:0/2495460391 conn(0x55d0c1c74710 msgr2=0x55d0c1c74af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:35.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.762+0000 7f2164661740 1 -- 172.21.15.135:0/2495460391 shutdown_connections 2024-04-20T12:27:35.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.762+0000 7f2164661740 1 -- 172.21.15.135:0/2495460391 wait complete. 2024-04-20T12:27:35.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.763+0000 7f2164661740 1 -- start start 2024-04-20T12:27:35.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.763+0000 7f2164661740 1 Processor -- start 2024-04-20T12:27:35.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.763+0000 7f2164661740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c871d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.763+0000 7f2164661740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c84560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.763+0000 7f2164661740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c84aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.763+0000 7f2164661740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d0c1c8a4f0 con 0x55d0c1c79c90 2024-04-20T12:27:35.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.763+0000 7f2164661740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d0c1b67480 con 0x55d0c1c7a5b0 2024-04-20T12:27:35.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.763+0000 7f2164661740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d0c1c8a670 con 0x55d0c1c878f0 2024-04-20T12:27:35.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.763+0000 7f2164661740 10 client.0 _ll_register_callbacks cb 0x55d0c1b66e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:35.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.763+0000 7f215b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c871d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.763+0000 7f215b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c871d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56672/0 (socket says 172.21.15.135:56672) 2024-04-20T12:27:35.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.763+0000 7f215b7fe640 1 -- 172.21.15.135:0/1024910930 learned_addr learned my addr 172.21.15.135:0/1024910930 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:35.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.763+0000 7f215affd640 1 --2- 172.21.15.135:0/1024910930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c84560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.763+0000 7f215bfff640 1 --2- 172.21.15.135:0/1024910930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c84aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f215b7fe640 1 -- 172.21.15.135:0/1024910930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 msgr2=0x55d0c1c84aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f215b7fe640 1 --2- 172.21.15.135:0/1024910930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c84aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f215b7fe640 1 -- 172.21.15.135:0/1024910930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 msgr2=0x55d0c1c84560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f215b7fe640 1 --2- 172.21.15.135:0/1024910930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c84560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f215b7fe640 1 -- 172.21.15.135:0/1024910930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c1a19f70 con 0x55d0c1c79c90 2024-04-20T12:27:35.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f215bfff640 1 --2- 172.21.15.135:0/1024910930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c84aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:35.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f215affd640 1 --2- 172.21.15.135:0/1024910930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c84560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:35.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f215b7fe640 1 --2- 172.21.15.135:0/1024910930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c871d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f214c0efc10 tx=0x7f214c0bdda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4790ed69db37f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:35.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f213affd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:35.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f213affd640 1 -- 172.21.15.135:0/1024910930 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c04b040 con 0x55d0c1c79c90 2024-04-20T12:27:35.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f213affd640 1 -- 172.21.15.135:0/1024910930 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f214c0efcd0 con 0x55d0c1c79c90 2024-04-20T12:27:35.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f2164661740 1 -- 172.21.15.135:0/1024910930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d0c1bec920 con 0x55d0c1c79c90 2024-04-20T12:27:35.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f213affd640 1 -- 172.21.15.135:0/1024910930 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f214c0bdef0 con 0x55d0c1c79c90 2024-04-20T12:27:35.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f2164661740 10 client.17133 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:35.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f2164661740 1 -- 172.21.15.135:0/1024910930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d0c18b1170 con 0x55d0c1c79c90 2024-04-20T12:27:35.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f213affd640 1 -- 172.21.15.135:0/1024910930 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d0c1bec920 con 0x55d0c1c79c90 2024-04-20T12:27:35.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f213affd640 1 -- 172.21.15.135:0/1024910930 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f214c0baa20 con 0x55d0c1c79c90 2024-04-20T12:27:35.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f2164661740 10 client.17133 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:35.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f2164661740 10 client.17133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:35.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.764+0000 7f2164661740 20 client.17133 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:35.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.765+0000 7f2164661740 1 --2- 172.21.15.135:0/1024910930 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0c1c97550 0x55d0c1c99940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.765+0000 7f2164661740 4 client.17133 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:35.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.765+0000 7f2164661740 1 -- 172.21.15.135:0/1024910930 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0c1be6790 con 0x55d0c1c97550 2024-04-20T12:27:35.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.765+0000 7f215affd640 1 --2- 172.21.15.135:0/1024910930 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0c1c97550 0x55d0c1c99940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.765+0000 7f213affd640 10 client.17133 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:35.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.765+0000 7f215affd640 1 --2- 172.21.15.135:0/1024910930 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0c1c97550 0x55d0c1c99940 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d1b9eb4ac33f5d6 server_cookie=4e39808f0969ad2c in_seq=0 out_seq=0 2024-04-20T12:27:35.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.766+0000 7f213affd640 1 -- 172.21.15.135:0/1024910930 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d0c1be6790 con 0x55d0c1c97550 2024-04-20T12:27:35.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.766+0000 7f213affd640 10 client.17133 handle_command_reply: tid=0 2024-04-20T12:27:35.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.766+0000 7f2164661740 1 client.17133 shutdown 2024-04-20T12:27:35.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.766+0000 7f2164661740 1 -- 172.21.15.135:0/1024910930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 msgr2=0x55d0c1c871d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.766+0000 7f2164661740 1 --2- 172.21.15.135:0/1024910930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c871d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f214c0efc10 tx=0x7f214c0bdda0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.766+0000 7f2164661740 1 -- 172.21.15.135:0/1024910930 shutdown_connections 2024-04-20T12:27:35.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.766+0000 7f2164661740 1 --2- 172.21.15.135:0/1024910930 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0c1c97550 0x55d0c1c99940 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.766+0000 7f2164661740 1 --2- 172.21.15.135:0/1024910930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c84aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.766+0000 7f2164661740 1 --2- 172.21.15.135:0/1024910930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c84560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.766+0000 7f213affd640 0 client.17133 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:35.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.766+0000 7f2164661740 1 --2- 172.21.15.135:0/1024910930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c871d0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.766+0000 7f2164661740 1 -- 172.21.15.135:0/1024910930 >> 172.21.15.135:0/1024910930 conn(0x55d0c1c74710 msgr2=0x55d0c1c76460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:35.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.766+0000 7f2164661740 1 -- 172.21.15.135:0/1024910930 shutdown_connections 2024-04-20T12:27:35.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.766+0000 7f2164661740 1 -- 172.21.15.135:0/1024910930 wait complete. 2024-04-20T12:27:35.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.766+0000 7f2164661740 20 client.17133 trim_cache size 0 max 16384 2024-04-20T12:27:35.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f2164661740 1 Processor -- start 2024-04-20T12:27:35.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f2164661740 1 -- start start 2024-04-20T12:27:35.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f2164661740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c86c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f2164661740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c871d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f2164661740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c9f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f2164661740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f215c1acf80 con 0x55d0c1c79c90 2024-04-20T12:27:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f2164661740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f215c1aeac0 con 0x55d0c1c7a5b0 2024-04-20T12:27:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f2164661740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f215c1ad650 con 0x55d0c1c878f0 2024-04-20T12:27:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f215b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c86c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f215b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c86c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56688/0 (socket says 172.21.15.135:56688) 2024-04-20T12:27:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f215b7fe640 1 -- 172.21.15.135:0/2565435281 learned_addr learned my addr 172.21.15.135:0/2565435281 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f215affd640 1 --2- 172.21.15.135:0/2565435281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c871d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f215b7fe640 1 -- 172.21.15.135:0/2565435281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 msgr2=0x55d0c1c9f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f215b7fe640 1 --2- 172.21.15.135:0/2565435281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c9f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f215b7fe640 1 -- 172.21.15.135:0/2565435281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 msgr2=0x55d0c1c871d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f215b7fe640 1 --2- 172.21.15.135:0/2565435281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c871d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.784+0000 7f215b7fe640 1 -- 172.21.15.135:0/2565435281 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c1c89ce0 con 0x55d0c1c79c90 2024-04-20T12:27:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.785+0000 7f215b7fe640 1 --2- 172.21.15.135:0/2565435281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c86c90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f214c0bc660 tx=0x7f214c0ba050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d4141b179847d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.785+0000 7f21417fa640 1 -- 172.21.15.135:0/2565435281 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c04b070 con 0x55d0c1c79c90 2024-04-20T12:27:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.785+0000 7f21417fa640 1 -- 172.21.15.135:0/2565435281 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f214c0d2e50 con 0x55d0c1c79c90 2024-04-20T12:27:35.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.785+0000 7f21417fa640 1 -- 172.21.15.135:0/2565435281 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c0c2760 con 0x55d0c1c79c90 2024-04-20T12:27:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.785+0000 7f2164661740 1 -- 172.21.15.135:0/2565435281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 msgr2=0x55d0c1c86c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.785+0000 7f2164661740 1 --2- 172.21.15.135:0/2565435281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c86c90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f214c0bc660 tx=0x7f214c0ba050 comp rx=0 tx=0).stop 2024-04-20T12:27:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.785+0000 7f2164661740 1 -- 172.21.15.135:0/2565435281 shutdown_connections 2024-04-20T12:27:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.785+0000 7f2164661740 1 --2- 172.21.15.135:0/2565435281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c9f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.785+0000 7f2164661740 1 --2- 172.21.15.135:0/2565435281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c871d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.785+0000 7f2164661740 1 --2- 172.21.15.135:0/2565435281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c86c90 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.785+0000 7f2164661740 1 -- 172.21.15.135:0/2565435281 >> 172.21.15.135:0/2565435281 conn(0x55d0c1c74710 msgr2=0x55d0c1c73720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.785+0000 7f2164661740 1 -- 172.21.15.135:0/2565435281 shutdown_connections 2024-04-20T12:27:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.785+0000 7f2164661740 1 -- 172.21.15.135:0/2565435281 wait complete. 2024-04-20T12:27:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f2164661740 1 -- start start 2024-04-20T12:27:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f2164661740 1 Processor -- start 2024-04-20T12:27:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f2164661740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c8f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f2164661740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c8fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f2164661740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c8c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f2164661740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f215c1ae3f0 con 0x55d0c1c79c90 2024-04-20T12:27:35.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f2164661740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f215c1add20 con 0x55d0c1c7a5b0 2024-04-20T12:27:35.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f2164661740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f215c1aaf50 con 0x55d0c1c878f0 2024-04-20T12:27:35.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f2164661740 10 client.0 _ll_register_callbacks cb 0x7f21540136a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:35.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f215b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c8f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f215b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c8f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56704/0 (socket says 172.21.15.135:56704) 2024-04-20T12:27:35.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f215b7fe640 1 -- 172.21.15.135:0/1629622400 learned_addr learned my addr 172.21.15.135:0/1629622400 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:35.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f215bfff640 1 --2- 172.21.15.135:0/1629622400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c8c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f215b7fe640 1 -- 172.21.15.135:0/1629622400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 msgr2=0x55d0c1c8c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f215b7fe640 1 --2- 172.21.15.135:0/1629622400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c8c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f215b7fe640 1 -- 172.21.15.135:0/1629622400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 msgr2=0x55d0c1c8fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f215b7fe640 1 --2- 172.21.15.135:0/1629622400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c8fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.786+0000 7f215b7fe640 1 -- 172.21.15.135:0/1629622400 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c1c8d120 con 0x55d0c1c79c90 2024-04-20T12:27:35.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f215b7fe640 1 --2- 172.21.15.135:0/1629622400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c8f8c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f214c0f0050 tx=0x7f214c0c70c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f17cfb9ac30a880 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:35.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f213affd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:35.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f213affd640 1 -- 172.21.15.135:0/1629622400 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c04b040 con 0x55d0c1c79c90 2024-04-20T12:27:35.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f213affd640 1 -- 172.21.15.135:0/1629622400 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f214c0c6b90 con 0x55d0c1c79c90 2024-04-20T12:27:35.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f2164661740 1 -- 172.21.15.135:0/1629622400 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f214c0d2e50 con 0x55d0c1c79c90 2024-04-20T12:27:35.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f213affd640 1 -- 172.21.15.135:0/1629622400 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f214c083050 con 0x55d0c1c79c90 2024-04-20T12:27:35.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f2164661740 10 client.17139 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:35.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f2164661740 1 -- 172.21.15.135:0/1629622400 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d0c1c8d120 con 0x55d0c1c79c90 2024-04-20T12:27:35.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f213affd640 1 -- 172.21.15.135:0/1629622400 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f214c0d2e50 con 0x55d0c1c79c90 2024-04-20T12:27:35.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f213affd640 1 -- 172.21.15.135:0/1629622400 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f214c0bd800 con 0x55d0c1c79c90 2024-04-20T12:27:35.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f2164661740 10 client.17139 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:35.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f2164661740 10 client.17139 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:35.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f2164661740 20 client.17139 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:35.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f2164661740 1 --2- 172.21.15.135:0/1629622400 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0c1cfe740 0x55d0c1d00b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f2164661740 4 client.17139 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:27:35.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.787+0000 7f2164661740 1 -- 172.21.15.135:0/1629622400 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d0c1b62c50 con 0x55d0c1cfe740 2024-04-20T12:27:35.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.788+0000 7f215affd640 1 --2- 172.21.15.135:0/1629622400 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0c1cfe740 0x55d0c1d00b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.788+0000 7f215affd640 1 --2- 172.21.15.135:0/1629622400 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0c1cfe740 0x55d0c1d00b30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b24ec4f65991d6d8 server_cookie=dd88df1113b9e34a in_seq=0 out_seq=0 2024-04-20T12:27:35.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.788+0000 7f213affd640 10 client.17139 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:35.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.789+0000 7f213affd640 1 -- 172.21.15.135:0/1629622400 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d0c1b62c50 con 0x55d0c1cfe740 2024-04-20T12:27:35.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.789+0000 7f213affd640 10 client.17139 handle_command_reply: tid=0 2024-04-20T12:27:35.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.789+0000 7f2164661740 1 client.17139 shutdown 2024-04-20T12:27:35.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.789+0000 7f2164661740 1 -- 172.21.15.135:0/1629622400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 msgr2=0x55d0c1c8f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.789+0000 7f2164661740 1 --2- 172.21.15.135:0/1629622400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c8f8c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f214c0f0050 tx=0x7f214c0c70c0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.789+0000 7f2164661740 1 -- 172.21.15.135:0/1629622400 shutdown_connections 2024-04-20T12:27:35.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.789+0000 7f2164661740 1 --2- 172.21.15.135:0/1629622400 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d0c1cfe740 0x55d0c1d00b30 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f213affd640 0 client.17139 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:35.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2164661740 1 --2- 172.21.15.135:0/1629622400 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d0c1c878f0 0x55d0c1c8c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2164661740 1 --2- 172.21.15.135:0/1629622400 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d0c1c7a5b0 0x55d0c1c8fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2164661740 1 --2- 172.21.15.135:0/1629622400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d0c1c79c90 0x55d0c1c8f8c0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2164661740 1 -- 172.21.15.135:0/1629622400 >> 172.21.15.135:0/1629622400 conn(0x55d0c1c74710 msgr2=0x55d0c1c75970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:35.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2164661740 1 -- 172.21.15.135:0/1629622400 shutdown_connections 2024-04-20T12:27:35.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2164661740 1 -- 172.21.15.135:0/1629622400 wait complete. 2024-04-20T12:27:35.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2164661740 20 client.17139 trim_cache size 0 max 16384 2024-04-20T12:27:35.794 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:27:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:27:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "b9a0cbe5-6f43-424c-ad02-d44da46d88ad", 2024-04-20T12:27:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:27:35.795 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:27:35.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2161a77640 1 -- 172.21.15.135:0/1433648675 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21440a3d20 msgr2=0x7f21440a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.795 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2161a77640 1 --2- 172.21.15.135:0/1433648675 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21440a3d20 0x7f21440a61e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2154013b90 tx=0x7f2154007d70 comp rx=0 tx=0).stop 2024-04-20T12:27:35.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2161a77640 1 -- 172.21.15.135:0/1433648675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c06a7d0 msgr2=0x7f215c198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2161a77640 1 --2- 172.21.15.135:0/1433648675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c06a7d0 0x7f215c198720 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f214c006010 tx=0x7f214c02cd70 comp rx=0 tx=0).stop 2024-04-20T12:27:35.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2161a77640 1 -- 172.21.15.135:0/1433648675 shutdown_connections 2024-04-20T12:27:35.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2161a77640 1 --2- 172.21.15.135:0/1433648675 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21440a3d20 0x7f21440a61e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2161a77640 1 --2- 172.21.15.135:0/1433648675 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f215c19cfe0 0x7f215c19d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2161a77640 1 --2- 172.21.15.135:0/1433648675 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f215c107290 0x7f215c198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2161a77640 1 --2- 172.21.15.135:0/1433648675 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f215c06a7d0 0x7f215c198720 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2161a77640 1 -- 172.21.15.135:0/1433648675 >> 172.21.15.135:0/1433648675 conn(0x7f215c076c60 msgr2=0x7f215c0ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:35.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2161a77640 1 -- 172.21.15.135:0/1433648675 shutdown_connections 2024-04-20T12:27:35.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.790+0000 7f2161a77640 1 -- 172.21.15.135:0/1433648675 wait complete. 2024-04-20T12:27:35.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:27:35.800 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:27:35.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 -- 172.21.15.135:0/2557369501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72d4102b60 msgr2=0x7f72d4106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 --2- 172.21.15.135:0/2557369501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72d4102b60 0x7f72d4106ba0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009900 tx=0x7f72d002bc30 comp rx=0 tx=0).stop 2024-04-20T12:27:35.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 -- 172.21.15.135:0/2557369501 shutdown_connections 2024-04-20T12:27:35.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 --2- 172.21.15.135:0/2557369501 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72d4107280 0x7f72d410ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 --2- 172.21.15.135:0/2557369501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72d4102b60 0x7f72d4106ba0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 --2- 172.21.15.135:0/2557369501 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72d41021b0 0x7f72d4102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 -- 172.21.15.135:0/2557369501 >> 172.21.15.135:0/2557369501 conn(0x7f72d4079360 msgr2=0x7f72d4079770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:35.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 -- 172.21.15.135:0/2557369501 shutdown_connections 2024-04-20T12:27:35.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 -- 172.21.15.135:0/2557369501 wait complete. 2024-04-20T12:27:35.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 Processor -- start 2024-04-20T12:27:35.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 -- start start 2024-04-20T12:27:35.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72d41021b0 0x7f72d4074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72d4107280 0x7f72d40747a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72d4074ce0 0x7f72d41a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f72d4112310 con 0x7f72d41021b0 2024-04-20T12:27:35.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f72d4112190 con 0x7f72d4074ce0 2024-04-20T12:27:35.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.902+0000 7f72dba11640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72d4112490 con 0x7f72d4107280 2024-04-20T12:27:35.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72d97ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72d41021b0 0x7f72d4074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72d97ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72d41021b0 0x7f72d4074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56720/0 (socket says 172.21.15.135:56720) 2024-04-20T12:27:35.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72d97ad640 1 -- 172.21.15.135:0/3190342720 learned_addr learned my addr 172.21.15.135:0/3190342720 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:35.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72d9fae640 1 --2- 172.21.15.135:0/3190342720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72d4074ce0 0x7f72d41a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72d8fac640 1 --2- 172.21.15.135:0/3190342720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72d4107280 0x7f72d40747a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72d97ad640 1 -- 172.21.15.135:0/3190342720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72d4107280 msgr2=0x7f72d40747a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72d97ad640 1 --2- 172.21.15.135:0/3190342720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72d4107280 0x7f72d40747a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72d97ad640 1 -- 172.21.15.135:0/3190342720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72d4074ce0 msgr2=0x7f72d41a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72d97ad640 1 --2- 172.21.15.135:0/3190342720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72d4074ce0 0x7f72d41a6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72d97ad640 1 -- 172.21.15.135:0/3190342720 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d41a7140 con 0x7f72d41021b0 2024-04-20T12:27:35.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72d9fae640 1 --2- 172.21.15.135:0/3190342720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72d4074ce0 0x7f72d41a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:35.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72d97ad640 1 --2- 172.21.15.135:0/3190342720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72d41021b0 0x7f72d4074260 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f72c800d770 tx=0x7f72c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:35.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72c67fc640 1 -- 172.21.15.135:0/3190342720 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c8017070 con 0x7f72d41021b0 2024-04-20T12:27:35.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72dba11640 1 -- 172.21.15.135:0/3190342720 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d41a7430 con 0x7f72d41021b0 2024-04-20T12:27:35.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72c67fc640 1 -- 172.21.15.135:0/3190342720 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72c8005500 con 0x7f72d41021b0 2024-04-20T12:27:35.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72c67fc640 1 -- 172.21.15.135:0/3190342720 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c8004e00 con 0x7f72d41021b0 2024-04-20T12:27:35.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.903+0000 7f72dba11640 1 -- 172.21.15.135:0/3190342720 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d41a7930 con 0x7f72d41021b0 2024-04-20T12:27:35.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.905+0000 7f72c67fc640 1 -- 172.21.15.135:0/3190342720 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f72c8004fa0 con 0x7f72d41021b0 2024-04-20T12:27:35.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72de604740 1 Processor -- start 2024-04-20T12:27:35.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72de604740 1 -- start start 2024-04-20T12:27:35.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72de604740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa455d20 0x55dcfa456100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72de604740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa456640 0x55dcfa45ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72de604740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa45f220 0x55dcfa461610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72de604740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa3bb1b0 con 0x55dcfa45f220 2024-04-20T12:27:35.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72de604740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa358390 con 0x55dcfa456640 2024-04-20T12:27:35.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72de604740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa3b7170 con 0x55dcfa455d20 2024-04-20T12:27:35.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72d8fac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa45f220 0x55dcfa461610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72d8fac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa45f220 0x55dcfa461610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56736/0 (socket says 172.21.15.135:56736) 2024-04-20T12:27:35.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72d8fac640 1 -- 172.21.15.135:0/3164666740 learned_addr learned my addr 172.21.15.135:0/3164666740 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:35.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72d97ad640 1 --2- 172.21.15.135:0/3164666740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa456640 0x55dcfa45ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72c67fc640 1 --2- 172.21.15.135:0/3190342720 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72c00a3d50 0x7f72c00a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72d8fac640 1 -- 172.21.15.135:0/3164666740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa455d20 msgr2=0x55dcfa456100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72d8fac640 1 --2- 172.21.15.135:0/3164666740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa455d20 0x55dcfa456100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72d8fac640 1 -- 172.21.15.135:0/3164666740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa456640 msgr2=0x55dcfa45ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72d8fac640 1 --2- 172.21.15.135:0/3164666740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa456640 0x55dcfa45ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72d8fac640 1 -- 172.21.15.135:0/3164666740 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcfa1977d0 con 0x55dcfa45f220 2024-04-20T12:27:35.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72d9fae640 1 --2- 172.21.15.135:0/3190342720 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72c00a3d50 0x7f72c00a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72c67fc640 1 -- 172.21.15.135:0/3190342720 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f72c80d0670 con 0x7f72d41021b0 2024-04-20T12:27:35.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.906+0000 7f72d8fac640 1 --2- 172.21.15.135:0/3164666740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa45f220 0x55dcfa461610 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f72d0036040 tx=0x7f72d0009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fefde9ee241e8223 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:35.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.907+0000 7f72bf7fe640 1 -- 172.21.15.135:0/3164666740 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d002ca80 con 0x55dcfa45f220 2024-04-20T12:27:35.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.907+0000 7f72bf7fe640 1 -- 172.21.15.135:0/3164666740 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72d002cc20 con 0x55dcfa45f220 2024-04-20T12:27:35.913 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.907+0000 7f72bf7fe640 1 -- 172.21.15.135:0/3164666740 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d0004920 con 0x55dcfa45f220 2024-04-20T12:27:35.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.907+0000 7f72d9fae640 1 --2- 172.21.15.135:0/3190342720 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72c00a3d50 0x7f72c00a6210 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f72cc005c40 tx=0x7f72cc0094a0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:35.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.907+0000 7f72de604740 1 -- 172.21.15.135:0/3164666740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa45f220 msgr2=0x55dcfa461610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.907+0000 7f72de604740 1 --2- 172.21.15.135:0/3164666740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa45f220 0x55dcfa461610 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f72d0036040 tx=0x7f72d0009680 comp rx=0 tx=0).stop 2024-04-20T12:27:35.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.907+0000 7f72de604740 1 -- 172.21.15.135:0/3164666740 shutdown_connections 2024-04-20T12:27:35.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.907+0000 7f72de604740 1 --2- 172.21.15.135:0/3164666740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa45f220 0x55dcfa461610 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.907+0000 7f72de604740 1 --2- 172.21.15.135:0/3164666740 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa456640 0x55dcfa45ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.907+0000 7f72de604740 1 --2- 172.21.15.135:0/3164666740 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa455d20 0x55dcfa456100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.907+0000 7f72de604740 1 -- 172.21.15.135:0/3164666740 >> 172.21.15.135:0/3164666740 conn(0x55dcfa450450 msgr2=0x55dcfa450830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:35.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.907+0000 7f72de604740 1 -- 172.21.15.135:0/3164666740 shutdown_connections 2024-04-20T12:27:35.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.907+0000 7f72de604740 1 -- 172.21.15.135:0/3164666740 wait complete. 2024-04-20T12:27:35.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.908+0000 7f72de604740 1 -- start start 2024-04-20T12:27:35.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.908+0000 7f72de604740 1 Processor -- start 2024-04-20T12:27:35.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.908+0000 7f72de604740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa455d20 0x55dcfa45c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.908+0000 7f72de604740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa456640 0x55dcfa45c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.908+0000 7f72de604740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa45f220 0x55dcfa45cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.908+0000 7f72de604740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa461fb0 con 0x55dcfa45f220 2024-04-20T12:27:35.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.908+0000 7f72de604740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa3742f0 con 0x55dcfa456640 2024-04-20T12:27:35.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.908+0000 7f72de604740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55dcfa462130 con 0x55dcfa455d20 2024-04-20T12:27:35.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.908+0000 7f72de604740 10 client.0 _ll_register_callbacks cb 0x55dcfa33e4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:35.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.908+0000 7f72d9fae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa45f220 0x55dcfa45cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.908+0000 7f72d9fae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa45f220 0x55dcfa45cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56750/0 (socket says 172.21.15.135:56750) 2024-04-20T12:27:35.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.908+0000 7f72d9fae640 1 -- 172.21.15.135:0/2584222083 learned_addr learned my addr 172.21.15.135:0/2584222083 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:35.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.908+0000 7f72d97ad640 1 --2- 172.21.15.135:0/2584222083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa455d20 0x55dcfa45c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72d8fac640 1 --2- 172.21.15.135:0/2584222083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa456640 0x55dcfa45c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72d9fae640 1 -- 172.21.15.135:0/2584222083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa455d20 msgr2=0x55dcfa45c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72d9fae640 1 --2- 172.21.15.135:0/2584222083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa455d20 0x55dcfa45c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72d9fae640 1 -- 172.21.15.135:0/2584222083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa456640 msgr2=0x55dcfa45c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72d9fae640 1 --2- 172.21.15.135:0/2584222083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa456640 0x55dcfa45c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72d9fae640 1 -- 172.21.15.135:0/2584222083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcfa0cd3f0 con 0x55dcfa45f220 2024-04-20T12:27:35.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72d8fac640 1 --2- 172.21.15.135:0/2584222083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa456640 0x55dcfa45c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:27:35.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72d9fae640 1 --2- 172.21.15.135:0/2584222083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa45f220 0x55dcfa45cd50 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0127a0 tx=0x7f72cc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ce549024ecd5d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:35.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:35.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72bcff9640 1 -- 172.21.15.135:0/2584222083 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72cc022070 con 0x55dcfa45f220 2024-04-20T12:27:35.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72bcff9640 1 -- 172.21.15.135:0/2584222083 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f72cc011ae0 con 0x55dcfa45f220 2024-04-20T12:27:35.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72de604740 1 -- 172.21.15.135:0/2584222083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72d002cc20 con 0x55dcfa45f220 2024-04-20T12:27:35.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72bcff9640 1 -- 172.21.15.135:0/2584222083 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f72cc02e050 con 0x55dcfa45f220 2024-04-20T12:27:35.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72de604740 10 client.17151 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:35.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72de604740 1 -- 172.21.15.135:0/2584222083 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dcfa08d0f0 con 0x55dcfa45f220 2024-04-20T12:27:35.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72bcff9640 1 -- 172.21.15.135:0/2584222083 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72d002cc20 con 0x55dcfa45f220 2024-04-20T12:27:35.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72bcff9640 1 -- 172.21.15.135:0/2584222083 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f72cc01a070 con 0x55dcfa45f220 2024-04-20T12:27:35.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72de604740 10 client.17151 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:35.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72de604740 10 client.17151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:35.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72de604740 20 client.17151 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:35.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72de604740 1 --2- 172.21.15.135:0/2584222083 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55dcfa46f670 0x55dcfa471ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72de604740 4 client.17151 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:27:35.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.909+0000 7f72de604740 1 -- 172.21.15.135:0/2584222083 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dcfa3c8bd0 con 0x55dcfa46f670 2024-04-20T12:27:35.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.910+0000 7f72d97ad640 1 --2- 172.21.15.135:0/2584222083 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55dcfa46f670 0x55dcfa471ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.910+0000 7f72d97ad640 1 --2- 172.21.15.135:0/2584222083 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55dcfa46f670 0x55dcfa471ad0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e01b128ea25600b4 server_cookie=4f624438bb51f9db in_seq=0 out_seq=0 2024-04-20T12:27:35.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.910+0000 7f72bcff9640 10 client.17151 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:35.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.911+0000 7f72bcff9640 1 -- 172.21.15.135:0/2584222083 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dcfa3c8bd0 con 0x55dcfa46f670 2024-04-20T12:27:35.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.911+0000 7f72bcff9640 10 client.17151 handle_command_reply: tid=0 2024-04-20T12:27:35.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.911+0000 7f72de604740 1 client.17151 shutdown 2024-04-20T12:27:35.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.911+0000 7f72de604740 1 -- 172.21.15.135:0/2584222083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa45f220 msgr2=0x55dcfa45cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.911+0000 7f72de604740 1 --2- 172.21.15.135:0/2584222083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa45f220 0x55dcfa45cd50 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0127a0 tx=0x7f72cc004ab0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.911+0000 7f72de604740 1 -- 172.21.15.135:0/2584222083 shutdown_connections 2024-04-20T12:27:35.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.911+0000 7f72de604740 1 --2- 172.21.15.135:0/2584222083 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55dcfa46f670 0x55dcfa471ad0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.911+0000 7f72de604740 1 --2- 172.21.15.135:0/2584222083 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa45f220 0x55dcfa45cd50 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.911+0000 7f72bcff9640 0 client.17151 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:35.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.911+0000 7f72de604740 1 --2- 172.21.15.135:0/2584222083 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa456640 0x55dcfa45c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.911+0000 7f72de604740 1 --2- 172.21.15.135:0/2584222083 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa455d20 0x55dcfa45c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.911+0000 7f72de604740 1 -- 172.21.15.135:0/2584222083 >> 172.21.15.135:0/2584222083 conn(0x55dcfa450450 msgr2=0x55dcfa4521a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:35.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.911+0000 7f72de604740 1 -- 172.21.15.135:0/2584222083 shutdown_connections 2024-04-20T12:27:35.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.911+0000 7f72de604740 1 -- 172.21.15.135:0/2584222083 wait complete. 2024-04-20T12:27:35.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.911+0000 7f72de604740 20 client.17151 trim_cache size 0 max 16384 2024-04-20T12:27:35.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.928+0000 7f72de604740 1 Processor -- start 2024-04-20T12:27:35.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.928+0000 7f72de604740 1 -- start start 2024-04-20T12:27:35.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.928+0000 7f72de604740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa455d20 0x55dcfa45ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.928+0000 7f72de604740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa456640 0x55dcfa44b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.928+0000 7f72de604740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa45f220 0x55dcfa46ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.928+0000 7f72de604740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f72d41b1540 con 0x55dcfa455d20 2024-04-20T12:27:35.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.928+0000 7f72de604740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f72d41b3080 con 0x55dcfa45f220 2024-04-20T12:27:35.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.928+0000 7f72de604740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72d41b1c10 con 0x55dcfa456640 2024-04-20T12:27:35.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.929+0000 7f72d97ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa455d20 0x55dcfa45ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.929+0000 7f72d97ad640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa455d20 0x55dcfa45ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56766/0 (socket says 172.21.15.135:56766) 2024-04-20T12:27:35.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.929+0000 7f72d97ad640 1 -- 172.21.15.135:0/2919498972 learned_addr learned my addr 172.21.15.135:0/2919498972 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:35.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.929+0000 7f72d9fae640 1 --2- 172.21.15.135:0/2919498972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa45f220 0x55dcfa46ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.929+0000 7f72d97ad640 1 -- 172.21.15.135:0/2919498972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa456640 msgr2=0x55dcfa44b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.929+0000 7f72d97ad640 1 --2- 172.21.15.135:0/2919498972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa456640 0x55dcfa44b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.929+0000 7f72d97ad640 1 -- 172.21.15.135:0/2919498972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa45f220 msgr2=0x55dcfa46ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.929+0000 7f72d97ad640 1 --2- 172.21.15.135:0/2919498972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa45f220 0x55dcfa46ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.929+0000 7f72d97ad640 1 -- 172.21.15.135:0/2919498972 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcfa45b280 con 0x55dcfa455d20 2024-04-20T12:27:35.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.929+0000 7f72d97ad640 1 --2- 172.21.15.135:0/2919498972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa455d20 0x55dcfa45ea00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f72c80cdaf0 tx=0x7f72c8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b73bffe8acb999 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:35.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.929+0000 7f72beffd640 1 -- 172.21.15.135:0/2919498972 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c8020040 con 0x55dcfa455d20 2024-04-20T12:27:35.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.929+0000 7f72beffd640 1 -- 172.21.15.135:0/2919498972 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72c80d7040 con 0x55dcfa455d20 2024-04-20T12:27:35.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.929+0000 7f72beffd640 1 -- 172.21.15.135:0/2919498972 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c8005290 con 0x55dcfa455d20 2024-04-20T12:27:35.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 -- 172.21.15.135:0/2919498972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa455d20 msgr2=0x55dcfa45ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 --2- 172.21.15.135:0/2919498972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa455d20 0x55dcfa45ea00 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f72c80cdaf0 tx=0x7f72c8009c30 comp rx=0 tx=0).stop 2024-04-20T12:27:35.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 -- 172.21.15.135:0/2919498972 shutdown_connections 2024-04-20T12:27:35.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 --2- 172.21.15.135:0/2919498972 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa45f220 0x55dcfa46ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 --2- 172.21.15.135:0/2919498972 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa456640 0x55dcfa44b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 --2- 172.21.15.135:0/2919498972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa455d20 0x55dcfa45ea00 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 -- 172.21.15.135:0/2919498972 >> 172.21.15.135:0/2919498972 conn(0x55dcfa450450 msgr2=0x55dcfa452130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:35.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 -- 172.21.15.135:0/2919498972 shutdown_connections 2024-04-20T12:27:35.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 -- 172.21.15.135:0/2919498972 wait complete. 2024-04-20T12:27:35.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 -- start start 2024-04-20T12:27:35.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 Processor -- start 2024-04-20T12:27:35.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa455d20 0x55dcfa465510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa456640 0x55dcfa465a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa45f220 0x55dcfa4d4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f72d41b29b0 con 0x55dcfa456640 2024-04-20T12:27:35.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f72d41b22e0 con 0x55dcfa45f220 2024-04-20T12:27:35.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.930+0000 7f72de604740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72d41af510 con 0x55dcfa455d20 2024-04-20T12:27:35.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72de604740 10 client.0 _ll_register_callbacks cb 0x7f72cc009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:27:35.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72d8fac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa456640 0x55dcfa465a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72d8fac640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa456640 0x55dcfa465a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56776/0 (socket says 172.21.15.135:56776) 2024-04-20T12:27:35.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72d8fac640 1 -- 172.21.15.135:0/111773220 learned_addr learned my addr 172.21.15.135:0/111773220 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:27:35.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72d9fae640 1 --2- 172.21.15.135:0/111773220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa45f220 0x55dcfa4d4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72d97ad640 1 --2- 172.21.15.135:0/111773220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa455d20 0x55dcfa465510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72d8fac640 1 -- 172.21.15.135:0/111773220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa455d20 msgr2=0x55dcfa465510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72d8fac640 1 --2- 172.21.15.135:0/111773220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa455d20 0x55dcfa465510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72d8fac640 1 -- 172.21.15.135:0/111773220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa45f220 msgr2=0x55dcfa4d4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:27:35.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72d8fac640 1 --2- 172.21.15.135:0/111773220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa45f220 0x55dcfa4d4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72d8fac640 1 -- 172.21.15.135:0/111773220 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcfa4d5190 con 0x55dcfa456640 2024-04-20T12:27:35.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72d97ad640 1 --2- 172.21.15.135:0/111773220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa455d20 0x55dcfa465510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:27:35.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72d9fae640 1 --2- 172.21.15.135:0/111773220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa45f220 0x55dcfa4d4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:27:35.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72d8fac640 1 --2- 172.21.15.135:0/111773220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa456640 0x55dcfa465a50 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009650 tx=0x7f72d0004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9325c186daf46881 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:27:35.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72bcff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:27:35.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72bcff9640 1 -- 172.21.15.135:0/111773220 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d0049020 con 0x55dcfa456640 2024-04-20T12:27:35.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72bcff9640 1 -- 172.21.15.135:0/111773220 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f72d0005250 con 0x55dcfa456640 2024-04-20T12:27:35.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72de604740 1 -- 172.21.15.135:0/111773220 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72c80d7040 con 0x55dcfa456640 2024-04-20T12:27:35.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72bcff9640 1 -- 172.21.15.135:0/111773220 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f72d0054050 con 0x55dcfa456640 2024-04-20T12:27:35.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72de604740 10 client.17157 fetch_fsmap learned FSMap version 29 2024-04-20T12:27:35.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72de604740 1 -- 172.21.15.135:0/111773220 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dcfa4d64d0 con 0x55dcfa456640 2024-04-20T12:27:35.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.931+0000 7f72bcff9640 1 -- 172.21.15.135:0/111773220 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72c80d7040 con 0x55dcfa456640 2024-04-20T12:27:35.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.932+0000 7f72bcff9640 1 -- 172.21.15.135:0/111773220 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f72d0004cc0 con 0x55dcfa456640 2024-04-20T12:27:35.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.932+0000 7f72de604740 10 client.17157 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:27:35.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.932+0000 7f72de604740 10 client.17157 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:27:35.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.932+0000 7f72de604740 20 client.17157 populate_metadata read hostname 'smithi135' 2024-04-20T12:27:35.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.932+0000 7f72de604740 1 --2- 172.21.15.135:0/111773220 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55dcfa4d6920 0x55dcfa4d8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:27:35.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.932+0000 7f72de604740 4 client.17157 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:27:35.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.932+0000 7f72de604740 1 -- 172.21.15.135:0/111773220 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dcfa3c2a40 con 0x55dcfa4d6920 2024-04-20T12:27:35.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.932+0000 7f72d97ad640 1 --2- 172.21.15.135:0/111773220 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55dcfa4d6920 0x55dcfa4d8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:27:35.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.932+0000 7f72bcff9640 10 client.17157 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:35.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.932+0000 7f72d97ad640 1 --2- 172.21.15.135:0/111773220 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55dcfa4d6920 0x55dcfa4d8d10 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b819f072fd8d2446 server_cookie=122a00e0be97b853 in_seq=0 out_seq=0 2024-04-20T12:27:35.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.932+0000 7f72bcff9640 1 -- 172.21.15.135:0/111773220 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55dcfa3c2a40 con 0x55dcfa4d6920 2024-04-20T12:27:35.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.932+0000 7f72bcff9640 10 client.17157 handle_command_reply: tid=0 2024-04-20T12:27:35.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.932+0000 7f72de604740 1 client.17157 shutdown 2024-04-20T12:27:35.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72de604740 1 -- 172.21.15.135:0/111773220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa456640 msgr2=0x55dcfa465a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72de604740 1 --2- 172.21.15.135:0/111773220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa456640 0x55dcfa465a50 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009650 tx=0x7f72d0004260 comp rx=0 tx=0).stop 2024-04-20T12:27:35.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72de604740 1 -- 172.21.15.135:0/111773220 shutdown_connections 2024-04-20T12:27:35.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72de604740 1 --2- 172.21.15.135:0/111773220 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55dcfa4d6920 0x55dcfa4d8d10 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72de604740 1 --2- 172.21.15.135:0/111773220 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55dcfa45f220 0x55dcfa4d4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72bcff9640 0 client.17157 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:27:35.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72de604740 1 --2- 172.21.15.135:0/111773220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dcfa456640 0x55dcfa465a50 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72de604740 1 --2- 172.21.15.135:0/111773220 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55dcfa455d20 0x55dcfa465510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72de604740 1 -- 172.21.15.135:0/111773220 >> 172.21.15.135:0/111773220 conn(0x55dcfa450450 msgr2=0x55dcfa451820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:35.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72de604740 1 -- 172.21.15.135:0/111773220 shutdown_connections 2024-04-20T12:27:35.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72de604740 1 -- 172.21.15.135:0/111773220 wait complete. 2024-04-20T12:27:35.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72de604740 20 client.17157 trim_cache size 0 max 16384 2024-04-20T12:27:35.939 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:27:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:27:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:27:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "b9a0cbe5-6f43-424c-ad02-d44da46d88ad": { 2024-04-20T12:27:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:27:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "b9a0cbe5-6f43-424c-ad02-d44da46d88ad", 2024-04-20T12:27:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:27:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:27:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:27:35.940 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:27:35.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72dba11640 1 -- 172.21.15.135:0/3190342720 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72c00a3d50 msgr2=0x7f72c00a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72dba11640 1 --2- 172.21.15.135:0/3190342720 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72c00a3d50 0x7f72c00a6210 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f72cc005c40 tx=0x7f72cc0094a0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72dba11640 1 -- 172.21.15.135:0/3190342720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72d41021b0 msgr2=0x7f72d4074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:27:35.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72dba11640 1 --2- 172.21.15.135:0/3190342720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72d41021b0 0x7f72d4074260 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f72c800d770 tx=0x7f72c800dc30 comp rx=0 tx=0).stop 2024-04-20T12:27:35.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72dba11640 1 -- 172.21.15.135:0/3190342720 shutdown_connections 2024-04-20T12:27:35.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72dba11640 1 --2- 172.21.15.135:0/3190342720 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f72d4074ce0 0x7f72d41a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72dba11640 1 --2- 172.21.15.135:0/3190342720 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72c00a3d50 0x7f72c00a6210 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72dba11640 1 --2- 172.21.15.135:0/3190342720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72d4107280 0x7f72d40747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72dba11640 1 --2- 172.21.15.135:0/3190342720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72d41021b0 0x7f72d4074260 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:27:35.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72dba11640 1 -- 172.21.15.135:0/3190342720 >> 172.21.15.135:0/3190342720 conn(0x7f72d4079360 msgr2=0x7f72d4100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:27:35.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72dba11640 1 -- 172.21.15.135:0/3190342720 shutdown_connections 2024-04-20T12:27:35.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:27:35.933+0000 7f72dba11640 1 -- 172.21.15.135:0/3190342720 wait complete. 2024-04-20T12:27:35.943 INFO:tasks.cephfs.filesystem:scrub status for tag:b9a0cbe5-6f43-424c-ad02-d44da46d88ad - {'path': '/', 'tag': 'b9a0cbe5-6f43-424c-ad02-d44da46d88ad', 'options': 'recursive,force'} 2024-04-20T12:27:36.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:36 smithi135 ceph-mon[18264]: pgmap v137: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:36.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:36 smithi154 ceph-mon[22073]: pgmap v137: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:36.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:36 smithi139 ceph-mon[21834]: pgmap v137: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:37.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:37 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:27:37.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:37 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:27:37.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:37 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:27:37.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:37 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:27:37.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:37 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:27:37.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:37 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:27:37.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:37 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:27:37.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:37 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:27:37.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:37 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:27:37.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:37 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:27:37.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:37 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:27:37.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:37 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:27:38.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:38 smithi135 ceph-mon[18264]: pgmap v138: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:38.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:38 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:27:38.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:38 smithi154 ceph-mon[22073]: pgmap v138: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:38.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:38 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:27:38.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:38 smithi139 ceph-mon[21834]: pgmap v138: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:38.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:38 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:27:40.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:40 smithi135 ceph-mon[18264]: pgmap v139: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:27:40.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:40 smithi154 ceph-mon[22073]: pgmap v139: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:27:40.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:40 smithi139 ceph-mon[21834]: pgmap v139: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:27:42.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:42 smithi135 ceph-mon[18264]: pgmap v140: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:27:42.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:42 smithi154 ceph-mon[22073]: pgmap v140: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:27:42.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:42 smithi139 ceph-mon[21834]: pgmap v140: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:27:44.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:44 smithi135 ceph-mon[18264]: pgmap v141: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:27:44.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:44 smithi154 ceph-mon[22073]: pgmap v141: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:27:44.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:44 smithi139 ceph-mon[21834]: pgmap v141: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:27:46.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:46 smithi135 ceph-mon[18264]: pgmap v142: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:27:46.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:46 smithi154 ceph-mon[22073]: pgmap v142: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:27:46.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:46 smithi139 ceph-mon[21834]: pgmap v142: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:27:48.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:48 smithi135 ceph-mon[18264]: pgmap v143: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:27:48.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:48 smithi154 ceph-mon[22073]: pgmap v143: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:27:48.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:48 smithi139 ceph-mon[21834]: pgmap v143: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:27:50.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:50 smithi135 ceph-mon[18264]: pgmap v144: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:27:50.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:50 smithi154 ceph-mon[22073]: pgmap v144: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:27:50.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:50 smithi139 ceph-mon[21834]: pgmap v144: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:27:52.632 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:52 smithi139 ceph-mon[21834]: pgmap v145: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:52.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:52 smithi154 ceph-mon[22073]: pgmap v145: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:52.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:52 smithi135 ceph-mon[18264]: pgmap v145: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:54.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:54 smithi154 ceph-mon[22073]: pgmap v146: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:27:54.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:54 smithi139 ceph-mon[21834]: pgmap v146: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:27:54.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:54 smithi135 ceph-mon[18264]: pgmap v146: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:27:56.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:56 smithi154 ceph-mon[22073]: pgmap v147: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:56.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:56 smithi139 ceph-mon[21834]: pgmap v147: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:56.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:56 smithi135 ceph-mon[18264]: pgmap v147: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:58.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:27:58 smithi154 ceph-mon[22073]: pgmap v148: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:58.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:27:58 smithi139 ceph-mon[21834]: pgmap v148: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:27:58.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:27:58 smithi135 ceph-mon[18264]: pgmap v148: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:00.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:00 smithi154 ceph-mon[22073]: pgmap v149: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:28:00.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:00 smithi139 ceph-mon[21834]: pgmap v149: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:28:00.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:00 smithi135 ceph-mon[18264]: pgmap v149: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:28:02.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:02 smithi154 ceph-mon[22073]: pgmap v150: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:02.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:02 smithi139 ceph-mon[21834]: pgmap v150: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:02.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:02 smithi135 ceph-mon[18264]: pgmap v150: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:04.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:04 smithi154 ceph-mon[22073]: pgmap v151: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:28:04.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:04 smithi139 ceph-mon[21834]: pgmap v151: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:28:04.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:04 smithi135 ceph-mon[18264]: pgmap v151: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:28:05.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:28:05.944 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:28:06.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.057+0000 7f1f5c643640 1 -- 172.21.15.135:0/1755279586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f54107040 msgr2=0x7f1f54107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.057+0000 7f1f5c643640 1 --2- 172.21.15.135:0/1755279586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f54107040 0x7f1f54107420 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009930 tx=0x7f1f5002bc30 comp rx=0 tx=0).stop 2024-04-20T12:28:06.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.057+0000 7f1f5c643640 1 -- 172.21.15.135:0/1755279586 shutdown_connections 2024-04-20T12:28:06.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.057+0000 7f1f5c643640 1 --2- 172.21.15.135:0/1755279586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f54101b50 0x7f1f5410dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.057+0000 7f1f5c643640 1 --2- 172.21.15.135:0/1755279586 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f541011b0 0x7f1f54101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.057+0000 7f1f5c643640 1 --2- 172.21.15.135:0/1755279586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f54107040 0x7f1f54107420 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.057+0000 7f1f5c643640 1 -- 172.21.15.135:0/1755279586 >> 172.21.15.135:0/1755279586 conn(0x7f1f54076c60 msgr2=0x7f1f54077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.057+0000 7f1f5c643640 1 -- 172.21.15.135:0/1755279586 shutdown_connections 2024-04-20T12:28:06.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.057+0000 7f1f5c643640 1 -- 172.21.15.135:0/1755279586 wait complete. 2024-04-20T12:28:06.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.058+0000 7f1f5c643640 1 Processor -- start 2024-04-20T12:28:06.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.058+0000 7f1f5c643640 1 -- start start 2024-04-20T12:28:06.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.058+0000 7f1f5c643640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f541011b0 0x7f1f54102b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.058+0000 7f1f5c643640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f54101b50 0x7f1f541030a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.058+0000 7f1f5c643640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f54107040 0x7f1f541035e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.058+0000 7f1f5c643640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1f54111240 con 0x7f1f54101b50 2024-04-20T12:28:06.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.058+0000 7f1f5c643640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541110c0 con 0x7f1f54107040 2024-04-20T12:28:06.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.058+0000 7f1f5c643640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541113c0 con 0x7f1f541011b0 2024-04-20T12:28:06.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.058+0000 7f1f59bde640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f54101b50 0x7f1f541030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.058+0000 7f1f59bde640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f54101b50 0x7f1f541030a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37700/0 (socket says 172.21.15.135:37700) 2024-04-20T12:28:06.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.058+0000 7f1f59bde640 1 -- 172.21.15.135:0/1788117905 learned_addr learned my addr 172.21.15.135:0/1788117905 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.058+0000 7f1f5a3df640 1 --2- 172.21.15.135:0/1788117905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f541011b0 0x7f1f54102b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.059+0000 7f1f5abe0640 1 --2- 172.21.15.135:0/1788117905 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f54107040 0x7f1f541035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.059+0000 7f1f59bde640 1 -- 172.21.15.135:0/1788117905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f541011b0 msgr2=0x7f1f54102b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.059+0000 7f1f59bde640 1 --2- 172.21.15.135:0/1788117905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f541011b0 0x7f1f54102b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.059+0000 7f1f59bde640 1 -- 172.21.15.135:0/1788117905 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f54107040 msgr2=0x7f1f541035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.059+0000 7f1f59bde640 1 --2- 172.21.15.135:0/1788117905 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f54107040 0x7f1f541035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.059+0000 7f1f59bde640 1 -- 172.21.15.135:0/1788117905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f541a6dd0 con 0x7f1f54101b50 2024-04-20T12:28:06.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.059+0000 7f1f5abe0640 1 --2- 172.21.15.135:0/1788117905 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f54107040 0x7f1f541035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:06.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.059+0000 7f1f59bde640 1 --2- 172.21.15.135:0/1788117905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f54101b50 0x7f1f541030a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800d950 tx=0x7f1f4800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.059+0000 7f1f477fe640 1 -- 172.21.15.135:0/1788117905 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48017070 con 0x7f1f54101b50 2024-04-20T12:28:06.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.059+0000 7f1f5c643640 1 -- 172.21.15.135:0/1788117905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f541a70c0 con 0x7f1f54101b50 2024-04-20T12:28:06.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.059+0000 7f1f477fe640 1 -- 172.21.15.135:0/1788117905 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f48009c30 con 0x7f1f54101b50 2024-04-20T12:28:06.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.059+0000 7f1f477fe640 1 -- 172.21.15.135:0/1788117905 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4800f6b0 con 0x7f1f54101b50 2024-04-20T12:28:06.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.059+0000 7f1f5c643640 1 -- 172.21.15.135:0/1788117905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f541a7610 con 0x7f1f54101b50 2024-04-20T12:28:06.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.062+0000 7f1f5f23a740 1 Processor -- start 2024-04-20T12:28:06.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.062+0000 7f1f5f23a740 1 -- start start 2024-04-20T12:28:06.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.062+0000 7f1f477fe640 1 -- 172.21.15.135:0/1788117905 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f1f480109d0 con 0x7f1f54101b50 2024-04-20T12:28:06.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.062+0000 7f1f5f23a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c8080fd20 0x558c80810100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.062+0000 7f1f5f23a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c80810640 0x558c80818ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.062+0000 7f1f5f23a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c80819220 0x558c8081b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.062+0000 7f1f5f23a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558c807751b0 con 0x558c80819220 2024-04-20T12:28:06.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.062+0000 7f1f5f23a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558c80712390 con 0x558c8080fd20 2024-04-20T12:28:06.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.062+0000 7f1f5f23a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558c80771170 con 0x558c80810640 2024-04-20T12:28:06.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.062+0000 7f1f59bde640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c80819220 0x558c8081b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.062+0000 7f1f59bde640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c80819220 0x558c8081b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37712/0 (socket says 172.21.15.135:37712) 2024-04-20T12:28:06.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.062+0000 7f1f59bde640 1 -- 172.21.15.135:0/3594576586 learned_addr learned my addr 172.21.15.135:0/3594576586 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.062+0000 7f1f5a3df640 1 --2- 172.21.15.135:0/3594576586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c80810640 0x558c80818ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.062+0000 7f1f5abe0640 1 --2- 172.21.15.135:0/3594576586 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c8080fd20 0x558c80810100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.063+0000 7f1f59bde640 1 -- 172.21.15.135:0/3594576586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c80810640 msgr2=0x558c80818ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.063+0000 7f1f59bde640 1 --2- 172.21.15.135:0/3594576586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c80810640 0x558c80818ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.063+0000 7f1f59bde640 1 -- 172.21.15.135:0/3594576586 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c8080fd20 msgr2=0x558c80810100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.063+0000 7f1f59bde640 1 --2- 172.21.15.135:0/3594576586 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c8080fd20 0x558c80810100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.063+0000 7f1f59bde640 1 -- 172.21.15.135:0/3594576586 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c805517d0 con 0x558c80819220 2024-04-20T12:28:06.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.063+0000 7f1f477fe640 1 --2- 172.21.15.135:0/1788117905 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1f400a3d20 0x7f1f400a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.063+0000 7f1f59bde640 1 --2- 172.21.15.135:0/3594576586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c80819220 0x558c8081b610 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1f480cd910 tx=0x7f1f480d6cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36870ee6dfab3f01 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.063+0000 7f1f5abe0640 1 --2- 172.21.15.135:0/1788117905 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1f400a3d20 0x7f1f400a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.063+0000 7f1f44bfe640 1 -- 172.21.15.135:0/3594576586 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48098490 con 0x558c80819220 2024-04-20T12:28:06.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.063+0000 7f1f477fe640 1 -- 172.21.15.135:0/1788117905 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f1f480d05d0 con 0x7f1f54101b50 2024-04-20T12:28:06.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.063+0000 7f1f44bfe640 1 -- 172.21.15.135:0/3594576586 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f4809c8f0 con 0x558c80819220 2024-04-20T12:28:06.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.063+0000 7f1f44bfe640 1 -- 172.21.15.135:0/3594576586 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f480b82c0 con 0x558c80819220 2024-04-20T12:28:06.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.064+0000 7f1f5f23a740 1 -- 172.21.15.135:0/3594576586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c80819220 msgr2=0x558c8081b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.064+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/3594576586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c80819220 0x558c8081b610 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1f480cd910 tx=0x7f1f480d6cd0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.064+0000 7f1f5abe0640 1 --2- 172.21.15.135:0/1788117905 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1f400a3d20 0x7f1f400a61e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00af00 tx=0x7f1f4c00a6b0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.064+0000 7f1f5f23a740 1 -- 172.21.15.135:0/3594576586 shutdown_connections 2024-04-20T12:28:06.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.064+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/3594576586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c80819220 0x558c8081b610 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.064+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/3594576586 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c80810640 0x558c80818ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.064+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/3594576586 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c8080fd20 0x558c80810100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.064+0000 7f1f5f23a740 1 -- 172.21.15.135:0/3594576586 >> 172.21.15.135:0/3594576586 conn(0x558c8080a450 msgr2=0x558c8080a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.064+0000 7f1f5f23a740 1 -- 172.21.15.135:0/3594576586 shutdown_connections 2024-04-20T12:28:06.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.064+0000 7f1f5f23a740 1 -- 172.21.15.135:0/3594576586 wait complete. 2024-04-20T12:28:06.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.064+0000 7f1f5f23a740 1 -- start start 2024-04-20T12:28:06.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.064+0000 7f1f5f23a740 1 Processor -- start 2024-04-20T12:28:06.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5f23a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c8080fd20 0x558c80816280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5f23a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c80810640 0x558c808167c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5f23a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c80819220 0x558c80816d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5f23a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558c8081bfb0 con 0x558c8080fd20 2024-04-20T12:28:06.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5f23a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558c8072e2f0 con 0x558c80819220 2024-04-20T12:28:06.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5f23a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558c8081c130 con 0x558c80810640 2024-04-20T12:28:06.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5f23a740 10 client.0 _ll_register_callbacks cb 0x558c806f84e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:06.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5a3df640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c8080fd20 0x558c80816280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5a3df640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c8080fd20 0x558c80816280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37724/0 (socket says 172.21.15.135:37724) 2024-04-20T12:28:06.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5a3df640 1 -- 172.21.15.135:0/2855224284 learned_addr learned my addr 172.21.15.135:0/2855224284 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f59bde640 1 --2- 172.21.15.135:0/2855224284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c80810640 0x558c808167c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5abe0640 1 --2- 172.21.15.135:0/2855224284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c80819220 0x558c80816d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5a3df640 1 -- 172.21.15.135:0/2855224284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c80810640 msgr2=0x558c808167c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5a3df640 1 --2- 172.21.15.135:0/2855224284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c80810640 0x558c808167c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5a3df640 1 -- 172.21.15.135:0/2855224284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c80819220 msgr2=0x558c80816d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5a3df640 1 --2- 172.21.15.135:0/2855224284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c80819220 0x558c80816d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5a3df640 1 -- 172.21.15.135:0/2855224284 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c804873f0 con 0x558c8080fd20 2024-04-20T12:28:06.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5a3df640 1 --2- 172.21.15.135:0/2855224284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c8080fd20 0x558c80816280 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009900 tx=0x7f1f5002ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33019bfe914b0aaf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:06.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f3dffb640 1 -- 172.21.15.135:0/2855224284 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50004400 con 0x558c8080fd20 2024-04-20T12:28:06.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f3dffb640 1 -- 172.21.15.135:0/2855224284 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f1f500046c0 con 0x558c8080fd20 2024-04-20T12:28:06.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.065+0000 7f1f5f23a740 1 -- 172.21.15.135:0/2855224284 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f4809c8f0 con 0x558c8080fd20 2024-04-20T12:28:06.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.066+0000 7f1f3dffb640 1 -- 172.21.15.135:0/2855224284 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1f500048c0 con 0x558c8080fd20 2024-04-20T12:28:06.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.066+0000 7f1f5f23a740 10 client.17169 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:06.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.066+0000 7f1f5f23a740 1 -- 172.21.15.135:0/2855224284 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558c804470f0 con 0x558c8080fd20 2024-04-20T12:28:06.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.066+0000 7f1f3dffb640 1 -- 172.21.15.135:0/2855224284 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f4809c8f0 con 0x558c8080fd20 2024-04-20T12:28:06.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.066+0000 7f1f3dffb640 1 -- 172.21.15.135:0/2855224284 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f1f50003680 con 0x558c8080fd20 2024-04-20T12:28:06.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.066+0000 7f1f5f23a740 10 client.17169 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:06.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.066+0000 7f1f5f23a740 10 client.17169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:06.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.066+0000 7f1f5f23a740 20 client.17169 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:06.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.066+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/2855224284 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558c808295c0 0x558c8082ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.066+0000 7f1f5f23a740 4 client.17169 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:06.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.066+0000 7f1f5f23a740 1 -- 172.21.15.135:0/2855224284 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c80782bd0 con 0x558c808295c0 2024-04-20T12:28:06.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.066+0000 7f1f59bde640 1 --2- 172.21.15.135:0/2855224284 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558c808295c0 0x558c8082ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.067+0000 7f1f59bde640 1 --2- 172.21.15.135:0/2855224284 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558c808295c0 0x558c8082ba10 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c78b0c89559f17c5 server_cookie=dacc8392e675b26a in_seq=0 out_seq=0 2024-04-20T12:28:06.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.067+0000 7f1f3dffb640 10 client.17169 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:06.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.067+0000 7f1f3dffb640 1 -- 172.21.15.135:0/2855224284 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558c80782bd0 con 0x558c808295c0 2024-04-20T12:28:06.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.067+0000 7f1f3dffb640 10 client.17169 handle_command_reply: tid=0 2024-04-20T12:28:06.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.067+0000 7f1f5f23a740 1 client.17169 shutdown 2024-04-20T12:28:06.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.068+0000 7f1f5f23a740 1 -- 172.21.15.135:0/2855224284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c8080fd20 msgr2=0x558c80816280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.068+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/2855224284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c8080fd20 0x558c80816280 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009900 tx=0x7f1f5002ce30 comp rx=0 tx=0).stop 2024-04-20T12:28:06.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.068+0000 7f1f5f23a740 1 -- 172.21.15.135:0/2855224284 shutdown_connections 2024-04-20T12:28:06.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.068+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/2855224284 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558c808295c0 0x558c8082ba10 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.068+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/2855224284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c80819220 0x558c80816d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.068+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/2855224284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c80810640 0x558c808167c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.068+0000 7f1f3dffb640 0 client.17169 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:06.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.068+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/2855224284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c8080fd20 0x558c80816280 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.068+0000 7f1f5f23a740 1 -- 172.21.15.135:0/2855224284 >> 172.21.15.135:0/2855224284 conn(0x558c8080a450 msgr2=0x558c8080c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.068+0000 7f1f5f23a740 1 -- 172.21.15.135:0/2855224284 shutdown_connections 2024-04-20T12:28:06.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.068+0000 7f1f5f23a740 1 -- 172.21.15.135:0/2855224284 wait complete. 2024-04-20T12:28:06.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.068+0000 7f1f5f23a740 20 client.17169 trim_cache size 0 max 16384 2024-04-20T12:28:06.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.085+0000 7f1f5f23a740 1 Processor -- start 2024-04-20T12:28:06.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.085+0000 7f1f5f23a740 1 -- start start 2024-04-20T12:28:06.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.085+0000 7f1f5f23a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c8080fd20 0x558c808189b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.085+0000 7f1f5f23a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c80810640 0x558c80809630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.085+0000 7f1f5f23a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c80819220 0x558c808312e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.085+0000 7f1f5f23a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541b16f0 con 0x558c8080fd20 2024-04-20T12:28:06.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.085+0000 7f1f5f23a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541b3230 con 0x558c80819220 2024-04-20T12:28:06.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.085+0000 7f1f5f23a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541b1dc0 con 0x558c80810640 2024-04-20T12:28:06.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.085+0000 7f1f5a3df640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c8080fd20 0x558c808189b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.085+0000 7f1f5a3df640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c8080fd20 0x558c808189b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37734/0 (socket says 172.21.15.135:37734) 2024-04-20T12:28:06.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.085+0000 7f1f5a3df640 1 -- 172.21.15.135:0/4211683374 learned_addr learned my addr 172.21.15.135:0/4211683374 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.085+0000 7f1f5a3df640 1 -- 172.21.15.135:0/4211683374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c80810640 msgr2=0x558c80809630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.085+0000 7f1f5a3df640 1 --2- 172.21.15.135:0/4211683374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c80810640 0x558c80809630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.085+0000 7f1f5a3df640 1 -- 172.21.15.135:0/4211683374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c80819220 msgr2=0x558c808312e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.085+0000 7f1f5a3df640 1 --2- 172.21.15.135:0/4211683374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c80819220 0x558c808312e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.086+0000 7f1f5a3df640 1 -- 172.21.15.135:0/4211683374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c80809cb0 con 0x558c8080fd20 2024-04-20T12:28:06.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.086+0000 7f1f5a3df640 1 --2- 172.21.15.135:0/4211683374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c8080fd20 0x558c808189b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009930 tx=0x7f1f5002cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4187f8fd8825d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.086+0000 7f1f3ffff640 1 -- 172.21.15.135:0/4211683374 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5005b070 con 0x558c8080fd20 2024-04-20T12:28:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.086+0000 7f1f3ffff640 1 -- 172.21.15.135:0/4211683374 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f500037f0 con 0x558c8080fd20 2024-04-20T12:28:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.086+0000 7f1f3ffff640 1 -- 172.21.15.135:0/4211683374 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50003ef0 con 0x558c8080fd20 2024-04-20T12:28:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.086+0000 7f1f5f23a740 1 -- 172.21.15.135:0/4211683374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c8080fd20 msgr2=0x558c808189b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.086+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/4211683374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c8080fd20 0x558c808189b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009930 tx=0x7f1f5002cea0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.086+0000 7f1f5f23a740 1 -- 172.21.15.135:0/4211683374 shutdown_connections 2024-04-20T12:28:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.086+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/4211683374 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c80819220 0x558c808312e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.086+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/4211683374 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c80810640 0x558c80809630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.086+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/4211683374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c8080fd20 0x558c808189b0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.086+0000 7f1f5f23a740 1 -- 172.21.15.135:0/4211683374 >> 172.21.15.135:0/4211683374 conn(0x558c8080a450 msgr2=0x558c8080b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.086+0000 7f1f5f23a740 1 -- 172.21.15.135:0/4211683374 shutdown_connections 2024-04-20T12:28:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.086+0000 7f1f5f23a740 1 -- 172.21.15.135:0/4211683374 wait complete. 2024-04-20T12:28:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f5f23a740 1 -- start start 2024-04-20T12:28:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f5f23a740 1 Processor -- start 2024-04-20T12:28:06.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f5f23a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c8080fd20 0x558c80888230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f5f23a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c80810640 0x558c80888770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f5f23a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c80819220 0x558c80820940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f5f23a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541b2b60 con 0x558c80810640 2024-04-20T12:28:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f5f23a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541b2490 con 0x558c80819220 2024-04-20T12:28:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f5f23a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1f541af6c0 con 0x558c8080fd20 2024-04-20T12:28:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f5f23a740 10 client.0 _ll_register_callbacks cb 0x7f1f5002ccf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f59bde640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c80810640 0x558c80888770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f59bde640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c80810640 0x558c80888770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37738/0 (socket says 172.21.15.135:37738) 2024-04-20T12:28:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f59bde640 1 -- 172.21.15.135:0/1085547349 learned_addr learned my addr 172.21.15.135:0/1085547349 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f5a3df640 1 --2- 172.21.15.135:0/1085547349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c8080fd20 0x558c80888230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f59bde640 1 -- 172.21.15.135:0/1085547349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c8080fd20 msgr2=0x558c80888230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f59bde640 1 --2- 172.21.15.135:0/1085547349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c8080fd20 0x558c80888230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f59bde640 1 -- 172.21.15.135:0/1085547349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c80819220 msgr2=0x558c80820940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f59bde640 1 --2- 172.21.15.135:0/1085547349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c80819220 0x558c80820940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f59bde640 1 -- 172.21.15.135:0/1085547349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c80821080 con 0x558c80810640 2024-04-20T12:28:06.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f5a3df640 1 --2- 172.21.15.135:0/1085547349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c8080fd20 0x558c80888230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:06.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.087+0000 7f1f59bde640 1 --2- 172.21.15.135:0/1085547349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c80810640 0x558c80888770 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009610 tx=0x7f1f48010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57d5440385bff8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:06.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f3dffb640 1 -- 172.21.15.135:0/1085547349 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48014030 con 0x558c80810640 2024-04-20T12:28:06.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f3dffb640 1 -- 172.21.15.135:0/1085547349 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f1f4809a4f0 con 0x558c80810640 2024-04-20T12:28:06.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f5f23a740 1 -- 172.21.15.135:0/1085547349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f500037f0 con 0x558c80810640 2024-04-20T12:28:06.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f3dffb640 1 -- 172.21.15.135:0/1085547349 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1f480b6480 con 0x558c80810640 2024-04-20T12:28:06.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f5f23a740 10 client.17175 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:06.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f5f23a740 1 -- 172.21.15.135:0/1085547349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558c8088fa60 con 0x558c80810640 2024-04-20T12:28:06.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f3dffb640 1 -- 172.21.15.135:0/1085547349 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f500037f0 con 0x558c80810640 2024-04-20T12:28:06.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f3dffb640 1 -- 172.21.15.135:0/1085547349 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f1f480cdc20 con 0x558c80810640 2024-04-20T12:28:06.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f5f23a740 10 client.17175 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:06.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f5f23a740 10 client.17175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:06.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f5f23a740 20 client.17175 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:06.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/1085547349 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558c8088fd40 0x558c80892130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f5f23a740 4 client.17175 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:28:06.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f5f23a740 1 -- 172.21.15.135:0/1085547349 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558c8077ca40 con 0x558c8088fd40 2024-04-20T12:28:06.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.088+0000 7f1f5a3df640 1 --2- 172.21.15.135:0/1085547349 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558c8088fd40 0x558c80892130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f3dffb640 10 client.17175 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:06.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f5a3df640 1 --2- 172.21.15.135:0/1085547349 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558c8088fd40 0x558c80892130 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f03c390a429ca518 server_cookie=d6c1065e5a119f97 in_seq=0 out_seq=0 2024-04-20T12:28:06.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f3dffb640 1 -- 172.21.15.135:0/1085547349 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558c8077ca40 con 0x558c8088fd40 2024-04-20T12:28:06.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f3dffb640 10 client.17175 handle_command_reply: tid=0 2024-04-20T12:28:06.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f5f23a740 1 client.17175 shutdown 2024-04-20T12:28:06.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f5f23a740 1 -- 172.21.15.135:0/1085547349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c80810640 msgr2=0x558c80888770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/1085547349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c80810640 0x558c80888770 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f1f48009610 tx=0x7f1f48010ce0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f5f23a740 1 -- 172.21.15.135:0/1085547349 shutdown_connections 2024-04-20T12:28:06.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/1085547349 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558c8088fd40 0x558c80892130 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/1085547349 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558c80819220 0x558c80820940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/1085547349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558c80810640 0x558c80888770 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f3dffb640 0 client.17175 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:06.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f5f23a740 1 --2- 172.21.15.135:0/1085547349 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558c8080fd20 0x558c80888230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f5f23a740 1 -- 172.21.15.135:0/1085547349 >> 172.21.15.135:0/1085547349 conn(0x558c8080a450 msgr2=0x558c8080be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f5f23a740 1 -- 172.21.15.135:0/1085547349 shutdown_connections 2024-04-20T12:28:06.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f5f23a740 1 -- 172.21.15.135:0/1085547349 wait complete. 2024-04-20T12:28:06.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.089+0000 7f1f5f23a740 20 client.17175 trim_cache size 0 max 16384 2024-04-20T12:28:06.096 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:28:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:28:06.096 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:28:06.096 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:28:06.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.090+0000 7f1f5c643640 1 -- 172.21.15.135:0/1788117905 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1f400a3d20 msgr2=0x7f1f400a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.090+0000 7f1f5c643640 1 --2- 172.21.15.135:0/1788117905 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1f400a3d20 0x7f1f400a61e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00af00 tx=0x7f1f4c00a6b0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.090+0000 7f1f5c643640 1 -- 172.21.15.135:0/1788117905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f54101b50 msgr2=0x7f1f541030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.090+0000 7f1f5c643640 1 --2- 172.21.15.135:0/1788117905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f54101b50 0x7f1f541030a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800d950 tx=0x7f1f4800de10 comp rx=0 tx=0).stop 2024-04-20T12:28:06.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.090+0000 7f1f5c643640 1 -- 172.21.15.135:0/1788117905 shutdown_connections 2024-04-20T12:28:06.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.090+0000 7f1f5c643640 1 --2- 172.21.15.135:0/1788117905 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1f54107040 0x7f1f541035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.090+0000 7f1f5c643640 1 --2- 172.21.15.135:0/1788117905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f54101b50 0x7f1f541030a0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.090+0000 7f1f5c643640 1 --2- 172.21.15.135:0/1788117905 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1f400a3d20 0x7f1f400a61e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.090+0000 7f1f5c643640 1 --2- 172.21.15.135:0/1788117905 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f541011b0 0x7f1f54102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.090+0000 7f1f5c643640 1 -- 172.21.15.135:0/1788117905 >> 172.21.15.135:0/1788117905 conn(0x7f1f54076c60 msgr2=0x7f1f54100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.090+0000 7f1f5c643640 1 -- 172.21.15.135:0/1788117905 shutdown_connections 2024-04-20T12:28:06.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.090+0000 7f1f5c643640 1 -- 172.21.15.135:0/1788117905 wait complete. 2024-04-20T12:28:06.100 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:28:06.101 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:28:06.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.199+0000 7efd4bd59640 1 -- 172.21.15.135:0/507057759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd44101ad0 msgr2=0x7efd44105ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.199+0000 7efd4bd59640 1 --2- 172.21.15.135:0/507057759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd44101ad0 0x7efd44105ac0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7efd40009900 tx=0x7efd4002bc30 comp rx=0 tx=0).stop 2024-04-20T12:28:06.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.199+0000 7efd4bd59640 1 -- 172.21.15.135:0/507057759 shutdown_connections 2024-04-20T12:28:06.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.199+0000 7efd4bd59640 1 --2- 172.21.15.135:0/507057759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd441061a0 0x7efd4410dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.199+0000 7efd4bd59640 1 --2- 172.21.15.135:0/507057759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd44101ad0 0x7efd44105ac0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.199+0000 7efd4bd59640 1 --2- 172.21.15.135:0/507057759 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd44101120 0x7efd44101500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.199+0000 7efd4bd59640 1 -- 172.21.15.135:0/507057759 >> 172.21.15.135:0/507057759 conn(0x7efd44077fc0 msgr2=0x7efd440783d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.199+0000 7efd4bd59640 1 -- 172.21.15.135:0/507057759 shutdown_connections 2024-04-20T12:28:06.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.199+0000 7efd4bd59640 1 -- 172.21.15.135:0/507057759 wait complete. 2024-04-20T12:28:06.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.199+0000 7efd4bd59640 1 Processor -- start 2024-04-20T12:28:06.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4bd59640 1 -- start start 2024-04-20T12:28:06.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4bd59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd44101120 0x7efd44199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4bd59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd441061a0 0x7efd44199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4bd59640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4419a190 0x7efd441a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4bd59640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd44111210 con 0x7efd4419a190 2024-04-20T12:28:06.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4bd59640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7efd44111090 con 0x7efd441061a0 2024-04-20T12:28:06.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4bd59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7efd44111390 con 0x7efd44101120 2024-04-20T12:28:06.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4a2f6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4419a190 0x7efd441a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4a2f6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4419a190 0x7efd441a46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37756/0 (socket says 172.21.15.135:37756) 2024-04-20T12:28:06.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4a2f6640 1 -- 172.21.15.135:0/2454924088 learned_addr learned my addr 172.21.15.135:0/2454924088 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd492f4640 1 --2- 172.21.15.135:0/2454924088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd441061a0 0x7efd44199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd49af5640 1 --2- 172.21.15.135:0/2454924088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd44101120 0x7efd44199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4a2f6640 1 -- 172.21.15.135:0/2454924088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd44101120 msgr2=0x7efd44199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4a2f6640 1 --2- 172.21.15.135:0/2454924088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd44101120 0x7efd44199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4a2f6640 1 -- 172.21.15.135:0/2454924088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd441061a0 msgr2=0x7efd44199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4a2f6640 1 --2- 172.21.15.135:0/2454924088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd441061a0 0x7efd44199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4a2f6640 1 -- 172.21.15.135:0/2454924088 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd441a4f10 con 0x7efd4419a190 2024-04-20T12:28:06.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4a2f6640 1 --2- 172.21.15.135:0/2454924088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4419a190 0x7efd441a46f0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00ea60 tx=0x7efd3c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd3affd640 1 -- 172.21.15.135:0/2454924088 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c00ce40 con 0x7efd4419a190 2024-04-20T12:28:06.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd3affd640 1 -- 172.21.15.135:0/2454924088 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd3c005020 con 0x7efd4419a190 2024-04-20T12:28:06.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd4bd59640 1 -- 172.21.15.135:0/2454924088 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd441a5200 con 0x7efd4419a190 2024-04-20T12:28:06.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.200+0000 7efd3affd640 1 -- 172.21.15.135:0/2454924088 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c010690 con 0x7efd4419a190 2024-04-20T12:28:06.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.201+0000 7efd4bd59640 1 -- 172.21.15.135:0/2454924088 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd441a56d0 con 0x7efd4419a190 2024-04-20T12:28:06.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.202+0000 7efd4bd59640 1 -- 172.21.15.135:0/2454924088 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd440691d0 con 0x7efd4419a190 2024-04-20T12:28:06.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.203+0000 7efd3affd640 1 -- 172.21.15.135:0/2454924088 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7efd3c005520 con 0x7efd4419a190 2024-04-20T12:28:06.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.203+0000 7efd3affd640 1 --2- 172.21.15.135:0/2454924088 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7efd300a3d20 0x7efd300a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.203+0000 7efd49af5640 1 --2- 172.21.15.135:0/2454924088 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7efd300a3d20 0x7efd300a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.204+0000 7efd3affd640 1 -- 172.21.15.135:0/2454924088 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7efd3c0d1070 con 0x7efd4419a190 2024-04-20T12:28:06.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.204+0000 7efd49af5640 1 --2- 172.21.15.135:0/2454924088 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7efd300a3d20 0x7efd300a61e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efd34005fd0 tx=0x7efd34005850 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.208+0000 7efd3affd640 1 -- 172.21.15.135:0/2454924088 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7efd3c09d390 con 0x7efd4419a190 2024-04-20T12:28:06.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.427+0000 7efd4bd59640 1 -- 172.21.15.135:0/2454924088 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd44101ad0 con 0x7efd4419a190 2024-04-20T12:28:06.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.428+0000 7efd3affd640 1 -- 172.21.15.135:0/2454924088 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7efd3c09cc90 con 0x7efd4419a190 2024-04-20T12:28:06.428 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:28:06.428 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:28:06.428 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:28:06.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.430+0000 7efd4bd59640 1 -- 172.21.15.135:0/2454924088 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7efd300a3d20 msgr2=0x7efd300a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.430+0000 7efd4bd59640 1 --2- 172.21.15.135:0/2454924088 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7efd300a3d20 0x7efd300a61e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efd34005fd0 tx=0x7efd34005850 comp rx=0 tx=0).stop 2024-04-20T12:28:06.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.430+0000 7efd4bd59640 1 -- 172.21.15.135:0/2454924088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4419a190 msgr2=0x7efd441a46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.430+0000 7efd4bd59640 1 --2- 172.21.15.135:0/2454924088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4419a190 0x7efd441a46f0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00ea60 tx=0x7efd3c00ef20 comp rx=0 tx=0).stop 2024-04-20T12:28:06.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.430+0000 7efd4bd59640 1 -- 172.21.15.135:0/2454924088 shutdown_connections 2024-04-20T12:28:06.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.430+0000 7efd4bd59640 1 --2- 172.21.15.135:0/2454924088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd4419a190 0x7efd441a46f0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.430+0000 7efd4bd59640 1 --2- 172.21.15.135:0/2454924088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7efd441061a0 0x7efd44199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.430+0000 7efd4bd59640 1 --2- 172.21.15.135:0/2454924088 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7efd300a3d20 0x7efd300a61e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.430+0000 7efd4bd59640 1 --2- 172.21.15.135:0/2454924088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd44101120 0x7efd44199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.430+0000 7efd4bd59640 1 -- 172.21.15.135:0/2454924088 >> 172.21.15.135:0/2454924088 conn(0x7efd44077fc0 msgr2=0x7efd440ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.430+0000 7efd4bd59640 1 -- 172.21.15.135:0/2454924088 shutdown_connections 2024-04-20T12:28:06.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.431+0000 7efd4bd59640 1 -- 172.21.15.135:0/2454924088 wait complete. 2024-04-20T12:28:06.442 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:28:06.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.542+0000 7f2387e6d640 1 -- 172.21.15.135:0/3166540657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2380101a60 msgr2=0x7f2380105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.542+0000 7f2387e6d640 1 --2- 172.21.15.135:0/3166540657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2380101a60 0x7f2380105aa0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f2370009900 tx=0x7f237002bc30 comp rx=0 tx=0).stop 2024-04-20T12:28:06.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.542+0000 7f2387e6d640 1 -- 172.21.15.135:0/3166540657 shutdown_connections 2024-04-20T12:28:06.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.542+0000 7f2387e6d640 1 --2- 172.21.15.135:0/3166540657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2380106180 0x7f238010dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.542+0000 7f2387e6d640 1 --2- 172.21.15.135:0/3166540657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2380101a60 0x7f2380105aa0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.542+0000 7f2387e6d640 1 --2- 172.21.15.135:0/3166540657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f23801010b0 0x7f2380101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.542+0000 7f2387e6d640 1 -- 172.21.15.135:0/3166540657 >> 172.21.15.135:0/3166540657 conn(0x7f2380077f80 msgr2=0x7f2380078390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.542+0000 7f2387e6d640 1 -- 172.21.15.135:0/3166540657 shutdown_connections 2024-04-20T12:28:06.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.542+0000 7f2387e6d640 1 -- 172.21.15.135:0/3166540657 wait complete. 2024-04-20T12:28:06.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2387e6d640 1 Processor -- start 2024-04-20T12:28:06.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2387e6d640 1 -- start start 2024-04-20T12:28:06.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2387e6d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23801010b0 0x7f23801976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2387e6d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2380106180 0x7f2380197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2387e6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f238019bf40 0x7f238019c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2387e6d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f23801111f0 con 0x7f23801010b0 2024-04-20T12:28:06.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2387e6d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2380111070 con 0x7f2380106180 2024-04-20T12:28:06.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2387e6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2380111370 con 0x7f238019bf40 2024-04-20T12:28:06.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2385c09640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23801010b0 0x7f23801976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2385c09640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23801010b0 0x7f23801976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37778/0 (socket says 172.21.15.135:37778) 2024-04-20T12:28:06.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2385c09640 1 -- 172.21.15.135:0/3349590932 learned_addr learned my addr 172.21.15.135:0/3349590932 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f238640a640 1 --2- 172.21.15.135:0/3349590932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f238019bf40 0x7f238019c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2385408640 1 --2- 172.21.15.135:0/3349590932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2380106180 0x7f2380197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2385c09640 1 -- 172.21.15.135:0/3349590932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f238019bf40 msgr2=0x7f238019c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2385c09640 1 --2- 172.21.15.135:0/3349590932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f238019bf40 0x7f238019c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2385c09640 1 -- 172.21.15.135:0/3349590932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2380106180 msgr2=0x7f2380197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2385c09640 1 --2- 172.21.15.135:0/3349590932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2380106180 0x7f2380197c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f2385c09640 1 -- 172.21.15.135:0/3349590932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f238019ca30 con 0x7f23801010b0 2024-04-20T12:28:06.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.543+0000 7f238640a640 1 --2- 172.21.15.135:0/3349590932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f238019bf40 0x7f238019c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:06.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.544+0000 7f2385c09640 1 --2- 172.21.15.135:0/3349590932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23801010b0 0x7f23801976d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f237c00c890 tx=0x7f237c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.544+0000 7f2376ffd640 1 -- 172.21.15.135:0/3349590932 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c004220 con 0x7f23801010b0 2024-04-20T12:28:06.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.544+0000 7f2376ffd640 1 -- 172.21.15.135:0/3349590932 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f237c0043c0 con 0x7f23801010b0 2024-04-20T12:28:06.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.544+0000 7f2387e6d640 1 -- 172.21.15.135:0/3349590932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f238019cd20 con 0x7f23801010b0 2024-04-20T12:28:06.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.544+0000 7f2376ffd640 1 -- 172.21.15.135:0/3349590932 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c0049e0 con 0x7f23801010b0 2024-04-20T12:28:06.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.544+0000 7f2387e6d640 1 -- 172.21.15.135:0/3349590932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23801a4510 con 0x7f23801010b0 2024-04-20T12:28:06.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.547+0000 7f2376ffd640 1 -- 172.21.15.135:0/3349590932 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f237c0079b0 con 0x7f23801010b0 2024-04-20T12:28:06.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.547+0000 7f238aa65740 1 Processor -- start 2024-04-20T12:28:06.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.547+0000 7f238aa65740 1 -- start start 2024-04-20T12:28:06.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.547+0000 7f238aa65740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477ea9e10 0x558477eaa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.547+0000 7f238aa65740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477eaa730 0x558477eb2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.547+0000 7f238aa65740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.547+0000 7f238aa65740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558477e0f110 con 0x558477eb3310 2024-04-20T12:28:06.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.547+0000 7f238aa65740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558477dac550 con 0x558477eaa730 2024-04-20T12:28:06.554 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.547+0000 7f238aa65740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558477e0b0d0 con 0x558477ea9e10 2024-04-20T12:28:06.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.547+0000 7f2385408640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.547+0000 7f2385408640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37784/0 (socket says 172.21.15.135:37784) 2024-04-20T12:28:06.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f2385408640 1 -- 172.21.15.135:0/7720645 learned_addr learned my addr 172.21.15.135:0/7720645 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f238640a640 1 --2- 172.21.15.135:0/7720645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477ea9e10 0x558477eaa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f2385c09640 1 --2- 172.21.15.135:0/7720645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477eaa730 0x558477eb2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f2376ffd640 1 --2- 172.21.15.135:0/3349590932 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f236c0a3d20 0x7f236c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f238640a640 1 --2- 172.21.15.135:0/3349590932 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f236c0a3d20 0x7f236c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f2385408640 1 -- 172.21.15.135:0/7720645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477ea9e10 msgr2=0x558477eaa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f2385408640 1 --2- 172.21.15.135:0/7720645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477ea9e10 0x558477eaa1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f2385408640 1 -- 172.21.15.135:0/7720645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477eaa730 msgr2=0x558477eb2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f2385408640 1 --2- 172.21.15.135:0/7720645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477eaa730 0x558477eb2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f2385408640 1 -- 172.21.15.135:0/7720645 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558477dd4900 con 0x558477eb3310 2024-04-20T12:28:06.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f2376ffd640 1 -- 172.21.15.135:0/3349590932 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f237c0d0cd0 con 0x7f23801010b0 2024-04-20T12:28:06.555 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f2385408640 1 --2- 172.21.15.135:0/7720645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb5700 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f2370000c00 tx=0x7f237002c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f313db676ecf21 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f238640a640 1 --2- 172.21.15.135:0/3349590932 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f236c0a3d20 0x7f236c0a61e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f23780127b0 tx=0x7f2378004ab0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f236bfff640 1 -- 172.21.15.135:0/7720645 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237002ca80 con 0x558477eb3310 2024-04-20T12:28:06.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f236bfff640 1 -- 172.21.15.135:0/7720645 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f237002cc20 con 0x558477eb3310 2024-04-20T12:28:06.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.548+0000 7f236bfff640 1 -- 172.21.15.135:0/7720645 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2370004920 con 0x558477eb3310 2024-04-20T12:28:06.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.549+0000 7f238aa65740 1 -- 172.21.15.135:0/7720645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 msgr2=0x558477eb5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.549+0000 7f238aa65740 1 --2- 172.21.15.135:0/7720645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb5700 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f2370000c00 tx=0x7f237002c5d0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.549+0000 7f238aa65740 1 -- 172.21.15.135:0/7720645 shutdown_connections 2024-04-20T12:28:06.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.549+0000 7f238aa65740 1 --2- 172.21.15.135:0/7720645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb5700 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.549+0000 7f238aa65740 1 --2- 172.21.15.135:0/7720645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477eaa730 0x558477eb2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.549+0000 7f238aa65740 1 --2- 172.21.15.135:0/7720645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477ea9e10 0x558477eaa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.549+0000 7f238aa65740 1 -- 172.21.15.135:0/7720645 >> 172.21.15.135:0/7720645 conn(0x558477ea4540 msgr2=0x558477ea4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.549+0000 7f238aa65740 1 -- 172.21.15.135:0/7720645 shutdown_connections 2024-04-20T12:28:06.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.549+0000 7f238aa65740 1 -- 172.21.15.135:0/7720645 wait complete. 2024-04-20T12:28:06.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.549+0000 7f238aa65740 1 -- start start 2024-04-20T12:28:06.556 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.549+0000 7f238aa65740 1 Processor -- start 2024-04-20T12:28:06.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238aa65740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477ea9e10 0x558477eb0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238aa65740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eaa730 0x558477eb09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238aa65740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238aa65740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558477eb5fe0 con 0x558477eb3310 2024-04-20T12:28:06.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238aa65740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558477dc8500 con 0x558477ea9e10 2024-04-20T12:28:06.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238aa65740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558477eb6160 con 0x558477eaa730 2024-04-20T12:28:06.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238aa65740 10 client.0 _ll_register_callbacks cb 0x558477dad2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:06.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238640a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238640a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37788/0 (socket says 172.21.15.135:37788) 2024-04-20T12:28:06.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238640a640 1 -- 172.21.15.135:0/2022001523 learned_addr learned my addr 172.21.15.135:0/2022001523 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f2385408640 1 --2- 172.21.15.135:0/2022001523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eaa730 0x558477eb09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f2385c09640 1 --2- 172.21.15.135:0/2022001523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477ea9e10 0x558477eb0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238640a640 1 -- 172.21.15.135:0/2022001523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eaa730 msgr2=0x558477eb09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.557 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238640a640 1 --2- 172.21.15.135:0/2022001523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eaa730 0x558477eb09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238640a640 1 -- 172.21.15.135:0/2022001523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477ea9e10 msgr2=0x558477eb0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238640a640 1 --2- 172.21.15.135:0/2022001523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477ea9e10 0x558477eb0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238640a640 1 -- 172.21.15.135:0/2022001523 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558477b213f0 con 0x558477eb3310 2024-04-20T12:28:06.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f2385408640 1 --2- 172.21.15.135:0/2022001523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eaa730 0x558477eb09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:06.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f2385c09640 1 --2- 172.21.15.135:0/2022001523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477ea9e10 0x558477eb0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:06.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f238640a640 1 --2- 172.21.15.135:0/2022001523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb0f00 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f2378007ec0 tx=0x7f2378004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d73cd79c5a14051 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.550+0000 7f23697fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:06.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.551+0000 7f23697fa640 1 -- 172.21.15.135:0/2022001523 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378024020 con 0x558477eb3310 2024-04-20T12:28:06.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.551+0000 7f23697fa640 1 -- 172.21.15.135:0/2022001523 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f2378020410 con 0x558477eb3310 2024-04-20T12:28:06.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.551+0000 7f238aa65740 1 -- 172.21.15.135:0/2022001523 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f237002cc20 con 0x558477eb3310 2024-04-20T12:28:06.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.551+0000 7f23697fa640 1 -- 172.21.15.135:0/2022001523 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f237802f050 con 0x558477eb3310 2024-04-20T12:28:06.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.551+0000 7f238aa65740 10 client.17193 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:06.558 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.551+0000 7f238aa65740 1 -- 172.21.15.135:0/2022001523 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558477beb7d0 con 0x558477eb3310 2024-04-20T12:28:06.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.551+0000 7f23697fa640 1 -- 172.21.15.135:0/2022001523 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f237002cc20 con 0x558477eb3310 2024-04-20T12:28:06.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.551+0000 7f23697fa640 1 -- 172.21.15.135:0/2022001523 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f23780117b0 con 0x558477eb3310 2024-04-20T12:28:06.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.551+0000 7f238aa65740 10 client.17193 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:06.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.551+0000 7f238aa65740 10 client.17193 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:28:06.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.551+0000 7f238aa65740 20 client.17193 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:06.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.551+0000 7f238aa65740 1 --2- 172.21.15.135:0/2022001523 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558477ec3730 0x558477ec5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.551+0000 7f238aa65740 4 client.17193 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:06.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.551+0000 7f238aa65740 1 -- 172.21.15.135:0/2022001523 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558477e1cb30 con 0x558477ec3730 2024-04-20T12:28:06.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.551+0000 7f2385c09640 1 --2- 172.21.15.135:0/2022001523 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558477ec3730 0x558477ec5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f23697fa640 10 client.17193 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:28:06.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f2385c09640 1 --2- 172.21.15.135:0/2022001523 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558477ec3730 0x558477ec5bb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3d1f6b963f23df00 server_cookie=7955bb06717e2815 in_seq=0 out_seq=0 2024-04-20T12:28:06.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f23697fa640 1 -- 172.21.15.135:0/2022001523 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558477e1cb30 con 0x558477ec3730 2024-04-20T12:28:06.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f23697fa640 10 client.17193 handle_command_reply: tid=0 2024-04-20T12:28:06.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f238aa65740 1 client.17193 shutdown 2024-04-20T12:28:06.559 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f238aa65740 1 -- 172.21.15.135:0/2022001523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 msgr2=0x558477eb0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f238aa65740 1 --2- 172.21.15.135:0/2022001523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb0f00 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f2378007ec0 tx=0x7f2378004a40 comp rx=0 tx=0).stop 2024-04-20T12:28:06.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f238aa65740 1 -- 172.21.15.135:0/2022001523 shutdown_connections 2024-04-20T12:28:06.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f238aa65740 1 --2- 172.21.15.135:0/2022001523 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558477ec3730 0x558477ec5bb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f238aa65740 1 --2- 172.21.15.135:0/2022001523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb0f00 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f238aa65740 1 --2- 172.21.15.135:0/2022001523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eaa730 0x558477eb09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f23697fa640 0 client.17193 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:28:06.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f238aa65740 1 --2- 172.21.15.135:0/2022001523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477ea9e10 0x558477eb0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f238aa65740 1 -- 172.21.15.135:0/2022001523 >> 172.21.15.135:0/2022001523 conn(0x558477ea4540 msgr2=0x558477ea6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f238aa65740 1 -- 172.21.15.135:0/2022001523 shutdown_connections 2024-04-20T12:28:06.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.552+0000 7f238aa65740 1 -- 172.21.15.135:0/2022001523 wait complete. 2024-04-20T12:28:06.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.553+0000 7f238aa65740 20 client.17193 trim_cache size 0 max 16384 2024-04-20T12:28:06.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f238aa65740 1 Processor -- start 2024-04-20T12:28:06.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f238aa65740 1 -- start start 2024-04-20T12:28:06.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f238aa65740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477ea9e10 0x558477eb2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f238aa65740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477eaa730 0x558477ebb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f238aa65740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eb3310 0x558477ecb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f238aa65740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f23801ae180 con 0x558477ea9e10 2024-04-20T12:28:06.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f238aa65740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f23801afcc0 con 0x558477eaa730 2024-04-20T12:28:06.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f238aa65740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f23801ae850 con 0x558477eb3310 2024-04-20T12:28:06.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f2385c09640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477ea9e10 0x558477eb2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f2385c09640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477ea9e10 0x558477eb2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37802/0 (socket says 172.21.15.135:37802) 2024-04-20T12:28:06.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f2385c09640 1 -- 172.21.15.135:0/1523016164 learned_addr learned my addr 172.21.15.135:0/1523016164 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f238640a640 1 --2- 172.21.15.135:0/1523016164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eb3310 0x558477ecb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f2385c09640 1 -- 172.21.15.135:0/1523016164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eb3310 msgr2=0x558477ecb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f2385c09640 1 --2- 172.21.15.135:0/1523016164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eb3310 0x558477ecb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f2385c09640 1 -- 172.21.15.135:0/1523016164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477eaa730 msgr2=0x558477ebb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f2385c09640 1 --2- 172.21.15.135:0/1523016164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477eaa730 0x558477ebb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.566+0000 7f2385c09640 1 -- 172.21.15.135:0/1523016164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558477ec6230 con 0x558477ea9e10 2024-04-20T12:28:06.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.567+0000 7f2385c09640 1 --2- 172.21.15.135:0/1523016164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477ea9e10 0x558477eb2bb0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f237c09c5f0 tx=0x7f237c005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf90f10b2b72f02 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.567+0000 7f236b7fe640 1 -- 172.21.15.135:0/1523016164 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c01d070 con 0x558477ea9e10 2024-04-20T12:28:06.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.567+0000 7f236b7fe640 1 -- 172.21.15.135:0/1523016164 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f237c0d2040 con 0x558477ea9e10 2024-04-20T12:28:06.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.567+0000 7f236b7fe640 1 -- 172.21.15.135:0/1523016164 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c0ce4b0 con 0x558477ea9e10 2024-04-20T12:28:06.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.567+0000 7f238aa65740 1 -- 172.21.15.135:0/1523016164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477ea9e10 msgr2=0x558477eb2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.567+0000 7f238aa65740 1 --2- 172.21.15.135:0/1523016164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477ea9e10 0x558477eb2bb0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f237c09c5f0 tx=0x7f237c005300 comp rx=0 tx=0).stop 2024-04-20T12:28:06.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.567+0000 7f238aa65740 1 -- 172.21.15.135:0/1523016164 shutdown_connections 2024-04-20T12:28:06.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.567+0000 7f238aa65740 1 --2- 172.21.15.135:0/1523016164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eb3310 0x558477ecb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.567+0000 7f238aa65740 1 --2- 172.21.15.135:0/1523016164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477eaa730 0x558477ebb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.567+0000 7f238aa65740 1 --2- 172.21.15.135:0/1523016164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477ea9e10 0x558477eb2bb0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.567+0000 7f238aa65740 1 -- 172.21.15.135:0/1523016164 >> 172.21.15.135:0/1523016164 conn(0x558477ea4540 msgr2=0x558477ea6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.567+0000 7f238aa65740 1 -- 172.21.15.135:0/1523016164 shutdown_connections 2024-04-20T12:28:06.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.567+0000 7f238aa65740 1 -- 172.21.15.135:0/1523016164 wait complete. 2024-04-20T12:28:06.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238aa65740 1 -- start start 2024-04-20T12:28:06.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238aa65740 1 Processor -- start 2024-04-20T12:28:06.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238aa65740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477ea9e10 0x558477ebb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238aa65740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eaa730 0x558477eb6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238aa65740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238aa65740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f23801af5f0 con 0x558477eb3310 2024-04-20T12:28:06.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238aa65740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f23801aef20 con 0x558477ea9e10 2024-04-20T12:28:06.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238aa65740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f23801ac150 con 0x558477eaa730 2024-04-20T12:28:06.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238aa65740 10 client.0 _ll_register_callbacks cb 0x7f2378010ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:06.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238640a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238640a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37814/0 (socket says 172.21.15.135:37814) 2024-04-20T12:28:06.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238640a640 1 -- 172.21.15.135:0/1353038276 learned_addr learned my addr 172.21.15.135:0/1353038276 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f2385408640 1 --2- 172.21.15.135:0/1353038276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eaa730 0x558477eb6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f2385c09640 1 --2- 172.21.15.135:0/1353038276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477ea9e10 0x558477ebb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238640a640 1 -- 172.21.15.135:0/1353038276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eaa730 msgr2=0x558477eb6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238640a640 1 --2- 172.21.15.135:0/1353038276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eaa730 0x558477eb6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238640a640 1 -- 172.21.15.135:0/1353038276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477ea9e10 msgr2=0x558477ebb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238640a640 1 --2- 172.21.15.135:0/1353038276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477ea9e10 0x558477ebb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f238640a640 1 -- 172.21.15.135:0/1353038276 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558477eb7690 con 0x558477eb3310 2024-04-20T12:28:06.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.568+0000 7f2385c09640 1 --2- 172.21.15.135:0/1353038276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477ea9e10 0x558477ebb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:06.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f238640a640 1 --2- 172.21.15.135:0/1353038276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb6f50 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2378011dc0 tx=0x7f2378007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7046578af3232a97 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f23697fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:06.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f23697fa640 1 -- 172.21.15.135:0/1353038276 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2378024040 con 0x558477eb3310 2024-04-20T12:28:06.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f23697fa640 1 -- 172.21.15.135:0/1353038276 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f23780113e0 con 0x558477eb3310 2024-04-20T12:28:06.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f238aa65740 1 -- 172.21.15.135:0/1353038276 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f237c0d2040 con 0x558477eb3310 2024-04-20T12:28:06.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f23697fa640 1 -- 172.21.15.135:0/1353038276 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2378042050 con 0x558477eb3310 2024-04-20T12:28:06.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f238aa65740 10 client.17199 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:06.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f238aa65740 1 -- 172.21.15.135:0/1353038276 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558477f2e030 con 0x558477eb3310 2024-04-20T12:28:06.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f23697fa640 1 -- 172.21.15.135:0/1353038276 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f237c0d2040 con 0x558477eb3310 2024-04-20T12:28:06.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f23697fa640 1 -- 172.21.15.135:0/1353038276 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2378020b90 con 0x558477eb3310 2024-04-20T12:28:06.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f238aa65740 10 client.17199 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:06.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f238aa65740 10 client.17199 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:28:06.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f238aa65740 20 client.17199 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:06.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f238aa65740 1 --2- 172.21.15.135:0/1353038276 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558477f2e740 0x558477f30b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f238aa65740 4 client.17199 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:28:06.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f238aa65740 1 -- 172.21.15.135:0/1353038276 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558477e169a0 con 0x558477f2e740 2024-04-20T12:28:06.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.569+0000 7f2385c09640 1 --2- 172.21.15.135:0/1353038276 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558477f2e740 0x558477f30b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f23697fa640 10 client.17199 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:28:06.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f2385c09640 1 --2- 172.21.15.135:0/1353038276 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558477f2e740 0x558477f30b30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c87fa7624790e67a server_cookie=a272ff4dcde528b9 in_seq=0 out_seq=0 2024-04-20T12:28:06.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f23697fa640 1 -- 172.21.15.135:0/1353038276 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558477e169a0 con 0x558477f2e740 2024-04-20T12:28:06.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f23697fa640 10 client.17199 handle_command_reply: tid=0 2024-04-20T12:28:06.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f238aa65740 1 client.17199 shutdown 2024-04-20T12:28:06.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f238aa65740 1 -- 172.21.15.135:0/1353038276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 msgr2=0x558477eb6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f238aa65740 1 --2- 172.21.15.135:0/1353038276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb6f50 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2378011dc0 tx=0x7f2378007820 comp rx=0 tx=0).stop 2024-04-20T12:28:06.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f238aa65740 1 -- 172.21.15.135:0/1353038276 shutdown_connections 2024-04-20T12:28:06.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f238aa65740 1 --2- 172.21.15.135:0/1353038276 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x558477f2e740 0x558477f30b30 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f238aa65740 1 --2- 172.21.15.135:0/1353038276 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558477eb3310 0x558477eb6f50 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f238aa65740 1 --2- 172.21.15.135:0/1353038276 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558477eaa730 0x558477eb6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f23697fa640 0 client.17199 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:28:06.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f238aa65740 1 --2- 172.21.15.135:0/1353038276 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558477ea9e10 0x558477ebb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f238aa65740 1 -- 172.21.15.135:0/1353038276 >> 172.21.15.135:0/1353038276 conn(0x558477ea4540 msgr2=0x558477ea2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f238aa65740 1 -- 172.21.15.135:0/1353038276 shutdown_connections 2024-04-20T12:28:06.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f238aa65740 1 -- 172.21.15.135:0/1353038276 wait complete. 2024-04-20T12:28:06.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.570+0000 7f238aa65740 20 client.17199 trim_cache size 0 max 16384 2024-04-20T12:28:06.577 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:28:06.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.571+0000 7f2387e6d640 1 -- 172.21.15.135:0/3349590932 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f236c0a3d20 msgr2=0x7f236c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.571+0000 7f2387e6d640 1 --2- 172.21.15.135:0/3349590932 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f236c0a3d20 0x7f236c0a61e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f23780127b0 tx=0x7f2378004ab0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.571+0000 7f2387e6d640 1 -- 172.21.15.135:0/3349590932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23801010b0 msgr2=0x7f23801976d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.571+0000 7f2387e6d640 1 --2- 172.21.15.135:0/3349590932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23801010b0 0x7f23801976d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f237c00c890 tx=0x7f237c00cd50 comp rx=0 tx=0).stop 2024-04-20T12:28:06.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.571+0000 7f2387e6d640 1 -- 172.21.15.135:0/3349590932 shutdown_connections 2024-04-20T12:28:06.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.571+0000 7f2387e6d640 1 --2- 172.21.15.135:0/3349590932 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f236c0a3d20 0x7f236c0a61e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.571+0000 7f2387e6d640 1 --2- 172.21.15.135:0/3349590932 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f238019bf40 0x7f238019c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.571+0000 7f2387e6d640 1 --2- 172.21.15.135:0/3349590932 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2380106180 0x7f2380197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.571+0000 7f2387e6d640 1 --2- 172.21.15.135:0/3349590932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f23801010b0 0x7f23801976d0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.571+0000 7f2387e6d640 1 -- 172.21.15.135:0/3349590932 >> 172.21.15.135:0/3349590932 conn(0x7f2380077f80 msgr2=0x7f23800fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.571+0000 7f2387e6d640 1 -- 172.21.15.135:0/3349590932 shutdown_connections 2024-04-20T12:28:06.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.571+0000 7f2387e6d640 1 -- 172.21.15.135:0/3349590932 wait complete. 2024-04-20T12:28:06.581 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:28:06.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.682+0000 7f5a76270640 1 -- 172.21.15.135:0/839092335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a70107280 msgr2=0x7f5a7010ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.682+0000 7f5a76270640 1 --2- 172.21.15.135:0/839092335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a70107280 0x7f5a7010ee50 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009ca0 tx=0x7f5a6802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.682+0000 7f5a76270640 1 -- 172.21.15.135:0/839092335 shutdown_connections 2024-04-20T12:28:06.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.682+0000 7f5a76270640 1 --2- 172.21.15.135:0/839092335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a70107280 0x7f5a7010ee50 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.682+0000 7f5a76270640 1 --2- 172.21.15.135:0/839092335 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70102b60 0x7f5a70106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.682+0000 7f5a76270640 1 --2- 172.21.15.135:0/839092335 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a701021b0 0x7f5a70102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.682+0000 7f5a76270640 1 -- 172.21.15.135:0/839092335 >> 172.21.15.135:0/839092335 conn(0x7f5a700793f0 msgr2=0x7f5a70079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.682+0000 7f5a76270640 1 -- 172.21.15.135:0/839092335 shutdown_connections 2024-04-20T12:28:06.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.682+0000 7f5a76270640 1 -- 172.21.15.135:0/839092335 wait complete. 2024-04-20T12:28:06.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a76270640 1 Processor -- start 2024-04-20T12:28:06.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a76270640 1 -- start start 2024-04-20T12:28:06.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a76270640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a701021b0 0x7f5a7019e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a76270640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a70107280 0x7f5a7019e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a76270640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70198600 0x7f5a70198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a76270640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a70112340 con 0x7f5a701021b0 2024-04-20T12:28:06.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a76270640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701121c0 con 0x7f5a70198600 2024-04-20T12:28:06.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a76270640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701124c0 con 0x7f5a70107280 2024-04-20T12:28:06.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a701021b0 0x7f5a7019e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a701021b0 0x7f5a7019e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37818/0 (socket says 172.21.15.135:37818) 2024-04-20T12:28:06.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a6ffff640 1 -- 172.21.15.135:0/1873124989 learned_addr learned my addr 172.21.15.135:0/1873124989 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a7480d640 1 --2- 172.21.15.135:0/1873124989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70198600 0x7f5a70198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a6f7fe640 1 --2- 172.21.15.135:0/1873124989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a70107280 0x7f5a7019e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a6ffff640 1 -- 172.21.15.135:0/1873124989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a70107280 msgr2=0x7f5a7019e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a6ffff640 1 --2- 172.21.15.135:0/1873124989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a70107280 0x7f5a7019e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a6ffff640 1 -- 172.21.15.135:0/1873124989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70198600 msgr2=0x7f5a70198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a6ffff640 1 --2- 172.21.15.135:0/1873124989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70198600 0x7f5a70198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a6ffff640 1 -- 172.21.15.135:0/1873124989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a70199120 con 0x7f5a701021b0 2024-04-20T12:28:06.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.683+0000 7f5a7480d640 1 --2- 172.21.15.135:0/1873124989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70198600 0x7f5a70198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:06.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.684+0000 7f5a6ffff640 1 --2- 172.21.15.135:0/1873124989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a701021b0 0x7f5a7019e450 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000c970 tx=0x7f5a6000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.684+0000 7f5a6d7fa640 1 -- 172.21.15.135:0/1873124989 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60007bb0 con 0x7f5a701021b0 2024-04-20T12:28:06.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.684+0000 7f5a6d7fa640 1 -- 172.21.15.135:0/1873124989 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a60007d50 con 0x7f5a701021b0 2024-04-20T12:28:06.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.684+0000 7f5a76270640 1 -- 172.21.15.135:0/1873124989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a70199410 con 0x7f5a701021b0 2024-04-20T12:28:06.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.684+0000 7f5a6d7fa640 1 -- 172.21.15.135:0/1873124989 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6000f450 con 0x7f5a701021b0 2024-04-20T12:28:06.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.684+0000 7f5a76270640 1 -- 172.21.15.135:0/1873124989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a701a5610 con 0x7f5a701021b0 2024-04-20T12:28:06.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.686+0000 7f5a78e5b740 1 Processor -- start 2024-04-20T12:28:06.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.686+0000 7f5a6d7fa640 1 -- 172.21.15.135:0/1873124989 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f5a60005020 con 0x7f5a701021b0 2024-04-20T12:28:06.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.686+0000 7f5a78e5b740 1 -- start start 2024-04-20T12:28:06.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.686+0000 7f5a78e5b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e89e10 0x5589e2e8a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.686+0000 7f5a78e5b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e8a730 0x5589e2e92dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.686+0000 7f5a78e5b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 0x5589e2e95700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a78e5b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5589e2def110 con 0x5589e2e8a730 2024-04-20T12:28:06.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a78e5b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5589e2d8c550 con 0x5589e2e93310 2024-04-20T12:28:06.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a78e5b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5589e2deb0d0 con 0x5589e2e89e10 2024-04-20T12:28:06.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e8a730 0x5589e2e92dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e8a730 0x5589e2e92dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37826/0 (socket says 172.21.15.135:37826) 2024-04-20T12:28:06.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a6ffff640 1 -- 172.21.15.135:0/4166006842 learned_addr learned my addr 172.21.15.135:0/4166006842 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a6f7fe640 1 --2- 172.21.15.135:0/4166006842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 0x5589e2e95700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a7480d640 1 --2- 172.21.15.135:0/4166006842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e89e10 0x5589e2e8a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a6ffff640 1 -- 172.21.15.135:0/4166006842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e89e10 msgr2=0x5589e2e8a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a6ffff640 1 --2- 172.21.15.135:0/4166006842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e89e10 0x5589e2e8a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a6d7fa640 1 --2- 172.21.15.135:0/1873124989 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5a580a3d20 0x7f5a580a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a6ffff640 1 -- 172.21.15.135:0/4166006842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 msgr2=0x5589e2e95700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a6ffff640 1 --2- 172.21.15.135:0/4166006842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 0x5589e2e95700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a6ffff640 1 -- 172.21.15.135:0/4166006842 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589e2db4900 con 0x5589e2e8a730 2024-04-20T12:28:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a6f7fe640 1 --2- 172.21.15.135:0/4166006842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 0x5589e2e95700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:28:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a7480d640 1 --2- 172.21.15.135:0/1873124989 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5a580a3d20 0x7f5a580a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a6d7fa640 1 -- 172.21.15.135:0/1873124989 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5a600d0a40 con 0x7f5a701021b0 2024-04-20T12:28:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a6ffff640 1 --2- 172.21.15.135:0/4166006842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e8a730 0x5589e2e92dd0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f5a600cdd80 tx=0x7f5a600b0d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6444b7da262d985 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a567fc640 1 -- 172.21.15.135:0/4166006842 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6001d070 con 0x5589e2e8a730 2024-04-20T12:28:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a567fc640 1 -- 172.21.15.135:0/4166006842 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a6009cd60 con 0x5589e2e8a730 2024-04-20T12:28:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.687+0000 7f5a567fc640 1 -- 172.21.15.135:0/4166006842 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6009c1a0 con 0x5589e2e8a730 2024-04-20T12:28:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.688+0000 7f5a78e5b740 1 -- 172.21.15.135:0/4166006842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e8a730 msgr2=0x5589e2e92dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.688+0000 7f5a7480d640 1 --2- 172.21.15.135:0/1873124989 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5a580a3d20 0x7f5a580a61e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009430 tx=0x7f5a68004a40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.688+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/4166006842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e8a730 0x5589e2e92dd0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f5a600cdd80 tx=0x7f5a600b0d40 comp rx=0 tx=0).stop 2024-04-20T12:28:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.688+0000 7f5a78e5b740 1 -- 172.21.15.135:0/4166006842 shutdown_connections 2024-04-20T12:28:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.688+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/4166006842 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 0x5589e2e95700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.688+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/4166006842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e8a730 0x5589e2e92dd0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.688+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/4166006842 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e89e10 0x5589e2e8a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.688+0000 7f5a78e5b740 1 -- 172.21.15.135:0/4166006842 >> 172.21.15.135:0/4166006842 conn(0x5589e2e84540 msgr2=0x5589e2e84920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.688+0000 7f5a78e5b740 1 -- 172.21.15.135:0/4166006842 shutdown_connections 2024-04-20T12:28:06.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.688+0000 7f5a78e5b740 1 -- 172.21.15.135:0/4166006842 wait complete. 2024-04-20T12:28:06.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a78e5b740 1 -- start start 2024-04-20T12:28:06.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a78e5b740 1 Processor -- start 2024-04-20T12:28:06.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a78e5b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e89e10 0x5589e2e90410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a78e5b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e8a730 0x5589e2e90950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a78e5b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e93310 0x5589e2e90e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a78e5b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5589e2e96040 con 0x5589e2e93310 2024-04-20T12:28:06.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a78e5b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5589e2da8500 con 0x5589e2e89e10 2024-04-20T12:28:06.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a78e5b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5589e2e961c0 con 0x5589e2e8a730 2024-04-20T12:28:06.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a78e5b740 10 client.0 _ll_register_callbacks cb 0x5589e2d8d2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:06.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a7480d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e93310 0x5589e2e90e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a7480d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e93310 0x5589e2e90e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37828/0 (socket says 172.21.15.135:37828) 2024-04-20T12:28:06.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a7480d640 1 -- 172.21.15.135:0/153073296 learned_addr learned my addr 172.21.15.135:0/153073296 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a6ffff640 1 --2- 172.21.15.135:0/153073296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e89e10 0x5589e2e90410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a6f7fe640 1 --2- 172.21.15.135:0/153073296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e8a730 0x5589e2e90950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a7480d640 1 -- 172.21.15.135:0/153073296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e8a730 msgr2=0x5589e2e90950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a7480d640 1 --2- 172.21.15.135:0/153073296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e8a730 0x5589e2e90950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a7480d640 1 -- 172.21.15.135:0/153073296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e89e10 msgr2=0x5589e2e90410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a7480d640 1 --2- 172.21.15.135:0/153073296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e89e10 0x5589e2e90410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.689+0000 7f5a7480d640 1 -- 172.21.15.135:0/153073296 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589e2b013f0 con 0x5589e2e93310 2024-04-20T12:28:06.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a7480d640 1 --2- 172.21.15.135:0/153073296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e93310 0x5589e2e90e90 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f5a68036000 tx=0x7f5a6802c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a328de60139e1c4d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:06.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a4f7fe640 1 -- 172.21.15.135:0/153073296 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68050070 con 0x5589e2e93310 2024-04-20T12:28:06.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a4f7fe640 1 -- 172.21.15.135:0/153073296 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5a68004450 con 0x5589e2e93310 2024-04-20T12:28:06.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a78e5b740 1 -- 172.21.15.135:0/153073296 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a6009cd60 con 0x5589e2e93310 2024-04-20T12:28:06.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a4f7fe640 1 -- 172.21.15.135:0/153073296 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5a68039040 con 0x5589e2e93310 2024-04-20T12:28:06.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a78e5b740 10 client.17211 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:06.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a78e5b740 1 -- 172.21.15.135:0/153073296 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5589e2bcb7d0 con 0x5589e2e93310 2024-04-20T12:28:06.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a4f7fe640 1 -- 172.21.15.135:0/153073296 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a6009cd60 con 0x5589e2e93310 2024-04-20T12:28:06.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a4f7fe640 1 -- 172.21.15.135:0/153073296 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f5a6804b070 con 0x5589e2e93310 2024-04-20T12:28:06.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a78e5b740 10 client.17211 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:06.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a78e5b740 10 client.17211 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:28:06.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a78e5b740 20 client.17211 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:06.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/153073296 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5589e2ea3740 0x5589e2ea5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a78e5b740 4 client.17211 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:06.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.690+0000 7f5a78e5b740 1 -- 172.21.15.135:0/153073296 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589e2dfcb30 con 0x5589e2ea3740 2024-04-20T12:28:06.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.691+0000 7f5a6ffff640 1 --2- 172.21.15.135:0/153073296 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5589e2ea3740 0x5589e2ea5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.691+0000 7f5a6ffff640 1 --2- 172.21.15.135:0/153073296 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5589e2ea3740 0x5589e2ea5b80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=33c8131e599edabb server_cookie=710dbced35a79fb7 in_seq=0 out_seq=0 2024-04-20T12:28:06.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.691+0000 7f5a4f7fe640 10 client.17211 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:28:06.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.692+0000 7f5a4f7fe640 1 -- 172.21.15.135:0/153073296 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5589e2dfcb30 con 0x5589e2ea3740 2024-04-20T12:28:06.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.692+0000 7f5a4f7fe640 10 client.17211 handle_command_reply: tid=0 2024-04-20T12:28:06.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.692+0000 7f5a78e5b740 1 client.17211 shutdown 2024-04-20T12:28:06.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.692+0000 7f5a78e5b740 1 -- 172.21.15.135:0/153073296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e93310 msgr2=0x5589e2e90e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.692+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/153073296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e93310 0x5589e2e90e90 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f5a68036000 tx=0x7f5a6802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.692+0000 7f5a78e5b740 1 -- 172.21.15.135:0/153073296 shutdown_connections 2024-04-20T12:28:06.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.692+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/153073296 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5589e2ea3740 0x5589e2ea5b80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.692+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/153073296 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e93310 0x5589e2e90e90 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.692+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/153073296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e8a730 0x5589e2e90950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.692+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/153073296 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e89e10 0x5589e2e90410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.692+0000 7f5a4f7fe640 0 client.17211 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:28:06.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.692+0000 7f5a78e5b740 1 -- 172.21.15.135:0/153073296 >> 172.21.15.135:0/153073296 conn(0x5589e2e84540 msgr2=0x5589e2e86290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.692+0000 7f5a78e5b740 1 -- 172.21.15.135:0/153073296 shutdown_connections 2024-04-20T12:28:06.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.692+0000 7f5a78e5b740 1 -- 172.21.15.135:0/153073296 wait complete. 2024-04-20T12:28:06.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.692+0000 7f5a78e5b740 20 client.17211 trim_cache size 0 max 16384 2024-04-20T12:28:06.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.705+0000 7f5a78e5b740 1 Processor -- start 2024-04-20T12:28:06.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.705+0000 7f5a78e5b740 1 -- start start 2024-04-20T12:28:06.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.705+0000 7f5a78e5b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e89e10 0x5589e2e9efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.705+0000 7f5a78e5b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e8a730 0x5589e2e8f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.705+0000 7f5a78e5b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 0x5589e2e90cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.705+0000 7f5a78e5b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701af430 con 0x5589e2e89e10 2024-04-20T12:28:06.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.705+0000 7f5a78e5b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701b0f70 con 0x5589e2e93310 2024-04-20T12:28:06.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.705+0000 7f5a78e5b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701afb00 con 0x5589e2e8a730 2024-04-20T12:28:06.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.705+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e89e10 0x5589e2e9efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.705+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e89e10 0x5589e2e9efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37842/0 (socket says 172.21.15.135:37842) 2024-04-20T12:28:06.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.705+0000 7f5a6ffff640 1 -- 172.21.15.135:0/3457242008 learned_addr learned my addr 172.21.15.135:0/3457242008 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a6ffff640 1 -- 172.21.15.135:0/3457242008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e8a730 msgr2=0x5589e2e8f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a6ffff640 1 --2- 172.21.15.135:0/3457242008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e8a730 0x5589e2e8f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a6ffff640 1 -- 172.21.15.135:0/3457242008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 msgr2=0x5589e2e90cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a6ffff640 1 --2- 172.21.15.135:0/3457242008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 0x5589e2e90cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a6ffff640 1 -- 172.21.15.135:0/3457242008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589e2e7fbe0 con 0x5589e2e89e10 2024-04-20T12:28:06.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a6ffff640 1 --2- 172.21.15.135:0/3457242008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e89e10 0x5589e2e9efc0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f5a6009c360 tx=0x7f5a60004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c83a995ddd788bb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a55ffb640 1 -- 172.21.15.135:0/3457242008 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a600ba070 con 0x5589e2e89e10 2024-04-20T12:28:06.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a55ffb640 1 -- 172.21.15.135:0/3457242008 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a6009cd60 con 0x5589e2e89e10 2024-04-20T12:28:06.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a55ffb640 1 -- 172.21.15.135:0/3457242008 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a600d7070 con 0x5589e2e89e10 2024-04-20T12:28:06.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a78e5b740 1 -- 172.21.15.135:0/3457242008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e89e10 msgr2=0x5589e2e9efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/3457242008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e89e10 0x5589e2e9efc0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f5a6009c360 tx=0x7f5a60004a20 comp rx=0 tx=0).stop 2024-04-20T12:28:06.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a78e5b740 1 -- 172.21.15.135:0/3457242008 shutdown_connections 2024-04-20T12:28:06.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/3457242008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 0x5589e2e90cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/3457242008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e8a730 0x5589e2e8f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/3457242008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e89e10 0x5589e2e9efc0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a78e5b740 1 -- 172.21.15.135:0/3457242008 >> 172.21.15.135:0/3457242008 conn(0x5589e2e84540 msgr2=0x5589e2e85950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a78e5b740 1 -- 172.21.15.135:0/3457242008 shutdown_connections 2024-04-20T12:28:06.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.706+0000 7f5a78e5b740 1 -- 172.21.15.135:0/3457242008 wait complete. 2024-04-20T12:28:06.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.707+0000 7f5a78e5b740 1 -- start start 2024-04-20T12:28:06.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.707+0000 7f5a78e5b740 1 Processor -- start 2024-04-20T12:28:06.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.707+0000 7f5a78e5b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e89e10 0x5589e2e9b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.707+0000 7f5a78e5b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e8a730 0x5589e2e8cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.707+0000 7f5a78e5b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 0x5589e2e8d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.707+0000 7f5a78e5b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701b08a0 con 0x5589e2e89e10 2024-04-20T12:28:06.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.707+0000 7f5a78e5b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701b01d0 con 0x5589e2e93310 2024-04-20T12:28:06.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.707+0000 7f5a78e5b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5a701ad400 con 0x5589e2e8a730 2024-04-20T12:28:06.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.707+0000 7f5a78e5b740 10 client.0 _ll_register_callbacks cb 0x7f5a64005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:06.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.707+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e89e10 0x5589e2e9b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.707+0000 7f5a6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e89e10 0x5589e2e9b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37854/0 (socket says 172.21.15.135:37854) 2024-04-20T12:28:06.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.707+0000 7f5a6ffff640 1 -- 172.21.15.135:0/1451596037 learned_addr learned my addr 172.21.15.135:0/1451596037 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.707+0000 7f5a6f7fe640 1 --2- 172.21.15.135:0/1451596037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e8a730 0x5589e2e8cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a7480d640 1 --2- 172.21.15.135:0/1451596037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 0x5589e2e8d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a6ffff640 1 -- 172.21.15.135:0/1451596037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e8a730 msgr2=0x5589e2e8cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a6ffff640 1 --2- 172.21.15.135:0/1451596037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e8a730 0x5589e2e8cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a6ffff640 1 -- 172.21.15.135:0/1451596037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 msgr2=0x5589e2e8d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a6ffff640 1 --2- 172.21.15.135:0/1451596037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 0x5589e2e8d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a6ffff640 1 -- 172.21.15.135:0/1451596037 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589e2e8db50 con 0x5589e2e89e10 2024-04-20T12:28:06.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a7480d640 1 --2- 172.21.15.135:0/1451596037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 0x5589e2e8d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:06.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a6ffff640 1 --2- 172.21.15.135:0/1451596037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e89e10 0x5589e2e9b8a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f5a60098ac0 tx=0x7f5a6000a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30111eaaa7a4d163 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a4f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:06.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a4f7fe640 1 -- 172.21.15.135:0/1451596037 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60067060 con 0x5589e2e89e10 2024-04-20T12:28:06.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a4f7fe640 1 -- 172.21.15.135:0/1451596037 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5a600046c0 con 0x5589e2e89e10 2024-04-20T12:28:06.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a78e5b740 1 -- 172.21.15.135:0/1451596037 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a6009cd60 con 0x5589e2e89e10 2024-04-20T12:28:06.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a4f7fe640 1 -- 172.21.15.135:0/1451596037 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5a600ba070 con 0x5589e2e89e10 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a78e5b740 10 client.17217 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a78e5b740 1 -- 172.21.15.135:0/1451596037 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5589e2f09c50 con 0x5589e2e89e10 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a4f7fe640 1 -- 172.21.15.135:0/1451596037 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a6009cd60 con 0x5589e2e89e10 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a4f7fe640 1 -- 172.21.15.135:0/1451596037 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f5a600ce090 con 0x5589e2e89e10 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a78e5b740 10 client.17217 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a78e5b740 10 client.17217 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a78e5b740 20 client.17217 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/1451596037 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5589e2f09f30 0x5589e2f0c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a78e5b740 4 client.17217 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.708+0000 7f5a78e5b740 1 -- 172.21.15.135:0/1451596037 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5589e2df69a0 con 0x5589e2f09f30 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.709+0000 7f5a6f7fe640 1 --2- 172.21.15.135:0/1451596037 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5589e2f09f30 0x5589e2f0c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.709+0000 7f5a6f7fe640 1 --2- 172.21.15.135:0/1451596037 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5589e2f09f30 0x5589e2f0c320 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6609c8b8808c1fbe server_cookie=4371905e9bb5210 in_seq=0 out_seq=0 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.709+0000 7f5a4f7fe640 10 client.17217 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.709+0000 7f5a4f7fe640 1 -- 172.21.15.135:0/1451596037 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5589e2df69a0 con 0x5589e2f09f30 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.709+0000 7f5a4f7fe640 10 client.17217 handle_command_reply: tid=0 2024-04-20T12:28:06.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.709+0000 7f5a78e5b740 1 client.17217 shutdown 2024-04-20T12:28:06.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.709+0000 7f5a78e5b740 1 -- 172.21.15.135:0/1451596037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e89e10 msgr2=0x5589e2e9b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.709+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/1451596037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e89e10 0x5589e2e9b8a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f5a60098ac0 tx=0x7f5a6000a530 comp rx=0 tx=0).stop 2024-04-20T12:28:06.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.709+0000 7f5a78e5b740 1 -- 172.21.15.135:0/1451596037 shutdown_connections 2024-04-20T12:28:06.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.709+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/1451596037 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5589e2f09f30 0x5589e2f0c320 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.709+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/1451596037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5589e2e93310 0x5589e2e8d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.709+0000 7f5a4f7fe640 0 client.17217 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:28:06.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.709+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/1451596037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5589e2e8a730 0x5589e2e8cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.709+0000 7f5a78e5b740 1 --2- 172.21.15.135:0/1451596037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589e2e89e10 0x5589e2e9b8a0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.709+0000 7f5a78e5b740 1 -- 172.21.15.135:0/1451596037 >> 172.21.15.135:0/1451596037 conn(0x5589e2e84540 msgr2=0x5589e2e836e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.710+0000 7f5a78e5b740 1 -- 172.21.15.135:0/1451596037 shutdown_connections 2024-04-20T12:28:06.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.710+0000 7f5a78e5b740 1 -- 172.21.15.135:0/1451596037 wait complete. 2024-04-20T12:28:06.716 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.710+0000 7f5a78e5b740 20 client.17217 trim_cache size 0 max 16384 2024-04-20T12:28:06.717 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:28:06.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.710+0000 7f5a76270640 1 -- 172.21.15.135:0/1873124989 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5a580a3d20 msgr2=0x7f5a580a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.717 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.710+0000 7f5a76270640 1 --2- 172.21.15.135:0/1873124989 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5a580a3d20 0x7f5a580a61e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009430 tx=0x7f5a68004a40 comp rx=0 tx=0).stop 2024-04-20T12:28:06.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.710+0000 7f5a76270640 1 -- 172.21.15.135:0/1873124989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a701021b0 msgr2=0x7f5a7019e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.710+0000 7f5a76270640 1 --2- 172.21.15.135:0/1873124989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a701021b0 0x7f5a7019e450 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000c970 tx=0x7f5a6000ce30 comp rx=0 tx=0).stop 2024-04-20T12:28:06.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.710+0000 7f5a76270640 1 -- 172.21.15.135:0/1873124989 shutdown_connections 2024-04-20T12:28:06.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.710+0000 7f5a76270640 1 --2- 172.21.15.135:0/1873124989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5a70198600 0x7f5a70198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.710+0000 7f5a76270640 1 --2- 172.21.15.135:0/1873124989 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5a580a3d20 0x7f5a580a61e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.710+0000 7f5a76270640 1 --2- 172.21.15.135:0/1873124989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5a70107280 0x7f5a7019e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.710+0000 7f5a76270640 1 --2- 172.21.15.135:0/1873124989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a701021b0 0x7f5a7019e450 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.710+0000 7f5a76270640 1 -- 172.21.15.135:0/1873124989 >> 172.21.15.135:0/1873124989 conn(0x7f5a700793f0 msgr2=0x7f5a700ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.710+0000 7f5a76270640 1 -- 172.21.15.135:0/1873124989 shutdown_connections 2024-04-20T12:28:06.718 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.710+0000 7f5a76270640 1 -- 172.21.15.135:0/1873124989 wait complete. 2024-04-20T12:28:06.720 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:06 smithi135 ceph-mon[18264]: pgmap v152: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:28:06.721 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:28:06.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:06 smithi154 ceph-mon[22073]: pgmap v152: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:28:06.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.822+0000 7f815a7fb640 1 -- 172.21.15.135:0/332178875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101a40 msgr2=0x7f8154105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.822+0000 7f815a7fb640 1 --2- 172.21.15.135:0/332178875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101a40 0x7f8154105a80 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f8148009900 tx=0x7f814802bc30 comp rx=0 tx=0).stop 2024-04-20T12:28:06.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.822+0000 7f815a7fb640 1 -- 172.21.15.135:0/332178875 shutdown_connections 2024-04-20T12:28:06.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.822+0000 7f815a7fb640 1 --2- 172.21.15.135:0/332178875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8154106160 0x7f815410dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.822+0000 7f815a7fb640 1 --2- 172.21.15.135:0/332178875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101a40 0x7f8154105a80 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.822+0000 7f815a7fb640 1 --2- 172.21.15.135:0/332178875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8154101090 0x7f8154101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.822+0000 7f815a7fb640 1 -- 172.21.15.135:0/332178875 >> 172.21.15.135:0/332178875 conn(0x7f8154078010 msgr2=0x7f8154078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.822+0000 7f815a7fb640 1 -- 172.21.15.135:0/332178875 shutdown_connections 2024-04-20T12:28:06.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.822+0000 7f815a7fb640 1 -- 172.21.15.135:0/332178875 wait complete. 2024-04-20T12:28:06.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.822+0000 7f815a7fb640 1 Processor -- start 2024-04-20T12:28:06.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.822+0000 7f815a7fb640 1 -- start start 2024-04-20T12:28:06.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f815a7fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101090 0x7f8154199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f815a7fb640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8154106160 0x7f8154199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f815a7fb640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f815419a100 0x7f81541a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f815a7fb640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81541111f0 con 0x7f8154101090 2024-04-20T12:28:06.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f815a7fb640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8154111070 con 0x7f815419a100 2024-04-20T12:28:06.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f815a7fb640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8154111370 con 0x7f8154106160 2024-04-20T12:28:06.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f8153fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101090 0x7f8154199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f8153fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101090 0x7f8154199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37864/0 (socket says 172.21.15.135:37864) 2024-04-20T12:28:06.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f8153fff640 1 -- 172.21.15.135:0/2346624226 learned_addr learned my addr 172.21.15.135:0/2346624226 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f8158d98640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f815419a100 0x7f81541a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f81537fe640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8154106160 0x7f8154199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f8153fff640 1 -- 172.21.15.135:0/2346624226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8154106160 msgr2=0x7f8154199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f8153fff640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8154106160 0x7f8154199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.825 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f8153fff640 1 -- 172.21.15.135:0/2346624226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f815419a100 msgr2=0x7f81541a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f8153fff640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f815419a100 0x7f81541a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f8153fff640 1 -- 172.21.15.135:0/2346624226 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81541a4eb0 con 0x7f8154101090 2024-04-20T12:28:06.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f81537fe640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8154106160 0x7f8154199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:06.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f8158d98640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f815419a100 0x7f81541a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:06.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f8153fff640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101090 0x7f8154199630 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f814400d950 tx=0x7f814400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f81517fa640 1 -- 172.21.15.135:0/2346624226 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144017070 con 0x7f8154101090 2024-04-20T12:28:06.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f81517fa640 1 -- 172.21.15.135:0/2346624226 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8144009c30 con 0x7f8154101090 2024-04-20T12:28:06.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f815a7fb640 1 -- 172.21.15.135:0/2346624226 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81541a51a0 con 0x7f8154101090 2024-04-20T12:28:06.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f81517fa640 1 -- 172.21.15.135:0/2346624226 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814400f6b0 con 0x7f8154101090 2024-04-20T12:28:06.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.823+0000 7f815a7fb640 1 -- 172.21.15.135:0/2346624226 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81541a56f0 con 0x7f8154101090 2024-04-20T12:28:06.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:06 smithi139 ceph-mon[21834]: pgmap v152: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:28:06.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.826+0000 7f815d3e2740 1 Processor -- start 2024-04-20T12:28:06.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.826+0000 7f81517fa640 1 -- 172.21.15.135:0/2346624226 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f81440109d0 con 0x7f8154101090 2024-04-20T12:28:06.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.826+0000 7f815d3e2740 1 -- start start 2024-04-20T12:28:06.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.826+0000 7f815d3e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe687f0 0x56088fe68bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f815d3e2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe691a0 0x56088fe761e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f815d3e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe76720 0x56088fe78b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f815d3e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56088fdce110 con 0x56088fe687f0 2024-04-20T12:28:06.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f815d3e2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56088fd6b550 con 0x56088fe691a0 2024-04-20T12:28:06.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f815d3e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56088fdca0d0 con 0x56088fe76720 2024-04-20T12:28:06.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f8158d98640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe687f0 0x56088fe68bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f8158d98640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe687f0 0x56088fe68bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37870/0 (socket says 172.21.15.135:37870) 2024-04-20T12:28:06.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f8158d98640 1 -- 172.21.15.135:0/1488149489 learned_addr learned my addr 172.21.15.135:0/1488149489 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f8153fff640 1 --2- 172.21.15.135:0/1488149489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe691a0 0x56088fe761e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f81537fe640 1 --2- 172.21.15.135:0/1488149489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe76720 0x56088fe78b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f8158d98640 1 -- 172.21.15.135:0/1488149489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe76720 msgr2=0x56088fe78b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f8158d98640 1 --2- 172.21.15.135:0/1488149489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe76720 0x56088fe78b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f81517fa640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f813c0a3d20 0x7f813c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f8158d98640 1 -- 172.21.15.135:0/1488149489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe691a0 msgr2=0x56088fe761e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f8158d98640 1 --2- 172.21.15.135:0/1488149489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe691a0 0x56088fe761e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f8158d98640 1 -- 172.21.15.135:0/1488149489 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56088fd93900 con 0x56088fe687f0 2024-04-20T12:28:06.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f81517fa640 1 -- 172.21.15.135:0/2346624226 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f81440d0880 con 0x7f8154101090 2024-04-20T12:28:06.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f8158d98640 1 --2- 172.21.15.135:0/1488149489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe687f0 0x56088fe68bd0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f814c009f30 tx=0x7f814c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d699f7b2d2459f5c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f8158d98640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f813c0a3d20 0x7f813c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f813a7fc640 1 -- 172.21.15.135:0/1488149489 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814c016070 con 0x56088fe687f0 2024-04-20T12:28:06.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f813a7fc640 1 -- 172.21.15.135:0/1488149489 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f814c012450 con 0x56088fe687f0 2024-04-20T12:28:06.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.827+0000 7f813a7fc640 1 -- 172.21.15.135:0/1488149489 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814c0116a0 con 0x56088fe687f0 2024-04-20T12:28:06.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.828+0000 7f815d3e2740 1 -- 172.21.15.135:0/1488149489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe687f0 msgr2=0x56088fe68bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.828+0000 7f8158d98640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f813c0a3d20 0x7f813c0a61e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f814c011010 tx=0x7f814c011dc0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.828+0000 7f815d3e2740 1 --2- 172.21.15.135:0/1488149489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe687f0 0x56088fe68bd0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f814c009f30 tx=0x7f814c010800 comp rx=0 tx=0).stop 2024-04-20T12:28:06.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.828+0000 7f815d3e2740 1 -- 172.21.15.135:0/1488149489 shutdown_connections 2024-04-20T12:28:06.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.828+0000 7f815d3e2740 1 --2- 172.21.15.135:0/1488149489 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe76720 0x56088fe78b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.828+0000 7f815d3e2740 1 --2- 172.21.15.135:0/1488149489 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe691a0 0x56088fe761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.828+0000 7f815d3e2740 1 --2- 172.21.15.135:0/1488149489 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe687f0 0x56088fe68bd0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.828+0000 7f815d3e2740 1 -- 172.21.15.135:0/1488149489 >> 172.21.15.135:0/1488149489 conn(0x56088fe63540 msgr2=0x56088fe63920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.828+0000 7f815d3e2740 1 -- 172.21.15.135:0/1488149489 shutdown_connections 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.828+0000 7f815d3e2740 1 -- 172.21.15.135:0/1488149489 wait complete. 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f815d3e2740 1 -- start start 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f815d3e2740 1 Processor -- start 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f815d3e2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe687f0 0x56088fe736e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f815d3e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe691a0 0x56088fe73c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f815d3e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe76720 0x56088fe74160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f815d3e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56088fe794e0 con 0x56088fe691a0 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f815d3e2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56088fd87500 con 0x56088fe687f0 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f815d3e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56088fe79660 con 0x56088fe76720 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f815d3e2740 10 client.0 _ll_register_callbacks cb 0x56088fd6c2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f81537fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe691a0 0x56088fe73c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f81537fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe691a0 0x56088fe73c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37886/0 (socket says 172.21.15.135:37886) 2024-04-20T12:28:06.836 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f81537fe640 1 -- 172.21.15.135:0/3814229943 learned_addr learned my addr 172.21.15.135:0/3814229943 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f8153fff640 1 --2- 172.21.15.135:0/3814229943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe687f0 0x56088fe736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f8158d98640 1 --2- 172.21.15.135:0/3814229943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe76720 0x56088fe74160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f81537fe640 1 -- 172.21.15.135:0/3814229943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe76720 msgr2=0x56088fe74160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f81537fe640 1 --2- 172.21.15.135:0/3814229943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe76720 0x56088fe74160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f81537fe640 1 -- 172.21.15.135:0/3814229943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe687f0 msgr2=0x56088fe736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f81537fe640 1 --2- 172.21.15.135:0/3814229943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe687f0 0x56088fe736e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.829+0000 7f81537fe640 1 -- 172.21.15.135:0/3814229943 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56088fae03f0 con 0x56088fe691a0 2024-04-20T12:28:06.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f81537fe640 1 --2- 172.21.15.135:0/3814229943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe691a0 0x56088fe73c20 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8148009900 tx=0x7f8148005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc37fbb18e1fc10 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f81337fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:06.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f81337fe640 1 -- 172.21.15.135:0/3814229943 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148005030 con 0x56088fe691a0 2024-04-20T12:28:06.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f81337fe640 1 -- 172.21.15.135:0/3814229943 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f81480051d0 con 0x56088fe691a0 2024-04-20T12:28:06.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f815d3e2740 1 -- 172.21.15.135:0/3814229943 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f814c012450 con 0x56088fe691a0 2024-04-20T12:28:06.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f81337fe640 1 -- 172.21.15.135:0/3814229943 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f814804d050 con 0x56088fe691a0 2024-04-20T12:28:06.837 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f815d3e2740 10 client.17229 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:06.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f815d3e2740 1 -- 172.21.15.135:0/3814229943 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56088fbaa7d0 con 0x56088fe691a0 2024-04-20T12:28:06.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f81337fe640 1 -- 172.21.15.135:0/3814229943 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f814c012450 con 0x56088fe691a0 2024-04-20T12:28:06.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f81337fe640 1 -- 172.21.15.135:0/3814229943 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f81480035f0 con 0x56088fe691a0 2024-04-20T12:28:06.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f815d3e2740 10 client.17229 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:06.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f815d3e2740 10 client.17229 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:28:06.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f815d3e2740 20 client.17229 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:06.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f815d3e2740 1 --2- 172.21.15.135:0/3814229943 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x56088fe86a50 0x56088fe88f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f815d3e2740 4 client.17229 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:06.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.830+0000 7f815d3e2740 1 -- 172.21.15.135:0/3814229943 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56088fddbb30 con 0x56088fe86a50 2024-04-20T12:28:06.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.831+0000 7f8153fff640 1 --2- 172.21.15.135:0/3814229943 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x56088fe86a50 0x56088fe88f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.831+0000 7f8153fff640 1 --2- 172.21.15.135:0/3814229943 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x56088fe86a50 0x56088fe88f10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=84daf97274f50d1 server_cookie=390a95a367a2a992 in_seq=0 out_seq=0 2024-04-20T12:28:06.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.831+0000 7f81337fe640 10 client.17229 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:28:06.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.832+0000 7f81337fe640 1 -- 172.21.15.135:0/3814229943 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56088fddbb30 con 0x56088fe86a50 2024-04-20T12:28:06.838 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.832+0000 7f81337fe640 10 client.17229 handle_command_reply: tid=0 2024-04-20T12:28:06.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.832+0000 7f815d3e2740 1 client.17229 shutdown 2024-04-20T12:28:06.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.832+0000 7f815d3e2740 1 -- 172.21.15.135:0/3814229943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe691a0 msgr2=0x56088fe73c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.832+0000 7f815d3e2740 1 --2- 172.21.15.135:0/3814229943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe691a0 0x56088fe73c20 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8148009900 tx=0x7f8148005dd0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.832+0000 7f815d3e2740 1 -- 172.21.15.135:0/3814229943 shutdown_connections 2024-04-20T12:28:06.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.832+0000 7f815d3e2740 1 --2- 172.21.15.135:0/3814229943 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x56088fe86a50 0x56088fe88f10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.832+0000 7f815d3e2740 1 --2- 172.21.15.135:0/3814229943 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe76720 0x56088fe74160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.832+0000 7f815d3e2740 1 --2- 172.21.15.135:0/3814229943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe691a0 0x56088fe73c20 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.832+0000 7f81337fe640 0 client.17229 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:28:06.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.832+0000 7f815d3e2740 1 --2- 172.21.15.135:0/3814229943 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe687f0 0x56088fe736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.832+0000 7f815d3e2740 1 -- 172.21.15.135:0/3814229943 >> 172.21.15.135:0/3814229943 conn(0x56088fe63540 msgr2=0x56088fe65290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.832+0000 7f815d3e2740 1 -- 172.21.15.135:0/3814229943 shutdown_connections 2024-04-20T12:28:06.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.832+0000 7f815d3e2740 1 -- 172.21.15.135:0/3814229943 wait complete. 2024-04-20T12:28:06.839 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.832+0000 7f815d3e2740 20 client.17229 trim_cache size 0 max 16384 2024-04-20T12:28:06.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.845+0000 7f815d3e2740 1 Processor -- start 2024-04-20T12:28:06.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.845+0000 7f815d3e2740 1 -- start start 2024-04-20T12:28:06.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.845+0000 7f815d3e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe687f0 0x56088fe823e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.845+0000 7f815d3e2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe691a0 0x56088fe73db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.845+0000 7f815d3e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe76720 0x56088fe8e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.845+0000 7f815d3e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81541ad1e0 con 0x56088fe687f0 2024-04-20T12:28:06.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.845+0000 7f815d3e2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f81541aed20 con 0x56088fe691a0 2024-04-20T12:28:06.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.845+0000 7f815d3e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81541ad8b0 con 0x56088fe76720 2024-04-20T12:28:06.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.845+0000 7f8153fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe687f0 0x56088fe823e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.845+0000 7f8153fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe687f0 0x56088fe823e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37902/0 (socket says 172.21.15.135:37902) 2024-04-20T12:28:06.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.845+0000 7f8153fff640 1 -- 172.21.15.135:0/697390536 learned_addr learned my addr 172.21.15.135:0/697390536 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f81537fe640 1 --2- 172.21.15.135:0/697390536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe691a0 0x56088fe73db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f8153fff640 1 -- 172.21.15.135:0/697390536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe76720 msgr2=0x56088fe8e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f8153fff640 1 --2- 172.21.15.135:0/697390536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe76720 0x56088fe8e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f8153fff640 1 -- 172.21.15.135:0/697390536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe691a0 msgr2=0x56088fe73db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f8153fff640 1 --2- 172.21.15.135:0/697390536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe691a0 0x56088fe73db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f8153fff640 1 -- 172.21.15.135:0/697390536 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56088fe6f2b0 con 0x56088fe687f0 2024-04-20T12:28:06.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f81537fe640 1 --2- 172.21.15.135:0/697390536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe691a0 0x56088fe73db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:06.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f8153fff640 1 --2- 172.21.15.135:0/697390536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe687f0 0x56088fe823e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f81440ce250 tx=0x7f8144005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9596a195d23cdc58 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f8139ffb640 1 -- 172.21.15.135:0/697390536 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144020040 con 0x56088fe687f0 2024-04-20T12:28:06.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f8139ffb640 1 -- 172.21.15.135:0/697390536 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8144009de0 con 0x56088fe687f0 2024-04-20T12:28:06.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f8139ffb640 1 -- 172.21.15.135:0/697390536 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81440cded0 con 0x56088fe687f0 2024-04-20T12:28:06.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f815d3e2740 1 -- 172.21.15.135:0/697390536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe687f0 msgr2=0x56088fe823e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f815d3e2740 1 --2- 172.21.15.135:0/697390536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe687f0 0x56088fe823e0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f81440ce250 tx=0x7f8144005880 comp rx=0 tx=0).stop 2024-04-20T12:28:06.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f815d3e2740 1 -- 172.21.15.135:0/697390536 shutdown_connections 2024-04-20T12:28:06.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f815d3e2740 1 --2- 172.21.15.135:0/697390536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe76720 0x56088fe8e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f815d3e2740 1 --2- 172.21.15.135:0/697390536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe691a0 0x56088fe73db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f815d3e2740 1 --2- 172.21.15.135:0/697390536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe687f0 0x56088fe823e0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f815d3e2740 1 -- 172.21.15.135:0/697390536 >> 172.21.15.135:0/697390536 conn(0x56088fe63540 msgr2=0x56088fe736a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f815d3e2740 1 -- 172.21.15.135:0/697390536 shutdown_connections 2024-04-20T12:28:06.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.846+0000 7f815d3e2740 1 -- 172.21.15.135:0/697390536 wait complete. 2024-04-20T12:28:06.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.847+0000 7f815d3e2740 1 -- start start 2024-04-20T12:28:06.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.847+0000 7f815d3e2740 1 Processor -- start 2024-04-20T12:28:06.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.847+0000 7f815d3e2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe687f0 0x56088fe7a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.847+0000 7f815d3e2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe691a0 0x56088fe7a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.847+0000 7f815d3e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe76720 0x56088fe7adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.847+0000 7f815d3e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f81541ae650 con 0x56088fe76720 2024-04-20T12:28:06.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.847+0000 7f815d3e2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f81541adf80 con 0x56088fe691a0 2024-04-20T12:28:06.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.847+0000 7f815d3e2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f81541ab1b0 con 0x56088fe687f0 2024-04-20T12:28:06.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.847+0000 7f815d3e2740 10 client.0 _ll_register_callbacks cb 0x7f8148009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:06.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.847+0000 7f8158d98640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe76720 0x56088fe7adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.847+0000 7f8158d98640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe76720 0x56088fe7adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37904/0 (socket says 172.21.15.135:37904) 2024-04-20T12:28:06.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.847+0000 7f8158d98640 1 -- 172.21.15.135:0/4068282365 learned_addr learned my addr 172.21.15.135:0/4068282365 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.847+0000 7f8153fff640 1 --2- 172.21.15.135:0/4068282365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe687f0 0x56088fe7a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f8158d98640 1 -- 172.21.15.135:0/4068282365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe687f0 msgr2=0x56088fe7a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f8158d98640 1 --2- 172.21.15.135:0/4068282365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe687f0 0x56088fe7a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f8158d98640 1 -- 172.21.15.135:0/4068282365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe691a0 msgr2=0x56088fe7a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f8158d98640 1 --2- 172.21.15.135:0/4068282365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe691a0 0x56088fe7a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f8158d98640 1 -- 172.21.15.135:0/4068282365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56088feec080 con 0x56088fe76720 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f8153fff640 1 --2- 172.21.15.135:0/4068282365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe687f0 0x56088fe7a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f8158d98640 1 --2- 172.21.15.135:0/4068282365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe76720 0x56088fe7adf0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f814c010d00 tx=0x7f814c00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7435c71e9c71e9c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f81337fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f81337fe640 1 -- 172.21.15.135:0/4068282365 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814c016030 con 0x56088fe76720 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f815d3e2740 1 -- 172.21.15.135:0/4068282365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8144009de0 con 0x56088fe76720 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f81337fe640 1 -- 172.21.15.135:0/4068282365 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f814c0113e0 con 0x56088fe76720 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f81337fe640 1 -- 172.21.15.135:0/4068282365 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f814c03e050 con 0x56088fe76720 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f815d3e2740 10 client.17235 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f815d3e2740 1 -- 172.21.15.135:0/4068282365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56088feed300 con 0x56088fe76720 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f81337fe640 1 -- 172.21.15.135:0/4068282365 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8144009de0 con 0x56088fe76720 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f81337fe640 1 -- 172.21.15.135:0/4068282365 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f814c039030 con 0x56088fe76720 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f815d3e2740 10 client.17235 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f815d3e2740 10 client.17235 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:28:06.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f815d3e2740 20 client.17235 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:06.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f815d3e2740 1 --2- 172.21.15.135:0/4068282365 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x56088feed850 0x56088feefc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f815d3e2740 4 client.17235 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:28:06.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.848+0000 7f815d3e2740 1 -- 172.21.15.135:0/4068282365 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56088fdd59a0 con 0x56088feed850 2024-04-20T12:28:06.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f8153fff640 1 --2- 172.21.15.135:0/4068282365 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x56088feed850 0x56088feefc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f81337fe640 10 client.17235 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:28:06.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f8153fff640 1 --2- 172.21.15.135:0/4068282365 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x56088feed850 0x56088feefc70 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e8166a650ef03065 server_cookie=3d38dc5b4b33470c in_seq=0 out_seq=0 2024-04-20T12:28:06.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f81337fe640 1 -- 172.21.15.135:0/4068282365 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56088fdd59a0 con 0x56088feed850 2024-04-20T12:28:06.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f81337fe640 10 client.17235 handle_command_reply: tid=0 2024-04-20T12:28:06.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f815d3e2740 1 client.17235 shutdown 2024-04-20T12:28:06.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f815d3e2740 1 -- 172.21.15.135:0/4068282365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe76720 msgr2=0x56088fe7adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f815d3e2740 1 --2- 172.21.15.135:0/4068282365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe76720 0x56088fe7adf0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f814c010d00 tx=0x7f814c00e000 comp rx=0 tx=0).stop 2024-04-20T12:28:06.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f815d3e2740 1 -- 172.21.15.135:0/4068282365 shutdown_connections 2024-04-20T12:28:06.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f815d3e2740 1 --2- 172.21.15.135:0/4068282365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56088fe76720 0x56088fe7adf0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f815d3e2740 1 --2- 172.21.15.135:0/4068282365 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56088fe691a0 0x56088fe7a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f815d3e2740 1 --2- 172.21.15.135:0/4068282365 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x56088feed850 0x56088feefc70 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f815d3e2740 1 --2- 172.21.15.135:0/4068282365 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56088fe687f0 0x56088fe7a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f81337fe640 0 client.17235 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:28:06.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f815d3e2740 1 -- 172.21.15.135:0/4068282365 >> 172.21.15.135:0/4068282365 conn(0x56088fe63540 msgr2=0x56088fe73d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f815d3e2740 1 -- 172.21.15.135:0/4068282365 shutdown_connections 2024-04-20T12:28:06.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.849+0000 7f815d3e2740 1 -- 172.21.15.135:0/4068282365 wait complete. 2024-04-20T12:28:06.857 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.850+0000 7f815d3e2740 20 client.17235 trim_cache size 0 max 16384 2024-04-20T12:28:06.857 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:28:06.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.850+0000 7f815a7fb640 1 -- 172.21.15.135:0/2346624226 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f813c0a3d20 msgr2=0x7f813c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.850+0000 7f815a7fb640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f813c0a3d20 0x7f813c0a61e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f814c011010 tx=0x7f814c011dc0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.850+0000 7f815a7fb640 1 -- 172.21.15.135:0/2346624226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101090 msgr2=0x7f8154199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.850+0000 7f815a7fb640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101090 0x7f8154199630 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f814400d950 tx=0x7f814400de10 comp rx=0 tx=0).stop 2024-04-20T12:28:06.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.850+0000 7f815a7fb640 1 -- 172.21.15.135:0/2346624226 shutdown_connections 2024-04-20T12:28:06.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.850+0000 7f815a7fb640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f815419a100 0x7f81541a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.850+0000 7f815a7fb640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f813c0a3d20 0x7f813c0a61e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.850+0000 7f815a7fb640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8154106160 0x7f8154199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.850+0000 7f815a7fb640 1 --2- 172.21.15.135:0/2346624226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8154101090 0x7f8154199630 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.850+0000 7f815a7fb640 1 -- 172.21.15.135:0/2346624226 >> 172.21.15.135:0/2346624226 conn(0x7f8154078010 msgr2=0x7f81540fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.850+0000 7f815a7fb640 1 -- 172.21.15.135:0/2346624226 shutdown_connections 2024-04-20T12:28:06.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.850+0000 7f815a7fb640 1 -- 172.21.15.135:0/2346624226 wait complete. 2024-04-20T12:28:06.861 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:28:06.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.962+0000 7f15cdcc8640 1 -- 172.21.15.135:0/936271371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15c8107280 msgr2=0x7f15c810ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.962+0000 7f15cdcc8640 1 --2- 172.21.15.135:0/936271371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15c8107280 0x7f15c810ee50 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009ca0 tx=0x7f15c002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.962+0000 7f15cdcc8640 1 -- 172.21.15.135:0/936271371 shutdown_connections 2024-04-20T12:28:06.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.962+0000 7f15cdcc8640 1 --2- 172.21.15.135:0/936271371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15c8107280 0x7f15c810ee50 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.962+0000 7f15cdcc8640 1 --2- 172.21.15.135:0/936271371 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c8102b60 0x7f15c8106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.962+0000 7f15cdcc8640 1 --2- 172.21.15.135:0/936271371 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c81021b0 0x7f15c8102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.962+0000 7f15cdcc8640 1 -- 172.21.15.135:0/936271371 >> 172.21.15.135:0/936271371 conn(0x7f15c80793f0 msgr2=0x7f15c8079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.962+0000 7f15cdcc8640 1 -- 172.21.15.135:0/936271371 shutdown_connections 2024-04-20T12:28:06.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.962+0000 7f15cdcc8640 1 -- 172.21.15.135:0/936271371 wait complete. 2024-04-20T12:28:06.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15cdcc8640 1 Processor -- start 2024-04-20T12:28:06.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15cdcc8640 1 -- start start 2024-04-20T12:28:06.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15cdcc8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c81021b0 0x7f15c81a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15cdcc8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15c8107280 0x7f15c81a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15cdcc8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c819a7e0 0x7f15c819ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15cdcc8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f15c8112340 con 0x7f15c8107280 2024-04-20T12:28:06.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15cdcc8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f15c81121c0 con 0x7f15c81021b0 2024-04-20T12:28:06.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15cdcc8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f15c81124c0 con 0x7f15c819a7e0 2024-04-20T12:28:06.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15c6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15c8107280 0x7f15c81a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15c6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15c8107280 0x7f15c81a0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37914/0 (socket says 172.21.15.135:37914) 2024-04-20T12:28:06.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15c6ffd640 1 -- 172.21.15.135:0/2985833923 learned_addr learned my addr 172.21.15.135:0/2985833923 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15c77fe640 1 --2- 172.21.15.135:0/2985833923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c81021b0 0x7f15c81a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15c6ffd640 1 -- 172.21.15.135:0/2985833923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c819a7e0 msgr2=0x7f15c819ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15c7fff640 1 --2- 172.21.15.135:0/2985833923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c819a7e0 0x7f15c819ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15c6ffd640 1 --2- 172.21.15.135:0/2985833923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c819a7e0 0x7f15c819ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15c6ffd640 1 -- 172.21.15.135:0/2985833923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c81021b0 msgr2=0x7f15c81a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15c6ffd640 1 --2- 172.21.15.135:0/2985833923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c81021b0 0x7f15c81a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15c6ffd640 1 -- 172.21.15.135:0/2985833923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c819b370 con 0x7f15c8107280 2024-04-20T12:28:06.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.963+0000 7f15c6ffd640 1 --2- 172.21.15.135:0/2985833923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15c8107280 0x7f15c81a0bb0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00d740 tx=0x7f15bc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.964+0000 7f15c4ff9640 1 -- 172.21.15.135:0/2985833923 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc017070 con 0x7f15c8107280 2024-04-20T12:28:06.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.964+0000 7f15cdcc8640 1 -- 172.21.15.135:0/2985833923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c819b660 con 0x7f15c8107280 2024-04-20T12:28:06.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.964+0000 7f15c4ff9640 1 -- 172.21.15.135:0/2985833923 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15bc00de50 con 0x7f15c8107280 2024-04-20T12:28:06.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.964+0000 7f15c4ff9640 1 -- 172.21.15.135:0/2985833923 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc004e00 con 0x7f15c8107280 2024-04-20T12:28:06.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.964+0000 7f15cdcc8640 1 -- 172.21.15.135:0/2985833923 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c81a77f0 con 0x7f15c8107280 2024-04-20T12:28:06.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.966+0000 7f15c4ff9640 1 -- 172.21.15.135:0/2985833923 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f15bc004fa0 con 0x7f15c8107280 2024-04-20T12:28:06.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.966+0000 7f15d0996740 1 Processor -- start 2024-04-20T12:28:06.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.966+0000 7f15d0996740 1 -- start start 2024-04-20T12:28:06.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.966+0000 7f15d0996740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a2e10 0x5591526a31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.966+0000 7f15d0996740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a3730 0x5591526abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.966+0000 7f15d0996740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526ac310 0x5591526ae700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.966+0000 7f15d0996740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559152608110 con 0x5591526a2e10 2024-04-20T12:28:06.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.966+0000 7f15d0996740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5591525a5550 con 0x5591526a3730 2024-04-20T12:28:06.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.966+0000 7f15d0996740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5591526040d0 con 0x5591526ac310 2024-04-20T12:28:06.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.966+0000 7f15c7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a2e10 0x5591526a31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.966+0000 7f15c4ff9640 1 --2- 172.21.15.135:0/2985833923 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f15b00a3d20 0x7f15b00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.966+0000 7f15c7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a2e10 0x5591526a31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37918/0 (socket says 172.21.15.135:37918) 2024-04-20T12:28:06.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.966+0000 7f15c7fff640 1 -- 172.21.15.135:0/2977695597 learned_addr learned my addr 172.21.15.135:0/2977695597 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.967+0000 7f15c6ffd640 1 --2- 172.21.15.135:0/2977695597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526ac310 0x5591526ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.967+0000 7f15c7fff640 1 --2- 172.21.15.135:0/2985833923 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f15b00a3d20 0x7f15b00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.967+0000 7f15c77fe640 1 --2- 172.21.15.135:0/2977695597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a3730 0x5591526abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.967+0000 7f15c4ff9640 1 -- 172.21.15.135:0/2985833923 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f15bc0d04a0 con 0x7f15c8107280 2024-04-20T12:28:06.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.967+0000 7f15c7fff640 1 -- 172.21.15.135:0/2977695597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526ac310 msgr2=0x5591526ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.967+0000 7f15c7fff640 1 --2- 172.21.15.135:0/2977695597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526ac310 0x5591526ae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.967+0000 7f15c7fff640 1 -- 172.21.15.135:0/2977695597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a3730 msgr2=0x5591526abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.967+0000 7f15c7fff640 1 --2- 172.21.15.135:0/2977695597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a3730 0x5591526abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.967+0000 7f15c7fff640 1 -- 172.21.15.135:0/2977695597 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591525cd900 con 0x5591526a2e10 2024-04-20T12:28:06.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.967+0000 7f15c6ffd640 1 --2- 172.21.15.135:0/2977695597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526ac310 0x5591526ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:06.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.967+0000 7f15c7fff640 1 --2- 172.21.15.135:0/2977695597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a2e10 0x5591526a31f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009430 tx=0x7f15c0032ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6143285d7b132f8a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.967+0000 7f15adffb640 1 -- 172.21.15.135:0/2977695597 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0003c30 con 0x5591526a2e10 2024-04-20T12:28:06.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.967+0000 7f15adffb640 1 -- 172.21.15.135:0/2977695597 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15c0003dd0 con 0x5591526a2e10 2024-04-20T12:28:06.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.967+0000 7f15c7fff640 1 --2- 172.21.15.135:0/2985833923 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f15b00a3d20 0x7f15b00a61e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f15c0049000 tx=0x7f15c0048000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.967+0000 7f15adffb640 1 -- 172.21.15.135:0/2977695597 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0039070 con 0x5591526a2e10 2024-04-20T12:28:06.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.968+0000 7f15d0996740 1 -- 172.21.15.135:0/2977695597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a2e10 msgr2=0x5591526a31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.968+0000 7f15d0996740 1 --2- 172.21.15.135:0/2977695597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a2e10 0x5591526a31f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009430 tx=0x7f15c0032ec0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.968+0000 7f15d0996740 1 -- 172.21.15.135:0/2977695597 shutdown_connections 2024-04-20T12:28:06.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.968+0000 7f15d0996740 1 --2- 172.21.15.135:0/2977695597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526ac310 0x5591526ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.968+0000 7f15d0996740 1 --2- 172.21.15.135:0/2977695597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a3730 0x5591526abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.968+0000 7f15d0996740 1 --2- 172.21.15.135:0/2977695597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a2e10 0x5591526a31f0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.968+0000 7f15d0996740 1 -- 172.21.15.135:0/2977695597 >> 172.21.15.135:0/2977695597 conn(0x55915269d540 msgr2=0x55915269d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.968+0000 7f15d0996740 1 -- 172.21.15.135:0/2977695597 shutdown_connections 2024-04-20T12:28:06.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.968+0000 7f15d0996740 1 -- 172.21.15.135:0/2977695597 wait complete. 2024-04-20T12:28:06.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.968+0000 7f15d0996740 1 -- start start 2024-04-20T12:28:06.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.968+0000 7f15d0996740 1 Processor -- start 2024-04-20T12:28:06.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15d0996740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a2e10 0x5591526a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15d0996740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a3730 0x5591526a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15d0996740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526ac310 0x5591526a9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15d0996740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5591526aefe0 con 0x5591526a3730 2024-04-20T12:28:06.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15d0996740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5591525c1500 con 0x5591526a2e10 2024-04-20T12:28:06.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15d0996740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5591526af160 con 0x5591526ac310 2024-04-20T12:28:06.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15d0996740 10 client.0 _ll_register_callbacks cb 0x5591525a62f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:06.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15c6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a3730 0x5591526a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15c6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a3730 0x5591526a99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37922/0 (socket says 172.21.15.135:37922) 2024-04-20T12:28:06.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15c6ffd640 1 -- 172.21.15.135:0/727351223 learned_addr learned my addr 172.21.15.135:0/727351223 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15c77fe640 1 --2- 172.21.15.135:0/727351223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a2e10 0x5591526a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15c6ffd640 1 -- 172.21.15.135:0/727351223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526ac310 msgr2=0x5591526a9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15c6ffd640 1 --2- 172.21.15.135:0/727351223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526ac310 0x5591526a9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15c6ffd640 1 -- 172.21.15.135:0/727351223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a2e10 msgr2=0x5591526a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15c6ffd640 1 --2- 172.21.15.135:0/727351223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a2e10 0x5591526a94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15c6ffd640 1 -- 172.21.15.135:0/727351223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55915231a3f0 con 0x5591526a3730 2024-04-20T12:28:06.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15c77fe640 1 --2- 172.21.15.135:0/727351223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a2e10 0x5591526a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:06.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15c6ffd640 1 --2- 172.21.15.135:0/727351223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a3730 0x5591526a99e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f15bc098520 tx=0x7f15bc06aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243aa1adf9af6ec2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:06.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15a6ffd640 1 -- 172.21.15.135:0/727351223 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc020040 con 0x5591526a3730 2024-04-20T12:28:06.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15a6ffd640 1 -- 172.21.15.135:0/727351223 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f15bc0cdaf0 con 0x5591526a3730 2024-04-20T12:28:06.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.969+0000 7f15d0996740 1 -- 172.21.15.135:0/727351223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15c0003dd0 con 0x5591526a3730 2024-04-20T12:28:06.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.970+0000 7f15a6ffd640 1 -- 172.21.15.135:0/727351223 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f15bc0a0470 con 0x5591526a3730 2024-04-20T12:28:06.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.970+0000 7f15d0996740 10 client.17247 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:06.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.970+0000 7f15d0996740 1 -- 172.21.15.135:0/727351223 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5591523e47d0 con 0x5591526a3730 2024-04-20T12:28:06.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.970+0000 7f15a6ffd640 1 -- 172.21.15.135:0/727351223 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15c0003dd0 con 0x5591526a3730 2024-04-20T12:28:06.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.970+0000 7f15a6ffd640 1 -- 172.21.15.135:0/727351223 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f15bc0a48a0 con 0x5591526a3730 2024-04-20T12:28:06.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.970+0000 7f15d0996740 10 client.17247 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:06.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.970+0000 7f15d0996740 10 client.17247 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:28:06.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.970+0000 7f15d0996740 20 client.17247 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:06.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.970+0000 7f15d0996740 1 --2- 172.21.15.135:0/727351223 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5591526bc740 0x5591526beb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.970+0000 7f15d0996740 4 client.17247 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:06.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.970+0000 7f15d0996740 1 -- 172.21.15.135:0/727351223 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559152615b30 con 0x5591526bc740 2024-04-20T12:28:06.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.970+0000 7f15c77fe640 1 --2- 172.21.15.135:0/727351223 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5591526bc740 0x5591526beb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.971+0000 7f15c77fe640 1 --2- 172.21.15.135:0/727351223 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5591526bc740 0x5591526beb90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=244cb9d9c148ade7 server_cookie=b9dd4e7a79242ac0 in_seq=0 out_seq=0 2024-04-20T12:28:06.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.971+0000 7f15a6ffd640 10 client.17247 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:28:06.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.971+0000 7f15a6ffd640 1 -- 172.21.15.135:0/727351223 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559152615b30 con 0x5591526bc740 2024-04-20T12:28:06.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.971+0000 7f15a6ffd640 10 client.17247 handle_command_reply: tid=0 2024-04-20T12:28:06.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.971+0000 7f15d0996740 1 client.17247 shutdown 2024-04-20T12:28:06.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.971+0000 7f15d0996740 1 -- 172.21.15.135:0/727351223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a3730 msgr2=0x5591526a99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.971+0000 7f15d0996740 1 --2- 172.21.15.135:0/727351223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a3730 0x5591526a99e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f15bc098520 tx=0x7f15bc06aa70 comp rx=0 tx=0).stop 2024-04-20T12:28:06.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.971+0000 7f15d0996740 1 -- 172.21.15.135:0/727351223 shutdown_connections 2024-04-20T12:28:06.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.971+0000 7f15d0996740 1 --2- 172.21.15.135:0/727351223 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5591526bc740 0x5591526beb90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.971+0000 7f15d0996740 1 --2- 172.21.15.135:0/727351223 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526ac310 0x5591526a9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.971+0000 7f15a6ffd640 0 client.17247 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:28:06.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.971+0000 7f15d0996740 1 --2- 172.21.15.135:0/727351223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a3730 0x5591526a99e0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.971+0000 7f15d0996740 1 --2- 172.21.15.135:0/727351223 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a2e10 0x5591526a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.971+0000 7f15d0996740 1 -- 172.21.15.135:0/727351223 >> 172.21.15.135:0/727351223 conn(0x55915269d540 msgr2=0x55915269f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.972+0000 7f15d0996740 1 -- 172.21.15.135:0/727351223 shutdown_connections 2024-04-20T12:28:06.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.972+0000 7f15d0996740 1 -- 172.21.15.135:0/727351223 wait complete. 2024-04-20T12:28:06.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.972+0000 7f15d0996740 20 client.17247 trim_cache size 0 max 16384 2024-04-20T12:28:06.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15d0996740 1 Processor -- start 2024-04-20T12:28:06.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15d0996740 1 -- start start 2024-04-20T12:28:06.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15d0996740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a2e10 0x5591526abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15d0996740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a3730 0x5591526b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15d0996740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526ac310 0x559152698570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15d0996740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f15c81b1530 con 0x5591526a2e10 2024-04-20T12:28:06.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15d0996740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f15c81b3070 con 0x5591526a3730 2024-04-20T12:28:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15d0996740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f15c81b1c00 con 0x5591526ac310 2024-04-20T12:28:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15c77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a2e10 0x5591526abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15c77fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a2e10 0x5591526abbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37932/0 (socket says 172.21.15.135:37932) 2024-04-20T12:28:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15c77fe640 1 -- 172.21.15.135:0/1343018991 learned_addr learned my addr 172.21.15.135:0/1343018991 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15c6ffd640 1 --2- 172.21.15.135:0/1343018991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a3730 0x5591526b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15c7fff640 1 --2- 172.21.15.135:0/1343018991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526ac310 0x559152698570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15c77fe640 1 -- 172.21.15.135:0/1343018991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526ac310 msgr2=0x559152698570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15c77fe640 1 --2- 172.21.15.135:0/1343018991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526ac310 0x559152698570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15c77fe640 1 -- 172.21.15.135:0/1343018991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a3730 msgr2=0x5591526b7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15c77fe640 1 --2- 172.21.15.135:0/1343018991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a3730 0x5591526b7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15c77fe640 1 -- 172.21.15.135:0/1343018991 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591526bb2e0 con 0x5591526a2e10 2024-04-20T12:28:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15c77fe640 1 --2- 172.21.15.135:0/1343018991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a2e10 0x5591526abbd0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x5591526bf400 tx=0x7f15b8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c2163c257f323d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15ad7fa640 1 -- 172.21.15.135:0/1343018991 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8005220 con 0x5591526a2e10 2024-04-20T12:28:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15ad7fa640 1 -- 172.21.15.135:0/1343018991 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15b8004c80 con 0x5591526a2e10 2024-04-20T12:28:06.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.985+0000 7f15ad7fa640 1 -- 172.21.15.135:0/1343018991 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8020810 con 0x5591526a2e10 2024-04-20T12:28:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.986+0000 7f15d0996740 1 -- 172.21.15.135:0/1343018991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a2e10 msgr2=0x5591526abbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.986+0000 7f15d0996740 1 --2- 172.21.15.135:0/1343018991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a2e10 0x5591526abbd0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x5591526bf400 tx=0x7f15b8005f90 comp rx=0 tx=0).stop 2024-04-20T12:28:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.986+0000 7f15d0996740 1 -- 172.21.15.135:0/1343018991 shutdown_connections 2024-04-20T12:28:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.986+0000 7f15d0996740 1 --2- 172.21.15.135:0/1343018991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526ac310 0x559152698570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.986+0000 7f15d0996740 1 --2- 172.21.15.135:0/1343018991 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a3730 0x5591526b7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.986+0000 7f15d0996740 1 --2- 172.21.15.135:0/1343018991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526a2e10 0x5591526abbd0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.986+0000 7f15d0996740 1 -- 172.21.15.135:0/1343018991 >> 172.21.15.135:0/1343018991 conn(0x55915269d540 msgr2=0x55915269e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.986+0000 7f15d0996740 1 -- 172.21.15.135:0/1343018991 shutdown_connections 2024-04-20T12:28:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.986+0000 7f15d0996740 1 -- 172.21.15.135:0/1343018991 wait complete. 2024-04-20T12:28:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.986+0000 7f15d0996740 1 -- start start 2024-04-20T12:28:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15d0996740 1 Processor -- start 2024-04-20T12:28:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15d0996740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a2e10 0x5591526b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15d0996740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526a3730 0x5591526a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15d0996740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526ac310 0x5591526a6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15d0996740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f15c81b29a0 con 0x5591526ac310 2024-04-20T12:28:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15d0996740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f15c81b22d0 con 0x5591526a2e10 2024-04-20T12:28:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15d0996740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f15c81af500 con 0x5591526a3730 2024-04-20T12:28:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15d0996740 10 client.0 _ll_register_callbacks cb 0x7f15bc0983c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15c7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526ac310 0x5591526a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15c7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526ac310 0x5591526a6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37946/0 (socket says 172.21.15.135:37946) 2024-04-20T12:28:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15c7fff640 1 -- 172.21.15.135:0/1927136341 learned_addr learned my addr 172.21.15.135:0/1927136341 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15c6ffd640 1 --2- 172.21.15.135:0/1927136341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526a3730 0x5591526a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15c77fe640 1 --2- 172.21.15.135:0/1927136341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a2e10 0x5591526b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15c7fff640 1 -- 172.21.15.135:0/1927136341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526a3730 msgr2=0x5591526a5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15c7fff640 1 --2- 172.21.15.135:0/1927136341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526a3730 0x5591526a5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15c7fff640 1 -- 172.21.15.135:0/1927136341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a2e10 msgr2=0x5591526b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:06.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15c7fff640 1 --2- 172.21.15.135:0/1927136341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a2e10 0x5591526b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15c7fff640 1 -- 172.21.15.135:0/1927136341 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591526a6a50 con 0x5591526ac310 2024-04-20T12:28:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15c77fe640 1 --2- 172.21.15.135:0/1927136341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a2e10 0x5591526b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15c7fff640 1 --2- 172.21.15.135:0/1927136341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526ac310 0x5591526a6310 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009430 tx=0x7f15c0003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74653135ed709b3f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15a6ffd640 1 -- 172.21.15.135:0/1927136341 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0039040 con 0x5591526ac310 2024-04-20T12:28:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15a6ffd640 1 -- 172.21.15.135:0/1927136341 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f15c0034ac0 con 0x5591526ac310 2024-04-20T12:28:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.987+0000 7f15d0996740 1 -- 172.21.15.135:0/1927136341 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15b8004c80 con 0x5591526ac310 2024-04-20T12:28:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.988+0000 7f15a6ffd640 1 -- 172.21.15.135:0/1927136341 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f15c005e050 con 0x5591526ac310 2024-04-20T12:28:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.988+0000 7f15d0996740 10 client.17253 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.988+0000 7f15d0996740 1 -- 172.21.15.135:0/1927136341 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559152722c20 con 0x5591526ac310 2024-04-20T12:28:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.988+0000 7f15a6ffd640 1 -- 172.21.15.135:0/1927136341 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15b8004c80 con 0x5591526ac310 2024-04-20T12:28:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.988+0000 7f15a6ffd640 1 -- 172.21.15.135:0/1927136341 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f15c0004520 con 0x5591526ac310 2024-04-20T12:28:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.988+0000 7f15d0996740 10 client.17253 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:06.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.988+0000 7f15d0996740 10 client.17253 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:28:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.988+0000 7f15d0996740 20 client.17253 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.988+0000 7f15d0996740 1 --2- 172.21.15.135:0/1927136341 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x559152722f50 0x559152725340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.988+0000 7f15d0996740 4 client.17253 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:28:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.988+0000 7f15d0996740 1 -- 172.21.15.135:0/1927136341 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55915260f9a0 con 0x559152722f50 2024-04-20T12:28:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.988+0000 7f15c77fe640 1 --2- 172.21.15.135:0/1927136341 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x559152722f50 0x559152725340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15c77fe640 1 --2- 172.21.15.135:0/1927136341 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x559152722f50 0x559152725340 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b51add529907f84e server_cookie=98ba8c9b9be29fa7 in_seq=0 out_seq=0 2024-04-20T12:28:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15a6ffd640 10 client.17253 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:28:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15a6ffd640 1 -- 172.21.15.135:0/1927136341 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55915260f9a0 con 0x559152722f50 2024-04-20T12:28:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15a6ffd640 10 client.17253 handle_command_reply: tid=0 2024-04-20T12:28:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15d0996740 1 client.17253 shutdown 2024-04-20T12:28:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15d0996740 1 -- 172.21.15.135:0/1927136341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526ac310 msgr2=0x5591526a6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15d0996740 1 --2- 172.21.15.135:0/1927136341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526ac310 0x5591526a6310 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009430 tx=0x7f15c0003c60 comp rx=0 tx=0).stop 2024-04-20T12:28:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15d0996740 1 -- 172.21.15.135:0/1927136341 shutdown_connections 2024-04-20T12:28:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15d0996740 1 --2- 172.21.15.135:0/1927136341 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x559152722f50 0x559152725340 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15d0996740 1 --2- 172.21.15.135:0/1927136341 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5591526ac310 0x5591526a6310 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15d0996740 1 --2- 172.21.15.135:0/1927136341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5591526a3730 0x5591526a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15d0996740 1 --2- 172.21.15.135:0/1927136341 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5591526a2e10 0x5591526b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15a6ffd640 0 client.17253 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:28:06.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15d0996740 1 -- 172.21.15.135:0/1927136341 >> 172.21.15.135:0/1927136341 conn(0x55915269d540 msgr2=0x55915269f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15d0996740 1 -- 172.21.15.135:0/1927136341 shutdown_connections 2024-04-20T12:28:06.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15d0996740 1 -- 172.21.15.135:0/1927136341 wait complete. 2024-04-20T12:28:06.996 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.989+0000 7f15d0996740 20 client.17253 trim_cache size 0 max 16384 2024-04-20T12:28:06.996 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:28:06.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.990+0000 7f15cdcc8640 1 -- 172.21.15.135:0/2985833923 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f15b00a3d20 msgr2=0x7f15b00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.990+0000 7f15cdcc8640 1 --2- 172.21.15.135:0/2985833923 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f15b00a3d20 0x7f15b00a61e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f15c0049000 tx=0x7f15c0048000 comp rx=0 tx=0).stop 2024-04-20T12:28:06.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.990+0000 7f15cdcc8640 1 -- 172.21.15.135:0/2985833923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15c8107280 msgr2=0x7f15c81a0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:06.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.990+0000 7f15cdcc8640 1 --2- 172.21.15.135:0/2985833923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15c8107280 0x7f15c81a0bb0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00d740 tx=0x7f15bc00dc00 comp rx=0 tx=0).stop 2024-04-20T12:28:06.997 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.990+0000 7f15cdcc8640 1 -- 172.21.15.135:0/2985833923 shutdown_connections 2024-04-20T12:28:06.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.990+0000 7f15cdcc8640 1 --2- 172.21.15.135:0/2985833923 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f15b00a3d20 0x7f15b00a61e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.990+0000 7f15cdcc8640 1 --2- 172.21.15.135:0/2985833923 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f15c819a7e0 0x7f15c819ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.990+0000 7f15cdcc8640 1 --2- 172.21.15.135:0/2985833923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f15c8107280 0x7f15c81a0bb0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.990+0000 7f15cdcc8640 1 --2- 172.21.15.135:0/2985833923 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f15c81021b0 0x7f15c81a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:06.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.990+0000 7f15cdcc8640 1 -- 172.21.15.135:0/2985833923 >> 172.21.15.135:0/2985833923 conn(0x7f15c80793f0 msgr2=0x7f15c80ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:06.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.990+0000 7f15cdcc8640 1 -- 172.21.15.135:0/2985833923 shutdown_connections 2024-04-20T12:28:06.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:06.990+0000 7f15cdcc8640 1 -- 172.21.15.135:0/2985833923 wait complete. 2024-04-20T12:28:07.000 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:28:07.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.099+0000 7fd3c1081640 1 -- 172.21.15.135:0/742711084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3bc100d50 msgr2=0x7fd3bc101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:07.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.099+0000 7fd3c1081640 1 --2- 172.21.15.135:0/742711084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3bc100d50 0x7fd3bc101130 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009ca0 tx=0x7fd3ac02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.099+0000 7fd3c1081640 1 -- 172.21.15.135:0/742711084 shutdown_connections 2024-04-20T12:28:07.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.099+0000 7fd3c1081640 1 --2- 172.21.15.135:0/742711084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3bc10e900 0x7fd3bc110cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.099+0000 7fd3c1081640 1 --2- 172.21.15.135:0/742711084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc101670 0x7fd3bc10e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.099+0000 7fd3c1081640 1 --2- 172.21.15.135:0/742711084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3bc100d50 0x7fd3bc101130 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.099+0000 7fd3c1081640 1 -- 172.21.15.135:0/742711084 >> 172.21.15.135:0/742711084 conn(0x7fd3bc078010 msgr2=0x7fd3bc078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:07.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.099+0000 7fd3c1081640 1 -- 172.21.15.135:0/742711084 shutdown_connections 2024-04-20T12:28:07.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.099+0000 7fd3c1081640 1 -- 172.21.15.135:0/742711084 wait complete. 2024-04-20T12:28:07.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.100+0000 7fd3c1081640 1 Processor -- start 2024-04-20T12:28:07.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.100+0000 7fd3c1081640 1 -- start start 2024-04-20T12:28:07.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.100+0000 7fd3c1081640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3bc100d50 0x7fd3bc1a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.100+0000 7fd3c1081640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc101670 0x7fd3bc1a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.100+0000 7fd3c1081640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3bc10e900 0x7fd3bc19a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.100+0000 7fd3c1081640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc114520 con 0x7fd3bc100d50 2024-04-20T12:28:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.100+0000 7fd3c1081640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1143a0 con 0x7fd3bc10e900 2024-04-20T12:28:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.100+0000 7fd3c1081640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1146a0 con 0x7fd3bc101670 2024-04-20T12:28:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3bad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3bc100d50 0x7fd3bc1a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3bad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3bc100d50 0x7fd3bc1a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37966/0 (socket says 172.21.15.135:37966) 2024-04-20T12:28:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3bad9d640 1 -- 172.21.15.135:0/885690435 learned_addr learned my addr 172.21.15.135:0/885690435 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3bb59e640 1 --2- 172.21.15.135:0/885690435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3bc10e900 0x7fd3bc19a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3ba59c640 1 --2- 172.21.15.135:0/885690435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc101670 0x7fd3bc1a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3bad9d640 1 -- 172.21.15.135:0/885690435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc101670 msgr2=0x7fd3bc1a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3bad9d640 1 --2- 172.21.15.135:0/885690435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc101670 0x7fd3bc1a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3bad9d640 1 -- 172.21.15.135:0/885690435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3bc10e900 msgr2=0x7fd3bc19a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3bad9d640 1 --2- 172.21.15.135:0/885690435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3bc10e900 0x7fd3bc19a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3bad9d640 1 -- 172.21.15.135:0/885690435 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3bc19aff0 con 0x7fd3bc100d50 2024-04-20T12:28:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3bad9d640 1 --2- 172.21.15.135:0/885690435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3bc100d50 0x7fd3bc1a06b0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac005e30 tx=0x7fd3ac034760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:07.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3a3fff640 1 -- 172.21.15.135:0/885690435 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac039040 con 0x7fd3bc100d50 2024-04-20T12:28:07.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3a3fff640 1 -- 172.21.15.135:0/885690435 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3ac044070 con 0x7fd3bc100d50 2024-04-20T12:28:07.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3c1081640 1 -- 172.21.15.135:0/885690435 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3bc19b280 con 0x7fd3bc100d50 2024-04-20T12:28:07.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3a3fff640 1 -- 172.21.15.135:0/885690435 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0042a0 con 0x7fd3bc100d50 2024-04-20T12:28:07.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.101+0000 7fd3c1081640 1 -- 172.21.15.135:0/885690435 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3bc1a7500 con 0x7fd3bc100d50 2024-04-20T12:28:07.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.103+0000 7fd3a3fff640 1 -- 172.21.15.135:0/885690435 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fd3ac003970 con 0x7fd3bc100d50 2024-04-20T12:28:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3c3c7a740 1 Processor -- start 2024-04-20T12:28:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3c3c7a740 1 -- start start 2024-04-20T12:28:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3c3c7a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e8f7e10 0x557f5e8f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3c3c7a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f8730 0x557f5e900dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3c3c7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e901310 0x557f5e903700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3c3c7a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557f5e85d110 con 0x557f5e8f7e10 2024-04-20T12:28:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3c3c7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557f5e7fa550 con 0x557f5e901310 2024-04-20T12:28:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3c3c7a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557f5e8590d0 con 0x557f5e8f8730 2024-04-20T12:28:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3a3fff640 1 --2- 172.21.15.135:0/885690435 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3a40a3d20 0x7fd3a40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3bb59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e8f7e10 0x557f5e8f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3bb59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e8f7e10 0x557f5e8f81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37970/0 (socket says 172.21.15.135:37970) 2024-04-20T12:28:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3bb59e640 1 -- 172.21.15.135:0/2518316342 learned_addr learned my addr 172.21.15.135:0/2518316342 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3bb59e640 1 --2- 172.21.15.135:0/885690435 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3a40a3d20 0x7fd3a40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.111 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3a3fff640 1 -- 172.21.15.135:0/885690435 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fd3ac0f2cf0 con 0x7fd3bc100d50 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3bad9d640 1 --2- 172.21.15.135:0/2518316342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f8730 0x557f5e900dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3ba59c640 1 --2- 172.21.15.135:0/2518316342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e901310 0x557f5e903700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3bb59e640 1 -- 172.21.15.135:0/2518316342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f8730 msgr2=0x557f5e900dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3bb59e640 1 --2- 172.21.15.135:0/2518316342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f8730 0x557f5e900dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3bb59e640 1 -- 172.21.15.135:0/2518316342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e901310 msgr2=0x557f5e903700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3bb59e640 1 --2- 172.21.15.135:0/2518316342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e901310 0x557f5e903700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3bb59e640 1 -- 172.21.15.135:0/2518316342 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5e822900 con 0x557f5e8f7e10 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.104+0000 7fd3bad9d640 1 --2- 172.21.15.135:0/2518316342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f8730 0x557f5e900dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.105+0000 7fd3bb59e640 1 --2- 172.21.15.135:0/2518316342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e8f7e10 0x557f5e8f81f0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4012990 tx=0x7fd3b4012e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f173e59519ff65e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.105+0000 7fd3bb59e640 1 --2- 172.21.15.135:0/885690435 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3a40a3d20 0x7fd3a40a61e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4010740 tx=0x7fd3b4017000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.105+0000 7fd3a17fa640 1 -- 172.21.15.135:0/2518316342 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4024070 con 0x557f5e8f7e10 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.105+0000 7fd3a17fa640 1 -- 172.21.15.135:0/2518316342 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3b4012510 con 0x557f5e8f7e10 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.105+0000 7fd3a17fa640 1 -- 172.21.15.135:0/2518316342 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4004c40 con 0x557f5e8f7e10 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.105+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/2518316342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e8f7e10 msgr2=0x557f5e8f81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.105+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/2518316342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e8f7e10 0x557f5e8f81f0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4012990 tx=0x7fd3b4012e50 comp rx=0 tx=0).stop 2024-04-20T12:28:07.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.105+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/2518316342 shutdown_connections 2024-04-20T12:28:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.105+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/2518316342 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e901310 0x557f5e903700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.105+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/2518316342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f8730 0x557f5e900dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.105+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/2518316342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e8f7e10 0x557f5e8f81f0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.105+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/2518316342 >> 172.21.15.135:0/2518316342 conn(0x557f5e8f2540 msgr2=0x557f5e8f2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/2518316342 shutdown_connections 2024-04-20T12:28:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/2518316342 wait complete. 2024-04-20T12:28:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3c3c7a740 1 -- start start 2024-04-20T12:28:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3c3c7a740 1 Processor -- start 2024-04-20T12:28:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3c3c7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f7e10 0x557f5e8fe4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3c3c7a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e8f8730 0x557f5e8fea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3c3c7a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e901310 0x557f5e8fef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3c3c7a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557f5e904040 con 0x557f5e8f8730 2024-04-20T12:28:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3c3c7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557f5e816500 con 0x557f5e8f7e10 2024-04-20T12:28:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3c3c7a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557f5e9041c0 con 0x557f5e901310 2024-04-20T12:28:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3c3c7a740 10 client.0 _ll_register_callbacks cb 0x557f5e7fb2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3ba59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e8f8730 0x557f5e8fea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3ba59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e8f8730 0x557f5e8fea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37986/0 (socket says 172.21.15.135:37986) 2024-04-20T12:28:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3ba59c640 1 -- 172.21.15.135:0/3118780957 learned_addr learned my addr 172.21.15.135:0/3118780957 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3bb59e640 1 --2- 172.21.15.135:0/3118780957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e901310 0x557f5e8fef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3bad9d640 1 --2- 172.21.15.135:0/3118780957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f7e10 0x557f5e8fe4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3ba59c640 1 -- 172.21.15.135:0/3118780957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e901310 msgr2=0x557f5e8fef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3ba59c640 1 --2- 172.21.15.135:0/3118780957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e901310 0x557f5e8fef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3ba59c640 1 -- 172.21.15.135:0/3118780957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f7e10 msgr2=0x557f5e8fe4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:07.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3ba59c640 1 --2- 172.21.15.135:0/3118780957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f7e10 0x557f5e8fe4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.106+0000 7fd3ba59c640 1 -- 172.21.15.135:0/3118780957 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f5e56f3f0 con 0x557f5e8f8730 2024-04-20T12:28:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd3ba59c640 1 --2- 172.21.15.135:0/3118780957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e8f8730 0x557f5e8fea20 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000b920 tx=0x7fd3b000bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ccbadb78ce1b21 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd39eff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd39eff5640 1 -- 172.21.15.135:0/3118780957 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0003e20 con 0x557f5e8f8730 2024-04-20T12:28:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd39eff5640 1 -- 172.21.15.135:0/3118780957 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fd3b0005020 con 0x557f5e8f8730 2024-04-20T12:28:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3118780957 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f5e86ab30 con 0x557f5e8f8730 2024-04-20T12:28:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd39eff5640 1 -- 172.21.15.135:0/3118780957 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd3b0024050 con 0x557f5e8f8730 2024-04-20T12:28:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd3c3c7a740 10 client.17265 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3118780957 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557f5e6397d0 con 0x557f5e8f8730 2024-04-20T12:28:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd39eff5640 1 -- 172.21.15.135:0/3118780957 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557f5e86ab30 con 0x557f5e8f8730 2024-04-20T12:28:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd39eff5640 1 -- 172.21.15.135:0/3118780957 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fd3b001b470 con 0x557f5e8f8730 2024-04-20T12:28:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd3c3c7a740 10 client.17265 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd3c3c7a740 10 client.17265 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd3c3c7a740 20 client.17265 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:07.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/3118780957 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f5e9117a0 0x557f5e913c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd3c3c7a740 4 client.17265 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:07.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.107+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3118780957 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f5e8649a0 con 0x557f5e9117a0 2024-04-20T12:28:07.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.108+0000 7fd3bad9d640 1 --2- 172.21.15.135:0/3118780957 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f5e9117a0 0x557f5e913c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.108+0000 7fd3bad9d640 1 --2- 172.21.15.135:0/3118780957 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f5e9117a0 0x557f5e913c00 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d096eb71864021c server_cookie=7d4eb3167e6610c8 in_seq=0 out_seq=0 2024-04-20T12:28:07.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.108+0000 7fd39eff5640 10 client.17265 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:07.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.109+0000 7fd39eff5640 1 -- 172.21.15.135:0/3118780957 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557f5e8649a0 con 0x557f5e9117a0 2024-04-20T12:28:07.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.109+0000 7fd39eff5640 10 client.17265 handle_command_reply: tid=0 2024-04-20T12:28:07.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.109+0000 7fd3c3c7a740 1 client.17265 shutdown 2024-04-20T12:28:07.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.109+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3118780957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e8f8730 msgr2=0x557f5e8fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:07.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.109+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/3118780957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e8f8730 0x557f5e8fea20 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000b920 tx=0x7fd3b000bd20 comp rx=0 tx=0).stop 2024-04-20T12:28:07.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.109+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3118780957 shutdown_connections 2024-04-20T12:28:07.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.109+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/3118780957 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f5e9117a0 0x557f5e913c00 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.109+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/3118780957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e901310 0x557f5e8fef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.109+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/3118780957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e8f8730 0x557f5e8fea20 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.109+0000 7fd39eff5640 0 client.17265 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:07.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.109+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/3118780957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f7e10 0x557f5e8fe4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.109+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3118780957 >> 172.21.15.135:0/3118780957 conn(0x557f5e8f2540 msgr2=0x557f5e8f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:07.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.109+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3118780957 shutdown_connections 2024-04-20T12:28:07.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.109+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3118780957 wait complete. 2024-04-20T12:28:07.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.109+0000 7fd3c3c7a740 20 client.17265 trim_cache size 0 max 16384 2024-04-20T12:28:07.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.122+0000 7fd3c3c7a740 1 Processor -- start 2024-04-20T12:28:07.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.122+0000 7fd3c3c7a740 1 -- start start 2024-04-20T12:28:07.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.122+0000 7fd3c3c7a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f7e10 0x557f5e900ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.122+0000 7fd3c3c7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f8730 0x557f5e8f1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.122+0000 7fd3c3c7a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e901310 0x557f5e9194d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.122+0000 7fd3c3c7a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1b1540 con 0x557f5e901310 2024-04-20T12:28:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.122+0000 7fd3c3c7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1b3080 con 0x557f5e8f8730 2024-04-20T12:28:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.122+0000 7fd3c3c7a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1b1c10 con 0x557f5e8f7e10 2024-04-20T12:28:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.122+0000 7fd3bb59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e901310 0x557f5e9194d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.122+0000 7fd3bb59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e901310 0x557f5e9194d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37988/0 (socket says 172.21.15.135:37988) 2024-04-20T12:28:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.122+0000 7fd3bb59e640 1 -- 172.21.15.135:0/4275498850 learned_addr learned my addr 172.21.15.135:0/4275498850 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.122+0000 7fd3ba59c640 1 --2- 172.21.15.135:0/4275498850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f8730 0x557f5e8f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.123+0000 7fd3bb59e640 1 -- 172.21.15.135:0/4275498850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f7e10 msgr2=0x557f5e900ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.123+0000 7fd3bad9d640 1 --2- 172.21.15.135:0/4275498850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f7e10 0x557f5e900ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.123+0000 7fd3bb59e640 1 --2- 172.21.15.135:0/4275498850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f7e10 0x557f5e900ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.123+0000 7fd3bb59e640 1 -- 172.21.15.135:0/4275498850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f8730 msgr2=0x557f5e8f1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.123+0000 7fd3bb59e640 1 --2- 172.21.15.135:0/4275498850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f8730 0x557f5e8f1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.123+0000 7fd3bb59e640 1 -- 172.21.15.135:0/4275498850 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5e914280 con 0x557f5e901310 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.123+0000 7fd3ba59c640 1 --2- 172.21.15.135:0/4275498850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f8730 0x557f5e8f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.123+0000 7fd3bb59e640 1 --2- 172.21.15.135:0/4275498850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e901310 0x557f5e9194d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4010fc0 tx=0x7fd3b400b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75288e5e1e950197 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.123+0000 7fd3a0ff9640 1 -- 172.21.15.135:0/4275498850 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4024070 con 0x557f5e901310 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.123+0000 7fd3a0ff9640 1 -- 172.21.15.135:0/4275498850 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3b402d070 con 0x557f5e901310 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.123+0000 7fd3a0ff9640 1 -- 172.21.15.135:0/4275498850 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400d720 con 0x557f5e901310 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/4275498850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e901310 msgr2=0x557f5e9194d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/4275498850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e901310 0x557f5e9194d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4010fc0 tx=0x7fd3b400b2e0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/4275498850 shutdown_connections 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/4275498850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e901310 0x557f5e9194d0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/4275498850 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f8730 0x557f5e8f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/4275498850 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f7e10 0x557f5e900ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/4275498850 >> 172.21.15.135:0/4275498850 conn(0x557f5e8f2540 msgr2=0x557f5e8f0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/4275498850 shutdown_connections 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/4275498850 wait complete. 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 -- start start 2024-04-20T12:28:07.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 Processor -- start 2024-04-20T12:28:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f7e10 0x557f5e8fb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f8730 0x557f5e8fb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e901310 0x557f5e8fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1b29b0 con 0x557f5e901310 2024-04-20T12:28:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1b22e0 con 0x557f5e8f8730 2024-04-20T12:28:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3bc1af510 con 0x557f5e8f7e10 2024-04-20T12:28:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3c3c7a740 10 client.0 _ll_register_callbacks cb 0x7fd3b00042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3bb59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e901310 0x557f5e8fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3bb59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e901310 0x557f5e8fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37994/0 (socket says 172.21.15.135:37994) 2024-04-20T12:28:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3bb59e640 1 -- 172.21.15.135:0/3789587527 learned_addr learned my addr 172.21.15.135:0/3789587527 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3ba59c640 1 --2- 172.21.15.135:0/3789587527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f8730 0x557f5e8fb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3bad9d640 1 --2- 172.21.15.135:0/3789587527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f7e10 0x557f5e8fb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.124+0000 7fd3bb59e640 1 -- 172.21.15.135:0/3789587527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f7e10 msgr2=0x557f5e8fb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd3bb59e640 1 --2- 172.21.15.135:0/3789587527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f7e10 0x557f5e8fb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd3bb59e640 1 -- 172.21.15.135:0/3789587527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f8730 msgr2=0x557f5e8fb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd3bb59e640 1 --2- 172.21.15.135:0/3789587527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f8730 0x557f5e8fb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd3bb59e640 1 -- 172.21.15.135:0/3789587527 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f5e976d70 con 0x557f5e901310 2024-04-20T12:28:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd3ba59c640 1 --2- 172.21.15.135:0/3789587527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f8730 0x557f5e8fb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd3bb59e640 1 --2- 172.21.15.135:0/3789587527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e901310 0x557f5e8fbbf0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400d950 tx=0x7fd3b4012e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed78dab97d01423 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd39eff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd39eff5640 1 -- 172.21.15.135:0/3789587527 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4024040 con 0x557f5e901310 2024-04-20T12:28:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd39eff5640 1 -- 172.21.15.135:0/3789587527 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fd3b4004eb0 con 0x557f5e901310 2024-04-20T12:28:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3789587527 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3b402d070 con 0x557f5e901310 2024-04-20T12:28:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd39eff5640 1 -- 172.21.15.135:0/3789587527 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd3b40050b0 con 0x557f5e901310 2024-04-20T12:28:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd3c3c7a740 10 client.17271 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3789587527 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557f5e978050 con 0x557f5e901310 2024-04-20T12:28:07.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd39eff5640 1 -- 172.21.15.135:0/3789587527 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3b402d070 con 0x557f5e901310 2024-04-20T12:28:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd39eff5640 1 -- 172.21.15.135:0/3789587527 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fd3b403c4b0 con 0x557f5e901310 2024-04-20T12:28:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd3c3c7a740 10 client.17271 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd3c3c7a740 10 client.17271 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd3c3c7a740 20 client.17271 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/3789587527 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f5e9785a0 0x557f5e97a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd3c3c7a740 4 client.17271 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:28:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.125+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3789587527 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557f5e7e06e0 con 0x557f5e9785a0 2024-04-20T12:28:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd3bad9d640 1 --2- 172.21.15.135:0/3789587527 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f5e9785a0 0x557f5e97a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd3bad9d640 1 --2- 172.21.15.135:0/3789587527 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f5e9785a0 0x557f5e97a9c0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3c7d6d29ab48589 server_cookie=9d98723990871ff7 in_seq=0 out_seq=0 2024-04-20T12:28:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd39eff5640 10 client.17271 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd39eff5640 1 -- 172.21.15.135:0/3789587527 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557f5e7e06e0 con 0x557f5e9785a0 2024-04-20T12:28:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd39eff5640 10 client.17271 handle_command_reply: tid=0 2024-04-20T12:28:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd3c3c7a740 1 client.17271 shutdown 2024-04-20T12:28:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3789587527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e901310 msgr2=0x557f5e8fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:07.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/3789587527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e901310 0x557f5e8fbbf0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400d950 tx=0x7fd3b4012e50 comp rx=0 tx=0).stop 2024-04-20T12:28:07.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3789587527 shutdown_connections 2024-04-20T12:28:07.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/3789587527 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f5e9785a0 0x557f5e97a9c0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/3789587527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5e901310 0x557f5e8fbbf0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd39eff5640 0 client.17271 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:07.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/3789587527 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5e8f8730 0x557f5e8fb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd3c3c7a740 1 --2- 172.21.15.135:0/3789587527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5e8f7e10 0x557f5e8fb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3789587527 >> 172.21.15.135:0/3789587527 conn(0x557f5e8f2540 msgr2=0x557f5e8f16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:07.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3789587527 shutdown_connections 2024-04-20T12:28:07.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.126+0000 7fd3c3c7a740 1 -- 172.21.15.135:0/3789587527 wait complete. 2024-04-20T12:28:07.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.127+0000 7fd3c3c7a740 20 client.17271 trim_cache size 0 max 16384 2024-04-20T12:28:07.133 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:28:07.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.127+0000 7fd3c1081640 1 -- 172.21.15.135:0/885690435 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3a40a3d20 msgr2=0x7fd3a40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:07.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.127+0000 7fd3c1081640 1 --2- 172.21.15.135:0/885690435 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3a40a3d20 0x7fd3a40a61e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4010740 tx=0x7fd3b4017000 comp rx=0 tx=0).stop 2024-04-20T12:28:07.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.127+0000 7fd3c1081640 1 -- 172.21.15.135:0/885690435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3bc100d50 msgr2=0x7fd3bc1a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:07.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.127+0000 7fd3c1081640 1 --2- 172.21.15.135:0/885690435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3bc100d50 0x7fd3bc1a06b0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac005e30 tx=0x7fd3ac034760 comp rx=0 tx=0).stop 2024-04-20T12:28:07.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.127+0000 7fd3c1081640 1 -- 172.21.15.135:0/885690435 shutdown_connections 2024-04-20T12:28:07.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.127+0000 7fd3c1081640 1 --2- 172.21.15.135:0/885690435 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3bc10e900 0x7fd3bc19a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.127+0000 7fd3c1081640 1 --2- 172.21.15.135:0/885690435 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3a40a3d20 0x7fd3a40a61e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.127+0000 7fd3c1081640 1 --2- 172.21.15.135:0/885690435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3bc101670 0x7fd3bc1a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.127+0000 7fd3c1081640 1 --2- 172.21.15.135:0/885690435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3bc100d50 0x7fd3bc1a06b0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:07.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.127+0000 7fd3c1081640 1 -- 172.21.15.135:0/885690435 >> 172.21.15.135:0/885690435 conn(0x7fd3bc078010 msgr2=0x7fd3bc10fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:07.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.127+0000 7fd3c1081640 1 -- 172.21.15.135:0/885690435 shutdown_connections 2024-04-20T12:28:07.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:07.127+0000 7fd3c1081640 1 -- 172.21.15.135:0/885690435 wait complete. 2024-04-20T12:28:07.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:07 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2454924088' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:28:07.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:07 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2454924088' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:28:07.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:07 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2454924088' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:28:08.138 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:28:08.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:28:08.138 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:28:08.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.253+0000 7ff53e83a640 1 -- 172.21.15.135:0/3766797687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5381031c0 msgr2=0x7ff5381035a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.253+0000 7ff53e83a640 1 --2- 172.21.15.135:0/3766797687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5381031c0 0x7ff5381035a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff528009900 tx=0x7ff52802bcd0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.253+0000 7ff53e83a640 1 -- 172.21.15.135:0/3766797687 shutdown_connections 2024-04-20T12:28:08.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.253+0000 7ff53e83a640 1 --2- 172.21.15.135:0/3766797687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff53810c590 0x7ff53810e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.253+0000 7ff53e83a640 1 --2- 172.21.15.135:0/3766797687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff538103ae0 0x7ff53810bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.253+0000 7ff53e83a640 1 --2- 172.21.15.135:0/3766797687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5381031c0 0x7ff5381035a0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.253+0000 7ff53e83a640 1 -- 172.21.15.135:0/3766797687 >> 172.21.15.135:0/3766797687 conn(0x7ff5380771e0 msgr2=0x7ff5380775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:08.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.253+0000 7ff53e83a640 1 -- 172.21.15.135:0/3766797687 shutdown_connections 2024-04-20T12:28:08.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.253+0000 7ff53e83a640 1 -- 172.21.15.135:0/3766797687 wait complete. 2024-04-20T12:28:08.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.254+0000 7ff53e83a640 1 Processor -- start 2024-04-20T12:28:08.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.254+0000 7ff53e83a640 1 -- start start 2024-04-20T12:28:08.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.254+0000 7ff53e83a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5381031c0 0x7ff53819e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.254+0000 7ff53e83a640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff538103ae0 0x7ff53819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.254+0000 7ff53e83a640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff53810c590 0x7ff5381986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.254+0000 7ff53e83a640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff538112310 con 0x7ff5381031c0 2024-04-20T12:28:08.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.254+0000 7ff53e83a640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff538112190 con 0x7ff53810c590 2024-04-20T12:28:08.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.254+0000 7ff53e83a640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff538112490 con 0x7ff538103ae0 2024-04-20T12:28:08.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.254+0000 7ff537fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5381031c0 0x7ff53819e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.254+0000 7ff537fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5381031c0 0x7ff53819e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38006/0 (socket says 172.21.15.135:38006) 2024-04-20T12:28:08.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.254+0000 7ff537fff640 1 -- 172.21.15.135:0/4094649248 learned_addr learned my addr 172.21.15.135:0/4094649248 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:08.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.254+0000 7ff53cdd7640 1 --2- 172.21.15.135:0/4094649248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff53810c590 0x7ff5381986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.254+0000 7ff5377fe640 1 --2- 172.21.15.135:0/4094649248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff538103ae0 0x7ff53819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.255+0000 7ff537fff640 1 -- 172.21.15.135:0/4094649248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff538103ae0 msgr2=0x7ff53819eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.255+0000 7ff537fff640 1 --2- 172.21.15.135:0/4094649248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff538103ae0 0x7ff53819eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.255+0000 7ff537fff640 1 -- 172.21.15.135:0/4094649248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff53810c590 msgr2=0x7ff5381986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.255+0000 7ff537fff640 1 --2- 172.21.15.135:0/4094649248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff53810c590 0x7ff5381986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.255+0000 7ff537fff640 1 -- 172.21.15.135:0/4094649248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff538198f70 con 0x7ff5381031c0 2024-04-20T12:28:08.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.255+0000 7ff537fff640 1 --2- 172.21.15.135:0/4094649248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5381031c0 0x7ff53819e5f0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff528005940 tx=0x7ff52802cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:08.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.255+0000 7ff5357fa640 1 -- 172.21.15.135:0/4094649248 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528041070 con 0x7ff5381031c0 2024-04-20T12:28:08.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.255+0000 7ff53e83a640 1 -- 172.21.15.135:0/4094649248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff538199200 con 0x7ff5381031c0 2024-04-20T12:28:08.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.255+0000 7ff5357fa640 1 -- 172.21.15.135:0/4094649248 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff528004450 con 0x7ff5381031c0 2024-04-20T12:28:08.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.255+0000 7ff5357fa640 1 -- 172.21.15.135:0/4094649248 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528034440 con 0x7ff5381031c0 2024-04-20T12:28:08.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.255+0000 7ff53e83a640 1 -- 172.21.15.135:0/4094649248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5381a5390 con 0x7ff5381031c0 2024-04-20T12:28:08.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.257+0000 7ff5357fa640 1 -- 172.21.15.135:0/4094649248 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7ff528044070 con 0x7ff5381031c0 2024-04-20T12:28:08.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff541420740 1 Processor -- start 2024-04-20T12:28:08.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff5357fa640 1 --2- 172.21.15.135:0/4094649248 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5200a3d20 0x7ff5200a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff541420740 1 -- start start 2024-04-20T12:28:08.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff541420740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc2864fe0 0x558bc28653c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff53cdd7640 1 --2- 172.21.15.135:0/4094649248 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5200a3d20 0x7ff5200a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff541420740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 0x558bc286dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff541420740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc286e4e0 0x558bc28708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff541420740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558bc27c9f00 con 0x558bc286e4e0 2024-04-20T12:28:08.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff541420740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558bc2767530 con 0x558bc2865900 2024-04-20T12:28:08.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff5357fa640 1 -- 172.21.15.135:0/4094649248 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff5280f26a0 con 0x7ff5381031c0 2024-04-20T12:28:08.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff541420740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558bc27c5ec0 con 0x558bc2864fe0 2024-04-20T12:28:08.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff53cdd7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc286e4e0 0x558bc28708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff53cdd7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc286e4e0 0x558bc28708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38012/0 (socket says 172.21.15.135:38012) 2024-04-20T12:28:08.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff53cdd7640 1 -- 172.21.15.135:0/811613773 learned_addr learned my addr 172.21.15.135:0/811613773 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:08.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff537fff640 1 --2- 172.21.15.135:0/811613773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc2864fe0 0x558bc28653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff5377fe640 1 --2- 172.21.15.135:0/811613773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 0x558bc286dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff53cdd7640 1 --2- 172.21.15.135:0/4094649248 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5200a3d20 0x7ff5200a61e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff530013750 tx=0x7ff530013b50 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:08.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff53cdd7640 1 -- 172.21.15.135:0/811613773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc2864fe0 msgr2=0x558bc28653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff53cdd7640 1 --2- 172.21.15.135:0/811613773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc2864fe0 0x558bc28653c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff53cdd7640 1 -- 172.21.15.135:0/811613773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 msgr2=0x558bc286dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff53cdd7640 1 --2- 172.21.15.135:0/811613773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 0x558bc286dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.258+0000 7ff53cdd7640 1 -- 172.21.15.135:0/811613773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc25a47e0 con 0x558bc286e4e0 2024-04-20T12:28:08.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.259+0000 7ff53cdd7640 1 --2- 172.21.15.135:0/811613773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc286e4e0 0x558bc28708d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff530011b10 tx=0x7ff53001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb82e77e10502822 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:08.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.259+0000 7ff51e7fc640 1 -- 172.21.15.135:0/811613773 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530013250 con 0x558bc286e4e0 2024-04-20T12:28:08.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.259+0000 7ff51e7fc640 1 -- 172.21.15.135:0/811613773 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff530024070 con 0x558bc286e4e0 2024-04-20T12:28:08.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.259+0000 7ff51e7fc640 1 -- 172.21.15.135:0/811613773 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530012ab0 con 0x558bc286e4e0 2024-04-20T12:28:08.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.259+0000 7ff541420740 1 -- 172.21.15.135:0/811613773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc286e4e0 msgr2=0x558bc28708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.259+0000 7ff541420740 1 --2- 172.21.15.135:0/811613773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc286e4e0 0x558bc28708d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff530011b10 tx=0x7ff53001d000 comp rx=0 tx=0).stop 2024-04-20T12:28:08.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.259+0000 7ff541420740 1 -- 172.21.15.135:0/811613773 shutdown_connections 2024-04-20T12:28:08.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.259+0000 7ff541420740 1 --2- 172.21.15.135:0/811613773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc286e4e0 0x558bc28708d0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.259+0000 7ff541420740 1 --2- 172.21.15.135:0/811613773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 0x558bc286dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.259+0000 7ff541420740 1 --2- 172.21.15.135:0/811613773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc2864fe0 0x558bc28653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.259+0000 7ff541420740 1 -- 172.21.15.135:0/811613773 >> 172.21.15.135:0/811613773 conn(0x558bc285f710 msgr2=0x558bc285faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:08.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.260+0000 7ff541420740 1 -- 172.21.15.135:0/811613773 shutdown_connections 2024-04-20T12:28:08.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.260+0000 7ff541420740 1 -- 172.21.15.135:0/811613773 wait complete. 2024-04-20T12:28:08.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.260+0000 7ff541420740 1 -- start start 2024-04-20T12:28:08.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.260+0000 7ff541420740 1 Processor -- start 2024-04-20T12:28:08.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.260+0000 7ff541420740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2864fe0 0x558bc286de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.260+0000 7ff541420740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 0x558bc286b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.260+0000 7ff541420740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc286e4e0 0x558bc286b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.260+0000 7ff541420740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558bc2871270 con 0x558bc2864fe0 2024-04-20T12:28:08.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.260+0000 7ff541420740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558bc2752480 con 0x558bc2865900 2024-04-20T12:28:08.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.260+0000 7ff541420740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558bc28713f0 con 0x558bc286e4e0 2024-04-20T12:28:08.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.260+0000 7ff541420740 10 client.0 _ll_register_callbacks cb 0x558bc2751e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:08.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.260+0000 7ff537fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2864fe0 0x558bc286de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.260+0000 7ff537fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2864fe0 0x558bc286de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38022/0 (socket says 172.21.15.135:38022) 2024-04-20T12:28:08.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.260+0000 7ff537fff640 1 -- 172.21.15.135:0/3045414092 learned_addr learned my addr 172.21.15.135:0/3045414092 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:08.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff53cdd7640 1 --2- 172.21.15.135:0/3045414092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc286e4e0 0x558bc286b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff5377fe640 1 --2- 172.21.15.135:0/3045414092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 0x558bc286b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff537fff640 1 -- 172.21.15.135:0/3045414092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc286e4e0 msgr2=0x558bc286b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff537fff640 1 --2- 172.21.15.135:0/3045414092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc286e4e0 0x558bc286b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff537fff640 1 -- 172.21.15.135:0/3045414092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 msgr2=0x558bc286b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff537fff640 1 --2- 172.21.15.135:0/3045414092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 0x558bc286b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff537fff640 1 -- 172.21.15.135:0/3045414092 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bc2604f70 con 0x558bc2864fe0 2024-04-20T12:28:08.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff537fff640 1 --2- 172.21.15.135:0/3045414092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2864fe0 0x558bc286de80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff528006010 tx=0x7ff5280be2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878dcab53db98de8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:08.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff5177fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:08.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff5177fe640 1 -- 172.21.15.135:0/3045414092 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52804b040 con 0x558bc2864fe0 2024-04-20T12:28:08.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff5177fe640 1 -- 172.21.15.135:0/3045414092 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff5280f22d0 con 0x558bc2864fe0 2024-04-20T12:28:08.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff541420740 1 -- 172.21.15.135:0/3045414092 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff530024070 con 0x558bc2864fe0 2024-04-20T12:28:08.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff5177fe640 1 -- 172.21.15.135:0/3045414092 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff5280f24d0 con 0x558bc2864fe0 2024-04-20T12:28:08.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff541420740 10 client.17283 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:08.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff541420740 1 -- 172.21.15.135:0/3045414092 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558bc249c170 con 0x558bc2864fe0 2024-04-20T12:28:08.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff5177fe640 1 -- 172.21.15.135:0/3045414092 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff530024070 con 0x558bc2864fe0 2024-04-20T12:28:08.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.261+0000 7ff5177fe640 1 -- 172.21.15.135:0/3045414092 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7ff5280c6bb0 con 0x558bc2864fe0 2024-04-20T12:28:08.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.262+0000 7ff541420740 10 client.17283 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:08.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.262+0000 7ff541420740 10 client.17283 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:08.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.262+0000 7ff541420740 20 client.17283 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:08.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.262+0000 7ff541420740 1 --2- 172.21.15.135:0/3045414092 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558bc287e4c0 0x558bc28808b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.262+0000 7ff541420740 4 client.17283 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:08.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.262+0000 7ff541420740 1 -- 172.21.15.135:0/3045414092 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bc27d7920 con 0x558bc287e4c0 2024-04-20T12:28:08.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.262+0000 7ff5377fe640 1 --2- 172.21.15.135:0/3045414092 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558bc287e4c0 0x558bc28808b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.262+0000 7ff5177fe640 10 client.17283 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:08.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.262+0000 7ff5377fe640 1 --2- 172.21.15.135:0/3045414092 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558bc287e4c0 0x558bc28808b0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6453ab11d0bb16b6 server_cookie=74052290aa2dae85 in_seq=0 out_seq=0 2024-04-20T12:28:08.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.263+0000 7ff5177fe640 1 -- 172.21.15.135:0/3045414092 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558bc27d7920 con 0x558bc287e4c0 2024-04-20T12:28:08.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.263+0000 7ff5177fe640 10 client.17283 handle_command_reply: tid=0 2024-04-20T12:28:08.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.263+0000 7ff541420740 1 client.17283 shutdown 2024-04-20T12:28:08.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.263+0000 7ff541420740 1 -- 172.21.15.135:0/3045414092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2864fe0 msgr2=0x558bc286de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.263+0000 7ff541420740 1 --2- 172.21.15.135:0/3045414092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2864fe0 0x558bc286de80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff528006010 tx=0x7ff5280be2c0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.263+0000 7ff541420740 1 -- 172.21.15.135:0/3045414092 shutdown_connections 2024-04-20T12:28:08.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.263+0000 7ff541420740 1 --2- 172.21.15.135:0/3045414092 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558bc287e4c0 0x558bc28808b0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.263+0000 7ff541420740 1 --2- 172.21.15.135:0/3045414092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc286e4e0 0x558bc286b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.263+0000 7ff5177fe640 0 client.17283 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:08.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.263+0000 7ff541420740 1 --2- 172.21.15.135:0/3045414092 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 0x558bc286b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.263+0000 7ff541420740 1 --2- 172.21.15.135:0/3045414092 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2864fe0 0x558bc286de80 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.263+0000 7ff541420740 1 -- 172.21.15.135:0/3045414092 >> 172.21.15.135:0/3045414092 conn(0x558bc285f710 msgr2=0x558bc2861460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:08.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.263+0000 7ff541420740 1 -- 172.21.15.135:0/3045414092 shutdown_connections 2024-04-20T12:28:08.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.263+0000 7ff541420740 1 -- 172.21.15.135:0/3045414092 wait complete. 2024-04-20T12:28:08.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.263+0000 7ff541420740 20 client.17283 trim_cache size 0 max 16384 2024-04-20T12:28:08.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.280+0000 7ff541420740 1 Processor -- start 2024-04-20T12:28:08.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff541420740 1 -- start start 2024-04-20T12:28:08.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff541420740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2864fe0 0x558bc286d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff541420740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 0x558bc286de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff541420740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc286e4e0 0x558bc2861160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff541420740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff5381af2e0 con 0x558bc2864fe0 2024-04-20T12:28:08.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff541420740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff5381b0e20 con 0x558bc2865900 2024-04-20T12:28:08.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff541420740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5381af9b0 con 0x558bc286e4e0 2024-04-20T12:28:08.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff537fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2864fe0 0x558bc286d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff537fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2864fe0 0x558bc286d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38030/0 (socket says 172.21.15.135:38030) 2024-04-20T12:28:08.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff537fff640 1 -- 172.21.15.135:0/2088702826 learned_addr learned my addr 172.21.15.135:0/2088702826 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:08.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff5377fe640 1 --2- 172.21.15.135:0/2088702826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 0x558bc286de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff53cdd7640 1 --2- 172.21.15.135:0/2088702826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc286e4e0 0x558bc2861160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff537fff640 1 -- 172.21.15.135:0/2088702826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc286e4e0 msgr2=0x558bc2861160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff537fff640 1 --2- 172.21.15.135:0/2088702826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc286e4e0 0x558bc2861160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff537fff640 1 -- 172.21.15.135:0/2088702826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 msgr2=0x558bc286de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff537fff640 1 --2- 172.21.15.135:0/2088702826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 0x558bc286de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff537fff640 1 -- 172.21.15.135:0/2088702826 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bc286bb20 con 0x558bc2864fe0 2024-04-20T12:28:08.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff5377fe640 1 --2- 172.21.15.135:0/2088702826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 0x558bc286de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:08.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff537fff640 1 --2- 172.21.15.135:0/2088702826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2864fe0 0x558bc286d940 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff5280be0d0 tx=0x7ff528003990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3168c3d1e47dc6af server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:08.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff51dffb640 1 -- 172.21.15.135:0/2088702826 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52804b070 con 0x558bc2864fe0 2024-04-20T12:28:08.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff51dffb640 1 -- 172.21.15.135:0/2088702826 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5280c2780 con 0x558bc2864fe0 2024-04-20T12:28:08.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.281+0000 7ff51dffb640 1 -- 172.21.15.135:0/2088702826 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5280d7b50 con 0x558bc2864fe0 2024-04-20T12:28:08.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.282+0000 7ff541420740 1 -- 172.21.15.135:0/2088702826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2864fe0 msgr2=0x558bc286d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.282+0000 7ff541420740 1 --2- 172.21.15.135:0/2088702826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2864fe0 0x558bc286d940 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff5280be0d0 tx=0x7ff528003990 comp rx=0 tx=0).stop 2024-04-20T12:28:08.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.282+0000 7ff541420740 1 -- 172.21.15.135:0/2088702826 shutdown_connections 2024-04-20T12:28:08.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.282+0000 7ff541420740 1 --2- 172.21.15.135:0/2088702826 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc286e4e0 0x558bc2861160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.282+0000 7ff541420740 1 --2- 172.21.15.135:0/2088702826 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc2865900 0x558bc286de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.282+0000 7ff541420740 1 --2- 172.21.15.135:0/2088702826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2864fe0 0x558bc286d940 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.282+0000 7ff541420740 1 -- 172.21.15.135:0/2088702826 >> 172.21.15.135:0/2088702826 conn(0x558bc285f710 msgr2=0x558bc2860a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:08.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.282+0000 7ff541420740 1 -- 172.21.15.135:0/2088702826 shutdown_connections 2024-04-20T12:28:08.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.282+0000 7ff541420740 1 -- 172.21.15.135:0/2088702826 wait complete. 2024-04-20T12:28:08.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.282+0000 7ff541420740 1 -- start start 2024-04-20T12:28:08.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff541420740 1 Processor -- start 2024-04-20T12:28:08.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff541420740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc2864fe0 0x558bc28727c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff541420740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2865900 0x558bc2872d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff541420740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc286e4e0 0x558bc28e7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff541420740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff5381b0750 con 0x558bc2865900 2024-04-20T12:28:08.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff541420740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff5381b0080 con 0x558bc286e4e0 2024-04-20T12:28:08.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff541420740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5381ad2b0 con 0x558bc2864fe0 2024-04-20T12:28:08.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff541420740 10 client.0 _ll_register_callbacks cb 0x7ff5280ba720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:08.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff5377fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2865900 0x558bc2872d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff5377fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2865900 0x558bc2872d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38036/0 (socket says 172.21.15.135:38036) 2024-04-20T12:28:08.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff5377fe640 1 -- 172.21.15.135:0/400306756 learned_addr learned my addr 172.21.15.135:0/400306756 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:08.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff537fff640 1 --2- 172.21.15.135:0/400306756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc2864fe0 0x558bc28727c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff53cdd7640 1 --2- 172.21.15.135:0/400306756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc286e4e0 0x558bc28e7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff5377fe640 1 -- 172.21.15.135:0/400306756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc2864fe0 msgr2=0x558bc28727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff5377fe640 1 --2- 172.21.15.135:0/400306756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc2864fe0 0x558bc28727c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff5377fe640 1 -- 172.21.15.135:0/400306756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc286e4e0 msgr2=0x558bc28e7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff5377fe640 1 --2- 172.21.15.135:0/400306756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc286e4e0 0x558bc28e7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff5377fe640 1 -- 172.21.15.135:0/400306756 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bc28e8350 con 0x558bc2865900 2024-04-20T12:28:08.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff5377fe640 1 --2- 172.21.15.135:0/400306756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2865900 0x558bc2872d00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x558bc2864ab0 tx=0x7ff52c004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81072e4af8c5d0ed server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:08.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff5177fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:08.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff5177fe640 1 -- 172.21.15.135:0/400306756 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0037f0 con 0x558bc2865900 2024-04-20T12:28:08.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff5177fe640 1 -- 172.21.15.135:0/400306756 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff52c003990 con 0x558bc2865900 2024-04-20T12:28:08.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.283+0000 7ff541420740 1 -- 172.21.15.135:0/400306756 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5280c2780 con 0x558bc2865900 2024-04-20T12:28:08.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.284+0000 7ff5177fe640 1 -- 172.21.15.135:0/400306756 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff52c02d050 con 0x558bc2865900 2024-04-20T12:28:08.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.284+0000 7ff541420740 10 client.17289 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:08.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.284+0000 7ff541420740 1 -- 172.21.15.135:0/400306756 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558bc28e96f0 con 0x558bc2865900 2024-04-20T12:28:08.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.284+0000 7ff5177fe640 1 -- 172.21.15.135:0/400306756 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5280c2780 con 0x558bc2865900 2024-04-20T12:28:08.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.284+0000 7ff5177fe640 1 -- 172.21.15.135:0/400306756 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7ff52c025420 con 0x558bc2865900 2024-04-20T12:28:08.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.284+0000 7ff541420740 10 client.17289 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:08.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.284+0000 7ff541420740 10 client.17289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:08.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.284+0000 7ff541420740 20 client.17289 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:08.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.284+0000 7ff541420740 1 --2- 172.21.15.135:0/400306756 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558bc28e9ef0 0x558bc28ec310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.284+0000 7ff541420740 4 client.17289 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:28:08.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.284+0000 7ff541420740 1 -- 172.21.15.135:0/400306756 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558bc27d1790 con 0x558bc28e9ef0 2024-04-20T12:28:08.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.284+0000 7ff537fff640 1 --2- 172.21.15.135:0/400306756 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558bc28e9ef0 0x558bc28ec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.285+0000 7ff537fff640 1 --2- 172.21.15.135:0/400306756 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558bc28e9ef0 0x558bc28ec310 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=865e3b068f73b8c0 server_cookie=3a54688b8de659f4 in_seq=0 out_seq=0 2024-04-20T12:28:08.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.285+0000 7ff5177fe640 10 client.17289 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:08.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.286+0000 7ff5177fe640 1 -- 172.21.15.135:0/400306756 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558bc27d1790 con 0x558bc28e9ef0 2024-04-20T12:28:08.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.286+0000 7ff5177fe640 10 client.17289 handle_command_reply: tid=0 2024-04-20T12:28:08.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.286+0000 7ff541420740 1 client.17289 shutdown 2024-04-20T12:28:08.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.286+0000 7ff541420740 1 -- 172.21.15.135:0/400306756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2865900 msgr2=0x558bc2872d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.286+0000 7ff541420740 1 --2- 172.21.15.135:0/400306756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2865900 0x558bc2872d00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x558bc2864ab0 tx=0x7ff52c004410 comp rx=0 tx=0).stop 2024-04-20T12:28:08.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.286+0000 7ff541420740 1 -- 172.21.15.135:0/400306756 shutdown_connections 2024-04-20T12:28:08.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.286+0000 7ff541420740 1 --2- 172.21.15.135:0/400306756 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x558bc28e9ef0 0x558bc28ec310 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.286+0000 7ff541420740 1 --2- 172.21.15.135:0/400306756 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558bc286e4e0 0x558bc28e7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.286+0000 7ff541420740 1 --2- 172.21.15.135:0/400306756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558bc2865900 0x558bc2872d00 secure :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x558bc2864ab0 tx=0x7ff52c004410 comp rx=0 tx=0).stop 2024-04-20T12:28:08.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.286+0000 7ff541420740 1 --2- 172.21.15.135:0/400306756 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558bc2864fe0 0x558bc28727c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.286+0000 7ff541420740 1 -- 172.21.15.135:0/400306756 >> 172.21.15.135:0/400306756 conn(0x558bc285f710 msgr2=0x558bc2866570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:08.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.286+0000 7ff5177fe640 0 client.17289 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:08.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.286+0000 7ff541420740 1 -- 172.21.15.135:0/400306756 shutdown_connections 2024-04-20T12:28:08.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.286+0000 7ff541420740 1 -- 172.21.15.135:0/400306756 wait complete. 2024-04-20T12:28:08.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.286+0000 7ff541420740 20 client.17289 trim_cache size 0 max 16384 2024-04-20T12:28:08.294 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:28:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:28:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "08746625-896e-4821-af6a-5e15dc55244f", 2024-04-20T12:28:08.294 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:28:08.295 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:28:08.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.287+0000 7ff53e83a640 1 -- 172.21.15.135:0/4094649248 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5200a3d20 msgr2=0x7ff5200a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.287+0000 7ff53e83a640 1 --2- 172.21.15.135:0/4094649248 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5200a3d20 0x7ff5200a61e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff530013750 tx=0x7ff530013b50 comp rx=0 tx=0).stop 2024-04-20T12:28:08.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.287+0000 7ff53e83a640 1 -- 172.21.15.135:0/4094649248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5381031c0 msgr2=0x7ff53819e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.287+0000 7ff53e83a640 1 --2- 172.21.15.135:0/4094649248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5381031c0 0x7ff53819e5f0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff528005940 tx=0x7ff52802cd10 comp rx=0 tx=0).stop 2024-04-20T12:28:08.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.287+0000 7ff53e83a640 1 -- 172.21.15.135:0/4094649248 shutdown_connections 2024-04-20T12:28:08.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.287+0000 7ff53e83a640 1 --2- 172.21.15.135:0/4094649248 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff53810c590 0x7ff5381986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.287+0000 7ff53e83a640 1 --2- 172.21.15.135:0/4094649248 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5200a3d20 0x7ff5200a61e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.287+0000 7ff53e83a640 1 --2- 172.21.15.135:0/4094649248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff538103ae0 0x7ff53819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.287+0000 7ff53e83a640 1 --2- 172.21.15.135:0/4094649248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5381031c0 0x7ff53819e5f0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.287+0000 7ff53e83a640 1 -- 172.21.15.135:0/4094649248 >> 172.21.15.135:0/4094649248 conn(0x7ff5380771e0 msgr2=0x7ff5380feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:08.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.287+0000 7ff53e83a640 1 -- 172.21.15.135:0/4094649248 shutdown_connections 2024-04-20T12:28:08.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.287+0000 7ff53e83a640 1 -- 172.21.15.135:0/4094649248 wait complete. 2024-04-20T12:28:08.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:28:08.298 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:28:08.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 -- 172.21.15.135:0/1311686987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c44106170 msgr2=0x7f6c4410dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 --2- 172.21.15.135:0/1311686987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c44106170 0x7f6c4410dd40 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009ca0 tx=0x7f6c3c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 -- 172.21.15.135:0/1311686987 shutdown_connections 2024-04-20T12:28:08.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 --2- 172.21.15.135:0/1311686987 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c44106170 0x7f6c4410dd40 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 --2- 172.21.15.135:0/1311686987 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c44101a50 0x7f6c44105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 --2- 172.21.15.135:0/1311686987 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c441010a0 0x7f6c44101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 -- 172.21.15.135:0/1311686987 >> 172.21.15.135:0/1311686987 conn(0x7f6c440771e0 msgr2=0x7f6c440775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:08.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 -- 172.21.15.135:0/1311686987 shutdown_connections 2024-04-20T12:28:08.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 -- 172.21.15.135:0/1311686987 wait complete. 2024-04-20T12:28:08.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 Processor -- start 2024-04-20T12:28:08.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 -- start start 2024-04-20T12:28:08.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c441010a0 0x7f6c4419e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c44106170 0x7f6c4419eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c44198670 0x7f6c44198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6c44111230 con 0x7f6c441010a0 2024-04-20T12:28:08.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6c441110b0 con 0x7f6c44106170 2024-04-20T12:28:08.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.402+0000 7f6c4ae55640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c441113b0 con 0x7f6c44198670 2024-04-20T12:28:08.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c48bf1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c441010a0 0x7f6c4419e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c48bf1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c441010a0 0x7f6c4419e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38064/0 (socket says 172.21.15.135:38064) 2024-04-20T12:28:08.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c48bf1640 1 -- 172.21.15.135:0/4123075652 learned_addr learned my addr 172.21.15.135:0/4123075652 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:08.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c43fff640 1 --2- 172.21.15.135:0/4123075652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c44106170 0x7f6c4419eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c493f2640 1 --2- 172.21.15.135:0/4123075652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c44198670 0x7f6c44198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c48bf1640 1 -- 172.21.15.135:0/4123075652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c44198670 msgr2=0x7f6c44198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c48bf1640 1 --2- 172.21.15.135:0/4123075652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c44198670 0x7f6c44198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c48bf1640 1 -- 172.21.15.135:0/4123075652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c44106170 msgr2=0x7f6c4419eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c48bf1640 1 --2- 172.21.15.135:0/4123075652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c44106170 0x7f6c4419eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c48bf1640 1 -- 172.21.15.135:0/4123075652 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c44199270 con 0x7f6c441010a0 2024-04-20T12:28:08.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c48bf1640 1 --2- 172.21.15.135:0/4123075652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c441010a0 0x7f6c4419e5b0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800d950 tx=0x7f6c3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:08.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c41ffb640 1 -- 172.21.15.135:0/4123075652 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38017070 con 0x7f6c441010a0 2024-04-20T12:28:08.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c41ffb640 1 -- 172.21.15.135:0/4123075652 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c38009c30 con 0x7f6c441010a0 2024-04-20T12:28:08.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c4ae55640 1 -- 172.21.15.135:0/4123075652 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c441a5350 con 0x7f6c441010a0 2024-04-20T12:28:08.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c41ffb640 1 -- 172.21.15.135:0/4123075652 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3800f6b0 con 0x7f6c441010a0 2024-04-20T12:28:08.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.403+0000 7f6c4ae55640 1 -- 172.21.15.135:0/4123075652 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c441a5750 con 0x7f6c441010a0 2024-04-20T12:28:08.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c41ffb640 1 -- 172.21.15.135:0/4123075652 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f6c380109d0 con 0x7f6c441010a0 2024-04-20T12:28:08.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c4da48740 1 Processor -- start 2024-04-20T12:28:08.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c4da48740 1 -- start start 2024-04-20T12:28:08.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c41ffb640 1 --2- 172.21.15.135:0/4123075652 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c340a3d20 0x7f6c340a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c4da48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739e0d20 0x5599739e1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c493f2640 1 --2- 172.21.15.135:0/4123075652 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c340a3d20 0x7f6c340a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c41ffb640 1 -- 172.21.15.135:0/4123075652 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f6c380d0700 con 0x7f6c441010a0 2024-04-20T12:28:08.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c4da48740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e1640 0x5599739e9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c4da48740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739ea220 0x5599739ec610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c4da48740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5599739461b0 con 0x5599739e1640 2024-04-20T12:28:08.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c4da48740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5599738e3390 con 0x5599739ea220 2024-04-20T12:28:08.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c4da48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559973942170 con 0x5599739e0d20 2024-04-20T12:28:08.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c43fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e1640 0x5599739e9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c43fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e1640 0x5599739e9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38080/0 (socket says 172.21.15.135:38080) 2024-04-20T12:28:08.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c43fff640 1 -- 172.21.15.135:0/173058614 learned_addr learned my addr 172.21.15.135:0/173058614 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:08.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.406+0000 7f6c48bf1640 1 --2- 172.21.15.135:0/173058614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739e0d20 0x5599739e1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.407+0000 7f6c493f2640 1 --2- 172.21.15.135:0/173058614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739ea220 0x5599739ec610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.407+0000 7f6c43fff640 1 -- 172.21.15.135:0/173058614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739e0d20 msgr2=0x5599739e1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.407+0000 7f6c43fff640 1 --2- 172.21.15.135:0/173058614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739e0d20 0x5599739e1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.407+0000 7f6c43fff640 1 -- 172.21.15.135:0/173058614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739ea220 msgr2=0x5599739ec610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.407+0000 7f6c43fff640 1 --2- 172.21.15.135:0/173058614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739ea220 0x5599739ec610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.407+0000 7f6c493f2640 1 --2- 172.21.15.135:0/4123075652 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c340a3d20 0x7f6c340a61e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c005e30 tx=0x7f6c3c032340 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:08.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.407+0000 7f6c43fff640 1 -- 172.21.15.135:0/173058614 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599737227d0 con 0x5599739e1640 2024-04-20T12:28:08.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.407+0000 7f6c48bf1640 1 --2- 172.21.15.135:0/173058614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739e0d20 0x5599739e1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:28:08.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.407+0000 7f6c43fff640 1 --2- 172.21.15.135:0/173058614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e1640 0x5599739e9ce0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f6c30004620 tx=0x7f6c3000bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6d1b9740ac0559 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:08.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.407+0000 7f6c2effd640 1 -- 172.21.15.135:0/173058614 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30003ba0 con 0x5599739e1640 2024-04-20T12:28:08.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.407+0000 7f6c2effd640 1 -- 172.21.15.135:0/173058614 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c30015070 con 0x5599739e1640 2024-04-20T12:28:08.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.407+0000 7f6c2effd640 1 -- 172.21.15.135:0/173058614 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30004d70 con 0x5599739e1640 2024-04-20T12:28:08.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.408+0000 7f6c4da48740 1 -- 172.21.15.135:0/173058614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e1640 msgr2=0x5599739e9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.408+0000 7f6c4da48740 1 --2- 172.21.15.135:0/173058614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e1640 0x5599739e9ce0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f6c30004620 tx=0x7f6c3000bb20 comp rx=0 tx=0).stop 2024-04-20T12:28:08.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.408+0000 7f6c4da48740 1 -- 172.21.15.135:0/173058614 shutdown_connections 2024-04-20T12:28:08.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.408+0000 7f6c4da48740 1 --2- 172.21.15.135:0/173058614 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739ea220 0x5599739ec610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.408+0000 7f6c4da48740 1 --2- 172.21.15.135:0/173058614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e1640 0x5599739e9ce0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.408+0000 7f6c4da48740 1 --2- 172.21.15.135:0/173058614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739e0d20 0x5599739e1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.408+0000 7f6c4da48740 1 -- 172.21.15.135:0/173058614 >> 172.21.15.135:0/173058614 conn(0x5599739db450 msgr2=0x5599739db830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:08.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.408+0000 7f6c4da48740 1 -- 172.21.15.135:0/173058614 shutdown_connections 2024-04-20T12:28:08.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.408+0000 7f6c4da48740 1 -- 172.21.15.135:0/173058614 wait complete. 2024-04-20T12:28:08.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.408+0000 7f6c4da48740 1 -- start start 2024-04-20T12:28:08.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.408+0000 7f6c4da48740 1 Processor -- start 2024-04-20T12:28:08.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c4da48740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e0d20 0x5599739e7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c4da48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739e1640 0x5599739e77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c4da48740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739ea220 0x5599739e7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c4da48740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5599739ed010 con 0x5599739e0d20 2024-04-20T12:28:08.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c4da48740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5599738ff2f0 con 0x5599739ea220 2024-04-20T12:28:08.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c4da48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5599739ed190 con 0x5599739e1640 2024-04-20T12:28:08.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c4da48740 10 client.0 _ll_register_callbacks cb 0x5599738c94e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:08.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c48bf1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e0d20 0x5599739e7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c48bf1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e0d20 0x5599739e7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38082/0 (socket says 172.21.15.135:38082) 2024-04-20T12:28:08.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c48bf1640 1 -- 172.21.15.135:0/3957850629 learned_addr learned my addr 172.21.15.135:0/3957850629 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:08.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c43fff640 1 --2- 172.21.15.135:0/3957850629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739e1640 0x5599739e77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c493f2640 1 --2- 172.21.15.135:0/3957850629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739ea220 0x5599739e7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c48bf1640 1 -- 172.21.15.135:0/3957850629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739e1640 msgr2=0x5599739e77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c48bf1640 1 --2- 172.21.15.135:0/3957850629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739e1640 0x5599739e77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c48bf1640 1 -- 172.21.15.135:0/3957850629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739ea220 msgr2=0x5599739e7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c48bf1640 1 --2- 172.21.15.135:0/3957850629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739ea220 0x5599739e7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c48bf1640 1 -- 172.21.15.135:0/3957850629 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599736583f0 con 0x5599739e0d20 2024-04-20T12:28:08.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c48bf1640 1 --2- 172.21.15.135:0/3957850629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e0d20 0x5599739e7290 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f6c380cdb30 tx=0x7f6c38009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dd002288f45b9c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:08.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c23fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:08.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c23fff640 1 -- 172.21.15.135:0/3957850629 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38020040 con 0x5599739e0d20 2024-04-20T12:28:08.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c23fff640 1 -- 172.21.15.135:0/3957850629 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f6c380d0340 con 0x5599739e0d20 2024-04-20T12:28:08.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c4da48740 1 -- 172.21.15.135:0/3957850629 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c30015070 con 0x5599739e0d20 2024-04-20T12:28:08.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c23fff640 1 -- 172.21.15.135:0/3957850629 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6c380d0540 con 0x5599739e0d20 2024-04-20T12:28:08.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c4da48740 10 client.17301 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:08.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.409+0000 7f6c4da48740 1 -- 172.21.15.135:0/3957850629 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5599736180f0 con 0x5599739e0d20 2024-04-20T12:28:08.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.410+0000 7f6c23fff640 1 -- 172.21.15.135:0/3957850629 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c30015070 con 0x5599739e0d20 2024-04-20T12:28:08.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.410+0000 7f6c23fff640 1 -- 172.21.15.135:0/3957850629 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f6c38098120 con 0x5599739e0d20 2024-04-20T12:28:08.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.410+0000 7f6c4da48740 10 client.17301 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:08.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.410+0000 7f6c4da48740 10 client.17301 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:08.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.410+0000 7f6c4da48740 20 client.17301 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:08.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.410+0000 7f6c4da48740 1 --2- 172.21.15.135:0/3957850629 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5599739fa5d0 0x5599739fca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.410+0000 7f6c4da48740 4 client.17301 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:08.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.410+0000 7f6c4da48740 1 -- 172.21.15.135:0/3957850629 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559973953bd0 con 0x5599739fa5d0 2024-04-20T12:28:08.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.410+0000 7f6c43fff640 1 --2- 172.21.15.135:0/3957850629 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5599739fa5d0 0x5599739fca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.411+0000 7f6c43fff640 1 --2- 172.21.15.135:0/3957850629 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5599739fa5d0 0x5599739fca20 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca11044d1e220504 server_cookie=a991864e7bcdb951 in_seq=0 out_seq=0 2024-04-20T12:28:08.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.411+0000 7f6c23fff640 10 client.17301 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:08.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.411+0000 7f6c23fff640 1 -- 172.21.15.135:0/3957850629 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559973953bd0 con 0x5599739fa5d0 2024-04-20T12:28:08.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.411+0000 7f6c23fff640 10 client.17301 handle_command_reply: tid=0 2024-04-20T12:28:08.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.411+0000 7f6c4da48740 1 client.17301 shutdown 2024-04-20T12:28:08.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.411+0000 7f6c4da48740 1 -- 172.21.15.135:0/3957850629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e0d20 msgr2=0x5599739e7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.411+0000 7f6c4da48740 1 --2- 172.21.15.135:0/3957850629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e0d20 0x5599739e7290 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f6c380cdb30 tx=0x7f6c38009f50 comp rx=0 tx=0).stop 2024-04-20T12:28:08.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.411+0000 7f6c4da48740 1 -- 172.21.15.135:0/3957850629 shutdown_connections 2024-04-20T12:28:08.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.411+0000 7f6c4da48740 1 --2- 172.21.15.135:0/3957850629 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5599739fa5d0 0x5599739fca20 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.411+0000 7f6c4da48740 1 --2- 172.21.15.135:0/3957850629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739ea220 0x5599739e7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.411+0000 7f6c4da48740 1 --2- 172.21.15.135:0/3957850629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739e1640 0x5599739e77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.411+0000 7f6c23fff640 0 client.17301 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:08.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.411+0000 7f6c4da48740 1 --2- 172.21.15.135:0/3957850629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e0d20 0x5599739e7290 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.411+0000 7f6c4da48740 1 -- 172.21.15.135:0/3957850629 >> 172.21.15.135:0/3957850629 conn(0x5599739db450 msgr2=0x5599739dd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:08.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.412+0000 7f6c4da48740 1 -- 172.21.15.135:0/3957850629 shutdown_connections 2024-04-20T12:28:08.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.412+0000 7f6c4da48740 1 -- 172.21.15.135:0/3957850629 wait complete. 2024-04-20T12:28:08.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.412+0000 7f6c4da48740 20 client.17301 trim_cache size 0 max 16384 2024-04-20T12:28:08.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.428+0000 7f6c4da48740 1 Processor -- start 2024-04-20T12:28:08.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.428+0000 7f6c4da48740 1 -- start start 2024-04-20T12:28:08.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.428+0000 7f6c4da48740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e0d20 0x5599739f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.428+0000 7f6c4da48740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739e1640 0x5599739e7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.428+0000 7f6c4da48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739ea220 0x5599739da4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.428+0000 7f6c4da48740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6c441af3c0 con 0x5599739e0d20 2024-04-20T12:28:08.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.428+0000 7f6c4da48740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6c441b0f00 con 0x5599739e1640 2024-04-20T12:28:08.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.428+0000 7f6c4da48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c441afa90 con 0x5599739ea220 2024-04-20T12:28:08.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.429+0000 7f6c48bf1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e0d20 0x5599739f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.434 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.429+0000 7f6c48bf1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e0d20 0x5599739f5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38084/0 (socket says 172.21.15.135:38084) 2024-04-20T12:28:08.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.429+0000 7f6c48bf1640 1 -- 172.21.15.135:0/3035900599 learned_addr learned my addr 172.21.15.135:0/3035900599 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:08.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.429+0000 7f6c493f2640 1 --2- 172.21.15.135:0/3035900599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739ea220 0x5599739da4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.429+0000 7f6c43fff640 1 --2- 172.21.15.135:0/3035900599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739e1640 0x5599739e7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.429+0000 7f6c48bf1640 1 -- 172.21.15.135:0/3035900599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739ea220 msgr2=0x5599739da4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.429+0000 7f6c48bf1640 1 --2- 172.21.15.135:0/3035900599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739ea220 0x5599739da4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.429+0000 7f6c48bf1640 1 -- 172.21.15.135:0/3035900599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739e1640 msgr2=0x5599739e7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.429+0000 7f6c48bf1640 1 --2- 172.21.15.135:0/3035900599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739e1640 0x5599739e7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.429+0000 7f6c48bf1640 1 -- 172.21.15.135:0/3035900599 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599739d6d10 con 0x5599739e0d20 2024-04-20T12:28:08.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.429+0000 7f6c43fff640 1 --2- 172.21.15.135:0/3035900599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739e1640 0x5599739e7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:08.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.429+0000 7f6c48bf1640 1 --2- 172.21.15.135:0/3035900599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e0d20 0x5599739f5f00 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f6c380987e0 tx=0x7f6c38010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbd1f22559c7643 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:08.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.429+0000 7f6c2e7fc640 1 -- 172.21.15.135:0/3035900599 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c380ba070 con 0x5599739e0d20 2024-04-20T12:28:08.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.429+0000 7f6c2e7fc640 1 -- 172.21.15.135:0/3035900599 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c38098a40 con 0x5599739e0d20 2024-04-20T12:28:08.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.429+0000 7f6c2e7fc640 1 -- 172.21.15.135:0/3035900599 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38020070 con 0x5599739e0d20 2024-04-20T12:28:08.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.430+0000 7f6c4da48740 1 -- 172.21.15.135:0/3035900599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e0d20 msgr2=0x5599739f5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.435 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.430+0000 7f6c4da48740 1 --2- 172.21.15.135:0/3035900599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e0d20 0x5599739f5f00 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f6c380987e0 tx=0x7f6c38010d70 comp rx=0 tx=0).stop 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.430+0000 7f6c4da48740 1 -- 172.21.15.135:0/3035900599 shutdown_connections 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.430+0000 7f6c4da48740 1 --2- 172.21.15.135:0/3035900599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739ea220 0x5599739da4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.430+0000 7f6c4da48740 1 --2- 172.21.15.135:0/3035900599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739e1640 0x5599739e7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.430+0000 7f6c4da48740 1 --2- 172.21.15.135:0/3035900599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e0d20 0x5599739f5f00 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.430+0000 7f6c4da48740 1 -- 172.21.15.135:0/3035900599 >> 172.21.15.135:0/3035900599 conn(0x5599739db450 msgr2=0x5599739d9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.430+0000 7f6c4da48740 1 -- 172.21.15.135:0/3035900599 shutdown_connections 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.430+0000 7f6c4da48740 1 -- 172.21.15.135:0/3035900599 wait complete. 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.430+0000 7f6c4da48740 1 -- start start 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.430+0000 7f6c4da48740 1 Processor -- start 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.430+0000 7f6c4da48740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739e0d20 0x559973a57f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.430+0000 7f6c4da48740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e1640 0x559973a58460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.430+0000 7f6c4da48740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739ea220 0x5599739ef660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c4da48740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6c441b0830 con 0x5599739e1640 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c4da48740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6c441b0160 con 0x5599739e0d20 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c4da48740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c441ad390 con 0x5599739ea220 2024-04-20T12:28:08.436 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c4da48740 10 client.0 _ll_register_callbacks cb 0x7f6c3809bd30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:08.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c43fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e1640 0x559973a58460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c43fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e1640 0x559973a58460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38100/0 (socket says 172.21.15.135:38100) 2024-04-20T12:28:08.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c43fff640 1 -- 172.21.15.135:0/1987301852 learned_addr learned my addr 172.21.15.135:0/1987301852 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:08.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c48bf1640 1 --2- 172.21.15.135:0/1987301852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739e0d20 0x559973a57f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c493f2640 1 --2- 172.21.15.135:0/1987301852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739ea220 0x5599739ef660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c43fff640 1 -- 172.21.15.135:0/1987301852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739ea220 msgr2=0x5599739ef660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c43fff640 1 --2- 172.21.15.135:0/1987301852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739ea220 0x5599739ef660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c43fff640 1 -- 172.21.15.135:0/1987301852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739e0d20 msgr2=0x559973a57f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:08.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c43fff640 1 --2- 172.21.15.135:0/1987301852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739e0d20 0x559973a57f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c43fff640 1 -- 172.21.15.135:0/1987301852 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599739efe60 con 0x5599739e1640 2024-04-20T12:28:08.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c493f2640 1 --2- 172.21.15.135:0/1987301852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739ea220 0x5599739ef660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:08.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c23fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:08.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c43fff640 1 --2- 172.21.15.135:0/1987301852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e1640 0x559973a58460 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f6c30004540 tx=0x7f6c30005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5923bf2c8f2a6a65 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:08.437 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c23fff640 1 -- 172.21.15.135:0/1987301852 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30003db0 con 0x5599739e1640 2024-04-20T12:28:08.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c23fff640 1 -- 172.21.15.135:0/1987301852 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f6c30003f50 con 0x5599739e1640 2024-04-20T12:28:08.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c4da48740 1 -- 172.21.15.135:0/1987301852 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c38098a40 con 0x5599739e1640 2024-04-20T12:28:08.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c23fff640 1 -- 172.21.15.135:0/1987301852 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6c30034050 con 0x5599739e1640 2024-04-20T12:28:08.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c4da48740 10 client.17307 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:08.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.431+0000 7f6c4da48740 1 -- 172.21.15.135:0/1987301852 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559973a60680 con 0x5599739e1640 2024-04-20T12:28:08.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.432+0000 7f6c23fff640 1 -- 172.21.15.135:0/1987301852 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c38098a40 con 0x5599739e1640 2024-04-20T12:28:08.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.432+0000 7f6c23fff640 1 -- 172.21.15.135:0/1987301852 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f6c30027590 con 0x5599739e1640 2024-04-20T12:28:08.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.432+0000 7f6c4da48740 10 client.17307 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:08.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.432+0000 7f6c4da48740 10 client.17307 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:08.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.432+0000 7f6c4da48740 20 client.17307 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:08.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.432+0000 7f6c4da48740 1 --2- 172.21.15.135:0/1987301852 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5599739fa5d0 0x559973a62cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:08.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.432+0000 7f6c4da48740 4 client.17307 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:28:08.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.432+0000 7f6c4da48740 1 -- 172.21.15.135:0/1987301852 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55997394da40 con 0x5599739fa5d0 2024-04-20T12:28:08.438 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.432+0000 7f6c48bf1640 1 --2- 172.21.15.135:0/1987301852 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5599739fa5d0 0x559973a62cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:08.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c23fff640 10 client.17307 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:08.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c48bf1640 1 --2- 172.21.15.135:0/1987301852 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5599739fa5d0 0x559973a62cd0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a8199567af00088 server_cookie=b7b441b0d7bb59ca in_seq=0 out_seq=0 2024-04-20T12:28:08.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c23fff640 1 -- 172.21.15.135:0/1987301852 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55997394da40 con 0x5599739fa5d0 2024-04-20T12:28:08.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c23fff640 10 client.17307 handle_command_reply: tid=0 2024-04-20T12:28:08.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c4da48740 1 client.17307 shutdown 2024-04-20T12:28:08.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c4da48740 1 -- 172.21.15.135:0/1987301852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e1640 msgr2=0x559973a58460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c4da48740 1 --2- 172.21.15.135:0/1987301852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e1640 0x559973a58460 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f6c30004540 tx=0x7f6c30005f80 comp rx=0 tx=0).stop 2024-04-20T12:28:08.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c4da48740 1 -- 172.21.15.135:0/1987301852 shutdown_connections 2024-04-20T12:28:08.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c4da48740 1 --2- 172.21.15.135:0/1987301852 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5599739fa5d0 0x559973a62cd0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c4da48740 1 --2- 172.21.15.135:0/1987301852 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5599739ea220 0x5599739ef660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c23fff640 0 client.17307 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:08.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c4da48740 1 --2- 172.21.15.135:0/1987301852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599739e1640 0x559973a58460 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c4da48740 1 --2- 172.21.15.135:0/1987301852 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5599739e0d20 0x559973a57f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.439 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c4da48740 1 -- 172.21.15.135:0/1987301852 >> 172.21.15.135:0/1987301852 conn(0x5599739db450 msgr2=0x5599739dc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:08.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c4da48740 1 -- 172.21.15.135:0/1987301852 shutdown_connections 2024-04-20T12:28:08.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c4da48740 1 -- 172.21.15.135:0/1987301852 wait complete. 2024-04-20T12:28:08.440 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.433+0000 7f6c4da48740 20 client.17307 trim_cache size 0 max 16384 2024-04-20T12:28:08.440 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:28:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:28:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:28:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: "08746625-896e-4821-af6a-5e15dc55244f": { 2024-04-20T12:28:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:28:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "08746625-896e-4821-af6a-5e15dc55244f", 2024-04-20T12:28:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:28:08.440 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:28:08.441 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:28:08.441 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:28:08.441 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.434+0000 7f6c4ae55640 1 -- 172.21.15.135:0/4123075652 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c340a3d20 msgr2=0x7f6c340a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.434+0000 7f6c4ae55640 1 --2- 172.21.15.135:0/4123075652 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c340a3d20 0x7f6c340a61e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c005e30 tx=0x7f6c3c032340 comp rx=0 tx=0).stop 2024-04-20T12:28:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.434+0000 7f6c4ae55640 1 -- 172.21.15.135:0/4123075652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c441010a0 msgr2=0x7f6c4419e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.434+0000 7f6c4ae55640 1 --2- 172.21.15.135:0/4123075652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c441010a0 0x7f6c4419e5b0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800d950 tx=0x7f6c3800de10 comp rx=0 tx=0).stop 2024-04-20T12:28:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.434+0000 7f6c4ae55640 1 -- 172.21.15.135:0/4123075652 shutdown_connections 2024-04-20T12:28:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.434+0000 7f6c4ae55640 1 --2- 172.21.15.135:0/4123075652 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c340a3d20 0x7f6c340a61e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.434+0000 7f6c4ae55640 1 --2- 172.21.15.135:0/4123075652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c44198670 0x7f6c44198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.434+0000 7f6c4ae55640 1 --2- 172.21.15.135:0/4123075652 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c44106170 0x7f6c4419eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.434+0000 7f6c4ae55640 1 --2- 172.21.15.135:0/4123075652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c441010a0 0x7f6c4419e5b0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:08.442 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.434+0000 7f6c4ae55640 1 -- 172.21.15.135:0/4123075652 >> 172.21.15.135:0/4123075652 conn(0x7f6c440771e0 msgr2=0x7f6c4406a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:08.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.434+0000 7f6c4ae55640 1 -- 172.21.15.135:0/4123075652 shutdown_connections 2024-04-20T12:28:08.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:08.434+0000 7f6c4ae55640 1 -- 172.21.15.135:0/4123075652 wait complete. 2024-04-20T12:28:08.443 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:08 smithi135 ceph-mon[18264]: pgmap v153: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:28:08.444 INFO:tasks.cephfs.filesystem:scrub status for tag:08746625-896e-4821-af6a-5e15dc55244f - {'path': '/', 'tag': '08746625-896e-4821-af6a-5e15dc55244f', 'options': 'recursive,force'} 2024-04-20T12:28:08.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:08 smithi154 ceph-mon[22073]: pgmap v153: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:28:08.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:08 smithi139 ceph-mon[21834]: pgmap v153: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:28:09.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:09 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:28:09.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:09 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:28:09.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:09 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:28:09.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:09 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:28:09.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:09 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:28:09.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:09 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:28:09.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:09 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:28:09.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:09 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:28:09.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:09 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:28:09.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:09 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:28:09.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:09 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:28:09.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:09 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:28:10.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:10 smithi154 ceph-mon[22073]: pgmap v154: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:28:10.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:10 smithi139 ceph-mon[21834]: pgmap v154: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:28:10.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:10 smithi135 ceph-mon[18264]: pgmap v154: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:28:12.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:12 smithi154 ceph-mon[22073]: pgmap v155: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:28:12.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:12 smithi139 ceph-mon[21834]: pgmap v155: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:28:12.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:12 smithi135 ceph-mon[18264]: pgmap v155: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:28:13.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:13 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:28:13.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:13 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:28:13.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:13 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:28:14.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:14 smithi154 ceph-mon[22073]: pgmap v156: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-20T12:28:14.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:14 smithi139 ceph-mon[21834]: pgmap v156: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-20T12:28:14.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:14 smithi135 ceph-mon[18264]: pgmap v156: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 22 KiB/s wr, 28 op/s 2024-04-20T12:28:16.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:16 smithi154 ceph-mon[22073]: pgmap v157: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-20T12:28:16.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:16 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:28:16.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:16 smithi139 ceph-mon[21834]: pgmap v157: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-20T12:28:16.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:16 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:28:16.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:16 smithi135 ceph-mon[18264]: pgmap v157: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-20T12:28:16.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:16 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:28:17.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:17 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:28:17.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:17 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:28:17.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:17 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:28:17.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:17 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:28:17.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:17 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:28:17.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:17 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:28:17.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:17 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:28:17.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:17 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:28:17.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:17 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:28:18.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:18 smithi135 ceph-mon[18264]: pgmap v158: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-20T12:28:19.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:18 smithi154 ceph-mon[22073]: pgmap v158: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-20T12:28:19.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:18 smithi139 ceph-mon[21834]: pgmap v158: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 9 op/s 2024-04-20T12:28:20.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:20 smithi135 ceph-mon[18264]: pgmap v159: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-20T12:28:21.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:20 smithi154 ceph-mon[22073]: pgmap v159: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-20T12:28:21.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:20 smithi139 ceph-mon[21834]: pgmap v159: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-20T12:28:22.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:22 smithi135 ceph-mon[18264]: pgmap v160: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:28:22.882 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:22 smithi139 ceph-mon[21834]: pgmap v160: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:28:23.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:22 smithi154 ceph-mon[22073]: pgmap v160: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:28:24.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:24 smithi135 ceph-mon[18264]: pgmap v161: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 op/s 2024-04-20T12:28:25.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:24 smithi154 ceph-mon[22073]: pgmap v161: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 op/s 2024-04-20T12:28:25.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:24 smithi139 ceph-mon[21834]: pgmap v161: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 op/s 2024-04-20T12:28:26.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:26 smithi135 ceph-mon[18264]: pgmap v162: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:28:27.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:26 smithi154 ceph-mon[22073]: pgmap v162: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:28:27.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:26 smithi139 ceph-mon[21834]: pgmap v162: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:28:29.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:28 smithi154 ceph-mon[22073]: pgmap v163: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:28:29.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:28 smithi139 ceph-mon[21834]: pgmap v163: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:28:29.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:28 smithi135 ceph-mon[18264]: pgmap v163: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:28:31.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:30 smithi154 ceph-mon[22073]: pgmap v164: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:28:31.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:30 smithi139 ceph-mon[21834]: pgmap v164: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:28:31.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:30 smithi135 ceph-mon[18264]: pgmap v164: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:28:33.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:32 smithi154 ceph-mon[22073]: pgmap v165: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:28:33.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:32 smithi139 ceph-mon[21834]: pgmap v165: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:28:33.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:32 smithi135 ceph-mon[18264]: pgmap v165: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:28:35.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:34 smithi154 ceph-mon[22073]: pgmap v166: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:28:35.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:34 smithi139 ceph-mon[21834]: pgmap v166: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:28:35.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:34 smithi135 ceph-mon[18264]: pgmap v166: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:28:37.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:36 smithi154 ceph-mon[22073]: pgmap v167: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:37.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:36 smithi139 ceph-mon[21834]: pgmap v167: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:37.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:36 smithi135 ceph-mon[18264]: pgmap v167: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:38.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:28:38.446 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:28:38.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.560+0000 7f9834f85640 1 -- 172.21.15.135:0/1736477699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9830103980 msgr2=0x7f983010c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:38.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.560+0000 7f9834f85640 1 --2- 172.21.15.135:0/1736477699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9830103980 0x7f983010c040 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f9824009900 tx=0x7f982402bcd0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.560+0000 7f9834f85640 1 -- 172.21.15.135:0/1736477699 shutdown_connections 2024-04-20T12:28:38.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.560+0000 7f9834f85640 1 --2- 172.21.15.135:0/1736477699 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f983010c580 0x7f983010e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.560+0000 7f9834f85640 1 --2- 172.21.15.135:0/1736477699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9830103980 0x7f983010c040 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.560+0000 7f9834f85640 1 --2- 172.21.15.135:0/1736477699 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9830103060 0x7f9830103440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.560+0000 7f9834f85640 1 -- 172.21.15.135:0/1736477699 >> 172.21.15.135:0/1736477699 conn(0x7f9830077fc0 msgr2=0x7f98300783d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:38.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.560+0000 7f9834f85640 1 -- 172.21.15.135:0/1736477699 shutdown_connections 2024-04-20T12:28:38.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.560+0000 7f9834f85640 1 -- 172.21.15.135:0/1736477699 wait complete. 2024-04-20T12:28:38.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f9834f85640 1 Processor -- start 2024-04-20T12:28:38.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f9834f85640 1 -- start start 2024-04-20T12:28:38.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f9834f85640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9830103060 0x7f983019e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f9834f85640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9830103980 0x7f983019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f9834f85640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f983010c580 0x7f9830198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f9834f85640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9830112310 con 0x7f9830103060 2024-04-20T12:28:38.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f9834f85640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9830112190 con 0x7f9830103980 2024-04-20T12:28:38.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f9834f85640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9830112490 con 0x7f983010c580 2024-04-20T12:28:38.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f982e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9830103060 0x7f983019e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f982e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9830103060 0x7f983019e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55526/0 (socket says 172.21.15.135:55526) 2024-04-20T12:28:38.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f982e59c640 1 -- 172.21.15.135:0/3133948127 learned_addr learned my addr 172.21.15.135:0/3133948127 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:38.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f982dd9b640 1 --2- 172.21.15.135:0/3133948127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9830103980 0x7f983019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f982ed9d640 1 --2- 172.21.15.135:0/3133948127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f983010c580 0x7f9830198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f982e59c640 1 -- 172.21.15.135:0/3133948127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f983010c580 msgr2=0x7f9830198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:38.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f982e59c640 1 --2- 172.21.15.135:0/3133948127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f983010c580 0x7f9830198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f982e59c640 1 -- 172.21.15.135:0/3133948127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9830103980 msgr2=0x7f983019eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:38.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f982e59c640 1 --2- 172.21.15.135:0/3133948127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9830103980 0x7f983019eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f982e59c640 1 -- 172.21.15.135:0/3133948127 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9830198fd0 con 0x7f9830103060 2024-04-20T12:28:38.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.561+0000 7f982e59c640 1 --2- 172.21.15.135:0/3133948127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9830103060 0x7f983019e650 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f982000d950 tx=0x7f982000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:38.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.562+0000 7f981f7fe640 1 -- 172.21.15.135:0/3133948127 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9820017070 con 0x7f9830103060 2024-04-20T12:28:38.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.562+0000 7f981f7fe640 1 -- 172.21.15.135:0/3133948127 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9820009c30 con 0x7f9830103060 2024-04-20T12:28:38.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.562+0000 7f9834f85640 1 -- 172.21.15.135:0/3133948127 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98301992c0 con 0x7f9830103060 2024-04-20T12:28:38.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.562+0000 7f981f7fe640 1 -- 172.21.15.135:0/3133948127 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982000f6b0 con 0x7f9830103060 2024-04-20T12:28:38.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.562+0000 7f9834f85640 1 -- 172.21.15.135:0/3133948127 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98301a55d0 con 0x7f9830103060 2024-04-20T12:28:38.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.564+0000 7f981f7fe640 1 -- 172.21.15.135:0/3133948127 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f98200109d0 con 0x7f9830103060 2024-04-20T12:28:38.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.564+0000 7f9837b71740 1 Processor -- start 2024-04-20T12:28:38.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.564+0000 7f9837b71740 1 -- start start 2024-04-20T12:28:38.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.564+0000 7f9837b71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45dd20 0x55a16b45e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.564+0000 7f9837b71740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b45e640 0x55a16b466ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.564+0000 7f9837b71740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b467220 0x55a16b469610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.564+0000 7f9837b71740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a16b3c31b0 con 0x55a16b467220 2024-04-20T12:28:38.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.564+0000 7f981f7fe640 1 --2- 172.21.15.135:0/3133948127 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f98180a3d20 0x7f98180a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f9837b71740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a16b360390 con 0x55a16b45e640 2024-04-20T12:28:38.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f9837b71740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a16b3bf170 con 0x55a16b45dd20 2024-04-20T12:28:38.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f982ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b467220 0x55a16b469610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f982dd9b640 1 --2- 172.21.15.135:0/3133948127 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f98180a3d20 0x7f98180a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f982ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b467220 0x55a16b469610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55540/0 (socket says 172.21.15.135:55540) 2024-04-20T12:28:38.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f982ed9d640 1 -- 172.21.15.135:0/2232973464 learned_addr learned my addr 172.21.15.135:0/2232973464 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:38.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f982e59c640 1 --2- 172.21.15.135:0/2232973464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b45e640 0x55a16b466ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f981f7fe640 1 -- 172.21.15.135:0/3133948127 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f98200d0700 con 0x7f9830103060 2024-04-20T12:28:38.578 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f982ed9d640 1 --2- 172.21.15.135:0/2232973464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45dd20 0x55a16b45e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f982ed9d640 1 -- 172.21.15.135:0/2232973464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45dd20 msgr2=0x55a16b45e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:38.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f982ed9d640 1 --2- 172.21.15.135:0/2232973464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45dd20 0x55a16b45e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f982ed9d640 1 -- 172.21.15.135:0/2232973464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b45e640 msgr2=0x55a16b466ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:38.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f982ed9d640 1 --2- 172.21.15.135:0/2232973464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b45e640 0x55a16b466ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f982ed9d640 1 -- 172.21.15.135:0/2232973464 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a16b19f7d0 con 0x55a16b467220 2024-04-20T12:28:38.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f982e59c640 1 --2- 172.21.15.135:0/2232973464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b45e640 0x55a16b466ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:28:38.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f982dd9b640 1 --2- 172.21.15.135:0/3133948127 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f98180a3d20 0x7f98180a61e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f982402efd0 tx=0x7f982402cf90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:38.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f982ed9d640 1 --2- 172.21.15.135:0/2232973464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b467220 0x55a16b469610 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9828014b90 tx=0x7f982800a930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12222eedbbe5af0d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:38.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f981cff9640 1 -- 172.21.15.135:0/2232973464 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982800fdf0 con 0x55a16b467220 2024-04-20T12:28:38.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f981cff9640 1 -- 172.21.15.135:0/2232973464 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98280140d0 con 0x55a16b467220 2024-04-20T12:28:38.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.565+0000 7f981cff9640 1 -- 172.21.15.135:0/2232973464 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828004260 con 0x55a16b467220 2024-04-20T12:28:38.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.566+0000 7f9837b71740 1 -- 172.21.15.135:0/2232973464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b467220 msgr2=0x55a16b469610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:38.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.566+0000 7f9837b71740 1 --2- 172.21.15.135:0/2232973464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b467220 0x55a16b469610 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9828014b90 tx=0x7f982800a930 comp rx=0 tx=0).stop 2024-04-20T12:28:38.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.566+0000 7f9837b71740 1 -- 172.21.15.135:0/2232973464 shutdown_connections 2024-04-20T12:28:38.579 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.566+0000 7f9837b71740 1 --2- 172.21.15.135:0/2232973464 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b467220 0x55a16b469610 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.566+0000 7f9837b71740 1 --2- 172.21.15.135:0/2232973464 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b45e640 0x55a16b466ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.566+0000 7f9837b71740 1 --2- 172.21.15.135:0/2232973464 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45dd20 0x55a16b45e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.566+0000 7f9837b71740 1 -- 172.21.15.135:0/2232973464 >> 172.21.15.135:0/2232973464 conn(0x55a16b458450 msgr2=0x55a16b458830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.566+0000 7f9837b71740 1 -- 172.21.15.135:0/2232973464 shutdown_connections 2024-04-20T12:28:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.566+0000 7f9837b71740 1 -- 172.21.15.135:0/2232973464 wait complete. 2024-04-20T12:28:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f9837b71740 1 -- start start 2024-04-20T12:28:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f9837b71740 1 Processor -- start 2024-04-20T12:28:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f9837b71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45dd20 0x55a16b4642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f9837b71740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b45e640 0x55a16b4647e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f9837b71740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b467220 0x55a16b464d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f9837b71740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a16b469fb0 con 0x55a16b45e640 2024-04-20T12:28:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f9837b71740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a16b37c2f0 con 0x55a16b467220 2024-04-20T12:28:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f9837b71740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a16b46a130 con 0x55a16b45dd20 2024-04-20T12:28:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f9837b71740 10 client.0 _ll_register_callbacks cb 0x55a16b3464e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:38.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f982dd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b45e640 0x55a16b4647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f982dd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b45e640 0x55a16b4647e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55550/0 (socket says 172.21.15.135:55550) 2024-04-20T12:28:38.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f982dd9b640 1 -- 172.21.15.135:0/647894409 learned_addr learned my addr 172.21.15.135:0/647894409 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:38.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f982ed9d640 1 --2- 172.21.15.135:0/647894409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b467220 0x55a16b464d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f982e59c640 1 --2- 172.21.15.135:0/647894409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45dd20 0x55a16b4642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f982dd9b640 1 -- 172.21.15.135:0/647894409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45dd20 msgr2=0x55a16b4642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:38.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f982dd9b640 1 --2- 172.21.15.135:0/647894409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45dd20 0x55a16b4642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f982dd9b640 1 -- 172.21.15.135:0/647894409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b467220 msgr2=0x55a16b464d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:38.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f982dd9b640 1 --2- 172.21.15.135:0/647894409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b467220 0x55a16b464d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f982dd9b640 1 -- 172.21.15.135:0/647894409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a16b0d53f0 con 0x55a16b45e640 2024-04-20T12:28:38.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f982dd9b640 1 --2- 172.21.15.135:0/647894409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b45e640 0x55a16b4647e0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9824009900 tx=0x7f982402bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740fb1b094786dd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:38.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.567+0000 7f9815ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:38.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.568+0000 7f9815ffb640 1 -- 172.21.15.135:0/647894409 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982404f070 con 0x55a16b45e640 2024-04-20T12:28:38.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.568+0000 7f9815ffb640 1 -- 172.21.15.135:0/647894409 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9824004f10 con 0x55a16b45e640 2024-04-20T12:28:38.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.568+0000 7f9837b71740 1 -- 172.21.15.135:0/647894409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98280140d0 con 0x55a16b45e640 2024-04-20T12:28:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.568+0000 7f9815ffb640 1 -- 172.21.15.135:0/647894409 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9824005110 con 0x55a16b45e640 2024-04-20T12:28:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.568+0000 7f9837b71740 10 client.17319 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.568+0000 7f9837b71740 1 -- 172.21.15.135:0/647894409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a16b0950f0 con 0x55a16b45e640 2024-04-20T12:28:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.568+0000 7f9815ffb640 1 -- 172.21.15.135:0/647894409 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98280140d0 con 0x55a16b45e640 2024-04-20T12:28:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.568+0000 7f9815ffb640 1 -- 172.21.15.135:0/647894409 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f982404b450 con 0x55a16b45e640 2024-04-20T12:28:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.568+0000 7f9837b71740 10 client.17319 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.568+0000 7f9837b71740 10 client.17319 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.568+0000 7f9837b71740 20 client.17319 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.568+0000 7f9837b71740 1 --2- 172.21.15.135:0/647894409 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a16b477530 0x55a16b479970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.568+0000 7f9837b71740 4 client.17319 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.568+0000 7f9837b71740 1 -- 172.21.15.135:0/647894409 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a16b3d0bd0 con 0x55a16b477530 2024-04-20T12:28:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.569+0000 7f982e59c640 1 --2- 172.21.15.135:0/647894409 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a16b477530 0x55a16b479970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.569+0000 7f982e59c640 1 --2- 172.21.15.135:0/647894409 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a16b477530 0x55a16b479970 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b99a031d763ab7b server_cookie=b7231b77e73721bb in_seq=0 out_seq=0 2024-04-20T12:28:38.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.569+0000 7f9815ffb640 10 client.17319 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.570+0000 7f9815ffb640 1 -- 172.21.15.135:0/647894409 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a16b3d0bd0 con 0x55a16b477530 2024-04-20T12:28:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.570+0000 7f9815ffb640 10 client.17319 handle_command_reply: tid=0 2024-04-20T12:28:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.570+0000 7f9837b71740 1 client.17319 shutdown 2024-04-20T12:28:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.570+0000 7f9837b71740 1 -- 172.21.15.135:0/647894409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b45e640 msgr2=0x55a16b4647e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.570+0000 7f9837b71740 1 --2- 172.21.15.135:0/647894409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b45e640 0x55a16b4647e0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9824009900 tx=0x7f982402bcd0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.570+0000 7f9837b71740 1 -- 172.21.15.135:0/647894409 shutdown_connections 2024-04-20T12:28:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.570+0000 7f9837b71740 1 --2- 172.21.15.135:0/647894409 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a16b477530 0x55a16b479970 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.570+0000 7f9837b71740 1 --2- 172.21.15.135:0/647894409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b467220 0x55a16b464d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.570+0000 7f9837b71740 1 --2- 172.21.15.135:0/647894409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b45e640 0x55a16b4647e0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.570+0000 7f9815ffb640 0 client.17319 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.570+0000 7f9837b71740 1 --2- 172.21.15.135:0/647894409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45dd20 0x55a16b4642a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.570+0000 7f9837b71740 1 -- 172.21.15.135:0/647894409 >> 172.21.15.135:0/647894409 conn(0x55a16b458450 msgr2=0x55a16b45a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.570+0000 7f9837b71740 1 -- 172.21.15.135:0/647894409 shutdown_connections 2024-04-20T12:28:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.570+0000 7f9837b71740 1 -- 172.21.15.135:0/647894409 wait complete. 2024-04-20T12:28:38.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.570+0000 7f9837b71740 20 client.17319 trim_cache size 0 max 16384 2024-04-20T12:28:38.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.587+0000 7f9837b71740 1 Processor -- start 2024-04-20T12:28:38.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.587+0000 7f9837b71740 1 -- start start 2024-04-20T12:28:38.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.587+0000 7f9837b71740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b45dd20 0x55a16b4669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.587+0000 7f9837b71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45e640 0x55a16b472e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.587+0000 7f9837b71740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b467220 0x55a16b46f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.587+0000 7f9837b71740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f98301af4c0 con 0x55a16b467220 2024-04-20T12:28:38.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.587+0000 7f9837b71740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f98301b1000 con 0x55a16b45dd20 2024-04-20T12:28:38.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.587+0000 7f9837b71740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98301afb90 con 0x55a16b45e640 2024-04-20T12:28:38.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.587+0000 7f982ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b467220 0x55a16b46f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.587+0000 7f982ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b467220 0x55a16b46f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55560/0 (socket says 172.21.15.135:55560) 2024-04-20T12:28:38.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.587+0000 7f982ed9d640 1 -- 172.21.15.135:0/2324288405 learned_addr learned my addr 172.21.15.135:0/2324288405 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:38.593 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.588+0000 7f982e59c640 1 --2- 172.21.15.135:0/2324288405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b45dd20 0x55a16b4669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.588+0000 7f982dd9b640 1 --2- 172.21.15.135:0/2324288405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45e640 0x55a16b472e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.588+0000 7f982ed9d640 1 -- 172.21.15.135:0/2324288405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45e640 msgr2=0x55a16b472e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:38.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.588+0000 7f982ed9d640 1 --2- 172.21.15.135:0/2324288405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45e640 0x55a16b472e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.588+0000 7f982ed9d640 1 -- 172.21.15.135:0/2324288405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b45dd20 msgr2=0x55a16b4669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:38.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.588+0000 7f982ed9d640 1 --2- 172.21.15.135:0/2324288405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b45dd20 0x55a16b4669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.588+0000 7f982ed9d640 1 -- 172.21.15.135:0/2324288405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a16b457f80 con 0x55a16b467220 2024-04-20T12:28:38.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.588+0000 7f982ed9d640 1 --2- 172.21.15.135:0/2324288405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b467220 0x55a16b46f760 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9828014b60 tx=0x7f982800af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1838dd3d19a68521 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:38.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.588+0000 7f9817fff640 1 -- 172.21.15.135:0/2324288405 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98280140d0 con 0x55a16b467220 2024-04-20T12:28:38.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.588+0000 7f9817fff640 1 -- 172.21.15.135:0/2324288405 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9828023070 con 0x55a16b467220 2024-04-20T12:28:38.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.588+0000 7f9817fff640 1 -- 172.21.15.135:0/2324288405 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828003c00 con 0x55a16b467220 2024-04-20T12:28:38.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 -- 172.21.15.135:0/2324288405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b467220 msgr2=0x55a16b46f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:38.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 --2- 172.21.15.135:0/2324288405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b467220 0x55a16b46f760 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9828014b60 tx=0x7f982800af50 comp rx=0 tx=0).stop 2024-04-20T12:28:38.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 -- 172.21.15.135:0/2324288405 shutdown_connections 2024-04-20T12:28:38.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 --2- 172.21.15.135:0/2324288405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b467220 0x55a16b46f760 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 --2- 172.21.15.135:0/2324288405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45e640 0x55a16b472e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 --2- 172.21.15.135:0/2324288405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b45dd20 0x55a16b4669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 -- 172.21.15.135:0/2324288405 >> 172.21.15.135:0/2324288405 conn(0x55a16b458450 msgr2=0x55a16b4631e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:38.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 -- 172.21.15.135:0/2324288405 shutdown_connections 2024-04-20T12:28:38.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 -- 172.21.15.135:0/2324288405 wait complete. 2024-04-20T12:28:38.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 -- start start 2024-04-20T12:28:38.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 Processor -- start 2024-04-20T12:28:38.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45dd20 0x55a16b4d5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b45e640 0x55a16b4d61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b467220 0x55a16b4e0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f98301b0930 con 0x55a16b45e640 2024-04-20T12:28:38.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f98301b0260 con 0x55a16b467220 2024-04-20T12:28:38.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98301ad490 con 0x55a16b45dd20 2024-04-20T12:28:38.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f9837b71740 10 client.0 _ll_register_callbacks cb 0x7f9824042070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:38.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f982dd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b45e640 0x55a16b4d61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f982dd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b45e640 0x55a16b4d61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55562/0 (socket says 172.21.15.135:55562) 2024-04-20T12:28:38.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f982dd9b640 1 -- 172.21.15.135:0/1193421891 learned_addr learned my addr 172.21.15.135:0/1193421891 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:38.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.589+0000 7f982e59c640 1 --2- 172.21.15.135:0/1193421891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45dd20 0x55a16b4d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f982dd9b640 1 -- 172.21.15.135:0/1193421891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45dd20 msgr2=0x55a16b4d5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:38.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f982dd9b640 1 --2- 172.21.15.135:0/1193421891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45dd20 0x55a16b4d5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f982dd9b640 1 -- 172.21.15.135:0/1193421891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b467220 msgr2=0x55a16b4e0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:38.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f982dd9b640 1 --2- 172.21.15.135:0/1193421891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b467220 0x55a16b4e0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f982dd9b640 1 -- 172.21.15.135:0/1193421891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a16b4e1060 con 0x55a16b45e640 2024-04-20T12:28:38.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f982dd9b640 1 --2- 172.21.15.135:0/1193421891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b45e640 0x55a16b4d61a0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x55a16b465870 tx=0x7f982403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abad31f540b8945 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:38.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f9815ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:38.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f9815ffb640 1 -- 172.21.15.135:0/1193421891 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9824063070 con 0x55a16b45e640 2024-04-20T12:28:38.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f9815ffb640 1 -- 172.21.15.135:0/1193421891 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f982404bc70 con 0x55a16b45e640 2024-04-20T12:28:38.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f9837b71740 1 -- 172.21.15.135:0/1193421891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9828023070 con 0x55a16b45e640 2024-04-20T12:28:38.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f9815ffb640 1 -- 172.21.15.135:0/1193421891 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f982404f050 con 0x55a16b45e640 2024-04-20T12:28:38.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f9837b71740 10 client.17325 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:38.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f9837b71740 1 -- 172.21.15.135:0/1193421891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a16b4e2370 con 0x55a16b45e640 2024-04-20T12:28:38.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f9815ffb640 1 -- 172.21.15.135:0/1193421891 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9828023070 con 0x55a16b45e640 2024-04-20T12:28:38.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f9815ffb640 1 -- 172.21.15.135:0/1193421891 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f9824054440 con 0x55a16b45e640 2024-04-20T12:28:38.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f9837b71740 10 client.17325 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:38.597 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f9837b71740 10 client.17325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:38.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f9837b71740 20 client.17325 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:38.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f9837b71740 1 --2- 172.21.15.135:0/1193421891 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a16b4e2ab0 0x55a16b4e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f9837b71740 4 client.17325 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:28:38.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.590+0000 7f9837b71740 1 -- 172.21.15.135:0/1193421891 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a16b3caa40 con 0x55a16b4e2ab0 2024-04-20T12:28:38.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.591+0000 7f982e59c640 1 --2- 172.21.15.135:0/1193421891 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a16b4e2ab0 0x55a16b4e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.591+0000 7f9815ffb640 10 client.17325 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:38.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.591+0000 7f982e59c640 1 --2- 172.21.15.135:0/1193421891 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a16b4e2ab0 0x55a16b4e4ed0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eedaeb4f11d7d79 server_cookie=c33ebc328a7396dc in_seq=0 out_seq=0 2024-04-20T12:28:38.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.591+0000 7f9815ffb640 1 -- 172.21.15.135:0/1193421891 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a16b3caa40 con 0x55a16b4e2ab0 2024-04-20T12:28:38.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.591+0000 7f9815ffb640 10 client.17325 handle_command_reply: tid=0 2024-04-20T12:28:38.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.591+0000 7f9837b71740 1 client.17325 shutdown 2024-04-20T12:28:38.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9837b71740 1 -- 172.21.15.135:0/1193421891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b45e640 msgr2=0x55a16b4d61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:38.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9837b71740 1 --2- 172.21.15.135:0/1193421891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b45e640 0x55a16b4d61a0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x55a16b465870 tx=0x7f982403f000 comp rx=0 tx=0).stop 2024-04-20T12:28:38.598 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9837b71740 1 -- 172.21.15.135:0/1193421891 shutdown_connections 2024-04-20T12:28:38.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9837b71740 1 --2- 172.21.15.135:0/1193421891 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a16b4e2ab0 0x55a16b4e4ed0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9837b71740 1 --2- 172.21.15.135:0/1193421891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a16b467220 0x55a16b4e0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9837b71740 1 --2- 172.21.15.135:0/1193421891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16b45e640 0x55a16b4d61a0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9815ffb640 0 client.17325 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:38.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9837b71740 1 --2- 172.21.15.135:0/1193421891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a16b45dd20 0x55a16b4d5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9837b71740 1 -- 172.21.15.135:0/1193421891 >> 172.21.15.135:0/1193421891 conn(0x55a16b458450 msgr2=0x55a16b464ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:38.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9837b71740 1 -- 172.21.15.135:0/1193421891 shutdown_connections 2024-04-20T12:28:38.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9837b71740 1 -- 172.21.15.135:0/1193421891 wait complete. 2024-04-20T12:28:38.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9837b71740 20 client.17325 trim_cache size 0 max 16384 2024-04-20T12:28:38.599 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:28:38.600 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:28:38.600 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:28:38.600 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:28:38.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9834f85640 1 -- 172.21.15.135:0/3133948127 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f98180a3d20 msgr2=0x7f98180a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:38.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9834f85640 1 --2- 172.21.15.135:0/3133948127 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f98180a3d20 0x7f98180a61e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f982402efd0 tx=0x7f982402cf90 comp rx=0 tx=0).stop 2024-04-20T12:28:38.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9834f85640 1 -- 172.21.15.135:0/3133948127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9830103060 msgr2=0x7f983019e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:38.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9834f85640 1 --2- 172.21.15.135:0/3133948127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9830103060 0x7f983019e650 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f982000d950 tx=0x7f982000de10 comp rx=0 tx=0).stop 2024-04-20T12:28:38.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9834f85640 1 -- 172.21.15.135:0/3133948127 shutdown_connections 2024-04-20T12:28:38.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9834f85640 1 --2- 172.21.15.135:0/3133948127 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f98180a3d20 0x7f98180a61e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9834f85640 1 --2- 172.21.15.135:0/3133948127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f983010c580 0x7f9830198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9834f85640 1 --2- 172.21.15.135:0/3133948127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9830103980 0x7f983019eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9834f85640 1 --2- 172.21.15.135:0/3133948127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9830103060 0x7f983019e650 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9834f85640 1 -- 172.21.15.135:0/3133948127 >> 172.21.15.135:0/3133948127 conn(0x7f9830077fc0 msgr2=0x7f98300ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:38.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9834f85640 1 -- 172.21.15.135:0/3133948127 shutdown_connections 2024-04-20T12:28:38.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.592+0000 7f9834f85640 1 -- 172.21.15.135:0/3133948127 wait complete. 2024-04-20T12:28:38.603 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:28:38.603 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:28:38.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.702+0000 7ff78ed46640 1 -- 172.21.15.135:0/76854967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881080e0 msgr2=0x7ff7881084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:38.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.702+0000 7ff78ed46640 1 --2- 172.21.15.135:0/76854967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881080e0 0x7ff7881084c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ff780009cd0 tx=0x7ff78002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.702+0000 7ff78ed46640 1 -- 172.21.15.135:0/76854967 shutdown_connections 2024-04-20T12:28:38.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.702+0000 7ff78ed46640 1 --2- 172.21.15.135:0/76854967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff788100e50 0x7ff78810eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.702+0000 7ff78ed46640 1 --2- 172.21.15.135:0/76854967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff7881004d0 0x7ff788100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.702+0000 7ff78ed46640 1 --2- 172.21.15.135:0/76854967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881080e0 0x7ff7881084c0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.702+0000 7ff78ed46640 1 -- 172.21.15.135:0/76854967 >> 172.21.15.135:0/76854967 conn(0x7ff788077490 msgr2=0x7ff7880fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:38.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.702+0000 7ff78ed46640 1 -- 172.21.15.135:0/76854967 shutdown_connections 2024-04-20T12:28:38.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.702+0000 7ff78ed46640 1 -- 172.21.15.135:0/76854967 wait complete. 2024-04-20T12:28:38.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78ed46640 1 Processor -- start 2024-04-20T12:28:38.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78ed46640 1 -- start start 2024-04-20T12:28:38.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78ed46640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881004d0 0x7ff78819e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78ed46640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff788100e50 0x7ff78819ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78ed46640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7881080e0 0x7ff788198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78ed46640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff788112400 con 0x7ff7881004d0 2024-04-20T12:28:38.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78ed46640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff788112280 con 0x7ff7881080e0 2024-04-20T12:28:38.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78ed46640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff788112580 con 0x7ff788100e50 2024-04-20T12:28:38.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78cae2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881004d0 0x7ff78819e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78cae2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881004d0 0x7ff78819e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55584/0 (socket says 172.21.15.135:55584) 2024-04-20T12:28:38.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78cae2640 1 -- 172.21.15.135:0/3416889162 learned_addr learned my addr 172.21.15.135:0/3416889162 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:38.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78d2e3640 1 --2- 172.21.15.135:0/3416889162 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7881080e0 0x7ff788198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78cae2640 1 -- 172.21.15.135:0/3416889162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff788100e50 msgr2=0x7ff78819ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:38.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78cae2640 1 --2- 172.21.15.135:0/3416889162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff788100e50 0x7ff78819ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78cae2640 1 -- 172.21.15.135:0/3416889162 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7881080e0 msgr2=0x7ff788198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:38.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78cae2640 1 --2- 172.21.15.135:0/3416889162 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7881080e0 0x7ff788198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78cae2640 1 -- 172.21.15.135:0/3416889162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff788199000 con 0x7ff7881004d0 2024-04-20T12:28:38.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.703+0000 7ff78cae2640 1 --2- 172.21.15.135:0/3416889162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881004d0 0x7ff78819e680 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7ff780004af0 tx=0x7ff780032ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:38.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.704+0000 7ff785ffb640 1 -- 172.21.15.135:0/3416889162 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780041020 con 0x7ff7881004d0 2024-04-20T12:28:38.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.704+0000 7ff78ed46640 1 -- 172.21.15.135:0/3416889162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff788199290 con 0x7ff7881004d0 2024-04-20T12:28:38.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.704+0000 7ff785ffb640 1 -- 172.21.15.135:0/3416889162 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff780034cd0 con 0x7ff7881004d0 2024-04-20T12:28:38.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.704+0000 7ff785ffb640 1 -- 172.21.15.135:0/3416889162 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780039040 con 0x7ff7881004d0 2024-04-20T12:28:38.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.704+0000 7ff78ed46640 1 -- 172.21.15.135:0/3416889162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7881a5420 con 0x7ff7881004d0 2024-04-20T12:28:38.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.705+0000 7ff78ed46640 1 -- 172.21.15.135:0/3416889162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7881037f0 con 0x7ff7881004d0 2024-04-20T12:28:38.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.706+0000 7ff785ffb640 1 -- 172.21.15.135:0/3416889162 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7ff780044020 con 0x7ff7881004d0 2024-04-20T12:28:38.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.707+0000 7ff785ffb640 1 --2- 172.21.15.135:0/3416889162 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff7740a3d20 0x7ff7740a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:38.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.707+0000 7ff787fff640 1 --2- 172.21.15.135:0/3416889162 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff7740a3d20 0x7ff7740a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:38.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.707+0000 7ff785ffb640 1 -- 172.21.15.135:0/3416889162 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff7800f2820 con 0x7ff7881004d0 2024-04-20T12:28:38.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.707+0000 7ff787fff640 1 --2- 172.21.15.135:0/3416889162 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff7740a3d20 0x7ff7740a61e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff7700058c0 tx=0x7ff770005850 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:38.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.711+0000 7ff785ffb640 1 -- 172.21.15.135:0/3416889162 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7ff78004b020 con 0x7ff7881004d0 2024-04-20T12:28:38.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:38 smithi135 ceph-mon[18264]: pgmap v168: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:38.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.929+0000 7ff78ed46640 1 -- 172.21.15.135:0/3416889162 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff78810a4f0 con 0x7ff7881004d0 2024-04-20T12:28:38.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.929+0000 7ff785ffb640 1 -- 172.21.15.135:0/3416889162 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7ff7800348f0 con 0x7ff7881004d0 2024-04-20T12:28:38.929 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:28:38.929 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:28:38.930 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:28:38.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.932+0000 7ff78ed46640 1 -- 172.21.15.135:0/3416889162 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff7740a3d20 msgr2=0x7ff7740a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:38.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.932+0000 7ff78ed46640 1 --2- 172.21.15.135:0/3416889162 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff7740a3d20 0x7ff7740a61e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff7700058c0 tx=0x7ff770005850 comp rx=0 tx=0).stop 2024-04-20T12:28:38.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.932+0000 7ff78ed46640 1 -- 172.21.15.135:0/3416889162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881004d0 msgr2=0x7ff78819e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:38.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.932+0000 7ff78ed46640 1 --2- 172.21.15.135:0/3416889162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881004d0 0x7ff78819e680 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7ff780004af0 tx=0x7ff780032ec0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.932+0000 7ff78ed46640 1 -- 172.21.15.135:0/3416889162 shutdown_connections 2024-04-20T12:28:38.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.932+0000 7ff78ed46640 1 --2- 172.21.15.135:0/3416889162 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff7881080e0 0x7ff788198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.932+0000 7ff78ed46640 1 --2- 172.21.15.135:0/3416889162 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff7740a3d20 0x7ff7740a61e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.932+0000 7ff78ed46640 1 --2- 172.21.15.135:0/3416889162 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff788100e50 0x7ff78819ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.932+0000 7ff78ed46640 1 --2- 172.21.15.135:0/3416889162 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7881004d0 0x7ff78819e680 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:38.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.932+0000 7ff78ed46640 1 -- 172.21.15.135:0/3416889162 >> 172.21.15.135:0/3416889162 conn(0x7ff788077490 msgr2=0x7ff7880febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:38.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.932+0000 7ff78ed46640 1 -- 172.21.15.135:0/3416889162 shutdown_connections 2024-04-20T12:28:38.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:38.932+0000 7ff78ed46640 1 -- 172.21.15.135:0/3416889162 wait complete. 2024-04-20T12:28:38.943 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:28:39.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:38 smithi154 ceph-mon[22073]: pgmap v168: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:39.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 -- 172.21.15.135:0/2399531134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb590101090 msgr2=0x7fb590101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 --2- 172.21.15.135:0/2399531134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb590101090 0x7fb590101470 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb588009ca0 tx=0x7fb58802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 -- 172.21.15.135:0/2399531134 shutdown_connections 2024-04-20T12:28:39.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 --2- 172.21.15.135:0/2399531134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb590106160 0x7fb59010dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 --2- 172.21.15.135:0/2399531134 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb590101a40 0x7fb590105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 --2- 172.21.15.135:0/2399531134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb590101090 0x7fb590101470 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 -- 172.21.15.135:0/2399531134 >> 172.21.15.135:0/2399531134 conn(0x7fb590078010 msgr2=0x7fb590078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 -- 172.21.15.135:0/2399531134 shutdown_connections 2024-04-20T12:28:39.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 -- 172.21.15.135:0/2399531134 wait complete. 2024-04-20T12:28:39.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 Processor -- start 2024-04-20T12:28:39.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 -- start start 2024-04-20T12:28:39.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb590101090 0x7fb590199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb590106160 0x7fb590199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59019a110 0x7fb5901a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5901111f0 con 0x7fb59019a110 2024-04-20T12:28:39.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb590111070 con 0x7fb590101090 2024-04-20T12:28:39.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.044+0000 7fb598554640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb590111370 con 0x7fb590106160 2024-04-20T12:28:39.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb596af1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59019a110 0x7fb5901a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb596af1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59019a110 0x7fb5901a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55604/0 (socket says 172.21.15.135:55604) 2024-04-20T12:28:39.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb596af1640 1 -- 172.21.15.135:0/95796971 learned_addr learned my addr 172.21.15.135:0/95796971 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb595aef640 1 --2- 172.21.15.135:0/95796971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb590106160 0x7fb590199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb5962f0640 1 --2- 172.21.15.135:0/95796971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb590101090 0x7fb590199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb596af1640 1 -- 172.21.15.135:0/95796971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb590106160 msgr2=0x7fb590199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb596af1640 1 --2- 172.21.15.135:0/95796971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb590106160 0x7fb590199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb596af1640 1 -- 172.21.15.135:0/95796971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb590101090 msgr2=0x7fb590199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb596af1640 1 --2- 172.21.15.135:0/95796971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb590101090 0x7fb590199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb596af1640 1 -- 172.21.15.135:0/95796971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5901a4e90 con 0x7fb59019a110 2024-04-20T12:28:39.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb596af1640 1 --2- 172.21.15.135:0/95796971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59019a110 0x7fb5901a4710 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fb58000d750 tx=0x7fb58000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb58f7fe640 1 -- 172.21.15.135:0/95796971 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb580017070 con 0x7fb59019a110 2024-04-20T12:28:39.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb598554640 1 -- 172.21.15.135:0/95796971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5901a5180 con 0x7fb59019a110 2024-04-20T12:28:39.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb58f7fe640 1 -- 172.21.15.135:0/95796971 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb580005500 con 0x7fb59019a110 2024-04-20T12:28:39.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb58f7fe640 1 -- 172.21.15.135:0/95796971 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb580004d90 con 0x7fb59019a110 2024-04-20T12:28:39.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.045+0000 7fb598554640 1 -- 172.21.15.135:0/95796971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5901a56d0 con 0x7fb59019a110 2024-04-20T12:28:39.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.047+0000 7fb58f7fe640 1 -- 172.21.15.135:0/95796971 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fb580004f30 con 0x7fb59019a110 2024-04-20T12:28:39.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.048+0000 7fb59b216740 1 Processor -- start 2024-04-20T12:28:39.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.048+0000 7fb59b216740 1 -- start start 2024-04-20T12:28:39.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.048+0000 7fb59b216740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44debb40 0x560c44debf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.048+0000 7fb59b216740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44dec460 0x560c44df91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.048+0000 7fb59b216740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44df9720 0x560c44dfbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.048+0000 7fb59b216740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560c44d51110 con 0x560c44dec460 2024-04-20T12:28:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.048+0000 7fb59b216740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560c44cee550 con 0x560c44debb40 2024-04-20T12:28:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.048+0000 7fb59b216740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560c44d4d0d0 con 0x560c44df9720 2024-04-20T12:28:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.048+0000 7fb58f7fe640 1 --2- 172.21.15.135:0/95796971 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5780a3d20 0x7fb5780a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.048+0000 7fb5962f0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44dec460 0x560c44df91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.048+0000 7fb5962f0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44dec460 0x560c44df91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55612/0 (socket says 172.21.15.135:55612) 2024-04-20T12:28:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.048+0000 7fb5962f0640 1 -- 172.21.15.135:0/1341349989 learned_addr learned my addr 172.21.15.135:0/1341349989 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.048+0000 7fb595aef640 1 --2- 172.21.15.135:0/1341349989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44df9720 0x560c44dfbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.048+0000 7fb596af1640 1 --2- 172.21.15.135:0/95796971 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5780a3d20 0x7fb5780a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.049+0000 7fb595aef640 1 --2- 172.21.15.135:0/1341349989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44debb40 0x560c44debf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.049+0000 7fb58f7fe640 1 -- 172.21.15.135:0/95796971 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fb5800d0470 con 0x7fb59019a110 2024-04-20T12:28:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.049+0000 7fb5962f0640 1 -- 172.21.15.135:0/1341349989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44df9720 msgr2=0x560c44dfbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.049+0000 7fb5962f0640 1 --2- 172.21.15.135:0/1341349989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44df9720 0x560c44dfbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.049+0000 7fb5962f0640 1 -- 172.21.15.135:0/1341349989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44debb40 msgr2=0x560c44debf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.049+0000 7fb5962f0640 1 --2- 172.21.15.135:0/1341349989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44debb40 0x560c44debf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.049+0000 7fb5962f0640 1 -- 172.21.15.135:0/1341349989 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c44d16900 con 0x560c44dec460 2024-04-20T12:28:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.049+0000 7fb5962f0640 1 --2- 172.21.15.135:0/1341349989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44dec460 0x560c44df91e0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb588009ca0 tx=0x7fb5880323c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6fd476dc0f0e7e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.049+0000 7fb596af1640 1 --2- 172.21.15.135:0/95796971 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5780a3d20 0x7fb5780a61e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb5800cd990 tx=0x7fb580004830 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.049+0000 7fb58cbfe640 1 -- 172.21.15.135:0/1341349989 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588043020 con 0x560c44dec460 2024-04-20T12:28:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.049+0000 7fb58cbfe640 1 -- 172.21.15.135:0/1341349989 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb58802cca0 con 0x560c44dec460 2024-04-20T12:28:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.049+0000 7fb58cbfe640 1 -- 172.21.15.135:0/1341349989 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588039040 con 0x560c44dec460 2024-04-20T12:28:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.050+0000 7fb59b216740 1 -- 172.21.15.135:0/1341349989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44dec460 msgr2=0x560c44df91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.050+0000 7fb59b216740 1 --2- 172.21.15.135:0/1341349989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44dec460 0x560c44df91e0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb588009ca0 tx=0x7fb5880323c0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.050+0000 7fb59b216740 1 -- 172.21.15.135:0/1341349989 shutdown_connections 2024-04-20T12:28:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.050+0000 7fb59b216740 1 --2- 172.21.15.135:0/1341349989 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44df9720 0x560c44dfbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.050+0000 7fb59b216740 1 --2- 172.21.15.135:0/1341349989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44dec460 0x560c44df91e0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.050+0000 7fb59b216740 1 --2- 172.21.15.135:0/1341349989 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44debb40 0x560c44debf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.050+0000 7fb59b216740 1 -- 172.21.15.135:0/1341349989 >> 172.21.15.135:0/1341349989 conn(0x560c44de6540 msgr2=0x560c44de6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.050+0000 7fb59b216740 1 -- 172.21.15.135:0/1341349989 shutdown_connections 2024-04-20T12:28:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.050+0000 7fb59b216740 1 -- 172.21.15.135:0/1341349989 wait complete. 2024-04-20T12:28:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.050+0000 7fb59b216740 1 -- start start 2024-04-20T12:28:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.050+0000 7fb59b216740 1 Processor -- start 2024-04-20T12:28:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.050+0000 7fb59b216740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44debb40 0x560c44df6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.050+0000 7fb59b216740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44dec460 0x560c44df6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.050+0000 7fb59b216740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44df9720 0x560c44df71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb59b216740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560c44dfc480 con 0x560c44df9720 2024-04-20T12:28:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb59b216740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560c44d0a500 con 0x560c44debb40 2024-04-20T12:28:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb59b216740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560c44dfc600 con 0x560c44dec460 2024-04-20T12:28:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb59b216740 10 client.0 _ll_register_callbacks cb 0x560c44cef2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb595aef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44df9720 0x560c44df71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb595aef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44df9720 0x560c44df71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55628/0 (socket says 172.21.15.135:55628) 2024-04-20T12:28:39.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb595aef640 1 -- 172.21.15.135:0/2369616418 learned_addr learned my addr 172.21.15.135:0/2369616418 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb595aef640 1 --2- 172.21.15.135:0/2369616418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44debb40 0x560c44df6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb595aef640 1 -- 172.21.15.135:0/2369616418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44dec460 msgr2=0x560c44df6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb595aef640 1 --2- 172.21.15.135:0/2369616418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44dec460 0x560c44df6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb595aef640 1 -- 172.21.15.135:0/2369616418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44debb40 msgr2=0x560c44df6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb595aef640 1 --2- 172.21.15.135:0/2369616418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44debb40 0x560c44df6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb595aef640 1 -- 172.21.15.135:0/2369616418 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c44a633f0 con 0x560c44df9720 2024-04-20T12:28:39.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb595aef640 1 --2- 172.21.15.135:0/2369616418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44df9720 0x560c44df71c0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fb584011e90 tx=0x7fb5840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19585371863b8ef5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:39.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb575ffb640 1 -- 172.21.15.135:0/2369616418 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb584011320 con 0x560c44df9720 2024-04-20T12:28:39.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb575ffb640 1 -- 172.21.15.135:0/2369616418 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fb584004040 con 0x560c44df9720 2024-04-20T12:28:39.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb59b216740 1 -- 172.21.15.135:0/2369616418 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb58802cca0 con 0x560c44df9720 2024-04-20T12:28:39.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb575ffb640 1 -- 172.21.15.135:0/2369616418 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb584004240 con 0x560c44df9720 2024-04-20T12:28:39.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb59b216740 10 client.17343 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:39.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb59b216740 1 -- 172.21.15.135:0/2369616418 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560c44b2d7d0 con 0x560c44df9720 2024-04-20T12:28:39.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.051+0000 7fb575ffb640 1 -- 172.21.15.135:0/2369616418 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb58802cca0 con 0x560c44df9720 2024-04-20T12:28:39.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.052+0000 7fb575ffb640 1 -- 172.21.15.135:0/2369616418 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fb584020040 con 0x560c44df9720 2024-04-20T12:28:39.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.052+0000 7fb59b216740 10 client.17343 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:39.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.052+0000 7fb59b216740 10 client.17343 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:28:39.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.052+0000 7fb59b216740 20 client.17343 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:39.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.052+0000 7fb59b216740 1 --2- 172.21.15.135:0/2369616418 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x560c44e09ae0 0x560c44e0bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.052+0000 7fb59b216740 4 client.17343 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:39.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.052+0000 7fb59b216740 1 -- 172.21.15.135:0/2369616418 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c44d5eb30 con 0x560c44e09ae0 2024-04-20T12:28:39.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.052+0000 7fb5962f0640 1 --2- 172.21.15.135:0/2369616418 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x560c44e09ae0 0x560c44e0bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.052+0000 7fb5962f0640 1 --2- 172.21.15.135:0/2369616418 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x560c44e09ae0 0x560c44e0bfa0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2d877fb4ff853b52 server_cookie=450709580dd208d7 in_seq=0 out_seq=0 2024-04-20T12:28:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.052+0000 7fb575ffb640 10 client.17343 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:28:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.053+0000 7fb575ffb640 1 -- 172.21.15.135:0/2369616418 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560c44d5eb30 con 0x560c44e09ae0 2024-04-20T12:28:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.053+0000 7fb575ffb640 10 client.17343 handle_command_reply: tid=0 2024-04-20T12:28:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.053+0000 7fb59b216740 1 client.17343 shutdown 2024-04-20T12:28:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.053+0000 7fb59b216740 1 -- 172.21.15.135:0/2369616418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44df9720 msgr2=0x560c44df71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.053+0000 7fb59b216740 1 --2- 172.21.15.135:0/2369616418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44df9720 0x560c44df71c0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fb584011e90 tx=0x7fb5840046c0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.053+0000 7fb59b216740 1 -- 172.21.15.135:0/2369616418 shutdown_connections 2024-04-20T12:28:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.053+0000 7fb59b216740 1 --2- 172.21.15.135:0/2369616418 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x560c44e09ae0 0x560c44e0bfa0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.053+0000 7fb59b216740 1 --2- 172.21.15.135:0/2369616418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44df9720 0x560c44df71c0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.053+0000 7fb575ffb640 0 client.17343 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:28:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.053+0000 7fb59b216740 1 --2- 172.21.15.135:0/2369616418 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44dec460 0x560c44df6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.053+0000 7fb59b216740 1 --2- 172.21.15.135:0/2369616418 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44debb40 0x560c44df6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.053+0000 7fb59b216740 1 -- 172.21.15.135:0/2369616418 >> 172.21.15.135:0/2369616418 conn(0x560c44de6540 msgr2=0x560c44de8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.053+0000 7fb59b216740 1 -- 172.21.15.135:0/2369616418 shutdown_connections 2024-04-20T12:28:39.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.053+0000 7fb59b216740 1 -- 172.21.15.135:0/2369616418 wait complete. 2024-04-20T12:28:39.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.053+0000 7fb59b216740 20 client.17343 trim_cache size 0 max 16384 2024-04-20T12:28:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.066+0000 7fb59b216740 1 Processor -- start 2024-04-20T12:28:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.066+0000 7fb59b216740 1 -- start start 2024-04-20T12:28:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.066+0000 7fb59b216740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44debb40 0x560c44df8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.066+0000 7fb59b216740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44dec460 0x560c44e05380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.066+0000 7fb59b216740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44df9720 0x560c44df6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.066+0000 7fb59b216740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5901ad0c0 con 0x560c44df9720 2024-04-20T12:28:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.066+0000 7fb59b216740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb5901aec00 con 0x560c44dec460 2024-04-20T12:28:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.066+0000 7fb59b216740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb5901ad790 con 0x560c44debb40 2024-04-20T12:28:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.066+0000 7fb595aef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44df9720 0x560c44df6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.066+0000 7fb595aef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44df9720 0x560c44df6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55640/0 (socket says 172.21.15.135:55640) 2024-04-20T12:28:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.066+0000 7fb595aef640 1 -- 172.21.15.135:0/2461184426 learned_addr learned my addr 172.21.15.135:0/2461184426 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb595aef640 1 -- 172.21.15.135:0/2461184426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44debb40 msgr2=0x560c44df8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb595aef640 1 --2- 172.21.15.135:0/2461184426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44debb40 0x560c44df8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb595aef640 1 -- 172.21.15.135:0/2461184426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44dec460 msgr2=0x560c44e05380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb595aef640 1 --2- 172.21.15.135:0/2461184426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44dec460 0x560c44e05380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb595aef640 1 -- 172.21.15.135:0/2461184426 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c44de0af0 con 0x560c44df9720 2024-04-20T12:28:39.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb595aef640 1 --2- 172.21.15.135:0/2461184426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44df9720 0x560c44df6020 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fb584005fd0 tx=0x7fb584005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7648f2c38551f896 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb577fff640 1 -- 172.21.15.135:0/2461184426 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb584011320 con 0x560c44df9720 2024-04-20T12:28:39.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb577fff640 1 -- 172.21.15.135:0/2461184426 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb584004040 con 0x560c44df9720 2024-04-20T12:28:39.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb577fff640 1 -- 172.21.15.135:0/2461184426 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb584004990 con 0x560c44df9720 2024-04-20T12:28:39.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb59b216740 1 -- 172.21.15.135:0/2461184426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44df9720 msgr2=0x560c44df6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb59b216740 1 --2- 172.21.15.135:0/2461184426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44df9720 0x560c44df6020 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fb584005fd0 tx=0x7fb584005d30 comp rx=0 tx=0).stop 2024-04-20T12:28:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb59b216740 1 -- 172.21.15.135:0/2461184426 shutdown_connections 2024-04-20T12:28:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb59b216740 1 --2- 172.21.15.135:0/2461184426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44df9720 0x560c44df6020 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb59b216740 1 --2- 172.21.15.135:0/2461184426 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44dec460 0x560c44e05380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb59b216740 1 --2- 172.21.15.135:0/2461184426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44debb40 0x560c44df8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.067+0000 7fb59b216740 1 -- 172.21.15.135:0/2461184426 >> 172.21.15.135:0/2461184426 conn(0x560c44de6540 msgr2=0x560c44de8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb59b216740 1 -- 172.21.15.135:0/2461184426 shutdown_connections 2024-04-20T12:28:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb59b216740 1 -- 172.21.15.135:0/2461184426 wait complete. 2024-04-20T12:28:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb59b216740 1 -- start start 2024-04-20T12:28:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb59b216740 1 Processor -- start 2024-04-20T12:28:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb59b216740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44debb40 0x560c44df2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb59b216740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44dec460 0x560c44df34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb59b216740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44df9720 0x560c44df3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb59b216740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5901ae530 con 0x560c44dec460 2024-04-20T12:28:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb59b216740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb5901ade60 con 0x560c44debb40 2024-04-20T12:28:39.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb59b216740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb5901ab090 con 0x560c44df9720 2024-04-20T12:28:39.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb59b216740 10 client.0 _ll_register_callbacks cb 0x7fb584009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:39.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb5962f0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44dec460 0x560c44df34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb5962f0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44dec460 0x560c44df34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55652/0 (socket says 172.21.15.135:55652) 2024-04-20T12:28:39.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb5962f0640 1 -- 172.21.15.135:0/3555150559 learned_addr learned my addr 172.21.15.135:0/3555150559 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb595aef640 1 --2- 172.21.15.135:0/3555150559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44df9720 0x560c44df3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb595aef640 1 --2- 172.21.15.135:0/3555150559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44debb40 0x560c44df2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb5962f0640 1 -- 172.21.15.135:0/3555150559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44df9720 msgr2=0x560c44df3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb5962f0640 1 --2- 172.21.15.135:0/3555150559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44df9720 0x560c44df3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb5962f0640 1 -- 172.21.15.135:0/3555150559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44debb40 msgr2=0x560c44df2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb5962f0640 1 --2- 172.21.15.135:0/3555150559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44debb40 0x560c44df2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb5962f0640 1 -- 172.21.15.135:0/3555150559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c44e009b0 con 0x560c44dec460 2024-04-20T12:28:39.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb5962f0640 1 --2- 172.21.15.135:0/3555150559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44dec460 0x560c44df34f0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x560c44decd20 tx=0x7fb588032340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a49e574c9e4795 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.068+0000 7fb575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:39.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.069+0000 7fb575ffb640 1 -- 172.21.15.135:0/3555150559 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58804c070 con 0x560c44dec460 2024-04-20T12:28:39.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.069+0000 7fb575ffb640 1 -- 172.21.15.135:0/3555150559 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fb588032590 con 0x560c44dec460 2024-04-20T12:28:39.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.069+0000 7fb59b216740 1 -- 172.21.15.135:0/3555150559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb584004040 con 0x560c44dec460 2024-04-20T12:28:39.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.069+0000 7fb575ffb640 1 -- 172.21.15.135:0/3555150559 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb588058050 con 0x560c44dec460 2024-04-20T12:28:39.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.069+0000 7fb59b216740 10 client.17349 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:39.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.069+0000 7fb59b216740 1 -- 172.21.15.135:0/3555150559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560c44e01cb0 con 0x560c44dec460 2024-04-20T12:28:39.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.069+0000 7fb575ffb640 1 -- 172.21.15.135:0/3555150559 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb584004040 con 0x560c44dec460 2024-04-20T12:28:39.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.069+0000 7fb575ffb640 1 -- 172.21.15.135:0/3555150559 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fb588032800 con 0x560c44dec460 2024-04-20T12:28:39.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.069+0000 7fb59b216740 10 client.17349 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:39.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.069+0000 7fb59b216740 10 client.17349 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:28:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.069+0000 7fb59b216740 20 client.17349 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.069+0000 7fb59b216740 1 --2- 172.21.15.135:0/3555150559 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x560c44e748d0 0x560c44e76cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.069+0000 7fb59b216740 4 client.17349 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:28:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.069+0000 7fb59b216740 1 -- 172.21.15.135:0/3555150559 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560c44d589a0 con 0x560c44e748d0 2024-04-20T12:28:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.069+0000 7fb595aef640 1 --2- 172.21.15.135:0/3555150559 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x560c44e748d0 0x560c44e76cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb575ffb640 10 client.17349 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:28:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb595aef640 1 --2- 172.21.15.135:0/3555150559 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x560c44e748d0 0x560c44e76cc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2bdd43ef67b9e206 server_cookie=60bdb9908cce40bf in_seq=0 out_seq=0 2024-04-20T12:28:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb575ffb640 1 -- 172.21.15.135:0/3555150559 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560c44d589a0 con 0x560c44e748d0 2024-04-20T12:28:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb575ffb640 10 client.17349 handle_command_reply: tid=0 2024-04-20T12:28:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb59b216740 1 client.17349 shutdown 2024-04-20T12:28:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb59b216740 1 -- 172.21.15.135:0/3555150559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44dec460 msgr2=0x560c44df34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb59b216740 1 --2- 172.21.15.135:0/3555150559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44dec460 0x560c44df34f0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x560c44decd20 tx=0x7fb588032340 comp rx=0 tx=0).stop 2024-04-20T12:28:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb59b216740 1 -- 172.21.15.135:0/3555150559 shutdown_connections 2024-04-20T12:28:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb59b216740 1 --2- 172.21.15.135:0/3555150559 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x560c44e748d0 0x560c44e76cc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb59b216740 1 --2- 172.21.15.135:0/3555150559 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560c44df9720 0x560c44df3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb59b216740 1 --2- 172.21.15.135:0/3555150559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c44dec460 0x560c44df34f0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb575ffb640 0 client.17349 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:28:39.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb59b216740 1 --2- 172.21.15.135:0/3555150559 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560c44debb40 0x560c44df2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb59b216740 1 -- 172.21.15.135:0/3555150559 >> 172.21.15.135:0/3555150559 conn(0x560c44de6540 msgr2=0x560c44de4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb59b216740 1 -- 172.21.15.135:0/3555150559 shutdown_connections 2024-04-20T12:28:39.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb59b216740 1 -- 172.21.15.135:0/3555150559 wait complete. 2024-04-20T12:28:39.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb59b216740 20 client.17349 trim_cache size 0 max 16384 2024-04-20T12:28:39.077 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:28:39.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb598554640 1 -- 172.21.15.135:0/95796971 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5780a3d20 msgr2=0x7fb5780a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb598554640 1 --2- 172.21.15.135:0/95796971 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5780a3d20 0x7fb5780a61e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb5800cd990 tx=0x7fb580004830 comp rx=0 tx=0).stop 2024-04-20T12:28:39.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb598554640 1 -- 172.21.15.135:0/95796971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59019a110 msgr2=0x7fb5901a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.070+0000 7fb598554640 1 --2- 172.21.15.135:0/95796971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59019a110 0x7fb5901a4710 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fb58000d750 tx=0x7fb58000dc10 comp rx=0 tx=0).stop 2024-04-20T12:28:39.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.071+0000 7fb598554640 1 -- 172.21.15.135:0/95796971 shutdown_connections 2024-04-20T12:28:39.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.071+0000 7fb598554640 1 --2- 172.21.15.135:0/95796971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb59019a110 0x7fb5901a4710 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.071+0000 7fb598554640 1 --2- 172.21.15.135:0/95796971 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb5780a3d20 0x7fb5780a61e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.071+0000 7fb598554640 1 --2- 172.21.15.135:0/95796971 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb590106160 0x7fb590199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.071+0000 7fb598554640 1 --2- 172.21.15.135:0/95796971 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb590101090 0x7fb590199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.071+0000 7fb598554640 1 -- 172.21.15.135:0/95796971 >> 172.21.15.135:0/95796971 conn(0x7fb590078010 msgr2=0x7fb5900ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.071+0000 7fb598554640 1 -- 172.21.15.135:0/95796971 shutdown_connections 2024-04-20T12:28:39.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.071+0000 7fb598554640 1 -- 172.21.15.135:0/95796971 wait complete. 2024-04-20T12:28:39.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:38 smithi139 ceph-mon[21834]: pgmap v168: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:39.081 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:28:39.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.182+0000 7f5c0e1a4640 1 -- 172.21.15.135:0/44693189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c081003f0 msgr2=0x7f5c08100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.182+0000 7f5c0e1a4640 1 --2- 172.21.15.135:0/44693189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c081003f0 0x7f5c08100830 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009930 tx=0x7f5bf002bc30 comp rx=0 tx=0).stop 2024-04-20T12:28:39.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.182+0000 7f5c0e1a4640 1 -- 172.21.15.135:0/44693189 shutdown_connections 2024-04-20T12:28:39.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.182+0000 7f5c0e1a4640 1 --2- 172.21.15.135:0/44693189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c08100d70 0x7f5c0810ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.182+0000 7f5c0e1a4640 1 --2- 172.21.15.135:0/44693189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c081003f0 0x7f5c08100830 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.182+0000 7f5c0e1a4640 1 --2- 172.21.15.135:0/44693189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c08107fe0 0x7f5c081083c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.182+0000 7f5c0e1a4640 1 -- 172.21.15.135:0/44693189 >> 172.21.15.135:0/44693189 conn(0x7f5c08077370 msgr2=0x7f5c080fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.182+0000 7f5c0e1a4640 1 -- 172.21.15.135:0/44693189 shutdown_connections 2024-04-20T12:28:39.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.182+0000 7f5c0e1a4640 1 -- 172.21.15.135:0/44693189 wait complete. 2024-04-20T12:28:39.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.182+0000 7f5c0e1a4640 1 Processor -- start 2024-04-20T12:28:39.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.182+0000 7f5c0e1a4640 1 -- start start 2024-04-20T12:28:39.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c0e1a4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c081003f0 0x7f5c0819e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c0e1a4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c08100d70 0x7f5c0819eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c0e1a4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c08107fe0 0x7f5c08198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c0e1a4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5c08112300 con 0x7f5c08107fe0 2024-04-20T12:28:39.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c0e1a4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5c08112180 con 0x7f5c08100d70 2024-04-20T12:28:39.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c0e1a4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5c08112480 con 0x7f5c081003f0 2024-04-20T12:28:39.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c07fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c08107fe0 0x7f5c08198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c07fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c08107fe0 0x7f5c08198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55678/0 (socket says 172.21.15.135:55678) 2024-04-20T12:28:39.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c07fff640 1 -- 172.21.15.135:0/4215634687 learned_addr learned my addr 172.21.15.135:0/4215634687 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c077fe640 1 --2- 172.21.15.135:0/4215634687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c081003f0 0x7f5c0819e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c06ffd640 1 --2- 172.21.15.135:0/4215634687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c08100d70 0x7f5c0819eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c07fff640 1 -- 172.21.15.135:0/4215634687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c081003f0 msgr2=0x7f5c0819e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c07fff640 1 --2- 172.21.15.135:0/4215634687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c081003f0 0x7f5c0819e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c07fff640 1 -- 172.21.15.135:0/4215634687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c08100d70 msgr2=0x7f5c0819eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c07fff640 1 --2- 172.21.15.135:0/4215634687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c08100d70 0x7f5c0819eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c07fff640 1 -- 172.21.15.135:0/4215634687 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c08198f40 con 0x7f5c08107fe0 2024-04-20T12:28:39.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c07fff640 1 --2- 172.21.15.135:0/4215634687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c08107fe0 0x7f5c08198680 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000eaa0 tx=0x7f5c0000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c04ff9640 1 -- 172.21.15.135:0/4215634687 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0000cdb0 con 0x7f5c08107fe0 2024-04-20T12:28:39.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c04ff9640 1 -- 172.21.15.135:0/4215634687 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c00005020 con 0x7f5c08107fe0 2024-04-20T12:28:39.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c0e1a4640 1 -- 172.21.15.135:0/4215634687 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c08199230 con 0x7f5c08107fe0 2024-04-20T12:28:39.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c04ff9640 1 -- 172.21.15.135:0/4215634687 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c000116b0 con 0x7f5c08107fe0 2024-04-20T12:28:39.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.183+0000 7f5c0e1a4640 1 -- 172.21.15.135:0/4215634687 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c081a5540 con 0x7f5c08107fe0 2024-04-20T12:28:39.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.186+0000 7f5c04ff9640 1 -- 172.21.15.135:0/4215634687 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f5c00005560 con 0x7f5c08107fe0 2024-04-20T12:28:39.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.186+0000 7f5c10d9a740 1 Processor -- start 2024-04-20T12:28:39.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.186+0000 7f5c10d9a740 1 -- start start 2024-04-20T12:28:39.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.186+0000 7f5c04ff9640 1 --2- 172.21.15.135:0/4215634687 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5bf40a3d20 0x7f5bf40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.186+0000 7f5c10d9a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990cbac0 0x557b990cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.186+0000 7f5c10d9a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990cc3e0 0x557b990d91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.186+0000 7f5c10d9a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990d9720 0x557b990dbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.186+0000 7f5c10d9a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557b99031110 con 0x557b990d9720 2024-04-20T12:28:39.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.186+0000 7f5c10d9a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557b98fce550 con 0x557b990cbac0 2024-04-20T12:28:39.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.186+0000 7f5c10d9a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557b9902d0d0 con 0x557b990cc3e0 2024-04-20T12:28:39.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.186+0000 7f5c06ffd640 1 --2- 172.21.15.135:0/4215634687 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5bf40a3d20 0x7f5bf40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.186+0000 7f5c04ff9640 1 -- 172.21.15.135:0/4215634687 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5c000d0d20 con 0x7f5c08107fe0 2024-04-20T12:28:39.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.186+0000 7f5c07fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990d9720 0x557b990dbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.186+0000 7f5c07fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990d9720 0x557b990dbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55694/0 (socket says 172.21.15.135:55694) 2024-04-20T12:28:39.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.186+0000 7f5c07fff640 1 -- 172.21.15.135:0/527979012 learned_addr learned my addr 172.21.15.135:0/527979012 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.187+0000 7f5c077fe640 1 --2- 172.21.15.135:0/527979012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990cbac0 0x557b990cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.187+0000 7f5c06ffd640 1 --2- 172.21.15.135:0/527979012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990cc3e0 0x557b990d91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.187+0000 7f5c07fff640 1 -- 172.21.15.135:0/527979012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990cc3e0 msgr2=0x557b990d91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.187+0000 7f5c07fff640 1 --2- 172.21.15.135:0/527979012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990cc3e0 0x557b990d91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.187+0000 7f5c07fff640 1 -- 172.21.15.135:0/527979012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990cbac0 msgr2=0x557b990cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.187+0000 7f5c07fff640 1 --2- 172.21.15.135:0/527979012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990cbac0 0x557b990cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.187+0000 7f5c07fff640 1 -- 172.21.15.135:0/527979012 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b98ff6900 con 0x557b990d9720 2024-04-20T12:28:39.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.187+0000 7f5c06ffd640 1 --2- 172.21.15.135:0/4215634687 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5bf40a3d20 0x7f5bf40a61e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0005ab0 tx=0x7f5bf002c980 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.187+0000 7f5c07fff640 1 --2- 172.21.15.135:0/527979012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990d9720 0x557b990dbb10 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f5c00098e50 tx=0x7f5c0009cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb302a84c1b126a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.187+0000 7f5bfdffb640 1 -- 172.21.15.135:0/527979012 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0001f070 con 0x557b990d9720 2024-04-20T12:28:39.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.187+0000 7f5bfdffb640 1 -- 172.21.15.135:0/527979012 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c000051d0 con 0x557b990d9720 2024-04-20T12:28:39.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.187+0000 7f5bfdffb640 1 -- 172.21.15.135:0/527979012 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0005ea70 con 0x557b990d9720 2024-04-20T12:28:39.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.188+0000 7f5c10d9a740 1 -- 172.21.15.135:0/527979012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990d9720 msgr2=0x557b990dbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.188+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/527979012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990d9720 0x557b990dbb10 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f5c00098e50 tx=0x7f5c0009cb40 comp rx=0 tx=0).stop 2024-04-20T12:28:39.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.188+0000 7f5c10d9a740 1 -- 172.21.15.135:0/527979012 shutdown_connections 2024-04-20T12:28:39.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.188+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/527979012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990d9720 0x557b990dbb10 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.188+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/527979012 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990cc3e0 0x557b990d91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.188+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/527979012 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990cbac0 0x557b990cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.188+0000 7f5c10d9a740 1 -- 172.21.15.135:0/527979012 >> 172.21.15.135:0/527979012 conn(0x557b990c6540 msgr2=0x557b990c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.188+0000 7f5c10d9a740 1 -- 172.21.15.135:0/527979012 shutdown_connections 2024-04-20T12:28:39.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.188+0000 7f5c10d9a740 1 -- 172.21.15.135:0/527979012 wait complete. 2024-04-20T12:28:39.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.188+0000 7f5c10d9a740 1 -- start start 2024-04-20T12:28:39.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.188+0000 7f5c10d9a740 1 Processor -- start 2024-04-20T12:28:39.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.188+0000 7f5c10d9a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990d6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.188+0000 7f5c10d9a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990cc3e0 0x557b990d6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c10d9a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990d9720 0x557b990d70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c10d9a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557b990dc560 con 0x557b990cbac0 2024-04-20T12:28:39.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c10d9a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557b98fea500 con 0x557b990d9720 2024-04-20T12:28:39.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c10d9a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557b990dc6e0 con 0x557b990cc3e0 2024-04-20T12:28:39.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c10d9a740 10 client.0 _ll_register_callbacks cb 0x557b98fcf2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:39.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990d6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990d6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55696/0 (socket says 172.21.15.135:55696) 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c077fe640 1 -- 172.21.15.135:0/2366697298 learned_addr learned my addr 172.21.15.135:0/2366697298 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c07fff640 1 --2- 172.21.15.135:0/2366697298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990d9720 0x557b990d70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c06ffd640 1 --2- 172.21.15.135:0/2366697298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990cc3e0 0x557b990d6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c077fe640 1 -- 172.21.15.135:0/2366697298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990cc3e0 msgr2=0x557b990d6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c077fe640 1 --2- 172.21.15.135:0/2366697298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990cc3e0 0x557b990d6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c077fe640 1 -- 172.21.15.135:0/2366697298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990d9720 msgr2=0x557b990d70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c077fe640 1 --2- 172.21.15.135:0/2366697298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990d9720 0x557b990d70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c077fe640 1 -- 172.21.15.135:0/2366697298 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b98d433f0 con 0x557b990cbac0 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c077fe640 1 --2- 172.21.15.135:0/2366697298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990d6670 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800ba10 tx=0x7f5bf800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5211cb2b541d57db server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5be6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5be6ffd640 1 -- 172.21.15.135:0/2366697298 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8003e80 con 0x557b990cbac0 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5be6ffd640 1 -- 172.21.15.135:0/2366697298 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5bf8011440 con 0x557b990cbac0 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c10d9a740 1 -- 172.21.15.135:0/2366697298 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c000051d0 con 0x557b990cbac0 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5be6ffd640 1 -- 172.21.15.135:0/2366697298 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5bf8011640 con 0x557b990cbac0 2024-04-20T12:28:39.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c10d9a740 10 client.17361 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:39.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.189+0000 7f5c10d9a740 1 -- 172.21.15.135:0/2366697298 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557b98e0d7d0 con 0x557b990cbac0 2024-04-20T12:28:39.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.190+0000 7f5be6ffd640 1 -- 172.21.15.135:0/2366697298 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5c000051d0 con 0x557b990cbac0 2024-04-20T12:28:39.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.190+0000 7f5be6ffd640 1 -- 172.21.15.135:0/2366697298 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f5bf801bad0 con 0x557b990cbac0 2024-04-20T12:28:39.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.190+0000 7f5c10d9a740 10 client.17361 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:39.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.190+0000 7f5c10d9a740 10 client.17361 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:28:39.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.190+0000 7f5c10d9a740 20 client.17361 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:39.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.190+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/2366697298 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x557b990e9b80 0x557b990ebfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.190+0000 7f5c10d9a740 4 client.17361 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:39.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.190+0000 7f5c10d9a740 1 -- 172.21.15.135:0/2366697298 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b9903eb30 con 0x557b990e9b80 2024-04-20T12:28:39.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.190+0000 7f5c06ffd640 1 --2- 172.21.15.135:0/2366697298 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x557b990e9b80 0x557b990ebfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.190+0000 7f5be6ffd640 10 client.17361 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:28:39.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.190+0000 7f5c06ffd640 1 --2- 172.21.15.135:0/2366697298 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x557b990e9b80 0x557b990ebfc0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=30f21792880b7d5a server_cookie=6b42e776bdca4205 in_seq=0 out_seq=0 2024-04-20T12:28:39.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.191+0000 7f5be6ffd640 1 -- 172.21.15.135:0/2366697298 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557b9903eb30 con 0x557b990e9b80 2024-04-20T12:28:39.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.191+0000 7f5be6ffd640 10 client.17361 handle_command_reply: tid=0 2024-04-20T12:28:39.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.191+0000 7f5c10d9a740 1 client.17361 shutdown 2024-04-20T12:28:39.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.191+0000 7f5c10d9a740 1 -- 172.21.15.135:0/2366697298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 msgr2=0x557b990d6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.191+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/2366697298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990d6670 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800ba10 tx=0x7f5bf800bed0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.192+0000 7f5c10d9a740 1 -- 172.21.15.135:0/2366697298 shutdown_connections 2024-04-20T12:28:39.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.192+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/2366697298 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x557b990e9b80 0x557b990ebfc0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.192+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/2366697298 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990d9720 0x557b990d70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.192+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/2366697298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990cc3e0 0x557b990d6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.192+0000 7f5be6ffd640 0 client.17361 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:28:39.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.192+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/2366697298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990d6670 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.192+0000 7f5c10d9a740 1 -- 172.21.15.135:0/2366697298 >> 172.21.15.135:0/2366697298 conn(0x557b990c6540 msgr2=0x557b990c8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.192+0000 7f5c10d9a740 1 -- 172.21.15.135:0/2366697298 shutdown_connections 2024-04-20T12:28:39.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.192+0000 7f5c10d9a740 1 -- 172.21.15.135:0/2366697298 wait complete. 2024-04-20T12:28:39.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.192+0000 7f5c10d9a740 20 client.17361 trim_cache size 0 max 16384 2024-04-20T12:28:39.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c10d9a740 1 Processor -- start 2024-04-20T12:28:39.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c10d9a740 1 -- start start 2024-04-20T12:28:39.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c10d9a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990d8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c10d9a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990cc3e0 0x557b990e5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c10d9a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990d9720 0x557b990f1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c10d9a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5c081ad260 con 0x557b990cbac0 2024-04-20T12:28:39.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c10d9a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5c081aeda0 con 0x557b990d9720 2024-04-20T12:28:39.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c10d9a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5c081ad930 con 0x557b990cc3e0 2024-04-20T12:28:39.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990d8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990d8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55702/0 (socket says 172.21.15.135:55702) 2024-04-20T12:28:39.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c077fe640 1 -- 172.21.15.135:0/3897532630 learned_addr learned my addr 172.21.15.135:0/3897532630 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c077fe640 1 -- 172.21.15.135:0/3897532630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990cc3e0 msgr2=0x557b990e5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c077fe640 1 --2- 172.21.15.135:0/3897532630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990cc3e0 0x557b990e5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c077fe640 1 -- 172.21.15.135:0/3897532630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990d9720 msgr2=0x557b990f1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c077fe640 1 --2- 172.21.15.135:0/3897532630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990d9720 0x557b990f1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c077fe640 1 -- 172.21.15.135:0/3897532630 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b990c6370 con 0x557b990cbac0 2024-04-20T12:28:39.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.205+0000 7f5c077fe640 1 --2- 172.21.15.135:0/3897532630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990d8da0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8000c00 tx=0x7f5bf8005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f4c419851a11fe server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.206+0000 7f5bfd7fa640 1 -- 172.21.15.135:0/3897532630 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8011440 con 0x557b990cbac0 2024-04-20T12:28:39.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.206+0000 7f5bfd7fa640 1 -- 172.21.15.135:0/3897532630 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bf802e070 con 0x557b990cbac0 2024-04-20T12:28:39.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.206+0000 7f5bfd7fa640 1 -- 172.21.15.135:0/3897532630 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf80052a0 con 0x557b990cbac0 2024-04-20T12:28:39.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.206+0000 7f5c10d9a740 1 -- 172.21.15.135:0/3897532630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 msgr2=0x557b990d8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.206+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/3897532630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990d8da0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8000c00 tx=0x7f5bf8005850 comp rx=0 tx=0).stop 2024-04-20T12:28:39.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.206+0000 7f5c10d9a740 1 -- 172.21.15.135:0/3897532630 shutdown_connections 2024-04-20T12:28:39.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.206+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/3897532630 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990d9720 0x557b990f1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.206+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/3897532630 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990cc3e0 0x557b990e5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.206+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/3897532630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990d8da0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.206+0000 7f5c10d9a740 1 -- 172.21.15.135:0/3897532630 >> 172.21.15.135:0/3897532630 conn(0x557b990c6540 msgr2=0x557b990d56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.206+0000 7f5c10d9a740 1 -- 172.21.15.135:0/3897532630 shutdown_connections 2024-04-20T12:28:39.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.206+0000 7f5c10d9a740 1 -- 172.21.15.135:0/3897532630 wait complete. 2024-04-20T12:28:39.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c10d9a740 1 -- start start 2024-04-20T12:28:39.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c10d9a740 1 Processor -- start 2024-04-20T12:28:39.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c10d9a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990e1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c10d9a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990cc3e0 0x557b990dcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c10d9a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990d9720 0x557b990dd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c10d9a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5c081ae6d0 con 0x557b990cbac0 2024-04-20T12:28:39.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c10d9a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5c081ae000 con 0x557b990cc3e0 2024-04-20T12:28:39.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c10d9a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5c081ab230 con 0x557b990d9720 2024-04-20T12:28:39.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c10d9a740 10 client.0 _ll_register_callbacks cb 0x7f5bf8004180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:39.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990e1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990e1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55712/0 (socket says 172.21.15.135:55712) 2024-04-20T12:28:39.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c077fe640 1 -- 172.21.15.135:0/1266030444 learned_addr learned my addr 172.21.15.135:0/1266030444 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c07fff640 1 --2- 172.21.15.135:0/1266030444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990d9720 0x557b990dd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c077fe640 1 -- 172.21.15.135:0/1266030444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990d9720 msgr2=0x557b990dd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c077fe640 1 --2- 172.21.15.135:0/1266030444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990d9720 0x557b990dd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c077fe640 1 -- 172.21.15.135:0/1266030444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990cc3e0 msgr2=0x557b990dcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c077fe640 1 --2- 172.21.15.135:0/1266030444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990cc3e0 0x557b990dcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.207+0000 7f5c077fe640 1 -- 172.21.15.135:0/1266030444 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b990dda40 con 0x557b990cbac0 2024-04-20T12:28:39.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5c077fe640 1 --2- 172.21.15.135:0/1266030444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990e1bf0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800bf10 tx=0x7f5bf80044a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b31f4c72cb49ec8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5be6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:39.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5be6ffd640 1 -- 172.21.15.135:0/1266030444 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8037070 con 0x557b990cbac0 2024-04-20T12:28:39.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5be6ffd640 1 -- 172.21.15.135:0/1266030444 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5bf8011440 con 0x557b990cbac0 2024-04-20T12:28:39.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5c10d9a740 1 -- 172.21.15.135:0/1266030444 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bf802e070 con 0x557b990cbac0 2024-04-20T12:28:39.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5be6ffd640 1 -- 172.21.15.135:0/1266030444 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5bf8003e80 con 0x557b990cbac0 2024-04-20T12:28:39.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5c10d9a740 10 client.17367 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:39.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5c10d9a740 1 -- 172.21.15.135:0/1266030444 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557b9914fef0 con 0x557b990cbac0 2024-04-20T12:28:39.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5be6ffd640 1 -- 172.21.15.135:0/1266030444 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bf802e070 con 0x557b990cbac0 2024-04-20T12:28:39.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5be6ffd640 1 -- 172.21.15.135:0/1266030444 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f5bf8011b50 con 0x557b990cbac0 2024-04-20T12:28:39.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5c10d9a740 10 client.17367 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:39.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5c10d9a740 10 client.17367 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:28:39.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5c10d9a740 20 client.17367 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:39.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/1266030444 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x557b991503c0 0x557b991527b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5c10d9a740 4 client.17367 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:28:39.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.208+0000 7f5c10d9a740 1 -- 172.21.15.135:0/1266030444 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557b990389a0 con 0x557b991503c0 2024-04-20T12:28:39.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5c06ffd640 1 --2- 172.21.15.135:0/1266030444 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x557b991503c0 0x557b991527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5c06ffd640 1 --2- 172.21.15.135:0/1266030444 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x557b991503c0 0x557b991527b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b47963e6c938dc16 server_cookie=3d4137401420bc47 in_seq=0 out_seq=0 2024-04-20T12:28:39.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5be6ffd640 10 client.17367 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:28:39.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5be6ffd640 1 -- 172.21.15.135:0/1266030444 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557b990389a0 con 0x557b991503c0 2024-04-20T12:28:39.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5be6ffd640 10 client.17367 handle_command_reply: tid=0 2024-04-20T12:28:39.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5c10d9a740 1 client.17367 shutdown 2024-04-20T12:28:39.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5c10d9a740 1 -- 172.21.15.135:0/1266030444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 msgr2=0x557b990e1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/1266030444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990e1bf0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800bf10 tx=0x7f5bf80044a0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5c10d9a740 1 -- 172.21.15.135:0/1266030444 shutdown_connections 2024-04-20T12:28:39.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/1266030444 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x557b991503c0 0x557b991527b0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/1266030444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557b990d9720 0x557b990dd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/1266030444 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557b990cc3e0 0x557b990dcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5be6ffd640 0 client.17367 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:28:39.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5c10d9a740 1 --2- 172.21.15.135:0/1266030444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b990cbac0 0x557b990e1bf0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5c10d9a740 1 -- 172.21.15.135:0/1266030444 >> 172.21.15.135:0/1266030444 conn(0x557b990c6540 msgr2=0x557b990c4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5c10d9a740 1 -- 172.21.15.135:0/1266030444 shutdown_connections 2024-04-20T12:28:39.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5c10d9a740 1 -- 172.21.15.135:0/1266030444 wait complete. 2024-04-20T12:28:39.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.209+0000 7f5c10d9a740 20 client.17367 trim_cache size 0 max 16384 2024-04-20T12:28:39.216 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:28:39.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.210+0000 7f5c0e1a4640 1 -- 172.21.15.135:0/4215634687 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5bf40a3d20 msgr2=0x7f5bf40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.210+0000 7f5c0e1a4640 1 --2- 172.21.15.135:0/4215634687 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5bf40a3d20 0x7f5bf40a61e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0005ab0 tx=0x7f5bf002c980 comp rx=0 tx=0).stop 2024-04-20T12:28:39.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.210+0000 7f5c0e1a4640 1 -- 172.21.15.135:0/4215634687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c08107fe0 msgr2=0x7f5c08198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.210+0000 7f5c0e1a4640 1 --2- 172.21.15.135:0/4215634687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c08107fe0 0x7f5c08198680 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000eaa0 tx=0x7f5c0000ef60 comp rx=0 tx=0).stop 2024-04-20T12:28:39.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.210+0000 7f5c0e1a4640 1 -- 172.21.15.135:0/4215634687 shutdown_connections 2024-04-20T12:28:39.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.210+0000 7f5c0e1a4640 1 --2- 172.21.15.135:0/4215634687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c08107fe0 0x7f5c08198680 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.210+0000 7f5c0e1a4640 1 --2- 172.21.15.135:0/4215634687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5c08100d70 0x7f5c0819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.210+0000 7f5c0e1a4640 1 --2- 172.21.15.135:0/4215634687 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5bf40a3d20 0x7f5bf40a61e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.210+0000 7f5c0e1a4640 1 --2- 172.21.15.135:0/4215634687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5c081003f0 0x7f5c0819e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.210+0000 7f5c0e1a4640 1 -- 172.21.15.135:0/4215634687 >> 172.21.15.135:0/4215634687 conn(0x7f5c08077370 msgr2=0x7f5c080feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.210+0000 7f5c0e1a4640 1 -- 172.21.15.135:0/4215634687 shutdown_connections 2024-04-20T12:28:39.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.210+0000 7f5c0e1a4640 1 -- 172.21.15.135:0/4215634687 wait complete. 2024-04-20T12:28:39.220 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:28:39.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.321+0000 7ff5e128c640 1 -- 172.21.15.135:0/4193920362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc106190 msgr2=0x7ff5dc10dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.321+0000 7ff5e128c640 1 --2- 172.21.15.135:0/4193920362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc106190 0x7ff5dc10dd60 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4009ca0 tx=0x7ff5d402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.321+0000 7ff5e128c640 1 -- 172.21.15.135:0/4193920362 shutdown_connections 2024-04-20T12:28:39.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.321+0000 7ff5e128c640 1 --2- 172.21.15.135:0/4193920362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc106190 0x7ff5dc10dd60 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.321+0000 7ff5e128c640 1 --2- 172.21.15.135:0/4193920362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5dc101a70 0x7ff5dc105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.321+0000 7ff5e128c640 1 --2- 172.21.15.135:0/4193920362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5dc1010c0 0x7ff5dc1014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.321+0000 7ff5e128c640 1 -- 172.21.15.135:0/4193920362 >> 172.21.15.135:0/4193920362 conn(0x7ff5dc0771e0 msgr2=0x7ff5dc0775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.321+0000 7ff5e128c640 1 -- 172.21.15.135:0/4193920362 shutdown_connections 2024-04-20T12:28:39.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.321+0000 7ff5e128c640 1 -- 172.21.15.135:0/4193920362 wait complete. 2024-04-20T12:28:39.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5e128c640 1 Processor -- start 2024-04-20T12:28:39.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5e128c640 1 -- start start 2024-04-20T12:28:39.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5e128c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5dc1010c0 0x7ff5dc199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5e128c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc106190 0x7ff5dc199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5e128c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5dc19a100 0x7ff5dc1a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5e128c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc111250 con 0x7ff5dc106190 2024-04-20T12:28:39.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5e128c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc1110d0 con 0x7ff5dc1010c0 2024-04-20T12:28:39.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5e128c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc1113d0 con 0x7ff5dc19a100 2024-04-20T12:28:39.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5da7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc106190 0x7ff5dc199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5da7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc106190 0x7ff5dc199b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55736/0 (socket says 172.21.15.135:55736) 2024-04-20T12:28:39.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5da7fc640 1 -- 172.21.15.135:0/214926890 learned_addr learned my addr 172.21.15.135:0/214926890 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5daffd640 1 --2- 172.21.15.135:0/214926890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5dc1010c0 0x7ff5dc199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5db7fe640 1 --2- 172.21.15.135:0/214926890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5dc19a100 0x7ff5dc1a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5da7fc640 1 -- 172.21.15.135:0/214926890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5dc19a100 msgr2=0x7ff5dc1a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5da7fc640 1 --2- 172.21.15.135:0/214926890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5dc19a100 0x7ff5dc1a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5da7fc640 1 -- 172.21.15.135:0/214926890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5dc1010c0 msgr2=0x7ff5dc199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5da7fc640 1 --2- 172.21.15.135:0/214926890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5dc1010c0 0x7ff5dc199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5da7fc640 1 -- 172.21.15.135:0/214926890 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc1a4e80 con 0x7ff5dc106190 2024-04-20T12:28:39.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5db7fe640 1 --2- 172.21.15.135:0/214926890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5dc19a100 0x7ff5dc1a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:39.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.322+0000 7ff5da7fc640 1 --2- 172.21.15.135:0/214926890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc106190 0x7ff5dc199b70 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000c970 tx=0x7ff5d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.323+0000 7ff5c3fff640 1 -- 172.21.15.135:0/214926890 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0007bb0 con 0x7ff5dc106190 2024-04-20T12:28:39.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.323+0000 7ff5e128c640 1 -- 172.21.15.135:0/214926890 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5dc1a5170 con 0x7ff5dc106190 2024-04-20T12:28:39.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.323+0000 7ff5c3fff640 1 -- 172.21.15.135:0/214926890 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5d0007d50 con 0x7ff5dc106190 2024-04-20T12:28:39.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.323+0000 7ff5c3fff640 1 -- 172.21.15.135:0/214926890 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00187a0 con 0x7ff5dc106190 2024-04-20T12:28:39.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.323+0000 7ff5e128c640 1 -- 172.21.15.135:0/214926890 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5dc1a5670 con 0x7ff5dc106190 2024-04-20T12:28:39.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.325+0000 7ff5c3fff640 1 -- 172.21.15.135:0/214926890 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7ff5d000f450 con 0x7ff5dc106190 2024-04-20T12:28:39.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.325+0000 7ff5e3e81740 1 Processor -- start 2024-04-20T12:28:39.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.325+0000 7ff5e3e81740 1 -- start start 2024-04-20T12:28:39.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.325+0000 7ff5e3e81740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbce10 0x5563cebbd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.325+0000 7ff5e3e81740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebbd730 0x5563cebc5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.325+0000 7ff5e3e81740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebc6310 0x5563cebc8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.325+0000 7ff5e3e81740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5563ceb22110 con 0x5563cebbd730 2024-04-20T12:28:39.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.325+0000 7ff5e3e81740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5563ceabf550 con 0x5563cebbce10 2024-04-20T12:28:39.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.325+0000 7ff5e3e81740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5563ceb1e0d0 con 0x5563cebc6310 2024-04-20T12:28:39.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.325+0000 7ff5daffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebbd730 0x5563cebc5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.325+0000 7ff5daffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebbd730 0x5563cebc5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55742/0 (socket says 172.21.15.135:55742) 2024-04-20T12:28:39.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.325+0000 7ff5daffd640 1 -- 172.21.15.135:0/1290547956 learned_addr learned my addr 172.21.15.135:0/1290547956 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.325+0000 7ff5c3fff640 1 --2- 172.21.15.135:0/214926890 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5c40a3d20 0x7ff5c40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.326+0000 7ff5da7fc640 1 --2- 172.21.15.135:0/1290547956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebc6310 0x5563cebc8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.326+0000 7ff5db7fe640 1 --2- 172.21.15.135:0/1290547956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbce10 0x5563cebbd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.326+0000 7ff5daffd640 1 -- 172.21.15.135:0/1290547956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebc6310 msgr2=0x5563cebc8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.326+0000 7ff5db7fe640 1 --2- 172.21.15.135:0/214926890 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5c40a3d20 0x7ff5c40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.326+0000 7ff5daffd640 1 --2- 172.21.15.135:0/1290547956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebc6310 0x5563cebc8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.326+0000 7ff5daffd640 1 -- 172.21.15.135:0/1290547956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbce10 msgr2=0x5563cebbd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.326+0000 7ff5daffd640 1 --2- 172.21.15.135:0/1290547956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbce10 0x5563cebbd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.326+0000 7ff5daffd640 1 -- 172.21.15.135:0/1290547956 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563ceae7900 con 0x5563cebbd730 2024-04-20T12:28:39.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.326+0000 7ff5da7fc640 1 --2- 172.21.15.135:0/1290547956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebc6310 0x5563cebc8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:39.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.326+0000 7ff5c3fff640 1 -- 172.21.15.135:0/214926890 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff5d00d0bd0 con 0x7ff5dc106190 2024-04-20T12:28:39.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.326+0000 7ff5daffd640 1 --2- 172.21.15.135:0/1290547956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebbd730 0x5563cebc5dd0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00bd10 tx=0x7ff5cc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449178c642db882a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.326+0000 7ff5db7fe640 1 --2- 172.21.15.135:0/214926890 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5c40a3d20 0x7ff5c40a61e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4037040 tx=0x7ff5d40095c0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.326+0000 7ff5c17fa640 1 -- 172.21.15.135:0/1290547956 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc004030 con 0x5563cebbd730 2024-04-20T12:28:39.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.326+0000 7ff5c17fa640 1 -- 172.21.15.135:0/1290547956 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5cc0041d0 con 0x5563cebbd730 2024-04-20T12:28:39.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.326+0000 7ff5c17fa640 1 -- 172.21.15.135:0/1290547956 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc011840 con 0x5563cebbd730 2024-04-20T12:28:39.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 -- 172.21.15.135:0/1290547956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebbd730 msgr2=0x5563cebc5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/1290547956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebbd730 0x5563cebc5dd0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00bd10 tx=0x7ff5cc0107a0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 -- 172.21.15.135:0/1290547956 shutdown_connections 2024-04-20T12:28:39.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/1290547956 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebc6310 0x5563cebc8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/1290547956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebbd730 0x5563cebc5dd0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/1290547956 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbce10 0x5563cebbd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 -- 172.21.15.135:0/1290547956 >> 172.21.15.135:0/1290547956 conn(0x5563cebb7540 msgr2=0x5563cebb7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 -- 172.21.15.135:0/1290547956 shutdown_connections 2024-04-20T12:28:39.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 -- 172.21.15.135:0/1290547956 wait complete. 2024-04-20T12:28:39.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 -- start start 2024-04-20T12:28:39.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 Processor -- start 2024-04-20T12:28:39.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebbce10 0x5563cebc33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbd730 0x5563cebc3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebc6310 0x5563cebc3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5563cebc9100 con 0x5563cebc6310 2024-04-20T12:28:39.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5563ceadb500 con 0x5563cebbd730 2024-04-20T12:28:39.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5563cebc9280 con 0x5563cebbce10 2024-04-20T12:28:39.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.327+0000 7ff5e3e81740 10 client.0 _ll_register_callbacks cb 0x5563ceac02f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:39.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5db7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebc6310 0x5563cebc3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5db7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebc6310 0x5563cebc3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55752/0 (socket says 172.21.15.135:55752) 2024-04-20T12:28:39.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5db7fe640 1 -- 172.21.15.135:0/3843701570 learned_addr learned my addr 172.21.15.135:0/3843701570 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5daffd640 1 --2- 172.21.15.135:0/3843701570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebbce10 0x5563cebc33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5da7fc640 1 --2- 172.21.15.135:0/3843701570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbd730 0x5563cebc3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5db7fe640 1 -- 172.21.15.135:0/3843701570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebbce10 msgr2=0x5563cebc33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5db7fe640 1 --2- 172.21.15.135:0/3843701570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebbce10 0x5563cebc33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5db7fe640 1 -- 172.21.15.135:0/3843701570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbd730 msgr2=0x5563cebc3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5db7fe640 1 --2- 172.21.15.135:0/3843701570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbd730 0x5563cebc3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5db7fe640 1 -- 172.21.15.135:0/3843701570 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563ce8343f0 con 0x5563cebc6310 2024-04-20T12:28:39.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5da7fc640 1 --2- 172.21.15.135:0/3843701570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbd730 0x5563cebc3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:39.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5db7fe640 1 --2- 172.21.15.135:0/3843701570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebc6310 0x5563cebc3e50 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4032bc0 tx=0x7ff5d4009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8990a90d4a54dd68 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5beff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:39.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5beff5640 1 -- 172.21.15.135:0/3843701570 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4051060 con 0x5563cebc6310 2024-04-20T12:28:39.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5beff5640 1 -- 172.21.15.135:0/3843701570 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff5d4004040 con 0x5563cebc6310 2024-04-20T12:28:39.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5e3e81740 1 -- 172.21.15.135:0/3843701570 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5cc0041d0 con 0x5563cebc6310 2024-04-20T12:28:39.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5beff5640 1 -- 172.21.15.135:0/3843701570 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff5d4058050 con 0x5563cebc6310 2024-04-20T12:28:39.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5e3e81740 10 client.17379 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:39.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5e3e81740 1 -- 172.21.15.135:0/3843701570 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5563ce8fe7d0 con 0x5563cebc6310 2024-04-20T12:28:39.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.328+0000 7ff5beff5640 1 -- 172.21.15.135:0/3843701570 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5cc0041d0 con 0x5563cebc6310 2024-04-20T12:28:39.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.329+0000 7ff5beff5640 1 -- 172.21.15.135:0/3843701570 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7ff5d4041990 con 0x5563cebc6310 2024-04-20T12:28:39.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.329+0000 7ff5e3e81740 10 client.17379 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:39.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.329+0000 7ff5e3e81740 10 client.17379 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:28:39.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.329+0000 7ff5e3e81740 20 client.17379 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:39.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.329+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/3843701570 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5563cebd6680 0x5563cebd8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.329+0000 7ff5e3e81740 4 client.17379 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:39.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.329+0000 7ff5e3e81740 1 -- 172.21.15.135:0/3843701570 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563ceb2fb30 con 0x5563cebd6680 2024-04-20T12:28:39.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.329+0000 7ff5daffd640 1 --2- 172.21.15.135:0/3843701570 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5563cebd6680 0x5563cebd8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.329+0000 7ff5beff5640 10 client.17379 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:28:39.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.329+0000 7ff5daffd640 1 --2- 172.21.15.135:0/3843701570 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5563cebd6680 0x5563cebd8ad0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=273d40afafcf2cc7 server_cookie=3da2efa3b1baf3ee in_seq=0 out_seq=0 2024-04-20T12:28:39.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.330+0000 7ff5beff5640 1 -- 172.21.15.135:0/3843701570 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5563ceb2fb30 con 0x5563cebd6680 2024-04-20T12:28:39.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.330+0000 7ff5beff5640 10 client.17379 handle_command_reply: tid=0 2024-04-20T12:28:39.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.330+0000 7ff5e3e81740 1 client.17379 shutdown 2024-04-20T12:28:39.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.330+0000 7ff5e3e81740 1 -- 172.21.15.135:0/3843701570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebc6310 msgr2=0x5563cebc3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.330+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/3843701570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebc6310 0x5563cebc3e50 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4032bc0 tx=0x7ff5d4009380 comp rx=0 tx=0).stop 2024-04-20T12:28:39.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.330+0000 7ff5e3e81740 1 -- 172.21.15.135:0/3843701570 shutdown_connections 2024-04-20T12:28:39.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.330+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/3843701570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebc6310 0x5563cebc3e50 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.330+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/3843701570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbd730 0x5563cebc3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.330+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/3843701570 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5563cebd6680 0x5563cebd8ad0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.330+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/3843701570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebbce10 0x5563cebc33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.330+0000 7ff5beff5640 0 client.17379 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:28:39.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.330+0000 7ff5e3e81740 1 -- 172.21.15.135:0/3843701570 >> 172.21.15.135:0/3843701570 conn(0x5563cebb7540 msgr2=0x5563cebb9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.330+0000 7ff5e3e81740 1 -- 172.21.15.135:0/3843701570 shutdown_connections 2024-04-20T12:28:39.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.330+0000 7ff5e3e81740 1 -- 172.21.15.135:0/3843701570 wait complete. 2024-04-20T12:28:39.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.330+0000 7ff5e3e81740 20 client.17379 trim_cache size 0 max 16384 2024-04-20T12:28:39.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5e3e81740 1 Processor -- start 2024-04-20T12:28:39.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5e3e81740 1 -- start start 2024-04-20T12:28:39.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5e3e81740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebbce10 0x5563cebc5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5e3e81740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbd730 0x5563cebd1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5e3e81740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebc6310 0x5563cebde3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5e3e81740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc1af360 con 0x5563cebc6310 2024-04-20T12:28:39.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5e3e81740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc1b0ea0 con 0x5563cebbd730 2024-04-20T12:28:39.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5e3e81740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc1afa30 con 0x5563cebbce10 2024-04-20T12:28:39.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5db7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebc6310 0x5563cebde3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5db7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebc6310 0x5563cebde3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55756/0 (socket says 172.21.15.135:55756) 2024-04-20T12:28:39.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5db7fe640 1 -- 172.21.15.135:0/2764704506 learned_addr learned my addr 172.21.15.135:0/2764704506 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5db7fe640 1 -- 172.21.15.135:0/2764704506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebbce10 msgr2=0x5563cebc5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5db7fe640 1 --2- 172.21.15.135:0/2764704506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebbce10 0x5563cebc5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5db7fe640 1 -- 172.21.15.135:0/2764704506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbd730 msgr2=0x5563cebd1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5db7fe640 1 --2- 172.21.15.135:0/2764704506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbd730 0x5563cebd1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5db7fe640 1 -- 172.21.15.135:0/2764704506 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563cebd9150 con 0x5563cebc6310 2024-04-20T12:28:39.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5db7fe640 1 --2- 172.21.15.135:0/2764704506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebc6310 0x5563cebde3a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4041de0 tx=0x7ff5d40324c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379f2c010787f7a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.344+0000 7ff5c0ff9640 1 -- 172.21.15.135:0/2764704506 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4051040 con 0x5563cebc6310 2024-04-20T12:28:39.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.345+0000 7ff5c0ff9640 1 -- 172.21.15.135:0/2764704506 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5d403a040 con 0x5563cebc6310 2024-04-20T12:28:39.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.345+0000 7ff5c0ff9640 1 -- 172.21.15.135:0/2764704506 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4039040 con 0x5563cebc6310 2024-04-20T12:28:39.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.345+0000 7ff5e3e81740 1 -- 172.21.15.135:0/2764704506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebc6310 msgr2=0x5563cebde3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.345+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/2764704506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebc6310 0x5563cebde3a0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4041de0 tx=0x7ff5d40324c0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.345+0000 7ff5e3e81740 1 -- 172.21.15.135:0/2764704506 shutdown_connections 2024-04-20T12:28:39.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.345+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/2764704506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebc6310 0x5563cebde3a0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.345+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/2764704506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbd730 0x5563cebd1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.345+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/2764704506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebbce10 0x5563cebc5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.345+0000 7ff5e3e81740 1 -- 172.21.15.135:0/2764704506 >> 172.21.15.135:0/2764704506 conn(0x5563cebb7540 msgr2=0x5563cebb66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.345+0000 7ff5e3e81740 1 -- 172.21.15.135:0/2764704506 shutdown_connections 2024-04-20T12:28:39.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.345+0000 7ff5e3e81740 1 -- 172.21.15.135:0/2764704506 wait complete. 2024-04-20T12:28:39.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.345+0000 7ff5e3e81740 1 -- start start 2024-04-20T12:28:39.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.345+0000 7ff5e3e81740 1 Processor -- start 2024-04-20T12:28:39.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5e3e81740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbce10 0x5563cebc07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5e3e81740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebbd730 0x5563cebc0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5e3e81740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebc6310 0x5563cec3bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5e3e81740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc1b07d0 con 0x5563cebbd730 2024-04-20T12:28:39.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5e3e81740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc1b0100 con 0x5563cebbce10 2024-04-20T12:28:39.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5e3e81740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc1ad330 con 0x5563cebc6310 2024-04-20T12:28:39.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5e3e81740 10 client.0 _ll_register_callbacks cb 0x7ff5d4037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:39.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5da7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebbd730 0x5563cebc0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5da7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebbd730 0x5563cebc0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55772/0 (socket says 172.21.15.135:55772) 2024-04-20T12:28:39.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5da7fc640 1 -- 172.21.15.135:0/16683555 learned_addr learned my addr 172.21.15.135:0/16683555 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5daffd640 1 --2- 172.21.15.135:0/16683555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbce10 0x5563cebc07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5db7fe640 1 --2- 172.21.15.135:0/16683555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebc6310 0x5563cec3bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5da7fc640 1 -- 172.21.15.135:0/16683555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebc6310 msgr2=0x5563cec3bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5da7fc640 1 --2- 172.21.15.135:0/16683555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebc6310 0x5563cec3bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5da7fc640 1 -- 172.21.15.135:0/16683555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbce10 msgr2=0x5563cebc07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5da7fc640 1 --2- 172.21.15.135:0/16683555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbce10 0x5563cebc07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5da7fc640 1 -- 172.21.15.135:0/16683555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563cec3c150 con 0x5563cebbd730 2024-04-20T12:28:39.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5da7fc640 1 --2- 172.21.15.135:0/16683555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebbd730 0x5563cebc0d00 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7ff5d009c720 tx=0x7ff5d009c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da7b5a3246ef4e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5beff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:39.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5beff5640 1 -- 172.21.15.135:0/16683555 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d009c790 con 0x5563cebbd730 2024-04-20T12:28:39.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5beff5640 1 -- 172.21.15.135:0/16683555 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff5d000f740 con 0x5563cebbd730 2024-04-20T12:28:39.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5e3e81740 1 -- 172.21.15.135:0/16683555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5d403a040 con 0x5563cebbd730 2024-04-20T12:28:39.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5beff5640 1 -- 172.21.15.135:0/16683555 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff5d00a0b40 con 0x5563cebbd730 2024-04-20T12:28:39.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5e3e81740 10 client.17385 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:39.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.346+0000 7ff5e3e81740 1 -- 172.21.15.135:0/16683555 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5563cec3d420 con 0x5563cebbd730 2024-04-20T12:28:39.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.347+0000 7ff5beff5640 1 -- 172.21.15.135:0/16683555 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5d403a040 con 0x5563cebbd730 2024-04-20T12:28:39.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.347+0000 7ff5beff5640 1 -- 172.21.15.135:0/16683555 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7ff5d0020030 con 0x5563cebbd730 2024-04-20T12:28:39.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.347+0000 7ff5e3e81740 10 client.17385 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:39.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.347+0000 7ff5e3e81740 10 client.17385 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:28:39.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.347+0000 7ff5e3e81740 20 client.17385 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:39.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.347+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/16683555 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5563cec3dba0 0x5563cec3ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.347+0000 7ff5e3e81740 4 client.17385 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:28:39.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.347+0000 7ff5e3e81740 1 -- 172.21.15.135:0/16683555 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5563ceb299a0 con 0x5563cec3dba0 2024-04-20T12:28:39.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.347+0000 7ff5daffd640 1 --2- 172.21.15.135:0/16683555 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5563cec3dba0 0x5563cec3ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5daffd640 1 --2- 172.21.15.135:0/16683555 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5563cec3dba0 0x5563cec3ffc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6bab56f84d09c25f server_cookie=95a5a4c285338cc4 in_seq=0 out_seq=0 2024-04-20T12:28:39.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5beff5640 10 client.17385 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:28:39.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5beff5640 1 -- 172.21.15.135:0/16683555 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5563ceb299a0 con 0x5563cec3dba0 2024-04-20T12:28:39.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5beff5640 10 client.17385 handle_command_reply: tid=0 2024-04-20T12:28:39.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e3e81740 1 client.17385 shutdown 2024-04-20T12:28:39.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e3e81740 1 -- 172.21.15.135:0/16683555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebbd730 msgr2=0x5563cebc0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/16683555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebbd730 0x5563cebc0d00 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7ff5d009c720 tx=0x7ff5d009c650 comp rx=0 tx=0).stop 2024-04-20T12:28:39.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e3e81740 1 -- 172.21.15.135:0/16683555 shutdown_connections 2024-04-20T12:28:39.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/16683555 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5563cec3dba0 0x5563cec3ffc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/16683555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563cebc6310 0x5563cec3bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5beff5640 0 client.17385 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:28:39.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/16683555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563cebbd730 0x5563cebc0d00 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e3e81740 1 --2- 172.21.15.135:0/16683555 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563cebbce10 0x5563cebc07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e3e81740 1 -- 172.21.15.135:0/16683555 >> 172.21.15.135:0/16683555 conn(0x5563cebb7540 msgr2=0x5563cebb5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e3e81740 1 -- 172.21.15.135:0/16683555 shutdown_connections 2024-04-20T12:28:39.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e3e81740 1 -- 172.21.15.135:0/16683555 wait complete. 2024-04-20T12:28:39.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e3e81740 20 client.17385 trim_cache size 0 max 16384 2024-04-20T12:28:39.355 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:28:39.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e128c640 1 -- 172.21.15.135:0/214926890 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5c40a3d20 msgr2=0x7ff5c40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e128c640 1 --2- 172.21.15.135:0/214926890 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5c40a3d20 0x7ff5c40a61e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4037040 tx=0x7ff5d40095c0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e128c640 1 -- 172.21.15.135:0/214926890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc106190 msgr2=0x7ff5dc199b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e128c640 1 --2- 172.21.15.135:0/214926890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc106190 0x7ff5dc199b70 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000c970 tx=0x7ff5d000ce30 comp rx=0 tx=0).stop 2024-04-20T12:28:39.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e128c640 1 -- 172.21.15.135:0/214926890 shutdown_connections 2024-04-20T12:28:39.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e128c640 1 --2- 172.21.15.135:0/214926890 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff5c40a3d20 0x7ff5c40a61e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.348+0000 7ff5e128c640 1 --2- 172.21.15.135:0/214926890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff5dc19a100 0x7ff5dc1a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.349+0000 7ff5e128c640 1 --2- 172.21.15.135:0/214926890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5dc106190 0x7ff5dc199b70 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.349+0000 7ff5e128c640 1 --2- 172.21.15.135:0/214926890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff5dc1010c0 0x7ff5dc199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.349+0000 7ff5e128c640 1 -- 172.21.15.135:0/214926890 >> 172.21.15.135:0/214926890 conn(0x7ff5dc0771e0 msgr2=0x7ff5dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.349+0000 7ff5e128c640 1 -- 172.21.15.135:0/214926890 shutdown_connections 2024-04-20T12:28:39.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.349+0000 7ff5e128c640 1 -- 172.21.15.135:0/214926890 wait complete. 2024-04-20T12:28:39.359 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:28:39.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.459+0000 7ff73a5ef640 1 -- 172.21.15.135:0/2557530432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff734108930 msgr2=0x7ff73406a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.459+0000 7ff73a5ef640 1 --2- 172.21.15.135:0/2557530432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff734108930 0x7ff73406a5e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7ff728009900 tx=0x7ff72802bcd0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.459+0000 7ff73a5ef640 1 -- 172.21.15.135:0/2557530432 shutdown_connections 2024-04-20T12:28:39.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.459+0000 7ff73a5ef640 1 --2- 172.21.15.135:0/2557530432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff73406acf0 0x7ff73410edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.459+0000 7ff73a5ef640 1 --2- 172.21.15.135:0/2557530432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff734108930 0x7ff73406a5e0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.459+0000 7ff73a5ef640 1 --2- 172.21.15.135:0/2557530432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff734108010 0x7ff7341083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.459+0000 7ff73a5ef640 1 -- 172.21.15.135:0/2557530432 >> 172.21.15.135:0/2557530432 conn(0x7ff734076c60 msgr2=0x7ff734077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.459+0000 7ff73a5ef640 1 -- 172.21.15.135:0/2557530432 shutdown_connections 2024-04-20T12:28:39.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.459+0000 7ff73a5ef640 1 -- 172.21.15.135:0/2557530432 wait complete. 2024-04-20T12:28:39.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.460+0000 7ff73a5ef640 1 Processor -- start 2024-04-20T12:28:39.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.460+0000 7ff73a5ef640 1 -- start start 2024-04-20T12:28:39.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.460+0000 7ff73a5ef640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73406acf0 0x7ff73419e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.460+0000 7ff73a5ef640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff734108010 0x7ff73419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.460+0000 7ff73a5ef640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff734108930 0x7ff7341985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.460+0000 7ff73a5ef640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341122f0 con 0x7ff73406acf0 2024-04-20T12:28:39.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.460+0000 7ff73a5ef640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff734112170 con 0x7ff734108930 2024-04-20T12:28:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.460+0000 7ff73a5ef640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff734112470 con 0x7ff734108010 2024-04-20T12:28:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.460+0000 7ff733fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73406acf0 0x7ff73419e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.460+0000 7ff733fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73406acf0 0x7ff73419e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55794/0 (socket says 172.21.15.135:55794) 2024-04-20T12:28:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.460+0000 7ff733fff640 1 -- 172.21.15.135:0/2996706885 learned_addr learned my addr 172.21.15.135:0/2996706885 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.460+0000 7ff7337fe640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff734108010 0x7ff73419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.461+0000 7ff733fff640 1 -- 172.21.15.135:0/2996706885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff734108010 msgr2=0x7ff73419e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.461+0000 7ff733fff640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff734108010 0x7ff73419e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.461+0000 7ff738b8c640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff734108930 0x7ff7341985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.461+0000 7ff733fff640 1 -- 172.21.15.135:0/2996706885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff734108930 msgr2=0x7ff7341985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.461+0000 7ff733fff640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff734108930 0x7ff7341985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.461+0000 7ff733fff640 1 -- 172.21.15.135:0/2996706885 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff734198d30 con 0x7ff73406acf0 2024-04-20T12:28:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.461+0000 7ff7337fe640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff734108010 0x7ff73419e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.461+0000 7ff738b8c640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff734108930 0x7ff7341985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.461+0000 7ff733fff640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73406acf0 0x7ff73419e400 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff72400c920 tx=0x7ff72400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.461+0000 7ff7317fa640 1 -- 172.21.15.135:0/2996706885 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff724007c70 con 0x7ff73406acf0 2024-04-20T12:28:39.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.461+0000 7ff7317fa640 1 -- 172.21.15.135:0/2996706885 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff724007e10 con 0x7ff73406acf0 2024-04-20T12:28:39.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.461+0000 7ff73a5ef640 1 -- 172.21.15.135:0/2996706885 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff734199020 con 0x7ff73406acf0 2024-04-20T12:28:39.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.461+0000 7ff7317fa640 1 -- 172.21.15.135:0/2996706885 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff724018890 con 0x7ff73406acf0 2024-04-20T12:28:39.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.461+0000 7ff73a5ef640 1 -- 172.21.15.135:0/2996706885 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7341a52c0 con 0x7ff73406acf0 2024-04-20T12:28:39.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.463+0000 7ff7317fa640 1 -- 172.21.15.135:0/2996706885 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7ff724018a70 con 0x7ff73406acf0 2024-04-20T12:28:39.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.463+0000 7ff73d1db740 1 Processor -- start 2024-04-20T12:28:39.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.463+0000 7ff73d1db740 1 -- start start 2024-04-20T12:28:39.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.463+0000 7ff73d1db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d50e10 0x5595b8d511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.463+0000 7ff73d1db740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d51730 0x5595b8d59dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.463+0000 7ff73d1db740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d5a310 0x5595b8d5c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.463+0000 7ff73d1db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5595b8cb6110 con 0x5595b8d50e10 2024-04-20T12:28:39.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.463+0000 7ff73d1db740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5595b8c53550 con 0x5595b8d51730 2024-04-20T12:28:39.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.463+0000 7ff73d1db740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5595b8cb20d0 con 0x5595b8d5a310 2024-04-20T12:28:39.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff7317fa640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff71c0a3da0 0x7ff71c0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff738b8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d50e10 0x5595b8d511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff738b8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d50e10 0x5595b8d511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55796/0 (socket says 172.21.15.135:55796) 2024-04-20T12:28:39.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff738b8c640 1 -- 172.21.15.135:0/2115730490 learned_addr learned my addr 172.21.15.135:0/2115730490 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff733fff640 1 --2- 172.21.15.135:0/2115730490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d51730 0x5595b8d59dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff738b8c640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff71c0a3da0 0x7ff71c0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff7317fa640 1 -- 172.21.15.135:0/2996706885 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff7240d0c50 con 0x7ff73406acf0 2024-04-20T12:28:39.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff7337fe640 1 --2- 172.21.15.135:0/2115730490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d5a310 0x5595b8d5c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff738b8c640 1 -- 172.21.15.135:0/2115730490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d5a310 msgr2=0x5595b8d5c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff738b8c640 1 --2- 172.21.15.135:0/2115730490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d5a310 0x5595b8d5c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff738b8c640 1 -- 172.21.15.135:0/2115730490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d51730 msgr2=0x5595b8d59dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff738b8c640 1 --2- 172.21.15.135:0/2115730490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d51730 0x5595b8d59dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff738b8c640 1 -- 172.21.15.135:0/2115730490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b8c7b900 con 0x5595b8d50e10 2024-04-20T12:28:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff738b8c640 1 --2- 172.21.15.135:0/2115730490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d50e10 0x5595b8d511f0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7ff72c014ed0 tx=0x7ff72c011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c759ea7122f8f4a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff738b8c640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff71c0a3da0 0x7ff71c0a6260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff72c011c50 tx=0x7ff72c016000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff71a7fc640 1 -- 172.21.15.135:0/2115730490 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c00cc30 con 0x5595b8d50e10 2024-04-20T12:28:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff71a7fc640 1 -- 172.21.15.135:0/2115730490 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff72c009d50 con 0x5595b8d50e10 2024-04-20T12:28:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.464+0000 7ff71a7fc640 1 -- 172.21.15.135:0/2115730490 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c005770 con 0x5595b8d50e10 2024-04-20T12:28:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.465+0000 7ff73d1db740 1 -- 172.21.15.135:0/2115730490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d50e10 msgr2=0x5595b8d511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.465+0000 7ff73d1db740 1 --2- 172.21.15.135:0/2115730490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d50e10 0x5595b8d511f0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7ff72c014ed0 tx=0x7ff72c011750 comp rx=0 tx=0).stop 2024-04-20T12:28:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.465+0000 7ff73d1db740 1 -- 172.21.15.135:0/2115730490 shutdown_connections 2024-04-20T12:28:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.465+0000 7ff73d1db740 1 --2- 172.21.15.135:0/2115730490 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d5a310 0x5595b8d5c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.465+0000 7ff73d1db740 1 --2- 172.21.15.135:0/2115730490 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d51730 0x5595b8d59dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.465+0000 7ff73d1db740 1 --2- 172.21.15.135:0/2115730490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d50e10 0x5595b8d511f0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.465+0000 7ff73d1db740 1 -- 172.21.15.135:0/2115730490 >> 172.21.15.135:0/2115730490 conn(0x5595b8d4b540 msgr2=0x5595b8d4b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.465+0000 7ff73d1db740 1 -- 172.21.15.135:0/2115730490 shutdown_connections 2024-04-20T12:28:39.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.465+0000 7ff73d1db740 1 -- 172.21.15.135:0/2115730490 wait complete. 2024-04-20T12:28:39.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.465+0000 7ff73d1db740 1 -- start start 2024-04-20T12:28:39.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff73d1db740 1 Processor -- start 2024-04-20T12:28:39.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff73d1db740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d50e10 0x5595b8d57420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff73d1db740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d51730 0x5595b8d57960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff73d1db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d57ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff73d1db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5595b8d5cfe0 con 0x5595b8d5a310 2024-04-20T12:28:39.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff73d1db740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5595b8c6f500 con 0x5595b8d50e10 2024-04-20T12:28:39.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff73d1db740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5595b8d5d160 con 0x5595b8d51730 2024-04-20T12:28:39.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff73d1db740 10 client.0 _ll_register_callbacks cb 0x5595b8c542f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:39.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff738b8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d57ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff738b8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d57ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55804/0 (socket says 172.21.15.135:55804) 2024-04-20T12:28:39.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff738b8c640 1 -- 172.21.15.135:0/2186680176 learned_addr learned my addr 172.21.15.135:0/2186680176 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff733fff640 1 --2- 172.21.15.135:0/2186680176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d50e10 0x5595b8d57420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff738b8c640 1 -- 172.21.15.135:0/2186680176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d51730 msgr2=0x5595b8d57960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff738b8c640 1 --2- 172.21.15.135:0/2186680176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d51730 0x5595b8d57960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff738b8c640 1 -- 172.21.15.135:0/2186680176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d50e10 msgr2=0x5595b8d57420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff738b8c640 1 --2- 172.21.15.135:0/2186680176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d50e10 0x5595b8d57420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff738b8c640 1 -- 172.21.15.135:0/2186680176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595b89c83f0 con 0x5595b8d5a310 2024-04-20T12:28:39.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff738b8c640 1 --2- 172.21.15.135:0/2186680176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d57ea0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff72c015fd0 tx=0x7ff72c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2520068e1ec4b65 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.466+0000 7ff7137fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:39.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.467+0000 7ff7137fe640 1 -- 172.21.15.135:0/2186680176 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c037060 con 0x5595b8d5a310 2024-04-20T12:28:39.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.467+0000 7ff7137fe640 1 -- 172.21.15.135:0/2186680176 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff72c005510 con 0x5595b8d5a310 2024-04-20T12:28:39.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.467+0000 7ff73d1db740 1 -- 172.21.15.135:0/2186680176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff72c009d50 con 0x5595b8d5a310 2024-04-20T12:28:39.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.467+0000 7ff7137fe640 1 -- 172.21.15.135:0/2186680176 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff72c03e050 con 0x5595b8d5a310 2024-04-20T12:28:39.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.467+0000 7ff73d1db740 10 client.17397 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:39.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.467+0000 7ff73d1db740 1 -- 172.21.15.135:0/2186680176 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5595b8a927d0 con 0x5595b8d5a310 2024-04-20T12:28:39.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.467+0000 7ff7137fe640 1 -- 172.21.15.135:0/2186680176 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff72c009d50 con 0x5595b8d5a310 2024-04-20T12:28:39.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.467+0000 7ff7137fe640 1 -- 172.21.15.135:0/2186680176 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7ff72c032420 con 0x5595b8d5a310 2024-04-20T12:28:39.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.467+0000 7ff73d1db740 10 client.17397 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:39.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.467+0000 7ff73d1db740 10 client.17397 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:28:39.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.467+0000 7ff73d1db740 20 client.17397 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:39.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.467+0000 7ff73d1db740 1 --2- 172.21.15.135:0/2186680176 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5595b8d6a5d0 0x5595b8d6c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.467+0000 7ff73d1db740 4 client.17397 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:39.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.467+0000 7ff73d1db740 1 -- 172.21.15.135:0/2186680176 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595b8cc3b30 con 0x5595b8d6a5d0 2024-04-20T12:28:39.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.467+0000 7ff733fff640 1 --2- 172.21.15.135:0/2186680176 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5595b8d6a5d0 0x5595b8d6c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.468+0000 7ff7137fe640 10 client.17397 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:28:39.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.468+0000 7ff733fff640 1 --2- 172.21.15.135:0/2186680176 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5595b8d6a5d0 0x5595b8d6c9c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=57de5e78b0a09ab5 server_cookie=a5ac192c74a3c37e in_seq=0 out_seq=0 2024-04-20T12:28:39.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.468+0000 7ff7137fe640 1 -- 172.21.15.135:0/2186680176 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5595b8cc3b30 con 0x5595b8d6a5d0 2024-04-20T12:28:39.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.468+0000 7ff7137fe640 10 client.17397 handle_command_reply: tid=0 2024-04-20T12:28:39.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.468+0000 7ff73d1db740 1 client.17397 shutdown 2024-04-20T12:28:39.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.469+0000 7ff73d1db740 1 -- 172.21.15.135:0/2186680176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 msgr2=0x5595b8d57ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.469+0000 7ff73d1db740 1 --2- 172.21.15.135:0/2186680176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d57ea0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff72c015fd0 tx=0x7ff72c00ce60 comp rx=0 tx=0).stop 2024-04-20T12:28:39.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.469+0000 7ff73d1db740 1 -- 172.21.15.135:0/2186680176 shutdown_connections 2024-04-20T12:28:39.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.469+0000 7ff73d1db740 1 --2- 172.21.15.135:0/2186680176 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5595b8d6a5d0 0x5595b8d6c9c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.469+0000 7ff73d1db740 1 --2- 172.21.15.135:0/2186680176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d57ea0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.469+0000 7ff73d1db740 1 --2- 172.21.15.135:0/2186680176 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d51730 0x5595b8d57960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.469+0000 7ff73d1db740 1 --2- 172.21.15.135:0/2186680176 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d50e10 0x5595b8d57420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.469+0000 7ff7137fe640 0 client.17397 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:28:39.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.469+0000 7ff73d1db740 1 -- 172.21.15.135:0/2186680176 >> 172.21.15.135:0/2186680176 conn(0x5595b8d4b540 msgr2=0x5595b8d4d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.469+0000 7ff73d1db740 1 -- 172.21.15.135:0/2186680176 shutdown_connections 2024-04-20T12:28:39.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.469+0000 7ff73d1db740 1 -- 172.21.15.135:0/2186680176 wait complete. 2024-04-20T12:28:39.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.469+0000 7ff73d1db740 20 client.17397 trim_cache size 0 max 16384 2024-04-20T12:28:39.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff73d1db740 1 Processor -- start 2024-04-20T12:28:39.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff73d1db740 1 -- start start 2024-04-20T12:28:39.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff73d1db740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d50e10 0x5595b8d59b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff73d1db740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d51730 0x5595b8d565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff73d1db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d721b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff73d1db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341af300 con 0x5595b8d5a310 2024-04-20T12:28:39.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff73d1db740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b0e40 con 0x5595b8d50e10 2024-04-20T12:28:39.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff73d1db740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341af9d0 con 0x5595b8d51730 2024-04-20T12:28:39.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff738b8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff738b8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d721b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55806/0 (socket says 172.21.15.135:55806) 2024-04-20T12:28:39.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff738b8c640 1 -- 172.21.15.135:0/2966699868 learned_addr learned my addr 172.21.15.135:0/2966699868 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff7337fe640 1 --2- 172.21.15.135:0/2966699868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d51730 0x5595b8d565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff738b8c640 1 -- 172.21.15.135:0/2966699868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d51730 msgr2=0x5595b8d565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff738b8c640 1 --2- 172.21.15.135:0/2966699868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d51730 0x5595b8d565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff738b8c640 1 -- 172.21.15.135:0/2966699868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d50e10 msgr2=0x5595b8d59b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff738b8c640 1 --2- 172.21.15.135:0/2966699868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d50e10 0x5595b8d59b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff738b8c640 1 -- 172.21.15.135:0/2966699868 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595b8d6cf80 con 0x5595b8d5a310 2024-04-20T12:28:39.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff738b8c640 1 --2- 172.21.15.135:0/2966699868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d721b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff72c002230 tx=0x7ff72c014cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28825b23ea527142 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.482+0000 7ff719ffb640 1 -- 172.21.15.135:0/2966699868 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c037040 con 0x5595b8d5a310 2024-04-20T12:28:39.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.483+0000 7ff719ffb640 1 -- 172.21.15.135:0/2966699868 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff72c009d50 con 0x5595b8d5a310 2024-04-20T12:28:39.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.483+0000 7ff719ffb640 1 -- 172.21.15.135:0/2966699868 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c032400 con 0x5595b8d5a310 2024-04-20T12:28:39.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.483+0000 7ff73d1db740 1 -- 172.21.15.135:0/2966699868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 msgr2=0x5595b8d721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.483+0000 7ff73d1db740 1 --2- 172.21.15.135:0/2966699868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d721b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff72c002230 tx=0x7ff72c014cd0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.483+0000 7ff73d1db740 1 -- 172.21.15.135:0/2966699868 shutdown_connections 2024-04-20T12:28:39.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.483+0000 7ff73d1db740 1 --2- 172.21.15.135:0/2966699868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d721b0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.483+0000 7ff73d1db740 1 --2- 172.21.15.135:0/2966699868 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d51730 0x5595b8d565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.483+0000 7ff73d1db740 1 --2- 172.21.15.135:0/2966699868 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d50e10 0x5595b8d59b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.483+0000 7ff73d1db740 1 -- 172.21.15.135:0/2966699868 >> 172.21.15.135:0/2966699868 conn(0x5595b8d4b540 msgr2=0x5595b8d46570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.483+0000 7ff73d1db740 1 -- 172.21.15.135:0/2966699868 shutdown_connections 2024-04-20T12:28:39.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.483+0000 7ff73d1db740 1 -- 172.21.15.135:0/2966699868 wait complete. 2024-04-20T12:28:39.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.483+0000 7ff73d1db740 1 -- start start 2024-04-20T12:28:39.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff73d1db740 1 Processor -- start 2024-04-20T12:28:39.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff73d1db740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d50e10 0x5595b8d623b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff73d1db740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d51730 0x5595b8d628f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff73d1db740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d53770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff73d1db740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b0770 con 0x5595b8d5a310 2024-04-20T12:28:39.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff73d1db740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b00a0 con 0x5595b8d51730 2024-04-20T12:28:39.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff73d1db740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341ad2d0 con 0x5595b8d50e10 2024-04-20T12:28:39.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff73d1db740 10 client.0 _ll_register_callbacks cb 0x7ff72400fe30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:39.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff738b8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d53770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff738b8c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d53770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55808/0 (socket says 172.21.15.135:55808) 2024-04-20T12:28:39.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff738b8c640 1 -- 172.21.15.135:0/1274920792 learned_addr learned my addr 172.21.15.135:0/1274920792 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff7337fe640 1 --2- 172.21.15.135:0/1274920792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d51730 0x5595b8d628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff738b8c640 1 -- 172.21.15.135:0/1274920792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d50e10 msgr2=0x5595b8d623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff738b8c640 1 --2- 172.21.15.135:0/1274920792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d50e10 0x5595b8d623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff738b8c640 1 -- 172.21.15.135:0/1274920792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d51730 msgr2=0x5595b8d628f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff738b8c640 1 --2- 172.21.15.135:0/1274920792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d51730 0x5595b8d628f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff738b8c640 1 -- 172.21.15.135:0/1274920792 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595b8d53db0 con 0x5595b8d5a310 2024-04-20T12:28:39.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff7337fe640 1 --2- 172.21.15.135:0/1274920792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d51730 0x5595b8d628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:39.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff738b8c640 1 --2- 172.21.15.135:0/1274920792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d53770 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff72c005b40 tx=0x7ff72c005260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f31662ccb92fed8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff7137fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:39.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.484+0000 7ff7137fe640 1 -- 172.21.15.135:0/1274920792 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c037040 con 0x5595b8d5a310 2024-04-20T12:28:39.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.485+0000 7ff7137fe640 1 -- 172.21.15.135:0/1274920792 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7ff72c032a60 con 0x5595b8d5a310 2024-04-20T12:28:39.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.485+0000 7ff73d1db740 1 -- 172.21.15.135:0/1274920792 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff72c009d50 con 0x5595b8d5a310 2024-04-20T12:28:39.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.485+0000 7ff7137fe640 1 -- 172.21.15.135:0/1274920792 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff72c055050 con 0x5595b8d5a310 2024-04-20T12:28:39.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.485+0000 7ff73d1db740 10 client.17403 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:39.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.485+0000 7ff73d1db740 1 -- 172.21.15.135:0/1274920792 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5595b8dd0360 con 0x5595b8d5a310 2024-04-20T12:28:39.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.485+0000 7ff7137fe640 1 -- 172.21.15.135:0/1274920792 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff72c009d50 con 0x5595b8d5a310 2024-04-20T12:28:39.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.485+0000 7ff7137fe640 1 -- 172.21.15.135:0/1274920792 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7ff72c004a50 con 0x5595b8d5a310 2024-04-20T12:28:39.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.485+0000 7ff73d1db740 10 client.17403 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:39.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.485+0000 7ff73d1db740 10 client.17403 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:28:39.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.485+0000 7ff73d1db740 20 client.17403 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:39.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.485+0000 7ff73d1db740 1 --2- 172.21.15.135:0/1274920792 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5595b8dd09c0 0x5595b8dd2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.485+0000 7ff73d1db740 4 client.17403 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:28:39.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.485+0000 7ff73d1db740 1 -- 172.21.15.135:0/1274920792 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5595b8cbd9a0 con 0x5595b8dd09c0 2024-04-20T12:28:39.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.485+0000 7ff733fff640 1 --2- 172.21.15.135:0/1274920792 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5595b8dd09c0 0x5595b8dd2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff733fff640 1 --2- 172.21.15.135:0/1274920792 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5595b8dd09c0 0x5595b8dd2de0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4f4a97b0173040ce server_cookie=bea83ec034c175e7 in_seq=0 out_seq=0 2024-04-20T12:28:39.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff7137fe640 10 client.17403 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:28:39.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff7137fe640 1 -- 172.21.15.135:0/1274920792 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5595b8cbd9a0 con 0x5595b8dd09c0 2024-04-20T12:28:39.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff7137fe640 10 client.17403 handle_command_reply: tid=0 2024-04-20T12:28:39.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff73d1db740 1 client.17403 shutdown 2024-04-20T12:28:39.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff73d1db740 1 -- 172.21.15.135:0/1274920792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 msgr2=0x5595b8d53770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff73d1db740 1 --2- 172.21.15.135:0/1274920792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d53770 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff72c005b40 tx=0x7ff72c005260 comp rx=0 tx=0).stop 2024-04-20T12:28:39.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff73d1db740 1 -- 172.21.15.135:0/1274920792 shutdown_connections 2024-04-20T12:28:39.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff73d1db740 1 --2- 172.21.15.135:0/1274920792 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5595b8dd09c0 0x5595b8dd2de0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff73d1db740 1 --2- 172.21.15.135:0/1274920792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5595b8d5a310 0x5595b8d53770 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff73d1db740 1 --2- 172.21.15.135:0/1274920792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5595b8d51730 0x5595b8d628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff7137fe640 0 client.17403 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:28:39.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff73d1db740 1 --2- 172.21.15.135:0/1274920792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5595b8d50e10 0x5595b8d623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff73d1db740 1 -- 172.21.15.135:0/1274920792 >> 172.21.15.135:0/1274920792 conn(0x5595b8d4b540 msgr2=0x5595b8d49e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff73d1db740 1 -- 172.21.15.135:0/1274920792 shutdown_connections 2024-04-20T12:28:39.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff73d1db740 1 -- 172.21.15.135:0/1274920792 wait complete. 2024-04-20T12:28:39.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.486+0000 7ff73d1db740 20 client.17403 trim_cache size 0 max 16384 2024-04-20T12:28:39.495 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:28:39.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.487+0000 7ff73a5ef640 1 -- 172.21.15.135:0/2996706885 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff71c0a3da0 msgr2=0x7ff71c0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.487+0000 7ff73a5ef640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff71c0a3da0 0x7ff71c0a6260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff72c011c50 tx=0x7ff72c016000 comp rx=0 tx=0).stop 2024-04-20T12:28:39.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.487+0000 7ff73a5ef640 1 -- 172.21.15.135:0/2996706885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73406acf0 msgr2=0x7ff73419e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.487+0000 7ff73a5ef640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73406acf0 0x7ff73419e400 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff72400c920 tx=0x7ff72400cde0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.487+0000 7ff73a5ef640 1 -- 172.21.15.135:0/2996706885 shutdown_connections 2024-04-20T12:28:39.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.487+0000 7ff73a5ef640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff734108930 0x7ff7341985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.487+0000 7ff73a5ef640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff71c0a3da0 0x7ff71c0a6260 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.487+0000 7ff73a5ef640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff734108010 0x7ff73419e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.487+0000 7ff73a5ef640 1 --2- 172.21.15.135:0/2996706885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73406acf0 0x7ff73419e400 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.487+0000 7ff73a5ef640 1 -- 172.21.15.135:0/2996706885 >> 172.21.15.135:0/2996706885 conn(0x7ff734076c60 msgr2=0x7ff7340ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.487+0000 7ff73a5ef640 1 -- 172.21.15.135:0/2996706885 shutdown_connections 2024-04-20T12:28:39.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.487+0000 7ff73a5ef640 1 -- 172.21.15.135:0/2996706885 wait complete. 2024-04-20T12:28:39.498 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:28:39.599 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.597+0000 7f6f422c1640 1 -- 172.21.15.135:0/5738575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f3c100fe0 msgr2=0x7f6f3c10d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.597+0000 7f6f422c1640 1 --2- 172.21.15.135:0/5738575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f3c100fe0 0x7f6f3c10d450 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400adb0 tx=0x7f6f3402cff0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.597+0000 7f6f422c1640 1 -- 172.21.15.135:0/5738575 shutdown_connections 2024-04-20T12:28:39.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.597+0000 7f6f422c1640 1 --2- 172.21.15.135:0/5738575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f3c100fe0 0x7f6f3c10d450 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.597+0000 7f6f422c1640 1 --2- 172.21.15.135:0/5738575 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f3c100620 0x7f6f3c100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.597+0000 7f6f422c1640 1 --2- 172.21.15.135:0/5738575 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3c106690 0x7f6f3c106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.597+0000 7f6f422c1640 1 -- 172.21.15.135:0/5738575 >> 172.21.15.135:0/5738575 conn(0x7f6f3c077370 msgr2=0x7f6f3c0fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.597+0000 7f6f422c1640 1 -- 172.21.15.135:0/5738575 shutdown_connections 2024-04-20T12:28:39.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.597+0000 7f6f422c1640 1 -- 172.21.15.135:0/5738575 wait complete. 2024-04-20T12:28:39.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.598+0000 7f6f422c1640 1 Processor -- start 2024-04-20T12:28:39.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.598+0000 7f6f422c1640 1 -- start start 2024-04-20T12:28:39.600 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.598+0000 7f6f422c1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f3c100620 0x7f6f3c102240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.598+0000 7f6f422c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f3c100fe0 0x7f6f3c102780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.598+0000 7f6f422c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3c106690 0x7f6f3c102cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.598+0000 7f6f422c1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c110110 con 0x7f6f3c100fe0 2024-04-20T12:28:39.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.598+0000 7f6f422c1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c10ff90 con 0x7f6f3c106690 2024-04-20T12:28:39.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.598+0000 7f6f422c1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c110290 con 0x7f6f3c100620 2024-04-20T12:28:39.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.598+0000 7f6f3b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f3c100fe0 0x7f6f3c102780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.598+0000 7f6f3b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f3c100fe0 0x7f6f3c102780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55824/0 (socket says 172.21.15.135:55824) 2024-04-20T12:28:39.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.598+0000 7f6f3b7fe640 1 -- 172.21.15.135:0/120710153 learned_addr learned my addr 172.21.15.135:0/120710153 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.599+0000 7f6f4085e640 1 --2- 172.21.15.135:0/120710153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3c106690 0x7f6f3c102cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.599+0000 7f6f3bfff640 1 --2- 172.21.15.135:0/120710153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f3c100620 0x7f6f3c102240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.599+0000 7f6f3b7fe640 1 -- 172.21.15.135:0/120710153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f3c100620 msgr2=0x7f6f3c102240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.599+0000 7f6f3b7fe640 1 --2- 172.21.15.135:0/120710153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f3c100620 0x7f6f3c102240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.599+0000 7f6f3b7fe640 1 -- 172.21.15.135:0/120710153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3c106690 msgr2=0x7f6f3c102cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.601 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.599+0000 7f6f3b7fe640 1 --2- 172.21.15.135:0/120710153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3c106690 0x7f6f3c102cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.599+0000 7f6f3b7fe640 1 -- 172.21.15.135:0/120710153 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f3c1a6c60 con 0x7f6f3c100fe0 2024-04-20T12:28:39.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.599+0000 7f6f4085e640 1 --2- 172.21.15.135:0/120710153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3c106690 0x7f6f3c102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:39.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.599+0000 7f6f3b7fe640 1 --2- 172.21.15.135:0/120710153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f3c100fe0 0x7f6f3c102780 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000d950 tx=0x7f6f3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.599+0000 7f6f397fa640 1 -- 172.21.15.135:0/120710153 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f30017070 con 0x7f6f3c100fe0 2024-04-20T12:28:39.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.599+0000 7f6f397fa640 1 -- 172.21.15.135:0/120710153 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f30009c30 con 0x7f6f3c100fe0 2024-04-20T12:28:39.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.599+0000 7f6f422c1640 1 -- 172.21.15.135:0/120710153 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f3c1a6f50 con 0x7f6f3c100fe0 2024-04-20T12:28:39.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.599+0000 7f6f397fa640 1 -- 172.21.15.135:0/120710153 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3000f6b0 con 0x7f6f3c100fe0 2024-04-20T12:28:39.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.599+0000 7f6f422c1640 1 -- 172.21.15.135:0/120710153 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f3c1a7410 con 0x7f6f3c100fe0 2024-04-20T12:28:39.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.601+0000 7f6f397fa640 1 -- 172.21.15.135:0/120710153 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f6f300109d0 con 0x7f6f3c100fe0 2024-04-20T12:28:39.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.601+0000 7f6f44f8d740 1 Processor -- start 2024-04-20T12:28:39.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.601+0000 7f6f44f8d740 1 -- start start 2024-04-20T12:28:39.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f44f8d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4ee10 0x563bc5c4f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f44f8d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c4f730 0x563bc5c57dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f44f8d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c58310 0x563bc5c5a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f44f8d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563bc5bb4110 con 0x563bc5c4f730 2024-04-20T12:28:39.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f44f8d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563bc5b51550 con 0x563bc5c4ee10 2024-04-20T12:28:39.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f44f8d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563bc5bb00d0 con 0x563bc5c58310 2024-04-20T12:28:39.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f397fa640 1 --2- 172.21.15.135:0/120710153 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6f240a3d20 0x7f6f240a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f3bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c4f730 0x563bc5c57dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f3bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c4f730 0x563bc5c57dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55840/0 (socket says 172.21.15.135:55840) 2024-04-20T12:28:39.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f3bfff640 1 -- 172.21.15.135:0/3861119505 learned_addr learned my addr 172.21.15.135:0/3861119505 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f4085e640 1 --2- 172.21.15.135:0/3861119505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4ee10 0x563bc5c4f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f4085e640 1 --2- 172.21.15.135:0/120710153 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6f240a3d20 0x7f6f240a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f397fa640 1 -- 172.21.15.135:0/120710153 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f6f300d0840 con 0x7f6f3c100fe0 2024-04-20T12:28:39.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f3b7fe640 1 --2- 172.21.15.135:0/3861119505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c58310 0x563bc5c5a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f3bfff640 1 -- 172.21.15.135:0/3861119505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c58310 msgr2=0x563bc5c5a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f3bfff640 1 --2- 172.21.15.135:0/3861119505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c58310 0x563bc5c5a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f3bfff640 1 -- 172.21.15.135:0/3861119505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4ee10 msgr2=0x563bc5c4f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f3bfff640 1 --2- 172.21.15.135:0/3861119505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4ee10 0x563bc5c4f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f3bfff640 1 -- 172.21.15.135:0/3861119505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bc5b79900 con 0x563bc5c4f730 2024-04-20T12:28:39.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f3bfff640 1 --2- 172.21.15.135:0/3861119505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c4f730 0x563bc5c57dd0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009b30 tx=0x7f6f2c00e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36df6ac4306aaab server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.610 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f4085e640 1 --2- 172.21.15.135:0/120710153 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6f240a3d20 0x7f6f240a61e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400ab70 tx=0x7f6f3400a6d0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.602+0000 7f6f227fc640 1 -- 172.21.15.135:0/3861119505 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c016070 con 0x563bc5c4f730 2024-04-20T12:28:39.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.603+0000 7f6f227fc640 1 -- 172.21.15.135:0/3861119505 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f2c005500 con 0x563bc5c4f730 2024-04-20T12:28:39.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.603+0000 7f6f227fc640 1 -- 172.21.15.135:0/3861119505 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c011470 con 0x563bc5c4f730 2024-04-20T12:28:39.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.603+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3861119505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c4f730 msgr2=0x563bc5c57dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.603+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/3861119505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c4f730 0x563bc5c57dd0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009b30 tx=0x7f6f2c00e2f0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.603+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3861119505 shutdown_connections 2024-04-20T12:28:39.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.603+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/3861119505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c58310 0x563bc5c5a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.603+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/3861119505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c4f730 0x563bc5c57dd0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.603+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/3861119505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4ee10 0x563bc5c4f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.603+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3861119505 >> 172.21.15.135:0/3861119505 conn(0x563bc5c49540 msgr2=0x563bc5c49920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.603+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3861119505 shutdown_connections 2024-04-20T12:28:39.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.603+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3861119505 wait complete. 2024-04-20T12:28:39.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f44f8d740 1 -- start start 2024-04-20T12:28:39.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f44f8d740 1 Processor -- start 2024-04-20T12:28:39.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f44f8d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c4ee10 0x563bc5c55400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f44f8d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4f730 0x563bc5c55940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f44f8d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c55e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f44f8d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563bc5c5b100 con 0x563bc5c58310 2024-04-20T12:28:39.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f44f8d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x563bc5b6d500 con 0x563bc5c4f730 2024-04-20T12:28:39.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f44f8d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x563bc5c5b280 con 0x563bc5c4ee10 2024-04-20T12:28:39.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f44f8d740 10 client.0 _ll_register_callbacks cb 0x563bc5b522f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:39.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f4085e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c55e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f4085e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c55e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55854/0 (socket says 172.21.15.135:55854) 2024-04-20T12:28:39.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f4085e640 1 -- 172.21.15.135:0/2786131678 learned_addr learned my addr 172.21.15.135:0/2786131678 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f3b7fe640 1 --2- 172.21.15.135:0/2786131678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4f730 0x563bc5c55940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f3bfff640 1 --2- 172.21.15.135:0/2786131678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c4ee10 0x563bc5c55400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f4085e640 1 -- 172.21.15.135:0/2786131678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c4ee10 msgr2=0x563bc5c55400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f4085e640 1 --2- 172.21.15.135:0/2786131678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c4ee10 0x563bc5c55400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f4085e640 1 -- 172.21.15.135:0/2786131678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4f730 msgr2=0x563bc5c55940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f4085e640 1 --2- 172.21.15.135:0/2786131678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4f730 0x563bc5c55940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.604+0000 7f6f4085e640 1 -- 172.21.15.135:0/2786131678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bc58c63f0 con 0x563bc5c58310 2024-04-20T12:28:39.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f4085e640 1 --2- 172.21.15.135:0/2786131678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c55e80 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f6f34037000 tx=0x7f6f3402cff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939b391b9919f766 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:39.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f1b7fe640 1 -- 172.21.15.135:0/2786131678 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3403a070 con 0x563bc5c58310 2024-04-20T12:28:39.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f1b7fe640 1 -- 172.21.15.135:0/2786131678 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f6f34003cb0 con 0x563bc5c58310 2024-04-20T12:28:39.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f44f8d740 1 -- 172.21.15.135:0/2786131678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f2c005500 con 0x563bc5c58310 2024-04-20T12:28:39.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f1b7fe640 1 -- 172.21.15.135:0/2786131678 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6f3405a050 con 0x563bc5c58310 2024-04-20T12:28:39.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f44f8d740 10 client.17415 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:39.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f44f8d740 1 -- 172.21.15.135:0/2786131678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563bc59907d0 con 0x563bc5c58310 2024-04-20T12:28:39.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f1b7fe640 1 -- 172.21.15.135:0/2786131678 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f2c005500 con 0x563bc5c58310 2024-04-20T12:28:39.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f1b7fe640 1 -- 172.21.15.135:0/2786131678 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f6f34035920 con 0x563bc5c58310 2024-04-20T12:28:39.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f44f8d740 10 client.17415 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:39.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f44f8d740 10 client.17415 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:39.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f44f8d740 20 client.17415 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:39.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/2786131678 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563bc5c68740 0x563bc5c6ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f44f8d740 4 client.17415 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:39.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.605+0000 7f6f44f8d740 1 -- 172.21.15.135:0/2786131678 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bc5bc1b30 con 0x563bc5c68740 2024-04-20T12:28:39.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.606+0000 7f6f3bfff640 1 --2- 172.21.15.135:0/2786131678 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563bc5c68740 0x563bc5c6ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.606+0000 7f6f1b7fe640 10 client.17415 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:39.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.606+0000 7f6f3bfff640 1 --2- 172.21.15.135:0/2786131678 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563bc5c68740 0x563bc5c6ab70 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1626f02bd4284918 server_cookie=d5d68d881a74ed25 in_seq=0 out_seq=0 2024-04-20T12:28:39.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.607+0000 7f6f1b7fe640 1 -- 172.21.15.135:0/2786131678 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563bc5bc1b30 con 0x563bc5c68740 2024-04-20T12:28:39.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.607+0000 7f6f1b7fe640 10 client.17415 handle_command_reply: tid=0 2024-04-20T12:28:39.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.607+0000 7f6f44f8d740 1 client.17415 shutdown 2024-04-20T12:28:39.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.607+0000 7f6f44f8d740 1 -- 172.21.15.135:0/2786131678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 msgr2=0x563bc5c55e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.607+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/2786131678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c55e80 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f6f34037000 tx=0x7f6f3402cff0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.607+0000 7f6f44f8d740 1 -- 172.21.15.135:0/2786131678 shutdown_connections 2024-04-20T12:28:39.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.607+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/2786131678 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563bc5c68740 0x563bc5c6ab70 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.607+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/2786131678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c55e80 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.607+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/2786131678 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4f730 0x563bc5c55940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.607+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/2786131678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c4ee10 0x563bc5c55400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.607+0000 7f6f1b7fe640 0 client.17415 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:39.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.607+0000 7f6f44f8d740 1 -- 172.21.15.135:0/2786131678 >> 172.21.15.135:0/2786131678 conn(0x563bc5c49540 msgr2=0x563bc5c4b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.607+0000 7f6f44f8d740 1 -- 172.21.15.135:0/2786131678 shutdown_connections 2024-04-20T12:28:39.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.607+0000 7f6f44f8d740 1 -- 172.21.15.135:0/2786131678 wait complete. 2024-04-20T12:28:39.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.607+0000 7f6f44f8d740 20 client.17415 trim_cache size 0 max 16384 2024-04-20T12:28:39.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.620+0000 7f6f44f8d740 1 Processor -- start 2024-04-20T12:28:39.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.620+0000 7f6f44f8d740 1 -- start start 2024-04-20T12:28:39.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.620+0000 7f6f44f8d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4ee10 0x563bc5c57b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.620+0000 7f6f44f8d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c4f730 0x563bc5c63ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.620+0000 7f6f44f8d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c70440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.620+0000 7f6f44f8d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c1b1680 con 0x563bc5c58310 2024-04-20T12:28:39.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.620+0000 7f6f44f8d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c1b31c0 con 0x563bc5c4ee10 2024-04-20T12:28:39.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.620+0000 7f6f44f8d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c1b1d50 con 0x563bc5c4f730 2024-04-20T12:28:39.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.620+0000 7f6f4085e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c70440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.620+0000 7f6f4085e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c70440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55870/0 (socket says 172.21.15.135:55870) 2024-04-20T12:28:39.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.620+0000 7f6f4085e640 1 -- 172.21.15.135:0/3697468476 learned_addr learned my addr 172.21.15.135:0/3697468476 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f4085e640 1 -- 172.21.15.135:0/3697468476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c4f730 msgr2=0x563bc5c63ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f4085e640 1 --2- 172.21.15.135:0/3697468476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c4f730 0x563bc5c63ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f4085e640 1 -- 172.21.15.135:0/3697468476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4ee10 msgr2=0x563bc5c57b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f4085e640 1 --2- 172.21.15.135:0/3697468476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4ee10 0x563bc5c57b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f4085e640 1 -- 172.21.15.135:0/3697468476 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bc5c5aa70 con 0x563bc5c58310 2024-04-20T12:28:39.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f4085e640 1 --2- 172.21.15.135:0/3697468476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c70440 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6f34035f00 tx=0x7f6f34005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af4e2439a949e26 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f21ffb640 1 -- 172.21.15.135:0/3697468476 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3403a040 con 0x563bc5c58310 2024-04-20T12:28:39.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f21ffb640 1 -- 172.21.15.135:0/3697468476 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f3403b040 con 0x563bc5c58310 2024-04-20T12:28:39.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f21ffb640 1 -- 172.21.15.135:0/3697468476 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34004b40 con 0x563bc5c58310 2024-04-20T12:28:39.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3697468476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 msgr2=0x563bc5c70440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/3697468476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c70440 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6f34035f00 tx=0x7f6f34005ef0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3697468476 shutdown_connections 2024-04-20T12:28:39.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/3697468476 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c70440 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/3697468476 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c4f730 0x563bc5c63ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/3697468476 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4ee10 0x563bc5c57b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.621+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3697468476 >> 172.21.15.135:0/3697468476 conn(0x563bc5c49540 msgr2=0x563bc5c44570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3697468476 shutdown_connections 2024-04-20T12:28:39.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3697468476 wait complete. 2024-04-20T12:28:39.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f44f8d740 1 -- start start 2024-04-20T12:28:39.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f44f8d740 1 Processor -- start 2024-04-20T12:28:39.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f44f8d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4ee10 0x563bc5c606f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f44f8d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c4f730 0x563bc5c51a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f44f8d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c51fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f44f8d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c1b2af0 con 0x563bc5c58310 2024-04-20T12:28:39.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f44f8d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c1b2420 con 0x563bc5c4ee10 2024-04-20T12:28:39.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f44f8d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c1af650 con 0x563bc5c4f730 2024-04-20T12:28:39.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f44f8d740 10 client.0 _ll_register_callbacks cb 0x7f6f3400ac30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:39.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f4085e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c51fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f4085e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c51fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55882/0 (socket says 172.21.15.135:55882) 2024-04-20T12:28:39.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f4085e640 1 -- 172.21.15.135:0/3822260306 learned_addr learned my addr 172.21.15.135:0/3822260306 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:39.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f3b7fe640 1 --2- 172.21.15.135:0/3822260306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c4f730 0x563bc5c51a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.622+0000 7f6f3bfff640 1 --2- 172.21.15.135:0/3822260306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4ee10 0x563bc5c606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f4085e640 1 -- 172.21.15.135:0/3822260306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c4f730 msgr2=0x563bc5c51a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f4085e640 1 --2- 172.21.15.135:0/3822260306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c4f730 0x563bc5c51a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f4085e640 1 -- 172.21.15.135:0/3822260306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4ee10 msgr2=0x563bc5c606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:39.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f4085e640 1 --2- 172.21.15.135:0/3822260306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4ee10 0x563bc5c606f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f4085e640 1 -- 172.21.15.135:0/3822260306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bc5c52500 con 0x563bc5c58310 2024-04-20T12:28:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f3b7fe640 1 --2- 172.21.15.135:0/3822260306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c4f730 0x563bc5c51a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f3bfff640 1 --2- 172.21.15.135:0/3822260306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4ee10 0x563bc5c606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f4085e640 1 --2- 172.21.15.135:0/3822260306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c51fc0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400ad00 tx=0x7f6f34003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999c88ad0132721e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f1b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f1b7fe640 1 -- 172.21.15.135:0/3822260306 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3403a030 con 0x563bc5c58310 2024-04-20T12:28:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f1b7fe640 1 -- 172.21.15.135:0/3822260306 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f6f34004d50 con 0x563bc5c58310 2024-04-20T12:28:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3822260306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f3403b040 con 0x563bc5c58310 2024-04-20T12:28:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f1b7fe640 1 -- 172.21.15.135:0/3822260306 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6f3406f050 con 0x563bc5c58310 2024-04-20T12:28:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f44f8d740 10 client.17421 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3822260306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563bc5cce9d0 con 0x563bc5c58310 2024-04-20T12:28:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f1b7fe640 1 -- 172.21.15.135:0/3822260306 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f3403b040 con 0x563bc5c58310 2024-04-20T12:28:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f1b7fe640 1 -- 172.21.15.135:0/3822260306 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f6f3405f440 con 0x563bc5c58310 2024-04-20T12:28:39.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f44f8d740 10 client.17421 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f44f8d740 10 client.17421 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f44f8d740 20 client.17421 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/3822260306 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563bc5ccef80 0x563bc5cd1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f44f8d740 4 client.17421 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:28:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.623+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3822260306 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563bc5bbb9a0 con 0x563bc5ccef80 2024-04-20T12:28:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.624+0000 7f6f3bfff640 1 --2- 172.21.15.135:0/3822260306 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563bc5ccef80 0x563bc5cd1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.624+0000 7f6f1b7fe640 10 client.17421 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.624+0000 7f6f3bfff640 1 --2- 172.21.15.135:0/3822260306 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563bc5ccef80 0x563bc5cd1370 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abc79055c68e369b server_cookie=db577c2a2bd71544 in_seq=0 out_seq=0 2024-04-20T12:28:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.624+0000 7f6f1b7fe640 1 -- 172.21.15.135:0/3822260306 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563bc5bbb9a0 con 0x563bc5ccef80 2024-04-20T12:28:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.624+0000 7f6f1b7fe640 10 client.17421 handle_command_reply: tid=0 2024-04-20T12:28:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.624+0000 7f6f44f8d740 1 client.17421 shutdown 2024-04-20T12:28:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3822260306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 msgr2=0x563bc5c51fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/3822260306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c51fc0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400ad00 tx=0x7f6f34003f60 comp rx=0 tx=0).stop 2024-04-20T12:28:39.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3822260306 shutdown_connections 2024-04-20T12:28:39.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/3822260306 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x563bc5ccef80 0x563bc5cd1370 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/3822260306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563bc5c58310 0x563bc5c51fc0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/3822260306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x563bc5c4f730 0x563bc5c51a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f1b7fe640 0 client.17421 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:39.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f44f8d740 1 --2- 172.21.15.135:0/3822260306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x563bc5c4ee10 0x563bc5c606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3822260306 >> 172.21.15.135:0/3822260306 conn(0x563bc5c49540 msgr2=0x563bc5c4a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3822260306 shutdown_connections 2024-04-20T12:28:39.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f44f8d740 1 -- 172.21.15.135:0/3822260306 wait complete. 2024-04-20T12:28:39.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f44f8d740 20 client.17421 trim_cache size 0 max 16384 2024-04-20T12:28:39.631 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:28:39.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f422c1640 1 -- 172.21.15.135:0/120710153 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6f240a3d20 msgr2=0x7f6f240a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f422c1640 1 --2- 172.21.15.135:0/120710153 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6f240a3d20 0x7f6f240a61e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400ab70 tx=0x7f6f3400a6d0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f422c1640 1 -- 172.21.15.135:0/120710153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f3c100fe0 msgr2=0x7f6f3c102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:39.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f422c1640 1 --2- 172.21.15.135:0/120710153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f3c100fe0 0x7f6f3c102780 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000d950 tx=0x7f6f3000de10 comp rx=0 tx=0).stop 2024-04-20T12:28:39.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f422c1640 1 -- 172.21.15.135:0/120710153 shutdown_connections 2024-04-20T12:28:39.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f422c1640 1 --2- 172.21.15.135:0/120710153 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f3c106690 0x7f6f3c102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f422c1640 1 --2- 172.21.15.135:0/120710153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f3c100fe0 0x7f6f3c102780 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f422c1640 1 --2- 172.21.15.135:0/120710153 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6f240a3d20 0x7f6f240a61e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f422c1640 1 --2- 172.21.15.135:0/120710153 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f3c100620 0x7f6f3c102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:39.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f422c1640 1 -- 172.21.15.135:0/120710153 >> 172.21.15.135:0/120710153 conn(0x7f6f3c077370 msgr2=0x7f6f3c1049f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:39.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f422c1640 1 -- 172.21.15.135:0/120710153 shutdown_connections 2024-04-20T12:28:39.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:39.625+0000 7f6f422c1640 1 -- 172.21.15.135:0/120710153 wait complete. 2024-04-20T12:28:39.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:39 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3416889162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:28:40.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:39 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3416889162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:28:40.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:39 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3416889162' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:28:40.637 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:28:40.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:28:40.637 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:28:40.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.751+0000 7f9279f32640 1 -- 172.21.15.135:0/3785999122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9274102b50 msgr2=0x7f9274106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.751+0000 7f9279f32640 1 --2- 172.21.15.135:0/3785999122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9274102b50 0x7f9274106b90 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f9268009900 tx=0x7f926802bc30 comp rx=0 tx=0).stop 2024-04-20T12:28:40.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.751+0000 7f9279f32640 1 -- 172.21.15.135:0/3785999122 shutdown_connections 2024-04-20T12:28:40.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.751+0000 7f9279f32640 1 --2- 172.21.15.135:0/3785999122 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9274107270 0x7f927410ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.751+0000 7f9279f32640 1 --2- 172.21.15.135:0/3785999122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9274102b50 0x7f9274106b90 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.751+0000 7f9279f32640 1 --2- 172.21.15.135:0/3785999122 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f92741021a0 0x7f9274102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.751+0000 7f9279f32640 1 -- 172.21.15.135:0/3785999122 >> 172.21.15.135:0/3785999122 conn(0x7f92740793b0 msgr2=0x7f92740797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:40.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.752+0000 7f9279f32640 1 -- 172.21.15.135:0/3785999122 shutdown_connections 2024-04-20T12:28:40.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.752+0000 7f9279f32640 1 -- 172.21.15.135:0/3785999122 wait complete. 2024-04-20T12:28:40.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.752+0000 7f9279f32640 1 Processor -- start 2024-04-20T12:28:40.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.752+0000 7f9279f32640 1 -- start start 2024-04-20T12:28:40.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f9279f32640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92741021a0 0x7f927419e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f9279f32640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9274107270 0x7f927419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f9279f32640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92741986a0 0x7f9274198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f9279f32640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9274112300 con 0x7f92741021a0 2024-04-20T12:28:40.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f9279f32640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9274112180 con 0x7f92741986a0 2024-04-20T12:28:40.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f9279f32640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9274112480 con 0x7f9274107270 2024-04-20T12:28:40.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f92737fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92741021a0 0x7f927419e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f92737fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92741021a0 0x7f927419e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51930/0 (socket says 172.21.15.135:51930) 2024-04-20T12:28:40.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f92737fe640 1 -- 172.21.15.135:0/830005916 learned_addr learned my addr 172.21.15.135:0/830005916 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:40.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f9273fff640 1 --2- 172.21.15.135:0/830005916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92741986a0 0x7f9274198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f92737fe640 1 -- 172.21.15.135:0/830005916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9274107270 msgr2=0x7f927419eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f92737fe640 1 --2- 172.21.15.135:0/830005916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9274107270 0x7f927419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f92737fe640 1 -- 172.21.15.135:0/830005916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92741986a0 msgr2=0x7f9274198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f92737fe640 1 --2- 172.21.15.135:0/830005916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92741986a0 0x7f9274198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f92737fe640 1 -- 172.21.15.135:0/830005916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92741992a0 con 0x7f92741021a0 2024-04-20T12:28:40.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f9273fff640 1 --2- 172.21.15.135:0/830005916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92741986a0 0x7f9274198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:40.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f92737fe640 1 --2- 172.21.15.135:0/830005916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92741021a0 0x7f927419e5e0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f926400e9f0 tx=0x7f926400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:40.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f9270ff9640 1 -- 172.21.15.135:0/830005916 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926400cd80 con 0x7f92741021a0 2024-04-20T12:28:40.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f9270ff9640 1 -- 172.21.15.135:0/830005916 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9264005500 con 0x7f92741021a0 2024-04-20T12:28:40.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f9279f32640 1 -- 172.21.15.135:0/830005916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92741a5380 con 0x7f92741021a0 2024-04-20T12:28:40.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f9270ff9640 1 -- 172.21.15.135:0/830005916 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264010690 con 0x7f92741021a0 2024-04-20T12:28:40.757 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.753+0000 7f9279f32640 1 -- 172.21.15.135:0/830005916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92741a5730 con 0x7f92741021a0 2024-04-20T12:28:40.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.756+0000 7f9270ff9640 1 -- 172.21.15.135:0/830005916 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f92640046c0 con 0x7f92741021a0 2024-04-20T12:28:40.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.756+0000 7f927cc04740 1 Processor -- start 2024-04-20T12:28:40.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.756+0000 7f927cc04740 1 -- start start 2024-04-20T12:28:40.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.756+0000 7f927cc04740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f0522fe0 0x5600f05233c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f927cc04740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0523900 0x5600f052bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f927cc04740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f052c4e0 0x5600f052e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f927cc04740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5600f0487f00 con 0x5600f052c4e0 2024-04-20T12:28:40.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f927cc04740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5600f0425530 con 0x5600f0523900 2024-04-20T12:28:40.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f927cc04740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5600f0483ec0 con 0x5600f0522fe0 2024-04-20T12:28:40.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9272ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f052c4e0 0x5600f052e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9272ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f052c4e0 0x5600f052e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51932/0 (socket says 172.21.15.135:51932) 2024-04-20T12:28:40.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9272ffd640 1 -- 172.21.15.135:0/784157851 learned_addr learned my addr 172.21.15.135:0/784157851 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:40.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9270ff9640 1 --2- 172.21.15.135:0/830005916 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f925c0a3d20 0x7f925c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f92737fe640 1 --2- 172.21.15.135:0/784157851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0523900 0x5600f052bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9273fff640 1 --2- 172.21.15.135:0/784157851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f0522fe0 0x5600f05233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9272ffd640 1 -- 172.21.15.135:0/784157851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f0522fe0 msgr2=0x5600f05233c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9272ffd640 1 --2- 172.21.15.135:0/784157851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f0522fe0 0x5600f05233c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9272ffd640 1 -- 172.21.15.135:0/784157851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0523900 msgr2=0x5600f052bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9272ffd640 1 --2- 172.21.15.135:0/784157851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0523900 0x5600f052bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9273fff640 1 --2- 172.21.15.135:0/830005916 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f925c0a3d20 0x7f925c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9272ffd640 1 -- 172.21.15.135:0/784157851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600f02627e0 con 0x5600f052c4e0 2024-04-20T12:28:40.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f92737fe640 1 --2- 172.21.15.135:0/784157851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0523900 0x5600f052bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:28:40.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9270ff9640 1 -- 172.21.15.135:0/830005916 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f92640d10f0 con 0x7f92741021a0 2024-04-20T12:28:40.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9272ffd640 1 --2- 172.21.15.135:0/784157851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f052c4e0 0x5600f052e8d0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f926802c170 tx=0x7f9268009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a816cb6140ac26a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:40.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9259ffb640 1 -- 172.21.15.135:0/784157851 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9268041020 con 0x5600f052c4e0 2024-04-20T12:28:40.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9273fff640 1 --2- 172.21.15.135:0/830005916 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f925c0a3d20 0x7f925c0a61e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f926c005fd0 tx=0x7f926c009240 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:40.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9259ffb640 1 -- 172.21.15.135:0/784157851 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9268004040 con 0x5600f052c4e0 2024-04-20T12:28:40.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.757+0000 7f9259ffb640 1 -- 172.21.15.135:0/784157851 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9268003ab0 con 0x5600f052c4e0 2024-04-20T12:28:40.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.758+0000 7f927cc04740 1 -- 172.21.15.135:0/784157851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f052c4e0 msgr2=0x5600f052e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.758+0000 7f927cc04740 1 --2- 172.21.15.135:0/784157851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f052c4e0 0x5600f052e8d0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f926802c170 tx=0x7f9268009560 comp rx=0 tx=0).stop 2024-04-20T12:28:40.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.758+0000 7f927cc04740 1 -- 172.21.15.135:0/784157851 shutdown_connections 2024-04-20T12:28:40.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.758+0000 7f927cc04740 1 --2- 172.21.15.135:0/784157851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f052c4e0 0x5600f052e8d0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.758+0000 7f927cc04740 1 --2- 172.21.15.135:0/784157851 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0523900 0x5600f052bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.758+0000 7f927cc04740 1 --2- 172.21.15.135:0/784157851 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f0522fe0 0x5600f05233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.758+0000 7f927cc04740 1 -- 172.21.15.135:0/784157851 >> 172.21.15.135:0/784157851 conn(0x5600f051d710 msgr2=0x5600f051daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:40.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.758+0000 7f927cc04740 1 -- 172.21.15.135:0/784157851 shutdown_connections 2024-04-20T12:28:40.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.758+0000 7f927cc04740 1 -- 172.21.15.135:0/784157851 wait complete. 2024-04-20T12:28:40.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.758+0000 7f927cc04740 1 -- start start 2024-04-20T12:28:40.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f927cc04740 1 Processor -- start 2024-04-20T12:28:40.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f927cc04740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f0522fe0 0x5600f052bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f927cc04740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f0523900 0x5600f0529170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f927cc04740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f052c4e0 0x5600f05296b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f927cc04740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5600f052f270 con 0x5600f0523900 2024-04-20T12:28:40.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f927cc04740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5600f0410480 con 0x5600f052c4e0 2024-04-20T12:28:40.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f927cc04740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5600f052f3f0 con 0x5600f0522fe0 2024-04-20T12:28:40.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f927cc04740 10 client.0 _ll_register_callbacks cb 0x5600f040fe70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:40.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f9272ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f0523900 0x5600f0529170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f9272ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f0523900 0x5600f0529170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51940/0 (socket says 172.21.15.135:51940) 2024-04-20T12:28:40.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f9272ffd640 1 -- 172.21.15.135:0/264114568 learned_addr learned my addr 172.21.15.135:0/264114568 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:40.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f92737fe640 1 --2- 172.21.15.135:0/264114568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f0522fe0 0x5600f052bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f9272ffd640 1 -- 172.21.15.135:0/264114568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f0522fe0 msgr2=0x5600f052bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f9272ffd640 1 --2- 172.21.15.135:0/264114568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f0522fe0 0x5600f052bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f9272ffd640 1 -- 172.21.15.135:0/264114568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f052c4e0 msgr2=0x5600f05296b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f9272ffd640 1 --2- 172.21.15.135:0/264114568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f052c4e0 0x5600f05296b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.759+0000 7f9272ffd640 1 -- 172.21.15.135:0/264114568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600f02c2f70 con 0x5600f0523900 2024-04-20T12:28:40.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f9272ffd640 1 --2- 172.21.15.135:0/264114568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f0523900 0x5600f0529170 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f9268003790 tx=0x7f926802cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302ee5c3ed226b61 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:40.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f9252ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:40.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f9252ffd640 1 -- 172.21.15.135:0/264114568 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9268041030 con 0x5600f0523900 2024-04-20T12:28:40.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f9252ffd640 1 -- 172.21.15.135:0/264114568 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9268003830 con 0x5600f0523900 2024-04-20T12:28:40.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f927cc04740 1 -- 172.21.15.135:0/264114568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9268004040 con 0x5600f0523900 2024-04-20T12:28:40.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f9252ffd640 1 -- 172.21.15.135:0/264114568 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9268058050 con 0x5600f0523900 2024-04-20T12:28:40.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f927cc04740 10 client.17433 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:40.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f927cc04740 1 -- 172.21.15.135:0/264114568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5600f015a170 con 0x5600f0523900 2024-04-20T12:28:40.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f9252ffd640 1 -- 172.21.15.135:0/264114568 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9268004040 con 0x5600f0523900 2024-04-20T12:28:40.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f9252ffd640 1 -- 172.21.15.135:0/264114568 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f926804fae0 con 0x5600f0523900 2024-04-20T12:28:40.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f927cc04740 10 client.17433 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:40.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f927cc04740 10 client.17433 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:40.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f927cc04740 20 client.17433 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:40.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f927cc04740 1 --2- 172.21.15.135:0/264114568 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5600f053c330 0x5600f053e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f927cc04740 4 client.17433 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:40.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.760+0000 7f927cc04740 1 -- 172.21.15.135:0/264114568 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600f0495920 con 0x5600f053c330 2024-04-20T12:28:40.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.761+0000 7f92737fe640 1 --2- 172.21.15.135:0/264114568 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5600f053c330 0x5600f053e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.761+0000 7f92737fe640 1 --2- 172.21.15.135:0/264114568 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5600f053c330 0x5600f053e720 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9ea1693473b7127 server_cookie=426308c3de1f260 in_seq=0 out_seq=0 2024-04-20T12:28:40.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.761+0000 7f9252ffd640 10 client.17433 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:40.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.762+0000 7f9252ffd640 1 -- 172.21.15.135:0/264114568 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5600f0495920 con 0x5600f053c330 2024-04-20T12:28:40.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.762+0000 7f9252ffd640 10 client.17433 handle_command_reply: tid=0 2024-04-20T12:28:40.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.762+0000 7f927cc04740 1 client.17433 shutdown 2024-04-20T12:28:40.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.762+0000 7f927cc04740 1 -- 172.21.15.135:0/264114568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f0523900 msgr2=0x5600f0529170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.762+0000 7f927cc04740 1 --2- 172.21.15.135:0/264114568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f0523900 0x5600f0529170 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f9268003790 tx=0x7f926802cb30 comp rx=0 tx=0).stop 2024-04-20T12:28:40.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.762+0000 7f927cc04740 1 -- 172.21.15.135:0/264114568 shutdown_connections 2024-04-20T12:28:40.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.762+0000 7f927cc04740 1 --2- 172.21.15.135:0/264114568 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5600f053c330 0x5600f053e720 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.762+0000 7f927cc04740 1 --2- 172.21.15.135:0/264114568 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f052c4e0 0x5600f05296b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.762+0000 7f9252ffd640 0 client.17433 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:40.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.762+0000 7f927cc04740 1 --2- 172.21.15.135:0/264114568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f0523900 0x5600f0529170 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.762+0000 7f927cc04740 1 --2- 172.21.15.135:0/264114568 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f0522fe0 0x5600f052bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.762+0000 7f927cc04740 1 -- 172.21.15.135:0/264114568 >> 172.21.15.135:0/264114568 conn(0x5600f051d710 msgr2=0x5600f051f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:40.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.762+0000 7f927cc04740 1 -- 172.21.15.135:0/264114568 shutdown_connections 2024-04-20T12:28:40.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.762+0000 7f927cc04740 1 -- 172.21.15.135:0/264114568 wait complete. 2024-04-20T12:28:40.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.762+0000 7f927cc04740 20 client.17433 trim_cache size 0 max 16384 2024-04-20T12:28:40.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f927cc04740 1 Processor -- start 2024-04-20T12:28:40.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f927cc04740 1 -- start start 2024-04-20T12:28:40.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f927cc04740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f051d710 0x5600f051c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f927cc04740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0522fe0 0x5600f052b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f927cc04740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f0523900 0x5600f052bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f927cc04740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f92741af390 con 0x5600f051d710 2024-04-20T12:28:40.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f927cc04740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f92741b0ed0 con 0x5600f0522fe0 2024-04-20T12:28:40.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f927cc04740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f92741afa60 con 0x5600f0523900 2024-04-20T12:28:40.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f92737fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f051d710 0x5600f051c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f92737fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f051d710 0x5600f051c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51946/0 (socket says 172.21.15.135:51946) 2024-04-20T12:28:40.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f92737fe640 1 -- 172.21.15.135:0/1490329593 learned_addr learned my addr 172.21.15.135:0/1490329593 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:40.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f92737fe640 1 -- 172.21.15.135:0/1490329593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f0523900 msgr2=0x5600f052bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f92737fe640 1 --2- 172.21.15.135:0/1490329593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f0523900 0x5600f052bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f92737fe640 1 -- 172.21.15.135:0/1490329593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0522fe0 msgr2=0x5600f052b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f92737fe640 1 --2- 172.21.15.135:0/1490329593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0522fe0 0x5600f052b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f92737fe640 1 -- 172.21.15.135:0/1490329593 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600f0523730 con 0x5600f051d710 2024-04-20T12:28:40.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f92737fe640 1 --2- 172.21.15.135:0/1490329593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f051d710 0x5600f051c500 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f92640049d0 tx=0x7f92640bd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36677ccc2ec773b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:40.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f92597fa640 1 -- 172.21.15.135:0/1490329593 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92640a5980 con 0x5600f051d710 2024-04-20T12:28:40.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f92597fa640 1 -- 172.21.15.135:0/1490329593 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f926409cd10 con 0x5600f051d710 2024-04-20T12:28:40.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.780+0000 7f92597fa640 1 -- 172.21.15.135:0/1490329593 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9264099380 con 0x5600f051d710 2024-04-20T12:28:40.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.781+0000 7f927cc04740 1 -- 172.21.15.135:0/1490329593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f051d710 msgr2=0x5600f051c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.781+0000 7f927cc04740 1 --2- 172.21.15.135:0/1490329593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f051d710 0x5600f051c500 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f92640049d0 tx=0x7f92640bd040 comp rx=0 tx=0).stop 2024-04-20T12:28:40.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.781+0000 7f927cc04740 1 -- 172.21.15.135:0/1490329593 shutdown_connections 2024-04-20T12:28:40.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.781+0000 7f927cc04740 1 --2- 172.21.15.135:0/1490329593 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f0523900 0x5600f052bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.781+0000 7f927cc04740 1 --2- 172.21.15.135:0/1490329593 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0522fe0 0x5600f052b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.781+0000 7f927cc04740 1 --2- 172.21.15.135:0/1490329593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f051d710 0x5600f051c500 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.781+0000 7f927cc04740 1 -- 172.21.15.135:0/1490329593 >> 172.21.15.135:0/1490329593 conn(0x5600f0527df0 msgr2=0x5600f05246b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:40.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.781+0000 7f927cc04740 1 -- 172.21.15.135:0/1490329593 shutdown_connections 2024-04-20T12:28:40.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.781+0000 7f927cc04740 1 -- 172.21.15.135:0/1490329593 wait complete. 2024-04-20T12:28:40.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.781+0000 7f927cc04740 1 -- start start 2024-04-20T12:28:40.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f927cc04740 1 Processor -- start 2024-04-20T12:28:40.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f927cc04740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f051d710 0x5600f0531640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f927cc04740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f0522fe0 0x5600f0531b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f927cc04740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0523900 0x5600f05320c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f927cc04740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f92741b0800 con 0x5600f0522fe0 2024-04-20T12:28:40.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f927cc04740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f92741b0130 con 0x5600f0523900 2024-04-20T12:28:40.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f927cc04740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f92741ad360 con 0x5600f051d710 2024-04-20T12:28:40.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f927cc04740 10 client.0 _ll_register_callbacks cb 0x7f9268005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:40.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f9272ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f0522fe0 0x5600f0531b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f9272ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f0522fe0 0x5600f0531b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51948/0 (socket says 172.21.15.135:51948) 2024-04-20T12:28:40.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f9272ffd640 1 -- 172.21.15.135:0/3516442645 learned_addr learned my addr 172.21.15.135:0/3516442645 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:40.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f9273fff640 1 --2- 172.21.15.135:0/3516442645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0523900 0x5600f05320c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f9272ffd640 1 -- 172.21.15.135:0/3516442645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f051d710 msgr2=0x5600f0531640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f9272ffd640 1 --2- 172.21.15.135:0/3516442645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f051d710 0x5600f0531640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f9272ffd640 1 -- 172.21.15.135:0/3516442645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0523900 msgr2=0x5600f05320c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f9272ffd640 1 --2- 172.21.15.135:0/3516442645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0523900 0x5600f05320c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f9272ffd640 1 -- 172.21.15.135:0/3516442645 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600f05a26d0 con 0x5600f0522fe0 2024-04-20T12:28:40.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f9273fff640 1 --2- 172.21.15.135:0/3516442645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0523900 0x5600f05320c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:40.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f9272ffd640 1 --2- 172.21.15.135:0/3516442645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f0522fe0 0x5600f0531b80 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f926802c170 tx=0x7f9268004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd781ab25a647259 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:40.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f9252ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:40.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.782+0000 7f9252ffd640 1 -- 172.21.15.135:0/3516442645 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9268041070 con 0x5600f0522fe0 2024-04-20T12:28:40.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.783+0000 7f9252ffd640 1 -- 172.21.15.135:0/3516442645 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9268034930 con 0x5600f0522fe0 2024-04-20T12:28:40.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.783+0000 7f927cc04740 1 -- 172.21.15.135:0/3516442645 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f926409cd10 con 0x5600f0522fe0 2024-04-20T12:28:40.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.783+0000 7f9252ffd640 1 -- 172.21.15.135:0/3516442645 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9268034690 con 0x5600f0522fe0 2024-04-20T12:28:40.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.783+0000 7f927cc04740 10 client.17439 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:40.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.783+0000 7f927cc04740 1 -- 172.21.15.135:0/3516442645 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5600f05a3a10 con 0x5600f0522fe0 2024-04-20T12:28:40.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.783+0000 7f9252ffd640 1 -- 172.21.15.135:0/3516442645 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f926409cd10 con 0x5600f0522fe0 2024-04-20T12:28:40.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.783+0000 7f9252ffd640 1 -- 172.21.15.135:0/3516442645 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f92680037c0 con 0x5600f0522fe0 2024-04-20T12:28:40.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.783+0000 7f927cc04740 10 client.17439 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:40.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.783+0000 7f927cc04740 10 client.17439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:40.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.783+0000 7f927cc04740 20 client.17439 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:40.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.783+0000 7f927cc04740 1 --2- 172.21.15.135:0/3516442645 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5600f052c4e0 0x5600f05a6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.783+0000 7f927cc04740 4 client.17439 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:28:40.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.783+0000 7f927cc04740 1 -- 172.21.15.135:0/3516442645 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5600f048f790 con 0x5600f052c4e0 2024-04-20T12:28:40.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.783+0000 7f92737fe640 1 --2- 172.21.15.135:0/3516442645 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5600f052c4e0 0x5600f05a6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.784+0000 7f9252ffd640 10 client.17439 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:40.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.784+0000 7f92737fe640 1 --2- 172.21.15.135:0/3516442645 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5600f052c4e0 0x5600f05a6170 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95950b3301d2bab8 server_cookie=d48fa5aef351dc1c in_seq=0 out_seq=0 2024-04-20T12:28:40.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.785+0000 7f9252ffd640 1 -- 172.21.15.135:0/3516442645 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5600f048f790 con 0x5600f052c4e0 2024-04-20T12:28:40.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.785+0000 7f9252ffd640 10 client.17439 handle_command_reply: tid=0 2024-04-20T12:28:40.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.785+0000 7f927cc04740 1 client.17439 shutdown 2024-04-20T12:28:40.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.785+0000 7f927cc04740 1 -- 172.21.15.135:0/3516442645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f0522fe0 msgr2=0x5600f0531b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.785+0000 7f927cc04740 1 --2- 172.21.15.135:0/3516442645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f0522fe0 0x5600f0531b80 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f926802c170 tx=0x7f9268004500 comp rx=0 tx=0).stop 2024-04-20T12:28:40.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.785+0000 7f927cc04740 1 -- 172.21.15.135:0/3516442645 shutdown_connections 2024-04-20T12:28:40.793 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.785+0000 7f927cc04740 1 --2- 172.21.15.135:0/3516442645 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5600f052c4e0 0x5600f05a6170 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.785+0000 7f927cc04740 1 --2- 172.21.15.135:0/3516442645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5600f0523900 0x5600f05320c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.785+0000 7f9252ffd640 0 client.17439 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:40.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.785+0000 7f927cc04740 1 --2- 172.21.15.135:0/3516442645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5600f0522fe0 0x5600f0531b80 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.785+0000 7f927cc04740 1 --2- 172.21.15.135:0/3516442645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5600f051d710 0x5600f0531640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.785+0000 7f927cc04740 1 -- 172.21.15.135:0/3516442645 >> 172.21.15.135:0/3516442645 conn(0x5600f0527df0 msgr2=0x5600f0523e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:40.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.785+0000 7f927cc04740 1 -- 172.21.15.135:0/3516442645 shutdown_connections 2024-04-20T12:28:40.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.785+0000 7f927cc04740 1 -- 172.21.15.135:0/3516442645 wait complete. 2024-04-20T12:28:40.794 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.785+0000 7f927cc04740 20 client.17439 trim_cache size 0 max 16384 2024-04-20T12:28:40.795 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:28:40.795 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:28:40.795 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "80c64ecb-8404-4249-826b-84ab2959df5a", 2024-04-20T12:28:40.795 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:28:40.795 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:28:40.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.786+0000 7f9279f32640 1 -- 172.21.15.135:0/830005916 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f925c0a3d20 msgr2=0x7f925c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.786+0000 7f9279f32640 1 --2- 172.21.15.135:0/830005916 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f925c0a3d20 0x7f925c0a61e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f926c005fd0 tx=0x7f926c009240 comp rx=0 tx=0).stop 2024-04-20T12:28:40.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.786+0000 7f9279f32640 1 -- 172.21.15.135:0/830005916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92741021a0 msgr2=0x7f927419e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.786+0000 7f9279f32640 1 --2- 172.21.15.135:0/830005916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92741021a0 0x7f927419e5e0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f926400e9f0 tx=0x7f926400edf0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.786+0000 7f9279f32640 1 -- 172.21.15.135:0/830005916 shutdown_connections 2024-04-20T12:28:40.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.786+0000 7f9279f32640 1 --2- 172.21.15.135:0/830005916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f92741986a0 0x7f9274198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.786+0000 7f9279f32640 1 --2- 172.21.15.135:0/830005916 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f925c0a3d20 0x7f925c0a61e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.786+0000 7f9279f32640 1 --2- 172.21.15.135:0/830005916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9274107270 0x7f927419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.786+0000 7f9279f32640 1 --2- 172.21.15.135:0/830005916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92741021a0 0x7f927419e5e0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.786+0000 7f9279f32640 1 -- 172.21.15.135:0/830005916 >> 172.21.15.135:0/830005916 conn(0x7f92740793b0 msgr2=0x7f92740fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:40.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.786+0000 7f9279f32640 1 -- 172.21.15.135:0/830005916 shutdown_connections 2024-04-20T12:28:40.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.786+0000 7f9279f32640 1 -- 172.21.15.135:0/830005916 wait complete. 2024-04-20T12:28:40.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:28:40.799 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:28:40.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.899+0000 7fde7606d640 1 -- 172.21.15.135:0/4100760506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde70102b60 msgr2=0x7fde70106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.899+0000 7fde7606d640 1 --2- 172.21.15.135:0/4100760506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde70102b60 0x7fde70106ba0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fde64009900 tx=0x7fde6402bc30 comp rx=0 tx=0).stop 2024-04-20T12:28:40.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.899+0000 7fde7606d640 1 -- 172.21.15.135:0/4100760506 shutdown_connections 2024-04-20T12:28:40.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.899+0000 7fde7606d640 1 --2- 172.21.15.135:0/4100760506 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde70107280 0x7fde7010ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.899+0000 7fde7606d640 1 --2- 172.21.15.135:0/4100760506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde70102b60 0x7fde70106ba0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.899+0000 7fde7606d640 1 --2- 172.21.15.135:0/4100760506 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde701021b0 0x7fde70102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.899+0000 7fde7606d640 1 -- 172.21.15.135:0/4100760506 >> 172.21.15.135:0/4100760506 conn(0x7fde700fd9d0 msgr2=0x7fde700ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:40.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.899+0000 7fde7606d640 1 -- 172.21.15.135:0/4100760506 shutdown_connections 2024-04-20T12:28:40.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.899+0000 7fde7606d640 1 -- 172.21.15.135:0/4100760506 wait complete. 2024-04-20T12:28:40.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde7606d640 1 Processor -- start 2024-04-20T12:28:40.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde7606d640 1 -- start start 2024-04-20T12:28:40.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde7606d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde701021b0 0x7fde7019e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde7606d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde70107280 0x7fde7019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde7606d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde701987c0 0x7fde70198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde7606d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fde70112310 con 0x7fde70107280 2024-04-20T12:28:40.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde7606d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fde70112190 con 0x7fde701987c0 2024-04-20T12:28:40.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde7606d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fde70112490 con 0x7fde701021b0 2024-04-20T12:28:40.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde6effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde70107280 0x7fde7019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde6effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde70107280 0x7fde7019ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51962/0 (socket says 172.21.15.135:51962) 2024-04-20T12:28:40.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde6effd640 1 -- 172.21.15.135:0/673308331 learned_addr learned my addr 172.21.15.135:0/673308331 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:40.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde6f7fe640 1 --2- 172.21.15.135:0/673308331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde701021b0 0x7fde7019e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde6ffff640 1 --2- 172.21.15.135:0/673308331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde701987c0 0x7fde70198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde6effd640 1 -- 172.21.15.135:0/673308331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde701021b0 msgr2=0x7fde7019e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde6effd640 1 --2- 172.21.15.135:0/673308331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde701021b0 0x7fde7019e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde6effd640 1 -- 172.21.15.135:0/673308331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde701987c0 msgr2=0x7fde70198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde6effd640 1 --2- 172.21.15.135:0/673308331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde701987c0 0x7fde70198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.900+0000 7fde6effd640 1 -- 172.21.15.135:0/673308331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde701993a0 con 0x7fde70107280 2024-04-20T12:28:40.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.901+0000 7fde6effd640 1 --2- 172.21.15.135:0/673308331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde70107280 0x7fde7019ebb0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fde64036040 tx=0x7fde6402cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:40.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.901+0000 7fde6cff9640 1 -- 172.21.15.135:0/673308331 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde64041070 con 0x7fde70107280 2024-04-20T12:28:40.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.901+0000 7fde6cff9640 1 -- 172.21.15.135:0/673308331 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde640054e0 con 0x7fde70107280 2024-04-20T12:28:40.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.901+0000 7fde7606d640 1 -- 172.21.15.135:0/673308331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde701a5480 con 0x7fde70107280 2024-04-20T12:28:40.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.901+0000 7fde6cff9640 1 -- 172.21.15.135:0/673308331 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde64034440 con 0x7fde70107280 2024-04-20T12:28:40.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.901+0000 7fde7606d640 1 -- 172.21.15.135:0/673308331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde701a5830 con 0x7fde70107280 2024-04-20T12:28:40.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.903+0000 7fde6cff9640 1 -- 172.21.15.135:0/673308331 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fde64044070 con 0x7fde70107280 2024-04-20T12:28:40.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.903+0000 7fde78c69740 1 Processor -- start 2024-04-20T12:28:40.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.903+0000 7fde78c69740 1 -- start start 2024-04-20T12:28:40.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6cff9640 1 --2- 172.21.15.135:0/673308331 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde580a3d20 0x7fde580a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde78c69740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b688d20 0x55852b689100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde78c69740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b689640 0x55852b691ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde78c69740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b692220 0x55852b694610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde78c69740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55852b5ee1b0 con 0x55852b692220 2024-04-20T12:28:40.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde78c69740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55852b58b390 con 0x55852b689640 2024-04-20T12:28:40.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde78c69740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55852b5ea170 con 0x55852b688d20 2024-04-20T12:28:40.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6ffff640 1 --2- 172.21.15.135:0/673308331 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde580a3d20 0x7fde580a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6cff9640 1 -- 172.21.15.135:0/673308331 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fde640f2920 con 0x7fde70107280 2024-04-20T12:28:40.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b688d20 0x55852b689100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b692220 0x55852b694610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6f7fe640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b688d20 0x55852b689100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.135:49750/0 (socket says 172.21.15.135:49750) 2024-04-20T12:28:40.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6f7fe640 1 -- 172.21.15.135:0/1554815331 learned_addr learned my addr 172.21.15.135:0/1554815331 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:40.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6effd640 1 --2- 172.21.15.135:0/1554815331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b689640 0x55852b691ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6ffff640 1 -- 172.21.15.135:0/1554815331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b688d20 msgr2=0x55852b689100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6ffff640 1 --2- 172.21.15.135:0/1554815331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b688d20 0x55852b689100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6ffff640 1 -- 172.21.15.135:0/1554815331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b689640 msgr2=0x55852b691ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6ffff640 1 --2- 172.21.15.135:0/1554815331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b689640 0x55852b691ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6ffff640 1 -- 172.21.15.135:0/1554815331 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55852b3ca7d0 con 0x55852b692220 2024-04-20T12:28:40.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6f7fe640 1 --2- 172.21.15.135:0/1554815331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b688d20 0x55852b689100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:28:40.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6ffff640 1 --2- 172.21.15.135:0/673308331 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde580a3d20 0x7fde580a61e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fde68009fd0 tx=0x7fde68009d40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:40.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde6ffff640 1 --2- 172.21.15.135:0/1554815331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b692220 0x55852b694610 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fde68009270 tx=0x7fde68012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44eefc70387f142 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:40.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde55ffb640 1 -- 172.21.15.135:0/1554815331 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde68003970 con 0x55852b692220 2024-04-20T12:28:40.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde55ffb640 1 -- 172.21.15.135:0/1554815331 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde6801f740 con 0x55852b692220 2024-04-20T12:28:40.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.904+0000 7fde55ffb640 1 -- 172.21.15.135:0/1554815331 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde68004270 con 0x55852b692220 2024-04-20T12:28:40.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.905+0000 7fde78c69740 1 -- 172.21.15.135:0/1554815331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b692220 msgr2=0x55852b694610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.905+0000 7fde78c69740 1 --2- 172.21.15.135:0/1554815331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b692220 0x55852b694610 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fde68009270 tx=0x7fde68012f90 comp rx=0 tx=0).stop 2024-04-20T12:28:40.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.905+0000 7fde78c69740 1 -- 172.21.15.135:0/1554815331 shutdown_connections 2024-04-20T12:28:40.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.905+0000 7fde78c69740 1 --2- 172.21.15.135:0/1554815331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b692220 0x55852b694610 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.905+0000 7fde78c69740 1 --2- 172.21.15.135:0/1554815331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b689640 0x55852b691ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.905+0000 7fde78c69740 1 --2- 172.21.15.135:0/1554815331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b688d20 0x55852b689100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.905+0000 7fde78c69740 1 -- 172.21.15.135:0/1554815331 >> 172.21.15.135:0/1554815331 conn(0x55852b683450 msgr2=0x55852b683830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:40.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.905+0000 7fde78c69740 1 -- 172.21.15.135:0/1554815331 shutdown_connections 2024-04-20T12:28:40.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.905+0000 7fde78c69740 1 -- 172.21.15.135:0/1554815331 wait complete. 2024-04-20T12:28:40.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.905+0000 7fde78c69740 1 -- start start 2024-04-20T12:28:40.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde78c69740 1 Processor -- start 2024-04-20T12:28:40.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde78c69740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b688d20 0x55852b68f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde78c69740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b689640 0x55852b68f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde78c69740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b692220 0x55852b68fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde78c69740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55852b694fb0 con 0x55852b688d20 2024-04-20T12:28:40.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde78c69740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55852b5a72f0 con 0x55852b689640 2024-04-20T12:28:40.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde78c69740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55852b695130 con 0x55852b692220 2024-04-20T12:28:40.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde78c69740 10 client.0 _ll_register_callbacks cb 0x55852b5714e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:40.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde6f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b688d20 0x55852b68f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde6f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b688d20 0x55852b68f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51978/0 (socket says 172.21.15.135:51978) 2024-04-20T12:28:40.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde6f7fe640 1 -- 172.21.15.135:0/3484982836 learned_addr learned my addr 172.21.15.135:0/3484982836 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:40.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde6effd640 1 --2- 172.21.15.135:0/3484982836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b689640 0x55852b68f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde6ffff640 1 --2- 172.21.15.135:0/3484982836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b692220 0x55852b68fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde6f7fe640 1 -- 172.21.15.135:0/3484982836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b692220 msgr2=0x55852b68fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde6f7fe640 1 --2- 172.21.15.135:0/3484982836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b692220 0x55852b68fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde6f7fe640 1 -- 172.21.15.135:0/3484982836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b689640 msgr2=0x55852b68f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde6f7fe640 1 --2- 172.21.15.135:0/3484982836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b689640 0x55852b68f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde6f7fe640 1 -- 172.21.15.135:0/3484982836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55852b3003f0 con 0x55852b688d20 2024-04-20T12:28:40.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde6ffff640 1 --2- 172.21.15.135:0/3484982836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b692220 0x55852b68fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:28:40.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.906+0000 7fde6f7fe640 1 --2- 172.21.15.135:0/3484982836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b688d20 0x55852b68f2d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fde6000ba50 tx=0x7fde6000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f591de8ca3cead server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:40.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde4effd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:40.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde4effd640 1 -- 172.21.15.135:0/3484982836 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde60011440 con 0x55852b688d20 2024-04-20T12:28:40.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde4effd640 1 -- 172.21.15.135:0/3484982836 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fde600115e0 con 0x55852b688d20 2024-04-20T12:28:40.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde78c69740 1 -- 172.21.15.135:0/3484982836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde6801f740 con 0x55852b688d20 2024-04-20T12:28:40.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde4effd640 1 -- 172.21.15.135:0/3484982836 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fde60005020 con 0x55852b688d20 2024-04-20T12:28:40.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde78c69740 10 client.17451 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:40.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde78c69740 1 -- 172.21.15.135:0/3484982836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55852b2c00f0 con 0x55852b688d20 2024-04-20T12:28:40.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde4effd640 1 -- 172.21.15.135:0/3484982836 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde6801f740 con 0x55852b688d20 2024-04-20T12:28:40.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde4effd640 1 -- 172.21.15.135:0/3484982836 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fde600047a0 con 0x55852b688d20 2024-04-20T12:28:40.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde78c69740 10 client.17451 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:40.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde78c69740 10 client.17451 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:40.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde78c69740 20 client.17451 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:40.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde78c69740 1 --2- 172.21.15.135:0/3484982836 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55852b6a26d0 0x55852b6a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde78c69740 4 client.17451 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:28:40.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde78c69740 1 -- 172.21.15.135:0/3484982836 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55852b5fbbd0 con 0x55852b6a26d0 2024-04-20T12:28:40.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.907+0000 7fde6effd640 1 --2- 172.21.15.135:0/3484982836 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55852b6a26d0 0x55852b6a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.908+0000 7fde6effd640 1 --2- 172.21.15.135:0/3484982836 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55852b6a26d0 0x55852b6a4b20 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1330b8b37ad3050 server_cookie=561264444aa22d3 in_seq=0 out_seq=0 2024-04-20T12:28:40.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.908+0000 7fde4effd640 10 client.17451 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:40.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.908+0000 7fde4effd640 1 -- 172.21.15.135:0/3484982836 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55852b5fbbd0 con 0x55852b6a26d0 2024-04-20T12:28:40.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.908+0000 7fde4effd640 10 client.17451 handle_command_reply: tid=0 2024-04-20T12:28:40.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.908+0000 7fde78c69740 1 client.17451 shutdown 2024-04-20T12:28:40.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.909+0000 7fde78c69740 1 -- 172.21.15.135:0/3484982836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b688d20 msgr2=0x55852b68f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.909+0000 7fde78c69740 1 --2- 172.21.15.135:0/3484982836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b688d20 0x55852b68f2d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fde6000ba50 tx=0x7fde6000bf10 comp rx=0 tx=0).stop 2024-04-20T12:28:40.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.909+0000 7fde78c69740 1 -- 172.21.15.135:0/3484982836 shutdown_connections 2024-04-20T12:28:40.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.909+0000 7fde78c69740 1 --2- 172.21.15.135:0/3484982836 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55852b6a26d0 0x55852b6a4b20 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.909+0000 7fde78c69740 1 --2- 172.21.15.135:0/3484982836 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b692220 0x55852b68fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.909+0000 7fde78c69740 1 --2- 172.21.15.135:0/3484982836 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b689640 0x55852b68f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.909+0000 7fde4effd640 0 client.17451 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:40.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.909+0000 7fde78c69740 1 --2- 172.21.15.135:0/3484982836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b688d20 0x55852b68f2d0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.909+0000 7fde78c69740 1 -- 172.21.15.135:0/3484982836 >> 172.21.15.135:0/3484982836 conn(0x55852b683450 msgr2=0x55852b6851a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:40.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.909+0000 7fde78c69740 1 -- 172.21.15.135:0/3484982836 shutdown_connections 2024-04-20T12:28:40.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.909+0000 7fde78c69740 1 -- 172.21.15.135:0/3484982836 wait complete. 2024-04-20T12:28:40.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.909+0000 7fde78c69740 20 client.17451 trim_cache size 0 max 16384 2024-04-20T12:28:40.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.926+0000 7fde78c69740 1 Processor -- start 2024-04-20T12:28:40.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.926+0000 7fde78c69740 1 -- start start 2024-04-20T12:28:40.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.926+0000 7fde78c69740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b688d20 0x55852b69dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.926+0000 7fde78c69740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b689640 0x55852b68e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.926+0000 7fde78c69740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b692220 0x55852b68fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.926+0000 7fde78c69740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fde701af370 con 0x55852b692220 2024-04-20T12:28:40.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.926+0000 7fde78c69740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fde701b0eb0 con 0x55852b688d20 2024-04-20T12:28:40.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.926+0000 7fde78c69740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fde701afa40 con 0x55852b689640 2024-04-20T12:28:40.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.926+0000 7fde6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b692220 0x55852b68fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.926+0000 7fde6ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b692220 0x55852b68fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51986/0 (socket says 172.21.15.135:51986) 2024-04-20T12:28:40.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.926+0000 7fde6f7fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b688d20 0x55852b69dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.926+0000 7fde6ffff640 1 -- 172.21.15.135:0/704980438 learned_addr learned my addr 172.21.15.135:0/704980438 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:40.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.926+0000 7fde6effd640 1 --2- 172.21.15.135:0/704980438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b689640 0x55852b68e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.927+0000 7fde6ffff640 1 -- 172.21.15.135:0/704980438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b689640 msgr2=0x55852b68e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.927+0000 7fde6ffff640 1 --2- 172.21.15.135:0/704980438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b689640 0x55852b68e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.927+0000 7fde6ffff640 1 -- 172.21.15.135:0/704980438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b688d20 msgr2=0x55852b69dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.952 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.927+0000 7fde6ffff640 1 --2- 172.21.15.135:0/704980438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b688d20 0x55852b69dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.927+0000 7fde6ffff640 1 -- 172.21.15.135:0/704980438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55852b6880a0 con 0x55852b692220 2024-04-20T12:28:40.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.927+0000 7fde6ffff640 1 --2- 172.21.15.135:0/704980438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b692220 0x55852b68fb70 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fde68009af0 tx=0x7fde68003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c788cecaaf60c332 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:40.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.927+0000 7fde557fa640 1 -- 172.21.15.135:0/704980438 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde68003d70 con 0x55852b692220 2024-04-20T12:28:40.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.927+0000 7fde557fa640 1 -- 172.21.15.135:0/704980438 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde6801fc20 con 0x55852b692220 2024-04-20T12:28:40.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.927+0000 7fde557fa640 1 -- 172.21.15.135:0/704980438 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde680056b0 con 0x55852b692220 2024-04-20T12:28:40.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.927+0000 7fde78c69740 1 -- 172.21.15.135:0/704980438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b692220 msgr2=0x55852b68fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.927+0000 7fde78c69740 1 --2- 172.21.15.135:0/704980438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b692220 0x55852b68fb70 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fde68009af0 tx=0x7fde68003b80 comp rx=0 tx=0).stop 2024-04-20T12:28:40.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.927+0000 7fde78c69740 1 -- 172.21.15.135:0/704980438 shutdown_connections 2024-04-20T12:28:40.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.927+0000 7fde78c69740 1 --2- 172.21.15.135:0/704980438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b692220 0x55852b68fb70 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.927+0000 7fde78c69740 1 --2- 172.21.15.135:0/704980438 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b689640 0x55852b68e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.927+0000 7fde78c69740 1 --2- 172.21.15.135:0/704980438 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b688d20 0x55852b69dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde78c69740 1 -- 172.21.15.135:0/704980438 >> 172.21.15.135:0/704980438 conn(0x55852b683450 msgr2=0x55852b684880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:40.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde78c69740 1 -- 172.21.15.135:0/704980438 shutdown_connections 2024-04-20T12:28:40.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde78c69740 1 -- 172.21.15.135:0/704980438 wait complete. 2024-04-20T12:28:40.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde78c69740 1 -- start start 2024-04-20T12:28:40.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde78c69740 1 Processor -- start 2024-04-20T12:28:40.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde78c69740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b688d20 0x55852b6fff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde78c69740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b689640 0x55852b700450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde78c69740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b692220 0x55852b697770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde78c69740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fde701b07e0 con 0x55852b689640 2024-04-20T12:28:40.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde78c69740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fde701b0110 con 0x55852b688d20 2024-04-20T12:28:40.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde78c69740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fde701ad340 con 0x55852b692220 2024-04-20T12:28:40.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde78c69740 10 client.0 _ll_register_callbacks cb 0x7fde60004270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:28:40.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde6effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b689640 0x55852b700450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde6effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b689640 0x55852b700450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:51992/0 (socket says 172.21.15.135:51992) 2024-04-20T12:28:40.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde6effd640 1 -- 172.21.15.135:0/3713793121 learned_addr learned my addr 172.21.15.135:0/3713793121 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:28:40.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde6f7fe640 1 --2- 172.21.15.135:0/3713793121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b688d20 0x55852b6fff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.928+0000 7fde6ffff640 1 --2- 172.21.15.135:0/3713793121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b692220 0x55852b697770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde6effd640 1 -- 172.21.15.135:0/3713793121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b692220 msgr2=0x55852b697770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde6effd640 1 --2- 172.21.15.135:0/3713793121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b692220 0x55852b697770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde6effd640 1 -- 172.21.15.135:0/3713793121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b688d20 msgr2=0x55852b6fff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:28:40.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde6effd640 1 --2- 172.21.15.135:0/3713793121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b688d20 0x55852b6fff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde6effd640 1 -- 172.21.15.135:0/3713793121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55852b697e60 con 0x55852b689640 2024-04-20T12:28:40.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde6effd640 1 --2- 172.21.15.135:0/3713793121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b689640 0x55852b700450 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fde6402cfd0 tx=0x7fde64004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6c4fb4441beaad server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:28:40.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde4effd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:28:40.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde4effd640 1 -- 172.21.15.135:0/3713793121 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6404b040 con 0x55852b689640 2024-04-20T12:28:40.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde4effd640 1 -- 172.21.15.135:0/3713793121 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fde640eff70 con 0x55852b689640 2024-04-20T12:28:40.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde78c69740 1 -- 172.21.15.135:0/3713793121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde6801fc20 con 0x55852b689640 2024-04-20T12:28:40.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde4effd640 1 -- 172.21.15.135:0/3713793121 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fde64004c80 con 0x55852b689640 2024-04-20T12:28:40.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde78c69740 10 client.17457 fetch_fsmap learned FSMap version 29 2024-04-20T12:28:40.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde78c69740 1 -- 172.21.15.135:0/3713793121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55852b7087f0 con 0x55852b689640 2024-04-20T12:28:40.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde4effd640 1 -- 172.21.15.135:0/3713793121 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde6801fc20 con 0x55852b689640 2024-04-20T12:28:40.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde4effd640 1 -- 172.21.15.135:0/3713793121 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fde640bacc0 con 0x55852b689640 2024-04-20T12:28:40.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde78c69740 10 client.17457 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:28:40.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde78c69740 10 client.17457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:28:40.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde78c69740 20 client.17457 populate_metadata read hostname 'smithi135' 2024-04-20T12:28:40.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde78c69740 1 --2- 172.21.15.135:0/3713793121 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55852b708f20 0x55852b70b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:28:40.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde78c69740 4 client.17457 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:28:40.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.929+0000 7fde78c69740 1 -- 172.21.15.135:0/3713793121 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55852b5f5a40 con 0x55852b708f20 2024-04-20T12:28:40.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.930+0000 7fde6f7fe640 1 --2- 172.21.15.135:0/3713793121 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55852b708f20 0x55852b70b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:28:40.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.930+0000 7fde4effd640 10 client.17457 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:40.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.930+0000 7fde6f7fe640 1 --2- 172.21.15.135:0/3713793121 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55852b708f20 0x55852b70b340 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a8e68a68cb7d085 server_cookie=64178ae8fae51144 in_seq=0 out_seq=0 2024-04-20T12:28:40.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.930+0000 7fde4effd640 1 -- 172.21.15.135:0/3713793121 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55852b5f5a40 con 0x55852b708f20 2024-04-20T12:28:40.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.930+0000 7fde4effd640 10 client.17457 handle_command_reply: tid=0 2024-04-20T12:28:40.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.930+0000 7fde78c69740 1 client.17457 shutdown 2024-04-20T12:28:40.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.930+0000 7fde78c69740 1 -- 172.21.15.135:0/3713793121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b689640 msgr2=0x55852b700450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.930+0000 7fde78c69740 1 --2- 172.21.15.135:0/3713793121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b689640 0x55852b700450 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fde6402cfd0 tx=0x7fde64004ee0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.930+0000 7fde78c69740 1 -- 172.21.15.135:0/3713793121 shutdown_connections 2024-04-20T12:28:40.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.930+0000 7fde78c69740 1 --2- 172.21.15.135:0/3713793121 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55852b708f20 0x55852b70b340 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.930+0000 7fde78c69740 1 --2- 172.21.15.135:0/3713793121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55852b692220 0x55852b697770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.930+0000 7fde4effd640 0 client.17457 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:28:40.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.930+0000 7fde78c69740 1 --2- 172.21.15.135:0/3713793121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55852b689640 0x55852b700450 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.930+0000 7fde78c69740 1 --2- 172.21.15.135:0/3713793121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55852b688d20 0x55852b6fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde78c69740 1 -- 172.21.15.135:0/3713793121 >> 172.21.15.135:0/3713793121 conn(0x55852b683450 msgr2=0x55852b6850a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:40.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde78c69740 1 -- 172.21.15.135:0/3713793121 shutdown_connections 2024-04-20T12:28:40.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde78c69740 1 -- 172.21.15.135:0/3713793121 wait complete. 2024-04-20T12:28:40.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde78c69740 20 client.17457 trim_cache size 0 max 16384 2024-04-20T12:28:40.966 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:28:40.966 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:28:40.967 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:28:40.967 INFO:teuthology.orchestra.run.smithi135.stdout: "80c64ecb-8404-4249-826b-84ab2959df5a": { 2024-04-20T12:28:40.967 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:28:40.967 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "80c64ecb-8404-4249-826b-84ab2959df5a", 2024-04-20T12:28:40.967 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:28:40.967 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:28:40.967 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:28:40.968 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:28:40.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde7606d640 1 -- 172.21.15.135:0/673308331 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde580a3d20 msgr2=0x7fde580a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde7606d640 1 --2- 172.21.15.135:0/673308331 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde580a3d20 0x7fde580a61e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fde68009fd0 tx=0x7fde68009d40 comp rx=0 tx=0).stop 2024-04-20T12:28:40.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde7606d640 1 -- 172.21.15.135:0/673308331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde70107280 msgr2=0x7fde7019ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:28:40.969 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde7606d640 1 --2- 172.21.15.135:0/673308331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde70107280 0x7fde7019ebb0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fde64036040 tx=0x7fde6402cbf0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde7606d640 1 -- 172.21.15.135:0/673308331 shutdown_connections 2024-04-20T12:28:40.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde7606d640 1 --2- 172.21.15.135:0/673308331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fde701987c0 0x7fde70198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde7606d640 1 --2- 172.21.15.135:0/673308331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde70107280 0x7fde7019ebb0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde7606d640 1 --2- 172.21.15.135:0/673308331 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde580a3d20 0x7fde580a61e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde7606d640 1 --2- 172.21.15.135:0/673308331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde701021b0 0x7fde7019e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:28:40.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde7606d640 1 -- 172.21.15.135:0/673308331 >> 172.21.15.135:0/673308331 conn(0x7fde700fd9d0 msgr2=0x7fde700fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:28:40.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde7606d640 1 -- 172.21.15.135:0/673308331 shutdown_connections 2024-04-20T12:28:40.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:28:40.931+0000 7fde7606d640 1 -- 172.21.15.135:0/673308331 wait complete. 2024-04-20T12:28:40.972 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:40 smithi135 ceph-mon[18264]: pgmap v169: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:28:40.973 INFO:tasks.cephfs.filesystem:scrub status for tag:80c64ecb-8404-4249-826b-84ab2959df5a - {'path': '/', 'tag': '80c64ecb-8404-4249-826b-84ab2959df5a', 'options': 'recursive,force'} 2024-04-20T12:28:41.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:40 smithi154 ceph-mon[22073]: pgmap v169: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:28:41.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:40 smithi139 ceph-mon[21834]: pgmap v169: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:28:42.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:41 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:28:42.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:41 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:28:42.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:41 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:28:42.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:41 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:28:42.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:41 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:28:42.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:41 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:28:42.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:41 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:28:42.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:41 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:28:42.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:41 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:28:42.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:41 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:28:42.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:41 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:28:42.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:41 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:28:43.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:42 smithi154 ceph-mon[22073]: pgmap v170: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:43.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:42 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:28:43.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:42 smithi139 ceph-mon[21834]: pgmap v170: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:43.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:42 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:28:43.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:42 smithi135 ceph-mon[18264]: pgmap v170: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:43.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:42 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:28:45.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:44 smithi154 ceph-mon[22073]: pgmap v171: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:28:45.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:44 smithi139 ceph-mon[21834]: pgmap v171: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:28:45.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:44 smithi135 ceph-mon[18264]: pgmap v171: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:28:47.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:46 smithi154 ceph-mon[22073]: pgmap v172: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:28:47.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:46 smithi139 ceph-mon[21834]: pgmap v172: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:28:47.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:46 smithi135 ceph-mon[18264]: pgmap v172: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:28:49.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:48 smithi154 ceph-mon[22073]: pgmap v173: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:28:49.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:48 smithi139 ceph-mon[21834]: pgmap v173: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:28:49.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:48 smithi135 ceph-mon[18264]: pgmap v173: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:28:51.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:50 smithi154 ceph-mon[22073]: pgmap v174: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:28:51.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:50 smithi139 ceph-mon[21834]: pgmap v174: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:28:51.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:50 smithi135 ceph-mon[18264]: pgmap v174: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:28:53.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:52 smithi154 ceph-mon[22073]: pgmap v175: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:28:53.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:52 smithi139 ceph-mon[21834]: pgmap v175: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:28:53.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:52 smithi135 ceph-mon[18264]: pgmap v175: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:28:55.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:54 smithi154 ceph-mon[22073]: pgmap v176: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:28:55.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:54 smithi139 ceph-mon[21834]: pgmap v176: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:28:55.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:54 smithi135 ceph-mon[18264]: pgmap v176: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:28:57.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:56 smithi154 ceph-mon[22073]: pgmap v177: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:57.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:56 smithi139 ceph-mon[21834]: pgmap v177: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:57.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:56 smithi135 ceph-mon[18264]: pgmap v177: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:59.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:28:58 smithi154 ceph-mon[22073]: pgmap v178: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:59.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:28:58 smithi139 ceph-mon[21834]: pgmap v178: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:28:59.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:28:58 smithi135 ceph-mon[18264]: pgmap v178: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:01.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:00 smithi154 ceph-mon[22073]: pgmap v179: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:29:01.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:00 smithi139 ceph-mon[21834]: pgmap v179: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:29:01.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:00 smithi135 ceph-mon[18264]: pgmap v179: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:29:03.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:02 smithi154 ceph-mon[22073]: pgmap v180: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:03.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:02 smithi139 ceph-mon[21834]: pgmap v180: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:03.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:02 smithi135 ceph-mon[18264]: pgmap v180: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:05.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:04 smithi154 ceph-mon[22073]: pgmap v181: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:29:05.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:04 smithi139 ceph-mon[21834]: pgmap v181: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:29:05.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:04 smithi135 ceph-mon[18264]: pgmap v181: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:29:07.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:06 smithi154 ceph-mon[22073]: pgmap v182: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:29:07.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:06 smithi139 ceph-mon[21834]: pgmap v182: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:29:07.265 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:06 smithi135 ceph-mon[18264]: pgmap v182: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:29:09.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:08 smithi154 ceph-mon[22073]: pgmap v183: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:29:09.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:08 smithi139 ceph-mon[21834]: pgmap v183: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:29:09.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:08 smithi135 ceph-mon[18264]: pgmap v183: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:29:10.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:29:10.974 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:29:11.000 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:10 smithi135 ceph-mon[18264]: pgmap v184: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:29:11.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:10 smithi154 ceph-mon[22073]: pgmap v184: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:29:11.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:10 smithi139 ceph-mon[21834]: pgmap v184: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:29:11.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.089+0000 7f44b7fb2640 1 -- 172.21.15.135:0/2289065763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b0102b50 msgr2=0x7f44b0106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.089+0000 7f44b7fb2640 1 --2- 172.21.15.135:0/2289065763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b0102b50 0x7f44b0106b90 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009900 tx=0x7f44a002bc30 comp rx=0 tx=0).stop 2024-04-20T12:29:11.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.089+0000 7f44b7fb2640 1 -- 172.21.15.135:0/2289065763 shutdown_connections 2024-04-20T12:29:11.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.089+0000 7f44b7fb2640 1 --2- 172.21.15.135:0/2289065763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44b0107270 0x7f44b010ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.089+0000 7f44b7fb2640 1 --2- 172.21.15.135:0/2289065763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b0102b50 0x7f44b0106b90 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.089+0000 7f44b7fb2640 1 --2- 172.21.15.135:0/2289065763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b01021a0 0x7f44b0102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.089+0000 7f44b7fb2640 1 -- 172.21.15.135:0/2289065763 >> 172.21.15.135:0/2289065763 conn(0x7f44b00793b0 msgr2=0x7f44b00797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.089+0000 7f44b7fb2640 1 -- 172.21.15.135:0/2289065763 shutdown_connections 2024-04-20T12:29:11.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.090+0000 7f44b7fb2640 1 -- 172.21.15.135:0/2289065763 wait complete. 2024-04-20T12:29:11.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.090+0000 7f44b7fb2640 1 Processor -- start 2024-04-20T12:29:11.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.090+0000 7f44b7fb2640 1 -- start start 2024-04-20T12:29:11.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.090+0000 7f44b7fb2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b01021a0 0x7f44b0074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.090+0000 7f44b7fb2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44b0107270 0x7f44b00747a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.090+0000 7f44b7fb2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b0074ce0 0x7f44b01a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.090+0000 7f44b7fb2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f44b0112300 con 0x7f44b01021a0 2024-04-20T12:29:11.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.090+0000 7f44b7fb2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f44b0112180 con 0x7f44b0107270 2024-04-20T12:29:11.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.090+0000 7f44b7fb2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f44b0112480 con 0x7f44b0074ce0 2024-04-20T12:29:11.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.090+0000 7f44b5d4e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b01021a0 0x7f44b0074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.090+0000 7f44b5d4e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b01021a0 0x7f44b0074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55814/0 (socket says 172.21.15.135:55814) 2024-04-20T12:29:11.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.090+0000 7f44b5d4e640 1 -- 172.21.15.135:0/1715324174 learned_addr learned my addr 172.21.15.135:0/1715324174 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.091+0000 7f44b554d640 1 --2- 172.21.15.135:0/1715324174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44b0107270 0x7f44b00747a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.091+0000 7f44b654f640 1 --2- 172.21.15.135:0/1715324174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b0074ce0 0x7f44b01a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.091+0000 7f44b5d4e640 1 -- 172.21.15.135:0/1715324174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b0074ce0 msgr2=0x7f44b01a69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.091+0000 7f44b5d4e640 1 --2- 172.21.15.135:0/1715324174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b0074ce0 0x7f44b01a69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.091+0000 7f44b5d4e640 1 -- 172.21.15.135:0/1715324174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44b0107270 msgr2=0x7f44b00747a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.091+0000 7f44b5d4e640 1 --2- 172.21.15.135:0/1715324174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44b0107270 0x7f44b00747a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.091+0000 7f44b5d4e640 1 -- 172.21.15.135:0/1715324174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b01a70b0 con 0x7f44b01021a0 2024-04-20T12:29:11.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.091+0000 7f44b5d4e640 1 --2- 172.21.15.135:0/1715324174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b01021a0 0x7f44b0074260 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00d770 tx=0x7f44ac00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.091+0000 7f44a6ffd640 1 -- 172.21.15.135:0/1715324174 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac017070 con 0x7f44b01021a0 2024-04-20T12:29:11.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.091+0000 7f44a6ffd640 1 -- 172.21.15.135:0/1715324174 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44ac005500 con 0x7f44b01021a0 2024-04-20T12:29:11.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.091+0000 7f44b7fb2640 1 -- 172.21.15.135:0/1715324174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b01a73a0 con 0x7f44b01021a0 2024-04-20T12:29:11.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.091+0000 7f44a6ffd640 1 -- 172.21.15.135:0/1715324174 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac004e00 con 0x7f44b01021a0 2024-04-20T12:29:11.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.091+0000 7f44b7fb2640 1 -- 172.21.15.135:0/1715324174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b01a7870 con 0x7f44b01021a0 2024-04-20T12:29:11.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.093+0000 7f44a6ffd640 1 -- 172.21.15.135:0/1715324174 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f44ac004fa0 con 0x7f44b01021a0 2024-04-20T12:29:11.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.094+0000 7f44baba1740 1 Processor -- start 2024-04-20T12:29:11.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.094+0000 7f44baba1740 1 -- start start 2024-04-20T12:29:11.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.094+0000 7f44baba1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e6255d20 0x5617e6256100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.094+0000 7f44baba1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6256640 0x5617e625ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.094+0000 7f44baba1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e625f220 0x5617e6261610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.094+0000 7f44baba1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5617e61bb1b0 con 0x5617e6255d20 2024-04-20T12:29:11.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.094+0000 7f44baba1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5617e6158390 con 0x5617e625f220 2024-04-20T12:29:11.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.094+0000 7f44baba1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5617e61b7170 con 0x5617e6256640 2024-04-20T12:29:11.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.094+0000 7f44a6ffd640 1 --2- 172.21.15.135:0/1715324174 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f449c0a3d50 0x7f449c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.094+0000 7f44b654f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e6255d20 0x5617e6256100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.094+0000 7f44b654f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e6255d20 0x5617e6256100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55830/0 (socket says 172.21.15.135:55830) 2024-04-20T12:29:11.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.094+0000 7f44b654f640 1 -- 172.21.15.135:0/2759773763 learned_addr learned my addr 172.21.15.135:0/2759773763 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.094+0000 7f44b5d4e640 1 --2- 172.21.15.135:0/2759773763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6256640 0x5617e625ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.094+0000 7f44b654f640 1 --2- 172.21.15.135:0/1715324174 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f449c0a3d50 0x7f449c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.095+0000 7f44b554d640 1 --2- 172.21.15.135:0/2759773763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e625f220 0x5617e6261610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.095+0000 7f44a6ffd640 1 -- 172.21.15.135:0/1715324174 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f44ac0d0650 con 0x7f44b01021a0 2024-04-20T12:29:11.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.095+0000 7f44b654f640 1 -- 172.21.15.135:0/2759773763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6256640 msgr2=0x5617e625ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.095+0000 7f44b654f640 1 --2- 172.21.15.135:0/2759773763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6256640 0x5617e625ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.095+0000 7f44b654f640 1 -- 172.21.15.135:0/2759773763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e625f220 msgr2=0x5617e6261610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.095+0000 7f44b654f640 1 --2- 172.21.15.135:0/2759773763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e625f220 0x5617e6261610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.095+0000 7f44b654f640 1 -- 172.21.15.135:0/2759773763 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617e5f977d0 con 0x5617e6255d20 2024-04-20T12:29:11.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.095+0000 7f44b554d640 1 --2- 172.21.15.135:0/2759773763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e625f220 0x5617e6261610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:11.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.095+0000 7f44b654f640 1 --2- 172.21.15.135:0/2759773763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e6255d20 0x5617e6256100 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f44a8012cd0 tx=0x7f44a800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3844bc05f01628c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.095+0000 7f44b654f640 1 --2- 172.21.15.135:0/1715324174 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f449c0a3d50 0x7f449c0a6210 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f44a800fc30 tx=0x7f44a801a000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.095+0000 7f449bfff640 1 -- 172.21.15.135:0/2759773763 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a8020070 con 0x5617e6255d20 2024-04-20T12:29:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.095+0000 7f449bfff640 1 -- 172.21.15.135:0/2759773763 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44a800aaa0 con 0x5617e6255d20 2024-04-20T12:29:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.095+0000 7f449bfff640 1 -- 172.21.15.135:0/2759773763 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a80113e0 con 0x5617e6255d20 2024-04-20T12:29:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.096+0000 7f44baba1740 1 -- 172.21.15.135:0/2759773763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e6255d20 msgr2=0x5617e6256100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.096+0000 7f44baba1740 1 --2- 172.21.15.135:0/2759773763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e6255d20 0x5617e6256100 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f44a8012cd0 tx=0x7f44a800f730 comp rx=0 tx=0).stop 2024-04-20T12:29:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.096+0000 7f44baba1740 1 -- 172.21.15.135:0/2759773763 shutdown_connections 2024-04-20T12:29:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.096+0000 7f44baba1740 1 --2- 172.21.15.135:0/2759773763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e625f220 0x5617e6261610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.096+0000 7f44baba1740 1 --2- 172.21.15.135:0/2759773763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6256640 0x5617e625ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.096+0000 7f44baba1740 1 --2- 172.21.15.135:0/2759773763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e6255d20 0x5617e6256100 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.096+0000 7f44baba1740 1 -- 172.21.15.135:0/2759773763 >> 172.21.15.135:0/2759773763 conn(0x5617e6250450 msgr2=0x5617e6250830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.096+0000 7f44baba1740 1 -- 172.21.15.135:0/2759773763 shutdown_connections 2024-04-20T12:29:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.096+0000 7f44baba1740 1 -- 172.21.15.135:0/2759773763 wait complete. 2024-04-20T12:29:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.096+0000 7f44baba1740 1 -- start start 2024-04-20T12:29:11.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.096+0000 7f44baba1740 1 Processor -- start 2024-04-20T12:29:11.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44baba1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e6255d20 0x5617e625c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44baba1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6256640 0x5617e625c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44baba1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e625cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44baba1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5617e6261fb0 con 0x5617e625f220 2024-04-20T12:29:11.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44baba1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5617e61742f0 con 0x5617e6255d20 2024-04-20T12:29:11.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44baba1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5617e6262130 con 0x5617e6256640 2024-04-20T12:29:11.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44baba1740 10 client.0 _ll_register_callbacks cb 0x5617e613e4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:11.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44b654f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e625cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44b654f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e625cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55834/0 (socket says 172.21.15.135:55834) 2024-04-20T12:29:11.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44b654f640 1 -- 172.21.15.135:0/2239684658 learned_addr learned my addr 172.21.15.135:0/2239684658 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44b5d4e640 1 --2- 172.21.15.135:0/2239684658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e6255d20 0x5617e625c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44b554d640 1 --2- 172.21.15.135:0/2239684658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6256640 0x5617e625c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.106 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44b654f640 1 -- 172.21.15.135:0/2239684658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6256640 msgr2=0x5617e625c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44b654f640 1 --2- 172.21.15.135:0/2239684658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6256640 0x5617e625c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44b654f640 1 -- 172.21.15.135:0/2239684658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e6255d20 msgr2=0x5617e625c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44b654f640 1 --2- 172.21.15.135:0/2239684658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e6255d20 0x5617e625c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44b654f640 1 -- 172.21.15.135:0/2239684658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617e5ecd3f0 con 0x5617e625f220 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44b654f640 1 --2- 172.21.15.135:0/2239684658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e625cdb0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f44a8005ca0 tx=0x7f44a8019d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64ce7f80cf2c477 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.097+0000 7f44997fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.098+0000 7f44997fa640 1 -- 172.21.15.135:0/2239684658 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a802b070 con 0x5617e625f220 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.098+0000 7f44997fa640 1 -- 172.21.15.135:0/2239684658 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f44a801c430 con 0x5617e625f220 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.098+0000 7f44baba1740 1 -- 172.21.15.135:0/2239684658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44a800aaa0 con 0x5617e625f220 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.098+0000 7f44997fa640 1 -- 172.21.15.135:0/2239684658 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f44a8039050 con 0x5617e625f220 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.098+0000 7f44baba1740 10 client.17469 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.098+0000 7f44baba1740 1 -- 172.21.15.135:0/2239684658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5617e5e8d0f0 con 0x5617e625f220 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.098+0000 7f44997fa640 1 -- 172.21.15.135:0/2239684658 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44a800aaa0 con 0x5617e625f220 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.098+0000 7f44997fa640 1 -- 172.21.15.135:0/2239684658 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f44a801b070 con 0x5617e625f220 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.098+0000 7f44baba1740 10 client.17469 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:11.107 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.098+0000 7f44baba1740 10 client.17469 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:11.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.098+0000 7f44baba1740 20 client.17469 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:11.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.098+0000 7f44baba1740 1 --2- 172.21.15.135:0/2239684658 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5617e626f670 0x5617e6271a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.098+0000 7f44baba1740 4 client.17469 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:11.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.098+0000 7f44baba1740 1 -- 172.21.15.135:0/2239684658 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617e61c8bd0 con 0x5617e626f670 2024-04-20T12:29:11.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.098+0000 7f44b5d4e640 1 --2- 172.21.15.135:0/2239684658 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5617e626f670 0x5617e6271a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.099+0000 7f44997fa640 10 client.17469 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:11.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.099+0000 7f44b5d4e640 1 --2- 172.21.15.135:0/2239684658 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5617e626f670 0x5617e6271a60 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67537037908c88c6 server_cookie=2a9c666a59a1183 in_seq=0 out_seq=0 2024-04-20T12:29:11.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.099+0000 7f44997fa640 1 -- 172.21.15.135:0/2239684658 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5617e61c8bd0 con 0x5617e626f670 2024-04-20T12:29:11.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.099+0000 7f44997fa640 10 client.17469 handle_command_reply: tid=0 2024-04-20T12:29:11.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.099+0000 7f44baba1740 1 client.17469 shutdown 2024-04-20T12:29:11.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.100+0000 7f44baba1740 1 -- 172.21.15.135:0/2239684658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 msgr2=0x5617e625cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.108 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.100+0000 7f44baba1740 1 --2- 172.21.15.135:0/2239684658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e625cdb0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f44a8005ca0 tx=0x7f44a8019d90 comp rx=0 tx=0).stop 2024-04-20T12:29:11.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.100+0000 7f44baba1740 1 -- 172.21.15.135:0/2239684658 shutdown_connections 2024-04-20T12:29:11.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.100+0000 7f44baba1740 1 --2- 172.21.15.135:0/2239684658 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5617e626f670 0x5617e6271a60 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.100+0000 7f44baba1740 1 --2- 172.21.15.135:0/2239684658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e625cdb0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.100+0000 7f44baba1740 1 --2- 172.21.15.135:0/2239684658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6256640 0x5617e625c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.100+0000 7f44baba1740 1 --2- 172.21.15.135:0/2239684658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e6255d20 0x5617e625c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.100+0000 7f44997fa640 0 client.17469 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:11.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.100+0000 7f44baba1740 1 -- 172.21.15.135:0/2239684658 >> 172.21.15.135:0/2239684658 conn(0x5617e6250450 msgr2=0x5617e62521a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.100+0000 7f44baba1740 1 -- 172.21.15.135:0/2239684658 shutdown_connections 2024-04-20T12:29:11.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.100+0000 7f44baba1740 1 -- 172.21.15.135:0/2239684658 wait complete. 2024-04-20T12:29:11.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.100+0000 7f44baba1740 20 client.17469 trim_cache size 0 max 16384 2024-04-20T12:29:11.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.117+0000 7f44baba1740 1 Processor -- start 2024-04-20T12:29:11.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.117+0000 7f44baba1740 1 -- start start 2024-04-20T12:29:11.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.117+0000 7f44baba1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6255d20 0x5617e626ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.117+0000 7f44baba1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e6256640 0x5617e625bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.117+0000 7f44baba1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e625ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.117+0000 7f44baba1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f44b01b1430 con 0x5617e625f220 2024-04-20T12:29:11.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.117+0000 7f44baba1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f44b01b2f70 con 0x5617e6256640 2024-04-20T12:29:11.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.117+0000 7f44baba1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f44b01b1b00 con 0x5617e6255d20 2024-04-20T12:29:11.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.117+0000 7f44b654f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e625ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.117+0000 7f44b654f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e625ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55836/0 (socket says 172.21.15.135:55836) 2024-04-20T12:29:11.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.117+0000 7f44b654f640 1 -- 172.21.15.135:0/2816863451 learned_addr learned my addr 172.21.15.135:0/2816863451 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.118+0000 7f44b654f640 1 -- 172.21.15.135:0/2816863451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6255d20 msgr2=0x5617e626ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.118+0000 7f44b654f640 1 --2- 172.21.15.135:0/2816863451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6255d20 0x5617e626ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.118+0000 7f44b654f640 1 -- 172.21.15.135:0/2816863451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e6256640 msgr2=0x5617e625bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.118+0000 7f44b654f640 1 --2- 172.21.15.135:0/2816863451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e6256640 0x5617e625bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.118+0000 7f44b654f640 1 -- 172.21.15.135:0/2816863451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617e625c060 con 0x5617e625f220 2024-04-20T12:29:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.118+0000 7f44b654f640 1 --2- 172.21.15.135:0/2816863451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e625ca00 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f44a8000f80 tx=0x7f44a800aef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49822060562fcdbf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.118+0000 7f449b7fe640 1 -- 172.21.15.135:0/2816863451 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a802b040 con 0x5617e625f220 2024-04-20T12:29:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.118+0000 7f449b7fe640 1 -- 172.21.15.135:0/2816863451 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44a8029070 con 0x5617e625f220 2024-04-20T12:29:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.118+0000 7f449b7fe640 1 -- 172.21.15.135:0/2816863451 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a8020040 con 0x5617e625f220 2024-04-20T12:29:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.118+0000 7f44baba1740 1 -- 172.21.15.135:0/2816863451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 msgr2=0x5617e625ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.118+0000 7f44baba1740 1 --2- 172.21.15.135:0/2816863451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e625ca00 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f44a8000f80 tx=0x7f44a800aef0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.118+0000 7f44baba1740 1 -- 172.21.15.135:0/2816863451 shutdown_connections 2024-04-20T12:29:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.118+0000 7f44baba1740 1 --2- 172.21.15.135:0/2816863451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e625ca00 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44baba1740 1 --2- 172.21.15.135:0/2816863451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e6256640 0x5617e625bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44baba1740 1 --2- 172.21.15.135:0/2816863451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6255d20 0x5617e626ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44baba1740 1 -- 172.21.15.135:0/2816863451 >> 172.21.15.135:0/2816863451 conn(0x5617e6250450 msgr2=0x5617e625c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44baba1740 1 -- 172.21.15.135:0/2816863451 shutdown_connections 2024-04-20T12:29:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44baba1740 1 -- 172.21.15.135:0/2816863451 wait complete. 2024-04-20T12:29:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44baba1740 1 -- start start 2024-04-20T12:29:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44baba1740 1 Processor -- start 2024-04-20T12:29:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44baba1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e6255d20 0x5617e6267020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44baba1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6256640 0x5617e6267560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44baba1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e62644d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44baba1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f44b01b28a0 con 0x5617e625f220 2024-04-20T12:29:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44baba1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f44b01b21d0 con 0x5617e6255d20 2024-04-20T12:29:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44baba1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f44b01af400 con 0x5617e6256640 2024-04-20T12:29:11.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44baba1740 10 client.0 _ll_register_callbacks cb 0x7f44ac0985b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44b654f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e62644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44b654f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e62644d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55852/0 (socket says 172.21.15.135:55852) 2024-04-20T12:29:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.119+0000 7f44b654f640 1 -- 172.21.15.135:0/4163189670 learned_addr learned my addr 172.21.15.135:0/4163189670 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44b554d640 1 --2- 172.21.15.135:0/4163189670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6256640 0x5617e6267560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44b654f640 1 -- 172.21.15.135:0/4163189670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6256640 msgr2=0x5617e6267560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44b654f640 1 --2- 172.21.15.135:0/4163189670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6256640 0x5617e6267560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44b654f640 1 -- 172.21.15.135:0/4163189670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e6255d20 msgr2=0x5617e6267020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44b5d4e640 1 --2- 172.21.15.135:0/4163189670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e6255d20 0x5617e6267020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44b654f640 1 --2- 172.21.15.135:0/4163189670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e6255d20 0x5617e6267020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44b654f640 1 -- 172.21.15.135:0/4163189670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617e6264bc0 con 0x5617e625f220 2024-04-20T12:29:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44b654f640 1 --2- 172.21.15.135:0/4163189670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e62644d0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f44a80124d0 tx=0x7f44a801cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d0898498a8f511 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44997fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44997fa640 1 -- 172.21.15.135:0/4163189670 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a802b040 con 0x5617e625f220 2024-04-20T12:29:11.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44baba1740 1 -- 172.21.15.135:0/4163189670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44a8029070 con 0x5617e625f220 2024-04-20T12:29:11.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44997fa640 1 -- 172.21.15.135:0/4163189670 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f44a801c630 con 0x5617e625f220 2024-04-20T12:29:11.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44997fa640 1 -- 172.21.15.135:0/4163189670 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f44a8020040 con 0x5617e625f220 2024-04-20T12:29:11.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44baba1740 10 client.17475 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:11.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44baba1740 1 -- 172.21.15.135:0/4163189670 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5617e62d52d0 con 0x5617e625f220 2024-04-20T12:29:11.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44997fa640 1 -- 172.21.15.135:0/4163189670 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44a8029070 con 0x5617e625f220 2024-04-20T12:29:11.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44997fa640 1 -- 172.21.15.135:0/4163189670 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f44a801b050 con 0x5617e625f220 2024-04-20T12:29:11.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44baba1740 10 client.17475 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:11.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.120+0000 7f44baba1740 10 client.17475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:11.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44baba1740 20 client.17475 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:11.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44baba1740 1 --2- 172.21.15.135:0/4163189670 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5617e62d5660 0x5617e62d7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44baba1740 4 client.17475 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:29:11.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44baba1740 1 -- 172.21.15.135:0/4163189670 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5617e61c2a40 con 0x5617e62d5660 2024-04-20T12:29:11.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44b5d4e640 1 --2- 172.21.15.135:0/4163189670 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5617e62d5660 0x5617e62d7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44b5d4e640 1 --2- 172.21.15.135:0/4163189670 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5617e62d5660 0x5617e62d7a80 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eca9f220600a63ca server_cookie=8da886de2fc0488 in_seq=0 out_seq=0 2024-04-20T12:29:11.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44997fa640 10 client.17475 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:11.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44997fa640 1 -- 172.21.15.135:0/4163189670 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5617e61c2a40 con 0x5617e62d5660 2024-04-20T12:29:11.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44997fa640 10 client.17475 handle_command_reply: tid=0 2024-04-20T12:29:11.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44baba1740 1 client.17475 shutdown 2024-04-20T12:29:11.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44baba1740 1 -- 172.21.15.135:0/4163189670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 msgr2=0x5617e62644d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44baba1740 1 --2- 172.21.15.135:0/4163189670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e62644d0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f44a80124d0 tx=0x7f44a801cb90 comp rx=0 tx=0).stop 2024-04-20T12:29:11.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44baba1740 1 -- 172.21.15.135:0/4163189670 shutdown_connections 2024-04-20T12:29:11.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44baba1740 1 --2- 172.21.15.135:0/4163189670 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5617e62d5660 0x5617e62d7a80 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44baba1740 1 --2- 172.21.15.135:0/4163189670 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617e625f220 0x5617e62644d0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44baba1740 1 --2- 172.21.15.135:0/4163189670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617e6256640 0x5617e6267560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44baba1740 1 --2- 172.21.15.135:0/4163189670 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617e6255d20 0x5617e6267020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.121+0000 7f44997fa640 0 client.17475 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:11.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44baba1740 1 -- 172.21.15.135:0/4163189670 >> 172.21.15.135:0/4163189670 conn(0x5617e6250450 msgr2=0x5617e625cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44baba1740 1 -- 172.21.15.135:0/4163189670 shutdown_connections 2024-04-20T12:29:11.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44baba1740 1 -- 172.21.15.135:0/4163189670 wait complete. 2024-04-20T12:29:11.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44baba1740 20 client.17475 trim_cache size 0 max 16384 2024-04-20T12:29:11.127 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:29:11.127 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:29:11.127 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:29:11.127 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:29:11.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44b7fb2640 1 -- 172.21.15.135:0/1715324174 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f449c0a3d50 msgr2=0x7f449c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44b7fb2640 1 --2- 172.21.15.135:0/1715324174 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f449c0a3d50 0x7f449c0a6210 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f44a800fc30 tx=0x7f44a801a000 comp rx=0 tx=0).stop 2024-04-20T12:29:11.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44b7fb2640 1 -- 172.21.15.135:0/1715324174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b01021a0 msgr2=0x7f44b0074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44b7fb2640 1 --2- 172.21.15.135:0/1715324174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b01021a0 0x7f44b0074260 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00d770 tx=0x7f44ac00dc30 comp rx=0 tx=0).stop 2024-04-20T12:29:11.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44b7fb2640 1 -- 172.21.15.135:0/1715324174 shutdown_connections 2024-04-20T12:29:11.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44b7fb2640 1 --2- 172.21.15.135:0/1715324174 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f449c0a3d50 0x7f449c0a6210 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44b7fb2640 1 --2- 172.21.15.135:0/1715324174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b0074ce0 0x7f44b01a69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44b7fb2640 1 --2- 172.21.15.135:0/1715324174 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44b0107270 0x7f44b00747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44b7fb2640 1 --2- 172.21.15.135:0/1715324174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44b01021a0 0x7f44b0074260 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44b7fb2640 1 -- 172.21.15.135:0/1715324174 >> 172.21.15.135:0/1715324174 conn(0x7f44b00793b0 msgr2=0x7f44b00ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44b7fb2640 1 -- 172.21.15.135:0/1715324174 shutdown_connections 2024-04-20T12:29:11.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.122+0000 7f44b7fb2640 1 -- 172.21.15.135:0/1715324174 wait complete. 2024-04-20T12:29:11.132 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:29:11.132 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:29:11.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.271+0000 7f5628a1e640 1 -- 172.21.15.135:0/3769061487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5624101a60 msgr2=0x7f5624105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.271+0000 7f5628a1e640 1 --2- 172.21.15.135:0/3769061487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5624101a60 0x7f5624105aa0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f560c009900 tx=0x7f560c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:29:11.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.272+0000 7f5628a1e640 1 -- 172.21.15.135:0/3769061487 shutdown_connections 2024-04-20T12:29:11.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.272+0000 7f5628a1e640 1 --2- 172.21.15.135:0/3769061487 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5624106180 0x7f562410dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.272+0000 7f5628a1e640 1 --2- 172.21.15.135:0/3769061487 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5624101a60 0x7f5624105aa0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.272+0000 7f5628a1e640 1 --2- 172.21.15.135:0/3769061487 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f56241010b0 0x7f5624101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.272+0000 7f5628a1e640 1 -- 172.21.15.135:0/3769061487 >> 172.21.15.135:0/3769061487 conn(0x7f5624077f60 msgr2=0x7f5624078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.272+0000 7f5628a1e640 1 -- 172.21.15.135:0/3769061487 shutdown_connections 2024-04-20T12:29:11.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.272+0000 7f5628a1e640 1 -- 172.21.15.135:0/3769061487 wait complete. 2024-04-20T12:29:11.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.272+0000 7f5628a1e640 1 Processor -- start 2024-04-20T12:29:11.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.272+0000 7f5628a1e640 1 -- start start 2024-04-20T12:29:11.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f5628a1e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56241010b0 0x7f562419e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f5628a1e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5624106180 0x7f562419eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f5628a1e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5624198630 0x7f5624198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f5628a1e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5624111210 con 0x7f5624106180 2024-04-20T12:29:11.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f5628a1e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5624111090 con 0x7f56241010b0 2024-04-20T12:29:11.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f5628a1e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5624111390 con 0x7f5624198630 2024-04-20T12:29:11.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f561bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5624106180 0x7f562419eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f561bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5624106180 0x7f562419eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55878/0 (socket says 172.21.15.135:55878) 2024-04-20T12:29:11.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f561bfff640 1 -- 172.21.15.135:0/2556068566 learned_addr learned my addr 172.21.15.135:0/2556068566 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f562259c640 1 --2- 172.21.15.135:0/2556068566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56241010b0 0x7f562419e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f5622d9d640 1 --2- 172.21.15.135:0/2556068566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5624198630 0x7f5624198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f561bfff640 1 -- 172.21.15.135:0/2556068566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5624198630 msgr2=0x7f5624198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f561bfff640 1 --2- 172.21.15.135:0/2556068566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5624198630 0x7f5624198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f561bfff640 1 -- 172.21.15.135:0/2556068566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56241010b0 msgr2=0x7f562419e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f561bfff640 1 --2- 172.21.15.135:0/2556068566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56241010b0 0x7f562419e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f561bfff640 1 -- 172.21.15.135:0/2556068566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5624199230 con 0x7f5624106180 2024-04-20T12:29:11.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f561bfff640 1 --2- 172.21.15.135:0/2556068566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5624106180 0x7f562419eab0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f560c036040 tx=0x7f560c02ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f561b7fe640 1 -- 172.21.15.135:0/2556068566 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c041070 con 0x7f5624106180 2024-04-20T12:29:11.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f5628a1e640 1 -- 172.21.15.135:0/2556068566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56241994c0 con 0x7f5624106180 2024-04-20T12:29:11.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f561b7fe640 1 -- 172.21.15.135:0/2556068566 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f560c0054e0 con 0x7f5624106180 2024-04-20T12:29:11.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.273+0000 7f561b7fe640 1 -- 172.21.15.135:0/2556068566 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f560c034440 con 0x7f5624106180 2024-04-20T12:29:11.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.274+0000 7f5628a1e640 1 -- 172.21.15.135:0/2556068566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56241a5650 con 0x7f5624106180 2024-04-20T12:29:11.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.275+0000 7f5628a1e640 1 -- 172.21.15.135:0/2556068566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5624102580 con 0x7f5624106180 2024-04-20T12:29:11.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.276+0000 7f561b7fe640 1 -- 172.21.15.135:0/2556068566 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f560c044070 con 0x7f5624106180 2024-04-20T12:29:11.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.276+0000 7f561b7fe640 1 --2- 172.21.15.135:0/2556068566 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f56100a3d20 0x7f56100a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.276+0000 7f562259c640 1 --2- 172.21.15.135:0/2556068566 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f56100a3d20 0x7f56100a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.276+0000 7f561b7fe640 1 -- 172.21.15.135:0/2556068566 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f560c0f27e0 con 0x7f5624106180 2024-04-20T12:29:11.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.277+0000 7f562259c640 1 --2- 172.21.15.135:0/2556068566 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f56100a3d20 0x7f56100a61e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5614005fd0 tx=0x7f561400b390 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.280+0000 7f561b7fe640 1 -- 172.21.15.135:0/2556068566 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f560c004c50 con 0x7f5624106180 2024-04-20T12:29:11.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.496+0000 7f5628a1e640 1 -- 172.21.15.135:0/2556068566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f562410a3c0 con 0x7f5624106180 2024-04-20T12:29:11.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.497+0000 7f561b7fe640 1 -- 172.21.15.135:0/2556068566 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7f560c0be650 con 0x7f5624106180 2024-04-20T12:29:11.497 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:29:11.497 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:29:11.497 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:29:11.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.499+0000 7f5628a1e640 1 -- 172.21.15.135:0/2556068566 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f56100a3d20 msgr2=0x7f56100a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.499+0000 7f5628a1e640 1 --2- 172.21.15.135:0/2556068566 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f56100a3d20 0x7f56100a61e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5614005fd0 tx=0x7f561400b390 comp rx=0 tx=0).stop 2024-04-20T12:29:11.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.499+0000 7f5628a1e640 1 -- 172.21.15.135:0/2556068566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5624106180 msgr2=0x7f562419eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.499+0000 7f5628a1e640 1 --2- 172.21.15.135:0/2556068566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5624106180 0x7f562419eab0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f560c036040 tx=0x7f560c02ce20 comp rx=0 tx=0).stop 2024-04-20T12:29:11.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.499+0000 7f5628a1e640 1 -- 172.21.15.135:0/2556068566 shutdown_connections 2024-04-20T12:29:11.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.499+0000 7f5628a1e640 1 --2- 172.21.15.135:0/2556068566 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f56100a3d20 0x7f56100a61e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.499+0000 7f5628a1e640 1 --2- 172.21.15.135:0/2556068566 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5624198630 0x7f5624198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.499+0000 7f5628a1e640 1 --2- 172.21.15.135:0/2556068566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5624106180 0x7f562419eab0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.499+0000 7f5628a1e640 1 --2- 172.21.15.135:0/2556068566 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f56241010b0 0x7f562419e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.499+0000 7f5628a1e640 1 -- 172.21.15.135:0/2556068566 >> 172.21.15.135:0/2556068566 conn(0x7f5624077f60 msgr2=0x7f56241001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.499+0000 7f5628a1e640 1 -- 172.21.15.135:0/2556068566 shutdown_connections 2024-04-20T12:29:11.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.499+0000 7f5628a1e640 1 -- 172.21.15.135:0/2556068566 wait complete. 2024-04-20T12:29:11.511 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:29:11.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.613+0000 7f3e81443640 1 -- 172.21.15.135:0/2885634869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e7c101a40 msgr2=0x7f3e7c105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.613+0000 7f3e81443640 1 --2- 172.21.15.135:0/2885634869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e7c101a40 0x7f3e7c105a80 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009900 tx=0x7f3e7002bc30 comp rx=0 tx=0).stop 2024-04-20T12:29:11.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.613+0000 7f3e81443640 1 -- 172.21.15.135:0/2885634869 shutdown_connections 2024-04-20T12:29:11.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.613+0000 7f3e81443640 1 --2- 172.21.15.135:0/2885634869 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c106160 0x7f3e7c10dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.613+0000 7f3e81443640 1 --2- 172.21.15.135:0/2885634869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e7c101a40 0x7f3e7c105a80 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.613+0000 7f3e81443640 1 --2- 172.21.15.135:0/2885634869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e7c101090 0x7f3e7c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.613+0000 7f3e81443640 1 -- 172.21.15.135:0/2885634869 >> 172.21.15.135:0/2885634869 conn(0x7f3e7c078010 msgr2=0x7f3e7c078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.613+0000 7f3e81443640 1 -- 172.21.15.135:0/2885634869 shutdown_connections 2024-04-20T12:29:11.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.613+0000 7f3e81443640 1 -- 172.21.15.135:0/2885634869 wait complete. 2024-04-20T12:29:11.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.613+0000 7f3e81443640 1 Processor -- start 2024-04-20T12:29:11.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.613+0000 7f3e81443640 1 -- start start 2024-04-20T12:29:11.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e81443640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e7c101090 0x7f3e7c1a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e81443640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e7c106160 0x7f3e7c1a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e81443640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c19a7c0 0x7f3e7c19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e81443640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c10feb0 con 0x7f3e7c101090 2024-04-20T12:29:11.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e81443640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c10fd30 con 0x7f3e7c19a7c0 2024-04-20T12:29:11.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e81443640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c110030 con 0x7f3e7c106160 2024-04-20T12:29:11.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e7affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e7c101090 0x7f3e7c1a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e7affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e7c101090 0x7f3e7c1a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55904/0 (socket says 172.21.15.135:55904) 2024-04-20T12:29:11.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e7affd640 1 -- 172.21.15.135:0/894978531 learned_addr learned my addr 172.21.15.135:0/894978531 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e7b7fe640 1 --2- 172.21.15.135:0/894978531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c19a7c0 0x7f3e7c19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e7affd640 1 -- 172.21.15.135:0/894978531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e7c106160 msgr2=0x7f3e7c1a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e7affd640 1 --2- 172.21.15.135:0/894978531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e7c106160 0x7f3e7c1a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e7affd640 1 -- 172.21.15.135:0/894978531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c19a7c0 msgr2=0x7f3e7c19ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e7affd640 1 --2- 172.21.15.135:0/894978531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c19a7c0 0x7f3e7c19ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e7affd640 1 -- 172.21.15.135:0/894978531 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7c19b350 con 0x7f3e7c101090 2024-04-20T12:29:11.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e7affd640 1 --2- 172.21.15.135:0/894978531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e7c101090 0x7f3e7c1a0650 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009d50 tx=0x7f3e6c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e63fff640 1 -- 172.21.15.135:0/894978531 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c003b70 con 0x7f3e7c101090 2024-04-20T12:29:11.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e81443640 1 -- 172.21.15.135:0/894978531 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e7c19b640 con 0x7f3e7c101090 2024-04-20T12:29:11.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e63fff640 1 -- 172.21.15.135:0/894978531 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e6c003d10 con 0x7f3e7c101090 2024-04-20T12:29:11.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e63fff640 1 -- 172.21.15.135:0/894978531 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c010a20 con 0x7f3e7c101090 2024-04-20T12:29:11.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.614+0000 7f3e81443640 1 -- 172.21.15.135:0/894978531 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e7c1a7820 con 0x7f3e7c101090 2024-04-20T12:29:11.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.617+0000 7f3e63fff640 1 -- 172.21.15.135:0/894978531 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f3e6c003ec0 con 0x7f3e7c101090 2024-04-20T12:29:11.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.617+0000 7f3e8403c740 1 Processor -- start 2024-04-20T12:29:11.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.617+0000 7f3e8403c740 1 -- start start 2024-04-20T12:29:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.617+0000 7f3e8403c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495a9ce10 0x565495a9d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.617+0000 7f3e8403c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9d730 0x565495aa5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.617+0000 7f3e8403c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495aa6310 0x565495aa8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.617+0000 7f3e8403c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x565495a02110 con 0x565495a9d730 2024-04-20T12:29:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.617+0000 7f3e8403c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56549599f550 con 0x565495aa6310 2024-04-20T12:29:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.617+0000 7f3e8403c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5654959fe0d0 con 0x565495a9ce10 2024-04-20T12:29:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e7affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9d730 0x565495aa5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e7affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9d730 0x565495aa5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55908/0 (socket says 172.21.15.135:55908) 2024-04-20T12:29:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e7affd640 1 -- 172.21.15.135:0/624690085 learned_addr learned my addr 172.21.15.135:0/624690085 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e63fff640 1 --2- 172.21.15.135:0/894978531 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3e640a3d20 0x7f3e640a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e7a7fc640 1 --2- 172.21.15.135:0/624690085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495aa6310 0x565495aa8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e7b7fe640 1 --2- 172.21.15.135:0/624690085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495a9ce10 0x565495a9d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e7b7fe640 1 --2- 172.21.15.135:0/894978531 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3e640a3d20 0x7f3e640a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e7affd640 1 -- 172.21.15.135:0/624690085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495a9ce10 msgr2=0x565495a9d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e7affd640 1 --2- 172.21.15.135:0/624690085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495a9ce10 0x565495a9d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e7affd640 1 -- 172.21.15.135:0/624690085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495aa6310 msgr2=0x565495aa8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e7affd640 1 --2- 172.21.15.135:0/624690085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495aa6310 0x565495aa8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e7affd640 1 -- 172.21.15.135:0/624690085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654959c7900 con 0x565495a9d730 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e63fff640 1 -- 172.21.15.135:0/894978531 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f3e6c0d1350 con 0x7f3e7c101090 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e7affd640 1 --2- 172.21.15.135:0/624690085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9d730 0x565495aa5dd0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0993d0 tx=0x7f3e6c067570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964094c97ad08469 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e617fa640 1 -- 172.21.15.135:0/624690085 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c09c8d0 con 0x565495a9d730 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e7b7fe640 1 --2- 172.21.15.135:0/894978531 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3e640a3d20 0x7f3e640a61e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009d30 tx=0x7f3e74005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e617fa640 1 -- 172.21.15.135:0/624690085 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e6c009820 con 0x565495a9d730 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.618+0000 7f3e617fa640 1 -- 172.21.15.135:0/624690085 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c09cf70 con 0x565495a9d730 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.619+0000 7f3e8403c740 1 -- 172.21.15.135:0/624690085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9d730 msgr2=0x565495aa5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.619+0000 7f3e8403c740 1 --2- 172.21.15.135:0/624690085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9d730 0x565495aa5dd0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0993d0 tx=0x7f3e6c067570 comp rx=0 tx=0).stop 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.619+0000 7f3e8403c740 1 -- 172.21.15.135:0/624690085 shutdown_connections 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.619+0000 7f3e8403c740 1 --2- 172.21.15.135:0/624690085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495aa6310 0x565495aa8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.619+0000 7f3e8403c740 1 --2- 172.21.15.135:0/624690085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9d730 0x565495aa5dd0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.619+0000 7f3e8403c740 1 --2- 172.21.15.135:0/624690085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495a9ce10 0x565495a9d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.619+0000 7f3e8403c740 1 -- 172.21.15.135:0/624690085 >> 172.21.15.135:0/624690085 conn(0x565495a97540 msgr2=0x565495a97920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.619+0000 7f3e8403c740 1 -- 172.21.15.135:0/624690085 shutdown_connections 2024-04-20T12:29:11.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.619+0000 7f3e8403c740 1 -- 172.21.15.135:0/624690085 wait complete. 2024-04-20T12:29:11.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.619+0000 7f3e8403c740 1 -- start start 2024-04-20T12:29:11.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.619+0000 7f3e8403c740 1 Processor -- start 2024-04-20T12:29:11.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e8403c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9ce10 0x565495aa3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e8403c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495a9d730 0x565495aa3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e8403c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495aa6310 0x565495aa3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e8403c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x565495aa9040 con 0x565495aa6310 2024-04-20T12:29:11.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e8403c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5654959bb500 con 0x565495a9ce10 2024-04-20T12:29:11.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e8403c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x565495aa91c0 con 0x565495a9d730 2024-04-20T12:29:11.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e8403c740 10 client.0 _ll_register_callbacks cb 0x5654959a02f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:11.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e7b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495aa6310 0x565495aa3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e7b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495aa6310 0x565495aa3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55914/0 (socket says 172.21.15.135:55914) 2024-04-20T12:29:11.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e7b7fe640 1 -- 172.21.15.135:0/2990187319 learned_addr learned my addr 172.21.15.135:0/2990187319 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e7affd640 1 --2- 172.21.15.135:0/2990187319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9ce10 0x565495aa3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e7a7fc640 1 --2- 172.21.15.135:0/2990187319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495a9d730 0x565495aa3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e7b7fe640 1 -- 172.21.15.135:0/2990187319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495a9d730 msgr2=0x565495aa3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e7b7fe640 1 --2- 172.21.15.135:0/2990187319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495a9d730 0x565495aa3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e7b7fe640 1 -- 172.21.15.135:0/2990187319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9ce10 msgr2=0x565495aa3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e7b7fe640 1 --2- 172.21.15.135:0/2990187319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9ce10 0x565495aa3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e7b7fe640 1 -- 172.21.15.135:0/2990187319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654957143f0 con 0x565495aa6310 2024-04-20T12:29:11.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e7a7fc640 1 --2- 172.21.15.135:0/2990187319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495a9d730 0x565495aa3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:11.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e7b7fe640 1 --2- 172.21.15.135:0/2990187319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495aa6310 0x565495aa3d90 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f3e740038a0 tx=0x7f3e740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eda90c76344a387 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e5eff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:11.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e5eff5640 1 -- 172.21.15.135:0/2990187319 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e74024020 con 0x565495aa6310 2024-04-20T12:29:11.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e5eff5640 1 -- 172.21.15.135:0/2990187319 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f3e7400fba0 con 0x565495aa6310 2024-04-20T12:29:11.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.620+0000 7f3e8403c740 1 -- 172.21.15.135:0/2990187319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e6c009820 con 0x565495aa6310 2024-04-20T12:29:11.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.621+0000 7f3e5eff5640 1 -- 172.21.15.135:0/2990187319 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3e7402f050 con 0x565495aa6310 2024-04-20T12:29:11.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.621+0000 7f3e8403c740 10 client.17493 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:11.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.621+0000 7f3e8403c740 1 -- 172.21.15.135:0/2990187319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5654957de7d0 con 0x565495aa6310 2024-04-20T12:29:11.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.621+0000 7f3e5eff5640 1 -- 172.21.15.135:0/2990187319 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e6c009820 con 0x565495aa6310 2024-04-20T12:29:11.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.621+0000 7f3e5eff5640 1 -- 172.21.15.135:0/2990187319 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f3e74011430 con 0x565495aa6310 2024-04-20T12:29:11.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.621+0000 7f3e8403c740 10 client.17493 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:11.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.621+0000 7f3e8403c740 10 client.17493 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:29:11.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.621+0000 7f3e8403c740 20 client.17493 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:11.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.621+0000 7f3e8403c740 1 --2- 172.21.15.135:0/2990187319 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x565495ab66a0 0x565495ab8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.621+0000 7f3e8403c740 4 client.17493 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:11.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.621+0000 7f3e8403c740 1 -- 172.21.15.135:0/2990187319 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565495a0fb30 con 0x565495ab66a0 2024-04-20T12:29:11.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.621+0000 7f3e7affd640 1 --2- 172.21.15.135:0/2990187319 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x565495ab66a0 0x565495ab8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.621+0000 7f3e7affd640 1 --2- 172.21.15.135:0/2990187319 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x565495ab66a0 0x565495ab8ad0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=78b017a1ff007ede server_cookie=caaf2ea5bb858cbb in_seq=0 out_seq=0 2024-04-20T12:29:11.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.621+0000 7f3e5eff5640 10 client.17493 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:29:11.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.622+0000 7f3e5eff5640 1 -- 172.21.15.135:0/2990187319 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x565495a0fb30 con 0x565495ab66a0 2024-04-20T12:29:11.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.622+0000 7f3e5eff5640 10 client.17493 handle_command_reply: tid=0 2024-04-20T12:29:11.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.622+0000 7f3e8403c740 1 client.17493 shutdown 2024-04-20T12:29:11.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.622+0000 7f3e8403c740 1 -- 172.21.15.135:0/2990187319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495aa6310 msgr2=0x565495aa3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.622+0000 7f3e8403c740 1 --2- 172.21.15.135:0/2990187319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495aa6310 0x565495aa3d90 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f3e740038a0 tx=0x7f3e740046c0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.622+0000 7f3e8403c740 1 -- 172.21.15.135:0/2990187319 shutdown_connections 2024-04-20T12:29:11.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.622+0000 7f3e8403c740 1 --2- 172.21.15.135:0/2990187319 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x565495ab66a0 0x565495ab8ad0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.622+0000 7f3e8403c740 1 --2- 172.21.15.135:0/2990187319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495aa6310 0x565495aa3d90 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.622+0000 7f3e8403c740 1 --2- 172.21.15.135:0/2990187319 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495a9d730 0x565495aa3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.622+0000 7f3e5eff5640 0 client.17493 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:29:11.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.622+0000 7f3e8403c740 1 --2- 172.21.15.135:0/2990187319 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9ce10 0x565495aa3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.622+0000 7f3e8403c740 1 -- 172.21.15.135:0/2990187319 >> 172.21.15.135:0/2990187319 conn(0x565495a97540 msgr2=0x565495a99290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.622+0000 7f3e8403c740 1 -- 172.21.15.135:0/2990187319 shutdown_connections 2024-04-20T12:29:11.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.622+0000 7f3e8403c740 1 -- 172.21.15.135:0/2990187319 wait complete. 2024-04-20T12:29:11.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.622+0000 7f3e8403c740 20 client.17493 trim_cache size 0 max 16384 2024-04-20T12:29:11.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.635+0000 7f3e8403c740 1 Processor -- start 2024-04-20T12:29:11.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.635+0000 7f3e8403c740 1 -- start start 2024-04-20T12:29:11.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.635+0000 7f3e8403c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9ce10 0x565495aa5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.635+0000 7f3e8403c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9d730 0x565495ab1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.635+0000 7f3e8403c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495aa6310 0x565495abe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.635+0000 7f3e8403c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1b1600 con 0x565495a9ce10 2024-04-20T12:29:11.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.635+0000 7f3e8403c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1b3140 con 0x565495a9d730 2024-04-20T12:29:11.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.635+0000 7f3e8403c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1b1cd0 con 0x565495aa6310 2024-04-20T12:29:11.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.635+0000 7f3e7affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9ce10 0x565495aa5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.635+0000 7f3e7affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9ce10 0x565495aa5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55924/0 (socket says 172.21.15.135:55924) 2024-04-20T12:29:11.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.635+0000 7f3e7affd640 1 -- 172.21.15.135:0/1136520803 learned_addr learned my addr 172.21.15.135:0/1136520803 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.636+0000 7f3e7affd640 1 -- 172.21.15.135:0/1136520803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495aa6310 msgr2=0x565495abe3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.636+0000 7f3e7affd640 1 --2- 172.21.15.135:0/1136520803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495aa6310 0x565495abe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.636+0000 7f3e7a7fc640 1 --2- 172.21.15.135:0/1136520803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9d730 0x565495ab1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.636+0000 7f3e7affd640 1 -- 172.21.15.135:0/1136520803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9d730 msgr2=0x565495ab1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.636+0000 7f3e7affd640 1 --2- 172.21.15.135:0/1136520803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9d730 0x565495ab1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.636+0000 7f3e7affd640 1 -- 172.21.15.135:0/1136520803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565495a91af0 con 0x565495a9ce10 2024-04-20T12:29:11.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.636+0000 7f3e7a7fc640 1 --2- 172.21.15.135:0/1136520803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9d730 0x565495ab1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:11.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.636+0000 7f3e7affd640 1 --2- 172.21.15.135:0/1136520803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9ce10 0x565495aa5a40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c09cc70 tx=0x7f3e6c009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3fc8934a1383c13 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.636+0000 7f3e60ff9640 1 -- 172.21.15.135:0/1136520803 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c09d670 con 0x565495a9ce10 2024-04-20T12:29:11.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.636+0000 7f3e60ff9640 1 -- 172.21.15.135:0/1136520803 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e6c0b6070 con 0x565495a9ce10 2024-04-20T12:29:11.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.636+0000 7f3e60ff9640 1 -- 172.21.15.135:0/1136520803 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c004620 con 0x565495a9ce10 2024-04-20T12:29:11.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 -- 172.21.15.135:0/1136520803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9ce10 msgr2=0x565495aa5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 --2- 172.21.15.135:0/1136520803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9ce10 0x565495aa5a40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c09cc70 tx=0x7f3e6c009200 comp rx=0 tx=0).stop 2024-04-20T12:29:11.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 -- 172.21.15.135:0/1136520803 shutdown_connections 2024-04-20T12:29:11.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 --2- 172.21.15.135:0/1136520803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495aa6310 0x565495abe3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 --2- 172.21.15.135:0/1136520803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9d730 0x565495ab1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 --2- 172.21.15.135:0/1136520803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9ce10 0x565495aa5a40 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 -- 172.21.15.135:0/1136520803 >> 172.21.15.135:0/1136520803 conn(0x565495a97540 msgr2=0x565495a966e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 -- 172.21.15.135:0/1136520803 shutdown_connections 2024-04-20T12:29:11.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 -- 172.21.15.135:0/1136520803 wait complete. 2024-04-20T12:29:11.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 -- start start 2024-04-20T12:29:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 Processor -- start 2024-04-20T12:29:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9ce10 0x565495aae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9d730 0x565495aa9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495aa6310 0x565495aaa430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1b2a70 con 0x565495a9ce10 2024-04-20T12:29:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1b23a0 con 0x565495a9d730 2024-04-20T12:29:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7c1af5d0 con 0x565495aa6310 2024-04-20T12:29:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e8403c740 10 client.0 _ll_register_callbacks cb 0x7f3e74009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e7affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9ce10 0x565495aae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e7affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9ce10 0x565495aae9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55928/0 (socket says 172.21.15.135:55928) 2024-04-20T12:29:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e7affd640 1 -- 172.21.15.135:0/3670701745 learned_addr learned my addr 172.21.15.135:0/3670701745 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e7a7fc640 1 --2- 172.21.15.135:0/3670701745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9d730 0x565495aa9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.637+0000 7f3e7b7fe640 1 --2- 172.21.15.135:0/3670701745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495aa6310 0x565495aaa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e7affd640 1 -- 172.21.15.135:0/3670701745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495aa6310 msgr2=0x565495aaa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e7affd640 1 --2- 172.21.15.135:0/3670701745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495aa6310 0x565495aaa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e7affd640 1 -- 172.21.15.135:0/3670701745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9d730 msgr2=0x565495aa9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e7affd640 1 --2- 172.21.15.135:0/3670701745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9d730 0x565495aa9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e7affd640 1 -- 172.21.15.135:0/3670701745 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565495b1bc10 con 0x565495a9ce10 2024-04-20T12:29:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e7a7fc640 1 --2- 172.21.15.135:0/3670701745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9d730 0x565495aa9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e7affd640 1 --2- 172.21.15.135:0/3670701745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9ce10 0x565495aae9d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c099940 tx=0x7f3e6c0a5d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36057422683cadb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e5eff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e5eff5640 1 -- 172.21.15.135:0/3670701745 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c0d1030 con 0x565495a9ce10 2024-04-20T12:29:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e5eff5640 1 -- 172.21.15.135:0/3670701745 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f3e6c0ce9a0 con 0x565495a9ce10 2024-04-20T12:29:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e8403c740 1 -- 172.21.15.135:0/3670701745 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e6c0b6070 con 0x565495a9ce10 2024-04-20T12:29:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e5eff5640 1 -- 172.21.15.135:0/3670701745 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3e6c0995e0 con 0x565495a9ce10 2024-04-20T12:29:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e8403c740 10 client.17499 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e8403c740 1 -- 172.21.15.135:0/3670701745 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x565495b1cd20 con 0x565495a9ce10 2024-04-20T12:29:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e5eff5640 1 -- 172.21.15.135:0/3670701745 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e6c0b6070 con 0x565495a9ce10 2024-04-20T12:29:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e5eff5640 1 -- 172.21.15.135:0/3670701745 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f3e6c0a5750 con 0x565495a9ce10 2024-04-20T12:29:11.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e8403c740 10 client.17499 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:11.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e8403c740 10 client.17499 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:29:11.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.638+0000 7f3e8403c740 20 client.17499 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:11.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e8403c740 1 --2- 172.21.15.135:0/3670701745 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x565495b1cfb0 0x565495b1f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e8403c740 4 client.17499 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:29:11.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e8403c740 1 -- 172.21.15.135:0/3670701745 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565495a099a0 con 0x565495b1cfb0 2024-04-20T12:29:11.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e7a7fc640 1 --2- 172.21.15.135:0/3670701745 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x565495b1cfb0 0x565495b1f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e5eff5640 10 client.17499 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:29:11.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e7a7fc640 1 --2- 172.21.15.135:0/3670701745 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x565495b1cfb0 0x565495b1f3a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5416f1220c0776ae server_cookie=26e0d7ae4b5d0d79 in_seq=0 out_seq=0 2024-04-20T12:29:11.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e5eff5640 1 -- 172.21.15.135:0/3670701745 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565495a099a0 con 0x565495b1cfb0 2024-04-20T12:29:11.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e5eff5640 10 client.17499 handle_command_reply: tid=0 2024-04-20T12:29:11.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e8403c740 1 client.17499 shutdown 2024-04-20T12:29:11.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e8403c740 1 -- 172.21.15.135:0/3670701745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9ce10 msgr2=0x565495aae9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e8403c740 1 --2- 172.21.15.135:0/3670701745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9ce10 0x565495aae9d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c099940 tx=0x7f3e6c0a5d20 comp rx=0 tx=0).stop 2024-04-20T12:29:11.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e8403c740 1 -- 172.21.15.135:0/3670701745 shutdown_connections 2024-04-20T12:29:11.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e8403c740 1 --2- 172.21.15.135:0/3670701745 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x565495b1cfb0 0x565495b1f3a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e8403c740 1 --2- 172.21.15.135:0/3670701745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x565495aa6310 0x565495aaa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e8403c740 1 --2- 172.21.15.135:0/3670701745 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x565495a9d730 0x565495aa9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e8403c740 1 --2- 172.21.15.135:0/3670701745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565495a9ce10 0x565495aae9d0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e5eff5640 0 client.17499 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:29:11.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e8403c740 1 -- 172.21.15.135:0/3670701745 >> 172.21.15.135:0/3670701745 conn(0x565495a97540 msgr2=0x565495aa32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e8403c740 1 -- 172.21.15.135:0/3670701745 shutdown_connections 2024-04-20T12:29:11.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e8403c740 1 -- 172.21.15.135:0/3670701745 wait complete. 2024-04-20T12:29:11.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.639+0000 7f3e8403c740 20 client.17499 trim_cache size 0 max 16384 2024-04-20T12:29:11.645 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:29:11.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.640+0000 7f3e81443640 1 -- 172.21.15.135:0/894978531 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3e640a3d20 msgr2=0x7f3e640a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.640+0000 7f3e81443640 1 --2- 172.21.15.135:0/894978531 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3e640a3d20 0x7f3e640a61e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009d30 tx=0x7f3e74005f90 comp rx=0 tx=0).stop 2024-04-20T12:29:11.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.640+0000 7f3e81443640 1 -- 172.21.15.135:0/894978531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e7c101090 msgr2=0x7f3e7c1a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.640+0000 7f3e81443640 1 --2- 172.21.15.135:0/894978531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e7c101090 0x7f3e7c1a0650 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009d50 tx=0x7f3e6c00c6a0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.640+0000 7f3e81443640 1 -- 172.21.15.135:0/894978531 shutdown_connections 2024-04-20T12:29:11.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.640+0000 7f3e81443640 1 --2- 172.21.15.135:0/894978531 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3e7c19a7c0 0x7f3e7c19ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.640+0000 7f3e81443640 1 --2- 172.21.15.135:0/894978531 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3e640a3d20 0x7f3e640a61e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.640+0000 7f3e81443640 1 --2- 172.21.15.135:0/894978531 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3e7c106160 0x7f3e7c1a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.640+0000 7f3e81443640 1 --2- 172.21.15.135:0/894978531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e7c101090 0x7f3e7c1a0650 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.640+0000 7f3e81443640 1 -- 172.21.15.135:0/894978531 >> 172.21.15.135:0/894978531 conn(0x7f3e7c078010 msgr2=0x7f3e7c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.640+0000 7f3e81443640 1 -- 172.21.15.135:0/894978531 shutdown_connections 2024-04-20T12:29:11.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.640+0000 7f3e81443640 1 -- 172.21.15.135:0/894978531 wait complete. 2024-04-20T12:29:11.649 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:29:11.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.752+0000 7f2e55906640 1 -- 172.21.15.135:0/2268392097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e50074260 msgr2=0x7f2e50074640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.752+0000 7f2e55906640 1 --2- 172.21.15.135:0/2268392097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e50074260 0x7f2e50074640 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009900 tx=0x7f2e4002bcd0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.752+0000 7f2e55906640 1 -- 172.21.15.135:0/2268392097 shutdown_connections 2024-04-20T12:29:11.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.752+0000 7f2e55906640 1 --2- 172.21.15.135:0/2268392097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e5010e820 0x7f2e50110c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.752+0000 7f2e55906640 1 --2- 172.21.15.135:0/2268392097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e50074b80 0x7f2e5010e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.752+0000 7f2e55906640 1 --2- 172.21.15.135:0/2268392097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e50074260 0x7f2e50074640 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.752+0000 7f2e55906640 1 -- 172.21.15.135:0/2268392097 >> 172.21.15.135:0/2268392097 conn(0x7f2e500793f0 msgr2=0x7f2e50079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.752+0000 7f2e55906640 1 -- 172.21.15.135:0/2268392097 shutdown_connections 2024-04-20T12:29:11.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.752+0000 7f2e55906640 1 -- 172.21.15.135:0/2268392097 wait complete. 2024-04-20T12:29:11.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e55906640 1 Processor -- start 2024-04-20T12:29:11.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e55906640 1 -- start start 2024-04-20T12:29:11.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e55906640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e50074260 0x7f2e501a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e55906640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e50074b80 0x7f2e501a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e55906640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5010e820 0x7f2e5019a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e55906640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501145f0 con 0x7f2e50074b80 2024-04-20T12:29:11.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e55906640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2e50114470 con 0x7f2e50074260 2024-04-20T12:29:11.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e55906640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e50114770 con 0x7f2e5010e820 2024-04-20T12:29:11.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e50074b80 0x7f2e501a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e50074b80 0x7f2e501a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55954/0 (socket says 172.21.15.135:55954) 2024-04-20T12:29:11.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e47fff640 1 -- 172.21.15.135:0/110672931 learned_addr learned my addr 172.21.15.135:0/110672931 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e4effd640 1 --2- 172.21.15.135:0/110672931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e50074260 0x7f2e501a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e47fff640 1 -- 172.21.15.135:0/110672931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5010e820 msgr2=0x7f2e5019a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e4f7fe640 1 --2- 172.21.15.135:0/110672931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5010e820 0x7f2e5019a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e47fff640 1 --2- 172.21.15.135:0/110672931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5010e820 0x7f2e5019a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e47fff640 1 -- 172.21.15.135:0/110672931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e50074260 msgr2=0x7f2e501a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e47fff640 1 --2- 172.21.15.135:0/110672931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e50074260 0x7f2e501a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e47fff640 1 -- 172.21.15.135:0/110672931 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5019b060 con 0x7f2e50074b80 2024-04-20T12:29:11.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.753+0000 7f2e4effd640 1 --2- 172.21.15.135:0/110672931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e50074260 0x7f2e501a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:11.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.754+0000 7f2e47fff640 1 --2- 172.21.15.135:0/110672931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e50074b80 0x7f2e501a0c20 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800b4a0 tx=0x7f2e3800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.754+0000 7f2e54904640 1 -- 172.21.15.135:0/110672931 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38014070 con 0x7f2e50074b80 2024-04-20T12:29:11.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.754+0000 7f2e55906640 1 -- 172.21.15.135:0/110672931 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5019b350 con 0x7f2e50074b80 2024-04-20T12:29:11.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.754+0000 7f2e54904640 1 -- 172.21.15.135:0/110672931 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e38010af0 con 0x7f2e50074b80 2024-04-20T12:29:11.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.754+0000 7f2e54904640 1 -- 172.21.15.135:0/110672931 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38017d10 con 0x7f2e50074b80 2024-04-20T12:29:11.756 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.754+0000 7f2e55906640 1 -- 172.21.15.135:0/110672931 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e501a75a0 con 0x7f2e50074b80 2024-04-20T12:29:11.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e54904640 1 -- 172.21.15.135:0/110672931 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f2e38017070 con 0x7f2e50074b80 2024-04-20T12:29:11.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e585cb740 1 Processor -- start 2024-04-20T12:29:11.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e585cb740 1 -- start start 2024-04-20T12:29:11.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e585cb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039face10 0x562039fad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e585cb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039fad730 0x562039fb5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e585cb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fb8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e585cb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562039f12110 con 0x562039fb6310 2024-04-20T12:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e585cb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562039eaf550 con 0x562039fad730 2024-04-20T12:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e585cb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562039f0e0d0 con 0x562039face10 2024-04-20T12:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fb8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fb8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55968/0 (socket says 172.21.15.135:55968) 2024-04-20T12:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e47fff640 1 -- 172.21.15.135:0/3841393808 learned_addr learned my addr 172.21.15.135:0/3841393808 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e54904640 1 --2- 172.21.15.135:0/110672931 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2e3c0a3d20 0x7f2e3c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e4effd640 1 --2- 172.21.15.135:0/3841393808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039fad730 0x562039fb5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e4f7fe640 1 --2- 172.21.15.135:0/3841393808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039face10 0x562039fad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e4f7fe640 1 --2- 172.21.15.135:0/110672931 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2e3c0a3d20 0x7f2e3c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e47fff640 1 -- 172.21.15.135:0/3841393808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039face10 msgr2=0x562039fad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e47fff640 1 --2- 172.21.15.135:0/3841393808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039face10 0x562039fad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e47fff640 1 -- 172.21.15.135:0/3841393808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039fad730 msgr2=0x562039fb5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e47fff640 1 --2- 172.21.15.135:0/3841393808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039fad730 0x562039fb5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e54904640 1 -- 172.21.15.135:0/110672931 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f2e380cff10 con 0x7f2e50074b80 2024-04-20T12:29:11.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e47fff640 1 -- 172.21.15.135:0/3841393808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562039ed7900 con 0x562039fb6310 2024-04-20T12:29:11.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.757+0000 7f2e4f7fe640 1 --2- 172.21.15.135:0/3841393808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039face10 0x562039fad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:11.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.758+0000 7f2e47fff640 1 --2- 172.21.15.135:0/3841393808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fb8700 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f2e38098610 tx=0x7f2e38050d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205ebe1556a85592 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.758+0000 7f2e45ffb640 1 -- 172.21.15.135:0/3841393808 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3809c340 con 0x562039fb6310 2024-04-20T12:29:11.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.758+0000 7f2e45ffb640 1 -- 172.21.15.135:0/3841393808 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e3809bc40 con 0x562039fb6310 2024-04-20T12:29:11.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.758+0000 7f2e45ffb640 1 -- 172.21.15.135:0/3841393808 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e380cd560 con 0x562039fb6310 2024-04-20T12:29:11.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.758+0000 7f2e585cb740 1 -- 172.21.15.135:0/3841393808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 msgr2=0x562039fb8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.758+0000 7f2e4f7fe640 1 --2- 172.21.15.135:0/110672931 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2e3c0a3d20 0x7f2e3c0a61e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2e48006bd0 tx=0x7f2e48005df0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.758+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3841393808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fb8700 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f2e38098610 tx=0x7f2e38050d80 comp rx=0 tx=0).stop 2024-04-20T12:29:11.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 1 -- 172.21.15.135:0/3841393808 shutdown_connections 2024-04-20T12:29:11.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3841393808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fb8700 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3841393808 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039fad730 0x562039fb5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3841393808 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039face10 0x562039fad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 1 -- 172.21.15.135:0/3841393808 >> 172.21.15.135:0/3841393808 conn(0x562039fa7540 msgr2=0x562039fa7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 1 -- 172.21.15.135:0/3841393808 shutdown_connections 2024-04-20T12:29:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 1 -- 172.21.15.135:0/3841393808 wait complete. 2024-04-20T12:29:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 1 -- start start 2024-04-20T12:29:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 1 Processor -- start 2024-04-20T12:29:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039face10 0x562039fb3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039fad730 0x562039fb3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fb3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562039fb8fe0 con 0x562039fb6310 2024-04-20T12:29:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562039ecb500 con 0x562039fad730 2024-04-20T12:29:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562039fb9160 con 0x562039face10 2024-04-20T12:29:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e585cb740 10 client.0 _ll_register_callbacks cb 0x562039eb02f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e4f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fb3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e4f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fb3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55970/0 (socket says 172.21.15.135:55970) 2024-04-20T12:29:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.759+0000 7f2e4f7fe640 1 -- 172.21.15.135:0/3565224577 learned_addr learned my addr 172.21.15.135:0/3565224577 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e4effd640 1 --2- 172.21.15.135:0/3565224577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039face10 0x562039fb3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e47fff640 1 --2- 172.21.15.135:0/3565224577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039fad730 0x562039fb3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e4f7fe640 1 -- 172.21.15.135:0/3565224577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039face10 msgr2=0x562039fb3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e4f7fe640 1 --2- 172.21.15.135:0/3565224577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039face10 0x562039fb3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e4f7fe640 1 -- 172.21.15.135:0/3565224577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039fad730 msgr2=0x562039fb3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e4f7fe640 1 --2- 172.21.15.135:0/3565224577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039fad730 0x562039fb3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e4f7fe640 1 -- 172.21.15.135:0/3565224577 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562039c243f0 con 0x562039fb6310 2024-04-20T12:29:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e4f7fe640 1 --2- 172.21.15.135:0/3565224577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fb3ed0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f2e480149c0 tx=0x7f2e48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1f71ddcc5ceb51 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e2effd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e2effd640 1 -- 172.21.15.135:0/3565224577 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e48025060 con 0x562039fb6310 2024-04-20T12:29:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e2effd640 1 -- 172.21.15.135:0/3565224577 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f2e48013d50 con 0x562039fb6310 2024-04-20T12:29:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e585cb740 1 -- 172.21.15.135:0/3565224577 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e3809bc40 con 0x562039fb6310 2024-04-20T12:29:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e2effd640 1 -- 172.21.15.135:0/3565224577 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2e4802c050 con 0x562039fb6310 2024-04-20T12:29:11.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e585cb740 10 client.17511 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:11.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e585cb740 1 -- 172.21.15.135:0/3565224577 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562039cee7d0 con 0x562039fb6310 2024-04-20T12:29:11.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.760+0000 7f2e2effd640 1 -- 172.21.15.135:0/3565224577 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e3809bc40 con 0x562039fb6310 2024-04-20T12:29:11.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.761+0000 7f2e2effd640 1 -- 172.21.15.135:0/3565224577 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2e4801f550 con 0x562039fb6310 2024-04-20T12:29:11.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.761+0000 7f2e585cb740 10 client.17511 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:11.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.761+0000 7f2e585cb740 10 client.17511 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:29:11.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.761+0000 7f2e585cb740 20 client.17511 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:11.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.761+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3565224577 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x562039fc66a0 0x562039fc8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.761+0000 7f2e585cb740 4 client.17511 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:11.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.761+0000 7f2e585cb740 1 -- 172.21.15.135:0/3565224577 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562039f1fb30 con 0x562039fc66a0 2024-04-20T12:29:11.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.761+0000 7f2e4effd640 1 --2- 172.21.15.135:0/3565224577 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x562039fc66a0 0x562039fc8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.761+0000 7f2e2effd640 10 client.17511 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:29:11.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.761+0000 7f2e4effd640 1 --2- 172.21.15.135:0/3565224577 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x562039fc66a0 0x562039fc8a90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=556da25a4bc69be3 server_cookie=3b8327e9d15707fc in_seq=0 out_seq=0 2024-04-20T12:29:11.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.762+0000 7f2e2effd640 1 -- 172.21.15.135:0/3565224577 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562039f1fb30 con 0x562039fc66a0 2024-04-20T12:29:11.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.762+0000 7f2e2effd640 10 client.17511 handle_command_reply: tid=0 2024-04-20T12:29:11.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.762+0000 7f2e585cb740 1 client.17511 shutdown 2024-04-20T12:29:11.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.762+0000 7f2e585cb740 1 -- 172.21.15.135:0/3565224577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 msgr2=0x562039fb3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.762+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3565224577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fb3ed0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f2e480149c0 tx=0x7f2e48004a40 comp rx=0 tx=0).stop 2024-04-20T12:29:11.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.762+0000 7f2e585cb740 1 -- 172.21.15.135:0/3565224577 shutdown_connections 2024-04-20T12:29:11.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.762+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3565224577 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x562039fc66a0 0x562039fc8a90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.762+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3565224577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fb3ed0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.762+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3565224577 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039fad730 0x562039fb3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.762+0000 7f2e2effd640 0 client.17511 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:29:11.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.762+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3565224577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039face10 0x562039fb3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.762+0000 7f2e585cb740 1 -- 172.21.15.135:0/3565224577 >> 172.21.15.135:0/3565224577 conn(0x562039fa7540 msgr2=0x562039fa9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.762+0000 7f2e585cb740 1 -- 172.21.15.135:0/3565224577 shutdown_connections 2024-04-20T12:29:11.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.762+0000 7f2e585cb740 1 -- 172.21.15.135:0/3565224577 wait complete. 2024-04-20T12:29:11.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.762+0000 7f2e585cb740 20 client.17511 trim_cache size 0 max 16384 2024-04-20T12:29:11.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e585cb740 1 Processor -- start 2024-04-20T12:29:11.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e585cb740 1 -- start start 2024-04-20T12:29:11.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e585cb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039face10 0x562039fc1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e585cb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039fad730 0x562039fce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e585cb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e585cb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501b1760 con 0x562039fb6310 2024-04-20T12:29:11.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e585cb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501b32a0 con 0x562039fad730 2024-04-20T12:29:11.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e585cb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501b1e30 con 0x562039face10 2024-04-20T12:29:11.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e4f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e4f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fce8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55974/0 (socket says 172.21.15.135:55974) 2024-04-20T12:29:11.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e4f7fe640 1 -- 172.21.15.135:0/2484409825 learned_addr learned my addr 172.21.15.135:0/2484409825 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e4f7fe640 1 -- 172.21.15.135:0/2484409825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039face10 msgr2=0x562039fc1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e4f7fe640 1 --2- 172.21.15.135:0/2484409825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039face10 0x562039fc1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e4f7fe640 1 -- 172.21.15.135:0/2484409825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039fad730 msgr2=0x562039fce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e47fff640 1 --2- 172.21.15.135:0/2484409825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039fad730 0x562039fce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e4f7fe640 1 --2- 172.21.15.135:0/2484409825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039fad730 0x562039fce360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e4f7fe640 1 -- 172.21.15.135:0/2484409825 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562039fc8e00 con 0x562039fb6310 2024-04-20T12:29:11.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e4f7fe640 1 --2- 172.21.15.135:0/2484409825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fce8a0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f2e4801f920 tx=0x7f2e48006190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b79685b11801fbb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e457fa640 1 -- 172.21.15.135:0/2484409825 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4801fd90 con 0x562039fb6310 2024-04-20T12:29:11.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e457fa640 1 -- 172.21.15.135:0/2484409825 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e4801b050 con 0x562039fb6310 2024-04-20T12:29:11.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.776+0000 7f2e457fa640 1 -- 172.21.15.135:0/2484409825 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e48030850 con 0x562039fb6310 2024-04-20T12:29:11.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.777+0000 7f2e585cb740 1 -- 172.21.15.135:0/2484409825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 msgr2=0x562039fce8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.777+0000 7f2e585cb740 1 --2- 172.21.15.135:0/2484409825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fce8a0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f2e4801f920 tx=0x7f2e48006190 comp rx=0 tx=0).stop 2024-04-20T12:29:11.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.777+0000 7f2e585cb740 1 -- 172.21.15.135:0/2484409825 shutdown_connections 2024-04-20T12:29:11.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.777+0000 7f2e585cb740 1 --2- 172.21.15.135:0/2484409825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fb6310 0x562039fce8a0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.777+0000 7f2e585cb740 1 --2- 172.21.15.135:0/2484409825 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039fad730 0x562039fce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.777+0000 7f2e585cb740 1 --2- 172.21.15.135:0/2484409825 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039face10 0x562039fc1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.777+0000 7f2e585cb740 1 -- 172.21.15.135:0/2484409825 >> 172.21.15.135:0/2484409825 conn(0x562039fa7540 msgr2=0x562039fa7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.777+0000 7f2e585cb740 1 -- 172.21.15.135:0/2484409825 shutdown_connections 2024-04-20T12:29:11.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.777+0000 7f2e585cb740 1 -- 172.21.15.135:0/2484409825 wait complete. 2024-04-20T12:29:11.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.777+0000 7f2e585cb740 1 -- start start 2024-04-20T12:29:11.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e585cb740 1 Processor -- start 2024-04-20T12:29:11.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e585cb740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039face10 0x562039fb9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e585cb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fad730 0x562039fba430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e585cb740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039fb6310 0x562039fba970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e585cb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501b2bd0 con 0x562039fad730 2024-04-20T12:29:11.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e585cb740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501b2500 con 0x562039face10 2024-04-20T12:29:11.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e585cb740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501af730 con 0x562039fb6310 2024-04-20T12:29:11.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e585cb740 10 client.0 _ll_register_callbacks cb 0x7f2e48017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:11.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fad730 0x562039fba430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e47fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fad730 0x562039fba430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55976/0 (socket says 172.21.15.135:55976) 2024-04-20T12:29:11.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e47fff640 1 -- 172.21.15.135:0/3661795933 learned_addr learned my addr 172.21.15.135:0/3661795933 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e47fff640 1 -- 172.21.15.135:0/3661795933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039fb6310 msgr2=0x562039fba970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e47fff640 1 --2- 172.21.15.135:0/3661795933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039fb6310 0x562039fba970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e4effd640 1 --2- 172.21.15.135:0/3661795933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039face10 0x562039fb9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e47fff640 1 -- 172.21.15.135:0/3661795933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039face10 msgr2=0x562039fb9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e47fff640 1 --2- 172.21.15.135:0/3661795933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039face10 0x562039fb9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e47fff640 1 -- 172.21.15.135:0/3661795933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56203a02bd00 con 0x562039fad730 2024-04-20T12:29:11.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e47fff640 1 --2- 172.21.15.135:0/3661795933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fad730 0x562039fba430 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f2e380cd8e0 tx=0x7f2e38009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516be8b1414571ed server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e2effd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:11.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e2effd640 1 -- 172.21.15.135:0/3661795933 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3801e040 con 0x562039fad730 2024-04-20T12:29:11.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e2effd640 1 -- 172.21.15.135:0/3661795933 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f2e38017360 con 0x562039fad730 2024-04-20T12:29:11.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.778+0000 7f2e585cb740 1 -- 172.21.15.135:0/3661795933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e4801b050 con 0x562039fad730 2024-04-20T12:29:11.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.779+0000 7f2e2effd640 1 -- 172.21.15.135:0/3661795933 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2e380a48b0 con 0x562039fad730 2024-04-20T12:29:11.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.779+0000 7f2e585cb740 10 client.17517 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:11.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.779+0000 7f2e585cb740 1 -- 172.21.15.135:0/3661795933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56203a02cfe0 con 0x562039fad730 2024-04-20T12:29:11.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.779+0000 7f2e2effd640 1 -- 172.21.15.135:0/3661795933 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e4801b050 con 0x562039fad730 2024-04-20T12:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.779+0000 7f2e2effd640 1 -- 172.21.15.135:0/3661795933 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2e38010ca0 con 0x562039fad730 2024-04-20T12:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.779+0000 7f2e585cb740 10 client.17517 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.779+0000 7f2e585cb740 10 client.17517 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.779+0000 7f2e585cb740 20 client.17517 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.779+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3661795933 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56203a02d3d0 0x56203a02f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.779+0000 7f2e585cb740 4 client.17517 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.779+0000 7f2e585cb740 1 -- 172.21.15.135:0/3661795933 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562039f199a0 con 0x56203a02d3d0 2024-04-20T12:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.779+0000 7f2e4effd640 1 --2- 172.21.15.135:0/3661795933 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56203a02d3d0 0x56203a02f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e2effd640 10 client.17517 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e4effd640 1 --2- 172.21.15.135:0/3661795933 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56203a02d3d0 0x56203a02f7c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=53b11645cf979eae server_cookie=66f37e00dbde5f7d in_seq=0 out_seq=0 2024-04-20T12:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e2effd640 1 -- 172.21.15.135:0/3661795933 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562039f199a0 con 0x56203a02d3d0 2024-04-20T12:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e2effd640 10 client.17517 handle_command_reply: tid=0 2024-04-20T12:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e585cb740 1 client.17517 shutdown 2024-04-20T12:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e585cb740 1 -- 172.21.15.135:0/3661795933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fad730 msgr2=0x562039fba430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3661795933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fad730 0x562039fba430 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f2e380cd8e0 tx=0x7f2e38009390 comp rx=0 tx=0).stop 2024-04-20T12:29:11.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e585cb740 1 -- 172.21.15.135:0/3661795933 shutdown_connections 2024-04-20T12:29:11.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3661795933 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x56203a02d3d0 0x56203a02f7c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3661795933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562039fb6310 0x562039fba970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3661795933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562039fad730 0x562039fba430 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e2effd640 0 client.17517 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:29:11.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e585cb740 1 --2- 172.21.15.135:0/3661795933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562039face10 0x562039fb9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e585cb740 1 -- 172.21.15.135:0/3661795933 >> 172.21.15.135:0/3661795933 conn(0x562039fa7540 msgr2=0x562039fa5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e585cb740 1 -- 172.21.15.135:0/3661795933 shutdown_connections 2024-04-20T12:29:11.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e585cb740 1 -- 172.21.15.135:0/3661795933 wait complete. 2024-04-20T12:29:11.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.780+0000 7f2e585cb740 20 client.17517 trim_cache size 0 max 16384 2024-04-20T12:29:11.785 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:29:11.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.781+0000 7f2e55906640 1 -- 172.21.15.135:0/110672931 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2e3c0a3d20 msgr2=0x7f2e3c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.781+0000 7f2e55906640 1 --2- 172.21.15.135:0/110672931 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2e3c0a3d20 0x7f2e3c0a61e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2e48006bd0 tx=0x7f2e48005df0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.781+0000 7f2e55906640 1 -- 172.21.15.135:0/110672931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e50074b80 msgr2=0x7f2e501a0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.781+0000 7f2e55906640 1 --2- 172.21.15.135:0/110672931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e50074b80 0x7f2e501a0c20 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800b4a0 tx=0x7f2e3800b960 comp rx=0 tx=0).stop 2024-04-20T12:29:11.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.781+0000 7f2e55906640 1 -- 172.21.15.135:0/110672931 shutdown_connections 2024-04-20T12:29:11.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.781+0000 7f2e55906640 1 --2- 172.21.15.135:0/110672931 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2e3c0a3d20 0x7f2e3c0a61e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.781+0000 7f2e55906640 1 --2- 172.21.15.135:0/110672931 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e5010e820 0x7f2e5019a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.781+0000 7f2e55906640 1 --2- 172.21.15.135:0/110672931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e50074b80 0x7f2e501a0c20 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.781+0000 7f2e55906640 1 --2- 172.21.15.135:0/110672931 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e50074260 0x7f2e501a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.781+0000 7f2e55906640 1 -- 172.21.15.135:0/110672931 >> 172.21.15.135:0/110672931 conn(0x7f2e500793f0 msgr2=0x7f2e500fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.781+0000 7f2e55906640 1 -- 172.21.15.135:0/110672931 shutdown_connections 2024-04-20T12:29:11.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.781+0000 7f2e55906640 1 -- 172.21.15.135:0/110672931 wait complete. 2024-04-20T12:29:11.789 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:11 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2556068566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:29:11.790 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:29:11.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 -- 172.21.15.135:0/3705681584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0308106170 msgr2=0x7f030810dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 --2- 172.21.15.135:0/3705681584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0308106170 0x7f030810dd40 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f0300009ca0 tx=0x7f030002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 -- 172.21.15.135:0/3705681584 shutdown_connections 2024-04-20T12:29:11.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 --2- 172.21.15.135:0/3705681584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0308106170 0x7f030810dd40 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 --2- 172.21.15.135:0/3705681584 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0308101a50 0x7f0308105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 --2- 172.21.15.135:0/3705681584 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03081010a0 0x7f0308101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 -- 172.21.15.135:0/3705681584 >> 172.21.15.135:0/3705681584 conn(0x7f03080771e0 msgr2=0x7f03080775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 -- 172.21.15.135:0/3705681584 shutdown_connections 2024-04-20T12:29:11.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 -- 172.21.15.135:0/3705681584 wait complete. 2024-04-20T12:29:11.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 Processor -- start 2024-04-20T12:29:11.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 -- start start 2024-04-20T12:29:11.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03081010a0 0x7f03081995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0308106170 0x7f0308199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f030819a0a0 0x7f03081a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0308111210 con 0x7f030819a0a0 2024-04-20T12:29:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0308111090 con 0x7f03081010a0 2024-04-20T12:29:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.891+0000 7f030f3bd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0308111390 con 0x7f0308106170 2024-04-20T12:29:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f030d95a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f030819a0a0 0x7f03081a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f030d95a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f030819a0a0 0x7f03081a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55992/0 (socket says 172.21.15.135:55992) 2024-04-20T12:29:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f030d95a640 1 -- 172.21.15.135:0/1973242294 learned_addr learned my addr 172.21.15.135:0/1973242294 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f030c958640 1 --2- 172.21.15.135:0/1973242294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0308106170 0x7f0308199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f030d159640 1 --2- 172.21.15.135:0/1973242294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03081010a0 0x7f03081995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f030d95a640 1 -- 172.21.15.135:0/1973242294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0308106170 msgr2=0x7f0308199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f030d95a640 1 --2- 172.21.15.135:0/1973242294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0308106170 0x7f0308199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f030d95a640 1 -- 172.21.15.135:0/1973242294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03081010a0 msgr2=0x7f03081995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f030d95a640 1 --2- 172.21.15.135:0/1973242294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03081010a0 0x7f03081995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f030d95a640 1 -- 172.21.15.135:0/1973242294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03081a4e20 con 0x7f030819a0a0 2024-04-20T12:29:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f030d95a640 1 --2- 172.21.15.135:0/1973242294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f030819a0a0 0x7f03081a4650 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f030002c700 tx=0x7f0300032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f02fe7fc640 1 -- 172.21.15.135:0/1973242294 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0300039040 con 0x7f030819a0a0 2024-04-20T12:29:11.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f02fe7fc640 1 -- 172.21.15.135:0/1973242294 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0300044070 con 0x7f030819a0a0 2024-04-20T12:29:11.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f030f3bd640 1 -- 172.21.15.135:0/1973242294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03081a50b0 con 0x7f030819a0a0 2024-04-20T12:29:11.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f02fe7fc640 1 -- 172.21.15.135:0/1973242294 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03000042a0 con 0x7f030819a0a0 2024-04-20T12:29:11.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.892+0000 7f030f3bd640 1 -- 172.21.15.135:0/1973242294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03081a55a0 con 0x7f030819a0a0 2024-04-20T12:29:11.900 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f02fe7fc640 1 -- 172.21.15.135:0/1973242294 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f0300004440 con 0x7f030819a0a0 2024-04-20T12:29:11.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f0311fb3740 1 Processor -- start 2024-04-20T12:29:11.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f0311fb3740 1 -- start start 2024-04-20T12:29:11.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f0311fb3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556b6e10 0x55e8556b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f0311fb3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f0311fb3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556c0310 0x55e8556c2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f0311fb3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e85561c110 con 0x55e8556b7730 2024-04-20T12:29:11.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f0311fb3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e8555b9550 con 0x55e8556c0310 2024-04-20T12:29:11.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f0311fb3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e8556180d0 con 0x55e8556b6e10 2024-04-20T12:29:11.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f030d159640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f030d159640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556bfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55994/0 (socket says 172.21.15.135:55994) 2024-04-20T12:29:11.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f030d159640 1 -- 172.21.15.135:0/821629970 learned_addr learned my addr 172.21.15.135:0/821629970 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f02fe7fc640 1 --2- 172.21.15.135:0/1973242294 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f02f40a3d20 0x7f02f40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.901 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f030c958640 1 --2- 172.21.15.135:0/821629970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556c0310 0x55e8556c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f030c958640 1 --2- 172.21.15.135:0/821629970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556b6e10 0x55e8556b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f030d159640 1 -- 172.21.15.135:0/821629970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556b6e10 msgr2=0x55e8556b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f030d159640 1 --2- 172.21.15.135:0/821629970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556b6e10 0x55e8556b71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f030d159640 1 -- 172.21.15.135:0/821629970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556c0310 msgr2=0x55e8556c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f030d159640 1 --2- 172.21.15.135:0/821629970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556c0310 0x55e8556c2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.895+0000 7f030d159640 1 -- 172.21.15.135:0/821629970 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8555e1900 con 0x55e8556b7730 2024-04-20T12:29:11.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.896+0000 7f030c958640 1 --2- 172.21.15.135:0/821629970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556b6e10 0x55e8556b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:11.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.896+0000 7f02fe7fc640 1 -- 172.21.15.135:0/1973242294 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f03000f2e60 con 0x7f030819a0a0 2024-04-20T12:29:11.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.896+0000 7f030d95a640 1 --2- 172.21.15.135:0/1973242294 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f02f40a3d20 0x7f02f40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.896+0000 7f030d159640 1 --2- 172.21.15.135:0/821629970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556bfdd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f030400bcb0 tx=0x7f030400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb42ad2b400c540 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.896+0000 7f02f37fe640 1 -- 172.21.15.135:0/821629970 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0304015070 con 0x55e8556b7730 2024-04-20T12:29:11.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.896+0000 7f02f37fe640 1 -- 172.21.15.135:0/821629970 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f030401a940 con 0x55e8556b7730 2024-04-20T12:29:11.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.896+0000 7f02f37fe640 1 -- 172.21.15.135:0/821629970 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0304011a60 con 0x55e8556b7730 2024-04-20T12:29:11.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.897+0000 7f0311fb3740 1 -- 172.21.15.135:0/821629970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 msgr2=0x55e8556bfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.897+0000 7f030d95a640 1 --2- 172.21.15.135:0/1973242294 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f02f40a3d20 0x7f02f40a61e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f03000c72d0 tx=0x7f0300091680 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.897+0000 7f0311fb3740 1 --2- 172.21.15.135:0/821629970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556bfdd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f030400bcb0 tx=0x7f030400f730 comp rx=0 tx=0).stop 2024-04-20T12:29:11.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.897+0000 7f0311fb3740 1 -- 172.21.15.135:0/821629970 shutdown_connections 2024-04-20T12:29:11.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.897+0000 7f0311fb3740 1 --2- 172.21.15.135:0/821629970 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556c0310 0x55e8556c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.897+0000 7f0311fb3740 1 --2- 172.21.15.135:0/821629970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556bfdd0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.897+0000 7f0311fb3740 1 --2- 172.21.15.135:0/821629970 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556b6e10 0x55e8556b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.897+0000 7f0311fb3740 1 -- 172.21.15.135:0/821629970 >> 172.21.15.135:0/821629970 conn(0x55e8556b1540 msgr2=0x55e8556b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.897+0000 7f0311fb3740 1 -- 172.21.15.135:0/821629970 shutdown_connections 2024-04-20T12:29:11.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.897+0000 7f0311fb3740 1 -- 172.21.15.135:0/821629970 wait complete. 2024-04-20T12:29:11.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.897+0000 7f0311fb3740 1 -- start start 2024-04-20T12:29:11.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.897+0000 7f0311fb3740 1 Processor -- start 2024-04-20T12:29:11.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.897+0000 7f0311fb3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556b6e10 0x55e8556bd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.897+0000 7f0311fb3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556bd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.897+0000 7f0311fb3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556c0310 0x55e8556bde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f0311fb3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e8556c3100 con 0x55e8556b7730 2024-04-20T12:29:11.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f0311fb3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e8555d5500 con 0x55e8556b6e10 2024-04-20T12:29:11.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f0311fb3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e8556c3280 con 0x55e8556c0310 2024-04-20T12:29:11.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f0311fb3740 10 client.0 _ll_register_callbacks cb 0x55e8555ba2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:11.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f030d159640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556bd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f030d159640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556bd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55996/0 (socket says 172.21.15.135:55996) 2024-04-20T12:29:11.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f030d159640 1 -- 172.21.15.135:0/3641562853 learned_addr learned my addr 172.21.15.135:0/3641562853 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f030c958640 1 --2- 172.21.15.135:0/3641562853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556b6e10 0x55e8556bd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f030d159640 1 -- 172.21.15.135:0/3641562853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556c0310 msgr2=0x55e8556bde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f030d159640 1 --2- 172.21.15.135:0/3641562853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556c0310 0x55e8556bde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f030d159640 1 -- 172.21.15.135:0/3641562853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556b6e10 msgr2=0x55e8556bd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f030d159640 1 --2- 172.21.15.135:0/3641562853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556b6e10 0x55e8556bd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f030d159640 1 -- 172.21.15.135:0/3641562853 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e85532e3f0 con 0x55e8556b7730 2024-04-20T12:29:11.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f030d159640 1 --2- 172.21.15.135:0/3641562853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556bd950 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f0304004630 tx=0x7f030400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5ae0823f2a2782 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f02f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:11.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f02f0ff9640 1 -- 172.21.15.135:0/3641562853 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0304028060 con 0x55e8556b7730 2024-04-20T12:29:11.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f02f0ff9640 1 -- 172.21.15.135:0/3641562853 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f030401a730 con 0x55e8556b7730 2024-04-20T12:29:11.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f0311fb3740 1 -- 172.21.15.135:0/3641562853 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f030401a940 con 0x55e8556b7730 2024-04-20T12:29:11.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f02f0ff9640 1 -- 172.21.15.135:0/3641562853 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f030402f050 con 0x55e8556b7730 2024-04-20T12:29:11.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f0311fb3740 10 client.17529 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:11.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f0311fb3740 1 -- 172.21.15.135:0/3641562853 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e8553f87d0 con 0x55e8556b7730 2024-04-20T12:29:11.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.898+0000 7f02f0ff9640 1 -- 172.21.15.135:0/3641562853 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f030401a940 con 0x55e8556b7730 2024-04-20T12:29:11.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.899+0000 7f02f0ff9640 1 -- 172.21.15.135:0/3641562853 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f03040117f0 con 0x55e8556b7730 2024-04-20T12:29:11.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.899+0000 7f0311fb3740 10 client.17529 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:11.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.899+0000 7f0311fb3740 10 client.17529 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:29:11.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.899+0000 7f0311fb3740 20 client.17529 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:11.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.899+0000 7f0311fb3740 1 --2- 172.21.15.135:0/3641562853 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e8556d0640 0x55e8556d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.899+0000 7f0311fb3740 4 client.17529 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:11.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.899+0000 7f0311fb3740 1 -- 172.21.15.135:0/3641562853 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e855629b30 con 0x55e8556d0640 2024-04-20T12:29:11.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.899+0000 7f030c958640 1 --2- 172.21.15.135:0/3641562853 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e8556d0640 0x55e8556d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.899+0000 7f02f0ff9640 10 client.17529 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:29:11.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.899+0000 7f030c958640 1 --2- 172.21.15.135:0/3641562853 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e8556d0640 0x55e8556d2a30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fb0c43afd8327486 server_cookie=5ebaac4e682361f5 in_seq=0 out_seq=0 2024-04-20T12:29:11.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.900+0000 7f02f0ff9640 1 -- 172.21.15.135:0/3641562853 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e855629b30 con 0x55e8556d0640 2024-04-20T12:29:11.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.900+0000 7f02f0ff9640 10 client.17529 handle_command_reply: tid=0 2024-04-20T12:29:11.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.900+0000 7f0311fb3740 1 client.17529 shutdown 2024-04-20T12:29:11.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.900+0000 7f0311fb3740 1 -- 172.21.15.135:0/3641562853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 msgr2=0x55e8556bd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.900+0000 7f0311fb3740 1 --2- 172.21.15.135:0/3641562853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556bd950 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f0304004630 tx=0x7f030400bfd0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.900+0000 7f0311fb3740 1 -- 172.21.15.135:0/3641562853 shutdown_connections 2024-04-20T12:29:11.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.900+0000 7f0311fb3740 1 --2- 172.21.15.135:0/3641562853 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e8556d0640 0x55e8556d2a30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.900+0000 7f0311fb3740 1 --2- 172.21.15.135:0/3641562853 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556c0310 0x55e8556bde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.900+0000 7f0311fb3740 1 --2- 172.21.15.135:0/3641562853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556bd950 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.900+0000 7f02f0ff9640 0 client.17529 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:29:11.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.900+0000 7f0311fb3740 1 --2- 172.21.15.135:0/3641562853 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556b6e10 0x55e8556bd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.900+0000 7f0311fb3740 1 -- 172.21.15.135:0/3641562853 >> 172.21.15.135:0/3641562853 conn(0x55e8556b1540 msgr2=0x55e8556b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.900+0000 7f0311fb3740 1 -- 172.21.15.135:0/3641562853 shutdown_connections 2024-04-20T12:29:11.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.900+0000 7f0311fb3740 1 -- 172.21.15.135:0/3641562853 wait complete. 2024-04-20T12:29:11.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.900+0000 7f0311fb3740 20 client.17529 trim_cache size 0 max 16384 2024-04-20T12:29:11.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.913+0000 7f0311fb3740 1 Processor -- start 2024-04-20T12:29:11.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.913+0000 7f0311fb3740 1 -- start start 2024-04-20T12:29:11.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f0311fb3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556b6e10 0x55e8556cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f0311fb3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556d8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f0311fb3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556c0310 0x55e8556d85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f0311fb3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03081af3a0 con 0x55e8556b7730 2024-04-20T12:29:11.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f0311fb3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f03081b0ee0 con 0x55e8556c0310 2024-04-20T12:29:11.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f0311fb3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f03081afa70 con 0x55e8556b6e10 2024-04-20T12:29:11.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f030d159640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556d8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f030d159640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556d8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56010/0 (socket says 172.21.15.135:56010) 2024-04-20T12:29:11.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f030d159640 1 -- 172.21.15.135:0/3429200597 learned_addr learned my addr 172.21.15.135:0/3429200597 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f030d159640 1 -- 172.21.15.135:0/3429200597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556b6e10 msgr2=0x55e8556cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f030d159640 1 --2- 172.21.15.135:0/3429200597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556b6e10 0x55e8556cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f030d159640 1 -- 172.21.15.135:0/3429200597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556c0310 msgr2=0x55e8556d85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f030d159640 1 --2- 172.21.15.135:0/3429200597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556c0310 0x55e8556d85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f030d159640 1 -- 172.21.15.135:0/3429200597 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8556ace10 con 0x55e8556b7730 2024-04-20T12:29:11.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f030d159640 1 --2- 172.21.15.135:0/3429200597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556d8060 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f0304000c00 tx=0x7f03040114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa28538bd28c594 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f02f2ffd640 1 -- 172.21.15.135:0/3429200597 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0304038070 con 0x55e8556b7730 2024-04-20T12:29:11.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f02f2ffd640 1 -- 172.21.15.135:0/3429200597 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f030400b760 con 0x55e8556b7730 2024-04-20T12:29:11.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.914+0000 7f02f2ffd640 1 -- 172.21.15.135:0/3429200597 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0304028030 con 0x55e8556b7730 2024-04-20T12:29:11.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 -- 172.21.15.135:0/3429200597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 msgr2=0x55e8556d8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 --2- 172.21.15.135:0/3429200597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556d8060 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f0304000c00 tx=0x7f03040114b0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 -- 172.21.15.135:0/3429200597 shutdown_connections 2024-04-20T12:29:11.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 --2- 172.21.15.135:0/3429200597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556c0310 0x55e8556d85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 --2- 172.21.15.135:0/3429200597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556b7730 0x55e8556d8060 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 --2- 172.21.15.135:0/3429200597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556b6e10 0x55e8556cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 -- 172.21.15.135:0/3429200597 >> 172.21.15.135:0/3429200597 conn(0x55e8556b1540 msgr2=0x55e8556b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 -- 172.21.15.135:0/3429200597 shutdown_connections 2024-04-20T12:29:11.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 -- 172.21.15.135:0/3429200597 wait complete. 2024-04-20T12:29:11.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 -- start start 2024-04-20T12:29:11.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 Processor -- start 2024-04-20T12:29:11.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556b6e10 0x55e8556c8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556b7730 0x55e8556c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556c0310 0x55e8556c4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03081b0810 con 0x55e8556c0310 2024-04-20T12:29:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f03081b0140 con 0x55e8556b6e10 2024-04-20T12:29:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.915+0000 7f0311fb3740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f03081ad370 con 0x55e8556b7730 2024-04-20T12:29:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f0311fb3740 10 client.0 _ll_register_callbacks cb 0x7f030400bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f030c958640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556c0310 0x55e8556c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f030c958640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556c0310 0x55e8556c4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56024/0 (socket says 172.21.15.135:56024) 2024-04-20T12:29:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f030c958640 1 -- 172.21.15.135:0/1408591969 learned_addr learned my addr 172.21.15.135:0/1408591969 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f030c958640 1 --2- 172.21.15.135:0/1408591969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556b6e10 0x55e8556c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f030d159640 1 --2- 172.21.15.135:0/1408591969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556b7730 0x55e8556c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f030c958640 1 -- 172.21.15.135:0/1408591969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556b7730 msgr2=0x55e8556c3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f030c958640 1 --2- 172.21.15.135:0/1408591969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556b7730 0x55e8556c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f030c958640 1 -- 172.21.15.135:0/1408591969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556b6e10 msgr2=0x55e8556c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f030c958640 1 --2- 172.21.15.135:0/1408591969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556b6e10 0x55e8556c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f030c958640 1 -- 172.21.15.135:0/1408591969 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8556c4a90 con 0x55e8556c0310 2024-04-20T12:29:11.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f030c958640 1 --2- 172.21.15.135:0/1408591969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556c0310 0x55e8556c4260 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f02f80057c0 tx=0x7f02f8014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86dbfb100d121880 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:11.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f02f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:11.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f02f0ff9640 1 -- 172.21.15.135:0/1408591969 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f8005250 con 0x55e8556c0310 2024-04-20T12:29:11.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f02f0ff9640 1 -- 172.21.15.135:0/1408591969 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f02f80053f0 con 0x55e8556c0310 2024-04-20T12:29:11.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f0311fb3740 1 -- 172.21.15.135:0/1408591969 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f030400b760 con 0x55e8556c0310 2024-04-20T12:29:11.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f02f0ff9640 1 -- 172.21.15.135:0/1408591969 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f02f8033050 con 0x55e8556c0310 2024-04-20T12:29:11.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f0311fb3740 10 client.17535 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:11.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.916+0000 7f0311fb3740 1 -- 172.21.15.135:0/1408591969 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e855736a00 con 0x55e8556c0310 2024-04-20T12:29:11.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.917+0000 7f02f0ff9640 1 -- 172.21.15.135:0/1408591969 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f030400b760 con 0x55e8556c0310 2024-04-20T12:29:11.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.917+0000 7f02f0ff9640 1 -- 172.21.15.135:0/1408591969 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f02f802a520 con 0x55e8556c0310 2024-04-20T12:29:11.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.917+0000 7f0311fb3740 10 client.17535 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:11.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.917+0000 7f0311fb3740 10 client.17535 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:29:11.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.917+0000 7f0311fb3740 20 client.17535 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:11.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.917+0000 7f0311fb3740 1 --2- 172.21.15.135:0/1408591969 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e855737130 0x55e855739550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:11.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.917+0000 7f0311fb3740 4 client.17535 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:29:11.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.917+0000 7f0311fb3740 1 -- 172.21.15.135:0/1408591969 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e8556239a0 con 0x55e855737130 2024-04-20T12:29:11.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.917+0000 7f030d159640 1 --2- 172.21.15.135:0/1408591969 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e855737130 0x55e855739550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:11.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.917+0000 7f02f0ff9640 10 client.17535 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:29:11.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.917+0000 7f030d159640 1 --2- 172.21.15.135:0/1408591969 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e855737130 0x55e855739550 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1bec1358e0248105 server_cookie=5d2196441b9be36e in_seq=0 out_seq=0 2024-04-20T12:29:11.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f02f0ff9640 1 -- 172.21.15.135:0/1408591969 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e8556239a0 con 0x55e855737130 2024-04-20T12:29:11.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f02f0ff9640 10 client.17535 handle_command_reply: tid=0 2024-04-20T12:29:11.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f0311fb3740 1 client.17535 shutdown 2024-04-20T12:29:11.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f0311fb3740 1 -- 172.21.15.135:0/1408591969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556c0310 msgr2=0x55e8556c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f0311fb3740 1 --2- 172.21.15.135:0/1408591969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556c0310 0x55e8556c4260 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f02f80057c0 tx=0x7f02f8014040 comp rx=0 tx=0).stop 2024-04-20T12:29:11.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f0311fb3740 1 -- 172.21.15.135:0/1408591969 shutdown_connections 2024-04-20T12:29:11.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f0311fb3740 1 --2- 172.21.15.135:0/1408591969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8556c0310 0x55e8556c4260 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f0311fb3740 1 --2- 172.21.15.135:0/1408591969 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e855737130 0x55e855739550 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f0311fb3740 1 --2- 172.21.15.135:0/1408591969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e8556b7730 0x55e8556c3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f0311fb3740 1 --2- 172.21.15.135:0/1408591969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e8556b6e10 0x55e8556c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f02f0ff9640 0 client.17535 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:29:11.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f0311fb3740 1 -- 172.21.15.135:0/1408591969 >> 172.21.15.135:0/1408591969 conn(0x55e8556b1540 msgr2=0x55e8556b28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f0311fb3740 1 -- 172.21.15.135:0/1408591969 shutdown_connections 2024-04-20T12:29:11.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f0311fb3740 1 -- 172.21.15.135:0/1408591969 wait complete. 2024-04-20T12:29:11.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f0311fb3740 20 client.17535 trim_cache size 0 max 16384 2024-04-20T12:29:11.927 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:29:11.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f030f3bd640 1 -- 172.21.15.135:0/1973242294 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f02f40a3d20 msgr2=0x7f02f40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f030f3bd640 1 --2- 172.21.15.135:0/1973242294 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f02f40a3d20 0x7f02f40a61e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f03000c72d0 tx=0x7f0300091680 comp rx=0 tx=0).stop 2024-04-20T12:29:11.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f030f3bd640 1 -- 172.21.15.135:0/1973242294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f030819a0a0 msgr2=0x7f03081a4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:11.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f030f3bd640 1 --2- 172.21.15.135:0/1973242294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f030819a0a0 0x7f03081a4650 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f030002c700 tx=0x7f0300032f20 comp rx=0 tx=0).stop 2024-04-20T12:29:11.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f030f3bd640 1 -- 172.21.15.135:0/1973242294 shutdown_connections 2024-04-20T12:29:11.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f030f3bd640 1 --2- 172.21.15.135:0/1973242294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f030819a0a0 0x7f03081a4650 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f030f3bd640 1 --2- 172.21.15.135:0/1973242294 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f02f40a3d20 0x7f02f40a61e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f030f3bd640 1 --2- 172.21.15.135:0/1973242294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0308106170 0x7f0308199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f030f3bd640 1 --2- 172.21.15.135:0/1973242294 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f03081010a0 0x7f03081995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:11.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.918+0000 7f030f3bd640 1 -- 172.21.15.135:0/1973242294 >> 172.21.15.135:0/1973242294 conn(0x7f03080771e0 msgr2=0x7f03080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:11.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.919+0000 7f030f3bd640 1 -- 172.21.15.135:0/1973242294 shutdown_connections 2024-04-20T12:29:11.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:11.919+0000 7f030f3bd640 1 -- 172.21.15.135:0/1973242294 wait complete. 2024-04-20T12:29:11.930 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:29:12.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:11 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2556068566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:29:12.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.031+0000 7fe120874640 1 -- 172.21.15.135:0/2620254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe11c1010a0 msgr2=0x7fe11c101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.031+0000 7fe120874640 1 --2- 172.21.15.135:0/2620254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe11c1010a0 0x7fe11c101480 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fe110009900 tx=0x7fe11002bc30 comp rx=0 tx=0).stop 2024-04-20T12:29:12.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.031+0000 7fe120874640 1 -- 172.21.15.135:0/2620254 shutdown_connections 2024-04-20T12:29:12.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.031+0000 7fe120874640 1 --2- 172.21.15.135:0/2620254 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe11c106170 0x7fe11c10dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.031+0000 7fe120874640 1 --2- 172.21.15.135:0/2620254 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe11c101a50 0x7fe11c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.031+0000 7fe120874640 1 --2- 172.21.15.135:0/2620254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe11c1010a0 0x7fe11c101480 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.031+0000 7fe120874640 1 -- 172.21.15.135:0/2620254 >> 172.21.15.135:0/2620254 conn(0x7fe11c0771e0 msgr2=0x7fe11c0775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:12.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.031+0000 7fe120874640 1 -- 172.21.15.135:0/2620254 shutdown_connections 2024-04-20T12:29:12.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.031+0000 7fe120874640 1 -- 172.21.15.135:0/2620254 wait complete. 2024-04-20T12:29:12.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe120874640 1 Processor -- start 2024-04-20T12:29:12.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe120874640 1 -- start start 2024-04-20T12:29:12.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe120874640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe11c1010a0 0x7fe11c199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe120874640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe11c106170 0x7fe11c199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe120874640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe11c19a120 0x7fe11c1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe120874640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c111230 con 0x7fe11c1010a0 2024-04-20T12:29:12.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe120874640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1110b0 con 0x7fe11c106170 2024-04-20T12:29:12.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe120874640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1113b0 con 0x7fe11c19a120 2024-04-20T12:29:12.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe11a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe11c1010a0 0x7fe11c199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe11a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe11c1010a0 0x7fe11c199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56040/0 (socket says 172.21.15.135:56040) 2024-04-20T12:29:12.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe11a59c640 1 -- 172.21.15.135:0/717841286 learned_addr learned my addr 172.21.15.135:0/717841286 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:12.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe119d9b640 1 --2- 172.21.15.135:0/717841286 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe11c106170 0x7fe11c199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe11ad9d640 1 --2- 172.21.15.135:0/717841286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe11c19a120 0x7fe11c1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe11a59c640 1 -- 172.21.15.135:0/717841286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe11c19a120 msgr2=0x7fe11c1a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe11a59c640 1 --2- 172.21.15.135:0/717841286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe11c19a120 0x7fe11c1a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe11a59c640 1 -- 172.21.15.135:0/717841286 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe11c106170 msgr2=0x7fe11c199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe11a59c640 1 --2- 172.21.15.135:0/717841286 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe11c106170 0x7fe11c199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.032+0000 7fe11a59c640 1 -- 172.21.15.135:0/717841286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11c1a4ea0 con 0x7fe11c1010a0 2024-04-20T12:29:12.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.033+0000 7fe11a59c640 1 --2- 172.21.15.135:0/717841286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe11c1010a0 0x7fe11c199650 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fe110006010 tx=0x7fe11002cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:12.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.033+0000 7fe10b7fe640 1 -- 172.21.15.135:0/717841286 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110041070 con 0x7fe11c1010a0 2024-04-20T12:29:12.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.033+0000 7fe10b7fe640 1 -- 172.21.15.135:0/717841286 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe110004450 con 0x7fe11c1010a0 2024-04-20T12:29:12.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.033+0000 7fe120874640 1 -- 172.21.15.135:0/717841286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe11c1a5130 con 0x7fe11c1010a0 2024-04-20T12:29:12.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.033+0000 7fe10b7fe640 1 -- 172.21.15.135:0/717841286 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110003e00 con 0x7fe11c1010a0 2024-04-20T12:29:12.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.033+0000 7fe120874640 1 -- 172.21.15.135:0/717841286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe11c1a5620 con 0x7fe11c1010a0 2024-04-20T12:29:12.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.035+0000 7fe10b7fe640 1 -- 172.21.15.135:0/717841286 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fe110044070 con 0x7fe11c1010a0 2024-04-20T12:29:12.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.035+0000 7fe12346c740 1 Processor -- start 2024-04-20T12:29:12.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.035+0000 7fe12346c740 1 -- start start 2024-04-20T12:29:12.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe12346c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45ceb5e10 0x55f45ceb61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe12346c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45ceb6730 0x55f45cebedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe12346c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45cebf310 0x55f45cec1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe12346c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f45ce1b110 con 0x55f45cebf310 2024-04-20T12:29:12.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe12346c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f45cdb8550 con 0x55f45ceb5e10 2024-04-20T12:29:12.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe12346c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f45ce170d0 con 0x55f45ceb6730 2024-04-20T12:29:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe10b7fe640 1 --2- 172.21.15.135:0/717841286 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe1040a3d20 0x7fe1040a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe119d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45cebf310 0x55f45cec1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe119d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45cebf310 0x55f45cec1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56056/0 (socket says 172.21.15.135:56056) 2024-04-20T12:29:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe119d9b640 1 -- 172.21.15.135:0/2987854513 learned_addr learned my addr 172.21.15.135:0/2987854513 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe11ad9d640 1 --2- 172.21.15.135:0/717841286 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe1040a3d20 0x7fe1040a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe11ad9d640 1 --2- 172.21.15.135:0/2987854513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45ceb5e10 0x55f45ceb61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe10b7fe640 1 -- 172.21.15.135:0/717841286 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe1100f2650 con 0x7fe11c1010a0 2024-04-20T12:29:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe11a59c640 1 --2- 172.21.15.135:0/2987854513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45ceb6730 0x55f45cebedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe119d9b640 1 -- 172.21.15.135:0/2987854513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45ceb6730 msgr2=0x55f45cebedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe119d9b640 1 --2- 172.21.15.135:0/2987854513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45ceb6730 0x55f45cebedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe119d9b640 1 -- 172.21.15.135:0/2987854513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45ceb5e10 msgr2=0x55f45ceb61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe119d9b640 1 --2- 172.21.15.135:0/2987854513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45ceb5e10 0x55f45ceb61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe119d9b640 1 -- 172.21.15.135:0/2987854513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f45cde0900 con 0x55f45cebf310 2024-04-20T12:29:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe11ad9d640 1 --2- 172.21.15.135:0/717841286 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe1040a3d20 0x7fe1040a61e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe114009fd0 tx=0x7fe114009500 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe119d9b640 1 --2- 172.21.15.135:0/2987854513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45cebf310 0x55f45cec1700 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe10c009c60 tx=0x7fe10c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ab2c0cb30888ab server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:12.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe108ff9640 1 -- 172.21.15.135:0/2987854513 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c004230 con 0x55f45cebf310 2024-04-20T12:29:12.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe108ff9640 1 -- 172.21.15.135:0/2987854513 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe10c0043d0 con 0x55f45cebf310 2024-04-20T12:29:12.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.036+0000 7fe108ff9640 1 -- 172.21.15.135:0/2987854513 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c004d50 con 0x55f45cebf310 2024-04-20T12:29:12.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.037+0000 7fe12346c740 1 -- 172.21.15.135:0/2987854513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45cebf310 msgr2=0x55f45cec1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.037+0000 7fe12346c740 1 --2- 172.21.15.135:0/2987854513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45cebf310 0x55f45cec1700 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe10c009c60 tx=0x7fe10c011810 comp rx=0 tx=0).stop 2024-04-20T12:29:12.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.037+0000 7fe12346c740 1 -- 172.21.15.135:0/2987854513 shutdown_connections 2024-04-20T12:29:12.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.037+0000 7fe12346c740 1 --2- 172.21.15.135:0/2987854513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45cebf310 0x55f45cec1700 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.037+0000 7fe12346c740 1 --2- 172.21.15.135:0/2987854513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45ceb6730 0x55f45cebedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.037+0000 7fe12346c740 1 --2- 172.21.15.135:0/2987854513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45ceb5e10 0x55f45ceb61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.037+0000 7fe12346c740 1 -- 172.21.15.135:0/2987854513 >> 172.21.15.135:0/2987854513 conn(0x55f45ceb0540 msgr2=0x55f45ceb0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:12.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.037+0000 7fe12346c740 1 -- 172.21.15.135:0/2987854513 shutdown_connections 2024-04-20T12:29:12.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.037+0000 7fe12346c740 1 -- 172.21.15.135:0/2987854513 wait complete. 2024-04-20T12:29:12.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe12346c740 1 -- start start 2024-04-20T12:29:12.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe12346c740 1 Processor -- start 2024-04-20T12:29:12.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe12346c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45ceb5e10 0x55f45cebc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe12346c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45ceb6730 0x55f45cebc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe12346c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45cebf310 0x55f45cebcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe12346c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f45cec20a0 con 0x55f45ceb6730 2024-04-20T12:29:12.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe12346c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55f45cdd4500 con 0x55f45cebf310 2024-04-20T12:29:12.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe12346c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55f45cec2220 con 0x55f45ceb5e10 2024-04-20T12:29:12.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe12346c740 10 client.0 _ll_register_callbacks cb 0x55f45cdb92f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:12.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe119d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45ceb6730 0x55f45cebc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe119d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45ceb6730 0x55f45cebc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56060/0 (socket says 172.21.15.135:56060) 2024-04-20T12:29:12.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe119d9b640 1 -- 172.21.15.135:0/4128336572 learned_addr learned my addr 172.21.15.135:0/4128336572 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:12.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe11a59c640 1 --2- 172.21.15.135:0/4128336572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45ceb5e10 0x55f45cebc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe11ad9d640 1 --2- 172.21.15.135:0/4128336572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45cebf310 0x55f45cebcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe119d9b640 1 -- 172.21.15.135:0/4128336572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45ceb5e10 msgr2=0x55f45cebc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe119d9b640 1 --2- 172.21.15.135:0/4128336572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45ceb5e10 0x55f45cebc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe119d9b640 1 -- 172.21.15.135:0/4128336572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45cebf310 msgr2=0x55f45cebcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe119d9b640 1 --2- 172.21.15.135:0/4128336572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45cebf310 0x55f45cebcd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.038+0000 7fe119d9b640 1 -- 172.21.15.135:0/4128336572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f45cb2d3f0 con 0x55f45ceb6730 2024-04-20T12:29:12.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe119d9b640 1 --2- 172.21.15.135:0/4128336572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45ceb6730 0x55f45cebc840 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe10c000c00 tx=0x7fe10c019c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e760050d845b1ddf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:12.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe101ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:12.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe101ffb640 1 -- 172.21.15.135:0/4128336572 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c028020 con 0x55f45ceb6730 2024-04-20T12:29:12.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe101ffb640 1 -- 172.21.15.135:0/4128336572 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe10c024830 con 0x55f45ceb6730 2024-04-20T12:29:12.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe12346c740 1 -- 172.21.15.135:0/4128336572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe10c0043d0 con 0x55f45ceb6730 2024-04-20T12:29:12.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe101ffb640 1 -- 172.21.15.135:0/4128336572 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe10c033050 con 0x55f45ceb6730 2024-04-20T12:29:12.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe12346c740 10 client.17547 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:12.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe12346c740 1 -- 172.21.15.135:0/4128336572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f45cbf77d0 con 0x55f45ceb6730 2024-04-20T12:29:12.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe101ffb640 1 -- 172.21.15.135:0/4128336572 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe10c0043d0 con 0x55f45ceb6730 2024-04-20T12:29:12.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe101ffb640 1 -- 172.21.15.135:0/4128336572 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe10c018070 con 0x55f45ceb6730 2024-04-20T12:29:12.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe12346c740 10 client.17547 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:12.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe12346c740 10 client.17547 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:29:12.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe12346c740 20 client.17547 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:12.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe12346c740 1 --2- 172.21.15.135:0/4128336572 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55f45cecf4e0 0x55f45ced18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe12346c740 4 client.17547 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:12.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.039+0000 7fe12346c740 1 -- 172.21.15.135:0/4128336572 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f45ce28b30 con 0x55f45cecf4e0 2024-04-20T12:29:12.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.040+0000 7fe11a59c640 1 --2- 172.21.15.135:0/4128336572 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55f45cecf4e0 0x55f45ced18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.040+0000 7fe101ffb640 10 client.17547 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:29:12.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.040+0000 7fe11a59c640 1 --2- 172.21.15.135:0/4128336572 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55f45cecf4e0 0x55f45ced18d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=148bb55e6e321f8b server_cookie=f17e4658ec83aa93 in_seq=0 out_seq=0 2024-04-20T12:29:12.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.041+0000 7fe101ffb640 1 -- 172.21.15.135:0/4128336572 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f45ce28b30 con 0x55f45cecf4e0 2024-04-20T12:29:12.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.041+0000 7fe101ffb640 10 client.17547 handle_command_reply: tid=0 2024-04-20T12:29:12.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.041+0000 7fe12346c740 1 client.17547 shutdown 2024-04-20T12:29:12.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.041+0000 7fe12346c740 1 -- 172.21.15.135:0/4128336572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45ceb6730 msgr2=0x55f45cebc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.041+0000 7fe12346c740 1 --2- 172.21.15.135:0/4128336572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45ceb6730 0x55f45cebc840 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fe10c000c00 tx=0x7fe10c019c30 comp rx=0 tx=0).stop 2024-04-20T12:29:12.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.041+0000 7fe12346c740 1 -- 172.21.15.135:0/4128336572 shutdown_connections 2024-04-20T12:29:12.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.041+0000 7fe12346c740 1 --2- 172.21.15.135:0/4128336572 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55f45cecf4e0 0x55f45ced18d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.041+0000 7fe12346c740 1 --2- 172.21.15.135:0/4128336572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45cebf310 0x55f45cebcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.041+0000 7fe101ffb640 0 client.17547 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:29:12.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.041+0000 7fe12346c740 1 --2- 172.21.15.135:0/4128336572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45ceb6730 0x55f45cebc840 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.041+0000 7fe12346c740 1 --2- 172.21.15.135:0/4128336572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45ceb5e10 0x55f45cebc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.041+0000 7fe12346c740 1 -- 172.21.15.135:0/4128336572 >> 172.21.15.135:0/4128336572 conn(0x55f45ceb0540 msgr2=0x55f45ceb2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:12.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.041+0000 7fe12346c740 1 -- 172.21.15.135:0/4128336572 shutdown_connections 2024-04-20T12:29:12.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.041+0000 7fe12346c740 1 -- 172.21.15.135:0/4128336572 wait complete. 2024-04-20T12:29:12.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.041+0000 7fe12346c740 20 client.17547 trim_cache size 0 max 16384 2024-04-20T12:29:12.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe12346c740 1 Processor -- start 2024-04-20T12:29:12.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe12346c740 1 -- start start 2024-04-20T12:29:12.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe12346c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45ceb5e10 0x55f45cebea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe12346c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45ceb6730 0x55f45cecaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe12346c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45cebf310 0x55f45ced7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe12346c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1af360 con 0x55f45cebf310 2024-04-20T12:29:12.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe12346c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1b0ea0 con 0x55f45ceb5e10 2024-04-20T12:29:12.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe12346c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1afa30 con 0x55f45ceb6730 2024-04-20T12:29:12.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe11ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45cebf310 0x55f45ced7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe11ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45cebf310 0x55f45ced7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56070/0 (socket says 172.21.15.135:56070) 2024-04-20T12:29:12.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe11ad9d640 1 -- 172.21.15.135:0/2752041441 learned_addr learned my addr 172.21.15.135:0/2752041441 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe11ad9d640 1 -- 172.21.15.135:0/2752041441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45ceb6730 msgr2=0x55f45cecaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe11a59c640 1 --2- 172.21.15.135:0/2752041441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45ceb5e10 0x55f45cebea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe11ad9d640 1 --2- 172.21.15.135:0/2752041441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45ceb6730 0x55f45cecaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe11ad9d640 1 -- 172.21.15.135:0/2752041441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45ceb5e10 msgr2=0x55f45cebea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe11ad9d640 1 --2- 172.21.15.135:0/2752041441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45ceb5e10 0x55f45cebea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.054+0000 7fe11ad9d640 1 -- 172.21.15.135:0/2752041441 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f45ceba850 con 0x55f45cebf310 2024-04-20T12:29:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.055+0000 7fe11ad9d640 1 --2- 172.21.15.135:0/2752041441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45cebf310 0x55f45ced7120 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fe114010af0 tx=0x7fe114005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4b53638f73bb90 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.055+0000 7fe103fff640 1 -- 172.21.15.135:0/2752041441 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11401f990 con 0x55f45cebf310 2024-04-20T12:29:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.055+0000 7fe103fff640 1 -- 172.21.15.135:0/2752041441 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe11401fb30 con 0x55f45cebf310 2024-04-20T12:29:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.055+0000 7fe103fff640 1 -- 172.21.15.135:0/2752041441 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11401d650 con 0x55f45cebf310 2024-04-20T12:29:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.055+0000 7fe12346c740 1 -- 172.21.15.135:0/2752041441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45cebf310 msgr2=0x55f45ced7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.055+0000 7fe12346c740 1 --2- 172.21.15.135:0/2752041441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45cebf310 0x55f45ced7120 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fe114010af0 tx=0x7fe114005bd0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.055+0000 7fe12346c740 1 -- 172.21.15.135:0/2752041441 shutdown_connections 2024-04-20T12:29:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.055+0000 7fe12346c740 1 --2- 172.21.15.135:0/2752041441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45cebf310 0x55f45ced7120 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.055+0000 7fe12346c740 1 --2- 172.21.15.135:0/2752041441 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45ceb6730 0x55f45cecaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.055+0000 7fe12346c740 1 --2- 172.21.15.135:0/2752041441 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45ceb5e10 0x55f45cebea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.055+0000 7fe12346c740 1 -- 172.21.15.135:0/2752041441 >> 172.21.15.135:0/2752041441 conn(0x55f45ceb0540 msgr2=0x55f45ceab570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:12.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.055+0000 7fe12346c740 1 -- 172.21.15.135:0/2752041441 shutdown_connections 2024-04-20T12:29:12.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.055+0000 7fe12346c740 1 -- 172.21.15.135:0/2752041441 wait complete. 2024-04-20T12:29:12.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe12346c740 1 -- start start 2024-04-20T12:29:12.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe12346c740 1 Processor -- start 2024-04-20T12:29:12.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe12346c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45ceb5e10 0x55f45cec79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe12346c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45ceb6730 0x55f45ceb8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe12346c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45cebf310 0x55f45ceb9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe12346c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1b07d0 con 0x55f45ceb6730 2024-04-20T12:29:12.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe12346c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1b0100 con 0x55f45ceb5e10 2024-04-20T12:29:12.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe12346c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c1ad330 con 0x55f45cebf310 2024-04-20T12:29:12.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe12346c740 10 client.0 _ll_register_callbacks cb 0x7fe10c009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:12.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe119d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45ceb6730 0x55f45ceb8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe119d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45ceb6730 0x55f45ceb8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56074/0 (socket says 172.21.15.135:56074) 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe119d9b640 1 -- 172.21.15.135:0/4090818231 learned_addr learned my addr 172.21.15.135:0/4090818231 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe11a59c640 1 --2- 172.21.15.135:0/4090818231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45ceb5e10 0x55f45cec79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe119d9b640 1 -- 172.21.15.135:0/4090818231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45cebf310 msgr2=0x55f45ceb9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe119d9b640 1 --2- 172.21.15.135:0/4090818231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45cebf310 0x55f45ceb9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe119d9b640 1 -- 172.21.15.135:0/4090818231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45ceb5e10 msgr2=0x55f45cec79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe119d9b640 1 --2- 172.21.15.135:0/4090818231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45ceb5e10 0x55f45cec79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe119d9b640 1 -- 172.21.15.135:0/4090818231 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f45cf34990 con 0x55f45ceb6730 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe119d9b640 1 --2- 172.21.15.135:0/4090818231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45ceb6730 0x55f45ceb8df0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0243f0 tx=0x7fe10c019820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7189e8726694c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe101ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.056+0000 7fe101ffb640 1 -- 172.21.15.135:0/4090818231 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c028070 con 0x55f45ceb6730 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.057+0000 7fe101ffb640 1 -- 172.21.15.135:0/4090818231 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe10c018e20 con 0x55f45ceb6730 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.057+0000 7fe12346c740 1 -- 172.21.15.135:0/4090818231 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe11401fb30 con 0x55f45ceb6730 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.057+0000 7fe101ffb640 1 -- 172.21.15.135:0/4090818231 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe10c019b90 con 0x55f45ceb6730 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.057+0000 7fe12346c740 10 client.17553 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:12.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.057+0000 7fe12346c740 1 -- 172.21.15.135:0/4090818231 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f45cf35ab0 con 0x55f45ceb6730 2024-04-20T12:29:12.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.057+0000 7fe101ffb640 1 -- 172.21.15.135:0/4090818231 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe11401fb30 con 0x55f45ceb6730 2024-04-20T12:29:12.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.057+0000 7fe101ffb640 1 -- 172.21.15.135:0/4090818231 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe10c018040 con 0x55f45ceb6730 2024-04-20T12:29:12.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.057+0000 7fe12346c740 10 client.17553 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:12.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.057+0000 7fe12346c740 10 client.17553 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:29:12.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.057+0000 7fe12346c740 20 client.17553 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:12.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.057+0000 7fe12346c740 1 --2- 172.21.15.135:0/4090818231 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55f45cf36280 0x55f45cf386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.057+0000 7fe12346c740 4 client.17553 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:29:12.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.057+0000 7fe12346c740 1 -- 172.21.15.135:0/4090818231 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f45ce229a0 con 0x55f45cf36280 2024-04-20T12:29:12.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.057+0000 7fe11a59c640 1 --2- 172.21.15.135:0/4090818231 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55f45cf36280 0x55f45cf386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe11a59c640 1 --2- 172.21.15.135:0/4090818231 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55f45cf36280 0x55f45cf386a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5eb7d5077327d26c server_cookie=7f57e182c7cf03bc in_seq=0 out_seq=0 2024-04-20T12:29:12.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe101ffb640 10 client.17553 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:29:12.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe101ffb640 1 -- 172.21.15.135:0/4090818231 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f45ce229a0 con 0x55f45cf36280 2024-04-20T12:29:12.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe101ffb640 10 client.17553 handle_command_reply: tid=0 2024-04-20T12:29:12.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe12346c740 1 client.17553 shutdown 2024-04-20T12:29:12.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe12346c740 1 -- 172.21.15.135:0/4090818231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45ceb6730 msgr2=0x55f45ceb8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe12346c740 1 --2- 172.21.15.135:0/4090818231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45ceb6730 0x55f45ceb8df0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0243f0 tx=0x7fe10c019820 comp rx=0 tx=0).stop 2024-04-20T12:29:12.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe12346c740 1 -- 172.21.15.135:0/4090818231 shutdown_connections 2024-04-20T12:29:12.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe12346c740 1 --2- 172.21.15.135:0/4090818231 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55f45cf36280 0x55f45cf386a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe12346c740 1 --2- 172.21.15.135:0/4090818231 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f45cebf310 0x55f45ceb9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe101ffb640 0 client.17553 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:29:12.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe12346c740 1 --2- 172.21.15.135:0/4090818231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f45ceb6730 0x55f45ceb8df0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe12346c740 1 --2- 172.21.15.135:0/4090818231 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55f45ceb5e10 0x55f45cec79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe12346c740 1 -- 172.21.15.135:0/4090818231 >> 172.21.15.135:0/4090818231 conn(0x55f45ceb0540 msgr2=0x55f45ceaee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:12.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe12346c740 1 -- 172.21.15.135:0/4090818231 shutdown_connections 2024-04-20T12:29:12.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe12346c740 1 -- 172.21.15.135:0/4090818231 wait complete. 2024-04-20T12:29:12.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.058+0000 7fe12346c740 20 client.17553 trim_cache size 0 max 16384 2024-04-20T12:29:12.063 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:29:12.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.059+0000 7fe120874640 1 -- 172.21.15.135:0/717841286 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe1040a3d20 msgr2=0x7fe1040a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.059+0000 7fe120874640 1 --2- 172.21.15.135:0/717841286 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe1040a3d20 0x7fe1040a61e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe114009fd0 tx=0x7fe114009500 comp rx=0 tx=0).stop 2024-04-20T12:29:12.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.059+0000 7fe120874640 1 -- 172.21.15.135:0/717841286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe11c1010a0 msgr2=0x7fe11c199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.059+0000 7fe120874640 1 --2- 172.21.15.135:0/717841286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe11c1010a0 0x7fe11c199650 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fe110006010 tx=0x7fe11002cb30 comp rx=0 tx=0).stop 2024-04-20T12:29:12.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.059+0000 7fe120874640 1 -- 172.21.15.135:0/717841286 shutdown_connections 2024-04-20T12:29:12.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.059+0000 7fe120874640 1 --2- 172.21.15.135:0/717841286 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe1040a3d20 0x7fe1040a61e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.059+0000 7fe120874640 1 --2- 172.21.15.135:0/717841286 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe11c19a120 0x7fe11c1a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.059+0000 7fe120874640 1 --2- 172.21.15.135:0/717841286 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe11c106170 0x7fe11c199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.059+0000 7fe120874640 1 --2- 172.21.15.135:0/717841286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe11c1010a0 0x7fe11c199650 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.059+0000 7fe120874640 1 -- 172.21.15.135:0/717841286 >> 172.21.15.135:0/717841286 conn(0x7fe11c0771e0 msgr2=0x7fe11c0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:12.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.059+0000 7fe120874640 1 -- 172.21.15.135:0/717841286 shutdown_connections 2024-04-20T12:29:12.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.059+0000 7fe120874640 1 -- 172.21.15.135:0/717841286 wait complete. 2024-04-20T12:29:12.068 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:29:12.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:11 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2556068566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:29:12.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.169+0000 7fcd7ced2640 1 -- 172.21.15.135:0/1542562099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd78105de0 msgr2=0x7fcd781061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.169+0000 7fcd7ced2640 1 --2- 172.21.15.135:0/1542562099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd78105de0 0x7fcd781061c0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009900 tx=0x7fcd6802bc30 comp rx=0 tx=0).stop 2024-04-20T12:29:12.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.169+0000 7fcd7ced2640 1 -- 172.21.15.135:0/1542562099 shutdown_connections 2024-04-20T12:29:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.169+0000 7fcd7ced2640 1 --2- 172.21.15.135:0/1542562099 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd78101a50 0x7fcd7810dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.169+0000 7fcd7ced2640 1 --2- 172.21.15.135:0/1542562099 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd781010b0 0x7fcd78101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.169+0000 7fcd7ced2640 1 --2- 172.21.15.135:0/1542562099 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd78105de0 0x7fcd781061c0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.169+0000 7fcd7ced2640 1 -- 172.21.15.135:0/1542562099 >> 172.21.15.135:0/1542562099 conn(0x7fcd78077c50 msgr2=0x7fcd78078060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.169+0000 7fcd7ced2640 1 -- 172.21.15.135:0/1542562099 shutdown_connections 2024-04-20T12:29:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.169+0000 7fcd7ced2640 1 -- 172.21.15.135:0/1542562099 wait complete. 2024-04-20T12:29:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7ced2640 1 Processor -- start 2024-04-20T12:29:12.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7ced2640 1 -- start start 2024-04-20T12:29:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7ced2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd781010b0 0x7fcd7819e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7ced2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd78101a50 0x7fcd7819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7ced2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd78105de0 0x7fcd781986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7ced2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd78111310 con 0x7fcd781010b0 2024-04-20T12:29:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7ced2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcd78111190 con 0x7fcd78105de0 2024-04-20T12:29:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7ced2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd78111490 con 0x7fcd78101a50 2024-04-20T12:29:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd781010b0 0x7fcd7819e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd781010b0 0x7fcd7819e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56094/0 (socket says 172.21.15.135:56094) 2024-04-20T12:29:12.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7659c640 1 -- 172.21.15.135:0/1189546551 learned_addr learned my addr 172.21.15.135:0/1189546551 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd6ffff640 1 --2- 172.21.15.135:0/1189546551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd78101a50 0x7fcd7819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd76d9d640 1 --2- 172.21.15.135:0/1189546551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd78105de0 0x7fcd781986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7659c640 1 -- 172.21.15.135:0/1189546551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd78101a50 msgr2=0x7fcd7819eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7659c640 1 --2- 172.21.15.135:0/1189546551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd78101a50 0x7fcd7819eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7659c640 1 -- 172.21.15.135:0/1189546551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd78105de0 msgr2=0x7fcd781986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7659c640 1 --2- 172.21.15.135:0/1189546551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd78105de0 0x7fcd781986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd7659c640 1 -- 172.21.15.135:0/1189546551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd78198f60 con 0x7fcd781010b0 2024-04-20T12:29:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.170+0000 7fcd76d9d640 1 --2- 172.21.15.135:0/1189546551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd78105de0 0x7fcd781986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.171+0000 7fcd7659c640 1 --2- 172.21.15.135:0/1189546551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd781010b0 0x7fcd7819e5e0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fcd68006010 tx=0x7fcd6802cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.171+0000 7fcd6f7fe640 1 -- 172.21.15.135:0/1189546551 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd68041070 con 0x7fcd781010b0 2024-04-20T12:29:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.171+0000 7fcd7ced2640 1 -- 172.21.15.135:0/1189546551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd781991f0 con 0x7fcd781010b0 2024-04-20T12:29:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.171+0000 7fcd6f7fe640 1 -- 172.21.15.135:0/1189546551 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd68004450 con 0x7fcd781010b0 2024-04-20T12:29:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.171+0000 7fcd6f7fe640 1 -- 172.21.15.135:0/1189546551 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd68003e00 con 0x7fcd781010b0 2024-04-20T12:29:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.171+0000 7fcd7ced2640 1 -- 172.21.15.135:0/1189546551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd781a5380 con 0x7fcd781010b0 2024-04-20T12:29:12.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.173+0000 7fcd6f7fe640 1 -- 172.21.15.135:0/1189546551 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fcd68044070 con 0x7fcd781010b0 2024-04-20T12:29:12.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd7fba5740 1 Processor -- start 2024-04-20T12:29:12.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd7fba5740 1 -- start start 2024-04-20T12:29:12.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd6f7fe640 1 --2- 172.21.15.135:0/1189546551 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd640a3d20 0x7fcd640a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd7fba5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2de10 0x562451c2e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd7fba5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c2e730 0x562451c36dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd7fba5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c37310 0x562451c39700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd7fba5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562451b93110 con 0x562451c37310 2024-04-20T12:29:12.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd7fba5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562451b30550 con 0x562451c2e730 2024-04-20T12:29:12.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd7fba5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562451b8f0d0 con 0x562451c2de10 2024-04-20T12:29:12.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd76d9d640 1 --2- 172.21.15.135:0/1189546551 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd640a3d20 0x7fcd640a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd6ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c2e730 0x562451c36dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd76d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c37310 0x562451c39700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd6f7fe640 1 -- 172.21.15.135:0/1189546551 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fcd680f27b0 con 0x7fcd781010b0 2024-04-20T12:29:12.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd7659c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2de10 0x562451c2e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd6ffff640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c2e730 0x562451c36dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:43038/0 (socket says 172.21.15.135:43038) 2024-04-20T12:29:12.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.174+0000 7fcd6ffff640 1 -- 172.21.15.135:0/748516000 learned_addr learned my addr 172.21.15.135:0/748516000 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:12.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.175+0000 7fcd6ffff640 1 -- 172.21.15.135:0/748516000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2de10 msgr2=0x562451c2e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.175+0000 7fcd6ffff640 1 --2- 172.21.15.135:0/748516000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2de10 0x562451c2e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.175+0000 7fcd6ffff640 1 -- 172.21.15.135:0/748516000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c37310 msgr2=0x562451c39700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.175+0000 7fcd6ffff640 1 --2- 172.21.15.135:0/748516000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c37310 0x562451c39700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.175+0000 7fcd6ffff640 1 -- 172.21.15.135:0/748516000 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562451b58900 con 0x562451c2e730 2024-04-20T12:29:12.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.175+0000 7fcd76d9d640 1 --2- 172.21.15.135:0/748516000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c37310 0x562451c39700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:29:12.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.175+0000 7fcd76d9d640 1 --2- 172.21.15.135:0/1189546551 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd640a3d20 0x7fcd640a61e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009810 tx=0x7fcd70009e40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:12.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.175+0000 7fcd6ffff640 1 --2- 172.21.15.135:0/748516000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c2e730 0x562451c36dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000b7f0 tx=0x7fcd6000bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab77e281e992bca7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:12.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.175+0000 7fcd6cff9640 1 -- 172.21.15.135:0/748516000 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6000d950 con 0x562451c2e730 2024-04-20T12:29:12.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.175+0000 7fcd6cff9640 1 -- 172.21.15.135:0/748516000 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd60018070 con 0x562451c2e730 2024-04-20T12:29:12.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.175+0000 7fcd6cff9640 1 -- 172.21.15.135:0/748516000 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd600123e0 con 0x562451c2e730 2024-04-20T12:29:12.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.176+0000 7fcd7fba5740 1 -- 172.21.15.135:0/748516000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c2e730 msgr2=0x562451c36dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.176+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/748516000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c2e730 0x562451c36dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd6000b7f0 tx=0x7fcd6000bcb0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.176+0000 7fcd7fba5740 1 -- 172.21.15.135:0/748516000 shutdown_connections 2024-04-20T12:29:12.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.176+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/748516000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c37310 0x562451c39700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.176+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/748516000 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c2e730 0x562451c36dd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.176+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/748516000 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2de10 0x562451c2e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.176+0000 7fcd7fba5740 1 -- 172.21.15.135:0/748516000 >> 172.21.15.135:0/748516000 conn(0x562451c28540 msgr2=0x562451c28920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:12.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.176+0000 7fcd7fba5740 1 -- 172.21.15.135:0/748516000 shutdown_connections 2024-04-20T12:29:12.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.176+0000 7fcd7fba5740 1 -- 172.21.15.135:0/748516000 wait complete. 2024-04-20T12:29:12.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.176+0000 7fcd7fba5740 1 -- start start 2024-04-20T12:29:12.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.176+0000 7fcd7fba5740 1 Processor -- start 2024-04-20T12:29:12.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7fba5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c2de10 0x562451c343c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7fba5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2e730 0x562451c34900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7fba5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c37310 0x562451c34e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7fba5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562451c3a100 con 0x562451c2de10 2024-04-20T12:29:12.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7fba5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562451b4c500 con 0x562451c37310 2024-04-20T12:29:12.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7fba5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562451c3a280 con 0x562451c2e730 2024-04-20T12:29:12.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7fba5740 10 client.0 _ll_register_callbacks cb 0x562451b312f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:12.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c2de10 0x562451c343c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c2de10 0x562451c343c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56120/0 (socket says 172.21.15.135:56120) 2024-04-20T12:29:12.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7659c640 1 -- 172.21.15.135:0/1187200201 learned_addr learned my addr 172.21.15.135:0/1187200201 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:12.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd76d9d640 1 --2- 172.21.15.135:0/1187200201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c37310 0x562451c34e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd6ffff640 1 --2- 172.21.15.135:0/1187200201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2e730 0x562451c34900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7659c640 1 -- 172.21.15.135:0/1187200201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2e730 msgr2=0x562451c34900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7659c640 1 --2- 172.21.15.135:0/1187200201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2e730 0x562451c34900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7659c640 1 -- 172.21.15.135:0/1187200201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c37310 msgr2=0x562451c34e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7659c640 1 --2- 172.21.15.135:0/1187200201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c37310 0x562451c34e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7659c640 1 -- 172.21.15.135:0/1187200201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624518a53f0 con 0x562451c2de10 2024-04-20T12:29:12.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd76d9d640 1 --2- 172.21.15.135:0/1187200201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c37310 0x562451c34e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:12.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7659c640 1 --2- 172.21.15.135:0/1187200201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c2de10 0x562451c343c0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fcd680be180 tx=0x7fcd680bdea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209d2f1bdc8b5533 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:12.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:12.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd5dffb640 1 -- 172.21.15.135:0/1187200201 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6804b040 con 0x562451c2de10 2024-04-20T12:29:12.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd5dffb640 1 -- 172.21.15.135:0/1187200201 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fcd680efda0 con 0x562451c2de10 2024-04-20T12:29:12.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7fba5740 1 -- 172.21.15.135:0/1187200201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd60018070 con 0x562451c2de10 2024-04-20T12:29:12.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd5dffb640 1 -- 172.21.15.135:0/1187200201 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd680effa0 con 0x562451c2de10 2024-04-20T12:29:12.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7fba5740 10 client.17565 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:12.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.177+0000 7fcd7fba5740 1 -- 172.21.15.135:0/1187200201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56245196f7d0 con 0x562451c2de10 2024-04-20T12:29:12.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.178+0000 7fcd5dffb640 1 -- 172.21.15.135:0/1187200201 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd60018070 con 0x562451c2de10 2024-04-20T12:29:12.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.178+0000 7fcd5dffb640 1 -- 172.21.15.135:0/1187200201 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fcd680da120 con 0x562451c2de10 2024-04-20T12:29:12.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.178+0000 7fcd7fba5740 10 client.17565 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:12.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.178+0000 7fcd7fba5740 10 client.17565 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:12.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.178+0000 7fcd7fba5740 20 client.17565 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:12.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.178+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/1187200201 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562451c475e0 0x562451c49a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.178+0000 7fcd7fba5740 4 client.17565 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:12.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.178+0000 7fcd7fba5740 1 -- 172.21.15.135:0/1187200201 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562451ba0b30 con 0x562451c475e0 2024-04-20T12:29:12.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.178+0000 7fcd6ffff640 1 --2- 172.21.15.135:0/1187200201 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562451c475e0 0x562451c49a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.178+0000 7fcd5dffb640 10 client.17565 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:12.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.178+0000 7fcd6ffff640 1 --2- 172.21.15.135:0/1187200201 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562451c475e0 0x562451c49a30 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d42b026656ac8f40 server_cookie=5295fe5ea0873e20 in_seq=0 out_seq=0 2024-04-20T12:29:12.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.179+0000 7fcd5dffb640 1 -- 172.21.15.135:0/1187200201 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562451ba0b30 con 0x562451c475e0 2024-04-20T12:29:12.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.179+0000 7fcd5dffb640 10 client.17565 handle_command_reply: tid=0 2024-04-20T12:29:12.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.179+0000 7fcd7fba5740 1 client.17565 shutdown 2024-04-20T12:29:12.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.179+0000 7fcd7fba5740 1 -- 172.21.15.135:0/1187200201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c2de10 msgr2=0x562451c343c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.179+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/1187200201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c2de10 0x562451c343c0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fcd680be180 tx=0x7fcd680bdea0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.179+0000 7fcd7fba5740 1 -- 172.21.15.135:0/1187200201 shutdown_connections 2024-04-20T12:29:12.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.179+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/1187200201 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562451c475e0 0x562451c49a30 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.179+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/1187200201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c37310 0x562451c34e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.179+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/1187200201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2e730 0x562451c34900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.179+0000 7fcd5dffb640 0 client.17565 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:12.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.179+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/1187200201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c2de10 0x562451c343c0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.179+0000 7fcd7fba5740 1 -- 172.21.15.135:0/1187200201 >> 172.21.15.135:0/1187200201 conn(0x562451c28540 msgr2=0x562451c2a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:12.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.179+0000 7fcd7fba5740 1 -- 172.21.15.135:0/1187200201 shutdown_connections 2024-04-20T12:29:12.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.179+0000 7fcd7fba5740 1 -- 172.21.15.135:0/1187200201 wait complete. 2024-04-20T12:29:12.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.179+0000 7fcd7fba5740 20 client.17565 trim_cache size 0 max 16384 2024-04-20T12:29:12.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.192+0000 7fcd7fba5740 1 Processor -- start 2024-04-20T12:29:12.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.192+0000 7fcd7fba5740 1 -- start start 2024-04-20T12:29:12.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd7fba5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c2de10 0x562451c36af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd7fba5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2e730 0x562451c42fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd7fba5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c37310 0x562451c27560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd7fba5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd781af2c0 con 0x562451c2de10 2024-04-20T12:29:12.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd7fba5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcd781b0e00 con 0x562451c37310 2024-04-20T12:29:12.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd7fba5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd781af990 con 0x562451c2e730 2024-04-20T12:29:12.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd7659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c2de10 0x562451c36af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd7659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c2de10 0x562451c36af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56128/0 (socket says 172.21.15.135:56128) 2024-04-20T12:29:12.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd7659c640 1 -- 172.21.15.135:0/3322236409 learned_addr learned my addr 172.21.15.135:0/3322236409 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:12.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd7659c640 1 -- 172.21.15.135:0/3322236409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2e730 msgr2=0x562451c42fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd7659c640 1 --2- 172.21.15.135:0/3322236409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2e730 0x562451c42fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd7659c640 1 -- 172.21.15.135:0/3322236409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c37310 msgr2=0x562451c27560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd7659c640 1 --2- 172.21.15.135:0/3322236409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c37310 0x562451c27560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd7659c640 1 -- 172.21.15.135:0/3322236409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562451c4a080 con 0x562451c2de10 2024-04-20T12:29:12.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd7659c640 1 --2- 172.21.15.135:0/3322236409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c2de10 0x562451c36af0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fcd680c6bc0 tx=0x7fcd680bc990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=703f362ccb006b64 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd5ffff640 1 -- 172.21.15.135:0/3322236409 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd680c2830 con 0x562451c2de10 2024-04-20T12:29:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd5ffff640 1 -- 172.21.15.135:0/3322236409 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd680ee050 con 0x562451c2de10 2024-04-20T12:29:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.193+0000 7fcd5ffff640 1 -- 172.21.15.135:0/3322236409 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd680c6cb0 con 0x562451c2de10 2024-04-20T12:29:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 -- 172.21.15.135:0/3322236409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c2de10 msgr2=0x562451c36af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/3322236409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c2de10 0x562451c36af0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fcd680c6bc0 tx=0x7fcd680bc990 comp rx=0 tx=0).stop 2024-04-20T12:29:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 -- 172.21.15.135:0/3322236409 shutdown_connections 2024-04-20T12:29:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/3322236409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c37310 0x562451c27560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/3322236409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2e730 0x562451c42fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/3322236409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c2de10 0x562451c36af0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 -- 172.21.15.135:0/3322236409 >> 172.21.15.135:0/3322236409 conn(0x562451c28540 msgr2=0x562451c26e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 -- 172.21.15.135:0/3322236409 shutdown_connections 2024-04-20T12:29:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 -- 172.21.15.135:0/3322236409 wait complete. 2024-04-20T12:29:12.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 -- start start 2024-04-20T12:29:12.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 Processor -- start 2024-04-20T12:29:12.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2de10 0x562451c3fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c2e730 0x562451c30fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c37310 0x562451c31710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd781b0730 con 0x562451c37310 2024-04-20T12:29:12.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcd781b0060 con 0x562451c2e730 2024-04-20T12:29:12.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.194+0000 7fcd7fba5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd781ad290 con 0x562451c2de10 2024-04-20T12:29:12.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd7fba5740 10 client.0 _ll_register_callbacks cb 0x7fcd680be2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:12.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd76d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c37310 0x562451c31710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd76d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c37310 0x562451c31710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56134/0 (socket says 172.21.15.135:56134) 2024-04-20T12:29:12.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd76d9d640 1 -- 172.21.15.135:0/2594361892 learned_addr learned my addr 172.21.15.135:0/2594361892 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:12.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd7659c640 1 --2- 172.21.15.135:0/2594361892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2de10 0x562451c3fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd6ffff640 1 --2- 172.21.15.135:0/2594361892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c2e730 0x562451c30fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd76d9d640 1 -- 172.21.15.135:0/2594361892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2de10 msgr2=0x562451c3fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd76d9d640 1 --2- 172.21.15.135:0/2594361892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2de10 0x562451c3fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd76d9d640 1 -- 172.21.15.135:0/2594361892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c2e730 msgr2=0x562451c30fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:12.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd76d9d640 1 --2- 172.21.15.135:0/2594361892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c2e730 0x562451c30fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd76d9d640 1 -- 172.21.15.135:0/2594361892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562451cacb40 con 0x562451c37310 2024-04-20T12:29:12.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd76d9d640 1 --2- 172.21.15.135:0/2594361892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c37310 0x562451c31710 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fcd70014e70 tx=0x7fcd70009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94f64fe91a427ed server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:12.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:12.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd5dffb640 1 -- 172.21.15.135:0/2594361892 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd70014ea0 con 0x562451c37310 2024-04-20T12:29:12.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd5dffb640 1 -- 172.21.15.135:0/2594361892 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fcd700047b0 con 0x562451c37310 2024-04-20T12:29:12.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd7fba5740 1 -- 172.21.15.135:0/2594361892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd680ee050 con 0x562451c37310 2024-04-20T12:29:12.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd5dffb640 1 -- 172.21.15.135:0/2594361892 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd70021450 con 0x562451c37310 2024-04-20T12:29:12.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd7fba5740 10 client.17571 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:12.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.195+0000 7fcd7fba5740 1 -- 172.21.15.135:0/2594361892 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562451cadd00 con 0x562451c37310 2024-04-20T12:29:12.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.196+0000 7fcd5dffb640 1 -- 172.21.15.135:0/2594361892 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd680ee050 con 0x562451c37310 2024-04-20T12:29:12.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.196+0000 7fcd5dffb640 1 -- 172.21.15.135:0/2594361892 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fcd700126b0 con 0x562451c37310 2024-04-20T12:29:12.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.196+0000 7fcd7fba5740 10 client.17571 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:12.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.196+0000 7fcd7fba5740 10 client.17571 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:12.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.196+0000 7fcd7fba5740 20 client.17571 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:12.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.196+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/2594361892 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562451cae4d0 0x562451cb08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:12.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.196+0000 7fcd7fba5740 4 client.17571 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:29:12.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.196+0000 7fcd7fba5740 1 -- 172.21.15.135:0/2594361892 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562451b9a9a0 con 0x562451cae4d0 2024-04-20T12:29:12.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.196+0000 7fcd7659c640 1 --2- 172.21.15.135:0/2594361892 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562451cae4d0 0x562451cb08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:12.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd5dffb640 10 client.17571 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:12.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7659c640 1 --2- 172.21.15.135:0/2594361892 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562451cae4d0 0x562451cb08f0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5379ec1985453a1 server_cookie=cd6ff6862d8737f3 in_seq=0 out_seq=0 2024-04-20T12:29:12.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd5dffb640 1 -- 172.21.15.135:0/2594361892 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562451b9a9a0 con 0x562451cae4d0 2024-04-20T12:29:12.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd5dffb640 10 client.17571 handle_command_reply: tid=0 2024-04-20T12:29:12.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7fba5740 1 client.17571 shutdown 2024-04-20T12:29:12.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7fba5740 1 -- 172.21.15.135:0/2594361892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c37310 msgr2=0x562451c31710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/2594361892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c37310 0x562451c31710 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fcd70014e70 tx=0x7fcd70009500 comp rx=0 tx=0).stop 2024-04-20T12:29:12.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7fba5740 1 -- 172.21.15.135:0/2594361892 shutdown_connections 2024-04-20T12:29:12.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/2594361892 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562451cae4d0 0x562451cb08f0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/2594361892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562451c37310 0x562451c31710 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/2594361892 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562451c2e730 0x562451c30fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd5dffb640 0 client.17571 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:12.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7fba5740 1 --2- 172.21.15.135:0/2594361892 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562451c2de10 0x562451c3fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7fba5740 1 -- 172.21.15.135:0/2594361892 >> 172.21.15.135:0/2594361892 conn(0x562451c28540 msgr2=0x562451c2a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:12.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7fba5740 1 -- 172.21.15.135:0/2594361892 shutdown_connections 2024-04-20T12:29:12.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7fba5740 1 -- 172.21.15.135:0/2594361892 wait complete. 2024-04-20T12:29:12.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7fba5740 20 client.17571 trim_cache size 0 max 16384 2024-04-20T12:29:12.210 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:29:12.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7ced2640 1 -- 172.21.15.135:0/1189546551 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd640a3d20 msgr2=0x7fcd640a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7ced2640 1 --2- 172.21.15.135:0/1189546551 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd640a3d20 0x7fcd640a61e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009810 tx=0x7fcd70009e40 comp rx=0 tx=0).stop 2024-04-20T12:29:12.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7ced2640 1 -- 172.21.15.135:0/1189546551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd781010b0 msgr2=0x7fcd7819e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:12.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7ced2640 1 --2- 172.21.15.135:0/1189546551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd781010b0 0x7fcd7819e5e0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fcd68006010 tx=0x7fcd6802cb30 comp rx=0 tx=0).stop 2024-04-20T12:29:12.211 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7ced2640 1 -- 172.21.15.135:0/1189546551 shutdown_connections 2024-04-20T12:29:12.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7ced2640 1 --2- 172.21.15.135:0/1189546551 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd78105de0 0x7fcd781986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7ced2640 1 --2- 172.21.15.135:0/1189546551 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd640a3d20 0x7fcd640a61e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7ced2640 1 --2- 172.21.15.135:0/1189546551 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd78101a50 0x7fcd7819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7ced2640 1 --2- 172.21.15.135:0/1189546551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd781010b0 0x7fcd7819e5e0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:12.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.197+0000 7fcd7ced2640 1 -- 172.21.15.135:0/1189546551 >> 172.21.15.135:0/1189546551 conn(0x7fcd78077c50 msgr2=0x7fcd7806a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:12.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.198+0000 7fcd7ced2640 1 -- 172.21.15.135:0/1189546551 shutdown_connections 2024-04-20T12:29:12.212 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:12.198+0000 7fcd7ced2640 1 -- 172.21.15.135:0/1189546551 wait complete. 2024-04-20T12:29:13.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:12 smithi154 ceph-mon[22073]: pgmap v185: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:29:13.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:12 smithi139 ceph-mon[21834]: pgmap v185: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:29:13.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:12 smithi135 ceph-mon[18264]: pgmap v185: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-04-20T12:29:13.213 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:29:13.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:29:13.214 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:29:13.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.328+0000 7f3736e88640 1 -- 172.21.15.135:0/175209611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3730107280 msgr2=0x7f373010ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.328+0000 7f3736e88640 1 --2- 172.21.15.135:0/175209611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3730107280 0x7f373010ee50 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f3728009ca0 tx=0x7f372802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.328+0000 7f3736e88640 1 -- 172.21.15.135:0/175209611 shutdown_connections 2024-04-20T12:29:13.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.328+0000 7f3736e88640 1 --2- 172.21.15.135:0/175209611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3730107280 0x7f373010ee50 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.328+0000 7f3736e88640 1 --2- 172.21.15.135:0/175209611 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f373006b200 0x7f3730106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.328+0000 7f3736e88640 1 --2- 172.21.15.135:0/175209611 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f373006a850 0x7f373006ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.328+0000 7f3736e88640 1 -- 172.21.15.135:0/175209611 >> 172.21.15.135:0/175209611 conn(0x7f3730077ec0 msgr2=0x7f37300782d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:13.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.329+0000 7f3736e88640 1 -- 172.21.15.135:0/175209611 shutdown_connections 2024-04-20T12:29:13.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.329+0000 7f3736e88640 1 -- 172.21.15.135:0/175209611 wait complete. 2024-04-20T12:29:13.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.329+0000 7f3736e88640 1 Processor -- start 2024-04-20T12:29:13.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.329+0000 7f3736e88640 1 -- start start 2024-04-20T12:29:13.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.329+0000 7f3736e88640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f373006a850 0x7f3730198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.329+0000 7f3736e88640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3730107280 0x7f3730198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.329+0000 7f3736e88640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f373019cfc0 0x7f373019d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.329+0000 7f3736e88640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3730112330 con 0x7f373019cfc0 2024-04-20T12:29:13.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.329+0000 7f3736e88640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f37301121b0 con 0x7f3730107280 2024-04-20T12:29:13.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.329+0000 7f3736e88640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37301124b0 con 0x7f373006a850 2024-04-20T12:29:13.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.329+0000 7f3735425640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f373019cfc0 0x7f373019d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.329+0000 7f3735425640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f373019cfc0 0x7f373019d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56154/0 (socket says 172.21.15.135:56154) 2024-04-20T12:29:13.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.329+0000 7f3735425640 1 -- 172.21.15.135:0/1751737024 learned_addr learned my addr 172.21.15.135:0/1751737024 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:13.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.329+0000 7f3734c24640 1 --2- 172.21.15.135:0/1751737024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f373006a850 0x7f3730198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.330+0000 7f372ffff640 1 --2- 172.21.15.135:0/1751737024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3730107280 0x7f3730198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.330+0000 7f3735425640 1 -- 172.21.15.135:0/1751737024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f373006a850 msgr2=0x7f3730198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.330+0000 7f3735425640 1 --2- 172.21.15.135:0/1751737024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f373006a850 0x7f3730198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.330+0000 7f3735425640 1 -- 172.21.15.135:0/1751737024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3730107280 msgr2=0x7f3730198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.330+0000 7f3735425640 1 --2- 172.21.15.135:0/1751737024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3730107280 0x7f3730198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.330+0000 7f3735425640 1 -- 172.21.15.135:0/1751737024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373019dab0 con 0x7f373019cfc0 2024-04-20T12:29:13.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.330+0000 7f3735425640 1 --2- 172.21.15.135:0/1751737024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f373019cfc0 0x7f373019d470 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f372802c700 tx=0x7f3728035b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:13.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.330+0000 7f372dffb640 1 -- 172.21.15.135:0/1751737024 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728039040 con 0x7f373019cfc0 2024-04-20T12:29:13.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.330+0000 7f372dffb640 1 -- 172.21.15.135:0/1751737024 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3728044070 con 0x7f373019cfc0 2024-04-20T12:29:13.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.330+0000 7f3736e88640 1 -- 172.21.15.135:0/1751737024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f373019dd40 con 0x7f373019cfc0 2024-04-20T12:29:13.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.330+0000 7f372dffb640 1 -- 172.21.15.135:0/1751737024 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728004330 con 0x7f373019cfc0 2024-04-20T12:29:13.332 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.330+0000 7f3736e88640 1 -- 172.21.15.135:0/1751737024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37301a5500 con 0x7f373019cfc0 2024-04-20T12:29:13.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.333+0000 7f372dffb640 1 -- 172.21.15.135:0/1751737024 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f3728003970 con 0x7f373019cfc0 2024-04-20T12:29:13.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.333+0000 7f3739a7f740 1 Processor -- start 2024-04-20T12:29:13.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.333+0000 7f3739a7f740 1 -- start start 2024-04-20T12:29:13.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f3739a7f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f80fe0 0x55c874f813c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f3739a7f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f81900 0x55c874f89fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f3739a7f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874f8c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f3739a7f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c874ee5f00 con 0x55c874f8a4e0 2024-04-20T12:29:13.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f3739a7f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c874e83530 con 0x55c874f80fe0 2024-04-20T12:29:13.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f3739a7f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c874ee1ec0 con 0x55c874f81900 2024-04-20T12:29:13.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f372dffb640 1 --2- 172.21.15.135:0/1751737024 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f37180a3d20 0x7f37180a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f372ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874f8c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f372ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874f8c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56164/0 (socket says 172.21.15.135:56164) 2024-04-20T12:29:13.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f372ffff640 1 -- 172.21.15.135:0/4077339569 learned_addr learned my addr 172.21.15.135:0/4077339569 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:13.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f3735425640 1 --2- 172.21.15.135:0/1751737024 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f37180a3d20 0x7f37180a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f372ffff640 1 --2- 172.21.15.135:0/4077339569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f80fe0 0x55c874f813c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f3734c24640 1 --2- 172.21.15.135:0/4077339569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f81900 0x55c874f89fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f372dffb640 1 -- 172.21.15.135:0/1751737024 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f37280f2f30 con 0x7f373019cfc0 2024-04-20T12:29:13.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f372ffff640 1 -- 172.21.15.135:0/4077339569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f81900 msgr2=0x55c874f89fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f372ffff640 1 --2- 172.21.15.135:0/4077339569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f81900 0x55c874f89fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f372ffff640 1 -- 172.21.15.135:0/4077339569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f80fe0 msgr2=0x55c874f813c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f372ffff640 1 --2- 172.21.15.135:0/4077339569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f80fe0 0x55c874f813c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f372ffff640 1 -- 172.21.15.135:0/4077339569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c874cc07e0 con 0x55c874f8a4e0 2024-04-20T12:29:13.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f3734c24640 1 --2- 172.21.15.135:0/4077339569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f81900 0x55c874f89fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:13.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f372ffff640 1 --2- 172.21.15.135:0/4077339569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874f8c8d0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f372400afd0 tx=0x7f372400a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d022ab2e67a1aced server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:13.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.334+0000 7f3735425640 1 --2- 172.21.15.135:0/1751737024 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f37180a3d20 0x7f37180a61e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f37280f0900 tx=0x7f3728091750 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:13.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.335+0000 7f3716ffd640 1 -- 172.21.15.135:0/4077339569 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3724005220 con 0x55c874f8a4e0 2024-04-20T12:29:13.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.335+0000 7f3716ffd640 1 -- 172.21.15.135:0/4077339569 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3724004c80 con 0x55c874f8a4e0 2024-04-20T12:29:13.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.335+0000 7f3716ffd640 1 -- 172.21.15.135:0/4077339569 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372400fb90 con 0x55c874f8a4e0 2024-04-20T12:29:13.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.335+0000 7f3739a7f740 1 -- 172.21.15.135:0/4077339569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 msgr2=0x55c874f8c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.335+0000 7f3739a7f740 1 --2- 172.21.15.135:0/4077339569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874f8c8d0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f372400afd0 tx=0x7f372400a6a0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.335+0000 7f3739a7f740 1 -- 172.21.15.135:0/4077339569 shutdown_connections 2024-04-20T12:29:13.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.335+0000 7f3739a7f740 1 --2- 172.21.15.135:0/4077339569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874f8c8d0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.335+0000 7f3739a7f740 1 --2- 172.21.15.135:0/4077339569 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f81900 0x55c874f89fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.335+0000 7f3739a7f740 1 --2- 172.21.15.135:0/4077339569 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f80fe0 0x55c874f813c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.335+0000 7f3739a7f740 1 -- 172.21.15.135:0/4077339569 >> 172.21.15.135:0/4077339569 conn(0x55c874f7b710 msgr2=0x55c874f7baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:13.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.335+0000 7f3739a7f740 1 -- 172.21.15.135:0/4077339569 shutdown_connections 2024-04-20T12:29:13.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.335+0000 7f3739a7f740 1 -- 172.21.15.135:0/4077339569 wait complete. 2024-04-20T12:29:13.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.336+0000 7f3739a7f740 1 -- start start 2024-04-20T12:29:13.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.336+0000 7f3739a7f740 1 Processor -- start 2024-04-20T12:29:13.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.336+0000 7f3739a7f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f80fe0 0x55c874f89ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.336+0000 7f3739a7f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f81900 0x55c874f87250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.336+0000 7f3739a7f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874f87860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.336+0000 7f3739a7f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c874f8d2d0 con 0x55c874f8a4e0 2024-04-20T12:29:13.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.336+0000 7f3739a7f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c874e6e480 con 0x55c874f81900 2024-04-20T12:29:13.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.336+0000 7f3739a7f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c874f8d450 con 0x55c874f80fe0 2024-04-20T12:29:13.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.336+0000 7f3739a7f740 10 client.0 _ll_register_callbacks cb 0x55c874e6de70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:13.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.336+0000 7f372ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874f87860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.336+0000 7f372ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874f87860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56170/0 (socket says 172.21.15.135:56170) 2024-04-20T12:29:13.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.336+0000 7f372ffff640 1 -- 172.21.15.135:0/3100033648 learned_addr learned my addr 172.21.15.135:0/3100033648 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:13.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.336+0000 7f3734c24640 1 --2- 172.21.15.135:0/3100033648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f81900 0x55c874f87250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.336+0000 7f372ffff640 1 --2- 172.21.15.135:0/3100033648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f80fe0 0x55c874f89ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f372ffff640 1 -- 172.21.15.135:0/3100033648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f80fe0 msgr2=0x55c874f89ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f372ffff640 1 --2- 172.21.15.135:0/3100033648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f80fe0 0x55c874f89ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f372ffff640 1 -- 172.21.15.135:0/3100033648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f81900 msgr2=0x55c874f87250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f372ffff640 1 --2- 172.21.15.135:0/3100033648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f81900 0x55c874f87250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f372ffff640 1 -- 172.21.15.135:0/3100033648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c874d20f70 con 0x55c874f8a4e0 2024-04-20T12:29:13.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f372ffff640 1 --2- 172.21.15.135:0/3100033648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874f87860 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3724005780 tx=0x7f3724013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c7e5defe6d61cf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:13.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f370ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:13.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f370ffff640 1 -- 172.21.15.135:0/3100033648 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372402e060 con 0x55c874f8a4e0 2024-04-20T12:29:13.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f370ffff640 1 -- 172.21.15.135:0/3100033648 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f372400f950 con 0x55c874f8a4e0 2024-04-20T12:29:13.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f3739a7f740 1 -- 172.21.15.135:0/3100033648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3724004c80 con 0x55c874f8a4e0 2024-04-20T12:29:13.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f370ffff640 1 -- 172.21.15.135:0/3100033648 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3724021040 con 0x55c874f8a4e0 2024-04-20T12:29:13.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f3739a7f740 10 client.17583 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:13.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f3739a7f740 1 -- 172.21.15.135:0/3100033648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c874bb8170 con 0x55c874f8a4e0 2024-04-20T12:29:13.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f370ffff640 1 -- 172.21.15.135:0/3100033648 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3724004c80 con 0x55c874f8a4e0 2024-04-20T12:29:13.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f370ffff640 1 -- 172.21.15.135:0/3100033648 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f372401b070 con 0x55c874f8a4e0 2024-04-20T12:29:13.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f3739a7f740 10 client.17583 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:13.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.337+0000 7f3739a7f740 10 client.17583 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:13.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.338+0000 7f3739a7f740 20 client.17583 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:13.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.338+0000 7f3739a7f740 1 --2- 172.21.15.135:0/3100033648 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c874f9a4f0 0x55c874f9c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.338+0000 7f3739a7f740 4 client.17583 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:13.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.338+0000 7f3739a7f740 1 -- 172.21.15.135:0/3100033648 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c874ef3920 con 0x55c874f9a4f0 2024-04-20T12:29:13.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.338+0000 7f3734c24640 1 --2- 172.21.15.135:0/3100033648 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c874f9a4f0 0x55c874f9c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.338+0000 7f370ffff640 10 client.17583 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:13.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.338+0000 7f3734c24640 1 --2- 172.21.15.135:0/3100033648 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c874f9a4f0 0x55c874f9c8e0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25439cafdeb9c2c0 server_cookie=d6252432e845fbe4 in_seq=0 out_seq=0 2024-04-20T12:29:13.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.339+0000 7f370ffff640 1 -- 172.21.15.135:0/3100033648 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c874ef3920 con 0x55c874f9a4f0 2024-04-20T12:29:13.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.339+0000 7f370ffff640 10 client.17583 handle_command_reply: tid=0 2024-04-20T12:29:13.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.339+0000 7f3739a7f740 1 client.17583 shutdown 2024-04-20T12:29:13.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.339+0000 7f3739a7f740 1 -- 172.21.15.135:0/3100033648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 msgr2=0x55c874f87860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.339+0000 7f3739a7f740 1 --2- 172.21.15.135:0/3100033648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874f87860 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3724005780 tx=0x7f3724013040 comp rx=0 tx=0).stop 2024-04-20T12:29:13.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.339+0000 7f3739a7f740 1 -- 172.21.15.135:0/3100033648 shutdown_connections 2024-04-20T12:29:13.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.339+0000 7f3739a7f740 1 --2- 172.21.15.135:0/3100033648 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c874f9a4f0 0x55c874f9c8e0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.339+0000 7f3739a7f740 1 --2- 172.21.15.135:0/3100033648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874f87860 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.339+0000 7f370ffff640 0 client.17583 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:13.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.339+0000 7f3739a7f740 1 --2- 172.21.15.135:0/3100033648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f81900 0x55c874f87250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.339+0000 7f3739a7f740 1 --2- 172.21.15.135:0/3100033648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f80fe0 0x55c874f89ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.339+0000 7f3739a7f740 1 -- 172.21.15.135:0/3100033648 >> 172.21.15.135:0/3100033648 conn(0x55c874f7b710 msgr2=0x55c874f7d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:13.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.339+0000 7f3739a7f740 1 -- 172.21.15.135:0/3100033648 shutdown_connections 2024-04-20T12:29:13.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.339+0000 7f3739a7f740 1 -- 172.21.15.135:0/3100033648 wait complete. 2024-04-20T12:29:13.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.339+0000 7f3739a7f740 20 client.17583 trim_cache size 0 max 16384 2024-04-20T12:29:13.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.356+0000 7f3739a7f740 1 Processor -- start 2024-04-20T12:29:13.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f3739a7f740 1 -- start start 2024-04-20T12:29:13.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f3739a7f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f80fe0 0x55c874f7d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f3739a7f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f81900 0x55c874f92ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f3739a7f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f8a4e0 0x55c874f89980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f3739a7f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f37301af1d0 con 0x55c874f80fe0 2024-04-20T12:29:13.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f3739a7f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f37301b0d10 con 0x55c874f81900 2024-04-20T12:29:13.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f3739a7f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37301af8a0 con 0x55c874f8a4e0 2024-04-20T12:29:13.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f372ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f80fe0 0x55c874f7d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f372ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f80fe0 0x55c874f7d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56178/0 (socket says 172.21.15.135:56178) 2024-04-20T12:29:13.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f372ffff640 1 -- 172.21.15.135:0/715381798 learned_addr learned my addr 172.21.15.135:0/715381798 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:13.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f372ffff640 1 -- 172.21.15.135:0/715381798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f8a4e0 msgr2=0x55c874f89980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f372ffff640 1 --2- 172.21.15.135:0/715381798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f8a4e0 0x55c874f89980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f372ffff640 1 -- 172.21.15.135:0/715381798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f81900 msgr2=0x55c874f92ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f372ffff640 1 --2- 172.21.15.135:0/715381798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f81900 0x55c874f92ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f372ffff640 1 -- 172.21.15.135:0/715381798 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c874f80780 con 0x55c874f80fe0 2024-04-20T12:29:13.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f372ffff640 1 --2- 172.21.15.135:0/715381798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f80fe0 0x55c874f7d1d0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f372402c040 tx=0x7f3724005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d62e2cdb8a569c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:13.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f37167fc640 1 -- 172.21.15.135:0/715381798 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372403e070 con 0x55c874f80fe0 2024-04-20T12:29:13.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f37167fc640 1 -- 172.21.15.135:0/715381798 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f372400a2d0 con 0x55c874f80fe0 2024-04-20T12:29:13.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.357+0000 7f37167fc640 1 -- 172.21.15.135:0/715381798 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372402e040 con 0x55c874f80fe0 2024-04-20T12:29:13.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.358+0000 7f3739a7f740 1 -- 172.21.15.135:0/715381798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f80fe0 msgr2=0x55c874f7d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.358+0000 7f3739a7f740 1 --2- 172.21.15.135:0/715381798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f80fe0 0x55c874f7d1d0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f372402c040 tx=0x7f3724005690 comp rx=0 tx=0).stop 2024-04-20T12:29:13.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.358+0000 7f3739a7f740 1 -- 172.21.15.135:0/715381798 shutdown_connections 2024-04-20T12:29:13.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.358+0000 7f3739a7f740 1 --2- 172.21.15.135:0/715381798 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f8a4e0 0x55c874f89980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.358+0000 7f3739a7f740 1 --2- 172.21.15.135:0/715381798 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f81900 0x55c874f92ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.358+0000 7f3739a7f740 1 --2- 172.21.15.135:0/715381798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f80fe0 0x55c874f7d1d0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.358+0000 7f3739a7f740 1 -- 172.21.15.135:0/715381798 >> 172.21.15.135:0/715381798 conn(0x55c874f7b710 msgr2=0x55c874f857a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:13.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.358+0000 7f3739a7f740 1 -- 172.21.15.135:0/715381798 shutdown_connections 2024-04-20T12:29:13.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.358+0000 7f3739a7f740 1 -- 172.21.15.135:0/715381798 wait complete. 2024-04-20T12:29:13.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.358+0000 7f3739a7f740 1 -- start start 2024-04-20T12:29:13.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.358+0000 7f3739a7f740 1 Processor -- start 2024-04-20T12:29:13.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f3739a7f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f80fe0 0x55c874ff8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f3739a7f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f81900 0x55c874ff8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f3739a7f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874ffd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f3739a7f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f37301b0640 con 0x55c874f8a4e0 2024-04-20T12:29:13.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f3739a7f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f37301aff70 con 0x55c874f80fe0 2024-04-20T12:29:13.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f3739a7f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f37301ad1a0 con 0x55c874f81900 2024-04-20T12:29:13.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f3739a7f740 10 client.0 _ll_register_callbacks cb 0x7f3724005460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:13.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f372ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874ffd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f372ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874ffd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56190/0 (socket says 172.21.15.135:56190) 2024-04-20T12:29:13.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f372ffff640 1 -- 172.21.15.135:0/3561802706 learned_addr learned my addr 172.21.15.135:0/3561802706 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:13.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f372ffff640 1 --2- 172.21.15.135:0/3561802706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f80fe0 0x55c874ff8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f3734c24640 1 --2- 172.21.15.135:0/3561802706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f81900 0x55c874ff8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f372ffff640 1 -- 172.21.15.135:0/3561802706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f81900 msgr2=0x55c874ff8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f372ffff640 1 --2- 172.21.15.135:0/3561802706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f81900 0x55c874ff8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f372ffff640 1 -- 172.21.15.135:0/3561802706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f80fe0 msgr2=0x55c874ff8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f372ffff640 1 --2- 172.21.15.135:0/3561802706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f80fe0 0x55c874ff8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f372ffff640 1 -- 172.21.15.135:0/3561802706 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c874ffdf80 con 0x55c874f8a4e0 2024-04-20T12:29:13.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f3734c24640 1 --2- 172.21.15.135:0/3561802706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f81900 0x55c874ff8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:13.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f372ffff640 1 --2- 172.21.15.135:0/3561802706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874ffd940 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f372401c660 tx=0x7f372400faf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905d70668b8950c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:13.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f370ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:13.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.359+0000 7f370ffff640 1 -- 172.21.15.135:0/3561802706 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372403e040 con 0x55c874f8a4e0 2024-04-20T12:29:13.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.360+0000 7f370ffff640 1 -- 172.21.15.135:0/3561802706 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f372400f690 con 0x55c874f8a4e0 2024-04-20T12:29:13.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.360+0000 7f3739a7f740 1 -- 172.21.15.135:0/3561802706 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f372400a2d0 con 0x55c874f8a4e0 2024-04-20T12:29:13.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.360+0000 7f370ffff640 1 -- 172.21.15.135:0/3561802706 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f372404e050 con 0x55c874f8a4e0 2024-04-20T12:29:13.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.360+0000 7f3739a7f740 10 client.17589 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:13.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.360+0000 7f3739a7f740 1 -- 172.21.15.135:0/3561802706 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c875005370 con 0x55c874f8a4e0 2024-04-20T12:29:13.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.360+0000 7f370ffff640 1 -- 172.21.15.135:0/3561802706 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f372400a2d0 con 0x55c874f8a4e0 2024-04-20T12:29:13.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.360+0000 7f370ffff640 1 -- 172.21.15.135:0/3561802706 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f372401b070 con 0x55c874f8a4e0 2024-04-20T12:29:13.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.360+0000 7f3739a7f740 10 client.17589 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:13.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.360+0000 7f3739a7f740 10 client.17589 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:13.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.360+0000 7f3739a7f740 20 client.17589 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:13.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.360+0000 7f3739a7f740 1 --2- 172.21.15.135:0/3561802706 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c8750058b0 0x55c875007cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.360+0000 7f3739a7f740 4 client.17589 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:29:13.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.360+0000 7f3739a7f740 1 -- 172.21.15.135:0/3561802706 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c874eed790 con 0x55c8750058b0 2024-04-20T12:29:13.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.360+0000 7f3734c24640 1 --2- 172.21.15.135:0/3561802706 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c8750058b0 0x55c875007cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.361+0000 7f370ffff640 10 client.17589 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:13.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.361+0000 7f3734c24640 1 --2- 172.21.15.135:0/3561802706 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c8750058b0 0x55c875007cd0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1ea161676fb4dd0 server_cookie=bfa878e41c92b156 in_seq=0 out_seq=0 2024-04-20T12:29:13.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.362+0000 7f370ffff640 1 -- 172.21.15.135:0/3561802706 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c874eed790 con 0x55c8750058b0 2024-04-20T12:29:13.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.362+0000 7f370ffff640 10 client.17589 handle_command_reply: tid=0 2024-04-20T12:29:13.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.362+0000 7f3739a7f740 1 client.17589 shutdown 2024-04-20T12:29:13.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.362+0000 7f3739a7f740 1 -- 172.21.15.135:0/3561802706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 msgr2=0x55c874ffd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.362+0000 7f3739a7f740 1 --2- 172.21.15.135:0/3561802706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874ffd940 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f372401c660 tx=0x7f372400faf0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.362+0000 7f3739a7f740 1 -- 172.21.15.135:0/3561802706 shutdown_connections 2024-04-20T12:29:13.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.362+0000 7f3739a7f740 1 --2- 172.21.15.135:0/3561802706 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c8750058b0 0x55c875007cd0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.362+0000 7f3739a7f740 1 --2- 172.21.15.135:0/3561802706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c874f8a4e0 0x55c874ffd940 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.362+0000 7f3739a7f740 1 --2- 172.21.15.135:0/3561802706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c874f81900 0x55c874ff8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.362+0000 7f3739a7f740 1 --2- 172.21.15.135:0/3561802706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c874f80fe0 0x55c874ff8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.362+0000 7f3739a7f740 1 -- 172.21.15.135:0/3561802706 >> 172.21.15.135:0/3561802706 conn(0x55c874f7b710 msgr2=0x55c874f7cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:13.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.362+0000 7f370ffff640 0 client.17589 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:13.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.362+0000 7f3739a7f740 1 -- 172.21.15.135:0/3561802706 shutdown_connections 2024-04-20T12:29:13.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.362+0000 7f3739a7f740 1 -- 172.21.15.135:0/3561802706 wait complete. 2024-04-20T12:29:13.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.362+0000 7f3739a7f740 20 client.17589 trim_cache size 0 max 16384 2024-04-20T12:29:13.367 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:29:13.367 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:29:13.367 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "f3a59888-b996-4622-9501-c92d2230a199", 2024-04-20T12:29:13.367 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:29:13.367 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:29:13.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.363+0000 7f3736e88640 1 -- 172.21.15.135:0/1751737024 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f37180a3d20 msgr2=0x7f37180a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.363+0000 7f3736e88640 1 --2- 172.21.15.135:0/1751737024 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f37180a3d20 0x7f37180a61e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f37280f0900 tx=0x7f3728091750 comp rx=0 tx=0).stop 2024-04-20T12:29:13.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.363+0000 7f3736e88640 1 -- 172.21.15.135:0/1751737024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f373019cfc0 msgr2=0x7f373019d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.363+0000 7f3736e88640 1 --2- 172.21.15.135:0/1751737024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f373019cfc0 0x7f373019d470 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f372802c700 tx=0x7f3728035b60 comp rx=0 tx=0).stop 2024-04-20T12:29:13.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.363+0000 7f3736e88640 1 -- 172.21.15.135:0/1751737024 shutdown_connections 2024-04-20T12:29:13.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.363+0000 7f3736e88640 1 --2- 172.21.15.135:0/1751737024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f373019cfc0 0x7f373019d470 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.363+0000 7f3736e88640 1 --2- 172.21.15.135:0/1751737024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3730107280 0x7f3730198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.363+0000 7f3736e88640 1 --2- 172.21.15.135:0/1751737024 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f37180a3d20 0x7f37180a61e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.363+0000 7f3736e88640 1 --2- 172.21.15.135:0/1751737024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f373006a850 0x7f3730198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.363+0000 7f3736e88640 1 -- 172.21.15.135:0/1751737024 >> 172.21.15.135:0/1751737024 conn(0x7f3730077ec0 msgr2=0x7f37300fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:13.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.363+0000 7f3736e88640 1 -- 172.21.15.135:0/1751737024 shutdown_connections 2024-04-20T12:29:13.369 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.363+0000 7f3736e88640 1 -- 172.21.15.135:0/1751737024 wait complete. 2024-04-20T12:29:13.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:29:13.373 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:29:13.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.474+0000 7f55959ca640 1 -- 172.21.15.135:0/347824189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f559010e840 msgr2=0x7f5590110c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.474+0000 7f55959ca640 1 --2- 172.21.15.135:0/347824189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f559010e840 0x7f5590110c30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f5588009ca0 tx=0x7f558802c180 comp rx=0 tx=0).stop 2024-04-20T12:29:13.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.474+0000 7f55959ca640 1 -- 172.21.15.135:0/347824189 shutdown_connections 2024-04-20T12:29:13.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.474+0000 7f55959ca640 1 --2- 172.21.15.135:0/347824189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f559010e840 0x7f5590110c30 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.474+0000 7f55959ca640 1 --2- 172.21.15.135:0/347824189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5590074c30 0x7f559010e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.474+0000 7f55959ca640 1 --2- 172.21.15.135:0/347824189 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5590074310 0x7f55900746f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.474+0000 7f55959ca640 1 -- 172.21.15.135:0/347824189 >> 172.21.15.135:0/347824189 conn(0x7f55900fda70 msgr2=0x7f55900ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:13.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.474+0000 7f55959ca640 1 -- 172.21.15.135:0/347824189 shutdown_connections 2024-04-20T12:29:13.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.474+0000 7f55959ca640 1 -- 172.21.15.135:0/347824189 wait complete. 2024-04-20T12:29:13.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.474+0000 7f55959ca640 1 Processor -- start 2024-04-20T12:29:13.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f55959ca640 1 -- start start 2024-04-20T12:29:13.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f55959ca640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5590074310 0x7f55901a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f55959ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5590074c30 0x7f55901a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f55959ca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f559010e840 0x7f559019a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f55959ca640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5590114540 con 0x7f559010e840 2024-04-20T12:29:13.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f55959ca640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f55901143c0 con 0x7f5590074310 2024-04-20T12:29:13.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f55959ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55901146c0 con 0x7f5590074c30 2024-04-20T12:29:13.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f558f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f559010e840 0x7f559019a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f558f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f559010e840 0x7f559019a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56204/0 (socket says 172.21.15.135:56204) 2024-04-20T12:29:13.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f558f7fe640 1 -- 172.21.15.135:0/1376463597 learned_addr learned my addr 172.21.15.135:0/1376463597 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:13.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f558e7fc640 1 --2- 172.21.15.135:0/1376463597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5590074c30 0x7f55901a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f558effd640 1 --2- 172.21.15.135:0/1376463597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5590074310 0x7f55901a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f558f7fe640 1 -- 172.21.15.135:0/1376463597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5590074c30 msgr2=0x7f55901a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f558f7fe640 1 --2- 172.21.15.135:0/1376463597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5590074c30 0x7f55901a0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f558f7fe640 1 -- 172.21.15.135:0/1376463597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5590074310 msgr2=0x7f55901a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f558f7fe640 1 --2- 172.21.15.135:0/1376463597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5590074310 0x7f55901a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f558f7fe640 1 -- 172.21.15.135:0/1376463597 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559019b020 con 0x7f559010e840 2024-04-20T12:29:13.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f558e7fc640 1 --2- 172.21.15.135:0/1376463597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5590074c30 0x7f55901a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:13.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.475+0000 7f558f7fe640 1 --2- 172.21.15.135:0/1376463597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f559010e840 0x7f559019a8a0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f558802c790 tx=0x7f5588035e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:13.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.476+0000 7f55949c8640 1 -- 172.21.15.135:0/1376463597 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588039040 con 0x7f559010e840 2024-04-20T12:29:13.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.476+0000 7f55959ca640 1 -- 172.21.15.135:0/1376463597 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559019b2b0 con 0x7f559010e840 2024-04-20T12:29:13.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.476+0000 7f55949c8640 1 -- 172.21.15.135:0/1376463597 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5588044070 con 0x7f559010e840 2024-04-20T12:29:13.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.476+0000 7f55949c8640 1 -- 172.21.15.135:0/1376463597 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588032940 con 0x7f559010e840 2024-04-20T12:29:13.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.476+0000 7f55959ca640 1 -- 172.21.15.135:0/1376463597 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55901a75b0 con 0x7f559010e840 2024-04-20T12:29:13.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f55949c8640 1 -- 172.21.15.135:0/1376463597 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f5588032ae0 con 0x7f559010e840 2024-04-20T12:29:13.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f55985b6740 1 Processor -- start 2024-04-20T12:29:13.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f55985b6740 1 -- start start 2024-04-20T12:29:13.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f55985b6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee67d20 0x556d5ee68100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f55985b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee68640 0x556d5ee70ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f55985b6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee73610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f55985b6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556d5edcd1b0 con 0x556d5ee71220 2024-04-20T12:29:13.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f55985b6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556d5ed6a390 con 0x556d5ee67d20 2024-04-20T12:29:13.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f55985b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556d5edc9170 con 0x556d5ee68640 2024-04-20T12:29:13.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f55949c8640 1 --2- 172.21.15.135:0/1376463597 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f55780a3d20 0x7f55780a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f558e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee73610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f558e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee73610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56210/0 (socket says 172.21.15.135:56210) 2024-04-20T12:29:13.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f558e7fc640 1 -- 172.21.15.135:0/3308161299 learned_addr learned my addr 172.21.15.135:0/3308161299 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:13.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f558effd640 1 --2- 172.21.15.135:0/3308161299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee68640 0x556d5ee70ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f558f7fe640 1 --2- 172.21.15.135:0/1376463597 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f55780a3d20 0x7f55780a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.478+0000 7f558e7fc640 1 --2- 172.21.15.135:0/3308161299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee67d20 0x556d5ee68100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.479+0000 7f558e7fc640 1 -- 172.21.15.135:0/3308161299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee68640 msgr2=0x556d5ee70ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.479+0000 7f558e7fc640 1 --2- 172.21.15.135:0/3308161299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee68640 0x556d5ee70ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.479+0000 7f55949c8640 1 -- 172.21.15.135:0/1376463597 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f55880f2fe0 con 0x7f559010e840 2024-04-20T12:29:13.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.479+0000 7f558e7fc640 1 -- 172.21.15.135:0/3308161299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee67d20 msgr2=0x556d5ee68100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.479+0000 7f558e7fc640 1 --2- 172.21.15.135:0/3308161299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee67d20 0x556d5ee68100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.479+0000 7f558e7fc640 1 -- 172.21.15.135:0/3308161299 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d5eba97d0 con 0x556d5ee71220 2024-04-20T12:29:13.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.479+0000 7f558effd640 1 --2- 172.21.15.135:0/3308161299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee68640 0x556d5ee70ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:13.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.479+0000 7f558e7fc640 1 --2- 172.21.15.135:0/3308161299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee73610 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f5580012570 tx=0x7f5580009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c5c058da988662 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:13.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.479+0000 7f558f7fe640 1 --2- 172.21.15.135:0/1376463597 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f55780a3d20 0x7f55780a61e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f55880f09b0 tx=0x7f55880907e0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:13.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.479+0000 7f5575ffb640 1 -- 172.21.15.135:0/3308161299 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5580010710 con 0x556d5ee71220 2024-04-20T12:29:13.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.479+0000 7f5575ffb640 1 -- 172.21.15.135:0/3308161299 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5580010d90 con 0x556d5ee71220 2024-04-20T12:29:13.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.479+0000 7f5575ffb640 1 -- 172.21.15.135:0/3308161299 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558001de10 con 0x556d5ee71220 2024-04-20T12:29:13.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.480+0000 7f55985b6740 1 -- 172.21.15.135:0/3308161299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 msgr2=0x556d5ee73610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.480+0000 7f55985b6740 1 --2- 172.21.15.135:0/3308161299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee73610 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f5580012570 tx=0x7f5580009730 comp rx=0 tx=0).stop 2024-04-20T12:29:13.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.480+0000 7f55985b6740 1 -- 172.21.15.135:0/3308161299 shutdown_connections 2024-04-20T12:29:13.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.480+0000 7f55985b6740 1 --2- 172.21.15.135:0/3308161299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee73610 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.480+0000 7f55985b6740 1 --2- 172.21.15.135:0/3308161299 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee68640 0x556d5ee70ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.480+0000 7f55985b6740 1 --2- 172.21.15.135:0/3308161299 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee67d20 0x556d5ee68100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.480+0000 7f55985b6740 1 -- 172.21.15.135:0/3308161299 >> 172.21.15.135:0/3308161299 conn(0x556d5ee62450 msgr2=0x556d5ee62830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:13.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.480+0000 7f55985b6740 1 -- 172.21.15.135:0/3308161299 shutdown_connections 2024-04-20T12:29:13.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.480+0000 7f55985b6740 1 -- 172.21.15.135:0/3308161299 wait complete. 2024-04-20T12:29:13.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.480+0000 7f55985b6740 1 -- start start 2024-04-20T12:29:13.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.480+0000 7f55985b6740 1 Processor -- start 2024-04-20T12:29:13.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.480+0000 7f55985b6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee67d20 0x556d5ee6e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.480+0000 7f55985b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee68640 0x556d5ee6e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f55985b6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee6ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f55985b6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556d5ee74010 con 0x556d5ee71220 2024-04-20T12:29:13.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f55985b6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556d5ed862f0 con 0x556d5ee67d20 2024-04-20T12:29:13.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f55985b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556d5ee74190 con 0x556d5ee68640 2024-04-20T12:29:13.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f55985b6740 10 client.0 _ll_register_callbacks cb 0x556d5ed504e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:13.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f558e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee6ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f558e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee6ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56216/0 (socket says 172.21.15.135:56216) 2024-04-20T12:29:13.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f558e7fc640 1 -- 172.21.15.135:0/109552118 learned_addr learned my addr 172.21.15.135:0/109552118 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:13.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f558e7fc640 1 --2- 172.21.15.135:0/109552118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee67d20 0x556d5ee6e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f558effd640 1 --2- 172.21.15.135:0/109552118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee68640 0x556d5ee6e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f558e7fc640 1 -- 172.21.15.135:0/109552118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee68640 msgr2=0x556d5ee6e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f558e7fc640 1 --2- 172.21.15.135:0/109552118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee68640 0x556d5ee6e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f558e7fc640 1 -- 172.21.15.135:0/109552118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee67d20 msgr2=0x556d5ee6e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f558e7fc640 1 --2- 172.21.15.135:0/109552118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee67d20 0x556d5ee6e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f558e7fc640 1 -- 172.21.15.135:0/109552118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d5eadf3f0 con 0x556d5ee71220 2024-04-20T12:29:13.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f558e7fc640 1 --2- 172.21.15.135:0/109552118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee6ed40 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f5580009d60 tx=0x7f558001daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ddc828578aac85 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:13.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f556effd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:13.489 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f556effd640 1 -- 172.21.15.135:0/109552118 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5580005280 con 0x556d5ee71220 2024-04-20T12:29:13.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f556effd640 1 -- 172.21.15.135:0/109552118 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5580005420 con 0x556d5ee71220 2024-04-20T12:29:13.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f55985b6740 1 -- 172.21.15.135:0/109552118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5580010d90 con 0x556d5ee71220 2024-04-20T12:29:13.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f556effd640 1 -- 172.21.15.135:0/109552118 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5580010510 con 0x556d5ee71220 2024-04-20T12:29:13.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f55985b6740 10 client.17601 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:13.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f55985b6740 1 -- 172.21.15.135:0/109552118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556d5ea9f0f0 con 0x556d5ee71220 2024-04-20T12:29:13.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.481+0000 7f556effd640 1 -- 172.21.15.135:0/109552118 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5580010d90 con 0x556d5ee71220 2024-04-20T12:29:13.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.482+0000 7f556effd640 1 -- 172.21.15.135:0/109552118 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f5580029040 con 0x556d5ee71220 2024-04-20T12:29:13.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.482+0000 7f55985b6740 10 client.17601 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:13.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.482+0000 7f55985b6740 10 client.17601 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:13.490 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.482+0000 7f55985b6740 20 client.17601 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:13.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.482+0000 7f55985b6740 1 --2- 172.21.15.135:0/109552118 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d5ee81500 0x556d5ee838f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.482+0000 7f55985b6740 4 client.17601 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:13.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.482+0000 7f55985b6740 1 -- 172.21.15.135:0/109552118 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d5eddabd0 con 0x556d5ee81500 2024-04-20T12:29:13.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.482+0000 7f558effd640 1 --2- 172.21.15.135:0/109552118 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d5ee81500 0x556d5ee838f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.482+0000 7f556effd640 10 client.17601 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:13.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.482+0000 7f558effd640 1 --2- 172.21.15.135:0/109552118 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d5ee81500 0x556d5ee838f0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39df49b5fd44b2a server_cookie=160f936f58f30503 in_seq=0 out_seq=0 2024-04-20T12:29:13.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.483+0000 7f556effd640 1 -- 172.21.15.135:0/109552118 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556d5eddabd0 con 0x556d5ee81500 2024-04-20T12:29:13.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.483+0000 7f556effd640 10 client.17601 handle_command_reply: tid=0 2024-04-20T12:29:13.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.483+0000 7f55985b6740 1 client.17601 shutdown 2024-04-20T12:29:13.491 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.483+0000 7f55985b6740 1 -- 172.21.15.135:0/109552118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 msgr2=0x556d5ee6ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.483+0000 7f55985b6740 1 --2- 172.21.15.135:0/109552118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee6ed40 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f5580009d60 tx=0x7f558001daf0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.483+0000 7f55985b6740 1 -- 172.21.15.135:0/109552118 shutdown_connections 2024-04-20T12:29:13.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.483+0000 7f55985b6740 1 --2- 172.21.15.135:0/109552118 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d5ee81500 0x556d5ee838f0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.483+0000 7f55985b6740 1 --2- 172.21.15.135:0/109552118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee6ed40 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.483+0000 7f55985b6740 1 --2- 172.21.15.135:0/109552118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee68640 0x556d5ee6e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.483+0000 7f556effd640 0 client.17601 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:13.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.483+0000 7f55985b6740 1 --2- 172.21.15.135:0/109552118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee67d20 0x556d5ee6e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.483+0000 7f55985b6740 1 -- 172.21.15.135:0/109552118 >> 172.21.15.135:0/109552118 conn(0x556d5ee62450 msgr2=0x556d5ee641a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:13.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.483+0000 7f55985b6740 1 -- 172.21.15.135:0/109552118 shutdown_connections 2024-04-20T12:29:13.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.483+0000 7f55985b6740 1 -- 172.21.15.135:0/109552118 wait complete. 2024-04-20T12:29:13.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.484+0000 7f55985b6740 20 client.17601 trim_cache size 0 max 16384 2024-04-20T12:29:13.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f55985b6740 1 Processor -- start 2024-04-20T12:29:13.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f55985b6740 1 -- start start 2024-04-20T12:29:13.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f55985b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee67d20 0x556d5ee709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f55985b6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee68640 0x556d5ee6d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f55985b6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee7cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.506 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f55985b6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55901b1580 con 0x556d5ee71220 2024-04-20T12:29:13.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f55985b6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f55901b30c0 con 0x556d5ee68640 2024-04-20T12:29:13.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f55985b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55901b1c50 con 0x556d5ee67d20 2024-04-20T12:29:13.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f558e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee7cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f558e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee7cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56228/0 (socket says 172.21.15.135:56228) 2024-04-20T12:29:13.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f558e7fc640 1 -- 172.21.15.135:0/1900321964 learned_addr learned my addr 172.21.15.135:0/1900321964 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:13.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f558effd640 1 --2- 172.21.15.135:0/1900321964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee68640 0x556d5ee6d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f558e7fc640 1 --2- 172.21.15.135:0/1900321964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee67d20 0x556d5ee709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f558e7fc640 1 -- 172.21.15.135:0/1900321964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee67d20 msgr2=0x556d5ee709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f558e7fc640 1 --2- 172.21.15.135:0/1900321964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee67d20 0x556d5ee709f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f558e7fc640 1 -- 172.21.15.135:0/1900321964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee68640 msgr2=0x556d5ee6d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f558e7fc640 1 --2- 172.21.15.135:0/1900321964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee68640 0x556d5ee6d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f558e7fc640 1 -- 172.21.15.135:0/1900321964 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d5ee5dd10 con 0x556d5ee71220 2024-04-20T12:29:13.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.501+0000 7f558effd640 1 --2- 172.21.15.135:0/1900321964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee68640 0x556d5ee6d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:13.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.502+0000 7f558e7fc640 1 --2- 172.21.15.135:0/1900321964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee7cf00 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f5580009e30 tx=0x7f5580005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f9756b1131c45de server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:13.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.502+0000 7f55757fa640 1 -- 172.21.15.135:0/1900321964 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558001d7a0 con 0x556d5ee71220 2024-04-20T12:29:13.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.502+0000 7f55757fa640 1 -- 172.21.15.135:0/1900321964 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f558001dde0 con 0x556d5ee71220 2024-04-20T12:29:13.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.502+0000 7f55757fa640 1 -- 172.21.15.135:0/1900321964 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5580004c70 con 0x556d5ee71220 2024-04-20T12:29:13.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.502+0000 7f55985b6740 1 -- 172.21.15.135:0/1900321964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 msgr2=0x556d5ee7cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.502+0000 7f55985b6740 1 --2- 172.21.15.135:0/1900321964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee7cf00 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f5580009e30 tx=0x7f5580005740 comp rx=0 tx=0).stop 2024-04-20T12:29:13.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.502+0000 7f55985b6740 1 -- 172.21.15.135:0/1900321964 shutdown_connections 2024-04-20T12:29:13.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.502+0000 7f55985b6740 1 --2- 172.21.15.135:0/1900321964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee71220 0x556d5ee7cf00 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.502+0000 7f55985b6740 1 --2- 172.21.15.135:0/1900321964 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee68640 0x556d5ee6d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.502+0000 7f55985b6740 1 --2- 172.21.15.135:0/1900321964 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee67d20 0x556d5ee709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.502+0000 7f55985b6740 1 -- 172.21.15.135:0/1900321964 >> 172.21.15.135:0/1900321964 conn(0x556d5ee62450 msgr2=0x556d5ee61630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:13.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.502+0000 7f55985b6740 1 -- 172.21.15.135:0/1900321964 shutdown_connections 2024-04-20T12:29:13.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.502+0000 7f55985b6740 1 -- 172.21.15.135:0/1900321964 wait complete. 2024-04-20T12:29:13.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f55985b6740 1 -- start start 2024-04-20T12:29:13.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f55985b6740 1 Processor -- start 2024-04-20T12:29:13.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f55985b6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee67d20 0x556d5ee795f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f55985b6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee68640 0x556d5ee76980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f55985b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee71220 0x556d5ee76ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f55985b6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55901b29f0 con 0x556d5ee68640 2024-04-20T12:29:13.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f55985b6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f55901b2320 con 0x556d5ee67d20 2024-04-20T12:29:13.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f55985b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f55901af550 con 0x556d5ee71220 2024-04-20T12:29:13.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f55985b6740 10 client.0 _ll_register_callbacks cb 0x7f5580012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:13.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f558effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee68640 0x556d5ee76980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f558effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee68640 0x556d5ee76980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56244/0 (socket says 172.21.15.135:56244) 2024-04-20T12:29:13.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f558effd640 1 -- 172.21.15.135:0/2800412799 learned_addr learned my addr 172.21.15.135:0/2800412799 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:13.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f558e7fc640 1 --2- 172.21.15.135:0/2800412799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee67d20 0x556d5ee795f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f558e7fc640 1 --2- 172.21.15.135:0/2800412799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee71220 0x556d5ee76ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f558effd640 1 -- 172.21.15.135:0/2800412799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee71220 msgr2=0x556d5ee76ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f558effd640 1 --2- 172.21.15.135:0/2800412799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee71220 0x556d5ee76ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f558effd640 1 -- 172.21.15.135:0/2800412799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee67d20 msgr2=0x556d5ee795f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:13.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f558effd640 1 --2- 172.21.15.135:0/2800412799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee67d20 0x556d5ee795f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f558effd640 1 -- 172.21.15.135:0/2800412799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d5ee77500 con 0x556d5ee68640 2024-04-20T12:29:13.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.503+0000 7f558e7fc640 1 --2- 172.21.15.135:0/2800412799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee71220 0x556d5ee76ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:13.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f558effd640 1 --2- 172.21.15.135:0/2800412799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee68640 0x556d5ee76980 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x556d5ee6db20 tx=0x7f5584012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9423438f5dc6597a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:13.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f556effd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:13.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f556effd640 1 -- 172.21.15.135:0/2800412799 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558401e790 con 0x556d5ee68640 2024-04-20T12:29:13.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f556effd640 1 -- 172.21.15.135:0/2800412799 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f5584005020 con 0x556d5ee68640 2024-04-20T12:29:13.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f55985b6740 1 -- 172.21.15.135:0/2800412799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f558001dde0 con 0x556d5ee68640 2024-04-20T12:29:13.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f556effd640 1 -- 172.21.15.135:0/2800412799 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f558402e050 con 0x556d5ee68640 2024-04-20T12:29:13.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f55985b6740 10 client.17607 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:13.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f55985b6740 1 -- 172.21.15.135:0/2800412799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556d5eee77b0 con 0x556d5ee68640 2024-04-20T12:29:13.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f556effd640 1 -- 172.21.15.135:0/2800412799 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f558001dde0 con 0x556d5ee68640 2024-04-20T12:29:13.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f556effd640 1 -- 172.21.15.135:0/2800412799 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f5584011440 con 0x556d5ee68640 2024-04-20T12:29:13.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f55985b6740 10 client.17607 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:13.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f55985b6740 10 client.17607 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:13.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f55985b6740 20 client.17607 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:13.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f55985b6740 1 --2- 172.21.15.135:0/2800412799 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d5eee7f60 0x556d5eeea380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:13.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f55985b6740 4 client.17607 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:29:13.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f55985b6740 1 -- 172.21.15.135:0/2800412799 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556d5edd4a40 con 0x556d5eee7f60 2024-04-20T12:29:13.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.504+0000 7f558e7fc640 1 --2- 172.21.15.135:0/2800412799 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d5eee7f60 0x556d5eeea380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:13.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f558e7fc640 1 --2- 172.21.15.135:0/2800412799 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d5eee7f60 0x556d5eeea380 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5261b179ce4466b server_cookie=5ffe909003912456 in_seq=0 out_seq=0 2024-04-20T12:29:13.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f556effd640 10 client.17607 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:13.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f556effd640 1 -- 172.21.15.135:0/2800412799 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556d5edd4a40 con 0x556d5eee7f60 2024-04-20T12:29:13.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f556effd640 10 client.17607 handle_command_reply: tid=0 2024-04-20T12:29:13.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f55985b6740 1 client.17607 shutdown 2024-04-20T12:29:13.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f55985b6740 1 -- 172.21.15.135:0/2800412799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee68640 msgr2=0x556d5ee76980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f55985b6740 1 --2- 172.21.15.135:0/2800412799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee68640 0x556d5ee76980 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x556d5ee6db20 tx=0x7f5584012820 comp rx=0 tx=0).stop 2024-04-20T12:29:13.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f55985b6740 1 -- 172.21.15.135:0/2800412799 shutdown_connections 2024-04-20T12:29:13.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f55985b6740 1 --2- 172.21.15.135:0/2800412799 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d5eee7f60 0x556d5eeea380 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f55985b6740 1 --2- 172.21.15.135:0/2800412799 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d5ee71220 0x556d5ee76ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f55985b6740 1 --2- 172.21.15.135:0/2800412799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d5ee68640 0x556d5ee76980 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f55985b6740 1 --2- 172.21.15.135:0/2800412799 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d5ee67d20 0x556d5ee795f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f556effd640 0 client.17607 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:13.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f55985b6740 1 -- 172.21.15.135:0/2800412799 >> 172.21.15.135:0/2800412799 conn(0x556d5ee62450 msgr2=0x556d5ee6e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:13.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f55985b6740 1 -- 172.21.15.135:0/2800412799 shutdown_connections 2024-04-20T12:29:13.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f55985b6740 1 -- 172.21.15.135:0/2800412799 wait complete. 2024-04-20T12:29:13.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.505+0000 7f55985b6740 20 client.17607 trim_cache size 0 max 16384 2024-04-20T12:29:13.512 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:29:13.513 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:29:13.513 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:29:13.513 INFO:teuthology.orchestra.run.smithi135.stdout: "f3a59888-b996-4622-9501-c92d2230a199": { 2024-04-20T12:29:13.513 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:29:13.513 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "f3a59888-b996-4622-9501-c92d2230a199", 2024-04-20T12:29:13.513 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:29:13.513 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:29:13.513 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:29:13.513 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:29:13.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.506+0000 7f55959ca640 1 -- 172.21.15.135:0/1376463597 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f55780a3d20 msgr2=0x7f55780a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.506+0000 7f55959ca640 1 --2- 172.21.15.135:0/1376463597 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f55780a3d20 0x7f55780a61e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f55880f09b0 tx=0x7f55880907e0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.506+0000 7f55959ca640 1 -- 172.21.15.135:0/1376463597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f559010e840 msgr2=0x7f559019a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:13.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.506+0000 7f55959ca640 1 --2- 172.21.15.135:0/1376463597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f559010e840 0x7f559019a8a0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f558802c790 tx=0x7f5588035e00 comp rx=0 tx=0).stop 2024-04-20T12:29:13.514 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.506+0000 7f55959ca640 1 -- 172.21.15.135:0/1376463597 shutdown_connections 2024-04-20T12:29:13.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.506+0000 7f55959ca640 1 --2- 172.21.15.135:0/1376463597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f559010e840 0x7f559019a8a0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.506+0000 7f55959ca640 1 --2- 172.21.15.135:0/1376463597 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f55780a3d20 0x7f55780a61e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.506+0000 7f55959ca640 1 --2- 172.21.15.135:0/1376463597 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5590074c30 0x7f55901a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.506+0000 7f55959ca640 1 --2- 172.21.15.135:0/1376463597 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5590074310 0x7f55901a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:13.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.506+0000 7f55959ca640 1 -- 172.21.15.135:0/1376463597 >> 172.21.15.135:0/1376463597 conn(0x7f55900fda70 msgr2=0x7f55900ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:13.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.506+0000 7f55959ca640 1 -- 172.21.15.135:0/1376463597 shutdown_connections 2024-04-20T12:29:13.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:13.506+0000 7f55959ca640 1 -- 172.21.15.135:0/1376463597 wait complete. 2024-04-20T12:29:13.516 INFO:tasks.cephfs.filesystem:scrub status for tag:f3a59888-b996-4622-9501-c92d2230a199 - {'path': '/', 'tag': 'f3a59888-b996-4622-9501-c92d2230a199', 'options': 'recursive,force'} 2024-04-20T12:29:13.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:13 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:29:13.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:13 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:29:13.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:13 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:29:13.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:13 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:29:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:13 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:29:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:13 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:29:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:13 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:29:14.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:13 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:29:14.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:13 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:29:14.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:13 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:29:14.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:13 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:29:14.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:13 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:29:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:14 smithi154 ceph-mon[22073]: pgmap v186: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:29:15.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:14 smithi139 ceph-mon[21834]: pgmap v186: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:29:15.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:14 smithi135 ceph-mon[18264]: pgmap v186: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 22 KiB/s wr, 27 op/s 2024-04-20T12:29:17.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:16 smithi154 ceph-mon[22073]: pgmap v187: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-20T12:29:17.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:16 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:29:17.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:16 smithi139 ceph-mon[21834]: pgmap v187: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-20T12:29:17.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:16 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:29:17.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:16 smithi135 ceph-mon[18264]: pgmap v187: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-20T12:29:17.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:16 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:29:18.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:17 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:29:18.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:17 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:29:18.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:17 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:29:18.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:17 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:29:18.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:17 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:29:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:17 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:29:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:17 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:29:18.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:17 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:29:18.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:17 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:29:18.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:17 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:29:18.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:17 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:29:18.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:17 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:29:19.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:18 smithi154 ceph-mon[22073]: pgmap v188: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-20T12:29:19.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:18 smithi139 ceph-mon[21834]: pgmap v188: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-20T12:29:19.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:18 smithi135 ceph-mon[18264]: pgmap v188: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 85 B/s wr, 8 op/s 2024-04-20T12:29:21.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:20 smithi154 ceph-mon[22073]: pgmap v189: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-20T12:29:21.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:20 smithi139 ceph-mon[21834]: pgmap v189: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-20T12:29:21.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:20 smithi135 ceph-mon[18264]: pgmap v189: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 85 B/s wr, 13 op/s 2024-04-20T12:29:23.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:22 smithi154 ceph-mon[22073]: pgmap v190: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-04-20T12:29:23.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:22 smithi139 ceph-mon[21834]: pgmap v190: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-04-20T12:29:23.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:22 smithi135 ceph-mon[18264]: pgmap v190: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-04-20T12:29:25.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:24 smithi154 ceph-mon[22073]: pgmap v191: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 op/s 2024-04-20T12:29:25.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:24 smithi139 ceph-mon[21834]: pgmap v191: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 op/s 2024-04-20T12:29:25.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:24 smithi135 ceph-mon[18264]: pgmap v191: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 op/s 2024-04-20T12:29:27.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:26 smithi154 ceph-mon[22073]: pgmap v192: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:29:27.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:26 smithi139 ceph-mon[21834]: pgmap v192: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:29:27.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:26 smithi135 ceph-mon[18264]: pgmap v192: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:29:29.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:28 smithi154 ceph-mon[22073]: pgmap v193: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:29:29.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:28 smithi139 ceph-mon[21834]: pgmap v193: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:29:29.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:28 smithi135 ceph-mon[18264]: pgmap v193: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:29:31.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:30 smithi154 ceph-mon[22073]: pgmap v194: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:29:31.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:30 smithi139 ceph-mon[21834]: pgmap v194: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:29:31.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:30 smithi135 ceph-mon[18264]: pgmap v194: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:29:33.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:32 smithi154 ceph-mon[22073]: pgmap v195: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:33.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:32 smithi139 ceph-mon[21834]: pgmap v195: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:33.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:32 smithi135 ceph-mon[18264]: pgmap v195: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:35.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:34 smithi154 ceph-mon[22073]: pgmap v196: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:29:35.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:34 smithi139 ceph-mon[21834]: pgmap v196: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:29:35.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:34 smithi135 ceph-mon[18264]: pgmap v196: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:29:37.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:36 smithi154 ceph-mon[22073]: pgmap v197: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:37.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:36 smithi139 ceph-mon[21834]: pgmap v197: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:37.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:36 smithi135 ceph-mon[18264]: pgmap v197: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:39.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:38 smithi154 ceph-mon[22073]: pgmap v198: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:39.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:38 smithi139 ceph-mon[21834]: pgmap v198: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:39.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:38 smithi135 ceph-mon[18264]: pgmap v198: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:41.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:40 smithi154 ceph-mon[22073]: pgmap v199: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:29:41.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:40 smithi139 ceph-mon[21834]: pgmap v199: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:29:41.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:40 smithi135 ceph-mon[18264]: pgmap v199: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:29:43.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:42 smithi139 ceph-mon[21834]: pgmap v200: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:43.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:42 smithi135 ceph-mon[18264]: pgmap v200: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:43.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:42 smithi154 ceph-mon[22073]: pgmap v200: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:43.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:29:43.518 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:29:43.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.630+0000 7f09536ba640 1 -- 172.21.15.135:0/3037076125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f094c1005d0 msgr2=0x7f094c100a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:43.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.630+0000 7f09536ba640 1 --2- 172.21.15.135:0/3037076125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f094c1005d0 0x7f094c100a50 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f093c009900 tx=0x7f093c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:29:43.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.630+0000 7f09536ba640 1 -- 172.21.15.135:0/3037076125 shutdown_connections 2024-04-20T12:29:43.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.630+0000 7f09536ba640 1 --2- 172.21.15.135:0/3037076125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f094c100f90 0x7f094c10d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.630+0000 7f09536ba640 1 --2- 172.21.15.135:0/3037076125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f094c1005d0 0x7f094c100a50 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.630+0000 7f09536ba640 1 --2- 172.21.15.135:0/3037076125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f094c106690 0x7f094c106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.630+0000 7f09536ba640 1 -- 172.21.15.135:0/3037076125 >> 172.21.15.135:0/3037076125 conn(0x7f094c0773f0 msgr2=0x7f094c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:43.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.630+0000 7f09536ba640 1 -- 172.21.15.135:0/3037076125 shutdown_connections 2024-04-20T12:29:43.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.630+0000 7f09536ba640 1 -- 172.21.15.135:0/3037076125 wait complete. 2024-04-20T12:29:43.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.631+0000 7f09536ba640 1 Processor -- start 2024-04-20T12:29:43.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.631+0000 7f09536ba640 1 -- start start 2024-04-20T12:29:43.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.631+0000 7f09536ba640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f094c1005d0 0x7f094c1965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.631+0000 7f09536ba640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f094c100f90 0x7f094c196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.631+0000 7f09536ba640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f094c106690 0x7f094c19ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.631+0000 7f09536ba640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f094c110110 con 0x7f094c106690 2024-04-20T12:29:43.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.631+0000 7f09536ba640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f094c10ff90 con 0x7f094c100f90 2024-04-20T12:29:43.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.631+0000 7f09536ba640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f094c110290 con 0x7f094c1005d0 2024-04-20T12:29:43.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.631+0000 7f0951c57640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f094c106690 0x7f094c19ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.631+0000 7f0951c57640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f094c106690 0x7f094c19ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36076/0 (socket says 172.21.15.135:36076) 2024-04-20T12:29:43.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.631+0000 7f0951c57640 1 -- 172.21.15.135:0/4019623074 learned_addr learned my addr 172.21.15.135:0/4019623074 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:43.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.631+0000 7f0951456640 1 --2- 172.21.15.135:0/4019623074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f094c1005d0 0x7f094c1965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.631+0000 7f0950c55640 1 --2- 172.21.15.135:0/4019623074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f094c100f90 0x7f094c196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.632+0000 7f0951c57640 1 -- 172.21.15.135:0/4019623074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f094c1005d0 msgr2=0x7f094c1965d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:43.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.632+0000 7f0951c57640 1 --2- 172.21.15.135:0/4019623074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f094c1005d0 0x7f094c1965d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.632+0000 7f0951c57640 1 -- 172.21.15.135:0/4019623074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f094c100f90 msgr2=0x7f094c196b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:43.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.632+0000 7f0951c57640 1 --2- 172.21.15.135:0/4019623074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f094c100f90 0x7f094c196b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.632+0000 7f0951c57640 1 -- 172.21.15.135:0/4019623074 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094c19b5c0 con 0x7f094c106690 2024-04-20T12:29:43.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.632+0000 7f0951c57640 1 --2- 172.21.15.135:0/4019623074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f094c106690 0x7f094c19ae90 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f094400cad0 tx=0x7f094400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:43.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.632+0000 7f09427fc640 1 -- 172.21.15.135:0/4019623074 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094400ae20 con 0x7f094c106690 2024-04-20T12:29:43.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.632+0000 7f09536ba640 1 -- 172.21.15.135:0/4019623074 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094c19b8b0 con 0x7f094c106690 2024-04-20T12:29:43.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.632+0000 7f09427fc640 1 -- 172.21.15.135:0/4019623074 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0944005020 con 0x7f094c106690 2024-04-20T12:29:43.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.632+0000 7f09427fc640 1 -- 172.21.15.135:0/4019623074 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094400f6f0 con 0x7f094c106690 2024-04-20T12:29:43.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.632+0000 7f09536ba640 1 -- 172.21.15.135:0/4019623074 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f094c1a3140 con 0x7f094c106690 2024-04-20T12:29:43.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.634+0000 7f09427fc640 1 -- 172.21.15.135:0/4019623074 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f09440051d0 con 0x7f094c106690 2024-04-20T12:29:43.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0956387740 1 Processor -- start 2024-04-20T12:29:43.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0956387740 1 -- start start 2024-04-20T12:29:43.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f09427fc640 1 --2- 172.21.15.135:0/4019623074 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f09380a3d20 0x7f09380a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0956387740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f59100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0956387740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 0x562d23f61ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0956387740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f62220 0x562d23f64610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0956387740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562d23ebe1b0 con 0x562d23f58d20 2024-04-20T12:29:43.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0956387740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562d23e5b390 con 0x562d23f62220 2024-04-20T12:29:43.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0956387740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562d23eba170 con 0x562d23f59640 2024-04-20T12:29:43.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0950c55640 1 --2- 172.21.15.135:0/4019623074 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f09380a3d20 0x7f09380a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0951456640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f59100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f09427fc640 1 -- 172.21.15.135:0/4019623074 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f09440d0ba0 con 0x7f094c106690 2024-04-20T12:29:43.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0951456640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f59100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36082/0 (socket says 172.21.15.135:36082) 2024-04-20T12:29:43.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0951456640 1 -- 172.21.15.135:0/2003009933 learned_addr learned my addr 172.21.15.135:0/2003009933 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:43.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0950c55640 1 --2- 172.21.15.135:0/2003009933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 0x562d23f61ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0951c57640 1 --2- 172.21.15.135:0/2003009933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f62220 0x562d23f64610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0951456640 1 -- 172.21.15.135:0/2003009933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 msgr2=0x562d23f61ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:43.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0951456640 1 --2- 172.21.15.135:0/2003009933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 0x562d23f61ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0951456640 1 -- 172.21.15.135:0/2003009933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f62220 msgr2=0x562d23f64610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:43.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.635+0000 7f0951456640 1 --2- 172.21.15.135:0/2003009933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f62220 0x562d23f64610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.636+0000 7f0951456640 1 -- 172.21.15.135:0/2003009933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d23c9a7d0 con 0x562d23f58d20 2024-04-20T12:29:43.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.636+0000 7f0950c55640 1 --2- 172.21.15.135:0/4019623074 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f09380a3d20 0x7f09380a61e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f093c009230 tx=0x7f093c004260 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:43.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.636+0000 7f0951456640 1 --2- 172.21.15.135:0/2003009933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f59100 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f094800cde0 tx=0x7f094800e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5975d1212613fa8c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:43.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.636+0000 7f09377fe640 1 -- 172.21.15.135:0/2003009933 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094801a070 con 0x562d23f58d20 2024-04-20T12:29:43.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.636+0000 7f09377fe640 1 -- 172.21.15.135:0/2003009933 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0948016df0 con 0x562d23f58d20 2024-04-20T12:29:43.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.636+0000 7f09377fe640 1 -- 172.21.15.135:0/2003009933 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0948015d10 con 0x562d23f58d20 2024-04-20T12:29:43.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.637+0000 7f0956387740 1 -- 172.21.15.135:0/2003009933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 msgr2=0x562d23f59100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:43.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.637+0000 7f0956387740 1 --2- 172.21.15.135:0/2003009933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f59100 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f094800cde0 tx=0x7f094800e820 comp rx=0 tx=0).stop 2024-04-20T12:29:43.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.637+0000 7f0956387740 1 -- 172.21.15.135:0/2003009933 shutdown_connections 2024-04-20T12:29:43.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.637+0000 7f0956387740 1 --2- 172.21.15.135:0/2003009933 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f62220 0x562d23f64610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.637+0000 7f0956387740 1 --2- 172.21.15.135:0/2003009933 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 0x562d23f61ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.637+0000 7f0956387740 1 --2- 172.21.15.135:0/2003009933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f59100 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.637+0000 7f0956387740 1 -- 172.21.15.135:0/2003009933 >> 172.21.15.135:0/2003009933 conn(0x562d23f53450 msgr2=0x562d23f53830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:43.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.637+0000 7f0956387740 1 -- 172.21.15.135:0/2003009933 shutdown_connections 2024-04-20T12:29:43.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.637+0000 7f0956387740 1 -- 172.21.15.135:0/2003009933 wait complete. 2024-04-20T12:29:43.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.637+0000 7f0956387740 1 -- start start 2024-04-20T12:29:43.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.637+0000 7f0956387740 1 Processor -- start 2024-04-20T12:29:43.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.637+0000 7f0956387740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f58d20 0x562d23f5f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.637+0000 7f0956387740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 0x562d23f5f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.637+0000 7f0956387740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f62220 0x562d23f5fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0956387740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562d23f65010 con 0x562d23f62220 2024-04-20T12:29:43.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0956387740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562d23e772f0 con 0x562d23f58d20 2024-04-20T12:29:43.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0956387740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562d23f65190 con 0x562d23f59640 2024-04-20T12:29:43.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0956387740 10 client.0 _ll_register_callbacks cb 0x562d23e414e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:43.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0951c57640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f62220 0x562d23f5fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0951c57640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f62220 0x562d23f5fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36086/0 (socket says 172.21.15.135:36086) 2024-04-20T12:29:43.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0951c57640 1 -- 172.21.15.135:0/538341909 learned_addr learned my addr 172.21.15.135:0/538341909 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:43.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0951456640 1 --2- 172.21.15.135:0/538341909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f58d20 0x562d23f5f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0950c55640 1 --2- 172.21.15.135:0/538341909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 0x562d23f5f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0951c57640 1 -- 172.21.15.135:0/538341909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 msgr2=0x562d23f5f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0951c57640 1 --2- 172.21.15.135:0/538341909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 0x562d23f5f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0951c57640 1 -- 172.21.15.135:0/538341909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f58d20 msgr2=0x562d23f5f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0951c57640 1 --2- 172.21.15.135:0/538341909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f58d20 0x562d23f5f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0951c57640 1 -- 172.21.15.135:0/538341909 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d23bd03f0 con 0x562d23f62220 2024-04-20T12:29:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0951456640 1 --2- 172.21.15.135:0/538341909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f58d20 0x562d23f5f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:29:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0950c55640 1 --2- 172.21.15.135:0/538341909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 0x562d23f5f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0951c57640 1 --2- 172.21.15.135:0/538341909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f62220 0x562d23f5fd10 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f0944098cd0 tx=0x7f094409c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70311cc59024810 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0934ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0934ff9640 1 -- 172.21.15.135:0/538341909 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094401d040 con 0x562d23f62220 2024-04-20T12:29:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0934ff9640 1 -- 172.21.15.135:0/538341909 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f0944080070 con 0x562d23f62220 2024-04-20T12:29:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0956387740 1 -- 172.21.15.135:0/538341909 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0948016df0 con 0x562d23f62220 2024-04-20T12:29:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0934ff9640 1 -- 172.21.15.135:0/538341909 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f09440a5430 con 0x562d23f62220 2024-04-20T12:29:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0956387740 10 client.17619 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.638+0000 7f0956387740 1 -- 172.21.15.135:0/538341909 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562d23b900f0 con 0x562d23f62220 2024-04-20T12:29:43.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.639+0000 7f0934ff9640 1 -- 172.21.15.135:0/538341909 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0948016df0 con 0x562d23f62220 2024-04-20T12:29:43.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.639+0000 7f0934ff9640 1 -- 172.21.15.135:0/538341909 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f094409bcc0 con 0x562d23f62220 2024-04-20T12:29:43.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.639+0000 7f0956387740 10 client.17619 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:43.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.639+0000 7f0956387740 10 client.17619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:43.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.639+0000 7f0956387740 20 client.17619 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:43.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.639+0000 7f0956387740 1 --2- 172.21.15.135:0/538341909 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562d23f72450 0x562d23f74840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.639+0000 7f0956387740 4 client.17619 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:43.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.639+0000 7f0956387740 1 -- 172.21.15.135:0/538341909 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d23ecbbd0 con 0x562d23f72450 2024-04-20T12:29:43.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.639+0000 7f0951456640 1 --2- 172.21.15.135:0/538341909 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562d23f72450 0x562d23f74840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.640+0000 7f0934ff9640 10 client.17619 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:43.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.640+0000 7f0951456640 1 --2- 172.21.15.135:0/538341909 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562d23f72450 0x562d23f74840 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=148f2ee9366562bd server_cookie=b92d262aa197d491 in_seq=0 out_seq=0 2024-04-20T12:29:43.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.640+0000 7f0934ff9640 1 -- 172.21.15.135:0/538341909 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562d23ecbbd0 con 0x562d23f72450 2024-04-20T12:29:43.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.640+0000 7f0934ff9640 10 client.17619 handle_command_reply: tid=0 2024-04-20T12:29:43.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.640+0000 7f0956387740 1 client.17619 shutdown 2024-04-20T12:29:43.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.640+0000 7f0956387740 1 -- 172.21.15.135:0/538341909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f62220 msgr2=0x562d23f5fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:43.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.640+0000 7f0956387740 1 --2- 172.21.15.135:0/538341909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f62220 0x562d23f5fd10 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f0944098cd0 tx=0x7f094409c870 comp rx=0 tx=0).stop 2024-04-20T12:29:43.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.641+0000 7f0956387740 1 -- 172.21.15.135:0/538341909 shutdown_connections 2024-04-20T12:29:43.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.641+0000 7f0956387740 1 --2- 172.21.15.135:0/538341909 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562d23f72450 0x562d23f74840 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.641+0000 7f0956387740 1 --2- 172.21.15.135:0/538341909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f62220 0x562d23f5fd10 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.641+0000 7f0956387740 1 --2- 172.21.15.135:0/538341909 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 0x562d23f5f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.641+0000 7f0934ff9640 0 client.17619 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:43.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.641+0000 7f0956387740 1 --2- 172.21.15.135:0/538341909 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f58d20 0x562d23f5f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.641+0000 7f0956387740 1 -- 172.21.15.135:0/538341909 >> 172.21.15.135:0/538341909 conn(0x562d23f53450 msgr2=0x562d23f551a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:43.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.641+0000 7f0956387740 1 -- 172.21.15.135:0/538341909 shutdown_connections 2024-04-20T12:29:43.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.641+0000 7f0956387740 1 -- 172.21.15.135:0/538341909 wait complete. 2024-04-20T12:29:43.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.641+0000 7f0956387740 20 client.17619 trim_cache size 0 max 16384 2024-04-20T12:29:43.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0956387740 1 Processor -- start 2024-04-20T12:29:43.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0956387740 1 -- start start 2024-04-20T12:29:43.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0956387740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f6ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0956387740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f59640 0x562d23f52630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0956387740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f62220 0x562d23f5f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0956387740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f094c1ad220 con 0x562d23f58d20 2024-04-20T12:29:43.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0956387740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f094c1aed60 con 0x562d23f59640 2024-04-20T12:29:43.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0956387740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f094c1ad8f0 con 0x562d23f62220 2024-04-20T12:29:43.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0951456640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f6ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0951456640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f6ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36088/0 (socket says 172.21.15.135:36088) 2024-04-20T12:29:43.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0951456640 1 -- 172.21.15.135:0/1767395473 learned_addr learned my addr 172.21.15.135:0/1767395473 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:43.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0950c55640 1 --2- 172.21.15.135:0/1767395473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f59640 0x562d23f52630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0951c57640 1 --2- 172.21.15.135:0/1767395473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f62220 0x562d23f5f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0951456640 1 -- 172.21.15.135:0/1767395473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f62220 msgr2=0x562d23f5f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:43.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0951456640 1 --2- 172.21.15.135:0/1767395473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f62220 0x562d23f5f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0951456640 1 -- 172.21.15.135:0/1767395473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f59640 msgr2=0x562d23f52630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:43.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0951456640 1 --2- 172.21.15.135:0/1767395473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f59640 0x562d23f52630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0951456640 1 -- 172.21.15.135:0/1767395473 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d23f52cb0 con 0x562d23f58d20 2024-04-20T12:29:43.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.658+0000 7f0950c55640 1 --2- 172.21.15.135:0/1767395473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f59640 0x562d23f52630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:43.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.659+0000 7f0951456640 1 --2- 172.21.15.135:0/1767395473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f6ded0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f0948000c00 tx=0x7f094800c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffdc36f7a5ff291 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:43.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.659+0000 7f0936ffd640 1 -- 172.21.15.135:0/1767395473 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094801a040 con 0x562d23f58d20 2024-04-20T12:29:43.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.659+0000 7f0936ffd640 1 -- 172.21.15.135:0/1767395473 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0948015c40 con 0x562d23f58d20 2024-04-20T12:29:43.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.659+0000 7f0936ffd640 1 -- 172.21.15.135:0/1767395473 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094802b850 con 0x562d23f58d20 2024-04-20T12:29:43.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.659+0000 7f0956387740 1 -- 172.21.15.135:0/1767395473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 msgr2=0x562d23f6ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:43.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.659+0000 7f0956387740 1 --2- 172.21.15.135:0/1767395473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f6ded0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f0948000c00 tx=0x7f094800c590 comp rx=0 tx=0).stop 2024-04-20T12:29:43.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.659+0000 7f0956387740 1 -- 172.21.15.135:0/1767395473 shutdown_connections 2024-04-20T12:29:43.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.659+0000 7f0956387740 1 --2- 172.21.15.135:0/1767395473 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f62220 0x562d23f5f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.659+0000 7f0956387740 1 --2- 172.21.15.135:0/1767395473 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f59640 0x562d23f52630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.659+0000 7f0956387740 1 --2- 172.21.15.135:0/1767395473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f6ded0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.659+0000 7f0956387740 1 -- 172.21.15.135:0/1767395473 >> 172.21.15.135:0/1767395473 conn(0x562d23f53450 msgr2=0x562d23f5f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:43.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.659+0000 7f0956387740 1 -- 172.21.15.135:0/1767395473 shutdown_connections 2024-04-20T12:29:43.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.659+0000 7f0956387740 1 -- 172.21.15.135:0/1767395473 wait complete. 2024-04-20T12:29:43.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.660+0000 7f0956387740 1 -- start start 2024-04-20T12:29:43.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.660+0000 7f0956387740 1 Processor -- start 2024-04-20T12:29:43.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.660+0000 7f0956387740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f67f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.660+0000 7f0956387740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 0x562d23f684a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.660+0000 7f0956387740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f62220 0x562d23f689e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.660+0000 7f0956387740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f094c1ae690 con 0x562d23f58d20 2024-04-20T12:29:43.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.660+0000 7f0956387740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f094c1adfc0 con 0x562d23f62220 2024-04-20T12:29:43.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.660+0000 7f0956387740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f094c1ab1f0 con 0x562d23f59640 2024-04-20T12:29:43.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.660+0000 7f0956387740 10 client.0 _ll_register_callbacks cb 0x7f0944005860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:43.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.660+0000 7f0951456640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f67f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.660+0000 7f0951456640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f67f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36098/0 (socket says 172.21.15.135:36098) 2024-04-20T12:29:43.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.660+0000 7f0951456640 1 -- 172.21.15.135:0/2719047010 learned_addr learned my addr 172.21.15.135:0/2719047010 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:43.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.660+0000 7f0950c55640 1 --2- 172.21.15.135:0/2719047010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 0x562d23f684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.660+0000 7f0951c57640 1 --2- 172.21.15.135:0/2719047010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f62220 0x562d23f689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0951456640 1 -- 172.21.15.135:0/2719047010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 msgr2=0x562d23f684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:43.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0951456640 1 --2- 172.21.15.135:0/2719047010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 0x562d23f684a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0951456640 1 -- 172.21.15.135:0/2719047010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f62220 msgr2=0x562d23f689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:43.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0951456640 1 --2- 172.21.15.135:0/2719047010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f62220 0x562d23f689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0951456640 1 -- 172.21.15.135:0/2719047010 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d23fd7ad0 con 0x562d23f58d20 2024-04-20T12:29:43.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0950c55640 1 --2- 172.21.15.135:0/2719047010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 0x562d23f684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:43.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0951c57640 1 --2- 172.21.15.135:0/2719047010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f62220 0x562d23f689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:43.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0951456640 1 --2- 172.21.15.135:0/2719047010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f67f60 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f0948005940 tx=0x7f094800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f78e29514fb44d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:43.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0934ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:43.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0934ff9640 1 -- 172.21.15.135:0/2719047010 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094801a070 con 0x562d23f58d20 2024-04-20T12:29:43.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0934ff9640 1 -- 172.21.15.135:0/2719047010 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f0948004020 con 0x562d23f58d20 2024-04-20T12:29:43.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0956387740 1 -- 172.21.15.135:0/2719047010 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0948015c40 con 0x562d23f58d20 2024-04-20T12:29:43.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0934ff9640 1 -- 172.21.15.135:0/2719047010 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0948043050 con 0x562d23f58d20 2024-04-20T12:29:43.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0956387740 10 client.17625 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:43.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0956387740 1 -- 172.21.15.135:0/2719047010 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562d23fd8dc0 con 0x562d23f58d20 2024-04-20T12:29:43.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0934ff9640 1 -- 172.21.15.135:0/2719047010 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0948015c40 con 0x562d23f58d20 2024-04-20T12:29:43.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0934ff9640 1 -- 172.21.15.135:0/2719047010 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f094800b040 con 0x562d23f58d20 2024-04-20T12:29:43.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0956387740 10 client.17625 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:43.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0956387740 10 client.17625 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:43.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0956387740 20 client.17625 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:43.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0956387740 1 --2- 172.21.15.135:0/2719047010 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562d23fd9340 0x562d23fdb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0956387740 4 client.17625 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:29:43.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.661+0000 7f0956387740 1 -- 172.21.15.135:0/2719047010 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562d23ec5a40 con 0x562d23fd9340 2024-04-20T12:29:43.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.662+0000 7f0950c55640 1 --2- 172.21.15.135:0/2719047010 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562d23fd9340 0x562d23fdb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.662+0000 7f0934ff9640 10 client.17625 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:43.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.662+0000 7f0950c55640 1 --2- 172.21.15.135:0/2719047010 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562d23fd9340 0x562d23fdb730 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9f70af5ac08dfa6 server_cookie=471871660f19491 in_seq=0 out_seq=0 2024-04-20T12:29:43.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.662+0000 7f0934ff9640 1 -- 172.21.15.135:0/2719047010 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562d23ec5a40 con 0x562d23fd9340 2024-04-20T12:29:43.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.662+0000 7f0934ff9640 10 client.17625 handle_command_reply: tid=0 2024-04-20T12:29:43.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.662+0000 7f0956387740 1 client.17625 shutdown 2024-04-20T12:29:43.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.662+0000 7f0956387740 1 -- 172.21.15.135:0/2719047010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 msgr2=0x562d23f67f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:43.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.662+0000 7f0956387740 1 --2- 172.21.15.135:0/2719047010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f67f60 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f0948005940 tx=0x7f094800ca30 comp rx=0 tx=0).stop 2024-04-20T12:29:43.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.662+0000 7f0956387740 1 -- 172.21.15.135:0/2719047010 shutdown_connections 2024-04-20T12:29:43.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.662+0000 7f0956387740 1 --2- 172.21.15.135:0/2719047010 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x562d23fd9340 0x562d23fdb730 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.662+0000 7f0956387740 1 --2- 172.21.15.135:0/2719047010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562d23f62220 0x562d23f689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.662+0000 7f0956387740 1 --2- 172.21.15.135:0/2719047010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562d23f59640 0x562d23f684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.662+0000 7f0956387740 1 --2- 172.21.15.135:0/2719047010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562d23f58d20 0x562d23f67f60 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.662+0000 7f0934ff9640 0 client.17625 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:43.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.662+0000 7f0956387740 1 -- 172.21.15.135:0/2719047010 >> 172.21.15.135:0/2719047010 conn(0x562d23f53450 msgr2=0x562d23f524b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:43.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.663+0000 7f0956387740 1 -- 172.21.15.135:0/2719047010 shutdown_connections 2024-04-20T12:29:43.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.663+0000 7f0956387740 1 -- 172.21.15.135:0/2719047010 wait complete. 2024-04-20T12:29:43.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.663+0000 7f0956387740 20 client.17625 trim_cache size 0 max 16384 2024-04-20T12:29:43.671 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:29:43.672 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:29:43.672 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:29:43.672 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:29:43.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.663+0000 7f09536ba640 1 -- 172.21.15.135:0/4019623074 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f09380a3d20 msgr2=0x7f09380a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:43.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.663+0000 7f09536ba640 1 --2- 172.21.15.135:0/4019623074 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f09380a3d20 0x7f09380a61e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f093c009230 tx=0x7f093c004260 comp rx=0 tx=0).stop 2024-04-20T12:29:43.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.663+0000 7f09536ba640 1 -- 172.21.15.135:0/4019623074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f094c106690 msgr2=0x7f094c19ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:43.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.663+0000 7f09536ba640 1 --2- 172.21.15.135:0/4019623074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f094c106690 0x7f094c19ae90 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f094400cad0 tx=0x7f094400cf90 comp rx=0 tx=0).stop 2024-04-20T12:29:43.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.663+0000 7f09536ba640 1 -- 172.21.15.135:0/4019623074 shutdown_connections 2024-04-20T12:29:43.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.663+0000 7f09536ba640 1 --2- 172.21.15.135:0/4019623074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f094c106690 0x7f094c19ae90 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.663+0000 7f09536ba640 1 --2- 172.21.15.135:0/4019623074 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f094c100f90 0x7f094c196b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.663+0000 7f09536ba640 1 --2- 172.21.15.135:0/4019623074 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f09380a3d20 0x7f09380a61e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.663+0000 7f09536ba640 1 --2- 172.21.15.135:0/4019623074 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f094c1005d0 0x7f094c1965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.663+0000 7f09536ba640 1 -- 172.21.15.135:0/4019623074 >> 172.21.15.135:0/4019623074 conn(0x7f094c0773f0 msgr2=0x7f094c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:43.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.663+0000 7f09536ba640 1 -- 172.21.15.135:0/4019623074 shutdown_connections 2024-04-20T12:29:43.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.663+0000 7f09536ba640 1 -- 172.21.15.135:0/4019623074 wait complete. 2024-04-20T12:29:43.674 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:29:43.675 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:29:43.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.773+0000 7f8bf63e0640 1 -- 172.21.15.135:0/111194694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf0101090 msgr2=0x7f8bf0106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:43.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.773+0000 7f8bf63e0640 1 --2- 172.21.15.135:0/111194694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf0101090 0x7f8bf0106bc0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009900 tx=0x7f8be402bc30 comp rx=0 tx=0).stop 2024-04-20T12:29:43.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.773+0000 7f8bf63e0640 1 -- 172.21.15.135:0/111194694 shutdown_connections 2024-04-20T12:29:43.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.773+0000 7f8bf63e0640 1 --2- 172.21.15.135:0/111194694 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bf01072f0 0x7f8bf010ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.773+0000 7f8bf63e0640 1 --2- 172.21.15.135:0/111194694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf0101090 0x7f8bf0106bc0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.773+0000 7f8bf63e0640 1 --2- 172.21.15.135:0/111194694 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf01006e0 0x7f8bf0100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.773+0000 7f8bf63e0640 1 -- 172.21.15.135:0/111194694 >> 172.21.15.135:0/111194694 conn(0x7f8bf0077430 msgr2=0x7f8bf00fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:43.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.773+0000 7f8bf63e0640 1 -- 172.21.15.135:0/111194694 shutdown_connections 2024-04-20T12:29:43.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.773+0000 7f8bf63e0640 1 -- 172.21.15.135:0/111194694 wait complete. 2024-04-20T12:29:43.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.774+0000 7f8bf63e0640 1 Processor -- start 2024-04-20T12:29:43.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.774+0000 7f8bf63e0640 1 -- start start 2024-04-20T12:29:43.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.774+0000 7f8bf63e0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf01006e0 0x7f8bf0101650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.774+0000 7f8bf63e0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bf01072f0 0x7f8bf0101b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.774+0000 7f8bf63e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf01020d0 0x7f8bf01a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.774+0000 7f8bf63e0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf01122f0 con 0x7f8bf01020d0 2024-04-20T12:29:43.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.774+0000 7f8bf63e0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf0112170 con 0x7f8bf01072f0 2024-04-20T12:29:43.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.774+0000 7f8bf63e0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf0112470 con 0x7f8bf01006e0 2024-04-20T12:29:43.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.774+0000 7f8bf497d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf01020d0 0x7f8bf01a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8bf497d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf01020d0 0x7f8bf01a6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36126/0 (socket says 172.21.15.135:36126) 2024-04-20T12:29:43.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8bf497d640 1 -- 172.21.15.135:0/112992432 learned_addr learned my addr 172.21.15.135:0/112992432 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:43.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8bef7fe640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bf01072f0 0x7f8bf0101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8beffff640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf01006e0 0x7f8bf0101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8bf497d640 1 -- 172.21.15.135:0/112992432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf01006e0 msgr2=0x7f8bf0101650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:43.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8bf497d640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf01006e0 0x7f8bf0101650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8bf497d640 1 -- 172.21.15.135:0/112992432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bf01072f0 msgr2=0x7f8bf0101b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:43.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8bf497d640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bf01072f0 0x7f8bf0101b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:43.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8bf497d640 1 -- 172.21.15.135:0/112992432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf01a7120 con 0x7f8bf01020d0 2024-04-20T12:29:43.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8beffff640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf01006e0 0x7f8bf0101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:43.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8bef7fe640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bf01072f0 0x7f8bf0101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:43.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8bf497d640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf01020d0 0x7f8bf01a6a20 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f8be800eaa0 tx=0x7f8be800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:43.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8bed7fa640 1 -- 172.21.15.135:0/112992432 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be800cdb0 con 0x7f8bf01020d0 2024-04-20T12:29:43.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8bf63e0640 1 -- 172.21.15.135:0/112992432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf01a7410 con 0x7f8bf01020d0 2024-04-20T12:29:43.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8bed7fa640 1 -- 172.21.15.135:0/112992432 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8be8005020 con 0x7f8bf01020d0 2024-04-20T12:29:43.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8bed7fa640 1 -- 172.21.15.135:0/112992432 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be80116b0 con 0x7f8bf01020d0 2024-04-20T12:29:43.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.775+0000 7f8bf63e0640 1 -- 172.21.15.135:0/112992432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf01a7960 con 0x7f8bf01020d0 2024-04-20T12:29:43.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.776+0000 7f8bf63e0640 1 -- 172.21.15.135:0/112992432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf0102b80 con 0x7f8bf01020d0 2024-04-20T12:29:43.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.777+0000 7f8bed7fa640 1 -- 172.21.15.135:0/112992432 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f8be8005560 con 0x7f8bf01020d0 2024-04-20T12:29:43.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.778+0000 7f8bed7fa640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8bd80a3d50 0x7f8bd80a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:43.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.778+0000 7f8beffff640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8bd80a3d50 0x7f8bd80a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:43.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.778+0000 7f8bed7fa640 1 -- 172.21.15.135:0/112992432 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f8be80d0df0 con 0x7f8bf01020d0 2024-04-20T12:29:43.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.778+0000 7f8beffff640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8bd80a3d50 0x7f8bd80a6210 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8be00058c0 tx=0x7f8be0005d30 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:43.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.782+0000 7f8bed7fa640 1 -- 172.21.15.135:0/112992432 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f8be8016030 con 0x7f8bf01020d0 2024-04-20T12:29:43.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.998+0000 7f8bf63e0640 1 -- 172.21.15.135:0/112992432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bf010a430 con 0x7f8bf01020d0 2024-04-20T12:29:43.998 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:43.999+0000 7f8bed7fa640 1 -- 172.21.15.135:0/112992432 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7f8be809d110 con 0x7f8bf01020d0 2024-04-20T12:29:43.999 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:29:43.999 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:29:43.999 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:29:44.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.001+0000 7f8bf63e0640 1 -- 172.21.15.135:0/112992432 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8bd80a3d50 msgr2=0x7f8bd80a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.001+0000 7f8bf63e0640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8bd80a3d50 0x7f8bd80a6210 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8be00058c0 tx=0x7f8be0005d30 comp rx=0 tx=0).stop 2024-04-20T12:29:44.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.001+0000 7f8bf63e0640 1 -- 172.21.15.135:0/112992432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf01020d0 msgr2=0x7f8bf01a6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.001+0000 7f8bf63e0640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf01020d0 0x7f8bf01a6a20 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f8be800eaa0 tx=0x7f8be800ef60 comp rx=0 tx=0).stop 2024-04-20T12:29:44.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.001+0000 7f8bf63e0640 1 -- 172.21.15.135:0/112992432 shutdown_connections 2024-04-20T12:29:44.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.001+0000 7f8bf63e0640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8bf01020d0 0x7f8bf01a6a20 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.001+0000 7f8bf63e0640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8bf01072f0 0x7f8bf0101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.001+0000 7f8bf63e0640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8bd80a3d50 0x7f8bd80a6210 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.001+0000 7f8bf63e0640 1 --2- 172.21.15.135:0/112992432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8bf01006e0 0x7f8bf0101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.001+0000 7f8bf63e0640 1 -- 172.21.15.135:0/112992432 >> 172.21.15.135:0/112992432 conn(0x7f8bf0077430 msgr2=0x7f8bf0105720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.001+0000 7f8bf63e0640 1 -- 172.21.15.135:0/112992432 shutdown_connections 2024-04-20T12:29:44.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.001+0000 7f8bf63e0640 1 -- 172.21.15.135:0/112992432 wait complete. 2024-04-20T12:29:44.012 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:29:44.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.113+0000 7fc779767640 1 -- 172.21.15.135:0/1802145454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc774106160 msgr2=0x7fc77410dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.113+0000 7fc779767640 1 --2- 172.21.15.135:0/1802145454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc774106160 0x7fc77410dd30 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009900 tx=0x7fc76c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:29:44.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.113+0000 7fc779767640 1 -- 172.21.15.135:0/1802145454 shutdown_connections 2024-04-20T12:29:44.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.113+0000 7fc779767640 1 --2- 172.21.15.135:0/1802145454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc774106160 0x7fc77410dd30 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.113+0000 7fc779767640 1 --2- 172.21.15.135:0/1802145454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc774101a40 0x7fc774105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.113+0000 7fc779767640 1 --2- 172.21.15.135:0/1802145454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc774101090 0x7fc774101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.113+0000 7fc779767640 1 -- 172.21.15.135:0/1802145454 >> 172.21.15.135:0/1802145454 conn(0x7fc774078010 msgr2=0x7fc774078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.113+0000 7fc779767640 1 -- 172.21.15.135:0/1802145454 shutdown_connections 2024-04-20T12:29:44.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.113+0000 7fc779767640 1 -- 172.21.15.135:0/1802145454 wait complete. 2024-04-20T12:29:44.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.114+0000 7fc779767640 1 Processor -- start 2024-04-20T12:29:44.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.114+0000 7fc779767640 1 -- start start 2024-04-20T12:29:44.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.114+0000 7fc779767640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc774101090 0x7fc774199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.114+0000 7fc779767640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc774106160 0x7fc774199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.114+0000 7fc779767640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc77419a0f0 0x7fc7741a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.114+0000 7fc779767640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc774111220 con 0x7fc77419a0f0 2024-04-20T12:29:44.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.114+0000 7fc779767640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741110a0 con 0x7fc774101090 2024-04-20T12:29:44.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.114+0000 7fc779767640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741113a0 con 0x7fc774106160 2024-04-20T12:29:44.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.114+0000 7fc7737fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc77419a0f0 0x7fc7741a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc7737fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc77419a0f0 0x7fc7741a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36140/0 (socket says 172.21.15.135:36140) 2024-04-20T12:29:44.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc7737fe640 1 -- 172.21.15.135:0/167298861 learned_addr learned my addr 172.21.15.135:0/167298861 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc7727fc640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc774106160 0x7fc774199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc772ffd640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc774101090 0x7fc774199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc7737fe640 1 -- 172.21.15.135:0/167298861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc774106160 msgr2=0x7fc774199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc7737fe640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc774106160 0x7fc774199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc7737fe640 1 -- 172.21.15.135:0/167298861 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc774101090 msgr2=0x7fc774199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc7737fe640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc774101090 0x7fc774199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc7737fe640 1 -- 172.21.15.135:0/167298861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7741a4e70 con 0x7fc77419a0f0 2024-04-20T12:29:44.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc772ffd640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc774101090 0x7fc774199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:44.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc7727fc640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc774106160 0x7fc774199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:44.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc7737fe640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc77419a0f0 0x7fc7741a46a0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009230 tx=0x7fc76c02cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc75bfff640 1 -- 172.21.15.135:0/167298861 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c041070 con 0x7fc77419a0f0 2024-04-20T12:29:44.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc779767640 1 -- 172.21.15.135:0/167298861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7741a5100 con 0x7fc77419a0f0 2024-04-20T12:29:44.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc75bfff640 1 -- 172.21.15.135:0/167298861 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc76c004450 con 0x7fc77419a0f0 2024-04-20T12:29:44.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc75bfff640 1 -- 172.21.15.135:0/167298861 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c003d90 con 0x7fc77419a0f0 2024-04-20T12:29:44.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.115+0000 7fc779767640 1 -- 172.21.15.135:0/167298861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7741a55f0 con 0x7fc77419a0f0 2024-04-20T12:29:44.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.117+0000 7fc75bfff640 1 -- 172.21.15.135:0/167298861 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fc76c044070 con 0x7fc77419a0f0 2024-04-20T12:29:44.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc77c438740 1 Processor -- start 2024-04-20T12:29:44.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc77c438740 1 -- start start 2024-04-20T12:29:44.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc77c438740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf214e10 0x55aebf2151f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc77c438740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf215730 0x55aebf21ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc77c438740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf21e310 0x55aebf220700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc77c438740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55aebf17a110 con 0x55aebf215730 2024-04-20T12:29:44.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc77c438740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55aebf117550 con 0x55aebf21e310 2024-04-20T12:29:44.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc77c438740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55aebf1760d0 con 0x55aebf214e10 2024-04-20T12:29:44.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc772ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf215730 0x55aebf21ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc772ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf215730 0x55aebf21ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36154/0 (socket says 172.21.15.135:36154) 2024-04-20T12:29:44.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc772ffd640 1 -- 172.21.15.135:0/2093003505 learned_addr learned my addr 172.21.15.135:0/2093003505 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc75bfff640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc75c0a3d20 0x7fc75c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc7737fe640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc75c0a3d20 0x7fc75c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc7727fc640 1 --2- 172.21.15.135:0/2093003505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf21e310 0x55aebf220700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc772ffd640 1 -- 172.21.15.135:0/2093003505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf214e10 msgr2=0x55aebf2151f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc772ffd640 1 --2- 172.21.15.135:0/2093003505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf214e10 0x55aebf2151f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc772ffd640 1 -- 172.21.15.135:0/2093003505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf21e310 msgr2=0x55aebf220700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc772ffd640 1 --2- 172.21.15.135:0/2093003505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf21e310 0x55aebf220700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc772ffd640 1 -- 172.21.15.135:0/2093003505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebf13f900 con 0x55aebf215730 2024-04-20T12:29:44.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc7727fc640 1 --2- 172.21.15.135:0/2093003505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf21e310 0x55aebf220700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:44.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.118+0000 7fc75bfff640 1 -- 172.21.15.135:0/167298861 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc76c0f2780 con 0x7fc77419a0f0 2024-04-20T12:29:44.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.119+0000 7fc772ffd640 1 --2- 172.21.15.135:0/2093003505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf215730 0x55aebf21ddd0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc76400f390 tx=0x7fc76400f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96dc7d08efba25e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.119+0000 7fc7737fe640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc75c0a3d20 0x7fc75c0a61e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0be3e0 tx=0x7fc76c090f40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.119+0000 7fc7597fa640 1 -- 172.21.15.135:0/2093003505 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc764003b70 con 0x55aebf215730 2024-04-20T12:29:44.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.119+0000 7fc7597fa640 1 -- 172.21.15.135:0/2093003505 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc764003d10 con 0x55aebf215730 2024-04-20T12:29:44.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.119+0000 7fc7597fa640 1 -- 172.21.15.135:0/2093003505 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc764011af0 con 0x55aebf215730 2024-04-20T12:29:44.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 -- 172.21.15.135:0/2093003505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf215730 msgr2=0x55aebf21ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 --2- 172.21.15.135:0/2093003505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf215730 0x55aebf21ddd0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc76400f390 tx=0x7fc76400f850 comp rx=0 tx=0).stop 2024-04-20T12:29:44.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 -- 172.21.15.135:0/2093003505 shutdown_connections 2024-04-20T12:29:44.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 --2- 172.21.15.135:0/2093003505 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf21e310 0x55aebf220700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 --2- 172.21.15.135:0/2093003505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf215730 0x55aebf21ddd0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 --2- 172.21.15.135:0/2093003505 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf214e10 0x55aebf2151f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 -- 172.21.15.135:0/2093003505 >> 172.21.15.135:0/2093003505 conn(0x55aebf20f540 msgr2=0x55aebf20f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 -- 172.21.15.135:0/2093003505 shutdown_connections 2024-04-20T12:29:44.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 -- 172.21.15.135:0/2093003505 wait complete. 2024-04-20T12:29:44.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 -- start start 2024-04-20T12:29:44.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 Processor -- start 2024-04-20T12:29:44.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf214e10 0x55aebf21b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf215730 0x55aebf21b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf21e310 0x55aebf21be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55aebf221100 con 0x55aebf215730 2024-04-20T12:29:44.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55aebf133500 con 0x55aebf214e10 2024-04-20T12:29:44.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55aebf221280 con 0x55aebf21e310 2024-04-20T12:29:44.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc77c438740 10 client.0 _ll_register_callbacks cb 0x55aebf1182f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc772ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf215730 0x55aebf21b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc772ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf215730 0x55aebf21b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36160/0 (socket says 172.21.15.135:36160) 2024-04-20T12:29:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc772ffd640 1 -- 172.21.15.135:0/1986776574 learned_addr learned my addr 172.21.15.135:0/1986776574 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.120+0000 7fc7727fc640 1 --2- 172.21.15.135:0/1986776574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf21e310 0x55aebf21be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc7727fc640 1 --2- 172.21.15.135:0/1986776574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf214e10 0x55aebf21b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc772ffd640 1 -- 172.21.15.135:0/1986776574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf21e310 msgr2=0x55aebf21be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc772ffd640 1 --2- 172.21.15.135:0/1986776574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf21e310 0x55aebf21be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc772ffd640 1 -- 172.21.15.135:0/1986776574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf214e10 msgr2=0x55aebf21b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc772ffd640 1 --2- 172.21.15.135:0/1986776574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf214e10 0x55aebf21b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc772ffd640 1 -- 172.21.15.135:0/1986776574 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebee8c3f0 con 0x55aebf215730 2024-04-20T12:29:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc772ffd640 1 --2- 172.21.15.135:0/1986776574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf215730 0x55aebf21b940 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fc764006010 tx=0x7fc764009d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11a64f85350f83 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc756ff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc756ff5640 1 -- 172.21.15.135:0/1986776574 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc764004a40 con 0x55aebf215730 2024-04-20T12:29:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc756ff5640 1 -- 172.21.15.135:0/1986776574 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc764004be0 con 0x55aebf215730 2024-04-20T12:29:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc77c438740 1 -- 172.21.15.135:0/1986776574 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc764003d10 con 0x55aebf215730 2024-04-20T12:29:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc756ff5640 1 -- 172.21.15.135:0/1986776574 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc764004e20 con 0x55aebf215730 2024-04-20T12:29:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc77c438740 10 client.17643 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc77c438740 1 -- 172.21.15.135:0/1986776574 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55aebef567d0 con 0x55aebf215730 2024-04-20T12:29:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc756ff5640 1 -- 172.21.15.135:0/1986776574 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc764003d10 con 0x55aebf215730 2024-04-20T12:29:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc756ff5640 1 -- 172.21.15.135:0/1986776574 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc764005040 con 0x55aebf215730 2024-04-20T12:29:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc77c438740 10 client.17643 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:44.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc77c438740 10 client.17643 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:29:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc77c438740 20 client.17643 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc77c438740 1 --2- 172.21.15.135:0/1986776574 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55aebf22e570 0x55aebf230960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc77c438740 4 client.17643 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.121+0000 7fc77c438740 1 -- 172.21.15.135:0/1986776574 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aebf187b30 con 0x55aebf22e570 2024-04-20T12:29:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.122+0000 7fc7727fc640 1 --2- 172.21.15.135:0/1986776574 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55aebf22e570 0x55aebf230960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.122+0000 7fc756ff5640 10 client.17643 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:29:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.122+0000 7fc7727fc640 1 --2- 172.21.15.135:0/1986776574 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55aebf22e570 0x55aebf230960 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e0ce1350ef777f7f server_cookie=30f9d30d7f379ff0 in_seq=0 out_seq=0 2024-04-20T12:29:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.122+0000 7fc756ff5640 1 -- 172.21.15.135:0/1986776574 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55aebf187b30 con 0x55aebf22e570 2024-04-20T12:29:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.122+0000 7fc756ff5640 10 client.17643 handle_command_reply: tid=0 2024-04-20T12:29:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.122+0000 7fc77c438740 1 client.17643 shutdown 2024-04-20T12:29:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.123+0000 7fc77c438740 1 -- 172.21.15.135:0/1986776574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf215730 msgr2=0x55aebf21b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.123+0000 7fc77c438740 1 --2- 172.21.15.135:0/1986776574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf215730 0x55aebf21b940 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fc764006010 tx=0x7fc764009d50 comp rx=0 tx=0).stop 2024-04-20T12:29:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.123+0000 7fc77c438740 1 -- 172.21.15.135:0/1986776574 shutdown_connections 2024-04-20T12:29:44.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.123+0000 7fc77c438740 1 --2- 172.21.15.135:0/1986776574 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55aebf22e570 0x55aebf230960 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.123+0000 7fc77c438740 1 --2- 172.21.15.135:0/1986776574 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf21e310 0x55aebf21be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.123+0000 7fc756ff5640 0 client.17643 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:29:44.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.123+0000 7fc77c438740 1 --2- 172.21.15.135:0/1986776574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf215730 0x55aebf21b940 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.123+0000 7fc77c438740 1 --2- 172.21.15.135:0/1986776574 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf214e10 0x55aebf21b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.123+0000 7fc77c438740 1 -- 172.21.15.135:0/1986776574 >> 172.21.15.135:0/1986776574 conn(0x55aebf20f540 msgr2=0x55aebf211290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.123+0000 7fc77c438740 1 -- 172.21.15.135:0/1986776574 shutdown_connections 2024-04-20T12:29:44.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.123+0000 7fc77c438740 1 -- 172.21.15.135:0/1986776574 wait complete. 2024-04-20T12:29:44.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.123+0000 7fc77c438740 20 client.17643 trim_cache size 0 max 16384 2024-04-20T12:29:44.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc77c438740 1 Processor -- start 2024-04-20T12:29:44.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc77c438740 1 -- start start 2024-04-20T12:29:44.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc77c438740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf214e10 0x55aebf21db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc77c438740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf215730 0x55aebf22ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc77c438740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf21e310 0x55aebf229fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc77c438740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741af390 con 0x55aebf214e10 2024-04-20T12:29:44.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc77c438740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741b0ed0 con 0x55aebf21e310 2024-04-20T12:29:44.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc77c438740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741afa60 con 0x55aebf215730 2024-04-20T12:29:44.141 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc7727fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf214e10 0x55aebf21db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc7727fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf214e10 0x55aebf21db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36162/0 (socket says 172.21.15.135:36162) 2024-04-20T12:29:44.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc7727fc640 1 -- 172.21.15.135:0/80696037 learned_addr learned my addr 172.21.15.135:0/80696037 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc7727fc640 1 -- 172.21.15.135:0/80696037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf215730 msgr2=0x55aebf22ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc7727fc640 1 --2- 172.21.15.135:0/80696037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf215730 0x55aebf22ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc7727fc640 1 -- 172.21.15.135:0/80696037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf21e310 msgr2=0x55aebf229fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc7727fc640 1 --2- 172.21.15.135:0/80696037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf21e310 0x55aebf229fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc7727fc640 1 -- 172.21.15.135:0/80696037 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aebf21a3b0 con 0x55aebf214e10 2024-04-20T12:29:44.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc7727fc640 1 --2- 172.21.15.135:0/80696037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf214e10 0x55aebf21db30 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fc76800dc10 tx=0x7fc768005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3afec8736e71f4c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.136+0000 7fc758ff9640 1 -- 172.21.15.135:0/80696037 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc768004be0 con 0x55aebf214e10 2024-04-20T12:29:44.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.137+0000 7fc758ff9640 1 -- 172.21.15.135:0/80696037 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc768004d80 con 0x55aebf214e10 2024-04-20T12:29:44.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.137+0000 7fc758ff9640 1 -- 172.21.15.135:0/80696037 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7680035f0 con 0x55aebf214e10 2024-04-20T12:29:44.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.137+0000 7fc77c438740 1 -- 172.21.15.135:0/80696037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf214e10 msgr2=0x55aebf21db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.137+0000 7fc77c438740 1 --2- 172.21.15.135:0/80696037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf214e10 0x55aebf21db30 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fc76800dc10 tx=0x7fc768005d30 comp rx=0 tx=0).stop 2024-04-20T12:29:44.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.137+0000 7fc77c438740 1 -- 172.21.15.135:0/80696037 shutdown_connections 2024-04-20T12:29:44.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.137+0000 7fc77c438740 1 --2- 172.21.15.135:0/80696037 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf21e310 0x55aebf229fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.137+0000 7fc77c438740 1 --2- 172.21.15.135:0/80696037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf215730 0x55aebf22ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.137+0000 7fc77c438740 1 --2- 172.21.15.135:0/80696037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf214e10 0x55aebf21db30 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.137+0000 7fc77c438740 1 -- 172.21.15.135:0/80696037 >> 172.21.15.135:0/80696037 conn(0x55aebf20f540 msgr2=0x55aebf20e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.137+0000 7fc77c438740 1 -- 172.21.15.135:0/80696037 shutdown_connections 2024-04-20T12:29:44.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.137+0000 7fc77c438740 1 -- 172.21.15.135:0/80696037 wait complete. 2024-04-20T12:29:44.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.137+0000 7fc77c438740 1 -- start start 2024-04-20T12:29:44.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.137+0000 7fc77c438740 1 Processor -- start 2024-04-20T12:29:44.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc77c438740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf214e10 0x55aebf2182e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc77c438740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf215730 0x55aebf218820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc77c438740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf21e310 0x55aebf218d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc77c438740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741b0800 con 0x55aebf21e310 2024-04-20T12:29:44.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc77c438740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741b0130 con 0x55aebf214e10 2024-04-20T12:29:44.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc77c438740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc7741ad360 con 0x55aebf215730 2024-04-20T12:29:44.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc77c438740 10 client.0 _ll_register_callbacks cb 0x7fc764015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:44.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc7727fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf21e310 0x55aebf218d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc7727fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf21e310 0x55aebf218d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36166/0 (socket says 172.21.15.135:36166) 2024-04-20T12:29:44.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc7727fc640 1 -- 172.21.15.135:0/3277138821 learned_addr learned my addr 172.21.15.135:0/3277138821 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc772ffd640 1 --2- 172.21.15.135:0/3277138821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf215730 0x55aebf218820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc7727fc640 1 --2- 172.21.15.135:0/3277138821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf214e10 0x55aebf2182e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc7727fc640 1 -- 172.21.15.135:0/3277138821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf215730 msgr2=0x55aebf218820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc7727fc640 1 --2- 172.21.15.135:0/3277138821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf215730 0x55aebf218820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc7727fc640 1 -- 172.21.15.135:0/3277138821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf214e10 msgr2=0x55aebf2182e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc7727fc640 1 --2- 172.21.15.135:0/3277138821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf214e10 0x55aebf2182e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc7727fc640 1 -- 172.21.15.135:0/3277138821 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aebf293b90 con 0x55aebf21e310 2024-04-20T12:29:44.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc7727fc640 1 --2- 172.21.15.135:0/3277138821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf21e310 0x55aebf218d60 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fc76800e010 tx=0x7fc768004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8854494289dd92c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc756ff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:44.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc756ff5640 1 -- 172.21.15.135:0/3277138821 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7680055d0 con 0x55aebf21e310 2024-04-20T12:29:44.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc756ff5640 1 -- 172.21.15.135:0/3277138821 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fc76801a630 con 0x55aebf21e310 2024-04-20T12:29:44.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc77c438740 1 -- 172.21.15.135:0/3277138821 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc768004d80 con 0x55aebf21e310 2024-04-20T12:29:44.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.138+0000 7fc756ff5640 1 -- 172.21.15.135:0/3277138821 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc76801a830 con 0x55aebf21e310 2024-04-20T12:29:44.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc77c438740 10 client.17649 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:44.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc77c438740 1 -- 172.21.15.135:0/3277138821 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55aebf294e50 con 0x55aebf21e310 2024-04-20T12:29:44.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc756ff5640 1 -- 172.21.15.135:0/3277138821 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc768004d80 con 0x55aebf21e310 2024-04-20T12:29:44.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc756ff5640 1 -- 172.21.15.135:0/3277138821 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc7680233f0 con 0x55aebf21e310 2024-04-20T12:29:44.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc77c438740 10 client.17649 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:44.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc77c438740 10 client.17649 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:29:44.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc77c438740 20 client.17649 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:44.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc77c438740 1 --2- 172.21.15.135:0/3277138821 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55aebf295550 0x55aebf297970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc77c438740 4 client.17649 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:29:44.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc77c438740 1 -- 172.21.15.135:0/3277138821 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aebf1819a0 con 0x55aebf295550 2024-04-20T12:29:44.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc772ffd640 1 --2- 172.21.15.135:0/3277138821 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55aebf295550 0x55aebf297970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc756ff5640 10 client.17649 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:29:44.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc772ffd640 1 --2- 172.21.15.135:0/3277138821 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55aebf295550 0x55aebf297970 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9dee90513ad1d99a server_cookie=51f0cae1676d6455 in_seq=0 out_seq=0 2024-04-20T12:29:44.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc756ff5640 1 -- 172.21.15.135:0/3277138821 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aebf1819a0 con 0x55aebf295550 2024-04-20T12:29:44.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc756ff5640 10 client.17649 handle_command_reply: tid=0 2024-04-20T12:29:44.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.139+0000 7fc77c438740 1 client.17649 shutdown 2024-04-20T12:29:44.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc77c438740 1 -- 172.21.15.135:0/3277138821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf21e310 msgr2=0x55aebf218d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc77c438740 1 --2- 172.21.15.135:0/3277138821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf21e310 0x55aebf218d60 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fc76800e010 tx=0x7fc768004f90 comp rx=0 tx=0).stop 2024-04-20T12:29:44.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc77c438740 1 -- 172.21.15.135:0/3277138821 shutdown_connections 2024-04-20T12:29:44.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc77c438740 1 --2- 172.21.15.135:0/3277138821 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55aebf295550 0x55aebf297970 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc77c438740 1 --2- 172.21.15.135:0/3277138821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55aebf21e310 0x55aebf218d60 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc77c438740 1 --2- 172.21.15.135:0/3277138821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55aebf215730 0x55aebf218820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc756ff5640 0 client.17649 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:29:44.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc77c438740 1 --2- 172.21.15.135:0/3277138821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55aebf214e10 0x55aebf2182e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc77c438740 1 -- 172.21.15.135:0/3277138821 >> 172.21.15.135:0/3277138821 conn(0x55aebf20f540 msgr2=0x55aebf21b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc77c438740 1 -- 172.21.15.135:0/3277138821 shutdown_connections 2024-04-20T12:29:44.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc77c438740 1 -- 172.21.15.135:0/3277138821 wait complete. 2024-04-20T12:29:44.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc77c438740 20 client.17649 trim_cache size 0 max 16384 2024-04-20T12:29:44.148 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:29:44.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc779767640 1 -- 172.21.15.135:0/167298861 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc75c0a3d20 msgr2=0x7fc75c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc779767640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc75c0a3d20 0x7fc75c0a61e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0be3e0 tx=0x7fc76c090f40 comp rx=0 tx=0).stop 2024-04-20T12:29:44.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc779767640 1 -- 172.21.15.135:0/167298861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc77419a0f0 msgr2=0x7fc7741a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc779767640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc77419a0f0 0x7fc7741a46a0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009230 tx=0x7fc76c02cba0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc779767640 1 -- 172.21.15.135:0/167298861 shutdown_connections 2024-04-20T12:29:44.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc779767640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc77419a0f0 0x7fc7741a46a0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc779767640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc75c0a3d20 0x7fc75c0a61e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc779767640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc774106160 0x7fc774199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc779767640 1 --2- 172.21.15.135:0/167298861 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc774101090 0x7fc774199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc779767640 1 -- 172.21.15.135:0/167298861 >> 172.21.15.135:0/167298861 conn(0x7fc774078010 msgr2=0x7fc7740fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc779767640 1 -- 172.21.15.135:0/167298861 shutdown_connections 2024-04-20T12:29:44.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.140+0000 7fc779767640 1 -- 172.21.15.135:0/167298861 wait complete. 2024-04-20T12:29:44.151 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:29:44.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.251+0000 7fce7555f640 1 -- 172.21.15.135:0/1545791451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce70101090 msgr2=0x7fce70101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.251+0000 7fce7555f640 1 --2- 172.21.15.135:0/1545791451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce70101090 0x7fce70101470 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fce60009ca0 tx=0x7fce6002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.251+0000 7fce7555f640 1 -- 172.21.15.135:0/1545791451 shutdown_connections 2024-04-20T12:29:44.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.251+0000 7fce7555f640 1 --2- 172.21.15.135:0/1545791451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce70106160 0x7fce7010dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.251+0000 7fce7555f640 1 --2- 172.21.15.135:0/1545791451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce70101a40 0x7fce70105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.251+0000 7fce7555f640 1 --2- 172.21.15.135:0/1545791451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce70101090 0x7fce70101470 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.251+0000 7fce7555f640 1 -- 172.21.15.135:0/1545791451 >> 172.21.15.135:0/1545791451 conn(0x7fce70078010 msgr2=0x7fce70078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.251+0000 7fce7555f640 1 -- 172.21.15.135:0/1545791451 shutdown_connections 2024-04-20T12:29:44.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.251+0000 7fce7555f640 1 -- 172.21.15.135:0/1545791451 wait complete. 2024-04-20T12:29:44.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.252+0000 7fce7555f640 1 Processor -- start 2024-04-20T12:29:44.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.252+0000 7fce7555f640 1 -- start start 2024-04-20T12:29:44.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.252+0000 7fce7555f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce70101090 0x7fce7019e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.252+0000 7fce7555f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce70106160 0x7fce7019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.252+0000 7fce7555f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce70198670 0x7fce70198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.252+0000 7fce7555f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce70111220 con 0x7fce70198670 2024-04-20T12:29:44.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.252+0000 7fce7555f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fce701110a0 con 0x7fce70101090 2024-04-20T12:29:44.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.252+0000 7fce7555f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce701113a0 con 0x7fce70106160 2024-04-20T12:29:44.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce6f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce70198670 0x7fce70198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce6f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce70198670 0x7fce70198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36192/0 (socket says 172.21.15.135:36192) 2024-04-20T12:29:44.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce6f7fe640 1 -- 172.21.15.135:0/1815806926 learned_addr learned my addr 172.21.15.135:0/1815806926 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce6effd640 1 --2- 172.21.15.135:0/1815806926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce70101090 0x7fce7019e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/1815806926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce70106160 0x7fce7019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce6f7fe640 1 -- 172.21.15.135:0/1815806926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce70106160 msgr2=0x7fce7019eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce6f7fe640 1 --2- 172.21.15.135:0/1815806926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce70106160 0x7fce7019eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce6f7fe640 1 -- 172.21.15.135:0/1815806926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce70101090 msgr2=0x7fce7019e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce6f7fe640 1 --2- 172.21.15.135:0/1815806926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce70101090 0x7fce7019e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce6f7fe640 1 -- 172.21.15.135:0/1815806926 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce70199270 con 0x7fce70198670 2024-04-20T12:29:44.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/1815806926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce70106160 0x7fce7019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:44.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce6f7fe640 1 --2- 172.21.15.135:0/1815806926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce70198670 0x7fce70198af0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fce6800c970 tx=0x7fce6800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce57fff640 1 -- 172.21.15.135:0/1815806926 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68007bb0 con 0x7fce70198670 2024-04-20T12:29:44.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce57fff640 1 -- 172.21.15.135:0/1815806926 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce68007d50 con 0x7fce70198670 2024-04-20T12:29:44.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce7555f640 1 -- 172.21.15.135:0/1815806926 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce701a5350 con 0x7fce70198670 2024-04-20T12:29:44.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce57fff640 1 -- 172.21.15.135:0/1815806926 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6800f450 con 0x7fce70198670 2024-04-20T12:29:44.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.253+0000 7fce7555f640 1 -- 172.21.15.135:0/1815806926 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce701a57b0 con 0x7fce70198670 2024-04-20T12:29:44.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.256+0000 7fce7822a740 1 Processor -- start 2024-04-20T12:29:44.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.256+0000 7fce57fff640 1 -- 172.21.15.135:0/1815806926 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fce68004f20 con 0x7fce70198670 2024-04-20T12:29:44.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.256+0000 7fce7822a740 1 -- start start 2024-04-20T12:29:44.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.256+0000 7fce7822a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82d1e10 0x5637d82d21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.256+0000 7fce7822a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d2730 0x5637d82dadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.256+0000 7fce7822a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82db310 0x5637d82dd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.256+0000 7fce7822a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5637d8237110 con 0x5637d82db310 2024-04-20T12:29:44.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.256+0000 7fce7822a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5637d81d4550 con 0x5637d82d1e10 2024-04-20T12:29:44.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.256+0000 7fce7822a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5637d82330d0 con 0x5637d82d2730 2024-04-20T12:29:44.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce6e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82db310 0x5637d82dd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce6e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82db310 0x5637d82dd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36194/0 (socket says 172.21.15.135:36194) 2024-04-20T12:29:44.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce6e7fc640 1 -- 172.21.15.135:0/775158907 learned_addr learned my addr 172.21.15.135:0/775158907 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce57fff640 1 --2- 172.21.15.135:0/1815806926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fce580a3da0 0x7fce580a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/775158907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82d1e10 0x5637d82d21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce6effd640 1 --2- 172.21.15.135:0/775158907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d2730 0x5637d82dadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce6f7fe640 1 --2- 172.21.15.135:0/1815806926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fce580a3da0 0x7fce580a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce6e7fc640 1 -- 172.21.15.135:0/775158907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d2730 msgr2=0x5637d82dadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/775158907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d2730 0x5637d82dadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce6e7fc640 1 -- 172.21.15.135:0/775158907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82d1e10 msgr2=0x5637d82d21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/775158907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82d1e10 0x5637d82d21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce6e7fc640 1 -- 172.21.15.135:0/775158907 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637d81fc900 con 0x5637d82db310 2024-04-20T12:29:44.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce57fff640 1 -- 172.21.15.135:0/1815806926 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fce680d07c0 con 0x7fce70198670 2024-04-20T12:29:44.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/775158907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82db310 0x5637d82dd700 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fce640148b0 tx=0x7fce6400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b2011e1407f6a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.264 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce557fa640 1 -- 172.21.15.135:0/775158907 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce640117e0 con 0x5637d82db310 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce6f7fe640 1 --2- 172.21.15.135:0/1815806926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fce580a3da0 0x7fce580a6260 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fce680cdc40 tx=0x7fce6801baf0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce557fa640 1 -- 172.21.15.135:0/775158907 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce64011e60 con 0x5637d82db310 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.257+0000 7fce557fa640 1 -- 172.21.15.135:0/775158907 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6400ed30 con 0x5637d82db310 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.258+0000 7fce7822a740 1 -- 172.21.15.135:0/775158907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82db310 msgr2=0x5637d82dd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.258+0000 7fce7822a740 1 --2- 172.21.15.135:0/775158907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82db310 0x5637d82dd700 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fce640148b0 tx=0x7fce6400bf90 comp rx=0 tx=0).stop 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.258+0000 7fce7822a740 1 -- 172.21.15.135:0/775158907 shutdown_connections 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.258+0000 7fce7822a740 1 --2- 172.21.15.135:0/775158907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82db310 0x5637d82dd700 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.258+0000 7fce7822a740 1 --2- 172.21.15.135:0/775158907 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d2730 0x5637d82dadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.258+0000 7fce7822a740 1 --2- 172.21.15.135:0/775158907 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82d1e10 0x5637d82d21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.258+0000 7fce7822a740 1 -- 172.21.15.135:0/775158907 >> 172.21.15.135:0/775158907 conn(0x5637d82cc540 msgr2=0x5637d82cc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.258+0000 7fce7822a740 1 -- 172.21.15.135:0/775158907 shutdown_connections 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.258+0000 7fce7822a740 1 -- 172.21.15.135:0/775158907 wait complete. 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.258+0000 7fce7822a740 1 -- start start 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.258+0000 7fce7822a740 1 Processor -- start 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce7822a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d1e10 0x5637d82d8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.265 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce7822a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d2730 0x5637d82d8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce7822a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82db310 0x5637d82d8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce7822a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5637d82de040 con 0x5637d82d2730 2024-04-20T12:29:44.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce7822a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5637d81f0500 con 0x5637d82db310 2024-04-20T12:29:44.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce7822a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5637d82de1c0 con 0x5637d82d1e10 2024-04-20T12:29:44.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce7822a740 10 client.0 _ll_register_callbacks cb 0x5637d81d52f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:44.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce6effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d2730 0x5637d82d8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce6effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d2730 0x5637d82d8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36208/0 (socket says 172.21.15.135:36208) 2024-04-20T12:29:44.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce6effd640 1 -- 172.21.15.135:0/257765858 learned_addr learned my addr 172.21.15.135:0/257765858 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.266 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/257765858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82db310 0x5637d82d8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/257765858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d1e10 0x5637d82d8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce6effd640 1 -- 172.21.15.135:0/257765858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d1e10 msgr2=0x5637d82d8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce6effd640 1 --2- 172.21.15.135:0/257765858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d1e10 0x5637d82d8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce6effd640 1 -- 172.21.15.135:0/257765858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82db310 msgr2=0x5637d82d8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce6effd640 1 --2- 172.21.15.135:0/257765858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82db310 0x5637d82d8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce6effd640 1 -- 172.21.15.135:0/257765858 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637d7f493f0 con 0x5637d82d2730 2024-04-20T12:29:44.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/257765858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d1e10 0x5637d82d8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:44.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce6effd640 1 --2- 172.21.15.135:0/257765858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d2730 0x5637d82d8950 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fce6002c630 tx=0x7fce6002cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9461a48a5b6ed348 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce52ff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:44.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce52ff5640 1 -- 172.21.15.135:0/257765858 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60044070 con 0x5637d82d2730 2024-04-20T12:29:44.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce52ff5640 1 -- 172.21.15.135:0/257765858 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fce60032790 con 0x5637d82d2730 2024-04-20T12:29:44.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce7822a740 1 -- 172.21.15.135:0/257765858 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce64011e60 con 0x5637d82d2730 2024-04-20T12:29:44.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.259+0000 7fce52ff5640 1 -- 172.21.15.135:0/257765858 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fce60050050 con 0x5637d82d2730 2024-04-20T12:29:44.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.260+0000 7fce7822a740 10 client.17661 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:44.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.260+0000 7fce7822a740 1 -- 172.21.15.135:0/257765858 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5637d80137d0 con 0x5637d82d2730 2024-04-20T12:29:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.260+0000 7fce52ff5640 1 -- 172.21.15.135:0/257765858 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce64011e60 con 0x5637d82d2730 2024-04-20T12:29:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.260+0000 7fce52ff5640 1 -- 172.21.15.135:0/257765858 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fce600043a0 con 0x5637d82d2730 2024-04-20T12:29:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.260+0000 7fce7822a740 10 client.17661 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.260+0000 7fce7822a740 10 client.17661 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:29:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.260+0000 7fce7822a740 20 client.17661 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.260+0000 7fce7822a740 1 --2- 172.21.15.135:0/257765858 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5637d82eb760 0x5637d82edb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.260+0000 7fce7822a740 4 client.17661 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.260+0000 7fce7822a740 1 -- 172.21.15.135:0/257765858 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637d8244b30 con 0x5637d82eb760 2024-04-20T12:29:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.260+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/257765858 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5637d82eb760 0x5637d82edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce52ff5640 10 client.17661 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:29:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/257765858 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5637d82eb760 0x5637d82edb80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a07681ed86c0c8f0 server_cookie=deff2e2a8a66cea9 in_seq=0 out_seq=0 2024-04-20T12:29:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce52ff5640 1 -- 172.21.15.135:0/257765858 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5637d8244b30 con 0x5637d82eb760 2024-04-20T12:29:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce52ff5640 10 client.17661 handle_command_reply: tid=0 2024-04-20T12:29:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce7822a740 1 client.17661 shutdown 2024-04-20T12:29:44.268 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce7822a740 1 -- 172.21.15.135:0/257765858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d2730 msgr2=0x5637d82d8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce7822a740 1 --2- 172.21.15.135:0/257765858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d2730 0x5637d82d8950 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fce6002c630 tx=0x7fce6002cd30 comp rx=0 tx=0).stop 2024-04-20T12:29:44.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce7822a740 1 -- 172.21.15.135:0/257765858 shutdown_connections 2024-04-20T12:29:44.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce7822a740 1 --2- 172.21.15.135:0/257765858 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5637d82eb760 0x5637d82edb80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce7822a740 1 --2- 172.21.15.135:0/257765858 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82db310 0x5637d82d8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce52ff5640 0 client.17661 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:29:44.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce7822a740 1 --2- 172.21.15.135:0/257765858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d2730 0x5637d82d8950 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce7822a740 1 --2- 172.21.15.135:0/257765858 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d1e10 0x5637d82d8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce7822a740 1 -- 172.21.15.135:0/257765858 >> 172.21.15.135:0/257765858 conn(0x5637d82cc540 msgr2=0x5637d82ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce7822a740 1 -- 172.21.15.135:0/257765858 shutdown_connections 2024-04-20T12:29:44.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.261+0000 7fce7822a740 1 -- 172.21.15.135:0/257765858 wait complete. 2024-04-20T12:29:44.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.262+0000 7fce7822a740 20 client.17661 trim_cache size 0 max 16384 2024-04-20T12:29:44.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce7822a740 1 Processor -- start 2024-04-20T12:29:44.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce7822a740 1 -- start start 2024-04-20T12:29:44.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce7822a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d1e10 0x5637d82e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce7822a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82d2730 0x5637d82c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce7822a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82db310 0x5637d82d8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce7822a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce701af460 con 0x5637d82d1e10 2024-04-20T12:29:44.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce7822a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fce701b0fa0 con 0x5637d82d2730 2024-04-20T12:29:44.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce7822a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce701afb30 con 0x5637d82db310 2024-04-20T12:29:44.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce6e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d1e10 0x5637d82e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce6e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d1e10 0x5637d82e6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36224/0 (socket says 172.21.15.135:36224) 2024-04-20T12:29:44.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce6e7fc640 1 -- 172.21.15.135:0/777603823 learned_addr learned my addr 172.21.15.135:0/777603823 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce6e7fc640 1 -- 172.21.15.135:0/777603823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82db310 msgr2=0x5637d82d8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/777603823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82db310 0x5637d82d8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce6e7fc640 1 -- 172.21.15.135:0/777603823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82d2730 msgr2=0x5637d82c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/777603823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82d2730 0x5637d82c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce6e7fc640 1 -- 172.21.15.135:0/777603823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637d82d6960 con 0x5637d82d1e10 2024-04-20T12:29:44.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/777603823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d1e10 0x5637d82e6fc0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fce6400b6d0 tx=0x7fce6400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1caaf221c5fca9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce54ff9640 1 -- 172.21.15.135:0/777603823 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6402d070 con 0x5637d82d1e10 2024-04-20T12:29:44.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce54ff9640 1 -- 172.21.15.135:0/777603823 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce64028dd0 con 0x5637d82d1e10 2024-04-20T12:29:44.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.275+0000 7fce54ff9640 1 -- 172.21.15.135:0/777603823 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce64028350 con 0x5637d82d1e10 2024-04-20T12:29:44.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 -- 172.21.15.135:0/777603823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d1e10 msgr2=0x5637d82e6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 --2- 172.21.15.135:0/777603823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d1e10 0x5637d82e6fc0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fce6400b6d0 tx=0x7fce6400b700 comp rx=0 tx=0).stop 2024-04-20T12:29:44.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 -- 172.21.15.135:0/777603823 shutdown_connections 2024-04-20T12:29:44.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 --2- 172.21.15.135:0/777603823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82db310 0x5637d82d8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 --2- 172.21.15.135:0/777603823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82d2730 0x5637d82c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 --2- 172.21.15.135:0/777603823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d1e10 0x5637d82e6fc0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 -- 172.21.15.135:0/777603823 >> 172.21.15.135:0/777603823 conn(0x5637d82cc540 msgr2=0x5637d82cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 -- 172.21.15.135:0/777603823 shutdown_connections 2024-04-20T12:29:44.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 -- 172.21.15.135:0/777603823 wait complete. 2024-04-20T12:29:44.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 -- start start 2024-04-20T12:29:44.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 Processor -- start 2024-04-20T12:29:44.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d1e10 0x5637d82e3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d2730 0x5637d82e0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82db310 0x5637d82e0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce701b08d0 con 0x5637d82d1e10 2024-04-20T12:29:44.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fce701b0200 con 0x5637d82db310 2024-04-20T12:29:44.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.276+0000 7fce7822a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce701ad430 con 0x5637d82d2730 2024-04-20T12:29:44.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce7822a740 10 client.0 _ll_register_callbacks cb 0x7fce60009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce6e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d1e10 0x5637d82e3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce6e7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d1e10 0x5637d82e3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36238/0 (socket says 172.21.15.135:36238) 2024-04-20T12:29:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce6e7fc640 1 -- 172.21.15.135:0/3617162741 learned_addr learned my addr 172.21.15.135:0/3617162741 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce6effd640 1 --2- 172.21.15.135:0/3617162741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d2730 0x5637d82e0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/3617162741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82db310 0x5637d82e0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce6e7fc640 1 -- 172.21.15.135:0/3617162741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d2730 msgr2=0x5637d82e0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/3617162741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d2730 0x5637d82e0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce6e7fc640 1 -- 172.21.15.135:0/3617162741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82db310 msgr2=0x5637d82e0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/3617162741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82db310 0x5637d82e0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce6e7fc640 1 -- 172.21.15.135:0/3617162741 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637d82e1380 con 0x5637d82d1e10 2024-04-20T12:29:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce6e7fc640 1 --2- 172.21.15.135:0/3617162741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d1e10 0x5637d82e3570 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fce64005c80 tx=0x7fce64014420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceabb7911c95a765 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce52ff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce52ff5640 1 -- 172.21.15.135:0/3617162741 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6402d040 con 0x5637d82d1e10 2024-04-20T12:29:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce7822a740 1 -- 172.21.15.135:0/3617162741 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce64028dd0 con 0x5637d82d1e10 2024-04-20T12:29:44.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce52ff5640 1 -- 172.21.15.135:0/3617162741 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fce6400e670 con 0x5637d82d1e10 2024-04-20T12:29:44.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce52ff5640 1 -- 172.21.15.135:0/3617162741 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fce6403c050 con 0x5637d82d1e10 2024-04-20T12:29:44.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce7822a740 10 client.17667 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:44.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce7822a740 1 -- 172.21.15.135:0/3617162741 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5637d83519b0 con 0x5637d82d1e10 2024-04-20T12:29:44.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.277+0000 7fce52ff5640 1 -- 172.21.15.135:0/3617162741 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce64028dd0 con 0x5637d82d1e10 2024-04-20T12:29:44.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.278+0000 7fce52ff5640 1 -- 172.21.15.135:0/3617162741 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fce64028030 con 0x5637d82d1e10 2024-04-20T12:29:44.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.278+0000 7fce7822a740 10 client.17667 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:44.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.278+0000 7fce7822a740 10 client.17667 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:29:44.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.278+0000 7fce7822a740 20 client.17667 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:44.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.278+0000 7fce7822a740 1 --2- 172.21.15.135:0/3617162741 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5637d8351ea0 0x5637d83542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.278+0000 7fce7822a740 4 client.17667 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:29:44.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.278+0000 7fce7822a740 1 -- 172.21.15.135:0/3617162741 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5637d823e9a0 con 0x5637d8351ea0 2024-04-20T12:29:44.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.278+0000 7fce6effd640 1 --2- 172.21.15.135:0/3617162741 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5637d8351ea0 0x5637d83542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.278+0000 7fce52ff5640 10 client.17667 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:29:44.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.278+0000 7fce6effd640 1 --2- 172.21.15.135:0/3617162741 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5637d8351ea0 0x5637d83542c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=72f40bbe1c8f5d14 server_cookie=45b3d7cf2d70341 in_seq=0 out_seq=0 2024-04-20T12:29:44.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.278+0000 7fce52ff5640 1 -- 172.21.15.135:0/3617162741 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5637d823e9a0 con 0x5637d8351ea0 2024-04-20T12:29:44.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.278+0000 7fce52ff5640 10 client.17667 handle_command_reply: tid=0 2024-04-20T12:29:44.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.278+0000 7fce7822a740 1 client.17667 shutdown 2024-04-20T12:29:44.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7822a740 1 -- 172.21.15.135:0/3617162741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d1e10 msgr2=0x5637d82e3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7822a740 1 --2- 172.21.15.135:0/3617162741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d1e10 0x5637d82e3570 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fce64005c80 tx=0x7fce64014420 comp rx=0 tx=0).stop 2024-04-20T12:29:44.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7822a740 1 -- 172.21.15.135:0/3617162741 shutdown_connections 2024-04-20T12:29:44.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7822a740 1 --2- 172.21.15.135:0/3617162741 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5637d8351ea0 0x5637d83542c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7822a740 1 --2- 172.21.15.135:0/3617162741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5637d82db310 0x5637d82e0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7822a740 1 --2- 172.21.15.135:0/3617162741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5637d82d2730 0x5637d82e0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7822a740 1 --2- 172.21.15.135:0/3617162741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5637d82d1e10 0x5637d82e3570 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce52ff5640 0 client.17667 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:29:44.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7822a740 1 -- 172.21.15.135:0/3617162741 >> 172.21.15.135:0/3617162741 conn(0x5637d82cc540 msgr2=0x5637d82cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7822a740 1 -- 172.21.15.135:0/3617162741 shutdown_connections 2024-04-20T12:29:44.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7822a740 1 -- 172.21.15.135:0/3617162741 wait complete. 2024-04-20T12:29:44.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7822a740 20 client.17667 trim_cache size 0 max 16384 2024-04-20T12:29:44.286 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:29:44.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7555f640 1 -- 172.21.15.135:0/1815806926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fce580a3da0 msgr2=0x7fce580a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7555f640 1 --2- 172.21.15.135:0/1815806926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fce580a3da0 0x7fce580a6260 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fce680cdc40 tx=0x7fce6801baf0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7555f640 1 -- 172.21.15.135:0/1815806926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce70198670 msgr2=0x7fce70198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7555f640 1 --2- 172.21.15.135:0/1815806926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce70198670 0x7fce70198af0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fce6800c970 tx=0x7fce6800ce30 comp rx=0 tx=0).stop 2024-04-20T12:29:44.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7555f640 1 -- 172.21.15.135:0/1815806926 shutdown_connections 2024-04-20T12:29:44.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7555f640 1 --2- 172.21.15.135:0/1815806926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce70198670 0x7fce70198af0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7555f640 1 --2- 172.21.15.135:0/1815806926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fce580a3da0 0x7fce580a6260 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7555f640 1 --2- 172.21.15.135:0/1815806926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce70106160 0x7fce7019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7555f640 1 --2- 172.21.15.135:0/1815806926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce70101090 0x7fce7019e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7555f640 1 -- 172.21.15.135:0/1815806926 >> 172.21.15.135:0/1815806926 conn(0x7fce70078010 msgr2=0x7fce700694a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7555f640 1 -- 172.21.15.135:0/1815806926 shutdown_connections 2024-04-20T12:29:44.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.279+0000 7fce7555f640 1 -- 172.21.15.135:0/1815806926 wait complete. 2024-04-20T12:29:44.290 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:29:44.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.390+0000 7f9d6c081640 1 -- 172.21.15.135:0/1120624203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101fe0 msgr2=0x7f9d6410dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.390+0000 7f9d6c081640 1 --2- 172.21.15.135:0/1120624203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101fe0 0x7f9d6410dd00 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009ca0 tx=0x7f9d5c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.390+0000 7f9d6c081640 1 -- 172.21.15.135:0/1120624203 shutdown_connections 2024-04-20T12:29:44.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.390+0000 7f9d6c081640 1 --2- 172.21.15.135:0/1120624203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101fe0 0x7f9d6410dd00 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.390+0000 7f9d6c081640 1 --2- 172.21.15.135:0/1120624203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d64101620 0x7f9d64101aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.390+0000 7f9d6c081640 1 --2- 172.21.15.135:0/1120624203 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d64105e70 0x7f9d64106250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.390+0000 7f9d6c081640 1 -- 172.21.15.135:0/1120624203 >> 172.21.15.135:0/1120624203 conn(0x7f9d64077370 msgr2=0x7f9d640fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.390+0000 7f9d6c081640 1 -- 172.21.15.135:0/1120624203 shutdown_connections 2024-04-20T12:29:44.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.390+0000 7f9d6c081640 1 -- 172.21.15.135:0/1120624203 wait complete. 2024-04-20T12:29:44.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d6c081640 1 Processor -- start 2024-04-20T12:29:44.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d6c081640 1 -- start start 2024-04-20T12:29:44.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d6c081640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101620 0x7f9d6410e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d6c081640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d64101fe0 0x7f9d6410ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d6c081640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d64105e70 0x7f9d6410f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d6c081640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d64112350 con 0x7f9d64101620 2024-04-20T12:29:44.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d6c081640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d641121d0 con 0x7f9d64105e70 2024-04-20T12:29:44.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d6c081640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d641124d0 con 0x7f9d64101fe0 2024-04-20T12:29:44.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d69e1d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101620 0x7f9d6410e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d69e1d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101620 0x7f9d6410e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36264/0 (socket says 172.21.15.135:36264) 2024-04-20T12:29:44.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d69e1d640 1 -- 172.21.15.135:0/2505940386 learned_addr learned my addr 172.21.15.135:0/2505940386 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d6961c640 1 --2- 172.21.15.135:0/2505940386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d64101fe0 0x7f9d6410ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d6a61e640 1 --2- 172.21.15.135:0/2505940386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d64105e70 0x7f9d6410f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d69e1d640 1 -- 172.21.15.135:0/2505940386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d64101fe0 msgr2=0x7f9d6410ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d69e1d640 1 --2- 172.21.15.135:0/2505940386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d64101fe0 0x7f9d6410ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d69e1d640 1 -- 172.21.15.135:0/2505940386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d64105e70 msgr2=0x7f9d6410f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.391+0000 7f9d69e1d640 1 --2- 172.21.15.135:0/2505940386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d64105e70 0x7f9d6410f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.392+0000 7f9d69e1d640 1 -- 172.21.15.135:0/2505940386 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d641a6b90 con 0x7f9d64101620 2024-04-20T12:29:44.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.392+0000 7f9d6a61e640 1 --2- 172.21.15.135:0/2505940386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d64105e70 0x7f9d6410f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:44.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.392+0000 7f9d69e1d640 1 --2- 172.21.15.135:0/2505940386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101620 0x7f9d6410e790 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000c920 tx=0x7f9d6000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.392+0000 7f9d5affd640 1 -- 172.21.15.135:0/2505940386 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60007c70 con 0x7f9d64101620 2024-04-20T12:29:44.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.392+0000 7f9d5affd640 1 -- 172.21.15.135:0/2505940386 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d60007e10 con 0x7f9d64101620 2024-04-20T12:29:44.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.392+0000 7f9d6c081640 1 -- 172.21.15.135:0/2505940386 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d641a6e80 con 0x7f9d64101620 2024-04-20T12:29:44.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.392+0000 7f9d5affd640 1 -- 172.21.15.135:0/2505940386 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60018890 con 0x7f9d64101620 2024-04-20T12:29:44.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.392+0000 7f9d6c081640 1 -- 172.21.15.135:0/2505940386 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d641a7340 con 0x7f9d64101620 2024-04-20T12:29:44.402 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.394+0000 7f9d5affd640 1 -- 172.21.15.135:0/2505940386 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f9d60018a70 con 0x7f9d64101620 2024-04-20T12:29:44.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.394+0000 7f9d6ec77740 1 Processor -- start 2024-04-20T12:29:44.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.394+0000 7f9d6ec77740 1 -- start start 2024-04-20T12:29:44.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6ec77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d1111f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.403 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6ec77740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d119dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6ec77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d11a310 0x55602d11c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6ec77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55602d076110 con 0x55602d110e10 2024-04-20T12:29:44.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6ec77740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55602d013550 con 0x55602d111730 2024-04-20T12:29:44.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6ec77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55602d0720d0 con 0x55602d11a310 2024-04-20T12:29:44.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6a61e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d1111f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6a61e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d1111f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36270/0 (socket says 172.21.15.135:36270) 2024-04-20T12:29:44.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6a61e640 1 -- 172.21.15.135:0/2028452967 learned_addr learned my addr 172.21.15.135:0/2028452967 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d5affd640 1 --2- 172.21.15.135:0/2505940386 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9d500a3d20 0x7f9d500a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6a61e640 1 --2- 172.21.15.135:0/2505940386 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9d500a3d20 0x7f9d500a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d69e1d640 1 --2- 172.21.15.135:0/2028452967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d119dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6a61e640 1 -- 172.21.15.135:0/2028452967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d11a310 msgr2=0x55602d11c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.404 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d5affd640 1 -- 172.21.15.135:0/2505940386 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9d600d0cf0 con 0x7f9d64101620 2024-04-20T12:29:44.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6961c640 1 --2- 172.21.15.135:0/2028452967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d11a310 0x55602d11c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6a61e640 1 --2- 172.21.15.135:0/2028452967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d11a310 0x55602d11c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6a61e640 1 -- 172.21.15.135:0/2028452967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 msgr2=0x55602d119dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6a61e640 1 --2- 172.21.15.135:0/2028452967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d119dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6a61e640 1 -- 172.21.15.135:0/2028452967 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55602d03b900 con 0x55602d110e10 2024-04-20T12:29:44.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d69e1d640 1 --2- 172.21.15.135:0/2028452967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d119dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:44.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.395+0000 7f9d6a61e640 1 --2- 172.21.15.135:0/2028452967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d1111f0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c037040 tx=0x7f9d5c032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2e1b1471300418 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.396+0000 7f9d4ffff640 1 -- 172.21.15.135:0/2028452967 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c004040 con 0x55602d110e10 2024-04-20T12:29:44.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.396+0000 7f9d4ffff640 1 -- 172.21.15.135:0/2028452967 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d5c032d70 con 0x55602d110e10 2024-04-20T12:29:44.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.396+0000 7f9d4ffff640 1 -- 172.21.15.135:0/2028452967 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c039070 con 0x55602d110e10 2024-04-20T12:29:44.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.396+0000 7f9d6ec77740 1 -- 172.21.15.135:0/2028452967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 msgr2=0x55602d1111f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.396+0000 7f9d6a61e640 1 --2- 172.21.15.135:0/2505940386 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9d500a3d20 0x7f9d500a61e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c04c000 tx=0x7f9d5c048000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.396+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/2028452967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d1111f0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c037040 tx=0x7f9d5c032fc0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.405 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.396+0000 7f9d6ec77740 1 -- 172.21.15.135:0/2028452967 shutdown_connections 2024-04-20T12:29:44.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.396+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/2028452967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d11a310 0x55602d11c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.396+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/2028452967 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d119dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.396+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/2028452967 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d1111f0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.396+0000 7f9d6ec77740 1 -- 172.21.15.135:0/2028452967 >> 172.21.15.135:0/2028452967 conn(0x55602d10b540 msgr2=0x55602d10b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.396+0000 7f9d6ec77740 1 -- 172.21.15.135:0/2028452967 shutdown_connections 2024-04-20T12:29:44.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.397+0000 7f9d6ec77740 1 -- 172.21.15.135:0/2028452967 wait complete. 2024-04-20T12:29:44.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.397+0000 7f9d6ec77740 1 -- start start 2024-04-20T12:29:44.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.397+0000 7f9d6ec77740 1 Processor -- start 2024-04-20T12:29:44.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.397+0000 7f9d6ec77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d1173b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.406 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.397+0000 7f9d6ec77740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d1178f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.397+0000 7f9d6ec77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d11a310 0x55602d117e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.397+0000 7f9d6ec77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55602d11d0a0 con 0x55602d110e10 2024-04-20T12:29:44.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.397+0000 7f9d6ec77740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55602d02f500 con 0x55602d111730 2024-04-20T12:29:44.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.397+0000 7f9d6ec77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55602d11d220 con 0x55602d11a310 2024-04-20T12:29:44.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.397+0000 7f9d6ec77740 10 client.0 _ll_register_callbacks cb 0x55602d0142f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:44.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.397+0000 7f9d69e1d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d1173b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.407 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.397+0000 7f9d69e1d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d1173b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36280/0 (socket says 172.21.15.135:36280) 2024-04-20T12:29:44.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.397+0000 7f9d69e1d640 1 -- 172.21.15.135:0/542249579 learned_addr learned my addr 172.21.15.135:0/542249579 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d6a61e640 1 --2- 172.21.15.135:0/542249579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d11a310 0x55602d117e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d6961c640 1 --2- 172.21.15.135:0/542249579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d1178f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d69e1d640 1 -- 172.21.15.135:0/542249579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d11a310 msgr2=0x55602d117e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d69e1d640 1 --2- 172.21.15.135:0/542249579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d11a310 0x55602d117e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d69e1d640 1 -- 172.21.15.135:0/542249579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 msgr2=0x55602d1178f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d69e1d640 1 --2- 172.21.15.135:0/542249579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d1178f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d69e1d640 1 -- 172.21.15.135:0/542249579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55602cd883f0 con 0x55602d110e10 2024-04-20T12:29:44.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d6961c640 1 --2- 172.21.15.135:0/542249579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d1178f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:44.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d69e1d640 1 --2- 172.21.15.135:0/542249579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d1173b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f9d600ce120 tx=0x7f9d60015aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59bc22133611041 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:44.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d4d7fa640 1 -- 172.21.15.135:0/542249579 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d600d2070 con 0x55602d110e10 2024-04-20T12:29:44.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d4d7fa640 1 -- 172.21.15.135:0/542249579 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9d6001dd40 con 0x55602d110e10 2024-04-20T12:29:44.408 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d6ec77740 1 -- 172.21.15.135:0/542249579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55602d083b30 con 0x55602d110e10 2024-04-20T12:29:44.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d4d7fa640 1 -- 172.21.15.135:0/542249579 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9d6009d010 con 0x55602d110e10 2024-04-20T12:29:44.409 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d6ec77740 10 client.17679 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:44.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d6ec77740 1 -- 172.21.15.135:0/542249579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55602ce527d0 con 0x55602d110e10 2024-04-20T12:29:44.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d4d7fa640 1 -- 172.21.15.135:0/542249579 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55602d083b30 con 0x55602d110e10 2024-04-20T12:29:44.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d4d7fa640 1 -- 172.21.15.135:0/542249579 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f9d600ce340 con 0x55602d110e10 2024-04-20T12:29:44.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d6ec77740 10 client.17679 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:44.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d6ec77740 10 client.17679 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:29:44.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d6ec77740 20 client.17679 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:44.410 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/542249579 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55602d12a690 0x55602d12cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d6ec77740 4 client.17679 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:44.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.398+0000 7f9d6ec77740 1 -- 172.21.15.135:0/542249579 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55602d07d9a0 con 0x55602d12a690 2024-04-20T12:29:44.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.399+0000 7f9d6961c640 1 --2- 172.21.15.135:0/542249579 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55602d12a690 0x55602d12cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.399+0000 7f9d6961c640 1 --2- 172.21.15.135:0/542249579 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55602d12a690 0x55602d12cb50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bc8af63a1c2deb00 server_cookie=a534143ae76a7f0e in_seq=0 out_seq=0 2024-04-20T12:29:44.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.399+0000 7f9d4d7fa640 10 client.17679 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:29:44.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.400+0000 7f9d4d7fa640 1 -- 172.21.15.135:0/542249579 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55602d07d9a0 con 0x55602d12a690 2024-04-20T12:29:44.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.400+0000 7f9d4d7fa640 10 client.17679 handle_command_reply: tid=0 2024-04-20T12:29:44.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.400+0000 7f9d6ec77740 1 client.17679 shutdown 2024-04-20T12:29:44.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.400+0000 7f9d6ec77740 1 -- 172.21.15.135:0/542249579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 msgr2=0x55602d1173b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.400+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/542249579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d1173b0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f9d600ce120 tx=0x7f9d60015aa0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.400+0000 7f9d6ec77740 1 -- 172.21.15.135:0/542249579 shutdown_connections 2024-04-20T12:29:44.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.400+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/542249579 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55602d12a690 0x55602d12cb50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.400+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/542249579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d11a310 0x55602d117e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.400+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/542249579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d1178f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.400+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/542249579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d1173b0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.400+0000 7f9d4d7fa640 0 client.17679 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:29:44.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.400+0000 7f9d6ec77740 1 -- 172.21.15.135:0/542249579 >> 172.21.15.135:0/542249579 conn(0x55602d10b540 msgr2=0x55602d10d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.400+0000 7f9d6ec77740 1 -- 172.21.15.135:0/542249579 shutdown_connections 2024-04-20T12:29:44.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.400+0000 7f9d6ec77740 1 -- 172.21.15.135:0/542249579 wait complete. 2024-04-20T12:29:44.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.400+0000 7f9d6ec77740 20 client.17679 trim_cache size 0 max 16384 2024-04-20T12:29:44.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.413+0000 7f9d6ec77740 1 Processor -- start 2024-04-20T12:29:44.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.413+0000 7f9d6ec77740 1 -- start start 2024-04-20T12:29:44.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.413+0000 7f9d6ec77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d10d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.413+0000 7f9d6ec77740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d132420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.413+0000 7f9d6ec77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d11a310 0x55602d132960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.413+0000 7f9d6ec77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d641b1470 con 0x55602d110e10 2024-04-20T12:29:44.420 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.413+0000 7f9d6ec77740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d641b2fb0 con 0x55602d111730 2024-04-20T12:29:44.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.413+0000 7f9d6ec77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d641b1b40 con 0x55602d11a310 2024-04-20T12:29:44.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.413+0000 7f9d69e1d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.414+0000 7f9d69e1d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d10d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36288/0 (socket says 172.21.15.135:36288) 2024-04-20T12:29:44.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.414+0000 7f9d69e1d640 1 -- 172.21.15.135:0/4108394200 learned_addr learned my addr 172.21.15.135:0/4108394200 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.421 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.414+0000 7f9d6a61e640 1 --2- 172.21.15.135:0/4108394200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d11a310 0x55602d132960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.414+0000 7f9d6961c640 1 --2- 172.21.15.135:0/4108394200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d132420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.414+0000 7f9d69e1d640 1 -- 172.21.15.135:0/4108394200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d11a310 msgr2=0x55602d132960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.414+0000 7f9d69e1d640 1 --2- 172.21.15.135:0/4108394200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d11a310 0x55602d132960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.414+0000 7f9d69e1d640 1 -- 172.21.15.135:0/4108394200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 msgr2=0x55602d132420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.414+0000 7f9d69e1d640 1 --2- 172.21.15.135:0/4108394200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d132420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.422 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.414+0000 7f9d69e1d640 1 -- 172.21.15.135:0/4108394200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55602d106be0 con 0x55602d110e10 2024-04-20T12:29:44.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.414+0000 7f9d69e1d640 1 --2- 172.21.15.135:0/4108394200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d10d080 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f9d600ce170 tx=0x7f9d6009c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb61e0894045c37 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.414+0000 7f9d4f7fe640 1 -- 172.21.15.135:0/4108394200 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60014210 con 0x55602d110e10 2024-04-20T12:29:44.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.414+0000 7f9d4f7fe640 1 -- 172.21.15.135:0/4108394200 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d60085e50 con 0x55602d110e10 2024-04-20T12:29:44.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.414+0000 7f9d4f7fe640 1 -- 172.21.15.135:0/4108394200 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d600a50f0 con 0x55602d110e10 2024-04-20T12:29:44.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 -- 172.21.15.135:0/4108394200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 msgr2=0x55602d10d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/4108394200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d10d080 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f9d600ce170 tx=0x7f9d6009c700 comp rx=0 tx=0).stop 2024-04-20T12:29:44.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 -- 172.21.15.135:0/4108394200 shutdown_connections 2024-04-20T12:29:44.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/4108394200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d11a310 0x55602d132960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/4108394200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d132420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/4108394200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d110e10 0x55602d10d080 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 -- 172.21.15.135:0/4108394200 >> 172.21.15.135:0/4108394200 conn(0x55602d10b540 msgr2=0x55602d10c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 -- 172.21.15.135:0/4108394200 shutdown_connections 2024-04-20T12:29:44.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 -- 172.21.15.135:0/4108394200 wait complete. 2024-04-20T12:29:44.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 -- start start 2024-04-20T12:29:44.423 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 Processor -- start 2024-04-20T12:29:44.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d110e10 0x55602d11e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d11e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d11a310 0x55602d11eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d641b28e0 con 0x55602d11a310 2024-04-20T12:29:44.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d641b2210 con 0x55602d111730 2024-04-20T12:29:44.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d641af440 con 0x55602d110e10 2024-04-20T12:29:44.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6ec77740 10 client.0 _ll_register_callbacks cb 0x7f9d600076c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:44.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.415+0000 7f9d6a61e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d11a310 0x55602d11eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d6a61e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d11a310 0x55602d11eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36300/0 (socket says 172.21.15.135:36300) 2024-04-20T12:29:44.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d6a61e640 1 -- 172.21.15.135:0/4093036249 learned_addr learned my addr 172.21.15.135:0/4093036249 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d6961c640 1 --2- 172.21.15.135:0/4093036249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d11e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d69e1d640 1 --2- 172.21.15.135:0/4093036249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d110e10 0x55602d11e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d6a61e640 1 -- 172.21.15.135:0/4093036249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d110e10 msgr2=0x55602d11e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d6a61e640 1 --2- 172.21.15.135:0/4093036249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d110e10 0x55602d11e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d6a61e640 1 -- 172.21.15.135:0/4093036249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 msgr2=0x55602d11e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d6a61e640 1 --2- 172.21.15.135:0/4093036249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d11e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d6a61e640 1 -- 172.21.15.135:0/4093036249 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55602d18fdc0 con 0x55602d11a310 2024-04-20T12:29:44.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d6a61e640 1 --2- 172.21.15.135:0/4093036249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d11a310 0x55602d11eaa0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c003f70 tx=0x7f9d5c0324d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb306c9b23cc84a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:44.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d4d7fa640 1 -- 172.21.15.135:0/4093036249 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c039040 con 0x55602d11a310 2024-04-20T12:29:44.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d4d7fa640 1 -- 172.21.15.135:0/4093036249 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f9d5c052040 con 0x55602d11a310 2024-04-20T12:29:44.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d6ec77740 1 -- 172.21.15.135:0/4093036249 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d60085e50 con 0x55602d11a310 2024-04-20T12:29:44.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d4d7fa640 1 -- 172.21.15.135:0/4093036249 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9d5c064050 con 0x55602d11a310 2024-04-20T12:29:44.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d6ec77740 10 client.17685 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:44.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d6ec77740 1 -- 172.21.15.135:0/4093036249 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55602d1910a0 con 0x55602d11a310 2024-04-20T12:29:44.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.416+0000 7f9d4d7fa640 1 -- 172.21.15.135:0/4093036249 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d60085e50 con 0x55602d11a310 2024-04-20T12:29:44.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.417+0000 7f9d4d7fa640 1 -- 172.21.15.135:0/4093036249 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f9d5c056070 con 0x55602d11a310 2024-04-20T12:29:44.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.417+0000 7f9d6ec77740 10 client.17685 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:44.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.417+0000 7f9d6ec77740 10 client.17685 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:29:44.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.417+0000 7f9d6ec77740 20 client.17685 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:44.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.417+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/4093036249 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55602d1913a0 0x55602d1937c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.417+0000 7f9d6ec77740 4 client.17685 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:29:44.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.417+0000 7f9d6ec77740 1 -- 172.21.15.135:0/4093036249 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55602cff96e0 con 0x55602d1913a0 2024-04-20T12:29:44.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.417+0000 7f9d69e1d640 1 --2- 172.21.15.135:0/4093036249 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55602d1913a0 0x55602d1937c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.417+0000 7f9d4d7fa640 10 client.17685 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:29:44.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.417+0000 7f9d69e1d640 1 --2- 172.21.15.135:0/4093036249 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55602d1913a0 0x55602d1937c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=66af4db56371c6e4 server_cookie=70e54ac3778b630f in_seq=0 out_seq=0 2024-04-20T12:29:44.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.417+0000 7f9d4d7fa640 1 -- 172.21.15.135:0/4093036249 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55602cff96e0 con 0x55602d1913a0 2024-04-20T12:29:44.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.417+0000 7f9d4d7fa640 10 client.17685 handle_command_reply: tid=0 2024-04-20T12:29:44.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.417+0000 7f9d6ec77740 1 client.17685 shutdown 2024-04-20T12:29:44.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6ec77740 1 -- 172.21.15.135:0/4093036249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d11a310 msgr2=0x55602d11eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/4093036249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d11a310 0x55602d11eaa0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c003f70 tx=0x7f9d5c0324d0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6ec77740 1 -- 172.21.15.135:0/4093036249 shutdown_connections 2024-04-20T12:29:44.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/4093036249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55602d11a310 0x55602d11eaa0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/4093036249 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55602d111730 0x55602d11e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/4093036249 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55602d1913a0 0x55602d1937c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6ec77740 1 --2- 172.21.15.135:0/4093036249 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55602d110e10 0x55602d11e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d4d7fa640 0 client.17685 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:29:44.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6ec77740 1 -- 172.21.15.135:0/4093036249 >> 172.21.15.135:0/4093036249 conn(0x55602d10b540 msgr2=0x55602d10d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6ec77740 1 -- 172.21.15.135:0/4093036249 shutdown_connections 2024-04-20T12:29:44.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6ec77740 1 -- 172.21.15.135:0/4093036249 wait complete. 2024-04-20T12:29:44.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6ec77740 20 client.17685 trim_cache size 0 max 16384 2024-04-20T12:29:44.428 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:29:44.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6c081640 1 -- 172.21.15.135:0/2505940386 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9d500a3d20 msgr2=0x7f9d500a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6c081640 1 --2- 172.21.15.135:0/2505940386 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9d500a3d20 0x7f9d500a61e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c04c000 tx=0x7f9d5c048000 comp rx=0 tx=0).stop 2024-04-20T12:29:44.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6c081640 1 -- 172.21.15.135:0/2505940386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101620 msgr2=0x7f9d6410e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6c081640 1 --2- 172.21.15.135:0/2505940386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101620 0x7f9d6410e790 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000c920 tx=0x7f9d6000cde0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6c081640 1 -- 172.21.15.135:0/2505940386 shutdown_connections 2024-04-20T12:29:44.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6c081640 1 --2- 172.21.15.135:0/2505940386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d64105e70 0x7f9d6410f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6c081640 1 --2- 172.21.15.135:0/2505940386 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9d500a3d20 0x7f9d500a61e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6c081640 1 --2- 172.21.15.135:0/2505940386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d64101fe0 0x7f9d6410ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6c081640 1 --2- 172.21.15.135:0/2505940386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d64101620 0x7f9d6410e790 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6c081640 1 -- 172.21.15.135:0/2505940386 >> 172.21.15.135:0/2505940386 conn(0x7f9d64077370 msgr2=0x7f9d64103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6c081640 1 -- 172.21.15.135:0/2505940386 shutdown_connections 2024-04-20T12:29:44.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.418+0000 7f9d6c081640 1 -- 172.21.15.135:0/2505940386 wait complete. 2024-04-20T12:29:44.431 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:29:44.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.532+0000 7f7911504640 1 -- 172.21.15.135:0/3804081225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790c107280 msgr2=0x7f790c10ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.532+0000 7f7911504640 1 --2- 172.21.15.135:0/3804081225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790c107280 0x7f790c10ee50 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7904009ca0 tx=0x7f790402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.532+0000 7f7911504640 1 -- 172.21.15.135:0/3804081225 shutdown_connections 2024-04-20T12:29:44.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.532+0000 7f7911504640 1 --2- 172.21.15.135:0/3804081225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790c107280 0x7f790c10ee50 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.532+0000 7f7911504640 1 --2- 172.21.15.135:0/3804081225 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f790c102b60 0x7f790c106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.532+0000 7f7911504640 1 --2- 172.21.15.135:0/3804081225 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f790c1021b0 0x7f790c102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.532+0000 7f7911504640 1 -- 172.21.15.135:0/3804081225 >> 172.21.15.135:0/3804081225 conn(0x7f790c0793f0 msgr2=0x7f790c079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.532+0000 7f7911504640 1 -- 172.21.15.135:0/3804081225 shutdown_connections 2024-04-20T12:29:44.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.532+0000 7f7911504640 1 -- 172.21.15.135:0/3804081225 wait complete. 2024-04-20T12:29:44.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f7911504640 1 Processor -- start 2024-04-20T12:29:44.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f7911504640 1 -- start start 2024-04-20T12:29:44.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f7911504640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f790c1021b0 0x7f790c19e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f7911504640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790c107280 0x7f790c19e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f7911504640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f790c198600 0x7f790c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f7911504640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f790c112340 con 0x7f790c107280 2024-04-20T12:29:44.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f7911504640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f790c1121c0 con 0x7f790c1021b0 2024-04-20T12:29:44.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f7911504640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f790c1124c0 con 0x7f790c198600 2024-04-20T12:29:44.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f790a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790c107280 0x7f790c19e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f790a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790c107280 0x7f790c19e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36318/0 (socket says 172.21.15.135:36318) 2024-04-20T12:29:44.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f790a7fc640 1 -- 172.21.15.135:0/726111156 learned_addr learned my addr 172.21.15.135:0/726111156 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f790b7fe640 1 --2- 172.21.15.135:0/726111156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f790c198600 0x7f790c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f790affd640 1 --2- 172.21.15.135:0/726111156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f790c1021b0 0x7f790c19e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f790a7fc640 1 -- 172.21.15.135:0/726111156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f790c198600 msgr2=0x7f790c198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f790a7fc640 1 --2- 172.21.15.135:0/726111156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f790c198600 0x7f790c198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f790a7fc640 1 -- 172.21.15.135:0/726111156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f790c1021b0 msgr2=0x7f790c19e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f790a7fc640 1 --2- 172.21.15.135:0/726111156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f790c1021b0 0x7f790c19e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.533+0000 7f790a7fc640 1 -- 172.21.15.135:0/726111156 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c199120 con 0x7f790c107280 2024-04-20T12:29:44.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.534+0000 7f790a7fc640 1 --2- 172.21.15.135:0/726111156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790c107280 0x7f790c19e990 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00e9c0 tx=0x7f78fc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.534+0000 7f78f3fff640 1 -- 172.21.15.135:0/726111156 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc00cd80 con 0x7f790c107280 2024-04-20T12:29:44.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.534+0000 7f7911504640 1 -- 172.21.15.135:0/726111156 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790c199410 con 0x7f790c107280 2024-04-20T12:29:44.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.534+0000 7f78f3fff640 1 -- 172.21.15.135:0/726111156 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78fc005500 con 0x7f790c107280 2024-04-20T12:29:44.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.534+0000 7f78f3fff640 1 -- 172.21.15.135:0/726111156 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc010690 con 0x7f790c107280 2024-04-20T12:29:44.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.534+0000 7f7911504640 1 -- 172.21.15.135:0/726111156 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790c1a56b0 con 0x7f790c107280 2024-04-20T12:29:44.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.536+0000 7f79141d5740 1 Processor -- start 2024-04-20T12:29:44.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.536+0000 7f78f3fff640 1 -- 172.21.15.135:0/726111156 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f78fc0046c0 con 0x7f790c107280 2024-04-20T12:29:44.543 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.536+0000 7f79141d5740 1 -- start start 2024-04-20T12:29:44.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.536+0000 7f79141d5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db54be10 0x5571db54c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.536+0000 7f79141d5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54c730 0x5571db554dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.536+0000 7f79141d5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db555310 0x5571db557700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.536+0000 7f79141d5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5571db4b1110 con 0x5571db54c730 2024-04-20T12:29:44.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.536+0000 7f79141d5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5571db44e550 con 0x5571db54be10 2024-04-20T12:29:44.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.536+0000 7f79141d5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5571db4ad0d0 con 0x5571db555310 2024-04-20T12:29:44.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.536+0000 7f790affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54c730 0x5571db554dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f790affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54c730 0x5571db554dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36334/0 (socket says 172.21.15.135:36334) 2024-04-20T12:29:44.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f790affd640 1 -- 172.21.15.135:0/3083681879 learned_addr learned my addr 172.21.15.135:0/3083681879 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f790b7fe640 1 --2- 172.21.15.135:0/3083681879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db54be10 0x5571db54c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f790a7fc640 1 --2- 172.21.15.135:0/3083681879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db555310 0x5571db557700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f78f3fff640 1 --2- 172.21.15.135:0/726111156 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78f40a3d20 0x7f78f40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f790affd640 1 -- 172.21.15.135:0/3083681879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db555310 msgr2=0x5571db557700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.544 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f790affd640 1 --2- 172.21.15.135:0/3083681879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db555310 0x5571db557700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f790affd640 1 -- 172.21.15.135:0/3083681879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db54be10 msgr2=0x5571db54c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f790affd640 1 --2- 172.21.15.135:0/3083681879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db54be10 0x5571db54c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f790affd640 1 -- 172.21.15.135:0/3083681879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571db476900 con 0x5571db54c730 2024-04-20T12:29:44.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f790a7fc640 1 --2- 172.21.15.135:0/3083681879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db555310 0x5571db557700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:44.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f790b7fe640 1 --2- 172.21.15.135:0/726111156 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78f40a3d20 0x7f78f40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f78f3fff640 1 -- 172.21.15.135:0/726111156 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f78fc0d0f20 con 0x7f790c107280 2024-04-20T12:29:44.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f790affd640 1 --2- 172.21.15.135:0/3083681879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54c730 0x5571db554dd0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f7900009c90 tx=0x7f79000117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea07a2a98e7c2e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f78f17fa640 1 -- 172.21.15.135:0/3083681879 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900012450 con 0x5571db54c730 2024-04-20T12:29:44.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f78f17fa640 1 -- 172.21.15.135:0/3083681879 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7900012ad0 con 0x5571db54c730 2024-04-20T12:29:44.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.537+0000 7f78f17fa640 1 -- 172.21.15.135:0/3083681879 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790000fc30 con 0x5571db54c730 2024-04-20T12:29:44.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.538+0000 7f79141d5740 1 -- 172.21.15.135:0/3083681879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54c730 msgr2=0x5571db554dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.538+0000 7f790b7fe640 1 --2- 172.21.15.135:0/726111156 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78f40a3d20 0x7f78f40a61e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7904004af0 tx=0x7f790402e040 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.538+0000 7f79141d5740 1 --2- 172.21.15.135:0/3083681879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54c730 0x5571db554dd0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f7900009c90 tx=0x7f79000117b0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.545 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.538+0000 7f79141d5740 1 -- 172.21.15.135:0/3083681879 shutdown_connections 2024-04-20T12:29:44.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.538+0000 7f79141d5740 1 --2- 172.21.15.135:0/3083681879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db555310 0x5571db557700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.538+0000 7f79141d5740 1 --2- 172.21.15.135:0/3083681879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54c730 0x5571db554dd0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.538+0000 7f79141d5740 1 --2- 172.21.15.135:0/3083681879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db54be10 0x5571db54c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.538+0000 7f79141d5740 1 -- 172.21.15.135:0/3083681879 >> 172.21.15.135:0/3083681879 conn(0x5571db546540 msgr2=0x5571db546920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.538+0000 7f79141d5740 1 -- 172.21.15.135:0/3083681879 shutdown_connections 2024-04-20T12:29:44.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.538+0000 7f79141d5740 1 -- 172.21.15.135:0/3083681879 wait complete. 2024-04-20T12:29:44.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.538+0000 7f79141d5740 1 -- start start 2024-04-20T12:29:44.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.538+0000 7f79141d5740 1 Processor -- start 2024-04-20T12:29:44.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f79141d5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54be10 0x5571db5522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f79141d5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db54c730 0x5571db552810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f79141d5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db555310 0x5571db552d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f79141d5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5571db558040 con 0x5571db54be10 2024-04-20T12:29:44.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f79141d5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5571db46a500 con 0x5571db54c730 2024-04-20T12:29:44.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f79141d5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5571db5581c0 con 0x5571db555310 2024-04-20T12:29:44.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f79141d5740 10 client.0 _ll_register_callbacks cb 0x5571db44f2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:44.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f790affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54be10 0x5571db5522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f790affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54be10 0x5571db5522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36342/0 (socket says 172.21.15.135:36342) 2024-04-20T12:29:44.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f790affd640 1 -- 172.21.15.135:0/322779583 learned_addr learned my addr 172.21.15.135:0/322779583 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f790a7fc640 1 --2- 172.21.15.135:0/322779583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db54c730 0x5571db552810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f790affd640 1 -- 172.21.15.135:0/322779583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db555310 msgr2=0x5571db552d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f790affd640 1 --2- 172.21.15.135:0/322779583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db555310 0x5571db552d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f790affd640 1 -- 172.21.15.135:0/322779583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db54c730 msgr2=0x5571db552810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f790affd640 1 --2- 172.21.15.135:0/322779583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db54c730 0x5571db552810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f790affd640 1 -- 172.21.15.135:0/322779583 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571db1c33f0 con 0x5571db54be10 2024-04-20T12:29:44.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f790affd640 1 --2- 172.21.15.135:0/322779583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54be10 0x5571db5522d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f790000fa90 tx=0x7f790000fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea316e58fe027d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f78eeff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:44.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f78eeff5640 1 -- 172.21.15.135:0/322779583 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7900029020 con 0x5571db54be10 2024-04-20T12:29:44.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f78eeff5640 1 -- 172.21.15.135:0/322779583 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f7900009d80 con 0x5571db54be10 2024-04-20T12:29:44.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f79141d5740 1 -- 172.21.15.135:0/322779583 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7900012ad0 con 0x5571db54be10 2024-04-20T12:29:44.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f78eeff5640 1 -- 172.21.15.135:0/322779583 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7900034050 con 0x5571db54be10 2024-04-20T12:29:44.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f79141d5740 10 client.17697 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:44.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.539+0000 7f79141d5740 1 -- 172.21.15.135:0/322779583 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5571db28d7d0 con 0x5571db54be10 2024-04-20T12:29:44.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.540+0000 7f78eeff5640 1 -- 172.21.15.135:0/322779583 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7900012ad0 con 0x5571db54be10 2024-04-20T12:29:44.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.540+0000 7f78eeff5640 1 -- 172.21.15.135:0/322779583 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f7900004680 con 0x5571db54be10 2024-04-20T12:29:44.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.540+0000 7f79141d5740 10 client.17697 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:44.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.540+0000 7f79141d5740 10 client.17697 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:29:44.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.540+0000 7f79141d5740 20 client.17697 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:44.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.540+0000 7f79141d5740 1 --2- 172.21.15.135:0/322779583 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5571db5655d0 0x5571db5679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.540+0000 7f79141d5740 4 client.17697 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:44.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.540+0000 7f79141d5740 1 -- 172.21.15.135:0/322779583 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571db4beb30 con 0x5571db5655d0 2024-04-20T12:29:44.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.540+0000 7f790a7fc640 1 --2- 172.21.15.135:0/322779583 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5571db5655d0 0x5571db5679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.540+0000 7f78eeff5640 10 client.17697 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:29:44.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.540+0000 7f790a7fc640 1 --2- 172.21.15.135:0/322779583 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5571db5655d0 0x5571db5679c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=699b0ae85d67d547 server_cookie=e13c9a489e7b6ba1 in_seq=0 out_seq=0 2024-04-20T12:29:44.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.541+0000 7f78eeff5640 1 -- 172.21.15.135:0/322779583 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5571db4beb30 con 0x5571db5655d0 2024-04-20T12:29:44.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.541+0000 7f78eeff5640 10 client.17697 handle_command_reply: tid=0 2024-04-20T12:29:44.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.541+0000 7f79141d5740 1 client.17697 shutdown 2024-04-20T12:29:44.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.541+0000 7f79141d5740 1 -- 172.21.15.135:0/322779583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54be10 msgr2=0x5571db5522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.541+0000 7f79141d5740 1 --2- 172.21.15.135:0/322779583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54be10 0x5571db5522d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f790000fa90 tx=0x7f790000fac0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.541+0000 7f79141d5740 1 -- 172.21.15.135:0/322779583 shutdown_connections 2024-04-20T12:29:44.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.541+0000 7f79141d5740 1 --2- 172.21.15.135:0/322779583 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5571db5655d0 0x5571db5679c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.541+0000 7f79141d5740 1 --2- 172.21.15.135:0/322779583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db555310 0x5571db552d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.541+0000 7f79141d5740 1 --2- 172.21.15.135:0/322779583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db54c730 0x5571db552810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.541+0000 7f78eeff5640 0 client.17697 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:29:44.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.541+0000 7f79141d5740 1 --2- 172.21.15.135:0/322779583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54be10 0x5571db5522d0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.541+0000 7f79141d5740 1 -- 172.21.15.135:0/322779583 >> 172.21.15.135:0/322779583 conn(0x5571db546540 msgr2=0x5571db548290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.541+0000 7f79141d5740 1 -- 172.21.15.135:0/322779583 shutdown_connections 2024-04-20T12:29:44.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.541+0000 7f79141d5740 1 -- 172.21.15.135:0/322779583 wait complete. 2024-04-20T12:29:44.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.541+0000 7f79141d5740 20 client.17697 trim_cache size 0 max 16384 2024-04-20T12:29:44.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.554+0000 7f79141d5740 1 Processor -- start 2024-04-20T12:29:44.560 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f79141d5740 1 -- start start 2024-04-20T12:29:44.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f79141d5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db54be10 0x5571db554a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f79141d5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db54c730 0x5571db560fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f79141d5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db555310 0x5571db541570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f79141d5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f790c1af400 con 0x5571db555310 2024-04-20T12:29:44.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f79141d5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f790c1b0f40 con 0x5571db54c730 2024-04-20T12:29:44.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f79141d5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f790c1afad0 con 0x5571db54be10 2024-04-20T12:29:44.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f790b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db555310 0x5571db541570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f790b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db555310 0x5571db541570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36358/0 (socket says 172.21.15.135:36358) 2024-04-20T12:29:44.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f790b7fe640 1 -- 172.21.15.135:0/2265784558 learned_addr learned my addr 172.21.15.135:0/2265784558 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f790a7fc640 1 --2- 172.21.15.135:0/2265784558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db54c730 0x5571db560fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f790affd640 1 --2- 172.21.15.135:0/2265784558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db54be10 0x5571db554a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.561 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f790b7fe640 1 -- 172.21.15.135:0/2265784558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db54be10 msgr2=0x5571db554a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f790b7fe640 1 --2- 172.21.15.135:0/2265784558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db54be10 0x5571db554a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f790b7fe640 1 -- 172.21.15.135:0/2265784558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db54c730 msgr2=0x5571db560fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f790b7fe640 1 --2- 172.21.15.135:0/2265784558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db54c730 0x5571db560fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f790b7fe640 1 -- 172.21.15.135:0/2265784558 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571db546370 con 0x5571db555310 2024-04-20T12:29:44.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f790affd640 1 --2- 172.21.15.135:0/2265784558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db54be10 0x5571db554a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:44.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f790b7fe640 1 --2- 172.21.15.135:0/2265784558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db555310 0x5571db541570 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7904036000 tx=0x7f790402c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47636bc202e2bbe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f78f0ff9640 1 -- 172.21.15.135:0/2265784558 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7904039040 con 0x5571db555310 2024-04-20T12:29:44.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f78f0ff9640 1 -- 172.21.15.135:0/2265784558 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7904052070 con 0x5571db555310 2024-04-20T12:29:44.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.555+0000 7f78f0ff9640 1 -- 172.21.15.135:0/2265784558 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7904004710 con 0x5571db555310 2024-04-20T12:29:44.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.556+0000 7f79141d5740 1 -- 172.21.15.135:0/2265784558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db555310 msgr2=0x5571db541570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.562 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.556+0000 7f79141d5740 1 --2- 172.21.15.135:0/2265784558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db555310 0x5571db541570 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f7904036000 tx=0x7f790402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.556+0000 7f79141d5740 1 -- 172.21.15.135:0/2265784558 shutdown_connections 2024-04-20T12:29:44.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.556+0000 7f79141d5740 1 --2- 172.21.15.135:0/2265784558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db555310 0x5571db541570 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.556+0000 7f79141d5740 1 --2- 172.21.15.135:0/2265784558 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db54c730 0x5571db560fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.556+0000 7f79141d5740 1 --2- 172.21.15.135:0/2265784558 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db54be10 0x5571db554a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.556+0000 7f79141d5740 1 -- 172.21.15.135:0/2265784558 >> 172.21.15.135:0/2265784558 conn(0x5571db546540 msgr2=0x5571db551430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.556+0000 7f79141d5740 1 -- 172.21.15.135:0/2265784558 shutdown_connections 2024-04-20T12:29:44.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.556+0000 7f79141d5740 1 -- 172.21.15.135:0/2265784558 wait complete. 2024-04-20T12:29:44.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.556+0000 7f79141d5740 1 -- start start 2024-04-20T12:29:44.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.556+0000 7f79141d5740 1 Processor -- start 2024-04-20T12:29:44.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f79141d5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db54be10 0x5571db55d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.563 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f79141d5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54c730 0x5571db55da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f79141d5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db555310 0x5571db558c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f79141d5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f790c1b0870 con 0x5571db54c730 2024-04-20T12:29:44.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f79141d5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f790c1b01a0 con 0x5571db555310 2024-04-20T12:29:44.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f79141d5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f790c1ad3d0 con 0x5571db54be10 2024-04-20T12:29:44.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f79141d5740 10 client.0 _ll_register_callbacks cb 0x7f78fc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:44.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f790a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54c730 0x5571db55da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f790a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54c730 0x5571db55da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36362/0 (socket says 172.21.15.135:36362) 2024-04-20T12:29:44.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f790a7fc640 1 -- 172.21.15.135:0/3517666528 learned_addr learned my addr 172.21.15.135:0/3517666528 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f790b7fe640 1 --2- 172.21.15.135:0/3517666528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db555310 0x5571db558c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f790affd640 1 --2- 172.21.15.135:0/3517666528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db54be10 0x5571db55d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f790a7fc640 1 -- 172.21.15.135:0/3517666528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db54be10 msgr2=0x5571db55d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.564 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f790a7fc640 1 --2- 172.21.15.135:0/3517666528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db54be10 0x5571db55d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f790a7fc640 1 -- 172.21.15.135:0/3517666528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db555310 msgr2=0x5571db558c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f790a7fc640 1 --2- 172.21.15.135:0/3517666528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db555310 0x5571db558c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f790a7fc640 1 -- 172.21.15.135:0/3517666528 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571db559490 con 0x5571db54c730 2024-04-20T12:29:44.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f790a7fc640 1 --2- 172.21.15.135:0/3517666528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54c730 0x5571db55da60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f78fc09cad0 tx=0x7f78fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563c023f22804243 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f78eeff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:44.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f78eeff5640 1 -- 172.21.15.135:0/3517666528 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc0b5070 con 0x5571db54c730 2024-04-20T12:29:44.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f78eeff5640 1 -- 172.21.15.135:0/3517666528 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f78fc0ce570 con 0x5571db54c730 2024-04-20T12:29:44.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f79141d5740 1 -- 172.21.15.135:0/3517666528 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7904052070 con 0x5571db54c730 2024-04-20T12:29:44.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f78eeff5640 1 -- 172.21.15.135:0/3517666528 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f78fc09d240 con 0x5571db54c730 2024-04-20T12:29:44.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f79141d5740 10 client.17703 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:44.565 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.557+0000 7f79141d5740 1 -- 172.21.15.135:0/3517666528 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5571db5cb5e0 con 0x5571db54c730 2024-04-20T12:29:44.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.558+0000 7f78eeff5640 1 -- 172.21.15.135:0/3517666528 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7904052070 con 0x5571db54c730 2024-04-20T12:29:44.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.558+0000 7f78eeff5640 1 -- 172.21.15.135:0/3517666528 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f78fc0a5320 con 0x5571db54c730 2024-04-20T12:29:44.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.558+0000 7f79141d5740 10 client.17703 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:44.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.558+0000 7f79141d5740 10 client.17703 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:29:44.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.558+0000 7f79141d5740 20 client.17703 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:44.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.558+0000 7f79141d5740 1 --2- 172.21.15.135:0/3517666528 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5571db5cbd30 0x5571db5ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.558+0000 7f79141d5740 4 client.17703 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:29:44.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.558+0000 7f79141d5740 1 -- 172.21.15.135:0/3517666528 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5571db4b89a0 con 0x5571db5cbd30 2024-04-20T12:29:44.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.558+0000 7f790affd640 1 --2- 172.21.15.135:0/3517666528 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5571db5cbd30 0x5571db5ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.558+0000 7f78eeff5640 10 client.17703 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:29:44.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.558+0000 7f790affd640 1 --2- 172.21.15.135:0/3517666528 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5571db5cbd30 0x5571db5ce150 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9434c2dbd6f94b29 server_cookie=cad814beb516db1f in_seq=0 out_seq=0 2024-04-20T12:29:44.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f78eeff5640 1 -- 172.21.15.135:0/3517666528 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5571db4b89a0 con 0x5571db5cbd30 2024-04-20T12:29:44.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f78eeff5640 10 client.17703 handle_command_reply: tid=0 2024-04-20T12:29:44.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f79141d5740 1 client.17703 shutdown 2024-04-20T12:29:44.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f79141d5740 1 -- 172.21.15.135:0/3517666528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54c730 msgr2=0x5571db55da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f79141d5740 1 --2- 172.21.15.135:0/3517666528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54c730 0x5571db55da60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f78fc09cad0 tx=0x7f78fc005880 comp rx=0 tx=0).stop 2024-04-20T12:29:44.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f79141d5740 1 -- 172.21.15.135:0/3517666528 shutdown_connections 2024-04-20T12:29:44.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f79141d5740 1 --2- 172.21.15.135:0/3517666528 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x5571db5cbd30 0x5571db5ce150 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f79141d5740 1 --2- 172.21.15.135:0/3517666528 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5571db555310 0x5571db558c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f78eeff5640 0 client.17703 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:29:44.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f79141d5740 1 --2- 172.21.15.135:0/3517666528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571db54c730 0x5571db55da60 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f79141d5740 1 --2- 172.21.15.135:0/3517666528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5571db54be10 0x5571db55d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f79141d5740 1 -- 172.21.15.135:0/3517666528 >> 172.21.15.135:0/3517666528 conn(0x5571db546540 msgr2=0x5571db551430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f79141d5740 1 -- 172.21.15.135:0/3517666528 shutdown_connections 2024-04-20T12:29:44.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f79141d5740 1 -- 172.21.15.135:0/3517666528 wait complete. 2024-04-20T12:29:44.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f79141d5740 20 client.17703 trim_cache size 0 max 16384 2024-04-20T12:29:44.568 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:29:44.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f7911504640 1 -- 172.21.15.135:0/726111156 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78f40a3d20 msgr2=0x7f78f40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f7911504640 1 --2- 172.21.15.135:0/726111156 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78f40a3d20 0x7f78f40a61e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7904004af0 tx=0x7f790402e040 comp rx=0 tx=0).stop 2024-04-20T12:29:44.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f7911504640 1 -- 172.21.15.135:0/726111156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790c107280 msgr2=0x7f790c19e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f7911504640 1 --2- 172.21.15.135:0/726111156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790c107280 0x7f790c19e990 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00e9c0 tx=0x7f78fc00ee80 comp rx=0 tx=0).stop 2024-04-20T12:29:44.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f7911504640 1 -- 172.21.15.135:0/726111156 shutdown_connections 2024-04-20T12:29:44.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f7911504640 1 --2- 172.21.15.135:0/726111156 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78f40a3d20 0x7f78f40a61e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f7911504640 1 --2- 172.21.15.135:0/726111156 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f790c198600 0x7f790c198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f7911504640 1 --2- 172.21.15.135:0/726111156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f790c107280 0x7f790c19e990 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f7911504640 1 --2- 172.21.15.135:0/726111156 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f790c1021b0 0x7f790c19e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.559+0000 7f7911504640 1 -- 172.21.15.135:0/726111156 >> 172.21.15.135:0/726111156 conn(0x7f790c0793f0 msgr2=0x7f790c0ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.560+0000 7f7911504640 1 -- 172.21.15.135:0/726111156 shutdown_connections 2024-04-20T12:29:44.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.560+0000 7f7911504640 1 -- 172.21.15.135:0/726111156 wait complete. 2024-04-20T12:29:44.571 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:29:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.671+0000 7f6c6ba5b640 1 -- 172.21.15.135:0/1745905085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c641021b0 msgr2=0x7f6c64102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.671+0000 7f6c6ba5b640 1 --2- 172.21.15.135:0/1745905085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c641021b0 0x7f6c64102590 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009900 tx=0x7f6c6002bc30 comp rx=0 tx=0).stop 2024-04-20T12:29:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.671+0000 7f6c6ba5b640 1 -- 172.21.15.135:0/1745905085 shutdown_connections 2024-04-20T12:29:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.671+0000 7f6c6ba5b640 1 --2- 172.21.15.135:0/1745905085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c64107280 0x7f6c6410ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.671+0000 7f6c6ba5b640 1 --2- 172.21.15.135:0/1745905085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c64102b60 0x7f6c64106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.671+0000 7f6c6ba5b640 1 --2- 172.21.15.135:0/1745905085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c641021b0 0x7f6c64102590 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.671+0000 7f6c6ba5b640 1 -- 172.21.15.135:0/1745905085 >> 172.21.15.135:0/1745905085 conn(0x7f6c640793f0 msgr2=0x7f6c64079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.671+0000 7f6c6ba5b640 1 -- 172.21.15.135:0/1745905085 shutdown_connections 2024-04-20T12:29:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.671+0000 7f6c6ba5b640 1 -- 172.21.15.135:0/1745905085 wait complete. 2024-04-20T12:29:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c6ba5b640 1 Processor -- start 2024-04-20T12:29:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c6ba5b640 1 -- start start 2024-04-20T12:29:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c6ba5b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c641021b0 0x7f6c6419e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c6ba5b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c64107280 0x7f6c6419ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c6ba5b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c64198650 0x7f6c64198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c6ba5b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6c64112330 con 0x7f6c64107280 2024-04-20T12:29:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c6ba5b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641121b0 con 0x7f6c641021b0 2024-04-20T12:29:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c6ba5b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641124b0 con 0x7f6c64198650 2024-04-20T12:29:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c68ff6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c64107280 0x7f6c6419ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c68ff6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c64107280 0x7f6c6419ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36372/0 (socket says 172.21.15.135:36372) 2024-04-20T12:29:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c68ff6640 1 -- 172.21.15.135:0/3639764380 learned_addr learned my addr 172.21.15.135:0/3639764380 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c69ff8640 1 --2- 172.21.15.135:0/3639764380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c64198650 0x7f6c64198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c697f7640 1 --2- 172.21.15.135:0/3639764380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c641021b0 0x7f6c6419e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c68ff6640 1 -- 172.21.15.135:0/3639764380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c64198650 msgr2=0x7f6c64198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c68ff6640 1 --2- 172.21.15.135:0/3639764380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c64198650 0x7f6c64198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c68ff6640 1 -- 172.21.15.135:0/3639764380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c641021b0 msgr2=0x7f6c6419e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c68ff6640 1 --2- 172.21.15.135:0/3639764380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c641021b0 0x7f6c6419e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.672+0000 7f6c68ff6640 1 -- 172.21.15.135:0/3639764380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c64199250 con 0x7f6c64107280 2024-04-20T12:29:44.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.673+0000 7f6c68ff6640 1 --2- 172.21.15.135:0/3639764380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c64107280 0x7f6c6419ead0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400e9f0 tx=0x7f6c5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.673+0000 7f6c5a7fc640 1 -- 172.21.15.135:0/3639764380 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5400ccc0 con 0x7f6c64107280 2024-04-20T12:29:44.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.673+0000 7f6c5a7fc640 1 -- 172.21.15.135:0/3639764380 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c54005500 con 0x7f6c64107280 2024-04-20T12:29:44.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.673+0000 7f6c6ba5b640 1 -- 172.21.15.135:0/3639764380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c641a5330 con 0x7f6c64107280 2024-04-20T12:29:44.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.673+0000 7f6c5a7fc640 1 -- 172.21.15.135:0/3639764380 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54010690 con 0x7f6c64107280 2024-04-20T12:29:44.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.673+0000 7f6c6ba5b640 1 -- 172.21.15.135:0/3639764380 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c641a56e0 con 0x7f6c64107280 2024-04-20T12:29:44.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.675+0000 7f6c5a7fc640 1 -- 172.21.15.135:0/3639764380 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f6c540046c0 con 0x7f6c64107280 2024-04-20T12:29:44.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.675+0000 7f6c6e645740 1 Processor -- start 2024-04-20T12:29:44.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.675+0000 7f6c6e645740 1 -- start start 2024-04-20T12:29:44.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c6e645740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470ae9aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c6e645740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 0x56470aea81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c6e645740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 0x56470aeaab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c6e645740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56470ae00110 con 0x56470ae9aac0 2024-04-20T12:29:44.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c6e645740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56470ad9d550 con 0x56470ae9b3e0 2024-04-20T12:29:44.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c6e645740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56470adfc0d0 con 0x56470aea8720 2024-04-20T12:29:44.682 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c5a7fc640 1 --2- 172.21.15.135:0/3639764380 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c500a3d20 0x7f6c500a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c69ff8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470ae9aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c69ff8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470ae9aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36386/0 (socket says 172.21.15.135:36386) 2024-04-20T12:29:44.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c697f7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 0x56470aea81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c69ff8640 1 -- 172.21.15.135:0/2380776636 learned_addr learned my addr 172.21.15.135:0/2380776636 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c5a7fc640 1 -- 172.21.15.135:0/3639764380 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f6c540d0f70 con 0x7f6c64107280 2024-04-20T12:29:44.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c68ff6640 1 --2- 172.21.15.135:0/2380776636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 0x56470aeaab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c69ff8640 1 --2- 172.21.15.135:0/3639764380 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c500a3d20 0x7f6c500a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c69ff8640 1 -- 172.21.15.135:0/2380776636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 msgr2=0x56470aeaab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c69ff8640 1 --2- 172.21.15.135:0/2380776636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 0x56470aeaab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c69ff8640 1 -- 172.21.15.135:0/2380776636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 msgr2=0x56470aea81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c69ff8640 1 --2- 172.21.15.135:0/2380776636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 0x56470aea81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c69ff8640 1 -- 172.21.15.135:0/2380776636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56470adc5900 con 0x56470ae9aac0 2024-04-20T12:29:44.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c697f7640 1 --2- 172.21.15.135:0/2380776636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 0x56470aea81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:29:44.683 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c68ff6640 1 --2- 172.21.15.135:0/2380776636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 0x56470aeaab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:29:44.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c69ff8640 1 --2- 172.21.15.135:0/2380776636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470ae9aea0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0129f0 tx=0x7f6c5c012eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc8215d30ef4b56 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c69ff8640 1 --2- 172.21.15.135:0/3639764380 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c500a3d20 0x7f6c500a61e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c01c000 tx=0x7f6c5c01e000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.676+0000 7f6c4f7fe640 1 -- 172.21.15.135:0/2380776636 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c004d20 con 0x56470ae9aac0 2024-04-20T12:29:44.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.677+0000 7f6c4f7fe640 1 -- 172.21.15.135:0/2380776636 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c5c021030 con 0x56470ae9aac0 2024-04-20T12:29:44.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.677+0000 7f6c4f7fe640 1 -- 172.21.15.135:0/2380776636 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c005690 con 0x56470ae9aac0 2024-04-20T12:29:44.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.677+0000 7f6c6e645740 1 -- 172.21.15.135:0/2380776636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 msgr2=0x56470ae9aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.677+0000 7f6c6e645740 1 --2- 172.21.15.135:0/2380776636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470ae9aea0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0129f0 tx=0x7f6c5c012eb0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.677+0000 7f6c6e645740 1 -- 172.21.15.135:0/2380776636 shutdown_connections 2024-04-20T12:29:44.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.677+0000 7f6c6e645740 1 --2- 172.21.15.135:0/2380776636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 0x56470aeaab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.677+0000 7f6c6e645740 1 --2- 172.21.15.135:0/2380776636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 0x56470aea81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.677+0000 7f6c6e645740 1 --2- 172.21.15.135:0/2380776636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470ae9aea0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.677+0000 7f6c6e645740 1 -- 172.21.15.135:0/2380776636 >> 172.21.15.135:0/2380776636 conn(0x56470ae95540 msgr2=0x56470ae95920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.677+0000 7f6c6e645740 1 -- 172.21.15.135:0/2380776636 shutdown_connections 2024-04-20T12:29:44.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.677+0000 7f6c6e645740 1 -- 172.21.15.135:0/2380776636 wait complete. 2024-04-20T12:29:44.684 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.678+0000 7f6c6e645740 1 -- start start 2024-04-20T12:29:44.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.678+0000 7f6c6e645740 1 Processor -- start 2024-04-20T12:29:44.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.678+0000 7f6c6e645740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aea5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.678+0000 7f6c6e645740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 0x56470aea5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.678+0000 7f6c6e645740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 0x56470aea6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.678+0000 7f6c6e645740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56470aeab500 con 0x56470ae9aac0 2024-04-20T12:29:44.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.678+0000 7f6c6e645740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56470adb9500 con 0x56470ae9b3e0 2024-04-20T12:29:44.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.678+0000 7f6c6e645740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56470aeab680 con 0x56470aea8720 2024-04-20T12:29:44.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.678+0000 7f6c6e645740 10 client.0 _ll_register_callbacks cb 0x56470ad9e2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:44.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.678+0000 7f6c697f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aea5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.678+0000 7f6c697f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aea5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36390/0 (socket says 172.21.15.135:36390) 2024-04-20T12:29:44.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.678+0000 7f6c697f7640 1 -- 172.21.15.135:0/3833489197 learned_addr learned my addr 172.21.15.135:0/3833489197 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.678+0000 7f6c68ff6640 1 --2- 172.21.15.135:0/3833489197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 0x56470aea5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.678+0000 7f6c69ff8640 1 --2- 172.21.15.135:0/3833489197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 0x56470aea6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c697f7640 1 -- 172.21.15.135:0/3833489197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 msgr2=0x56470aea6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.685 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c697f7640 1 --2- 172.21.15.135:0/3833489197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 0x56470aea6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c697f7640 1 -- 172.21.15.135:0/3833489197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 msgr2=0x56470aea5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c697f7640 1 --2- 172.21.15.135:0/3833489197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 0x56470aea5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c697f7640 1 -- 172.21.15.135:0/3833489197 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56470ab123f0 con 0x56470ae9aac0 2024-04-20T12:29:44.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c697f7640 1 --2- 172.21.15.135:0/3833489197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aea5780 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f6c6002cfd0 tx=0x7f6c60009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff560896d55ff55 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c4cff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:44.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c4cff9640 1 -- 172.21.15.135:0/3833489197 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60004450 con 0x56470ae9aac0 2024-04-20T12:29:44.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c6e645740 1 -- 172.21.15.135:0/3833489197 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c5c021030 con 0x56470ae9aac0 2024-04-20T12:29:44.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c4cff9640 1 -- 172.21.15.135:0/3833489197 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f6c60005030 con 0x56470ae9aac0 2024-04-20T12:29:44.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c4cff9640 1 -- 172.21.15.135:0/3833489197 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6c6004c050 con 0x56470ae9aac0 2024-04-20T12:29:44.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c6e645740 10 client.17715 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:44.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c6e645740 1 -- 172.21.15.135:0/3833489197 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56470abdc7d0 con 0x56470ae9aac0 2024-04-20T12:29:44.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c4cff9640 1 -- 172.21.15.135:0/3833489197 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c5c021030 con 0x56470ae9aac0 2024-04-20T12:29:44.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c4cff9640 1 -- 172.21.15.135:0/3833489197 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f6c600035f0 con 0x56470ae9aac0 2024-04-20T12:29:44.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c6e645740 10 client.17715 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:44.686 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c6e645740 10 client.17715 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:44.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c6e645740 20 client.17715 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:44.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c6e645740 1 --2- 172.21.15.135:0/3833489197 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56470aeb8af0 0x56470aebaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c6e645740 4 client.17715 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:44.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.679+0000 7f6c6e645740 1 -- 172.21.15.135:0/3833489197 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56470ae0db30 con 0x56470aeb8af0 2024-04-20T12:29:44.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.680+0000 7f6c68ff6640 1 --2- 172.21.15.135:0/3833489197 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56470aeb8af0 0x56470aebaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.680+0000 7f6c68ff6640 1 --2- 172.21.15.135:0/3833489197 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56470aeb8af0 0x56470aebaf20 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=732e178ae160ad92 server_cookie=c0e4387f0ae4a80f in_seq=0 out_seq=0 2024-04-20T12:29:44.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.680+0000 7f6c4cff9640 10 client.17715 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:44.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.681+0000 7f6c4cff9640 1 -- 172.21.15.135:0/3833489197 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56470ae0db30 con 0x56470aeb8af0 2024-04-20T12:29:44.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.681+0000 7f6c4cff9640 10 client.17715 handle_command_reply: tid=0 2024-04-20T12:29:44.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.681+0000 7f6c6e645740 1 client.17715 shutdown 2024-04-20T12:29:44.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.681+0000 7f6c6e645740 1 -- 172.21.15.135:0/3833489197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 msgr2=0x56470aea5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.681+0000 7f6c6e645740 1 --2- 172.21.15.135:0/3833489197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aea5780 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f6c6002cfd0 tx=0x7f6c60009670 comp rx=0 tx=0).stop 2024-04-20T12:29:44.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.681+0000 7f6c6e645740 1 -- 172.21.15.135:0/3833489197 shutdown_connections 2024-04-20T12:29:44.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.681+0000 7f6c6e645740 1 --2- 172.21.15.135:0/3833489197 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56470aeb8af0 0x56470aebaf20 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.687 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.681+0000 7f6c6e645740 1 --2- 172.21.15.135:0/3833489197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 0x56470aea6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.681+0000 7f6c6e645740 1 --2- 172.21.15.135:0/3833489197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 0x56470aea5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.681+0000 7f6c4cff9640 0 client.17715 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:44.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.681+0000 7f6c6e645740 1 --2- 172.21.15.135:0/3833489197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aea5780 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.681+0000 7f6c6e645740 1 -- 172.21.15.135:0/3833489197 >> 172.21.15.135:0/3833489197 conn(0x56470ae95540 msgr2=0x56470ae97290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.681+0000 7f6c6e645740 1 -- 172.21.15.135:0/3833489197 shutdown_connections 2024-04-20T12:29:44.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.681+0000 7f6c6e645740 1 -- 172.21.15.135:0/3833489197 wait complete. 2024-04-20T12:29:44.688 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.681+0000 7f6c6e645740 20 client.17715 trim_cache size 0 max 16384 2024-04-20T12:29:44.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.694+0000 7f6c6e645740 1 Processor -- start 2024-04-20T12:29:44.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.694+0000 7f6c6e645740 1 -- start start 2024-04-20T12:29:44.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.694+0000 7f6c6e645740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aea7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.694+0000 7f6c6e645740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 0x56470aeb4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.694+0000 7f6c6e645740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 0x56470aeb4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.694+0000 7f6c6e645740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641ad120 con 0x56470ae9aac0 2024-04-20T12:29:44.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.694+0000 7f6c6e645740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641aec60 con 0x56470ae9b3e0 2024-04-20T12:29:44.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.694+0000 7f6c6e645740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641ad7f0 con 0x56470aea8720 2024-04-20T12:29:44.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.694+0000 7f6c697f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aea7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.695+0000 7f6c697f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aea7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36404/0 (socket says 172.21.15.135:36404) 2024-04-20T12:29:44.701 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.695+0000 7f6c697f7640 1 -- 172.21.15.135:0/1638745502 learned_addr learned my addr 172.21.15.135:0/1638745502 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.695+0000 7f6c69ff8640 1 --2- 172.21.15.135:0/1638745502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 0x56470aeb4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.695+0000 7f6c697f7640 1 -- 172.21.15.135:0/1638745502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 msgr2=0x56470aeb4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.695+0000 7f6c697f7640 1 --2- 172.21.15.135:0/1638745502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 0x56470aeb4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.695+0000 7f6c68ff6640 1 --2- 172.21.15.135:0/1638745502 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 0x56470aeb4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.695+0000 7f6c697f7640 1 -- 172.21.15.135:0/1638745502 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 msgr2=0x56470aeb4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.695+0000 7f6c697f7640 1 --2- 172.21.15.135:0/1638745502 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 0x56470aeb4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.695+0000 7f6c697f7640 1 -- 172.21.15.135:0/1638745502 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56470aea4730 con 0x56470ae9aac0 2024-04-20T12:29:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.695+0000 7f6c697f7640 1 --2- 172.21.15.135:0/1638745502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aea7eb0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6c6002c170 tx=0x7f6c6002c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b651552655b0f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.695+0000 7f6c4effd640 1 -- 172.21.15.135:0/1638745502 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60005d50 con 0x56470ae9aac0 2024-04-20T12:29:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.695+0000 7f6c4effd640 1 -- 172.21.15.135:0/1638745502 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c60055070 con 0x56470ae9aac0 2024-04-20T12:29:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.695+0000 7f6c4effd640 1 -- 172.21.15.135:0/1638745502 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6002c2b0 con 0x56470ae9aac0 2024-04-20T12:29:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 -- 172.21.15.135:0/1638745502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 msgr2=0x56470aea7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 --2- 172.21.15.135:0/1638745502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aea7eb0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6c6002c170 tx=0x7f6c6002c7e0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 -- 172.21.15.135:0/1638745502 shutdown_connections 2024-04-20T12:29:44.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 --2- 172.21.15.135:0/1638745502 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470aea8720 0x56470aeb4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 --2- 172.21.15.135:0/1638745502 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470ae9b3e0 0x56470aeb4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 --2- 172.21.15.135:0/1638745502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aea7eb0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 -- 172.21.15.135:0/1638745502 >> 172.21.15.135:0/1638745502 conn(0x56470ae95540 msgr2=0x56470ae95920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 -- 172.21.15.135:0/1638745502 shutdown_connections 2024-04-20T12:29:44.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 -- 172.21.15.135:0/1638745502 wait complete. 2024-04-20T12:29:44.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 -- start start 2024-04-20T12:29:44.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 Processor -- start 2024-04-20T12:29:44.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aeac770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470ae9b3e0 0x56470aeaccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470aea8720 0x56470af1e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641ae590 con 0x56470ae9aac0 2024-04-20T12:29:44.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641adec0 con 0x56470aea8720 2024-04-20T12:29:44.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641ab0f0 con 0x56470ae9b3e0 2024-04-20T12:29:44.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.696+0000 7f6c6e645740 10 client.0 _ll_register_callbacks cb 0x7f6c60009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:44.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c697f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aeac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c697f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aeac770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36416/0 (socket says 172.21.15.135:36416) 2024-04-20T12:29:44.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c697f7640 1 -- 172.21.15.135:0/1600163547 learned_addr learned my addr 172.21.15.135:0/1600163547 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:44.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c68ff6640 1 --2- 172.21.15.135:0/1600163547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470ae9b3e0 0x56470aeaccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c69ff8640 1 --2- 172.21.15.135:0/1600163547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470aea8720 0x56470af1e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c697f7640 1 -- 172.21.15.135:0/1600163547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470ae9b3e0 msgr2=0x56470aeaccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c697f7640 1 --2- 172.21.15.135:0/1600163547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470ae9b3e0 0x56470aeaccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c697f7640 1 -- 172.21.15.135:0/1600163547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470aea8720 msgr2=0x56470af1e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:44.704 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c697f7640 1 --2- 172.21.15.135:0/1600163547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470aea8720 0x56470af1e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c697f7640 1 -- 172.21.15.135:0/1600163547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56470af1e5a0 con 0x56470ae9aac0 2024-04-20T12:29:44.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c697f7640 1 --2- 172.21.15.135:0/1600163547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aeac770 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f6c60003a40 tx=0x7f6c6002cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5110eb9317a471b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:44.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c4cff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:44.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c4cff9640 1 -- 172.21.15.135:0/1600163547 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6005d070 con 0x56470ae9aac0 2024-04-20T12:29:44.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c4cff9640 1 -- 172.21.15.135:0/1600163547 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f6c60005050 con 0x56470ae9aac0 2024-04-20T12:29:44.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c6e645740 1 -- 172.21.15.135:0/1600163547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c60055070 con 0x56470ae9aac0 2024-04-20T12:29:44.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c4cff9640 1 -- 172.21.15.135:0/1600163547 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6c60069050 con 0x56470ae9aac0 2024-04-20T12:29:44.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c6e645740 10 client.17721 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:44.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c6e645740 1 -- 172.21.15.135:0/1600163547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56470af1f760 con 0x56470ae9aac0 2024-04-20T12:29:44.705 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.697+0000 7f6c4cff9640 1 -- 172.21.15.135:0/1600163547 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c60055070 con 0x56470ae9aac0 2024-04-20T12:29:44.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.698+0000 7f6c4cff9640 1 -- 172.21.15.135:0/1600163547 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f6c60004960 con 0x56470ae9aac0 2024-04-20T12:29:44.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.698+0000 7f6c6e645740 10 client.17721 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:44.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.698+0000 7f6c6e645740 10 client.17721 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:44.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.698+0000 7f6c6e645740 20 client.17721 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:44.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.698+0000 7f6c6e645740 1 --2- 172.21.15.135:0/1600163547 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56470af1fd60 0x56470af22180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:44.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.698+0000 7f6c6e645740 4 client.17721 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:29:44.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.698+0000 7f6c6e645740 1 -- 172.21.15.135:0/1600163547 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56470ae079a0 con 0x56470af1fd60 2024-04-20T12:29:44.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.698+0000 7f6c68ff6640 1 --2- 172.21.15.135:0/1600163547 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56470af1fd60 0x56470af22180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:44.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.698+0000 7f6c4cff9640 10 client.17721 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:44.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.698+0000 7f6c68ff6640 1 --2- 172.21.15.135:0/1600163547 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56470af1fd60 0x56470af22180 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6609bc5f7a370304 server_cookie=8f888d05dda53482 in_seq=0 out_seq=0 2024-04-20T12:29:44.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.698+0000 7f6c4cff9640 1 -- 172.21.15.135:0/1600163547 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56470ae079a0 con 0x56470af1fd60 2024-04-20T12:29:44.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.698+0000 7f6c4cff9640 10 client.17721 handle_command_reply: tid=0 2024-04-20T12:29:44.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.698+0000 7f6c6e645740 1 client.17721 shutdown 2024-04-20T12:29:44.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6e645740 1 -- 172.21.15.135:0/1600163547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 msgr2=0x56470aeac770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6e645740 1 --2- 172.21.15.135:0/1600163547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aeac770 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f6c60003a40 tx=0x7f6c6002cd40 comp rx=0 tx=0).stop 2024-04-20T12:29:44.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6e645740 1 -- 172.21.15.135:0/1600163547 shutdown_connections 2024-04-20T12:29:44.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6e645740 1 --2- 172.21.15.135:0/1600163547 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56470af1fd60 0x56470af22180 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6e645740 1 --2- 172.21.15.135:0/1600163547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56470aea8720 0x56470af1e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6e645740 1 --2- 172.21.15.135:0/1600163547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56470ae9b3e0 0x56470aeaccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c4cff9640 0 client.17721 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:44.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6e645740 1 --2- 172.21.15.135:0/1600163547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56470ae9aac0 0x56470aeac770 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6e645740 1 -- 172.21.15.135:0/1600163547 >> 172.21.15.135:0/1600163547 conn(0x56470ae95540 msgr2=0x56470ae97220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6e645740 1 -- 172.21.15.135:0/1600163547 shutdown_connections 2024-04-20T12:29:44.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6e645740 1 -- 172.21.15.135:0/1600163547 wait complete. 2024-04-20T12:29:44.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6e645740 20 client.17721 trim_cache size 0 max 16384 2024-04-20T12:29:44.709 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:29:44.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6ba5b640 1 -- 172.21.15.135:0/3639764380 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c500a3d20 msgr2=0x7f6c500a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6ba5b640 1 --2- 172.21.15.135:0/3639764380 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c500a3d20 0x7f6c500a61e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c01c000 tx=0x7f6c5c01e000 comp rx=0 tx=0).stop 2024-04-20T12:29:44.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6ba5b640 1 -- 172.21.15.135:0/3639764380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c64107280 msgr2=0x7f6c6419ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:44.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6ba5b640 1 --2- 172.21.15.135:0/3639764380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c64107280 0x7f6c6419ead0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f6c5400e9f0 tx=0x7f6c5400eeb0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6ba5b640 1 -- 172.21.15.135:0/3639764380 shutdown_connections 2024-04-20T12:29:44.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6ba5b640 1 --2- 172.21.15.135:0/3639764380 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6c500a3d20 0x7f6c500a61e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6ba5b640 1 --2- 172.21.15.135:0/3639764380 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c64198650 0x7f6c64198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6ba5b640 1 --2- 172.21.15.135:0/3639764380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c64107280 0x7f6c6419ead0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6ba5b640 1 --2- 172.21.15.135:0/3639764380 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6c641021b0 0x7f6c6419e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:44.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6ba5b640 1 -- 172.21.15.135:0/3639764380 >> 172.21.15.135:0/3639764380 conn(0x7f6c640793f0 msgr2=0x7f6c640ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:44.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6ba5b640 1 -- 172.21.15.135:0/3639764380 shutdown_connections 2024-04-20T12:29:44.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:44.699+0000 7f6c6ba5b640 1 -- 172.21.15.135:0/3639764380 wait complete. 2024-04-20T12:29:44.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:44 smithi135 ceph-mon[18264]: pgmap v201: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:29:44.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:44 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/112992432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:29:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:44 smithi139 ceph-mon[21834]: pgmap v201: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:29:45.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:44 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/112992432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:29:45.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:44 smithi154 ceph-mon[22073]: pgmap v201: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:29:45.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:44 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/112992432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:29:45.712 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:29:45.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:29:45.713 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:29:45.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.818+0000 7fe4f70f2640 1 -- 172.21.15.135:0/2743384779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4f0101a50 msgr2=0x7fe4f0105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:45.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.818+0000 7fe4f70f2640 1 --2- 172.21.15.135:0/2743384779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4f0101a50 0x7fe4f0105a90 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009900 tx=0x7fe4d802bc30 comp rx=0 tx=0).stop 2024-04-20T12:29:45.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.818+0000 7fe4f70f2640 1 -- 172.21.15.135:0/2743384779 shutdown_connections 2024-04-20T12:29:45.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.818+0000 7fe4f70f2640 1 --2- 172.21.15.135:0/2743384779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f0106170 0x7fe4f010dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.818+0000 7fe4f70f2640 1 --2- 172.21.15.135:0/2743384779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4f0101a50 0x7fe4f0105a90 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.818+0000 7fe4f70f2640 1 --2- 172.21.15.135:0/2743384779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4f01010a0 0x7fe4f0101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.818+0000 7fe4f70f2640 1 -- 172.21.15.135:0/2743384779 >> 172.21.15.135:0/2743384779 conn(0x7fe4f0077f60 msgr2=0x7fe4f0078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:45.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.818+0000 7fe4f70f2640 1 -- 172.21.15.135:0/2743384779 shutdown_connections 2024-04-20T12:29:45.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.818+0000 7fe4f70f2640 1 -- 172.21.15.135:0/2743384779 wait complete. 2024-04-20T12:29:45.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.818+0000 7fe4f70f2640 1 Processor -- start 2024-04-20T12:29:45.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.818+0000 7fe4f70f2640 1 -- start start 2024-04-20T12:29:45.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.818+0000 7fe4f70f2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4f01010a0 0x7fe4f019e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.818+0000 7fe4f70f2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4f0106170 0x7fe4f019ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4f70f2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f0198650 0x7fe4f0198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4f70f2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f0111200 con 0x7fe4f0106170 2024-04-20T12:29:45.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4f70f2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f0111080 con 0x7fe4f01010a0 2024-04-20T12:29:45.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4f70f2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f0111380 con 0x7fe4f0198650 2024-04-20T12:29:45.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4effff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4f0106170 0x7fe4f019ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4effff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4f0106170 0x7fe4f019ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36434/0 (socket says 172.21.15.135:36434) 2024-04-20T12:29:45.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4effff640 1 -- 172.21.15.135:0/564295393 learned_addr learned my addr 172.21.15.135:0/564295393 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:45.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4f4e8e640 1 --2- 172.21.15.135:0/564295393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4f01010a0 0x7fe4f019e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4f568f640 1 --2- 172.21.15.135:0/564295393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f0198650 0x7fe4f0198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4effff640 1 -- 172.21.15.135:0/564295393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f0198650 msgr2=0x7fe4f0198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:45.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4effff640 1 --2- 172.21.15.135:0/564295393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f0198650 0x7fe4f0198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4effff640 1 -- 172.21.15.135:0/564295393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4f01010a0 msgr2=0x7fe4f019e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:45.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4effff640 1 --2- 172.21.15.135:0/564295393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4f01010a0 0x7fe4f019e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4effff640 1 -- 172.21.15.135:0/564295393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f0199250 con 0x7fe4f0106170 2024-04-20T12:29:45.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4effff640 1 --2- 172.21.15.135:0/564295393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4f0106170 0x7fe4f019ead0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8036040 tx=0x7fe4d802ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:45.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4edffb640 1 -- 172.21.15.135:0/564295393 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8041070 con 0x7fe4f0106170 2024-04-20T12:29:45.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4edffb640 1 -- 172.21.15.135:0/564295393 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4d80054e0 con 0x7fe4f0106170 2024-04-20T12:29:45.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4f70f2640 1 -- 172.21.15.135:0/564295393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f01994e0 con 0x7fe4f0106170 2024-04-20T12:29:45.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4edffb640 1 -- 172.21.15.135:0/564295393 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8034440 con 0x7fe4f0106170 2024-04-20T12:29:45.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.819+0000 7fe4f70f2640 1 -- 172.21.15.135:0/564295393 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f01a5670 con 0x7fe4f0106170 2024-04-20T12:29:45.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4edffb640 1 -- 172.21.15.135:0/564295393 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fe4d8044070 con 0x7fe4f0106170 2024-04-20T12:29:45.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4f9dc4740 1 Processor -- start 2024-04-20T12:29:45.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4f9dc4740 1 -- start start 2024-04-20T12:29:45.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4edffb640 1 --2- 172.21.15.135:0/564295393 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe4dc0a3da0 0x7fe4dc0a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4f9dc4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b043c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4f9dc4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b04900 0x557601b0cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4f9dc4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b0d4e0 0x557601b0f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.829 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4f9dc4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557601a68f00 con 0x557601b03fe0 2024-04-20T12:29:45.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4f9dc4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557601a06530 con 0x557601b04900 2024-04-20T12:29:45.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4f9dc4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557601a64ec0 con 0x557601b0d4e0 2024-04-20T12:29:45.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4edffb640 1 -- 172.21.15.135:0/564295393 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe4d80f26c0 con 0x7fe4f0106170 2024-04-20T12:29:45.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4f4e8e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4f568f640 1 --2- 172.21.15.135:0/564295393 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe4dc0a3da0 0x7fe4dc0a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4f4e8e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b043c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36442/0 (socket says 172.21.15.135:36442) 2024-04-20T12:29:45.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4f4e8e640 1 -- 172.21.15.135:0/1351595452 learned_addr learned my addr 172.21.15.135:0/1351595452 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:45.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4f568f640 1 --2- 172.21.15.135:0/1351595452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b0d4e0 0x557601b0f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.822+0000 7fe4effff640 1 --2- 172.21.15.135:0/1351595452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b04900 0x557601b0cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.823+0000 7fe4f4e8e640 1 -- 172.21.15.135:0/1351595452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b0d4e0 msgr2=0x557601b0f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:45.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.823+0000 7fe4f4e8e640 1 --2- 172.21.15.135:0/1351595452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b0d4e0 0x557601b0f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.823+0000 7fe4f4e8e640 1 -- 172.21.15.135:0/1351595452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b04900 msgr2=0x557601b0cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:45.830 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.823+0000 7fe4f4e8e640 1 --2- 172.21.15.135:0/1351595452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b04900 0x557601b0cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.823+0000 7fe4f4e8e640 1 -- 172.21.15.135:0/1351595452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576018437e0 con 0x557601b03fe0 2024-04-20T12:29:45.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.823+0000 7fe4f568f640 1 --2- 172.21.15.135:0/564295393 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe4dc0a3da0 0x7fe4dc0a6260 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0005fd0 tx=0x7fe4e000e9d0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:45.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.823+0000 7fe4f4e8e640 1 --2- 172.21.15.135:0/1351595452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b043c0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009f60 tx=0x7fe4e8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caff29f5403de088 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:45.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.823+0000 7fe4e6ffd640 1 -- 172.21.15.135:0/1351595452 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8016070 con 0x557601b03fe0 2024-04-20T12:29:45.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.823+0000 7fe4e6ffd640 1 -- 172.21.15.135:0/1351595452 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4e801bb40 con 0x557601b03fe0 2024-04-20T12:29:45.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.823+0000 7fe4e6ffd640 1 -- 172.21.15.135:0/1351595452 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8012cd0 con 0x557601b03fe0 2024-04-20T12:29:45.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.824+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/1351595452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 msgr2=0x557601b043c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:45.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.824+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/1351595452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b043c0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009f60 tx=0x7fe4e8009f90 comp rx=0 tx=0).stop 2024-04-20T12:29:45.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.824+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/1351595452 shutdown_connections 2024-04-20T12:29:45.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.824+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/1351595452 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b0d4e0 0x557601b0f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.824+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/1351595452 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b04900 0x557601b0cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.824+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/1351595452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b043c0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.824+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/1351595452 >> 172.21.15.135:0/1351595452 conn(0x557601afe710 msgr2=0x557601afeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:45.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.824+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/1351595452 shutdown_connections 2024-04-20T12:29:45.831 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.824+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/1351595452 wait complete. 2024-04-20T12:29:45.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.824+0000 7fe4f9dc4740 1 -- start start 2024-04-20T12:29:45.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.824+0000 7fe4f9dc4740 1 Processor -- start 2024-04-20T12:29:45.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.824+0000 7fe4f9dc4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b03fe0 0x557601b0ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.824+0000 7fe4f9dc4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b04900 0x557601b0a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4f9dc4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b0d4e0 0x557601b0a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4f9dc4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557601b102d0 con 0x557601b04900 2024-04-20T12:29:45.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4f9dc4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5576019f1480 con 0x557601b0d4e0 2024-04-20T12:29:45.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4f9dc4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557601b10450 con 0x557601b03fe0 2024-04-20T12:29:45.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4f9dc4740 10 client.0 _ll_register_callbacks cb 0x5576019f0e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:45.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4effff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b04900 0x557601b0a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4effff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b04900 0x557601b0a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36454/0 (socket says 172.21.15.135:36454) 2024-04-20T12:29:45.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4effff640 1 -- 172.21.15.135:0/2137514376 learned_addr learned my addr 172.21.15.135:0/2137514376 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:45.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4f4e8e640 1 --2- 172.21.15.135:0/2137514376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b03fe0 0x557601b0ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4f568f640 1 --2- 172.21.15.135:0/2137514376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b0d4e0 0x557601b0a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.832 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4effff640 1 -- 172.21.15.135:0/2137514376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b03fe0 msgr2=0x557601b0ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:45.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4effff640 1 --2- 172.21.15.135:0/2137514376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b03fe0 0x557601b0ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4effff640 1 -- 172.21.15.135:0/2137514376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b0d4e0 msgr2=0x557601b0a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:45.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4effff640 1 --2- 172.21.15.135:0/2137514376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b0d4e0 0x557601b0a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4effff640 1 -- 172.21.15.135:0/2137514376 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576018a3f70 con 0x557601b04900 2024-04-20T12:29:45.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4effff640 1 --2- 172.21.15.135:0/2137514376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b04900 0x557601b0a260 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8000c00 tx=0x7fe4d80bdea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6fe5954ed4a10f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:45.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4cffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:45.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4cffff640 1 -- 172.21.15.135:0/2137514376 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d804b040 con 0x557601b04900 2024-04-20T12:29:45.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4cffff640 1 -- 172.21.15.135:0/2137514376 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe4d80035f0 con 0x557601b04900 2024-04-20T12:29:45.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2137514376 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4e801bb40 con 0x557601b04900 2024-04-20T12:29:45.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4cffff640 1 -- 172.21.15.135:0/2137514376 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe4d80beb80 con 0x557601b04900 2024-04-20T12:29:45.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4f9dc4740 10 client.17733 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:45.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.825+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2137514376 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55760173b170 con 0x557601b04900 2024-04-20T12:29:45.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.826+0000 7fe4cffff640 1 -- 172.21.15.135:0/2137514376 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4e801bb40 con 0x557601b04900 2024-04-20T12:29:45.833 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.826+0000 7fe4cffff640 1 -- 172.21.15.135:0/2137514376 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe4d80f22e0 con 0x557601b04900 2024-04-20T12:29:45.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.826+0000 7fe4f9dc4740 10 client.17733 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:45.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.826+0000 7fe4f9dc4740 10 client.17733 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:45.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.826+0000 7fe4f9dc4740 20 client.17733 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:45.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.826+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/2137514376 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557601b1d4b0 0x557601b1f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.826+0000 7fe4f9dc4740 4 client.17733 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:45.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.826+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2137514376 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557601a76920 con 0x557601b1d4b0 2024-04-20T12:29:45.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.826+0000 7fe4f4e8e640 1 --2- 172.21.15.135:0/2137514376 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557601b1d4b0 0x557601b1f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.827+0000 7fe4cffff640 10 client.17733 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:45.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.827+0000 7fe4f4e8e640 1 --2- 172.21.15.135:0/2137514376 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557601b1d4b0 0x557601b1f8f0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34161c995f078999 server_cookie=b7c0cfdc481cb4ea in_seq=0 out_seq=0 2024-04-20T12:29:45.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.827+0000 7fe4cffff640 1 -- 172.21.15.135:0/2137514376 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557601a76920 con 0x557601b1d4b0 2024-04-20T12:29:45.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.827+0000 7fe4cffff640 10 client.17733 handle_command_reply: tid=0 2024-04-20T12:29:45.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.827+0000 7fe4f9dc4740 1 client.17733 shutdown 2024-04-20T12:29:45.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.827+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2137514376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b04900 msgr2=0x557601b0a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:45.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.827+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/2137514376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b04900 0x557601b0a260 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8000c00 tx=0x7fe4d80bdea0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.834 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.827+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2137514376 shutdown_connections 2024-04-20T12:29:45.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.827+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/2137514376 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557601b1d4b0 0x557601b1f8f0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.827+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/2137514376 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b0d4e0 0x557601b0a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.827+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/2137514376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b04900 0x557601b0a260 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.827+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/2137514376 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b03fe0 0x557601b0ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.827+0000 7fe4cffff640 0 client.17733 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:45.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.827+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2137514376 >> 172.21.15.135:0/2137514376 conn(0x557601afe710 msgr2=0x557601b00460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:45.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.828+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2137514376 shutdown_connections 2024-04-20T12:29:45.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.828+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2137514376 wait complete. 2024-04-20T12:29:45.835 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.828+0000 7fe4f9dc4740 20 client.17733 trim_cache size 0 max 16384 2024-04-20T12:29:45.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f9dc4740 1 Processor -- start 2024-04-20T12:29:45.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f9dc4740 1 -- start start 2024-04-20T12:29:45.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f9dc4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b19190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f9dc4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b04900 0x557601b15a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f9dc4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b0d4e0 0x557601b0c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f9dc4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f01af440 con 0x557601b03fe0 2024-04-20T12:29:45.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f9dc4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f01b0f80 con 0x557601b0d4e0 2024-04-20T12:29:45.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f9dc4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f01afb10 con 0x557601b04900 2024-04-20T12:29:45.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f4e8e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b19190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f4e8e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b19190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36456/0 (socket says 172.21.15.135:36456) 2024-04-20T12:29:45.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f4e8e640 1 -- 172.21.15.135:0/1041010200 learned_addr learned my addr 172.21.15.135:0/1041010200 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:45.851 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f4e8e640 1 -- 172.21.15.135:0/1041010200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b04900 msgr2=0x557601b15a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f4e8e640 1 --2- 172.21.15.135:0/1041010200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b04900 0x557601b15a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f4e8e640 1 -- 172.21.15.135:0/1041010200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b0d4e0 msgr2=0x557601b0c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f4e8e640 1 --2- 172.21.15.135:0/1041010200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b0d4e0 0x557601b0c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f4e8e640 1 -- 172.21.15.135:0/1041010200 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557601b046f0 con 0x557601b03fe0 2024-04-20T12:29:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4f4e8e640 1 --2- 172.21.15.135:0/1041010200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b19190 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8012820 tx=0x7fe4e801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a88a0143591b53 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.845+0000 7fe4e67fc640 1 -- 172.21.15.135:0/1041010200 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8016040 con 0x557601b03fe0 2024-04-20T12:29:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.846+0000 7fe4e67fc640 1 -- 172.21.15.135:0/1041010200 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4e8003970 con 0x557601b03fe0 2024-04-20T12:29:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.846+0000 7fe4e67fc640 1 -- 172.21.15.135:0/1041010200 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8005440 con 0x557601b03fe0 2024-04-20T12:29:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.846+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/1041010200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 msgr2=0x557601b19190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.846+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/1041010200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b19190 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8012820 tx=0x7fe4e801e040 comp rx=0 tx=0).stop 2024-04-20T12:29:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.846+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/1041010200 shutdown_connections 2024-04-20T12:29:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.846+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/1041010200 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b0d4e0 0x557601b0c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.846+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/1041010200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b04900 0x557601b15a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.846+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/1041010200 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b19190 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.852 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.846+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/1041010200 >> 172.21.15.135:0/1041010200 conn(0x557601afe710 msgr2=0x557601afd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.846+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/1041010200 shutdown_connections 2024-04-20T12:29:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.846+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/1041010200 wait complete. 2024-04-20T12:29:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.846+0000 7fe4f9dc4740 1 -- start start 2024-04-20T12:29:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.846+0000 7fe4f9dc4740 1 Processor -- start 2024-04-20T12:29:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f9dc4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b81b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f9dc4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b04900 0x557601b820a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f9dc4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b0d4e0 0x557601b7bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f9dc4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f01b08b0 con 0x557601b03fe0 2024-04-20T12:29:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f9dc4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f01b01e0 con 0x557601b04900 2024-04-20T12:29:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f9dc4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f01ad410 con 0x557601b0d4e0 2024-04-20T12:29:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f9dc4740 10 client.0 _ll_register_callbacks cb 0x7fe4d80bdfc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f4e8e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b81b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f4e8e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b81b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36472/0 (socket says 172.21.15.135:36472) 2024-04-20T12:29:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f4e8e640 1 -- 172.21.15.135:0/2149290693 learned_addr learned my addr 172.21.15.135:0/2149290693 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:45.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f4e8e640 1 -- 172.21.15.135:0/2149290693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b0d4e0 msgr2=0x557601b7bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f4e8e640 1 --2- 172.21.15.135:0/2149290693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b0d4e0 0x557601b7bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f4e8e640 1 -- 172.21.15.135:0/2149290693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b04900 msgr2=0x557601b820a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4effff640 1 --2- 172.21.15.135:0/2149290693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b04900 0x557601b820a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f4e8e640 1 --2- 172.21.15.135:0/2149290693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b04900 0x557601b820a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f4e8e640 1 -- 172.21.15.135:0/2149290693 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557601b7c690 con 0x557601b03fe0 2024-04-20T12:29:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4f4e8e640 1 --2- 172.21.15.135:0/2149290693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b81b60 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fe4e801e010 tx=0x7fe4e8010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4efa9fe9147b990 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4cffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.847+0000 7fe4cffff640 1 -- 172.21.15.135:0/2149290693 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8016040 con 0x557601b03fe0 2024-04-20T12:29:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.848+0000 7fe4cffff640 1 -- 172.21.15.135:0/2149290693 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7fe4e8005050 con 0x557601b03fe0 2024-04-20T12:29:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.848+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2149290693 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4e8003970 con 0x557601b03fe0 2024-04-20T12:29:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.848+0000 7fe4cffff640 1 -- 172.21.15.135:0/2149290693 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe4e803e050 con 0x557601b03fe0 2024-04-20T12:29:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.848+0000 7fe4f9dc4740 10 client.17739 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.848+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2149290693 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557601b893a0 con 0x557601b03fe0 2024-04-20T12:29:45.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.848+0000 7fe4cffff640 1 -- 172.21.15.135:0/2149290693 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4e8003970 con 0x557601b03fe0 2024-04-20T12:29:45.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.848+0000 7fe4cffff640 1 -- 172.21.15.135:0/2149290693 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe4e800f040 con 0x557601b03fe0 2024-04-20T12:29:45.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.848+0000 7fe4f9dc4740 10 client.17739 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:45.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.848+0000 7fe4f9dc4740 10 client.17739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:45.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.848+0000 7fe4f9dc4740 20 client.17739 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:45.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.848+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/2149290693 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557601b89940 0x557601b8bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.848+0000 7fe4f9dc4740 4 client.17739 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:29:45.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.848+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2149290693 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557601a70790 con 0x557601b89940 2024-04-20T12:29:45.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.848+0000 7fe4effff640 1 --2- 172.21.15.135:0/2149290693 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557601b89940 0x557601b8bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.849+0000 7fe4effff640 1 --2- 172.21.15.135:0/2149290693 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557601b89940 0x557601b8bd60 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f035e3cf0333891 server_cookie=626ed4feab097a47 in_seq=0 out_seq=0 2024-04-20T12:29:45.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.849+0000 7fe4cffff640 10 client.17739 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:45.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.850+0000 7fe4cffff640 1 -- 172.21.15.135:0/2149290693 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557601a70790 con 0x557601b89940 2024-04-20T12:29:45.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.850+0000 7fe4cffff640 10 client.17739 handle_command_reply: tid=0 2024-04-20T12:29:45.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.850+0000 7fe4f9dc4740 1 client.17739 shutdown 2024-04-20T12:29:45.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.850+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2149290693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 msgr2=0x557601b81b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:45.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.850+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/2149290693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b81b60 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fe4e801e010 tx=0x7fe4e8010d20 comp rx=0 tx=0).stop 2024-04-20T12:29:45.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.850+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2149290693 shutdown_connections 2024-04-20T12:29:45.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.850+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/2149290693 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557601b89940 0x557601b8bd60 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.850+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/2149290693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557601b0d4e0 0x557601b7bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.850+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/2149290693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557601b04900 0x557601b820a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.850+0000 7fe4f9dc4740 1 --2- 172.21.15.135:0/2149290693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557601b03fe0 0x557601b81b60 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.850+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2149290693 >> 172.21.15.135:0/2149290693 conn(0x557601afe710 msgr2=0x557601affb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:45.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4cffff640 0 client.17739 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:45.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2149290693 shutdown_connections 2024-04-20T12:29:45.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4f9dc4740 1 -- 172.21.15.135:0/2149290693 wait complete. 2024-04-20T12:29:45.856 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4f9dc4740 20 client.17739 trim_cache size 0 max 16384 2024-04-20T12:29:45.857 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:29:45.857 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:29:45.857 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "b1bd85d6-6457-442d-8bd6-7a8dae212a94", 2024-04-20T12:29:45.857 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:29:45.857 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:29:45.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4f70f2640 1 -- 172.21.15.135:0/564295393 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe4dc0a3da0 msgr2=0x7fe4dc0a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:45.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4f70f2640 1 --2- 172.21.15.135:0/564295393 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe4dc0a3da0 0x7fe4dc0a6260 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0005fd0 tx=0x7fe4e000e9d0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4f70f2640 1 -- 172.21.15.135:0/564295393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4f0106170 msgr2=0x7fe4f019ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:45.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4f70f2640 1 --2- 172.21.15.135:0/564295393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4f0106170 0x7fe4f019ead0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8036040 tx=0x7fe4d802ce20 comp rx=0 tx=0).stop 2024-04-20T12:29:45.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4f70f2640 1 -- 172.21.15.135:0/564295393 shutdown_connections 2024-04-20T12:29:45.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4f70f2640 1 --2- 172.21.15.135:0/564295393 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe4dc0a3da0 0x7fe4dc0a6260 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4f70f2640 1 --2- 172.21.15.135:0/564295393 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4f0198650 0x7fe4f0198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4f70f2640 1 --2- 172.21.15.135:0/564295393 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4f0106170 0x7fe4f019ead0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.858 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4f70f2640 1 --2- 172.21.15.135:0/564295393 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4f01010a0 0x7fe4f019e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4f70f2640 1 -- 172.21.15.135:0/564295393 >> 172.21.15.135:0/564295393 conn(0x7fe4f0077f60 msgr2=0x7fe4f0069460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:45.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4f70f2640 1 -- 172.21.15.135:0/564295393 shutdown_connections 2024-04-20T12:29:45.859 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.851+0000 7fe4f70f2640 1 -- 172.21.15.135:0/564295393 wait complete. 2024-04-20T12:29:45.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:29:45.862 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:29:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.963+0000 7f29f0043640 1 -- 172.21.15.135:0/3745774591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29e81072a0 msgr2=0x7f29e810ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.963+0000 7f29f0043640 1 --2- 172.21.15.135:0/3745774591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29e81072a0 0x7f29e810ee70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009ca0 tx=0x7f29e002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.963+0000 7f29f0043640 1 -- 172.21.15.135:0/3745774591 shutdown_connections 2024-04-20T12:29:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.963+0000 7f29f0043640 1 --2- 172.21.15.135:0/3745774591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29e81072a0 0x7f29e810ee70 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.963+0000 7f29f0043640 1 --2- 172.21.15.135:0/3745774591 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29e8102b80 0x7f29e8106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.963+0000 7f29f0043640 1 --2- 172.21.15.135:0/3745774591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e81021d0 0x7f29e81025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.963+0000 7f29f0043640 1 -- 172.21.15.135:0/3745774591 >> 172.21.15.135:0/3745774591 conn(0x7f29e80793f0 msgr2=0x7f29e8079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.963+0000 7f29f0043640 1 -- 172.21.15.135:0/3745774591 shutdown_connections 2024-04-20T12:29:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.963+0000 7f29f0043640 1 -- 172.21.15.135:0/3745774591 wait complete. 2024-04-20T12:29:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29f0043640 1 Processor -- start 2024-04-20T12:29:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29f0043640 1 -- start start 2024-04-20T12:29:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29f0043640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29e81021d0 0x7f29e819e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29f0043640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29e81072a0 0x7f29e819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29f0043640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e81986c0 0x7f29e8198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29f0043640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f29e8112360 con 0x7f29e81072a0 2024-04-20T12:29:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29f0043640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f29e81121e0 con 0x7f29e81021d0 2024-04-20T12:29:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29f0043640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29e81124e0 con 0x7f29e81986c0 2024-04-20T12:29:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29ed5de640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29e81072a0 0x7f29e819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29ed5de640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29e81072a0 0x7f29e819eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36494/0 (socket says 172.21.15.135:36494) 2024-04-20T12:29:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29ed5de640 1 -- 172.21.15.135:0/3083159125 learned_addr learned my addr 172.21.15.135:0/3083159125 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29edddf640 1 --2- 172.21.15.135:0/3083159125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29e81021d0 0x7f29e819e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29ee5e0640 1 --2- 172.21.15.135:0/3083159125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e81986c0 0x7f29e8198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29ed5de640 1 -- 172.21.15.135:0/3083159125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e81986c0 msgr2=0x7f29e8198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29ed5de640 1 --2- 172.21.15.135:0/3083159125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e81986c0 0x7f29e8198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29ed5de640 1 -- 172.21.15.135:0/3083159125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29e81021d0 msgr2=0x7f29e819e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29ed5de640 1 --2- 172.21.15.135:0/3083159125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29e81021d0 0x7f29e819e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.964+0000 7f29ed5de640 1 -- 172.21.15.135:0/3083159125 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e81992c0 con 0x7f29e81072a0 2024-04-20T12:29:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.965+0000 7f29ed5de640 1 --2- 172.21.15.135:0/3083159125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29e81072a0 0x7f29e819eb40 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00d770 tx=0x7f29dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.965+0000 7f29daffd640 1 -- 172.21.15.135:0/3083159125 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29dc017070 con 0x7f29e81072a0 2024-04-20T12:29:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.965+0000 7f29daffd640 1 -- 172.21.15.135:0/3083159125 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29dc009c30 con 0x7f29e81072a0 2024-04-20T12:29:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.965+0000 7f29f0043640 1 -- 172.21.15.135:0/3083159125 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e81a53a0 con 0x7f29e81072a0 2024-04-20T12:29:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.965+0000 7f29daffd640 1 -- 172.21.15.135:0/3083159125 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29dc00f620 con 0x7f29e81072a0 2024-04-20T12:29:45.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.965+0000 7f29f0043640 1 -- 172.21.15.135:0/3083159125 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e81a57a0 con 0x7f29e81072a0 2024-04-20T12:29:45.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.967+0000 7f29daffd640 1 -- 172.21.15.135:0/3083159125 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f29dc01a070 con 0x7f29e81072a0 2024-04-20T12:29:45.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.967+0000 7f29f2c37740 1 Processor -- start 2024-04-20T12:29:45.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29f2c37740 1 -- start start 2024-04-20T12:29:45.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29f2c37740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439ad20 0x557ae439b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29f2c37740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439b640 0x557ae43a3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29f2c37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae43a4220 0x557ae43a6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.978 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29f2c37740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557ae43001b0 con 0x557ae439b640 2024-04-20T12:29:45.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29f2c37740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557ae429d390 con 0x557ae439ad20 2024-04-20T12:29:45.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29f2c37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557ae42fc170 con 0x557ae43a4220 2024-04-20T12:29:45.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29daffd640 1 --2- 172.21.15.135:0/3083159125 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f29d40a3d20 0x7f29d40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29edddf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439b640 0x557ae43a3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29ee5e0640 1 --2- 172.21.15.135:0/3083159125 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f29d40a3d20 0x7f29d40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29edddf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439b640 0x557ae43a3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36502/0 (socket says 172.21.15.135:36502) 2024-04-20T12:29:45.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29edddf640 1 -- 172.21.15.135:0/3698825026 learned_addr learned my addr 172.21.15.135:0/3698825026 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:45.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29ee5e0640 1 --2- 172.21.15.135:0/3698825026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439ad20 0x557ae439b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29daffd640 1 -- 172.21.15.135:0/3083159125 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f29dc0d0630 con 0x7f29e81072a0 2024-04-20T12:29:45.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29ed5de640 1 --2- 172.21.15.135:0/3698825026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae43a4220 0x557ae43a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29edddf640 1 -- 172.21.15.135:0/3698825026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae43a4220 msgr2=0x557ae43a6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:45.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29edddf640 1 --2- 172.21.15.135:0/3698825026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae43a4220 0x557ae43a6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29edddf640 1 -- 172.21.15.135:0/3698825026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439ad20 msgr2=0x557ae439b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:45.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29edddf640 1 --2- 172.21.15.135:0/3698825026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439ad20 0x557ae439b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.968+0000 7f29edddf640 1 -- 172.21.15.135:0/3698825026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ae40dc7d0 con 0x557ae439b640 2024-04-20T12:29:45.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.969+0000 7f29ee5e0640 1 --2- 172.21.15.135:0/3083159125 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f29d40a3d20 0x7f29d40a61e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f29e0004af0 tx=0x7f29e0009880 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:45.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.969+0000 7f29edddf640 1 --2- 172.21.15.135:0/3698825026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439b640 0x557ae43a3ce0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f29e400b760 tx=0x7f29e400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75ec0e6be1d652e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:45.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.969+0000 7f29d3fff640 1 -- 172.21.15.135:0/3698825026 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4003dd0 con 0x557ae439b640 2024-04-20T12:29:45.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.969+0000 7f29d3fff640 1 -- 172.21.15.135:0/3698825026 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e4015070 con 0x557ae439b640 2024-04-20T12:29:45.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.969+0000 7f29d3fff640 1 -- 172.21.15.135:0/3698825026 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4004de0 con 0x557ae439b640 2024-04-20T12:29:45.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.969+0000 7f29f2c37740 1 -- 172.21.15.135:0/3698825026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439b640 msgr2=0x557ae43a3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:45.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.969+0000 7f29f2c37740 1 --2- 172.21.15.135:0/3698825026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439b640 0x557ae43a3ce0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f29e400b760 tx=0x7f29e400bc20 comp rx=0 tx=0).stop 2024-04-20T12:29:45.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.969+0000 7f29f2c37740 1 -- 172.21.15.135:0/3698825026 shutdown_connections 2024-04-20T12:29:45.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.969+0000 7f29f2c37740 1 --2- 172.21.15.135:0/3698825026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae43a4220 0x557ae43a6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.969+0000 7f29f2c37740 1 --2- 172.21.15.135:0/3698825026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439b640 0x557ae43a3ce0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.969+0000 7f29f2c37740 1 --2- 172.21.15.135:0/3698825026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439ad20 0x557ae439b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.970+0000 7f29f2c37740 1 -- 172.21.15.135:0/3698825026 >> 172.21.15.135:0/3698825026 conn(0x557ae4395450 msgr2=0x557ae4395830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:45.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.970+0000 7f29f2c37740 1 -- 172.21.15.135:0/3698825026 shutdown_connections 2024-04-20T12:29:45.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.970+0000 7f29f2c37740 1 -- 172.21.15.135:0/3698825026 wait complete. 2024-04-20T12:29:45.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.970+0000 7f29f2c37740 1 -- start start 2024-04-20T12:29:45.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.970+0000 7f29f2c37740 1 Processor -- start 2024-04-20T12:29:45.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.970+0000 7f29f2c37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae439ad20 0x557ae43a1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.970+0000 7f29f2c37740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439b640 0x557ae43a1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.970+0000 7f29f2c37740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae43a4220 0x557ae43a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.970+0000 7f29f2c37740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557ae43a7010 con 0x557ae43a4220 2024-04-20T12:29:45.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.970+0000 7f29f2c37740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557ae42b92f0 con 0x557ae439b640 2024-04-20T12:29:45.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.970+0000 7f29f2c37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557ae43a7190 con 0x557ae439ad20 2024-04-20T12:29:45.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.970+0000 7f29f2c37740 10 client.0 _ll_register_callbacks cb 0x557ae42834e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:45.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.970+0000 7f29ee5e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae43a4220 0x557ae43a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29ee5e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae43a4220 0x557ae43a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36506/0 (socket says 172.21.15.135:36506) 2024-04-20T12:29:45.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29ee5e0640 1 -- 172.21.15.135:0/482206499 learned_addr learned my addr 172.21.15.135:0/482206499 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:45.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29edddf640 1 --2- 172.21.15.135:0/482206499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae439ad20 0x557ae43a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29ed5de640 1 --2- 172.21.15.135:0/482206499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439b640 0x557ae43a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29ee5e0640 1 -- 172.21.15.135:0/482206499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae439ad20 msgr2=0x557ae43a1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:45.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29ee5e0640 1 --2- 172.21.15.135:0/482206499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae439ad20 0x557ae43a1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29ee5e0640 1 -- 172.21.15.135:0/482206499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439b640 msgr2=0x557ae43a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:45.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29ee5e0640 1 --2- 172.21.15.135:0/482206499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439b640 0x557ae43a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29ee5e0640 1 -- 172.21.15.135:0/482206499 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ae40123f0 con 0x557ae43a4220 2024-04-20T12:29:45.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29ee5e0640 1 --2- 172.21.15.135:0/482206499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae43a4220 0x557ae43a1cd0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f29e0032ec0 tx=0x7f29e0045070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b98a541b6cb634 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:45.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29d17fa640 1 -- 172.21.15.135:0/482206499 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0051020 con 0x557ae43a4220 2024-04-20T12:29:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29d17fa640 1 -- 172.21.15.135:0/482206499 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f29e0004240 con 0x557ae43a4220 2024-04-20T12:29:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29f2c37740 1 -- 172.21.15.135:0/482206499 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29e4015070 con 0x557ae43a4220 2024-04-20T12:29:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29d17fa640 1 -- 172.21.15.135:0/482206499 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f29e005c050 con 0x557ae43a4220 2024-04-20T12:29:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29f2c37740 10 client.17751 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29f2c37740 1 -- 172.21.15.135:0/482206499 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557ae3fd20f0 con 0x557ae43a4220 2024-04-20T12:29:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.971+0000 7f29d17fa640 1 -- 172.21.15.135:0/482206499 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e4015070 con 0x557ae43a4220 2024-04-20T12:29:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.972+0000 7f29d17fa640 1 -- 172.21.15.135:0/482206499 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f29e004c030 con 0x557ae43a4220 2024-04-20T12:29:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.972+0000 7f29f2c37740 10 client.17751 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.972+0000 7f29f2c37740 10 client.17751 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.972+0000 7f29f2c37740 20 client.17751 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.972+0000 7f29f2c37740 1 --2- 172.21.15.135:0/482206499 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557ae43b45f0 0x557ae43b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.972+0000 7f29f2c37740 4 client.17751 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:29:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.972+0000 7f29f2c37740 1 -- 172.21.15.135:0/482206499 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ae430dbd0 con 0x557ae43b45f0 2024-04-20T12:29:45.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.972+0000 7f29edddf640 1 --2- 172.21.15.135:0/482206499 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557ae43b45f0 0x557ae43b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.972+0000 7f29d17fa640 10 client.17751 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.972+0000 7f29edddf640 1 --2- 172.21.15.135:0/482206499 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557ae43b45f0 0x557ae43b6a40 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44603507fef3b90c server_cookie=d52698f3dd707da9 in_seq=0 out_seq=0 2024-04-20T12:29:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.973+0000 7f29d17fa640 1 -- 172.21.15.135:0/482206499 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557ae430dbd0 con 0x557ae43b45f0 2024-04-20T12:29:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.973+0000 7f29d17fa640 10 client.17751 handle_command_reply: tid=0 2024-04-20T12:29:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.973+0000 7f29f2c37740 1 client.17751 shutdown 2024-04-20T12:29:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.973+0000 7f29f2c37740 1 -- 172.21.15.135:0/482206499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae43a4220 msgr2=0x557ae43a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.973+0000 7f29f2c37740 1 --2- 172.21.15.135:0/482206499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae43a4220 0x557ae43a1cd0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f29e0032ec0 tx=0x7f29e0045070 comp rx=0 tx=0).stop 2024-04-20T12:29:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.973+0000 7f29f2c37740 1 -- 172.21.15.135:0/482206499 shutdown_connections 2024-04-20T12:29:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.973+0000 7f29f2c37740 1 --2- 172.21.15.135:0/482206499 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557ae43b45f0 0x557ae43b6a40 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.973+0000 7f29f2c37740 1 --2- 172.21.15.135:0/482206499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae43a4220 0x557ae43a1cd0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.973+0000 7f29f2c37740 1 --2- 172.21.15.135:0/482206499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439b640 0x557ae43a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.973+0000 7f29d17fa640 0 client.17751 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:45.984 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.973+0000 7f29f2c37740 1 --2- 172.21.15.135:0/482206499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae439ad20 0x557ae43a1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.973+0000 7f29f2c37740 1 -- 172.21.15.135:0/482206499 >> 172.21.15.135:0/482206499 conn(0x557ae4395450 msgr2=0x557ae43971a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.973+0000 7f29f2c37740 1 -- 172.21.15.135:0/482206499 shutdown_connections 2024-04-20T12:29:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.973+0000 7f29f2c37740 1 -- 172.21.15.135:0/482206499 wait complete. 2024-04-20T12:29:45.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.973+0000 7f29f2c37740 20 client.17751 trim_cache size 0 max 16384 2024-04-20T12:29:45.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29f2c37740 1 Processor -- start 2024-04-20T12:29:45.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29f2c37740 1 -- start start 2024-04-20T12:29:45.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29f2c37740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439ad20 0x557ae43a3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29f2c37740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439b640 0x557ae43afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29f2c37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae43a4220 0x557ae43944b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:45.999 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29f2c37740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f29e81af380 con 0x557ae439ad20 2024-04-20T12:29:46.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29f2c37740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f29e81b0ec0 con 0x557ae439b640 2024-04-20T12:29:46.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29f2c37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29e81afa50 con 0x557ae43a4220 2024-04-20T12:29:46.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29edddf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439ad20 0x557ae43a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:46.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29edddf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439ad20 0x557ae43a3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36510/0 (socket says 172.21.15.135:36510) 2024-04-20T12:29:46.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29edddf640 1 -- 172.21.15.135:0/1138645930 learned_addr learned my addr 172.21.15.135:0/1138645930 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:46.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29edddf640 1 -- 172.21.15.135:0/1138645930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae43a4220 msgr2=0x557ae43944b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:46.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29edddf640 1 --2- 172.21.15.135:0/1138645930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae43a4220 0x557ae43944b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:46.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29ed5de640 1 --2- 172.21.15.135:0/1138645930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439b640 0x557ae43afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:46.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29edddf640 1 -- 172.21.15.135:0/1138645930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439b640 msgr2=0x557ae43afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:46.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29edddf640 1 --2- 172.21.15.135:0/1138645930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439b640 0x557ae43afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:46.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29edddf640 1 -- 172.21.15.135:0/1138645930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ae43b70c0 con 0x557ae439ad20 2024-04-20T12:29:46.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29ed5de640 1 --2- 172.21.15.135:0/1138645930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439b640 0x557ae43afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:29:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.991+0000 7f29edddf640 1 --2- 172.21.15.135:0/1138645930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439ad20 0x557ae43a3980 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x557ae439a7f0 tx=0x7f29e4004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd88a8c3b7e0eadb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.992+0000 7f29d37fe640 1 -- 172.21.15.135:0/1138645930 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4003dd0 con 0x557ae439ad20 2024-04-20T12:29:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.992+0000 7f29d37fe640 1 -- 172.21.15.135:0/1138645930 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e4015030 con 0x557ae439ad20 2024-04-20T12:29:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.992+0000 7f29d37fe640 1 -- 172.21.15.135:0/1138645930 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4011730 con 0x557ae439ad20 2024-04-20T12:29:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.992+0000 7f29f2c37740 1 -- 172.21.15.135:0/1138645930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439ad20 msgr2=0x557ae43a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.992+0000 7f29f2c37740 1 --2- 172.21.15.135:0/1138645930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439ad20 0x557ae43a3980 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x557ae439a7f0 tx=0x7f29e4004920 comp rx=0 tx=0).stop 2024-04-20T12:29:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.992+0000 7f29f2c37740 1 -- 172.21.15.135:0/1138645930 shutdown_connections 2024-04-20T12:29:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.992+0000 7f29f2c37740 1 --2- 172.21.15.135:0/1138645930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae43a4220 0x557ae43944b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.992+0000 7f29f2c37740 1 --2- 172.21.15.135:0/1138645930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439b640 0x557ae43afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.992+0000 7f29f2c37740 1 --2- 172.21.15.135:0/1138645930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439ad20 0x557ae43a3980 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.992+0000 7f29f2c37740 1 -- 172.21.15.135:0/1138645930 >> 172.21.15.135:0/1138645930 conn(0x557ae4395450 msgr2=0x557ae4393da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.992+0000 7f29f2c37740 1 -- 172.21.15.135:0/1138645930 shutdown_connections 2024-04-20T12:29:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.992+0000 7f29f2c37740 1 -- 172.21.15.135:0/1138645930 wait complete. 2024-04-20T12:29:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.992+0000 7f29f2c37740 1 -- start start 2024-04-20T12:29:46.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29f2c37740 1 Processor -- start 2024-04-20T12:29:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29f2c37740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439ad20 0x557ae43a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29f2c37740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439b640 0x557ae43aa380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29f2c37740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae43a4220 0x557ae43aa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29f2c37740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f29e81b07f0 con 0x557ae439b640 2024-04-20T12:29:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29f2c37740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f29e81b0120 con 0x557ae439ad20 2024-04-20T12:29:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29f2c37740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f29e81ad350 con 0x557ae43a4220 2024-04-20T12:29:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29f2c37740 10 client.0 _ll_register_callbacks cb 0x7f29e0037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:29:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29ed5de640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439b640 0x557ae43aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29ed5de640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439b640 0x557ae43aa380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:36514/0 (socket says 172.21.15.135:36514) 2024-04-20T12:29:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29ed5de640 1 -- 172.21.15.135:0/483696520 learned_addr learned my addr 172.21.15.135:0/483696520 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:29:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29edddf640 1 --2- 172.21.15.135:0/483696520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439ad20 0x557ae43a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29ed5de640 1 -- 172.21.15.135:0/483696520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae43a4220 msgr2=0x557ae43aa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29ed5de640 1 --2- 172.21.15.135:0/483696520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae43a4220 0x557ae43aa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:46.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29ed5de640 1 -- 172.21.15.135:0/483696520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439ad20 msgr2=0x557ae43a9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:29:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29ed5de640 1 --2- 172.21.15.135:0/483696520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439ad20 0x557ae43a9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29ed5de640 1 -- 172.21.15.135:0/483696520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ae4419bc0 con 0x557ae439b640 2024-04-20T12:29:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29ed5de640 1 --2- 172.21.15.135:0/483696520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439b640 0x557ae43aa380 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f29dc010c80 tx=0x7f29dc09bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81067b061cd5f1a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:29:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.993+0000 7f29d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:29:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.994+0000 7f29d17fa640 1 -- 172.21.15.135:0/483696520 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29dc0b4070 con 0x557ae439b640 2024-04-20T12:29:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.994+0000 7f29d17fa640 1 -- 172.21.15.135:0/483696520 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9416+0+0 (secure 0 0 0) 0x7f29dc066970 con 0x557ae439b640 2024-04-20T12:29:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.994+0000 7f29f2c37740 1 -- 172.21.15.135:0/483696520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29e4015030 con 0x557ae439b640 2024-04-20T12:29:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.994+0000 7f29d17fa640 1 -- 172.21.15.135:0/483696520 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f29dc021040 con 0x557ae439b640 2024-04-20T12:29:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.994+0000 7f29f2c37740 10 client.17757 fetch_fsmap learned FSMap version 29 2024-04-20T12:29:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.994+0000 7f29f2c37740 1 -- 172.21.15.135:0/483696520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557ae441ae80 con 0x557ae439b640 2024-04-20T12:29:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.994+0000 7f29d17fa640 1 -- 172.21.15.135:0/483696520 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e4015030 con 0x557ae439b640 2024-04-20T12:29:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.994+0000 7f29d17fa640 1 -- 172.21.15.135:0/483696520 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f29dc0a0170 con 0x557ae439b640 2024-04-20T12:29:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.994+0000 7f29f2c37740 10 client.17757 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:29:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.994+0000 7f29f2c37740 10 client.17757 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:29:46.004 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.994+0000 7f29f2c37740 20 client.17757 populate_metadata read hostname 'smithi135' 2024-04-20T12:29:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.994+0000 7f29f2c37740 1 --2- 172.21.15.135:0/483696520 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557ae441b600 0x557ae441da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:29:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.994+0000 7f29f2c37740 4 client.17757 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:29:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.994+0000 7f29f2c37740 1 -- 172.21.15.135:0/483696520 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557ae4307a40 con 0x557ae441b600 2024-04-20T12:29:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.994+0000 7f29edddf640 1 --2- 172.21.15.135:0/483696520 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557ae441b600 0x557ae441da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:29:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29edddf640 1 --2- 172.21.15.135:0/483696520 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557ae441b600 0x557ae441da20 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34e3891cb8f032ef server_cookie=9e4f409f50fcba89 in_seq=0 out_seq=0 2024-04-20T12:29:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29d17fa640 10 client.17757 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29d17fa640 1 -- 172.21.15.135:0/483696520 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557ae4307a40 con 0x557ae441b600 2024-04-20T12:29:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29d17fa640 10 client.17757 handle_command_reply: tid=0 2024-04-20T12:29:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29f2c37740 1 client.17757 shutdown 2024-04-20T12:29:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29f2c37740 1 -- 172.21.15.135:0/483696520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439b640 msgr2=0x557ae43aa380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29f2c37740 1 --2- 172.21.15.135:0/483696520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439b640 0x557ae43aa380 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f29dc010c80 tx=0x7f29dc09bc70 comp rx=0 tx=0).stop 2024-04-20T12:29:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29f2c37740 1 -- 172.21.15.135:0/483696520 shutdown_connections 2024-04-20T12:29:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29f2c37740 1 --2- 172.21.15.135:0/483696520 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557ae441b600 0x557ae441da20 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29f2c37740 1 --2- 172.21.15.135:0/483696520 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557ae43a4220 0x557ae43aa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:46.005 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29d17fa640 0 client.17757 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:29:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29f2c37740 1 --2- 172.21.15.135:0/483696520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557ae439b640 0x557ae43aa380 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29f2c37740 1 --2- 172.21.15.135:0/483696520 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557ae439ad20 0x557ae43a9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29f2c37740 1 -- 172.21.15.135:0/483696520 >> 172.21.15.135:0/483696520 conn(0x557ae4395450 msgr2=0x557ae4394630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29f2c37740 1 -- 172.21.15.135:0/483696520 shutdown_connections 2024-04-20T12:29:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29f2c37740 1 -- 172.21.15.135:0/483696520 wait complete. 2024-04-20T12:29:46.006 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.995+0000 7f29f2c37740 20 client.17757 trim_cache size 0 max 16384 2024-04-20T12:29:46.006 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:29:46.006 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:29:46.006 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:29:46.006 INFO:teuthology.orchestra.run.smithi135.stdout: "b1bd85d6-6457-442d-8bd6-7a8dae212a94": { 2024-04-20T12:29:46.007 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:29:46.007 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "b1bd85d6-6457-442d-8bd6-7a8dae212a94", 2024-04-20T12:29:46.007 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:29:46.007 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:29:46.007 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:29:46.007 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:29:46.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.996+0000 7f29f0043640 1 -- 172.21.15.135:0/3083159125 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f29d40a3d20 msgr2=0x7f29d40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:46.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.996+0000 7f29f0043640 1 --2- 172.21.15.135:0/3083159125 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f29d40a3d20 0x7f29d40a61e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f29e0004af0 tx=0x7f29e0009880 comp rx=0 tx=0).stop 2024-04-20T12:29:46.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.996+0000 7f29f0043640 1 -- 172.21.15.135:0/3083159125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29e81072a0 msgr2=0x7f29e819eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:29:46.008 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.996+0000 7f29f0043640 1 --2- 172.21.15.135:0/3083159125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29e81072a0 0x7f29e819eb40 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00d770 tx=0x7f29dc00dc30 comp rx=0 tx=0).stop 2024-04-20T12:29:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.996+0000 7f29f0043640 1 -- 172.21.15.135:0/3083159125 shutdown_connections 2024-04-20T12:29:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.996+0000 7f29f0043640 1 --2- 172.21.15.135:0/3083159125 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f29d40a3d20 0x7f29d40a61e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.996+0000 7f29f0043640 1 --2- 172.21.15.135:0/3083159125 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29e81986c0 0x7f29e8198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.996+0000 7f29f0043640 1 --2- 172.21.15.135:0/3083159125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f29e81072a0 0x7f29e819eb40 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.996+0000 7f29f0043640 1 --2- 172.21.15.135:0/3083159125 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f29e81021d0 0x7f29e819e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:29:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.996+0000 7f29f0043640 1 -- 172.21.15.135:0/3083159125 >> 172.21.15.135:0/3083159125 conn(0x7f29e80793f0 msgr2=0x7f29e80ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:29:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.996+0000 7f29f0043640 1 -- 172.21.15.135:0/3083159125 shutdown_connections 2024-04-20T12:29:46.009 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:29:45.996+0000 7f29f0043640 1 -- 172.21.15.135:0/3083159125 wait complete. 2024-04-20T12:29:46.009 INFO:tasks.cephfs.filesystem:scrub status for tag:b1bd85d6-6457-442d-8bd6-7a8dae212a94 - {'path': '/', 'tag': 'b1bd85d6-6457-442d-8bd6-7a8dae212a94', 'options': 'recursive,force'} 2024-04-20T12:29:47.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:46 smithi139 ceph-mon[21834]: pgmap v202: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:47.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:46 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:29:47.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:46 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:29:47.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:46 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:29:47.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:46 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:29:47.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:46 smithi135 ceph-mon[18264]: pgmap v202: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:47.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:46 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:29:47.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:46 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:29:47.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:46 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:29:47.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:46 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:29:47.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:46 smithi154 ceph-mon[22073]: pgmap v202: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:47.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:46 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:29:47.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:46 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:29:47.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:46 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:29:47.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:46 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:29:48.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:47 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:29:48.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:47 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:29:48.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:47 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:29:49.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:48 smithi139 ceph-mon[21834]: pgmap v203: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:49.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:48 smithi135 ceph-mon[18264]: pgmap v203: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:49.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:48 smithi154 ceph-mon[22073]: pgmap v203: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:29:51.053 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:50 smithi154 ceph-mon[22073]: pgmap v204: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:29:51.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:50 smithi139 ceph-mon[21834]: pgmap v204: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:29:51.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:50 smithi135 ceph-mon[18264]: pgmap v204: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:29:53.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:52 smithi139 ceph-mon[21834]: pgmap v205: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:29:53.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:52 smithi135 ceph-mon[18264]: pgmap v205: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:29:53.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:52 smithi154 ceph-mon[22073]: pgmap v205: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:29:55.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:54 smithi139 ceph-mon[21834]: pgmap v206: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:29:55.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:54 smithi135 ceph-mon[18264]: pgmap v206: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:29:55.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:54 smithi154 ceph-mon[22073]: pgmap v206: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:29:57.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:56 smithi139 ceph-mon[21834]: pgmap v207: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:29:57.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:56 smithi135 ceph-mon[18264]: pgmap v207: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:29:57.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:56 smithi154 ceph-mon[22073]: pgmap v207: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:29:59.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:29:58 smithi139 ceph-mon[21834]: pgmap v208: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:29:59.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:29:58 smithi135 ceph-mon[18264]: pgmap v208: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:29:59.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:29:58 smithi154 ceph-mon[22073]: pgmap v208: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:30:01.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:00 smithi139 ceph-mon[21834]: pgmap v209: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:30:01.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:00 smithi139 ceph-mon[21834]: overall HEALTH_OK 2024-04-20T12:30:01.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:00 smithi135 ceph-mon[18264]: pgmap v209: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:30:01.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:00 smithi135 ceph-mon[18264]: overall HEALTH_OK 2024-04-20T12:30:01.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:00 smithi154 ceph-mon[22073]: pgmap v209: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:30:01.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:00 smithi154 ceph-mon[22073]: overall HEALTH_OK 2024-04-20T12:30:03.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:02 smithi139 ceph-mon[21834]: pgmap v210: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:30:03.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:02 smithi135 ceph-mon[18264]: pgmap v210: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:30:03.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:02 smithi154 ceph-mon[22073]: pgmap v210: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:30:05.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:04 smithi139 ceph-mon[21834]: pgmap v211: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-20T12:30:05.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:04 smithi135 ceph-mon[18264]: pgmap v211: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-20T12:30:05.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:04 smithi154 ceph-mon[22073]: pgmap v211: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-20T12:30:07.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:06 smithi139 ceph-mon[21834]: pgmap v212: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:30:07.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:06 smithi135 ceph-mon[18264]: pgmap v212: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:30:07.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:06 smithi154 ceph-mon[22073]: pgmap v212: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:30:09.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:08 smithi139 ceph-mon[21834]: pgmap v213: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:30:09.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:08 smithi139 ceph-mon[21834]: osdmap e96: 12 total, 12 up, 12 in 2024-04-20T12:30:09.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:08 smithi135 ceph-mon[18264]: pgmap v213: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:30:09.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:08 smithi135 ceph-mon[18264]: osdmap e96: 12 total, 12 up, 12 in 2024-04-20T12:30:09.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:08 smithi154 ceph-mon[22073]: pgmap v213: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:30:09.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:08 smithi154 ceph-mon[22073]: osdmap e96: 12 total, 12 up, 12 in 2024-04-20T12:30:11.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:10 smithi139 ceph-mon[21834]: pgmap v215: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:30:11.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:10 smithi135 ceph-mon[18264]: pgmap v215: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:30:11.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:10 smithi154 ceph-mon[22073]: pgmap v215: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:30:13.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:12 smithi139 ceph-mon[21834]: pgmap v216: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:30:13.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:12 smithi135 ceph-mon[18264]: pgmap v216: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:30:13.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:12 smithi154 ceph-mon[22073]: pgmap v216: 129 pgs: 129 active+clean; 16 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:30:15.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:14 smithi139 ceph-mon[21834]: pgmap v217: 129 pgs: 129 active+clean; 16 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:30:15.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:14 smithi135 ceph-mon[18264]: pgmap v217: 129 pgs: 129 active+clean; 16 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:30:15.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:14 smithi154 ceph-mon[22073]: pgmap v217: 129 pgs: 129 active+clean; 16 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:30:16.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:30:16.011 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:30:16.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.127+0000 7f2e4fe5c640 1 -- 172.21.15.135:0/500461928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e481072f0 msgr2=0x7f2e4810eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.127+0000 7f2e4fe5c640 1 --2- 172.21.15.135:0/500461928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e481072f0 0x7f2e4810eec0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009ca0 tx=0x7f2e4002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.127+0000 7f2e4fe5c640 1 -- 172.21.15.135:0/500461928 shutdown_connections 2024-04-20T12:30:16.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.127+0000 7f2e4fe5c640 1 --2- 172.21.15.135:0/500461928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e481072f0 0x7f2e4810eec0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.127+0000 7f2e4fe5c640 1 --2- 172.21.15.135:0/500461928 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e48102bd0 0x7f2e48106c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.127+0000 7f2e4fe5c640 1 --2- 172.21.15.135:0/500461928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e48102220 0x7f2e48102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.127+0000 7f2e4fe5c640 1 -- 172.21.15.135:0/500461928 >> 172.21.15.135:0/500461928 conn(0x7f2e480fdac0 msgr2=0x7f2e480ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.127+0000 7f2e4fe5c640 1 -- 172.21.15.135:0/500461928 shutdown_connections 2024-04-20T12:30:16.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.127+0000 7f2e4fe5c640 1 -- 172.21.15.135:0/500461928 wait complete. 2024-04-20T12:30:16.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4fe5c640 1 Processor -- start 2024-04-20T12:30:16.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4fe5c640 1 -- start start 2024-04-20T12:30:16.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4fe5c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e48102220 0x7f2e4819e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4fe5c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e481072f0 0x7f2e4819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4fe5c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e481987e0 0x7f2e48198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4fe5c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e48112400 con 0x7f2e48102220 2024-04-20T12:30:16.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4fe5c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2e48112280 con 0x7f2e481072f0 2024-04-20T12:30:16.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4fe5c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e48112580 con 0x7f2e481987e0 2024-04-20T12:30:16.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4dbf8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e48102220 0x7f2e4819e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4dbf8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e48102220 0x7f2e4819e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56830/0 (socket says 172.21.15.135:56830) 2024-04-20T12:30:16.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4dbf8640 1 -- 172.21.15.135:0/3285474615 learned_addr learned my addr 172.21.15.135:0/3285474615 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4e3f9640 1 --2- 172.21.15.135:0/3285474615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e481987e0 0x7f2e48198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4d3f7640 1 --2- 172.21.15.135:0/3285474615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e481072f0 0x7f2e4819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4dbf8640 1 -- 172.21.15.135:0/3285474615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e481987e0 msgr2=0x7f2e48198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4dbf8640 1 --2- 172.21.15.135:0/3285474615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e481987e0 0x7f2e48198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4dbf8640 1 -- 172.21.15.135:0/3285474615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e481072f0 msgr2=0x7f2e4819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4dbf8640 1 --2- 172.21.15.135:0/3285474615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e481072f0 0x7f2e4819eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4dbf8640 1 -- 172.21.15.135:0/3285474615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e48199370 con 0x7f2e48102220 2024-04-20T12:30:16.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4d3f7640 1 --2- 172.21.15.135:0/3285474615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e481072f0 0x7f2e4819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:16.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.128+0000 7f2e4dbf8640 1 --2- 172.21.15.135:0/3285474615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e48102220 0x7f2e4819e620 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400b4a0 tx=0x7f2e4400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.129+0000 7f2e3effd640 1 -- 172.21.15.135:0/3285474615 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e44014070 con 0x7f2e48102220 2024-04-20T12:30:16.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.129+0000 7f2e3effd640 1 -- 172.21.15.135:0/3285474615 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e44010af0 con 0x7f2e48102220 2024-04-20T12:30:16.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.129+0000 7f2e4fe5c640 1 -- 172.21.15.135:0/3285474615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e48199660 con 0x7f2e48102220 2024-04-20T12:30:16.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.129+0000 7f2e3effd640 1 -- 172.21.15.135:0/3285474615 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e44017d10 con 0x7f2e48102220 2024-04-20T12:30:16.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.129+0000 7f2e4fe5c640 1 -- 172.21.15.135:0/3285474615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e481a57f0 con 0x7f2e48102220 2024-04-20T12:30:16.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.132+0000 7f2e3effd640 1 -- 172.21.15.135:0/3285474615 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f2e44017070 con 0x7f2e48102220 2024-04-20T12:30:16.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.132+0000 7f2e52a4d740 1 Processor -- start 2024-04-20T12:30:16.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.132+0000 7f2e52a4d740 1 -- start start 2024-04-20T12:30:16.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.132+0000 7f2e52a4d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e7e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.132+0000 7f2e52a4d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7e640 0x55d8b2e86ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.132+0000 7f2e52a4d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 0x55d8b2e89610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.132+0000 7f2e52a4d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d8b2de31b0 con 0x55d8b2e7dd20 2024-04-20T12:30:16.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.132+0000 7f2e52a4d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d8b2d80390 con 0x55d8b2e87220 2024-04-20T12:30:16.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.132+0000 7f2e52a4d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d8b2ddf170 con 0x55d8b2e7e640 2024-04-20T12:30:16.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.132+0000 7f2e4e3f9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e7e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.132+0000 7f2e4e3f9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e7e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56842/0 (socket says 172.21.15.135:56842) 2024-04-20T12:30:16.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.132+0000 7f2e4e3f9640 1 -- 172.21.15.135:0/1039623968 learned_addr learned my addr 172.21.15.135:0/1039623968 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.132+0000 7f2e4d3f7640 1 --2- 172.21.15.135:0/1039623968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 0x55d8b2e89610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.133+0000 7f2e4dbf8640 1 --2- 172.21.15.135:0/1039623968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7e640 0x55d8b2e86ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.133+0000 7f2e3effd640 1 --2- 172.21.15.135:0/3285474615 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2e340a3d20 0x7f2e340a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.133+0000 7f2e4d3f7640 1 -- 172.21.15.135:0/1039623968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7e640 msgr2=0x55d8b2e86ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.133+0000 7f2e4d3f7640 1 --2- 172.21.15.135:0/1039623968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7e640 0x55d8b2e86ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.133+0000 7f2e4d3f7640 1 -- 172.21.15.135:0/1039623968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7dd20 msgr2=0x55d8b2e7e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.133+0000 7f2e4d3f7640 1 --2- 172.21.15.135:0/1039623968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e7e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.133+0000 7f2e4d3f7640 1 -- 172.21.15.135:0/1039623968 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b2bbf7d0 con 0x55d8b2e87220 2024-04-20T12:30:16.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.133+0000 7f2e4e3f9640 1 --2- 172.21.15.135:0/1039623968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e7e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:30:16.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.133+0000 7f2e4e3f9640 1 --2- 172.21.15.135:0/3285474615 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2e340a3d20 0x7f2e340a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.133+0000 7f2e3effd640 1 -- 172.21.15.135:0/3285474615 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f2e440cfeb0 con 0x7f2e48102220 2024-04-20T12:30:16.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.133+0000 7f2e4d3f7640 1 --2- 172.21.15.135:0/1039623968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 0x55d8b2e89610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2e48199ae0 tx=0x7f2e380117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35f9bc7565a15521 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.133+0000 7f2e33fff640 1 -- 172.21.15.135:0/1039623968 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38012450 con 0x55d8b2e87220 2024-04-20T12:30:16.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.133+0000 7f2e4e3f9640 1 --2- 172.21.15.135:0/3285474615 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2e340a3d20 0x7f2e340a61e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2e40037040 tx=0x7f2e4002e040 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.133+0000 7f2e33fff640 1 -- 172.21.15.135:0/1039623968 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e38012ad0 con 0x55d8b2e87220 2024-04-20T12:30:16.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.133+0000 7f2e33fff640 1 -- 172.21.15.135:0/1039623968 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800fa90 con 0x55d8b2e87220 2024-04-20T12:30:16.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.134+0000 7f2e52a4d740 1 -- 172.21.15.135:0/1039623968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 msgr2=0x55d8b2e89610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.134+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/1039623968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 0x55d8b2e89610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2e48199ae0 tx=0x7f2e380117b0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.134+0000 7f2e52a4d740 1 -- 172.21.15.135:0/1039623968 shutdown_connections 2024-04-20T12:30:16.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.134+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/1039623968 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 0x55d8b2e89610 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.134+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/1039623968 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7e640 0x55d8b2e86ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.134+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/1039623968 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e7e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.134+0000 7f2e52a4d740 1 -- 172.21.15.135:0/1039623968 >> 172.21.15.135:0/1039623968 conn(0x55d8b2e78450 msgr2=0x55d8b2e78830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.134+0000 7f2e52a4d740 1 -- 172.21.15.135:0/1039623968 shutdown_connections 2024-04-20T12:30:16.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.134+0000 7f2e52a4d740 1 -- 172.21.15.135:0/1039623968 wait complete. 2024-04-20T12:30:16.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.134+0000 7f2e52a4d740 1 -- start start 2024-04-20T12:30:16.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.134+0000 7f2e52a4d740 1 Processor -- start 2024-04-20T12:30:16.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e52a4d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e84250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e52a4d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7e640 0x55d8b2e84790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e52a4d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 0x55d8b2e84cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e52a4d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d8b2e8a010 con 0x55d8b2e7dd20 2024-04-20T12:30:16.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e52a4d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d8b2d9c2f0 con 0x55d8b2e87220 2024-04-20T12:30:16.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e52a4d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d8b2e8a190 con 0x55d8b2e7e640 2024-04-20T12:30:16.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e52a4d740 10 client.0 _ll_register_callbacks cb 0x55d8b2d664e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:16.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e4dbf8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e84250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e4dbf8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e84250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56854/0 (socket says 172.21.15.135:56854) 2024-04-20T12:30:16.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e4dbf8640 1 -- 172.21.15.135:0/4226761243 learned_addr learned my addr 172.21.15.135:0/4226761243 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e4e3f9640 1 --2- 172.21.15.135:0/4226761243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 0x55d8b2e84cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e4dbf8640 1 -- 172.21.15.135:0/4226761243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7e640 msgr2=0x55d8b2e84790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e4dbf8640 1 --2- 172.21.15.135:0/4226761243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7e640 0x55d8b2e84790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e4dbf8640 1 -- 172.21.15.135:0/4226761243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 msgr2=0x55d8b2e84cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e4dbf8640 1 --2- 172.21.15.135:0/4226761243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 0x55d8b2e84cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e4dbf8640 1 -- 172.21.15.135:0/4226761243 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b2af53f0 con 0x55d8b2e7dd20 2024-04-20T12:30:16.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e4dbf8640 1 --2- 172.21.15.135:0/4226761243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e84250 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2e440cd340 tx=0x7f2e44017eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce91de745b08b23 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.135+0000 7f2e317fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:16.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.136+0000 7f2e317fa640 1 -- 172.21.15.135:0/4226761243 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4401e070 con 0x55d8b2e7dd20 2024-04-20T12:30:16.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.136+0000 7f2e317fa640 1 -- 172.21.15.135:0/4226761243 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f2e44010ca0 con 0x55d8b2e7dd20 2024-04-20T12:30:16.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.136+0000 7f2e52a4d740 1 -- 172.21.15.135:0/4226761243 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e38012ad0 con 0x55d8b2e7dd20 2024-04-20T12:30:16.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.136+0000 7f2e317fa640 1 -- 172.21.15.135:0/4226761243 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2e4409ce60 con 0x55d8b2e7dd20 2024-04-20T12:30:16.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.136+0000 7f2e52a4d740 10 client.17769 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:16.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.136+0000 7f2e52a4d740 1 -- 172.21.15.135:0/4226761243 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d8b2ab50f0 con 0x55d8b2e7dd20 2024-04-20T12:30:16.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.136+0000 7f2e317fa640 1 -- 172.21.15.135:0/4226761243 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e38012ad0 con 0x55d8b2e7dd20 2024-04-20T12:30:16.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.136+0000 7f2e317fa640 1 -- 172.21.15.135:0/4226761243 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2e440cd450 con 0x55d8b2e7dd20 2024-04-20T12:30:16.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.136+0000 7f2e52a4d740 10 client.17769 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:16.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.136+0000 7f2e52a4d740 10 client.17769 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:16.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.136+0000 7f2e52a4d740 20 client.17769 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:16.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.136+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/4226761243 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d8b2e975a0 0x55d8b2e99a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.136+0000 7f2e52a4d740 4 client.17769 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:16.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.136+0000 7f2e52a4d740 1 -- 172.21.15.135:0/4226761243 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8b2df0bd0 con 0x55d8b2e975a0 2024-04-20T12:30:16.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.136+0000 7f2e4d3f7640 1 --2- 172.21.15.135:0/4226761243 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d8b2e975a0 0x55d8b2e99a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.137+0000 7f2e4d3f7640 1 --2- 172.21.15.135:0/4226761243 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d8b2e975a0 0x55d8b2e99a30 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cce9fb50f76775b server_cookie=3cbee9b9c0ca7f60 in_seq=0 out_seq=0 2024-04-20T12:30:16.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.137+0000 7f2e317fa640 10 client.17769 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:16.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.138+0000 7f2e317fa640 1 -- 172.21.15.135:0/4226761243 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d8b2df0bd0 con 0x55d8b2e975a0 2024-04-20T12:30:16.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.138+0000 7f2e317fa640 10 client.17769 handle_command_reply: tid=0 2024-04-20T12:30:16.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.138+0000 7f2e52a4d740 1 client.17769 shutdown 2024-04-20T12:30:16.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.138+0000 7f2e52a4d740 1 -- 172.21.15.135:0/4226761243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7dd20 msgr2=0x55d8b2e84250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.138+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/4226761243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e84250 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2e440cd340 tx=0x7f2e44017eb0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.138+0000 7f2e52a4d740 1 -- 172.21.15.135:0/4226761243 shutdown_connections 2024-04-20T12:30:16.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.138+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/4226761243 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d8b2e975a0 0x55d8b2e99a30 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.138+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/4226761243 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 0x55d8b2e84cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.138+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/4226761243 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7e640 0x55d8b2e84790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.138+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/4226761243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e84250 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.138+0000 7f2e317fa640 0 client.17769 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:16.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.138+0000 7f2e52a4d740 1 -- 172.21.15.135:0/4226761243 >> 172.21.15.135:0/4226761243 conn(0x55d8b2e78450 msgr2=0x55d8b2e7a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.138+0000 7f2e52a4d740 1 -- 172.21.15.135:0/4226761243 shutdown_connections 2024-04-20T12:30:16.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.138+0000 7f2e52a4d740 1 -- 172.21.15.135:0/4226761243 wait complete. 2024-04-20T12:30:16.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.138+0000 7f2e52a4d740 20 client.17769 trim_cache size 0 max 16384 2024-04-20T12:30:16.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e52a4d740 1 Processor -- start 2024-04-20T12:30:16.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e52a4d740 1 -- start start 2024-04-20T12:30:16.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e52a4d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e92ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e52a4d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7e640 0x55d8b2e7ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e52a4d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e87220 0x55d8b2e8f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e52a4d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e481af6e0 con 0x55d8b2e87220 2024-04-20T12:30:16.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e52a4d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2e481b1220 con 0x55d8b2e7dd20 2024-04-20T12:30:16.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e52a4d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e481afdb0 con 0x55d8b2e7e640 2024-04-20T12:30:16.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e4e3f9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e87220 0x55d8b2e8f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e4e3f9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e87220 0x55d8b2e8f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56856/0 (socket says 172.21.15.135:56856) 2024-04-20T12:30:16.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e4e3f9640 1 -- 172.21.15.135:0/3942936421 learned_addr learned my addr 172.21.15.135:0/3942936421 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e4dbf8640 1 --2- 172.21.15.135:0/3942936421 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e92ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e4d3f7640 1 --2- 172.21.15.135:0/3942936421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7e640 0x55d8b2e7ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e4e3f9640 1 -- 172.21.15.135:0/3942936421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7e640 msgr2=0x55d8b2e7ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e4e3f9640 1 --2- 172.21.15.135:0/3942936421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7e640 0x55d8b2e7ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e4e3f9640 1 -- 172.21.15.135:0/3942936421 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e7dd20 msgr2=0x55d8b2e92ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e4e3f9640 1 --2- 172.21.15.135:0/3942936421 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e92ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e4e3f9640 1 -- 172.21.15.135:0/3942936421 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b2e83200 con 0x55d8b2e87220 2024-04-20T12:30:16.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.156+0000 7f2e4e3f9640 1 --2- 172.21.15.135:0/3942936421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e87220 0x55d8b2e8f7c0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009ca0 tx=0x7f2e40041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d011a1822ac19b7e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.157+0000 7f2e337fe640 1 -- 172.21.15.135:0/3942936421 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e40039040 con 0x55d8b2e87220 2024-04-20T12:30:16.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.157+0000 7f2e337fe640 1 -- 172.21.15.135:0/3942936421 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e40053070 con 0x55d8b2e87220 2024-04-20T12:30:16.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.157+0000 7f2e337fe640 1 -- 172.21.15.135:0/3942936421 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4004e6f0 con 0x55d8b2e87220 2024-04-20T12:30:16.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.157+0000 7f2e52a4d740 1 -- 172.21.15.135:0/3942936421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e87220 msgr2=0x55d8b2e8f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.157+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/3942936421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e87220 0x55d8b2e8f7c0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009ca0 tx=0x7f2e40041000 comp rx=0 tx=0).stop 2024-04-20T12:30:16.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.157+0000 7f2e52a4d740 1 -- 172.21.15.135:0/3942936421 shutdown_connections 2024-04-20T12:30:16.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.157+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/3942936421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e87220 0x55d8b2e8f7c0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.157+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/3942936421 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7e640 0x55d8b2e7ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.157+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/3942936421 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e7dd20 0x55d8b2e92ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.157+0000 7f2e52a4d740 1 -- 172.21.15.135:0/3942936421 >> 172.21.15.135:0/3942936421 conn(0x55d8b2e78450 msgr2=0x55d8b2e77630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.157+0000 7f2e52a4d740 1 -- 172.21.15.135:0/3942936421 shutdown_connections 2024-04-20T12:30:16.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.157+0000 7f2e52a4d740 1 -- 172.21.15.135:0/3942936421 wait complete. 2024-04-20T12:30:16.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e52a4d740 1 -- start start 2024-04-20T12:30:16.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e52a4d740 1 Processor -- start 2024-04-20T12:30:16.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e52a4d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7dd20 0x55d8b2ef5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e52a4d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7e640 0x55d8b2ef60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e52a4d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 0x55d8b2ef6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e52a4d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e481b0b50 con 0x55d8b2e7e640 2024-04-20T12:30:16.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e52a4d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2e481b0480 con 0x55d8b2e87220 2024-04-20T12:30:16.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e52a4d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2e481ad6d0 con 0x55d8b2e7dd20 2024-04-20T12:30:16.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e52a4d740 10 client.0 _ll_register_callbacks cb 0x7f2e4400b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:16.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e4d3f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7e640 0x55d8b2ef60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e4d3f7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7e640 0x55d8b2ef60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56866/0 (socket says 172.21.15.135:56866) 2024-04-20T12:30:16.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e4d3f7640 1 -- 172.21.15.135:0/3639020622 learned_addr learned my addr 172.21.15.135:0/3639020622 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e4dbf8640 1 --2- 172.21.15.135:0/3639020622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7dd20 0x55d8b2ef5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e4e3f9640 1 --2- 172.21.15.135:0/3639020622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 0x55d8b2ef6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e4d3f7640 1 -- 172.21.15.135:0/3639020622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7dd20 msgr2=0x55d8b2ef5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e4d3f7640 1 --2- 172.21.15.135:0/3639020622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7dd20 0x55d8b2ef5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e4d3f7640 1 -- 172.21.15.135:0/3639020622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 msgr2=0x55d8b2ef6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e4d3f7640 1 --2- 172.21.15.135:0/3639020622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 0x55d8b2ef6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e4d3f7640 1 -- 172.21.15.135:0/3639020622 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b2f00ea0 con 0x55d8b2e7e640 2024-04-20T12:30:16.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.158+0000 7f2e4dbf8640 1 --2- 172.21.15.135:0/3639020622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7dd20 0x55d8b2ef5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:16.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e4d3f7640 1 --2- 172.21.15.135:0/3639020622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7e640 0x55d8b2ef60c0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x55d8b2e795e0 tx=0x7f2e38009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921beb28856a149f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e317fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:16.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e317fa640 1 -- 172.21.15.135:0/3639020622 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3802f070 con 0x55d8b2e7e640 2024-04-20T12:30:16.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e317fa640 1 -- 172.21.15.135:0/3639020622 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f2e380095a0 con 0x55d8b2e7e640 2024-04-20T12:30:16.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e52a4d740 1 -- 172.21.15.135:0/3639020622 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e40053070 con 0x55d8b2e7e640 2024-04-20T12:30:16.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e317fa640 1 -- 172.21.15.135:0/3639020622 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2e3803b050 con 0x55d8b2e7e640 2024-04-20T12:30:16.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e52a4d740 10 client.17775 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:16.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e52a4d740 1 -- 172.21.15.135:0/3639020622 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d8b2f021b0 con 0x55d8b2e7e640 2024-04-20T12:30:16.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e317fa640 1 -- 172.21.15.135:0/3639020622 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e40053070 con 0x55d8b2e7e640 2024-04-20T12:30:16.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e317fa640 1 -- 172.21.15.135:0/3639020622 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2e38012570 con 0x55d8b2e7e640 2024-04-20T12:30:16.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e52a4d740 10 client.17775 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:16.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e52a4d740 10 client.17775 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:16.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e52a4d740 20 client.17775 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:16.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/3639020622 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d8b2f026d0 0x55d8b2f04af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e52a4d740 4 client.17775 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:30:16.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.159+0000 7f2e52a4d740 1 -- 172.21.15.135:0/3639020622 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d8b2deaa40 con 0x55d8b2f026d0 2024-04-20T12:30:16.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e4dbf8640 1 --2- 172.21.15.135:0/3639020622 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d8b2f026d0 0x55d8b2f04af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e4dbf8640 1 --2- 172.21.15.135:0/3639020622 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d8b2f026d0 0x55d8b2f04af0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6dc53761a684ade server_cookie=25711dc834f09d84 in_seq=0 out_seq=0 2024-04-20T12:30:16.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e317fa640 10 client.17775 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:16.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e317fa640 1 -- 172.21.15.135:0/3639020622 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d8b2deaa40 con 0x55d8b2f026d0 2024-04-20T12:30:16.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e317fa640 10 client.17775 handle_command_reply: tid=0 2024-04-20T12:30:16.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e52a4d740 1 client.17775 shutdown 2024-04-20T12:30:16.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e52a4d740 1 -- 172.21.15.135:0/3639020622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7e640 msgr2=0x55d8b2ef60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/3639020622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7e640 0x55d8b2ef60c0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x55d8b2e795e0 tx=0x7f2e38009530 comp rx=0 tx=0).stop 2024-04-20T12:30:16.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e52a4d740 1 -- 172.21.15.135:0/3639020622 shutdown_connections 2024-04-20T12:30:16.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/3639020622 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d8b2f026d0 0x55d8b2f04af0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/3639020622 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d8b2e87220 0x55d8b2ef6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/3639020622 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d8b2e7e640 0x55d8b2ef60c0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e52a4d740 1 --2- 172.21.15.135:0/3639020622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d8b2e7dd20 0x55d8b2ef5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e317fa640 0 client.17775 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:16.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e52a4d740 1 -- 172.21.15.135:0/3639020622 >> 172.21.15.135:0/3639020622 conn(0x55d8b2e78450 msgr2=0x55d8b2e79610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e52a4d740 1 -- 172.21.15.135:0/3639020622 shutdown_connections 2024-04-20T12:30:16.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.160+0000 7f2e52a4d740 1 -- 172.21.15.135:0/3639020622 wait complete. 2024-04-20T12:30:16.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.161+0000 7f2e52a4d740 20 client.17775 trim_cache size 0 max 16384 2024-04-20T12:30:16.169 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:30:16.169 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:30:16.169 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:30:16.169 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:30:16.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.161+0000 7f2e4fe5c640 1 -- 172.21.15.135:0/3285474615 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2e340a3d20 msgr2=0x7f2e340a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.161+0000 7f2e4fe5c640 1 --2- 172.21.15.135:0/3285474615 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2e340a3d20 0x7f2e340a61e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2e40037040 tx=0x7f2e4002e040 comp rx=0 tx=0).stop 2024-04-20T12:30:16.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.161+0000 7f2e4fe5c640 1 -- 172.21.15.135:0/3285474615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e48102220 msgr2=0x7f2e4819e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.161+0000 7f2e4fe5c640 1 --2- 172.21.15.135:0/3285474615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e48102220 0x7f2e4819e620 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400b4a0 tx=0x7f2e4400b960 comp rx=0 tx=0).stop 2024-04-20T12:30:16.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.161+0000 7f2e4fe5c640 1 -- 172.21.15.135:0/3285474615 shutdown_connections 2024-04-20T12:30:16.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.161+0000 7f2e4fe5c640 1 --2- 172.21.15.135:0/3285474615 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2e340a3d20 0x7f2e340a61e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.161+0000 7f2e4fe5c640 1 --2- 172.21.15.135:0/3285474615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e481987e0 0x7f2e48198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.161+0000 7f2e4fe5c640 1 --2- 172.21.15.135:0/3285474615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2e481072f0 0x7f2e4819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.161+0000 7f2e4fe5c640 1 --2- 172.21.15.135:0/3285474615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e48102220 0x7f2e4819e620 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.161+0000 7f2e4fe5c640 1 -- 172.21.15.135:0/3285474615 >> 172.21.15.135:0/3285474615 conn(0x7f2e480fdac0 msgr2=0x7f2e480ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.161+0000 7f2e4fe5c640 1 -- 172.21.15.135:0/3285474615 shutdown_connections 2024-04-20T12:30:16.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.161+0000 7f2e4fe5c640 1 -- 172.21.15.135:0/3285474615 wait complete. 2024-04-20T12:30:16.172 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:30:16.172 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:30:16.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.271+0000 7f21d9175640 1 -- 172.21.15.135:0/699280451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d4102b50 msgr2=0x7f21d4106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.271+0000 7f21d9175640 1 --2- 172.21.15.135:0/699280451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d4102b50 0x7f21d4106b90 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009900 tx=0x7f21c802bc30 comp rx=0 tx=0).stop 2024-04-20T12:30:16.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.271+0000 7f21d9175640 1 -- 172.21.15.135:0/699280451 shutdown_connections 2024-04-20T12:30:16.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.271+0000 7f21d9175640 1 --2- 172.21.15.135:0/699280451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4107270 0x7f21d410ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.271+0000 7f21d9175640 1 --2- 172.21.15.135:0/699280451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d4102b50 0x7f21d4106b90 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.271+0000 7f21d9175640 1 --2- 172.21.15.135:0/699280451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d41021a0 0x7f21d4102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.271+0000 7f21d9175640 1 -- 172.21.15.135:0/699280451 >> 172.21.15.135:0/699280451 conn(0x7f21d4079320 msgr2=0x7f21d4079730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.271+0000 7f21d9175640 1 -- 172.21.15.135:0/699280451 shutdown_connections 2024-04-20T12:30:16.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.271+0000 7f21d9175640 1 -- 172.21.15.135:0/699280451 wait complete. 2024-04-20T12:30:16.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.271+0000 7f21d9175640 1 Processor -- start 2024-04-20T12:30:16.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d9175640 1 -- start start 2024-04-20T12:30:16.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d9175640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d41021a0 0x7f21d419e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d9175640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d4107270 0x7f21d419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d9175640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4198740 0x7f21d4198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d9175640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f21d4112360 con 0x7f21d41021a0 2024-04-20T12:30:16.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d9175640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41121e0 con 0x7f21d4107270 2024-04-20T12:30:16.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d9175640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21d41124e0 con 0x7f21d4198740 2024-04-20T12:30:16.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d41021a0 0x7f21d419e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d41021a0 0x7f21d419e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56880/0 (socket says 172.21.15.135:56880) 2024-04-20T12:30:16.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d2d9d640 1 -- 172.21.15.135:0/1512937746 learned_addr learned my addr 172.21.15.135:0/1512937746 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d259c640 1 --2- 172.21.15.135:0/1512937746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d4107270 0x7f21d419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d2d9d640 1 -- 172.21.15.135:0/1512937746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4198740 msgr2=0x7f21d4198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d2d9d640 1 --2- 172.21.15.135:0/1512937746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4198740 0x7f21d4198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d2d9d640 1 -- 172.21.15.135:0/1512937746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d4107270 msgr2=0x7f21d419eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d2d9d640 1 --2- 172.21.15.135:0/1512937746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d4107270 0x7f21d419eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d2d9d640 1 -- 172.21.15.135:0/1512937746 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d4199340 con 0x7f21d41021a0 2024-04-20T12:30:16.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d259c640 1 --2- 172.21.15.135:0/1512937746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d4107270 0x7f21d419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:16.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21d2d9d640 1 --2- 172.21.15.135:0/1512937746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d41021a0 0x7f21d419e630 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f21c400d950 tx=0x7f21c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.272+0000 7f21bbfff640 1 -- 172.21.15.135:0/1512937746 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4017070 con 0x7f21d41021a0 2024-04-20T12:30:16.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.273+0000 7f21bbfff640 1 -- 172.21.15.135:0/1512937746 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21c4009c30 con 0x7f21d41021a0 2024-04-20T12:30:16.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.273+0000 7f21d9175640 1 -- 172.21.15.135:0/1512937746 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d41a53d0 con 0x7f21d41021a0 2024-04-20T12:30:16.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.273+0000 7f21d9175640 1 -- 172.21.15.135:0/1512937746 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d41a5780 con 0x7f21d41021a0 2024-04-20T12:30:16.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.273+0000 7f21bbfff640 1 -- 172.21.15.135:0/1512937746 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c400f6b0 con 0x7f21d41021a0 2024-04-20T12:30:16.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.273+0000 7f21d9175640 1 -- 172.21.15.135:0/1512937746 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d4103670 con 0x7f21d41021a0 2024-04-20T12:30:16.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.275+0000 7f21bbfff640 1 -- 172.21.15.135:0/1512937746 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f21c40109d0 con 0x7f21d41021a0 2024-04-20T12:30:16.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.275+0000 7f21bbfff640 1 --2- 172.21.15.135:0/1512937746 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21bc0a3d20 0x7f21bc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.276+0000 7f21d259c640 1 --2- 172.21.15.135:0/1512937746 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21bc0a3d20 0x7f21bc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.276+0000 7f21bbfff640 1 -- 172.21.15.135:0/1512937746 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f21c40d0cb0 con 0x7f21d41021a0 2024-04-20T12:30:16.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.276+0000 7f21d259c640 1 --2- 172.21.15.135:0/1512937746 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21bc0a3d20 0x7f21bc0a61e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f21c8006010 tx=0x7f21c802c880 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.279+0000 7f21bbfff640 1 -- 172.21.15.135:0/1512937746 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f21c4009de0 con 0x7f21d41021a0 2024-04-20T12:30:16.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.497+0000 7f21d9175640 1 -- 172.21.15.135:0/1512937746 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21d4102b50 con 0x7f21d41021a0 2024-04-20T12:30:16.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.497+0000 7f21bbfff640 1 -- 172.21.15.135:0/1512937746 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7f21c409cec0 con 0x7f21d41021a0 2024-04-20T12:30:16.497 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:30:16.497 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:30:16.498 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:30:16.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.499+0000 7f21d9175640 1 -- 172.21.15.135:0/1512937746 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21bc0a3d20 msgr2=0x7f21bc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.499+0000 7f21d9175640 1 --2- 172.21.15.135:0/1512937746 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21bc0a3d20 0x7f21bc0a61e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f21c8006010 tx=0x7f21c802c880 comp rx=0 tx=0).stop 2024-04-20T12:30:16.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.499+0000 7f21d9175640 1 -- 172.21.15.135:0/1512937746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d41021a0 msgr2=0x7f21d419e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.499+0000 7f21d9175640 1 --2- 172.21.15.135:0/1512937746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d41021a0 0x7f21d419e630 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f21c400d950 tx=0x7f21c400de10 comp rx=0 tx=0).stop 2024-04-20T12:30:16.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.499+0000 7f21d9175640 1 -- 172.21.15.135:0/1512937746 shutdown_connections 2024-04-20T12:30:16.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.499+0000 7f21d9175640 1 --2- 172.21.15.135:0/1512937746 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21bc0a3d20 0x7f21bc0a61e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.499+0000 7f21d9175640 1 --2- 172.21.15.135:0/1512937746 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21d4198740 0x7f21d4198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.499+0000 7f21d9175640 1 --2- 172.21.15.135:0/1512937746 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f21d4107270 0x7f21d419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.499+0000 7f21d9175640 1 --2- 172.21.15.135:0/1512937746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d41021a0 0x7f21d419e630 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.499+0000 7f21d9175640 1 -- 172.21.15.135:0/1512937746 >> 172.21.15.135:0/1512937746 conn(0x7f21d4079320 msgr2=0x7f21d4100100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.500+0000 7f21d9175640 1 -- 172.21.15.135:0/1512937746 shutdown_connections 2024-04-20T12:30:16.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.500+0000 7f21d9175640 1 -- 172.21.15.135:0/1512937746 wait complete. 2024-04-20T12:30:16.511 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:30:16.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.611+0000 7f5cf1f24640 1 -- 172.21.15.135:0/3367914696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cec1010c0 msgr2=0x7f5cec1014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.611+0000 7f5cf1f24640 1 --2- 172.21.15.135:0/3367914696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cec1010c0 0x7f5cec1014a0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009900 tx=0x7f5cdc02bc30 comp rx=0 tx=0).stop 2024-04-20T12:30:16.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.611+0000 7f5cf1f24640 1 -- 172.21.15.135:0/3367914696 shutdown_connections 2024-04-20T12:30:16.613 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.611+0000 7f5cf1f24640 1 --2- 172.21.15.135:0/3367914696 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cec106190 0x7f5cec10dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.611+0000 7f5cf1f24640 1 --2- 172.21.15.135:0/3367914696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cec101a70 0x7f5cec105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.611+0000 7f5cf1f24640 1 --2- 172.21.15.135:0/3367914696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cec1010c0 0x7f5cec1014a0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.611+0000 7f5cf1f24640 1 -- 172.21.15.135:0/3367914696 >> 172.21.15.135:0/3367914696 conn(0x7f5cec0771e0 msgr2=0x7f5cec0775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.611+0000 7f5cf1f24640 1 -- 172.21.15.135:0/3367914696 shutdown_connections 2024-04-20T12:30:16.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.611+0000 7f5cf1f24640 1 -- 172.21.15.135:0/3367914696 wait complete. 2024-04-20T12:30:16.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5cf1f24640 1 Processor -- start 2024-04-20T12:30:16.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5cf1f24640 1 -- start start 2024-04-20T12:30:16.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5cf1f24640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cec1010c0 0x7f5cec19e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5cf1f24640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cec106190 0x7f5cec19e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5cf1f24640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cec198640 0x7f5cec198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5cf1f24640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec112360 con 0x7f5cec106190 2024-04-20T12:30:16.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5cf1f24640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec1121e0 con 0x7f5cec1010c0 2024-04-20T12:30:16.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5cf1f24640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec1124e0 con 0x7f5cec198640 2024-04-20T12:30:16.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5ceaffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cec106190 0x7f5cec19e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5ceaffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cec106190 0x7f5cec19e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56896/0 (socket says 172.21.15.135:56896) 2024-04-20T12:30:16.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5ceaffd640 1 -- 172.21.15.135:0/3141415216 learned_addr learned my addr 172.21.15.135:0/3141415216 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5ceb7fe640 1 --2- 172.21.15.135:0/3141415216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cec1010c0 0x7f5cec19e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5cebfff640 1 --2- 172.21.15.135:0/3141415216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cec198640 0x7f5cec198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5ceaffd640 1 -- 172.21.15.135:0/3141415216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cec198640 msgr2=0x7f5cec198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5ceaffd640 1 --2- 172.21.15.135:0/3141415216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cec198640 0x7f5cec198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5ceaffd640 1 -- 172.21.15.135:0/3141415216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cec1010c0 msgr2=0x7f5cec19e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5ceaffd640 1 --2- 172.21.15.135:0/3141415216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cec1010c0 0x7f5cec19e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.612+0000 7f5ceaffd640 1 -- 172.21.15.135:0/3141415216 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec199160 con 0x7f5cec106190 2024-04-20T12:30:16.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.613+0000 7f5ceaffd640 1 --2- 172.21.15.135:0/3141415216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cec106190 0x7f5cec19e980 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000e9f0 tx=0x7f5ce000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.613+0000 7f5ce8ff9640 1 -- 172.21.15.135:0/3141415216 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce000ccc0 con 0x7f5cec106190 2024-04-20T12:30:16.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.613+0000 7f5ce8ff9640 1 -- 172.21.15.135:0/3141415216 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ce0005500 con 0x7f5cec106190 2024-04-20T12:30:16.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.613+0000 7f5cf1f24640 1 -- 172.21.15.135:0/3141415216 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cec199450 con 0x7f5cec106190 2024-04-20T12:30:16.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.613+0000 7f5ce8ff9640 1 -- 172.21.15.135:0/3141415216 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0010690 con 0x7f5cec106190 2024-04-20T12:30:16.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.613+0000 7f5cf1f24640 1 -- 172.21.15.135:0/3141415216 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cec1a5600 con 0x7f5cec106190 2024-04-20T12:30:16.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5ce8ff9640 1 -- 172.21.15.135:0/3141415216 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f5ce00046c0 con 0x7f5cec106190 2024-04-20T12:30:16.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5cf4bf2740 1 Processor -- start 2024-04-20T12:30:16.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5cf4bf2740 1 -- start start 2024-04-20T12:30:16.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5cf4bf2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8bde10 0x55b0ee8be1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5cf4bf2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8be730 0x55b0ee8c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5cf4bf2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8c7310 0x55b0ee8c9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5cf4bf2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b0ee823110 con 0x55b0ee8be730 2024-04-20T12:30:16.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5cf4bf2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b0ee7c0550 con 0x55b0ee8bde10 2024-04-20T12:30:16.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5cf4bf2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b0ee81f0d0 con 0x55b0ee8c7310 2024-04-20T12:30:16.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5ceb7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8be730 0x55b0ee8c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5ceb7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8be730 0x55b0ee8c6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56910/0 (socket says 172.21.15.135:56910) 2024-04-20T12:30:16.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5ceb7fe640 1 -- 172.21.15.135:0/1130618887 learned_addr learned my addr 172.21.15.135:0/1130618887 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5ceaffd640 1 --2- 172.21.15.135:0/1130618887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8c7310 0x55b0ee8c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5cebfff640 1 --2- 172.21.15.135:0/1130618887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8bde10 0x55b0ee8be1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5ce8ff9640 1 --2- 172.21.15.135:0/3141415216 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5cd40a3d20 0x7f5cd40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5ceb7fe640 1 -- 172.21.15.135:0/1130618887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8c7310 msgr2=0x55b0ee8c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5ceb7fe640 1 --2- 172.21.15.135:0/1130618887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8c7310 0x55b0ee8c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5ceb7fe640 1 -- 172.21.15.135:0/1130618887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8bde10 msgr2=0x55b0ee8be1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5ceb7fe640 1 --2- 172.21.15.135:0/1130618887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8bde10 0x55b0ee8be1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5ceb7fe640 1 -- 172.21.15.135:0/1130618887 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0ee7e8900 con 0x55b0ee8be730 2024-04-20T12:30:16.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.616+0000 7f5cebfff640 1 --2- 172.21.15.135:0/3141415216 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5cd40a3d20 0x7f5cd40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.617+0000 7f5ce8ff9640 1 -- 172.21.15.135:0/3141415216 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f5ce00d0f80 con 0x7f5cec106190 2024-04-20T12:30:16.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.617+0000 7f5ceb7fe640 1 --2- 172.21.15.135:0/1130618887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8be730 0x55b0ee8c6dd0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc02cfd0 tx=0x7f5cdc005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd47bde1ad07322 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.617+0000 7f5cd1ffb640 1 -- 172.21.15.135:0/1130618887 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc042070 con 0x55b0ee8be730 2024-04-20T12:30:16.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.617+0000 7f5cd1ffb640 1 -- 172.21.15.135:0/1130618887 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cdc02ca80 con 0x55b0ee8be730 2024-04-20T12:30:16.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.617+0000 7f5cd1ffb640 1 -- 172.21.15.135:0/1130618887 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc004f00 con 0x55b0ee8be730 2024-04-20T12:30:16.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.617+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/1130618887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8be730 msgr2=0x55b0ee8c6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.617+0000 7f5cebfff640 1 --2- 172.21.15.135:0/3141415216 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5cd40a3d20 0x7f5cd40a61e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4005fd0 tx=0x7f5ce4004a40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.617+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/1130618887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8be730 0x55b0ee8c6dd0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc02cfd0 tx=0x7f5cdc005c00 comp rx=0 tx=0).stop 2024-04-20T12:30:16.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.617+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/1130618887 shutdown_connections 2024-04-20T12:30:16.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.617+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/1130618887 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8c7310 0x55b0ee8c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.617+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/1130618887 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8be730 0x55b0ee8c6dd0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.617+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/1130618887 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8bde10 0x55b0ee8be1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.617+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/1130618887 >> 172.21.15.135:0/1130618887 conn(0x55b0ee8b8540 msgr2=0x55b0ee8b8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/1130618887 shutdown_connections 2024-04-20T12:30:16.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/1130618887 wait complete. 2024-04-20T12:30:16.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5cf4bf2740 1 -- start start 2024-04-20T12:30:16.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5cf4bf2740 1 Processor -- start 2024-04-20T12:30:16.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5cf4bf2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8bde10 0x55b0ee8c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5cf4bf2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8be730 0x55b0ee8c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5cf4bf2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8c7310 0x55b0ee8c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5cf4bf2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b0ee8c9fe0 con 0x55b0ee8be730 2024-04-20T12:30:16.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5cf4bf2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b0ee7dc500 con 0x55b0ee8bde10 2024-04-20T12:30:16.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5cf4bf2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b0ee8ca160 con 0x55b0ee8c7310 2024-04-20T12:30:16.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5cf4bf2740 10 client.0 _ll_register_callbacks cb 0x55b0ee7c12f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:16.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5ceaffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8be730 0x55b0ee8c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5ceaffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8be730 0x55b0ee8c48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56920/0 (socket says 172.21.15.135:56920) 2024-04-20T12:30:16.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5ceaffd640 1 -- 172.21.15.135:0/284696016 learned_addr learned my addr 172.21.15.135:0/284696016 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5cebfff640 1 --2- 172.21.15.135:0/284696016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8c7310 0x55b0ee8c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.618+0000 7f5ceb7fe640 1 --2- 172.21.15.135:0/284696016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8bde10 0x55b0ee8c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5ceaffd640 1 -- 172.21.15.135:0/284696016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8c7310 msgr2=0x55b0ee8c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5ceaffd640 1 --2- 172.21.15.135:0/284696016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8c7310 0x55b0ee8c4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5ceaffd640 1 -- 172.21.15.135:0/284696016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8bde10 msgr2=0x55b0ee8c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5ceaffd640 1 --2- 172.21.15.135:0/284696016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8bde10 0x55b0ee8c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5ceaffd640 1 -- 172.21.15.135:0/284696016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0ee5353f0 con 0x55b0ee8be730 2024-04-20T12:30:16.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5ceaffd640 1 --2- 172.21.15.135:0/284696016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8be730 0x55b0ee8c48f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000c6a0 tx=0x7f5ce0099160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7b10e54b3b7267 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5ccaffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:16.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5ccaffd640 1 -- 172.21.15.135:0/284696016 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce009c630 con 0x55b0ee8be730 2024-04-20T12:30:16.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5ccaffd640 1 -- 172.21.15.135:0/284696016 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f5ce00a52d0 con 0x55b0ee8be730 2024-04-20T12:30:16.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/284696016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cdc02ca80 con 0x55b0ee8be730 2024-04-20T12:30:16.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5ccaffd640 1 -- 172.21.15.135:0/284696016 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5ce00056b0 con 0x55b0ee8be730 2024-04-20T12:30:16.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5cf4bf2740 10 client.17793 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:16.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/284696016 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b0ee5ff7d0 con 0x55b0ee8be730 2024-04-20T12:30:16.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5ccaffd640 1 -- 172.21.15.135:0/284696016 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cdc02ca80 con 0x55b0ee8be730 2024-04-20T12:30:16.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5ccaffd640 1 -- 172.21.15.135:0/284696016 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f5ce009bf40 con 0x55b0ee8be730 2024-04-20T12:30:16.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5cf4bf2740 10 client.17793 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:16.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.619+0000 7f5cf4bf2740 10 client.17793 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:30:16.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.620+0000 7f5cf4bf2740 20 client.17793 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:16.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.620+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/284696016 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55b0ee8d75d0 0x55b0ee8d99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.620+0000 7f5cf4bf2740 4 client.17793 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:16.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.620+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/284696016 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0ee830b30 con 0x55b0ee8d75d0 2024-04-20T12:30:16.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.620+0000 7f5ceb7fe640 1 --2- 172.21.15.135:0/284696016 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55b0ee8d75d0 0x55b0ee8d99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.620+0000 7f5ceb7fe640 1 --2- 172.21.15.135:0/284696016 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55b0ee8d75d0 0x55b0ee8d99c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1e5199e90559191a server_cookie=53f781e86d06e36f in_seq=0 out_seq=0 2024-04-20T12:30:16.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.620+0000 7f5ccaffd640 10 client.17793 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:30:16.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.620+0000 7f5ccaffd640 1 -- 172.21.15.135:0/284696016 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b0ee830b30 con 0x55b0ee8d75d0 2024-04-20T12:30:16.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.620+0000 7f5ccaffd640 10 client.17793 handle_command_reply: tid=0 2024-04-20T12:30:16.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.620+0000 7f5cf4bf2740 1 client.17793 shutdown 2024-04-20T12:30:16.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.621+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/284696016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8be730 msgr2=0x55b0ee8c48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.621+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/284696016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8be730 0x55b0ee8c48f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000c6a0 tx=0x7f5ce0099160 comp rx=0 tx=0).stop 2024-04-20T12:30:16.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.621+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/284696016 shutdown_connections 2024-04-20T12:30:16.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.621+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/284696016 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55b0ee8d75d0 0x55b0ee8d99c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.621+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/284696016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8c7310 0x55b0ee8c4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.621+0000 7f5ccaffd640 0 client.17793 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:30:16.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.621+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/284696016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8be730 0x55b0ee8c48f0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.621+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/284696016 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8bde10 0x55b0ee8c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.621+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/284696016 >> 172.21.15.135:0/284696016 conn(0x55b0ee8b8540 msgr2=0x55b0ee8ba290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.621+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/284696016 shutdown_connections 2024-04-20T12:30:16.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.621+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/284696016 wait complete. 2024-04-20T12:30:16.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.621+0000 7f5cf4bf2740 20 client.17793 trim_cache size 0 max 16384 2024-04-20T12:30:16.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.634+0000 7f5cf4bf2740 1 Processor -- start 2024-04-20T12:30:16.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.634+0000 7f5cf4bf2740 1 -- start start 2024-04-20T12:30:16.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.634+0000 7f5cf4bf2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8bde10 0x55b0ee8c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.634+0000 7f5cf4bf2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8be730 0x55b0ee8d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.634+0000 7f5cf4bf2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8c7310 0x55b0ee8df220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.634+0000 7f5cf4bf2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec1af510 con 0x55b0ee8c7310 2024-04-20T12:30:16.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.634+0000 7f5cf4bf2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec1b1050 con 0x55b0ee8be730 2024-04-20T12:30:16.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.634+0000 7f5cf4bf2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec1afbe0 con 0x55b0ee8bde10 2024-04-20T12:30:16.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.634+0000 7f5cebfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8c7310 0x55b0ee8df220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.634+0000 7f5cebfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8c7310 0x55b0ee8df220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56928/0 (socket says 172.21.15.135:56928) 2024-04-20T12:30:16.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.634+0000 7f5cebfff640 1 -- 172.21.15.135:0/2451818624 learned_addr learned my addr 172.21.15.135:0/2451818624 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.635+0000 7f5cebfff640 1 -- 172.21.15.135:0/2451818624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8bde10 msgr2=0x55b0ee8c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.635+0000 7f5cebfff640 1 --2- 172.21.15.135:0/2451818624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8bde10 0x55b0ee8c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.635+0000 7f5cebfff640 1 -- 172.21.15.135:0/2451818624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8be730 msgr2=0x55b0ee8d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.635+0000 7f5cebfff640 1 --2- 172.21.15.135:0/2451818624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8be730 0x55b0ee8d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.635+0000 7f5cebfff640 1 -- 172.21.15.135:0/2451818624 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0ee8d9ff0 con 0x55b0ee8c7310 2024-04-20T12:30:16.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.635+0000 7f5cebfff640 1 --2- 172.21.15.135:0/2451818624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8c7310 0x55b0ee8df220 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f5ce401f870 tx=0x7f5ce4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a786e490744577 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.635+0000 7f5cd17fa640 1 -- 172.21.15.135:0/2451818624 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce40139c0 con 0x55b0ee8c7310 2024-04-20T12:30:16.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.635+0000 7f5cd17fa640 1 -- 172.21.15.135:0/2451818624 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ce4017070 con 0x55b0ee8c7310 2024-04-20T12:30:16.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.635+0000 7f5cd17fa640 1 -- 172.21.15.135:0/2451818624 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce401e450 con 0x55b0ee8c7310 2024-04-20T12:30:16.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.635+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/2451818624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8c7310 msgr2=0x55b0ee8df220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.635+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/2451818624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8c7310 0x55b0ee8df220 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f5ce401f870 tx=0x7f5ce4015000 comp rx=0 tx=0).stop 2024-04-20T12:30:16.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/2451818624 shutdown_connections 2024-04-20T12:30:16.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/2451818624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8c7310 0x55b0ee8df220 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/2451818624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8be730 0x55b0ee8d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/2451818624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8bde10 0x55b0ee8c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/2451818624 >> 172.21.15.135:0/2451818624 conn(0x55b0ee8b8540 msgr2=0x55b0ee8b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/2451818624 shutdown_connections 2024-04-20T12:30:16.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/2451818624 wait complete. 2024-04-20T12:30:16.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 1 -- start start 2024-04-20T12:30:16.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 1 Processor -- start 2024-04-20T12:30:16.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8bde10 0x55b0ee8cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8be730 0x55b0ee8cab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8c7310 0x55b0ee8cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec1b0980 con 0x55b0ee8bde10 2024-04-20T12:30:16.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec1b02b0 con 0x55b0ee8be730 2024-04-20T12:30:16.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec1ad500 con 0x55b0ee8c7310 2024-04-20T12:30:16.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5cf4bf2740 10 client.0 _ll_register_callbacks cb 0x7f5ce000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:16.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5ceb7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8bde10 0x55b0ee8cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5ceb7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8bde10 0x55b0ee8cf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56940/0 (socket says 172.21.15.135:56940) 2024-04-20T12:30:16.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.636+0000 7f5ceb7fe640 1 -- 172.21.15.135:0/1707785957 learned_addr learned my addr 172.21.15.135:0/1707785957 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5cebfff640 1 --2- 172.21.15.135:0/1707785957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8c7310 0x55b0ee8cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5ceaffd640 1 --2- 172.21.15.135:0/1707785957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8be730 0x55b0ee8cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5ceb7fe640 1 -- 172.21.15.135:0/1707785957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8c7310 msgr2=0x55b0ee8cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5ceb7fe640 1 --2- 172.21.15.135:0/1707785957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8c7310 0x55b0ee8cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5ceb7fe640 1 -- 172.21.15.135:0/1707785957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8be730 msgr2=0x55b0ee8cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5ceb7fe640 1 --2- 172.21.15.135:0/1707785957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8be730 0x55b0ee8cab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5ceb7fe640 1 -- 172.21.15.135:0/1707785957 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0ee8cb8e0 con 0x55b0ee8bde10 2024-04-20T12:30:16.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5ceaffd640 1 --2- 172.21.15.135:0/1707785957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8be730 0x55b0ee8cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:16.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5ceb7fe640 1 --2- 172.21.15.135:0/1707785957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8bde10 0x55b0ee8cf7e0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc02cfd0 tx=0x7f5cdc005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ed8ebbc4b5d191 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5ccaffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:16.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5ccaffd640 1 -- 172.21.15.135:0/1707785957 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc042040 con 0x55b0ee8bde10 2024-04-20T12:30:16.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5ccaffd640 1 -- 172.21.15.135:0/1707785957 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f5cdc004a70 con 0x55b0ee8bde10 2024-04-20T12:30:16.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/1707785957 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ce4017070 con 0x55b0ee8bde10 2024-04-20T12:30:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5ccaffd640 1 -- 172.21.15.135:0/1707785957 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5cdc057050 con 0x55b0ee8bde10 2024-04-20T12:30:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5cf4bf2740 10 client.17799 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/1707785957 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b0ee93db20 con 0x55b0ee8bde10 2024-04-20T12:30:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.637+0000 7f5ccaffd640 1 -- 172.21.15.135:0/1707785957 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ce4017070 con 0x55b0ee8bde10 2024-04-20T12:30:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5ccaffd640 1 -- 172.21.15.135:0/1707785957 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f5cdc04ec30 con 0x55b0ee8bde10 2024-04-20T12:30:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 10 client.17799 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 10 client.17799 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:30:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 20 client.17799 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/1707785957 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55b0ee93de60 0x55b0ee940250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 4 client.17799 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:30:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/1707785957 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b0ee82a9a0 con 0x55b0ee93de60 2024-04-20T12:30:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5ceaffd640 1 --2- 172.21.15.135:0/1707785957 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55b0ee93de60 0x55b0ee940250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5ccaffd640 10 client.17799 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:30:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5ceaffd640 1 --2- 172.21.15.135:0/1707785957 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55b0ee93de60 0x55b0ee940250 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5bb4d7c08caf43cf server_cookie=c62a4c6eed5a40d8 in_seq=0 out_seq=0 2024-04-20T12:30:16.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5ccaffd640 1 -- 172.21.15.135:0/1707785957 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b0ee82a9a0 con 0x55b0ee93de60 2024-04-20T12:30:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5ccaffd640 10 client.17799 handle_command_reply: tid=0 2024-04-20T12:30:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 1 client.17799 shutdown 2024-04-20T12:30:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/1707785957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8bde10 msgr2=0x55b0ee8cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/1707785957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8bde10 0x55b0ee8cf7e0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc02cfd0 tx=0x7f5cdc005850 comp rx=0 tx=0).stop 2024-04-20T12:30:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/1707785957 shutdown_connections 2024-04-20T12:30:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/1707785957 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55b0ee93de60 0x55b0ee940250 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/1707785957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b0ee8c7310 0x55b0ee8cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/1707785957 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b0ee8be730 0x55b0ee8cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5ccaffd640 0 client.17799 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:30:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 1 --2- 172.21.15.135:0/1707785957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b0ee8bde10 0x55b0ee8cf7e0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/1707785957 >> 172.21.15.135:0/1707785957 conn(0x55b0ee8b8540 msgr2=0x55b0ee8b9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/1707785957 shutdown_connections 2024-04-20T12:30:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.638+0000 7f5cf4bf2740 1 -- 172.21.15.135:0/1707785957 wait complete. 2024-04-20T12:30:16.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.639+0000 7f5cf4bf2740 20 client.17799 trim_cache size 0 max 16384 2024-04-20T12:30:16.645 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:30:16.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.639+0000 7f5cf1f24640 1 -- 172.21.15.135:0/3141415216 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5cd40a3d20 msgr2=0x7f5cd40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.639+0000 7f5cf1f24640 1 --2- 172.21.15.135:0/3141415216 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5cd40a3d20 0x7f5cd40a61e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4005fd0 tx=0x7f5ce4004a40 comp rx=0 tx=0).stop 2024-04-20T12:30:16.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.639+0000 7f5cf1f24640 1 -- 172.21.15.135:0/3141415216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cec106190 msgr2=0x7f5cec19e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.639+0000 7f5cf1f24640 1 --2- 172.21.15.135:0/3141415216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cec106190 0x7f5cec19e980 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000e9f0 tx=0x7f5ce000eeb0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.639+0000 7f5cf1f24640 1 -- 172.21.15.135:0/3141415216 shutdown_connections 2024-04-20T12:30:16.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.639+0000 7f5cf1f24640 1 --2- 172.21.15.135:0/3141415216 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f5cd40a3d20 0x7f5cd40a61e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.639+0000 7f5cf1f24640 1 --2- 172.21.15.135:0/3141415216 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5cec198640 0x7f5cec198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.639+0000 7f5cf1f24640 1 --2- 172.21.15.135:0/3141415216 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5cec106190 0x7f5cec19e980 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.639+0000 7f5cf1f24640 1 --2- 172.21.15.135:0/3141415216 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f5cec1010c0 0x7f5cec19e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.639+0000 7f5cf1f24640 1 -- 172.21.15.135:0/3141415216 >> 172.21.15.135:0/3141415216 conn(0x7f5cec0771e0 msgr2=0x7f5cec0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.639+0000 7f5cf1f24640 1 -- 172.21.15.135:0/3141415216 shutdown_connections 2024-04-20T12:30:16.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.639+0000 7f5cf1f24640 1 -- 172.21.15.135:0/3141415216 wait complete. 2024-04-20T12:30:16.649 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:30:16.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.750+0000 7fe29dc5c640 1 -- 172.21.15.135:0/3397970710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe298102b60 msgr2=0x7fe298106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.750+0000 7fe29dc5c640 1 --2- 172.21.15.135:0/3397970710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe298102b60 0x7fe298106ba0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fe28c009900 tx=0x7fe28c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:30:16.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.750+0000 7fe29dc5c640 1 -- 172.21.15.135:0/3397970710 shutdown_connections 2024-04-20T12:30:16.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.750+0000 7fe29dc5c640 1 --2- 172.21.15.135:0/3397970710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe298107280 0x7fe29810ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.750+0000 7fe29dc5c640 1 --2- 172.21.15.135:0/3397970710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe298102b60 0x7fe298106ba0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.750+0000 7fe29dc5c640 1 --2- 172.21.15.135:0/3397970710 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2981021b0 0x7fe298102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.750+0000 7fe29dc5c640 1 -- 172.21.15.135:0/3397970710 >> 172.21.15.135:0/3397970710 conn(0x7fe2980793f0 msgr2=0x7fe298079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.750+0000 7fe29dc5c640 1 -- 172.21.15.135:0/3397970710 shutdown_connections 2024-04-20T12:30:16.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.750+0000 7fe29dc5c640 1 -- 172.21.15.135:0/3397970710 wait complete. 2024-04-20T12:30:16.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.751+0000 7fe29dc5c640 1 Processor -- start 2024-04-20T12:30:16.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.751+0000 7fe29dc5c640 1 -- start start 2024-04-20T12:30:16.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.751+0000 7fe29dc5c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2981021b0 0x7fe29819e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.751+0000 7fe29dc5c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe298107280 0x7fe29819e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.751+0000 7fe29dc5c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2981985f0 0x7fe298198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.751+0000 7fe29dc5c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe298112310 con 0x7fe2981985f0 2024-04-20T12:30:16.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.751+0000 7fe29dc5c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe298112190 con 0x7fe2981021b0 2024-04-20T12:30:16.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.751+0000 7fe29dc5c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe298112490 con 0x7fe298107280 2024-04-20T12:30:16.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe297fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2981985f0 0x7fe298198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.754 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe297fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2981985f0 0x7fe298198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56944/0 (socket says 172.21.15.135:56944) 2024-04-20T12:30:16.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe297fff640 1 -- 172.21.15.135:0/4020132020 learned_addr learned my addr 172.21.15.135:0/4020132020 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe296ffd640 1 --2- 172.21.15.135:0/4020132020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe298107280 0x7fe29819e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe2977fe640 1 --2- 172.21.15.135:0/4020132020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2981021b0 0x7fe29819e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe297fff640 1 -- 172.21.15.135:0/4020132020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe298107280 msgr2=0x7fe29819e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe297fff640 1 --2- 172.21.15.135:0/4020132020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe298107280 0x7fe29819e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe297fff640 1 -- 172.21.15.135:0/4020132020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2981021b0 msgr2=0x7fe29819e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe297fff640 1 --2- 172.21.15.135:0/4020132020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2981021b0 0x7fe29819e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe297fff640 1 -- 172.21.15.135:0/4020132020 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe298199110 con 0x7fe2981985f0 2024-04-20T12:30:16.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe297fff640 1 --2- 172.21.15.135:0/4020132020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2981985f0 0x7fe298198aa0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fe29000eb10 tx=0x7fe29000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe294ff9640 1 -- 172.21.15.135:0/4020132020 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290004b20 con 0x7fe2981985f0 2024-04-20T12:30:16.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe294ff9640 1 -- 172.21.15.135:0/4020132020 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe290004cc0 con 0x7fe2981985f0 2024-04-20T12:30:16.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe29dc5c640 1 -- 172.21.15.135:0/4020132020 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe298199400 con 0x7fe2981985f0 2024-04-20T12:30:16.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe294ff9640 1 -- 172.21.15.135:0/4020132020 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290010760 con 0x7fe2981985f0 2024-04-20T12:30:16.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.752+0000 7fe29dc5c640 1 -- 172.21.15.135:0/4020132020 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2981a5650 con 0x7fe2981985f0 2024-04-20T12:30:16.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.755+0000 7fe294ff9640 1 -- 172.21.15.135:0/4020132020 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fe290005020 con 0x7fe2981985f0 2024-04-20T12:30:16.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.755+0000 7fe2a0855740 1 Processor -- start 2024-04-20T12:30:16.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.755+0000 7fe2a0855740 1 -- start start 2024-04-20T12:30:16.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.755+0000 7fe2a0855740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890c7f0 0x556fc890cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.755+0000 7fe2a0855740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc890d1a0 0x556fc891a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.755+0000 7fe2a0855740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc891a720 0x556fc891cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.755+0000 7fe2a0855740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556fc8872110 con 0x556fc891a720 2024-04-20T12:30:16.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.755+0000 7fe2a0855740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556fc880f550 con 0x556fc890d1a0 2024-04-20T12:30:16.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.755+0000 7fe2a0855740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556fc886e0d0 con 0x556fc890c7f0 2024-04-20T12:30:16.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe296ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc891a720 0x556fc891cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe296ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc891a720 0x556fc891cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56960/0 (socket says 172.21.15.135:56960) 2024-04-20T12:30:16.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe296ffd640 1 -- 172.21.15.135:0/2391230059 learned_addr learned my addr 172.21.15.135:0/2391230059 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe2977fe640 1 --2- 172.21.15.135:0/2391230059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc890d1a0 0x556fc891a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe296ffd640 1 --2- 172.21.15.135:0/2391230059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890c7f0 0x556fc890cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe294ff9640 1 --2- 172.21.15.135:0/4020132020 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe2800a3d20 0x7fe2800a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe297fff640 1 --2- 172.21.15.135:0/4020132020 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe2800a3d20 0x7fe2800a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe296ffd640 1 -- 172.21.15.135:0/2391230059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890c7f0 msgr2=0x556fc890cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe296ffd640 1 --2- 172.21.15.135:0/2391230059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890c7f0 0x556fc890cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe296ffd640 1 -- 172.21.15.135:0/2391230059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc890d1a0 msgr2=0x556fc891a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe296ffd640 1 --2- 172.21.15.135:0/2391230059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc890d1a0 0x556fc891a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe296ffd640 1 -- 172.21.15.135:0/2391230059 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fc8837900 con 0x556fc891a720 2024-04-20T12:30:16.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe294ff9640 1 -- 172.21.15.135:0/4020132020 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7fe2900d1310 con 0x7fe2981985f0 2024-04-20T12:30:16.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe296ffd640 1 --2- 172.21.15.135:0/2391230059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc891a720 0x556fc891cb10 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fe28c005ec0 tx=0x7fe28c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa10f9d958c54102 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe27dffb640 1 -- 172.21.15.135:0/2391230059 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c004030 con 0x556fc891a720 2024-04-20T12:30:16.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe297fff640 1 --2- 172.21.15.135:0/4020132020 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe2800a3d20 0x7fe2800a61e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe29009cb80 tx=0x7fe29000efd0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe27dffb640 1 -- 172.21.15.135:0/2391230059 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe28c004ba0 con 0x556fc891a720 2024-04-20T12:30:16.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.756+0000 7fe27dffb640 1 -- 172.21.15.135:0/2391230059 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c005290 con 0x556fc891a720 2024-04-20T12:30:16.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.757+0000 7fe2a0855740 1 -- 172.21.15.135:0/2391230059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc891a720 msgr2=0x556fc891cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.757+0000 7fe2a0855740 1 --2- 172.21.15.135:0/2391230059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc891a720 0x556fc891cb10 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fe28c005ec0 tx=0x7fe28c005dd0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.757+0000 7fe2a0855740 1 -- 172.21.15.135:0/2391230059 shutdown_connections 2024-04-20T12:30:16.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.757+0000 7fe2a0855740 1 --2- 172.21.15.135:0/2391230059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc891a720 0x556fc891cb10 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.757+0000 7fe2a0855740 1 --2- 172.21.15.135:0/2391230059 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc890d1a0 0x556fc891a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.757+0000 7fe2a0855740 1 --2- 172.21.15.135:0/2391230059 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890c7f0 0x556fc890cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.757+0000 7fe2a0855740 1 -- 172.21.15.135:0/2391230059 >> 172.21.15.135:0/2391230059 conn(0x556fc8907540 msgr2=0x556fc8907920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.757+0000 7fe2a0855740 1 -- 172.21.15.135:0/2391230059 shutdown_connections 2024-04-20T12:30:16.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.757+0000 7fe2a0855740 1 -- 172.21.15.135:0/2391230059 wait complete. 2024-04-20T12:30:16.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.757+0000 7fe2a0855740 1 -- start start 2024-04-20T12:30:16.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2a0855740 1 Processor -- start 2024-04-20T12:30:16.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2a0855740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890c7f0 0x556fc8917720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2a0855740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc890d1a0 0x556fc8917c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2a0855740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc891a720 0x556fc89181a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2a0855740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556fc891d480 con 0x556fc890d1a0 2024-04-20T12:30:16.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2a0855740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556fc882b500 con 0x556fc891a720 2024-04-20T12:30:16.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2a0855740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556fc891d600 con 0x556fc890c7f0 2024-04-20T12:30:16.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2a0855740 10 client.0 _ll_register_callbacks cb 0x556fc88102f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:16.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc890d1a0 0x556fc8917c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2977fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc890d1a0 0x556fc8917c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56964/0 (socket says 172.21.15.135:56964) 2024-04-20T12:30:16.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2977fe640 1 -- 172.21.15.135:0/3472674534 learned_addr learned my addr 172.21.15.135:0/3472674534 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe296ffd640 1 --2- 172.21.15.135:0/3472674534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc891a720 0x556fc89181a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2977fe640 1 -- 172.21.15.135:0/3472674534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890c7f0 msgr2=0x556fc8917720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2977fe640 1 --2- 172.21.15.135:0/3472674534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890c7f0 0x556fc8917720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2977fe640 1 -- 172.21.15.135:0/3472674534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc891a720 msgr2=0x556fc89181a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2977fe640 1 --2- 172.21.15.135:0/3472674534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc891a720 0x556fc89181a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2977fe640 1 -- 172.21.15.135:0/3472674534 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fc85843f0 con 0x556fc890d1a0 2024-04-20T12:30:16.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe296ffd640 1 --2- 172.21.15.135:0/3472674534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc891a720 0x556fc89181a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:16.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe2977fe640 1 --2- 172.21.15.135:0/3472674534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc890d1a0 0x556fc8917c60 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe28800bf40 tx=0x7fe2880128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d13c91167b1283 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe276ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:16.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.758+0000 7fe276ffd640 1 -- 172.21.15.135:0/3472674534 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28801f060 con 0x556fc890d1a0 2024-04-20T12:30:16.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.759+0000 7fe2a0855740 1 -- 172.21.15.135:0/3472674534 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe28c004ba0 con 0x556fc890d1a0 2024-04-20T12:30:16.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.759+0000 7fe276ffd640 1 -- 172.21.15.135:0/3472674534 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7fe2880108a0 con 0x556fc890d1a0 2024-04-20T12:30:16.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.759+0000 7fe276ffd640 1 -- 172.21.15.135:0/3472674534 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe288026050 con 0x556fc890d1a0 2024-04-20T12:30:16.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.759+0000 7fe2a0855740 10 client.17811 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:16.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.759+0000 7fe2a0855740 1 -- 172.21.15.135:0/3472674534 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556fc864e7d0 con 0x556fc890d1a0 2024-04-20T12:30:16.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.759+0000 7fe276ffd640 1 -- 172.21.15.135:0/3472674534 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe28c004ba0 con 0x556fc890d1a0 2024-04-20T12:30:16.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.759+0000 7fe276ffd640 1 -- 172.21.15.135:0/3472674534 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe288019030 con 0x556fc890d1a0 2024-04-20T12:30:16.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.759+0000 7fe2a0855740 10 client.17811 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:16.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.759+0000 7fe2a0855740 10 client.17811 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:30:16.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.759+0000 7fe2a0855740 20 client.17811 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:16.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.759+0000 7fe2a0855740 1 --2- 172.21.15.135:0/3472674534 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x556fc892aa60 0x556fc892cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.759+0000 7fe2a0855740 4 client.17811 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:16.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.759+0000 7fe2a0855740 1 -- 172.21.15.135:0/3472674534 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fc887fb30 con 0x556fc892aa60 2024-04-20T12:30:16.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.759+0000 7fe296ffd640 1 --2- 172.21.15.135:0/3472674534 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x556fc892aa60 0x556fc892cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.760+0000 7fe296ffd640 1 --2- 172.21.15.135:0/3472674534 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x556fc892aa60 0x556fc892cec0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3e1be41339c6ab25 server_cookie=6a89fd336877479 in_seq=0 out_seq=0 2024-04-20T12:30:16.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.760+0000 7fe276ffd640 10 client.17811 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:30:16.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.760+0000 7fe276ffd640 1 -- 172.21.15.135:0/3472674534 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556fc887fb30 con 0x556fc892aa60 2024-04-20T12:30:16.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.760+0000 7fe276ffd640 10 client.17811 handle_command_reply: tid=0 2024-04-20T12:30:16.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.760+0000 7fe2a0855740 1 client.17811 shutdown 2024-04-20T12:30:16.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.761+0000 7fe2a0855740 1 -- 172.21.15.135:0/3472674534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc890d1a0 msgr2=0x556fc8917c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.761+0000 7fe2a0855740 1 --2- 172.21.15.135:0/3472674534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc890d1a0 0x556fc8917c60 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe28800bf40 tx=0x7fe2880128e0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.761+0000 7fe2a0855740 1 -- 172.21.15.135:0/3472674534 shutdown_connections 2024-04-20T12:30:16.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.761+0000 7fe2a0855740 1 --2- 172.21.15.135:0/3472674534 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x556fc892aa60 0x556fc892cec0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.761+0000 7fe2a0855740 1 --2- 172.21.15.135:0/3472674534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc891a720 0x556fc89181a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.761+0000 7fe276ffd640 0 client.17811 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:30:16.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.761+0000 7fe2a0855740 1 --2- 172.21.15.135:0/3472674534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc890d1a0 0x556fc8917c60 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.761+0000 7fe2a0855740 1 --2- 172.21.15.135:0/3472674534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890c7f0 0x556fc8917720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.761+0000 7fe2a0855740 1 -- 172.21.15.135:0/3472674534 >> 172.21.15.135:0/3472674534 conn(0x556fc8907540 msgr2=0x556fc8909290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.761+0000 7fe2a0855740 1 -- 172.21.15.135:0/3472674534 shutdown_connections 2024-04-20T12:30:16.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.761+0000 7fe2a0855740 1 -- 172.21.15.135:0/3472674534 wait complete. 2024-04-20T12:30:16.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.761+0000 7fe2a0855740 20 client.17811 trim_cache size 0 max 16384 2024-04-20T12:30:16.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe2a0855740 1 Processor -- start 2024-04-20T12:30:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe2a0855740 1 -- start start 2024-04-20T12:30:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe2a0855740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc890c7f0 0x556fc8919e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe2a0855740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890d1a0 0x556fc8926380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe2a0855740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc891a720 0x556fc8932790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe2a0855740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe2981ad410 con 0x556fc890c7f0 2024-04-20T12:30:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe2a0855740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe2981aef50 con 0x556fc891a720 2024-04-20T12:30:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe2a0855740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe2981adae0 con 0x556fc890d1a0 2024-04-20T12:30:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe296ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc890c7f0 0x556fc8919e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe296ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc890c7f0 0x556fc8919e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56974/0 (socket says 172.21.15.135:56974) 2024-04-20T12:30:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe296ffd640 1 -- 172.21.15.135:0/1830342443 learned_addr learned my addr 172.21.15.135:0/1830342443 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe296ffd640 1 -- 172.21.15.135:0/1830342443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890d1a0 msgr2=0x556fc8926380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe296ffd640 1 --2- 172.21.15.135:0/1830342443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890d1a0 0x556fc8926380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe296ffd640 1 -- 172.21.15.135:0/1830342443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc891a720 msgr2=0x556fc8932790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe296ffd640 1 --2- 172.21.15.135:0/1830342443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc891a720 0x556fc8932790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe296ffd640 1 -- 172.21.15.135:0/1830342443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fc8929660 con 0x556fc890c7f0 2024-04-20T12:30:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe296ffd640 1 --2- 172.21.15.135:0/1830342443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc890c7f0 0x556fc8919e50 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x556fc8908960 tx=0x7fe28c02cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3164d120dfd0b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.774+0000 7fe27d7fa640 1 -- 172.21.15.135:0/1830342443 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c054070 con 0x556fc890c7f0 2024-04-20T12:30:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.775+0000 7fe27d7fa640 1 -- 172.21.15.135:0/1830342443 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe28c0046c0 con 0x556fc890c7f0 2024-04-20T12:30:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.775+0000 7fe27d7fa640 1 -- 172.21.15.135:0/1830342443 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c003970 con 0x556fc890c7f0 2024-04-20T12:30:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.775+0000 7fe2a0855740 1 -- 172.21.15.135:0/1830342443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc890c7f0 msgr2=0x556fc8919e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.775+0000 7fe2a0855740 1 --2- 172.21.15.135:0/1830342443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc890c7f0 0x556fc8919e50 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x556fc8908960 tx=0x7fe28c02cea0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.775+0000 7fe2a0855740 1 -- 172.21.15.135:0/1830342443 shutdown_connections 2024-04-20T12:30:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.775+0000 7fe2a0855740 1 --2- 172.21.15.135:0/1830342443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc891a720 0x556fc8932790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.775+0000 7fe2a0855740 1 --2- 172.21.15.135:0/1830342443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890d1a0 0x556fc8926380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.775+0000 7fe2a0855740 1 --2- 172.21.15.135:0/1830342443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc890c7f0 0x556fc8919e50 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.775+0000 7fe2a0855740 1 -- 172.21.15.135:0/1830342443 >> 172.21.15.135:0/1830342443 conn(0x556fc8907540 msgr2=0x556fc8902570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.775+0000 7fe2a0855740 1 -- 172.21.15.135:0/1830342443 shutdown_connections 2024-04-20T12:30:16.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.775+0000 7fe2a0855740 1 -- 172.21.15.135:0/1830342443 wait complete. 2024-04-20T12:30:16.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.775+0000 7fe2a0855740 1 -- start start 2024-04-20T12:30:16.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe2a0855740 1 Processor -- start 2024-04-20T12:30:16.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe2a0855740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc890c7f0 0x556fc891e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe2a0855740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890d1a0 0x556fc891e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe2a0855740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc891a720 0x556fc891ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe2a0855740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe2981ae880 con 0x556fc891a720 2024-04-20T12:30:16.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe2a0855740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe2981ae1b0 con 0x556fc890c7f0 2024-04-20T12:30:16.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe2a0855740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe2981ab400 con 0x556fc890d1a0 2024-04-20T12:30:16.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe2a0855740 10 client.0 _ll_register_callbacks cb 0x7fe28800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:16.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe296ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc891a720 0x556fc891ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe296ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc891a720 0x556fc891ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56978/0 (socket says 172.21.15.135:56978) 2024-04-20T12:30:16.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe296ffd640 1 -- 172.21.15.135:0/3895977763 learned_addr learned my addr 172.21.15.135:0/3895977763 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe296ffd640 1 -- 172.21.15.135:0/3895977763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890d1a0 msgr2=0x556fc891e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe296ffd640 1 --2- 172.21.15.135:0/3895977763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890d1a0 0x556fc891e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe296ffd640 1 -- 172.21.15.135:0/3895977763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc890c7f0 msgr2=0x556fc891e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe296ffd640 1 --2- 172.21.15.135:0/3895977763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc890c7f0 0x556fc891e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe296ffd640 1 -- 172.21.15.135:0/3895977763 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fc891cb10 con 0x556fc891a720 2024-04-20T12:30:16.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe296ffd640 1 --2- 172.21.15.135:0/3895977763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc891a720 0x556fc891ecd0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fe28c006010 tx=0x7fe28c009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8d560d7fe52be2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe276ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:16.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.776+0000 7fe276ffd640 1 -- 172.21.15.135:0/3895977763 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28c054070 con 0x556fc891a720 2024-04-20T12:30:16.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.777+0000 7fe276ffd640 1 -- 172.21.15.135:0/3895977763 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7fe28c004a70 con 0x556fc891a720 2024-04-20T12:30:16.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.777+0000 7fe2a0855740 1 -- 172.21.15.135:0/3895977763 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe28c0046c0 con 0x556fc891a720 2024-04-20T12:30:16.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.777+0000 7fe276ffd640 1 -- 172.21.15.135:0/3895977763 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe28c004f40 con 0x556fc891a720 2024-04-20T12:30:16.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.777+0000 7fe2a0855740 10 client.17817 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:16.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.777+0000 7fe2a0855740 1 -- 172.21.15.135:0/3895977763 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556fc890d780 con 0x556fc891a720 2024-04-20T12:30:16.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.777+0000 7fe276ffd640 1 -- 172.21.15.135:0/3895977763 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe28c0046c0 con 0x556fc891a720 2024-04-20T12:30:16.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.777+0000 7fe276ffd640 1 -- 172.21.15.135:0/3895977763 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fe28c0348c0 con 0x556fc891a720 2024-04-20T12:30:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.777+0000 7fe2a0855740 10 client.17817 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.777+0000 7fe2a0855740 10 client.17817 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:30:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.777+0000 7fe2a0855740 20 client.17817 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.777+0000 7fe2a0855740 1 --2- 172.21.15.135:0/3895977763 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x556fc89910c0 0x556fc89934b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.777+0000 7fe2a0855740 4 client.17817 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:30:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.777+0000 7fe2a0855740 1 -- 172.21.15.135:0/3895977763 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556fc88799a0 con 0x556fc89910c0 2024-04-20T12:30:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.777+0000 7fe2977fe640 1 --2- 172.21.15.135:0/3895977763 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x556fc89910c0 0x556fc89934b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe2977fe640 1 --2- 172.21.15.135:0/3895977763 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x556fc89910c0 0x556fc89934b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a73abfb1e716382e server_cookie=58a1a3845568385 in_seq=0 out_seq=0 2024-04-20T12:30:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe276ffd640 10 client.17817 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:30:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe276ffd640 1 -- 172.21.15.135:0/3895977763 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556fc88799a0 con 0x556fc89910c0 2024-04-20T12:30:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe276ffd640 10 client.17817 handle_command_reply: tid=0 2024-04-20T12:30:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe2a0855740 1 client.17817 shutdown 2024-04-20T12:30:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe2a0855740 1 -- 172.21.15.135:0/3895977763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc891a720 msgr2=0x556fc891ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe2a0855740 1 --2- 172.21.15.135:0/3895977763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc891a720 0x556fc891ecd0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fe28c006010 tx=0x7fe28c009880 comp rx=0 tx=0).stop 2024-04-20T12:30:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe2a0855740 1 -- 172.21.15.135:0/3895977763 shutdown_connections 2024-04-20T12:30:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe2a0855740 1 --2- 172.21.15.135:0/3895977763 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x556fc89910c0 0x556fc89934b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe2a0855740 1 --2- 172.21.15.135:0/3895977763 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556fc891a720 0x556fc891ecd0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe276ffd640 0 client.17817 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:30:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe2a0855740 1 --2- 172.21.15.135:0/3895977763 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556fc890d1a0 0x556fc891e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe2a0855740 1 --2- 172.21.15.135:0/3895977763 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556fc890c7f0 0x556fc891e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe2a0855740 1 -- 172.21.15.135:0/3895977763 >> 172.21.15.135:0/3895977763 conn(0x556fc8907540 msgr2=0x556fc8908990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe2a0855740 1 -- 172.21.15.135:0/3895977763 shutdown_connections 2024-04-20T12:30:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe2a0855740 1 -- 172.21.15.135:0/3895977763 wait complete. 2024-04-20T12:30:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.778+0000 7fe2a0855740 20 client.17817 trim_cache size 0 max 16384 2024-04-20T12:30:16.784 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:30:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.779+0000 7fe29dc5c640 1 -- 172.21.15.135:0/4020132020 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe2800a3d20 msgr2=0x7fe2800a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.779+0000 7fe29dc5c640 1 --2- 172.21.15.135:0/4020132020 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe2800a3d20 0x7fe2800a61e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe29009cb80 tx=0x7fe29000efd0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.779+0000 7fe29dc5c640 1 -- 172.21.15.135:0/4020132020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2981985f0 msgr2=0x7fe298198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.779+0000 7fe29dc5c640 1 --2- 172.21.15.135:0/4020132020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2981985f0 0x7fe298198aa0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fe29000eb10 tx=0x7fe29000c2d0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.779+0000 7fe29dc5c640 1 -- 172.21.15.135:0/4020132020 shutdown_connections 2024-04-20T12:30:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.779+0000 7fe29dc5c640 1 --2- 172.21.15.135:0/4020132020 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2981985f0 0x7fe298198aa0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.779+0000 7fe29dc5c640 1 --2- 172.21.15.135:0/4020132020 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe2800a3d20 0x7fe2800a61e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.779+0000 7fe29dc5c640 1 --2- 172.21.15.135:0/4020132020 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe298107280 0x7fe29819e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.779+0000 7fe29dc5c640 1 --2- 172.21.15.135:0/4020132020 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe2981021b0 0x7fe29819e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.779+0000 7fe29dc5c640 1 -- 172.21.15.135:0/4020132020 >> 172.21.15.135:0/4020132020 conn(0x7fe2980793f0 msgr2=0x7fe2980ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.779+0000 7fe29dc5c640 1 -- 172.21.15.135:0/4020132020 shutdown_connections 2024-04-20T12:30:16.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.779+0000 7fe29dc5c640 1 -- 172.21.15.135:0/4020132020 wait complete. 2024-04-20T12:30:16.789 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:30:16.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.890+0000 7f33125c7640 1 -- 172.21.15.135:0/2380582893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330c101a40 msgr2=0x7f330c105a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.890+0000 7f33125c7640 1 --2- 172.21.15.135:0/2380582893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330c101a40 0x7f330c105a80 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009900 tx=0x7f32fc02bc30 comp rx=0 tx=0).stop 2024-04-20T12:30:16.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.891+0000 7f33125c7640 1 -- 172.21.15.135:0/2380582893 shutdown_connections 2024-04-20T12:30:16.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.891+0000 7f33125c7640 1 --2- 172.21.15.135:0/2380582893 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f330c106160 0x7f330c10dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.891+0000 7f33125c7640 1 --2- 172.21.15.135:0/2380582893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330c101a40 0x7f330c105a80 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.891+0000 7f33125c7640 1 --2- 172.21.15.135:0/2380582893 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c101090 0x7f330c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.891+0000 7f33125c7640 1 -- 172.21.15.135:0/2380582893 >> 172.21.15.135:0/2380582893 conn(0x7f330c078010 msgr2=0x7f330c078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.891+0000 7f33125c7640 1 -- 172.21.15.135:0/2380582893 shutdown_connections 2024-04-20T12:30:16.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.891+0000 7f33125c7640 1 -- 172.21.15.135:0/2380582893 wait complete. 2024-04-20T12:30:16.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.891+0000 7f33125c7640 1 Processor -- start 2024-04-20T12:30:16.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.891+0000 7f33125c7640 1 -- start start 2024-04-20T12:30:16.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.891+0000 7f33125c7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330c101090 0x7f330c19e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.891+0000 7f33125c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c106160 0x7f330c19e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.891+0000 7f33125c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f330c1985d0 0x7f330c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f33125c7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f330c1111f0 con 0x7f330c101090 2024-04-20T12:30:16.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f33125c7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f330c111070 con 0x7f330c1985d0 2024-04-20T12:30:16.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f33125c7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f330c111370 con 0x7f330c106160 2024-04-20T12:30:16.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f330bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330c101090 0x7f330c19e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f330bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330c101090 0x7f330c19e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56984/0 (socket says 172.21.15.135:56984) 2024-04-20T12:30:16.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f330bfff640 1 -- 172.21.15.135:0/3458379282 learned_addr learned my addr 172.21.15.135:0/3458379282 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f3310b64640 1 --2- 172.21.15.135:0/3458379282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f330c1985d0 0x7f330c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f330bfff640 1 -- 172.21.15.135:0/3458379282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c106160 msgr2=0x7f330c19e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f330bfff640 1 --2- 172.21.15.135:0/3458379282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c106160 0x7f330c19e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f330bfff640 1 -- 172.21.15.135:0/3458379282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f330c1985d0 msgr2=0x7f330c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f330bfff640 1 --2- 172.21.15.135:0/3458379282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f330c1985d0 0x7f330c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f330bfff640 1 -- 172.21.15.135:0/3458379282 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c1990f0 con 0x7f330c101090 2024-04-20T12:30:16.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f3310b64640 1 --2- 172.21.15.135:0/3458379282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f330c1985d0 0x7f330c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:16.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f330bfff640 1 --2- 172.21.15.135:0/3458379282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330c101090 0x7f330c19e420 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f32f400e9f0 tx=0x7f32f400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f33097fa640 1 -- 172.21.15.135:0/3458379282 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f400cd80 con 0x7f330c101090 2024-04-20T12:30:16.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f33097fa640 1 -- 172.21.15.135:0/3458379282 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32f4005500 con 0x7f330c101090 2024-04-20T12:30:16.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f33125c7640 1 -- 172.21.15.135:0/3458379282 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f330c1993e0 con 0x7f330c101090 2024-04-20T12:30:16.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f33097fa640 1 -- 172.21.15.135:0/3458379282 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4010690 con 0x7f330c101090 2024-04-20T12:30:16.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.892+0000 7f33125c7640 1 -- 172.21.15.135:0/3458379282 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f330c1a55e0 con 0x7f330c101090 2024-04-20T12:30:16.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f33151b9740 1 Processor -- start 2024-04-20T12:30:16.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f33151b9740 1 -- start start 2024-04-20T12:30:16.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f33097fa640 1 -- 172.21.15.135:0/3458379282 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f32f40046c0 con 0x7f330c101090 2024-04-20T12:30:16.902 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f33151b9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68ce10 0x55e41e68d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f33151b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e68d730 0x55e41e695dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f33151b9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e696310 0x55e41e698700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f33151b9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e41e5f2110 con 0x55e41e68ce10 2024-04-20T12:30:16.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f33151b9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e41e58f550 con 0x55e41e696310 2024-04-20T12:30:16.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f33151b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e41e5ee0d0 con 0x55e41e68d730 2024-04-20T12:30:16.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f3310b64640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68ce10 0x55e41e68d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f3310b64640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68ce10 0x55e41e68d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56986/0 (socket says 172.21.15.135:56986) 2024-04-20T12:30:16.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f3310b64640 1 -- 172.21.15.135:0/4197924672 learned_addr learned my addr 172.21.15.135:0/4197924672 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f330bfff640 1 --2- 172.21.15.135:0/4197924672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e68d730 0x55e41e695dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f3310b64640 1 -- 172.21.15.135:0/4197924672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e68d730 msgr2=0x55e41e695dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f3310b64640 1 --2- 172.21.15.135:0/4197924672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e68d730 0x55e41e695dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f3310b64640 1 -- 172.21.15.135:0/4197924672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e696310 msgr2=0x55e41e698700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f3310b64640 1 --2- 172.21.15.135:0/4197924672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e696310 0x55e41e698700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f3310b64640 1 -- 172.21.15.135:0/4197924672 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e41e5b7900 con 0x55e41e68ce10 2024-04-20T12:30:16.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f3310b64640 1 --2- 172.21.15.135:0/4197924672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68ce10 0x55e41e68d1f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f3304009f30 tx=0x7f3304010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7a06036a5cecd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f33097fa640 1 --2- 172.21.15.135:0/3458379282 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32f80a3d20 0x7f32f80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f33027fc640 1 -- 172.21.15.135:0/4197924672 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304016070 con 0x55e41e68ce10 2024-04-20T12:30:16.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.895+0000 7f330bfff640 1 --2- 172.21.15.135:0/3458379282 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32f80a3d20 0x7f32f80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.896+0000 7f33027fc640 1 -- 172.21.15.135:0/4197924672 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f330401bb40 con 0x55e41e68ce10 2024-04-20T12:30:16.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.896+0000 7f33027fc640 1 -- 172.21.15.135:0/4197924672 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304012c60 con 0x55e41e68ce10 2024-04-20T12:30:16.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.896+0000 7f33097fa640 1 -- 172.21.15.135:0/3458379282 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f32f40d11a0 con 0x7f330c101090 2024-04-20T12:30:16.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.896+0000 7f33151b9740 1 -- 172.21.15.135:0/4197924672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68ce10 msgr2=0x55e41e68d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.896+0000 7f33151b9740 1 --2- 172.21.15.135:0/4197924672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68ce10 0x55e41e68d1f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f3304009f30 tx=0x7f3304010800 comp rx=0 tx=0).stop 2024-04-20T12:30:16.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.896+0000 7f330bfff640 1 --2- 172.21.15.135:0/3458379282 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32f80a3d20 0x7f32f80a61e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f32f40ce570 tx=0x7f32f4004a40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.896+0000 7f33151b9740 1 -- 172.21.15.135:0/4197924672 shutdown_connections 2024-04-20T12:30:16.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.896+0000 7f33151b9740 1 --2- 172.21.15.135:0/4197924672 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e696310 0x55e41e698700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.896+0000 7f33151b9740 1 --2- 172.21.15.135:0/4197924672 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e68d730 0x55e41e695dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.896+0000 7f33151b9740 1 --2- 172.21.15.135:0/4197924672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68ce10 0x55e41e68d1f0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.896+0000 7f33151b9740 1 -- 172.21.15.135:0/4197924672 >> 172.21.15.135:0/4197924672 conn(0x55e41e687540 msgr2=0x55e41e687920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.896+0000 7f33151b9740 1 -- 172.21.15.135:0/4197924672 shutdown_connections 2024-04-20T12:30:16.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.896+0000 7f33151b9740 1 -- 172.21.15.135:0/4197924672 wait complete. 2024-04-20T12:30:16.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f33151b9740 1 -- start start 2024-04-20T12:30:16.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f33151b9740 1 Processor -- start 2024-04-20T12:30:16.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f33151b9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68ce10 0x55e41e693460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f33151b9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68d730 0x55e41e6939a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f33151b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e696310 0x55e41e693ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f33151b9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e41e698fe0 con 0x55e41e68d730 2024-04-20T12:30:16.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f33151b9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e41e5ab500 con 0x55e41e68ce10 2024-04-20T12:30:16.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f33151b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e41e699160 con 0x55e41e696310 2024-04-20T12:30:16.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f33151b9740 10 client.0 _ll_register_callbacks cb 0x55e41e5902f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:16.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f330b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68d730 0x55e41e6939a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f330b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68d730 0x55e41e6939a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56992/0 (socket says 172.21.15.135:56992) 2024-04-20T12:30:16.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f330b7fe640 1 -- 172.21.15.135:0/2298286861 learned_addr learned my addr 172.21.15.135:0/2298286861 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f3310b64640 1 --2- 172.21.15.135:0/2298286861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e696310 0x55e41e693ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f3310b64640 1 --2- 172.21.15.135:0/2298286861 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68ce10 0x55e41e693460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f330b7fe640 1 -- 172.21.15.135:0/2298286861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e696310 msgr2=0x55e41e693ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f330b7fe640 1 --2- 172.21.15.135:0/2298286861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e696310 0x55e41e693ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f330b7fe640 1 -- 172.21.15.135:0/2298286861 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68ce10 msgr2=0x55e41e693460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f330b7fe640 1 --2- 172.21.15.135:0/2298286861 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68ce10 0x55e41e693460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.897+0000 7f330b7fe640 1 -- 172.21.15.135:0/2298286861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e41e3043f0 con 0x55e41e68d730 2024-04-20T12:30:16.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f330b7fe640 1 --2- 172.21.15.135:0/2298286861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68d730 0x55e41e6939a0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f32fc005ab0 tx=0x7f32fc02cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da109eed0a24a7ad server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f32eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:16.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f32eb7fe640 1 -- 172.21.15.135:0/2298286861 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc005d50 con 0x55e41e68d730 2024-04-20T12:30:16.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f32eb7fe640 1 -- 172.21.15.135:0/2298286861 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f32fc004450 con 0x55e41e68d730 2024-04-20T12:30:16.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f33151b9740 1 -- 172.21.15.135:0/2298286861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f330401bb40 con 0x55e41e68d730 2024-04-20T12:30:16.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f32eb7fe640 1 -- 172.21.15.135:0/2298286861 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f32fc04b050 con 0x55e41e68d730 2024-04-20T12:30:16.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f33151b9740 10 client.17829 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:16.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f33151b9740 1 -- 172.21.15.135:0/2298286861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e41e3ce7d0 con 0x55e41e68d730 2024-04-20T12:30:16.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f32eb7fe640 1 -- 172.21.15.135:0/2298286861 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f330401bb40 con 0x55e41e68d730 2024-04-20T12:30:16.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f32eb7fe640 1 -- 172.21.15.135:0/2298286861 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f32fc03d7b0 con 0x55e41e68d730 2024-04-20T12:30:16.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f33151b9740 10 client.17829 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:16.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f33151b9740 10 client.17829 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:30:16.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f33151b9740 20 client.17829 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:16.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f33151b9740 1 --2- 172.21.15.135:0/2298286861 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e41e6a6660 0x55e41e6a8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f33151b9740 4 client.17829 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:16.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.898+0000 7f33151b9740 1 -- 172.21.15.135:0/2298286861 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e41e5ffb30 con 0x55e41e6a6660 2024-04-20T12:30:16.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.899+0000 7f3310b64640 1 --2- 172.21.15.135:0/2298286861 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e41e6a6660 0x55e41e6a8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.899+0000 7f32eb7fe640 10 client.17829 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:30:16.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.899+0000 7f3310b64640 1 --2- 172.21.15.135:0/2298286861 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e41e6a6660 0x55e41e6a8a90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b7559056c79b0765 server_cookie=c97162294004b9f8 in_seq=0 out_seq=0 2024-04-20T12:30:16.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.900+0000 7f32eb7fe640 1 -- 172.21.15.135:0/2298286861 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7f3304028ae0 con 0x55e41e6a6660 2024-04-20T12:30:16.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.900+0000 7f32eb7fe640 10 client.17829 handle_command_reply: tid=0 2024-04-20T12:30:16.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.900+0000 7f33151b9740 1 client.17829 shutdown 2024-04-20T12:30:16.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.900+0000 7f33151b9740 1 -- 172.21.15.135:0/2298286861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68d730 msgr2=0x55e41e6939a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.900+0000 7f33151b9740 1 --2- 172.21.15.135:0/2298286861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68d730 0x55e41e6939a0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f32fc005ab0 tx=0x7f32fc02cdf0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.900+0000 7f33151b9740 1 -- 172.21.15.135:0/2298286861 shutdown_connections 2024-04-20T12:30:16.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.900+0000 7f33151b9740 1 --2- 172.21.15.135:0/2298286861 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e41e6a6660 0x55e41e6a8a90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.900+0000 7f33151b9740 1 --2- 172.21.15.135:0/2298286861 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e696310 0x55e41e693ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.900+0000 7f33151b9740 1 --2- 172.21.15.135:0/2298286861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68d730 0x55e41e6939a0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.900+0000 7f33151b9740 1 --2- 172.21.15.135:0/2298286861 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68ce10 0x55e41e693460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.900+0000 7f32eb7fe640 0 client.17829 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:30:16.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.900+0000 7f33151b9740 1 -- 172.21.15.135:0/2298286861 >> 172.21.15.135:0/2298286861 conn(0x55e41e687540 msgr2=0x55e41e689290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.900+0000 7f33151b9740 1 -- 172.21.15.135:0/2298286861 shutdown_connections 2024-04-20T12:30:16.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.900+0000 7f33151b9740 1 -- 172.21.15.135:0/2298286861 wait complete. 2024-04-20T12:30:16.909 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.900+0000 7f33151b9740 20 client.17829 trim_cache size 0 max 16384 2024-04-20T12:30:16.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.913+0000 7f33151b9740 1 Processor -- start 2024-04-20T12:30:16.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.913+0000 7f33151b9740 1 -- start start 2024-04-20T12:30:16.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.913+0000 7f33151b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e68ce10 0x55e41e695b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.913+0000 7f33151b9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68d730 0x55e41e6a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.913+0000 7f33151b9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e696310 0x55e41e682570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.913+0000 7f33151b9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f330c1af620 con 0x55e41e696310 2024-04-20T12:30:16.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.913+0000 7f33151b9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f330c1b1160 con 0x55e41e68d730 2024-04-20T12:30:16.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.913+0000 7f33151b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f330c1afcf0 con 0x55e41e68ce10 2024-04-20T12:30:16.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.913+0000 7f3310b64640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e696310 0x55e41e682570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.913+0000 7f3310b64640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e696310 0x55e41e682570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:56996/0 (socket says 172.21.15.135:56996) 2024-04-20T12:30:16.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.913+0000 7f3310b64640 1 -- 172.21.15.135:0/1698354636 learned_addr learned my addr 172.21.15.135:0/1698354636 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.914+0000 7f330b7fe640 1 --2- 172.21.15.135:0/1698354636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68d730 0x55e41e6a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.914+0000 7f3310b64640 1 -- 172.21.15.135:0/1698354636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e68ce10 msgr2=0x55e41e695b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.914+0000 7f3310b64640 1 --2- 172.21.15.135:0/1698354636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e68ce10 0x55e41e695b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.914+0000 7f3310b64640 1 -- 172.21.15.135:0/1698354636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68d730 msgr2=0x55e41e6a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.914+0000 7f3310b64640 1 --2- 172.21.15.135:0/1698354636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68d730 0x55e41e6a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.914+0000 7f3310b64640 1 -- 172.21.15.135:0/1698354636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e41e692410 con 0x55e41e696310 2024-04-20T12:30:16.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.914+0000 7f330b7fe640 1 --2- 172.21.15.135:0/1698354636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68d730 0x55e41e6a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:16.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.914+0000 7f3310b64640 1 --2- 172.21.15.135:0/1698354636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e696310 0x55e41e682570 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f33040125d0 tx=0x7f33040127a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60cce046d2346da server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.914+0000 7f3301ffb640 1 -- 172.21.15.135:0/1698354636 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330402d070 con 0x55e41e696310 2024-04-20T12:30:16.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.914+0000 7f3301ffb640 1 -- 172.21.15.135:0/1698354636 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3304023050 con 0x55e41e696310 2024-04-20T12:30:16.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.914+0000 7f3301ffb640 1 -- 172.21.15.135:0/1698354636 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304016040 con 0x55e41e696310 2024-04-20T12:30:16.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 -- 172.21.15.135:0/1698354636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e696310 msgr2=0x55e41e682570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 --2- 172.21.15.135:0/1698354636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e696310 0x55e41e682570 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f33040125d0 tx=0x7f33040127a0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 -- 172.21.15.135:0/1698354636 shutdown_connections 2024-04-20T12:30:16.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 --2- 172.21.15.135:0/1698354636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e696310 0x55e41e682570 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 --2- 172.21.15.135:0/1698354636 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68d730 0x55e41e6a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 --2- 172.21.15.135:0/1698354636 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e68ce10 0x55e41e695b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 -- 172.21.15.135:0/1698354636 >> 172.21.15.135:0/1698354636 conn(0x55e41e687540 msgr2=0x55e41e6866e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 -- 172.21.15.135:0/1698354636 shutdown_connections 2024-04-20T12:30:16.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 -- 172.21.15.135:0/1698354636 wait complete. 2024-04-20T12:30:16.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 -- start start 2024-04-20T12:30:16.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 Processor -- start 2024-04-20T12:30:16.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68ce10 0x55e41e69a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68d730 0x55e41e69a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e696310 0x55e41e69aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f330c1b0a90 con 0x55e41e68d730 2024-04-20T12:30:16.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f330c1b03c0 con 0x55e41e68ce10 2024-04-20T12:30:16.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.915+0000 7f33151b9740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f330c1ad610 con 0x55e41e696310 2024-04-20T12:30:16.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f33151b9740 10 client.0 _ll_register_callbacks cb 0x7f32f4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:16.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f330b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68d730 0x55e41e69a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f330b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68d730 0x55e41e69a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57006/0 (socket says 172.21.15.135:57006) 2024-04-20T12:30:16.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f330b7fe640 1 -- 172.21.15.135:0/1136496687 learned_addr learned my addr 172.21.15.135:0/1136496687 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:16.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f3310b64640 1 --2- 172.21.15.135:0/1136496687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68ce10 0x55e41e69a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f3310b64640 1 --2- 172.21.15.135:0/1136496687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e696310 0x55e41e69aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f330b7fe640 1 -- 172.21.15.135:0/1136496687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e696310 msgr2=0x55e41e69aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f330b7fe640 1 --2- 172.21.15.135:0/1136496687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e696310 0x55e41e69aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f330b7fe640 1 -- 172.21.15.135:0/1136496687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68ce10 msgr2=0x55e41e69a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:16.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f330b7fe640 1 --2- 172.21.15.135:0/1136496687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68ce10 0x55e41e69a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f330b7fe640 1 -- 172.21.15.135:0/1136496687 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e41e70be70 con 0x55e41e68d730 2024-04-20T12:30:16.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f330b7fe640 1 --2- 172.21.15.135:0/1136496687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68d730 0x55e41e69a5a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009900 tx=0x7f32fc034530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c191547752e9f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:16.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f32eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:16.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f32eb7fe640 1 -- 172.21.15.135:0/1136496687 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc009520 con 0x55e41e68d730 2024-04-20T12:30:16.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f32eb7fe640 1 -- 172.21.15.135:0/1136496687 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f32fc03d480 con 0x55e41e68d730 2024-04-20T12:30:16.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f33151b9740 1 -- 172.21.15.135:0/1136496687 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3304023050 con 0x55e41e68d730 2024-04-20T12:30:16.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f32eb7fe640 1 -- 172.21.15.135:0/1136496687 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f32fc05e050 con 0x55e41e68d730 2024-04-20T12:30:16.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f33151b9740 10 client.17835 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:16.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f33151b9740 1 -- 172.21.15.135:0/1136496687 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e41e70d170 con 0x55e41e68d730 2024-04-20T12:30:16.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.916+0000 7f32eb7fe640 1 -- 172.21.15.135:0/1136496687 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3304023050 con 0x55e41e68d730 2024-04-20T12:30:16.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.917+0000 7f32eb7fe640 1 -- 172.21.15.135:0/1136496687 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f32fc057060 con 0x55e41e68d730 2024-04-20T12:30:16.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.917+0000 7f33151b9740 10 client.17835 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:16.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.917+0000 7f33151b9740 10 client.17835 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:30:16.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.917+0000 7f33151b9740 20 client.17835 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:16.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.917+0000 7f33151b9740 1 --2- 172.21.15.135:0/1136496687 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e41e70d890 0x55e41e70fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:16.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.917+0000 7f33151b9740 4 client.17835 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:30:16.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.917+0000 7f33151b9740 1 -- 172.21.15.135:0/1136496687 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e41e5f99a0 con 0x55e41e70d890 2024-04-20T12:30:16.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.917+0000 7f3310b64640 1 --2- 172.21.15.135:0/1136496687 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e41e70d890 0x55e41e70fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:16.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.917+0000 7f3310b64640 1 --2- 172.21.15.135:0/1136496687 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e41e70d890 0x55e41e70fcb0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=45d049ee440b7701 server_cookie=b62b3abc4790380a in_seq=0 out_seq=0 2024-04-20T12:30:16.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.917+0000 7f32eb7fe640 10 client.17835 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:30:16.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.917+0000 7f32eb7fe640 1 -- 172.21.15.135:0/1136496687 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e41e5f99a0 con 0x55e41e70d890 2024-04-20T12:30:16.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.917+0000 7f32eb7fe640 10 client.17835 handle_command_reply: tid=0 2024-04-20T12:30:16.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.917+0000 7f33151b9740 1 client.17835 shutdown 2024-04-20T12:30:16.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33151b9740 1 -- 172.21.15.135:0/1136496687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68d730 msgr2=0x55e41e69a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33151b9740 1 --2- 172.21.15.135:0/1136496687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68d730 0x55e41e69a5a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009900 tx=0x7f32fc034530 comp rx=0 tx=0).stop 2024-04-20T12:30:16.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33151b9740 1 -- 172.21.15.135:0/1136496687 shutdown_connections 2024-04-20T12:30:16.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33151b9740 1 --2- 172.21.15.135:0/1136496687 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55e41e70d890 0x55e41e70fcb0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33151b9740 1 --2- 172.21.15.135:0/1136496687 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e41e696310 0x55e41e69aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f32eb7fe640 0 client.17835 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:30:16.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33151b9740 1 --2- 172.21.15.135:0/1136496687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e41e68d730 0x55e41e69a5a0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33151b9740 1 --2- 172.21.15.135:0/1136496687 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e41e68ce10 0x55e41e69a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33151b9740 1 -- 172.21.15.135:0/1136496687 >> 172.21.15.135:0/1136496687 conn(0x55e41e687540 msgr2=0x55e41e693250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33151b9740 1 -- 172.21.15.135:0/1136496687 shutdown_connections 2024-04-20T12:30:16.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33151b9740 1 -- 172.21.15.135:0/1136496687 wait complete. 2024-04-20T12:30:16.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33151b9740 20 client.17835 trim_cache size 0 max 16384 2024-04-20T12:30:16.925 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:30:16.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33125c7640 1 -- 172.21.15.135:0/3458379282 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32f80a3d20 msgr2=0x7f32f80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33125c7640 1 --2- 172.21.15.135:0/3458379282 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32f80a3d20 0x7f32f80a61e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f32f40ce570 tx=0x7f32f4004a40 comp rx=0 tx=0).stop 2024-04-20T12:30:16.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33125c7640 1 -- 172.21.15.135:0/3458379282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330c101090 msgr2=0x7f330c19e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:16.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33125c7640 1 --2- 172.21.15.135:0/3458379282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330c101090 0x7f330c19e420 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f32f400e9f0 tx=0x7f32f400edf0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33125c7640 1 -- 172.21.15.135:0/3458379282 shutdown_connections 2024-04-20T12:30:16.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33125c7640 1 --2- 172.21.15.135:0/3458379282 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f330c1985d0 0x7f330c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33125c7640 1 --2- 172.21.15.135:0/3458379282 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32f80a3d20 0x7f32f80a61e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33125c7640 1 --2- 172.21.15.135:0/3458379282 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f330c106160 0x7f330c19e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33125c7640 1 --2- 172.21.15.135:0/3458379282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330c101090 0x7f330c19e420 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:16.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33125c7640 1 -- 172.21.15.135:0/3458379282 >> 172.21.15.135:0/3458379282 conn(0x7f330c078010 msgr2=0x7f330c104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:16.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33125c7640 1 -- 172.21.15.135:0/3458379282 shutdown_connections 2024-04-20T12:30:16.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:16.918+0000 7f33125c7640 1 -- 172.21.15.135:0/3458379282 wait complete. 2024-04-20T12:30:16.929 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:30:17.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.029+0000 7f4374eb3640 1 -- 172.21.15.135:0/3516976151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4370102b60 msgr2=0x7f4370106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.029+0000 7f4374eb3640 1 --2- 172.21.15.135:0/3516976151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4370102b60 0x7f4370106ba0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4360009900 tx=0x7f436002bc30 comp rx=0 tx=0).stop 2024-04-20T12:30:17.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.029+0000 7f4374eb3640 1 -- 172.21.15.135:0/3516976151 shutdown_connections 2024-04-20T12:30:17.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.029+0000 7f4374eb3640 1 --2- 172.21.15.135:0/3516976151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4370107280 0x7f437010ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.029+0000 7f4374eb3640 1 --2- 172.21.15.135:0/3516976151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4370102b60 0x7f4370106ba0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.029+0000 7f4374eb3640 1 --2- 172.21.15.135:0/3516976151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f43701021b0 0x7f4370102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.029+0000 7f4374eb3640 1 -- 172.21.15.135:0/3516976151 >> 172.21.15.135:0/3516976151 conn(0x7f43700793f0 msgr2=0x7f4370079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:17.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.029+0000 7f4374eb3640 1 -- 172.21.15.135:0/3516976151 shutdown_connections 2024-04-20T12:30:17.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.029+0000 7f4374eb3640 1 -- 172.21.15.135:0/3516976151 wait complete. 2024-04-20T12:30:17.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f4374eb3640 1 Processor -- start 2024-04-20T12:30:17.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f4374eb3640 1 -- start start 2024-04-20T12:30:17.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f4374eb3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43701021b0 0x7f437019e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f4374eb3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4370107280 0x7f437019e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f4374eb3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4370198610 0x7f4370198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f4374eb3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4370112310 con 0x7f43701021b0 2024-04-20T12:30:17.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f4374eb3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4370112190 con 0x7f4370107280 2024-04-20T12:30:17.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f4374eb3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4370112490 con 0x7f4370198610 2024-04-20T12:30:17.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f436e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43701021b0 0x7f437019e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f436e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43701021b0 0x7f437019e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57022/0 (socket says 172.21.15.135:57022) 2024-04-20T12:30:17.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f436e59c640 1 -- 172.21.15.135:0/3091014042 learned_addr learned my addr 172.21.15.135:0/3091014042 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:17.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f436dd9b640 1 --2- 172.21.15.135:0/3091014042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4370107280 0x7f437019e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f436ed9d640 1 --2- 172.21.15.135:0/3091014042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4370198610 0x7f4370198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f436e59c640 1 -- 172.21.15.135:0/3091014042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4370198610 msgr2=0x7f4370198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f436e59c640 1 --2- 172.21.15.135:0/3091014042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4370198610 0x7f4370198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f436e59c640 1 -- 172.21.15.135:0/3091014042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4370107280 msgr2=0x7f437019e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f436e59c640 1 --2- 172.21.15.135:0/3091014042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4370107280 0x7f437019e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f436e59c640 1 -- 172.21.15.135:0/3091014042 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4370199130 con 0x7f43701021b0 2024-04-20T12:30:17.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f436ed9d640 1 --2- 172.21.15.135:0/3091014042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4370198610 0x7f4370198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:17.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.030+0000 7f436e59c640 1 --2- 172.21.15.135:0/3091014042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43701021b0 0x7f437019e460 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f436400d770 tx=0x7f436400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:17.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.031+0000 7f435f7fe640 1 -- 172.21.15.135:0/3091014042 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364017070 con 0x7f43701021b0 2024-04-20T12:30:17.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.031+0000 7f4374eb3640 1 -- 172.21.15.135:0/3091014042 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4370199420 con 0x7f43701021b0 2024-04-20T12:30:17.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.031+0000 7f435f7fe640 1 -- 172.21.15.135:0/3091014042 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4364005500 con 0x7f43701021b0 2024-04-20T12:30:17.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.031+0000 7f435f7fe640 1 -- 172.21.15.135:0/3091014042 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364004e00 con 0x7f43701021b0 2024-04-20T12:30:17.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.031+0000 7f4374eb3640 1 -- 172.21.15.135:0/3091014042 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43701a5670 con 0x7f43701021b0 2024-04-20T12:30:17.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.033+0000 7f435f7fe640 1 -- 172.21.15.135:0/3091014042 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f4364004fa0 con 0x7f43701021b0 2024-04-20T12:30:17.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.033+0000 7f4377b7c740 1 Processor -- start 2024-04-20T12:30:17.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.033+0000 7f4377b7c740 1 -- start start 2024-04-20T12:30:17.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.033+0000 7f4377b7c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ad0e10 0x562aa7ad11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.033+0000 7f4377b7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad1730 0x562aa7ad9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.033+0000 7f4377b7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 0x562aa7adc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.033+0000 7f4377b7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562aa7a36110 con 0x562aa7ad1730 2024-04-20T12:30:17.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.033+0000 7f4377b7c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562aa79d3550 con 0x562aa7ad0e10 2024-04-20T12:30:17.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.033+0000 7f4377b7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562aa7a320d0 con 0x562aa7ada310 2024-04-20T12:30:17.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.033+0000 7f435f7fe640 1 --2- 172.21.15.135:0/3091014042 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f43580a3d20 0x7f43580a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f436e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad1730 0x562aa7ad9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f436ed9d640 1 --2- 172.21.15.135:0/3091014042 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f43580a3d20 0x7f43580a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f436e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad1730 0x562aa7ad9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57026/0 (socket says 172.21.15.135:57026) 2024-04-20T12:30:17.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f436e59c640 1 -- 172.21.15.135:0/3711246258 learned_addr learned my addr 172.21.15.135:0/3711246258 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f436ed9d640 1 --2- 172.21.15.135:0/3711246258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ad0e10 0x562aa7ad11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f436dd9b640 1 --2- 172.21.15.135:0/3711246258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 0x562aa7adc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f435f7fe640 1 -- 172.21.15.135:0/3091014042 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f43640d0760 con 0x7f43701021b0 2024-04-20T12:30:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f436e59c640 1 -- 172.21.15.135:0/3711246258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 msgr2=0x562aa7adc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f436e59c640 1 --2- 172.21.15.135:0/3711246258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 0x562aa7adc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f436e59c640 1 -- 172.21.15.135:0/3711246258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ad0e10 msgr2=0x562aa7ad11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f436e59c640 1 --2- 172.21.15.135:0/3711246258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ad0e10 0x562aa7ad11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f436e59c640 1 -- 172.21.15.135:0/3711246258 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aa79fb900 con 0x562aa7ad1730 2024-04-20T12:30:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f436ed9d640 1 --2- 172.21.15.135:0/3091014042 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f43580a3d20 0x7f43580a61e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4368005c40 tx=0x7f4368009cd0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f436e59c640 1 --2- 172.21.15.135:0/3711246258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad1730 0x562aa7ad9dd0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f4364066d40 tx=0x7f436406edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320d5c084df5aa99 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f435cff9640 1 -- 172.21.15.135:0/3711246258 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364020070 con 0x562aa7ad1730 2024-04-20T12:30:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f435cff9640 1 -- 172.21.15.135:0/3711246258 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43640046c0 con 0x562aa7ad1730 2024-04-20T12:30:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.034+0000 7f435cff9640 1 -- 172.21.15.135:0/3711246258 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436409c2d0 con 0x562aa7ad1730 2024-04-20T12:30:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.035+0000 7f4377b7c740 1 -- 172.21.15.135:0/3711246258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad1730 msgr2=0x562aa7ad9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.035+0000 7f4377b7c740 1 --2- 172.21.15.135:0/3711246258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad1730 0x562aa7ad9dd0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f4364066d40 tx=0x7f436406edc0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.035+0000 7f4377b7c740 1 -- 172.21.15.135:0/3711246258 shutdown_connections 2024-04-20T12:30:17.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.035+0000 7f4377b7c740 1 --2- 172.21.15.135:0/3711246258 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 0x562aa7adc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.035+0000 7f4377b7c740 1 --2- 172.21.15.135:0/3711246258 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad1730 0x562aa7ad9dd0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.035+0000 7f4377b7c740 1 --2- 172.21.15.135:0/3711246258 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ad0e10 0x562aa7ad11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.035+0000 7f4377b7c740 1 -- 172.21.15.135:0/3711246258 >> 172.21.15.135:0/3711246258 conn(0x562aa7acb540 msgr2=0x562aa7acb920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:17.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.035+0000 7f4377b7c740 1 -- 172.21.15.135:0/3711246258 shutdown_connections 2024-04-20T12:30:17.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.035+0000 7f4377b7c740 1 -- 172.21.15.135:0/3711246258 wait complete. 2024-04-20T12:30:17.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.035+0000 7f4377b7c740 1 -- start start 2024-04-20T12:30:17.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f4377b7c740 1 Processor -- start 2024-04-20T12:30:17.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f4377b7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ad0e10 0x562aa7ad74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f4377b7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad1730 0x562aa7ad79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f4377b7c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ada310 0x562aa7ad7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f4377b7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562aa7adcfe0 con 0x562aa7ad1730 2024-04-20T12:30:17.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f4377b7c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562aa79ef500 con 0x562aa7ada310 2024-04-20T12:30:17.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f4377b7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562aa7add160 con 0x562aa7ad0e10 2024-04-20T12:30:17.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f4377b7c740 10 client.0 _ll_register_callbacks cb 0x562aa79d42f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:17.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f436dd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad1730 0x562aa7ad79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f436dd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad1730 0x562aa7ad79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57028/0 (socket says 172.21.15.135:57028) 2024-04-20T12:30:17.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f436dd9b640 1 -- 172.21.15.135:0/1798955159 learned_addr learned my addr 172.21.15.135:0/1798955159 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:17.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f436ed9d640 1 --2- 172.21.15.135:0/1798955159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ada310 0x562aa7ad7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f436e59c640 1 --2- 172.21.15.135:0/1798955159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ad0e10 0x562aa7ad74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f436dd9b640 1 -- 172.21.15.135:0/1798955159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ad0e10 msgr2=0x562aa7ad74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f436dd9b640 1 --2- 172.21.15.135:0/1798955159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ad0e10 0x562aa7ad74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f436dd9b640 1 -- 172.21.15.135:0/1798955159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ada310 msgr2=0x562aa7ad7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f436dd9b640 1 --2- 172.21.15.135:0/1798955159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ada310 0x562aa7ad7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f436dd9b640 1 -- 172.21.15.135:0/1798955159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aa77483f0 con 0x562aa7ad1730 2024-04-20T12:30:17.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f436e59c640 1 --2- 172.21.15.135:0/1798955159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ad0e10 0x562aa7ad74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:17.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f436dd9b640 1 --2- 172.21.15.135:0/1798955159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad1730 0x562aa7ad79e0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f4360005ab0 tx=0x7f436002ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd71644dc948cd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:17.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f4355ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:17.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f4355ffb640 1 -- 172.21.15.135:0/1798955159 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43600044d0 con 0x562aa7ad1730 2024-04-20T12:30:17.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f4355ffb640 1 -- 172.21.15.135:0/1798955159 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f4360005030 con 0x562aa7ad1730 2024-04-20T12:30:17.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.036+0000 7f4377b7c740 1 -- 172.21.15.135:0/1798955159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562aa7a43b30 con 0x562aa7ad1730 2024-04-20T12:30:17.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.037+0000 7f4355ffb640 1 -- 172.21.15.135:0/1798955159 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f436004e050 con 0x562aa7ad1730 2024-04-20T12:30:17.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.037+0000 7f4377b7c740 10 client.17847 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:17.046 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.037+0000 7f4377b7c740 1 -- 172.21.15.135:0/1798955159 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562aa78127d0 con 0x562aa7ad1730 2024-04-20T12:30:17.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.037+0000 7f4355ffb640 1 -- 172.21.15.135:0/1798955159 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x562aa7a43b30 con 0x562aa7ad1730 2024-04-20T12:30:17.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.037+0000 7f4355ffb640 1 -- 172.21.15.135:0/1798955159 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f43600035f0 con 0x562aa7ad1730 2024-04-20T12:30:17.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.037+0000 7f4377b7c740 10 client.17847 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:17.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.037+0000 7f4377b7c740 10 client.17847 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:30:17.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.037+0000 7f4377b7c740 20 client.17847 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:17.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.037+0000 7f4377b7c740 1 --2- 172.21.15.135:0/1798955159 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x562aa7aea650 0x562aa7aecaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.037+0000 7f4377b7c740 4 client.17847 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:17.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.037+0000 7f4377b7c740 1 -- 172.21.15.135:0/1798955159 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562aa7a3d9a0 con 0x562aa7aea650 2024-04-20T12:30:17.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.037+0000 7f436e59c640 1 --2- 172.21.15.135:0/1798955159 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x562aa7aea650 0x562aa7aecaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.038+0000 7f4355ffb640 10 client.17847 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:30:17.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.038+0000 7f436e59c640 1 --2- 172.21.15.135:0/1798955159 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x562aa7aea650 0x562aa7aecaa0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f60f911017beed28 server_cookie=602296207cd3701a in_seq=0 out_seq=0 2024-04-20T12:30:17.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.038+0000 7f4355ffb640 1 -- 172.21.15.135:0/1798955159 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562aa7a3d9a0 con 0x562aa7aea650 2024-04-20T12:30:17.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.038+0000 7f4355ffb640 10 client.17847 handle_command_reply: tid=0 2024-04-20T12:30:17.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.038+0000 7f4377b7c740 1 client.17847 shutdown 2024-04-20T12:30:17.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.038+0000 7f4377b7c740 1 -- 172.21.15.135:0/1798955159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad1730 msgr2=0x562aa7ad79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.038+0000 7f4377b7c740 1 --2- 172.21.15.135:0/1798955159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad1730 0x562aa7ad79e0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f4360005ab0 tx=0x7f436002ce30 comp rx=0 tx=0).stop 2024-04-20T12:30:17.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.038+0000 7f4377b7c740 1 -- 172.21.15.135:0/1798955159 shutdown_connections 2024-04-20T12:30:17.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.038+0000 7f4377b7c740 1 --2- 172.21.15.135:0/1798955159 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x562aa7aea650 0x562aa7aecaa0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.038+0000 7f4377b7c740 1 --2- 172.21.15.135:0/1798955159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ada310 0x562aa7ad7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.038+0000 7f4377b7c740 1 --2- 172.21.15.135:0/1798955159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad1730 0x562aa7ad79e0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.038+0000 7f4377b7c740 1 --2- 172.21.15.135:0/1798955159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ad0e10 0x562aa7ad74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.038+0000 7f4355ffb640 0 client.17847 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:30:17.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.038+0000 7f4377b7c740 1 -- 172.21.15.135:0/1798955159 >> 172.21.15.135:0/1798955159 conn(0x562aa7acb540 msgr2=0x562aa7acd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:17.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.038+0000 7f4377b7c740 1 -- 172.21.15.135:0/1798955159 shutdown_connections 2024-04-20T12:30:17.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.039+0000 7f4377b7c740 1 -- 172.21.15.135:0/1798955159 wait complete. 2024-04-20T12:30:17.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.039+0000 7f4377b7c740 20 client.17847 trim_cache size 0 max 16384 2024-04-20T12:30:17.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f4377b7c740 1 Processor -- start 2024-04-20T12:30:17.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f4377b7c740 1 -- start start 2024-04-20T12:30:17.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f4377b7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad0e10 0x562aa7ad9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f4377b7c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ad1730 0x562aa7af2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f4377b7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 0x562aa7af28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f4377b7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f43701af5e0 con 0x562aa7ad0e10 2024-04-20T12:30:17.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f4377b7c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f43701b1120 con 0x562aa7ad1730 2024-04-20T12:30:17.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f4377b7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43701afcb0 con 0x562aa7ada310 2024-04-20T12:30:17.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f436e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad0e10 0x562aa7ad9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f436e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad0e10 0x562aa7ad9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57040/0 (socket says 172.21.15.135:57040) 2024-04-20T12:30:17.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f436e59c640 1 -- 172.21.15.135:0/2189148234 learned_addr learned my addr 172.21.15.135:0/2189148234 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:17.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f436ed9d640 1 --2- 172.21.15.135:0/2189148234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 0x562aa7af28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f436e59c640 1 -- 172.21.15.135:0/2189148234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 msgr2=0x562aa7af28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f436e59c640 1 --2- 172.21.15.135:0/2189148234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 0x562aa7af28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f436e59c640 1 -- 172.21.15.135:0/2189148234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ad1730 msgr2=0x562aa7af2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f436dd9b640 1 --2- 172.21.15.135:0/2189148234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ad1730 0x562aa7af2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f436e59c640 1 --2- 172.21.15.135:0/2189148234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ad1730 0x562aa7af2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f436e59c640 1 -- 172.21.15.135:0/2189148234 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aa7adca70 con 0x562aa7ad0e10 2024-04-20T12:30:17.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f436ed9d640 1 --2- 172.21.15.135:0/2189148234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 0x562aa7af28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:17.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.053+0000 7f436e59c640 1 --2- 172.21.15.135:0/2189148234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad0e10 0x562aa7ad9bd0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f43640ce080 tx=0x7f4364009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74173cd372d98ef6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:17.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.054+0000 7f4357fff640 1 -- 172.21.15.135:0/2189148234 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364020040 con 0x562aa7ad0e10 2024-04-20T12:30:17.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.054+0000 7f4357fff640 1 -- 172.21.15.135:0/2189148234 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f436409c2d0 con 0x562aa7ad0e10 2024-04-20T12:30:17.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.054+0000 7f4357fff640 1 -- 172.21.15.135:0/2189148234 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364009cc0 con 0x562aa7ad0e10 2024-04-20T12:30:17.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.054+0000 7f4377b7c740 1 -- 172.21.15.135:0/2189148234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad0e10 msgr2=0x562aa7ad9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.054+0000 7f4377b7c740 1 --2- 172.21.15.135:0/2189148234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad0e10 0x562aa7ad9bd0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f43640ce080 tx=0x7f4364009c30 comp rx=0 tx=0).stop 2024-04-20T12:30:17.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.054+0000 7f4377b7c740 1 -- 172.21.15.135:0/2189148234 shutdown_connections 2024-04-20T12:30:17.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.054+0000 7f4377b7c740 1 --2- 172.21.15.135:0/2189148234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 0x562aa7af28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.054+0000 7f4377b7c740 1 --2- 172.21.15.135:0/2189148234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ad1730 0x562aa7af2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.054+0000 7f4377b7c740 1 --2- 172.21.15.135:0/2189148234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad0e10 0x562aa7ad9bd0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.054+0000 7f4377b7c740 1 -- 172.21.15.135:0/2189148234 >> 172.21.15.135:0/2189148234 conn(0x562aa7acb540 msgr2=0x562aa7ac6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:17.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.054+0000 7f4377b7c740 1 -- 172.21.15.135:0/2189148234 shutdown_connections 2024-04-20T12:30:17.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.054+0000 7f4377b7c740 1 -- 172.21.15.135:0/2189148234 wait complete. 2024-04-20T12:30:17.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f4377b7c740 1 -- start start 2024-04-20T12:30:17.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f4377b7c740 1 Processor -- start 2024-04-20T12:30:17.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f4377b7c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad0e10 0x562aa7ae23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f4377b7c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ad1730 0x562aa7ae28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f4377b7c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 0x562aa7ad3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f4377b7c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f43701b0a50 con 0x562aa7ad0e10 2024-04-20T12:30:17.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f4377b7c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f43701b0380 con 0x562aa7ad1730 2024-04-20T12:30:17.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f4377b7c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f43701ad5d0 con 0x562aa7ada310 2024-04-20T12:30:17.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f4377b7c740 10 client.0 _ll_register_callbacks cb 0x7f4360009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:17.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f436e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad0e10 0x562aa7ae23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f436e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad0e10 0x562aa7ae23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57042/0 (socket says 172.21.15.135:57042) 2024-04-20T12:30:17.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f436e59c640 1 -- 172.21.15.135:0/896449939 learned_addr learned my addr 172.21.15.135:0/896449939 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:17.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f436ed9d640 1 --2- 172.21.15.135:0/896449939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 0x562aa7ad3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f436dd9b640 1 --2- 172.21.15.135:0/896449939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ad1730 0x562aa7ae28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f436e59c640 1 -- 172.21.15.135:0/896449939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 msgr2=0x562aa7ad3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f436e59c640 1 --2- 172.21.15.135:0/896449939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 0x562aa7ad3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f436e59c640 1 -- 172.21.15.135:0/896449939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ad1730 msgr2=0x562aa7ae28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f436e59c640 1 --2- 172.21.15.135:0/896449939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ad1730 0x562aa7ae28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.055+0000 7f436e59c640 1 -- 172.21.15.135:0/896449939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aa7ad3d90 con 0x562aa7ad0e10 2024-04-20T12:30:17.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f436e59c640 1 --2- 172.21.15.135:0/896449939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad0e10 0x562aa7ae23b0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f43640048e0 tx=0x7f4364005400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a651001786813b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:17.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f4355ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:17.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f4355ffb640 1 -- 172.21.15.135:0/896449939 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43640b5060 con 0x562aa7ad0e10 2024-04-20T12:30:17.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f4355ffb640 1 -- 172.21.15.135:0/896449939 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f43640a1aa0 con 0x562aa7ad0e10 2024-04-20T12:30:17.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f4377b7c740 1 -- 172.21.15.135:0/896449939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f436409c2d0 con 0x562aa7ad0e10 2024-04-20T12:30:17.062 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f4355ffb640 1 -- 172.21.15.135:0/896449939 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4364020070 con 0x562aa7ad0e10 2024-04-20T12:30:17.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f4377b7c740 10 client.17853 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:17.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f4377b7c740 1 -- 172.21.15.135:0/896449939 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562aa7b50430 con 0x562aa7ad0e10 2024-04-20T12:30:17.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f4355ffb640 1 -- 172.21.15.135:0/896449939 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f436409c2d0 con 0x562aa7ad0e10 2024-04-20T12:30:17.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f4355ffb640 1 -- 172.21.15.135:0/896449939 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f43640a4ab0 con 0x562aa7ad0e10 2024-04-20T12:30:17.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f4377b7c740 10 client.17853 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:17.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f4377b7c740 10 client.17853 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:30:17.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f4377b7c740 20 client.17853 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:17.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f4377b7c740 1 --2- 172.21.15.135:0/896449939 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x562aa7b50660 0x562aa7b52a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f4377b7c740 4 client.17853 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:30:17.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f4377b7c740 1 -- 172.21.15.135:0/896449939 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562aa79b96e0 con 0x562aa7b50660 2024-04-20T12:30:17.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.056+0000 7f436dd9b640 1 --2- 172.21.15.135:0/896449939 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x562aa7b50660 0x562aa7b52a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4355ffb640 10 client.17853 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:30:17.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f436dd9b640 1 --2- 172.21.15.135:0/896449939 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x562aa7b50660 0x562aa7b52a50 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d3daaf06a4ca552d server_cookie=57dd51c7a6d7706 in_seq=0 out_seq=0 2024-04-20T12:30:17.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4355ffb640 1 -- 172.21.15.135:0/896449939 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562aa79b96e0 con 0x562aa7b50660 2024-04-20T12:30:17.063 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4355ffb640 10 client.17853 handle_command_reply: tid=0 2024-04-20T12:30:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4377b7c740 1 client.17853 shutdown 2024-04-20T12:30:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4377b7c740 1 -- 172.21.15.135:0/896449939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad0e10 msgr2=0x562aa7ae23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4377b7c740 1 --2- 172.21.15.135:0/896449939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad0e10 0x562aa7ae23b0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f43640048e0 tx=0x7f4364005400 comp rx=0 tx=0).stop 2024-04-20T12:30:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4377b7c740 1 -- 172.21.15.135:0/896449939 shutdown_connections 2024-04-20T12:30:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4377b7c740 1 --2- 172.21.15.135:0/896449939 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x562aa7b50660 0x562aa7b52a50 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4377b7c740 1 --2- 172.21.15.135:0/896449939 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x562aa7ada310 0x562aa7ad3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4377b7c740 1 --2- 172.21.15.135:0/896449939 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x562aa7ad1730 0x562aa7ae28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4377b7c740 1 --2- 172.21.15.135:0/896449939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562aa7ad0e10 0x562aa7ae23b0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4355ffb640 0 client.17853 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:30:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4377b7c740 1 -- 172.21.15.135:0/896449939 >> 172.21.15.135:0/896449939 conn(0x562aa7acb540 msgr2=0x562aa7ac9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4377b7c740 1 -- 172.21.15.135:0/896449939 shutdown_connections 2024-04-20T12:30:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4377b7c740 1 -- 172.21.15.135:0/896449939 wait complete. 2024-04-20T12:30:17.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.057+0000 7f4377b7c740 20 client.17853 trim_cache size 0 max 16384 2024-04-20T12:30:17.065 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:30:17.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.058+0000 7f4374eb3640 1 -- 172.21.15.135:0/3091014042 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f43580a3d20 msgr2=0x7f43580a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.058+0000 7f4374eb3640 1 --2- 172.21.15.135:0/3091014042 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f43580a3d20 0x7f43580a61e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4368005c40 tx=0x7f4368009cd0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.058+0000 7f4374eb3640 1 -- 172.21.15.135:0/3091014042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43701021b0 msgr2=0x7f437019e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.058+0000 7f4374eb3640 1 --2- 172.21.15.135:0/3091014042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43701021b0 0x7f437019e460 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f436400d770 tx=0x7f436400dc30 comp rx=0 tx=0).stop 2024-04-20T12:30:17.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.058+0000 7f4374eb3640 1 -- 172.21.15.135:0/3091014042 shutdown_connections 2024-04-20T12:30:17.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.058+0000 7f4374eb3640 1 --2- 172.21.15.135:0/3091014042 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f43580a3d20 0x7f43580a61e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.058+0000 7f4374eb3640 1 --2- 172.21.15.135:0/3091014042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4370198610 0x7f4370198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.058+0000 7f4374eb3640 1 --2- 172.21.15.135:0/3091014042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4370107280 0x7f437019e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.058+0000 7f4374eb3640 1 --2- 172.21.15.135:0/3091014042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f43701021b0 0x7f437019e460 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.058+0000 7f4374eb3640 1 -- 172.21.15.135:0/3091014042 >> 172.21.15.135:0/3091014042 conn(0x7f43700793f0 msgr2=0x7f43700ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:17.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.058+0000 7f4374eb3640 1 -- 172.21.15.135:0/3091014042 shutdown_connections 2024-04-20T12:30:17.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.058+0000 7f4374eb3640 1 -- 172.21.15.135:0/3091014042 wait complete. 2024-04-20T12:30:17.067 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:16 smithi135 ceph-mon[18264]: pgmap v218: 129 pgs: 129 active+clean; 16 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:30:17.067 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:16 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1512937746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:30:17.068 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:30:17.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:16 smithi139 ceph-mon[21834]: pgmap v218: 129 pgs: 129 active+clean; 16 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:30:17.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:16 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1512937746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:30:17.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.169+0000 7f721bd60640 1 -- 172.21.15.135:0/861342766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7214107290 msgr2=0x7f721410ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.169+0000 7f721bd60640 1 --2- 172.21.15.135:0/861342766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7214107290 0x7f721410ee60 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f720c009ca0 tx=0x7f720c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.169+0000 7f721bd60640 1 -- 172.21.15.135:0/861342766 shutdown_connections 2024-04-20T12:30:17.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.169+0000 7f721bd60640 1 --2- 172.21.15.135:0/861342766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7214107290 0x7f721410ee60 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.169+0000 7f721bd60640 1 --2- 172.21.15.135:0/861342766 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7214101080 0x7f7214106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.169+0000 7f721bd60640 1 --2- 172.21.15.135:0/861342766 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72141006d0 0x7f7214100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.169+0000 7f721bd60640 1 -- 172.21.15.135:0/861342766 >> 172.21.15.135:0/861342766 conn(0x7f72140773b0 msgr2=0x7f72140fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:17.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.169+0000 7f721bd60640 1 -- 172.21.15.135:0/861342766 shutdown_connections 2024-04-20T12:30:17.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.169+0000 7f721bd60640 1 -- 172.21.15.135:0/861342766 wait complete. 2024-04-20T12:30:17.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.170+0000 7f721bd60640 1 Processor -- start 2024-04-20T12:30:17.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.170+0000 7f721bd60640 1 -- start start 2024-04-20T12:30:17.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.170+0000 7f721bd60640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72141006d0 0x7f72141a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.170+0000 7f721bd60640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7214107290 0x7f72141a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.170+0000 7f721bd60640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f721419a820 0x7f721419acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.170+0000 7f721bd60640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7214112350 con 0x7f721419a820 2024-04-20T12:30:17.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.170+0000 7f721bd60640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f72141121d0 con 0x7f7214107290 2024-04-20T12:30:17.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.170+0000 7f721bd60640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72141124d0 con 0x7f72141006d0 2024-04-20T12:30:17.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.170+0000 7f721a2fd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f721419a820 0x7f721419acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.170+0000 7f721a2fd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f721419a820 0x7f721419acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57060/0 (socket says 172.21.15.135:57060) 2024-04-20T12:30:17.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.170+0000 7f721a2fd640 1 -- 172.21.15.135:0/1385806849 learned_addr learned my addr 172.21.15.135:0/1385806849 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:17.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.170+0000 7f7219afc640 1 --2- 172.21.15.135:0/1385806849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72141006d0 0x7f72141a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.170+0000 7f72192fb640 1 --2- 172.21.15.135:0/1385806849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7214107290 0x7f72141a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.170+0000 7f721a2fd640 1 -- 172.21.15.135:0/1385806849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72141006d0 msgr2=0x7f72141a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.170+0000 7f721a2fd640 1 --2- 172.21.15.135:0/1385806849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72141006d0 0x7f72141a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.171+0000 7f721a2fd640 1 -- 172.21.15.135:0/1385806849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7214107290 msgr2=0x7f72141a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.171+0000 7f721a2fd640 1 --2- 172.21.15.135:0/1385806849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7214107290 0x7f72141a0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.171+0000 7f721a2fd640 1 -- 172.21.15.135:0/1385806849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721419b3b0 con 0x7f721419a820 2024-04-20T12:30:17.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.171+0000 7f721a2fd640 1 --2- 172.21.15.135:0/1385806849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f721419a820 0x7f721419acd0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f720c02c700 tx=0x7f720c032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:17.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.171+0000 7f720affd640 1 -- 172.21.15.135:0/1385806849 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c039040 con 0x7f721419a820 2024-04-20T12:30:17.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.171+0000 7f720affd640 1 -- 172.21.15.135:0/1385806849 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f720c044070 con 0x7f721419a820 2024-04-20T12:30:17.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.171+0000 7f720affd640 1 -- 172.21.15.135:0/1385806849 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720c0042a0 con 0x7f721419a820 2024-04-20T12:30:17.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.171+0000 7f721bd60640 1 -- 172.21.15.135:0/1385806849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f721419b640 con 0x7f721419a820 2024-04-20T12:30:17.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.171+0000 7f721bd60640 1 -- 172.21.15.135:0/1385806849 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72141a77f0 con 0x7f721419a820 2024-04-20T12:30:17.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.173+0000 7f720affd640 1 -- 172.21.15.135:0/1385806849 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f720c004440 con 0x7f721419a820 2024-04-20T12:30:17.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.173+0000 7f721ea32740 1 Processor -- start 2024-04-20T12:30:17.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f721ea32740 1 -- start start 2024-04-20T12:30:17.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f721ea32740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da70ae10 0x5590da70b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f721ea32740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70b730 0x5590da713dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f721ea32740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da714310 0x5590da716700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f721ea32740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5590da670110 con 0x5590da70ae10 2024-04-20T12:30:17.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f721ea32740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5590da60d550 con 0x5590da70b730 2024-04-20T12:30:17.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f721ea32740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5590da66c0d0 con 0x5590da714310 2024-04-20T12:30:17.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f720affd640 1 --2- 172.21.15.135:0/1385806849 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72000a3d20 0x7f72000a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f72192fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da70ae10 0x5590da70b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f72192fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da70ae10 0x5590da70b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57068/0 (socket says 172.21.15.135:57068) 2024-04-20T12:30:17.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f72192fb640 1 -- 172.21.15.135:0/2010117313 learned_addr learned my addr 172.21.15.135:0/2010117313 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:17.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f721a2fd640 1 --2- 172.21.15.135:0/1385806849 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72000a3d20 0x7f72000a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f7219afc640 1 --2- 172.21.15.135:0/2010117313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70b730 0x5590da713dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f720affd640 1 -- 172.21.15.135:0/1385806849 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f720c0f2f30 con 0x7f721419a820 2024-04-20T12:30:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f72192fb640 1 --2- 172.21.15.135:0/2010117313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da714310 0x5590da716700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f7219afc640 1 -- 172.21.15.135:0/2010117313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da714310 msgr2=0x5590da716700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f7219afc640 1 --2- 172.21.15.135:0/2010117313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da714310 0x5590da716700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f7219afc640 1 -- 172.21.15.135:0/2010117313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da70ae10 msgr2=0x5590da70b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f7219afc640 1 --2- 172.21.15.135:0/2010117313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da70ae10 0x5590da70b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f7219afc640 1 -- 172.21.15.135:0/2010117313 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590da635900 con 0x5590da70b730 2024-04-20T12:30:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f72192fb640 1 --2- 172.21.15.135:0/2010117313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da70ae10 0x5590da70b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:30:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.174+0000 7f721a2fd640 1 --2- 172.21.15.135:0/1385806849 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72000a3d20 0x7f72000a61e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f720c0f0410 tx=0x7f720c04e000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.175+0000 7f7219afc640 1 --2- 172.21.15.135:0/2010117313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70b730 0x5590da713dd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7210009ac0 tx=0x7f7210009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71e583d0decdca7d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.175+0000 7f71fffff640 1 -- 172.21.15.135:0/2010117313 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721000ecb0 con 0x5590da70b730 2024-04-20T12:30:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.175+0000 7f71fffff640 1 -- 172.21.15.135:0/2010117313 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f721000ee50 con 0x5590da70b730 2024-04-20T12:30:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.175+0000 7f71fffff640 1 -- 172.21.15.135:0/2010117313 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72100116d0 con 0x5590da70b730 2024-04-20T12:30:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.175+0000 7f721ea32740 1 -- 172.21.15.135:0/2010117313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70b730 msgr2=0x5590da713dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.175+0000 7f721ea32740 1 --2- 172.21.15.135:0/2010117313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70b730 0x5590da713dd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7210009ac0 tx=0x7f7210009f80 comp rx=0 tx=0).stop 2024-04-20T12:30:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 1 -- 172.21.15.135:0/2010117313 shutdown_connections 2024-04-20T12:30:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 1 --2- 172.21.15.135:0/2010117313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da714310 0x5590da716700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 1 --2- 172.21.15.135:0/2010117313 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70b730 0x5590da713dd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 1 --2- 172.21.15.135:0/2010117313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da70ae10 0x5590da70b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 1 -- 172.21.15.135:0/2010117313 >> 172.21.15.135:0/2010117313 conn(0x5590da705540 msgr2=0x5590da705920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:17.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 1 -- 172.21.15.135:0/2010117313 shutdown_connections 2024-04-20T12:30:17.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 1 -- 172.21.15.135:0/2010117313 wait complete. 2024-04-20T12:30:17.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 1 -- start start 2024-04-20T12:30:17.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 1 Processor -- start 2024-04-20T12:30:17.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70ae10 0x5590da711330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da70b730 0x5590da711870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da714310 0x5590da711db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5590da717100 con 0x5590da714310 2024-04-20T12:30:17.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5590da629500 con 0x5590da70ae10 2024-04-20T12:30:17.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5590da717280 con 0x5590da70b730 2024-04-20T12:30:17.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.176+0000 7f721ea32740 10 client.0 _ll_register_callbacks cb 0x5590da60e2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:17.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f72192fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da714310 0x5590da711db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f72192fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da714310 0x5590da711db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57082/0 (socket says 172.21.15.135:57082) 2024-04-20T12:30:17.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f72192fb640 1 -- 172.21.15.135:0/2970240969 learned_addr learned my addr 172.21.15.135:0/2970240969 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:17.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f72192fb640 1 --2- 172.21.15.135:0/2970240969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70ae10 0x5590da711330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f7219afc640 1 --2- 172.21.15.135:0/2970240969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da70b730 0x5590da711870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f72192fb640 1 -- 172.21.15.135:0/2970240969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da70b730 msgr2=0x5590da711870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f72192fb640 1 --2- 172.21.15.135:0/2970240969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da70b730 0x5590da711870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f72192fb640 1 -- 172.21.15.135:0/2970240969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70ae10 msgr2=0x5590da711330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f72192fb640 1 --2- 172.21.15.135:0/2970240969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70ae10 0x5590da711330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f72192fb640 1 -- 172.21.15.135:0/2970240969 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590da3823f0 con 0x5590da714310 2024-04-20T12:30:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f72192fb640 1 --2- 172.21.15.135:0/2970240969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da714310 0x5590da711db0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f7204014c00 tx=0x7f7204005f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe56a4ebdb74473e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f71fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f71fd7fa640 1 -- 172.21.15.135:0/2970240969 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7204010e70 con 0x5590da714310 2024-04-20T12:30:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f71fd7fa640 1 -- 172.21.15.135:0/2970240969 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f7204005020 con 0x5590da714310 2024-04-20T12:30:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f721ea32740 1 -- 172.21.15.135:0/2970240969 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f721000ee50 con 0x5590da714310 2024-04-20T12:30:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f71fd7fa640 1 -- 172.21.15.135:0/2970240969 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7204027050 con 0x5590da714310 2024-04-20T12:30:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f721ea32740 10 client.17865 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f721ea32740 1 -- 172.21.15.135:0/2970240969 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5590da44c7d0 con 0x5590da714310 2024-04-20T12:30:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.177+0000 7f71fd7fa640 1 -- 172.21.15.135:0/2970240969 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f721000ee50 con 0x5590da714310 2024-04-20T12:30:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.178+0000 7f71fd7fa640 1 -- 172.21.15.135:0/2970240969 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f720400c070 con 0x5590da714310 2024-04-20T12:30:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.178+0000 7f721ea32740 10 client.17865 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:17.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.178+0000 7f721ea32740 10 client.17865 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.178+0000 7f721ea32740 20 client.17865 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.178+0000 7f721ea32740 1 --2- 172.21.15.135:0/2970240969 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5590da7246c0 0x5590da726b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.178+0000 7f721ea32740 4 client.17865 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.178+0000 7f721ea32740 1 -- 172.21.15.135:0/2970240969 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590da67db30 con 0x5590da7246c0 2024-04-20T12:30:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.178+0000 7f7219afc640 1 --2- 172.21.15.135:0/2970240969 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5590da7246c0 0x5590da726b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.178+0000 7f7219afc640 1 --2- 172.21.15.135:0/2970240969 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5590da7246c0 0x5590da726b20 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e25eeb0f81bc9b51 server_cookie=83dedbfba8ff9c02 in_seq=0 out_seq=0 2024-04-20T12:30:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.178+0000 7f71fd7fa640 10 client.17865 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.179+0000 7f71fd7fa640 1 -- 172.21.15.135:0/2970240969 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5590da67db30 con 0x5590da7246c0 2024-04-20T12:30:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.179+0000 7f71fd7fa640 10 client.17865 handle_command_reply: tid=0 2024-04-20T12:30:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.179+0000 7f721ea32740 1 client.17865 shutdown 2024-04-20T12:30:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.179+0000 7f721ea32740 1 -- 172.21.15.135:0/2970240969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da714310 msgr2=0x5590da711db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.179+0000 7f721ea32740 1 --2- 172.21.15.135:0/2970240969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da714310 0x5590da711db0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f7204014c00 tx=0x7f7204005f50 comp rx=0 tx=0).stop 2024-04-20T12:30:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.179+0000 7f721ea32740 1 -- 172.21.15.135:0/2970240969 shutdown_connections 2024-04-20T12:30:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.179+0000 7f721ea32740 1 --2- 172.21.15.135:0/2970240969 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5590da7246c0 0x5590da726b20 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.179+0000 7f721ea32740 1 --2- 172.21.15.135:0/2970240969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da714310 0x5590da711db0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.179+0000 7f721ea32740 1 --2- 172.21.15.135:0/2970240969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da70b730 0x5590da711870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.179+0000 7f721ea32740 1 --2- 172.21.15.135:0/2970240969 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70ae10 0x5590da711330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.179+0000 7f71fd7fa640 0 client.17865 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.179+0000 7f721ea32740 1 -- 172.21.15.135:0/2970240969 >> 172.21.15.135:0/2970240969 conn(0x5590da705540 msgr2=0x5590da707290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.179+0000 7f721ea32740 1 -- 172.21.15.135:0/2970240969 shutdown_connections 2024-04-20T12:30:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.179+0000 7f721ea32740 1 -- 172.21.15.135:0/2970240969 wait complete. 2024-04-20T12:30:17.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.179+0000 7f721ea32740 20 client.17865 trim_cache size 0 max 16384 2024-04-20T12:30:17.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.192+0000 7f721ea32740 1 Processor -- start 2024-04-20T12:30:17.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f721ea32740 1 -- start start 2024-04-20T12:30:17.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f721ea32740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da70ae10 0x5590da713a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f721ea32740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70b730 0x5590da71fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f721ea32740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da714310 0x5590da704560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f721ea32740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f72141b1760 con 0x5590da714310 2024-04-20T12:30:17.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f721ea32740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f72141b32a0 con 0x5590da70b730 2024-04-20T12:30:17.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f721ea32740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72141b1e30 con 0x5590da70ae10 2024-04-20T12:30:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f72192fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da714310 0x5590da704560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f72192fb640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da714310 0x5590da704560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57098/0 (socket says 172.21.15.135:57098) 2024-04-20T12:30:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f72192fb640 1 -- 172.21.15.135:0/1660442730 learned_addr learned my addr 172.21.15.135:0/1660442730 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f7219afc640 1 --2- 172.21.15.135:0/1660442730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70b730 0x5590da71fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f72192fb640 1 -- 172.21.15.135:0/1660442730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da70ae10 msgr2=0x5590da713a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f72192fb640 1 --2- 172.21.15.135:0/1660442730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da70ae10 0x5590da713a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f72192fb640 1 -- 172.21.15.135:0/1660442730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70b730 msgr2=0x5590da71fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f72192fb640 1 --2- 172.21.15.135:0/1660442730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70b730 0x5590da71fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f72192fb640 1 -- 172.21.15.135:0/1660442730 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590da7062b0 con 0x5590da714310 2024-04-20T12:30:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f7219afc640 1 --2- 172.21.15.135:0/1660442730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70b730 0x5590da71fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f72192fb640 1 --2- 172.21.15.135:0/1660442730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da714310 0x5590da704560 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f7204004ec0 tx=0x7f7204009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8016863e8f1d4e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f71ff7fe640 1 -- 172.21.15.135:0/1660442730 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7204030070 con 0x5590da714310 2024-04-20T12:30:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f71ff7fe640 1 -- 172.21.15.135:0/1660442730 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7204010e70 con 0x5590da714310 2024-04-20T12:30:17.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.193+0000 7f71ff7fe640 1 -- 172.21.15.135:0/1660442730 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7204005240 con 0x5590da714310 2024-04-20T12:30:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.194+0000 7f721ea32740 1 -- 172.21.15.135:0/1660442730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da714310 msgr2=0x5590da704560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.194+0000 7f721ea32740 1 --2- 172.21.15.135:0/1660442730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da714310 0x5590da704560 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f7204004ec0 tx=0x7f7204009c50 comp rx=0 tx=0).stop 2024-04-20T12:30:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.194+0000 7f721ea32740 1 -- 172.21.15.135:0/1660442730 shutdown_connections 2024-04-20T12:30:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.194+0000 7f721ea32740 1 --2- 172.21.15.135:0/1660442730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da714310 0x5590da704560 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.194+0000 7f721ea32740 1 --2- 172.21.15.135:0/1660442730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da70b730 0x5590da71fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.194+0000 7f721ea32740 1 --2- 172.21.15.135:0/1660442730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da70ae10 0x5590da713a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.194+0000 7f721ea32740 1 -- 172.21.15.135:0/1660442730 >> 172.21.15.135:0/1660442730 conn(0x5590da705540 msgr2=0x5590da703e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.194+0000 7f721ea32740 1 -- 172.21.15.135:0/1660442730 shutdown_connections 2024-04-20T12:30:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.194+0000 7f721ea32740 1 -- 172.21.15.135:0/1660442730 wait complete. 2024-04-20T12:30:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.194+0000 7f721ea32740 1 -- start start 2024-04-20T12:30:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.194+0000 7f721ea32740 1 Processor -- start 2024-04-20T12:30:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f721ea32740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da70ae10 0x5590da717780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f721ea32740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da70b730 0x5590da717cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f721ea32740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da714310 0x5590da782c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f721ea32740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f72141b2bd0 con 0x5590da70b730 2024-04-20T12:30:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f721ea32740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f72141b2500 con 0x5590da714310 2024-04-20T12:30:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f721ea32740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f72141af750 con 0x5590da70ae10 2024-04-20T12:30:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f721ea32740 10 client.0 _ll_register_callbacks cb 0x7f7204009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f7219afc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da70b730 0x5590da717cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f7219afc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da70b730 0x5590da717cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57100/0 (socket says 172.21.15.135:57100) 2024-04-20T12:30:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f7219afc640 1 -- 172.21.15.135:0/3648173811 learned_addr learned my addr 172.21.15.135:0/3648173811 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f72192fb640 1 --2- 172.21.15.135:0/3648173811 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da714310 0x5590da782c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f72192fb640 1 --2- 172.21.15.135:0/3648173811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da70ae10 0x5590da717780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f7219afc640 1 -- 172.21.15.135:0/3648173811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da70ae10 msgr2=0x5590da717780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f7219afc640 1 --2- 172.21.15.135:0/3648173811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da70ae10 0x5590da717780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f7219afc640 1 -- 172.21.15.135:0/3648173811 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da714310 msgr2=0x5590da782c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f7219afc640 1 --2- 172.21.15.135:0/3648173811 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da714310 0x5590da782c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f7219afc640 1 -- 172.21.15.135:0/3648173811 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590da783210 con 0x5590da70b730 2024-04-20T12:30:17.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f72192fb640 1 --2- 172.21.15.135:0/3648173811 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da714310 0x5590da782c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f7219afc640 1 --2- 172.21.15.135:0/3648173811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da70b730 0x5590da717cc0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f7210005d00 tx=0x7f7210003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae666d2dd37cd961 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f71fd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f71fd7fa640 1 -- 172.21.15.135:0/3648173811 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72100035f0 con 0x5590da70b730 2024-04-20T12:30:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f71fd7fa640 1 -- 172.21.15.135:0/3648173811 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7f7210003790 con 0x5590da70b730 2024-04-20T12:30:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f721ea32740 1 -- 172.21.15.135:0/3648173811 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7204010e70 con 0x5590da70b730 2024-04-20T12:30:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f71fd7fa640 1 -- 172.21.15.135:0/3648173811 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7210003990 con 0x5590da70b730 2024-04-20T12:30:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f721ea32740 10 client.17871 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.195+0000 7f721ea32740 1 -- 172.21.15.135:0/3648173811 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5590da78a5b0 con 0x5590da70b730 2024-04-20T12:30:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.196+0000 7f71fd7fa640 1 -- 172.21.15.135:0/3648173811 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7204010e70 con 0x5590da70b730 2024-04-20T12:30:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.196+0000 7f71fd7fa640 1 -- 172.21.15.135:0/3648173811 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f721000f040 con 0x5590da70b730 2024-04-20T12:30:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.196+0000 7f721ea32740 10 client.17871 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.196+0000 7f721ea32740 10 client.17871 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.196+0000 7f721ea32740 20 client.17871 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:17.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.196+0000 7f721ea32740 1 --2- 172.21.15.135:0/3648173811 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5590da78ac20 0x5590da78d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.196+0000 7f721ea32740 4 client.17871 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:30:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.196+0000 7f721ea32740 1 -- 172.21.15.135:0/3648173811 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5590da6779a0 con 0x5590da78ac20 2024-04-20T12:30:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.196+0000 7f72192fb640 1 --2- 172.21.15.135:0/3648173811 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5590da78ac20 0x5590da78d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f71fd7fa640 10 client.17871 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f72192fb640 1 --2- 172.21.15.135:0/3648173811 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5590da78ac20 0x5590da78d040 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed0f5f72644cf3e6 server_cookie=aa52ed81ab85f02 in_seq=0 out_seq=0 2024-04-20T12:30:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f71fd7fa640 1 -- 172.21.15.135:0/3648173811 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5590da6779a0 con 0x5590da78ac20 2024-04-20T12:30:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f71fd7fa640 10 client.17871 handle_command_reply: tid=0 2024-04-20T12:30:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f721ea32740 1 client.17871 shutdown 2024-04-20T12:30:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f721ea32740 1 -- 172.21.15.135:0/3648173811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da70b730 msgr2=0x5590da717cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f721ea32740 1 --2- 172.21.15.135:0/3648173811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da70b730 0x5590da717cc0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f7210005d00 tx=0x7f7210003c60 comp rx=0 tx=0).stop 2024-04-20T12:30:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f721ea32740 1 -- 172.21.15.135:0/3648173811 shutdown_connections 2024-04-20T12:30:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f721ea32740 1 --2- 172.21.15.135:0/3648173811 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5590da78ac20 0x5590da78d040 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f721ea32740 1 --2- 172.21.15.135:0/3648173811 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5590da714310 0x5590da782c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f721ea32740 1 --2- 172.21.15.135:0/3648173811 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5590da70b730 0x5590da717cc0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f721ea32740 1 --2- 172.21.15.135:0/3648173811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5590da70ae10 0x5590da717780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f71fd7fa640 0 client.17871 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f721ea32740 1 -- 172.21.15.135:0/3648173811 >> 172.21.15.135:0/3648173811 conn(0x5590da705540 msgr2=0x5590da7046e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f721ea32740 1 -- 172.21.15.135:0/3648173811 shutdown_connections 2024-04-20T12:30:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f721ea32740 1 -- 172.21.15.135:0/3648173811 wait complete. 2024-04-20T12:30:17.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.197+0000 7f721ea32740 20 client.17871 trim_cache size 0 max 16384 2024-04-20T12:30:17.204 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:30:17.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.198+0000 7f721bd60640 1 -- 172.21.15.135:0/1385806849 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72000a3d20 msgr2=0x7f72000a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.198+0000 7f721bd60640 1 --2- 172.21.15.135:0/1385806849 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72000a3d20 0x7f72000a61e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f720c0f0410 tx=0x7f720c04e000 comp rx=0 tx=0).stop 2024-04-20T12:30:17.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.198+0000 7f721bd60640 1 -- 172.21.15.135:0/1385806849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f721419a820 msgr2=0x7f721419acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:17.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.198+0000 7f721bd60640 1 --2- 172.21.15.135:0/1385806849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f721419a820 0x7f721419acd0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f720c02c700 tx=0x7f720c032f20 comp rx=0 tx=0).stop 2024-04-20T12:30:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.198+0000 7f721bd60640 1 -- 172.21.15.135:0/1385806849 shutdown_connections 2024-04-20T12:30:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.198+0000 7f721bd60640 1 --2- 172.21.15.135:0/1385806849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f721419a820 0x7f721419acd0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.198+0000 7f721bd60640 1 --2- 172.21.15.135:0/1385806849 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7214107290 0x7f72141a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.198+0000 7f721bd60640 1 --2- 172.21.15.135:0/1385806849 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72000a3d20 0x7f72000a61e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.198+0000 7f721bd60640 1 --2- 172.21.15.135:0/1385806849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f72141006d0 0x7f72141a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.198+0000 7f721bd60640 1 -- 172.21.15.135:0/1385806849 >> 172.21.15.135:0/1385806849 conn(0x7f72140773b0 msgr2=0x7f7214105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.198+0000 7f721bd60640 1 -- 172.21.15.135:0/1385806849 shutdown_connections 2024-04-20T12:30:17.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:17.198+0000 7f721bd60640 1 -- 172.21.15.135:0/1385806849 wait complete. 2024-04-20T12:30:17.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:16 smithi154 ceph-mon[22073]: pgmap v218: 129 pgs: 129 active+clean; 16 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:30:17.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:16 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1512937746' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:30:18.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:17 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:30:18.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:17 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:30:18.209 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:30:18.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:30:18.210 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:30:18.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:17 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:30:18.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.313+0000 7fc1c1e2c640 1 -- 172.21.15.135:0/4081668828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1bc1010a0 msgr2=0x7fc1bc101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.313+0000 7fc1c1e2c640 1 --2- 172.21.15.135:0/4081668828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1bc1010a0 0x7fc1bc101480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac009900 tx=0x7fc1ac02bc30 comp rx=0 tx=0).stop 2024-04-20T12:30:18.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.313+0000 7fc1c1e2c640 1 -- 172.21.15.135:0/4081668828 shutdown_connections 2024-04-20T12:30:18.315 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.313+0000 7fc1c1e2c640 1 --2- 172.21.15.135:0/4081668828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1bc106170 0x7fc1bc10dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.313+0000 7fc1c1e2c640 1 --2- 172.21.15.135:0/4081668828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc101a50 0x7fc1bc105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.313+0000 7fc1c1e2c640 1 --2- 172.21.15.135:0/4081668828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1bc1010a0 0x7fc1bc101480 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.313+0000 7fc1c1e2c640 1 -- 172.21.15.135:0/4081668828 >> 172.21.15.135:0/4081668828 conn(0x7fc1bc077f60 msgr2=0x7fc1bc078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:18.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.313+0000 7fc1c1e2c640 1 -- 172.21.15.135:0/4081668828 shutdown_connections 2024-04-20T12:30:18.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.313+0000 7fc1c1e2c640 1 -- 172.21.15.135:0/4081668828 wait complete. 2024-04-20T12:30:18.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.313+0000 7fc1c1e2c640 1 Processor -- start 2024-04-20T12:30:18.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.313+0000 7fc1c1e2c640 1 -- start start 2024-04-20T12:30:18.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1c1e2c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1bc1010a0 0x7fc1bc19d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1c1e2c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1bc106170 0x7fc1bc19d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1c1e2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc1975a0 0x7fc1bc197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1c1e2c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc111220 con 0x7fc1bc106170 2024-04-20T12:30:18.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1c1e2c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc1110a0 con 0x7fc1bc1010a0 2024-04-20T12:30:18.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1c1e2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc1113a0 con 0x7fc1bc1975a0 2024-04-20T12:30:18.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1b2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1bc106170 0x7fc1bc19d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1b2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1bc106170 0x7fc1bc19d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57128/0 (socket says 172.21.15.135:57128) 2024-04-20T12:30:18.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1b2ffd640 1 -- 172.21.15.135:0/282865788 learned_addr learned my addr 172.21.15.135:0/282865788 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:18.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1bb7fe640 1 --2- 172.21.15.135:0/282865788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1bc1010a0 0x7fc1bc19d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1bbfff640 1 --2- 172.21.15.135:0/282865788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc1975a0 0x7fc1bc197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1b2ffd640 1 -- 172.21.15.135:0/282865788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc1975a0 msgr2=0x7fc1bc197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1b2ffd640 1 --2- 172.21.15.135:0/282865788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc1975a0 0x7fc1bc197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1b2ffd640 1 -- 172.21.15.135:0/282865788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1bc1010a0 msgr2=0x7fc1bc19d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1b2ffd640 1 --2- 172.21.15.135:0/282865788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1bc1010a0 0x7fc1bc19d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1b2ffd640 1 -- 172.21.15.135:0/282865788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1bc1980c0 con 0x7fc1bc106170 2024-04-20T12:30:18.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1bb7fe640 1 --2- 172.21.15.135:0/282865788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1bc1010a0 0x7fc1bc19d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:18.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.314+0000 7fc1b2ffd640 1 --2- 172.21.15.135:0/282865788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1bc106170 0x7fc1bc19d930 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400e9f0 tx=0x7fc1a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:18.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.315+0000 7fc1b97fa640 1 -- 172.21.15.135:0/282865788 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a400ccc0 con 0x7fc1bc106170 2024-04-20T12:30:18.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.315+0000 7fc1c1e2c640 1 -- 172.21.15.135:0/282865788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1bc1983b0 con 0x7fc1bc106170 2024-04-20T12:30:18.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.315+0000 7fc1b97fa640 1 -- 172.21.15.135:0/282865788 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1a4005500 con 0x7fc1bc106170 2024-04-20T12:30:18.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.315+0000 7fc1b97fa640 1 -- 172.21.15.135:0/282865788 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4010690 con 0x7fc1bc106170 2024-04-20T12:30:18.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.315+0000 7fc1c1e2c640 1 -- 172.21.15.135:0/282865788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1bc1a4600 con 0x7fc1bc106170 2024-04-20T12:30:18.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.317+0000 7fc1b97fa640 1 -- 172.21.15.135:0/282865788 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fc1a40046c0 con 0x7fc1bc106170 2024-04-20T12:30:18.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.317+0000 7fc1c4a18740 1 Processor -- start 2024-04-20T12:30:18.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.317+0000 7fc1c4a18740 1 -- start start 2024-04-20T12:30:18.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.317+0000 7fc1b97fa640 1 --2- 172.21.15.135:0/282865788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1a80a3d20 0x7fc1a80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.317+0000 7fc1c4a18740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 0x5650dee3eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.317+0000 7fc1c4a18740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee3f370 0x5650dee4a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.317+0000 7fc1c4a18740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee4a6f0 0x5650dee4cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.317+0000 7fc1c4a18740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5650deda3f00 con 0x5650dee3f370 2024-04-20T12:30:18.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.317+0000 7fc1c4a18740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5650ded41530 con 0x5650dee3e9c0 2024-04-20T12:30:18.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.317+0000 7fc1c4a18740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5650ded9fec0 con 0x5650dee4a6f0 2024-04-20T12:30:18.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.317+0000 7fc1bbfff640 1 --2- 172.21.15.135:0/282865788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1a80a3d20 0x7fc1a80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.317+0000 7fc1b97fa640 1 -- 172.21.15.135:0/282865788 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7fc1a40d10f0 con 0x7fc1bc106170 2024-04-20T12:30:18.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.317+0000 7fc1b2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee3f370 0x5650dee4a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.317+0000 7fc1b2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee3f370 0x5650dee4a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57144/0 (socket says 172.21.15.135:57144) 2024-04-20T12:30:18.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.317+0000 7fc1b2ffd640 1 -- 172.21.15.135:0/1664201100 learned_addr learned my addr 172.21.15.135:0/1664201100 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:18.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.318+0000 7fc1bbfff640 1 --2- 172.21.15.135:0/1664201100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee4a6f0 0x5650dee4cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.318+0000 7fc1bb7fe640 1 --2- 172.21.15.135:0/1664201100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 0x5650dee3eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.318+0000 7fc1b2ffd640 1 -- 172.21.15.135:0/1664201100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee4a6f0 msgr2=0x5650dee4cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.318+0000 7fc1b2ffd640 1 --2- 172.21.15.135:0/1664201100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee4a6f0 0x5650dee4cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.318+0000 7fc1b2ffd640 1 -- 172.21.15.135:0/1664201100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 msgr2=0x5650dee3eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.318+0000 7fc1b2ffd640 1 --2- 172.21.15.135:0/1664201100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 0x5650dee3eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.318+0000 7fc1b2ffd640 1 -- 172.21.15.135:0/1664201100 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650deb7e7e0 con 0x5650dee3f370 2024-04-20T12:30:18.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.318+0000 7fc1bbfff640 1 --2- 172.21.15.135:0/282865788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1a80a3d20 0x7fc1a80a61e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4005c40 tx=0x7fc1b4009d50 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:18.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.318+0000 7fc1b2ffd640 1 --2- 172.21.15.135:0/1664201100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee3f370 0x5650dee4a1b0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4099630 tx=0x7fc1a4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db0b35de0df500e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:18.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.318+0000 7fc1b1ffb640 1 -- 172.21.15.135:0/1664201100 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a409d360 con 0x5650dee3f370 2024-04-20T12:30:18.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.318+0000 7fc1b1ffb640 1 -- 172.21.15.135:0/1664201100 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1a409cc60 con 0x5650dee3f370 2024-04-20T12:30:18.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.318+0000 7fc1b1ffb640 1 -- 172.21.15.135:0/1664201100 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40992d0 con 0x5650dee3f370 2024-04-20T12:30:18.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.319+0000 7fc1c4a18740 1 -- 172.21.15.135:0/1664201100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee3f370 msgr2=0x5650dee4a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.319+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/1664201100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee3f370 0x5650dee4a1b0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4099630 tx=0x7fc1a4009750 comp rx=0 tx=0).stop 2024-04-20T12:30:18.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.319+0000 7fc1c4a18740 1 -- 172.21.15.135:0/1664201100 shutdown_connections 2024-04-20T12:30:18.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.319+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/1664201100 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee4a6f0 0x5650dee4cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.319+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/1664201100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee3f370 0x5650dee4a1b0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.319+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/1664201100 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 0x5650dee3eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.319+0000 7fc1c4a18740 1 -- 172.21.15.135:0/1664201100 >> 172.21.15.135:0/1664201100 conn(0x5650dee39710 msgr2=0x5650dee39af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:18.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.319+0000 7fc1c4a18740 1 -- 172.21.15.135:0/1664201100 shutdown_connections 2024-04-20T12:30:18.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.319+0000 7fc1c4a18740 1 -- 172.21.15.135:0/1664201100 wait complete. 2024-04-20T12:30:18.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.319+0000 7fc1c4a18740 1 -- start start 2024-04-20T12:30:18.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.319+0000 7fc1c4a18740 1 Processor -- start 2024-04-20T12:30:18.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1c4a18740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee3e9c0 0x5650dee49fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1c4a18740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3f370 0x5650dee47330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1c4a18740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee4a6f0 0x5650dee47870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1c4a18740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5650dee4d4b0 con 0x5650dee4a6f0 2024-04-20T12:30:18.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1c4a18740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5650ded2c480 con 0x5650dee3f370 2024-04-20T12:30:18.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1c4a18740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5650dee4d630 con 0x5650dee3e9c0 2024-04-20T12:30:18.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1c4a18740 10 client.0 _ll_register_callbacks cb 0x5650ded2be70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:18.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1bbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee4a6f0 0x5650dee47870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1bbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee4a6f0 0x5650dee47870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57146/0 (socket says 172.21.15.135:57146) 2024-04-20T12:30:18.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1bbfff640 1 -- 172.21.15.135:0/3928170175 learned_addr learned my addr 172.21.15.135:0/3928170175 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:18.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1b2ffd640 1 --2- 172.21.15.135:0/3928170175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3f370 0x5650dee47330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1bb7fe640 1 --2- 172.21.15.135:0/3928170175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee3e9c0 0x5650dee49fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1bbfff640 1 -- 172.21.15.135:0/3928170175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee3e9c0 msgr2=0x5650dee49fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1bbfff640 1 --2- 172.21.15.135:0/3928170175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee3e9c0 0x5650dee49fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1bbfff640 1 -- 172.21.15.135:0/3928170175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3f370 msgr2=0x5650dee47330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1bbfff640 1 --2- 172.21.15.135:0/3928170175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3f370 0x5650dee47330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1bbfff640 1 -- 172.21.15.135:0/3928170175 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650debdef70 con 0x5650dee4a6f0 2024-04-20T12:30:18.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1bbfff640 1 --2- 172.21.15.135:0/3928170175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee4a6f0 0x5650dee47870 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4011d60 tx=0x7fc1b401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378e10a84197c67e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:18.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc19affd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:18.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc19affd640 1 -- 172.21.15.135:0/3928170175 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4026070 con 0x5650dee4a6f0 2024-04-20T12:30:18.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc19affd640 1 -- 172.21.15.135:0/3928170175 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7fc1b4004730 con 0x5650dee4a6f0 2024-04-20T12:30:18.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3928170175 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1a409cc60 con 0x5650dee4a6f0 2024-04-20T12:30:18.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc19affd640 1 -- 172.21.15.135:0/3928170175 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc1b4032050 con 0x5650dee4a6f0 2024-04-20T12:30:18.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1c4a18740 10 client.17883 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:18.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.320+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3928170175 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5650dea76170 con 0x5650dee4a6f0 2024-04-20T12:30:18.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.321+0000 7fc19affd640 1 -- 172.21.15.135:0/3928170175 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1a409cc60 con 0x5650dee4a6f0 2024-04-20T12:30:18.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.321+0000 7fc19affd640 1 -- 172.21.15.135:0/3928170175 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc1b400f050 con 0x5650dee4a6f0 2024-04-20T12:30:18.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.321+0000 7fc1c4a18740 10 client.17883 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:18.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.321+0000 7fc1c4a18740 10 client.17883 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:18.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.321+0000 7fc1c4a18740 20 client.17883 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:18.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.321+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3928170175 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5650dee5a630 0x5650dee5ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.321+0000 7fc1c4a18740 4 client.17883 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:18.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.321+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3928170175 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650dedb1920 con 0x5650dee5a630 2024-04-20T12:30:18.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.321+0000 7fc1bb7fe640 1 --2- 172.21.15.135:0/3928170175 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5650dee5a630 0x5650dee5ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.321+0000 7fc1bb7fe640 1 --2- 172.21.15.135:0/3928170175 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5650dee5a630 0x5650dee5ca20 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6719eae210e54c0 server_cookie=b64cd52a834d25f8 in_seq=0 out_seq=0 2024-04-20T12:30:18.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.321+0000 7fc19affd640 10 client.17883 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:18.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.322+0000 7fc19affd640 1 -- 172.21.15.135:0/3928170175 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5650dedb1920 con 0x5650dee5a630 2024-04-20T12:30:18.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.322+0000 7fc19affd640 10 client.17883 handle_command_reply: tid=0 2024-04-20T12:30:18.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.322+0000 7fc1c4a18740 1 client.17883 shutdown 2024-04-20T12:30:18.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.322+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3928170175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee4a6f0 msgr2=0x5650dee47870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.322+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3928170175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee4a6f0 0x5650dee47870 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4011d60 tx=0x7fc1b401b000 comp rx=0 tx=0).stop 2024-04-20T12:30:18.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.322+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3928170175 shutdown_connections 2024-04-20T12:30:18.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.322+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3928170175 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5650dee5a630 0x5650dee5ca20 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.322+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3928170175 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee4a6f0 0x5650dee47870 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.322+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3928170175 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3f370 0x5650dee47330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.322+0000 7fc19affd640 0 client.17883 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:18.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.322+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3928170175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee3e9c0 0x5650dee49fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.322+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3928170175 >> 172.21.15.135:0/3928170175 conn(0x5650dee39710 msgr2=0x5650dee3b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:18.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.322+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3928170175 shutdown_connections 2024-04-20T12:30:18.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.322+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3928170175 wait complete. 2024-04-20T12:30:18.331 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.322+0000 7fc1c4a18740 20 client.17883 trim_cache size 0 max 16384 2024-04-20T12:30:18.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.339+0000 7fc1c4a18740 1 Processor -- start 2024-04-20T12:30:18.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.339+0000 7fc1c4a18740 1 -- start start 2024-04-20T12:30:18.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.339+0000 7fc1c4a18740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 0x5650dee563b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.344 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1c4a18740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee3f370 0x5650dee49a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1c4a18740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee4a6f0 0x5650dee49fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1c4a18740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc1ad490 con 0x5650dee4a6f0 2024-04-20T12:30:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1c4a18740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc1aefd0 con 0x5650dee3e9c0 2024-04-20T12:30:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1c4a18740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc1adb60 con 0x5650dee3f370 2024-04-20T12:30:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1bbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee4a6f0 0x5650dee49fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1bbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee4a6f0 0x5650dee49fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57160/0 (socket says 172.21.15.135:57160) 2024-04-20T12:30:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1bbfff640 1 -- 172.21.15.135:0/3067804532 learned_addr learned my addr 172.21.15.135:0/3067804532 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1bb7fe640 1 --2- 172.21.15.135:0/3067804532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 0x5650dee563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1b2ffd640 1 --2- 172.21.15.135:0/3067804532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee3f370 0x5650dee49a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1bbfff640 1 -- 172.21.15.135:0/3067804532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee3f370 msgr2=0x5650dee49a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1bbfff640 1 --2- 172.21.15.135:0/3067804532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee3f370 0x5650dee49a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.345 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1bbfff640 1 -- 172.21.15.135:0/3067804532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 msgr2=0x5650dee563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1bbfff640 1 --2- 172.21.15.135:0/3067804532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 0x5650dee563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1bbfff640 1 -- 172.21.15.135:0/3067804532 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650dee3e0d0 con 0x5650dee4a6f0 2024-04-20T12:30:18.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1b2ffd640 1 --2- 172.21.15.135:0/3067804532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee3f370 0x5650dee49a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:18.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1bbfff640 1 --2- 172.21.15.135:0/3067804532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee4a6f0 0x5650dee49fa0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4020ed0 tx=0x7fc1b4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5068ac0acfa9fb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:18.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1b17fa640 1 -- 172.21.15.135:0/3067804532 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b402f020 con 0x5650dee4a6f0 2024-04-20T12:30:18.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1b17fa640 1 -- 172.21.15.135:0/3067804532 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b4014480 con 0x5650dee4a6f0 2024-04-20T12:30:18.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.340+0000 7fc1b17fa640 1 -- 172.21.15.135:0/3067804532 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4026070 con 0x5650dee4a6f0 2024-04-20T12:30:18.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.341+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3067804532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee4a6f0 msgr2=0x5650dee49fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.341+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3067804532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee4a6f0 0x5650dee49fa0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4020ed0 tx=0x7fc1b4005bd0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.341+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3067804532 shutdown_connections 2024-04-20T12:30:18.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.341+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3067804532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee4a6f0 0x5650dee49fa0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.341+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3067804532 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee3f370 0x5650dee49a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.341+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3067804532 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 0x5650dee563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.346 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.341+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3067804532 >> 172.21.15.135:0/3067804532 conn(0x5650dee39710 msgr2=0x5650dee429e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:18.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.341+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3067804532 shutdown_connections 2024-04-20T12:30:18.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.341+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3067804532 wait complete. 2024-04-20T12:30:18.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.341+0000 7fc1c4a18740 1 -- start start 2024-04-20T12:30:18.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.341+0000 7fc1c4a18740 1 Processor -- start 2024-04-20T12:30:18.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1c4a18740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 0x5650dee44270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1c4a18740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee3f370 0x5650dee447b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1c4a18740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee4a6f0 0x5650dee44cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1c4a18740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc1ae900 con 0x5650dee3f370 2024-04-20T12:30:18.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1c4a18740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc1ae230 con 0x5650dee3e9c0 2024-04-20T12:30:18.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1c4a18740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1bc1ab480 con 0x5650dee4a6f0 2024-04-20T12:30:18.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1c4a18740 10 client.0 _ll_register_callbacks cb 0x7fc1b4009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:18.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1b2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee3f370 0x5650dee447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1b2ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee3f370 0x5650dee447b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57176/0 (socket says 172.21.15.135:57176) 2024-04-20T12:30:18.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1b2ffd640 1 -- 172.21.15.135:0/3744262226 learned_addr learned my addr 172.21.15.135:0/3744262226 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:18.347 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1bb7fe640 1 --2- 172.21.15.135:0/3744262226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 0x5650dee44270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1b2ffd640 1 -- 172.21.15.135:0/3744262226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee4a6f0 msgr2=0x5650dee44cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1b2ffd640 1 --2- 172.21.15.135:0/3744262226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee4a6f0 0x5650dee44cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1b2ffd640 1 -- 172.21.15.135:0/3744262226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 msgr2=0x5650dee44270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1b2ffd640 1 --2- 172.21.15.135:0/3744262226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 0x5650dee44270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1b2ffd640 1 -- 172.21.15.135:0/3744262226 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650deebfdb0 con 0x5650dee3f370 2024-04-20T12:30:18.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1bb7fe640 1 --2- 172.21.15.135:0/3744262226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 0x5650dee44270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:30:18.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1b2ffd640 1 --2- 172.21.15.135:0/3744262226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee3f370 0x5650dee447b0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40a53a0 tx=0x7fc1a4099500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfa434b10c9934d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:18.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc19affd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:18.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc19affd640 1 -- 172.21.15.135:0/3744262226 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a409cc60 con 0x5650dee3f370 2024-04-20T12:30:18.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc19affd640 1 -- 172.21.15.135:0/3744262226 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9592+0+0 (secure 0 0 0) 0x7fc1a40bd110 con 0x5650dee3f370 2024-04-20T12:30:18.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3744262226 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1b4014480 con 0x5650dee3f370 2024-04-20T12:30:18.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc19affd640 1 -- 172.21.15.135:0/3744262226 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc1a409d360 con 0x5650dee3f370 2024-04-20T12:30:18.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1c4a18740 10 client.17889 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:18.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.342+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3744262226 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5650deec1040 con 0x5650dee3f370 2024-04-20T12:30:18.348 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.343+0000 7fc19affd640 1 -- 172.21.15.135:0/3744262226 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1b4014480 con 0x5650dee3f370 2024-04-20T12:30:18.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.343+0000 7fc19affd640 1 -- 172.21.15.135:0/3744262226 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc1a40a5440 con 0x5650dee3f370 2024-04-20T12:30:18.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.343+0000 7fc1c4a18740 10 client.17889 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:18.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.343+0000 7fc1c4a18740 10 client.17889 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:18.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.343+0000 7fc1c4a18740 20 client.17889 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:18.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.343+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3744262226 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5650deec12d0 0x5650deec36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.343+0000 7fc1c4a18740 4 client.17889 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:30:18.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.343+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3744262226 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5650dee47c00 con 0x5650deec12d0 2024-04-20T12:30:18.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.343+0000 7fc1bb7fe640 1 --2- 172.21.15.135:0/3744262226 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5650deec12d0 0x5650deec36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.343+0000 7fc1bb7fe640 1 --2- 172.21.15.135:0/3744262226 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5650deec12d0 0x5650deec36c0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c24fdc2f88c54c09 server_cookie=486e9f208b68f1ca in_seq=0 out_seq=0 2024-04-20T12:30:18.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.343+0000 7fc19affd640 10 client.17889 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:18.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.344+0000 7fc19affd640 1 -- 172.21.15.135:0/3744262226 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5650dee47c00 con 0x5650deec12d0 2024-04-20T12:30:18.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.344+0000 7fc19affd640 10 client.17889 handle_command_reply: tid=0 2024-04-20T12:30:18.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.344+0000 7fc1c4a18740 1 client.17889 shutdown 2024-04-20T12:30:18.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.344+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3744262226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee3f370 msgr2=0x5650dee447b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.349 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.344+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3744262226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee3f370 0x5650dee447b0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40a53a0 tx=0x7fc1a4099500 comp rx=0 tx=0).stop 2024-04-20T12:30:18.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.344+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3744262226 shutdown_connections 2024-04-20T12:30:18.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.344+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3744262226 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5650deec12d0 0x5650deec36c0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.344+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3744262226 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5650dee4a6f0 0x5650dee44cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.344+0000 7fc19affd640 0 client.17889 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:18.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.344+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3744262226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650dee3f370 0x5650dee447b0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.344+0000 7fc1c4a18740 1 --2- 172.21.15.135:0/3744262226 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5650dee3e9c0 0x5650dee44270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.344+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3744262226 >> 172.21.15.135:0/3744262226 conn(0x5650dee39710 msgr2=0x5650dee37e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:18.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.345+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3744262226 shutdown_connections 2024-04-20T12:30:18.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.345+0000 7fc1c4a18740 1 -- 172.21.15.135:0/3744262226 wait complete. 2024-04-20T12:30:18.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.345+0000 7fc1c4a18740 20 client.17889 trim_cache size 0 max 16384 2024-04-20T12:30:18.350 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:30:18.351 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:30:18.351 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "ec29a88e-57a8-45ec-9937-684f0d0ebaee", 2024-04-20T12:30:18.351 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:30:18.351 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:30:18.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.345+0000 7fc1c1e2c640 1 -- 172.21.15.135:0/282865788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1a80a3d20 msgr2=0x7fc1a80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.345+0000 7fc1c1e2c640 1 --2- 172.21.15.135:0/282865788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1a80a3d20 0x7fc1a80a61e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4005c40 tx=0x7fc1b4009d50 comp rx=0 tx=0).stop 2024-04-20T12:30:18.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.345+0000 7fc1c1e2c640 1 -- 172.21.15.135:0/282865788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1bc106170 msgr2=0x7fc1bc19d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.345+0000 7fc1c1e2c640 1 --2- 172.21.15.135:0/282865788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1bc106170 0x7fc1bc19d930 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fc1a400e9f0 tx=0x7fc1a400eeb0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.345+0000 7fc1c1e2c640 1 -- 172.21.15.135:0/282865788 shutdown_connections 2024-04-20T12:30:18.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.346+0000 7fc1c1e2c640 1 --2- 172.21.15.135:0/282865788 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1a80a3d20 0x7fc1a80a61e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.346+0000 7fc1c1e2c640 1 --2- 172.21.15.135:0/282865788 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc1bc1975a0 0x7fc1bc197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.346+0000 7fc1c1e2c640 1 --2- 172.21.15.135:0/282865788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1bc106170 0x7fc1bc19d930 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.346+0000 7fc1c1e2c640 1 --2- 172.21.15.135:0/282865788 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1bc1010a0 0x7fc1bc19d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.346+0000 7fc1c1e2c640 1 -- 172.21.15.135:0/282865788 >> 172.21.15.135:0/282865788 conn(0x7fc1bc077f60 msgr2=0x7fc1bc0ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:18.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.346+0000 7fc1c1e2c640 1 -- 172.21.15.135:0/282865788 shutdown_connections 2024-04-20T12:30:18.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.346+0000 7fc1c1e2c640 1 -- 172.21.15.135:0/282865788 wait complete. 2024-04-20T12:30:18.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:30:18.356 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:30:18.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.460+0000 7fc16efc3640 1 -- 172.21.15.135:0/4206970704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168107290 msgr2=0x7fc16810ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.460+0000 7fc16efc3640 1 --2- 172.21.15.135:0/4206970704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168107290 0x7fc16810ee40 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fc160009ca0 tx=0x7fc16002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.460+0000 7fc16efc3640 1 -- 172.21.15.135:0/4206970704 shutdown_connections 2024-04-20T12:30:18.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.460+0000 7fc16efc3640 1 --2- 172.21.15.135:0/4206970704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168107290 0x7fc16810ee40 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.460+0000 7fc16efc3640 1 --2- 172.21.15.135:0/4206970704 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc16806b180 0x7fc168106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.460+0000 7fc16efc3640 1 --2- 172.21.15.135:0/4206970704 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16806a7d0 0x7fc16806abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.460+0000 7fc16efc3640 1 -- 172.21.15.135:0/4206970704 >> 172.21.15.135:0/4206970704 conn(0x7fc168076c60 msgr2=0x7fc168077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:18.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.460+0000 7fc16efc3640 1 -- 172.21.15.135:0/4206970704 shutdown_connections 2024-04-20T12:30:18.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.460+0000 7fc16efc3640 1 -- 172.21.15.135:0/4206970704 wait complete. 2024-04-20T12:30:18.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc16efc3640 1 Processor -- start 2024-04-20T12:30:18.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc16efc3640 1 -- start start 2024-04-20T12:30:18.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc16efc3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16806a7d0 0x7fc16819e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc16efc3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168107290 0x7fc16819e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc16efc3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1681985c0 0x7fc168198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc16efc3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc168112340 con 0x7fc168107290 2024-04-20T12:30:18.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc16efc3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681121c0 con 0x7fc1681985c0 2024-04-20T12:30:18.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc16efc3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681124c0 con 0x7fc16806a7d0 2024-04-20T12:30:18.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc167fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168107290 0x7fc16819e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc167fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168107290 0x7fc16819e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57192/0 (socket says 172.21.15.135:57192) 2024-04-20T12:30:18.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc167fff640 1 -- 172.21.15.135:0/512313308 learned_addr learned my addr 172.21.15.135:0/512313308 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:18.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc16cd5f640 1 --2- 172.21.15.135:0/512313308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16806a7d0 0x7fc16819e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc16d560640 1 --2- 172.21.15.135:0/512313308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1681985c0 0x7fc168198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc167fff640 1 -- 172.21.15.135:0/512313308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16806a7d0 msgr2=0x7fc16819e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc167fff640 1 --2- 172.21.15.135:0/512313308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16806a7d0 0x7fc16819e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc167fff640 1 -- 172.21.15.135:0/512313308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1681985c0 msgr2=0x7fc168198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc167fff640 1 --2- 172.21.15.135:0/512313308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1681985c0 0x7fc168198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc167fff640 1 -- 172.21.15.135:0/512313308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1681990e0 con 0x7fc168107290 2024-04-20T12:30:18.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc16d560640 1 --2- 172.21.15.135:0/512313308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1681985c0 0x7fc168198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:18.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc167fff640 1 --2- 172.21.15.135:0/512313308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168107290 0x7fc16819e950 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc15400d950 tx=0x7fc15400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:18.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc165ffb640 1 -- 172.21.15.135:0/512313308 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154017070 con 0x7fc168107290 2024-04-20T12:30:18.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.461+0000 7fc165ffb640 1 -- 172.21.15.135:0/512313308 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc154009c30 con 0x7fc168107290 2024-04-20T12:30:18.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.462+0000 7fc16efc3640 1 -- 172.21.15.135:0/512313308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1681993d0 con 0x7fc168107290 2024-04-20T12:30:18.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.462+0000 7fc165ffb640 1 -- 172.21.15.135:0/512313308 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1540047a0 con 0x7fc168107290 2024-04-20T12:30:18.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.462+0000 7fc16efc3640 1 -- 172.21.15.135:0/512313308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1681a5620 con 0x7fc168107290 2024-04-20T12:30:18.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.464+0000 7fc165ffb640 1 -- 172.21.15.135:0/512313308 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fc154004020 con 0x7fc168107290 2024-04-20T12:30:18.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc171bb0740 1 Processor -- start 2024-04-20T12:30:18.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc171bb0740 1 -- start start 2024-04-20T12:30:18.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc171bb0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef01d20 0x56216ef02100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc171bb0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef02640 0x56216ef0ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc171bb0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef0b220 0x56216ef0d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc165ffb640 1 --2- 172.21.15.135:0/512313308 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1580a3d20 0x7fc1580a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc171bb0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56216ee671b0 con 0x56216ef01d20 2024-04-20T12:30:18.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc171bb0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56216ee04390 con 0x56216ef0b220 2024-04-20T12:30:18.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc171bb0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56216ee63170 con 0x56216ef02640 2024-04-20T12:30:18.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc16d560640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef01d20 0x56216ef02100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc16d560640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef01d20 0x56216ef02100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57194/0 (socket says 172.21.15.135:57194) 2024-04-20T12:30:18.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc16d560640 1 -- 172.21.15.135:0/3864702284 learned_addr learned my addr 172.21.15.135:0/3864702284 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:18.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc167fff640 1 --2- 172.21.15.135:0/512313308 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1580a3d20 0x7fc1580a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc16cd5f640 1 --2- 172.21.15.135:0/3864702284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef02640 0x56216ef0ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc16d560640 1 --2- 172.21.15.135:0/3864702284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef0b220 0x56216ef0d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc165ffb640 1 -- 172.21.15.135:0/512313308 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7fc1540d0880 con 0x7fc168107290 2024-04-20T12:30:18.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc16d560640 1 -- 172.21.15.135:0/3864702284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef02640 msgr2=0x56216ef0ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc16d560640 1 --2- 172.21.15.135:0/3864702284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef02640 0x56216ef0ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc16d560640 1 -- 172.21.15.135:0/3864702284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef0b220 msgr2=0x56216ef0d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc16d560640 1 --2- 172.21.15.135:0/3864702284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef0b220 0x56216ef0d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.465+0000 7fc16d560640 1 -- 172.21.15.135:0/3864702284 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56216ec437d0 con 0x56216ef01d20 2024-04-20T12:30:18.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.466+0000 7fc16d560640 1 --2- 172.21.15.135:0/3864702284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef01d20 0x56216ef02100 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fc160009ca0 tx=0x7fc160004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b8129f2ebd5783 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:18.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.466+0000 7fc167fff640 1 --2- 172.21.15.135:0/512313308 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1580a3d20 0x7fc1580a61e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1540988b0 tx=0x7fc1540918e0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:18.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.466+0000 7fc152ffd640 1 -- 172.21.15.135:0/3864702284 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16002ce60 con 0x56216ef01d20 2024-04-20T12:30:18.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.466+0000 7fc152ffd640 1 -- 172.21.15.135:0/3864702284 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc160003970 con 0x56216ef01d20 2024-04-20T12:30:18.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.466+0000 7fc152ffd640 1 -- 172.21.15.135:0/3864702284 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160039040 con 0x56216ef01d20 2024-04-20T12:30:18.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.466+0000 7fc171bb0740 1 -- 172.21.15.135:0/3864702284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef01d20 msgr2=0x56216ef02100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.466+0000 7fc171bb0740 1 --2- 172.21.15.135:0/3864702284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef01d20 0x56216ef02100 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fc160009ca0 tx=0x7fc160004ab0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.466+0000 7fc171bb0740 1 -- 172.21.15.135:0/3864702284 shutdown_connections 2024-04-20T12:30:18.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.466+0000 7fc171bb0740 1 --2- 172.21.15.135:0/3864702284 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef0b220 0x56216ef0d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.466+0000 7fc171bb0740 1 --2- 172.21.15.135:0/3864702284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef02640 0x56216ef0ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.466+0000 7fc171bb0740 1 --2- 172.21.15.135:0/3864702284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef01d20 0x56216ef02100 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.466+0000 7fc171bb0740 1 -- 172.21.15.135:0/3864702284 >> 172.21.15.135:0/3864702284 conn(0x56216eefc450 msgr2=0x56216eefc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:18.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.466+0000 7fc171bb0740 1 -- 172.21.15.135:0/3864702284 shutdown_connections 2024-04-20T12:30:18.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.466+0000 7fc171bb0740 1 -- 172.21.15.135:0/3864702284 wait complete. 2024-04-20T12:30:18.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.467+0000 7fc171bb0740 1 -- start start 2024-04-20T12:30:18.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.467+0000 7fc171bb0740 1 Processor -- start 2024-04-20T12:30:18.470 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.467+0000 7fc171bb0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef01d20 0x56216ef082d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.471 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.467+0000 7fc171bb0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef02640 0x56216ef08810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.467+0000 7fc171bb0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef0b220 0x56216ef08d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.467+0000 7fc171bb0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56216ef0dfb0 con 0x56216ef01d20 2024-04-20T12:30:18.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.467+0000 7fc171bb0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56216ee202f0 con 0x56216ef02640 2024-04-20T12:30:18.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.467+0000 7fc171bb0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56216ef0e130 con 0x56216ef0b220 2024-04-20T12:30:18.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.467+0000 7fc171bb0740 10 client.0 _ll_register_callbacks cb 0x56216edea4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:18.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.467+0000 7fc16d560640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef01d20 0x56216ef082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.467+0000 7fc16d560640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef01d20 0x56216ef082d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57208/0 (socket says 172.21.15.135:57208) 2024-04-20T12:30:18.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.467+0000 7fc16d560640 1 -- 172.21.15.135:0/907176423 learned_addr learned my addr 172.21.15.135:0/907176423 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:18.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.467+0000 7fc16cd5f640 1 --2- 172.21.15.135:0/907176423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef02640 0x56216ef08810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.467+0000 7fc16d560640 1 --2- 172.21.15.135:0/907176423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef0b220 0x56216ef08d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc16d560640 1 -- 172.21.15.135:0/907176423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef0b220 msgr2=0x56216ef08d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc16d560640 1 --2- 172.21.15.135:0/907176423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef0b220 0x56216ef08d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc16d560640 1 -- 172.21.15.135:0/907176423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef02640 msgr2=0x56216ef08810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc16d560640 1 --2- 172.21.15.135:0/907176423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef02640 0x56216ef08810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc16d560640 1 -- 172.21.15.135:0/907176423 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56216eb793f0 con 0x56216ef01d20 2024-04-20T12:30:18.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc16d560640 1 --2- 172.21.15.135:0/907176423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef01d20 0x56216ef082d0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fc160033000 tx=0x7fc160004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95beb4cbdfa70c1d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:18.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc147fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:18.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc147fff640 1 -- 172.21.15.135:0/907176423 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16002ce60 con 0x56216ef01d20 2024-04-20T12:30:18.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc147fff640 1 -- 172.21.15.135:0/907176423 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7fc160032590 con 0x56216ef01d20 2024-04-20T12:30:18.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc171bb0740 1 -- 172.21.15.135:0/907176423 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc160003970 con 0x56216ef01d20 2024-04-20T12:30:18.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc147fff640 1 -- 172.21.15.135:0/907176423 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc160039040 con 0x56216ef01d20 2024-04-20T12:30:18.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc171bb0740 10 client.17901 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:18.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc171bb0740 1 -- 172.21.15.135:0/907176423 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56216eb390f0 con 0x56216ef01d20 2024-04-20T12:30:18.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc147fff640 1 -- 172.21.15.135:0/907176423 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc160003970 con 0x56216ef01d20 2024-04-20T12:30:18.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc147fff640 1 -- 172.21.15.135:0/907176423 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc16004c030 con 0x56216ef01d20 2024-04-20T12:30:18.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc171bb0740 10 client.17901 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:18.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc171bb0740 10 client.17901 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:18.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc171bb0740 20 client.17901 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:18.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc171bb0740 1 --2- 172.21.15.135:0/907176423 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56216ef1b460 0x56216ef1d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc171bb0740 4 client.17901 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:18.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.468+0000 7fc171bb0740 1 -- 172.21.15.135:0/907176423 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56216ee74bd0 con 0x56216ef1b460 2024-04-20T12:30:18.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.469+0000 7fc16cd5f640 1 --2- 172.21.15.135:0/907176423 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56216ef1b460 0x56216ef1d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.469+0000 7fc147fff640 10 client.17901 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:18.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.469+0000 7fc16cd5f640 1 --2- 172.21.15.135:0/907176423 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56216ef1b460 0x56216ef1d850 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c56ad47dbba0ffc4 server_cookie=221fdfbf2cb61083 in_seq=0 out_seq=0 2024-04-20T12:30:18.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.470+0000 7fc147fff640 1 -- 172.21.15.135:0/907176423 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56216ee74bd0 con 0x56216ef1b460 2024-04-20T12:30:18.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.470+0000 7fc147fff640 10 client.17901 handle_command_reply: tid=0 2024-04-20T12:30:18.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.470+0000 7fc171bb0740 1 client.17901 shutdown 2024-04-20T12:30:18.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.470+0000 7fc171bb0740 1 -- 172.21.15.135:0/907176423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef01d20 msgr2=0x56216ef082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.470+0000 7fc171bb0740 1 --2- 172.21.15.135:0/907176423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef01d20 0x56216ef082d0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fc160033000 tx=0x7fc160004a40 comp rx=0 tx=0).stop 2024-04-20T12:30:18.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.470+0000 7fc171bb0740 1 -- 172.21.15.135:0/907176423 shutdown_connections 2024-04-20T12:30:18.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.470+0000 7fc171bb0740 1 --2- 172.21.15.135:0/907176423 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56216ef1b460 0x56216ef1d850 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.470+0000 7fc171bb0740 1 --2- 172.21.15.135:0/907176423 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef0b220 0x56216ef08d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.470+0000 7fc147fff640 0 client.17901 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:18.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.470+0000 7fc171bb0740 1 --2- 172.21.15.135:0/907176423 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef02640 0x56216ef08810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.470+0000 7fc171bb0740 1 --2- 172.21.15.135:0/907176423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef01d20 0x56216ef082d0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.470+0000 7fc171bb0740 1 -- 172.21.15.135:0/907176423 >> 172.21.15.135:0/907176423 conn(0x56216eefc450 msgr2=0x56216eefe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:18.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.470+0000 7fc171bb0740 1 -- 172.21.15.135:0/907176423 shutdown_connections 2024-04-20T12:30:18.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.470+0000 7fc171bb0740 1 -- 172.21.15.135:0/907176423 wait complete. 2024-04-20T12:30:18.478 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.470+0000 7fc171bb0740 20 client.17901 trim_cache size 0 max 16384 2024-04-20T12:30:18.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.487+0000 7fc171bb0740 1 Processor -- start 2024-04-20T12:30:18.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.487+0000 7fc171bb0740 1 -- start start 2024-04-20T12:30:18.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.487+0000 7fc171bb0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef01d20 0x56216ef0aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.487+0000 7fc171bb0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef02640 0x56216ef07470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.487+0000 7fc171bb0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef0b220 0x56216ef08b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.487+0000 7fc171bb0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681af430 con 0x56216ef02640 2024-04-20T12:30:18.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.487+0000 7fc171bb0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681b0f70 con 0x56216ef01d20 2024-04-20T12:30:18.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.487+0000 7fc171bb0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681afb00 con 0x56216ef0b220 2024-04-20T12:30:18.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.487+0000 7fc16cd5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef02640 0x56216ef07470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.487+0000 7fc16cd5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef02640 0x56216ef07470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57222/0 (socket says 172.21.15.135:57222) 2024-04-20T12:30:18.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.487+0000 7fc16cd5f640 1 -- 172.21.15.135:0/1884292590 learned_addr learned my addr 172.21.15.135:0/1884292590 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:18.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc16d560640 1 --2- 172.21.15.135:0/1884292590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef01d20 0x56216ef0aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc16cd5f640 1 -- 172.21.15.135:0/1884292590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef0b220 msgr2=0x56216ef08b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc16cd5f640 1 --2- 172.21.15.135:0/1884292590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef0b220 0x56216ef08b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc16cd5f640 1 -- 172.21.15.135:0/1884292590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef01d20 msgr2=0x56216ef0aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc16cd5f640 1 --2- 172.21.15.135:0/1884292590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef01d20 0x56216ef0aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc16cd5f640 1 -- 172.21.15.135:0/1884292590 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56216ef23690 con 0x56216ef02640 2024-04-20T12:30:18.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc16cd5f640 1 --2- 172.21.15.135:0/1884292590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef02640 0x56216ef07470 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x56216ef017f0 tx=0x7fc15c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5738f74a5d03fb1a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:18.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc1527fc640 1 -- 172.21.15.135:0/1884292590 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c003e20 con 0x56216ef02640 2024-04-20T12:30:18.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc1527fc640 1 -- 172.21.15.135:0/1884292590 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc15c025070 con 0x56216ef02640 2024-04-20T12:30:18.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc1527fc640 1 -- 172.21.15.135:0/1884292590 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c010b40 con 0x56216ef02640 2024-04-20T12:30:18.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc171bb0740 1 -- 172.21.15.135:0/1884292590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef02640 msgr2=0x56216ef07470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc171bb0740 1 --2- 172.21.15.135:0/1884292590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef02640 0x56216ef07470 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x56216ef017f0 tx=0x7fc15c005f90 comp rx=0 tx=0).stop 2024-04-20T12:30:18.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc171bb0740 1 -- 172.21.15.135:0/1884292590 shutdown_connections 2024-04-20T12:30:18.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc171bb0740 1 --2- 172.21.15.135:0/1884292590 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef0b220 0x56216ef08b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc171bb0740 1 --2- 172.21.15.135:0/1884292590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef02640 0x56216ef07470 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.488+0000 7fc171bb0740 1 --2- 172.21.15.135:0/1884292590 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef01d20 0x56216ef0aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc171bb0740 1 -- 172.21.15.135:0/1884292590 >> 172.21.15.135:0/1884292590 conn(0x56216eefc450 msgr2=0x56216ef16380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:18.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc171bb0740 1 -- 172.21.15.135:0/1884292590 shutdown_connections 2024-04-20T12:30:18.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc171bb0740 1 -- 172.21.15.135:0/1884292590 wait complete. 2024-04-20T12:30:18.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc171bb0740 1 -- start start 2024-04-20T12:30:18.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc171bb0740 1 Processor -- start 2024-04-20T12:30:18.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc171bb0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef01d20 0x56216ef79b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc171bb0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef02640 0x56216ef7a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc171bb0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef0b220 0x56216ef1fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc171bb0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681b08a0 con 0x56216ef0b220 2024-04-20T12:30:18.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc171bb0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681b01d0 con 0x56216ef01d20 2024-04-20T12:30:18.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc171bb0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681ad400 con 0x56216ef02640 2024-04-20T12:30:18.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc171bb0740 10 client.0 _ll_register_callbacks cb 0x7fc15c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:18.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc16d560640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef0b220 0x56216ef1fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc16d560640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef0b220 0x56216ef1fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57228/0 (socket says 172.21.15.135:57228) 2024-04-20T12:30:18.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc16d560640 1 -- 172.21.15.135:0/2143594848 learned_addr learned my addr 172.21.15.135:0/2143594848 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:18.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.489+0000 7fc16cd5f640 1 --2- 172.21.15.135:0/2143594848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef02640 0x56216ef7a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc16d560640 1 --2- 172.21.15.135:0/2143594848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef01d20 0x56216ef79b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc16d560640 1 -- 172.21.15.135:0/2143594848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef02640 msgr2=0x56216ef7a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc16d560640 1 --2- 172.21.15.135:0/2143594848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef02640 0x56216ef7a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc16d560640 1 -- 172.21.15.135:0/2143594848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef01d20 msgr2=0x56216ef79b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:18.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc16d560640 1 --2- 172.21.15.135:0/2143594848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef01d20 0x56216ef79b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc16d560640 1 -- 172.21.15.135:0/2143594848 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56216ef20390 con 0x56216ef0b220 2024-04-20T12:30:18.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc16d560640 1 --2- 172.21.15.135:0/2143594848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef0b220 0x56216ef1fca0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fc160002230 tx=0x7fc160004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29cb18550266c16 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:18.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc147fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:18.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc147fff640 1 -- 172.21.15.135:0/2143594848 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160003970 con 0x56216ef0b220 2024-04-20T12:30:18.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc147fff640 1 -- 172.21.15.135:0/2143594848 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7fc160049040 con 0x56216ef0b220 2024-04-20T12:30:18.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc171bb0740 1 -- 172.21.15.135:0/2143594848 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc15c025070 con 0x56216ef0b220 2024-04-20T12:30:18.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc147fff640 1 -- 172.21.15.135:0/2143594848 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc160069050 con 0x56216ef0b220 2024-04-20T12:30:18.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc171bb0740 10 client.17907 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:18.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc171bb0740 1 -- 172.21.15.135:0/2143594848 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56216ef81320 con 0x56216ef0b220 2024-04-20T12:30:18.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc147fff640 1 -- 172.21.15.135:0/2143594848 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc15c025070 con 0x56216ef0b220 2024-04-20T12:30:18.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc147fff640 1 -- 172.21.15.135:0/2143594848 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc16004c040 con 0x56216ef0b220 2024-04-20T12:30:18.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc171bb0740 10 client.17907 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:18.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc171bb0740 10 client.17907 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:18.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc171bb0740 20 client.17907 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:18.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc171bb0740 1 --2- 172.21.15.135:0/2143594848 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56216ef81a70 0x56216ef83e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:18.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc171bb0740 4 client.17907 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:30:18.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.490+0000 7fc171bb0740 1 -- 172.21.15.135:0/2143594848 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56216ee6ea40 con 0x56216ef81a70 2024-04-20T12:30:18.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc16cd5f640 1 --2- 172.21.15.135:0/2143594848 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56216ef81a70 0x56216ef83e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc16cd5f640 1 --2- 172.21.15.135:0/2143594848 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56216ef81a70 0x56216ef83e90 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3fc7a9899ba2efb server_cookie=e362892fa6b2b19b in_seq=0 out_seq=0 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc147fff640 10 client.17907 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc147fff640 1 -- 172.21.15.135:0/2143594848 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56216ee6ea40 con 0x56216ef81a70 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc147fff640 10 client.17907 handle_command_reply: tid=0 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc171bb0740 1 client.17907 shutdown 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc171bb0740 1 -- 172.21.15.135:0/2143594848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef0b220 msgr2=0x56216ef1fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc171bb0740 1 --2- 172.21.15.135:0/2143594848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef0b220 0x56216ef1fca0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fc160002230 tx=0x7fc160004ab0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc171bb0740 1 -- 172.21.15.135:0/2143594848 shutdown_connections 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc171bb0740 1 --2- 172.21.15.135:0/2143594848 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56216ef81a70 0x56216ef83e90 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc171bb0740 1 --2- 172.21.15.135:0/2143594848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56216ef0b220 0x56216ef1fca0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc171bb0740 1 --2- 172.21.15.135:0/2143594848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56216ef02640 0x56216ef7a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc147fff640 0 client.17907 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc171bb0740 1 --2- 172.21.15.135:0/2143594848 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56216ef01d20 0x56216ef79b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc171bb0740 1 -- 172.21.15.135:0/2143594848 >> 172.21.15.135:0/2143594848 conn(0x56216eefc450 msgr2=0x56216ef16c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc171bb0740 1 -- 172.21.15.135:0/2143594848 shutdown_connections 2024-04-20T12:30:18.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.491+0000 7fc171bb0740 1 -- 172.21.15.135:0/2143594848 wait complete. 2024-04-20T12:30:18.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.492+0000 7fc171bb0740 20 client.17907 trim_cache size 0 max 16384 2024-04-20T12:30:18.498 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:30:18.498 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:30:18.498 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:30:18.498 INFO:teuthology.orchestra.run.smithi135.stdout: "ec29a88e-57a8-45ec-9937-684f0d0ebaee": { 2024-04-20T12:30:18.498 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:30:18.498 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "ec29a88e-57a8-45ec-9937-684f0d0ebaee", 2024-04-20T12:30:18.498 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:30:18.498 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:30:18.499 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:30:18.499 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:30:18.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.492+0000 7fc16efc3640 1 -- 172.21.15.135:0/512313308 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1580a3d20 msgr2=0x7fc1580a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.492+0000 7fc16efc3640 1 --2- 172.21.15.135:0/512313308 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1580a3d20 0x7fc1580a61e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1540988b0 tx=0x7fc1540918e0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.492+0000 7fc16efc3640 1 -- 172.21.15.135:0/512313308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168107290 msgr2=0x7fc16819e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:18.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.492+0000 7fc16efc3640 1 --2- 172.21.15.135:0/512313308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168107290 0x7fc16819e950 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc15400d950 tx=0x7fc15400de10 comp rx=0 tx=0).stop 2024-04-20T12:30:18.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.492+0000 7fc16efc3640 1 -- 172.21.15.135:0/512313308 shutdown_connections 2024-04-20T12:30:18.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.492+0000 7fc16efc3640 1 --2- 172.21.15.135:0/512313308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc1681985c0 0x7fc168198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.492+0000 7fc16efc3640 1 --2- 172.21.15.135:0/512313308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc168107290 0x7fc16819e950 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.492+0000 7fc16efc3640 1 --2- 172.21.15.135:0/512313308 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc1580a3d20 0x7fc1580a61e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.492+0000 7fc16efc3640 1 --2- 172.21.15.135:0/512313308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc16806a7d0 0x7fc16819e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:18.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.492+0000 7fc16efc3640 1 -- 172.21.15.135:0/512313308 >> 172.21.15.135:0/512313308 conn(0x7fc168076c60 msgr2=0x7fc1680ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:18.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.492+0000 7fc16efc3640 1 -- 172.21.15.135:0/512313308 shutdown_connections 2024-04-20T12:30:18.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:18.492+0000 7fc16efc3640 1 -- 172.21.15.135:0/512313308 wait complete. 2024-04-20T12:30:18.502 INFO:tasks.cephfs.filesystem:scrub status for tag:ec29a88e-57a8-45ec-9937-684f0d0ebaee - {'path': '/', 'tag': 'ec29a88e-57a8-45ec-9937-684f0d0ebaee', 'options': 'recursive,force'} 2024-04-20T12:30:19.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:18 smithi139 ceph-mon[21834]: pgmap v219: 129 pgs: 129 active+clean; 16 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:30:19.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:18 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:30:19.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:18 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:30:19.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:18 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:30:19.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:18 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:30:19.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:18 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:30:19.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:18 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:30:19.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:18 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:30:19.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:18 smithi139 ceph-mon[21834]: osdmap e97: 12 total, 12 up, 12 in 2024-04-20T12:30:19.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:18 smithi135 ceph-mon[18264]: pgmap v219: 129 pgs: 129 active+clean; 16 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:30:19.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:18 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:30:19.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:18 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:30:19.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:18 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:30:19.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:18 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:30:19.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:18 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:30:19.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:18 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:30:19.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:18 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:30:19.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:18 smithi135 ceph-mon[18264]: osdmap e97: 12 total, 12 up, 12 in 2024-04-20T12:30:19.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:18 smithi154 ceph-mon[22073]: pgmap v219: 129 pgs: 129 active+clean; 16 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:30:19.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:18 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:30:19.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:18 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:30:19.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:18 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:30:19.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:18 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:30:19.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:18 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:30:19.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:18 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:30:19.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:18 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:30:19.252 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:18 smithi154 ceph-mon[22073]: osdmap e97: 12 total, 12 up, 12 in 2024-04-20T12:30:21.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:20 smithi139 ceph-mon[21834]: pgmap v221: 129 pgs: 129 active+clean; 16 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:30:21.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:20 smithi135 ceph-mon[18264]: pgmap v221: 129 pgs: 129 active+clean; 16 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:30:21.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:20 smithi154 ceph-mon[22073]: pgmap v221: 129 pgs: 129 active+clean; 16 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:30:23.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:22 smithi139 ceph-mon[21834]: pgmap v222: 129 pgs: 129 active+clean; 16 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:30:23.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:22 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:30:23.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:22 smithi135 ceph-mon[18264]: pgmap v222: 129 pgs: 129 active+clean; 16 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:30:23.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:22 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:30:23.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:22 smithi154 ceph-mon[22073]: pgmap v222: 129 pgs: 129 active+clean; 16 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:30:23.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:22 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:30:25.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:24 smithi135 ceph-mon[18264]: pgmap v223: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2024-04-20T12:30:25.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:24 smithi154 ceph-mon[22073]: pgmap v223: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2024-04-20T12:30:25.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:24 smithi139 ceph-mon[21834]: pgmap v223: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2024-04-20T12:30:27.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:26 smithi135 ceph-mon[18264]: pgmap v224: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2024-04-20T12:30:27.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:26 smithi154 ceph-mon[22073]: pgmap v224: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2024-04-20T12:30:27.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:26 smithi139 ceph-mon[21834]: pgmap v224: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2024-04-20T12:30:29.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:28 smithi135 ceph-mon[18264]: pgmap v225: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2024-04-20T12:30:29.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:28 smithi154 ceph-mon[22073]: pgmap v225: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2024-04-20T12:30:29.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:28 smithi139 ceph-mon[21834]: pgmap v225: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2024-04-20T12:30:31.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:30 smithi135 ceph-mon[18264]: pgmap v226: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-04-20T12:30:31.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:30 smithi154 ceph-mon[22073]: pgmap v226: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-04-20T12:30:31.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:30 smithi139 ceph-mon[21834]: pgmap v226: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-04-20T12:30:33.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:32 smithi135 ceph-mon[18264]: pgmap v227: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:30:33.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:32 smithi154 ceph-mon[22073]: pgmap v227: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:30:33.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:32 smithi139 ceph-mon[21834]: pgmap v227: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:30:35.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:34 smithi135 ceph-mon[18264]: pgmap v228: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 op/s 2024-04-20T12:30:35.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:34 smithi154 ceph-mon[22073]: pgmap v228: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 op/s 2024-04-20T12:30:35.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:34 smithi139 ceph-mon[21834]: pgmap v228: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 op/s 2024-04-20T12:30:37.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:36 smithi135 ceph-mon[18264]: pgmap v229: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-04-20T12:30:37.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:36 smithi154 ceph-mon[22073]: pgmap v229: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-04-20T12:30:37.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:36 smithi139 ceph-mon[21834]: pgmap v229: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-04-20T12:30:39.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:38 smithi135 ceph-mon[18264]: pgmap v230: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-04-20T12:30:39.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:38 smithi154 ceph-mon[22073]: pgmap v230: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-04-20T12:30:39.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:38 smithi139 ceph-mon[21834]: pgmap v230: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-04-20T12:30:41.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:40 smithi135 ceph-mon[18264]: pgmap v231: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-04-20T12:30:41.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:40 smithi154 ceph-mon[22073]: pgmap v231: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-04-20T12:30:41.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:40 smithi139 ceph-mon[21834]: pgmap v231: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 12 op/s 2024-04-20T12:30:43.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:42 smithi135 ceph-mon[18264]: pgmap v232: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:30:43.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:42 smithi154 ceph-mon[22073]: pgmap v232: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:30:43.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:42 smithi139 ceph-mon[21834]: pgmap v232: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:30:45.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:44 smithi135 ceph-mon[18264]: pgmap v233: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:30:45.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:44 smithi154 ceph-mon[22073]: pgmap v233: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:30:45.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:44 smithi139 ceph-mon[21834]: pgmap v233: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:30:47.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:46 smithi154 ceph-mon[22073]: pgmap v234: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:30:47.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:46 smithi139 ceph-mon[21834]: pgmap v234: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:30:47.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:46 smithi135 ceph-mon[18264]: pgmap v234: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:30:48.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:30:48.503 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:30:48.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.618+0000 7fce376c7640 1 -- 172.21.15.135:0/7382891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce30100e20 msgr2=0x7fce3010edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:48.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.618+0000 7fce376c7640 1 --2- 172.21.15.135:0/7382891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce30100e20 0x7fce3010edf0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fce28009cd0 tx=0x7fce2802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.618+0000 7fce376c7640 1 -- 172.21.15.135:0/7382891 shutdown_connections 2024-04-20T12:30:48.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.618+0000 7fce376c7640 1 --2- 172.21.15.135:0/7382891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce30100e20 0x7fce3010edf0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.618+0000 7fce376c7640 1 --2- 172.21.15.135:0/7382891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce30100460 0x7fce301008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.618+0000 7fce376c7640 1 --2- 172.21.15.135:0/7382891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce30106f40 0x7fce30107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.618+0000 7fce376c7640 1 -- 172.21.15.135:0/7382891 >> 172.21.15.135:0/7382891 conn(0x7fce300773f0 msgr2=0x7fce300fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:48.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.618+0000 7fce376c7640 1 -- 172.21.15.135:0/7382891 shutdown_connections 2024-04-20T12:30:48.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.618+0000 7fce376c7640 1 -- 172.21.15.135:0/7382891 wait complete. 2024-04-20T12:30:48.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.619+0000 7fce376c7640 1 Processor -- start 2024-04-20T12:30:48.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.619+0000 7fce376c7640 1 -- start start 2024-04-20T12:30:48.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.619+0000 7fce376c7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce30100460 0x7fce3019e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.619+0000 7fce376c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce30100e20 0x7fce3019e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.619+0000 7fce376c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce30106f40 0x7fce301985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.619+0000 7fce376c7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce301123d0 con 0x7fce30100460 2024-04-20T12:30:48.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.619+0000 7fce376c7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fce30112250 con 0x7fce30106f40 2024-04-20T12:30:48.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.619+0000 7fce376c7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce30112550 con 0x7fce30100e20 2024-04-20T12:30:48.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.619+0000 7fce35463640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce30100460 0x7fce3019e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.619+0000 7fce35463640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce30100460 0x7fce3019e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55258/0 (socket says 172.21.15.135:55258) 2024-04-20T12:30:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.619+0000 7fce35463640 1 -- 172.21.15.135:0/4245962783 learned_addr learned my addr 172.21.15.135:0/4245962783 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.620+0000 7fce34c62640 1 --2- 172.21.15.135:0/4245962783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce30100e20 0x7fce3019e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.620+0000 7fce35463640 1 -- 172.21.15.135:0/4245962783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce30100e20 msgr2=0x7fce3019e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.620+0000 7fce35463640 1 --2- 172.21.15.135:0/4245962783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce30100e20 0x7fce3019e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.620+0000 7fce35463640 1 -- 172.21.15.135:0/4245962783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce30106f40 msgr2=0x7fce301985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.620+0000 7fce35c64640 1 --2- 172.21.15.135:0/4245962783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce30106f40 0x7fce301985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.620+0000 7fce35463640 1 --2- 172.21.15.135:0/4245962783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce30106f40 0x7fce301985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.620+0000 7fce35463640 1 -- 172.21.15.135:0/4245962783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce30198d70 con 0x7fce30100460 2024-04-20T12:30:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.620+0000 7fce34c62640 1 --2- 172.21.15.135:0/4245962783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce30100e20 0x7fce3019e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.620+0000 7fce35463640 1 --2- 172.21.15.135:0/4245962783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce30100460 0x7fce3019e440 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00d950 tx=0x7fce2c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.620+0000 7fce267fc640 1 -- 172.21.15.135:0/4245962783 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c017030 con 0x7fce30100460 2024-04-20T12:30:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.620+0000 7fce376c7640 1 -- 172.21.15.135:0/4245962783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce30199060 con 0x7fce30100460 2024-04-20T12:30:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.620+0000 7fce267fc640 1 -- 172.21.15.135:0/4245962783 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce2c004020 con 0x7fce30100460 2024-04-20T12:30:48.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.620+0000 7fce267fc640 1 -- 172.21.15.135:0/4245962783 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0047a0 con 0x7fce30100460 2024-04-20T12:30:48.622 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.620+0000 7fce376c7640 1 -- 172.21.15.135:0/4245962783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce301a5300 con 0x7fce30100460 2024-04-20T12:30:48.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.622+0000 7fce267fc640 1 -- 172.21.15.135:0/4245962783 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fce2c0041d0 con 0x7fce30100460 2024-04-20T12:30:48.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.623+0000 7fce3a38a740 1 Processor -- start 2024-04-20T12:30:48.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.623+0000 7fce3a38a740 1 -- start start 2024-04-20T12:30:48.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.623+0000 7fce3a38a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d94fd20 0x559e1d950100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.623+0000 7fce3a38a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d958ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.623+0000 7fce3a38a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d959220 0x559e1d95b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.623+0000 7fce3a38a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559e1d8b51b0 con 0x559e1d950640 2024-04-20T12:30:48.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.623+0000 7fce3a38a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559e1d852390 con 0x559e1d94fd20 2024-04-20T12:30:48.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.623+0000 7fce3a38a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e1d8b1170 con 0x559e1d959220 2024-04-20T12:30:48.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.623+0000 7fce35463640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d958ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.623+0000 7fce35463640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d958ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55274/0 (socket says 172.21.15.135:55274) 2024-04-20T12:30:48.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.623+0000 7fce35463640 1 -- 172.21.15.135:0/2856700386 learned_addr learned my addr 172.21.15.135:0/2856700386 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:48.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.623+0000 7fce34c62640 1 --2- 172.21.15.135:0/2856700386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d959220 0x559e1d95b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.623+0000 7fce35c64640 1 --2- 172.21.15.135:0/2856700386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d94fd20 0x559e1d950100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.623+0000 7fce267fc640 1 --2- 172.21.15.135:0/4245962783 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fce1c0a3d20 0x7fce1c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.623+0000 7fce35c64640 1 --2- 172.21.15.135:0/4245962783 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fce1c0a3d20 0x7fce1c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.624+0000 7fce35463640 1 -- 172.21.15.135:0/2856700386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d959220 msgr2=0x559e1d95b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:48.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.624+0000 7fce35463640 1 --2- 172.21.15.135:0/2856700386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d959220 0x559e1d95b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.624+0000 7fce35463640 1 -- 172.21.15.135:0/2856700386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d94fd20 msgr2=0x559e1d950100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:48.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.624+0000 7fce35463640 1 --2- 172.21.15.135:0/2856700386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d94fd20 0x559e1d950100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.624+0000 7fce267fc640 1 -- 172.21.15.135:0/4245962783 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7fce2c0d0640 con 0x7fce30100460 2024-04-20T12:30:48.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.624+0000 7fce35463640 1 -- 172.21.15.135:0/2856700386 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e1d6917d0 con 0x559e1d950640 2024-04-20T12:30:48.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.624+0000 7fce34c62640 1 --2- 172.21.15.135:0/2856700386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d959220 0x559e1d95b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:30:48.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.624+0000 7fce35463640 1 --2- 172.21.15.135:0/2856700386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d958ce0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fce2c09bf10 tx=0x7fce2c051350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d65bdaf2f7b1a0b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:48.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.624+0000 7fce1b7fe640 1 -- 172.21.15.135:0/2856700386 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c09bb70 con 0x559e1d950640 2024-04-20T12:30:48.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.624+0000 7fce35c64640 1 --2- 172.21.15.135:0/4245962783 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fce1c0a3d20 0x7fce1c0a61e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fce28009ca0 tx=0x7fce2802c0f0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:48.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.624+0000 7fce1b7fe640 1 -- 172.21.15.135:0/2856700386 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce2c09c910 con 0x559e1d950640 2024-04-20T12:30:48.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.624+0000 7fce1b7fe640 1 -- 172.21.15.135:0/2856700386 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c055ea0 con 0x559e1d950640 2024-04-20T12:30:48.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.625+0000 7fce3a38a740 1 -- 172.21.15.135:0/2856700386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 msgr2=0x559e1d958ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:48.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.625+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2856700386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d958ce0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fce2c09bf10 tx=0x7fce2c051350 comp rx=0 tx=0).stop 2024-04-20T12:30:48.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.625+0000 7fce3a38a740 1 -- 172.21.15.135:0/2856700386 shutdown_connections 2024-04-20T12:30:48.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.625+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2856700386 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d959220 0x559e1d95b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.625+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2856700386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d958ce0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.625+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2856700386 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d94fd20 0x559e1d950100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.625+0000 7fce3a38a740 1 -- 172.21.15.135:0/2856700386 >> 172.21.15.135:0/2856700386 conn(0x559e1d94a450 msgr2=0x559e1d94a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:48.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.625+0000 7fce3a38a740 1 -- 172.21.15.135:0/2856700386 shutdown_connections 2024-04-20T12:30:48.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.625+0000 7fce3a38a740 1 -- 172.21.15.135:0/2856700386 wait complete. 2024-04-20T12:30:48.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.625+0000 7fce3a38a740 1 -- start start 2024-04-20T12:30:48.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.625+0000 7fce3a38a740 1 Processor -- start 2024-04-20T12:30:48.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce3a38a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d94fd20 0x559e1d956270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce3a38a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d9567b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce3a38a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d959220 0x559e1d956cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce3a38a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559e1d95bfb0 con 0x559e1d950640 2024-04-20T12:30:48.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce3a38a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559e1d86e2f0 con 0x559e1d959220 2024-04-20T12:30:48.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce3a38a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e1d95c130 con 0x559e1d94fd20 2024-04-20T12:30:48.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce3a38a740 10 client.0 _ll_register_callbacks cb 0x559e1d8384e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:48.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce34c62640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d9567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce34c62640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d9567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55278/0 (socket says 172.21.15.135:55278) 2024-04-20T12:30:48.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce34c62640 1 -- 172.21.15.135:0/2195055930 learned_addr learned my addr 172.21.15.135:0/2195055930 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:48.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce35c64640 1 --2- 172.21.15.135:0/2195055930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d959220 0x559e1d956cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce35463640 1 --2- 172.21.15.135:0/2195055930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d94fd20 0x559e1d956270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce34c62640 1 -- 172.21.15.135:0/2195055930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d94fd20 msgr2=0x559e1d956270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:48.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce34c62640 1 --2- 172.21.15.135:0/2195055930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d94fd20 0x559e1d956270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.632 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce34c62640 1 -- 172.21.15.135:0/2195055930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d959220 msgr2=0x559e1d956cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:48.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce34c62640 1 --2- 172.21.15.135:0/2195055930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d959220 0x559e1d956cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce34c62640 1 -- 172.21.15.135:0/2195055930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e1d5c73f0 con 0x559e1d950640 2024-04-20T12:30:48.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce35463640 1 --2- 172.21.15.135:0/2195055930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d94fd20 0x559e1d956270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:48.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce34c62640 1 --2- 172.21.15.135:0/2195055930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d9567b0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fce20010850 tx=0x7fce20010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c28f8c89b2930d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:48.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:48.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce18ff9640 1 -- 172.21.15.135:0/2195055930 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2000eda0 con 0x559e1d950640 2024-04-20T12:30:48.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce18ff9640 1 -- 172.21.15.135:0/2195055930 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7fce20005020 con 0x559e1d950640 2024-04-20T12:30:48.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.626+0000 7fce3a38a740 1 -- 172.21.15.135:0/2195055930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce2c09c910 con 0x559e1d950640 2024-04-20T12:30:48.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.627+0000 7fce18ff9640 1 -- 172.21.15.135:0/2195055930 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fce20023050 con 0x559e1d950640 2024-04-20T12:30:48.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.627+0000 7fce3a38a740 10 client.17919 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:48.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.627+0000 7fce3a38a740 1 -- 172.21.15.135:0/2195055930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559e1d5870f0 con 0x559e1d950640 2024-04-20T12:30:48.633 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.627+0000 7fce18ff9640 1 -- 172.21.15.135:0/2195055930 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce2c09c910 con 0x559e1d950640 2024-04-20T12:30:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.627+0000 7fce18ff9640 1 -- 172.21.15.135:0/2195055930 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fce20018430 con 0x559e1d950640 2024-04-20T12:30:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.627+0000 7fce3a38a740 10 client.17919 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.627+0000 7fce3a38a740 10 client.17919 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.627+0000 7fce3a38a740 20 client.17919 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.627+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2195055930 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e1d9695f0 0x559e1d96ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.627+0000 7fce3a38a740 4 client.17919 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.627+0000 7fce3a38a740 1 -- 172.21.15.135:0/2195055930 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e1d8c2bd0 con 0x559e1d9695f0 2024-04-20T12:30:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.627+0000 7fce35463640 1 --2- 172.21.15.135:0/2195055930 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e1d9695f0 0x559e1d96ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.628+0000 7fce35463640 1 --2- 172.21.15.135:0/2195055930 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e1d9695f0 0x559e1d96ba70 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=133cd6ea31903306 server_cookie=13691ac365141c93 in_seq=0 out_seq=0 2024-04-20T12:30:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.628+0000 7fce18ff9640 10 client.17919 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.628+0000 7fce18ff9640 1 -- 172.21.15.135:0/2195055930 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559e1d8c2bd0 con 0x559e1d9695f0 2024-04-20T12:30:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.628+0000 7fce18ff9640 10 client.17919 handle_command_reply: tid=0 2024-04-20T12:30:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.628+0000 7fce3a38a740 1 client.17919 shutdown 2024-04-20T12:30:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.628+0000 7fce3a38a740 1 -- 172.21.15.135:0/2195055930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 msgr2=0x559e1d9567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:48.634 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.628+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2195055930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d9567b0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fce20010850 tx=0x7fce20010d10 comp rx=0 tx=0).stop 2024-04-20T12:30:48.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.628+0000 7fce3a38a740 1 -- 172.21.15.135:0/2195055930 shutdown_connections 2024-04-20T12:30:48.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.628+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2195055930 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e1d9695f0 0x559e1d96ba70 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.628+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2195055930 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d959220 0x559e1d956cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.629+0000 7fce18ff9640 0 client.17919 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:48.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.629+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2195055930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d9567b0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.629+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2195055930 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d94fd20 0x559e1d956270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.629+0000 7fce3a38a740 1 -- 172.21.15.135:0/2195055930 >> 172.21.15.135:0/2195055930 conn(0x559e1d94a450 msgr2=0x559e1d94c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:48.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.629+0000 7fce3a38a740 1 -- 172.21.15.135:0/2195055930 shutdown_connections 2024-04-20T12:30:48.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.629+0000 7fce3a38a740 1 -- 172.21.15.135:0/2195055930 wait complete. 2024-04-20T12:30:48.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.629+0000 7fce3a38a740 20 client.17919 trim_cache size 0 max 16384 2024-04-20T12:30:48.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce3a38a740 1 Processor -- start 2024-04-20T12:30:48.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce3a38a740 1 -- start start 2024-04-20T12:30:48.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce3a38a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d94fd20 0x559e1d964ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce3a38a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d950640 0x559e1d9494b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce3a38a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d959220 0x559e1d971340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce3a38a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce301ad270 con 0x559e1d94fd20 2024-04-20T12:30:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce3a38a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fce301aedb0 con 0x559e1d950640 2024-04-20T12:30:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce3a38a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce301ad940 con 0x559e1d959220 2024-04-20T12:30:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce35463640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d94fd20 0x559e1d964ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce35463640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d94fd20 0x559e1d964ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55284/0 (socket says 172.21.15.135:55284) 2024-04-20T12:30:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce35463640 1 -- 172.21.15.135:0/1958740792 learned_addr learned my addr 172.21.15.135:0/1958740792 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce35463640 1 -- 172.21.15.135:0/1958740792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d959220 msgr2=0x559e1d971340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce35463640 1 --2- 172.21.15.135:0/1958740792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d959220 0x559e1d971340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce35463640 1 -- 172.21.15.135:0/1958740792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d950640 msgr2=0x559e1d9494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce34c62640 1 --2- 172.21.15.135:0/1958740792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d950640 0x559e1d9494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce35463640 1 --2- 172.21.15.135:0/1958740792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d950640 0x559e1d9494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce35463640 1 -- 172.21.15.135:0/1958740792 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e1d95b610 con 0x559e1d94fd20 2024-04-20T12:30:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.646+0000 7fce34c62640 1 --2- 172.21.15.135:0/1958740792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d950640 0x559e1d9494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.647+0000 7fce35463640 1 --2- 172.21.15.135:0/1958740792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d94fd20 0x559e1d964ea0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fce2c098670 tx=0x7fce2c0985e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbf47e2db175427 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:48.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.647+0000 7fce1affd640 1 -- 172.21.15.135:0/1958740792 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c09bb70 con 0x559e1d94fd20 2024-04-20T12:30:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.647+0000 7fce1affd640 1 -- 172.21.15.135:0/1958740792 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce2c0d0040 con 0x559e1d94fd20 2024-04-20T12:30:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.647+0000 7fce1affd640 1 -- 172.21.15.135:0/1958740792 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0a05c0 con 0x559e1d94fd20 2024-04-20T12:30:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.647+0000 7fce3a38a740 1 -- 172.21.15.135:0/1958740792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d94fd20 msgr2=0x559e1d964ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.647+0000 7fce3a38a740 1 --2- 172.21.15.135:0/1958740792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d94fd20 0x559e1d964ea0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fce2c098670 tx=0x7fce2c0985e0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.647+0000 7fce3a38a740 1 -- 172.21.15.135:0/1958740792 shutdown_connections 2024-04-20T12:30:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.647+0000 7fce3a38a740 1 --2- 172.21.15.135:0/1958740792 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d959220 0x559e1d971340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.647+0000 7fce3a38a740 1 --2- 172.21.15.135:0/1958740792 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d950640 0x559e1d9494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.647+0000 7fce3a38a740 1 --2- 172.21.15.135:0/1958740792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d94fd20 0x559e1d964ea0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.647+0000 7fce3a38a740 1 -- 172.21.15.135:0/1958740792 >> 172.21.15.135:0/1958740792 conn(0x559e1d94a450 msgr2=0x559e1d948da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.647+0000 7fce3a38a740 1 -- 172.21.15.135:0/1958740792 shutdown_connections 2024-04-20T12:30:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.647+0000 7fce3a38a740 1 -- 172.21.15.135:0/1958740792 wait complete. 2024-04-20T12:30:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce3a38a740 1 -- start start 2024-04-20T12:30:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce3a38a740 1 Processor -- start 2024-04-20T12:30:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce3a38a740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d94fd20 0x559e1d961550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce3a38a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d95e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce3a38a740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d959220 0x559e1d95eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce3a38a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fce301ae6e0 con 0x559e1d950640 2024-04-20T12:30:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce3a38a740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fce301ae010 con 0x559e1d959220 2024-04-20T12:30:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce3a38a740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fce301ab240 con 0x559e1d94fd20 2024-04-20T12:30:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce3a38a740 10 client.0 _ll_register_callbacks cb 0x7fce2000b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce34c62640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d95e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce34c62640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d95e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55300/0 (socket says 172.21.15.135:55300) 2024-04-20T12:30:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce34c62640 1 -- 172.21.15.135:0/2080693891 learned_addr learned my addr 172.21.15.135:0/2080693891 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce35463640 1 --2- 172.21.15.135:0/2080693891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d94fd20 0x559e1d961550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce35c64640 1 --2- 172.21.15.135:0/2080693891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d959220 0x559e1d95eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce34c62640 1 -- 172.21.15.135:0/2080693891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d94fd20 msgr2=0x559e1d961550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce34c62640 1 --2- 172.21.15.135:0/2080693891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d94fd20 0x559e1d961550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce34c62640 1 -- 172.21.15.135:0/2080693891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d959220 msgr2=0x559e1d95eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:48.654 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce34c62640 1 --2- 172.21.15.135:0/2080693891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d959220 0x559e1d95eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce34c62640 1 -- 172.21.15.135:0/2080693891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e1d95f480 con 0x559e1d950640 2024-04-20T12:30:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.648+0000 7fce35c64640 1 --2- 172.21.15.135:0/2080693891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d959220 0x559e1d95eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce34c62640 1 --2- 172.21.15.135:0/2080693891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d95e980 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fce20018850 tx=0x7fce20018d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8dcd800f261be1a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce18ff9640 1 -- 172.21.15.135:0/2080693891 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2002b070 con 0x559e1d950640 2024-04-20T12:30:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce18ff9640 1 -- 172.21.15.135:0/2080693891 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7fce20005df0 con 0x559e1d950640 2024-04-20T12:30:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce3a38a740 1 -- 172.21.15.135:0/2080693891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce2c0d0040 con 0x559e1d950640 2024-04-20T12:30:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce18ff9640 1 -- 172.21.15.135:0/2080693891 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fce20037050 con 0x559e1d950640 2024-04-20T12:30:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce3a38a740 10 client.17925 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce3a38a740 1 -- 172.21.15.135:0/2080693891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559e1d9cf910 con 0x559e1d950640 2024-04-20T12:30:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce18ff9640 1 -- 172.21.15.135:0/2080693891 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce2c0d0040 con 0x559e1d950640 2024-04-20T12:30:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce18ff9640 1 -- 172.21.15.135:0/2080693891 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fce20030900 con 0x559e1d950640 2024-04-20T12:30:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce3a38a740 10 client.17925 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce3a38a740 10 client.17925 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:48.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce3a38a740 20 client.17925 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2080693891 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e1d9d0060 0x559e1d9d2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce3a38a740 4 client.17925 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.649+0000 7fce3a38a740 1 -- 172.21.15.135:0/2080693891 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559e1d8bca40 con 0x559e1d9d0060 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce35463640 1 --2- 172.21.15.135:0/2080693891 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e1d9d0060 0x559e1d9d2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce35463640 1 --2- 172.21.15.135:0/2080693891 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e1d9d0060 0x559e1d9d2480 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=947d422e851550cc server_cookie=2da77bf9e6db7665 in_seq=0 out_seq=0 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce18ff9640 10 client.17925 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce18ff9640 1 -- 172.21.15.135:0/2080693891 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559e1d8bca40 con 0x559e1d9d0060 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce18ff9640 10 client.17925 handle_command_reply: tid=0 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce3a38a740 1 client.17925 shutdown 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce3a38a740 1 -- 172.21.15.135:0/2080693891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 msgr2=0x559e1d95e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2080693891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d95e980 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fce20018850 tx=0x7fce20018d70 comp rx=0 tx=0).stop 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce3a38a740 1 -- 172.21.15.135:0/2080693891 shutdown_connections 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2080693891 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e1d9d0060 0x559e1d9d2480 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2080693891 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e1d959220 0x559e1d95eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce18ff9640 0 client.17925 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:48.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2080693891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e1d950640 0x559e1d95e980 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce3a38a740 1 --2- 172.21.15.135:0/2080693891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e1d94fd20 0x559e1d961550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce3a38a740 1 -- 172.21.15.135:0/2080693891 >> 172.21.15.135:0/2080693891 conn(0x559e1d94a450 msgr2=0x559e1d94c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:48.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce3a38a740 1 -- 172.21.15.135:0/2080693891 shutdown_connections 2024-04-20T12:30:48.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce3a38a740 1 -- 172.21.15.135:0/2080693891 wait complete. 2024-04-20T12:30:48.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.650+0000 7fce3a38a740 20 client.17925 trim_cache size 0 max 16384 2024-04-20T12:30:48.657 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:30:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:30:48.657 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:30:48.657 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:30:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.651+0000 7fce376c7640 1 -- 172.21.15.135:0/4245962783 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fce1c0a3d20 msgr2=0x7fce1c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.651+0000 7fce376c7640 1 --2- 172.21.15.135:0/4245962783 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fce1c0a3d20 0x7fce1c0a61e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fce28009ca0 tx=0x7fce2802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.651+0000 7fce376c7640 1 -- 172.21.15.135:0/4245962783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce30100460 msgr2=0x7fce3019e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:48.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.651+0000 7fce376c7640 1 --2- 172.21.15.135:0/4245962783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce30100460 0x7fce3019e440 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00d950 tx=0x7fce2c00de10 comp rx=0 tx=0).stop 2024-04-20T12:30:48.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.651+0000 7fce376c7640 1 -- 172.21.15.135:0/4245962783 shutdown_connections 2024-04-20T12:30:48.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.651+0000 7fce376c7640 1 --2- 172.21.15.135:0/4245962783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fce30106f40 0x7fce301985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.651+0000 7fce376c7640 1 --2- 172.21.15.135:0/4245962783 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fce1c0a3d20 0x7fce1c0a61e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.651+0000 7fce376c7640 1 --2- 172.21.15.135:0/4245962783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fce30100e20 0x7fce3019e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.651+0000 7fce376c7640 1 --2- 172.21.15.135:0/4245962783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fce30100460 0x7fce3019e440 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.651+0000 7fce376c7640 1 -- 172.21.15.135:0/4245962783 >> 172.21.15.135:0/4245962783 conn(0x7fce300773f0 msgr2=0x7fce30104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:48.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.651+0000 7fce376c7640 1 -- 172.21.15.135:0/4245962783 shutdown_connections 2024-04-20T12:30:48.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.651+0000 7fce376c7640 1 -- 172.21.15.135:0/4245962783 wait complete. 2024-04-20T12:30:48.660 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:30:48.661 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:30:48.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.759+0000 7f44e741f640 1 -- 172.21.15.135:0/2142617303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44e01031c0 msgr2=0x7f44e01035a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:48.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.759+0000 7f44e741f640 1 --2- 172.21.15.135:0/2142617303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44e01031c0 0x7f44e01035a0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f44dc009900 tx=0x7f44dc02bcd0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.759+0000 7f44e741f640 1 -- 172.21.15.135:0/2142617303 shutdown_connections 2024-04-20T12:30:48.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.759+0000 7f44e741f640 1 --2- 172.21.15.135:0/2142617303 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44e010c590 0x7f44e010e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.759+0000 7f44e741f640 1 --2- 172.21.15.135:0/2142617303 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e0103ae0 0x7f44e010bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.759+0000 7f44e741f640 1 --2- 172.21.15.135:0/2142617303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44e01031c0 0x7f44e01035a0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.759+0000 7f44e741f640 1 -- 172.21.15.135:0/2142617303 >> 172.21.15.135:0/2142617303 conn(0x7f44e00771e0 msgr2=0x7f44e00775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:48.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.759+0000 7f44e741f640 1 -- 172.21.15.135:0/2142617303 shutdown_connections 2024-04-20T12:30:48.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.759+0000 7f44e741f640 1 -- 172.21.15.135:0/2142617303 wait complete. 2024-04-20T12:30:48.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.760+0000 7f44e741f640 1 Processor -- start 2024-04-20T12:30:48.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.760+0000 7f44e741f640 1 -- start start 2024-04-20T12:30:48.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.760+0000 7f44e741f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e01031c0 0x7f44e019e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.760+0000 7f44e741f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44e0103ae0 0x7f44e019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.760+0000 7f44e741f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44e010c590 0x7f44e0198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.760+0000 7f44e741f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f44e0112310 con 0x7f44e010c590 2024-04-20T12:30:48.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.760+0000 7f44e741f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f44e0112190 con 0x7f44e0103ae0 2024-04-20T12:30:48.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.760+0000 7f44e741f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f44e0112490 con 0x7f44e01031c0 2024-04-20T12:30:48.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.760+0000 7f44e59bc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44e010c590 0x7f44e0198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.760+0000 7f44e59bc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44e010c590 0x7f44e0198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55322/0 (socket says 172.21.15.135:55322) 2024-04-20T12:30:48.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.760+0000 7f44e59bc640 1 -- 172.21.15.135:0/515156203 learned_addr learned my addr 172.21.15.135:0/515156203 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:48.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.760+0000 7f44e51bb640 1 --2- 172.21.15.135:0/515156203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e01031c0 0x7f44e019e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.760+0000 7f44e49ba640 1 --2- 172.21.15.135:0/515156203 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44e0103ae0 0x7f44e019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.760+0000 7f44e59bc640 1 -- 172.21.15.135:0/515156203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e01031c0 msgr2=0x7f44e019e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:48.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.760+0000 7f44e59bc640 1 --2- 172.21.15.135:0/515156203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e01031c0 0x7f44e019e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.761+0000 7f44e59bc640 1 -- 172.21.15.135:0/515156203 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44e0103ae0 msgr2=0x7f44e019eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:48.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.761+0000 7f44e59bc640 1 --2- 172.21.15.135:0/515156203 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44e0103ae0 0x7f44e019eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.761+0000 7f44e59bc640 1 -- 172.21.15.135:0/515156203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e0198f30 con 0x7f44e010c590 2024-04-20T12:30:48.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.761+0000 7f44e59bc640 1 --2- 172.21.15.135:0/515156203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44e010c590 0x7f44e0198670 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f44d800eb40 tx=0x7f44d800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:48.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.761+0000 7f44d67fc640 1 -- 172.21.15.135:0/515156203 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8004b20 con 0x7f44e010c590 2024-04-20T12:30:48.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.761+0000 7f44d67fc640 1 -- 172.21.15.135:0/515156203 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44d8004cc0 con 0x7f44e010c590 2024-04-20T12:30:48.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.761+0000 7f44e741f640 1 -- 172.21.15.135:0/515156203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e0199220 con 0x7f44e010c590 2024-04-20T12:30:48.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.761+0000 7f44d67fc640 1 -- 172.21.15.135:0/515156203 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8010850 con 0x7f44e010c590 2024-04-20T12:30:48.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.761+0000 7f44e741f640 1 -- 172.21.15.135:0/515156203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e01a5530 con 0x7f44e010c590 2024-04-20T12:30:48.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.762+0000 7f44e741f640 1 -- 172.21.15.135:0/515156203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e006ae20 con 0x7f44e010c590 2024-04-20T12:30:48.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.763+0000 7f44d67fc640 1 -- 172.21.15.135:0/515156203 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f44d8005000 con 0x7f44e010c590 2024-04-20T12:30:48.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.764+0000 7f44d67fc640 1 --2- 172.21.15.135:0/515156203 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f44cc0a3d20 0x7f44cc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:48.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.764+0000 7f44e51bb640 1 --2- 172.21.15.135:0/515156203 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f44cc0a3d20 0x7f44cc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:48.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.764+0000 7f44d67fc640 1 -- 172.21.15.135:0/515156203 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f44d80d12a0 con 0x7f44e010c590 2024-04-20T12:30:48.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.764+0000 7f44e51bb640 1 --2- 172.21.15.135:0/515156203 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f44cc0a3d20 0x7f44cc0a61e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f44dc02efd0 tx=0x7f44dc02cf90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:48.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.767+0000 7f44d67fc640 1 -- 172.21.15.135:0/515156203 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f44d809d570 con 0x7f44e010c590 2024-04-20T12:30:48.982 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.984+0000 7f44e741f640 1 -- 172.21.15.135:0/515156203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44e00691d0 con 0x7f44e010c590 2024-04-20T12:30:48.983 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.984+0000 7f44d67fc640 1 -- 172.21.15.135:0/515156203 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7f44d809ce70 con 0x7f44e010c590 2024-04-20T12:30:48.983 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:30:48.983 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:30:48.984 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:30:48.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.986+0000 7f44e741f640 1 -- 172.21.15.135:0/515156203 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f44cc0a3d20 msgr2=0x7f44cc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:48.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.986+0000 7f44e741f640 1 --2- 172.21.15.135:0/515156203 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f44cc0a3d20 0x7f44cc0a61e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f44dc02efd0 tx=0x7f44dc02cf90 comp rx=0 tx=0).stop 2024-04-20T12:30:48.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.986+0000 7f44e741f640 1 -- 172.21.15.135:0/515156203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44e010c590 msgr2=0x7f44e0198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:48.985 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.986+0000 7f44e741f640 1 --2- 172.21.15.135:0/515156203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44e010c590 0x7f44e0198670 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f44d800eb40 tx=0x7f44d800c2d0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.986+0000 7f44e741f640 1 -- 172.21.15.135:0/515156203 shutdown_connections 2024-04-20T12:30:48.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.986+0000 7f44e741f640 1 --2- 172.21.15.135:0/515156203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f44e010c590 0x7f44e0198670 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.986+0000 7f44e741f640 1 --2- 172.21.15.135:0/515156203 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f44e0103ae0 0x7f44e019eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.986+0000 7f44e741f640 1 --2- 172.21.15.135:0/515156203 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f44cc0a3d20 0x7f44cc0a61e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.986+0000 7f44e741f640 1 --2- 172.21.15.135:0/515156203 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44e01031c0 0x7f44e019e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:48.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.986+0000 7f44e741f640 1 -- 172.21.15.135:0/515156203 >> 172.21.15.135:0/515156203 conn(0x7f44e00771e0 msgr2=0x7f44e00fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:48.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.986+0000 7f44e741f640 1 -- 172.21.15.135:0/515156203 shutdown_connections 2024-04-20T12:30:48.986 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:48.987+0000 7f44e741f640 1 -- 172.21.15.135:0/515156203 wait complete. 2024-04-20T12:30:48.996 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:30:49.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.100+0000 7f330d4d2640 1 -- 172.21.15.135:0/1331034690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330810c590 msgr2=0x7f330810e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.100+0000 7f330d4d2640 1 --2- 172.21.15.135:0/1331034690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330810c590 0x7f330810e9c0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f3300009ca0 tx=0x7f330002c180 comp rx=0 tx=0).stop 2024-04-20T12:30:49.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.100+0000 7f330d4d2640 1 -- 172.21.15.135:0/1331034690 shutdown_connections 2024-04-20T12:30:49.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.100+0000 7f330d4d2640 1 --2- 172.21.15.135:0/1331034690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330810c590 0x7f330810e9c0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.100+0000 7f330d4d2640 1 --2- 172.21.15.135:0/1331034690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3308103ae0 0x7f330810bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.100+0000 7f330d4d2640 1 --2- 172.21.15.135:0/1331034690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33081031c0 0x7f33081035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.100+0000 7f330d4d2640 1 -- 172.21.15.135:0/1331034690 >> 172.21.15.135:0/1331034690 conn(0x7f33080771e0 msgr2=0x7f33080775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.100+0000 7f330d4d2640 1 -- 172.21.15.135:0/1331034690 shutdown_connections 2024-04-20T12:30:49.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.100+0000 7f330d4d2640 1 -- 172.21.15.135:0/1331034690 wait complete. 2024-04-20T12:30:49.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.100+0000 7f330d4d2640 1 Processor -- start 2024-04-20T12:30:49.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f330d4d2640 1 -- start start 2024-04-20T12:30:49.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f330d4d2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33081031c0 0x7f330819e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f330d4d2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3308103ae0 0x7f330819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f330d4d2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f330810c590 0x7f33081985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f330d4d2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3308112300 con 0x7f3308103ae0 2024-04-20T12:30:49.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f330d4d2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3308112180 con 0x7f330810c590 2024-04-20T12:30:49.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f330d4d2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3308112480 con 0x7f33081031c0 2024-04-20T12:30:49.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f33067fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3308103ae0 0x7f330819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f33067fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3308103ae0 0x7f330819e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55342/0 (socket says 172.21.15.135:55342) 2024-04-20T12:30:49.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f33067fc640 1 -- 172.21.15.135:0/780375570 learned_addr learned my addr 172.21.15.135:0/780375570 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f3306ffd640 1 --2- 172.21.15.135:0/780375570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33081031c0 0x7f330819e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f33077fe640 1 --2- 172.21.15.135:0/780375570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f330810c590 0x7f33081985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f33067fc640 1 -- 172.21.15.135:0/780375570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33081031c0 msgr2=0x7f330819e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f33067fc640 1 --2- 172.21.15.135:0/780375570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33081031c0 0x7f330819e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f33067fc640 1 -- 172.21.15.135:0/780375570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f330810c590 msgr2=0x7f33081985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f33067fc640 1 --2- 172.21.15.135:0/780375570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f330810c590 0x7f33081985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f33067fc640 1 -- 172.21.15.135:0/780375570 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3308198d60 con 0x7f3308103ae0 2024-04-20T12:30:49.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f33077fe640 1 --2- 172.21.15.135:0/780375570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f330810c590 0x7f33081985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:49.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f33067fc640 1 --2- 172.21.15.135:0/780375570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3308103ae0 0x7f330819e970 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00c890 tx=0x7f32fc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f32effff640 1 -- 172.21.15.135:0/780375570 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc004220 con 0x7f3308103ae0 2024-04-20T12:30:49.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f32effff640 1 -- 172.21.15.135:0/780375570 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32fc0043c0 con 0x7f3308103ae0 2024-04-20T12:30:49.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f330d4d2640 1 -- 172.21.15.135:0/780375570 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3308199050 con 0x7f3308103ae0 2024-04-20T12:30:49.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.101+0000 7f32effff640 1 -- 172.21.15.135:0/780375570 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0049e0 con 0x7f3308103ae0 2024-04-20T12:30:49.104 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.102+0000 7f330d4d2640 1 -- 172.21.15.135:0/780375570 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33081a52f0 con 0x7f3308103ae0 2024-04-20T12:30:49.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.103+0000 7f32effff640 1 -- 172.21.15.135:0/780375570 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f32fc0079b0 con 0x7f3308103ae0 2024-04-20T12:30:49.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.104+0000 7f33101a4740 1 Processor -- start 2024-04-20T12:30:49.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.104+0000 7f33101a4740 1 -- start start 2024-04-20T12:30:49.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.104+0000 7f33101a4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5556e10 0x5617c55571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.104+0000 7f33101a4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5557730 0x5617c555fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.104+0000 7f33101a4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5560310 0x5617c5562700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.104+0000 7f33101a4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5617c54bc110 con 0x5617c5560310 2024-04-20T12:30:49.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.104+0000 7f33101a4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5617c5459550 con 0x5617c5557730 2024-04-20T12:30:49.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.104+0000 7f33101a4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5617c54b80d0 con 0x5617c5556e10 2024-04-20T12:30:49.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.104+0000 7f32effff640 1 --2- 172.21.15.135:0/780375570 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32f00a3d20 0x7f32f00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.104+0000 7f33067fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5560310 0x5617c5562700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.104+0000 7f33077fe640 1 --2- 172.21.15.135:0/780375570 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32f00a3d20 0x7f32f00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.105+0000 7f33067fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5560310 0x5617c5562700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55348/0 (socket says 172.21.15.135:55348) 2024-04-20T12:30:49.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.105+0000 7f33067fc640 1 -- 172.21.15.135:0/1284259730 learned_addr learned my addr 172.21.15.135:0/1284259730 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.105+0000 7f33077fe640 1 --2- 172.21.15.135:0/1284259730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5556e10 0x5617c55571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.105+0000 7f32effff640 1 -- 172.21.15.135:0/780375570 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f32fc0d0cc0 con 0x7f3308103ae0 2024-04-20T12:30:49.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.105+0000 7f3306ffd640 1 --2- 172.21.15.135:0/1284259730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5557730 0x5617c555fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.105+0000 7f33067fc640 1 -- 172.21.15.135:0/1284259730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5556e10 msgr2=0x5617c55571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.105+0000 7f33067fc640 1 --2- 172.21.15.135:0/1284259730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5556e10 0x5617c55571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.105+0000 7f33067fc640 1 -- 172.21.15.135:0/1284259730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5557730 msgr2=0x5617c555fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.105+0000 7f33067fc640 1 --2- 172.21.15.135:0/1284259730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5557730 0x5617c555fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.105+0000 7f33067fc640 1 -- 172.21.15.135:0/1284259730 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617c5481900 con 0x5617c5560310 2024-04-20T12:30:49.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.105+0000 7f33067fc640 1 --2- 172.21.15.135:0/1284259730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5560310 0x5617c5562700 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f32fc007590 tx=0x7f32fc06c130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd03eb0fc46e43c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.105+0000 7f33077fe640 1 --2- 172.21.15.135:0/780375570 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32f00a3d20 0x7f32f00a61e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3300032610 tx=0x7f33000323c0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.105+0000 7f32ed7fa640 1 -- 172.21.15.135:0/1284259730 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc01d070 con 0x5617c5560310 2024-04-20T12:30:49.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.105+0000 7f32ed7fa640 1 -- 172.21.15.135:0/1284259730 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32fc09cf50 con 0x5617c5560310 2024-04-20T12:30:49.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.105+0000 7f32ed7fa640 1 -- 172.21.15.135:0/1284259730 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc007ca0 con 0x5617c5560310 2024-04-20T12:30:49.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.106+0000 7f33101a4740 1 -- 172.21.15.135:0/1284259730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5560310 msgr2=0x5617c5562700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.106+0000 7f33101a4740 1 --2- 172.21.15.135:0/1284259730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5560310 0x5617c5562700 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f32fc007590 tx=0x7f32fc06c130 comp rx=0 tx=0).stop 2024-04-20T12:30:49.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.106+0000 7f33101a4740 1 -- 172.21.15.135:0/1284259730 shutdown_connections 2024-04-20T12:30:49.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.106+0000 7f33101a4740 1 --2- 172.21.15.135:0/1284259730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5560310 0x5617c5562700 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.106+0000 7f33101a4740 1 --2- 172.21.15.135:0/1284259730 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5557730 0x5617c555fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.106+0000 7f33101a4740 1 --2- 172.21.15.135:0/1284259730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5556e10 0x5617c55571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.106+0000 7f33101a4740 1 -- 172.21.15.135:0/1284259730 >> 172.21.15.135:0/1284259730 conn(0x5617c5551540 msgr2=0x5617c5551920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.106+0000 7f33101a4740 1 -- 172.21.15.135:0/1284259730 shutdown_connections 2024-04-20T12:30:49.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.106+0000 7f33101a4740 1 -- 172.21.15.135:0/1284259730 wait complete. 2024-04-20T12:30:49.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f33101a4740 1 -- start start 2024-04-20T12:30:49.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f33101a4740 1 Processor -- start 2024-04-20T12:30:49.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f33101a4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5556e10 0x5617c555d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f33101a4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5557730 0x5617c555d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f33101a4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5560310 0x5617c555dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f33101a4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5617c5563040 con 0x5617c5556e10 2024-04-20T12:30:49.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f33101a4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5617c5475500 con 0x5617c5557730 2024-04-20T12:30:49.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f33101a4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5617c55631c0 con 0x5617c5560310 2024-04-20T12:30:49.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f33101a4740 10 client.0 _ll_register_callbacks cb 0x5617c545a2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:49.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f3306ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5556e10 0x5617c555d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f3306ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5556e10 0x5617c555d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55364/0 (socket says 172.21.15.135:55364) 2024-04-20T12:30:49.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f3306ffd640 1 -- 172.21.15.135:0/1149171008 learned_addr learned my addr 172.21.15.135:0/1149171008 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f33077fe640 1 --2- 172.21.15.135:0/1149171008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5560310 0x5617c555dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f3306ffd640 1 -- 172.21.15.135:0/1149171008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5560310 msgr2=0x5617c555dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f3306ffd640 1 --2- 172.21.15.135:0/1149171008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5560310 0x5617c555dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f3306ffd640 1 -- 172.21.15.135:0/1149171008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5557730 msgr2=0x5617c555d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f33067fc640 1 --2- 172.21.15.135:0/1149171008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5557730 0x5617c555d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f3306ffd640 1 --2- 172.21.15.135:0/1149171008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5557730 0x5617c555d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f3306ffd640 1 -- 172.21.15.135:0/1149171008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617c51ce3f0 con 0x5617c5556e10 2024-04-20T12:30:49.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f33077fe640 1 --2- 172.21.15.135:0/1149171008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5560310 0x5617c555dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:49.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f33067fc640 1 --2- 172.21.15.135:0/1149171008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5557730 0x5617c555d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:49.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f3306ffd640 1 --2- 172.21.15.135:0/1149171008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5556e10 0x5617c555d420 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f32f800bed0 tx=0x7f32f80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb878ef133590c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.107+0000 7f32eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:49.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.108+0000 7f32eaff5640 1 -- 172.21.15.135:0/1149171008 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f8012650 con 0x5617c5556e10 2024-04-20T12:30:49.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.108+0000 7f33101a4740 1 -- 172.21.15.135:0/1149171008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32fc09cf50 con 0x5617c5556e10 2024-04-20T12:30:49.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.108+0000 7f32eaff5640 1 -- 172.21.15.135:0/1149171008 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f32f80127f0 con 0x5617c5556e10 2024-04-20T12:30:49.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.108+0000 7f32eaff5640 1 -- 172.21.15.135:0/1149171008 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f32f80129f0 con 0x5617c5556e10 2024-04-20T12:30:49.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.108+0000 7f33101a4740 10 client.17943 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:49.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.108+0000 7f33101a4740 1 -- 172.21.15.135:0/1149171008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5617c52987d0 con 0x5617c5556e10 2024-04-20T12:30:49.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.108+0000 7f32eaff5640 1 -- 172.21.15.135:0/1149171008 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32fc09cf50 con 0x5617c5556e10 2024-04-20T12:30:49.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.108+0000 7f32eaff5640 1 -- 172.21.15.135:0/1149171008 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f32f801a3d0 con 0x5617c5556e10 2024-04-20T12:30:49.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.108+0000 7f33101a4740 10 client.17943 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:49.129 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.108+0000 7f33101a4740 10 client.17943 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:30:49.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.108+0000 7f33101a4740 20 client.17943 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:49.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.108+0000 7f33101a4740 1 --2- 172.21.15.135:0/1149171008 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5617c55706d0 0x5617c5572b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.108+0000 7f33101a4740 4 client.17943 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:49.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.108+0000 7f33101a4740 1 -- 172.21.15.135:0/1149171008 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617c54c9b30 con 0x5617c55706d0 2024-04-20T12:30:49.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.108+0000 7f33067fc640 1 --2- 172.21.15.135:0/1149171008 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5617c55706d0 0x5617c5572b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.130 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f32eaff5640 10 client.17943 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:30:49.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f33067fc640 1 --2- 172.21.15.135:0/1149171008 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5617c55706d0 0x5617c5572b90 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d4ab23910ce544 server_cookie=a1e0d3b9575791b6 in_seq=0 out_seq=0 2024-04-20T12:30:49.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f32eaff5640 1 -- 172.21.15.135:0/1149171008 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5617c54c9b30 con 0x5617c55706d0 2024-04-20T12:30:49.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f32eaff5640 10 client.17943 handle_command_reply: tid=0 2024-04-20T12:30:49.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f33101a4740 1 client.17943 shutdown 2024-04-20T12:30:49.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f33101a4740 1 -- 172.21.15.135:0/1149171008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5556e10 msgr2=0x5617c555d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.131 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f33101a4740 1 --2- 172.21.15.135:0/1149171008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5556e10 0x5617c555d420 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f32f800bed0 tx=0x7f32f80117b0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f33101a4740 1 -- 172.21.15.135:0/1149171008 shutdown_connections 2024-04-20T12:30:49.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f33101a4740 1 --2- 172.21.15.135:0/1149171008 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5617c55706d0 0x5617c5572b90 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f33101a4740 1 --2- 172.21.15.135:0/1149171008 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5560310 0x5617c555dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f33101a4740 1 --2- 172.21.15.135:0/1149171008 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5557730 0x5617c555d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f32eaff5640 0 client.17943 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:30:49.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f33101a4740 1 --2- 172.21.15.135:0/1149171008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5556e10 0x5617c555d420 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f33101a4740 1 -- 172.21.15.135:0/1149171008 >> 172.21.15.135:0/1149171008 conn(0x5617c5551540 msgr2=0x5617c5553290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f33101a4740 1 -- 172.21.15.135:0/1149171008 shutdown_connections 2024-04-20T12:30:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f33101a4740 1 -- 172.21.15.135:0/1149171008 wait complete. 2024-04-20T12:30:49.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.109+0000 7f33101a4740 20 client.17943 trim_cache size 0 max 16384 2024-04-20T12:30:49.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.122+0000 7f33101a4740 1 Processor -- start 2024-04-20T12:30:49.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.122+0000 7f33101a4740 1 -- start start 2024-04-20T12:30:49.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f33101a4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5556e10 0x5617c555fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f33101a4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5557730 0x5617c556bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f33101a4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5560310 0x5617c55784b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f33101a4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33081af510 con 0x5617c5556e10 2024-04-20T12:30:49.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f33101a4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f33081b1050 con 0x5617c5560310 2024-04-20T12:30:49.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f33101a4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f33081afbe0 con 0x5617c5557730 2024-04-20T12:30:49.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f3306ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5556e10 0x5617c555fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f3306ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5556e10 0x5617c555fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55376/0 (socket says 172.21.15.135:55376) 2024-04-20T12:30:49.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f3306ffd640 1 -- 172.21.15.135:0/431596727 learned_addr learned my addr 172.21.15.135:0/431596727 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f3306ffd640 1 -- 172.21.15.135:0/431596727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5557730 msgr2=0x5617c556bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f3306ffd640 1 --2- 172.21.15.135:0/431596727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5557730 0x5617c556bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f3306ffd640 1 -- 172.21.15.135:0/431596727 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5560310 msgr2=0x5617c55784b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f3306ffd640 1 --2- 172.21.15.135:0/431596727 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5560310 0x5617c55784b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f3306ffd640 1 -- 172.21.15.135:0/431596727 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617c5558fe0 con 0x5617c5556e10 2024-04-20T12:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f3306ffd640 1 --2- 172.21.15.135:0/431596727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5556e10 0x5617c555fb50 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f32f800b6b0 tx=0x7f32f800b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918076ef4c015086 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f32ecff9640 1 -- 172.21.15.135:0/431596727 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f802d070 con 0x5617c5556e10 2024-04-20T12:30:49.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f32ecff9640 1 -- 172.21.15.135:0/431596727 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32f801acb0 con 0x5617c5556e10 2024-04-20T12:30:49.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.123+0000 7f32ecff9640 1 -- 172.21.15.135:0/431596727 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f80052a0 con 0x5617c5556e10 2024-04-20T12:30:49.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 -- 172.21.15.135:0/431596727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5556e10 msgr2=0x5617c555fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 --2- 172.21.15.135:0/431596727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5556e10 0x5617c555fb50 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f32f800b6b0 tx=0x7f32f800b6e0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 -- 172.21.15.135:0/431596727 shutdown_connections 2024-04-20T12:30:49.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 --2- 172.21.15.135:0/431596727 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5560310 0x5617c55784b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 --2- 172.21.15.135:0/431596727 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5557730 0x5617c556bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 --2- 172.21.15.135:0/431596727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5556e10 0x5617c555fb50 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 -- 172.21.15.135:0/431596727 >> 172.21.15.135:0/431596727 conn(0x5617c5551540 msgr2=0x5617c5553190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 -- 172.21.15.135:0/431596727 shutdown_connections 2024-04-20T12:30:49.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 -- 172.21.15.135:0/431596727 wait complete. 2024-04-20T12:30:49.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 -- start start 2024-04-20T12:30:49.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 Processor -- start 2024-04-20T12:30:49.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5556e10 0x5617c5568820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5557730 0x5617c5563b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5560310 0x5617c55640d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33081b0980 con 0x5617c5560310 2024-04-20T12:30:49.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f33081b02b0 con 0x5617c5556e10 2024-04-20T12:30:49.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f33081ad4e0 con 0x5617c5557730 2024-04-20T12:30:49.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.124+0000 7f33101a4740 10 client.0 _ll_register_callbacks cb 0x7f32f800b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:49.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f33077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5560310 0x5617c55640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f33077fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5560310 0x5617c55640d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55392/0 (socket says 172.21.15.135:55392) 2024-04-20T12:30:49.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f33077fe640 1 -- 172.21.15.135:0/409210581 learned_addr learned my addr 172.21.15.135:0/409210581 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f33067fc640 1 --2- 172.21.15.135:0/409210581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5557730 0x5617c5563b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f3306ffd640 1 --2- 172.21.15.135:0/409210581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5556e10 0x5617c5568820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f33077fe640 1 -- 172.21.15.135:0/409210581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5557730 msgr2=0x5617c5563b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.149 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f33077fe640 1 --2- 172.21.15.135:0/409210581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5557730 0x5617c5563b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f33077fe640 1 -- 172.21.15.135:0/409210581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5556e10 msgr2=0x5617c5568820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f33077fe640 1 --2- 172.21.15.135:0/409210581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5556e10 0x5617c5568820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f33077fe640 1 -- 172.21.15.135:0/409210581 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617c5564900 con 0x5617c5560310 2024-04-20T12:30:49.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f33077fe640 1 --2- 172.21.15.135:0/409210581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5560310 0x5617c55640d0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f330806b6a0 tx=0x7f33000095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1563ae88b120e632 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f32eaff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:49.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f32eaff5640 1 -- 172.21.15.135:0/409210581 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300052020 con 0x5617c5560310 2024-04-20T12:30:49.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f32eaff5640 1 -- 172.21.15.135:0/409210581 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f3300004700 con 0x5617c5560310 2024-04-20T12:30:49.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f33101a4740 1 -- 172.21.15.135:0/409210581 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32f801acb0 con 0x5617c5560310 2024-04-20T12:30:49.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f32eaff5640 1 -- 172.21.15.135:0/409210581 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f330005d050 con 0x5617c5560310 2024-04-20T12:30:49.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f33101a4740 10 client.17949 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:49.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f33101a4740 1 -- 172.21.15.135:0/409210581 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5617c55d6d10 con 0x5617c5560310 2024-04-20T12:30:49.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.125+0000 7f32eaff5640 1 -- 172.21.15.135:0/409210581 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32f801acb0 con 0x5617c5560310 2024-04-20T12:30:49.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f32eaff5640 1 -- 172.21.15.135:0/409210581 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f330004ebb0 con 0x5617c5560310 2024-04-20T12:30:49.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 10 client.17949 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:49.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 10 client.17949 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:30:49.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 20 client.17949 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:49.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 1 --2- 172.21.15.135:0/409210581 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5617c55d74e0 0x5617c55d9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 4 client.17949 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:30:49.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 1 -- 172.21.15.135:0/409210581 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5617c54c39a0 con 0x5617c55d74e0 2024-04-20T12:30:49.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f3306ffd640 1 --2- 172.21.15.135:0/409210581 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5617c55d74e0 0x5617c55d9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f32eaff5640 10 client.17949 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:30:49.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f3306ffd640 1 --2- 172.21.15.135:0/409210581 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5617c55d74e0 0x5617c55d9900 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4f35c0926715f9b2 server_cookie=fcf2f1946fdca806 in_seq=0 out_seq=0 2024-04-20T12:30:49.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f32eaff5640 1 -- 172.21.15.135:0/409210581 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5617c54c39a0 con 0x5617c55d74e0 2024-04-20T12:30:49.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f32eaff5640 10 client.17949 handle_command_reply: tid=0 2024-04-20T12:30:49.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 1 client.17949 shutdown 2024-04-20T12:30:49.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 1 -- 172.21.15.135:0/409210581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5560310 msgr2=0x5617c55640d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 1 --2- 172.21.15.135:0/409210581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5560310 0x5617c55640d0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f330806b6a0 tx=0x7f33000095c0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 1 -- 172.21.15.135:0/409210581 shutdown_connections 2024-04-20T12:30:49.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 1 --2- 172.21.15.135:0/409210581 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5617c55d74e0 0x5617c55d9900 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 1 --2- 172.21.15.135:0/409210581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5617c5560310 0x5617c55640d0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 1 --2- 172.21.15.135:0/409210581 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5617c5557730 0x5617c5563b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 1 --2- 172.21.15.135:0/409210581 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5617c5556e10 0x5617c5568820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f32eaff5640 0 client.17949 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:30:49.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 1 -- 172.21.15.135:0/409210581 >> 172.21.15.135:0/409210581 conn(0x5617c5551540 msgr2=0x5617c5552890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 1 -- 172.21.15.135:0/409210581 shutdown_connections 2024-04-20T12:30:49.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 1 -- 172.21.15.135:0/409210581 wait complete. 2024-04-20T12:30:49.156 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.126+0000 7f33101a4740 20 client.17949 trim_cache size 0 max 16384 2024-04-20T12:30:49.156 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:30:49.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.127+0000 7f330d4d2640 1 -- 172.21.15.135:0/780375570 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32f00a3d20 msgr2=0x7f32f00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.157 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.127+0000 7f330d4d2640 1 --2- 172.21.15.135:0/780375570 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32f00a3d20 0x7f32f00a61e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3300032610 tx=0x7f33000323c0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.127+0000 7f330d4d2640 1 -- 172.21.15.135:0/780375570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3308103ae0 msgr2=0x7f330819e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.127+0000 7f330d4d2640 1 --2- 172.21.15.135:0/780375570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3308103ae0 0x7f330819e970 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f32fc00c890 tx=0x7f32fc00cd50 comp rx=0 tx=0).stop 2024-04-20T12:30:49.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.127+0000 7f330d4d2640 1 -- 172.21.15.135:0/780375570 shutdown_connections 2024-04-20T12:30:49.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.127+0000 7f330d4d2640 1 --2- 172.21.15.135:0/780375570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f330810c590 0x7f33081985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.127+0000 7f330d4d2640 1 --2- 172.21.15.135:0/780375570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3308103ae0 0x7f330819e970 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.127+0000 7f330d4d2640 1 --2- 172.21.15.135:0/780375570 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f32f00a3d20 0x7f32f00a61e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.127+0000 7f330d4d2640 1 --2- 172.21.15.135:0/780375570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33081031c0 0x7f330819e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.127+0000 7f330d4d2640 1 -- 172.21.15.135:0/780375570 >> 172.21.15.135:0/780375570 conn(0x7f33080771e0 msgr2=0x7f33080fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.127+0000 7f330d4d2640 1 -- 172.21.15.135:0/780375570 shutdown_connections 2024-04-20T12:30:49.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.127+0000 7f330d4d2640 1 -- 172.21.15.135:0/780375570 wait complete. 2024-04-20T12:30:49.159 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:48 smithi135 ceph-mon[18264]: pgmap v235: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:30:49.159 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:30:49.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:48 smithi154 ceph-mon[22073]: pgmap v235: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:30:49.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.262+0000 7fb0b33ed640 1 -- 172.21.15.135:0/1683080757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0ac1010b0 msgr2=0x7fb0ac101510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.262+0000 7fb0b33ed640 1 --2- 172.21.15.135:0/1683080757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0ac1010b0 0x7fb0ac101510 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8009900 tx=0x7fb0a802bc30 comp rx=0 tx=0).stop 2024-04-20T12:30:49.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.262+0000 7fb0b33ed640 1 -- 172.21.15.135:0/1683080757 shutdown_connections 2024-04-20T12:30:49.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.262+0000 7fb0b33ed640 1 --2- 172.21.15.135:0/1683080757 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0ac101a50 0x7fb0ac10dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.262+0000 7fb0b33ed640 1 --2- 172.21.15.135:0/1683080757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0ac1010b0 0x7fb0ac101510 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.262+0000 7fb0b33ed640 1 --2- 172.21.15.135:0/1683080757 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0ac105de0 0x7fb0ac1061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.262+0000 7fb0b33ed640 1 -- 172.21.15.135:0/1683080757 >> 172.21.15.135:0/1683080757 conn(0x7fb0ac077c50 msgr2=0x7fb0ac078060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.262+0000 7fb0b33ed640 1 -- 172.21.15.135:0/1683080757 shutdown_connections 2024-04-20T12:30:49.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.262+0000 7fb0b33ed640 1 -- 172.21.15.135:0/1683080757 wait complete. 2024-04-20T12:30:49.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.262+0000 7fb0b33ed640 1 Processor -- start 2024-04-20T12:30:49.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b33ed640 1 -- start start 2024-04-20T12:30:49.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b33ed640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0ac1010b0 0x7fb0ac19e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b33ed640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0ac101a50 0x7fb0ac19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b33ed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0ac105de0 0x7fb0ac198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b33ed640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac1124b0 con 0x7fb0ac105de0 2024-04-20T12:30:49.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b33ed640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac112330 con 0x7fb0ac101a50 2024-04-20T12:30:49.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b33ed640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac112630 con 0x7fb0ac1010b0 2024-04-20T12:30:49.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b198a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0ac105de0 0x7fb0ac198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b198a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0ac105de0 0x7fb0ac198730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55404/0 (socket says 172.21.15.135:55404) 2024-04-20T12:30:49.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b198a640 1 -- 172.21.15.135:0/2972134920 learned_addr learned my addr 172.21.15.135:0/2972134920 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b0988640 1 --2- 172.21.15.135:0/2972134920 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0ac101a50 0x7fb0ac19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b1189640 1 --2- 172.21.15.135:0/2972134920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0ac1010b0 0x7fb0ac19e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b198a640 1 -- 172.21.15.135:0/2972134920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0ac1010b0 msgr2=0x7fb0ac19e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b198a640 1 --2- 172.21.15.135:0/2972134920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0ac1010b0 0x7fb0ac19e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b198a640 1 -- 172.21.15.135:0/2972134920 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0ac101a50 msgr2=0x7fb0ac19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b198a640 1 --2- 172.21.15.135:0/2972134920 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0ac101a50 0x7fb0ac19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b198a640 1 -- 172.21.15.135:0/2972134920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ac198ff0 con 0x7fb0ac105de0 2024-04-20T12:30:49.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b1189640 1 --2- 172.21.15.135:0/2972134920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0ac1010b0 0x7fb0ac19e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:49.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b198a640 1 --2- 172.21.15.135:0/2972134920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0ac105de0 0x7fb0ac198730 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400b970 tx=0x7fb0a400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0a27fc640 1 -- 172.21.15.135:0/2972134920 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4019070 con 0x7fb0ac105de0 2024-04-20T12:30:49.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0a27fc640 1 -- 172.21.15.135:0/2972134920 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0a400cb40 con 0x7fb0ac105de0 2024-04-20T12:30:49.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b33ed640 1 -- 172.21.15.135:0/2972134920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0ac1992e0 con 0x7fb0ac105de0 2024-04-20T12:30:49.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0a27fc640 1 -- 172.21.15.135:0/2972134920 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4007650 con 0x7fb0ac105de0 2024-04-20T12:30:49.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.263+0000 7fb0b33ed640 1 -- 172.21.15.135:0/2972134920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0ac1a55f0 con 0x7fb0ac105de0 2024-04-20T12:30:49.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.266+0000 7fb0a27fc640 1 -- 172.21.15.135:0/2972134920 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fb0a401c070 con 0x7fb0ac105de0 2024-04-20T12:30:49.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.266+0000 7fb0b5fd8740 1 Processor -- start 2024-04-20T12:30:49.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.266+0000 7fb0b5fd8740 1 -- start start 2024-04-20T12:30:49.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.266+0000 7fb0b5fd8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cebe10 0x558957cec1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.266+0000 7fb0b5fd8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cec730 0x558957cf4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.266+0000 7fb0b5fd8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cf5310 0x558957cf7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.266+0000 7fb0b5fd8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558957c51110 con 0x558957cebe10 2024-04-20T12:30:49.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.266+0000 7fb0b5fd8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558957bee550 con 0x558957cf5310 2024-04-20T12:30:49.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.266+0000 7fb0b5fd8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558957c4d0d0 con 0x558957cec730 2024-04-20T12:30:49.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.266+0000 7fb0a27fc640 1 --2- 172.21.15.135:0/2972134920 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb0980a3d20 0x7fb0980a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.266+0000 7fb0b0988640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cebe10 0x558957cec1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.266+0000 7fb0b0988640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cebe10 0x558957cec1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55420/0 (socket says 172.21.15.135:55420) 2024-04-20T12:30:49.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.266+0000 7fb0b0988640 1 -- 172.21.15.135:0/2049226554 learned_addr learned my addr 172.21.15.135:0/2049226554 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.266+0000 7fb0b198a640 1 --2- 172.21.15.135:0/2972134920 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb0980a3d20 0x7fb0980a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.266+0000 7fb0b1189640 1 --2- 172.21.15.135:0/2049226554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cec730 0x558957cf4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.267+0000 7fb0b0988640 1 --2- 172.21.15.135:0/2049226554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cf5310 0x558957cf7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.267+0000 7fb0b0988640 1 -- 172.21.15.135:0/2049226554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cec730 msgr2=0x558957cf4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.267+0000 7fb0a27fc640 1 -- 172.21.15.135:0/2972134920 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7fb0a40d0120 con 0x7fb0ac105de0 2024-04-20T12:30:49.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.267+0000 7fb0b0988640 1 --2- 172.21.15.135:0/2049226554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cec730 0x558957cf4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.267+0000 7fb0b0988640 1 -- 172.21.15.135:0/2049226554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cf5310 msgr2=0x558957cf7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.267+0000 7fb0b0988640 1 --2- 172.21.15.135:0/2049226554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cf5310 0x558957cf7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.267+0000 7fb0b0988640 1 -- 172.21.15.135:0/2049226554 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558957c16900 con 0x558957cebe10 2024-04-20T12:30:49.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.267+0000 7fb0b1189640 1 --2- 172.21.15.135:0/2049226554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cec730 0x558957cf4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:49.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.267+0000 7fb0b0988640 1 --2- 172.21.15.135:0/2049226554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cebe10 0x558957cec1f0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8005ab0 tx=0x7fb0a8005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4053df3f83b2e80 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.267+0000 7fb0b198a640 1 --2- 172.21.15.135:0/2972134920 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb0980a3d20 0x7fb0980a61e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb0a409bb00 tx=0x7fb0a40c6f10 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.267+0000 7fb0977fe640 1 -- 172.21.15.135:0/2049226554 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8004020 con 0x558957cebe10 2024-04-20T12:30:49.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.267+0000 7fb0977fe640 1 -- 172.21.15.135:0/2049226554 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0a8004ba0 con 0x558957cebe10 2024-04-20T12:30:49.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.267+0000 7fb0977fe640 1 -- 172.21.15.135:0/2049226554 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8005370 con 0x558957cebe10 2024-04-20T12:30:49.286 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.268+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/2049226554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cebe10 msgr2=0x558957cec1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.268+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/2049226554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cebe10 0x558957cec1f0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8005ab0 tx=0x7fb0a8005a40 comp rx=0 tx=0).stop 2024-04-20T12:30:49.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.268+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/2049226554 shutdown_connections 2024-04-20T12:30:49.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.268+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/2049226554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cf5310 0x558957cf7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.268+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/2049226554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cec730 0x558957cf4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.268+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/2049226554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cebe10 0x558957cec1f0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.268+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/2049226554 >> 172.21.15.135:0/2049226554 conn(0x558957ce6540 msgr2=0x558957ce6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.287 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.268+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/2049226554 shutdown_connections 2024-04-20T12:30:49.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.268+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/2049226554 wait complete. 2024-04-20T12:30:49.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.268+0000 7fb0b5fd8740 1 -- start start 2024-04-20T12:30:49.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.268+0000 7fb0b5fd8740 1 Processor -- start 2024-04-20T12:30:49.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b5fd8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cebe10 0x558957cf23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b5fd8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cf2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b5fd8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cf5310 0x558957cf2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.288 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b5fd8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558957cf7fe0 con 0x558957cec730 2024-04-20T12:30:49.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b5fd8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558957c0a500 con 0x558957cf5310 2024-04-20T12:30:49.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b5fd8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558957cf8160 con 0x558957cebe10 2024-04-20T12:30:49.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b5fd8740 10 client.0 _ll_register_callbacks cb 0x558957bef2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:49.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b1189640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cf2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b1189640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cf2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55426/0 (socket says 172.21.15.135:55426) 2024-04-20T12:30:49.289 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b1189640 1 -- 172.21.15.135:0/2688022084 learned_addr learned my addr 172.21.15.135:0/2688022084 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b0988640 1 --2- 172.21.15.135:0/2688022084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cf5310 0x558957cf2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b0988640 1 --2- 172.21.15.135:0/2688022084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cebe10 0x558957cf23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b1189640 1 -- 172.21.15.135:0/2688022084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cebe10 msgr2=0x558957cf23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b1189640 1 --2- 172.21.15.135:0/2688022084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cebe10 0x558957cf23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b1189640 1 -- 172.21.15.135:0/2688022084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cf5310 msgr2=0x558957cf2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.290 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b1189640 1 --2- 172.21.15.135:0/2688022084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cf5310 0x558957cf2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b1189640 1 -- 172.21.15.135:0/2688022084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589579633f0 con 0x558957cec730 2024-04-20T12:30:49.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b1189640 1 --2- 172.21.15.135:0/2688022084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cf2920 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00e2d0 tx=0x7fb09c00e790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591fc6ad05dbda6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb094ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:49.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb094ff9640 1 -- 172.21.15.135:0/2688022084 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c018020 con 0x558957cec730 2024-04-20T12:30:49.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb094ff9640 1 -- 172.21.15.135:0/2688022084 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7fb09c013660 con 0x558957cec730 2024-04-20T12:30:49.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.269+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/2688022084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0a8004ba0 con 0x558957cec730 2024-04-20T12:30:49.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.270+0000 7fb094ff9640 1 -- 172.21.15.135:0/2688022084 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb09c023050 con 0x558957cec730 2024-04-20T12:30:49.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.270+0000 7fb0b5fd8740 10 client.17961 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:49.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.270+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/2688022084 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558957a2d7d0 con 0x558957cec730 2024-04-20T12:30:49.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.270+0000 7fb094ff9640 1 -- 172.21.15.135:0/2688022084 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0a8004ba0 con 0x558957cec730 2024-04-20T12:30:49.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.270+0000 7fb094ff9640 1 -- 172.21.15.135:0/2688022084 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fb09c014b00 con 0x558957cec730 2024-04-20T12:30:49.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.270+0000 7fb0b5fd8740 10 client.17961 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:49.291 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.270+0000 7fb0b5fd8740 10 client.17961 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:30:49.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.270+0000 7fb0b5fd8740 20 client.17961 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:49.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.270+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/2688022084 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558957d05630 0x558957d07a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.270+0000 7fb0b5fd8740 4 client.17961 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:49.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.270+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/2688022084 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558957c5eb30 con 0x558957d05630 2024-04-20T12:30:49.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.270+0000 7fb0b0988640 1 --2- 172.21.15.135:0/2688022084 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558957d05630 0x558957d07a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.271+0000 7fb0b0988640 1 --2- 172.21.15.135:0/2688022084 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558957d05630 0x558957d07a70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b920f4b460c1e4c3 server_cookie=705a0c1d8e3c5484 in_seq=0 out_seq=0 2024-04-20T12:30:49.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.271+0000 7fb094ff9640 10 client.17961 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:30:49.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.271+0000 7fb094ff9640 1 -- 172.21.15.135:0/2688022084 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558957c5eb30 con 0x558957d05630 2024-04-20T12:30:49.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.271+0000 7fb094ff9640 10 client.17961 handle_command_reply: tid=0 2024-04-20T12:30:49.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.271+0000 7fb0b5fd8740 1 client.17961 shutdown 2024-04-20T12:30:49.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.271+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/2688022084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 msgr2=0x558957cf2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.271+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/2688022084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cf2920 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00e2d0 tx=0x7fb09c00e790 comp rx=0 tx=0).stop 2024-04-20T12:30:49.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.271+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/2688022084 shutdown_connections 2024-04-20T12:30:49.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.271+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/2688022084 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558957d05630 0x558957d07a70 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.292 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.271+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/2688022084 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cf5310 0x558957cf2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.272+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/2688022084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cf2920 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.272+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/2688022084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cebe10 0x558957cf23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.272+0000 7fb094ff9640 0 client.17961 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:30:49.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.272+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/2688022084 >> 172.21.15.135:0/2688022084 conn(0x558957ce6540 msgr2=0x558957ce8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.272+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/2688022084 shutdown_connections 2024-04-20T12:30:49.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.272+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/2688022084 wait complete. 2024-04-20T12:30:49.293 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.272+0000 7fb0b5fd8740 20 client.17961 trim_cache size 0 max 16384 2024-04-20T12:30:49.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b5fd8740 1 Processor -- start 2024-04-20T12:30:49.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b5fd8740 1 -- start start 2024-04-20T12:30:49.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b5fd8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cebe10 0x558957cf4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b5fd8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cf2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b5fd8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cf5310 0x558957ce5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b5fd8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac1af3f0 con 0x558957cec730 2024-04-20T12:30:49.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b5fd8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac1b0f30 con 0x558957cebe10 2024-04-20T12:30:49.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b5fd8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac1afac0 con 0x558957cf5310 2024-04-20T12:30:49.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b1189640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cf2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b1189640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cf2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55436/0 (socket says 172.21.15.135:55436) 2024-04-20T12:30:49.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b1189640 1 -- 172.21.15.135:0/3395963445 learned_addr learned my addr 172.21.15.135:0/3395963445 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b0988640 1 --2- 172.21.15.135:0/3395963445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cebe10 0x558957cf4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b1189640 1 -- 172.21.15.135:0/3395963445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cf5310 msgr2=0x558957ce5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b1189640 1 --2- 172.21.15.135:0/3395963445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cf5310 0x558957ce5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b1189640 1 -- 172.21.15.135:0/3395963445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cebe10 msgr2=0x558957cf4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b1189640 1 --2- 172.21.15.135:0/3395963445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cebe10 0x558957cf4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b1189640 1 -- 172.21.15.135:0/3395963445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558957ceb190 con 0x558957cec730 2024-04-20T12:30:49.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b0988640 1 --2- 172.21.15.135:0/3395963445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cebe10 0x558957cf4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb0b1189640 1 --2- 172.21.15.135:0/3395963445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cf2c80 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00c2c0 tx=0x7fb09c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caba8d26102a9f6c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb096ffd640 1 -- 172.21.15.135:0/3395963445 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c018070 con 0x558957cec730 2024-04-20T12:30:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb096ffd640 1 -- 172.21.15.135:0/3395963445 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb09c012e20 con 0x558957cec730 2024-04-20T12:30:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.285+0000 7fb096ffd640 1 -- 172.21.15.135:0/3395963445 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c013bd0 con 0x558957cec730 2024-04-20T12:30:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.286+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/3395963445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 msgr2=0x558957cf2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.286+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/3395963445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cf2c80 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00c2c0 tx=0x7fb09c007f60 comp rx=0 tx=0).stop 2024-04-20T12:30:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.286+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/3395963445 shutdown_connections 2024-04-20T12:30:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.286+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/3395963445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cf5310 0x558957ce5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.286+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/3395963445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cf2c80 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.286+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/3395963445 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cebe10 0x558957cf4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.286+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/3395963445 >> 172.21.15.135:0/3395963445 conn(0x558957ce6540 msgr2=0x558957ce4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.286+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/3395963445 shutdown_connections 2024-04-20T12:30:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.286+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/3395963445 wait complete. 2024-04-20T12:30:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.286+0000 7fb0b5fd8740 1 -- start start 2024-04-20T12:30:49.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.286+0000 7fb0b5fd8740 1 Processor -- start 2024-04-20T12:30:49.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b5fd8740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cebe10 0x558957cef440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b5fd8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cef980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b5fd8740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cf5310 0x558957d6abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b5fd8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac1b0860 con 0x558957cec730 2024-04-20T12:30:49.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b5fd8740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac1b0190 con 0x558957cebe10 2024-04-20T12:30:49.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b5fd8740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac1ad3c0 con 0x558957cf5310 2024-04-20T12:30:49.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b5fd8740 10 client.0 _ll_register_callbacks cb 0x7fb09c00c170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:49.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b1189640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cef980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b1189640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cef980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55446/0 (socket says 172.21.15.135:55446) 2024-04-20T12:30:49.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b1189640 1 -- 172.21.15.135:0/3624308518 learned_addr learned my addr 172.21.15.135:0/3624308518 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b0988640 1 --2- 172.21.15.135:0/3624308518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cebe10 0x558957cef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b0988640 1 --2- 172.21.15.135:0/3624308518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cf5310 0x558957d6abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b1189640 1 -- 172.21.15.135:0/3624308518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cf5310 msgr2=0x558957d6abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b1189640 1 --2- 172.21.15.135:0/3624308518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cf5310 0x558957d6abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b1189640 1 -- 172.21.15.135:0/3624308518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cebe10 msgr2=0x558957cef440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b1189640 1 --2- 172.21.15.135:0/3624308518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cebe10 0x558957cef440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b1189640 1 -- 172.21.15.135:0/3624308518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558957d6b0f0 con 0x558957cec730 2024-04-20T12:30:49.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b0988640 1 --2- 172.21.15.135:0/3624308518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cf5310 0x558957d6abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:49.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b1189640 1 --2- 172.21.15.135:0/3624308518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cef980 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fb09c029040 tx=0x7fb09c013ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5a91b374c0bdfd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb094ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:49.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb094ff9640 1 -- 172.21.15.135:0/3624308518 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c018070 con 0x558957cec730 2024-04-20T12:30:49.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb094ff9640 1 -- 172.21.15.135:0/3624308518 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7fb09c02c040 con 0x558957cec730 2024-04-20T12:30:49.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.287+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/3624308518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb09c012e20 con 0x558957cec730 2024-04-20T12:30:49.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.288+0000 7fb094ff9640 1 -- 172.21.15.135:0/3624308518 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb09c03d050 con 0x558957cec730 2024-04-20T12:30:49.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.288+0000 7fb0b5fd8740 10 client.17967 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:49.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.288+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/3624308518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558957d6c1a0 con 0x558957cec730 2024-04-20T12:30:49.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.288+0000 7fb094ff9640 1 -- 172.21.15.135:0/3624308518 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb09c012e20 con 0x558957cec730 2024-04-20T12:30:49.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.288+0000 7fb094ff9640 1 -- 172.21.15.135:0/3624308518 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fb09c014400 con 0x558957cec730 2024-04-20T12:30:49.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.288+0000 7fb0b5fd8740 10 client.17967 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:49.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.288+0000 7fb0b5fd8740 10 client.17967 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:30:49.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.288+0000 7fb0b5fd8740 20 client.17967 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:49.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.288+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/3624308518 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558957d6c860 0x558957d6ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.288+0000 7fb0b5fd8740 4 client.17967 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:30:49.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.288+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/3624308518 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558957c589a0 con 0x558957d6c860 2024-04-20T12:30:49.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.288+0000 7fb0b0988640 1 --2- 172.21.15.135:0/3624308518 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558957d6c860 0x558957d6ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb0b0988640 1 --2- 172.21.15.135:0/3624308518 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558957d6c860 0x558957d6ec80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=45006ca329b81d7e server_cookie=bc3e88a7ea0446d8 in_seq=0 out_seq=0 2024-04-20T12:30:49.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb094ff9640 10 client.17967 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:30:49.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb094ff9640 1 -- 172.21.15.135:0/3624308518 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558957c589a0 con 0x558957d6c860 2024-04-20T12:30:49.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb094ff9640 10 client.17967 handle_command_reply: tid=0 2024-04-20T12:30:49.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb0b5fd8740 1 client.17967 shutdown 2024-04-20T12:30:49.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/3624308518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 msgr2=0x558957cef980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/3624308518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cef980 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fb09c029040 tx=0x7fb09c013ac0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/3624308518 shutdown_connections 2024-04-20T12:30:49.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/3624308518 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x558957d6c860 0x558957d6ec80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/3624308518 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558957cf5310 0x558957d6abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb094ff9640 0 client.17967 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:30:49.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/3624308518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558957cec730 0x558957cef980 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb0b5fd8740 1 --2- 172.21.15.135:0/3624308518 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558957cebe10 0x558957cef440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/3624308518 >> 172.21.15.135:0/3624308518 conn(0x558957ce6540 msgr2=0x558957ce8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/3624308518 shutdown_connections 2024-04-20T12:30:49.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb0b5fd8740 1 -- 172.21.15.135:0/3624308518 wait complete. 2024-04-20T12:30:49.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.289+0000 7fb0b5fd8740 20 client.17967 trim_cache size 0 max 16384 2024-04-20T12:30:49.309 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:30:49.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.290+0000 7fb0b33ed640 1 -- 172.21.15.135:0/2972134920 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb0980a3d20 msgr2=0x7fb0980a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.290+0000 7fb0b33ed640 1 --2- 172.21.15.135:0/2972134920 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb0980a3d20 0x7fb0980a61e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb0a409bb00 tx=0x7fb0a40c6f10 comp rx=0 tx=0).stop 2024-04-20T12:30:49.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.290+0000 7fb0b33ed640 1 -- 172.21.15.135:0/2972134920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0ac105de0 msgr2=0x7fb0ac198730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.290+0000 7fb0b33ed640 1 --2- 172.21.15.135:0/2972134920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0ac105de0 0x7fb0ac198730 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400b970 tx=0x7fb0a400be30 comp rx=0 tx=0).stop 2024-04-20T12:30:49.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.290+0000 7fb0b33ed640 1 -- 172.21.15.135:0/2972134920 shutdown_connections 2024-04-20T12:30:49.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.290+0000 7fb0b33ed640 1 --2- 172.21.15.135:0/2972134920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0ac105de0 0x7fb0ac198730 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.290+0000 7fb0b33ed640 1 --2- 172.21.15.135:0/2972134920 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0ac101a50 0x7fb0ac19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.290+0000 7fb0b33ed640 1 --2- 172.21.15.135:0/2972134920 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb0980a3d20 0x7fb0980a61e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.290+0000 7fb0b33ed640 1 --2- 172.21.15.135:0/2972134920 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0ac1010b0 0x7fb0ac19e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.290+0000 7fb0b33ed640 1 -- 172.21.15.135:0/2972134920 >> 172.21.15.135:0/2972134920 conn(0x7fb0ac077c50 msgr2=0x7fb0ac0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.290+0000 7fb0b33ed640 1 -- 172.21.15.135:0/2972134920 shutdown_connections 2024-04-20T12:30:49.312 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.290+0000 7fb0b33ed640 1 -- 172.21.15.135:0/2972134920 wait complete. 2024-04-20T12:30:49.312 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:30:49.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:48 smithi139 ceph-mon[21834]: pgmap v235: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:30:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.415+0000 7fee7cd59640 1 -- 172.21.15.135:0/3644231130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee78106670 msgr2=0x7fee78106a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.415+0000 7fee7cd59640 1 --2- 172.21.15.135:0/3644231130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee78106670 0x7fee78106a50 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fee70009930 tx=0x7fee7002bc30 comp rx=0 tx=0).stop 2024-04-20T12:30:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.415+0000 7fee7cd59640 1 -- 172.21.15.135:0/3644231130 shutdown_connections 2024-04-20T12:30:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.415+0000 7fee7cd59640 1 --2- 172.21.15.135:0/3644231130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee78100f90 0x7fee7810d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.415+0000 7fee7cd59640 1 --2- 172.21.15.135:0/3644231130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee781005d0 0x7fee78100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.415+0000 7fee7cd59640 1 --2- 172.21.15.135:0/3644231130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee78106670 0x7fee78106a50 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.415+0000 7fee7cd59640 1 -- 172.21.15.135:0/3644231130 >> 172.21.15.135:0/3644231130 conn(0x7fee780773b0 msgr2=0x7fee780fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.415+0000 7fee7cd59640 1 -- 172.21.15.135:0/3644231130 shutdown_connections 2024-04-20T12:30:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.415+0000 7fee7cd59640 1 -- 172.21.15.135:0/3644231130 wait complete. 2024-04-20T12:30:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee7cd59640 1 Processor -- start 2024-04-20T12:30:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee7cd59640 1 -- start start 2024-04-20T12:30:49.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee7cd59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee781005d0 0x7fee781995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee7cd59640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee78100f90 0x7fee78199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee7cd59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee78106670 0x7fee781a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee7cd59640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fee781111f0 con 0x7fee78100f90 2024-04-20T12:30:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee7cd59640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fee78111070 con 0x7fee781005d0 2024-04-20T12:30:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee7cd59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee78111370 con 0x7fee78106670 2024-04-20T12:30:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee75d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee78100f90 0x7fee78199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee75d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee78100f90 0x7fee78199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55462/0 (socket says 172.21.15.135:55462) 2024-04-20T12:30:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee75d9b640 1 -- 172.21.15.135:0/1915892684 learned_addr learned my addr 172.21.15.135:0/1915892684 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee7659c640 1 --2- 172.21.15.135:0/1915892684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee781005d0 0x7fee781995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee76d9d640 1 --2- 172.21.15.135:0/1915892684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee78106670 0x7fee781a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee75d9b640 1 -- 172.21.15.135:0/1915892684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee78106670 msgr2=0x7fee781a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee75d9b640 1 --2- 172.21.15.135:0/1915892684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee78106670 0x7fee781a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee75d9b640 1 -- 172.21.15.135:0/1915892684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee781005d0 msgr2=0x7fee781995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee75d9b640 1 --2- 172.21.15.135:0/1915892684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee781005d0 0x7fee781995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee75d9b640 1 -- 172.21.15.135:0/1915892684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee781a4bb0 con 0x7fee78100f90 2024-04-20T12:30:49.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.416+0000 7fee75d9b640 1 --2- 172.21.15.135:0/1915892684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee78100f90 0x7fee78199b30 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00ebc0 tx=0x7fee6c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.417+0000 7fee677fe640 1 -- 172.21.15.135:0/1915892684 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c010630 con 0x7fee78100f90 2024-04-20T12:30:49.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.417+0000 7fee677fe640 1 -- 172.21.15.135:0/1915892684 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee6c010cb0 con 0x7fee78100f90 2024-04-20T12:30:49.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.417+0000 7fee7cd59640 1 -- 172.21.15.135:0/1915892684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee781a4d80 con 0x7fee78100f90 2024-04-20T12:30:49.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.417+0000 7fee677fe640 1 -- 172.21.15.135:0/1915892684 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c018bd0 con 0x7fee78100f90 2024-04-20T12:30:49.418 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.417+0000 7fee7cd59640 1 -- 172.21.15.135:0/1915892684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee781a5270 con 0x7fee78100f90 2024-04-20T12:30:49.424 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.419+0000 7fee677fe640 1 -- 172.21.15.135:0/1915892684 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fee6c0107d0 con 0x7fee78100f90 2024-04-20T12:30:49.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.419+0000 7fee7fa2e740 1 Processor -- start 2024-04-20T12:30:49.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.419+0000 7fee7fa2e740 1 -- start start 2024-04-20T12:30:49.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee677fe640 1 --2- 172.21.15.135:0/1915892684 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fee600a3d20 0x7fee600a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee7fa2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd87f0 0x55d794bd8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee7fa2e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd91a0 0x55d794be61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee7fa2e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 0x55d794be8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.425 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee7fa2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d794b3e110 con 0x55d794bd87f0 2024-04-20T12:30:49.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee7fa2e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d794adb550 con 0x55d794bd91a0 2024-04-20T12:30:49.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee7fa2e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d794b3a0d0 con 0x55d794be6720 2024-04-20T12:30:49.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee76d9d640 1 --2- 172.21.15.135:0/1915892684 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fee600a3d20 0x7fee600a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee7659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd87f0 0x55d794bd8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee7659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd87f0 0x55d794bd8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55466/0 (socket says 172.21.15.135:55466) 2024-04-20T12:30:49.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee7659c640 1 -- 172.21.15.135:0/1574922087 learned_addr learned my addr 172.21.15.135:0/1574922087 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee677fe640 1 -- 172.21.15.135:0/1915892684 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7fee6c0d11c0 con 0x7fee78100f90 2024-04-20T12:30:49.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee75d9b640 1 --2- 172.21.15.135:0/1574922087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd91a0 0x55d794be61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee76d9d640 1 --2- 172.21.15.135:0/1574922087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 0x55d794be8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee7659c640 1 -- 172.21.15.135:0/1574922087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 msgr2=0x55d794be8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee7659c640 1 --2- 172.21.15.135:0/1574922087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 0x55d794be8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee7659c640 1 -- 172.21.15.135:0/1574922087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd91a0 msgr2=0x55d794be61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee7659c640 1 --2- 172.21.15.135:0/1574922087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd91a0 0x55d794be61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.426 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee7659c640 1 -- 172.21.15.135:0/1574922087 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d794b03900 con 0x55d794bd87f0 2024-04-20T12:30:49.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee76d9d640 1 --2- 172.21.15.135:0/1915892684 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fee600a3d20 0x7fee600a61e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fee6800b970 tx=0x7fee6800bd70 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee7659c640 1 --2- 172.21.15.135:0/1574922087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd87f0 0x55d794bd8bd0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fee7002cfd0 tx=0x7fee70005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1503d0eb0702fc23 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee64ff9640 1 -- 172.21.15.135:0/1574922087 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70042070 con 0x55d794bd87f0 2024-04-20T12:30:49.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee64ff9640 1 -- 172.21.15.135:0/1574922087 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee70004030 con 0x55d794bd87f0 2024-04-20T12:30:49.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.420+0000 7fee64ff9640 1 -- 172.21.15.135:0/1574922087 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70004ca0 con 0x55d794bd87f0 2024-04-20T12:30:49.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.421+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1574922087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd87f0 msgr2=0x55d794bd8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.421+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/1574922087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd87f0 0x55d794bd8bd0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fee7002cfd0 tx=0x7fee70005d50 comp rx=0 tx=0).stop 2024-04-20T12:30:49.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.421+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1574922087 shutdown_connections 2024-04-20T12:30:49.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.421+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/1574922087 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 0x55d794be8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.421+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/1574922087 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd91a0 0x55d794be61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.421+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/1574922087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd87f0 0x55d794bd8bd0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.421+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1574922087 >> 172.21.15.135:0/1574922087 conn(0x55d794bd3540 msgr2=0x55d794bd3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.421+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1574922087 shutdown_connections 2024-04-20T12:30:49.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.421+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1574922087 wait complete. 2024-04-20T12:30:49.427 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee7fa2e740 1 -- start start 2024-04-20T12:30:49.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee7fa2e740 1 Processor -- start 2024-04-20T12:30:49.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee7fa2e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd87f0 0x55d794be36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee7fa2e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794bd91a0 0x55d794be3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee7fa2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794be6720 0x55d794be4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee7fa2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d794be9480 con 0x55d794be6720 2024-04-20T12:30:49.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee7fa2e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d794af7500 con 0x55d794bd87f0 2024-04-20T12:30:49.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee7fa2e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d794be9600 con 0x55d794bd91a0 2024-04-20T12:30:49.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee7fa2e740 10 client.0 _ll_register_callbacks cb 0x55d794adc2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:49.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee76d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794be6720 0x55d794be4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee76d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794be6720 0x55d794be4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55480/0 (socket says 172.21.15.135:55480) 2024-04-20T12:30:49.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee76d9d640 1 -- 172.21.15.135:0/1482777119 learned_addr learned my addr 172.21.15.135:0/1482777119 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee7659c640 1 --2- 172.21.15.135:0/1482777119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd87f0 0x55d794be36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee76d9d640 1 -- 172.21.15.135:0/1482777119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794bd91a0 msgr2=0x55d794be3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.428 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee76d9d640 1 --2- 172.21.15.135:0/1482777119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794bd91a0 0x55d794be3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee76d9d640 1 -- 172.21.15.135:0/1482777119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd87f0 msgr2=0x55d794be36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee76d9d640 1 --2- 172.21.15.135:0/1482777119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd87f0 0x55d794be36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee76d9d640 1 -- 172.21.15.135:0/1482777119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7948503f0 con 0x55d794be6720 2024-04-20T12:30:49.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee76d9d640 1 --2- 172.21.15.135:0/1482777119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794be6720 0x55d794be4150 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fee680123f0 tx=0x7fee68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eda46b3dd474fcd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.422+0000 7fee5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:49.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.423+0000 7fee5dffb640 1 -- 172.21.15.135:0/1482777119 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6801f800 con 0x55d794be6720 2024-04-20T12:30:49.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.423+0000 7fee5dffb640 1 -- 172.21.15.135:0/1482777119 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7fee6801f9a0 con 0x55d794be6720 2024-04-20T12:30:49.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.423+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1482777119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee70004030 con 0x55d794be6720 2024-04-20T12:30:49.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.423+0000 7fee5dffb640 1 -- 172.21.15.135:0/1482777119 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fee6801fba0 con 0x55d794be6720 2024-04-20T12:30:49.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.423+0000 7fee7fa2e740 10 client.17979 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:49.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.423+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1482777119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d79491a7d0 con 0x55d794be6720 2024-04-20T12:30:49.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.423+0000 7fee5dffb640 1 -- 172.21.15.135:0/1482777119 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee70004030 con 0x55d794be6720 2024-04-20T12:30:49.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.423+0000 7fee5dffb640 1 -- 172.21.15.135:0/1482777119 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fee6800f3c0 con 0x55d794be6720 2024-04-20T12:30:49.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.423+0000 7fee7fa2e740 10 client.17979 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:49.429 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.423+0000 7fee7fa2e740 10 client.17979 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:30:49.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.423+0000 7fee7fa2e740 20 client.17979 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:49.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.423+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/1482777119 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55d794bf6a80 0x55d794bf8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.423+0000 7fee7fa2e740 4 client.17979 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:49.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.423+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1482777119 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d794b4bb30 con 0x55d794bf6a80 2024-04-20T12:30:49.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.423+0000 7fee7659c640 1 --2- 172.21.15.135:0/1482777119 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55d794bf6a80 0x55d794bf8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.424+0000 7fee5dffb640 10 client.17979 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:30:49.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.424+0000 7fee7659c640 1 --2- 172.21.15.135:0/1482777119 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55d794bf6a80 0x55d794bf8f40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c46bfea28a881c71 server_cookie=2f5f77098b82f923 in_seq=0 out_seq=0 2024-04-20T12:30:49.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.424+0000 7fee5dffb640 1 -- 172.21.15.135:0/1482777119 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d794b4bb30 con 0x55d794bf6a80 2024-04-20T12:30:49.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.424+0000 7fee5dffb640 10 client.17979 handle_command_reply: tid=0 2024-04-20T12:30:49.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.424+0000 7fee7fa2e740 1 client.17979 shutdown 2024-04-20T12:30:49.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.424+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1482777119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794be6720 msgr2=0x55d794be4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.425+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/1482777119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794be6720 0x55d794be4150 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fee680123f0 tx=0x7fee68004730 comp rx=0 tx=0).stop 2024-04-20T12:30:49.430 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.425+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1482777119 shutdown_connections 2024-04-20T12:30:49.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.425+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/1482777119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794be6720 0x55d794be4150 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.425+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/1482777119 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55d794bf6a80 0x55d794bf8f40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.425+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/1482777119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794bd91a0 0x55d794be3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.425+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/1482777119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd87f0 0x55d794be36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.425+0000 7fee5dffb640 0 client.17979 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:30:49.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.425+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1482777119 >> 172.21.15.135:0/1482777119 conn(0x55d794bd3540 msgr2=0x55d794bd5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.425+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1482777119 shutdown_connections 2024-04-20T12:30:49.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.425+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1482777119 wait complete. 2024-04-20T12:30:49.431 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.425+0000 7fee7fa2e740 20 client.17979 trim_cache size 0 max 16384 2024-04-20T12:30:49.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee7fa2e740 1 Processor -- start 2024-04-20T12:30:49.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee7fa2e740 1 -- start start 2024-04-20T12:30:49.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee7fa2e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd87f0 0x55d794bf23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee7fa2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd91a0 0x55d794bd5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.443 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee7fa2e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 0x55d794bfe810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee7fa2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fee781ad240 con 0x55d794bd91a0 2024-04-20T12:30:49.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee7fa2e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fee781aed80 con 0x55d794bd87f0 2024-04-20T12:30:49.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee7fa2e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee781ad910 con 0x55d794be6720 2024-04-20T12:30:49.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee75d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd91a0 0x55d794bd5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee75d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd91a0 0x55d794bd5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55484/0 (socket says 172.21.15.135:55484) 2024-04-20T12:30:49.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee75d9b640 1 -- 172.21.15.135:0/1994720197 learned_addr learned my addr 172.21.15.135:0/1994720197 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee7659c640 1 --2- 172.21.15.135:0/1994720197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd87f0 0x55d794bf23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee76d9d640 1 --2- 172.21.15.135:0/1994720197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 0x55d794bfe810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.444 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee75d9b640 1 -- 172.21.15.135:0/1994720197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 msgr2=0x55d794bfe810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee75d9b640 1 --2- 172.21.15.135:0/1994720197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 0x55d794bfe810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee75d9b640 1 -- 172.21.15.135:0/1994720197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd87f0 msgr2=0x55d794bf23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee75d9b640 1 --2- 172.21.15.135:0/1994720197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd87f0 0x55d794bf23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee75d9b640 1 -- 172.21.15.135:0/1994720197 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d794bcebe0 con 0x55d794bd91a0 2024-04-20T12:30:49.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee75d9b640 1 --2- 172.21.15.135:0/1994720197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd91a0 0x55d794bd5000 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0ce5a0 tx=0x7fee6c098aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc90ab530986ba2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee5ffff640 1 -- 172.21.15.135:0/1994720197 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c010e60 con 0x55d794bd91a0 2024-04-20T12:30:49.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee5ffff640 1 -- 172.21.15.135:0/1994720197 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee6c09ce40 con 0x55d794bd91a0 2024-04-20T12:30:49.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.438+0000 7fee5ffff640 1 -- 172.21.15.135:0/1994720197 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c09af70 con 0x55d794bd91a0 2024-04-20T12:30:49.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.439+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1994720197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd91a0 msgr2=0x55d794bd5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.445 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.439+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/1994720197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd91a0 0x55d794bd5000 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0ce5a0 tx=0x7fee6c098aa0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.439+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1994720197 shutdown_connections 2024-04-20T12:30:49.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.439+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/1994720197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 0x55d794bfe810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.439+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/1994720197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd91a0 0x55d794bd5000 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.439+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/1994720197 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd87f0 0x55d794bf23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.439+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1994720197 >> 172.21.15.135:0/1994720197 conn(0x55d794bd3540 msgr2=0x55d794bd48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.439+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1994720197 shutdown_connections 2024-04-20T12:30:49.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.439+0000 7fee7fa2e740 1 -- 172.21.15.135:0/1994720197 wait complete. 2024-04-20T12:30:49.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.439+0000 7fee7fa2e740 1 -- start start 2024-04-20T12:30:49.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.439+0000 7fee7fa2e740 1 Processor -- start 2024-04-20T12:30:49.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee7fa2e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd87f0 0x55d794be09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee7fa2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd91a0 0x55d794be0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee7fa2e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 0x55d794c5c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee7fa2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fee781ae6b0 con 0x55d794bd91a0 2024-04-20T12:30:49.446 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee7fa2e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fee781adfe0 con 0x55d794bd87f0 2024-04-20T12:30:49.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee7fa2e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fee781ab210 con 0x55d794be6720 2024-04-20T12:30:49.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee7fa2e740 10 client.0 _ll_register_callbacks cb 0x7fee6800b660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:49.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee75d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd91a0 0x55d794be0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee75d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd91a0 0x55d794be0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55498/0 (socket says 172.21.15.135:55498) 2024-04-20T12:30:49.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee75d9b640 1 -- 172.21.15.135:0/3360061679 learned_addr learned my addr 172.21.15.135:0/3360061679 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee76d9d640 1 --2- 172.21.15.135:0/3360061679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 0x55d794c5c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee7659c640 1 --2- 172.21.15.135:0/3360061679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd87f0 0x55d794be09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee75d9b640 1 -- 172.21.15.135:0/3360061679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 msgr2=0x55d794c5c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee75d9b640 1 --2- 172.21.15.135:0/3360061679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 0x55d794c5c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee75d9b640 1 -- 172.21.15.135:0/3360061679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd87f0 msgr2=0x55d794be09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee75d9b640 1 --2- 172.21.15.135:0/3360061679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd87f0 0x55d794be09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee75d9b640 1 -- 172.21.15.135:0/3360061679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d794c5c5c0 con 0x55d794bd91a0 2024-04-20T12:30:49.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee76d9d640 1 --2- 172.21.15.135:0/3360061679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 0x55d794c5c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:49.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee75d9b640 1 --2- 172.21.15.135:0/3360061679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd91a0 0x55d794be0f10 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fee6c09cb40 tx=0x7fee6c018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54179b2be33bbb93 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:49.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee5dffb640 1 -- 172.21.15.135:0/3360061679 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6c010e60 con 0x55d794bd91a0 2024-04-20T12:30:49.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee5dffb640 1 -- 172.21.15.135:0/3360061679 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7fee6c080cc0 con 0x55d794bd91a0 2024-04-20T12:30:49.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee7fa2e740 1 -- 172.21.15.135:0/3360061679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee6c09ce40 con 0x55d794bd91a0 2024-04-20T12:30:49.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee5dffb640 1 -- 172.21.15.135:0/3360061679 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fee6c09af50 con 0x55d794bd91a0 2024-04-20T12:30:49.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee7fa2e740 10 client.17985 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:49.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.440+0000 7fee7fa2e740 1 -- 172.21.15.135:0/3360061679 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d794c5d7c0 con 0x55d794bd91a0 2024-04-20T12:30:49.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.441+0000 7fee5dffb640 1 -- 172.21.15.135:0/3360061679 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee6c09ce40 con 0x55d794bd91a0 2024-04-20T12:30:49.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.441+0000 7fee5dffb640 1 -- 172.21.15.135:0/3360061679 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fee6c09c290 con 0x55d794bd91a0 2024-04-20T12:30:49.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.441+0000 7fee7fa2e740 10 client.17985 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:49.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.441+0000 7fee7fa2e740 10 client.17985 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:30:49.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.441+0000 7fee7fa2e740 20 client.17985 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:49.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.441+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/3360061679 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55d794c5de80 0x55d794c60270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.441+0000 7fee7fa2e740 4 client.17985 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:30:49.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.441+0000 7fee7fa2e740 1 -- 172.21.15.135:0/3360061679 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d794b459a0 con 0x55d794c5de80 2024-04-20T12:30:49.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.441+0000 7fee7659c640 1 --2- 172.21.15.135:0/3360061679 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55d794c5de80 0x55d794c60270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.441+0000 7fee5dffb640 10 client.17985 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:30:49.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.441+0000 7fee7659c640 1 --2- 172.21.15.135:0/3360061679 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55d794c5de80 0x55d794c60270 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7ccac09ad32cc60e server_cookie=f834099bdff96bd3 in_seq=0 out_seq=0 2024-04-20T12:30:49.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee5dffb640 1 -- 172.21.15.135:0/3360061679 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d794b459a0 con 0x55d794c5de80 2024-04-20T12:30:49.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee5dffb640 10 client.17985 handle_command_reply: tid=0 2024-04-20T12:30:49.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7fa2e740 1 client.17985 shutdown 2024-04-20T12:30:49.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7fa2e740 1 -- 172.21.15.135:0/3360061679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd91a0 msgr2=0x55d794be0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/3360061679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd91a0 0x55d794be0f10 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fee6c09cb40 tx=0x7fee6c018670 comp rx=0 tx=0).stop 2024-04-20T12:30:49.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7fa2e740 1 -- 172.21.15.135:0/3360061679 shutdown_connections 2024-04-20T12:30:49.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/3360061679 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55d794c5de80 0x55d794c60270 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/3360061679 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d794be6720 0x55d794c5c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/3360061679 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d794bd91a0 0x55d794be0f10 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7fa2e740 1 --2- 172.21.15.135:0/3360061679 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d794bd87f0 0x55d794be09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee5dffb640 0 client.17985 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:30:49.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7fa2e740 1 -- 172.21.15.135:0/3360061679 >> 172.21.15.135:0/3360061679 conn(0x55d794bd3540 msgr2=0x55d794bd26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7fa2e740 1 -- 172.21.15.135:0/3360061679 shutdown_connections 2024-04-20T12:30:49.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7fa2e740 1 -- 172.21.15.135:0/3360061679 wait complete. 2024-04-20T12:30:49.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7fa2e740 20 client.17985 trim_cache size 0 max 16384 2024-04-20T12:30:49.450 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:30:49.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7cd59640 1 -- 172.21.15.135:0/1915892684 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fee600a3d20 msgr2=0x7fee600a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7cd59640 1 --2- 172.21.15.135:0/1915892684 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fee600a3d20 0x7fee600a61e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fee6800b970 tx=0x7fee6800bd70 comp rx=0 tx=0).stop 2024-04-20T12:30:49.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7cd59640 1 -- 172.21.15.135:0/1915892684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee78100f90 msgr2=0x7fee78199b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7cd59640 1 --2- 172.21.15.135:0/1915892684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee78100f90 0x7fee78199b30 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fee6c00ebc0 tx=0x7fee6c00c6a0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7cd59640 1 -- 172.21.15.135:0/1915892684 shutdown_connections 2024-04-20T12:30:49.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7cd59640 1 --2- 172.21.15.135:0/1915892684 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fee600a3d20 0x7fee600a61e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7cd59640 1 --2- 172.21.15.135:0/1915892684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee78106670 0x7fee781a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7cd59640 1 --2- 172.21.15.135:0/1915892684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fee78100f90 0x7fee78199b30 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7cd59640 1 --2- 172.21.15.135:0/1915892684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fee781005d0 0x7fee781995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7cd59640 1 -- 172.21.15.135:0/1915892684 >> 172.21.15.135:0/1915892684 conn(0x7fee780773b0 msgr2=0x7fee780fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7cd59640 1 -- 172.21.15.135:0/1915892684 shutdown_connections 2024-04-20T12:30:49.452 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.442+0000 7fee7cd59640 1 -- 172.21.15.135:0/1915892684 wait complete. 2024-04-20T12:30:49.453 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:30:49.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.554+0000 7fa002b8f640 1 -- 172.21.15.135:0/2569306645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ffc1010b0 msgr2=0x7f9ffc101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.554+0000 7fa002b8f640 1 --2- 172.21.15.135:0/2569306645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ffc1010b0 0x7f9ffc101490 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009900 tx=0x7f9fec02bc30 comp rx=0 tx=0).stop 2024-04-20T12:30:49.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.554+0000 7fa002b8f640 1 -- 172.21.15.135:0/2569306645 shutdown_connections 2024-04-20T12:30:49.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.554+0000 7fa002b8f640 1 --2- 172.21.15.135:0/2569306645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ffc106180 0x7f9ffc10dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.554+0000 7fa002b8f640 1 --2- 172.21.15.135:0/2569306645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ffc101a60 0x7f9ffc105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.554+0000 7fa002b8f640 1 --2- 172.21.15.135:0/2569306645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ffc1010b0 0x7f9ffc101490 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.554+0000 7fa002b8f640 1 -- 172.21.15.135:0/2569306645 >> 172.21.15.135:0/2569306645 conn(0x7f9ffc077f80 msgr2=0x7f9ffc078390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.554+0000 7fa002b8f640 1 -- 172.21.15.135:0/2569306645 shutdown_connections 2024-04-20T12:30:49.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.554+0000 7fa002b8f640 1 -- 172.21.15.135:0/2569306645 wait complete. 2024-04-20T12:30:49.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.555+0000 7fa002b8f640 1 Processor -- start 2024-04-20T12:30:49.566 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.555+0000 7fa002b8f640 1 -- start start 2024-04-20T12:30:49.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.555+0000 7fa002b8f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ffc1010b0 0x7f9ffc199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.555+0000 7fa002b8f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ffc106180 0x7f9ffc199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.555+0000 7fa002b8f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ffc19a110 0x7f9ffc1a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.555+0000 7fa002b8f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc111210 con 0x7f9ffc19a110 2024-04-20T12:30:49.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.555+0000 7fa002b8f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc111090 con 0x7f9ffc106180 2024-04-20T12:30:49.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.555+0000 7fa002b8f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc111390 con 0x7f9ffc1010b0 2024-04-20T12:30:49.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.555+0000 7fa00112c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ffc19a110 0x7f9ffc1a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.555+0000 7fa00112c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ffc19a110 0x7f9ffc1a4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55530/0 (socket says 172.21.15.135:55530) 2024-04-20T12:30:49.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.555+0000 7fa00112c640 1 -- 172.21.15.135:0/2198653033 learned_addr learned my addr 172.21.15.135:0/2198653033 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.555+0000 7f9ffbfff640 1 --2- 172.21.15.135:0/2198653033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ffc106180 0x7f9ffc199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.555+0000 7fa00092b640 1 --2- 172.21.15.135:0/2198653033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ffc1010b0 0x7f9ffc199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.556+0000 7fa00112c640 1 -- 172.21.15.135:0/2198653033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ffc1010b0 msgr2=0x7f9ffc199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.556+0000 7fa00112c640 1 --2- 172.21.15.135:0/2198653033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ffc1010b0 0x7f9ffc199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.567 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.556+0000 7fa00112c640 1 -- 172.21.15.135:0/2198653033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ffc106180 msgr2=0x7f9ffc199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.556+0000 7fa00112c640 1 --2- 172.21.15.135:0/2198653033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ffc106180 0x7f9ffc199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.556+0000 7fa00112c640 1 -- 172.21.15.135:0/2198653033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc1a4e90 con 0x7f9ffc19a110 2024-04-20T12:30:49.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.556+0000 7fa00112c640 1 --2- 172.21.15.135:0/2198653033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ffc19a110 0x7f9ffc1a4710 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400eb10 tx=0x7f9ff400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.556+0000 7f9ff9ffb640 1 -- 172.21.15.135:0/2198653033 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4004b20 con 0x7f9ffc19a110 2024-04-20T12:30:49.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.556+0000 7fa002b8f640 1 -- 172.21.15.135:0/2198653033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ffc1a5180 con 0x7f9ffc19a110 2024-04-20T12:30:49.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.556+0000 7f9ff9ffb640 1 -- 172.21.15.135:0/2198653033 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ff4004cc0 con 0x7f9ffc19a110 2024-04-20T12:30:49.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.556+0000 7f9ff9ffb640 1 -- 172.21.15.135:0/2198653033 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4010760 con 0x7f9ffc19a110 2024-04-20T12:30:49.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.556+0000 7fa002b8f640 1 -- 172.21.15.135:0/2198653033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ffc1a5680 con 0x7f9ffc19a110 2024-04-20T12:30:49.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.558+0000 7f9ff9ffb640 1 -- 172.21.15.135:0/2198653033 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f9ff4005020 con 0x7f9ffc19a110 2024-04-20T12:30:49.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7fa00577f740 1 Processor -- start 2024-04-20T12:30:49.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7fa00577f740 1 -- start start 2024-04-20T12:30:49.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7f9ff9ffb640 1 --2- 172.21.15.135:0/2198653033 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9fe40a3d20 0x7f9fe40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7fa00577f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2ae10 0x56134bb2b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7fa00577f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2b730 0x56134bb33dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.568 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7fa00577f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 0x56134bb36700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7fa00577f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56134ba90110 con 0x56134bb2b730 2024-04-20T12:30:49.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7fa00577f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56134ba2d550 con 0x56134bb2ae10 2024-04-20T12:30:49.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7fa00577f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56134ba8c0d0 con 0x56134bb34310 2024-04-20T12:30:49.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7f9ff9ffb640 1 -- 172.21.15.135:0/2198653033 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f9ff40d10d0 con 0x7f9ffc19a110 2024-04-20T12:30:49.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7f9ffbfff640 1 --2- 172.21.15.135:0/2198653033 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9fe40a3d20 0x7f9fe40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7f9ffbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2b730 0x56134bb33dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7f9ffbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2b730 0x56134bb33dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55542/0 (socket says 172.21.15.135:55542) 2024-04-20T12:30:49.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7f9ffbfff640 1 -- 172.21.15.135:0/3490597945 learned_addr learned my addr 172.21.15.135:0/3490597945 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7fa00092b640 1 --2- 172.21.15.135:0/3490597945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2ae10 0x56134bb2b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7fa00112c640 1 --2- 172.21.15.135:0/3490597945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 0x56134bb36700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7f9ffbfff640 1 -- 172.21.15.135:0/3490597945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 msgr2=0x56134bb36700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7f9ffbfff640 1 --2- 172.21.15.135:0/3490597945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 0x56134bb36700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7f9ffbfff640 1 -- 172.21.15.135:0/3490597945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2ae10 msgr2=0x56134bb2b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7f9ffbfff640 1 --2- 172.21.15.135:0/3490597945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2ae10 0x56134bb2b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7f9ffbfff640 1 -- 172.21.15.135:0/3490597945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134ba55900 con 0x56134bb2b730 2024-04-20T12:30:49.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7f9ffbfff640 1 --2- 172.21.15.135:0/2198653033 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9fe40a3d20 0x7f9fe40a61e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0005ce0 tx=0x7f9ff000bb50 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.559+0000 7f9ffbfff640 1 --2- 172.21.15.135:0/3490597945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2b730 0x56134bb33dd0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0010740 tx=0x7f9ff001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b758972f552723 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.560+0000 7f9fe2ffd640 1 -- 172.21.15.135:0/3490597945 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0024070 con 0x56134bb2b730 2024-04-20T12:30:49.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.560+0000 7f9fe2ffd640 1 -- 172.21.15.135:0/3490597945 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ff0010e00 con 0x56134bb2b730 2024-04-20T12:30:49.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.560+0000 7f9fe2ffd640 1 -- 172.21.15.135:0/3490597945 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff00209e0 con 0x56134bb2b730 2024-04-20T12:30:49.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.560+0000 7fa00577f740 1 -- 172.21.15.135:0/3490597945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2b730 msgr2=0x56134bb33dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.560+0000 7fa00577f740 1 --2- 172.21.15.135:0/3490597945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2b730 0x56134bb33dd0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0010740 tx=0x7f9ff001c000 comp rx=0 tx=0).stop 2024-04-20T12:30:49.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.560+0000 7fa00577f740 1 -- 172.21.15.135:0/3490597945 shutdown_connections 2024-04-20T12:30:49.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.560+0000 7fa00577f740 1 --2- 172.21.15.135:0/3490597945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 0x56134bb36700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.560+0000 7fa00577f740 1 --2- 172.21.15.135:0/3490597945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2b730 0x56134bb33dd0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.560+0000 7fa00577f740 1 --2- 172.21.15.135:0/3490597945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2ae10 0x56134bb2b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.560+0000 7fa00577f740 1 -- 172.21.15.135:0/3490597945 >> 172.21.15.135:0/3490597945 conn(0x56134bb25540 msgr2=0x56134bb25920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.560+0000 7fa00577f740 1 -- 172.21.15.135:0/3490597945 shutdown_connections 2024-04-20T12:30:49.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.560+0000 7fa00577f740 1 -- 172.21.15.135:0/3490597945 wait complete. 2024-04-20T12:30:49.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00577f740 1 -- start start 2024-04-20T12:30:49.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00577f740 1 Processor -- start 2024-04-20T12:30:49.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00577f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb2ae10 0x56134bb313a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00577f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 0x56134bb318e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00577f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb34310 0x56134bb31e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00577f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56134bb37040 con 0x56134bb34310 2024-04-20T12:30:49.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00577f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56134ba49500 con 0x56134bb2b730 2024-04-20T12:30:49.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00577f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56134bb371c0 con 0x56134bb2ae10 2024-04-20T12:30:49.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00577f740 10 client.0 _ll_register_callbacks cb 0x56134ba2e2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:49.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00112c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb34310 0x56134bb31e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00112c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb34310 0x56134bb31e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55546/0 (socket says 172.21.15.135:55546) 2024-04-20T12:30:49.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00112c640 1 -- 172.21.15.135:0/1231339913 learned_addr learned my addr 172.21.15.135:0/1231339913 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7f9ffbfff640 1 --2- 172.21.15.135:0/1231339913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 0x56134bb318e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00092b640 1 --2- 172.21.15.135:0/1231339913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb2ae10 0x56134bb313a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00112c640 1 -- 172.21.15.135:0/1231339913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb2ae10 msgr2=0x56134bb313a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00112c640 1 --2- 172.21.15.135:0/1231339913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb2ae10 0x56134bb313a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00112c640 1 -- 172.21.15.135:0/1231339913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 msgr2=0x56134bb318e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.561+0000 7fa00112c640 1 --2- 172.21.15.135:0/1231339913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 0x56134bb318e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7fa00112c640 1 -- 172.21.15.135:0/1231339913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134b7a23f0 con 0x56134bb34310 2024-04-20T12:30:49.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7f9ffbfff640 1 --2- 172.21.15.135:0/1231339913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 0x56134bb318e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:49.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7fa00112c640 1 --2- 172.21.15.135:0/1231339913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb34310 0x56134bb31e20 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40049d0 tx=0x7f9ff409c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3c70b74d26d922 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7f9fdbfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:49.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7f9fdbfff640 1 -- 172.21.15.135:0/1231339913 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40bbe60 con 0x56134bb34310 2024-04-20T12:30:49.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7f9fdbfff640 1 -- 172.21.15.135:0/1231339913 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f9ff4099310 con 0x56134bb34310 2024-04-20T12:30:49.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7fa00577f740 1 -- 172.21.15.135:0/1231339913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ff0010e00 con 0x56134bb34310 2024-04-20T12:30:49.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7f9fdbfff640 1 -- 172.21.15.135:0/1231339913 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9ff40a1050 con 0x56134bb34310 2024-04-20T12:30:49.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7fa00577f740 10 client.17997 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:49.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7fa00577f740 1 -- 172.21.15.135:0/1231339913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56134b86c7d0 con 0x56134bb34310 2024-04-20T12:30:49.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7f9fdbfff640 1 -- 172.21.15.135:0/1231339913 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ff0010e00 con 0x56134bb34310 2024-04-20T12:30:49.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7f9fdbfff640 1 -- 172.21.15.135:0/1231339913 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f9ff40a5480 con 0x56134bb34310 2024-04-20T12:30:49.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7fa00577f740 10 client.17997 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:49.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7fa00577f740 10 client.17997 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:30:49.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7fa00577f740 20 client.17997 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:49.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7fa00577f740 1 --2- 172.21.15.135:0/1231339913 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56134bb446e0 0x56134bb46ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7fa00577f740 4 client.17997 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:49.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.562+0000 7fa00577f740 1 -- 172.21.15.135:0/1231339913 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56134ba9db30 con 0x56134bb446e0 2024-04-20T12:30:49.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.563+0000 7fa00092b640 1 --2- 172.21.15.135:0/1231339913 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56134bb446e0 0x56134bb46ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.563+0000 7f9fdbfff640 10 client.17997 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:30:49.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.563+0000 7fa00092b640 1 --2- 172.21.15.135:0/1231339913 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56134bb446e0 0x56134bb46ad0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=999fa6e09a8dc92a server_cookie=aeba62b66266acac in_seq=0 out_seq=0 2024-04-20T12:30:49.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.564+0000 7f9fdbfff640 1 -- 172.21.15.135:0/1231339913 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56134ba9db30 con 0x56134bb446e0 2024-04-20T12:30:49.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.564+0000 7f9fdbfff640 10 client.17997 handle_command_reply: tid=0 2024-04-20T12:30:49.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.564+0000 7fa00577f740 1 client.17997 shutdown 2024-04-20T12:30:49.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.564+0000 7fa00577f740 1 -- 172.21.15.135:0/1231339913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb34310 msgr2=0x56134bb31e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.564+0000 7fa00577f740 1 --2- 172.21.15.135:0/1231339913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb34310 0x56134bb31e20 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40049d0 tx=0x7f9ff409c8a0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.564+0000 7fa00577f740 1 -- 172.21.15.135:0/1231339913 shutdown_connections 2024-04-20T12:30:49.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.564+0000 7fa00577f740 1 --2- 172.21.15.135:0/1231339913 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56134bb446e0 0x56134bb46ad0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.564+0000 7fa00577f740 1 --2- 172.21.15.135:0/1231339913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb34310 0x56134bb31e20 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.564+0000 7fa00577f740 1 --2- 172.21.15.135:0/1231339913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 0x56134bb318e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.564+0000 7f9fdbfff640 0 client.17997 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:30:49.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.564+0000 7fa00577f740 1 --2- 172.21.15.135:0/1231339913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb2ae10 0x56134bb313a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.564+0000 7fa00577f740 1 -- 172.21.15.135:0/1231339913 >> 172.21.15.135:0/1231339913 conn(0x56134bb25540 msgr2=0x56134bb27290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.564+0000 7fa00577f740 1 -- 172.21.15.135:0/1231339913 shutdown_connections 2024-04-20T12:30:49.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.564+0000 7fa00577f740 1 -- 172.21.15.135:0/1231339913 wait complete. 2024-04-20T12:30:49.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.564+0000 7fa00577f740 20 client.17997 trim_cache size 0 max 16384 2024-04-20T12:30:49.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.577+0000 7fa00577f740 1 Processor -- start 2024-04-20T12:30:49.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.577+0000 7fa00577f740 1 -- start start 2024-04-20T12:30:49.582 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.577+0000 7fa00577f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2ae10 0x56134bb3ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.577+0000 7fa00577f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 0x56134bb31c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.577+0000 7fa00577f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 0x56134bb4c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.577+0000 7fa00577f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc1af450 con 0x56134bb2ae10 2024-04-20T12:30:49.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.577+0000 7fa00577f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc1b0f90 con 0x56134bb2b730 2024-04-20T12:30:49.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.577+0000 7fa00577f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc1afb20 con 0x56134bb34310 2024-04-20T12:30:49.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.577+0000 7fa00092b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2ae10 0x56134bb3ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.577+0000 7fa00092b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2ae10 0x56134bb3ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55562/0 (socket says 172.21.15.135:55562) 2024-04-20T12:30:49.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.577+0000 7fa00092b640 1 -- 172.21.15.135:0/3064788202 learned_addr learned my addr 172.21.15.135:0/3064788202 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.578+0000 7f9ffbfff640 1 --2- 172.21.15.135:0/3064788202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 0x56134bb31c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.578+0000 7fa00092b640 1 -- 172.21.15.135:0/3064788202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 msgr2=0x56134bb4c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.578+0000 7fa00112c640 1 --2- 172.21.15.135:0/3064788202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 0x56134bb4c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.578+0000 7fa00092b640 1 --2- 172.21.15.135:0/3064788202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 0x56134bb4c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.578+0000 7fa00092b640 1 -- 172.21.15.135:0/3064788202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 msgr2=0x56134bb31c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.583 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.578+0000 7fa00092b640 1 --2- 172.21.15.135:0/3064788202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 0x56134bb31c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.578+0000 7fa00092b640 1 -- 172.21.15.135:0/3064788202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56134bb36a70 con 0x56134bb2ae10 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.578+0000 7f9ffbfff640 1 --2- 172.21.15.135:0/3064788202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 0x56134bb31c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.578+0000 7fa00092b640 1 --2- 172.21.15.135:0/3064788202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2ae10 0x56134bb3ffb0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f9fec02c170 tx=0x7f9fec005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d71e139c93f645 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.578+0000 7f9fe27fc640 1 -- 172.21.15.135:0/3064788202 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec04b070 con 0x56134bb2ae10 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.578+0000 7f9fe27fc640 1 -- 172.21.15.135:0/3064788202 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fec02cd60 con 0x56134bb2ae10 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.578+0000 7f9fe27fc640 1 -- 172.21.15.135:0/3064788202 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec047590 con 0x56134bb2ae10 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 -- 172.21.15.135:0/3064788202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2ae10 msgr2=0x56134bb3ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 --2- 172.21.15.135:0/3064788202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2ae10 0x56134bb3ffb0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f9fec02c170 tx=0x7f9fec005dd0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 -- 172.21.15.135:0/3064788202 shutdown_connections 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 --2- 172.21.15.135:0/3064788202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 0x56134bb4c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 --2- 172.21.15.135:0/3064788202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 0x56134bb31c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 --2- 172.21.15.135:0/3064788202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2ae10 0x56134bb3ffb0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 -- 172.21.15.135:0/3064788202 >> 172.21.15.135:0/3064788202 conn(0x56134bb25540 msgr2=0x56134bb27220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 -- 172.21.15.135:0/3064788202 shutdown_connections 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 -- 172.21.15.135:0/3064788202 wait complete. 2024-04-20T12:30:49.584 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 -- start start 2024-04-20T12:30:49.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 Processor -- start 2024-04-20T12:30:49.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2ae10 0x56134bb37f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 0x56134bb38480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 0x56134bb389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc1b08c0 con 0x56134bb2ae10 2024-04-20T12:30:49.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc1b01f0 con 0x56134bb2b730 2024-04-20T12:30:49.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc1ad420 con 0x56134bb34310 2024-04-20T12:30:49.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.579+0000 7fa00577f740 10 client.0 _ll_register_callbacks cb 0x7f9ff4004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:49.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7fa00092b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2ae10 0x56134bb37f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.585 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7fa00092b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2ae10 0x56134bb37f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55564/0 (socket says 172.21.15.135:55564) 2024-04-20T12:30:49.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7fa00092b640 1 -- 172.21.15.135:0/3837347127 learned_addr learned my addr 172.21.15.135:0/3837347127 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7f9ffbfff640 1 --2- 172.21.15.135:0/3837347127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 0x56134bb38480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7fa00112c640 1 --2- 172.21.15.135:0/3837347127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 0x56134bb389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7fa00092b640 1 -- 172.21.15.135:0/3837347127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 msgr2=0x56134bb389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7fa00092b640 1 --2- 172.21.15.135:0/3837347127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 0x56134bb389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7fa00092b640 1 -- 172.21.15.135:0/3837347127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 msgr2=0x56134bb38480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7fa00092b640 1 --2- 172.21.15.135:0/3837347127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 0x56134bb38480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7fa00092b640 1 -- 172.21.15.135:0/3837347127 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56134bba9bf0 con 0x56134bb2ae10 2024-04-20T12:30:49.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7f9ffbfff640 1 --2- 172.21.15.135:0/3837347127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 0x56134bb38480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:49.586 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7fa00112c640 1 --2- 172.21.15.135:0/3837347127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 0x56134bb389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7fa00092b640 1 --2- 172.21.15.135:0/3837347127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2ae10 0x56134bb37f40 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009230 tx=0x7f9fec005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfcbe3d8c6c3a7a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7f9fdbfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7f9fdbfff640 1 -- 172.21.15.135:0/3837347127 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec054070 con 0x56134bb2ae10 2024-04-20T12:30:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7f9fdbfff640 1 -- 172.21.15.135:0/3837347127 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f9fec02ca80 con 0x56134bb2ae10 2024-04-20T12:30:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7fa00577f740 1 -- 172.21.15.135:0/3837347127 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fec02cd60 con 0x56134bb2ae10 2024-04-20T12:30:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7f9fdbfff640 1 -- 172.21.15.135:0/3837347127 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9fec05f050 con 0x56134bb2ae10 2024-04-20T12:30:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7fa00577f740 10 client.18003 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7fa00577f740 1 -- 172.21.15.135:0/3837347127 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56134bbaaef0 con 0x56134bb2ae10 2024-04-20T12:30:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.580+0000 7f9fdbfff640 1 -- 172.21.15.135:0/3837347127 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9fec02cd60 con 0x56134bb2ae10 2024-04-20T12:30:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.581+0000 7f9fdbfff640 1 -- 172.21.15.135:0/3837347127 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f9fec003680 con 0x56134bb2ae10 2024-04-20T12:30:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.581+0000 7fa00577f740 10 client.18003 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.581+0000 7fa00577f740 10 client.18003 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:30:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.581+0000 7fa00577f740 20 client.18003 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.581+0000 7fa00577f740 1 --2- 172.21.15.135:0/3837347127 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56134bbab610 0x56134bbada30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.581+0000 7fa00577f740 4 client.18003 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:30:49.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.581+0000 7fa00577f740 1 -- 172.21.15.135:0/3837347127 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56134ba979a0 con 0x56134bbab610 2024-04-20T12:30:49.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.581+0000 7f9ffbfff640 1 --2- 172.21.15.135:0/3837347127 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56134bbab610 0x56134bbada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.581+0000 7f9fdbfff640 10 client.18003 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:30:49.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.581+0000 7f9ffbfff640 1 --2- 172.21.15.135:0/3837347127 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56134bbab610 0x56134bbada30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=16cca95b51d31ffd server_cookie=402d6821c96cd58 in_seq=0 out_seq=0 2024-04-20T12:30:49.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.581+0000 7f9fdbfff640 1 -- 172.21.15.135:0/3837347127 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56134ba979a0 con 0x56134bbab610 2024-04-20T12:30:49.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.581+0000 7f9fdbfff640 10 client.18003 handle_command_reply: tid=0 2024-04-20T12:30:49.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.581+0000 7fa00577f740 1 client.18003 shutdown 2024-04-20T12:30:49.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.581+0000 7fa00577f740 1 -- 172.21.15.135:0/3837347127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2ae10 msgr2=0x56134bb37f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.581+0000 7fa00577f740 1 --2- 172.21.15.135:0/3837347127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2ae10 0x56134bb37f40 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009230 tx=0x7f9fec005fd0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.588 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa00577f740 1 -- 172.21.15.135:0/3837347127 shutdown_connections 2024-04-20T12:30:49.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa00577f740 1 --2- 172.21.15.135:0/3837347127 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x56134bbab610 0x56134bbada30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa00577f740 1 --2- 172.21.15.135:0/3837347127 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56134bb34310 0x56134bb389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa00577f740 1 --2- 172.21.15.135:0/3837347127 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56134bb2b730 0x56134bb38480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7f9fdbfff640 0 client.18003 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:30:49.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa00577f740 1 --2- 172.21.15.135:0/3837347127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56134bb2ae10 0x56134bb37f40 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa00577f740 1 -- 172.21.15.135:0/3837347127 >> 172.21.15.135:0/3837347127 conn(0x56134bb25540 msgr2=0x56134bb23e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.589 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa00577f740 1 -- 172.21.15.135:0/3837347127 shutdown_connections 2024-04-20T12:30:49.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa00577f740 1 -- 172.21.15.135:0/3837347127 wait complete. 2024-04-20T12:30:49.590 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa00577f740 20 client.18003 trim_cache size 0 max 16384 2024-04-20T12:30:49.590 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:30:49.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa002b8f640 1 -- 172.21.15.135:0/2198653033 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9fe40a3d20 msgr2=0x7f9fe40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa002b8f640 1 --2- 172.21.15.135:0/2198653033 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9fe40a3d20 0x7f9fe40a61e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0005ce0 tx=0x7f9ff000bb50 comp rx=0 tx=0).stop 2024-04-20T12:30:49.591 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa002b8f640 1 -- 172.21.15.135:0/2198653033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ffc19a110 msgr2=0x7f9ffc1a4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa002b8f640 1 --2- 172.21.15.135:0/2198653033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ffc19a110 0x7f9ffc1a4710 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f9ff400eb10 tx=0x7f9ff400c2d0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa002b8f640 1 -- 172.21.15.135:0/2198653033 shutdown_connections 2024-04-20T12:30:49.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa002b8f640 1 --2- 172.21.15.135:0/2198653033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ffc19a110 0x7f9ffc1a4710 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa002b8f640 1 --2- 172.21.15.135:0/2198653033 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9ffc106180 0x7f9ffc199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa002b8f640 1 --2- 172.21.15.135:0/2198653033 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9fe40a3d20 0x7f9fe40a61e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa002b8f640 1 --2- 172.21.15.135:0/2198653033 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9ffc1010b0 0x7f9ffc199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa002b8f640 1 -- 172.21.15.135:0/2198653033 >> 172.21.15.135:0/2198653033 conn(0x7f9ffc077f80 msgr2=0x7f9ffc0ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa002b8f640 1 -- 172.21.15.135:0/2198653033 shutdown_connections 2024-04-20T12:30:49.592 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.582+0000 7fa002b8f640 1 -- 172.21.15.135:0/2198653033 wait complete. 2024-04-20T12:30:49.593 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:30:49.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.696+0000 7f1fc7932640 1 -- 172.21.15.135:0/3755850888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fc0102b60 msgr2=0x7f1fc0106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.696+0000 7f1fc7932640 1 --2- 172.21.15.135:0/3755850888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fc0102b60 0x7f1fc0106ba0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009900 tx=0x7f1fb002bc30 comp rx=0 tx=0).stop 2024-04-20T12:30:49.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.696+0000 7f1fc7932640 1 -- 172.21.15.135:0/3755850888 shutdown_connections 2024-04-20T12:30:49.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.696+0000 7f1fc7932640 1 --2- 172.21.15.135:0/3755850888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fc0107280 0x7f1fc010ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.696+0000 7f1fc7932640 1 --2- 172.21.15.135:0/3755850888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fc0102b60 0x7f1fc0106ba0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.696+0000 7f1fc7932640 1 --2- 172.21.15.135:0/3755850888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fc01021b0 0x7f1fc0102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.696+0000 7f1fc7932640 1 -- 172.21.15.135:0/3755850888 >> 172.21.15.135:0/3755850888 conn(0x7f1fc00793f0 msgr2=0x7f1fc0079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.696+0000 7f1fc7932640 1 -- 172.21.15.135:0/3755850888 shutdown_connections 2024-04-20T12:30:49.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.696+0000 7f1fc7932640 1 -- 172.21.15.135:0/3755850888 wait complete. 2024-04-20T12:30:49.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc7932640 1 Processor -- start 2024-04-20T12:30:49.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc7932640 1 -- start start 2024-04-20T12:30:49.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc7932640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fc01021b0 0x7f1fc0074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc7932640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fc0107280 0x7f1fc00747a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc7932640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fc0074ce0 0x7f1fc01a6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc7932640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc01122f0 con 0x7f1fc01021b0 2024-04-20T12:30:49.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc7932640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc0112170 con 0x7f1fc0107280 2024-04-20T12:30:49.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc7932640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc0112470 con 0x7f1fc0074ce0 2024-04-20T12:30:49.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc56ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fc01021b0 0x7f1fc0074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc56ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fc01021b0 0x7f1fc0074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55576/0 (socket says 172.21.15.135:55576) 2024-04-20T12:30:49.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc56ce640 1 -- 172.21.15.135:0/2312680320 learned_addr learned my addr 172.21.15.135:0/2312680320 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc4ecd640 1 --2- 172.21.15.135:0/2312680320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fc0107280 0x7f1fc00747a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc56ce640 1 -- 172.21.15.135:0/2312680320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fc0074ce0 msgr2=0x7f1fc01a6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc56ce640 1 --2- 172.21.15.135:0/2312680320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fc0074ce0 0x7f1fc01a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc56ce640 1 -- 172.21.15.135:0/2312680320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fc0107280 msgr2=0x7f1fc00747a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc56ce640 1 --2- 172.21.15.135:0/2312680320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fc0107280 0x7f1fc00747a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc56ce640 1 -- 172.21.15.135:0/2312680320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc01a7060 con 0x7f1fc01021b0 2024-04-20T12:30:49.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.697+0000 7f1fc56ce640 1 --2- 172.21.15.135:0/2312680320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fc01021b0 0x7f1fc0074260 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800d950 tx=0x7f1fb800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.698+0000 7f1fb67fc640 1 -- 172.21.15.135:0/2312680320 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8017070 con 0x7f1fc01021b0 2024-04-20T12:30:49.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.698+0000 7f1fc7932640 1 -- 172.21.15.135:0/2312680320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc01a7350 con 0x7f1fc01021b0 2024-04-20T12:30:49.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.698+0000 7f1fb67fc640 1 -- 172.21.15.135:0/2312680320 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fb8009c30 con 0x7f1fc01021b0 2024-04-20T12:30:49.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.698+0000 7f1fb67fc640 1 -- 172.21.15.135:0/2312680320 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800f6b0 con 0x7f1fc01021b0 2024-04-20T12:30:49.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.698+0000 7f1fc7932640 1 -- 172.21.15.135:0/2312680320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fc01a78f0 con 0x7f1fc01021b0 2024-04-20T12:30:49.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.700+0000 7f1fb67fc640 1 -- 172.21.15.135:0/2312680320 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f1fb80109d0 con 0x7f1fc01021b0 2024-04-20T12:30:49.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.700+0000 7f1fca600740 1 Processor -- start 2024-04-20T12:30:49.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.700+0000 7f1fca600740 1 -- start start 2024-04-20T12:30:49.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.700+0000 7f1fb67fc640 1 --2- 172.21.15.135:0/2312680320 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1fac0a3d50 0x7f1fac0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.700+0000 7f1fca600740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197abe10 0x5620197ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.700+0000 7f1fca600740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197ac730 0x5620197b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.700+0000 7f1fca600740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197b5310 0x5620197b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.700+0000 7f1fca600740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562019711110 con 0x5620197ac730 2024-04-20T12:30:49.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.700+0000 7f1fca600740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5620196ae550 con 0x5620197abe10 2024-04-20T12:30:49.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.700+0000 7f1fca600740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56201970d0d0 con 0x5620197b5310 2024-04-20T12:30:49.706 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.700+0000 7f1fc5ecf640 1 --2- 172.21.15.135:0/2312680320 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1fac0a3d50 0x7f1fac0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.700+0000 7f1fb67fc640 1 -- 172.21.15.135:0/2312680320 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f1fb80d0890 con 0x7f1fc01021b0 2024-04-20T12:30:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fc4ecd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197ac730 0x5620197b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fc56ce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197abe10 0x5620197ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fc4ecd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197ac730 0x5620197b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55592/0 (socket says 172.21.15.135:55592) 2024-04-20T12:30:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fc4ecd640 1 -- 172.21.15.135:0/3614217026 learned_addr learned my addr 172.21.15.135:0/3614217026 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fc5ecf640 1 --2- 172.21.15.135:0/3614217026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197b5310 0x5620197b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fc56ce640 1 -- 172.21.15.135:0/3614217026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197b5310 msgr2=0x5620197b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fc56ce640 1 --2- 172.21.15.135:0/3614217026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197b5310 0x5620197b7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fc56ce640 1 -- 172.21.15.135:0/3614217026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197ac730 msgr2=0x5620197b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fc56ce640 1 --2- 172.21.15.135:0/3614217026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197ac730 0x5620197b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fc56ce640 1 -- 172.21.15.135:0/3614217026 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620196d6900 con 0x5620197abe10 2024-04-20T12:30:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fc4ecd640 1 --2- 172.21.15.135:0/3614217026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197ac730 0x5620197b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:30:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fc5ecf640 1 --2- 172.21.15.135:0/2312680320 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1fac0a3d50 0x7f1fac0a6210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc013450 tx=0x7f1fbc013910 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fc56ce640 1 --2- 172.21.15.135:0/3614217026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197abe10 0x5620197ac1f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80cdc10 tx=0x7f1fb8005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1517fb145e6a68b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.707 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fab7fe640 1 -- 172.21.15.135:0/3614217026 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8020040 con 0x5620197abe10 2024-04-20T12:30:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fab7fe640 1 -- 172.21.15.135:0/3614217026 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fb8009de0 con 0x5620197abe10 2024-04-20T12:30:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.701+0000 7f1fab7fe640 1 -- 172.21.15.135:0/3614217026 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb80a50d0 con 0x5620197abe10 2024-04-20T12:30:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.702+0000 7f1fca600740 1 -- 172.21.15.135:0/3614217026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197abe10 msgr2=0x5620197ac1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.702+0000 7f1fca600740 1 --2- 172.21.15.135:0/3614217026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197abe10 0x5620197ac1f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80cdc10 tx=0x7f1fb8005880 comp rx=0 tx=0).stop 2024-04-20T12:30:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.702+0000 7f1fca600740 1 -- 172.21.15.135:0/3614217026 shutdown_connections 2024-04-20T12:30:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.702+0000 7f1fca600740 1 --2- 172.21.15.135:0/3614217026 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197b5310 0x5620197b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.702+0000 7f1fca600740 1 --2- 172.21.15.135:0/3614217026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197ac730 0x5620197b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.702+0000 7f1fca600740 1 --2- 172.21.15.135:0/3614217026 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197abe10 0x5620197ac1f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.702+0000 7f1fca600740 1 -- 172.21.15.135:0/3614217026 >> 172.21.15.135:0/3614217026 conn(0x5620197a6540 msgr2=0x5620197a6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.702+0000 7f1fca600740 1 -- 172.21.15.135:0/3614217026 shutdown_connections 2024-04-20T12:30:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.702+0000 7f1fca600740 1 -- 172.21.15.135:0/3614217026 wait complete. 2024-04-20T12:30:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.702+0000 7f1fca600740 1 -- start start 2024-04-20T12:30:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.702+0000 7f1fca600740 1 Processor -- start 2024-04-20T12:30:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fca600740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197abe10 0x5620197b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fca600740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197ac730 0x5620197b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fca600740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197b5310 0x5620197b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fca600740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5620197b8040 con 0x5620197ac730 2024-04-20T12:30:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fca600740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5620196ca500 con 0x5620197b5310 2024-04-20T12:30:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fca600740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5620197b81c0 con 0x5620197abe10 2024-04-20T12:30:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fca600740 10 client.0 _ll_register_callbacks cb 0x5620196af2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fc4ecd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197ac730 0x5620197b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fc4ecd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197ac730 0x5620197b29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55602/0 (socket says 172.21.15.135:55602) 2024-04-20T12:30:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fc4ecd640 1 -- 172.21.15.135:0/2891030364 learned_addr learned my addr 172.21.15.135:0/2891030364 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fc5ecf640 1 --2- 172.21.15.135:0/2891030364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197b5310 0x5620197b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fc56ce640 1 --2- 172.21.15.135:0/2891030364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197abe10 0x5620197b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fc4ecd640 1 -- 172.21.15.135:0/2891030364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197abe10 msgr2=0x5620197b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fc4ecd640 1 --2- 172.21.15.135:0/2891030364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197abe10 0x5620197b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fc4ecd640 1 -- 172.21.15.135:0/2891030364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197b5310 msgr2=0x5620197b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fc4ecd640 1 --2- 172.21.15.135:0/2891030364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197b5310 0x5620197b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fc4ecd640 1 -- 172.21.15.135:0/2891030364 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620194233f0 con 0x5620197ac730 2024-04-20T12:30:49.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fc4ecd640 1 --2- 172.21.15.135:0/2891030364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197ac730 0x5620197b29b0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009230 tx=0x7f1fb0005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4929166bac5acf37 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.703+0000 7f1fa8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:49.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.704+0000 7f1fa8ff9640 1 -- 172.21.15.135:0/2891030364 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0005030 con 0x5620197ac730 2024-04-20T12:30:49.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.704+0000 7f1fa8ff9640 1 -- 172.21.15.135:0/2891030364 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f1fb00051d0 con 0x5620197ac730 2024-04-20T12:30:49.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.704+0000 7f1fca600740 1 -- 172.21.15.135:0/2891030364 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fb8009de0 con 0x5620197ac730 2024-04-20T12:30:49.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.704+0000 7f1fa8ff9640 1 -- 172.21.15.135:0/2891030364 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1fb004c050 con 0x5620197ac730 2024-04-20T12:30:49.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.704+0000 7f1fca600740 10 client.18015 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:49.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.704+0000 7f1fca600740 1 -- 172.21.15.135:0/2891030364 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5620194ed7d0 con 0x5620197ac730 2024-04-20T12:30:49.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.704+0000 7f1fa8ff9640 1 -- 172.21.15.135:0/2891030364 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fb8009de0 con 0x5620197ac730 2024-04-20T12:30:49.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.704+0000 7f1fa8ff9640 1 -- 172.21.15.135:0/2891030364 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f1fb00036f0 con 0x5620197ac730 2024-04-20T12:30:49.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.704+0000 7f1fca600740 10 client.18015 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:49.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.704+0000 7f1fca600740 10 client.18015 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:49.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.704+0000 7f1fca600740 20 client.18015 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:49.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.704+0000 7f1fca600740 1 --2- 172.21.15.135:0/2891030364 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5620197c56d0 0x5620197c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.704+0000 7f1fca600740 4 client.18015 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:49.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.704+0000 7f1fca600740 1 -- 172.21.15.135:0/2891030364 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56201971eb30 con 0x5620197c56d0 2024-04-20T12:30:49.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.704+0000 7f1fc56ce640 1 --2- 172.21.15.135:0/2891030364 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5620197c56d0 0x5620197c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.705+0000 7f1fa8ff9640 10 client.18015 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:49.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.705+0000 7f1fc56ce640 1 --2- 172.21.15.135:0/2891030364 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5620197c56d0 0x5620197c7b50 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29f931e0a68efabf server_cookie=1d30dbd8709fb5ad in_seq=0 out_seq=0 2024-04-20T12:30:49.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.705+0000 7f1fa8ff9640 1 -- 172.21.15.135:0/2891030364 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56201971eb30 con 0x5620197c56d0 2024-04-20T12:30:49.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.705+0000 7f1fa8ff9640 10 client.18015 handle_command_reply: tid=0 2024-04-20T12:30:49.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.706+0000 7f1fca600740 1 client.18015 shutdown 2024-04-20T12:30:49.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.706+0000 7f1fca600740 1 -- 172.21.15.135:0/2891030364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197ac730 msgr2=0x5620197b29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.706+0000 7f1fca600740 1 --2- 172.21.15.135:0/2891030364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197ac730 0x5620197b29b0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009230 tx=0x7f1fb0005e70 comp rx=0 tx=0).stop 2024-04-20T12:30:49.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.706+0000 7f1fca600740 1 -- 172.21.15.135:0/2891030364 shutdown_connections 2024-04-20T12:30:49.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.706+0000 7f1fca600740 1 --2- 172.21.15.135:0/2891030364 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5620197c56d0 0x5620197c7b50 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.706+0000 7f1fca600740 1 --2- 172.21.15.135:0/2891030364 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197b5310 0x5620197b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.706+0000 7f1fa8ff9640 0 client.18015 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:49.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.706+0000 7f1fca600740 1 --2- 172.21.15.135:0/2891030364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197ac730 0x5620197b29b0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.706+0000 7f1fca600740 1 --2- 172.21.15.135:0/2891030364 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197abe10 0x5620197b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.706+0000 7f1fca600740 1 -- 172.21.15.135:0/2891030364 >> 172.21.15.135:0/2891030364 conn(0x5620197a6540 msgr2=0x5620197a8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.706+0000 7f1fca600740 1 -- 172.21.15.135:0/2891030364 shutdown_connections 2024-04-20T12:30:49.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.706+0000 7f1fca600740 1 -- 172.21.15.135:0/2891030364 wait complete. 2024-04-20T12:30:49.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.706+0000 7f1fca600740 20 client.18015 trim_cache size 0 max 16384 2024-04-20T12:30:49.724 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fca600740 1 Processor -- start 2024-04-20T12:30:49.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fca600740 1 -- start start 2024-04-20T12:30:49.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fca600740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197abe10 0x5620197b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fca600740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197ac730 0x5620197cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fca600740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197b5310 0x5620197cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.725 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fca600740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc01b1740 con 0x5620197b5310 2024-04-20T12:30:49.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fca600740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc01b3280 con 0x5620197abe10 2024-04-20T12:30:49.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fca600740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc01b1e10 con 0x5620197ac730 2024-04-20T12:30:49.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fc5ecf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197b5310 0x5620197cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fc5ecf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197b5310 0x5620197cd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55612/0 (socket says 172.21.15.135:55612) 2024-04-20T12:30:49.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fc5ecf640 1 -- 172.21.15.135:0/3432925118 learned_addr learned my addr 172.21.15.135:0/3432925118 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fc4ecd640 1 --2- 172.21.15.135:0/3432925118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197ac730 0x5620197cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fc5ecf640 1 -- 172.21.15.135:0/3432925118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197ac730 msgr2=0x5620197cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fc5ecf640 1 --2- 172.21.15.135:0/3432925118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197ac730 0x5620197cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fc5ecf640 1 -- 172.21.15.135:0/3432925118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197abe10 msgr2=0x5620197b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fc56ce640 1 --2- 172.21.15.135:0/3432925118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197abe10 0x5620197b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fc5ecf640 1 --2- 172.21.15.135:0/3432925118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197abe10 0x5620197b4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fc5ecf640 1 -- 172.21.15.135:0/3432925118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620197a6070 con 0x5620197b5310 2024-04-20T12:30:49.726 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.719+0000 7f1fc4ecd640 1 --2- 172.21.15.135:0/3432925118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197ac730 0x5620197cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:49.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.720+0000 7f1fc5ecf640 1 --2- 172.21.15.135:0/3432925118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197b5310 0x5620197cd960 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc010620 tx=0x7f1fbc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2f6daf76db8de server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.720+0000 7f1faaffd640 1 -- 172.21.15.135:0/3432925118 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc004d20 con 0x5620197b5310 2024-04-20T12:30:49.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.720+0000 7f1faaffd640 1 -- 172.21.15.135:0/3432925118 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fbc003e50 con 0x5620197b5310 2024-04-20T12:30:49.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.720+0000 7f1faaffd640 1 -- 172.21.15.135:0/3432925118 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc004280 con 0x5620197b5310 2024-04-20T12:30:49.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.720+0000 7f1fca600740 1 -- 172.21.15.135:0/3432925118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197b5310 msgr2=0x5620197cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.720+0000 7f1fca600740 1 --2- 172.21.15.135:0/3432925118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197b5310 0x5620197cd960 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc010620 tx=0x7f1fbc016000 comp rx=0 tx=0).stop 2024-04-20T12:30:49.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.720+0000 7f1fca600740 1 -- 172.21.15.135:0/3432925118 shutdown_connections 2024-04-20T12:30:49.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.720+0000 7f1fca600740 1 --2- 172.21.15.135:0/3432925118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197b5310 0x5620197cd960 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.720+0000 7f1fca600740 1 --2- 172.21.15.135:0/3432925118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197ac730 0x5620197cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.720+0000 7f1fca600740 1 --2- 172.21.15.135:0/3432925118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197abe10 0x5620197b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.720+0000 7f1fca600740 1 -- 172.21.15.135:0/3432925118 >> 172.21.15.135:0/3432925118 conn(0x5620197a6540 msgr2=0x5620197a56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.720+0000 7f1fca600740 1 -- 172.21.15.135:0/3432925118 shutdown_connections 2024-04-20T12:30:49.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.720+0000 7f1fca600740 1 -- 172.21.15.135:0/3432925118 wait complete. 2024-04-20T12:30:49.727 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fca600740 1 -- start start 2024-04-20T12:30:49.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fca600740 1 Processor -- start 2024-04-20T12:30:49.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fca600740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197abe10 0x5620197af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fca600740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197ac730 0x5620197af920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fca600740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197b5310 0x5620197afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fca600740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc01b2bb0 con 0x5620197abe10 2024-04-20T12:30:49.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fca600740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc01b24e0 con 0x5620197b5310 2024-04-20T12:30:49.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fca600740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1fc01af710 con 0x5620197ac730 2024-04-20T12:30:49.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fca600740 10 client.0 _ll_register_callbacks cb 0x7f1fb0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:49.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fc56ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197abe10 0x5620197af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fc56ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197abe10 0x5620197af3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55620/0 (socket says 172.21.15.135:55620) 2024-04-20T12:30:49.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fc56ce640 1 -- 172.21.15.135:0/3272190902 learned_addr learned my addr 172.21.15.135:0/3272190902 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:49.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fc5ecf640 1 --2- 172.21.15.135:0/3272190902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197b5310 0x5620197afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fc4ecd640 1 --2- 172.21.15.135:0/3272190902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197ac730 0x5620197af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fc56ce640 1 -- 172.21.15.135:0/3272190902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197ac730 msgr2=0x5620197af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fc56ce640 1 --2- 172.21.15.135:0/3272190902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197ac730 0x5620197af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fc56ce640 1 -- 172.21.15.135:0/3272190902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197b5310 msgr2=0x5620197afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:49.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fc56ce640 1 --2- 172.21.15.135:0/3272190902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197b5310 0x5620197afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fc56ce640 1 -- 172.21.15.135:0/3272190902 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56201982af30 con 0x5620197abe10 2024-04-20T12:30:49.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.721+0000 7f1fc5ecf640 1 --2- 172.21.15.135:0/3272190902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197b5310 0x5620197afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:49.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fc56ce640 1 --2- 172.21.15.135:0/3272190902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197abe10 0x5620197af3e0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80988c0 tx=0x7f1fb809c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43673d3d50671dc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:49.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fa8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:49.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fa8ff9640 1 -- 172.21.15.135:0/3272190902 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8020040 con 0x5620197abe10 2024-04-20T12:30:49.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fa8ff9640 1 -- 172.21.15.135:0/3272190902 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f1fb8098ad0 con 0x5620197abe10 2024-04-20T12:30:49.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fca600740 1 -- 172.21.15.135:0/3272190902 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fbc003e50 con 0x5620197abe10 2024-04-20T12:30:49.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fa8ff9640 1 -- 172.21.15.135:0/3272190902 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1fb809c460 con 0x5620197abe10 2024-04-20T12:30:49.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fca600740 10 client.18021 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:49.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fca600740 1 -- 172.21.15.135:0/3272190902 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56201982c200 con 0x5620197abe10 2024-04-20T12:30:49.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fa8ff9640 1 -- 172.21.15.135:0/3272190902 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fbc003e50 con 0x5620197abe10 2024-04-20T12:30:49.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fa8ff9640 1 -- 172.21.15.135:0/3272190902 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f1fb80cdf20 con 0x5620197abe10 2024-04-20T12:30:49.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fca600740 10 client.18021 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:49.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fca600740 10 client.18021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:49.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fca600740 20 client.18021 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:49.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fca600740 1 --2- 172.21.15.135:0/3272190902 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56201982c540 0x56201982e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:49.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fca600740 4 client.18021 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:30:49.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fca600740 1 -- 172.21.15.135:0/3272190902 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5620197189a0 con 0x56201982c540 2024-04-20T12:30:49.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.722+0000 7f1fc4ecd640 1 --2- 172.21.15.135:0/3272190902 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56201982c540 0x56201982e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:49.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fa8ff9640 10 client.18021 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:49.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fc4ecd640 1 --2- 172.21.15.135:0/3272190902 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56201982c540 0x56201982e930 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e73e12a39b94dae server_cookie=f04daf12370e99d4 in_seq=0 out_seq=0 2024-04-20T12:30:49.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fa8ff9640 1 -- 172.21.15.135:0/3272190902 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5620197189a0 con 0x56201982c540 2024-04-20T12:30:49.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fa8ff9640 10 client.18021 handle_command_reply: tid=0 2024-04-20T12:30:49.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fca600740 1 client.18021 shutdown 2024-04-20T12:30:49.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fca600740 1 -- 172.21.15.135:0/3272190902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197abe10 msgr2=0x5620197af3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fca600740 1 --2- 172.21.15.135:0/3272190902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197abe10 0x5620197af3e0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80988c0 tx=0x7f1fb809c360 comp rx=0 tx=0).stop 2024-04-20T12:30:49.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fca600740 1 -- 172.21.15.135:0/3272190902 shutdown_connections 2024-04-20T12:30:49.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fca600740 1 --2- 172.21.15.135:0/3272190902 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56201982c540 0x56201982e930 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fca600740 1 --2- 172.21.15.135:0/3272190902 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5620197b5310 0x5620197afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fca600740 1 --2- 172.21.15.135:0/3272190902 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5620197ac730 0x5620197af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fa8ff9640 0 client.18021 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:49.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fca600740 1 --2- 172.21.15.135:0/3272190902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620197abe10 0x5620197af3e0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fca600740 1 -- 172.21.15.135:0/3272190902 >> 172.21.15.135:0/3272190902 conn(0x5620197a6540 msgr2=0x5620197a7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fca600740 1 -- 172.21.15.135:0/3272190902 shutdown_connections 2024-04-20T12:30:49.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fca600740 1 -- 172.21.15.135:0/3272190902 wait complete. 2024-04-20T12:30:49.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.723+0000 7f1fca600740 20 client.18021 trim_cache size 0 max 16384 2024-04-20T12:30:49.732 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:30:49.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.724+0000 7f1fc7932640 1 -- 172.21.15.135:0/2312680320 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1fac0a3d50 msgr2=0x7f1fac0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.724+0000 7f1fc7932640 1 --2- 172.21.15.135:0/2312680320 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1fac0a3d50 0x7f1fac0a6210 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc013450 tx=0x7f1fbc013910 comp rx=0 tx=0).stop 2024-04-20T12:30:49.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.724+0000 7f1fc7932640 1 -- 172.21.15.135:0/2312680320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fc01021b0 msgr2=0x7f1fc0074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:49.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.724+0000 7f1fc7932640 1 --2- 172.21.15.135:0/2312680320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fc01021b0 0x7f1fc0074260 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800d950 tx=0x7f1fb800de10 comp rx=0 tx=0).stop 2024-04-20T12:30:49.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.724+0000 7f1fc7932640 1 -- 172.21.15.135:0/2312680320 shutdown_connections 2024-04-20T12:30:49.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.724+0000 7f1fc7932640 1 --2- 172.21.15.135:0/2312680320 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f1fac0a3d50 0x7f1fac0a6210 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.724+0000 7f1fc7932640 1 --2- 172.21.15.135:0/2312680320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1fc0074ce0 0x7f1fc01a6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.724+0000 7f1fc7932640 1 --2- 172.21.15.135:0/2312680320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f1fc0107280 0x7f1fc00747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.724+0000 7f1fc7932640 1 --2- 172.21.15.135:0/2312680320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fc01021b0 0x7f1fc0074260 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:49.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.724+0000 7f1fc7932640 1 -- 172.21.15.135:0/2312680320 >> 172.21.15.135:0/2312680320 conn(0x7f1fc00793f0 msgr2=0x7f1fc00ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:49.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.724+0000 7f1fc7932640 1 -- 172.21.15.135:0/2312680320 shutdown_connections 2024-04-20T12:30:49.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:49.724+0000 7f1fc7932640 1 -- 172.21.15.135:0/2312680320 wait complete. 2024-04-20T12:30:50.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:49 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/515156203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:30:50.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:49 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/515156203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:30:50.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:49 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/515156203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:30:50.736 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:30:50.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:30:50.736 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:30:50.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.852+0000 7f036ded2640 1 -- 172.21.15.135:0/2137712752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f036806b180 msgr2=0x7f0368106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:50.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.852+0000 7f036ded2640 1 --2- 172.21.15.135:0/2137712752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f036806b180 0x7f0368106bb0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f035c009900 tx=0x7f035c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:30:50.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.852+0000 7f036ded2640 1 -- 172.21.15.135:0/2137712752 shutdown_connections 2024-04-20T12:30:50.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.852+0000 7f036ded2640 1 --2- 172.21.15.135:0/2137712752 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0368107290 0x7f036810ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.852+0000 7f036ded2640 1 --2- 172.21.15.135:0/2137712752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f036806b180 0x7f0368106bb0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.852+0000 7f036ded2640 1 --2- 172.21.15.135:0/2137712752 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f036806a7d0 0x7f036806abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.852+0000 7f036ded2640 1 -- 172.21.15.135:0/2137712752 >> 172.21.15.135:0/2137712752 conn(0x7f0368076c60 msgr2=0x7f0368077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:50.853 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.852+0000 7f036ded2640 1 -- 172.21.15.135:0/2137712752 shutdown_connections 2024-04-20T12:30:50.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.852+0000 7f036ded2640 1 -- 172.21.15.135:0/2137712752 wait complete. 2024-04-20T12:30:50.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.853+0000 7f036ded2640 1 Processor -- start 2024-04-20T12:30:50.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.853+0000 7f036ded2640 1 -- start start 2024-04-20T12:30:50.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.853+0000 7f036ded2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f036806a7d0 0x7f0368198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.853+0000 7f036ded2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0368107290 0x7f0368198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.853+0000 7f036ded2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f036819cfc0 0x7f036819d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.853+0000 7f036ded2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03681122e0 con 0x7f0368107290 2024-04-20T12:30:50.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.853+0000 7f036ded2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0368112160 con 0x7f036819cfc0 2024-04-20T12:30:50.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.853+0000 7f036ded2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0368112460 con 0x7f036806a7d0 2024-04-20T12:30:50.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.853+0000 7f0366ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0368107290 0x7f0368198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.853+0000 7f0366ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0368107290 0x7f0368198c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57328/0 (socket says 172.21.15.135:57328) 2024-04-20T12:30:50.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.853+0000 7f0366ffd640 1 -- 172.21.15.135:0/2580758304 learned_addr learned my addr 172.21.15.135:0/2580758304 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:50.854 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.853+0000 7f03677fe640 1 --2- 172.21.15.135:0/2580758304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f036806a7d0 0x7f0368198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.853+0000 7f0366ffd640 1 -- 172.21.15.135:0/2580758304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f036806a7d0 msgr2=0x7f0368198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:50.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.854+0000 7f0367fff640 1 --2- 172.21.15.135:0/2580758304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f036819cfc0 0x7f036819d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.854+0000 7f0366ffd640 1 --2- 172.21.15.135:0/2580758304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f036806a7d0 0x7f0368198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.854+0000 7f0366ffd640 1 -- 172.21.15.135:0/2580758304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f036819cfc0 msgr2=0x7f036819d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:50.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.854+0000 7f0366ffd640 1 --2- 172.21.15.135:0/2580758304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f036819cfc0 0x7f036819d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.854+0000 7f0366ffd640 1 -- 172.21.15.135:0/2580758304 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036819dab0 con 0x7f0368107290 2024-04-20T12:30:50.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.854+0000 7f0366ffd640 1 --2- 172.21.15.135:0/2580758304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0368107290 0x7f0368198c40 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f035c000c00 tx=0x7f035c02cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:50.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.854+0000 7f0364ff9640 1 -- 172.21.15.135:0/2580758304 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c041070 con 0x7f0368107290 2024-04-20T12:30:50.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.854+0000 7f0364ff9640 1 -- 172.21.15.135:0/2580758304 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f035c004450 con 0x7f0368107290 2024-04-20T12:30:50.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.854+0000 7f036ded2640 1 -- 172.21.15.135:0/2580758304 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f036819dd40 con 0x7f0368107290 2024-04-20T12:30:50.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.854+0000 7f0364ff9640 1 -- 172.21.15.135:0/2580758304 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c034440 con 0x7f0368107290 2024-04-20T12:30:50.855 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.854+0000 7f036ded2640 1 -- 172.21.15.135:0/2580758304 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03681a5500 con 0x7f0368107290 2024-04-20T12:30:50.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.857+0000 7f0364ff9640 1 -- 172.21.15.135:0/2580758304 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f035c044070 con 0x7f0368107290 2024-04-20T12:30:50.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.857+0000 7f0370ba2740 1 Processor -- start 2024-04-20T12:30:50.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.857+0000 7f0370ba2740 1 -- start start 2024-04-20T12:30:50.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.857+0000 7f0370ba2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d5591fe0 0x5638d55923c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.857+0000 7f0370ba2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d5592900 0x5638d559afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.857+0000 7f0370ba2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d559b4e0 0x5638d559d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.857+0000 7f0370ba2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5638d54f6f00 con 0x5638d559b4e0 2024-04-20T12:30:50.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.857+0000 7f0370ba2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5638d5494530 con 0x5638d5592900 2024-04-20T12:30:50.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.857+0000 7f0370ba2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5638d54f2ec0 con 0x5638d5591fe0 2024-04-20T12:30:50.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.857+0000 7f0366ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d559b4e0 0x5638d559d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.857+0000 7f0366ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d559b4e0 0x5638d559d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57342/0 (socket says 172.21.15.135:57342) 2024-04-20T12:30:50.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.857+0000 7f0366ffd640 1 -- 172.21.15.135:0/3137843692 learned_addr learned my addr 172.21.15.135:0/3137843692 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:50.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.857+0000 7f03677fe640 1 --2- 172.21.15.135:0/3137843692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d5592900 0x5638d559afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.858+0000 7f0367fff640 1 --2- 172.21.15.135:0/3137843692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d5591fe0 0x5638d55923c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.858+0000 7f0364ff9640 1 --2- 172.21.15.135:0/2580758304 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f03500a3d20 0x7f03500a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.858+0000 7f0366ffd640 1 -- 172.21.15.135:0/3137843692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d5591fe0 msgr2=0x5638d55923c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:50.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.858+0000 7f0366ffd640 1 --2- 172.21.15.135:0/3137843692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d5591fe0 0x5638d55923c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.858+0000 7f0366ffd640 1 -- 172.21.15.135:0/3137843692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d5592900 msgr2=0x5638d559afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:50.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.858+0000 7f0366ffd640 1 --2- 172.21.15.135:0/3137843692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d5592900 0x5638d559afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.858+0000 7f0366ffd640 1 -- 172.21.15.135:0/3137843692 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d52d17e0 con 0x5638d559b4e0 2024-04-20T12:30:50.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.858+0000 7f0367fff640 1 --2- 172.21.15.135:0/3137843692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d5591fe0 0x5638d55923c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:50.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.858+0000 7f0367fff640 1 --2- 172.21.15.135:0/2580758304 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f03500a3d20 0x7f03500a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.858+0000 7f0364ff9640 1 -- 172.21.15.135:0/2580758304 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f035c0f2850 con 0x7f0368107290 2024-04-20T12:30:50.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.858+0000 7f0366ffd640 1 --2- 172.21.15.135:0/3137843692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d559b4e0 0x5638d559d8d0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f035c0efc20 tx=0x7f035c04d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce2fc66c0cb0a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:50.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.858+0000 7f0367fff640 1 --2- 172.21.15.135:0/2580758304 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f03500a3d20 0x7f03500a61e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f036000bdc0 tx=0x7f0360004a40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:50.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.858+0000 7f034dffb640 1 -- 172.21.15.135:0/3137843692 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c0be070 con 0x5638d559b4e0 2024-04-20T12:30:50.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.858+0000 7f034dffb640 1 -- 172.21.15.135:0/3137843692 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f035c0399a0 con 0x5638d559b4e0 2024-04-20T12:30:50.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.858+0000 7f034dffb640 1 -- 172.21.15.135:0/3137843692 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c039b90 con 0x5638d559b4e0 2024-04-20T12:30:50.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.859+0000 7f0370ba2740 1 -- 172.21.15.135:0/3137843692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d559b4e0 msgr2=0x5638d559d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:50.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.859+0000 7f0370ba2740 1 --2- 172.21.15.135:0/3137843692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d559b4e0 0x5638d559d8d0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f035c0efc20 tx=0x7f035c04d000 comp rx=0 tx=0).stop 2024-04-20T12:30:50.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.859+0000 7f0370ba2740 1 -- 172.21.15.135:0/3137843692 shutdown_connections 2024-04-20T12:30:50.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.859+0000 7f0370ba2740 1 --2- 172.21.15.135:0/3137843692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d559b4e0 0x5638d559d8d0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.859+0000 7f0370ba2740 1 --2- 172.21.15.135:0/3137843692 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d5592900 0x5638d559afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.859+0000 7f0370ba2740 1 --2- 172.21.15.135:0/3137843692 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d5591fe0 0x5638d55923c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.864 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.859+0000 7f0370ba2740 1 -- 172.21.15.135:0/3137843692 >> 172.21.15.135:0/3137843692 conn(0x5638d558c710 msgr2=0x5638d558caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:50.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.859+0000 7f0370ba2740 1 -- 172.21.15.135:0/3137843692 shutdown_connections 2024-04-20T12:30:50.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.859+0000 7f0370ba2740 1 -- 172.21.15.135:0/3137843692 wait complete. 2024-04-20T12:30:50.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.859+0000 7f0370ba2740 1 -- start start 2024-04-20T12:30:50.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f0370ba2740 1 Processor -- start 2024-04-20T12:30:50.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f0370ba2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5591fe0 0x5638d559ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f0370ba2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d5592900 0x5638d55981f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f0370ba2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d559b4e0 0x5638d5598770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f0370ba2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5638d559e090 con 0x5638d5591fe0 2024-04-20T12:30:50.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f0370ba2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5638d547f480 con 0x5638d559b4e0 2024-04-20T12:30:50.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f0370ba2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5638d559e210 con 0x5638d5592900 2024-04-20T12:30:50.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f0370ba2740 10 client.0 _ll_register_callbacks cb 0x5638d547ee70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:50.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f03677fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5591fe0 0x5638d559ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f03677fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5591fe0 0x5638d559ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57352/0 (socket says 172.21.15.135:57352) 2024-04-20T12:30:50.865 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f03677fe640 1 -- 172.21.15.135:0/4013413549 learned_addr learned my addr 172.21.15.135:0/4013413549 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:50.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f0367fff640 1 --2- 172.21.15.135:0/4013413549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d559b4e0 0x5638d5598770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f03677fe640 1 -- 172.21.15.135:0/4013413549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d5592900 msgr2=0x5638d55981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:50.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f03677fe640 1 --2- 172.21.15.135:0/4013413549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d5592900 0x5638d55981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f03677fe640 1 -- 172.21.15.135:0/4013413549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d559b4e0 msgr2=0x5638d5598770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:50.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f03677fe640 1 --2- 172.21.15.135:0/4013413549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d559b4e0 0x5638d5598770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f03677fe640 1 -- 172.21.15.135:0/4013413549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d5331f70 con 0x5638d5591fe0 2024-04-20T12:30:50.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f0367fff640 1 --2- 172.21.15.135:0/4013413549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d559b4e0 0x5638d5598770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:50.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f03677fe640 1 --2- 172.21.15.135:0/4013413549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5591fe0 0x5638d559ae60 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f0358010820 tx=0x7f0358010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd7c9f2ecbb1ce0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:50.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f0346ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:50.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f0346ffd640 1 -- 172.21.15.135:0/4013413549 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035801d060 con 0x5638d5591fe0 2024-04-20T12:30:50.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.860+0000 7f0346ffd640 1 -- 172.21.15.135:0/4013413549 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f035800eda0 con 0x5638d5591fe0 2024-04-20T12:30:50.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.861+0000 7f0370ba2740 1 -- 172.21.15.135:0/4013413549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5638d5504920 con 0x5638d5591fe0 2024-04-20T12:30:50.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.861+0000 7f0346ffd640 1 -- 172.21.15.135:0/4013413549 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0358024050 con 0x5638d5591fe0 2024-04-20T12:30:50.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.861+0000 7f0370ba2740 10 client.18033 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:50.866 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.861+0000 7f0370ba2740 1 -- 172.21.15.135:0/4013413549 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5638d51c9170 con 0x5638d5591fe0 2024-04-20T12:30:50.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.861+0000 7f0346ffd640 1 -- 172.21.15.135:0/4013413549 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5638d5504920 con 0x5638d5591fe0 2024-04-20T12:30:50.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.861+0000 7f0346ffd640 1 -- 172.21.15.135:0/4013413549 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f035800d550 con 0x5638d5591fe0 2024-04-20T12:30:50.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.861+0000 7f0370ba2740 10 client.18033 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:50.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.861+0000 7f0370ba2740 10 client.18033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:50.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.861+0000 7f0370ba2740 20 client.18033 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:50.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.861+0000 7f0370ba2740 1 --2- 172.21.15.135:0/4013413549 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5638d55ab1d0 0x5638d55ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.861+0000 7f0370ba2740 4 client.18033 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:50.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.861+0000 7f0370ba2740 1 -- 172.21.15.135:0/4013413549 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638d54fe790 con 0x5638d55ab1d0 2024-04-20T12:30:50.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.861+0000 7f0366ffd640 1 --2- 172.21.15.135:0/4013413549 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5638d55ab1d0 0x5638d55ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.862+0000 7f0346ffd640 10 client.18033 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:50.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.862+0000 7f0366ffd640 1 --2- 172.21.15.135:0/4013413549 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5638d55ab1d0 0x5638d55ad690 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ede9df5872e89f42 server_cookie=12dccbcdf01da88c in_seq=0 out_seq=0 2024-04-20T12:30:50.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.862+0000 7f0346ffd640 1 -- 172.21.15.135:0/4013413549 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5638d54fe790 con 0x5638d55ab1d0 2024-04-20T12:30:50.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.862+0000 7f0346ffd640 10 client.18033 handle_command_reply: tid=0 2024-04-20T12:30:50.867 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.862+0000 7f0370ba2740 1 client.18033 shutdown 2024-04-20T12:30:50.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.863+0000 7f0370ba2740 1 -- 172.21.15.135:0/4013413549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5591fe0 msgr2=0x5638d559ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:50.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.863+0000 7f0370ba2740 1 --2- 172.21.15.135:0/4013413549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5591fe0 0x5638d559ae60 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f0358010820 tx=0x7f0358010ce0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.863+0000 7f0370ba2740 1 -- 172.21.15.135:0/4013413549 shutdown_connections 2024-04-20T12:30:50.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.863+0000 7f0370ba2740 1 --2- 172.21.15.135:0/4013413549 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5638d55ab1d0 0x5638d55ad690 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.863+0000 7f0370ba2740 1 --2- 172.21.15.135:0/4013413549 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d559b4e0 0x5638d5598770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.863+0000 7f0370ba2740 1 --2- 172.21.15.135:0/4013413549 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d5592900 0x5638d55981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.863+0000 7f0346ffd640 0 client.18033 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:50.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.863+0000 7f0370ba2740 1 --2- 172.21.15.135:0/4013413549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5591fe0 0x5638d559ae60 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.863+0000 7f0370ba2740 1 -- 172.21.15.135:0/4013413549 >> 172.21.15.135:0/4013413549 conn(0x5638d558c710 msgr2=0x5638d558e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:50.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.863+0000 7f0370ba2740 1 -- 172.21.15.135:0/4013413549 shutdown_connections 2024-04-20T12:30:50.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.863+0000 7f0370ba2740 1 -- 172.21.15.135:0/4013413549 wait complete. 2024-04-20T12:30:50.868 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.863+0000 7f0370ba2740 20 client.18033 trim_cache size 0 max 16384 2024-04-20T12:30:50.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0370ba2740 1 Processor -- start 2024-04-20T12:30:50.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0370ba2740 1 -- start start 2024-04-20T12:30:50.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0370ba2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d5591fe0 0x5638d559a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0370ba2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5592900 0x5638d559ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0370ba2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d559b4e0 0x5638d55b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0370ba2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03681af340 con 0x5638d5592900 2024-04-20T12:30:50.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0370ba2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f03681b0e80 con 0x5638d5591fe0 2024-04-20T12:30:50.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0370ba2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f03681afa10 con 0x5638d559b4e0 2024-04-20T12:30:50.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0366ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5592900 0x5638d559ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.886 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0366ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5592900 0x5638d559ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57362/0 (socket says 172.21.15.135:57362) 2024-04-20T12:30:50.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0366ffd640 1 -- 172.21.15.135:0/1608925246 learned_addr learned my addr 172.21.15.135:0/1608925246 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:50.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f03677fe640 1 --2- 172.21.15.135:0/1608925246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d5591fe0 0x5638d559a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0366ffd640 1 -- 172.21.15.135:0/1608925246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d559b4e0 msgr2=0x5638d55b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:50.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0366ffd640 1 --2- 172.21.15.135:0/1608925246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d559b4e0 0x5638d55b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0366ffd640 1 -- 172.21.15.135:0/1608925246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d5591fe0 msgr2=0x5638d559a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:50.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0366ffd640 1 --2- 172.21.15.135:0/1608925246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d5591fe0 0x5638d559a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0366ffd640 1 -- 172.21.15.135:0/1608925246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d5592730 con 0x5638d5592900 2024-04-20T12:30:50.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f03677fe640 1 --2- 172.21.15.135:0/1608925246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d5591fe0 0x5638d559a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:50.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f0366ffd640 1 --2- 172.21.15.135:0/1608925246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5592900 0x5638d559ae60 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f035c04c000 tx=0x7f035c0f8610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b7ec65232229dbd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:50.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.883+0000 7f034d7fa640 1 -- 172.21.15.135:0/1608925246 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c0bde90 con 0x5638d5592900 2024-04-20T12:30:50.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.884+0000 7f034d7fa640 1 -- 172.21.15.135:0/1608925246 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f035c0bec30 con 0x5638d5592900 2024-04-20T12:30:50.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.884+0000 7f034d7fa640 1 -- 172.21.15.135:0/1608925246 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035c0c71a0 con 0x5638d5592900 2024-04-20T12:30:50.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.884+0000 7f0370ba2740 1 -- 172.21.15.135:0/1608925246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5592900 msgr2=0x5638d559ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:50.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.884+0000 7f0370ba2740 1 --2- 172.21.15.135:0/1608925246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5592900 0x5638d559ae60 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f035c04c000 tx=0x7f035c0f8610 comp rx=0 tx=0).stop 2024-04-20T12:30:50.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.884+0000 7f0370ba2740 1 -- 172.21.15.135:0/1608925246 shutdown_connections 2024-04-20T12:30:50.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.884+0000 7f0370ba2740 1 --2- 172.21.15.135:0/1608925246 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d559b4e0 0x5638d55b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.884+0000 7f0370ba2740 1 --2- 172.21.15.135:0/1608925246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5592900 0x5638d559ae60 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.884+0000 7f0370ba2740 1 --2- 172.21.15.135:0/1608925246 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d5591fe0 0x5638d559a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.884+0000 7f0370ba2740 1 -- 172.21.15.135:0/1608925246 >> 172.21.15.135:0/1608925246 conn(0x5638d558c710 msgr2=0x5638d558b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:50.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.884+0000 7f0370ba2740 1 -- 172.21.15.135:0/1608925246 shutdown_connections 2024-04-20T12:30:50.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.884+0000 7f0370ba2740 1 -- 172.21.15.135:0/1608925246 wait complete. 2024-04-20T12:30:50.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f0370ba2740 1 -- start start 2024-04-20T12:30:50.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f0370ba2740 1 Processor -- start 2024-04-20T12:30:50.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f0370ba2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5591fe0 0x5638d55955f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f0370ba2740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d5592900 0x5638d5595b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f0370ba2740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d559b4e0 0x5638d5610820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f0370ba2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03681b07b0 con 0x5638d5591fe0 2024-04-20T12:30:50.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f0370ba2740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f03681b00e0 con 0x5638d559b4e0 2024-04-20T12:30:50.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f0370ba2740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f03681ad310 con 0x5638d5592900 2024-04-20T12:30:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f0370ba2740 10 client.0 _ll_register_callbacks cb 0x7f0358010430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f03677fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5591fe0 0x5638d55955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f03677fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5591fe0 0x5638d55955f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57370/0 (socket says 172.21.15.135:57370) 2024-04-20T12:30:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f03677fe640 1 -- 172.21.15.135:0/720480496 learned_addr learned my addr 172.21.15.135:0/720480496 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f0367fff640 1 --2- 172.21.15.135:0/720480496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d559b4e0 0x5638d5610820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f0366ffd640 1 --2- 172.21.15.135:0/720480496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d5592900 0x5638d5595b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f03677fe640 1 -- 172.21.15.135:0/720480496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d5592900 msgr2=0x5638d5595b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f03677fe640 1 --2- 172.21.15.135:0/720480496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d5592900 0x5638d5595b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f03677fe640 1 -- 172.21.15.135:0/720480496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d559b4e0 msgr2=0x5638d5610820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f03677fe640 1 --2- 172.21.15.135:0/720480496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d559b4e0 0x5638d5610820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f03677fe640 1 -- 172.21.15.135:0/720480496 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d5610d60 con 0x5638d5591fe0 2024-04-20T12:30:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.885+0000 7f0367fff640 1 --2- 172.21.15.135:0/720480496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d559b4e0 0x5638d5610820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:30:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f03677fe640 1 --2- 172.21.15.135:0/720480496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5591fe0 0x5638d55955f0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f035800d920 tx=0x7f0358005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c96bddbc6f3708 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:50.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0346ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:50.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0346ffd640 1 -- 172.21.15.135:0/720480496 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035800eda0 con 0x5638d5591fe0 2024-04-20T12:30:50.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0346ffd640 1 -- 172.21.15.135:0/720480496 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f035800d3a0 con 0x5638d5591fe0 2024-04-20T12:30:50.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0370ba2740 1 -- 172.21.15.135:0/720480496 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f035c0bec30 con 0x5638d5591fe0 2024-04-20T12:30:50.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0346ffd640 1 -- 172.21.15.135:0/720480496 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0358038050 con 0x5638d5591fe0 2024-04-20T12:30:50.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0370ba2740 10 client.18039 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:50.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0370ba2740 1 -- 172.21.15.135:0/720480496 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5638d5612040 con 0x5638d5591fe0 2024-04-20T12:30:50.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0346ffd640 1 -- 172.21.15.135:0/720480496 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f035c0bec30 con 0x5638d5591fe0 2024-04-20T12:30:50.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0346ffd640 1 -- 172.21.15.135:0/720480496 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f0358004760 con 0x5638d5591fe0 2024-04-20T12:30:50.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0370ba2740 10 client.18039 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:50.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0370ba2740 10 client.18039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:50.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0370ba2740 20 client.18039 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:50.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0370ba2740 1 --2- 172.21.15.135:0/720480496 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5638d5612790 0x5638d5614bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:50.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0370ba2740 4 client.18039 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:30:50.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0370ba2740 1 -- 172.21.15.135:0/720480496 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5638d547ac50 con 0x5638d5612790 2024-04-20T12:30:50.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.886+0000 7f0366ffd640 1 --2- 172.21.15.135:0/720480496 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5638d5612790 0x5638d5614bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:50.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.887+0000 7f0346ffd640 10 client.18039 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:50.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.887+0000 7f0366ffd640 1 --2- 172.21.15.135:0/720480496 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5638d5612790 0x5638d5614bb0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aacdf72045018ba4 server_cookie=44f5aa072506085b in_seq=0 out_seq=0 2024-04-20T12:30:50.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.888+0000 7f0346ffd640 1 -- 172.21.15.135:0/720480496 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5638d547ac50 con 0x5638d5612790 2024-04-20T12:30:50.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.888+0000 7f0346ffd640 10 client.18039 handle_command_reply: tid=0 2024-04-20T12:30:50.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.888+0000 7f0370ba2740 1 client.18039 shutdown 2024-04-20T12:30:50.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.888+0000 7f0370ba2740 1 -- 172.21.15.135:0/720480496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5591fe0 msgr2=0x5638d55955f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:50.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.888+0000 7f0370ba2740 1 --2- 172.21.15.135:0/720480496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5591fe0 0x5638d55955f0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f035800d920 tx=0x7f0358005e20 comp rx=0 tx=0).stop 2024-04-20T12:30:50.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.888+0000 7f0370ba2740 1 -- 172.21.15.135:0/720480496 shutdown_connections 2024-04-20T12:30:50.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.888+0000 7f0370ba2740 1 --2- 172.21.15.135:0/720480496 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5638d5612790 0x5638d5614bb0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.888+0000 7f0370ba2740 1 --2- 172.21.15.135:0/720480496 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5638d559b4e0 0x5638d5610820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.888+0000 7f0370ba2740 1 --2- 172.21.15.135:0/720480496 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5638d5592900 0x5638d5595b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.888+0000 7f0370ba2740 1 --2- 172.21.15.135:0/720480496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638d5591fe0 0x5638d55955f0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.888+0000 7f0370ba2740 1 -- 172.21.15.135:0/720480496 >> 172.21.15.135:0/720480496 conn(0x5638d558c710 msgr2=0x5638d5592f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:50.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.888+0000 7f0346ffd640 0 client.18039 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:50.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.888+0000 7f0370ba2740 1 -- 172.21.15.135:0/720480496 shutdown_connections 2024-04-20T12:30:50.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.888+0000 7f0370ba2740 1 -- 172.21.15.135:0/720480496 wait complete. 2024-04-20T12:30:50.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.888+0000 7f0370ba2740 20 client.18039 trim_cache size 0 max 16384 2024-04-20T12:30:50.893 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:30:50.893 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:30:50.893 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "082d6073-16df-40fa-afd2-d177845deac3", 2024-04-20T12:30:50.893 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:30:50.894 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:30:50.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.889+0000 7f036ded2640 1 -- 172.21.15.135:0/2580758304 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f03500a3d20 msgr2=0x7f03500a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:50.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.889+0000 7f036ded2640 1 --2- 172.21.15.135:0/2580758304 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f03500a3d20 0x7f03500a61e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f036000bdc0 tx=0x7f0360004a40 comp rx=0 tx=0).stop 2024-04-20T12:30:50.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.889+0000 7f036ded2640 1 -- 172.21.15.135:0/2580758304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0368107290 msgr2=0x7f0368198c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:50.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.889+0000 7f036ded2640 1 --2- 172.21.15.135:0/2580758304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0368107290 0x7f0368198c40 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f035c000c00 tx=0x7f035c02cc70 comp rx=0 tx=0).stop 2024-04-20T12:30:50.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.889+0000 7f036ded2640 1 -- 172.21.15.135:0/2580758304 shutdown_connections 2024-04-20T12:30:50.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.889+0000 7f036ded2640 1 --2- 172.21.15.135:0/2580758304 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f036819cfc0 0x7f036819d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.889+0000 7f036ded2640 1 --2- 172.21.15.135:0/2580758304 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0368107290 0x7f0368198c40 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.889+0000 7f036ded2640 1 --2- 172.21.15.135:0/2580758304 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f03500a3d20 0x7f03500a61e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.889+0000 7f036ded2640 1 --2- 172.21.15.135:0/2580758304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f036806a7d0 0x7f0368198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:50.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.889+0000 7f036ded2640 1 -- 172.21.15.135:0/2580758304 >> 172.21.15.135:0/2580758304 conn(0x7f0368076c60 msgr2=0x7f03680ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:50.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.889+0000 7f036ded2640 1 -- 172.21.15.135:0/2580758304 shutdown_connections 2024-04-20T12:30:50.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:50.889+0000 7f036ded2640 1 -- 172.21.15.135:0/2580758304 wait complete. 2024-04-20T12:30:50.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:30:50.899 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:30:51.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.000+0000 7f0e95d2e640 1 -- 172.21.15.135:0/2124654499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e90101a60 msgr2=0x7f0e90105aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:51.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.000+0000 7f0e95d2e640 1 --2- 172.21.15.135:0/2124654499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e90101a60 0x7f0e90105aa0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f0e80009900 tx=0x7f0e8002bc30 comp rx=0 tx=0).stop 2024-04-20T12:30:51.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.000+0000 7f0e95d2e640 1 -- 172.21.15.135:0/2124654499 shutdown_connections 2024-04-20T12:30:51.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.000+0000 7f0e95d2e640 1 --2- 172.21.15.135:0/2124654499 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e90106180 0x7f0e9010dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.000+0000 7f0e95d2e640 1 --2- 172.21.15.135:0/2124654499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e90101a60 0x7f0e90105aa0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.000+0000 7f0e95d2e640 1 --2- 172.21.15.135:0/2124654499 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e901010b0 0x7f0e90101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.000+0000 7f0e95d2e640 1 -- 172.21.15.135:0/2124654499 >> 172.21.15.135:0/2124654499 conn(0x7f0e900771e0 msgr2=0x7f0e900775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:51.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.000+0000 7f0e95d2e640 1 -- 172.21.15.135:0/2124654499 shutdown_connections 2024-04-20T12:30:51.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.000+0000 7f0e95d2e640 1 -- 172.21.15.135:0/2124654499 wait complete. 2024-04-20T12:30:51.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.000+0000 7f0e95d2e640 1 Processor -- start 2024-04-20T12:30:51.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.000+0000 7f0e95d2e640 1 -- start start 2024-04-20T12:30:51.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e95d2e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e901010b0 0x7f0e90199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e95d2e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e90106180 0x7f0e90199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e95d2e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e9019a160 0x7f0e901a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e95d2e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e90111210 con 0x7f0e90106180 2024-04-20T12:30:51.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e95d2e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0e90111090 con 0x7f0e901010b0 2024-04-20T12:30:51.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e95d2e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e90111390 con 0x7f0e9019a160 2024-04-20T12:30:51.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e8effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e90106180 0x7f0e90199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e8effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e90106180 0x7f0e90199bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57388/0 (socket says 172.21.15.135:57388) 2024-04-20T12:30:51.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e8effd640 1 -- 172.21.15.135:0/3728869068 learned_addr learned my addr 172.21.15.135:0/3728869068 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:51.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e8f7fe640 1 --2- 172.21.15.135:0/3728869068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e901010b0 0x7f0e90199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e8ffff640 1 --2- 172.21.15.135:0/3728869068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e9019a160 0x7f0e901a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e8effd640 1 -- 172.21.15.135:0/3728869068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e9019a160 msgr2=0x7f0e901a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:51.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e8effd640 1 --2- 172.21.15.135:0/3728869068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e9019a160 0x7f0e901a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e8effd640 1 -- 172.21.15.135:0/3728869068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e901010b0 msgr2=0x7f0e90199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:51.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e8effd640 1 --2- 172.21.15.135:0/3728869068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e901010b0 0x7f0e90199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e8effd640 1 -- 172.21.15.135:0/3728869068 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e901a4ee0 con 0x7f0e90106180 2024-04-20T12:30:51.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e8effd640 1 --2- 172.21.15.135:0/3728869068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e90106180 0x7f0e90199bd0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f0e80036040 tx=0x7f0e8002cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:51.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e8cff9640 1 -- 172.21.15.135:0/3728869068 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e80041070 con 0x7f0e90106180 2024-04-20T12:30:51.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e95d2e640 1 -- 172.21.15.135:0/3728869068 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e901a5170 con 0x7f0e90106180 2024-04-20T12:30:51.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e8cff9640 1 -- 172.21.15.135:0/3728869068 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e800054e0 con 0x7f0e90106180 2024-04-20T12:30:51.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e8cff9640 1 -- 172.21.15.135:0/3728869068 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e80034440 con 0x7f0e90106180 2024-04-20T12:30:51.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.001+0000 7f0e95d2e640 1 -- 172.21.15.135:0/3728869068 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e901a5660 con 0x7f0e90106180 2024-04-20T12:30:51.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.003+0000 7f0e8cff9640 1 -- 172.21.15.135:0/3728869068 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f0e80044070 con 0x7f0e90106180 2024-04-20T12:30:51.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e989f5740 1 Processor -- start 2024-04-20T12:30:51.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e989f5740 1 -- start start 2024-04-20T12:30:51.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e989f5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caec9d0 0x55b70caecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e8cff9640 1 --2- 172.21.15.135:0/3728869068 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0e780a3d20 0x7f0e780a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e989f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caed2f0 0x55b70cafa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e989f5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70cafa630 0x55b70cafca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e989f5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b70ca521b0 con 0x55b70caec9d0 2024-04-20T12:30:51.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e989f5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b70c9ef390 con 0x55b70cafa630 2024-04-20T12:30:51.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e989f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b70ca4e170 con 0x55b70caed2f0 2024-04-20T12:30:51.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caec9d0 0x55b70caecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e8ffff640 1 --2- 172.21.15.135:0/3728869068 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0e780a3d20 0x7f0e780a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e8f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caec9d0 0x55b70caecdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57396/0 (socket says 172.21.15.135:57396) 2024-04-20T12:30:51.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e8f7fe640 1 -- 172.21.15.135:0/2295533011 learned_addr learned my addr 172.21.15.135:0/2295533011 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:51.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e8effd640 1 --2- 172.21.15.135:0/2295533011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caed2f0 0x55b70cafa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e8cff9640 1 -- 172.21.15.135:0/3728869068 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f0e800f2a40 con 0x7f0e90106180 2024-04-20T12:30:51.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e8f7fe640 1 -- 172.21.15.135:0/2295533011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caed2f0 msgr2=0x55b70cafa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:51.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e8f7fe640 1 --2- 172.21.15.135:0/2295533011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caed2f0 0x55b70cafa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e8f7fe640 1 -- 172.21.15.135:0/2295533011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70cafa630 msgr2=0x55b70cafca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:51.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.004+0000 7f0e8f7fe640 1 --2- 172.21.15.135:0/2295533011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70cafa630 0x55b70cafca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.005+0000 7f0e8f7fe640 1 -- 172.21.15.135:0/2295533011 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b70c82e7d0 con 0x55b70caec9d0 2024-04-20T12:30:51.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.005+0000 7f0e8ffff640 1 --2- 172.21.15.135:0/3728869068 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0e780a3d20 0x7f0e780a61e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0e88005c40 tx=0x7f0e88009a80 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:51.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.005+0000 7f0e8f7fe640 1 --2- 172.21.15.135:0/2295533011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caec9d0 0x55b70caecdb0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400dcb0 tx=0x7f0e8400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4673ecc5afe4763 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:51.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.005+0000 7f0e75ffb640 1 -- 172.21.15.135:0/2295533011 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84011440 con 0x55b70caec9d0 2024-04-20T12:30:51.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.005+0000 7f0e75ffb640 1 -- 172.21.15.135:0/2295533011 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e84011ac0 con 0x55b70caec9d0 2024-04-20T12:30:51.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.005+0000 7f0e75ffb640 1 -- 172.21.15.135:0/2295533011 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8401b9f0 con 0x55b70caec9d0 2024-04-20T12:30:51.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.005+0000 7f0e989f5740 1 -- 172.21.15.135:0/2295533011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caec9d0 msgr2=0x55b70caecdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:51.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.005+0000 7f0e989f5740 1 --2- 172.21.15.135:0/2295533011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caec9d0 0x55b70caecdb0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400dcb0 tx=0x7f0e8400f730 comp rx=0 tx=0).stop 2024-04-20T12:30:51.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 1 -- 172.21.15.135:0/2295533011 shutdown_connections 2024-04-20T12:30:51.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 1 --2- 172.21.15.135:0/2295533011 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70cafa630 0x55b70cafca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 1 --2- 172.21.15.135:0/2295533011 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caed2f0 0x55b70cafa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 1 --2- 172.21.15.135:0/2295533011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caec9d0 0x55b70caecdb0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 1 -- 172.21.15.135:0/2295533011 >> 172.21.15.135:0/2295533011 conn(0x55b70cae7450 msgr2=0x55b70cae7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:51.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 1 -- 172.21.15.135:0/2295533011 shutdown_connections 2024-04-20T12:30:51.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 1 -- 172.21.15.135:0/2295533011 wait complete. 2024-04-20T12:30:51.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 1 -- start start 2024-04-20T12:30:51.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 1 Processor -- start 2024-04-20T12:30:51.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caec9d0 0x55b70caf7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70caed2f0 0x55b70caf7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70cafa630 0x55b70caf80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b70cafd470 con 0x55b70cafa630 2024-04-20T12:30:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55b70ca0b2f0 con 0x55b70caed2f0 2024-04-20T12:30:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55b70cafd5f0 con 0x55b70caec9d0 2024-04-20T12:30:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e989f5740 10 client.0 _ll_register_callbacks cb 0x55b70c9d54e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e8ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70cafa630 0x55b70caf80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e8ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70cafa630 0x55b70caf80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57404/0 (socket says 172.21.15.135:57404) 2024-04-20T12:30:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.006+0000 7f0e8ffff640 1 -- 172.21.15.135:0/255923760 learned_addr learned my addr 172.21.15.135:0/255923760 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e8f7fe640 1 --2- 172.21.15.135:0/255923760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caec9d0 0x55b70caf7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e8effd640 1 --2- 172.21.15.135:0/255923760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70caed2f0 0x55b70caf7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e8ffff640 1 -- 172.21.15.135:0/255923760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caec9d0 msgr2=0x55b70caf7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e8ffff640 1 --2- 172.21.15.135:0/255923760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caec9d0 0x55b70caf7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e8ffff640 1 -- 172.21.15.135:0/255923760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70caed2f0 msgr2=0x55b70caf7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e8ffff640 1 --2- 172.21.15.135:0/255923760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70caed2f0 0x55b70caf7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e8ffff640 1 -- 172.21.15.135:0/255923760 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b70c7643f0 con 0x55b70cafa630 2024-04-20T12:30:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e8effd640 1 --2- 172.21.15.135:0/255923760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70caed2f0 0x55b70caf7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:30:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e8ffff640 1 --2- 172.21.15.135:0/255923760 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70cafa630 0x55b70caf80e0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f0e88003fd0 tx=0x7f0e88004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1674d11a44efeb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e6effd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e6effd640 1 -- 172.21.15.135:0/255923760 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88022070 con 0x55b70cafa630 2024-04-20T12:30:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e989f5740 1 -- 172.21.15.135:0/255923760 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e84011ac0 con 0x55b70cafa630 2024-04-20T12:30:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e6effd640 1 -- 172.21.15.135:0/255923760 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f0e8800e960 con 0x55b70cafa630 2024-04-20T12:30:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e6effd640 1 -- 172.21.15.135:0/255923760 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0e88030050 con 0x55b70cafa630 2024-04-20T12:30:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e989f5740 10 client.18051 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e989f5740 1 -- 172.21.15.135:0/255923760 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b70c7240f0 con 0x55b70cafa630 2024-04-20T12:30:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e6effd640 1 -- 172.21.15.135:0/255923760 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e84011ac0 con 0x55b70cafa630 2024-04-20T12:30:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.007+0000 7f0e6effd640 1 -- 172.21.15.135:0/255923760 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f0e8801e3f0 con 0x55b70cafa630 2024-04-20T12:30:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.008+0000 7f0e989f5740 10 client.18051 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.008+0000 7f0e989f5740 10 client.18051 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:51.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.008+0000 7f0e989f5740 20 client.18051 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.008+0000 7f0e989f5740 1 --2- 172.21.15.135:0/255923760 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55b70cb0aa70 0x55b70cb0cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.008+0000 7f0e989f5740 4 client.18051 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:30:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.008+0000 7f0e989f5740 1 -- 172.21.15.135:0/255923760 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b70ca5fbd0 con 0x55b70cb0aa70 2024-04-20T12:30:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.008+0000 7f0e8f7fe640 1 --2- 172.21.15.135:0/255923760 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55b70cb0aa70 0x55b70cb0cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.008+0000 7f0e8f7fe640 1 --2- 172.21.15.135:0/255923760 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55b70cb0aa70 0x55b70cb0cea0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e10b0b8bb442e28 server_cookie=6305617d6072d2f2 in_seq=0 out_seq=0 2024-04-20T12:30:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.008+0000 7f0e6effd640 10 client.18051 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.009+0000 7f0e6effd640 1 -- 172.21.15.135:0/255923760 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b70ca5fbd0 con 0x55b70cb0aa70 2024-04-20T12:30:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.009+0000 7f0e6effd640 10 client.18051 handle_command_reply: tid=0 2024-04-20T12:30:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.009+0000 7f0e989f5740 1 client.18051 shutdown 2024-04-20T12:30:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.009+0000 7f0e989f5740 1 -- 172.21.15.135:0/255923760 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70cafa630 msgr2=0x55b70caf80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:51.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.009+0000 7f0e989f5740 1 --2- 172.21.15.135:0/255923760 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70cafa630 0x55b70caf80e0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f0e88003fd0 tx=0x7f0e88004ab0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.009+0000 7f0e989f5740 1 -- 172.21.15.135:0/255923760 shutdown_connections 2024-04-20T12:30:51.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.009+0000 7f0e989f5740 1 --2- 172.21.15.135:0/255923760 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55b70cb0aa70 0x55b70cb0cea0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.009+0000 7f0e989f5740 1 --2- 172.21.15.135:0/255923760 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70cafa630 0x55b70caf80e0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.009+0000 7f0e6effd640 0 client.18051 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:51.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.009+0000 7f0e989f5740 1 --2- 172.21.15.135:0/255923760 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70caed2f0 0x55b70caf7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.009+0000 7f0e989f5740 1 --2- 172.21.15.135:0/255923760 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caec9d0 0x55b70caf7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.009+0000 7f0e989f5740 1 -- 172.21.15.135:0/255923760 >> 172.21.15.135:0/255923760 conn(0x55b70cae7450 msgr2=0x55b70cae91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:51.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.009+0000 7f0e989f5740 1 -- 172.21.15.135:0/255923760 shutdown_connections 2024-04-20T12:30:51.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.009+0000 7f0e989f5740 1 -- 172.21.15.135:0/255923760 wait complete. 2024-04-20T12:30:51.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.009+0000 7f0e989f5740 20 client.18051 trim_cache size 0 max 16384 2024-04-20T12:30:51.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.026+0000 7f0e989f5740 1 Processor -- start 2024-04-20T12:30:51.031 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.026+0000 7f0e989f5740 1 -- start start 2024-04-20T12:30:51.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.026+0000 7f0e989f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caec9d0 0x55b70caf9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.026+0000 7f0e989f5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caed2f0 0x55b70cb063a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.026+0000 7f0e989f5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70cafa630 0x55b70cb12770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.026+0000 7f0e989f5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e901ad320 con 0x55b70caed2f0 2024-04-20T12:30:51.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.026+0000 7f0e989f5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0e901aee60 con 0x55b70cafa630 2024-04-20T12:30:51.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.026+0000 7f0e989f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e901ad9f0 con 0x55b70caec9d0 2024-04-20T12:30:51.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.027+0000 7f0e8effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caed2f0 0x55b70cb063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.027+0000 7f0e8effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caed2f0 0x55b70cb063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57410/0 (socket says 172.21.15.135:57410) 2024-04-20T12:30:51.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.027+0000 7f0e8effd640 1 -- 172.21.15.135:0/3302401522 learned_addr learned my addr 172.21.15.135:0/3302401522 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:51.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.027+0000 7f0e8ffff640 1 --2- 172.21.15.135:0/3302401522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70cafa630 0x55b70cb12770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.027+0000 7f0e8effd640 1 -- 172.21.15.135:0/3302401522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caec9d0 msgr2=0x55b70caf9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:51.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.027+0000 7f0e8effd640 1 --2- 172.21.15.135:0/3302401522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caec9d0 0x55b70caf9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.027+0000 7f0e8effd640 1 -- 172.21.15.135:0/3302401522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70cafa630 msgr2=0x55b70cb12770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:51.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.027+0000 7f0e8effd640 1 --2- 172.21.15.135:0/3302401522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70cafa630 0x55b70cb12770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.027+0000 7f0e8effd640 1 -- 172.21.15.135:0/3302401522 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b70cb096c0 con 0x55b70caed2f0 2024-04-20T12:30:51.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.027+0000 7f0e8effd640 1 --2- 172.21.15.135:0/3302401522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caed2f0 0x55b70cb063a0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f0e80000c00 tx=0x7f0e800428e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fe832e22b53e31 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:51.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.027+0000 7f0e757fa640 1 -- 172.21.15.135:0/3302401522 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8004b070 con 0x55b70caed2f0 2024-04-20T12:30:51.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.027+0000 7f0e757fa640 1 -- 172.21.15.135:0/3302401522 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e80004c80 con 0x55b70caed2f0 2024-04-20T12:30:51.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.027+0000 7f0e757fa640 1 -- 172.21.15.135:0/3302401522 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e800be720 con 0x55b70caed2f0 2024-04-20T12:30:51.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 -- 172.21.15.135:0/3302401522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caed2f0 msgr2=0x55b70cb063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:51.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 --2- 172.21.15.135:0/3302401522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caed2f0 0x55b70cb063a0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f0e80000c00 tx=0x7f0e800428e0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 -- 172.21.15.135:0/3302401522 shutdown_connections 2024-04-20T12:30:51.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 --2- 172.21.15.135:0/3302401522 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70cafa630 0x55b70cb12770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 --2- 172.21.15.135:0/3302401522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caed2f0 0x55b70cb063a0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 --2- 172.21.15.135:0/3302401522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caec9d0 0x55b70caf9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 -- 172.21.15.135:0/3302401522 >> 172.21.15.135:0/3302401522 conn(0x55b70cae7450 msgr2=0x55b70cae9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:51.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 -- 172.21.15.135:0/3302401522 shutdown_connections 2024-04-20T12:30:51.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 -- 172.21.15.135:0/3302401522 wait complete. 2024-04-20T12:30:51.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 -- start start 2024-04-20T12:30:51.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 Processor -- start 2024-04-20T12:30:51.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caec9d0 0x55b70cb00b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caed2f0 0x55b70cb010c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70cafa630 0x55b70cb6a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e901ae790 con 0x55b70caed2f0 2024-04-20T12:30:51.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0e901ae0c0 con 0x55b70cafa630 2024-04-20T12:30:51.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e901ab2f0 con 0x55b70caec9d0 2024-04-20T12:30:51.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e989f5740 10 client.0 _ll_register_callbacks cb 0x7f0e88009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:30:51.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e8effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caed2f0 0x55b70cb010c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e8effd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caed2f0 0x55b70cb010c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:57422/0 (socket says 172.21.15.135:57422) 2024-04-20T12:30:51.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.028+0000 7f0e8effd640 1 -- 172.21.15.135:0/3252463155 learned_addr learned my addr 172.21.15.135:0/3252463155 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:30:51.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e8f7fe640 1 --2- 172.21.15.135:0/3252463155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caec9d0 0x55b70cb00b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e8ffff640 1 --2- 172.21.15.135:0/3252463155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70cafa630 0x55b70cb6a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e8effd640 1 -- 172.21.15.135:0/3252463155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caec9d0 msgr2=0x55b70cb00b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:51.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e8effd640 1 --2- 172.21.15.135:0/3252463155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caec9d0 0x55b70cb00b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e8effd640 1 -- 172.21.15.135:0/3252463155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70cafa630 msgr2=0x55b70cb6a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:30:51.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e8effd640 1 --2- 172.21.15.135:0/3252463155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70cafa630 0x55b70cb6a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e8effd640 1 -- 172.21.15.135:0/3252463155 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b70cb6a670 con 0x55b70caed2f0 2024-04-20T12:30:51.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e8effd640 1 --2- 172.21.15.135:0/3252463155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caed2f0 0x55b70cb010c0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f0e800039d0 tx=0x7f0e800c3cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cc8c7399026b25 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:30:51.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e6effd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:30:51.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e6effd640 1 -- 172.21.15.135:0/3252463155 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8004b070 con 0x55b70caed2f0 2024-04-20T12:30:51.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e6effd640 1 -- 172.21.15.135:0/3252463155 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9504+0+0 (secure 0 0 0) 0x7f0e800be980 con 0x55b70caed2f0 2024-04-20T12:30:51.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e989f5740 1 -- 172.21.15.135:0/3252463155 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e80004c80 con 0x55b70caed2f0 2024-04-20T12:30:51.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e6effd640 1 -- 172.21.15.135:0/3252463155 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0e800f0240 con 0x55b70caed2f0 2024-04-20T12:30:51.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e989f5740 10 client.18057 fetch_fsmap learned FSMap version 29 2024-04-20T12:30:51.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e989f5740 1 -- 172.21.15.135:0/3252463155 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b70cb71a30 con 0x55b70caed2f0 2024-04-20T12:30:51.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e6effd640 1 -- 172.21.15.135:0/3252463155 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e80004c80 con 0x55b70caed2f0 2024-04-20T12:30:51.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e6effd640 1 -- 172.21.15.135:0/3252463155 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f0e800c6f00 con 0x55b70caed2f0 2024-04-20T12:30:51.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e989f5740 10 client.18057 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:30:51.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e989f5740 10 client.18057 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:30:51.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.029+0000 7f0e989f5740 20 client.18057 populate_metadata read hostname 'smithi135' 2024-04-20T12:30:51.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e989f5740 1 --2- 172.21.15.135:0/3252463155 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55b70cb71f10 0x55b70cb74330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:30:51.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e989f5740 4 client.18057 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:30:51.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e989f5740 1 -- 172.21.15.135:0/3252463155 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b70ca59a40 con 0x55b70cb71f10 2024-04-20T12:30:51.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e8f7fe640 1 --2- 172.21.15.135:0/3252463155 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55b70cb71f10 0x55b70cb74330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:30:51.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e6effd640 10 client.18057 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:51.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e8f7fe640 1 --2- 172.21.15.135:0/3252463155 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55b70cb71f10 0x55b70cb74330 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1134b9e8f49c0bc server_cookie=31c509dbb700e24c in_seq=0 out_seq=0 2024-04-20T12:30:51.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e6effd640 1 -- 172.21.15.135:0/3252463155 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b70ca59a40 con 0x55b70cb71f10 2024-04-20T12:30:51.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e6effd640 10 client.18057 handle_command_reply: tid=0 2024-04-20T12:30:51.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e989f5740 1 client.18057 shutdown 2024-04-20T12:30:51.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e989f5740 1 -- 172.21.15.135:0/3252463155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caed2f0 msgr2=0x55b70cb010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:51.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e989f5740 1 --2- 172.21.15.135:0/3252463155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caed2f0 0x55b70cb010c0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f0e800039d0 tx=0x7f0e800c3cd0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e989f5740 1 -- 172.21.15.135:0/3252463155 shutdown_connections 2024-04-20T12:30:51.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e989f5740 1 --2- 172.21.15.135:0/3252463155 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55b70cb71f10 0x55b70cb74330 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e989f5740 1 --2- 172.21.15.135:0/3252463155 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55b70cafa630 0x55b70cb6a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e6effd640 0 client.18057 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:30:51.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e989f5740 1 --2- 172.21.15.135:0/3252463155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b70caed2f0 0x55b70cb010c0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e989f5740 1 --2- 172.21.15.135:0/3252463155 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55b70caec9d0 0x55b70cb00b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.030+0000 7f0e989f5740 1 -- 172.21.15.135:0/3252463155 >> 172.21.15.135:0/3252463155 conn(0x55b70cae7450 msgr2=0x55b70cae88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:51.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.031+0000 7f0e989f5740 1 -- 172.21.15.135:0/3252463155 shutdown_connections 2024-04-20T12:30:51.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.031+0000 7f0e989f5740 1 -- 172.21.15.135:0/3252463155 wait complete. 2024-04-20T12:30:51.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.031+0000 7f0e989f5740 20 client.18057 trim_cache size 0 max 16384 2024-04-20T12:30:51.037 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:30:51.038 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:30:51.038 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:30:51.038 INFO:teuthology.orchestra.run.smithi135.stdout: "082d6073-16df-40fa-afd2-d177845deac3": { 2024-04-20T12:30:51.038 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:30:51.038 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "082d6073-16df-40fa-afd2-d177845deac3", 2024-04-20T12:30:51.038 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:30:51.038 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:30:51.038 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:30:51.038 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:30:51.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.031+0000 7f0e95d2e640 1 -- 172.21.15.135:0/3728869068 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0e780a3d20 msgr2=0x7f0e780a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:51.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.031+0000 7f0e95d2e640 1 --2- 172.21.15.135:0/3728869068 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0e780a3d20 0x7f0e780a61e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0e88005c40 tx=0x7f0e88009a80 comp rx=0 tx=0).stop 2024-04-20T12:30:51.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.031+0000 7f0e95d2e640 1 -- 172.21.15.135:0/3728869068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e90106180 msgr2=0x7f0e90199bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:30:51.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.031+0000 7f0e95d2e640 1 --2- 172.21.15.135:0/3728869068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e90106180 0x7f0e90199bd0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f0e80036040 tx=0x7f0e8002cbf0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.031+0000 7f0e95d2e640 1 -- 172.21.15.135:0/3728869068 shutdown_connections 2024-04-20T12:30:51.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.031+0000 7f0e95d2e640 1 --2- 172.21.15.135:0/3728869068 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0e780a3d20 0x7f0e780a61e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.031+0000 7f0e95d2e640 1 --2- 172.21.15.135:0/3728869068 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e9019a160 0x7f0e901a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.031+0000 7f0e95d2e640 1 --2- 172.21.15.135:0/3728869068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e90106180 0x7f0e90199bd0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.031+0000 7f0e95d2e640 1 --2- 172.21.15.135:0/3728869068 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e901010b0 0x7f0e90199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:30:51.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.031+0000 7f0e95d2e640 1 -- 172.21.15.135:0/3728869068 >> 172.21.15.135:0/3728869068 conn(0x7f0e900771e0 msgr2=0x7f0e900fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:30:51.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.031+0000 7f0e95d2e640 1 -- 172.21.15.135:0/3728869068 shutdown_connections 2024-04-20T12:30:51.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:30:51.031+0000 7f0e95d2e640 1 -- 172.21.15.135:0/3728869068 wait complete. 2024-04-20T12:30:51.040 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:50 smithi135 ceph-mon[18264]: pgmap v236: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:30:51.041 INFO:tasks.cephfs.filesystem:scrub status for tag:082d6073-16df-40fa-afd2-d177845deac3 - {'path': '/', 'tag': '082d6073-16df-40fa-afd2-d177845deac3', 'options': 'recursive,force'} 2024-04-20T12:30:51.152 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:50 smithi154 ceph-mon[22073]: pgmap v236: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:30:51.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:50 smithi139 ceph-mon[21834]: pgmap v236: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:30:52.231 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:51 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:30:52.231 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:51 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:30:52.231 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:51 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:30:52.231 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:51 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:30:52.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:51 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:30:52.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:51 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:30:52.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:51 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:30:52.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:51 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:30:52.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:51 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:30:52.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:51 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:30:52.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:51 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:30:52.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:51 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:30:53.246 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:52 smithi139 ceph-mon[21834]: pgmap v237: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:30:53.247 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:52 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:30:53.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:52 smithi154 ceph-mon[22073]: pgmap v237: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:30:53.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:52 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:30:53.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:52 smithi135 ceph-mon[18264]: pgmap v237: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-04-20T12:30:53.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:52 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:30:55.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:54 smithi154 ceph-mon[22073]: pgmap v238: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 op/s 2024-04-20T12:30:55.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:54 smithi139 ceph-mon[21834]: pgmap v238: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 op/s 2024-04-20T12:30:55.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:54 smithi135 ceph-mon[18264]: pgmap v238: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 op/s 2024-04-20T12:30:57.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:56 smithi154 ceph-mon[22073]: pgmap v239: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:30:57.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:56 smithi139 ceph-mon[21834]: pgmap v239: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:30:57.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:56 smithi135 ceph-mon[18264]: pgmap v239: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:30:59.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:30:58 smithi154 ceph-mon[22073]: pgmap v240: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:30:59.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:30:58 smithi139 ceph-mon[21834]: pgmap v240: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:30:59.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:30:58 smithi135 ceph-mon[18264]: pgmap v240: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:31:01.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:00 smithi154 ceph-mon[22073]: pgmap v241: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 op/s 2024-04-20T12:31:01.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:00 smithi139 ceph-mon[21834]: pgmap v241: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 op/s 2024-04-20T12:31:01.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:00 smithi135 ceph-mon[18264]: pgmap v241: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 13 op/s 2024-04-20T12:31:03.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:02 smithi154 ceph-mon[22073]: pgmap v242: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:31:03.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:02 smithi139 ceph-mon[21834]: pgmap v242: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:31:03.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:02 smithi135 ceph-mon[18264]: pgmap v242: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:31:05.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:04 smithi154 ceph-mon[22073]: pgmap v243: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-20T12:31:05.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:04 smithi139 ceph-mon[21834]: pgmap v243: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-20T12:31:05.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:04 smithi135 ceph-mon[18264]: pgmap v243: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-20T12:31:07.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:06 smithi154 ceph-mon[22073]: pgmap v244: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:31:07.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:06 smithi139 ceph-mon[21834]: pgmap v244: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:31:07.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:06 smithi135 ceph-mon[18264]: pgmap v244: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:31:09.166 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:08 smithi135 ceph-mon[18264]: pgmap v245: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:31:09.166 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:08 smithi135 ceph-mon[18264]: osdmap e98: 12 total, 12 up, 12 in 2024-04-20T12:31:09.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:08 smithi154 ceph-mon[22073]: pgmap v245: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:31:09.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:08 smithi154 ceph-mon[22073]: osdmap e98: 12 total, 12 up, 12 in 2024-04-20T12:31:09.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:08 smithi139 ceph-mon[21834]: pgmap v245: 129 pgs: 129 active+clean; 16 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:31:09.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:08 smithi139 ceph-mon[21834]: osdmap e98: 12 total, 12 up, 12 in 2024-04-20T12:31:11.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:10 smithi154 ceph-mon[22073]: pgmap v247: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:31:11.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:10 smithi139 ceph-mon[21834]: pgmap v247: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:31:11.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:10 smithi135 ceph-mon[18264]: pgmap v247: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:31:13.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:12 smithi154 ceph-mon[22073]: pgmap v248: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:31:13.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:12 smithi139 ceph-mon[21834]: pgmap v248: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:31:13.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:12 smithi135 ceph-mon[18264]: pgmap v248: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:31:14.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:14 smithi154 ceph-mon[22073]: pgmap v249: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:31:14.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:14 smithi154 ceph-mon[22073]: osdmap e99: 12 total, 12 up, 12 in 2024-04-20T12:31:14.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:14 smithi139 ceph-mon[21834]: pgmap v249: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:31:14.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:14 smithi139 ceph-mon[21834]: osdmap e99: 12 total, 12 up, 12 in 2024-04-20T12:31:14.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:14 smithi135 ceph-mon[18264]: pgmap v249: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:31:14.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:14 smithi135 ceph-mon[18264]: osdmap e99: 12 total, 12 up, 12 in 2024-04-20T12:31:16.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:16 smithi154 ceph-mon[22073]: pgmap v251: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-20T12:31:16.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:16 smithi139 ceph-mon[21834]: pgmap v251: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-20T12:31:16.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:16 smithi135 ceph-mon[18264]: pgmap v251: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-20T12:31:18.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:18 smithi154 ceph-mon[22073]: pgmap v252: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2024-04-20T12:31:18.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:18 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:31:18.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:18 smithi139 ceph-mon[21834]: pgmap v252: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2024-04-20T12:31:18.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:18 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:31:18.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:18 smithi135 ceph-mon[18264]: pgmap v252: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 219 B/s wr, 11 op/s 2024-04-20T12:31:18.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:18 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:31:19.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:19 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:31:19.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:19 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:31:19.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:19 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:31:19.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:19 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:31:19.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:19 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:31:19.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:19 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:31:19.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:19 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:31:19.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:19 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:31:19.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:19 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:31:21.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:31:21.043 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:31:21.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.155+0000 7f45d5104640 1 -- 172.21.15.135:0/1764577331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d010c520 msgr2=0x7f45d010e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.155+0000 7f45d5104640 1 --2- 172.21.15.135:0/1764577331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d010c520 0x7f45d010e9c0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009ca0 tx=0x7f45c802c230 comp rx=0 tx=0).stop 2024-04-20T12:31:21.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.155+0000 7f45d5104640 1 -- 172.21.15.135:0/1764577331 shutdown_connections 2024-04-20T12:31:21.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.155+0000 7f45d5104640 1 --2- 172.21.15.135:0/1764577331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d010c520 0x7f45d010e9c0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.155+0000 7f45d5104640 1 --2- 172.21.15.135:0/1764577331 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45d0103b00 0x7f45d010bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.155+0000 7f45d5104640 1 --2- 172.21.15.135:0/1764577331 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d01031e0 0x7f45d01035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.158 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.155+0000 7f45d5104640 1 -- 172.21.15.135:0/1764577331 >> 172.21.15.135:0/1764577331 conn(0x7f45d0077f60 msgr2=0x7f45d0078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.155+0000 7f45d5104640 1 -- 172.21.15.135:0/1764577331 shutdown_connections 2024-04-20T12:31:21.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.155+0000 7f45d5104640 1 -- 172.21.15.135:0/1764577331 wait complete. 2024-04-20T12:31:21.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.155+0000 7f45d5104640 1 Processor -- start 2024-04-20T12:31:21.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45d5104640 1 -- start start 2024-04-20T12:31:21.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45d5104640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d01031e0 0x7f45d019e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45d5104640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45d0103b00 0x7f45d019e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45d5104640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d010c520 0x7f45d0198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45d5104640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0112300 con 0x7f45d010c520 2024-04-20T12:31:21.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45d5104640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0112180 con 0x7f45d0103b00 2024-04-20T12:31:21.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45d5104640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0112480 con 0x7f45d01031e0 2024-04-20T12:31:21.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45cf59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d010c520 0x7f45d0198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45cf59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d010c520 0x7f45d0198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42474/0 (socket says 172.21.15.135:42474) 2024-04-20T12:31:21.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45cf59e640 1 -- 172.21.15.135:0/942894658 learned_addr learned my addr 172.21.15.135:0/942894658 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45ced9d640 1 --2- 172.21.15.135:0/942894658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d01031e0 0x7f45d019e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45ce59c640 1 --2- 172.21.15.135:0/942894658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45d0103b00 0x7f45d019e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45cf59e640 1 -- 172.21.15.135:0/942894658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d01031e0 msgr2=0x7f45d019e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45cf59e640 1 --2- 172.21.15.135:0/942894658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d01031e0 0x7f45d019e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45cf59e640 1 -- 172.21.15.135:0/942894658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45d0103b00 msgr2=0x7f45d019e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45cf59e640 1 --2- 172.21.15.135:0/942894658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45d0103b00 0x7f45d019e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45cf59e640 1 -- 172.21.15.135:0/942894658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d0198de0 con 0x7f45d010c520 2024-04-20T12:31:21.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.156+0000 7f45cf59e640 1 --2- 172.21.15.135:0/942894658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d010c520 0x7f45d0198660 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f45c802c840 tx=0x7f45c8035d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.157+0000 7f45c7fff640 1 -- 172.21.15.135:0/942894658 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8039040 con 0x7f45d010c520 2024-04-20T12:31:21.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.157+0000 7f45c7fff640 1 -- 172.21.15.135:0/942894658 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45c8044070 con 0x7f45d010c520 2024-04-20T12:31:21.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.157+0000 7f45d5104640 1 -- 172.21.15.135:0/942894658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d0199070 con 0x7f45d010c520 2024-04-20T12:31:21.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.157+0000 7f45c7fff640 1 -- 172.21.15.135:0/942894658 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c8004330 con 0x7f45d010c520 2024-04-20T12:31:21.161 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.157+0000 7f45d5104640 1 -- 172.21.15.135:0/942894658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d01a5320 con 0x7f45d010c520 2024-04-20T12:31:21.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.159+0000 7f45c7fff640 1 -- 172.21.15.135:0/942894658 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f45c80044d0 con 0x7f45d010c520 2024-04-20T12:31:21.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.159+0000 7f45d7dd1740 1 Processor -- start 2024-04-20T12:31:21.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.159+0000 7f45d7dd1740 1 -- start start 2024-04-20T12:31:21.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45d7dd1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81a9d20 0x561bf81aa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45d7dd1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81aa640 0x561bf81b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45d7dd1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81b3220 0x561bf81b5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45d7dd1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561bf810f1b0 con 0x561bf81a9d20 2024-04-20T12:31:21.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45d7dd1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561bf80ac390 con 0x561bf81aa640 2024-04-20T12:31:21.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45d7dd1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561bf810b170 con 0x561bf81b3220 2024-04-20T12:31:21.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45c7fff640 1 --2- 172.21.15.135:0/942894658 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f45bc0a3d20 0x7f45bc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45ce59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81a9d20 0x561bf81aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45ce59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81a9d20 0x561bf81aa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42484/0 (socket says 172.21.15.135:42484) 2024-04-20T12:31:21.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45ce59c640 1 -- 172.21.15.135:0/1681767022 learned_addr learned my addr 172.21.15.135:0/1681767022 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45cf59e640 1 --2- 172.21.15.135:0/942894658 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f45bc0a3d20 0x7f45bc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45ced9d640 1 --2- 172.21.15.135:0/1681767022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81aa640 0x561bf81b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45c7fff640 1 -- 172.21.15.135:0/942894658 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f45c80f2fc0 con 0x7f45d010c520 2024-04-20T12:31:21.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45ce59c640 1 --2- 172.21.15.135:0/1681767022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81b3220 0x561bf81b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45ced9d640 1 -- 172.21.15.135:0/1681767022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81b3220 msgr2=0x561bf81b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45ced9d640 1 --2- 172.21.15.135:0/1681767022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81b3220 0x561bf81b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45ced9d640 1 -- 172.21.15.135:0/1681767022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81a9d20 msgr2=0x561bf81aa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45ced9d640 1 --2- 172.21.15.135:0/1681767022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81a9d20 0x561bf81aa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45ced9d640 1 -- 172.21.15.135:0/1681767022 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bf7eeb7d0 con 0x561bf81aa640 2024-04-20T12:31:21.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45ce59c640 1 --2- 172.21.15.135:0/1681767022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81a9d20 0x561bf81aa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:31:21.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45cf59e640 1 --2- 172.21.15.135:0/942894658 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f45bc0a3d20 0x7f45bc0a61e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f45c80bb100 tx=0x7f45c80906e0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45ced9d640 1 --2- 172.21.15.135:0/1681767022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81aa640 0x561bf81b2ce0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f45c0004630 tx=0x7f45c000bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=320c71585599c3b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.160+0000 7f45c57fa640 1 -- 172.21.15.135:0/1681767022 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0003bd0 con 0x561bf81aa640 2024-04-20T12:31:21.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.161+0000 7f45c57fa640 1 -- 172.21.15.135:0/1681767022 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45c0015070 con 0x561bf81aa640 2024-04-20T12:31:21.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.161+0000 7f45c57fa640 1 -- 172.21.15.135:0/1681767022 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0004d90 con 0x561bf81aa640 2024-04-20T12:31:21.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.161+0000 7f45d7dd1740 1 -- 172.21.15.135:0/1681767022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81aa640 msgr2=0x561bf81b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.161+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/1681767022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81aa640 0x561bf81b2ce0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f45c0004630 tx=0x7f45c000bb20 comp rx=0 tx=0).stop 2024-04-20T12:31:21.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.161+0000 7f45d7dd1740 1 -- 172.21.15.135:0/1681767022 shutdown_connections 2024-04-20T12:31:21.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.161+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/1681767022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81b3220 0x561bf81b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.161+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/1681767022 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81aa640 0x561bf81b2ce0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.161+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/1681767022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81a9d20 0x561bf81aa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.161+0000 7f45d7dd1740 1 -- 172.21.15.135:0/1681767022 >> 172.21.15.135:0/1681767022 conn(0x561bf81a4450 msgr2=0x561bf81a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.161+0000 7f45d7dd1740 1 -- 172.21.15.135:0/1681767022 shutdown_connections 2024-04-20T12:31:21.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.161+0000 7f45d7dd1740 1 -- 172.21.15.135:0/1681767022 wait complete. 2024-04-20T12:31:21.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45d7dd1740 1 -- start start 2024-04-20T12:31:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45d7dd1740 1 Processor -- start 2024-04-20T12:31:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45d7dd1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81a9d20 0x561bf81b0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45d7dd1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81aa640 0x561bf81b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45d7dd1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81b3220 0x561bf81b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45d7dd1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561bf81b6010 con 0x561bf81a9d20 2024-04-20T12:31:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45d7dd1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561bf80c82f0 con 0x561bf81b3220 2024-04-20T12:31:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45d7dd1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561bf81b6190 con 0x561bf81aa640 2024-04-20T12:31:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45d7dd1740 10 client.0 _ll_register_callbacks cb 0x561bf80924e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45ce59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81a9d20 0x561bf81b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45ce59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81a9d20 0x561bf81b0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42486/0 (socket says 172.21.15.135:42486) 2024-04-20T12:31:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45ce59c640 1 -- 172.21.15.135:0/2156247292 learned_addr learned my addr 172.21.15.135:0/2156247292 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45ced9d640 1 --2- 172.21.15.135:0/2156247292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81aa640 0x561bf81b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45ce59c640 1 -- 172.21.15.135:0/2156247292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81aa640 msgr2=0x561bf81b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45ce59c640 1 --2- 172.21.15.135:0/2156247292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81aa640 0x561bf81b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45ce59c640 1 -- 172.21.15.135:0/2156247292 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81b3220 msgr2=0x561bf81b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45ce59c640 1 --2- 172.21.15.135:0/2156247292 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81b3220 0x561bf81b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.162+0000 7f45ce59c640 1 -- 172.21.15.135:0/2156247292 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bf7e213f0 con 0x561bf81a9d20 2024-04-20T12:31:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45ce59c640 1 --2- 172.21.15.135:0/2156247292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81a9d20 0x561bf81b0280 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009f70 tx=0x7f45b8013db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306aebb6b5873b37 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45b67fc640 1 -- 172.21.15.135:0/2156247292 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b8004260 con 0x561bf81a9d20 2024-04-20T12:31:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45b67fc640 1 -- 172.21.15.135:0/2156247292 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f45b8004400 con 0x561bf81a9d20 2024-04-20T12:31:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45d7dd1740 1 -- 172.21.15.135:0/2156247292 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45c0015070 con 0x561bf81a9d20 2024-04-20T12:31:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45b67fc640 1 -- 172.21.15.135:0/2156247292 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f45b800f8c0 con 0x561bf81a9d20 2024-04-20T12:31:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45d7dd1740 10 client.18069 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45d7dd1740 1 -- 172.21.15.135:0/2156247292 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561bf7de10f0 con 0x561bf81a9d20 2024-04-20T12:31:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45b67fc640 1 -- 172.21.15.135:0/2156247292 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45c0015070 con 0x561bf81a9d20 2024-04-20T12:31:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45b67fc640 1 -- 172.21.15.135:0/2156247292 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f45b801d020 con 0x561bf81a9d20 2024-04-20T12:31:21.172 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45d7dd1740 10 client.18069 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45d7dd1740 10 client.18069 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45d7dd1740 20 client.18069 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/2156247292 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561bf81c36b0 0x561bf81c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45d7dd1740 4 client.18069 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.163+0000 7f45d7dd1740 1 -- 172.21.15.135:0/2156247292 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bf811cbd0 con 0x561bf81c36b0 2024-04-20T12:31:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.164+0000 7f45ced9d640 1 --2- 172.21.15.135:0/2156247292 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561bf81c36b0 0x561bf81c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.164+0000 7f45ced9d640 1 --2- 172.21.15.135:0/2156247292 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561bf81c36b0 0x561bf81c5aa0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=457fdd3e052dfbcf server_cookie=34e0343603877325 in_seq=0 out_seq=0 2024-04-20T12:31:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.164+0000 7f45b67fc640 10 client.18069 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.165+0000 7f45b67fc640 1 -- 172.21.15.135:0/2156247292 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561bf811cbd0 con 0x561bf81c36b0 2024-04-20T12:31:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.165+0000 7f45b67fc640 10 client.18069 handle_command_reply: tid=0 2024-04-20T12:31:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.165+0000 7f45d7dd1740 1 client.18069 shutdown 2024-04-20T12:31:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.165+0000 7f45d7dd1740 1 -- 172.21.15.135:0/2156247292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81a9d20 msgr2=0x561bf81b0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.165+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/2156247292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81a9d20 0x561bf81b0280 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009f70 tx=0x7f45b8013db0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.173 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.165+0000 7f45d7dd1740 1 -- 172.21.15.135:0/2156247292 shutdown_connections 2024-04-20T12:31:21.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.165+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/2156247292 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561bf81c36b0 0x561bf81c5aa0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.165+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/2156247292 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81b3220 0x561bf81b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.165+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/2156247292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81aa640 0x561bf81b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.165+0000 7f45b67fc640 0 client.18069 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:21.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.165+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/2156247292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81a9d20 0x561bf81b0280 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.165+0000 7f45d7dd1740 1 -- 172.21.15.135:0/2156247292 >> 172.21.15.135:0/2156247292 conn(0x561bf81a4450 msgr2=0x561bf81a61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.165+0000 7f45d7dd1740 1 -- 172.21.15.135:0/2156247292 shutdown_connections 2024-04-20T12:31:21.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.165+0000 7f45d7dd1740 1 -- 172.21.15.135:0/2156247292 wait complete. 2024-04-20T12:31:21.174 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.165+0000 7f45d7dd1740 20 client.18069 trim_cache size 0 max 16384 2024-04-20T12:31:21.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.182+0000 7f45d7dd1740 1 Processor -- start 2024-04-20T12:31:21.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.182+0000 7f45d7dd1740 1 -- start start 2024-04-20T12:31:21.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45d7dd1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81a9d20 0x561bf81bef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45d7dd1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81aa640 0x561bf81a6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45d7dd1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81b3220 0x561bf81b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45d7dd1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01af410 con 0x561bf81aa640 2024-04-20T12:31:21.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45d7dd1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01b0f50 con 0x561bf81b3220 2024-04-20T12:31:21.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45d7dd1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01afae0 con 0x561bf81a9d20 2024-04-20T12:31:21.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45ced9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81aa640 0x561bf81a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45ced9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81aa640 0x561bf81a6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42502/0 (socket says 172.21.15.135:42502) 2024-04-20T12:31:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45ced9d640 1 -- 172.21.15.135:0/2775874411 learned_addr learned my addr 172.21.15.135:0/2775874411 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45ce59c640 1 --2- 172.21.15.135:0/2775874411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81b3220 0x561bf81b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45ced9d640 1 -- 172.21.15.135:0/2775874411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81a9d20 msgr2=0x561bf81bef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45ced9d640 1 --2- 172.21.15.135:0/2775874411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81a9d20 0x561bf81bef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45ced9d640 1 -- 172.21.15.135:0/2775874411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81b3220 msgr2=0x561bf81b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45ced9d640 1 --2- 172.21.15.135:0/2775874411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81b3220 0x561bf81b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45ced9d640 1 -- 172.21.15.135:0/2775874411 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bf81c6120 con 0x561bf81aa640 2024-04-20T12:31:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45ced9d640 1 --2- 172.21.15.135:0/2775874411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81aa640 0x561bf81a6110 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f45c0004630 tx=0x7f45c0013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed050b27982e352d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45c4ff9640 1 -- 172.21.15.135:0/2775874411 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0004660 con 0x561bf81aa640 2024-04-20T12:31:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45c4ff9640 1 -- 172.21.15.135:0/2775874411 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45c0015040 con 0x561bf81aa640 2024-04-20T12:31:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.183+0000 7f45c4ff9640 1 -- 172.21.15.135:0/2775874411 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c00116a0 con 0x561bf81aa640 2024-04-20T12:31:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.184+0000 7f45d7dd1740 1 -- 172.21.15.135:0/2775874411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81aa640 msgr2=0x561bf81a6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.184+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/2775874411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81aa640 0x561bf81a6110 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f45c0004630 tx=0x7f45c0013040 comp rx=0 tx=0).stop 2024-04-20T12:31:21.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.184+0000 7f45d7dd1740 1 -- 172.21.15.135:0/2775874411 shutdown_connections 2024-04-20T12:31:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.184+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/2775874411 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81b3220 0x561bf81b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.184+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/2775874411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81aa640 0x561bf81a6110 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.184+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/2775874411 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81a9d20 0x561bf81bef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.184+0000 7f45d7dd1740 1 -- 172.21.15.135:0/2775874411 >> 172.21.15.135:0/2775874411 conn(0x561bf81a4450 msgr2=0x561bf81af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.184+0000 7f45d7dd1740 1 -- 172.21.15.135:0/2775874411 shutdown_connections 2024-04-20T12:31:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.184+0000 7f45d7dd1740 1 -- 172.21.15.135:0/2775874411 wait complete. 2024-04-20T12:31:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.184+0000 7f45d7dd1740 1 -- start start 2024-04-20T12:31:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45d7dd1740 1 Processor -- start 2024-04-20T12:31:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45d7dd1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81a9d20 0x561bf81bb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45d7dd1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81aa640 0x561bf81b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45d7dd1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81b3220 0x561bf81b8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45d7dd1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01b0880 con 0x561bf81aa640 2024-04-20T12:31:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45d7dd1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01b01b0 con 0x561bf81b3220 2024-04-20T12:31:21.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45d7dd1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01ad3e0 con 0x561bf81a9d20 2024-04-20T12:31:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45d7dd1740 10 client.0 _ll_register_callbacks cb 0x7f45b8009770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45ced9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81aa640 0x561bf81b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45ced9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81aa640 0x561bf81b8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42508/0 (socket says 172.21.15.135:42508) 2024-04-20T12:31:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45ced9d640 1 -- 172.21.15.135:0/301828542 learned_addr learned my addr 172.21.15.135:0/301828542 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45ce59c640 1 --2- 172.21.15.135:0/301828542 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81b3220 0x561bf81b8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45ce59c640 1 --2- 172.21.15.135:0/301828542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81a9d20 0x561bf81bb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45ced9d640 1 -- 172.21.15.135:0/301828542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81a9d20 msgr2=0x561bf81bb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45ced9d640 1 --2- 172.21.15.135:0/301828542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81a9d20 0x561bf81bb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45ced9d640 1 -- 172.21.15.135:0/301828542 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81b3220 msgr2=0x561bf81b8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45ced9d640 1 --2- 172.21.15.135:0/301828542 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81b3220 0x561bf81b8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45ced9d640 1 -- 172.21.15.135:0/301828542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bf81b95c0 con 0x561bf81aa640 2024-04-20T12:31:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45ced9d640 1 --2- 172.21.15.135:0/301828542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81aa640 0x561bf81b8a40 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f45c0005d00 tx=0x7f45c0004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a68d8f2c9547294 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45b67fc640 1 -- 172.21.15.135:0/301828542 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0028860 con 0x561bf81aa640 2024-04-20T12:31:21.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45b67fc640 1 -- 172.21.15.135:0/301828542 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f45c0011440 con 0x561bf81aa640 2024-04-20T12:31:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.185+0000 7f45d7dd1740 1 -- 172.21.15.135:0/301828542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45c0015040 con 0x561bf81aa640 2024-04-20T12:31:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.186+0000 7f45b67fc640 1 -- 172.21.15.135:0/301828542 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f45c003a050 con 0x561bf81aa640 2024-04-20T12:31:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.186+0000 7f45d7dd1740 10 client.18075 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.186+0000 7f45d7dd1740 1 -- 172.21.15.135:0/301828542 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561bf8229a30 con 0x561bf81aa640 2024-04-20T12:31:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.186+0000 7f45b67fc640 1 -- 172.21.15.135:0/301828542 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45c0015040 con 0x561bf81aa640 2024-04-20T12:31:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.186+0000 7f45b67fc640 1 -- 172.21.15.135:0/301828542 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f45c00265c0 con 0x561bf81aa640 2024-04-20T12:31:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.186+0000 7f45d7dd1740 10 client.18075 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.186+0000 7f45d7dd1740 10 client.18075 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.186+0000 7f45d7dd1740 20 client.18075 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.186+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/301828542 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561bf8229f20 0x561bf822c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.186+0000 7f45d7dd1740 4 client.18075 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:31:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.186+0000 7f45d7dd1740 1 -- 172.21.15.135:0/301828542 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561bf8116a40 con 0x561bf8229f20 2024-04-20T12:31:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.186+0000 7f45ce59c640 1 --2- 172.21.15.135:0/301828542 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561bf8229f20 0x561bf822c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.186+0000 7f45b67fc640 10 client.18075 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:21.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.186+0000 7f45ce59c640 1 --2- 172.21.15.135:0/301828542 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561bf8229f20 0x561bf822c340 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d634cfe6f1c3584 server_cookie=d0663db38f2416a4 in_seq=0 out_seq=0 2024-04-20T12:31:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45b67fc640 1 -- 172.21.15.135:0/301828542 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561bf8116a40 con 0x561bf8229f20 2024-04-20T12:31:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45b67fc640 10 client.18075 handle_command_reply: tid=0 2024-04-20T12:31:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d7dd1740 1 client.18075 shutdown 2024-04-20T12:31:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d7dd1740 1 -- 172.21.15.135:0/301828542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81aa640 msgr2=0x561bf81b8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/301828542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81aa640 0x561bf81b8a40 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f45c0005d00 tx=0x7f45c0004660 comp rx=0 tx=0).stop 2024-04-20T12:31:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d7dd1740 1 -- 172.21.15.135:0/301828542 shutdown_connections 2024-04-20T12:31:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/301828542 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561bf8229f20 0x561bf822c340 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/301828542 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561bf81b3220 0x561bf81b8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/301828542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561bf81aa640 0x561bf81b8a40 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d7dd1740 1 --2- 172.21.15.135:0/301828542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561bf81a9d20 0x561bf81bb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d7dd1740 1 -- 172.21.15.135:0/301828542 >> 172.21.15.135:0/301828542 conn(0x561bf81a4450 msgr2=0x561bf81a3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45b67fc640 0 client.18075 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:21.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d7dd1740 1 -- 172.21.15.135:0/301828542 shutdown_connections 2024-04-20T12:31:21.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d7dd1740 1 -- 172.21.15.135:0/301828542 wait complete. 2024-04-20T12:31:21.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d7dd1740 20 client.18075 trim_cache size 0 max 16384 2024-04-20T12:31:21.194 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:31:21.194 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:31:21.194 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:31:21.194 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:31:21.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d5104640 1 -- 172.21.15.135:0/942894658 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f45bc0a3d20 msgr2=0x7f45bc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d5104640 1 --2- 172.21.15.135:0/942894658 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f45bc0a3d20 0x7f45bc0a61e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f45c80bb100 tx=0x7f45c80906e0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d5104640 1 -- 172.21.15.135:0/942894658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d010c520 msgr2=0x7f45d0198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d5104640 1 --2- 172.21.15.135:0/942894658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d010c520 0x7f45d0198660 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f45c802c840 tx=0x7f45c8035d90 comp rx=0 tx=0).stop 2024-04-20T12:31:21.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d5104640 1 -- 172.21.15.135:0/942894658 shutdown_connections 2024-04-20T12:31:21.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d5104640 1 --2- 172.21.15.135:0/942894658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45d010c520 0x7f45d0198660 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d5104640 1 --2- 172.21.15.135:0/942894658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45d0103b00 0x7f45d019e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d5104640 1 --2- 172.21.15.135:0/942894658 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f45bc0a3d20 0x7f45bc0a61e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d5104640 1 --2- 172.21.15.135:0/942894658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45d01031e0 0x7f45d019e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.187+0000 7f45d5104640 1 -- 172.21.15.135:0/942894658 >> 172.21.15.135:0/942894658 conn(0x7f45d0077f60 msgr2=0x7f45d00fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.188+0000 7f45d5104640 1 -- 172.21.15.135:0/942894658 shutdown_connections 2024-04-20T12:31:21.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.188+0000 7f45d5104640 1 -- 172.21.15.135:0/942894658 wait complete. 2024-04-20T12:31:21.197 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:20 smithi135 ceph-mon[18264]: pgmap v253: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:31:21.198 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:31:21.198 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:31:21.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:20 smithi154 ceph-mon[22073]: pgmap v253: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:31:21.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.297+0000 7f990333b640 1 -- 172.21.15.135:0/3889253093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98fc107270 msgr2=0x7f98fc10ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.297+0000 7f990333b640 1 --2- 172.21.15.135:0/3889253093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98fc107270 0x7f98fc10ee40 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009ca0 tx=0x7f98f402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.297+0000 7f990333b640 1 -- 172.21.15.135:0/3889253093 shutdown_connections 2024-04-20T12:31:21.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.297+0000 7f990333b640 1 --2- 172.21.15.135:0/3889253093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98fc107270 0x7f98fc10ee40 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.297+0000 7f990333b640 1 --2- 172.21.15.135:0/3889253093 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98fc102b50 0x7f98fc106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.297+0000 7f990333b640 1 --2- 172.21.15.135:0/3889253093 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98fc1021a0 0x7f98fc102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.297+0000 7f990333b640 1 -- 172.21.15.135:0/3889253093 >> 172.21.15.135:0/3889253093 conn(0x7f98fc079320 msgr2=0x7f98fc079730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.297+0000 7f990333b640 1 -- 172.21.15.135:0/3889253093 shutdown_connections 2024-04-20T12:31:21.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.297+0000 7f990333b640 1 -- 172.21.15.135:0/3889253093 wait complete. 2024-04-20T12:31:21.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f990333b640 1 Processor -- start 2024-04-20T12:31:21.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f990333b640 1 -- start start 2024-04-20T12:31:21.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f990333b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98fc1021a0 0x7f98fc19e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f990333b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98fc107270 0x7f98fc19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f990333b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98fc198590 0x7f98fc198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f990333b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc112330 con 0x7f98fc1021a0 2024-04-20T12:31:21.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f990333b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc1121b0 con 0x7f98fc198590 2024-04-20T12:31:21.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f990333b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc1124b0 con 0x7f98fc107270 2024-04-20T12:31:21.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f99010d7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98fc1021a0 0x7f98fc19e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f99010d7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98fc1021a0 0x7f98fc19e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42532/0 (socket says 172.21.15.135:42532) 2024-04-20T12:31:21.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f99010d7640 1 -- 172.21.15.135:0/2983825345 learned_addr learned my addr 172.21.15.135:0/2983825345 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f99018d8640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98fc198590 0x7f98fc198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f99008d6640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98fc107270 0x7f98fc19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f99010d7640 1 -- 172.21.15.135:0/2983825345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98fc107270 msgr2=0x7f98fc19e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f99010d7640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98fc107270 0x7f98fc19e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f99010d7640 1 -- 172.21.15.135:0/2983825345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98fc198590 msgr2=0x7f98fc198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f99010d7640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98fc198590 0x7f98fc198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f99010d7640 1 -- 172.21.15.135:0/2983825345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc1990b0 con 0x7f98fc1021a0 2024-04-20T12:31:21.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f99018d8640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98fc198590 0x7f98fc198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:21.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f99008d6640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98fc107270 0x7f98fc19e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:21.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.298+0000 7f99010d7640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98fc1021a0 0x7f98fc19e3e0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c970 tx=0x7f98f800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.299+0000 7f98f27fc640 1 -- 172.21.15.135:0/2983825345 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8007bb0 con 0x7f98fc1021a0 2024-04-20T12:31:21.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.299+0000 7f98f27fc640 1 -- 172.21.15.135:0/2983825345 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98f8007d50 con 0x7f98fc1021a0 2024-04-20T12:31:21.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.299+0000 7f990333b640 1 -- 172.21.15.135:0/2983825345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98fc1993a0 con 0x7f98fc1021a0 2024-04-20T12:31:21.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.299+0000 7f98f27fc640 1 -- 172.21.15.135:0/2983825345 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f800f450 con 0x7f98fc1021a0 2024-04-20T12:31:21.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.299+0000 7f990333b640 1 -- 172.21.15.135:0/2983825345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98fc1a55a0 con 0x7f98fc1021a0 2024-04-20T12:31:21.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.300+0000 7f990333b640 1 -- 172.21.15.135:0/2983825345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98fc0691d0 con 0x7f98fc1021a0 2024-04-20T12:31:21.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.301+0000 7f98f27fc640 1 -- 172.21.15.135:0/2983825345 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f98f8004fe0 con 0x7f98fc1021a0 2024-04-20T12:31:21.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.301+0000 7f98f27fc640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f98e80a3d20 0x7f98e80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.301+0000 7f99008d6640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f98e80a3d20 0x7f98e80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.301+0000 7f98f27fc640 1 -- 172.21.15.135:0/2983825345 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f98f80d0e30 con 0x7f98fc1021a0 2024-04-20T12:31:21.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.302+0000 7f99008d6640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f98e80a3d20 0x7f98e80a61e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0ff700 tx=0x7f98ec005d20 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.305+0000 7f98f27fc640 1 -- 172.21.15.135:0/2983825345 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f98f8014030 con 0x7f98fc1021a0 2024-04-20T12:31:21.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:20 smithi139 ceph-mon[21834]: pgmap v253: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:31:21.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.519+0000 7f990333b640 1 -- 172.21.15.135:0/2983825345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98fc199ac0 con 0x7f98fc1021a0 2024-04-20T12:31:21.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.520+0000 7f98f27fc640 1 -- 172.21.15.135:0/2983825345 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7f98f809d100 con 0x7f98fc1021a0 2024-04-20T12:31:21.519 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:31:21.520 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:31:21.520 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:31:21.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.522+0000 7f990333b640 1 -- 172.21.15.135:0/2983825345 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f98e80a3d20 msgr2=0x7f98e80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.522+0000 7f990333b640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f98e80a3d20 0x7f98e80a61e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f98fc0ff700 tx=0x7f98ec005d20 comp rx=0 tx=0).stop 2024-04-20T12:31:21.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.522+0000 7f990333b640 1 -- 172.21.15.135:0/2983825345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98fc1021a0 msgr2=0x7f98fc19e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.522+0000 7f990333b640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98fc1021a0 0x7f98fc19e3e0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f98f800c970 tx=0x7f98f800ce30 comp rx=0 tx=0).stop 2024-04-20T12:31:21.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.522+0000 7f990333b640 1 -- 172.21.15.135:0/2983825345 shutdown_connections 2024-04-20T12:31:21.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.522+0000 7f990333b640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f98fc198590 0x7f98fc198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.522+0000 7f990333b640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f98e80a3d20 0x7f98e80a61e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.522+0000 7f990333b640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98fc107270 0x7f98fc19e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.522+0000 7f990333b640 1 --2- 172.21.15.135:0/2983825345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f98fc1021a0 0x7f98fc19e3e0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.522+0000 7f990333b640 1 -- 172.21.15.135:0/2983825345 >> 172.21.15.135:0/2983825345 conn(0x7f98fc079320 msgr2=0x7f98fc0fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.522+0000 7f990333b640 1 -- 172.21.15.135:0/2983825345 shutdown_connections 2024-04-20T12:31:21.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.522+0000 7f990333b640 1 -- 172.21.15.135:0/2983825345 wait complete. 2024-04-20T12:31:21.533 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:31:21.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.633+0000 7fd3f05ca640 1 -- 172.21.15.135:0/930266379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3e8102b60 msgr2=0x7fd3e8106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.633+0000 7fd3f05ca640 1 --2- 172.21.15.135:0/930266379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3e8102b60 0x7fd3e8106ba0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009900 tx=0x7fd3e402bc30 comp rx=0 tx=0).stop 2024-04-20T12:31:21.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.633+0000 7fd3f05ca640 1 -- 172.21.15.135:0/930266379 shutdown_connections 2024-04-20T12:31:21.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.633+0000 7fd3f05ca640 1 --2- 172.21.15.135:0/930266379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e8107280 0x7fd3e810ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.633+0000 7fd3f05ca640 1 --2- 172.21.15.135:0/930266379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3e8102b60 0x7fd3e8106ba0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.633+0000 7fd3f05ca640 1 --2- 172.21.15.135:0/930266379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3e81021b0 0x7fd3e8102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.633+0000 7fd3f05ca640 1 -- 172.21.15.135:0/930266379 >> 172.21.15.135:0/930266379 conn(0x7fd3e80793f0 msgr2=0x7fd3e8079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.633+0000 7fd3f05ca640 1 -- 172.21.15.135:0/930266379 shutdown_connections 2024-04-20T12:31:21.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.633+0000 7fd3f05ca640 1 -- 172.21.15.135:0/930266379 wait complete. 2024-04-20T12:31:21.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.633+0000 7fd3f05ca640 1 Processor -- start 2024-04-20T12:31:21.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.633+0000 7fd3f05ca640 1 -- start start 2024-04-20T12:31:21.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3f05ca640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3e81021b0 0x7fd3e819e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3f05ca640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3e8107280 0x7fd3e819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3f05ca640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e81985b0 0x7fd3e8198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3f05ca640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e8112310 con 0x7fd3e8107280 2024-04-20T12:31:21.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3f05ca640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e8112190 con 0x7fd3e81021b0 2024-04-20T12:31:21.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3f05ca640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e8112490 con 0x7fd3e81985b0 2024-04-20T12:31:21.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3edb65640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3e8107280 0x7fd3e819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3edb65640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3e8107280 0x7fd3e819e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42556/0 (socket says 172.21.15.135:42556) 2024-04-20T12:31:21.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3edb65640 1 -- 172.21.15.135:0/3216651257 learned_addr learned my addr 172.21.15.135:0/3216651257 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3ee366640 1 --2- 172.21.15.135:0/3216651257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3e81021b0 0x7fd3e819e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3edb65640 1 -- 172.21.15.135:0/3216651257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e81985b0 msgr2=0x7fd3e8198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3edb65640 1 --2- 172.21.15.135:0/3216651257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e81985b0 0x7fd3e8198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3edb65640 1 -- 172.21.15.135:0/3216651257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3e81021b0 msgr2=0x7fd3e819e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3edb65640 1 --2- 172.21.15.135:0/3216651257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3e81021b0 0x7fd3e819e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3edb65640 1 -- 172.21.15.135:0/3216651257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e81990d0 con 0x7fd3e8107280 2024-04-20T12:31:21.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3edb65640 1 --2- 172.21.15.135:0/3216651257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3e8107280 0x7fd3e819e940 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4000c00 tx=0x7fd3e402cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3df7fe640 1 -- 172.21.15.135:0/3216651257 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4041070 con 0x7fd3e8107280 2024-04-20T12:31:21.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3df7fe640 1 -- 172.21.15.135:0/3216651257 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3e4004450 con 0x7fd3e8107280 2024-04-20T12:31:21.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3df7fe640 1 -- 172.21.15.135:0/3216651257 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4034440 con 0x7fd3e8107280 2024-04-20T12:31:21.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3f05ca640 1 -- 172.21.15.135:0/3216651257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e8199360 con 0x7fd3e8107280 2024-04-20T12:31:21.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.634+0000 7fd3f05ca640 1 -- 172.21.15.135:0/3216651257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e81a5550 con 0x7fd3e8107280 2024-04-20T12:31:21.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.637+0000 7fd3df7fe640 1 -- 172.21.15.135:0/3216651257 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fd3e4044070 con 0x7fd3e8107280 2024-04-20T12:31:21.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.637+0000 7fd3f31b6740 1 Processor -- start 2024-04-20T12:31:21.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.637+0000 7fd3f31b6740 1 -- start start 2024-04-20T12:31:21.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.637+0000 7fd3f31b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e92e10 0x5563e1e931f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.637+0000 7fd3f31b6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e93730 0x5563e1e9bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.637+0000 7fd3f31b6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e9c310 0x5563e1e9e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.637+0000 7fd3f31b6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5563e1df8110 con 0x5563e1e93730 2024-04-20T12:31:21.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.637+0000 7fd3f31b6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5563e1d95550 con 0x5563e1e9c310 2024-04-20T12:31:21.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.637+0000 7fd3f31b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5563e1df40d0 con 0x5563e1e92e10 2024-04-20T12:31:21.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3df7fe640 1 --2- 172.21.15.135:0/3216651257 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3d40a3d20 0x7fd3d40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3ee366640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e93730 0x5563e1e9bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3ee366640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e93730 0x5563e1e9bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42572/0 (socket says 172.21.15.135:42572) 2024-04-20T12:31:21.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3ee366640 1 -- 172.21.15.135:0/4120917742 learned_addr learned my addr 172.21.15.135:0/4120917742 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3eeb67640 1 --2- 172.21.15.135:0/4120917742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e92e10 0x5563e1e931f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3eeb67640 1 --2- 172.21.15.135:0/3216651257 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3d40a3d20 0x7fd3d40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3df7fe640 1 -- 172.21.15.135:0/3216651257 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7fd3e40f2840 con 0x7fd3e8107280 2024-04-20T12:31:21.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3edb65640 1 --2- 172.21.15.135:0/4120917742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e9c310 0x5563e1e9e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3ee366640 1 -- 172.21.15.135:0/4120917742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e92e10 msgr2=0x5563e1e931f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3ee366640 1 --2- 172.21.15.135:0/4120917742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e92e10 0x5563e1e931f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3ee366640 1 -- 172.21.15.135:0/4120917742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e9c310 msgr2=0x5563e1e9e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3ee366640 1 --2- 172.21.15.135:0/4120917742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e9c310 0x5563e1e9e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3ee366640 1 -- 172.21.15.135:0/4120917742 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e1dbd900 con 0x5563e1e93730 2024-04-20T12:31:21.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3edb65640 1 --2- 172.21.15.135:0/4120917742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e9c310 0x5563e1e9e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:21.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3eeb67640 1 --2- 172.21.15.135:0/3216651257 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3d40a3d20 0x7fd3d40a61e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0013980 tx=0x7fd3e0005d90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3ee366640 1 --2- 172.21.15.135:0/4120917742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e93730 0x5563e1e9bdd0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800cc60 tx=0x7fd3d800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cffaca5d76802c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3dcbfe640 1 -- 172.21.15.135:0/4120917742 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8014070 con 0x5563e1e93730 2024-04-20T12:31:21.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3dcbfe640 1 -- 172.21.15.135:0/4120917742 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3d80047a0 con 0x5563e1e93730 2024-04-20T12:31:21.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.638+0000 7fd3dcbfe640 1 -- 172.21.15.135:0/4120917742 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d8010760 con 0x5563e1e93730 2024-04-20T12:31:21.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.639+0000 7fd3f31b6740 1 -- 172.21.15.135:0/4120917742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e93730 msgr2=0x5563e1e9bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.639+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/4120917742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e93730 0x5563e1e9bdd0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800cc60 tx=0x7fd3d800e720 comp rx=0 tx=0).stop 2024-04-20T12:31:21.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.639+0000 7fd3f31b6740 1 -- 172.21.15.135:0/4120917742 shutdown_connections 2024-04-20T12:31:21.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.639+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/4120917742 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e9c310 0x5563e1e9e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.639+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/4120917742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e93730 0x5563e1e9bdd0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.639+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/4120917742 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e92e10 0x5563e1e931f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.639+0000 7fd3f31b6740 1 -- 172.21.15.135:0/4120917742 >> 172.21.15.135:0/4120917742 conn(0x5563e1e8d540 msgr2=0x5563e1e8d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.639+0000 7fd3f31b6740 1 -- 172.21.15.135:0/4120917742 shutdown_connections 2024-04-20T12:31:21.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.639+0000 7fd3f31b6740 1 -- 172.21.15.135:0/4120917742 wait complete. 2024-04-20T12:31:21.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3f31b6740 1 -- start start 2024-04-20T12:31:21.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3f31b6740 1 Processor -- start 2024-04-20T12:31:21.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3f31b6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e92e10 0x5563e1e99310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3f31b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e93730 0x5563e1e99850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.649 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3f31b6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e9c310 0x5563e1e99d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3f31b6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5563e1e9f040 con 0x5563e1e9c310 2024-04-20T12:31:21.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3f31b6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5563e1db1500 con 0x5563e1e92e10 2024-04-20T12:31:21.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3f31b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5563e1e9f1c0 con 0x5563e1e93730 2024-04-20T12:31:21.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3f31b6740 10 client.0 _ll_register_callbacks cb 0x5563e1d962f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:21.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3eeb67640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e9c310 0x5563e1e99d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3eeb67640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e9c310 0x5563e1e99d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42586/0 (socket says 172.21.15.135:42586) 2024-04-20T12:31:21.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3eeb67640 1 -- 172.21.15.135:0/248839548 learned_addr learned my addr 172.21.15.135:0/248839548 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3edb65640 1 --2- 172.21.15.135:0/248839548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e93730 0x5563e1e99850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3ee366640 1 --2- 172.21.15.135:0/248839548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e92e10 0x5563e1e99310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3eeb67640 1 -- 172.21.15.135:0/248839548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e93730 msgr2=0x5563e1e99850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3eeb67640 1 --2- 172.21.15.135:0/248839548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e93730 0x5563e1e99850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3eeb67640 1 -- 172.21.15.135:0/248839548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e92e10 msgr2=0x5563e1e99310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3eeb67640 1 --2- 172.21.15.135:0/248839548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e92e10 0x5563e1e99310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.650 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3eeb67640 1 -- 172.21.15.135:0/248839548 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563e1b0a3f0 con 0x5563e1e9c310 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3eeb67640 1 --2- 172.21.15.135:0/248839548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e9c310 0x5563e1e99d90 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0013710 tx=0x7fd3e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10cd5d2ff20cd2c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.640+0000 7fd3d1ffb640 1 -- 172.21.15.135:0/248839548 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0025070 con 0x5563e1e9c310 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3d1ffb640 1 -- 172.21.15.135:0/248839548 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7fd3e000ccf0 con 0x5563e1e9c310 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3f31b6740 1 -- 172.21.15.135:0/248839548 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3d80047a0 con 0x5563e1e9c310 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3d1ffb640 1 -- 172.21.15.135:0/248839548 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd3e0031050 con 0x5563e1e9c310 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3f31b6740 10 client.18093 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3f31b6740 1 -- 172.21.15.135:0/248839548 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5563e1bd47d0 con 0x5563e1e9c310 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3d1ffb640 1 -- 172.21.15.135:0/248839548 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3d80047a0 con 0x5563e1e9c310 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3d1ffb640 1 -- 172.21.15.135:0/248839548 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fd3e001d040 con 0x5563e1e9c310 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3f31b6740 10 client.18093 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3f31b6740 10 client.18093 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3f31b6740 20 client.18093 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/248839548 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5563e1eac620 0x5563e1eaea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3f31b6740 4 client.18093 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:21.651 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3f31b6740 1 -- 172.21.15.135:0/248839548 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563e1e05b30 con 0x5563e1eac620 2024-04-20T12:31:21.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3ee366640 1 --2- 172.21.15.135:0/248839548 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5563e1eac620 0x5563e1eaea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3ee366640 1 --2- 172.21.15.135:0/248839548 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5563e1eac620 0x5563e1eaea90 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e6fea84b15bec5c2 server_cookie=987971a2b843aa10 in_seq=0 out_seq=0 2024-04-20T12:31:21.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.641+0000 7fd3d1ffb640 10 client.18093 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:31:21.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.642+0000 7fd3d1ffb640 1 -- 172.21.15.135:0/248839548 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5563e1e05b30 con 0x5563e1eac620 2024-04-20T12:31:21.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.642+0000 7fd3d1ffb640 10 client.18093 handle_command_reply: tid=0 2024-04-20T12:31:21.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.642+0000 7fd3f31b6740 1 client.18093 shutdown 2024-04-20T12:31:21.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.642+0000 7fd3f31b6740 1 -- 172.21.15.135:0/248839548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e9c310 msgr2=0x5563e1e99d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.642+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/248839548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e9c310 0x5563e1e99d90 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0013710 tx=0x7fd3e0004a40 comp rx=0 tx=0).stop 2024-04-20T12:31:21.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.642+0000 7fd3f31b6740 1 -- 172.21.15.135:0/248839548 shutdown_connections 2024-04-20T12:31:21.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.642+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/248839548 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5563e1eac620 0x5563e1eaea90 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.642+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/248839548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e9c310 0x5563e1e99d90 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.642+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/248839548 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e93730 0x5563e1e99850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.642+0000 7fd3d1ffb640 0 client.18093 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:31:21.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.642+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/248839548 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e92e10 0x5563e1e99310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.652 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.642+0000 7fd3f31b6740 1 -- 172.21.15.135:0/248839548 >> 172.21.15.135:0/248839548 conn(0x5563e1e8d540 msgr2=0x5563e1e8f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.642+0000 7fd3f31b6740 1 -- 172.21.15.135:0/248839548 shutdown_connections 2024-04-20T12:31:21.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.642+0000 7fd3f31b6740 1 -- 172.21.15.135:0/248839548 wait complete. 2024-04-20T12:31:21.653 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.642+0000 7fd3f31b6740 20 client.18093 trim_cache size 0 max 16384 2024-04-20T12:31:21.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.655+0000 7fd3f31b6740 1 Processor -- start 2024-04-20T12:31:21.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.655+0000 7fd3f31b6740 1 -- start start 2024-04-20T12:31:21.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3f31b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e92e10 0x5563e1e9ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3f31b6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e93730 0x5563e1ea7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3f31b6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e9c310 0x5563e1e88570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3f31b6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e81af430 con 0x5563e1e93730 2024-04-20T12:31:21.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3f31b6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e81b0f70 con 0x5563e1e9c310 2024-04-20T12:31:21.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3f31b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e81afb00 con 0x5563e1e92e10 2024-04-20T12:31:21.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3edb65640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e93730 0x5563e1ea7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3edb65640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e93730 0x5563e1ea7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42600/0 (socket says 172.21.15.135:42600) 2024-04-20T12:31:21.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3edb65640 1 -- 172.21.15.135:0/184256491 learned_addr learned my addr 172.21.15.135:0/184256491 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3eeb67640 1 --2- 172.21.15.135:0/184256491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e9c310 0x5563e1e88570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3ee366640 1 --2- 172.21.15.135:0/184256491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e92e10 0x5563e1e9ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3edb65640 1 -- 172.21.15.135:0/184256491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e92e10 msgr2=0x5563e1e9ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3edb65640 1 --2- 172.21.15.135:0/184256491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e92e10 0x5563e1e9ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3edb65640 1 -- 172.21.15.135:0/184256491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e9c310 msgr2=0x5563e1e88570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3edb65640 1 --2- 172.21.15.135:0/184256491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e9c310 0x5563e1e88570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3edb65640 1 -- 172.21.15.135:0/184256491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e1e982c0 con 0x5563e1e93730 2024-04-20T12:31:21.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3edb65640 1 --2- 172.21.15.135:0/184256491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e93730 0x5563e1ea7ff0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fd3e40f2b20 tx=0x7fd3e40be150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5898cbcfcc7acf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3d3fff640 1 -- 172.21.15.135:0/184256491 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e404b040 con 0x5563e1e93730 2024-04-20T12:31:21.663 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3d3fff640 1 -- 172.21.15.135:0/184256491 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3e40c7190 con 0x5563e1e93730 2024-04-20T12:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.656+0000 7fd3d3fff640 1 -- 172.21.15.135:0/184256491 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e40f2680 con 0x5563e1e93730 2024-04-20T12:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.657+0000 7fd3f31b6740 1 -- 172.21.15.135:0/184256491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e93730 msgr2=0x5563e1ea7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.657+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/184256491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e93730 0x5563e1ea7ff0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fd3e40f2b20 tx=0x7fd3e40be150 comp rx=0 tx=0).stop 2024-04-20T12:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.657+0000 7fd3f31b6740 1 -- 172.21.15.135:0/184256491 shutdown_connections 2024-04-20T12:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.657+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/184256491 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e9c310 0x5563e1e88570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.657+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/184256491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e93730 0x5563e1ea7ff0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.657+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/184256491 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e92e10 0x5563e1e9ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.664 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.657+0000 7fd3f31b6740 1 -- 172.21.15.135:0/184256491 >> 172.21.15.135:0/184256491 conn(0x5563e1e8d540 msgr2=0x5563e1e8c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.657+0000 7fd3f31b6740 1 -- 172.21.15.135:0/184256491 shutdown_connections 2024-04-20T12:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.657+0000 7fd3f31b6740 1 -- 172.21.15.135:0/184256491 wait complete. 2024-04-20T12:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.657+0000 7fd3f31b6740 1 -- start start 2024-04-20T12:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.657+0000 7fd3f31b6740 1 Processor -- start 2024-04-20T12:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.657+0000 7fd3f31b6740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e92e10 0x5563e1ea4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3f31b6740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e93730 0x5563e1e9fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.665 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3f31b6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e9c310 0x5563e1ea0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3f31b6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e81b08a0 con 0x5563e1e9c310 2024-04-20T12:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3f31b6740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e81b01d0 con 0x5563e1e93730 2024-04-20T12:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3f31b6740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e81ad400 con 0x5563e1e92e10 2024-04-20T12:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3f31b6740 10 client.0 _ll_register_callbacks cb 0x7fd3e0013640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3eeb67640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e9c310 0x5563e1ea0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3eeb67640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e9c310 0x5563e1ea0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42614/0 (socket says 172.21.15.135:42614) 2024-04-20T12:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3eeb67640 1 -- 172.21.15.135:0/3730974958 learned_addr learned my addr 172.21.15.135:0/3730974958 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3edb65640 1 --2- 172.21.15.135:0/3730974958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e93730 0x5563e1e9fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3eeb67640 1 -- 172.21.15.135:0/3730974958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e92e10 msgr2=0x5563e1ea4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3eeb67640 1 --2- 172.21.15.135:0/3730974958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e92e10 0x5563e1ea4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3eeb67640 1 -- 172.21.15.135:0/3730974958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e93730 msgr2=0x5563e1e9fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3eeb67640 1 --2- 172.21.15.135:0/3730974958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e93730 0x5563e1e9fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3eeb67640 1 -- 172.21.15.135:0/3730974958 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563e1ea0540 con 0x5563e1e9c310 2024-04-20T12:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3edb65640 1 --2- 172.21.15.135:0/3730974958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e93730 0x5563e1e9fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3eeb67640 1 --2- 172.21.15.135:0/3730974958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e9c310 0x5563e1ea0000 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fd3e001d4a0 tx=0x7fd3e000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654eb1de0dc5b455 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3d1ffb640 1 -- 172.21.15.135:0/3730974958 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e003a060 con 0x5563e1e9c310 2024-04-20T12:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3d1ffb640 1 -- 172.21.15.135:0/3730974958 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7fd3e000ccf0 con 0x5563e1e9c310 2024-04-20T12:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3f31b6740 1 -- 172.21.15.135:0/3730974958 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3e40c7190 con 0x5563e1e9c310 2024-04-20T12:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3d1ffb640 1 -- 172.21.15.135:0/3730974958 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd3e0041050 con 0x5563e1e9c310 2024-04-20T12:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3f31b6740 10 client.18099 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3f31b6740 1 -- 172.21.15.135:0/3730974958 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5563e1f16cb0 con 0x5563e1e9c310 2024-04-20T12:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.658+0000 7fd3d1ffb640 1 -- 172.21.15.135:0/3730974958 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3e40c7190 con 0x5563e1e9c310 2024-04-20T12:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3d1ffb640 1 -- 172.21.15.135:0/3730974958 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fd3e001d040 con 0x5563e1e9c310 2024-04-20T12:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 10 client.18099 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 10 client.18099 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 20 client.18099 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:21.667 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/3730974958 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5563e1f17380 0x5563e1f197e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 4 client.18099 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 1 -- 172.21.15.135:0/3730974958 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5563e1dff9a0 con 0x5563e1f17380 2024-04-20T12:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3ee366640 1 --2- 172.21.15.135:0/3730974958 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5563e1f17380 0x5563e1f197e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3d1ffb640 10 client.18099 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3ee366640 1 --2- 172.21.15.135:0/3730974958 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5563e1f17380 0x5563e1f197e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1708b87c1eed211f server_cookie=388894e4bbacf67c in_seq=0 out_seq=0 2024-04-20T12:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3d1ffb640 1 -- 172.21.15.135:0/3730974958 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5563e1dff9a0 con 0x5563e1f17380 2024-04-20T12:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3d1ffb640 10 client.18099 handle_command_reply: tid=0 2024-04-20T12:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 1 client.18099 shutdown 2024-04-20T12:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 1 -- 172.21.15.135:0/3730974958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e9c310 msgr2=0x5563e1ea0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/3730974958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e9c310 0x5563e1ea0000 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fd3e001d4a0 tx=0x7fd3e000c870 comp rx=0 tx=0).stop 2024-04-20T12:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 1 -- 172.21.15.135:0/3730974958 shutdown_connections 2024-04-20T12:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/3730974958 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5563e1f17380 0x5563e1f197e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/3730974958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563e1e9c310 0x5563e1ea0000 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3d1ffb640 0 client.18099 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:31:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/3730974958 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5563e1e93730 0x5563e1e9fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 1 --2- 172.21.15.135:0/3730974958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5563e1e92e10 0x5563e1ea4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 1 -- 172.21.15.135:0/3730974958 >> 172.21.15.135:0/3730974958 conn(0x5563e1e8d540 msgr2=0x5563e1e992d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 1 -- 172.21.15.135:0/3730974958 shutdown_connections 2024-04-20T12:31:21.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.659+0000 7fd3f31b6740 1 -- 172.21.15.135:0/3730974958 wait complete. 2024-04-20T12:31:21.669 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.660+0000 7fd3f31b6740 20 client.18099 trim_cache size 0 max 16384 2024-04-20T12:31:21.669 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:31:21.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.660+0000 7fd3f05ca640 1 -- 172.21.15.135:0/3216651257 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3d40a3d20 msgr2=0x7fd3d40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.660+0000 7fd3f05ca640 1 --2- 172.21.15.135:0/3216651257 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3d40a3d20 0x7fd3d40a61e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0013980 tx=0x7fd3e0005d90 comp rx=0 tx=0).stop 2024-04-20T12:31:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.660+0000 7fd3f05ca640 1 -- 172.21.15.135:0/3216651257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3e8107280 msgr2=0x7fd3e819e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.660+0000 7fd3f05ca640 1 --2- 172.21.15.135:0/3216651257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3e8107280 0x7fd3e819e940 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4000c00 tx=0x7fd3e402cc70 comp rx=0 tx=0).stop 2024-04-20T12:31:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.660+0000 7fd3f05ca640 1 -- 172.21.15.135:0/3216651257 shutdown_connections 2024-04-20T12:31:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.660+0000 7fd3f05ca640 1 --2- 172.21.15.135:0/3216651257 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd3d40a3d20 0x7fd3d40a61e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.660+0000 7fd3f05ca640 1 --2- 172.21.15.135:0/3216651257 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd3e81985b0 0x7fd3e8198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.660+0000 7fd3f05ca640 1 --2- 172.21.15.135:0/3216651257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3e8107280 0x7fd3e819e940 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.660+0000 7fd3f05ca640 1 --2- 172.21.15.135:0/3216651257 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd3e81021b0 0x7fd3e819e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.660+0000 7fd3f05ca640 1 -- 172.21.15.135:0/3216651257 >> 172.21.15.135:0/3216651257 conn(0x7fd3e80793f0 msgr2=0x7fd3e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.660+0000 7fd3f05ca640 1 -- 172.21.15.135:0/3216651257 shutdown_connections 2024-04-20T12:31:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.660+0000 7fd3f05ca640 1 -- 172.21.15.135:0/3216651257 wait complete. 2024-04-20T12:31:21.672 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:31:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.772+0000 7f21370c1640 1 -- 172.21.15.135:0/3838862536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21301011b0 msgr2=0x7f2130101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.772+0000 7f21370c1640 1 --2- 172.21.15.135:0/3838862536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21301011b0 0x7f2130101610 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f211c009900 tx=0x7f211c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:31:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.772+0000 7f21370c1640 1 -- 172.21.15.135:0/3838862536 shutdown_connections 2024-04-20T12:31:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.772+0000 7f21370c1640 1 --2- 172.21.15.135:0/3838862536 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2130101b50 0x7f213010dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.772+0000 7f21370c1640 1 --2- 172.21.15.135:0/3838862536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21301011b0 0x7f2130101610 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.774 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.772+0000 7f21370c1640 1 --2- 172.21.15.135:0/3838862536 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2130106fa0 0x7f2130107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.772+0000 7f21370c1640 1 -- 172.21.15.135:0/3838862536 >> 172.21.15.135:0/3838862536 conn(0x7f2130076c60 msgr2=0x7f2130077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.772+0000 7f21370c1640 1 -- 172.21.15.135:0/3838862536 shutdown_connections 2024-04-20T12:31:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.772+0000 7f21370c1640 1 -- 172.21.15.135:0/3838862536 wait complete. 2024-04-20T12:31:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f21370c1640 1 Processor -- start 2024-04-20T12:31:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f21370c1640 1 -- start start 2024-04-20T12:31:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f21370c1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21301011b0 0x7f21301996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f21370c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2130101b50 0x7f2130199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f21370c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2130106fa0 0x7f21301a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f21370c1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2130111240 con 0x7f2130106fa0 2024-04-20T12:31:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f21370c1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f21301110c0 con 0x7f2130101b50 2024-04-20T12:31:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f21370c1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21301113c0 con 0x7f21301011b0 2024-04-20T12:31:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f213565e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2130106fa0 0x7f21301a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f213565e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2130106fa0 0x7f21301a4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42628/0 (socket says 172.21.15.135:42628) 2024-04-20T12:31:21.775 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f213565e640 1 -- 172.21.15.135:0/236022152 learned_addr learned my addr 172.21.15.135:0/236022152 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f2134e5d640 1 --2- 172.21.15.135:0/236022152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21301011b0 0x7f21301996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f212ffff640 1 --2- 172.21.15.135:0/236022152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2130101b50 0x7f2130199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f213565e640 1 -- 172.21.15.135:0/236022152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21301011b0 msgr2=0x7f21301996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f213565e640 1 --2- 172.21.15.135:0/236022152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21301011b0 0x7f21301996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f213565e640 1 -- 172.21.15.135:0/236022152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2130101b50 msgr2=0x7f2130199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f213565e640 1 --2- 172.21.15.135:0/236022152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2130101b50 0x7f2130199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f213565e640 1 -- 172.21.15.135:0/236022152 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21301a4ca0 con 0x7f2130106fa0 2024-04-20T12:31:21.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f2134e5d640 1 --2- 172.21.15.135:0/236022152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21301011b0 0x7f21301996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:21.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.773+0000 7f213565e640 1 --2- 172.21.15.135:0/236022152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2130106fa0 0x7f21301a4760 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f212800ec70 tx=0x7f212800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.774+0000 7f212dffb640 1 -- 172.21.15.135:0/236022152 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128003b70 con 0x7f2130106fa0 2024-04-20T12:31:21.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.774+0000 7f212dffb640 1 -- 172.21.15.135:0/236022152 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f212800ee80 con 0x7f2130106fa0 2024-04-20T12:31:21.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.774+0000 7f21370c1640 1 -- 172.21.15.135:0/236022152 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21301a4e70 con 0x7f2130106fa0 2024-04-20T12:31:21.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.774+0000 7f212dffb640 1 -- 172.21.15.135:0/236022152 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21280108a0 con 0x7f2130106fa0 2024-04-20T12:31:21.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.774+0000 7f21370c1640 1 -- 172.21.15.135:0/236022152 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21301a5330 con 0x7f2130106fa0 2024-04-20T12:31:21.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.776+0000 7f212dffb640 1 -- 172.21.15.135:0/236022152 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f2128004020 con 0x7f2130106fa0 2024-04-20T12:31:21.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.776+0000 7f2139d8c740 1 Processor -- start 2024-04-20T12:31:21.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.776+0000 7f2139d8c740 1 -- start start 2024-04-20T12:31:21.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.776+0000 7f212dffb640 1 --2- 172.21.15.135:0/236022152 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21200a3d20 0x7f21200a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.776+0000 7f2139d8c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755edbe10 0x55e755edc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.776+0000 7f2139d8c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edc730 0x55e755ee4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.776+0000 7f2139d8c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755ee5310 0x55e755ee7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.776+0000 7f2139d8c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e755e41110 con 0x55e755ee5310 2024-04-20T12:31:21.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f2139d8c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e755dde550 con 0x55e755edc730 2024-04-20T12:31:21.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f2139d8c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e755e3d0d0 con 0x55e755edbe10 2024-04-20T12:31:21.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f212ffff640 1 --2- 172.21.15.135:0/236022152 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21200a3d20 0x7f21200a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f213565e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755ee5310 0x55e755ee7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f213565e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755ee5310 0x55e755ee7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42638/0 (socket says 172.21.15.135:42638) 2024-04-20T12:31:21.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f213565e640 1 -- 172.21.15.135:0/2508783599 learned_addr learned my addr 172.21.15.135:0/2508783599 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f212dffb640 1 -- 172.21.15.135:0/236022152 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f21280d1080 con 0x7f2130106fa0 2024-04-20T12:31:21.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f2134e5d640 1 --2- 172.21.15.135:0/2508783599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755edbe10 0x55e755edc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f212ffff640 1 --2- 172.21.15.135:0/2508783599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edc730 0x55e755ee4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f213565e640 1 -- 172.21.15.135:0/2508783599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755edbe10 msgr2=0x55e755edc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f213565e640 1 --2- 172.21.15.135:0/2508783599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755edbe10 0x55e755edc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f213565e640 1 -- 172.21.15.135:0/2508783599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edc730 msgr2=0x55e755ee4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f213565e640 1 --2- 172.21.15.135:0/2508783599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edc730 0x55e755ee4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f213565e640 1 -- 172.21.15.135:0/2508783599 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e755e06900 con 0x55e755ee5310 2024-04-20T12:31:21.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f212ffff640 1 --2- 172.21.15.135:0/236022152 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21200a3d20 0x7f21200a61e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f213006b150 tx=0x7f211c02ca00 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f213565e640 1 --2- 172.21.15.135:0/2508783599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755ee5310 0x55e755ee7700 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f21280990b0 tx=0x7f2128099020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534073da0bed744 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f211affd640 1 -- 172.21.15.135:0/2508783599 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128070b00 con 0x55e755ee5310 2024-04-20T12:31:21.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f211affd640 1 -- 172.21.15.135:0/2508783599 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21280679f0 con 0x55e755ee5310 2024-04-20T12:31:21.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.777+0000 7f211affd640 1 -- 172.21.15.135:0/2508783599 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21280992c0 con 0x55e755ee5310 2024-04-20T12:31:21.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.778+0000 7f2139d8c740 1 -- 172.21.15.135:0/2508783599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755ee5310 msgr2=0x55e755ee7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.778+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2508783599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755ee5310 0x55e755ee7700 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f21280990b0 tx=0x7f2128099020 comp rx=0 tx=0).stop 2024-04-20T12:31:21.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.778+0000 7f2139d8c740 1 -- 172.21.15.135:0/2508783599 shutdown_connections 2024-04-20T12:31:21.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.778+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2508783599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755ee5310 0x55e755ee7700 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.778+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2508783599 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edc730 0x55e755ee4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.778+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2508783599 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755edbe10 0x55e755edc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.778+0000 7f2139d8c740 1 -- 172.21.15.135:0/2508783599 >> 172.21.15.135:0/2508783599 conn(0x55e755ed6540 msgr2=0x55e755ed6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.778+0000 7f2139d8c740 1 -- 172.21.15.135:0/2508783599 shutdown_connections 2024-04-20T12:31:21.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.778+0000 7f2139d8c740 1 -- 172.21.15.135:0/2508783599 wait complete. 2024-04-20T12:31:21.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.778+0000 7f2139d8c740 1 -- start start 2024-04-20T12:31:21.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.778+0000 7f2139d8c740 1 Processor -- start 2024-04-20T12:31:21.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f2139d8c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edbe10 0x55e755ee2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f2139d8c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755edc730 0x55e755ee2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f2139d8c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755ee5310 0x55e755ee2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f2139d8c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e755ee7fe0 con 0x55e755edc730 2024-04-20T12:31:21.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f2139d8c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55e755dfa500 con 0x55e755edbe10 2024-04-20T12:31:21.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f2139d8c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55e755ee8160 con 0x55e755ee5310 2024-04-20T12:31:21.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f2139d8c740 10 client.0 _ll_register_callbacks cb 0x55e755ddf2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:21.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f212ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755edc730 0x55e755ee2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f212ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755edc730 0x55e755ee2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42644/0 (socket says 172.21.15.135:42644) 2024-04-20T12:31:21.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f212ffff640 1 -- 172.21.15.135:0/2852613129 learned_addr learned my addr 172.21.15.135:0/2852613129 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f213565e640 1 --2- 172.21.15.135:0/2852613129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755ee5310 0x55e755ee2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f2134e5d640 1 --2- 172.21.15.135:0/2852613129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edbe10 0x55e755ee2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f212ffff640 1 -- 172.21.15.135:0/2852613129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755ee5310 msgr2=0x55e755ee2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f212ffff640 1 --2- 172.21.15.135:0/2852613129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755ee5310 0x55e755ee2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f212ffff640 1 -- 172.21.15.135:0/2852613129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edbe10 msgr2=0x55e755ee2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f212ffff640 1 --2- 172.21.15.135:0/2852613129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edbe10 0x55e755ee2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f212ffff640 1 -- 172.21.15.135:0/2852613129 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e755b533f0 con 0x55e755edc730 2024-04-20T12:31:21.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f2134e5d640 1 --2- 172.21.15.135:0/2852613129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edbe10 0x55e755ee2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:21.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f212ffff640 1 --2- 172.21.15.135:0/2852613129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755edc730 0x55e755ee2960 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f211c035000 tx=0x7f211c02bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efffcf1246ec1b2a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f210ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:21.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f210ffff640 1 -- 172.21.15.135:0/2852613129 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c052060 con 0x55e755edc730 2024-04-20T12:31:21.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f210ffff640 1 -- 172.21.15.135:0/2852613129 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f211c0048c0 con 0x55e755edc730 2024-04-20T12:31:21.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.779+0000 7f2139d8c740 1 -- 172.21.15.135:0/2852613129 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21280679f0 con 0x55e755edc730 2024-04-20T12:31:21.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.780+0000 7f210ffff640 1 -- 172.21.15.135:0/2852613129 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f211c059050 con 0x55e755edc730 2024-04-20T12:31:21.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.780+0000 7f2139d8c740 10 client.18111 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:21.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.780+0000 7f2139d8c740 1 -- 172.21.15.135:0/2852613129 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e755c1d7d0 con 0x55e755edc730 2024-04-20T12:31:21.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.780+0000 7f210ffff640 1 -- 172.21.15.135:0/2852613129 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21280679f0 con 0x55e755edc730 2024-04-20T12:31:21.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.780+0000 7f210ffff640 1 -- 172.21.15.135:0/2852613129 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f211c042440 con 0x55e755edc730 2024-04-20T12:31:21.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.780+0000 7f2139d8c740 10 client.18111 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:21.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.780+0000 7f2139d8c740 10 client.18111 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:31:21.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.780+0000 7f2139d8c740 20 client.18111 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:21.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.780+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2852613129 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55e755ef5640 0x55e755ef7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.780+0000 7f2139d8c740 4 client.18111 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:21.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.780+0000 7f2139d8c740 1 -- 172.21.15.135:0/2852613129 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e755e4eb30 con 0x55e755ef5640 2024-04-20T12:31:21.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.780+0000 7f2134e5d640 1 --2- 172.21.15.135:0/2852613129 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55e755ef5640 0x55e755ef7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.781+0000 7f2134e5d640 1 --2- 172.21.15.135:0/2852613129 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55e755ef5640 0x55e755ef7a50 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b0bffd63562bebc1 server_cookie=8aab1c4da4f3ad7 in_seq=0 out_seq=0 2024-04-20T12:31:21.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.781+0000 7f210ffff640 10 client.18111 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:31:21.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.781+0000 7f210ffff640 1 -- 172.21.15.135:0/2852613129 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e755e4eb30 con 0x55e755ef5640 2024-04-20T12:31:21.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.782+0000 7f210ffff640 10 client.18111 handle_command_reply: tid=0 2024-04-20T12:31:21.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.782+0000 7f2139d8c740 1 client.18111 shutdown 2024-04-20T12:31:21.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.782+0000 7f2139d8c740 1 -- 172.21.15.135:0/2852613129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755edc730 msgr2=0x55e755ee2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.782+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2852613129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755edc730 0x55e755ee2960 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f211c035000 tx=0x7f211c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:31:21.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.782+0000 7f2139d8c740 1 -- 172.21.15.135:0/2852613129 shutdown_connections 2024-04-20T12:31:21.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.782+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2852613129 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55e755ef5640 0x55e755ef7a50 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.782+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2852613129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755ee5310 0x55e755ee2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.782+0000 7f210ffff640 0 client.18111 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:31:21.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.782+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2852613129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755edc730 0x55e755ee2960 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.782+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2852613129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edbe10 0x55e755ee2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.782+0000 7f2139d8c740 1 -- 172.21.15.135:0/2852613129 >> 172.21.15.135:0/2852613129 conn(0x55e755ed6540 msgr2=0x55e755ed8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.782+0000 7f2139d8c740 1 -- 172.21.15.135:0/2852613129 shutdown_connections 2024-04-20T12:31:21.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.782+0000 7f2139d8c740 1 -- 172.21.15.135:0/2852613129 wait complete. 2024-04-20T12:31:21.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.782+0000 7f2139d8c740 20 client.18111 trim_cache size 0 max 16384 2024-04-20T12:31:21.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f2139d8c740 1 Processor -- start 2024-04-20T12:31:21.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f2139d8c740 1 -- start start 2024-04-20T12:31:21.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f2139d8c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755edbe10 0x55e755ef0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f2139d8c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edc730 0x55e755ed5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f2139d8c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755ee5310 0x55e755efd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f2139d8c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f21301af500 con 0x55e755ee5310 2024-04-20T12:31:21.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f2139d8c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f21301b1040 con 0x55e755edc730 2024-04-20T12:31:21.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f2139d8c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21301afbd0 con 0x55e755edbe10 2024-04-20T12:31:21.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f213565e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755ee5310 0x55e755efd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f213565e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755ee5310 0x55e755efd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42658/0 (socket says 172.21.15.135:42658) 2024-04-20T12:31:21.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f213565e640 1 -- 172.21.15.135:0/2365983779 learned_addr learned my addr 172.21.15.135:0/2365983779 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f2134e5d640 1 --2- 172.21.15.135:0/2365983779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755edbe10 0x55e755ef0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.801 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f212ffff640 1 --2- 172.21.15.135:0/2365983779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edc730 0x55e755ed5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f213565e640 1 -- 172.21.15.135:0/2365983779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755edbe10 msgr2=0x55e755ef0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f213565e640 1 --2- 172.21.15.135:0/2365983779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755edbe10 0x55e755ef0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f213565e640 1 -- 172.21.15.135:0/2365983779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edc730 msgr2=0x55e755ed5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f213565e640 1 --2- 172.21.15.135:0/2365983779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edc730 0x55e755ed5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.795+0000 7f213565e640 1 -- 172.21.15.135:0/2365983779 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e755ed7110 con 0x55e755ee5310 2024-04-20T12:31:21.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.796+0000 7f213565e640 1 --2- 172.21.15.135:0/2365983779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755ee5310 0x55e755efd320 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f212801b000 tx=0x7f2128009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba83f2b56f59d579 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.796+0000 7f211a7fc640 1 -- 172.21.15.135:0/2365983779 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21280b5070 con 0x55e755ee5310 2024-04-20T12:31:21.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.796+0000 7f211a7fc640 1 -- 172.21.15.135:0/2365983779 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f212809cc50 con 0x55e755ee5310 2024-04-20T12:31:21.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.796+0000 7f211a7fc640 1 -- 172.21.15.135:0/2365983779 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21280bd0c0 con 0x55e755ee5310 2024-04-20T12:31:21.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.796+0000 7f2139d8c740 1 -- 172.21.15.135:0/2365983779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755ee5310 msgr2=0x55e755efd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.796+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2365983779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755ee5310 0x55e755efd320 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f212801b000 tx=0x7f2128009960 comp rx=0 tx=0).stop 2024-04-20T12:31:21.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.796+0000 7f2139d8c740 1 -- 172.21.15.135:0/2365983779 shutdown_connections 2024-04-20T12:31:21.802 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.796+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2365983779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755ee5310 0x55e755efd320 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.796+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2365983779 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755edc730 0x55e755ed5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.796+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2365983779 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755edbe10 0x55e755ef0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.796+0000 7f2139d8c740 1 -- 172.21.15.135:0/2365983779 >> 172.21.15.135:0/2365983779 conn(0x55e755ed6540 msgr2=0x55e755ed4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.796+0000 7f2139d8c740 1 -- 172.21.15.135:0/2365983779 shutdown_connections 2024-04-20T12:31:21.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.796+0000 7f2139d8c740 1 -- 172.21.15.135:0/2365983779 wait complete. 2024-04-20T12:31:21.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f2139d8c740 1 -- start start 2024-04-20T12:31:21.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f2139d8c740 1 Processor -- start 2024-04-20T12:31:21.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f2139d8c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755edbe10 0x55e755eed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.803 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f2139d8c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755edc730 0x55e755ee8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f2139d8c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755ee5310 0x55e755ee93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f2139d8c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f21301b0970 con 0x55e755edc730 2024-04-20T12:31:21.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f2139d8c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f21301b02a0 con 0x55e755ee5310 2024-04-20T12:31:21.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f2139d8c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f21301ad4d0 con 0x55e755edbe10 2024-04-20T12:31:21.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f2139d8c740 10 client.0 _ll_register_callbacks cb 0x7f21280093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:21.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f212ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755edc730 0x55e755ee8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f212ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755edc730 0x55e755ee8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42666/0 (socket says 172.21.15.135:42666) 2024-04-20T12:31:21.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f212ffff640 1 -- 172.21.15.135:0/2899704308 learned_addr learned my addr 172.21.15.135:0/2899704308 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f2134e5d640 1 --2- 172.21.15.135:0/2899704308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755edbe10 0x55e755eed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f213565e640 1 --2- 172.21.15.135:0/2899704308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755ee5310 0x55e755ee93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f212ffff640 1 -- 172.21.15.135:0/2899704308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755edbe10 msgr2=0x55e755eed8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f212ffff640 1 --2- 172.21.15.135:0/2899704308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755edbe10 0x55e755eed8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f212ffff640 1 -- 172.21.15.135:0/2899704308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755ee5310 msgr2=0x55e755ee93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.804 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f212ffff640 1 --2- 172.21.15.135:0/2899704308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755ee5310 0x55e755ee93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.797+0000 7f212ffff640 1 -- 172.21.15.135:0/2899704308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e755f5ab90 con 0x55e755edc730 2024-04-20T12:31:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f212ffff640 1 --2- 172.21.15.135:0/2899704308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755edc730 0x55e755ee8ca0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f211c006010 tx=0x7f211c0426f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5510a4181acc28a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f210ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f210ffff640 1 -- 172.21.15.135:0/2899704308 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211c062060 con 0x55e755edc730 2024-04-20T12:31:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f210ffff640 1 -- 172.21.15.135:0/2899704308 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f211c0048c0 con 0x55e755edc730 2024-04-20T12:31:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f2139d8c740 1 -- 172.21.15.135:0/2899704308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f212809cc50 con 0x55e755edc730 2024-04-20T12:31:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f210ffff640 1 -- 172.21.15.135:0/2899704308 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f211c069050 con 0x55e755edc730 2024-04-20T12:31:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f2139d8c740 10 client.18117 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f2139d8c740 1 -- 172.21.15.135:0/2899704308 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e755f5bd10 con 0x55e755edc730 2024-04-20T12:31:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f210ffff640 1 -- 172.21.15.135:0/2899704308 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f212809cc50 con 0x55e755edc730 2024-04-20T12:31:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f210ffff640 1 -- 172.21.15.135:0/2899704308 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f211c0036f0 con 0x55e755edc730 2024-04-20T12:31:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f2139d8c740 10 client.18117 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f2139d8c740 10 client.18117 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:31:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f2139d8c740 20 client.18117 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:21.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2899704308 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55e755f5c490 0x55e755f5e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f2139d8c740 4 client.18117 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:31:21.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f2139d8c740 1 -- 172.21.15.135:0/2899704308 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e755e489a0 con 0x55e755f5c490 2024-04-20T12:31:21.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.798+0000 7f2134e5d640 1 --2- 172.21.15.135:0/2899704308 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55e755f5c490 0x55e755f5e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f210ffff640 10 client.18117 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:31:21.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f2134e5d640 1 --2- 172.21.15.135:0/2899704308 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55e755f5c490 0x55e755f5e8b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bce892601e24805c server_cookie=280810e7b2ffde9 in_seq=0 out_seq=0 2024-04-20T12:31:21.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f210ffff640 1 -- 172.21.15.135:0/2899704308 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e755e489a0 con 0x55e755f5c490 2024-04-20T12:31:21.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f210ffff640 10 client.18117 handle_command_reply: tid=0 2024-04-20T12:31:21.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f2139d8c740 1 client.18117 shutdown 2024-04-20T12:31:21.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f2139d8c740 1 -- 172.21.15.135:0/2899704308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755edc730 msgr2=0x55e755ee8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2899704308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755edc730 0x55e755ee8ca0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f211c006010 tx=0x7f211c0426f0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f2139d8c740 1 -- 172.21.15.135:0/2899704308 shutdown_connections 2024-04-20T12:31:21.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2899704308 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55e755f5c490 0x55e755f5e8b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2899704308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55e755ee5310 0x55e755ee93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.806 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f210ffff640 0 client.18117 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:31:21.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2899704308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e755edc730 0x55e755ee8ca0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f2139d8c740 1 --2- 172.21.15.135:0/2899704308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55e755edbe10 0x55e755eed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f2139d8c740 1 -- 172.21.15.135:0/2899704308 >> 172.21.15.135:0/2899704308 conn(0x55e755ed6540 msgr2=0x55e755ee2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f2139d8c740 1 -- 172.21.15.135:0/2899704308 shutdown_connections 2024-04-20T12:31:21.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f2139d8c740 1 -- 172.21.15.135:0/2899704308 wait complete. 2024-04-20T12:31:21.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.799+0000 7f2139d8c740 20 client.18117 trim_cache size 0 max 16384 2024-04-20T12:31:21.807 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:31:21.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.800+0000 7f21370c1640 1 -- 172.21.15.135:0/236022152 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21200a3d20 msgr2=0x7f21200a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.800+0000 7f21370c1640 1 --2- 172.21.15.135:0/236022152 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21200a3d20 0x7f21200a61e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f213006b150 tx=0x7f211c02ca00 comp rx=0 tx=0).stop 2024-04-20T12:31:21.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.800+0000 7f21370c1640 1 -- 172.21.15.135:0/236022152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2130106fa0 msgr2=0x7f21301a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.800+0000 7f21370c1640 1 --2- 172.21.15.135:0/236022152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2130106fa0 0x7f21301a4760 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f212800ec70 tx=0x7f212800c6a0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.800+0000 7f21370c1640 1 -- 172.21.15.135:0/236022152 shutdown_connections 2024-04-20T12:31:21.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.800+0000 7f21370c1640 1 --2- 172.21.15.135:0/236022152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2130106fa0 0x7f21301a4760 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.800+0000 7f21370c1640 1 --2- 172.21.15.135:0/236022152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2130101b50 0x7f2130199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.800+0000 7f21370c1640 1 --2- 172.21.15.135:0/236022152 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f21200a3d20 0x7f21200a61e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.800+0000 7f21370c1640 1 --2- 172.21.15.135:0/236022152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f21301011b0 0x7f21301996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.800+0000 7f21370c1640 1 -- 172.21.15.135:0/236022152 >> 172.21.15.135:0/236022152 conn(0x7f2130076c60 msgr2=0x7f2130100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.800+0000 7f21370c1640 1 -- 172.21.15.135:0/236022152 shutdown_connections 2024-04-20T12:31:21.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.800+0000 7f21370c1640 1 -- 172.21.15.135:0/236022152 wait complete. 2024-04-20T12:31:21.810 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:31:21.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.912+0000 7ff86ca43640 1 -- 172.21.15.135:0/973517608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8681010b0 msgr2=0x7ff868101510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.912+0000 7ff86ca43640 1 --2- 172.21.15.135:0/973517608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8681010b0 0x7ff868101510 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7ff850009900 tx=0x7ff85002bc30 comp rx=0 tx=0).stop 2024-04-20T12:31:21.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.912+0000 7ff86ca43640 1 -- 172.21.15.135:0/973517608 shutdown_connections 2024-04-20T12:31:21.914 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.912+0000 7ff86ca43640 1 --2- 172.21.15.135:0/973517608 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff868101a50 0x7ff86810dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.912+0000 7ff86ca43640 1 --2- 172.21.15.135:0/973517608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8681010b0 0x7ff868101510 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.912+0000 7ff86ca43640 1 --2- 172.21.15.135:0/973517608 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff868105de0 0x7ff8681061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.912+0000 7ff86ca43640 1 -- 172.21.15.135:0/973517608 >> 172.21.15.135:0/973517608 conn(0x7ff868077c50 msgr2=0x7ff868078060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.912+0000 7ff86ca43640 1 -- 172.21.15.135:0/973517608 shutdown_connections 2024-04-20T12:31:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.912+0000 7ff86ca43640 1 -- 172.21.15.135:0/973517608 wait complete. 2024-04-20T12:31:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.913+0000 7ff86ca43640 1 Processor -- start 2024-04-20T12:31:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.913+0000 7ff86ca43640 1 -- start start 2024-04-20T12:31:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.913+0000 7ff86ca43640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8681010b0 0x7ff8681996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.913+0000 7ff86ca43640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff868101a50 0x7ff868199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.913+0000 7ff86ca43640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff868105de0 0x7ff8681a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.913+0000 7ff86ca43640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff8681112d0 con 0x7ff868101a50 2024-04-20T12:31:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.913+0000 7ff86ca43640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff868111150 con 0x7ff8681010b0 2024-04-20T12:31:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.913+0000 7ff86ca43640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff868111450 con 0x7ff868105de0 2024-04-20T12:31:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.913+0000 7ff85ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff868101a50 0x7ff868199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.913+0000 7ff85ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff868101a50 0x7ff868199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42680/0 (socket says 172.21.15.135:42680) 2024-04-20T12:31:21.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.913+0000 7ff85ffff640 1 -- 172.21.15.135:0/2217295912 learned_addr learned my addr 172.21.15.135:0/2217295912 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.913+0000 7ff86659c640 1 --2- 172.21.15.135:0/2217295912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8681010b0 0x7ff8681996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.913+0000 7ff866d9d640 1 --2- 172.21.15.135:0/2217295912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff868105de0 0x7ff8681a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.914+0000 7ff85ffff640 1 -- 172.21.15.135:0/2217295912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff868105de0 msgr2=0x7ff8681a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.914+0000 7ff85ffff640 1 --2- 172.21.15.135:0/2217295912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff868105de0 0x7ff8681a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.914+0000 7ff85ffff640 1 -- 172.21.15.135:0/2217295912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8681010b0 msgr2=0x7ff8681996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.914+0000 7ff85ffff640 1 --2- 172.21.15.135:0/2217295912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8681010b0 0x7ff8681996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.914+0000 7ff85ffff640 1 -- 172.21.15.135:0/2217295912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8681a4c90 con 0x7ff868101a50 2024-04-20T12:31:21.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.914+0000 7ff85ffff640 1 --2- 172.21.15.135:0/2217295912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff868101a50 0x7ff868199c10 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7ff850006010 tx=0x7ff85002cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.914+0000 7ff85f7fe640 1 -- 172.21.15.135:0/2217295912 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff850041070 con 0x7ff868101a50 2024-04-20T12:31:21.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.914+0000 7ff85f7fe640 1 -- 172.21.15.135:0/2217295912 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff850004450 con 0x7ff868101a50 2024-04-20T12:31:21.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.914+0000 7ff86ca43640 1 -- 172.21.15.135:0/2217295912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8681a4e60 con 0x7ff868101a50 2024-04-20T12:31:21.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.914+0000 7ff85f7fe640 1 -- 172.21.15.135:0/2217295912 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff850003e00 con 0x7ff868101a50 2024-04-20T12:31:21.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.914+0000 7ff86ca43640 1 -- 172.21.15.135:0/2217295912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8681a5260 con 0x7ff868101a50 2024-04-20T12:31:21.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.916+0000 7ff85f7fe640 1 -- 172.21.15.135:0/2217295912 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7ff850044070 con 0x7ff868101a50 2024-04-20T12:31:21.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.916+0000 7ff86f638740 1 Processor -- start 2024-04-20T12:31:21.924 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff86f638740 1 -- start start 2024-04-20T12:31:21.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff86f638740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 0x555b92f2d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff86f638740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f2d730 0x555b92f35dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff86f638740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f36310 0x555b92f38700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff86f638740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555b92e92110 con 0x555b92f36310 2024-04-20T12:31:21.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff86f638740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555b92e2f550 con 0x555b92f2d730 2024-04-20T12:31:21.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff86f638740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555b92e8e0d0 con 0x555b92f2ce10 2024-04-20T12:31:21.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff85ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f36310 0x555b92f38700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff85ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f36310 0x555b92f38700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42690/0 (socket says 172.21.15.135:42690) 2024-04-20T12:31:21.925 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff85ffff640 1 -- 172.21.15.135:0/1881545193 learned_addr learned my addr 172.21.15.135:0/1881545193 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff86659c640 1 --2- 172.21.15.135:0/1881545193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f2d730 0x555b92f35dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff866d9d640 1 --2- 172.21.15.135:0/1881545193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 0x555b92f2d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff85f7fe640 1 --2- 172.21.15.135:0/2217295912 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff8540a3d20 0x7ff8540a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff866d9d640 1 --2- 172.21.15.135:0/2217295912 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff8540a3d20 0x7ff8540a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff86659c640 1 -- 172.21.15.135:0/1881545193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 msgr2=0x555b92f2d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff86659c640 1 --2- 172.21.15.135:0/1881545193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 0x555b92f2d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff86659c640 1 -- 172.21.15.135:0/1881545193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f36310 msgr2=0x555b92f38700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff86659c640 1 --2- 172.21.15.135:0/1881545193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f36310 0x555b92f38700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff86659c640 1 -- 172.21.15.135:0/1881545193 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b92e57900 con 0x555b92f2d730 2024-04-20T12:31:21.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff85f7fe640 1 -- 172.21.15.135:0/2217295912 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7ff8500f24c0 con 0x7ff868101a50 2024-04-20T12:31:21.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.917+0000 7ff85ffff640 1 --2- 172.21.15.135:0/1881545193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f36310 0x555b92f38700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:31:21.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.918+0000 7ff86659c640 1 --2- 172.21.15.135:0/1881545193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f2d730 0x555b92f35dd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff8580045b0 tx=0x7ff85800bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed690ae860f5e65e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.918+0000 7ff866d9d640 1 --2- 172.21.15.135:0/2217295912 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff8540a3d20 0x7ff8540a61e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff860005c40 tx=0x7ff860004ab0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.926 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.918+0000 7ff85cff9640 1 -- 172.21.15.135:0/1881545193 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff858003bd0 con 0x555b92f2d730 2024-04-20T12:31:21.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.918+0000 7ff85cff9640 1 -- 172.21.15.135:0/1881545193 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff858015070 con 0x555b92f2d730 2024-04-20T12:31:21.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.918+0000 7ff85cff9640 1 -- 172.21.15.135:0/1881545193 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff858004d70 con 0x555b92f2d730 2024-04-20T12:31:21.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.918+0000 7ff86f638740 1 -- 172.21.15.135:0/1881545193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f2d730 msgr2=0x555b92f35dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.918+0000 7ff86f638740 1 --2- 172.21.15.135:0/1881545193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f2d730 0x555b92f35dd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff8580045b0 tx=0x7ff85800bb20 comp rx=0 tx=0).stop 2024-04-20T12:31:21.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 1 -- 172.21.15.135:0/1881545193 shutdown_connections 2024-04-20T12:31:21.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 1 --2- 172.21.15.135:0/1881545193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f36310 0x555b92f38700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 1 --2- 172.21.15.135:0/1881545193 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f2d730 0x555b92f35dd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 1 --2- 172.21.15.135:0/1881545193 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 0x555b92f2d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 1 -- 172.21.15.135:0/1881545193 >> 172.21.15.135:0/1881545193 conn(0x555b92f27540 msgr2=0x555b92f27920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 1 -- 172.21.15.135:0/1881545193 shutdown_connections 2024-04-20T12:31:21.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 1 -- 172.21.15.135:0/1881545193 wait complete. 2024-04-20T12:31:21.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 1 -- start start 2024-04-20T12:31:21.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 1 Processor -- start 2024-04-20T12:31:21.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 0x555b92f333b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f2d730 0x555b92f338f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f36310 0x555b92f33e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555b92f39100 con 0x555b92f2d730 2024-04-20T12:31:21.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x555b92e4b500 con 0x555b92f36310 2024-04-20T12:31:21.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x555b92f39280 con 0x555b92f2ce10 2024-04-20T12:31:21.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86f638740 10 client.0 _ll_register_callbacks cb 0x555b92e302f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:21.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff85ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f2d730 0x555b92f338f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff85ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f2d730 0x555b92f338f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42696/0 (socket says 172.21.15.135:42696) 2024-04-20T12:31:21.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff85ffff640 1 -- 172.21.15.135:0/1104805202 learned_addr learned my addr 172.21.15.135:0/1104805202 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff866d9d640 1 --2- 172.21.15.135:0/1104805202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f36310 0x555b92f33e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.919+0000 7ff86659c640 1 --2- 172.21.15.135:0/1104805202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 0x555b92f333b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff85ffff640 1 -- 172.21.15.135:0/1104805202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 msgr2=0x555b92f333b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff85ffff640 1 --2- 172.21.15.135:0/1104805202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 0x555b92f333b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff85ffff640 1 -- 172.21.15.135:0/1104805202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f36310 msgr2=0x555b92f33e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff85ffff640 1 --2- 172.21.15.135:0/1104805202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f36310 0x555b92f33e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff85ffff640 1 -- 172.21.15.135:0/1104805202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b92ba43f0 con 0x555b92f2d730 2024-04-20T12:31:21.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff86659c640 1 --2- 172.21.15.135:0/1104805202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 0x555b92f333b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:21.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff85ffff640 1 --2- 172.21.15.135:0/1104805202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f2d730 0x555b92f338f0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7ff8500c6980 tx=0x7ff8500056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5a5a557a5a9925 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff84dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:21.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff84dffb640 1 -- 172.21.15.135:0/1104805202 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85004b040 con 0x555b92f2d730 2024-04-20T12:31:21.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff84dffb640 1 -- 172.21.15.135:0/1104805202 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7ff8500f2170 con 0x555b92f2d730 2024-04-20T12:31:21.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff86f638740 1 -- 172.21.15.135:0/1104805202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff858015070 con 0x555b92f2d730 2024-04-20T12:31:21.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff84dffb640 1 -- 172.21.15.135:0/1104805202 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff8500be0c0 con 0x555b92f2d730 2024-04-20T12:31:21.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff86f638740 10 client.18129 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:21.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff86f638740 1 -- 172.21.15.135:0/1104805202 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555b92c6e7d0 con 0x555b92f2d730 2024-04-20T12:31:21.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff84dffb640 1 -- 172.21.15.135:0/1104805202 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff858015070 con 0x555b92f2d730 2024-04-20T12:31:21.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff84dffb640 1 -- 172.21.15.135:0/1104805202 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7ff8500d2ce0 con 0x555b92f2d730 2024-04-20T12:31:21.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff86f638740 10 client.18129 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:21.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff86f638740 10 client.18129 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:31:21.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff86f638740 20 client.18129 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:21.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff86f638740 1 --2- 172.21.15.135:0/1104805202 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x555b92f465b0 0x555b92f48a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff86f638740 4 client.18129 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:21.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.920+0000 7ff86f638740 1 -- 172.21.15.135:0/1104805202 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b92e9fb30 con 0x555b92f465b0 2024-04-20T12:31:21.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.921+0000 7ff86659c640 1 --2- 172.21.15.135:0/1104805202 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x555b92f465b0 0x555b92f48a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.921+0000 7ff84dffb640 10 client.18129 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:31:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.921+0000 7ff86659c640 1 --2- 172.21.15.135:0/1104805202 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x555b92f465b0 0x555b92f48a20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d4e7a0b092322f65 server_cookie=3f74e3622825e65d in_seq=0 out_seq=0 2024-04-20T12:31:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.922+0000 7ff84dffb640 1 -- 172.21.15.135:0/1104805202 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555b92e9fb30 con 0x555b92f465b0 2024-04-20T12:31:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.922+0000 7ff84dffb640 10 client.18129 handle_command_reply: tid=0 2024-04-20T12:31:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.922+0000 7ff86f638740 1 client.18129 shutdown 2024-04-20T12:31:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.922+0000 7ff86f638740 1 -- 172.21.15.135:0/1104805202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f2d730 msgr2=0x555b92f338f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.922+0000 7ff86f638740 1 --2- 172.21.15.135:0/1104805202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f2d730 0x555b92f338f0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7ff8500c6980 tx=0x7ff8500056e0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.922+0000 7ff86f638740 1 -- 172.21.15.135:0/1104805202 shutdown_connections 2024-04-20T12:31:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.922+0000 7ff86f638740 1 --2- 172.21.15.135:0/1104805202 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f36310 0x555b92f33e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.922+0000 7ff86f638740 1 --2- 172.21.15.135:0/1104805202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f2d730 0x555b92f338f0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.922+0000 7ff86f638740 1 --2- 172.21.15.135:0/1104805202 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x555b92f465b0 0x555b92f48a20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.922+0000 7ff86f638740 1 --2- 172.21.15.135:0/1104805202 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 0x555b92f333b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.934 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.922+0000 7ff84dffb640 0 client.18129 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:31:21.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.922+0000 7ff86f638740 1 -- 172.21.15.135:0/1104805202 >> 172.21.15.135:0/1104805202 conn(0x555b92f27540 msgr2=0x555b92f29290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.922+0000 7ff86f638740 1 -- 172.21.15.135:0/1104805202 shutdown_connections 2024-04-20T12:31:21.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.922+0000 7ff86f638740 1 -- 172.21.15.135:0/1104805202 wait complete. 2024-04-20T12:31:21.935 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.922+0000 7ff86f638740 20 client.18129 trim_cache size 0 max 16384 2024-04-20T12:31:21.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff86f638740 1 Processor -- start 2024-04-20T12:31:21.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff86f638740 1 -- start start 2024-04-20T12:31:21.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff86f638740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f2ce10 0x555b92f35ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff86f638740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2d730 0x555b92f41ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff86f638740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f36310 0x555b92f4e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff86f638740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff8681af4a0 con 0x555b92f36310 2024-04-20T12:31:21.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff86f638740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff8681b0fe0 con 0x555b92f2ce10 2024-04-20T12:31:21.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff86f638740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8681afb70 con 0x555b92f2d730 2024-04-20T12:31:21.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff866d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f36310 0x555b92f4e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff866d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f36310 0x555b92f4e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42706/0 (socket says 172.21.15.135:42706) 2024-04-20T12:31:21.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff866d9d640 1 -- 172.21.15.135:0/1808035550 learned_addr learned my addr 172.21.15.135:0/1808035550 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff86659c640 1 --2- 172.21.15.135:0/1808035550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f2ce10 0x555b92f35ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff85ffff640 1 --2- 172.21.15.135:0/1808035550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2d730 0x555b92f41ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff866d9d640 1 -- 172.21.15.135:0/1808035550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2d730 msgr2=0x555b92f41ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff866d9d640 1 --2- 172.21.15.135:0/1808035550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2d730 0x555b92f41ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff866d9d640 1 -- 172.21.15.135:0/1808035550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f2ce10 msgr2=0x555b92f35ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff866d9d640 1 --2- 172.21.15.135:0/1808035550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f2ce10 0x555b92f35ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff866d9d640 1 -- 172.21.15.135:0/1808035550 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b92f2ef80 con 0x555b92f36310 2024-04-20T12:31:21.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff86659c640 1 --2- 172.21.15.135:0/1808035550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f2ce10 0x555b92f35ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:21.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.936+0000 7ff866d9d640 1 --2- 172.21.15.135:0/1808035550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f36310 0x555b92f4e2c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7ff860013470 tx=0x7ff860005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369ae6800cbadc4f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.937+0000 7ff84ffff640 1 -- 172.21.15.135:0/1808035550 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860004050 con 0x555b92f36310 2024-04-20T12:31:21.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.937+0000 7ff84ffff640 1 -- 172.21.15.135:0/1808035550 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff860026070 con 0x555b92f36310 2024-04-20T12:31:21.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.937+0000 7ff84ffff640 1 -- 172.21.15.135:0/1808035550 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff86002bd50 con 0x555b92f36310 2024-04-20T12:31:21.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.937+0000 7ff86f638740 1 -- 172.21.15.135:0/1808035550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f36310 msgr2=0x555b92f4e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.937+0000 7ff86f638740 1 --2- 172.21.15.135:0/1808035550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f36310 0x555b92f4e2c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7ff860013470 tx=0x7ff860005bd0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.937+0000 7ff86f638740 1 -- 172.21.15.135:0/1808035550 shutdown_connections 2024-04-20T12:31:21.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.937+0000 7ff86f638740 1 --2- 172.21.15.135:0/1808035550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f36310 0x555b92f4e2c0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.937+0000 7ff86f638740 1 --2- 172.21.15.135:0/1808035550 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2d730 0x555b92f41ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.937+0000 7ff86f638740 1 --2- 172.21.15.135:0/1808035550 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f2ce10 0x555b92f35ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.937+0000 7ff86f638740 1 -- 172.21.15.135:0/1808035550 >> 172.21.15.135:0/1808035550 conn(0x555b92f27540 msgr2=0x555b92f29200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.937+0000 7ff86f638740 1 -- 172.21.15.135:0/1808035550 shutdown_connections 2024-04-20T12:31:21.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.937+0000 7ff86f638740 1 -- 172.21.15.135:0/1808035550 wait complete. 2024-04-20T12:31:21.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.937+0000 7ff86f638740 1 -- start start 2024-04-20T12:31:21.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff86f638740 1 Processor -- start 2024-04-20T12:31:21.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff86f638740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 0x555b92f3a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff86f638740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f2d730 0x555b92f3a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff86f638740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f36310 0x555b92faff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff86f638740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff8681b0910 con 0x555b92f2d730 2024-04-20T12:31:21.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff86f638740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7ff8681b0240 con 0x555b92f36310 2024-04-20T12:31:21.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff86f638740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7ff8681ad470 con 0x555b92f2ce10 2024-04-20T12:31:21.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff86f638740 10 client.0 _ll_register_callbacks cb 0x555b92e302f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:21.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff85ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f2d730 0x555b92f3a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff85ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f2d730 0x555b92f3a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42718/0 (socket says 172.21.15.135:42718) 2024-04-20T12:31:21.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff85ffff640 1 -- 172.21.15.135:0/2697351879 learned_addr learned my addr 172.21.15.135:0/2697351879 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:21.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff86659c640 1 --2- 172.21.15.135:0/2697351879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 0x555b92f3a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff85ffff640 1 -- 172.21.15.135:0/2697351879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 msgr2=0x555b92f3a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff85ffff640 1 --2- 172.21.15.135:0/2697351879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 0x555b92f3a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.946 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff85ffff640 1 -- 172.21.15.135:0/2697351879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f36310 msgr2=0x555b92faff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff866d9d640 1 --2- 172.21.15.135:0/2697351879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f36310 0x555b92faff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff85ffff640 1 --2- 172.21.15.135:0/2697351879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f36310 0x555b92faff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff85ffff640 1 -- 172.21.15.135:0/2697351879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b92fb0480 con 0x555b92f2d730 2024-04-20T12:31:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff86659c640 1 --2- 172.21.15.135:0/2697351879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 0x555b92f3a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff85ffff640 1 --2- 172.21.15.135:0/2697351879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f2d730 0x555b92f3a860 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7ff8500bc5a0 tx=0x7ff850009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ecb017aa874468 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff84dffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff84dffb640 1 -- 172.21.15.135:0/2697351879 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85004b070 con 0x555b92f2d730 2024-04-20T12:31:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff84dffb640 1 -- 172.21.15.135:0/2697351879 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7ff8500f5c90 con 0x555b92f2d730 2024-04-20T12:31:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.938+0000 7ff86f638740 1 -- 172.21.15.135:0/2697351879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff860026070 con 0x555b92f2d730 2024-04-20T12:31:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.939+0000 7ff84dffb640 1 -- 172.21.15.135:0/2697351879 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff8500bdc50 con 0x555b92f2d730 2024-04-20T12:31:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.939+0000 7ff86f638740 10 client.18135 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.939+0000 7ff86f638740 1 -- 172.21.15.135:0/2697351879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x555b92fb1620 con 0x555b92f2d730 2024-04-20T12:31:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.939+0000 7ff84dffb640 1 -- 172.21.15.135:0/2697351879 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff860026070 con 0x555b92f2d730 2024-04-20T12:31:21.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.939+0000 7ff84dffb640 1 -- 172.21.15.135:0/2697351879 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7ff8500d2ce0 con 0x555b92f2d730 2024-04-20T12:31:21.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.939+0000 7ff86f638740 10 client.18135 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:21.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.939+0000 7ff86f638740 10 client.18135 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:31:21.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.939+0000 7ff86f638740 20 client.18135 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:21.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.939+0000 7ff86f638740 1 --2- 172.21.15.135:0/2697351879 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x555b92fb1c90 0x555b92fb40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:21.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.939+0000 7ff86f638740 4 client.18135 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:31:21.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.939+0000 7ff86f638740 1 -- 172.21.15.135:0/2697351879 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555b92e999a0 con 0x555b92fb1c90 2024-04-20T12:31:21.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.939+0000 7ff86659c640 1 --2- 172.21.15.135:0/2697351879 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x555b92fb1c90 0x555b92fb40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:21.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff84dffb640 10 client.18135 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:31:21.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86659c640 1 --2- 172.21.15.135:0/2697351879 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x555b92fb1c90 0x555b92fb40b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dbac99ec52abf5af server_cookie=5eeed2ad26d916a1 in_seq=0 out_seq=0 2024-04-20T12:31:21.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff84dffb640 1 -- 172.21.15.135:0/2697351879 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555b92e999a0 con 0x555b92fb1c90 2024-04-20T12:31:21.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff84dffb640 10 client.18135 handle_command_reply: tid=0 2024-04-20T12:31:21.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86f638740 1 client.18135 shutdown 2024-04-20T12:31:21.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86f638740 1 -- 172.21.15.135:0/2697351879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f2d730 msgr2=0x555b92f3a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.948 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86f638740 1 --2- 172.21.15.135:0/2697351879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f2d730 0x555b92f3a860 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7ff8500bc5a0 tx=0x7ff850009560 comp rx=0 tx=0).stop 2024-04-20T12:31:21.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86f638740 1 -- 172.21.15.135:0/2697351879 shutdown_connections 2024-04-20T12:31:21.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86f638740 1 --2- 172.21.15.135:0/2697351879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x555b92f36310 0x555b92faff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86f638740 1 --2- 172.21.15.135:0/2697351879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555b92f2d730 0x555b92f3a860 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86f638740 1 --2- 172.21.15.135:0/2697351879 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x555b92fb1c90 0x555b92fb40b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86f638740 1 --2- 172.21.15.135:0/2697351879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x555b92f2ce10 0x555b92f3a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff84dffb640 0 client.18135 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:31:21.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86f638740 1 -- 172.21.15.135:0/2697351879 >> 172.21.15.135:0/2697351879 conn(0x555b92f27540 msgr2=0x555b92f25e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86f638740 1 -- 172.21.15.135:0/2697351879 shutdown_connections 2024-04-20T12:31:21.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86f638740 1 -- 172.21.15.135:0/2697351879 wait complete. 2024-04-20T12:31:21.949 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86f638740 20 client.18135 trim_cache size 0 max 16384 2024-04-20T12:31:21.949 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:31:21.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86ca43640 1 -- 172.21.15.135:0/2217295912 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff8540a3d20 msgr2=0x7ff8540a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86ca43640 1 --2- 172.21.15.135:0/2217295912 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff8540a3d20 0x7ff8540a61e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff860005c40 tx=0x7ff860004ab0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86ca43640 1 -- 172.21.15.135:0/2217295912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff868101a50 msgr2=0x7ff868199c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:21.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.940+0000 7ff86ca43640 1 --2- 172.21.15.135:0/2217295912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff868101a50 0x7ff868199c10 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7ff850006010 tx=0x7ff85002cb30 comp rx=0 tx=0).stop 2024-04-20T12:31:21.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.941+0000 7ff86ca43640 1 -- 172.21.15.135:0/2217295912 shutdown_connections 2024-04-20T12:31:21.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.941+0000 7ff86ca43640 1 --2- 172.21.15.135:0/2217295912 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7ff8540a3d20 0x7ff8540a61e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.941+0000 7ff86ca43640 1 --2- 172.21.15.135:0/2217295912 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff868105de0 0x7ff8681a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.941+0000 7ff86ca43640 1 --2- 172.21.15.135:0/2217295912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff868101a50 0x7ff868199c10 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.941+0000 7ff86ca43640 1 --2- 172.21.15.135:0/2217295912 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7ff8681010b0 0x7ff8681996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:21.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.941+0000 7ff86ca43640 1 -- 172.21.15.135:0/2217295912 >> 172.21.15.135:0/2217295912 conn(0x7ff868077c50 msgr2=0x7ff8680fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:21.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.941+0000 7ff86ca43640 1 -- 172.21.15.135:0/2217295912 shutdown_connections 2024-04-20T12:31:21.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:21.941+0000 7ff86ca43640 1 -- 172.21.15.135:0/2217295912 wait complete. 2024-04-20T12:31:21.952 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:31:22.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.053+0000 7f685b831640 1 -- 172.21.15.135:0/1853569534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68541021a0 msgr2=0x7f6854102580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.053+0000 7f685b831640 1 --2- 172.21.15.135:0/1853569534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68541021a0 0x7f6854102580 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f6844009900 tx=0x7f684402bc30 comp rx=0 tx=0).stop 2024-04-20T12:31:22.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.053+0000 7f685b831640 1 -- 172.21.15.135:0/1853569534 shutdown_connections 2024-04-20T12:31:22.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.053+0000 7f685b831640 1 --2- 172.21.15.135:0/1853569534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6854107270 0x7f685410ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.053+0000 7f685b831640 1 --2- 172.21.15.135:0/1853569534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6854102b50 0x7f6854106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.053+0000 7f685b831640 1 --2- 172.21.15.135:0/1853569534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68541021a0 0x7f6854102580 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.053+0000 7f685b831640 1 -- 172.21.15.135:0/1853569534 >> 172.21.15.135:0/1853569534 conn(0x7f68540fda40 msgr2=0x7f68540ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:22.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.053+0000 7f685b831640 1 -- 172.21.15.135:0/1853569534 shutdown_connections 2024-04-20T12:31:22.053 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.053+0000 7f685b831640 1 -- 172.21.15.135:0/1853569534 wait complete. 2024-04-20T12:31:22.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.054+0000 7f685b831640 1 Processor -- start 2024-04-20T12:31:22.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.054+0000 7f685b831640 1 -- start start 2024-04-20T12:31:22.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.054+0000 7f685b831640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68541021a0 0x7f685419e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.054+0000 7f685b831640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6854107270 0x7f685419eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.054+0000 7f685b831640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68541986c0 0x7f6854198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.054+0000 7f685b831640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6854112300 con 0x7f68541021a0 2024-04-20T12:31:22.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.054+0000 7f685b831640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6854112180 con 0x7f6854107270 2024-04-20T12:31:22.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.054+0000 7f685b831640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6854112480 con 0x7f68541986c0 2024-04-20T12:31:22.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f68595cd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68541021a0 0x7f685419e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f68595cd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68541021a0 0x7f685419e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42744/0 (socket says 172.21.15.135:42744) 2024-04-20T12:31:22.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f68595cd640 1 -- 172.21.15.135:0/891926554 learned_addr learned my addr 172.21.15.135:0/891926554 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:22.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f6858dcc640 1 --2- 172.21.15.135:0/891926554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6854107270 0x7f685419eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f6859dce640 1 --2- 172.21.15.135:0/891926554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68541986c0 0x7f6854198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f68595cd640 1 -- 172.21.15.135:0/891926554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68541986c0 msgr2=0x7f6854198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f68595cd640 1 --2- 172.21.15.135:0/891926554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68541986c0 0x7f6854198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f68595cd640 1 -- 172.21.15.135:0/891926554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6854107270 msgr2=0x7f685419eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f68595cd640 1 --2- 172.21.15.135:0/891926554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6854107270 0x7f685419eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f68595cd640 1 -- 172.21.15.135:0/891926554 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68541992c0 con 0x7f68541021a0 2024-04-20T12:31:22.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f68595cd640 1 --2- 172.21.15.135:0/891926554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68541021a0 0x7f685419e5b0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f6844006010 tx=0x7f684402cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:22.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f684a7fc640 1 -- 172.21.15.135:0/891926554 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844041070 con 0x7f68541021a0 2024-04-20T12:31:22.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f685b831640 1 -- 172.21.15.135:0/891926554 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6854199550 con 0x7f68541021a0 2024-04-20T12:31:22.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f684a7fc640 1 -- 172.21.15.135:0/891926554 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6844004450 con 0x7f68541021a0 2024-04-20T12:31:22.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f684a7fc640 1 -- 172.21.15.135:0/891926554 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844003e00 con 0x7f68541021a0 2024-04-20T12:31:22.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.055+0000 7f685b831640 1 -- 172.21.15.135:0/891926554 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68541a5690 con 0x7f68541021a0 2024-04-20T12:31:22.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.057+0000 7f684a7fc640 1 -- 172.21.15.135:0/891926554 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f6844044070 con 0x7f68541021a0 2024-04-20T12:31:22.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.058+0000 7f685e41d740 1 Processor -- start 2024-04-20T12:31:22.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.058+0000 7f685e41d740 1 -- start start 2024-04-20T12:31:22.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.058+0000 7f685e41d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec16e10 0x55630ec171f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.064 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.058+0000 7f685e41d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec1fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.058+0000 7f685e41d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec20310 0x55630ec22700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.058+0000 7f685e41d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55630eb7c110 con 0x55630ec17730 2024-04-20T12:31:22.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.058+0000 7f685e41d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55630eb19550 con 0x55630ec16e10 2024-04-20T12:31:22.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.058+0000 7f685e41d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55630eb780d0 con 0x55630ec20310 2024-04-20T12:31:22.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.058+0000 7f684a7fc640 1 --2- 172.21.15.135:0/891926554 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f68400a3d20 0x7f68400a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.058+0000 7f68595cd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec1fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.058+0000 7f6858dcc640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec20310 0x55630ec22700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.058+0000 7f68595cd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec1fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42760/0 (socket says 172.21.15.135:42760) 2024-04-20T12:31:22.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.058+0000 7f6859dce640 1 --2- 172.21.15.135:0/891926554 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f68400a3d20 0x7f68400a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.058+0000 7f68595cd640 1 -- 172.21.15.135:0/4282711251 learned_addr learned my addr 172.21.15.135:0/4282711251 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:22.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.058+0000 7f6859dce640 1 --2- 172.21.15.135:0/4282711251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec16e10 0x55630ec171f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.059+0000 7f684a7fc640 1 -- 172.21.15.135:0/891926554 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f68440f24d0 con 0x7f68541021a0 2024-04-20T12:31:22.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.059+0000 7f6858dcc640 1 -- 172.21.15.135:0/4282711251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec16e10 msgr2=0x55630ec171f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.065 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.059+0000 7f6858dcc640 1 --2- 172.21.15.135:0/4282711251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec16e10 0x55630ec171f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.059+0000 7f6858dcc640 1 -- 172.21.15.135:0/4282711251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 msgr2=0x55630ec1fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.059+0000 7f6858dcc640 1 --2- 172.21.15.135:0/4282711251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec1fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.059+0000 7f6858dcc640 1 -- 172.21.15.135:0/4282711251 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55630eb41900 con 0x55630ec20310 2024-04-20T12:31:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.059+0000 7f6859dce640 1 --2- 172.21.15.135:0/891926554 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f68400a3d20 0x7f68400a61e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f684c0098b0 tx=0x7f684c009d90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.059+0000 7f6858dcc640 1 --2- 172.21.15.135:0/4282711251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec20310 0x55630ec22700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f685406b600 tx=0x7f6850011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d293161f22d9aa72 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.059+0000 7f683f7fe640 1 -- 172.21.15.135:0/4282711251 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685001e070 con 0x55630ec20310 2024-04-20T12:31:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.059+0000 7f683f7fe640 1 -- 172.21.15.135:0/4282711251 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6850009d70 con 0x55630ec20310 2024-04-20T12:31:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.059+0000 7f683f7fe640 1 -- 172.21.15.135:0/4282711251 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6850019410 con 0x55630ec20310 2024-04-20T12:31:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.060+0000 7f685e41d740 1 -- 172.21.15.135:0/4282711251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec20310 msgr2=0x55630ec22700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.060+0000 7f685e41d740 1 --2- 172.21.15.135:0/4282711251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec20310 0x55630ec22700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f685406b600 tx=0x7f6850011810 comp rx=0 tx=0).stop 2024-04-20T12:31:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.060+0000 7f685e41d740 1 -- 172.21.15.135:0/4282711251 shutdown_connections 2024-04-20T12:31:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.060+0000 7f685e41d740 1 --2- 172.21.15.135:0/4282711251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec20310 0x55630ec22700 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.060+0000 7f685e41d740 1 --2- 172.21.15.135:0/4282711251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec1fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.066 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.060+0000 7f685e41d740 1 --2- 172.21.15.135:0/4282711251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec16e10 0x55630ec171f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.060+0000 7f685e41d740 1 -- 172.21.15.135:0/4282711251 >> 172.21.15.135:0/4282711251 conn(0x55630ec11540 msgr2=0x55630ec11920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.060+0000 7f685e41d740 1 -- 172.21.15.135:0/4282711251 shutdown_connections 2024-04-20T12:31:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.060+0000 7f685e41d740 1 -- 172.21.15.135:0/4282711251 wait complete. 2024-04-20T12:31:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.060+0000 7f685e41d740 1 -- start start 2024-04-20T12:31:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.060+0000 7f685e41d740 1 Processor -- start 2024-04-20T12:31:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f685e41d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec16e10 0x55630ec1d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f685e41d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec1d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.067 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f685e41d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec20310 0x55630ec1de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f685e41d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55630ec23040 con 0x55630ec17730 2024-04-20T12:31:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f685e41d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55630eb35500 con 0x55630ec20310 2024-04-20T12:31:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f685e41d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55630ec231c0 con 0x55630ec16e10 2024-04-20T12:31:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f685e41d740 10 client.0 _ll_register_callbacks cb 0x55630eb1a2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f6858dcc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec1d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f6858dcc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec1d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42776/0 (socket says 172.21.15.135:42776) 2024-04-20T12:31:22.068 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f6858dcc640 1 -- 172.21.15.135:0/1364309773 learned_addr learned my addr 172.21.15.135:0/1364309773 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:22.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f68595cd640 1 --2- 172.21.15.135:0/1364309773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec16e10 0x55630ec1d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f6859dce640 1 --2- 172.21.15.135:0/1364309773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec20310 0x55630ec1de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f6858dcc640 1 -- 172.21.15.135:0/1364309773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec16e10 msgr2=0x55630ec1d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f6858dcc640 1 --2- 172.21.15.135:0/1364309773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec16e10 0x55630ec1d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f6858dcc640 1 -- 172.21.15.135:0/1364309773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec20310 msgr2=0x55630ec1de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f6858dcc640 1 --2- 172.21.15.135:0/1364309773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec20310 0x55630ec1de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f6858dcc640 1 -- 172.21.15.135:0/1364309773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55630e88e3f0 con 0x55630ec17730 2024-04-20T12:31:22.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f6858dcc640 1 --2- 172.21.15.135:0/1364309773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec1d920 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f6850003890 tx=0x7f6850005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b767c58b1fc132 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:22.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f683cff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:22.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f683cff9640 1 -- 172.21.15.135:0/1364309773 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685001e040 con 0x55630ec17730 2024-04-20T12:31:22.069 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.061+0000 7f683cff9640 1 -- 172.21.15.135:0/1364309773 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f68500046c0 con 0x55630ec17730 2024-04-20T12:31:22.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.062+0000 7f685e41d740 1 -- 172.21.15.135:0/1364309773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6850009d70 con 0x55630ec17730 2024-04-20T12:31:22.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.062+0000 7f683cff9640 1 -- 172.21.15.135:0/1364309773 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6850031050 con 0x55630ec17730 2024-04-20T12:31:22.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.062+0000 7f685e41d740 10 client.18147 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:22.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.062+0000 7f685e41d740 1 -- 172.21.15.135:0/1364309773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55630e9587d0 con 0x55630ec17730 2024-04-20T12:31:22.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.062+0000 7f683cff9640 1 -- 172.21.15.135:0/1364309773 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6850009d70 con 0x55630ec17730 2024-04-20T12:31:22.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.062+0000 7f683cff9640 1 -- 172.21.15.135:0/1364309773 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f685002c030 con 0x55630ec17730 2024-04-20T12:31:22.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.062+0000 7f685e41d740 10 client.18147 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:22.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.062+0000 7f685e41d740 10 client.18147 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:31:22.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.062+0000 7f685e41d740 20 client.18147 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:22.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.062+0000 7f685e41d740 1 --2- 172.21.15.135:0/1364309773 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55630ec305a0 0x55630ec32990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.062+0000 7f685e41d740 4 client.18147 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:22.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.062+0000 7f685e41d740 1 -- 172.21.15.135:0/1364309773 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55630eb89b30 con 0x55630ec305a0 2024-04-20T12:31:22.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.062+0000 7f68595cd640 1 --2- 172.21.15.135:0/1364309773 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55630ec305a0 0x55630ec32990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.063+0000 7f683cff9640 10 client.18147 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:31:22.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.063+0000 7f68595cd640 1 --2- 172.21.15.135:0/1364309773 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55630ec305a0 0x55630ec32990 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3c3dc65a865c66c0 server_cookie=98d8e4f4abddf626 in_seq=0 out_seq=0 2024-04-20T12:31:22.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.063+0000 7f683cff9640 1 -- 172.21.15.135:0/1364309773 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55630eb89b30 con 0x55630ec305a0 2024-04-20T12:31:22.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.063+0000 7f683cff9640 10 client.18147 handle_command_reply: tid=0 2024-04-20T12:31:22.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.063+0000 7f685e41d740 1 client.18147 shutdown 2024-04-20T12:31:22.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.064+0000 7f685e41d740 1 -- 172.21.15.135:0/1364309773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 msgr2=0x55630ec1d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.064+0000 7f685e41d740 1 --2- 172.21.15.135:0/1364309773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec1d920 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f6850003890 tx=0x7f6850005720 comp rx=0 tx=0).stop 2024-04-20T12:31:22.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.064+0000 7f685e41d740 1 -- 172.21.15.135:0/1364309773 shutdown_connections 2024-04-20T12:31:22.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.064+0000 7f685e41d740 1 --2- 172.21.15.135:0/1364309773 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55630ec305a0 0x55630ec32990 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.064+0000 7f685e41d740 1 --2- 172.21.15.135:0/1364309773 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec20310 0x55630ec1de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.064+0000 7f685e41d740 1 --2- 172.21.15.135:0/1364309773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec1d920 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.064+0000 7f683cff9640 0 client.18147 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:31:22.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.064+0000 7f685e41d740 1 --2- 172.21.15.135:0/1364309773 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec16e10 0x55630ec1d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.064+0000 7f685e41d740 1 -- 172.21.15.135:0/1364309773 >> 172.21.15.135:0/1364309773 conn(0x55630ec11540 msgr2=0x55630ec13290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:22.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.064+0000 7f685e41d740 1 -- 172.21.15.135:0/1364309773 shutdown_connections 2024-04-20T12:31:22.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.064+0000 7f685e41d740 1 -- 172.21.15.135:0/1364309773 wait complete. 2024-04-20T12:31:22.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.064+0000 7f685e41d740 20 client.18147 trim_cache size 0 max 16384 2024-04-20T12:31:22.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f685e41d740 1 Processor -- start 2024-04-20T12:31:22.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f685e41d740 1 -- start start 2024-04-20T12:31:22.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f685e41d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec16e10 0x55630ec1fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f685e41d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec17730 0x55630ec2bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f685e41d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec20310 0x55630ec38190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f685e41d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f68541af5a0 con 0x55630ec20310 2024-04-20T12:31:22.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f685e41d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f68541b10e0 con 0x55630ec17730 2024-04-20T12:31:22.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f685e41d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f68541afc70 con 0x55630ec16e10 2024-04-20T12:31:22.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f6859dce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec20310 0x55630ec38190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f6859dce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec20310 0x55630ec38190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42782/0 (socket says 172.21.15.135:42782) 2024-04-20T12:31:22.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f6859dce640 1 -- 172.21.15.135:0/425226523 learned_addr learned my addr 172.21.15.135:0/425226523 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:22.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f68595cd640 1 --2- 172.21.15.135:0/425226523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec16e10 0x55630ec1fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f6858dcc640 1 --2- 172.21.15.135:0/425226523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec17730 0x55630ec2bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f6859dce640 1 -- 172.21.15.135:0/425226523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec16e10 msgr2=0x55630ec1fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f6859dce640 1 --2- 172.21.15.135:0/425226523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec16e10 0x55630ec1fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f6859dce640 1 -- 172.21.15.135:0/425226523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec17730 msgr2=0x55630ec2bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f6859dce640 1 --2- 172.21.15.135:0/425226523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec17730 0x55630ec2bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.077+0000 7f6859dce640 1 -- 172.21.15.135:0/425226523 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55630ec32d00 con 0x55630ec20310 2024-04-20T12:31:22.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.078+0000 7f6859dce640 1 --2- 172.21.15.135:0/425226523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec20310 0x55630ec38190 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f684c009a90 tx=0x7f684c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ec836f75a51f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:22.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.078+0000 7f683effd640 1 -- 172.21.15.135:0/425226523 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c004b20 con 0x55630ec20310 2024-04-20T12:31:22.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.078+0000 7f683effd640 1 -- 172.21.15.135:0/425226523 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f684c004cc0 con 0x55630ec20310 2024-04-20T12:31:22.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.078+0000 7f683effd640 1 -- 172.21.15.135:0/425226523 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f684c0054b0 con 0x55630ec20310 2024-04-20T12:31:22.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.078+0000 7f685e41d740 1 -- 172.21.15.135:0/425226523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec20310 msgr2=0x55630ec38190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.078+0000 7f685e41d740 1 --2- 172.21.15.135:0/425226523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec20310 0x55630ec38190 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f684c009a90 tx=0x7f684c004ab0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.078+0000 7f685e41d740 1 -- 172.21.15.135:0/425226523 shutdown_connections 2024-04-20T12:31:22.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.078+0000 7f685e41d740 1 --2- 172.21.15.135:0/425226523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec20310 0x55630ec38190 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.078+0000 7f685e41d740 1 --2- 172.21.15.135:0/425226523 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec17730 0x55630ec2bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.078+0000 7f685e41d740 1 --2- 172.21.15.135:0/425226523 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec16e10 0x55630ec1fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.078+0000 7f685e41d740 1 -- 172.21.15.135:0/425226523 >> 172.21.15.135:0/425226523 conn(0x55630ec11540 msgr2=0x55630ec17b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:22.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.078+0000 7f685e41d740 1 -- 172.21.15.135:0/425226523 shutdown_connections 2024-04-20T12:31:22.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.078+0000 7f685e41d740 1 -- 172.21.15.135:0/425226523 wait complete. 2024-04-20T12:31:22.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.079+0000 7f685e41d740 1 -- start start 2024-04-20T12:31:22.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.079+0000 7f685e41d740 1 Processor -- start 2024-04-20T12:31:22.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.079+0000 7f685e41d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec16e10 0x55630ec28790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.079+0000 7f685e41d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec19d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.079+0000 7f685e41d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec20310 0x55630ec1a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.079+0000 7f685e41d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f68541b0a10 con 0x55630ec17730 2024-04-20T12:31:22.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.079+0000 7f685e41d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f68541b0340 con 0x55630ec16e10 2024-04-20T12:31:22.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.079+0000 7f685e41d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f68541ad570 con 0x55630ec20310 2024-04-20T12:31:22.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.079+0000 7f685e41d740 10 client.0 _ll_register_callbacks cb 0x7f685001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:22.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.079+0000 7f6858dcc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec19d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.079+0000 7f6858dcc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec19d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42784/0 (socket says 172.21.15.135:42784) 2024-04-20T12:31:22.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.079+0000 7f6858dcc640 1 -- 172.21.15.135:0/4123449352 learned_addr learned my addr 172.21.15.135:0/4123449352 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:22.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.079+0000 7f68595cd640 1 --2- 172.21.15.135:0/4123449352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec16e10 0x55630ec28790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.079+0000 7f6859dce640 1 --2- 172.21.15.135:0/4123449352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec20310 0x55630ec1a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f6858dcc640 1 -- 172.21.15.135:0/4123449352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec20310 msgr2=0x55630ec1a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f6858dcc640 1 --2- 172.21.15.135:0/4123449352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec20310 0x55630ec1a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f6858dcc640 1 -- 172.21.15.135:0/4123449352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec16e10 msgr2=0x55630ec28790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f6858dcc640 1 --2- 172.21.15.135:0/4123449352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec16e10 0x55630ec28790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f6858dcc640 1 -- 172.21.15.135:0/4123449352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55630ec1a9d0 con 0x55630ec17730 2024-04-20T12:31:22.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f6859dce640 1 --2- 172.21.15.135:0/4123449352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec20310 0x55630ec1a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:22.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f6858dcc640 1 --2- 172.21.15.135:0/4123449352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec19d50 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x55630ec1e9b0 tx=0x7f6850003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8420649ec50692c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:22.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f683cff9640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:22.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f683cff9640 1 -- 172.21.15.135:0/4123449352 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f685001e040 con 0x55630ec17730 2024-04-20T12:31:22.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f683cff9640 1 -- 172.21.15.135:0/4123449352 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f6850009cb0 con 0x55630ec17730 2024-04-20T12:31:22.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f685e41d740 1 -- 172.21.15.135:0/4123449352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f684c004cc0 con 0x55630ec17730 2024-04-20T12:31:22.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f683cff9640 1 -- 172.21.15.135:0/4123449352 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6850004150 con 0x55630ec17730 2024-04-20T12:31:22.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f685e41d740 10 client.18153 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:22.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f685e41d740 1 -- 172.21.15.135:0/4123449352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55630ec96970 con 0x55630ec17730 2024-04-20T12:31:22.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f683cff9640 1 -- 172.21.15.135:0/4123449352 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f684c004cc0 con 0x55630ec17730 2024-04-20T12:31:22.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f683cff9640 1 -- 172.21.15.135:0/4123449352 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f685002c040 con 0x55630ec17730 2024-04-20T12:31:22.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f685e41d740 10 client.18153 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:22.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f685e41d740 10 client.18153 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:31:22.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f685e41d740 20 client.18153 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:22.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f685e41d740 1 --2- 172.21.15.135:0/4123449352 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55630ec97170 0x55630ec99590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f685e41d740 4 client.18153 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:31:22.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.080+0000 7f685e41d740 1 -- 172.21.15.135:0/4123449352 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55630eb839a0 con 0x55630ec97170 2024-04-20T12:31:22.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f68595cd640 1 --2- 172.21.15.135:0/4123449352 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55630ec97170 0x55630ec99590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f68595cd640 1 --2- 172.21.15.135:0/4123449352 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55630ec97170 0x55630ec99590 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a0829fb7bd7fc360 server_cookie=1ad28cdcfef22c0c in_seq=0 out_seq=0 2024-04-20T12:31:22.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f683cff9640 10 client.18153 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:31:22.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f683cff9640 1 -- 172.21.15.135:0/4123449352 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55630eb839a0 con 0x55630ec97170 2024-04-20T12:31:22.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f683cff9640 10 client.18153 handle_command_reply: tid=0 2024-04-20T12:31:22.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f685e41d740 1 client.18153 shutdown 2024-04-20T12:31:22.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f685e41d740 1 -- 172.21.15.135:0/4123449352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 msgr2=0x55630ec19d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f685e41d740 1 --2- 172.21.15.135:0/4123449352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec19d50 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x55630ec1e9b0 tx=0x7f6850003700 comp rx=0 tx=0).stop 2024-04-20T12:31:22.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f685e41d740 1 -- 172.21.15.135:0/4123449352 shutdown_connections 2024-04-20T12:31:22.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f685e41d740 1 --2- 172.21.15.135:0/4123449352 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55630ec97170 0x55630ec99590 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f685e41d740 1 --2- 172.21.15.135:0/4123449352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55630ec20310 0x55630ec1a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f685e41d740 1 --2- 172.21.15.135:0/4123449352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55630ec17730 0x55630ec19d50 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f683cff9640 0 client.18153 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:31:22.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f685e41d740 1 --2- 172.21.15.135:0/4123449352 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55630ec16e10 0x55630ec28790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f685e41d740 1 -- 172.21.15.135:0/4123449352 >> 172.21.15.135:0/4123449352 conn(0x55630ec11540 msgr2=0x55630ec1d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:22.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f685e41d740 1 -- 172.21.15.135:0/4123449352 shutdown_connections 2024-04-20T12:31:22.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f685e41d740 1 -- 172.21.15.135:0/4123449352 wait complete. 2024-04-20T12:31:22.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.081+0000 7f685e41d740 20 client.18153 trim_cache size 0 max 16384 2024-04-20T12:31:22.088 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:31:22.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.082+0000 7f685b831640 1 -- 172.21.15.135:0/891926554 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f68400a3d20 msgr2=0x7f68400a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.082+0000 7f685b831640 1 --2- 172.21.15.135:0/891926554 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f68400a3d20 0x7f68400a61e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f684c0098b0 tx=0x7f684c009d90 comp rx=0 tx=0).stop 2024-04-20T12:31:22.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.082+0000 7f685b831640 1 -- 172.21.15.135:0/891926554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68541021a0 msgr2=0x7f685419e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.082+0000 7f685b831640 1 --2- 172.21.15.135:0/891926554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68541021a0 0x7f685419e5b0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f6844006010 tx=0x7f684402cb30 comp rx=0 tx=0).stop 2024-04-20T12:31:22.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.082+0000 7f685b831640 1 -- 172.21.15.135:0/891926554 shutdown_connections 2024-04-20T12:31:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.082+0000 7f685b831640 1 --2- 172.21.15.135:0/891926554 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f68400a3d20 0x7f68400a61e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.082+0000 7f685b831640 1 --2- 172.21.15.135:0/891926554 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68541986c0 0x7f6854198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.082+0000 7f685b831640 1 --2- 172.21.15.135:0/891926554 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6854107270 0x7f685419eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.082+0000 7f685b831640 1 --2- 172.21.15.135:0/891926554 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68541021a0 0x7f685419e5b0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.082+0000 7f685b831640 1 -- 172.21.15.135:0/891926554 >> 172.21.15.135:0/891926554 conn(0x7f68540fda40 msgr2=0x7f68540fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.082+0000 7f685b831640 1 -- 172.21.15.135:0/891926554 shutdown_connections 2024-04-20T12:31:22.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.082+0000 7f685b831640 1 -- 172.21.15.135:0/891926554 wait complete. 2024-04-20T12:31:22.091 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:21 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2983825345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:31:22.092 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:31:22.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.193+0000 7fdea639d640 1 -- 172.21.15.135:0/2946262297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea0107280 msgr2=0x7fdea010ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.193+0000 7fdea639d640 1 --2- 172.21.15.135:0/2946262297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea0107280 0x7fdea010ee50 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fde98009ca0 tx=0x7fde9802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.193+0000 7fdea639d640 1 -- 172.21.15.135:0/2946262297 shutdown_connections 2024-04-20T12:31:22.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.193+0000 7fdea639d640 1 --2- 172.21.15.135:0/2946262297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea0107280 0x7fdea010ee50 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.193+0000 7fdea639d640 1 --2- 172.21.15.135:0/2946262297 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdea0102b60 0x7fdea0106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.193+0000 7fdea639d640 1 --2- 172.21.15.135:0/2946262297 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea01021b0 0x7fdea0102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.193+0000 7fdea639d640 1 -- 172.21.15.135:0/2946262297 >> 172.21.15.135:0/2946262297 conn(0x7fdea00793f0 msgr2=0x7fdea0079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:22.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.193+0000 7fdea639d640 1 -- 172.21.15.135:0/2946262297 shutdown_connections 2024-04-20T12:31:22.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.193+0000 7fdea639d640 1 -- 172.21.15.135:0/2946262297 wait complete. 2024-04-20T12:31:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.193+0000 7fdea639d640 1 Processor -- start 2024-04-20T12:31:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.193+0000 7fdea639d640 1 -- start start 2024-04-20T12:31:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fdea639d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea01021b0 0x7fdea019e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fdea639d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdea0107280 0x7fdea019e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fdea639d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea0198660 0x7fdea0198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fdea639d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdea0112340 con 0x7fdea0198660 2024-04-20T12:31:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fdea639d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01121c0 con 0x7fdea0107280 2024-04-20T12:31:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fdea639d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01124c0 con 0x7fdea01021b0 2024-04-20T12:31:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fdea493a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea0198660 0x7fdea0198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fdea493a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea0198660 0x7fdea0198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42802/0 (socket says 172.21.15.135:42802) 2024-04-20T12:31:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fdea493a640 1 -- 172.21.15.135:0/1373767753 learned_addr learned my addr 172.21.15.135:0/1373767753 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fde9f7fe640 1 --2- 172.21.15.135:0/1373767753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdea0107280 0x7fdea019e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fde9ffff640 1 --2- 172.21.15.135:0/1373767753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea01021b0 0x7fdea019e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fdea493a640 1 -- 172.21.15.135:0/1373767753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea01021b0 msgr2=0x7fdea019e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fdea493a640 1 --2- 172.21.15.135:0/1373767753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea01021b0 0x7fdea019e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fdea493a640 1 -- 172.21.15.135:0/1373767753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdea0107280 msgr2=0x7fdea019e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fdea493a640 1 --2- 172.21.15.135:0/1373767753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdea0107280 0x7fdea019e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fdea493a640 1 -- 172.21.15.135:0/1373767753 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea0199180 con 0x7fdea0198660 2024-04-20T12:31:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.194+0000 7fdea493a640 1 --2- 172.21.15.135:0/1373767753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea0198660 0x7fdea0198b10 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fde9802c700 tx=0x7fde98032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.195+0000 7fde9d7fa640 1 -- 172.21.15.135:0/1373767753 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98039040 con 0x7fdea0198660 2024-04-20T12:31:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.195+0000 7fde9d7fa640 1 -- 172.21.15.135:0/1373767753 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde98044070 con 0x7fdea0198660 2024-04-20T12:31:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.195+0000 7fdea639d640 1 -- 172.21.15.135:0/1373767753 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea0199410 con 0x7fdea0198660 2024-04-20T12:31:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.195+0000 7fde9d7fa640 1 -- 172.21.15.135:0/1373767753 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde980042a0 con 0x7fdea0198660 2024-04-20T12:31:22.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.195+0000 7fdea639d640 1 -- 172.21.15.135:0/1373767753 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea01a55b0 con 0x7fdea0198660 2024-04-20T12:31:22.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.197+0000 7fde9d7fa640 1 -- 172.21.15.135:0/1373767753 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fde98004440 con 0x7fdea0198660 2024-04-20T12:31:22.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.197+0000 7fdea8f8e740 1 Processor -- start 2024-04-20T12:31:22.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fdea8f8e740 1 -- start start 2024-04-20T12:31:22.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fdea8f8e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e330e10 0x55d14e3311f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fdea8f8e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e331730 0x55d14e339dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fdea8f8e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e33a310 0x55d14e33c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fdea8f8e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d14e296110 con 0x55d14e33a310 2024-04-20T12:31:22.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fdea8f8e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d14e233550 con 0x55d14e331730 2024-04-20T12:31:22.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fdea8f8e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d14e2920d0 con 0x55d14e330e10 2024-04-20T12:31:22.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fde9d7fa640 1 --2- 172.21.15.135:0/1373767753 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde880a3d20 0x7fde880a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fde9f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e33a310 0x55d14e33c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fde9f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e33a310 0x55d14e33c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42808/0 (socket says 172.21.15.135:42808) 2024-04-20T12:31:22.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fde9f7fe640 1 -- 172.21.15.135:0/3624645823 learned_addr learned my addr 172.21.15.135:0/3624645823 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:22.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fde9ffff640 1 --2- 172.21.15.135:0/3624645823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e331730 0x55d14e339dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fde9f7fe640 1 --2- 172.21.15.135:0/3624645823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e330e10 0x55d14e3311f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fdea493a640 1 --2- 172.21.15.135:0/1373767753 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde880a3d20 0x7fde880a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fde9d7fa640 1 -- 172.21.15.135:0/1373767753 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7fde980f2e00 con 0x7fdea0198660 2024-04-20T12:31:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fde9f7fe640 1 -- 172.21.15.135:0/3624645823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e330e10 msgr2=0x55d14e3311f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fde9f7fe640 1 --2- 172.21.15.135:0/3624645823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e330e10 0x55d14e3311f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fde9f7fe640 1 -- 172.21.15.135:0/3624645823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e331730 msgr2=0x55d14e339dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fde9f7fe640 1 --2- 172.21.15.135:0/3624645823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e331730 0x55d14e339dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fde9f7fe640 1 -- 172.21.15.135:0/3624645823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d14e25b900 con 0x55d14e33a310 2024-04-20T12:31:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fde9f7fe640 1 --2- 172.21.15.135:0/3624645823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e33a310 0x55d14e33c700 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fde940126c0 tx=0x7fde9400b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625f097911535520 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.198+0000 7fdea493a640 1 --2- 172.21.15.135:0/1373767753 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde880a3d20 0x7fde880a61e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fde980bb4b0 tx=0x7fde98032950 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.199+0000 7fde867fc640 1 -- 172.21.15.135:0/3624645823 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94012c40 con 0x55d14e33a310 2024-04-20T12:31:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.199+0000 7fde867fc640 1 -- 172.21.15.135:0/3624645823 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde94012de0 con 0x55d14e33a310 2024-04-20T12:31:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.199+0000 7fde867fc640 1 -- 172.21.15.135:0/3624645823 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94004a00 con 0x55d14e33a310 2024-04-20T12:31:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.199+0000 7fdea8f8e740 1 -- 172.21.15.135:0/3624645823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e33a310 msgr2=0x55d14e33c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.199+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/3624645823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e33a310 0x55d14e33c700 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fde940126c0 tx=0x7fde9400b6e0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.199+0000 7fdea8f8e740 1 -- 172.21.15.135:0/3624645823 shutdown_connections 2024-04-20T12:31:22.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.199+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/3624645823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e33a310 0x55d14e33c700 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.199+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/3624645823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e331730 0x55d14e339dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.199+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/3624645823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e330e10 0x55d14e3311f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.199+0000 7fdea8f8e740 1 -- 172.21.15.135:0/3624645823 >> 172.21.15.135:0/3624645823 conn(0x55d14e32b540 msgr2=0x55d14e32b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:22.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.199+0000 7fdea8f8e740 1 -- 172.21.15.135:0/3624645823 shutdown_connections 2024-04-20T12:31:22.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.199+0000 7fdea8f8e740 1 -- 172.21.15.135:0/3624645823 wait complete. 2024-04-20T12:31:22.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fdea8f8e740 1 -- start start 2024-04-20T12:31:22.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fdea8f8e740 1 Processor -- start 2024-04-20T12:31:22.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fdea8f8e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e330e10 0x55d14e3374d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fdea8f8e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e331730 0x55d14e337a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fdea8f8e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e33a310 0x55d14e337f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fdea8f8e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d14e33d0a0 con 0x55d14e330e10 2024-04-20T12:31:22.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fdea8f8e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d14e24f500 con 0x55d14e331730 2024-04-20T12:31:22.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fdea8f8e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d14e33d220 con 0x55d14e33a310 2024-04-20T12:31:22.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fdea8f8e740 10 client.0 _ll_register_callbacks cb 0x55d14e2342f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:22.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fde9f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e330e10 0x55d14e3374d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fde9f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e330e10 0x55d14e3374d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42820/0 (socket says 172.21.15.135:42820) 2024-04-20T12:31:22.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fde9f7fe640 1 -- 172.21.15.135:0/3573370725 learned_addr learned my addr 172.21.15.135:0/3573370725 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:22.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fde9f7fe640 1 --2- 172.21.15.135:0/3573370725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e33a310 0x55d14e337f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fde9ffff640 1 --2- 172.21.15.135:0/3573370725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e331730 0x55d14e337a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fde9f7fe640 1 -- 172.21.15.135:0/3573370725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e33a310 msgr2=0x55d14e337f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fde9f7fe640 1 --2- 172.21.15.135:0/3573370725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e33a310 0x55d14e337f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fde9f7fe640 1 -- 172.21.15.135:0/3573370725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e331730 msgr2=0x55d14e337a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fde9f7fe640 1 --2- 172.21.15.135:0/3573370725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e331730 0x55d14e337a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.200+0000 7fde9f7fe640 1 -- 172.21.15.135:0/3573370725 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d14dfa83f0 con 0x55d14e330e10 2024-04-20T12:31:22.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fde9f7fe640 1 --2- 172.21.15.135:0/3573370725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e330e10 0x55d14e3374d0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fde94005250 tx=0x7fde9400b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce2201a2fcc4d72 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:22.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fde7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fde7f7fe640 1 -- 172.21.15.135:0/3573370725 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94012c40 con 0x55d14e330e10 2024-04-20T12:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fde7f7fe640 1 -- 172.21.15.135:0/3573370725 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7fde94010b50 con 0x55d14e330e10 2024-04-20T12:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fdea8f8e740 1 -- 172.21.15.135:0/3573370725 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde94012de0 con 0x55d14e330e10 2024-04-20T12:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fde7f7fe640 1 -- 172.21.15.135:0/3573370725 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fde94010d50 con 0x55d14e330e10 2024-04-20T12:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fdea8f8e740 10 client.18165 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fdea8f8e740 1 -- 172.21.15.135:0/3573370725 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d14e0727d0 con 0x55d14e330e10 2024-04-20T12:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fde7f7fe640 1 -- 172.21.15.135:0/3573370725 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde94012de0 con 0x55d14e330e10 2024-04-20T12:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fde7f7fe640 1 -- 172.21.15.135:0/3573370725 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fde9401e5d0 con 0x55d14e330e10 2024-04-20T12:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fdea8f8e740 10 client.18165 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fdea8f8e740 10 client.18165 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fdea8f8e740 20 client.18165 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/3573370725 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d14e34a680 0x55d14e34ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fdea8f8e740 4 client.18165 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.201+0000 7fdea8f8e740 1 -- 172.21.15.135:0/3573370725 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d14e2a3b30 con 0x55d14e34a680 2024-04-20T12:31:22.208 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.202+0000 7fde9ffff640 1 --2- 172.21.15.135:0/3573370725 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d14e34a680 0x55d14e34ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.202+0000 7fde7f7fe640 10 client.18165 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.202+0000 7fde9ffff640 1 --2- 172.21.15.135:0/3573370725 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d14e34a680 0x55d14e34ca70 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e77618ea56e6b132 server_cookie=447d8144856eb827 in_seq=0 out_seq=0 2024-04-20T12:31:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.203+0000 7fde7f7fe640 1 -- 172.21.15.135:0/3573370725 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d14e2a3b30 con 0x55d14e34a680 2024-04-20T12:31:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.203+0000 7fde7f7fe640 10 client.18165 handle_command_reply: tid=0 2024-04-20T12:31:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.203+0000 7fdea8f8e740 1 client.18165 shutdown 2024-04-20T12:31:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.203+0000 7fdea8f8e740 1 -- 172.21.15.135:0/3573370725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e330e10 msgr2=0x55d14e3374d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.203+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/3573370725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e330e10 0x55d14e3374d0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fde94005250 tx=0x7fde9400b570 comp rx=0 tx=0).stop 2024-04-20T12:31:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.203+0000 7fdea8f8e740 1 -- 172.21.15.135:0/3573370725 shutdown_connections 2024-04-20T12:31:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.203+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/3573370725 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d14e34a680 0x55d14e34ca70 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.203+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/3573370725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e33a310 0x55d14e337f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.203+0000 7fde7f7fe640 0 client.18165 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.203+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/3573370725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e331730 0x55d14e337a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.203+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/3573370725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e330e10 0x55d14e3374d0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.203+0000 7fdea8f8e740 1 -- 172.21.15.135:0/3573370725 >> 172.21.15.135:0/3573370725 conn(0x55d14e32b540 msgr2=0x55d14e32d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:22.209 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.203+0000 7fdea8f8e740 1 -- 172.21.15.135:0/3573370725 shutdown_connections 2024-04-20T12:31:22.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.203+0000 7fdea8f8e740 1 -- 172.21.15.135:0/3573370725 wait complete. 2024-04-20T12:31:22.210 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.203+0000 7fdea8f8e740 20 client.18165 trim_cache size 0 max 16384 2024-04-20T12:31:22.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fdea8f8e740 1 Processor -- start 2024-04-20T12:31:22.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fdea8f8e740 1 -- start start 2024-04-20T12:31:22.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fdea8f8e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e330e10 0x55d14e339c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fdea8f8e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e331730 0x55d14e345f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fdea8f8e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e33a310 0x55d14e336630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fdea8f8e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01af440 con 0x55d14e331730 2024-04-20T12:31:22.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fdea8f8e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01b0f80 con 0x55d14e330e10 2024-04-20T12:31:22.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fdea8f8e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01afb10 con 0x55d14e33a310 2024-04-20T12:31:22.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fde9ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e331730 0x55d14e345f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fde9ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e331730 0x55d14e345f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42832/0 (socket says 172.21.15.135:42832) 2024-04-20T12:31:22.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fde9ffff640 1 -- 172.21.15.135:0/734945737 learned_addr learned my addr 172.21.15.135:0/734945737 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:22.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fde9f7fe640 1 --2- 172.21.15.135:0/734945737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e33a310 0x55d14e336630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fde9ffff640 1 -- 172.21.15.135:0/734945737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e33a310 msgr2=0x55d14e336630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fde9ffff640 1 --2- 172.21.15.135:0/734945737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e33a310 0x55d14e336630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fde9ffff640 1 -- 172.21.15.135:0/734945737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e330e10 msgr2=0x55d14e339c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fde9ffff640 1 --2- 172.21.15.135:0/734945737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e330e10 0x55d14e339c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.216+0000 7fde9ffff640 1 -- 172.21.15.135:0/734945737 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d14e33cfe0 con 0x55d14e331730 2024-04-20T12:31:22.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.217+0000 7fde9ffff640 1 --2- 172.21.15.135:0/734945737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e331730 0x55d14e345f60 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x55d14e336d30 tx=0x7fde9000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcaa8b5e4eb4f77 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:22.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.217+0000 7fde85ffb640 1 -- 172.21.15.135:0/734945737 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde90021020 con 0x55d14e331730 2024-04-20T12:31:22.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.217+0000 7fde85ffb640 1 -- 172.21.15.135:0/734945737 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde9001d900 con 0x55d14e331730 2024-04-20T12:31:22.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.217+0000 7fde85ffb640 1 -- 172.21.15.135:0/734945737 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde90011d10 con 0x55d14e331730 2024-04-20T12:31:22.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.217+0000 7fdea8f8e740 1 -- 172.21.15.135:0/734945737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e331730 msgr2=0x55d14e345f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.217+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/734945737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e331730 0x55d14e345f60 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x55d14e336d30 tx=0x7fde9000bf50 comp rx=0 tx=0).stop 2024-04-20T12:31:22.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.217+0000 7fdea8f8e740 1 -- 172.21.15.135:0/734945737 shutdown_connections 2024-04-20T12:31:22.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.217+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/734945737 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e33a310 0x55d14e336630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.217+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/734945737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e331730 0x55d14e345f60 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.217+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/734945737 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e330e10 0x55d14e339c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.217+0000 7fdea8f8e740 1 -- 172.21.15.135:0/734945737 >> 172.21.15.135:0/734945737 conn(0x55d14e32b540 msgr2=0x55d14e329e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:22.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.217+0000 7fdea8f8e740 1 -- 172.21.15.135:0/734945737 shutdown_connections 2024-04-20T12:31:22.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.217+0000 7fdea8f8e740 1 -- 172.21.15.135:0/734945737 wait complete. 2024-04-20T12:31:22.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fdea8f8e740 1 -- start start 2024-04-20T12:31:22.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fdea8f8e740 1 Processor -- start 2024-04-20T12:31:22.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fdea8f8e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e330e10 0x55d14e342660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fdea8f8e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e331730 0x55d14e333d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fdea8f8e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e33a310 0x55d14e3342a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fdea8f8e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01b08b0 con 0x55d14e330e10 2024-04-20T12:31:22.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fdea8f8e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01b01e0 con 0x55d14e33a310 2024-04-20T12:31:22.223 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fdea8f8e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01ad410 con 0x55d14e331730 2024-04-20T12:31:22.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fdea8f8e740 10 client.0 _ll_register_callbacks cb 0x7fde90004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:22.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fde9f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e330e10 0x55d14e342660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fde9f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e330e10 0x55d14e342660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42836/0 (socket says 172.21.15.135:42836) 2024-04-20T12:31:22.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fde9f7fe640 1 -- 172.21.15.135:0/2437254755 learned_addr learned my addr 172.21.15.135:0/2437254755 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:22.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fde9ffff640 1 --2- 172.21.15.135:0/2437254755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e331730 0x55d14e333d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fde9f7fe640 1 -- 172.21.15.135:0/2437254755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e331730 msgr2=0x55d14e333d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fde9f7fe640 1 --2- 172.21.15.135:0/2437254755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e331730 0x55d14e333d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fde9f7fe640 1 -- 172.21.15.135:0/2437254755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e33a310 msgr2=0x55d14e3342a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:22.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fde9f7fe640 1 --2- 172.21.15.135:0/2437254755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e33a310 0x55d14e3342a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.218+0000 7fde9f7fe640 1 -- 172.21.15.135:0/2437254755 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d14e3347e0 con 0x55d14e330e10 2024-04-20T12:31:22.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fde9f7fe640 1 --2- 172.21.15.135:0/2437254755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e330e10 0x55d14e342660 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fde9401eeb0 tx=0x7fde9401eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9683a6fa6082d9d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:22.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fde7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:22.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fde7f7fe640 1 -- 172.21.15.135:0/2437254755 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9400b9b0 con 0x55d14e330e10 2024-04-20T12:31:22.224 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fde7f7fe640 1 -- 172.21.15.135:0/2437254755 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7fde9400bb50 con 0x55d14e330e10 2024-04-20T12:31:22.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fdea8f8e740 1 -- 172.21.15.135:0/2437254755 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde9001d900 con 0x55d14e330e10 2024-04-20T12:31:22.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fde7f7fe640 1 -- 172.21.15.135:0/2437254755 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fde94041050 con 0x55d14e330e10 2024-04-20T12:31:22.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fdea8f8e740 10 client.18171 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:22.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fdea8f8e740 1 -- 172.21.15.135:0/2437254755 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d14e3b0780 con 0x55d14e330e10 2024-04-20T12:31:22.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fde7f7fe640 1 -- 172.21.15.135:0/2437254755 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde9001d900 con 0x55d14e330e10 2024-04-20T12:31:22.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fde7f7fe640 1 -- 172.21.15.135:0/2437254755 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fde940283f0 con 0x55d14e330e10 2024-04-20T12:31:22.225 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fdea8f8e740 10 client.18171 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:22.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fdea8f8e740 10 client.18171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:22.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fdea8f8e740 20 client.18171 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:22.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/2437254755 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d14e3b0dc0 0x55d14e3b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:22.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fdea8f8e740 4 client.18171 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:31:22.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.219+0000 7fdea8f8e740 1 -- 172.21.15.135:0/2437254755 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d14e29d9a0 con 0x55d14e3b0dc0 2024-04-20T12:31:22.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.220+0000 7fde9ffff640 1 --2- 172.21.15.135:0/2437254755 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d14e3b0dc0 0x55d14e3b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:22.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.220+0000 7fde7f7fe640 10 client.18171 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:22.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.220+0000 7fde9ffff640 1 --2- 172.21.15.135:0/2437254755 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d14e3b0dc0 0x55d14e3b31e0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9349f5de6c345071 server_cookie=ee63db9c024215c2 in_seq=0 out_seq=0 2024-04-20T12:31:22.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.220+0000 7fde7f7fe640 1 -- 172.21.15.135:0/2437254755 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d14e29d9a0 con 0x55d14e3b0dc0 2024-04-20T12:31:22.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.220+0000 7fde7f7fe640 10 client.18171 handle_command_reply: tid=0 2024-04-20T12:31:22.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.220+0000 7fdea8f8e740 1 client.18171 shutdown 2024-04-20T12:31:22.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.220+0000 7fdea8f8e740 1 -- 172.21.15.135:0/2437254755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e330e10 msgr2=0x55d14e342660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.220+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/2437254755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e330e10 0x55d14e342660 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fde9401eeb0 tx=0x7fde9401eee0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.226 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.220+0000 7fdea8f8e740 1 -- 172.21.15.135:0/2437254755 shutdown_connections 2024-04-20T12:31:22.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.220+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/2437254755 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55d14e3b0dc0 0x55d14e3b31e0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/2437254755 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d14e33a310 0x55d14e3342a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/2437254755 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d14e331730 0x55d14e333d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fde7f7fe640 0 client.18171 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:22.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea8f8e740 1 --2- 172.21.15.135:0/2437254755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d14e330e10 0x55d14e342660 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea8f8e740 1 -- 172.21.15.135:0/2437254755 >> 172.21.15.135:0/2437254755 conn(0x55d14e32b540 msgr2=0x55d14e337d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:22.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea8f8e740 1 -- 172.21.15.135:0/2437254755 shutdown_connections 2024-04-20T12:31:22.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea8f8e740 1 -- 172.21.15.135:0/2437254755 wait complete. 2024-04-20T12:31:22.227 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea8f8e740 20 client.18171 trim_cache size 0 max 16384 2024-04-20T12:31:22.227 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:31:22.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea639d640 1 -- 172.21.15.135:0/1373767753 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde880a3d20 msgr2=0x7fde880a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea639d640 1 --2- 172.21.15.135:0/1373767753 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde880a3d20 0x7fde880a61e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fde980bb4b0 tx=0x7fde98032950 comp rx=0 tx=0).stop 2024-04-20T12:31:22.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea639d640 1 -- 172.21.15.135:0/1373767753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea0198660 msgr2=0x7fdea0198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:22.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea639d640 1 --2- 172.21.15.135:0/1373767753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea0198660 0x7fdea0198b10 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fde9802c700 tx=0x7fde98032f20 comp rx=0 tx=0).stop 2024-04-20T12:31:22.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea639d640 1 -- 172.21.15.135:0/1373767753 shutdown_connections 2024-04-20T12:31:22.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea639d640 1 --2- 172.21.15.135:0/1373767753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea0198660 0x7fdea0198b10 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea639d640 1 --2- 172.21.15.135:0/1373767753 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdea0107280 0x7fdea019e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea639d640 1 --2- 172.21.15.135:0/1373767753 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde880a3d20 0x7fde880a61e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea639d640 1 --2- 172.21.15.135:0/1373767753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea01021b0 0x7fdea019e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:22.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea639d640 1 -- 172.21.15.135:0/1373767753 >> 172.21.15.135:0/1373767753 conn(0x7fdea00793f0 msgr2=0x7fdea00ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:22.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea639d640 1 -- 172.21.15.135:0/1373767753 shutdown_connections 2024-04-20T12:31:22.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:22.221+0000 7fdea639d640 1 -- 172.21.15.135:0/1373767753 wait complete. 2024-04-20T12:31:22.231 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:21 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2983825345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:31:22.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:21 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2983825345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:31:23.233 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:31:23.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:31:23.233 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:31:23.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:22 smithi154 ceph-mon[22073]: pgmap v254: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:31:23.258 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:22 smithi135 ceph-mon[18264]: pgmap v254: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:31:23.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:22 smithi139 ceph-mon[21834]: pgmap v254: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:31:23.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.348+0000 7f04a0d7e640 1 -- 172.21.15.135:0/4287862982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f049c107270 msgr2=0x7f049c10ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.348+0000 7f04a0d7e640 1 --2- 172.21.15.135:0/4287862982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f049c107270 0x7f049c10ee40 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f0494009ca0 tx=0x7f049402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.348+0000 7f04a0d7e640 1 -- 172.21.15.135:0/4287862982 shutdown_connections 2024-04-20T12:31:23.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.348+0000 7f04a0d7e640 1 --2- 172.21.15.135:0/4287862982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f049c107270 0x7f049c10ee40 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.348+0000 7f04a0d7e640 1 --2- 172.21.15.135:0/4287862982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f049c102b50 0x7f049c106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.350 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.348+0000 7f04a0d7e640 1 --2- 172.21.15.135:0/4287862982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f049c1021a0 0x7f049c102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.348+0000 7f04a0d7e640 1 -- 172.21.15.135:0/4287862982 >> 172.21.15.135:0/4287862982 conn(0x7f049c0fd9a0 msgr2=0x7f049c0ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:23.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.348+0000 7f04a0d7e640 1 -- 172.21.15.135:0/4287862982 shutdown_connections 2024-04-20T12:31:23.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.348+0000 7f04a0d7e640 1 -- 172.21.15.135:0/4287862982 wait complete. 2024-04-20T12:31:23.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.349+0000 7f04a0d7e640 1 Processor -- start 2024-04-20T12:31:23.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.349+0000 7f04a0d7e640 1 -- start start 2024-04-20T12:31:23.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.349+0000 7f04a0d7e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f049c1021a0 0x7f049c1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.349+0000 7f04a0d7e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f049c107270 0x7f049c198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.349+0000 7f04a0d7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f049c19d020 0x7f049c19d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.349+0000 7f04a0d7e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f049c112330 con 0x7f049c107270 2024-04-20T12:31:23.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.349+0000 7f04a0d7e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1121b0 con 0x7f049c1021a0 2024-04-20T12:31:23.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.349+0000 7f04a0d7e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1124b0 con 0x7f049c19d020 2024-04-20T12:31:23.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.349+0000 7f0499d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f049c107270 0x7f049c198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.349+0000 7f0499d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f049c107270 0x7f049c198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42856/0 (socket says 172.21.15.135:42856) 2024-04-20T12:31:23.351 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.349+0000 7f0499d9b640 1 -- 172.21.15.135:0/1665266188 learned_addr learned my addr 172.21.15.135:0/1665266188 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.349+0000 7f049ad9d640 1 --2- 172.21.15.135:0/1665266188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f049c19d020 0x7f049c19d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.349+0000 7f049a59c640 1 --2- 172.21.15.135:0/1665266188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f049c1021a0 0x7f049c1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.350+0000 7f0499d9b640 1 -- 172.21.15.135:0/1665266188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f049c19d020 msgr2=0x7f049c19d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.350+0000 7f0499d9b640 1 --2- 172.21.15.135:0/1665266188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f049c19d020 0x7f049c19d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.350+0000 7f0499d9b640 1 -- 172.21.15.135:0/1665266188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f049c1021a0 msgr2=0x7f049c1987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.350+0000 7f0499d9b640 1 --2- 172.21.15.135:0/1665266188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f049c1021a0 0x7f049c1987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.350+0000 7f0499d9b640 1 -- 172.21.15.135:0/1665266188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c19db10 con 0x7f049c107270 2024-04-20T12:31:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.350+0000 7f049a59c640 1 --2- 172.21.15.135:0/1665266188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f049c1021a0 0x7f049c1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.350+0000 7f0499d9b640 1 --2- 172.21.15.135:0/1665266188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f049c107270 0x7f049c198cf0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f049000c970 tx=0x7f049000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.350+0000 7f048b7fe640 1 -- 172.21.15.135:0/1665266188 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490007bb0 con 0x7f049c107270 2024-04-20T12:31:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.350+0000 7f04a0d7e640 1 -- 172.21.15.135:0/1665266188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049c19de00 con 0x7f049c107270 2024-04-20T12:31:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.350+0000 7f048b7fe640 1 -- 172.21.15.135:0/1665266188 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0490007d50 con 0x7f049c107270 2024-04-20T12:31:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.350+0000 7f048b7fe640 1 -- 172.21.15.135:0/1665266188 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900187a0 con 0x7f049c107270 2024-04-20T12:31:23.352 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.350+0000 7f04a0d7e640 1 -- 172.21.15.135:0/1665266188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049c1a55f0 con 0x7f049c107270 2024-04-20T12:31:23.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.352+0000 7f048b7fe640 1 -- 172.21.15.135:0/1665266188 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f049000f450 con 0x7f049c107270 2024-04-20T12:31:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f04a396d740 1 Processor -- start 2024-04-20T12:31:23.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f04a396d740 1 -- start start 2024-04-20T12:31:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f04a396d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f3403c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f04a396d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 0x559b0f348fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f04a396d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 0x559b0f34b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f048b7fe640 1 --2- 172.21.15.135:0/1665266188 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f04840a3d20 0x7f04840a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f04a396d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559b0f2a4f00 con 0x559b0f33ffe0 2024-04-20T12:31:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f04a396d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559b0f242530 con 0x559b0f340900 2024-04-20T12:31:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f04a396d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559b0f2a0ec0 con 0x559b0f3494e0 2024-04-20T12:31:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f049ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f3403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f049ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f3403c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42864/0 (socket says 172.21.15.135:42864) 2024-04-20T12:31:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f049ad9d640 1 -- 172.21.15.135:0/3896519328 learned_addr learned my addr 172.21.15.135:0/3896519328 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f048b7fe640 1 -- 172.21.15.135:0/1665266188 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f04900d0bd0 con 0x7f049c107270 2024-04-20T12:31:23.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f049ad9d640 1 --2- 172.21.15.135:0/1665266188 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f04840a3d20 0x7f04840a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f0499d9b640 1 --2- 172.21.15.135:0/3896519328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 0x559b0f34b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.353+0000 7f049a59c640 1 --2- 172.21.15.135:0/3896519328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 0x559b0f348fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.354+0000 7f049ad9d640 1 -- 172.21.15.135:0/3896519328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 msgr2=0x559b0f34b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.354+0000 7f049ad9d640 1 --2- 172.21.15.135:0/3896519328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 0x559b0f34b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.354+0000 7f049ad9d640 1 -- 172.21.15.135:0/3896519328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 msgr2=0x559b0f348fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.354+0000 7f049ad9d640 1 --2- 172.21.15.135:0/3896519328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 0x559b0f348fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.354+0000 7f049ad9d640 1 -- 172.21.15.135:0/3896519328 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b0f07f7e0 con 0x559b0f33ffe0 2024-04-20T12:31:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.354+0000 7f049a59c640 1 --2- 172.21.15.135:0/3896519328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 0x559b0f348fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.354+0000 7f0499d9b640 1 --2- 172.21.15.135:0/3896519328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 0x559b0f34b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.354+0000 7f049ad9d640 1 --2- 172.21.15.135:0/3896519328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f3403c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f0494009ca0 tx=0x7f0494032690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff088d5f98d4d57d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.354+0000 7f049ad9d640 1 --2- 172.21.15.135:0/1665266188 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f04840a3d20 0x7f04840a61e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0494036000 tx=0x7f0494042000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.354+0000 7f0488ff9640 1 -- 172.21.15.135:0/3896519328 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494051070 con 0x559b0f33ffe0 2024-04-20T12:31:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.354+0000 7f0488ff9640 1 -- 172.21.15.135:0/3896519328 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0494004b40 con 0x559b0f33ffe0 2024-04-20T12:31:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.354+0000 7f0488ff9640 1 -- 172.21.15.135:0/3896519328 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494039040 con 0x559b0f33ffe0 2024-04-20T12:31:23.363 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.355+0000 7f04a396d740 1 -- 172.21.15.135:0/3896519328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 msgr2=0x559b0f3403c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.355+0000 7f04a396d740 1 --2- 172.21.15.135:0/3896519328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f3403c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f0494009ca0 tx=0x7f0494032690 comp rx=0 tx=0).stop 2024-04-20T12:31:23.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.355+0000 7f04a396d740 1 -- 172.21.15.135:0/3896519328 shutdown_connections 2024-04-20T12:31:23.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.355+0000 7f04a396d740 1 --2- 172.21.15.135:0/3896519328 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 0x559b0f34b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.355+0000 7f04a396d740 1 --2- 172.21.15.135:0/3896519328 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 0x559b0f348fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.355+0000 7f04a396d740 1 --2- 172.21.15.135:0/3896519328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f3403c0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.355+0000 7f04a396d740 1 -- 172.21.15.135:0/3896519328 >> 172.21.15.135:0/3896519328 conn(0x559b0f33a710 msgr2=0x559b0f33aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:23.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.355+0000 7f04a396d740 1 -- 172.21.15.135:0/3896519328 shutdown_connections 2024-04-20T12:31:23.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.355+0000 7f04a396d740 1 -- 172.21.15.135:0/3896519328 wait complete. 2024-04-20T12:31:23.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.355+0000 7f04a396d740 1 -- start start 2024-04-20T12:31:23.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.355+0000 7f04a396d740 1 Processor -- start 2024-04-20T12:31:23.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f04a396d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f348f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f04a396d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 0x559b0f3462c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.364 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f04a396d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 0x559b0f346a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f04a396d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559b0f34c270 con 0x559b0f33ffe0 2024-04-20T12:31:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f04a396d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559b0f22d480 con 0x559b0f340900 2024-04-20T12:31:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f04a396d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559b0f34c3f0 con 0x559b0f3494e0 2024-04-20T12:31:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f04a396d740 10 client.0 _ll_register_callbacks cb 0x559b0f22ce70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f049a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f348f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f049a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f348f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42872/0 (socket says 172.21.15.135:42872) 2024-04-20T12:31:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f049a59c640 1 -- 172.21.15.135:0/2540321116 learned_addr learned my addr 172.21.15.135:0/2540321116 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f0499d9b640 1 --2- 172.21.15.135:0/2540321116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 0x559b0f3462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f049ad9d640 1 --2- 172.21.15.135:0/2540321116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 0x559b0f346a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f049a59c640 1 -- 172.21.15.135:0/2540321116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 msgr2=0x559b0f346a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f049a59c640 1 --2- 172.21.15.135:0/2540321116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 0x559b0f346a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f049a59c640 1 -- 172.21.15.135:0/2540321116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 msgr2=0x559b0f3462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f049a59c640 1 --2- 172.21.15.135:0/2540321116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 0x559b0f3462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f049a59c640 1 -- 172.21.15.135:0/2540321116 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b0f0dff70 con 0x559b0f33ffe0 2024-04-20T12:31:23.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f0499d9b640 1 --2- 172.21.15.135:0/2540321116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 0x559b0f3462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f049a59c640 1 --2- 172.21.15.135:0/2540321116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f348f30 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f048c010760 tx=0x7f048c010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6134f771b3f04743 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f0481ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f0481ffb640 1 -- 172.21.15.135:0/2540321116 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c00ed40 con 0x559b0f33ffe0 2024-04-20T12:31:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f0481ffb640 1 -- 172.21.15.135:0/2540321116 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f048c005020 con 0x559b0f33ffe0 2024-04-20T12:31:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f04a396d740 1 -- 172.21.15.135:0/2540321116 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0494004b40 con 0x559b0f33ffe0 2024-04-20T12:31:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f0481ffb640 1 -- 172.21.15.135:0/2540321116 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f048c010e70 con 0x559b0f33ffe0 2024-04-20T12:31:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f04a396d740 10 client.18183 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.356+0000 7f04a396d740 1 -- 172.21.15.135:0/2540321116 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559b0ef77170 con 0x559b0f33ffe0 2024-04-20T12:31:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.357+0000 7f0481ffb640 1 -- 172.21.15.135:0/2540321116 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0494004b40 con 0x559b0f33ffe0 2024-04-20T12:31:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.357+0000 7f0481ffb640 1 -- 172.21.15.135:0/2540321116 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f048c011440 con 0x559b0f33ffe0 2024-04-20T12:31:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.357+0000 7f04a396d740 10 client.18183 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.357+0000 7f04a396d740 10 client.18183 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:23.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.357+0000 7f04a396d740 20 client.18183 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.357+0000 7f04a396d740 1 --2- 172.21.15.135:0/2540321116 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559b0f3595d0 0x559b0f35ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.357+0000 7f04a396d740 4 client.18183 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.357+0000 7f04a396d740 1 -- 172.21.15.135:0/2540321116 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b0f2b2920 con 0x559b0f3595d0 2024-04-20T12:31:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.357+0000 7f0499d9b640 1 --2- 172.21.15.135:0/2540321116 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559b0f3595d0 0x559b0f35ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.358+0000 7f0499d9b640 1 --2- 172.21.15.135:0/2540321116 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559b0f3595d0 0x559b0f35ba60 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1cc3cf4483e3447 server_cookie=aec92748f5427694 in_seq=0 out_seq=0 2024-04-20T12:31:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.358+0000 7f0481ffb640 10 client.18183 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.358+0000 7f0481ffb640 1 -- 172.21.15.135:0/2540321116 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559b0f2b2920 con 0x559b0f3595d0 2024-04-20T12:31:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.358+0000 7f0481ffb640 10 client.18183 handle_command_reply: tid=0 2024-04-20T12:31:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.358+0000 7f04a396d740 1 client.18183 shutdown 2024-04-20T12:31:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.358+0000 7f04a396d740 1 -- 172.21.15.135:0/2540321116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 msgr2=0x559b0f348f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.358+0000 7f04a396d740 1 --2- 172.21.15.135:0/2540321116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f348f30 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f048c010760 tx=0x7f048c010c20 comp rx=0 tx=0).stop 2024-04-20T12:31:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.358+0000 7f04a396d740 1 -- 172.21.15.135:0/2540321116 shutdown_connections 2024-04-20T12:31:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.358+0000 7f04a396d740 1 --2- 172.21.15.135:0/2540321116 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559b0f3595d0 0x559b0f35ba60 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.359+0000 7f04a396d740 1 --2- 172.21.15.135:0/2540321116 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 0x559b0f346a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.359+0000 7f04a396d740 1 --2- 172.21.15.135:0/2540321116 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 0x559b0f3462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.359+0000 7f0481ffb640 0 client.18183 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:23.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.359+0000 7f04a396d740 1 --2- 172.21.15.135:0/2540321116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f348f30 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.359+0000 7f04a396d740 1 -- 172.21.15.135:0/2540321116 >> 172.21.15.135:0/2540321116 conn(0x559b0f33a710 msgr2=0x559b0f33c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:23.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.359+0000 7f04a396d740 1 -- 172.21.15.135:0/2540321116 shutdown_connections 2024-04-20T12:31:23.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.359+0000 7f04a396d740 1 -- 172.21.15.135:0/2540321116 wait complete. 2024-04-20T12:31:23.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.359+0000 7f04a396d740 20 client.18183 trim_cache size 0 max 16384 2024-04-20T12:31:23.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.376+0000 7f04a396d740 1 Processor -- start 2024-04-20T12:31:23.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.376+0000 7f04a396d740 1 -- start start 2024-04-20T12:31:23.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.376+0000 7f04a396d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f33ffe0 0x559b0f339500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.376+0000 7f04a396d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f340900 0x559b0f361330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.376+0000 7f04a396d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f3494e0 0x559b0f361870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.376+0000 7f04a396d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1af3f0 con 0x559b0f340900 2024-04-20T12:31:23.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.376+0000 7f04a396d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1b0f30 con 0x559b0f3494e0 2024-04-20T12:31:23.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.376+0000 7f04a396d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1afac0 con 0x559b0f33ffe0 2024-04-20T12:31:23.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.376+0000 7f0499d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f340900 0x559b0f361330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.376+0000 7f0499d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f340900 0x559b0f361330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42884/0 (socket says 172.21.15.135:42884) 2024-04-20T12:31:23.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.376+0000 7f0499d9b640 1 -- 172.21.15.135:0/2291816908 learned_addr learned my addr 172.21.15.135:0/2291816908 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:23.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.377+0000 7f049a59c640 1 --2- 172.21.15.135:0/2291816908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f33ffe0 0x559b0f339500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.377+0000 7f049ad9d640 1 --2- 172.21.15.135:0/2291816908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f3494e0 0x559b0f361870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.377+0000 7f0499d9b640 1 -- 172.21.15.135:0/2291816908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f33ffe0 msgr2=0x559b0f339500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.377+0000 7f0499d9b640 1 --2- 172.21.15.135:0/2291816908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f33ffe0 0x559b0f339500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.377+0000 7f0499d9b640 1 -- 172.21.15.135:0/2291816908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f3494e0 msgr2=0x559b0f361870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.377+0000 7f0499d9b640 1 --2- 172.21.15.135:0/2291816908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f3494e0 0x559b0f361870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.377+0000 7f0499d9b640 1 -- 172.21.15.135:0/2291816908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b0f346d70 con 0x559b0f340900 2024-04-20T12:31:23.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.377+0000 7f049ad9d640 1 --2- 172.21.15.135:0/2291816908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f3494e0 0x559b0f361870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:23.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.377+0000 7f0499d9b640 1 --2- 172.21.15.135:0/2291816908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f340900 0x559b0f361330 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f049009c730 tx=0x7f049005c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc5dec2d231f599 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:23.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.377+0000 7f0483fff640 1 -- 172.21.15.135:0/2291816908 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049009c100 con 0x559b0f340900 2024-04-20T12:31:23.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.377+0000 7f0483fff640 1 -- 172.21.15.135:0/2291816908 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f049009cea0 con 0x559b0f340900 2024-04-20T12:31:23.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.377+0000 7f0483fff640 1 -- 172.21.15.135:0/2291816908 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900b4590 con 0x559b0f340900 2024-04-20T12:31:23.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 -- 172.21.15.135:0/2291816908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f340900 msgr2=0x559b0f361330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 --2- 172.21.15.135:0/2291816908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f340900 0x559b0f361330 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f049009c730 tx=0x7f049005c240 comp rx=0 tx=0).stop 2024-04-20T12:31:23.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 -- 172.21.15.135:0/2291816908 shutdown_connections 2024-04-20T12:31:23.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 --2- 172.21.15.135:0/2291816908 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f3494e0 0x559b0f361870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 --2- 172.21.15.135:0/2291816908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f340900 0x559b0f361330 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 --2- 172.21.15.135:0/2291816908 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f33ffe0 0x559b0f339500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 -- 172.21.15.135:0/2291816908 >> 172.21.15.135:0/2291816908 conn(0x559b0f33a710 msgr2=0x559b0f3417d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:23.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 -- 172.21.15.135:0/2291816908 shutdown_connections 2024-04-20T12:31:23.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 -- 172.21.15.135:0/2291816908 wait complete. 2024-04-20T12:31:23.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 -- start start 2024-04-20T12:31:23.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 Processor -- start 2024-04-20T12:31:23.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f34e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 0x559b0f34e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 0x559b0f34ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1b0860 con 0x559b0f33ffe0 2024-04-20T12:31:23.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1b0190 con 0x559b0f340900 2024-04-20T12:31:23.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1ad3c0 con 0x559b0f3494e0 2024-04-20T12:31:23.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f04a396d740 10 client.0 _ll_register_callbacks cb 0x7f048c00cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:23.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f049a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f34e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f049a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f34e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42886/0 (socket says 172.21.15.135:42886) 2024-04-20T12:31:23.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f049a59c640 1 -- 172.21.15.135:0/1963978718 learned_addr learned my addr 172.21.15.135:0/1963978718 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:23.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f049ad9d640 1 --2- 172.21.15.135:0/1963978718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 0x559b0f34ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.378+0000 7f0499d9b640 1 --2- 172.21.15.135:0/1963978718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 0x559b0f34e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f049a59c640 1 -- 172.21.15.135:0/1963978718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 msgr2=0x559b0f34ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f049a59c640 1 --2- 172.21.15.135:0/1963978718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 0x559b0f34ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f049a59c640 1 -- 172.21.15.135:0/1963978718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 msgr2=0x559b0f34e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f049a59c640 1 --2- 172.21.15.135:0/1963978718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 0x559b0f34e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f049a59c640 1 -- 172.21.15.135:0/1963978718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b0f3c86b0 con 0x559b0f33ffe0 2024-04-20T12:31:23.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f0499d9b640 1 --2- 172.21.15.135:0/1963978718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 0x559b0f34e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:23.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f049a59c640 1 --2- 172.21.15.135:0/1963978718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f34e360 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f048c011a50 tx=0x7f048c00e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1ae55e77281689 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:23.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f0481ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:23.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f0481ffb640 1 -- 172.21.15.135:0/1963978718 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c00c5b0 con 0x559b0f33ffe0 2024-04-20T12:31:23.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f04a396d740 1 -- 172.21.15.135:0/1963978718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f049009cea0 con 0x559b0f33ffe0 2024-04-20T12:31:23.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f0481ffb640 1 -- 172.21.15.135:0/1963978718 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f048c005040 con 0x559b0f33ffe0 2024-04-20T12:31:23.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f0481ffb640 1 -- 172.21.15.135:0/1963978718 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f048c038050 con 0x559b0f33ffe0 2024-04-20T12:31:23.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f04a396d740 10 client.18189 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:23.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f04a396d740 1 -- 172.21.15.135:0/1963978718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559b0f3c99c0 con 0x559b0f33ffe0 2024-04-20T12:31:23.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f0481ffb640 1 -- 172.21.15.135:0/1963978718 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f049009cea0 con 0x559b0f33ffe0 2024-04-20T12:31:23.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f0481ffb640 1 -- 172.21.15.135:0/1963978718 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f048c011ce0 con 0x559b0f33ffe0 2024-04-20T12:31:23.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f04a396d740 10 client.18189 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:23.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f04a396d740 10 client.18189 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:23.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f04a396d740 20 client.18189 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:23.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f04a396d740 1 --2- 172.21.15.135:0/1963978718 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559b0f3ca160 0x559b0f3cc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f04a396d740 4 client.18189 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:31:23.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.379+0000 7f04a396d740 1 -- 172.21.15.135:0/1963978718 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559b0f2ac790 con 0x559b0f3ca160 2024-04-20T12:31:23.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.380+0000 7f0499d9b640 1 --2- 172.21.15.135:0/1963978718 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559b0f3ca160 0x559b0f3cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.380+0000 7f0481ffb640 10 client.18189 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:23.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.380+0000 7f0499d9b640 1 --2- 172.21.15.135:0/1963978718 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559b0f3ca160 0x559b0f3cc580 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2dc79d96618fe90 server_cookie=8b06b95820cbf596 in_seq=0 out_seq=0 2024-04-20T12:31:23.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.381+0000 7f0481ffb640 1 -- 172.21.15.135:0/1963978718 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559b0f2ac790 con 0x559b0f3ca160 2024-04-20T12:31:23.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.381+0000 7f0481ffb640 10 client.18189 handle_command_reply: tid=0 2024-04-20T12:31:23.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.381+0000 7f04a396d740 1 client.18189 shutdown 2024-04-20T12:31:23.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.381+0000 7f04a396d740 1 -- 172.21.15.135:0/1963978718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 msgr2=0x559b0f34e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.381+0000 7f04a396d740 1 --2- 172.21.15.135:0/1963978718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f34e360 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f048c011a50 tx=0x7f048c00e860 comp rx=0 tx=0).stop 2024-04-20T12:31:23.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.381+0000 7f04a396d740 1 -- 172.21.15.135:0/1963978718 shutdown_connections 2024-04-20T12:31:23.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.381+0000 7f04a396d740 1 --2- 172.21.15.135:0/1963978718 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559b0f3ca160 0x559b0f3cc580 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.381+0000 7f04a396d740 1 --2- 172.21.15.135:0/1963978718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559b0f3494e0 0x559b0f34ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.381+0000 7f04a396d740 1 --2- 172.21.15.135:0/1963978718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559b0f340900 0x559b0f34e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.381+0000 7f04a396d740 1 --2- 172.21.15.135:0/1963978718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559b0f33ffe0 0x559b0f34e360 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.381+0000 7f0481ffb640 0 client.18189 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:23.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.381+0000 7f04a396d740 1 -- 172.21.15.135:0/1963978718 >> 172.21.15.135:0/1963978718 conn(0x559b0f33a710 msgr2=0x559b0f33ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:23.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.381+0000 7f04a396d740 1 -- 172.21.15.135:0/1963978718 shutdown_connections 2024-04-20T12:31:23.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.381+0000 7f04a396d740 1 -- 172.21.15.135:0/1963978718 wait complete. 2024-04-20T12:31:23.390 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.382+0000 7f04a396d740 20 client.18189 trim_cache size 0 max 16384 2024-04-20T12:31:23.390 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:31:23.391 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:31:23.391 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "66344827-c66d-4efa-be72-2096c476c126", 2024-04-20T12:31:23.391 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:31:23.391 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:31:23.391 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.382+0000 7f04a0d7e640 1 -- 172.21.15.135:0/1665266188 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f04840a3d20 msgr2=0x7f04840a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.382+0000 7f04a0d7e640 1 --2- 172.21.15.135:0/1665266188 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f04840a3d20 0x7f04840a61e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0494036000 tx=0x7f0494042000 comp rx=0 tx=0).stop 2024-04-20T12:31:23.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.382+0000 7f04a0d7e640 1 -- 172.21.15.135:0/1665266188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f049c107270 msgr2=0x7f049c198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.382+0000 7f04a0d7e640 1 --2- 172.21.15.135:0/1665266188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f049c107270 0x7f049c198cf0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f049000c970 tx=0x7f049000ce30 comp rx=0 tx=0).stop 2024-04-20T12:31:23.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.382+0000 7f04a0d7e640 1 -- 172.21.15.135:0/1665266188 shutdown_connections 2024-04-20T12:31:23.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.382+0000 7f04a0d7e640 1 --2- 172.21.15.135:0/1665266188 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f04840a3d20 0x7f04840a61e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.382+0000 7f04a0d7e640 1 --2- 172.21.15.135:0/1665266188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f049c19d020 0x7f049c19d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.382+0000 7f04a0d7e640 1 --2- 172.21.15.135:0/1665266188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f049c107270 0x7f049c198cf0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.382+0000 7f04a0d7e640 1 --2- 172.21.15.135:0/1665266188 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f049c1021a0 0x7f049c1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.382+0000 7f04a0d7e640 1 -- 172.21.15.135:0/1665266188 >> 172.21.15.135:0/1665266188 conn(0x7f049c0fd9a0 msgr2=0x7f049c0fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:23.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.382+0000 7f04a0d7e640 1 -- 172.21.15.135:0/1665266188 shutdown_connections 2024-04-20T12:31:23.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.382+0000 7f04a0d7e640 1 -- 172.21.15.135:0/1665266188 wait complete. 2024-04-20T12:31:23.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:31:23.393 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:31:23.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.534+0000 7fc690aa5640 1 -- 172.21.15.135:0/2650447823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc68c1031e0 msgr2=0x7fc68c1035c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.534+0000 7fc690aa5640 1 --2- 172.21.15.135:0/2650447823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc68c1031e0 0x7fc68c1035c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009ca0 tx=0x7fc67c02c230 comp rx=0 tx=0).stop 2024-04-20T12:31:23.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.534+0000 7fc690aa5640 1 -- 172.21.15.135:0/2650447823 shutdown_connections 2024-04-20T12:31:23.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.534+0000 7fc690aa5640 1 --2- 172.21.15.135:0/2650447823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc68c10c520 0x7fc68c10e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.534+0000 7fc690aa5640 1 --2- 172.21.15.135:0/2650447823 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc68c103b00 0x7fc68c10bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.534+0000 7fc690aa5640 1 --2- 172.21.15.135:0/2650447823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc68c1031e0 0x7fc68c1035c0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.534+0000 7fc690aa5640 1 -- 172.21.15.135:0/2650447823 >> 172.21.15.135:0/2650447823 conn(0x7fc68c077f60 msgr2=0x7fc68c078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:23.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.534+0000 7fc690aa5640 1 -- 172.21.15.135:0/2650447823 shutdown_connections 2024-04-20T12:31:23.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.534+0000 7fc690aa5640 1 -- 172.21.15.135:0/2650447823 wait complete. 2024-04-20T12:31:23.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.535+0000 7fc690aa5640 1 Processor -- start 2024-04-20T12:31:23.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.535+0000 7fc690aa5640 1 -- start start 2024-04-20T12:31:23.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.535+0000 7fc690aa5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc68c1031e0 0x7fc68c19e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.535+0000 7fc690aa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc68c103b00 0x7fc68c19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.535+0000 7fc690aa5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc68c10c520 0x7fc68c198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.535+0000 7fc690aa5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c112360 con 0x7fc68c10c520 2024-04-20T12:31:23.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.535+0000 7fc690aa5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c1121e0 con 0x7fc68c103b00 2024-04-20T12:31:23.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.535+0000 7fc690aa5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c1124e0 con 0x7fc68c1031e0 2024-04-20T12:31:23.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.535+0000 7fc68ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc68c10c520 0x7fc68c198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.536+0000 7fc68ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc68c10c520 0x7fc68c198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42904/0 (socket says 172.21.15.135:42904) 2024-04-20T12:31:23.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.536+0000 7fc68ad9d640 1 -- 172.21.15.135:0/1605950021 learned_addr learned my addr 172.21.15.135:0/1605950021 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:23.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.536+0000 7fc68a59c640 1 --2- 172.21.15.135:0/1605950021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc68c1031e0 0x7fc68c19e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.536+0000 7fc689d9b640 1 --2- 172.21.15.135:0/1605950021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc68c103b00 0x7fc68c19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.536+0000 7fc68ad9d640 1 -- 172.21.15.135:0/1605950021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc68c1031e0 msgr2=0x7fc68c19e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.536+0000 7fc68ad9d640 1 --2- 172.21.15.135:0/1605950021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc68c1031e0 0x7fc68c19e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.536+0000 7fc68ad9d640 1 -- 172.21.15.135:0/1605950021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc68c103b00 msgr2=0x7fc68c19eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.536+0000 7fc68ad9d640 1 --2- 172.21.15.135:0/1605950021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc68c103b00 0x7fc68c19eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.536+0000 7fc68ad9d640 1 -- 172.21.15.135:0/1605950021 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68c198f40 con 0x7fc68c10c520 2024-04-20T12:31:23.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.536+0000 7fc68ad9d640 1 --2- 172.21.15.135:0/1605950021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc68c10c520 0x7fc68c198680 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fc684009fd0 tx=0x7fc68400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:23.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.536+0000 7fc6837fe640 1 -- 172.21.15.135:0/1605950021 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc684011830 con 0x7fc68c10c520 2024-04-20T12:31:23.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.536+0000 7fc6837fe640 1 -- 172.21.15.135:0/1605950021 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc684016070 con 0x7fc68c10c520 2024-04-20T12:31:23.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.536+0000 7fc690aa5640 1 -- 172.21.15.135:0/1605950021 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc68c199230 con 0x7fc68c10c520 2024-04-20T12:31:23.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.536+0000 7fc6837fe640 1 -- 172.21.15.135:0/1605950021 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68400f2e0 con 0x7fc68c10c520 2024-04-20T12:31:23.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.536+0000 7fc690aa5640 1 -- 172.21.15.135:0/1605950021 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc68c1a5540 con 0x7fc68c10c520 2024-04-20T12:31:23.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.538+0000 7fc6837fe640 1 -- 172.21.15.135:0/1605950021 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fc6840119d0 con 0x7fc68c10c520 2024-04-20T12:31:23.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.539+0000 7fc693774740 1 Processor -- start 2024-04-20T12:31:23.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.539+0000 7fc693774740 1 -- start start 2024-04-20T12:31:23.546 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.539+0000 7fc693774740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52219d0 0x5583a5221db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.539+0000 7fc693774740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a52222f0 0x5583a522f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.539+0000 7fc693774740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a522f630 0x5583a5231a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.539+0000 7fc693774740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5583a51871b0 con 0x5583a522f630 2024-04-20T12:31:23.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.539+0000 7fc693774740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5583a5124390 con 0x5583a52219d0 2024-04-20T12:31:23.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.539+0000 7fc693774740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5583a5183170 con 0x5583a52222f0 2024-04-20T12:31:23.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.539+0000 7fc6837fe640 1 --2- 172.21.15.135:0/1605950021 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc6780a3d20 0x7fc6780a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.539+0000 7fc689d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a522f630 0x5583a5231a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.539+0000 7fc689d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a522f630 0x5583a5231a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42918/0 (socket says 172.21.15.135:42918) 2024-04-20T12:31:23.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.539+0000 7fc689d9b640 1 -- 172.21.15.135:0/2935581405 learned_addr learned my addr 172.21.15.135:0/2935581405 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:23.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.540+0000 7fc68ad9d640 1 --2- 172.21.15.135:0/1605950021 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc6780a3d20 0x7fc6780a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.540+0000 7fc68a59c640 1 --2- 172.21.15.135:0/2935581405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a52222f0 0x5583a522f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.540+0000 7fc689d9b640 1 --2- 172.21.15.135:0/2935581405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52219d0 0x5583a5221db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.540+0000 7fc6837fe640 1 -- 172.21.15.135:0/1605950021 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7fc6840d0100 con 0x7fc68c10c520 2024-04-20T12:31:23.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.540+0000 7fc689d9b640 1 -- 172.21.15.135:0/2935581405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a52222f0 msgr2=0x5583a522f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.547 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.540+0000 7fc689d9b640 1 --2- 172.21.15.135:0/2935581405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a52222f0 0x5583a522f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.540+0000 7fc689d9b640 1 -- 172.21.15.135:0/2935581405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52219d0 msgr2=0x5583a5221db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.540+0000 7fc689d9b640 1 --2- 172.21.15.135:0/2935581405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52219d0 0x5583a5221db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.540+0000 7fc689d9b640 1 -- 172.21.15.135:0/2935581405 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a4f637d0 con 0x5583a522f630 2024-04-20T12:31:23.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.540+0000 7fc68ad9d640 1 --2- 172.21.15.135:0/1605950021 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc6780a3d20 0x7fc6780a61e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc684098200 tx=0x7fc68400bf90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:23.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.540+0000 7fc689d9b640 1 --2- 172.21.15.135:0/2935581405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a522f630 0x5583a5231a20 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fc674013580 tx=0x7fc67400b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfc65a832fdbe57 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:23.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.540+0000 7fc680ff9640 1 -- 172.21.15.135:0/2935581405 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674019030 con 0x5583a522f630 2024-04-20T12:31:23.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.540+0000 7fc680ff9640 1 -- 172.21.15.135:0/2935581405 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc674011920 con 0x5583a522f630 2024-04-20T12:31:23.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.540+0000 7fc680ff9640 1 -- 172.21.15.135:0/2935581405 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc67400f850 con 0x5583a522f630 2024-04-20T12:31:23.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.541+0000 7fc693774740 1 -- 172.21.15.135:0/2935581405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a522f630 msgr2=0x5583a5231a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.541+0000 7fc693774740 1 --2- 172.21.15.135:0/2935581405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a522f630 0x5583a5231a20 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fc674013580 tx=0x7fc67400b690 comp rx=0 tx=0).stop 2024-04-20T12:31:23.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.541+0000 7fc693774740 1 -- 172.21.15.135:0/2935581405 shutdown_connections 2024-04-20T12:31:23.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.541+0000 7fc693774740 1 --2- 172.21.15.135:0/2935581405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a522f630 0x5583a5231a20 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.541+0000 7fc693774740 1 --2- 172.21.15.135:0/2935581405 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a52222f0 0x5583a522f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.548 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.541+0000 7fc693774740 1 --2- 172.21.15.135:0/2935581405 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52219d0 0x5583a5221db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.541+0000 7fc693774740 1 -- 172.21.15.135:0/2935581405 >> 172.21.15.135:0/2935581405 conn(0x5583a521c450 msgr2=0x5583a521c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:23.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.541+0000 7fc693774740 1 -- 172.21.15.135:0/2935581405 shutdown_connections 2024-04-20T12:31:23.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.541+0000 7fc693774740 1 -- 172.21.15.135:0/2935581405 wait complete. 2024-04-20T12:31:23.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.541+0000 7fc693774740 1 -- start start 2024-04-20T12:31:23.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.541+0000 7fc693774740 1 Processor -- start 2024-04-20T12:31:23.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc693774740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a52219d0 0x5583a522c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc693774740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 0x5583a522caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc693774740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a522f630 0x5583a522d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc693774740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5583a5232470 con 0x5583a52219d0 2024-04-20T12:31:23.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc693774740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5583a51402f0 con 0x5583a52222f0 2024-04-20T12:31:23.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc693774740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5583a52325f0 con 0x5583a522f630 2024-04-20T12:31:23.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc693774740 10 client.0 _ll_register_callbacks cb 0x5583a510a4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:23.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc689d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a52219d0 0x5583a522c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.549 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc689d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a52219d0 0x5583a522c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42934/0 (socket says 172.21.15.135:42934) 2024-04-20T12:31:23.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc689d9b640 1 -- 172.21.15.135:0/44438937 learned_addr learned my addr 172.21.15.135:0/44438937 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:23.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc68a59c640 1 --2- 172.21.15.135:0/44438937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 0x5583a522caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc689d9b640 1 -- 172.21.15.135:0/44438937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a522f630 msgr2=0x5583a522d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc689d9b640 1 --2- 172.21.15.135:0/44438937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a522f630 0x5583a522d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc689d9b640 1 -- 172.21.15.135:0/44438937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 msgr2=0x5583a522caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc689d9b640 1 --2- 172.21.15.135:0/44438937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 0x5583a522caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc689d9b640 1 -- 172.21.15.135:0/44438937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583a4e993f0 con 0x5583a52219d0 2024-04-20T12:31:23.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc689d9b640 1 --2- 172.21.15.135:0/44438937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a52219d0 0x5583a522c5b0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fc6740116c0 tx=0x7fc6740116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ecff49e7270fbf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:23.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc671ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:23.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc671ffb640 1 -- 172.21.15.135:0/44438937 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674019040 con 0x5583a52219d0 2024-04-20T12:31:23.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc671ffb640 1 -- 172.21.15.135:0/44438937 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7fc674011cd0 con 0x5583a52219d0 2024-04-20T12:31:23.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc693774740 1 -- 172.21.15.135:0/44438937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc674011920 con 0x5583a52219d0 2024-04-20T12:31:23.550 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc671ffb640 1 -- 172.21.15.135:0/44438937 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc674005040 con 0x5583a52219d0 2024-04-20T12:31:23.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc693774740 10 client.18201 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:23.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.542+0000 7fc693774740 1 -- 172.21.15.135:0/44438937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5583a4e590f0 con 0x5583a52219d0 2024-04-20T12:31:23.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.543+0000 7fc671ffb640 1 -- 172.21.15.135:0/44438937 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc674011920 con 0x5583a52219d0 2024-04-20T12:31:23.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.543+0000 7fc671ffb640 1 -- 172.21.15.135:0/44438937 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc674025070 con 0x5583a52219d0 2024-04-20T12:31:23.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.543+0000 7fc693774740 10 client.18201 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:23.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.543+0000 7fc693774740 10 client.18201 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:23.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.543+0000 7fc693774740 20 client.18201 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:23.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.543+0000 7fc693774740 1 --2- 172.21.15.135:0/44438937 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5583a523f8a0 0x5583a5241c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.543+0000 7fc693774740 4 client.18201 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:23.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.543+0000 7fc693774740 1 -- 172.21.15.135:0/44438937 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583a5194bd0 con 0x5583a523f8a0 2024-04-20T12:31:23.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.543+0000 7fc68a59c640 1 --2- 172.21.15.135:0/44438937 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5583a523f8a0 0x5583a5241c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.543+0000 7fc68a59c640 1 --2- 172.21.15.135:0/44438937 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5583a523f8a0 0x5583a5241c90 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3131d174b6cd84b server_cookie=96b1a2e9f5b93bc2 in_seq=0 out_seq=0 2024-04-20T12:31:23.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.543+0000 7fc671ffb640 10 client.18201 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:23.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.544+0000 7fc671ffb640 1 -- 172.21.15.135:0/44438937 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5583a5194bd0 con 0x5583a523f8a0 2024-04-20T12:31:23.551 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.544+0000 7fc671ffb640 10 client.18201 handle_command_reply: tid=0 2024-04-20T12:31:23.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.544+0000 7fc693774740 1 client.18201 shutdown 2024-04-20T12:31:23.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.544+0000 7fc693774740 1 -- 172.21.15.135:0/44438937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a52219d0 msgr2=0x5583a522c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.544+0000 7fc693774740 1 --2- 172.21.15.135:0/44438937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a52219d0 0x5583a522c5b0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fc6740116c0 tx=0x7fc6740116f0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.544+0000 7fc693774740 1 -- 172.21.15.135:0/44438937 shutdown_connections 2024-04-20T12:31:23.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.544+0000 7fc693774740 1 --2- 172.21.15.135:0/44438937 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5583a523f8a0 0x5583a5241c90 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.544+0000 7fc693774740 1 --2- 172.21.15.135:0/44438937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a522f630 0x5583a522d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.544+0000 7fc693774740 1 --2- 172.21.15.135:0/44438937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 0x5583a522caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.544+0000 7fc671ffb640 0 client.18201 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:23.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.544+0000 7fc693774740 1 --2- 172.21.15.135:0/44438937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a52219d0 0x5583a522c5b0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.544+0000 7fc693774740 1 -- 172.21.15.135:0/44438937 >> 172.21.15.135:0/44438937 conn(0x5583a521c450 msgr2=0x5583a521e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:23.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.544+0000 7fc693774740 1 -- 172.21.15.135:0/44438937 shutdown_connections 2024-04-20T12:31:23.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.544+0000 7fc693774740 1 -- 172.21.15.135:0/44438937 wait complete. 2024-04-20T12:31:23.552 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.544+0000 7fc693774740 20 client.18201 trim_cache size 0 max 16384 2024-04-20T12:31:23.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc693774740 1 Processor -- start 2024-04-20T12:31:23.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc693774740 1 -- start start 2024-04-20T12:31:23.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc693774740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a52219d0 0x5583a522ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc693774740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 0x5583a523b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc693774740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a522f630 0x5583a522ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc693774740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c1ad3a0 con 0x5583a52219d0 2024-04-20T12:31:23.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc693774740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c1aeee0 con 0x5583a52222f0 2024-04-20T12:31:23.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc693774740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c1ada70 con 0x5583a522f630 2024-04-20T12:31:23.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc689d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a52219d0 0x5583a522ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc689d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a52219d0 0x5583a522ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42950/0 (socket says 172.21.15.135:42950) 2024-04-20T12:31:23.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc689d9b640 1 -- 172.21.15.135:0/357032467 learned_addr learned my addr 172.21.15.135:0/357032467 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:23.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc689d9b640 1 --2- 172.21.15.135:0/357032467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a522f630 0x5583a522ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc689d9b640 1 -- 172.21.15.135:0/357032467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a522f630 msgr2=0x5583a522ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc68a59c640 1 --2- 172.21.15.135:0/357032467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 0x5583a523b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc689d9b640 1 --2- 172.21.15.135:0/357032467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a522f630 0x5583a522ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc689d9b640 1 -- 172.21.15.135:0/357032467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 msgr2=0x5583a523b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc689d9b640 1 --2- 172.21.15.135:0/357032467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 0x5583a523b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc689d9b640 1 -- 172.21.15.135:0/357032467 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583a521c280 con 0x5583a52219d0 2024-04-20T12:31:23.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc689d9b640 1 --2- 172.21.15.135:0/357032467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a52219d0 0x5583a522ece0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fc674005010 tx=0x7fc67400b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516c6075feb19e3a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:23.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.562+0000 7fc673fff640 1 -- 172.21.15.135:0/357032467 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674019070 con 0x5583a52219d0 2024-04-20T12:31:23.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.563+0000 7fc673fff640 1 -- 172.21.15.135:0/357032467 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6740132d0 con 0x5583a52219d0 2024-04-20T12:31:23.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.563+0000 7fc673fff640 1 -- 172.21.15.135:0/357032467 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6740048e0 con 0x5583a52219d0 2024-04-20T12:31:23.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.563+0000 7fc693774740 1 -- 172.21.15.135:0/357032467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a52219d0 msgr2=0x5583a522ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.563+0000 7fc693774740 1 --2- 172.21.15.135:0/357032467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a52219d0 0x5583a522ece0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fc674005010 tx=0x7fc67400b490 comp rx=0 tx=0).stop 2024-04-20T12:31:23.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.563+0000 7fc693774740 1 -- 172.21.15.135:0/357032467 shutdown_connections 2024-04-20T12:31:23.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.563+0000 7fc693774740 1 --2- 172.21.15.135:0/357032467 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a522f630 0x5583a522ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.563+0000 7fc693774740 1 --2- 172.21.15.135:0/357032467 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 0x5583a523b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.563+0000 7fc693774740 1 --2- 172.21.15.135:0/357032467 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a52219d0 0x5583a522ece0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.563+0000 7fc693774740 1 -- 172.21.15.135:0/357032467 >> 172.21.15.135:0/357032467 conn(0x5583a521c450 msgr2=0x5583a521b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:23.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.563+0000 7fc693774740 1 -- 172.21.15.135:0/357032467 shutdown_connections 2024-04-20T12:31:23.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.563+0000 7fc693774740 1 -- 172.21.15.135:0/357032467 wait complete. 2024-04-20T12:31:23.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.563+0000 7fc693774740 1 -- start start 2024-04-20T12:31:23.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.563+0000 7fc693774740 1 Processor -- start 2024-04-20T12:31:23.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc693774740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a52219d0 0x5583a52352e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc693774740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 0x5583a5235820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc693774740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a522f630 0x5583a5235d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc693774740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c1ae810 con 0x5583a522f630 2024-04-20T12:31:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc693774740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c1ae140 con 0x5583a52222f0 2024-04-20T12:31:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc693774740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc68c1ab370 con 0x5583a52219d0 2024-04-20T12:31:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc693774740 10 client.0 _ll_register_callbacks cb 0x7fc67c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc689d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a522f630 0x5583a5235d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc689d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a522f630 0x5583a5235d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:42952/0 (socket says 172.21.15.135:42952) 2024-04-20T12:31:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc689d9b640 1 -- 172.21.15.135:0/1515198647 learned_addr learned my addr 172.21.15.135:0/1515198647 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc68a59c640 1 --2- 172.21.15.135:0/1515198647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 0x5583a5235820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc689d9b640 1 -- 172.21.15.135:0/1515198647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a52219d0 msgr2=0x5583a52352e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc689d9b640 1 --2- 172.21.15.135:0/1515198647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a52219d0 0x5583a52352e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc689d9b640 1 -- 172.21.15.135:0/1515198647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 msgr2=0x5583a5235820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc689d9b640 1 --2- 172.21.15.135:0/1515198647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 0x5583a5235820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc689d9b640 1 -- 172.21.15.135:0/1515198647 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583a5231e40 con 0x5583a522f630 2024-04-20T12:31:23.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc68a59c640 1 --2- 172.21.15.135:0/1515198647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 0x5583a5235820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:23.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc689d9b640 1 --2- 172.21.15.135:0/1515198647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a522f630 0x5583a5235d60 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc674015040 tx=0x7fc674013500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b759f17a06aa95a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:23.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc671ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:23.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc671ffb640 1 -- 172.21.15.135:0/1515198647 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674019070 con 0x5583a522f630 2024-04-20T12:31:23.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc671ffb640 1 -- 172.21.15.135:0/1515198647 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7fc6740130d0 con 0x5583a522f630 2024-04-20T12:31:23.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc693774740 1 -- 172.21.15.135:0/1515198647 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6740132d0 con 0x5583a522f630 2024-04-20T12:31:23.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc671ffb640 1 -- 172.21.15.135:0/1515198647 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc674004680 con 0x5583a522f630 2024-04-20T12:31:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.564+0000 7fc693774740 10 client.18207 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.565+0000 7fc693774740 1 -- 172.21.15.135:0/1515198647 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5583a52a5d00 con 0x5583a522f630 2024-04-20T12:31:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.565+0000 7fc671ffb640 1 -- 172.21.15.135:0/1515198647 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6740132d0 con 0x5583a522f630 2024-04-20T12:31:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.565+0000 7fc671ffb640 1 -- 172.21.15.135:0/1515198647 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fc67403d020 con 0x5583a522f630 2024-04-20T12:31:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.565+0000 7fc693774740 10 client.18207 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.565+0000 7fc693774740 10 client.18207 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.565+0000 7fc693774740 20 client.18207 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.565+0000 7fc693774740 1 --2- 172.21.15.135:0/1515198647 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5583a52a6310 0x5583a52a8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.565+0000 7fc693774740 4 client.18207 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:31:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.565+0000 7fc693774740 1 -- 172.21.15.135:0/1515198647 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5583a518ea40 con 0x5583a52a6310 2024-04-20T12:31:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.565+0000 7fc68a59c640 1 --2- 172.21.15.135:0/1515198647 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5583a52a6310 0x5583a52a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.565+0000 7fc671ffb640 10 client.18207 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.565+0000 7fc68a59c640 1 --2- 172.21.15.135:0/1515198647 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5583a52a6310 0x5583a52a8730 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=219f8b595c6d7883 server_cookie=576ae9b27a7f455d in_seq=0 out_seq=0 2024-04-20T12:31:23.576 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc671ffb640 1 -- 172.21.15.135:0/1515198647 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5583a518ea40 con 0x5583a52a6310 2024-04-20T12:31:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc671ffb640 10 client.18207 handle_command_reply: tid=0 2024-04-20T12:31:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc693774740 1 client.18207 shutdown 2024-04-20T12:31:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc693774740 1 -- 172.21.15.135:0/1515198647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a522f630 msgr2=0x5583a5235d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc693774740 1 --2- 172.21.15.135:0/1515198647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a522f630 0x5583a5235d60 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc674015040 tx=0x7fc674013500 comp rx=0 tx=0).stop 2024-04-20T12:31:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc693774740 1 -- 172.21.15.135:0/1515198647 shutdown_connections 2024-04-20T12:31:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc693774740 1 --2- 172.21.15.135:0/1515198647 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5583a52a6310 0x5583a52a8730 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc693774740 1 --2- 172.21.15.135:0/1515198647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5583a522f630 0x5583a5235d60 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc693774740 1 --2- 172.21.15.135:0/1515198647 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5583a52222f0 0x5583a5235820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc671ffb640 0 client.18207 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc693774740 1 --2- 172.21.15.135:0/1515198647 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5583a52219d0 0x5583a52352e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc693774740 1 -- 172.21.15.135:0/1515198647 >> 172.21.15.135:0/1515198647 conn(0x5583a521c450 msgr2=0x5583a522c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc693774740 1 -- 172.21.15.135:0/1515198647 shutdown_connections 2024-04-20T12:31:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc693774740 1 -- 172.21.15.135:0/1515198647 wait complete. 2024-04-20T12:31:23.577 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc693774740 20 client.18207 trim_cache size 0 max 16384 2024-04-20T12:31:23.578 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:31:23.578 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:31:23.578 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:31:23.578 INFO:teuthology.orchestra.run.smithi135.stdout: "66344827-c66d-4efa-be72-2096c476c126": { 2024-04-20T12:31:23.578 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:31:23.578 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "66344827-c66d-4efa-be72-2096c476c126", 2024-04-20T12:31:23.578 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:31:23.578 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:31:23.578 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:31:23.579 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:31:23.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc690aa5640 1 -- 172.21.15.135:0/1605950021 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc6780a3d20 msgr2=0x7fc6780a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc690aa5640 1 --2- 172.21.15.135:0/1605950021 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc6780a3d20 0x7fc6780a61e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc684098200 tx=0x7fc68400bf90 comp rx=0 tx=0).stop 2024-04-20T12:31:23.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc690aa5640 1 -- 172.21.15.135:0/1605950021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc68c10c520 msgr2=0x7fc68c198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:23.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc690aa5640 1 --2- 172.21.15.135:0/1605950021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc68c10c520 0x7fc68c198680 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fc684009fd0 tx=0x7fc68400b8e0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc690aa5640 1 -- 172.21.15.135:0/1605950021 shutdown_connections 2024-04-20T12:31:23.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc690aa5640 1 --2- 172.21.15.135:0/1605950021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc68c10c520 0x7fc68c198680 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc690aa5640 1 --2- 172.21.15.135:0/1605950021 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc68c103b00 0x7fc68c19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc690aa5640 1 --2- 172.21.15.135:0/1605950021 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc6780a3d20 0x7fc6780a61e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.580 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc690aa5640 1 --2- 172.21.15.135:0/1605950021 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc68c1031e0 0x7fc68c19e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:23.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc690aa5640 1 -- 172.21.15.135:0/1605950021 >> 172.21.15.135:0/1605950021 conn(0x7fc68c077f60 msgr2=0x7fc68c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:23.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc690aa5640 1 -- 172.21.15.135:0/1605950021 shutdown_connections 2024-04-20T12:31:23.581 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:23.566+0000 7fc690aa5640 1 -- 172.21.15.135:0/1605950021 wait complete. 2024-04-20T12:31:23.581 INFO:tasks.cephfs.filesystem:scrub status for tag:66344827-c66d-4efa-be72-2096c476c126 - {'path': '/', 'tag': '66344827-c66d-4efa-be72-2096c476c126', 'options': 'recursive,force'} 2024-04-20T12:31:24.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:23 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:31:24.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:23 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:31:24.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:23 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:31:24.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:23 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:31:24.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:23 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:31:24.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:23 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:31:24.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:23 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:31:24.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:23 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:31:24.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:23 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:31:24.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:23 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:31:24.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:23 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:31:24.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:23 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:31:25.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:24 smithi154 ceph-mon[22073]: pgmap v255: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-20T12:31:25.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:24 smithi139 ceph-mon[21834]: pgmap v255: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-20T12:31:25.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:24 smithi135 ceph-mon[18264]: pgmap v255: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-04-20T12:31:27.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:26 smithi154 ceph-mon[22073]: pgmap v256: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-20T12:31:27.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:26 smithi139 ceph-mon[21834]: pgmap v256: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-20T12:31:27.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:26 smithi135 ceph-mon[18264]: pgmap v256: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-04-20T12:31:28.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:27 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:31:28.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:27 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:31:28.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:27 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:31:29.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:28 smithi154 ceph-mon[22073]: pgmap v257: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:29.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:28 smithi139 ceph-mon[21834]: pgmap v257: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:29.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:28 smithi135 ceph-mon[18264]: pgmap v257: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:31.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:30 smithi154 ceph-mon[22073]: pgmap v258: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 op/s 2024-04-20T12:31:31.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:30 smithi139 ceph-mon[21834]: pgmap v258: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 op/s 2024-04-20T12:31:31.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:30 smithi135 ceph-mon[18264]: pgmap v258: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 13 op/s 2024-04-20T12:31:33.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:32 smithi154 ceph-mon[22073]: pgmap v259: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:31:33.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:32 smithi139 ceph-mon[21834]: pgmap v259: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:31:33.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:32 smithi135 ceph-mon[18264]: pgmap v259: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:31:35.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:34 smithi154 ceph-mon[22073]: pgmap v260: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:31:35.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:34 smithi139 ceph-mon[21834]: pgmap v260: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:31:35.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:34 smithi135 ceph-mon[18264]: pgmap v260: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:31:37.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:36 smithi154 ceph-mon[22073]: pgmap v261: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:31:37.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:36 smithi139 ceph-mon[21834]: pgmap v261: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:31:37.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:36 smithi135 ceph-mon[18264]: pgmap v261: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:31:39.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:38 smithi154 ceph-mon[22073]: pgmap v262: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:31:39.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:38 smithi139 ceph-mon[21834]: pgmap v262: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:31:39.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:38 smithi135 ceph-mon[18264]: pgmap v262: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:31:41.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:40 smithi154 ceph-mon[22073]: pgmap v263: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:31:41.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:40 smithi139 ceph-mon[21834]: pgmap v263: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:31:41.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:40 smithi135 ceph-mon[18264]: pgmap v263: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:31:43.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:42 smithi154 ceph-mon[22073]: pgmap v264: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:43.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:42 smithi139 ceph-mon[21834]: pgmap v264: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:43.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:42 smithi135 ceph-mon[18264]: pgmap v264: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:45.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:44 smithi154 ceph-mon[22073]: pgmap v265: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:31:45.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:44 smithi139 ceph-mon[21834]: pgmap v265: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:31:45.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:44 smithi135 ceph-mon[18264]: pgmap v265: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:31:47.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:47 smithi139 ceph-mon[21834]: pgmap v266: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:47.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:47 smithi135 ceph-mon[18264]: pgmap v266: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:47.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:47 smithi154 ceph-mon[22073]: pgmap v266: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:49.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:49 smithi139 ceph-mon[21834]: pgmap v267: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:49.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:49 smithi135 ceph-mon[18264]: pgmap v267: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:49.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:49 smithi154 ceph-mon[22073]: pgmap v267: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:51.302 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:51 smithi154 ceph-mon[22073]: pgmap v268: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:31:51.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:51 smithi139 ceph-mon[21834]: pgmap v268: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:31:51.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:51 smithi135 ceph-mon[18264]: pgmap v268: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:31:53.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:53 smithi139 ceph-mon[21834]: pgmap v269: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:53.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:53 smithi135 ceph-mon[18264]: pgmap v269: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:53.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:53 smithi154 ceph-mon[22073]: pgmap v269: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:53.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:31:53.582 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:31:53.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.696+0000 7f0e71874640 1 -- 172.21.15.135:0/657699997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e6c101b50 msgr2=0x7f0e6c10dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:53.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.696+0000 7f0e71874640 1 --2- 172.21.15.135:0/657699997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e6c101b50 0x7f0e6c10dc90 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009930 tx=0x7f0e6402bc30 comp rx=0 tx=0).stop 2024-04-20T12:31:53.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.696+0000 7f0e71874640 1 -- 172.21.15.135:0/657699997 shutdown_connections 2024-04-20T12:31:53.696 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.696+0000 7f0e71874640 1 --2- 172.21.15.135:0/657699997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e6c101b50 0x7f0e6c10dc90 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.696+0000 7f0e71874640 1 --2- 172.21.15.135:0/657699997 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e6c1011b0 0x7f0e6c101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.696+0000 7f0e71874640 1 --2- 172.21.15.135:0/657699997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e6c107040 0x7f0e6c107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.696+0000 7f0e71874640 1 -- 172.21.15.135:0/657699997 >> 172.21.15.135:0/657699997 conn(0x7f0e6c076c60 msgr2=0x7f0e6c077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:53.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.696+0000 7f0e71874640 1 -- 172.21.15.135:0/657699997 shutdown_connections 2024-04-20T12:31:53.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.696+0000 7f0e71874640 1 -- 172.21.15.135:0/657699997 wait complete. 2024-04-20T12:31:53.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e71874640 1 Processor -- start 2024-04-20T12:31:53.697 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e71874640 1 -- start start 2024-04-20T12:31:53.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e71874640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e6c1011b0 0x7f0e6c1976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e71874640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e6c101b50 0x7f0e6c197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e71874640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e6c107040 0x7f0e6c19bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e71874640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c111240 con 0x7f0e6c1011b0 2024-04-20T12:31:53.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e71874640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c1110c0 con 0x7f0e6c101b50 2024-04-20T12:31:53.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e71874640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c1113c0 con 0x7f0e6c107040 2024-04-20T12:31:53.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e6affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e6c1011b0 0x7f0e6c1976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e6affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e6c1011b0 0x7f0e6c1976e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59012/0 (socket says 172.21.15.135:59012) 2024-04-20T12:31:53.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e6affd640 1 -- 172.21.15.135:0/2830358106 learned_addr learned my addr 172.21.15.135:0/2830358106 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:53.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e6b7fe640 1 --2- 172.21.15.135:0/2830358106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e6c107040 0x7f0e6c19bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e6a7fc640 1 --2- 172.21.15.135:0/2830358106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e6c101b50 0x7f0e6c197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e6affd640 1 -- 172.21.15.135:0/2830358106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e6c107040 msgr2=0x7f0e6c19bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:53.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e6affd640 1 --2- 172.21.15.135:0/2830358106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e6c107040 0x7f0e6c19bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e6affd640 1 -- 172.21.15.135:0/2830358106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e6c101b50 msgr2=0x7f0e6c197c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:53.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e6affd640 1 --2- 172.21.15.135:0/2830358106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e6c101b50 0x7f0e6c197c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.697+0000 7f0e6affd640 1 -- 172.21.15.135:0/2830358106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6c19c6d0 con 0x7f0e6c1011b0 2024-04-20T12:31:53.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.698+0000 7f0e6affd640 1 --2- 172.21.15.135:0/2830358106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e6c1011b0 0x7f0e6c1976e0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c00ea80 tx=0x7f0e5c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:53.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.698+0000 7f0e70872640 1 -- 172.21.15.135:0/2830358106 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c00ce40 con 0x7f0e6c1011b0 2024-04-20T12:31:53.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.698+0000 7f0e71874640 1 -- 172.21.15.135:0/2830358106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6c19c9c0 con 0x7f0e6c1011b0 2024-04-20T12:31:53.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.698+0000 7f0e70872640 1 -- 172.21.15.135:0/2830358106 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e5c005020 con 0x7f0e6c1011b0 2024-04-20T12:31:53.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.698+0000 7f0e70872640 1 -- 172.21.15.135:0/2830358106 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c011760 con 0x7f0e6c1011b0 2024-04-20T12:31:53.700 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.698+0000 7f0e71874640 1 -- 172.21.15.135:0/2830358106 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e6c1a4250 con 0x7f0e6c1011b0 2024-04-20T12:31:53.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.701+0000 7f0e70872640 1 -- 172.21.15.135:0/2830358106 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f0e5c0051d0 con 0x7f0e6c1011b0 2024-04-20T12:31:53.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.701+0000 7f0e7446d740 1 Processor -- start 2024-04-20T12:31:53.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.701+0000 7f0e7446d740 1 -- start start 2024-04-20T12:31:53.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.701+0000 7f0e7446d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557231243810 0x557231243bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.701+0000 7f0e7446d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572312441c0 0x55723124eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.701+0000 7f0e7446d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 0x557231251820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.708 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.701+0000 7f0e7446d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5572311a91b0 con 0x557231243810 2024-04-20T12:31:53.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.701+0000 7f0e7446d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557231146390 con 0x5572312441c0 2024-04-20T12:31:53.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.701+0000 7f0e7446d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5572311a5170 con 0x55723124f430 2024-04-20T12:31:53.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.701+0000 7f0e6b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557231243810 0x557231243bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.701+0000 7f0e6b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557231243810 0x557231243bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59018/0 (socket says 172.21.15.135:59018) 2024-04-20T12:31:53.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.701+0000 7f0e6b7fe640 1 -- 172.21.15.135:0/3294622534 learned_addr learned my addr 172.21.15.135:0/3294622534 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:53.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.701+0000 7f0e6a7fc640 1 --2- 172.21.15.135:0/3294622534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 0x557231251820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.701+0000 7f0e6affd640 1 --2- 172.21.15.135:0/3294622534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572312441c0 0x55723124eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.701+0000 7f0e70872640 1 --2- 172.21.15.135:0/2830358106 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0e540a3d20 0x7f0e540a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.702+0000 7f0e6b7fe640 1 -- 172.21.15.135:0/3294622534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 msgr2=0x557231251820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:53.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.702+0000 7f0e6b7fe640 1 --2- 172.21.15.135:0/3294622534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 0x557231251820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.702+0000 7f0e6b7fe640 1 -- 172.21.15.135:0/3294622534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572312441c0 msgr2=0x55723124eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:53.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.702+0000 7f0e6b7fe640 1 --2- 172.21.15.135:0/3294622534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572312441c0 0x55723124eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.702+0000 7f0e6b7fe640 1 -- 172.21.15.135:0/3294622534 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557230f857d0 con 0x557231243810 2024-04-20T12:31:53.709 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.702+0000 7f0e6a7fc640 1 --2- 172.21.15.135:0/3294622534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 0x557231251820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:31:53.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.702+0000 7f0e70872640 1 -- 172.21.15.135:0/2830358106 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f0e5c0d1140 con 0x7f0e6c1011b0 2024-04-20T12:31:53.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.702+0000 7f0e6b7fe640 1 --2- 172.21.15.135:0/2830358106 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0e540a3d20 0x7f0e540a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.702+0000 7f0e6b7fe640 1 --2- 172.21.15.135:0/3294622534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557231243810 0x557231243bf0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f0e6402cfd0 tx=0x7f0e6402c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01f0be54c13a948 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:53.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.702+0000 7f0e51ffb640 1 -- 172.21.15.135:0/3294622534 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6404f070 con 0x557231243810 2024-04-20T12:31:53.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.702+0000 7f0e51ffb640 1 -- 172.21.15.135:0/3294622534 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e640053f0 con 0x557231243810 2024-04-20T12:31:53.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.702+0000 7f0e51ffb640 1 -- 172.21.15.135:0/3294622534 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64049920 con 0x557231243810 2024-04-20T12:31:53.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.702+0000 7f0e6b7fe640 1 --2- 172.21.15.135:0/2830358106 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0e540a3d20 0x7f0e540a61e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x557231251df0 tx=0x7f0e64049000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:53.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.703+0000 7f0e7446d740 1 -- 172.21.15.135:0/3294622534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557231243810 msgr2=0x557231243bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:53.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.703+0000 7f0e7446d740 1 --2- 172.21.15.135:0/3294622534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557231243810 0x557231243bf0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f0e6402cfd0 tx=0x7f0e6402c5d0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.703+0000 7f0e7446d740 1 -- 172.21.15.135:0/3294622534 shutdown_connections 2024-04-20T12:31:53.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.703+0000 7f0e7446d740 1 --2- 172.21.15.135:0/3294622534 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 0x557231251820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.703+0000 7f0e7446d740 1 --2- 172.21.15.135:0/3294622534 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572312441c0 0x55723124eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.703+0000 7f0e7446d740 1 --2- 172.21.15.135:0/3294622534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557231243810 0x557231243bf0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.710 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.703+0000 7f0e7446d740 1 -- 172.21.15.135:0/3294622534 >> 172.21.15.135:0/3294622534 conn(0x55723123e450 msgr2=0x55723123e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:53.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.703+0000 7f0e7446d740 1 -- 172.21.15.135:0/3294622534 shutdown_connections 2024-04-20T12:31:53.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.703+0000 7f0e7446d740 1 -- 172.21.15.135:0/3294622534 wait complete. 2024-04-20T12:31:53.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.703+0000 7f0e7446d740 1 -- start start 2024-04-20T12:31:53.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e7446d740 1 Processor -- start 2024-04-20T12:31:53.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e7446d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557231243810 0x55723124c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e7446d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572312441c0 0x55723124ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e7446d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 0x55723124cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e7446d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557231252220 con 0x557231243810 2024-04-20T12:31:53.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e7446d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5572311622f0 con 0x5572312441c0 2024-04-20T12:31:53.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e7446d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5572312523a0 con 0x55723124f430 2024-04-20T12:31:53.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e7446d740 10 client.0 _ll_register_callbacks cb 0x55723112c4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:53.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e6affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557231243810 0x55723124c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e6affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557231243810 0x55723124c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59022/0 (socket says 172.21.15.135:59022) 2024-04-20T12:31:53.711 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e6affd640 1 -- 172.21.15.135:0/3871647101 learned_addr learned my addr 172.21.15.135:0/3871647101 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:53.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e6b7fe640 1 --2- 172.21.15.135:0/3871647101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 0x55723124cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e6a7fc640 1 --2- 172.21.15.135:0/3871647101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572312441c0 0x55723124ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e6affd640 1 -- 172.21.15.135:0/3871647101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 msgr2=0x55723124cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:53.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e6affd640 1 --2- 172.21.15.135:0/3871647101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 0x55723124cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e6affd640 1 -- 172.21.15.135:0/3871647101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572312441c0 msgr2=0x55723124ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:53.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e6affd640 1 --2- 172.21.15.135:0/3871647101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572312441c0 0x55723124ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e6affd640 1 -- 172.21.15.135:0/3871647101 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557230ebb3f0 con 0x557231243810 2024-04-20T12:31:53.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e6b7fe640 1 --2- 172.21.15.135:0/3871647101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 0x55723124cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:53.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e6a7fc640 1 --2- 172.21.15.135:0/3871647101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572312441c0 0x55723124ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:53.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e6affd640 1 --2- 172.21.15.135:0/3871647101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557231243810 0x55723124c4c0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0ce520 tx=0x7f0e5c09ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18859bc5758cd68 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:53.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e4affd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:53.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e4affd640 1 -- 172.21.15.135:0/3871647101 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c01f040 con 0x557231243810 2024-04-20T12:31:53.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e7446d740 1 -- 172.21.15.135:0/3871647101 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e640053f0 con 0x557231243810 2024-04-20T12:31:53.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.704+0000 7f0e4affd640 1 -- 172.21.15.135:0/3871647101 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f0e5c0a54f0 con 0x557231243810 2024-04-20T12:31:53.712 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.705+0000 7f0e4affd640 1 -- 172.21.15.135:0/3871647101 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0e5c0ce940 con 0x557231243810 2024-04-20T12:31:53.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.705+0000 7f0e7446d740 10 client.18219 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:53.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.705+0000 7f0e7446d740 1 -- 172.21.15.135:0/3871647101 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557230e7b0f0 con 0x557231243810 2024-04-20T12:31:53.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.705+0000 7f0e4affd640 1 -- 172.21.15.135:0/3871647101 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e640053f0 con 0x557231243810 2024-04-20T12:31:53.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.705+0000 7f0e4affd640 1 -- 172.21.15.135:0/3871647101 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f0e5c00f040 con 0x557231243810 2024-04-20T12:31:53.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.705+0000 7f0e7446d740 10 client.18219 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:53.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.705+0000 7f0e7446d740 10 client.18219 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:53.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.705+0000 7f0e7446d740 20 client.18219 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:53.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.705+0000 7f0e7446d740 1 --2- 172.21.15.135:0/3871647101 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55723125f8a0 0x557231261c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.705+0000 7f0e7446d740 4 client.18219 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:53.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.705+0000 7f0e7446d740 1 -- 172.21.15.135:0/3871647101 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572311b6bd0 con 0x55723125f8a0 2024-04-20T12:31:53.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.705+0000 7f0e6a7fc640 1 --2- 172.21.15.135:0/3871647101 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55723125f8a0 0x557231261c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.713 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.706+0000 7f0e4affd640 10 client.18219 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:53.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.706+0000 7f0e6a7fc640 1 --2- 172.21.15.135:0/3871647101 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55723125f8a0 0x557231261c90 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bb6d6e752d45c90 server_cookie=ad79f58d0deae0e4 in_seq=0 out_seq=0 2024-04-20T12:31:53.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.707+0000 7f0e4affd640 1 -- 172.21.15.135:0/3871647101 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5572311b6bd0 con 0x55723125f8a0 2024-04-20T12:31:53.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.707+0000 7f0e4affd640 10 client.18219 handle_command_reply: tid=0 2024-04-20T12:31:53.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.707+0000 7f0e7446d740 1 client.18219 shutdown 2024-04-20T12:31:53.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.707+0000 7f0e7446d740 1 -- 172.21.15.135:0/3871647101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557231243810 msgr2=0x55723124c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:53.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.707+0000 7f0e7446d740 1 --2- 172.21.15.135:0/3871647101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557231243810 0x55723124c4c0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c0ce520 tx=0x7f0e5c09ccc0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.707+0000 7f0e7446d740 1 -- 172.21.15.135:0/3871647101 shutdown_connections 2024-04-20T12:31:53.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.707+0000 7f0e7446d740 1 --2- 172.21.15.135:0/3871647101 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55723125f8a0 0x557231261c90 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.714 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.707+0000 7f0e7446d740 1 --2- 172.21.15.135:0/3871647101 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 0x55723124cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.707+0000 7f0e7446d740 1 --2- 172.21.15.135:0/3871647101 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5572312441c0 0x55723124ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.707+0000 7f0e4affd640 0 client.18219 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:53.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.707+0000 7f0e7446d740 1 --2- 172.21.15.135:0/3871647101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557231243810 0x55723124c4c0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.707+0000 7f0e7446d740 1 -- 172.21.15.135:0/3871647101 >> 172.21.15.135:0/3871647101 conn(0x55723123e450 msgr2=0x5572312401a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:53.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.707+0000 7f0e7446d740 1 -- 172.21.15.135:0/3871647101 shutdown_connections 2024-04-20T12:31:53.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.707+0000 7f0e7446d740 1 -- 172.21.15.135:0/3871647101 wait complete. 2024-04-20T12:31:53.715 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.707+0000 7f0e7446d740 20 client.18219 trim_cache size 0 max 16384 2024-04-20T12:31:53.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.724+0000 7f0e7446d740 1 Processor -- start 2024-04-20T12:31:53.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.724+0000 7f0e7446d740 1 -- start start 2024-04-20T12:31:53.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.724+0000 7f0e7446d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557231243810 0x55723124ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.724+0000 7f0e7446d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572312441c0 0x55723125b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e7446d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 0x557231267540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e7446d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c1ad240 con 0x5572312441c0 2024-04-20T12:31:53.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e7446d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c1aed80 con 0x557231243810 2024-04-20T12:31:53.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e7446d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c1ad910 con 0x55723124f430 2024-04-20T12:31:53.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e6a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572312441c0 0x55723125b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e6a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572312441c0 0x55723125b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59028/0 (socket says 172.21.15.135:59028) 2024-04-20T12:31:53.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e6a7fc640 1 -- 172.21.15.135:0/3904012419 learned_addr learned my addr 172.21.15.135:0/3904012419 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:53.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e6a7fc640 1 -- 172.21.15.135:0/3904012419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 msgr2=0x557231267540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:53.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e6a7fc640 1 --2- 172.21.15.135:0/3904012419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 0x557231267540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e6a7fc640 1 -- 172.21.15.135:0/3904012419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557231243810 msgr2=0x55723124ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:53.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e6a7fc640 1 --2- 172.21.15.135:0/3904012419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557231243810 0x55723124ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e6a7fc640 1 -- 172.21.15.135:0/3904012419 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723123df80 con 0x5572312441c0 2024-04-20T12:31:53.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e6a7fc640 1 --2- 172.21.15.135:0/3904012419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572312441c0 0x55723125b120 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x55723124bd20 tx=0x7f0e6000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c45ad55d3d77b83 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:53.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e517fa640 1 -- 172.21.15.135:0/3904012419 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e60003d80 con 0x5572312441c0 2024-04-20T12:31:53.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e517fa640 1 -- 172.21.15.135:0/3904012419 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e60023030 con 0x5572312441c0 2024-04-20T12:31:53.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.725+0000 7f0e517fa640 1 -- 172.21.15.135:0/3904012419 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6001f0f0 con 0x5572312441c0 2024-04-20T12:31:53.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 -- 172.21.15.135:0/3904012419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572312441c0 msgr2=0x55723125b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:53.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 --2- 172.21.15.135:0/3904012419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572312441c0 0x55723125b120 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x55723124bd20 tx=0x7f0e6000b390 comp rx=0 tx=0).stop 2024-04-20T12:31:53.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 -- 172.21.15.135:0/3904012419 shutdown_connections 2024-04-20T12:31:53.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 --2- 172.21.15.135:0/3904012419 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55723124f430 0x557231267540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 --2- 172.21.15.135:0/3904012419 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572312441c0 0x55723125b120 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 --2- 172.21.15.135:0/3904012419 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557231243810 0x55723124ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 -- 172.21.15.135:0/3904012419 >> 172.21.15.135:0/3904012419 conn(0x55723123e450 msgr2=0x55723123d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:53.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 -- 172.21.15.135:0/3904012419 shutdown_connections 2024-04-20T12:31:53.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 -- 172.21.15.135:0/3904012419 wait complete. 2024-04-20T12:31:53.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 -- start start 2024-04-20T12:31:53.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 Processor -- start 2024-04-20T12:31:53.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557231243810 0x5572312553f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572312441c0 0x557231255930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55723124f430 0x5572312c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c1ae6b0 con 0x5572312441c0 2024-04-20T12:31:53.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c1adfe0 con 0x55723124f430 2024-04-20T12:31:53.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.726+0000 7f0e7446d740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c1ab210 con 0x557231243810 2024-04-20T12:31:53.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e7446d740 10 client.0 _ll_register_callbacks cb 0x7f0e5c0d4920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:53.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e6a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572312441c0 0x557231255930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e6a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572312441c0 0x557231255930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59044/0 (socket says 172.21.15.135:59044) 2024-04-20T12:31:53.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e6a7fc640 1 -- 172.21.15.135:0/811375644 learned_addr learned my addr 172.21.15.135:0/811375644 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:53.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e6b7fe640 1 --2- 172.21.15.135:0/811375644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55723124f430 0x5572312c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e6a7fc640 1 -- 172.21.15.135:0/811375644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557231243810 msgr2=0x5572312553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:53.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e6a7fc640 1 --2- 172.21.15.135:0/811375644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557231243810 0x5572312553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e6a7fc640 1 -- 172.21.15.135:0/811375644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55723124f430 msgr2=0x5572312c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:53.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e6a7fc640 1 --2- 172.21.15.135:0/811375644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55723124f430 0x5572312c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e6a7fc640 1 -- 172.21.15.135:0/811375644 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557231256230 con 0x5572312441c0 2024-04-20T12:31:53.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e6b7fe640 1 --2- 172.21.15.135:0/811375644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55723124f430 0x5572312c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:53.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e6a7fc640 1 --2- 172.21.15.135:0/811375644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572312441c0 0x557231255930 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f0e60004f40 tx=0x7f0e60004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cbed9ef58ed618 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:53.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e4affd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:53.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e4affd640 1 -- 172.21.15.135:0/811375644 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6002c070 con 0x5572312441c0 2024-04-20T12:31:53.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e4affd640 1 -- 172.21.15.135:0/811375644 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f0e60003d80 con 0x5572312441c0 2024-04-20T12:31:53.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e7446d740 1 -- 172.21.15.135:0/811375644 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e60023030 con 0x5572312441c0 2024-04-20T12:31:53.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e4affd640 1 -- 172.21.15.135:0/811375644 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0e60038050 con 0x5572312441c0 2024-04-20T12:31:53.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e7446d740 10 client.18225 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:53.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e7446d740 1 -- 172.21.15.135:0/811375644 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5572312c6440 con 0x5572312441c0 2024-04-20T12:31:53.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.727+0000 7f0e4affd640 1 -- 172.21.15.135:0/811375644 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e60023030 con 0x5572312441c0 2024-04-20T12:31:53.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.728+0000 7f0e4affd640 1 -- 172.21.15.135:0/811375644 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f0e6001f480 con 0x5572312441c0 2024-04-20T12:31:53.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.728+0000 7f0e7446d740 10 client.18225 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:53.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.728+0000 7f0e7446d740 10 client.18225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:53.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.728+0000 7f0e7446d740 20 client.18225 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:53.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.728+0000 7f0e7446d740 1 --2- 172.21.15.135:0/811375644 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5572312c6b80 0x5572312c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.728+0000 7f0e7446d740 4 client.18225 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:31:53.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.728+0000 7f0e7446d740 1 -- 172.21.15.135:0/811375644 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5572311b0a40 con 0x5572312c6b80 2024-04-20T12:31:53.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.728+0000 7f0e6affd640 1 --2- 172.21.15.135:0/811375644 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5572312c6b80 0x5572312c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.728+0000 7f0e4affd640 10 client.18225 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:53.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.728+0000 7f0e6affd640 1 --2- 172.21.15.135:0/811375644 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5572312c6b80 0x5572312c8fa0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9087863620dccd67 server_cookie=ab19fab0c0cd8537 in_seq=0 out_seq=0 2024-04-20T12:31:53.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.728+0000 7f0e4affd640 1 -- 172.21.15.135:0/811375644 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5572311b0a40 con 0x5572312c6b80 2024-04-20T12:31:53.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.728+0000 7f0e4affd640 10 client.18225 handle_command_reply: tid=0 2024-04-20T12:31:53.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e7446d740 1 client.18225 shutdown 2024-04-20T12:31:53.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e7446d740 1 -- 172.21.15.135:0/811375644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572312441c0 msgr2=0x557231255930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:53.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e7446d740 1 --2- 172.21.15.135:0/811375644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572312441c0 0x557231255930 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f0e60004f40 tx=0x7f0e60004f70 comp rx=0 tx=0).stop 2024-04-20T12:31:53.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e7446d740 1 -- 172.21.15.135:0/811375644 shutdown_connections 2024-04-20T12:31:53.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e7446d740 1 --2- 172.21.15.135:0/811375644 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5572312c6b80 0x5572312c8fa0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e7446d740 1 --2- 172.21.15.135:0/811375644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55723124f430 0x5572312c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e4affd640 0 client.18225 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:53.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e7446d740 1 --2- 172.21.15.135:0/811375644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572312441c0 0x557231255930 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e7446d740 1 --2- 172.21.15.135:0/811375644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557231243810 0x5572312553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e7446d740 1 -- 172.21.15.135:0/811375644 >> 172.21.15.135:0/811375644 conn(0x55723123e450 msgr2=0x55723123cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:53.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e7446d740 1 -- 172.21.15.135:0/811375644 shutdown_connections 2024-04-20T12:31:53.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e7446d740 1 -- 172.21.15.135:0/811375644 wait complete. 2024-04-20T12:31:53.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e7446d740 20 client.18225 trim_cache size 0 max 16384 2024-04-20T12:31:53.737 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:31:53.737 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:31:53.737 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:31:53.737 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:31:53.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e71874640 1 -- 172.21.15.135:0/2830358106 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0e540a3d20 msgr2=0x7f0e540a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:53.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e71874640 1 --2- 172.21.15.135:0/2830358106 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0e540a3d20 0x7f0e540a61e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x557231251df0 tx=0x7f0e64049000 comp rx=0 tx=0).stop 2024-04-20T12:31:53.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e71874640 1 -- 172.21.15.135:0/2830358106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e6c1011b0 msgr2=0x7f0e6c1976e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:53.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e71874640 1 --2- 172.21.15.135:0/2830358106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e6c1011b0 0x7f0e6c1976e0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c00ea80 tx=0x7f0e5c00ef40 comp rx=0 tx=0).stop 2024-04-20T12:31:53.738 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e71874640 1 -- 172.21.15.135:0/2830358106 shutdown_connections 2024-04-20T12:31:53.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e71874640 1 --2- 172.21.15.135:0/2830358106 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0e540a3d20 0x7f0e540a61e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e71874640 1 --2- 172.21.15.135:0/2830358106 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e6c107040 0x7f0e6c19bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e71874640 1 --2- 172.21.15.135:0/2830358106 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0e6c101b50 0x7f0e6c197c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e71874640 1 --2- 172.21.15.135:0/2830358106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0e6c1011b0 0x7f0e6c1976e0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.729+0000 7f0e71874640 1 -- 172.21.15.135:0/2830358106 >> 172.21.15.135:0/2830358106 conn(0x7f0e6c076c60 msgr2=0x7f0e6c0ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:53.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.730+0000 7f0e71874640 1 -- 172.21.15.135:0/2830358106 shutdown_connections 2024-04-20T12:31:53.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.730+0000 7f0e71874640 1 -- 172.21.15.135:0/2830358106 wait complete. 2024-04-20T12:31:53.740 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:31:53.740 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:31:53.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.839+0000 7f4dc3f52640 1 -- 172.21.15.135:0/244938097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dbc101a50 msgr2=0x7f4dbc105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:53.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.839+0000 7f4dc3f52640 1 --2- 172.21.15.135:0/244938097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dbc101a50 0x7f4dbc105a90 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f4dac009900 tx=0x7f4dac02bc30 comp rx=0 tx=0).stop 2024-04-20T12:31:53.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.839+0000 7f4dc3f52640 1 -- 172.21.15.135:0/244938097 shutdown_connections 2024-04-20T12:31:53.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.839+0000 7f4dc3f52640 1 --2- 172.21.15.135:0/244938097 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4dbc106170 0x7f4dbc10dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.839+0000 7f4dc3f52640 1 --2- 172.21.15.135:0/244938097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dbc101a50 0x7f4dbc105a90 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.839+0000 7f4dc3f52640 1 --2- 172.21.15.135:0/244938097 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dbc1010a0 0x7f4dbc101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.841 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.839+0000 7f4dc3f52640 1 -- 172.21.15.135:0/244938097 >> 172.21.15.135:0/244938097 conn(0x7f4dbc0771e0 msgr2=0x7f4dbc0775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:53.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.839+0000 7f4dc3f52640 1 -- 172.21.15.135:0/244938097 shutdown_connections 2024-04-20T12:31:53.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.839+0000 7f4dc3f52640 1 -- 172.21.15.135:0/244938097 wait complete. 2024-04-20T12:31:53.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.839+0000 7f4dc3f52640 1 Processor -- start 2024-04-20T12:31:53.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc3f52640 1 -- start start 2024-04-20T12:31:53.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc3f52640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dbc1010a0 0x7f4dbc1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc3f52640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dbc106170 0x7f4dbc199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc3f52640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4dbc19a1b0 0x7f4dbc1a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc3f52640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc111260 con 0x7f4dbc106170 2024-04-20T12:31:53.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc3f52640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc1110e0 con 0x7f4dbc19a1b0 2024-04-20T12:31:53.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc3f52640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc1113e0 con 0x7f4dbc1010a0 2024-04-20T12:31:53.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc14ed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dbc106170 0x7f4dbc199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc14ed640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dbc106170 0x7f4dbc199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59054/0 (socket says 172.21.15.135:59054) 2024-04-20T12:31:53.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc14ed640 1 -- 172.21.15.135:0/264245271 learned_addr learned my addr 172.21.15.135:0/264245271 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:53.842 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc24ef640 1 --2- 172.21.15.135:0/264245271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4dbc19a1b0 0x7f4dbc1a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc1cee640 1 --2- 172.21.15.135:0/264245271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dbc1010a0 0x7f4dbc1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc14ed640 1 -- 172.21.15.135:0/264245271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dbc1010a0 msgr2=0x7f4dbc1996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc14ed640 1 --2- 172.21.15.135:0/264245271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dbc1010a0 0x7f4dbc1996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc14ed640 1 -- 172.21.15.135:0/264245271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4dbc19a1b0 msgr2=0x7f4dbc1a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc14ed640 1 --2- 172.21.15.135:0/264245271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4dbc19a1b0 0x7f4dbc1a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc14ed640 1 -- 172.21.15.135:0/264245271 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dbc1a4f30 con 0x7f4dbc106170 2024-04-20T12:31:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc24ef640 1 --2- 172.21.15.135:0/264245271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4dbc19a1b0 0x7f4dbc1a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc14ed640 1 --2- 172.21.15.135:0/264245271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dbc106170 0x7f4dbc199c20 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f4dac036040 tx=0x7f4dac02cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4db2ffd640 1 -- 172.21.15.135:0/264245271 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac041070 con 0x7f4dbc106170 2024-04-20T12:31:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4db2ffd640 1 -- 172.21.15.135:0/264245271 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4dac0054e0 con 0x7f4dbc106170 2024-04-20T12:31:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.840+0000 7f4dc3f52640 1 -- 172.21.15.135:0/264245271 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dbc1a51c0 con 0x7f4dbc106170 2024-04-20T12:31:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.841+0000 7f4db2ffd640 1 -- 172.21.15.135:0/264245271 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac034440 con 0x7f4dbc106170 2024-04-20T12:31:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.841+0000 7f4dc3f52640 1 -- 172.21.15.135:0/264245271 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dbc1a56b0 con 0x7f4dbc106170 2024-04-20T12:31:53.843 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.842+0000 7f4dc3f52640 1 -- 172.21.15.135:0/264245271 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dbc102570 con 0x7f4dbc106170 2024-04-20T12:31:53.844 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.843+0000 7f4db2ffd640 1 -- 172.21.15.135:0/264245271 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f4dac044070 con 0x7f4dbc106170 2024-04-20T12:31:53.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.843+0000 7f4db2ffd640 1 --2- 172.21.15.135:0/264245271 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4da80a3d20 0x7f4da80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:53.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.843+0000 7f4dc1cee640 1 --2- 172.21.15.135:0/264245271 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4da80a3d20 0x7f4da80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:53.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.843+0000 7f4db2ffd640 1 -- 172.21.15.135:0/264245271 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f4dac0f2a40 con 0x7f4dbc106170 2024-04-20T12:31:53.845 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.844+0000 7f4dc1cee640 1 --2- 172.21.15.135:0/264245271 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4da80a3d20 0x7f4da80a61e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4db4007dc0 tx=0x7f4db40072f0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:53.847 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:53.847+0000 7f4db2ffd640 1 -- 172.21.15.135:0/264245271 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f4dac0f4e20 con 0x7f4dbc106170 2024-04-20T12:31:54.070 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.071+0000 7f4dc3f52640 1 -- 172.21.15.135:0/264245271 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4dbc1093a0 con 0x7f4dbc106170 2024-04-20T12:31:54.071 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.072+0000 7f4db2ffd640 1 -- 172.21.15.135:0/264245271 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7f4dac0bee20 con 0x7f4dbc106170 2024-04-20T12:31:54.071 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:31:54.071 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:31:54.072 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:31:54.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.074+0000 7f4dc3f52640 1 -- 172.21.15.135:0/264245271 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4da80a3d20 msgr2=0x7f4da80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.074+0000 7f4dc3f52640 1 --2- 172.21.15.135:0/264245271 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4da80a3d20 0x7f4da80a61e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4db4007dc0 tx=0x7f4db40072f0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.074+0000 7f4dc3f52640 1 -- 172.21.15.135:0/264245271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dbc106170 msgr2=0x7f4dbc199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.074+0000 7f4dc3f52640 1 --2- 172.21.15.135:0/264245271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dbc106170 0x7f4dbc199c20 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f4dac036040 tx=0x7f4dac02cbf0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.074+0000 7f4dc3f52640 1 -- 172.21.15.135:0/264245271 shutdown_connections 2024-04-20T12:31:54.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.074+0000 7f4dc3f52640 1 --2- 172.21.15.135:0/264245271 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4dbc19a1b0 0x7f4dbc1a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.074+0000 7f4dc3f52640 1 --2- 172.21.15.135:0/264245271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4dbc106170 0x7f4dbc199c20 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.074+0000 7f4dc3f52640 1 --2- 172.21.15.135:0/264245271 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f4da80a3d20 0x7f4da80a61e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.074+0000 7f4dc3f52640 1 --2- 172.21.15.135:0/264245271 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4dbc1010a0 0x7f4dbc1996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.074+0000 7f4dc3f52640 1 -- 172.21.15.135:0/264245271 >> 172.21.15.135:0/264245271 conn(0x7f4dbc0771e0 msgr2=0x7f4dbc0fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.074+0000 7f4dc3f52640 1 -- 172.21.15.135:0/264245271 shutdown_connections 2024-04-20T12:31:54.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.074+0000 7f4dc3f52640 1 -- 172.21.15.135:0/264245271 wait complete. 2024-04-20T12:31:54.084 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:31:54.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.185+0000 7f78bace0640 1 -- 172.21.15.135:0/4055932428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b41021b0 msgr2=0x7f78b4102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.185+0000 7f78bace0640 1 --2- 172.21.15.135:0/4055932428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b41021b0 0x7f78b4102590 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009900 tx=0x7f78a802bc30 comp rx=0 tx=0).stop 2024-04-20T12:31:54.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.185+0000 7f78bace0640 1 -- 172.21.15.135:0/4055932428 shutdown_connections 2024-04-20T12:31:54.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.185+0000 7f78bace0640 1 --2- 172.21.15.135:0/4055932428 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78b4107280 0x7f78b410ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.185+0000 7f78bace0640 1 --2- 172.21.15.135:0/4055932428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b4102b60 0x7f78b4106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.185+0000 7f78bace0640 1 --2- 172.21.15.135:0/4055932428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b41021b0 0x7f78b4102590 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.185+0000 7f78bace0640 1 -- 172.21.15.135:0/4055932428 >> 172.21.15.135:0/4055932428 conn(0x7f78b40793f0 msgr2=0x7f78b4079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.185+0000 7f78bace0640 1 -- 172.21.15.135:0/4055932428 shutdown_connections 2024-04-20T12:31:54.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.185+0000 7f78bace0640 1 -- 172.21.15.135:0/4055932428 wait complete. 2024-04-20T12:31:54.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78bace0640 1 Processor -- start 2024-04-20T12:31:54.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78bace0640 1 -- start start 2024-04-20T12:31:54.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78bace0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b41021b0 0x7f78b419e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78bace0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78b4107280 0x7f78b419eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78bace0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b41986b0 0x7f78b4198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78bace0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f78b4112330 con 0x7f78b41986b0 2024-04-20T12:31:54.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78bace0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f78b41121b0 con 0x7f78b4107280 2024-04-20T12:31:54.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78bace0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78b41124b0 con 0x7f78b41021b0 2024-04-20T12:31:54.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78b927d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b41986b0 0x7f78b4198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78b927d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b41986b0 0x7f78b4198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59072/0 (socket says 172.21.15.135:59072) 2024-04-20T12:31:54.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78b927d640 1 -- 172.21.15.135:0/1607530803 learned_addr learned my addr 172.21.15.135:0/1607530803 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78b3fff640 1 --2- 172.21.15.135:0/1607530803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78b4107280 0x7f78b419eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78b8a7c640 1 --2- 172.21.15.135:0/1607530803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b41021b0 0x7f78b419e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78b927d640 1 -- 172.21.15.135:0/1607530803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b41021b0 msgr2=0x7f78b419e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78b927d640 1 --2- 172.21.15.135:0/1607530803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b41021b0 0x7f78b419e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78b927d640 1 -- 172.21.15.135:0/1607530803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78b4107280 msgr2=0x7f78b419eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78b927d640 1 --2- 172.21.15.135:0/1607530803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78b4107280 0x7f78b419eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78b927d640 1 -- 172.21.15.135:0/1607530803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b41992b0 con 0x7f78b41986b0 2024-04-20T12:31:54.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78b927d640 1 --2- 172.21.15.135:0/1607530803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b41986b0 0x7f78b4198b30 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00eaa0 tx=0x7f78ac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78b1ffb640 1 -- 172.21.15.135:0/1607530803 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ac00cdb0 con 0x7f78b41986b0 2024-04-20T12:31:54.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.186+0000 7f78b1ffb640 1 -- 172.21.15.135:0/1607530803 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78ac005020 con 0x7f78b41986b0 2024-04-20T12:31:54.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.187+0000 7f78bace0640 1 -- 172.21.15.135:0/1607530803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b41a5340 con 0x7f78b41986b0 2024-04-20T12:31:54.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.187+0000 7f78b1ffb640 1 -- 172.21.15.135:0/1607530803 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0116b0 con 0x7f78b41986b0 2024-04-20T12:31:54.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.187+0000 7f78bace0640 1 -- 172.21.15.135:0/1607530803 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b41a56f0 con 0x7f78b41986b0 2024-04-20T12:31:54.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.189+0000 7f78b1ffb640 1 -- 172.21.15.135:0/1607530803 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f78ac005560 con 0x7f78b41986b0 2024-04-20T12:31:54.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.189+0000 7f78bd9ac740 1 Processor -- start 2024-04-20T12:31:54.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.189+0000 7f78bd9ac740 1 -- start start 2024-04-20T12:31:54.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.189+0000 7f78b1ffb640 1 --2- 172.21.15.135:0/1607530803 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78a40a3d20 0x7f78a40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.189+0000 7f78bd9ac740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666745ac0 0x556666745ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.189+0000 7f78bd9ac740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 0x5566667531e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.189+0000 7f78bd9ac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556666753720 0x556666755b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.189+0000 7f78bd9ac740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5566666ab110 con 0x556666745ac0 2024-04-20T12:31:54.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.189+0000 7f78bd9ac740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556666648550 con 0x5566667463e0 2024-04-20T12:31:54.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.189+0000 7f78bd9ac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5566666a70d0 con 0x556666753720 2024-04-20T12:31:54.193 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.189+0000 7f78b8a7c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666745ac0 0x556666745ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.189+0000 7f78b3fff640 1 --2- 172.21.15.135:0/1607530803 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78a40a3d20 0x7f78a40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.189+0000 7f78b8a7c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666745ac0 0x556666745ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59080/0 (socket says 172.21.15.135:59080) 2024-04-20T12:31:54.194 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.190+0000 7f78b8a7c640 1 -- 172.21.15.135:0/2677397657 learned_addr learned my addr 172.21.15.135:0/2677397657 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.190+0000 7f78b1ffb640 1 -- 172.21.15.135:0/1607530803 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f78ac0d0dd0 con 0x7f78b41986b0 2024-04-20T12:31:54.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.190+0000 7f78b3fff640 1 --2- 172.21.15.135:0/2677397657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 0x5566667531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.190+0000 7f78b927d640 1 --2- 172.21.15.135:0/2677397657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556666753720 0x556666755b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.190+0000 7f78b8a7c640 1 -- 172.21.15.135:0/2677397657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556666753720 msgr2=0x556666755b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.190+0000 7f78b8a7c640 1 --2- 172.21.15.135:0/2677397657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556666753720 0x556666755b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.200 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.190+0000 7f78b8a7c640 1 -- 172.21.15.135:0/2677397657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 msgr2=0x5566667531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.190+0000 7f78b8a7c640 1 --2- 172.21.15.135:0/2677397657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 0x5566667531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.190+0000 7f78b8a7c640 1 -- 172.21.15.135:0/2677397657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556666670900 con 0x556666745ac0 2024-04-20T12:31:54.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.190+0000 7f78b3fff640 1 --2- 172.21.15.135:0/2677397657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 0x5566667531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:54.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.190+0000 7f78b8a7c640 1 --2- 172.21.15.135:0/2677397657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666745ac0 0x556666745ea0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009900 tx=0x7f78a802c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1e8b67562ba98f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.190+0000 7f78b3fff640 1 --2- 172.21.15.135:0/1607530803 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78a40a3d20 0x7f78a40a61e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f78b4199eb0 tx=0x7f78a000a6f0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.190+0000 7f789effd640 1 -- 172.21.15.135:0/2677397657 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a802cb00 con 0x556666745ac0 2024-04-20T12:31:54.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.190+0000 7f789effd640 1 -- 172.21.15.135:0/2677397657 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78a802cca0 con 0x556666745ac0 2024-04-20T12:31:54.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.190+0000 7f789effd640 1 -- 172.21.15.135:0/2677397657 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a80048c0 con 0x556666745ac0 2024-04-20T12:31:54.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.191+0000 7f78bd9ac740 1 -- 172.21.15.135:0/2677397657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666745ac0 msgr2=0x556666745ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.191+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/2677397657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666745ac0 0x556666745ea0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009900 tx=0x7f78a802c650 comp rx=0 tx=0).stop 2024-04-20T12:31:54.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.191+0000 7f78bd9ac740 1 -- 172.21.15.135:0/2677397657 shutdown_connections 2024-04-20T12:31:54.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.191+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/2677397657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556666753720 0x556666755b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.191+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/2677397657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 0x5566667531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.191+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/2677397657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666745ac0 0x556666745ea0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.191+0000 7f78bd9ac740 1 -- 172.21.15.135:0/2677397657 >> 172.21.15.135:0/2677397657 conn(0x556666740540 msgr2=0x556666740920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.191+0000 7f78bd9ac740 1 -- 172.21.15.135:0/2677397657 shutdown_connections 2024-04-20T12:31:54.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.191+0000 7f78bd9ac740 1 -- 172.21.15.135:0/2677397657 wait complete. 2024-04-20T12:31:54.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.191+0000 7f78bd9ac740 1 -- start start 2024-04-20T12:31:54.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.191+0000 7f78bd9ac740 1 Processor -- start 2024-04-20T12:31:54.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78bd9ac740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556666745ac0 0x556666750660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78bd9ac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566667463e0 0x556666750ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78bd9ac740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666753720 0x5566667510e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78bd9ac740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556666756500 con 0x556666753720 2024-04-20T12:31:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78bd9ac740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556666664500 con 0x556666745ac0 2024-04-20T12:31:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78bd9ac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556666756680 con 0x5566667463e0 2024-04-20T12:31:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78bd9ac740 10 client.0 _ll_register_callbacks cb 0x5566666492f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78b927d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666753720 0x5566667510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78b927d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666753720 0x5566667510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59088/0 (socket says 172.21.15.135:59088) 2024-04-20T12:31:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78b927d640 1 -- 172.21.15.135:0/1467241477 learned_addr learned my addr 172.21.15.135:0/1467241477 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78b8a7c640 1 --2- 172.21.15.135:0/1467241477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556666745ac0 0x556666750660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78b3fff640 1 --2- 172.21.15.135:0/1467241477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566667463e0 0x556666750ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78b927d640 1 -- 172.21.15.135:0/1467241477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566667463e0 msgr2=0x556666750ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78b927d640 1 --2- 172.21.15.135:0/1467241477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566667463e0 0x556666750ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78b927d640 1 -- 172.21.15.135:0/1467241477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556666745ac0 msgr2=0x556666750660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78b927d640 1 --2- 172.21.15.135:0/1467241477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556666745ac0 0x556666750660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78b927d640 1 -- 172.21.15.135:0/1467241477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566663bd3f0 con 0x556666753720 2024-04-20T12:31:54.203 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78b8a7c640 1 --2- 172.21.15.135:0/1467241477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556666745ac0 0x556666750660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78b927d640 1 --2- 172.21.15.135:0/1467241477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666753720 0x5566667510e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0092f0 tx=0x7f78ac09ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade75f7d2ac150b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f7893fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f7893fff640 1 -- 172.21.15.135:0/1467241477 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ac01f040 con 0x556666753720 2024-04-20T12:31:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f7893fff640 1 -- 172.21.15.135:0/1467241477 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f78ac0be350 con 0x556666753720 2024-04-20T12:31:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78bd9ac740 1 -- 172.21.15.135:0/1467241477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78a802cca0 con 0x556666753720 2024-04-20T12:31:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f7893fff640 1 -- 172.21.15.135:0/1467241477 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f78ac099010 con 0x556666753720 2024-04-20T12:31:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78bd9ac740 10 client.18243 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.192+0000 7f78bd9ac740 1 -- 172.21.15.135:0/1467241477 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5566664877d0 con 0x556666753720 2024-04-20T12:31:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.193+0000 7f7893fff640 1 -- 172.21.15.135:0/1467241477 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78a802cca0 con 0x556666753720 2024-04-20T12:31:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.193+0000 7f7893fff640 1 -- 172.21.15.135:0/1467241477 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f78ac00f040 con 0x556666753720 2024-04-20T12:31:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.193+0000 7f78bd9ac740 10 client.18243 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.193+0000 7f78bd9ac740 10 client.18243 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:31:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.193+0000 7f78bd9ac740 20 client.18243 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.193+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/1467241477 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x556666763960 0x556666765db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.204 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.193+0000 7f78bd9ac740 4 client.18243 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:54.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.193+0000 7f78bd9ac740 1 -- 172.21.15.135:0/1467241477 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566666b8b30 con 0x556666763960 2024-04-20T12:31:54.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.193+0000 7f78b8a7c640 1 --2- 172.21.15.135:0/1467241477 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x556666763960 0x556666765db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.193+0000 7f78b8a7c640 1 --2- 172.21.15.135:0/1467241477 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x556666763960 0x556666765db0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8817ec3b94cf963 server_cookie=af24e3ea814e672 in_seq=0 out_seq=0 2024-04-20T12:31:54.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.193+0000 7f7893fff640 10 client.18243 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:31:54.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.194+0000 7f7893fff640 1 -- 172.21.15.135:0/1467241477 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5566666b8b30 con 0x556666763960 2024-04-20T12:31:54.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.194+0000 7f7893fff640 10 client.18243 handle_command_reply: tid=0 2024-04-20T12:31:54.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.194+0000 7f78bd9ac740 1 client.18243 shutdown 2024-04-20T12:31:54.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.194+0000 7f78bd9ac740 1 -- 172.21.15.135:0/1467241477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666753720 msgr2=0x5566667510e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.194+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/1467241477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666753720 0x5566667510e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0092f0 tx=0x7f78ac09ca60 comp rx=0 tx=0).stop 2024-04-20T12:31:54.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.194+0000 7f78bd9ac740 1 -- 172.21.15.135:0/1467241477 shutdown_connections 2024-04-20T12:31:54.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.194+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/1467241477 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x556666763960 0x556666765db0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.194+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/1467241477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666753720 0x5566667510e0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.194+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/1467241477 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5566667463e0 0x556666750ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.205 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.194+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/1467241477 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556666745ac0 0x556666750660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.194+0000 7f7893fff640 0 client.18243 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:31:54.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.194+0000 7f78bd9ac740 1 -- 172.21.15.135:0/1467241477 >> 172.21.15.135:0/1467241477 conn(0x556666740540 msgr2=0x556666742290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.194+0000 7f78bd9ac740 1 -- 172.21.15.135:0/1467241477 shutdown_connections 2024-04-20T12:31:54.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.194+0000 7f78bd9ac740 1 -- 172.21.15.135:0/1467241477 wait complete. 2024-04-20T12:31:54.206 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.194+0000 7f78bd9ac740 20 client.18243 trim_cache size 0 max 16384 2024-04-20T12:31:54.213 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.207+0000 7f78bd9ac740 1 Processor -- start 2024-04-20T12:31:54.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.207+0000 7f78bd9ac740 1 -- start start 2024-04-20T12:31:54.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78bd9ac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556666745ac0 0x556666752d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78bd9ac740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 0x55666675f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78bd9ac740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666753720 0x55666673f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78bd9ac740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f78b41ad2c0 con 0x556666753720 2024-04-20T12:31:54.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78bd9ac740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f78b41aee00 con 0x5566667463e0 2024-04-20T12:31:54.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78bd9ac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78b41ad990 con 0x556666745ac0 2024-04-20T12:31:54.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78b927d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666753720 0x55666673f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78b927d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666753720 0x55666673f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59092/0 (socket says 172.21.15.135:59092) 2024-04-20T12:31:54.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78b927d640 1 -- 172.21.15.135:0/833281486 learned_addr learned my addr 172.21.15.135:0/833281486 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78b3fff640 1 --2- 172.21.15.135:0/833281486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 0x55666675f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.214 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78b927d640 1 -- 172.21.15.135:0/833281486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556666745ac0 msgr2=0x556666752d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78b927d640 1 --2- 172.21.15.135:0/833281486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556666745ac0 0x556666752d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78b927d640 1 -- 172.21.15.135:0/833281486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 msgr2=0x55666675f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78b927d640 1 --2- 172.21.15.135:0/833281486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 0x55666675f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78b927d640 1 -- 172.21.15.135:0/833281486 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556666740370 con 0x556666753720 2024-04-20T12:31:54.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f78b927d640 1 --2- 172.21.15.135:0/833281486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666753720 0x55666673f560 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f78ac098e00 tx=0x7f78ac0a5790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33063bdef0981db server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f789e7fc640 1 -- 172.21.15.135:0/833281486 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ac01f070 con 0x556666753720 2024-04-20T12:31:54.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f789e7fc640 1 -- 172.21.15.135:0/833281486 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78ac0b8070 con 0x556666753720 2024-04-20T12:31:54.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.208+0000 7f789e7fc640 1 -- 172.21.15.135:0/833281486 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ac0ce3d0 con 0x556666753720 2024-04-20T12:31:54.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.209+0000 7f78bd9ac740 1 -- 172.21.15.135:0/833281486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666753720 msgr2=0x55666673f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.209+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/833281486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666753720 0x55666673f560 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f78ac098e00 tx=0x7f78ac0a5790 comp rx=0 tx=0).stop 2024-04-20T12:31:54.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.209+0000 7f78bd9ac740 1 -- 172.21.15.135:0/833281486 shutdown_connections 2024-04-20T12:31:54.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.209+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/833281486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666753720 0x55666673f560 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.209+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/833281486 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 0x55666675f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.215 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.209+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/833281486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556666745ac0 0x556666752d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.209+0000 7f78bd9ac740 1 -- 172.21.15.135:0/833281486 >> 172.21.15.135:0/833281486 conn(0x556666740540 msgr2=0x55666673ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.209+0000 7f78bd9ac740 1 -- 172.21.15.135:0/833281486 shutdown_connections 2024-04-20T12:31:54.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.209+0000 7f78bd9ac740 1 -- 172.21.15.135:0/833281486 wait complete. 2024-04-20T12:31:54.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.209+0000 7f78bd9ac740 1 -- start start 2024-04-20T12:31:54.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.209+0000 7f78bd9ac740 1 Processor -- start 2024-04-20T12:31:54.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78bd9ac740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666745ac0 0x55666674d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78bd9ac740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 0x55666674d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78bd9ac740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556666753720 0x55666674de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78bd9ac740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f78b41ae730 con 0x556666745ac0 2024-04-20T12:31:54.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78bd9ac740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f78b41ae060 con 0x5566667463e0 2024-04-20T12:31:54.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78bd9ac740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f78b41ab290 con 0x556666753720 2024-04-20T12:31:54.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78bd9ac740 10 client.0 _ll_register_callbacks cb 0x7f78ac09c540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:54.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78b8a7c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666745ac0 0x55666674d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.216 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78b8a7c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666745ac0 0x55666674d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59102/0 (socket says 172.21.15.135:59102) 2024-04-20T12:31:54.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78b8a7c640 1 -- 172.21.15.135:0/4048687178 learned_addr learned my addr 172.21.15.135:0/4048687178 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78b927d640 1 --2- 172.21.15.135:0/4048687178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556666753720 0x55666674de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78b3fff640 1 --2- 172.21.15.135:0/4048687178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 0x55666674d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78b8a7c640 1 -- 172.21.15.135:0/4048687178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556666753720 msgr2=0x55666674de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78b8a7c640 1 --2- 172.21.15.135:0/4048687178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556666753720 0x55666674de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78b8a7c640 1 -- 172.21.15.135:0/4048687178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 msgr2=0x55666674d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78b8a7c640 1 --2- 172.21.15.135:0/4048687178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 0x55666674d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78b8a7c640 1 -- 172.21.15.135:0/4048687178 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566667c8fa0 con 0x556666745ac0 2024-04-20T12:31:54.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78b927d640 1 --2- 172.21.15.135:0/4048687178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556666753720 0x55666674de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:54.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78b3fff640 1 --2- 172.21.15.135:0/4048687178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 0x55666674d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:54.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78b8a7c640 1 --2- 172.21.15.135:0/4048687178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666745ac0 0x55666674d410 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f78a80056c0 tx=0x7f78a802bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410ae3f85fcf1700 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f7893fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:54.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f7893fff640 1 -- 172.21.15.135:0/4048687178 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a80035f0 con 0x556666745ac0 2024-04-20T12:31:54.217 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f7893fff640 1 -- 172.21.15.135:0/4048687178 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f78a8003790 con 0x556666745ac0 2024-04-20T12:31:54.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78bd9ac740 1 -- 172.21.15.135:0/4048687178 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78ac0b8070 con 0x556666745ac0 2024-04-20T12:31:54.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f7893fff640 1 -- 172.21.15.135:0/4048687178 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f78a8057050 con 0x556666745ac0 2024-04-20T12:31:54.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78bd9ac740 10 client.18249 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:54.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.210+0000 7f78bd9ac740 1 -- 172.21.15.135:0/4048687178 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5566667ca280 con 0x556666745ac0 2024-04-20T12:31:54.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f7893fff640 1 -- 172.21.15.135:0/4048687178 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78ac0b8070 con 0x556666745ac0 2024-04-20T12:31:54.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f7893fff640 1 -- 172.21.15.135:0/4048687178 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f78a80347e0 con 0x556666745ac0 2024-04-20T12:31:54.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f78bd9ac740 10 client.18249 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:54.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f78bd9ac740 10 client.18249 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:31:54.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f78bd9ac740 20 client.18249 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:54.218 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/4048687178 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5566667ca5c0 0x5566667cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f78bd9ac740 4 client.18249 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:31:54.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f78bd9ac740 1 -- 172.21.15.135:0/4048687178 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5566666b29a0 con 0x5566667ca5c0 2024-04-20T12:31:54.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f78b3fff640 1 --2- 172.21.15.135:0/4048687178 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5566667ca5c0 0x5566667cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f7893fff640 10 client.18249 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:31:54.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f78b3fff640 1 --2- 172.21.15.135:0/4048687178 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5566667ca5c0 0x5566667cc9b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=140ad3d6d588975c server_cookie=6b451746dce3c5cd in_seq=0 out_seq=0 2024-04-20T12:31:54.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f7893fff640 1 -- 172.21.15.135:0/4048687178 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5566666b29a0 con 0x5566667ca5c0 2024-04-20T12:31:54.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f7893fff640 10 client.18249 handle_command_reply: tid=0 2024-04-20T12:31:54.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f78bd9ac740 1 client.18249 shutdown 2024-04-20T12:31:54.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f78bd9ac740 1 -- 172.21.15.135:0/4048687178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666745ac0 msgr2=0x55666674d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.219 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.211+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/4048687178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666745ac0 0x55666674d410 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f78a80056c0 tx=0x7f78a802bc30 comp rx=0 tx=0).stop 2024-04-20T12:31:54.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bd9ac740 1 -- 172.21.15.135:0/4048687178 shutdown_connections 2024-04-20T12:31:54.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/4048687178 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5566667ca5c0 0x5566667cc9b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/4048687178 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556666753720 0x55666674de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f7893fff640 0 client.18249 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:31:54.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/4048687178 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5566667463e0 0x55666674d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bd9ac740 1 --2- 172.21.15.135:0/4048687178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556666745ac0 0x55666674d410 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bd9ac740 1 -- 172.21.15.135:0/4048687178 >> 172.21.15.135:0/4048687178 conn(0x556666740540 msgr2=0x55666673f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bd9ac740 1 -- 172.21.15.135:0/4048687178 shutdown_connections 2024-04-20T12:31:54.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bd9ac740 1 -- 172.21.15.135:0/4048687178 wait complete. 2024-04-20T12:31:54.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bd9ac740 20 client.18249 trim_cache size 0 max 16384 2024-04-20T12:31:54.221 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:31:54.221 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bace0640 1 -- 172.21.15.135:0/1607530803 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78a40a3d20 msgr2=0x7f78a40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bace0640 1 --2- 172.21.15.135:0/1607530803 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78a40a3d20 0x7f78a40a61e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f78b4199eb0 tx=0x7f78a000a6f0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bace0640 1 -- 172.21.15.135:0/1607530803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b41986b0 msgr2=0x7f78b4198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bace0640 1 --2- 172.21.15.135:0/1607530803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b41986b0 0x7f78b4198b30 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00eaa0 tx=0x7f78ac00ef60 comp rx=0 tx=0).stop 2024-04-20T12:31:54.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bace0640 1 -- 172.21.15.135:0/1607530803 shutdown_connections 2024-04-20T12:31:54.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bace0640 1 --2- 172.21.15.135:0/1607530803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78b41986b0 0x7f78b4198b30 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bace0640 1 --2- 172.21.15.135:0/1607530803 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f78b4107280 0x7f78b419eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bace0640 1 --2- 172.21.15.135:0/1607530803 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f78a40a3d20 0x7f78a40a61e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bace0640 1 --2- 172.21.15.135:0/1607530803 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78b41021b0 0x7f78b419e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bace0640 1 -- 172.21.15.135:0/1607530803 >> 172.21.15.135:0/1607530803 conn(0x7f78b40793f0 msgr2=0x7f78b40ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bace0640 1 -- 172.21.15.135:0/1607530803 shutdown_connections 2024-04-20T12:31:54.222 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.212+0000 7f78bace0640 1 -- 172.21.15.135:0/1607530803 wait complete. 2024-04-20T12:31:54.223 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:31:54.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.325+0000 7f60bdd98640 1 -- 172.21.15.135:0/3474852292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60b806acf0 msgr2=0x7f60b810edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.325+0000 7f60bdd98640 1 --2- 172.21.15.135:0/3474852292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60b806acf0 0x7f60b810edf0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f60b0009ca0 tx=0x7f60b002c180 comp rx=0 tx=0).stop 2024-04-20T12:31:54.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.325+0000 7f60bdd98640 1 -- 172.21.15.135:0/3474852292 shutdown_connections 2024-04-20T12:31:54.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.325+0000 7f60bdd98640 1 --2- 172.21.15.135:0/3474852292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60b806acf0 0x7f60b810edf0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.325+0000 7f60bdd98640 1 --2- 172.21.15.135:0/3474852292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b8108930 0x7f60b806a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.325+0000 7f60bdd98640 1 --2- 172.21.15.135:0/3474852292 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60b8108010 0x7f60b81083f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.325+0000 7f60bdd98640 1 -- 172.21.15.135:0/3474852292 >> 172.21.15.135:0/3474852292 conn(0x7f60b8076c60 msgr2=0x7f60b8077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.325+0000 7f60bdd98640 1 -- 172.21.15.135:0/3474852292 shutdown_connections 2024-04-20T12:31:54.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.325+0000 7f60bdd98640 1 -- 172.21.15.135:0/3474852292 wait complete. 2024-04-20T12:31:54.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.326+0000 7f60bdd98640 1 Processor -- start 2024-04-20T12:31:54.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.326+0000 7f60bdd98640 1 -- start start 2024-04-20T12:31:54.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.326+0000 7f60bdd98640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b806acf0 0x7f60b819e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.326+0000 7f60bdd98640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60b8108010 0x7f60b819e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.326+0000 7f60bdd98640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60b8108930 0x7f60b81985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.326+0000 7f60bdd98640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f60b81122f0 con 0x7f60b8108010 2024-04-20T12:31:54.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.326+0000 7f60bdd98640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f60b8112170 con 0x7f60b8108930 2024-04-20T12:31:54.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.326+0000 7f60bdd98640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60b8112470 con 0x7f60b806acf0 2024-04-20T12:31:54.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.326+0000 7f60b6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60b8108010 0x7f60b819e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.326+0000 7f60b6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60b8108010 0x7f60b819e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59118/0 (socket says 172.21.15.135:59118) 2024-04-20T12:31:54.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.326+0000 7f60b6ffd640 1 -- 172.21.15.135:0/3062059693 learned_addr learned my addr 172.21.15.135:0/3062059693 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.326+0000 7f60b7fff640 1 --2- 172.21.15.135:0/3062059693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60b8108930 0x7f60b81985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.326+0000 7f60b77fe640 1 --2- 172.21.15.135:0/3062059693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b806acf0 0x7f60b819e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.326+0000 7f60b6ffd640 1 -- 172.21.15.135:0/3062059693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b806acf0 msgr2=0x7f60b819e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.326+0000 7f60b6ffd640 1 --2- 172.21.15.135:0/3062059693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b806acf0 0x7f60b819e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.327+0000 7f60b6ffd640 1 -- 172.21.15.135:0/3062059693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60b8108930 msgr2=0x7f60b81985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.327+0000 7f60b6ffd640 1 --2- 172.21.15.135:0/3062059693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60b8108930 0x7f60b81985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.327+0000 7f60b6ffd640 1 -- 172.21.15.135:0/3062059693 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b8198d70 con 0x7f60b8108010 2024-04-20T12:31:54.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.327+0000 7f60b6ffd640 1 --2- 172.21.15.135:0/3062059693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60b8108010 0x7f60b819e980 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f60a800d770 tx=0x7f60a800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.327+0000 7f60b4ff9640 1 -- 172.21.15.135:0/3062059693 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8017070 con 0x7f60b8108010 2024-04-20T12:31:54.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.327+0000 7f60b4ff9640 1 -- 172.21.15.135:0/3062059693 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60a8005500 con 0x7f60b8108010 2024-04-20T12:31:54.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.327+0000 7f60bdd98640 1 -- 172.21.15.135:0/3062059693 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b8199060 con 0x7f60b8108010 2024-04-20T12:31:54.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.327+0000 7f60b4ff9640 1 -- 172.21.15.135:0/3062059693 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8004e00 con 0x7f60b8108010 2024-04-20T12:31:54.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.327+0000 7f60bdd98640 1 -- 172.21.15.135:0/3062059693 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b81a5300 con 0x7f60b8108010 2024-04-20T12:31:54.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.329+0000 7f60b4ff9640 1 -- 172.21.15.135:0/3062059693 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f60a8004fa0 con 0x7f60b8108010 2024-04-20T12:31:54.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.329+0000 7f60c0982740 1 Processor -- start 2024-04-20T12:31:54.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.329+0000 7f60c0982740 1 -- start start 2024-04-20T12:31:54.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60c0982740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab077f0 0x55ebeab07bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60c0982740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab081a0 0x55ebeab151e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60c0982740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab15720 0x55ebeab17b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60c0982740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ebeaa6d110 con 0x55ebeab077f0 2024-04-20T12:31:54.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60c0982740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ebeaa0a550 con 0x55ebeab081a0 2024-04-20T12:31:54.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60c0982740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ebeaa690d0 con 0x55ebeab15720 2024-04-20T12:31:54.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab077f0 0x55ebeab07bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab077f0 0x55ebeab07bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59130/0 (socket says 172.21.15.135:59130) 2024-04-20T12:31:54.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b7fff640 1 -- 172.21.15.135:0/2412640392 learned_addr learned my addr 172.21.15.135:0/2412640392 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b4ff9640 1 --2- 172.21.15.135:0/3062059693 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f60a00a3d20 0x7f60a00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b77fe640 1 --2- 172.21.15.135:0/2412640392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab081a0 0x55ebeab151e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b6ffd640 1 --2- 172.21.15.135:0/2412640392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab15720 0x55ebeab17b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b7fff640 1 --2- 172.21.15.135:0/3062059693 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f60a00a3d20 0x7f60a00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b7fff640 1 -- 172.21.15.135:0/2412640392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab15720 msgr2=0x55ebeab17b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b4ff9640 1 -- 172.21.15.135:0/3062059693 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f60a80d04e0 con 0x7f60b8108010 2024-04-20T12:31:54.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b7fff640 1 --2- 172.21.15.135:0/2412640392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab15720 0x55ebeab17b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b7fff640 1 -- 172.21.15.135:0/2412640392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab081a0 msgr2=0x55ebeab151e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b7fff640 1 --2- 172.21.15.135:0/2412640392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab081a0 0x55ebeab151e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b7fff640 1 -- 172.21.15.135:0/2412640392 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebeaa32900 con 0x55ebeab077f0 2024-04-20T12:31:54.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b6ffd640 1 --2- 172.21.15.135:0/2412640392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab15720 0x55ebeab17b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:54.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b7fff640 1 --2- 172.21.15.135:0/2412640392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab077f0 0x55ebeab07bd0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f60b0037040 tx=0x7f60b0003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd66a28d8511ee4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f609dffb640 1 -- 172.21.15.135:0/2412640392 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b0050070 con 0x55ebeab077f0 2024-04-20T12:31:54.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f609dffb640 1 -- 172.21.15.135:0/2412640392 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60b0004610 con 0x55ebeab077f0 2024-04-20T12:31:54.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f609dffb640 1 -- 172.21.15.135:0/2412640392 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b0039040 con 0x55ebeab077f0 2024-04-20T12:31:54.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.330+0000 7f60b7fff640 1 --2- 172.21.15.135:0/3062059693 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f60a00a3d20 0x7f60a00a61e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f60b004d000 tx=0x7f60b0048000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.331+0000 7f60c0982740 1 -- 172.21.15.135:0/2412640392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab077f0 msgr2=0x55ebeab07bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.331+0000 7f60c0982740 1 --2- 172.21.15.135:0/2412640392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab077f0 0x55ebeab07bd0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f60b0037040 tx=0x7f60b0003b00 comp rx=0 tx=0).stop 2024-04-20T12:31:54.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.331+0000 7f60c0982740 1 -- 172.21.15.135:0/2412640392 shutdown_connections 2024-04-20T12:31:54.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.331+0000 7f60c0982740 1 --2- 172.21.15.135:0/2412640392 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab15720 0x55ebeab17b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.331+0000 7f60c0982740 1 --2- 172.21.15.135:0/2412640392 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab081a0 0x55ebeab151e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.331+0000 7f60c0982740 1 --2- 172.21.15.135:0/2412640392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab077f0 0x55ebeab07bd0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.331+0000 7f60c0982740 1 -- 172.21.15.135:0/2412640392 >> 172.21.15.135:0/2412640392 conn(0x55ebeab02540 msgr2=0x55ebeab02920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.331+0000 7f60c0982740 1 -- 172.21.15.135:0/2412640392 shutdown_connections 2024-04-20T12:31:54.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.331+0000 7f60c0982740 1 -- 172.21.15.135:0/2412640392 wait complete. 2024-04-20T12:31:54.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.331+0000 7f60c0982740 1 -- start start 2024-04-20T12:31:54.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60c0982740 1 Processor -- start 2024-04-20T12:31:54.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60c0982740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab077f0 0x55ebeab126e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60c0982740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab081a0 0x55ebeab12c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60c0982740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab15720 0x55ebeab13160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60c0982740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ebeab184e0 con 0x55ebeab15720 2024-04-20T12:31:54.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60c0982740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ebeaa26500 con 0x55ebeab077f0 2024-04-20T12:31:54.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60c0982740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ebeab18660 con 0x55ebeab081a0 2024-04-20T12:31:54.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60c0982740 10 client.0 _ll_register_callbacks cb 0x55ebeaa0b2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:54.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab15720 0x55ebeab13160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab15720 0x55ebeab13160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59134/0 (socket says 172.21.15.135:59134) 2024-04-20T12:31:54.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60b7fff640 1 -- 172.21.15.135:0/2295383055 learned_addr learned my addr 172.21.15.135:0/2295383055 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60b77fe640 1 --2- 172.21.15.135:0/2295383055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab077f0 0x55ebeab126e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60b6ffd640 1 --2- 172.21.15.135:0/2295383055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab081a0 0x55ebeab12c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60b7fff640 1 -- 172.21.15.135:0/2295383055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab081a0 msgr2=0x55ebeab12c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60b7fff640 1 --2- 172.21.15.135:0/2295383055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab081a0 0x55ebeab12c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60b7fff640 1 -- 172.21.15.135:0/2295383055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab077f0 msgr2=0x55ebeab126e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60b7fff640 1 --2- 172.21.15.135:0/2295383055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab077f0 0x55ebeab126e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60b7fff640 1 -- 172.21.15.135:0/2295383055 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebea77f3f0 con 0x55ebeab15720 2024-04-20T12:31:54.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.332+0000 7f60b77fe640 1 --2- 172.21.15.135:0/2295383055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab077f0 0x55ebeab126e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:54.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f60b7fff640 1 --2- 172.21.15.135:0/2295383055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab15720 0x55ebeab13160 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f60b002c790 tx=0x7f60b00095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db94e85c2bf5f1f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f6096ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:54.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f6096ffd640 1 -- 172.21.15.135:0/2295383055 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b0058020 con 0x55ebeab15720 2024-04-20T12:31:54.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f6096ffd640 1 -- 172.21.15.135:0/2295383055 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f60b0034850 con 0x55ebeab15720 2024-04-20T12:31:54.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f60c0982740 1 -- 172.21.15.135:0/2295383055 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60b0004610 con 0x55ebeab15720 2024-04-20T12:31:54.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f6096ffd640 1 -- 172.21.15.135:0/2295383055 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f60b0063050 con 0x55ebeab15720 2024-04-20T12:31:54.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f60c0982740 10 client.18261 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:54.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f60c0982740 1 -- 172.21.15.135:0/2295383055 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ebea8497d0 con 0x55ebeab15720 2024-04-20T12:31:54.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f6096ffd640 1 -- 172.21.15.135:0/2295383055 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60b0004610 con 0x55ebeab15720 2024-04-20T12:31:54.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f6096ffd640 1 -- 172.21.15.135:0/2295383055 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f60b003f070 con 0x55ebeab15720 2024-04-20T12:31:54.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f60c0982740 10 client.18261 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:54.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f60c0982740 10 client.18261 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:31:54.341 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f60c0982740 20 client.18261 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:54.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f60c0982740 1 --2- 172.21.15.135:0/2295383055 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55ebeab25910 0x55ebeab27d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f60c0982740 4 client.18261 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:54.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.333+0000 7f60c0982740 1 -- 172.21.15.135:0/2295383055 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ebeaa7ab30 con 0x55ebeab25910 2024-04-20T12:31:54.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.334+0000 7f60b77fe640 1 --2- 172.21.15.135:0/2295383055 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55ebeab25910 0x55ebeab27d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.334+0000 7f6096ffd640 10 client.18261 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:31:54.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.334+0000 7f60b77fe640 1 --2- 172.21.15.135:0/2295383055 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55ebeab25910 0x55ebeab27d00 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=23f00c4e39b0a41 server_cookie=1940719ac6c3835c in_seq=0 out_seq=0 2024-04-20T12:31:54.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.335+0000 7f6096ffd640 1 -- 172.21.15.135:0/2295383055 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ebeaa7ab30 con 0x55ebeab25910 2024-04-20T12:31:54.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.335+0000 7f6096ffd640 10 client.18261 handle_command_reply: tid=0 2024-04-20T12:31:54.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.335+0000 7f60c0982740 1 client.18261 shutdown 2024-04-20T12:31:54.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.335+0000 7f60c0982740 1 -- 172.21.15.135:0/2295383055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab15720 msgr2=0x55ebeab13160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.335+0000 7f60c0982740 1 --2- 172.21.15.135:0/2295383055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab15720 0x55ebeab13160 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f60b002c790 tx=0x7f60b00095e0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.335+0000 7f60c0982740 1 -- 172.21.15.135:0/2295383055 shutdown_connections 2024-04-20T12:31:54.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.335+0000 7f60c0982740 1 --2- 172.21.15.135:0/2295383055 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55ebeab25910 0x55ebeab27d00 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.342 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.335+0000 7f60c0982740 1 --2- 172.21.15.135:0/2295383055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab15720 0x55ebeab13160 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.335+0000 7f60c0982740 1 --2- 172.21.15.135:0/2295383055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab081a0 0x55ebeab12c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.335+0000 7f60c0982740 1 --2- 172.21.15.135:0/2295383055 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab077f0 0x55ebeab126e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.335+0000 7f6096ffd640 0 client.18261 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:31:54.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.335+0000 7f60c0982740 1 -- 172.21.15.135:0/2295383055 >> 172.21.15.135:0/2295383055 conn(0x55ebeab02540 msgr2=0x55ebeab04290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.335+0000 7f60c0982740 1 -- 172.21.15.135:0/2295383055 shutdown_connections 2024-04-20T12:31:54.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.335+0000 7f60c0982740 1 -- 172.21.15.135:0/2295383055 wait complete. 2024-04-20T12:31:54.343 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.335+0000 7f60c0982740 20 client.18261 trim_cache size 0 max 16384 2024-04-20T12:31:54.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60c0982740 1 Processor -- start 2024-04-20T12:31:54.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60c0982740 1 -- start start 2024-04-20T12:31:54.353 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60c0982740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab077f0 0x55ebeab21410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60c0982740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab081a0 0x55ebeaafd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60c0982740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab15720 0x55ebeab2d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60c0982740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f60b81ad1d0 con 0x55ebeab081a0 2024-04-20T12:31:54.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60c0982740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f60b81aed10 con 0x55ebeab15720 2024-04-20T12:31:54.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60c0982740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60b81ad8a0 con 0x55ebeab077f0 2024-04-20T12:31:54.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60b6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab081a0 0x55ebeaafd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60b6ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab081a0 0x55ebeaafd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59142/0 (socket says 172.21.15.135:59142) 2024-04-20T12:31:54.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60b6ffd640 1 -- 172.21.15.135:0/2841301330 learned_addr learned my addr 172.21.15.135:0/2841301330 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60b77fe640 1 --2- 172.21.15.135:0/2841301330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab077f0 0x55ebeab21410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60b6ffd640 1 -- 172.21.15.135:0/2841301330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab077f0 msgr2=0x55ebeab21410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60b6ffd640 1 --2- 172.21.15.135:0/2841301330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab077f0 0x55ebeab21410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60b7fff640 1 --2- 172.21.15.135:0/2841301330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab15720 0x55ebeab2d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.354 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60b6ffd640 1 -- 172.21.15.135:0/2841301330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab15720 msgr2=0x55ebeab2d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.348+0000 7f60b6ffd640 1 --2- 172.21.15.135:0/2841301330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab15720 0x55ebeab2d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.349+0000 7f60b6ffd640 1 -- 172.21.15.135:0/2841301330 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebeab183c0 con 0x55ebeab081a0 2024-04-20T12:31:54.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.349+0000 7f60b7fff640 1 --2- 172.21.15.135:0/2841301330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab15720 0x55ebeab2d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:54.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.349+0000 7f60b6ffd640 1 --2- 172.21.15.135:0/2841301330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab081a0 0x55ebeaafd570 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f60a809c0e0 tx=0x7f60a806ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99bc2a85ba549c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.349+0000 7f609d7fa640 1 -- 172.21.15.135:0/2841301330 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8020040 con 0x55ebeab081a0 2024-04-20T12:31:54.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.349+0000 7f609d7fa640 1 -- 172.21.15.135:0/2841301330 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60a809c150 con 0x55ebeab081a0 2024-04-20T12:31:54.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.349+0000 7f609d7fa640 1 -- 172.21.15.135:0/2841301330 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a80987c0 con 0x55ebeab081a0 2024-04-20T12:31:54.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.349+0000 7f60c0982740 1 -- 172.21.15.135:0/2841301330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab081a0 msgr2=0x55ebeaafd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.349+0000 7f60c0982740 1 --2- 172.21.15.135:0/2841301330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab081a0 0x55ebeaafd570 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f60a809c0e0 tx=0x7f60a806ec40 comp rx=0 tx=0).stop 2024-04-20T12:31:54.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.349+0000 7f60c0982740 1 -- 172.21.15.135:0/2841301330 shutdown_connections 2024-04-20T12:31:54.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.349+0000 7f60c0982740 1 --2- 172.21.15.135:0/2841301330 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab15720 0x55ebeab2d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.349+0000 7f60c0982740 1 --2- 172.21.15.135:0/2841301330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab081a0 0x55ebeaafd570 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.349+0000 7f60c0982740 1 --2- 172.21.15.135:0/2841301330 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab077f0 0x55ebeab21410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.355 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.349+0000 7f60c0982740 1 -- 172.21.15.135:0/2841301330 >> 172.21.15.135:0/2841301330 conn(0x55ebeab02540 msgr2=0x55ebeab11730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.349+0000 7f60c0982740 1 -- 172.21.15.135:0/2841301330 shutdown_connections 2024-04-20T12:31:54.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.349+0000 7f60c0982740 1 -- 172.21.15.135:0/2841301330 wait complete. 2024-04-20T12:31:54.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.350+0000 7f60c0982740 1 -- start start 2024-04-20T12:31:54.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.350+0000 7f60c0982740 1 Processor -- start 2024-04-20T12:31:54.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.350+0000 7f60c0982740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab077f0 0x55ebeab1d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.350+0000 7f60c0982740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab081a0 0x55ebeab1de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.350+0000 7f60c0982740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab15720 0x55ebeab0ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.350+0000 7f60c0982740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f60b81ae640 con 0x55ebeab15720 2024-04-20T12:31:54.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.350+0000 7f60c0982740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f60b81adf70 con 0x55ebeab077f0 2024-04-20T12:31:54.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.350+0000 7f60c0982740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f60b81ab1a0 con 0x55ebeab081a0 2024-04-20T12:31:54.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.350+0000 7f60c0982740 10 client.0 _ll_register_callbacks cb 0x7f60b004e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:54.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.350+0000 7f60b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab15720 0x55ebeab0ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.350+0000 7f60b7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab15720 0x55ebeab0ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59156/0 (socket says 172.21.15.135:59156) 2024-04-20T12:31:54.356 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.350+0000 7f60b7fff640 1 -- 172.21.15.135:0/3427744443 learned_addr learned my addr 172.21.15.135:0/3427744443 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.350+0000 7f60b77fe640 1 --2- 172.21.15.135:0/3427744443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab077f0 0x55ebeab1d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.350+0000 7f60b6ffd640 1 --2- 172.21.15.135:0/3427744443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab081a0 0x55ebeab1de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f60b7fff640 1 -- 172.21.15.135:0/3427744443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab081a0 msgr2=0x55ebeab1de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f60b7fff640 1 --2- 172.21.15.135:0/3427744443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab081a0 0x55ebeab1de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f60b7fff640 1 -- 172.21.15.135:0/3427744443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab077f0 msgr2=0x55ebeab1d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f60b7fff640 1 --2- 172.21.15.135:0/3427744443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab077f0 0x55ebeab1d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f60b7fff640 1 -- 172.21.15.135:0/3427744443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebeab0f0b0 con 0x55ebeab15720 2024-04-20T12:31:54.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f60b7fff640 1 --2- 172.21.15.135:0/3427744443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab15720 0x55ebeab0ea10 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f60b0004af0 tx=0x7f60b0032d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2695e84c5d34b4d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f6096ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:54.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f6096ffd640 1 -- 172.21.15.135:0/3427744443 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b0058070 con 0x55ebeab15720 2024-04-20T12:31:54.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f6096ffd640 1 -- 172.21.15.135:0/3427744443 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f60b0004410 con 0x55ebeab15720 2024-04-20T12:31:54.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f60c0982740 1 -- 172.21.15.135:0/3427744443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60a809c150 con 0x55ebeab15720 2024-04-20T12:31:54.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f6096ffd640 1 -- 172.21.15.135:0/3427744443 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f60b0039070 con 0x55ebeab15720 2024-04-20T12:31:54.357 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f60c0982740 10 client.18267 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:54.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f60c0982740 1 -- 172.21.15.135:0/3427744443 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ebeab8b5a0 con 0x55ebeab15720 2024-04-20T12:31:54.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f6096ffd640 1 -- 172.21.15.135:0/3427744443 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60a809c150 con 0x55ebeab15720 2024-04-20T12:31:54.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f6096ffd640 1 -- 172.21.15.135:0/3427744443 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f60b003f070 con 0x55ebeab15720 2024-04-20T12:31:54.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f60c0982740 10 client.18267 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:54.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f60c0982740 10 client.18267 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:31:54.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f60c0982740 20 client.18267 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:54.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f60c0982740 1 --2- 172.21.15.135:0/3427744443 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55ebeab8bc80 0x55ebeab8e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f60c0982740 4 client.18267 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:31:54.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.351+0000 7f60c0982740 1 -- 172.21.15.135:0/3427744443 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ebeaa749a0 con 0x55ebeab8bc80 2024-04-20T12:31:54.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f60b77fe640 1 --2- 172.21.15.135:0/3427744443 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55ebeab8bc80 0x55ebeab8e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f60b77fe640 1 --2- 172.21.15.135:0/3427744443 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55ebeab8bc80 0x55ebeab8e070 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f8fc42d68f22e709 server_cookie=4d31d83d5211500f in_seq=0 out_seq=0 2024-04-20T12:31:54.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f6096ffd640 10 client.18267 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:31:54.358 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f6096ffd640 1 -- 172.21.15.135:0/3427744443 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ebeaa749a0 con 0x55ebeab8bc80 2024-04-20T12:31:54.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f6096ffd640 10 client.18267 handle_command_reply: tid=0 2024-04-20T12:31:54.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f60c0982740 1 client.18267 shutdown 2024-04-20T12:31:54.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f60c0982740 1 -- 172.21.15.135:0/3427744443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab15720 msgr2=0x55ebeab0ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f60c0982740 1 --2- 172.21.15.135:0/3427744443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab15720 0x55ebeab0ea10 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f60b0004af0 tx=0x7f60b0032d70 comp rx=0 tx=0).stop 2024-04-20T12:31:54.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f60c0982740 1 -- 172.21.15.135:0/3427744443 shutdown_connections 2024-04-20T12:31:54.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f60c0982740 1 --2- 172.21.15.135:0/3427744443 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55ebeab8bc80 0x55ebeab8e070 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f60c0982740 1 --2- 172.21.15.135:0/3427744443 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ebeab15720 0x55ebeab0ea10 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f60c0982740 1 --2- 172.21.15.135:0/3427744443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ebeab081a0 0x55ebeab1de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f6096ffd640 0 client.18267 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:31:54.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f60c0982740 1 --2- 172.21.15.135:0/3427744443 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ebeab077f0 0x55ebeab1d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f60c0982740 1 -- 172.21.15.135:0/3427744443 >> 172.21.15.135:0/3427744443 conn(0x55ebeab02540 msgr2=0x55ebeab12f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f60c0982740 1 -- 172.21.15.135:0/3427744443 shutdown_connections 2024-04-20T12:31:54.359 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.352+0000 7f60c0982740 1 -- 172.21.15.135:0/3427744443 wait complete. 2024-04-20T12:31:54.360 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.353+0000 7f60c0982740 20 client.18267 trim_cache size 0 max 16384 2024-04-20T12:31:54.360 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:31:54.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.353+0000 7f60bdd98640 1 -- 172.21.15.135:0/3062059693 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f60a00a3d20 msgr2=0x7f60a00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.353+0000 7f60bdd98640 1 --2- 172.21.15.135:0/3062059693 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f60a00a3d20 0x7f60a00a61e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f60b004d000 tx=0x7f60b0048000 comp rx=0 tx=0).stop 2024-04-20T12:31:54.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.353+0000 7f60bdd98640 1 -- 172.21.15.135:0/3062059693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60b8108010 msgr2=0x7f60b819e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.353+0000 7f60bdd98640 1 --2- 172.21.15.135:0/3062059693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60b8108010 0x7f60b819e980 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f60a800d770 tx=0x7f60a800dc30 comp rx=0 tx=0).stop 2024-04-20T12:31:54.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.353+0000 7f60bdd98640 1 -- 172.21.15.135:0/3062059693 shutdown_connections 2024-04-20T12:31:54.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.353+0000 7f60bdd98640 1 --2- 172.21.15.135:0/3062059693 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f60b8108930 0x7f60b81985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.353+0000 7f60bdd98640 1 --2- 172.21.15.135:0/3062059693 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f60b8108010 0x7f60b819e980 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.353+0000 7f60bdd98640 1 --2- 172.21.15.135:0/3062059693 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f60a00a3d20 0x7f60a00a61e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.353+0000 7f60bdd98640 1 --2- 172.21.15.135:0/3062059693 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f60b806acf0 0x7f60b819e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.361 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.353+0000 7f60bdd98640 1 -- 172.21.15.135:0/3062059693 >> 172.21.15.135:0/3062059693 conn(0x7f60b8076c60 msgr2=0x7f60b80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.353+0000 7f60bdd98640 1 -- 172.21.15.135:0/3062059693 shutdown_connections 2024-04-20T12:31:54.362 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.353+0000 7f60bdd98640 1 -- 172.21.15.135:0/3062059693 wait complete. 2024-04-20T12:31:54.364 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:31:54.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 -- 172.21.15.135:0/1289830327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa950106160 msgr2=0x7fa95010dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 --2- 172.21.15.135:0/1289830327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa950106160 0x7fa95010dd30 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fa948009ca0 tx=0x7fa94802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 -- 172.21.15.135:0/1289830327 shutdown_connections 2024-04-20T12:31:54.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 --2- 172.21.15.135:0/1289830327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa950106160 0x7fa95010dd30 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 --2- 172.21.15.135:0/1289830327 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa950101a40 0x7fa950105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 --2- 172.21.15.135:0/1289830327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950101090 0x7fa950101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 -- 172.21.15.135:0/1289830327 >> 172.21.15.135:0/1289830327 conn(0x7fa950078010 msgr2=0x7fa950078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 -- 172.21.15.135:0/1289830327 shutdown_connections 2024-04-20T12:31:54.467 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 -- 172.21.15.135:0/1289830327 wait complete. 2024-04-20T12:31:54.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 Processor -- start 2024-04-20T12:31:54.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 -- start start 2024-04-20T12:31:54.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950101090 0x7fa950198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa950106160 0x7fa950198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95019cfd0 0x7fa95019d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa950111200 con 0x7fa95019cfd0 2024-04-20T12:31:54.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa950111080 con 0x7fa950106160 2024-04-20T12:31:54.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa956a69640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa950111380 con 0x7fa950101090 2024-04-20T12:31:54.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa955006640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95019cfd0 0x7fa95019d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.465+0000 7fa955006640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95019cfd0 0x7fa95019d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59172/0 (socket says 172.21.15.135:59172) 2024-04-20T12:31:54.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.466+0000 7fa955006640 1 -- 172.21.15.135:0/2740464306 learned_addr learned my addr 172.21.15.135:0/2740464306 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.466+0000 7fa94ffff640 1 --2- 172.21.15.135:0/2740464306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa950106160 0x7fa950198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.466+0000 7fa954805640 1 --2- 172.21.15.135:0/2740464306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950101090 0x7fa950198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.466+0000 7fa955006640 1 -- 172.21.15.135:0/2740464306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950101090 msgr2=0x7fa950198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.468 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.466+0000 7fa955006640 1 --2- 172.21.15.135:0/2740464306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950101090 0x7fa950198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.466+0000 7fa955006640 1 -- 172.21.15.135:0/2740464306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa950106160 msgr2=0x7fa950198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.466+0000 7fa955006640 1 --2- 172.21.15.135:0/2740464306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa950106160 0x7fa950198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.466+0000 7fa955006640 1 -- 172.21.15.135:0/2740464306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95019dac0 con 0x7fa95019cfd0 2024-04-20T12:31:54.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.466+0000 7fa954805640 1 --2- 172.21.15.135:0/2740464306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950101090 0x7fa950198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:54.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.466+0000 7fa955006640 1 --2- 172.21.15.135:0/2740464306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95019cfd0 0x7fa95019d480 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fa94802c700 tx=0x7fa948032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.466+0000 7fa94dffb640 1 -- 172.21.15.135:0/2740464306 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa948041020 con 0x7fa95019cfd0 2024-04-20T12:31:54.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.466+0000 7fa94dffb640 1 -- 172.21.15.135:0/2740464306 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa948034cd0 con 0x7fa95019cfd0 2024-04-20T12:31:54.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.466+0000 7fa956a69640 1 -- 172.21.15.135:0/2740464306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa95019dd50 con 0x7fa95019cfd0 2024-04-20T12:31:54.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.466+0000 7fa94dffb640 1 -- 172.21.15.135:0/2740464306 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa948039040 con 0x7fa95019cfd0 2024-04-20T12:31:54.469 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.466+0000 7fa956a69640 1 -- 172.21.15.135:0/2740464306 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9501a5510 con 0x7fa95019cfd0 2024-04-20T12:31:54.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.468+0000 7fa94dffb640 1 -- 172.21.15.135:0/2740464306 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fa948044020 con 0x7fa95019cfd0 2024-04-20T12:31:54.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa959657740 1 Processor -- start 2024-04-20T12:31:54.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa959657740 1 -- start start 2024-04-20T12:31:54.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa959657740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 0x55ae3646a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa959657740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae3646ab40 0x55ae364731e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa959657740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae36473720 0x55ae36475b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa959657740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ae363cb110 con 0x55ae36473720 2024-04-20T12:31:54.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa959657740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ae36368550 con 0x55ae3646ab40 2024-04-20T12:31:54.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa959657740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ae363c70d0 con 0x55ae3646a220 2024-04-20T12:31:54.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa94dffb640 1 --2- 172.21.15.135:0/2740464306 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa9400a3d20 0x7fa9400a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa94ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae36473720 0x55ae36475b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa94ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae36473720 0x55ae36475b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59176/0 (socket says 172.21.15.135:59176) 2024-04-20T12:31:54.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa94ffff640 1 -- 172.21.15.135:0/4087798429 learned_addr learned my addr 172.21.15.135:0/4087798429 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa954805640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae3646ab40 0x55ae364731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa955006640 1 --2- 172.21.15.135:0/2740464306 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa9400a3d20 0x7fa9400a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa94ffff640 1 --2- 172.21.15.135:0/4087798429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 0x55ae3646a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa94dffb640 1 -- 172.21.15.135:0/2740464306 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7fa9480f29a0 con 0x7fa95019cfd0 2024-04-20T12:31:54.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa94ffff640 1 -- 172.21.15.135:0/4087798429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 msgr2=0x55ae3646a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa94ffff640 1 --2- 172.21.15.135:0/4087798429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 0x55ae3646a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa94ffff640 1 -- 172.21.15.135:0/4087798429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae3646ab40 msgr2=0x55ae364731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa94ffff640 1 --2- 172.21.15.135:0/4087798429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae3646ab40 0x55ae364731e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa94ffff640 1 -- 172.21.15.135:0/4087798429 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae36390900 con 0x55ae36473720 2024-04-20T12:31:54.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa954805640 1 --2- 172.21.15.135:0/4087798429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae3646ab40 0x55ae364731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:31:54.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.469+0000 7fa94ffff640 1 --2- 172.21.15.135:0/4087798429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae36473720 0x55ae36475b10 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009f60 tx=0x7fa93c009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6545912c5f672ad7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.470+0000 7fa955006640 1 --2- 172.21.15.135:0/2740464306 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa9400a3d20 0x7fa9400a61e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa9480be340 tx=0x7fa94808cff0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.470+0000 7fa93affd640 1 -- 172.21.15.135:0/4087798429 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c004050 con 0x55ae36473720 2024-04-20T12:31:54.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.470+0000 7fa93affd640 1 -- 172.21.15.135:0/4087798429 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa93c005500 con 0x55ae36473720 2024-04-20T12:31:54.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.470+0000 7fa93affd640 1 -- 172.21.15.135:0/4087798429 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c004d80 con 0x55ae36473720 2024-04-20T12:31:54.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.470+0000 7fa959657740 1 -- 172.21.15.135:0/4087798429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae36473720 msgr2=0x55ae36475b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.470+0000 7fa959657740 1 --2- 172.21.15.135:0/4087798429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae36473720 0x55ae36475b10 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009f60 tx=0x7fa93c009960 comp rx=0 tx=0).stop 2024-04-20T12:31:54.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.470+0000 7fa959657740 1 -- 172.21.15.135:0/4087798429 shutdown_connections 2024-04-20T12:31:54.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.470+0000 7fa959657740 1 --2- 172.21.15.135:0/4087798429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae36473720 0x55ae36475b10 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.470+0000 7fa959657740 1 --2- 172.21.15.135:0/4087798429 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae3646ab40 0x55ae364731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.470+0000 7fa959657740 1 --2- 172.21.15.135:0/4087798429 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 0x55ae3646a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.470+0000 7fa959657740 1 -- 172.21.15.135:0/4087798429 >> 172.21.15.135:0/4087798429 conn(0x55ae36464950 msgr2=0x55ae36464d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.470+0000 7fa959657740 1 -- 172.21.15.135:0/4087798429 shutdown_connections 2024-04-20T12:31:54.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.470+0000 7fa959657740 1 -- 172.21.15.135:0/4087798429 wait complete. 2024-04-20T12:31:54.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa959657740 1 -- start start 2024-04-20T12:31:54.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa959657740 1 Processor -- start 2024-04-20T12:31:54.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa959657740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 0x55ae364707c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa959657740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae3646ab40 0x55ae36470d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa959657740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae36473720 0x55ae36471240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa959657740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ae36476510 con 0x55ae3646ab40 2024-04-20T12:31:54.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa959657740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ae36384500 con 0x55ae36473720 2024-04-20T12:31:54.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa959657740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ae36476690 con 0x55ae3646a220 2024-04-20T12:31:54.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa959657740 10 client.0 _ll_register_callbacks cb 0x55ae363692f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:54.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa954805640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae3646ab40 0x55ae36470d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa954805640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae3646ab40 0x55ae36470d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59190/0 (socket says 172.21.15.135:59190) 2024-04-20T12:31:54.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa954805640 1 -- 172.21.15.135:0/3259522952 learned_addr learned my addr 172.21.15.135:0/3259522952 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa94ffff640 1 --2- 172.21.15.135:0/3259522952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 0x55ae364707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa954805640 1 -- 172.21.15.135:0/3259522952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 msgr2=0x55ae364707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa954805640 1 --2- 172.21.15.135:0/3259522952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 0x55ae364707c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.471+0000 7fa954805640 1 -- 172.21.15.135:0/3259522952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae36473720 msgr2=0x55ae36471240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa954805640 1 --2- 172.21.15.135:0/3259522952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae36473720 0x55ae36471240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa954805640 1 -- 172.21.15.135:0/3259522952 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae360dd3f0 con 0x55ae3646ab40 2024-04-20T12:31:54.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa954805640 1 --2- 172.21.15.135:0/3259522952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae3646ab40 0x55ae36470d00 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fa944010a50 tx=0x7fa944010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e8c533c6346046 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa92ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:54.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa92ffff640 1 -- 172.21.15.135:0/3259522952 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94401d060 con 0x55ae3646ab40 2024-04-20T12:31:54.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa92ffff640 1 -- 172.21.15.135:0/3259522952 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7fa94400ebe0 con 0x55ae3646ab40 2024-04-20T12:31:54.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa959657740 1 -- 172.21.15.135:0/3259522952 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa93c005500 con 0x55ae3646ab40 2024-04-20T12:31:54.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa92ffff640 1 -- 172.21.15.135:0/3259522952 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa944024050 con 0x55ae3646ab40 2024-04-20T12:31:54.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa959657740 10 client.18279 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:54.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa959657740 1 -- 172.21.15.135:0/3259522952 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ae361a77d0 con 0x55ae3646ab40 2024-04-20T12:31:54.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa92ffff640 1 -- 172.21.15.135:0/3259522952 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa93c005500 con 0x55ae3646ab40 2024-04-20T12:31:54.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa92ffff640 1 -- 172.21.15.135:0/3259522952 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fa9440173b0 con 0x55ae3646ab40 2024-04-20T12:31:54.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa959657740 10 client.18279 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:54.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa959657740 10 client.18279 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:31:54.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa959657740 20 client.18279 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:54.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa959657740 1 --2- 172.21.15.135:0/3259522952 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ae36483c30 0x55ae36486050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa959657740 4 client.18279 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:54.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.472+0000 7fa959657740 1 -- 172.21.15.135:0/3259522952 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae363d8b30 con 0x55ae36483c30 2024-04-20T12:31:54.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.473+0000 7fa94ffff640 1 --2- 172.21.15.135:0/3259522952 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ae36483c30 0x55ae36486050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.473+0000 7fa92ffff640 10 client.18279 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:31:54.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.473+0000 7fa94ffff640 1 --2- 172.21.15.135:0/3259522952 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ae36483c30 0x55ae36486050 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2f3ea970b8d23fc7 server_cookie=a12e5865cea4305c in_seq=0 out_seq=0 2024-04-20T12:31:54.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.474+0000 7fa92ffff640 1 -- 172.21.15.135:0/3259522952 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ae363d8b30 con 0x55ae36483c30 2024-04-20T12:31:54.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.474+0000 7fa92ffff640 10 client.18279 handle_command_reply: tid=0 2024-04-20T12:31:54.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.474+0000 7fa959657740 1 client.18279 shutdown 2024-04-20T12:31:54.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.474+0000 7fa959657740 1 -- 172.21.15.135:0/3259522952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae3646ab40 msgr2=0x55ae36470d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.474+0000 7fa959657740 1 --2- 172.21.15.135:0/3259522952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae3646ab40 0x55ae36470d00 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fa944010a50 tx=0x7fa944010f10 comp rx=0 tx=0).stop 2024-04-20T12:31:54.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.474+0000 7fa959657740 1 -- 172.21.15.135:0/3259522952 shutdown_connections 2024-04-20T12:31:54.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.474+0000 7fa959657740 1 --2- 172.21.15.135:0/3259522952 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae36473720 0x55ae36471240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.474+0000 7fa959657740 1 --2- 172.21.15.135:0/3259522952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae3646ab40 0x55ae36470d00 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.474+0000 7fa959657740 1 --2- 172.21.15.135:0/3259522952 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ae36483c30 0x55ae36486050 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.474+0000 7fa959657740 1 --2- 172.21.15.135:0/3259522952 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 0x55ae364707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.474+0000 7fa92ffff640 0 client.18279 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:31:54.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.474+0000 7fa959657740 1 -- 172.21.15.135:0/3259522952 >> 172.21.15.135:0/3259522952 conn(0x55ae36464950 msgr2=0x55ae36465e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.474+0000 7fa959657740 1 -- 172.21.15.135:0/3259522952 shutdown_connections 2024-04-20T12:31:54.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.474+0000 7fa959657740 1 -- 172.21.15.135:0/3259522952 wait complete. 2024-04-20T12:31:54.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.474+0000 7fa959657740 20 client.18279 trim_cache size 0 max 16384 2024-04-20T12:31:54.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa959657740 1 Processor -- start 2024-04-20T12:31:54.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa959657740 1 -- start start 2024-04-20T12:31:54.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa959657740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 0x55ae364725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa959657740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae3646ab40 0x55ae3648b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa959657740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae36473720 0x55ae3648be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.492 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa959657740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa9501ad190 con 0x55ae36473720 2024-04-20T12:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa959657740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa9501aecd0 con 0x55ae3646ab40 2024-04-20T12:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa959657740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa9501ad860 con 0x55ae3646a220 2024-04-20T12:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa94ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae36473720 0x55ae3648be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa94ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae36473720 0x55ae3648be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59194/0 (socket says 172.21.15.135:59194) 2024-04-20T12:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa94ffff640 1 -- 172.21.15.135:0/2321966390 learned_addr learned my addr 172.21.15.135:0/2321966390 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa94ffff640 1 -- 172.21.15.135:0/2321966390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 msgr2=0x55ae364725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa94ffff640 1 --2- 172.21.15.135:0/2321966390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 0x55ae364725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa94ffff640 1 -- 172.21.15.135:0/2321966390 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae3646ab40 msgr2=0x55ae3648b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa954805640 1 --2- 172.21.15.135:0/2321966390 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae3646ab40 0x55ae3648b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa94ffff640 1 --2- 172.21.15.135:0/2321966390 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae3646ab40 0x55ae3648b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa94ffff640 1 -- 172.21.15.135:0/2321966390 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae36482780 con 0x55ae36473720 2024-04-20T12:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.487+0000 7fa954805640 1 --2- 172.21.15.135:0/2321966390 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae3646ab40 0x55ae3648b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:54.493 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.488+0000 7fa94ffff640 1 --2- 172.21.15.135:0/2321966390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae36473720 0x55ae3648be40 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009f60 tx=0x7fa93c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bb3fbdcdc017ec server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.488+0000 7fa93a7fc640 1 -- 172.21.15.135:0/2321966390 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c030070 con 0x55ae36473720 2024-04-20T12:31:54.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.488+0000 7fa93a7fc640 1 -- 172.21.15.135:0/2321966390 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa93c01e5f0 con 0x55ae36473720 2024-04-20T12:31:54.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.488+0000 7fa93a7fc640 1 -- 172.21.15.135:0/2321966390 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa93c00f600 con 0x55ae36473720 2024-04-20T12:31:54.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.488+0000 7fa959657740 1 -- 172.21.15.135:0/2321966390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae36473720 msgr2=0x55ae3648be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.488+0000 7fa959657740 1 --2- 172.21.15.135:0/2321966390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae36473720 0x55ae3648be40 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009f60 tx=0x7fa93c009f90 comp rx=0 tx=0).stop 2024-04-20T12:31:54.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.488+0000 7fa959657740 1 -- 172.21.15.135:0/2321966390 shutdown_connections 2024-04-20T12:31:54.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.488+0000 7fa959657740 1 --2- 172.21.15.135:0/2321966390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae36473720 0x55ae3648be40 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.488+0000 7fa959657740 1 --2- 172.21.15.135:0/2321966390 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae3646ab40 0x55ae3648b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.488+0000 7fa959657740 1 --2- 172.21.15.135:0/2321966390 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 0x55ae364725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.488+0000 7fa959657740 1 -- 172.21.15.135:0/2321966390 >> 172.21.15.135:0/2321966390 conn(0x55ae36464950 msgr2=0x55ae36471ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.488+0000 7fa959657740 1 -- 172.21.15.135:0/2321966390 shutdown_connections 2024-04-20T12:31:54.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.488+0000 7fa959657740 1 -- 172.21.15.135:0/2321966390 wait complete. 2024-04-20T12:31:54.494 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa959657740 1 -- start start 2024-04-20T12:31:54.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa959657740 1 Processor -- start 2024-04-20T12:31:54.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa959657740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 0x55ae3647bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa959657740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae3646ab40 0x55ae36479160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa959657740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae36473720 0x55ae36479770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa959657740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa9501ae600 con 0x55ae3646ab40 2024-04-20T12:31:54.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa959657740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa9501adf30 con 0x55ae36473720 2024-04-20T12:31:54.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa959657740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa9501ab160 con 0x55ae3646a220 2024-04-20T12:31:54.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa959657740 10 client.0 _ll_register_callbacks cb 0x7fa94400b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:54.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa954805640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae3646ab40 0x55ae36479160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa954805640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae3646ab40 0x55ae36479160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59208/0 (socket says 172.21.15.135:59208) 2024-04-20T12:31:54.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa954805640 1 -- 172.21.15.135:0/3716816454 learned_addr learned my addr 172.21.15.135:0/3716816454 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa94ffff640 1 --2- 172.21.15.135:0/3716816454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 0x55ae3647bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa94ffff640 1 --2- 172.21.15.135:0/3716816454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae36473720 0x55ae36479770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.495 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa954805640 1 -- 172.21.15.135:0/3716816454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 msgr2=0x55ae3647bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa954805640 1 --2- 172.21.15.135:0/3716816454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 0x55ae3647bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa954805640 1 -- 172.21.15.135:0/3716816454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae36473720 msgr2=0x55ae36479770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa954805640 1 --2- 172.21.15.135:0/3716816454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae36473720 0x55ae36479770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa954805640 1 -- 172.21.15.135:0/3716816454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae36479f70 con 0x55ae3646ab40 2024-04-20T12:31:54.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa94ffff640 1 --2- 172.21.15.135:0/3716816454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae36473720 0x55ae36479770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:54.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa954805640 1 --2- 172.21.15.135:0/3716816454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae3646ab40 0x55ae36479160 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fa944000c00 tx=0x7fa94400e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1552d2948bb333f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.489+0000 7fa92ffff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:54.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.490+0000 7fa92ffff640 1 -- 172.21.15.135:0/3716816454 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa944017bf0 con 0x55ae3646ab40 2024-04-20T12:31:54.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.490+0000 7fa92ffff640 1 -- 172.21.15.135:0/3716816454 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7fa94400ebe0 con 0x55ae3646ab40 2024-04-20T12:31:54.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.490+0000 7fa959657740 1 -- 172.21.15.135:0/3716816454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa93c01e5f0 con 0x55ae3646ab40 2024-04-20T12:31:54.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.490+0000 7fa92ffff640 1 -- 172.21.15.135:0/3716816454 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa94401d030 con 0x55ae3646ab40 2024-04-20T12:31:54.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.490+0000 7fa959657740 10 client.18285 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:54.496 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.490+0000 7fa959657740 1 -- 172.21.15.135:0/3716816454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ae364ea220 con 0x55ae3646ab40 2024-04-20T12:31:54.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.490+0000 7fa92ffff640 1 -- 172.21.15.135:0/3716816454 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa93c01e5f0 con 0x55ae3646ab40 2024-04-20T12:31:54.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.490+0000 7fa92ffff640 1 -- 172.21.15.135:0/3716816454 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fa944004660 con 0x55ae3646ab40 2024-04-20T12:31:54.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.490+0000 7fa959657740 10 client.18285 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:54.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.490+0000 7fa959657740 10 client.18285 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:31:54.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.490+0000 7fa959657740 20 client.18285 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:54.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.490+0000 7fa959657740 1 --2- 172.21.15.135:0/3716816454 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ae364ea9d0 0x55ae364ecdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.490+0000 7fa959657740 4 client.18285 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:31:54.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.490+0000 7fa959657740 1 -- 172.21.15.135:0/3716816454 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ae363d29a0 con 0x55ae364ea9d0 2024-04-20T12:31:54.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.490+0000 7fa94ffff640 1 --2- 172.21.15.135:0/3716816454 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ae364ea9d0 0x55ae364ecdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa94ffff640 1 --2- 172.21.15.135:0/3716816454 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ae364ea9d0 0x55ae364ecdc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dd2f53522754c0b8 server_cookie=40e45fa51ef65ddb in_seq=0 out_seq=0 2024-04-20T12:31:54.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa92ffff640 10 client.18285 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:31:54.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa92ffff640 1 -- 172.21.15.135:0/3716816454 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ae363d29a0 con 0x55ae364ea9d0 2024-04-20T12:31:54.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa92ffff640 10 client.18285 handle_command_reply: tid=0 2024-04-20T12:31:54.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa959657740 1 client.18285 shutdown 2024-04-20T12:31:54.497 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa959657740 1 -- 172.21.15.135:0/3716816454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae3646ab40 msgr2=0x55ae36479160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa959657740 1 --2- 172.21.15.135:0/3716816454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae3646ab40 0x55ae36479160 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fa944000c00 tx=0x7fa94400e7f0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa959657740 1 -- 172.21.15.135:0/3716816454 shutdown_connections 2024-04-20T12:31:54.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa959657740 1 --2- 172.21.15.135:0/3716816454 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae36473720 0x55ae36479770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa959657740 1 --2- 172.21.15.135:0/3716816454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae3646ab40 0x55ae36479160 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa959657740 1 --2- 172.21.15.135:0/3716816454 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ae364ea9d0 0x55ae364ecdc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa959657740 1 --2- 172.21.15.135:0/3716816454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae3646a220 0x55ae3647bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa92ffff640 0 client.18285 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:31:54.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa959657740 1 -- 172.21.15.135:0/3716816454 >> 172.21.15.135:0/3716816454 conn(0x55ae36464950 msgr2=0x55ae36472700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa959657740 1 -- 172.21.15.135:0/3716816454 shutdown_connections 2024-04-20T12:31:54.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa959657740 1 -- 172.21.15.135:0/3716816454 wait complete. 2024-04-20T12:31:54.498 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.491+0000 7fa959657740 20 client.18285 trim_cache size 0 max 16384 2024-04-20T12:31:54.499 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:31:54.499 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.492+0000 7fa956a69640 1 -- 172.21.15.135:0/2740464306 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa9400a3d20 msgr2=0x7fa9400a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.492+0000 7fa956a69640 1 --2- 172.21.15.135:0/2740464306 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa9400a3d20 0x7fa9400a61e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa9480be340 tx=0x7fa94808cff0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.492+0000 7fa956a69640 1 -- 172.21.15.135:0/2740464306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95019cfd0 msgr2=0x7fa95019d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.492+0000 7fa956a69640 1 --2- 172.21.15.135:0/2740464306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95019cfd0 0x7fa95019d480 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fa94802c700 tx=0x7fa948032f20 comp rx=0 tx=0).stop 2024-04-20T12:31:54.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.492+0000 7fa956a69640 1 -- 172.21.15.135:0/2740464306 shutdown_connections 2024-04-20T12:31:54.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.492+0000 7fa956a69640 1 --2- 172.21.15.135:0/2740464306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa95019cfd0 0x7fa95019d480 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.492+0000 7fa956a69640 1 --2- 172.21.15.135:0/2740464306 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa950106160 0x7fa950198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.492+0000 7fa956a69640 1 --2- 172.21.15.135:0/2740464306 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa9400a3d20 0x7fa9400a61e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.492+0000 7fa956a69640 1 --2- 172.21.15.135:0/2740464306 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa950101090 0x7fa950198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.492+0000 7fa956a69640 1 -- 172.21.15.135:0/2740464306 >> 172.21.15.135:0/2740464306 conn(0x7fa950078010 msgr2=0x7fa950069370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.492+0000 7fa956a69640 1 -- 172.21.15.135:0/2740464306 shutdown_connections 2024-04-20T12:31:54.500 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.492+0000 7fa956a69640 1 -- 172.21.15.135:0/2740464306 wait complete. 2024-04-20T12:31:54.502 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:31:54.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.603+0000 7f2bfcc81640 1 -- 172.21.15.135:0/3558885130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf8101a50 msgr2=0x7f2bf8105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.603+0000 7f2bfcc81640 1 --2- 172.21.15.135:0/3558885130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf8101a50 0x7f2bf8105a90 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009900 tx=0x7f2bec02bc30 comp rx=0 tx=0).stop 2024-04-20T12:31:54.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.603+0000 7f2bfcc81640 1 -- 172.21.15.135:0/3558885130 shutdown_connections 2024-04-20T12:31:54.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.603+0000 7f2bfcc81640 1 --2- 172.21.15.135:0/3558885130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf8106170 0x7f2bf810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.603+0000 7f2bfcc81640 1 --2- 172.21.15.135:0/3558885130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf8101a50 0x7f2bf8105a90 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.603+0000 7f2bfcc81640 1 --2- 172.21.15.135:0/3558885130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf81010a0 0x7f2bf8101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.603+0000 7f2bfcc81640 1 -- 172.21.15.135:0/3558885130 >> 172.21.15.135:0/3558885130 conn(0x7f2bf80771e0 msgr2=0x7f2bf80775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.603+0000 7f2bfcc81640 1 -- 172.21.15.135:0/3558885130 shutdown_connections 2024-04-20T12:31:54.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.603+0000 7f2bfcc81640 1 -- 172.21.15.135:0/3558885130 wait complete. 2024-04-20T12:31:54.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bfcc81640 1 Processor -- start 2024-04-20T12:31:54.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bfcc81640 1 -- start start 2024-04-20T12:31:54.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bfcc81640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf81010a0 0x7f2bf819e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bfcc81640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf8106170 0x7f2bf819e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bfcc81640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf8198600 0x7f2bf8198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bfcc81640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8112340 con 0x7f2bf81010a0 2024-04-20T12:31:54.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bfcc81640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf81121c0 con 0x7f2bf8106170 2024-04-20T12:31:54.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bfcc81640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf81124c0 con 0x7f2bf8198600 2024-04-20T12:31:54.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bf659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf81010a0 0x7f2bf819e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bf659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf81010a0 0x7f2bf819e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59226/0 (socket says 172.21.15.135:59226) 2024-04-20T12:31:54.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bf659c640 1 -- 172.21.15.135:0/2093115547 learned_addr learned my addr 172.21.15.135:0/2093115547 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bf5d9b640 1 --2- 172.21.15.135:0/2093115547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf8106170 0x7f2bf819e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bf659c640 1 -- 172.21.15.135:0/2093115547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf8198600 msgr2=0x7f2bf8198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bf659c640 1 --2- 172.21.15.135:0/2093115547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf8198600 0x7f2bf8198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bf659c640 1 -- 172.21.15.135:0/2093115547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf8106170 msgr2=0x7f2bf819e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bf659c640 1 --2- 172.21.15.135:0/2093115547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf8106170 0x7f2bf819e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bf659c640 1 -- 172.21.15.135:0/2093115547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf8199120 con 0x7f2bf81010a0 2024-04-20T12:31:54.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bf5d9b640 1 --2- 172.21.15.135:0/2093115547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf8106170 0x7f2bf819e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:54.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.604+0000 7f2bf659c640 1 --2- 172.21.15.135:0/2093115547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf81010a0 0x7f2bf819e450 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f2be800d770 tx=0x7f2be800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.605+0000 7f2be77fe640 1 -- 172.21.15.135:0/2093115547 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8017070 con 0x7f2bf81010a0 2024-04-20T12:31:54.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.605+0000 7f2be77fe640 1 -- 172.21.15.135:0/2093115547 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2be8005500 con 0x7f2bf81010a0 2024-04-20T12:31:54.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.605+0000 7f2bfcc81640 1 -- 172.21.15.135:0/2093115547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf8199410 con 0x7f2bf81010a0 2024-04-20T12:31:54.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.605+0000 7f2be77fe640 1 -- 172.21.15.135:0/2093115547 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8004e00 con 0x7f2bf81010a0 2024-04-20T12:31:54.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.605+0000 7f2bfcc81640 1 -- 172.21.15.135:0/2093115547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf81a5610 con 0x7f2bf81010a0 2024-04-20T12:31:54.614 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.607+0000 7f2be77fe640 1 -- 172.21.15.135:0/2093115547 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f2be8004fa0 con 0x7f2bf81010a0 2024-04-20T12:31:54.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.607+0000 7f2bff87c740 1 Processor -- start 2024-04-20T12:31:54.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.607+0000 7f2bff87c740 1 -- start start 2024-04-20T12:31:54.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.607+0000 7f2bff87c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e172e10 0x55ec2e1731f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.607+0000 7f2bff87c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e173730 0x55ec2e17bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.607+0000 7f2bff87c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e17c310 0x55ec2e17e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.607+0000 7f2bff87c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ec2e0d8110 con 0x55ec2e17c310 2024-04-20T12:31:54.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.607+0000 7f2bff87c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ec2e075550 con 0x55ec2e173730 2024-04-20T12:31:54.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.607+0000 7f2bff87c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ec2e0d40d0 con 0x55ec2e172e10 2024-04-20T12:31:54.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.607+0000 7f2bf5d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e17c310 0x55ec2e17e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2bf5d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e17c310 0x55ec2e17e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59238/0 (socket says 172.21.15.135:59238) 2024-04-20T12:31:54.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2bf5d9b640 1 -- 172.21.15.135:0/4282582048 learned_addr learned my addr 172.21.15.135:0/4282582048 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2bf6d9d640 1 --2- 172.21.15.135:0/4282582048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e172e10 0x55ec2e1731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.615 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2be77fe640 1 --2- 172.21.15.135:0/2093115547 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2be00a3d20 0x7f2be00a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2bf659c640 1 --2- 172.21.15.135:0/4282582048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e173730 0x55ec2e17bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2bf5d9b640 1 -- 172.21.15.135:0/4282582048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e172e10 msgr2=0x55ec2e1731f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2bf5d9b640 1 --2- 172.21.15.135:0/4282582048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e172e10 0x55ec2e1731f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2bf5d9b640 1 -- 172.21.15.135:0/4282582048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e173730 msgr2=0x55ec2e17bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2bf5d9b640 1 --2- 172.21.15.135:0/4282582048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e173730 0x55ec2e17bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2bf5d9b640 1 -- 172.21.15.135:0/4282582048 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec2e09d900 con 0x55ec2e17c310 2024-04-20T12:31:54.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2bf6d9d640 1 --2- 172.21.15.135:0/4282582048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e172e10 0x55ec2e1731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:54.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2be77fe640 1 -- 172.21.15.135:0/2093115547 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f2be80d06d0 con 0x7f2bf81010a0 2024-04-20T12:31:54.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2bf6d9d640 1 --2- 172.21.15.135:0/2093115547 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2be00a3d20 0x7f2be00a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2bf5d9b640 1 --2- 172.21.15.135:0/4282582048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e17c310 0x55ec2e17e700 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f2bf806a3d0 tx=0x7f2bec02c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6aaeec0c59995f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2be4ff9640 1 -- 172.21.15.135:0/4282582048 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec02cbc0 con 0x55ec2e17c310 2024-04-20T12:31:54.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2be4ff9640 1 -- 172.21.15.135:0/4282582048 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bec005040 con 0x55ec2e17c310 2024-04-20T12:31:54.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2be4ff9640 1 -- 172.21.15.135:0/4282582048 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0049e0 con 0x55ec2e17c310 2024-04-20T12:31:54.616 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.608+0000 7f2bf6d9d640 1 --2- 172.21.15.135:0/2093115547 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2be00a3d20 0x7f2be00a61e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0005cc0 tx=0x7f2bf0004a40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.609+0000 7f2bff87c740 1 -- 172.21.15.135:0/4282582048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e17c310 msgr2=0x55ec2e17e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.609+0000 7f2bff87c740 1 --2- 172.21.15.135:0/4282582048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e17c310 0x55ec2e17e700 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f2bf806a3d0 tx=0x7f2bec02c650 comp rx=0 tx=0).stop 2024-04-20T12:31:54.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.609+0000 7f2bff87c740 1 -- 172.21.15.135:0/4282582048 shutdown_connections 2024-04-20T12:31:54.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.609+0000 7f2bff87c740 1 --2- 172.21.15.135:0/4282582048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e17c310 0x55ec2e17e700 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.609+0000 7f2bff87c740 1 --2- 172.21.15.135:0/4282582048 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e173730 0x55ec2e17bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.609+0000 7f2bff87c740 1 --2- 172.21.15.135:0/4282582048 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e172e10 0x55ec2e1731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.609+0000 7f2bff87c740 1 -- 172.21.15.135:0/4282582048 >> 172.21.15.135:0/4282582048 conn(0x55ec2e16d540 msgr2=0x55ec2e16d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.609+0000 7f2bff87c740 1 -- 172.21.15.135:0/4282582048 shutdown_connections 2024-04-20T12:31:54.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.609+0000 7f2bff87c740 1 -- 172.21.15.135:0/4282582048 wait complete. 2024-04-20T12:31:54.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.609+0000 7f2bff87c740 1 -- start start 2024-04-20T12:31:54.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bff87c740 1 Processor -- start 2024-04-20T12:31:54.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bff87c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e172e10 0x55ec2e179430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bff87c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e173730 0x55ec2e179970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.617 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bff87c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e17c310 0x55ec2e179eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bff87c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ec2e17efe0 con 0x55ec2e173730 2024-04-20T12:31:54.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bff87c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ec2e091500 con 0x55ec2e17c310 2024-04-20T12:31:54.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bff87c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ec2e17f160 con 0x55ec2e172e10 2024-04-20T12:31:54.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bff87c740 10 client.0 _ll_register_callbacks cb 0x55ec2e0762f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:54.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bf5d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e173730 0x55ec2e179970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bf5d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e173730 0x55ec2e179970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59252/0 (socket says 172.21.15.135:59252) 2024-04-20T12:31:54.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bf5d9b640 1 -- 172.21.15.135:0/226791828 learned_addr learned my addr 172.21.15.135:0/226791828 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bf6d9d640 1 --2- 172.21.15.135:0/226791828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e17c310 0x55ec2e179eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bf659c640 1 --2- 172.21.15.135:0/226791828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e172e10 0x55ec2e179430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bf5d9b640 1 -- 172.21.15.135:0/226791828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e172e10 msgr2=0x55ec2e179430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bf5d9b640 1 --2- 172.21.15.135:0/226791828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e172e10 0x55ec2e179430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bf5d9b640 1 -- 172.21.15.135:0/226791828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e17c310 msgr2=0x55ec2e179eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.618 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bf5d9b640 1 --2- 172.21.15.135:0/226791828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e17c310 0x55ec2e179eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bf5d9b640 1 -- 172.21.15.135:0/226791828 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec2ddea3f0 con 0x55ec2e173730 2024-04-20T12:31:54.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bf6d9d640 1 --2- 172.21.15.135:0/226791828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e17c310 0x55ec2e179eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:54.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bf5d9b640 1 --2- 172.21.15.135:0/226791828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e173730 0x55ec2e179970 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f2bec02c170 tx=0x7f2bec005480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89892deaf428df8d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bddffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:54.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bddffb640 1 -- 172.21.15.135:0/226791828 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec004ad0 con 0x55ec2e173730 2024-04-20T12:31:54.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bddffb640 1 -- 172.21.15.135:0/226791828 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f2bec004c70 con 0x55ec2e173730 2024-04-20T12:31:54.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.610+0000 7f2bff87c740 1 -- 172.21.15.135:0/226791828 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bec005040 con 0x55ec2e173730 2024-04-20T12:31:54.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.611+0000 7f2bddffb640 1 -- 172.21.15.135:0/226791828 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2bec004e70 con 0x55ec2e173730 2024-04-20T12:31:54.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.611+0000 7f2bff87c740 10 client.18297 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:54.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.611+0000 7f2bff87c740 1 -- 172.21.15.135:0/226791828 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ec2deb47d0 con 0x55ec2e173730 2024-04-20T12:31:54.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.611+0000 7f2bddffb640 1 -- 172.21.15.135:0/226791828 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bec005040 con 0x55ec2e173730 2024-04-20T12:31:54.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.611+0000 7f2bddffb640 1 -- 172.21.15.135:0/226791828 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2bec034670 con 0x55ec2e173730 2024-04-20T12:31:54.619 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.611+0000 7f2bff87c740 10 client.18297 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:54.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.611+0000 7f2bff87c740 10 client.18297 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:31:54.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.611+0000 7f2bff87c740 20 client.18297 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:54.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.611+0000 7f2bff87c740 1 --2- 172.21.15.135:0/226791828 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ec2e18c470 0x55ec2e18e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.611+0000 7f2bff87c740 4 client.18297 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:54.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.611+0000 7f2bff87c740 1 -- 172.21.15.135:0/226791828 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec2e0e5b30 con 0x55ec2e18c470 2024-04-20T12:31:54.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.611+0000 7f2bf659c640 1 --2- 172.21.15.135:0/226791828 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ec2e18c470 0x55ec2e18e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.612+0000 7f2bddffb640 10 client.18297 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:31:54.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.612+0000 7f2bf659c640 1 --2- 172.21.15.135:0/226791828 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ec2e18c470 0x55ec2e18e860 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1bd1ccd866785e45 server_cookie=49b920a30b382a56 in_seq=0 out_seq=0 2024-04-20T12:31:54.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.612+0000 7f2bddffb640 1 -- 172.21.15.135:0/226791828 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ec2e0e5b30 con 0x55ec2e18c470 2024-04-20T12:31:54.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.612+0000 7f2bddffb640 10 client.18297 handle_command_reply: tid=0 2024-04-20T12:31:54.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.612+0000 7f2bff87c740 1 client.18297 shutdown 2024-04-20T12:31:54.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.612+0000 7f2bff87c740 1 -- 172.21.15.135:0/226791828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e173730 msgr2=0x55ec2e179970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.612+0000 7f2bff87c740 1 --2- 172.21.15.135:0/226791828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e173730 0x55ec2e179970 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f2bec02c170 tx=0x7f2bec005480 comp rx=0 tx=0).stop 2024-04-20T12:31:54.620 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.612+0000 7f2bff87c740 1 -- 172.21.15.135:0/226791828 shutdown_connections 2024-04-20T12:31:54.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.612+0000 7f2bff87c740 1 --2- 172.21.15.135:0/226791828 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ec2e18c470 0x55ec2e18e860 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.612+0000 7f2bff87c740 1 --2- 172.21.15.135:0/226791828 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e17c310 0x55ec2e179eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.612+0000 7f2bddffb640 0 client.18297 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:31:54.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.612+0000 7f2bff87c740 1 --2- 172.21.15.135:0/226791828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e173730 0x55ec2e179970 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.612+0000 7f2bff87c740 1 --2- 172.21.15.135:0/226791828 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e172e10 0x55ec2e179430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.612+0000 7f2bff87c740 1 -- 172.21.15.135:0/226791828 >> 172.21.15.135:0/226791828 conn(0x55ec2e16d540 msgr2=0x55ec2e16f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.613+0000 7f2bff87c740 1 -- 172.21.15.135:0/226791828 shutdown_connections 2024-04-20T12:31:54.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.613+0000 7f2bff87c740 1 -- 172.21.15.135:0/226791828 wait complete. 2024-04-20T12:31:54.621 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.613+0000 7f2bff87c740 20 client.18297 trim_cache size 0 max 16384 2024-04-20T12:31:54.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bff87c740 1 Processor -- start 2024-04-20T12:31:54.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bff87c740 1 -- start start 2024-04-20T12:31:54.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bff87c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e172e10 0x55ec2e17bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bff87c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e173730 0x55ec2e193e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bff87c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e17c310 0x55ec2e1943a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bff87c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf81af3d0 con 0x55ec2e17c310 2024-04-20T12:31:54.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bff87c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf81b0f10 con 0x55ec2e173730 2024-04-20T12:31:54.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bff87c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf81afaa0 con 0x55ec2e172e10 2024-04-20T12:31:54.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bf6d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e17c310 0x55ec2e1943a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bf6d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e17c310 0x55ec2e1943a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59256/0 (socket says 172.21.15.135:59256) 2024-04-20T12:31:54.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bf6d9d640 1 -- 172.21.15.135:0/1600394503 learned_addr learned my addr 172.21.15.135:0/1600394503 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bf6d9d640 1 -- 172.21.15.135:0/1600394503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e172e10 msgr2=0x55ec2e17bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bf6d9d640 1 --2- 172.21.15.135:0/1600394503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e172e10 0x55ec2e17bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bf6d9d640 1 -- 172.21.15.135:0/1600394503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e173730 msgr2=0x55ec2e193e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bf6d9d640 1 --2- 172.21.15.135:0/1600394503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e173730 0x55ec2e193e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.637 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bf6d9d640 1 -- 172.21.15.135:0/1600394503 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec2e1779c0 con 0x55ec2e17c310 2024-04-20T12:31:54.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bf6d9d640 1 --2- 172.21.15.135:0/1600394503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e17c310 0x55ec2e1943a0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0011600 tx=0x7f2bf0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc20b4a35de7540c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bdffff640 1 -- 172.21.15.135:0/1600394503 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0022070 con 0x55ec2e17c310 2024-04-20T12:31:54.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bdffff640 1 -- 172.21.15.135:0/1600394503 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bf001ed10 con 0x55ec2e17c310 2024-04-20T12:31:54.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.626+0000 7f2bdffff640 1 -- 172.21.15.135:0/1600394503 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf001d3b0 con 0x55ec2e17c310 2024-04-20T12:31:54.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.627+0000 7f2bff87c740 1 -- 172.21.15.135:0/1600394503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e17c310 msgr2=0x55ec2e1943a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.627+0000 7f2bff87c740 1 --2- 172.21.15.135:0/1600394503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e17c310 0x55ec2e1943a0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0011600 tx=0x7f2bf0011000 comp rx=0 tx=0).stop 2024-04-20T12:31:54.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.627+0000 7f2bff87c740 1 -- 172.21.15.135:0/1600394503 shutdown_connections 2024-04-20T12:31:54.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.627+0000 7f2bff87c740 1 --2- 172.21.15.135:0/1600394503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e17c310 0x55ec2e1943a0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.627+0000 7f2bff87c740 1 --2- 172.21.15.135:0/1600394503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e173730 0x55ec2e193e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.627+0000 7f2bff87c740 1 --2- 172.21.15.135:0/1600394503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e172e10 0x55ec2e17bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.627+0000 7f2bff87c740 1 -- 172.21.15.135:0/1600394503 >> 172.21.15.135:0/1600394503 conn(0x55ec2e16d540 msgr2=0x55ec2e16c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.627+0000 7f2bff87c740 1 -- 172.21.15.135:0/1600394503 shutdown_connections 2024-04-20T12:31:54.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.627+0000 7f2bff87c740 1 -- 172.21.15.135:0/1600394503 wait complete. 2024-04-20T12:31:54.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.627+0000 7f2bff87c740 1 -- start start 2024-04-20T12:31:54.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.627+0000 7f2bff87c740 1 Processor -- start 2024-04-20T12:31:54.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bff87c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e172e10 0x55ec2e1843b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bff87c740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e173730 0x55ec2e1848f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bff87c740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e17c310 0x55ec2e181380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bff87c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf81b0840 con 0x55ec2e172e10 2024-04-20T12:31:54.640 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bff87c740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf81b0170 con 0x55ec2e17c310 2024-04-20T12:31:54.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bff87c740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf81ad3a0 con 0x55ec2e173730 2024-04-20T12:31:54.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bff87c740 10 client.0 _ll_register_callbacks cb 0x7f2bec005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:54.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bf659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e172e10 0x55ec2e1843b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bf659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e172e10 0x55ec2e1843b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59266/0 (socket says 172.21.15.135:59266) 2024-04-20T12:31:54.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bf659c640 1 -- 172.21.15.135:0/2873389888 learned_addr learned my addr 172.21.15.135:0/2873389888 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bf6d9d640 1 --2- 172.21.15.135:0/2873389888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e17c310 0x55ec2e181380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bf659c640 1 -- 172.21.15.135:0/2873389888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e173730 msgr2=0x55ec2e1848f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bf5d9b640 1 --2- 172.21.15.135:0/2873389888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e173730 0x55ec2e1848f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.641 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bf659c640 1 --2- 172.21.15.135:0/2873389888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e173730 0x55ec2e1848f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bf659c640 1 -- 172.21.15.135:0/2873389888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e17c310 msgr2=0x55ec2e181380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bf659c640 1 --2- 172.21.15.135:0/2873389888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e17c310 0x55ec2e181380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bf659c640 1 -- 172.21.15.135:0/2873389888 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec2e181b80 con 0x55ec2e172e10 2024-04-20T12:31:54.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bf6d9d640 1 --2- 172.21.15.135:0/2873389888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e17c310 0x55ec2e181380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:54.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bf5d9b640 1 --2- 172.21.15.135:0/2873389888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e173730 0x55ec2e1848f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:54.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bf659c640 1 --2- 172.21.15.135:0/2873389888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e172e10 0x55ec2e1843b0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f2be8098700 tx=0x7f2be806bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338635b89249a8fb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bddffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:54.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bddffb640 1 -- 172.21.15.135:0/2873389888 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8020040 con 0x55ec2e172e10 2024-04-20T12:31:54.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bddffb640 1 -- 172.21.15.135:0/2873389888 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f2be8009cc0 con 0x55ec2e172e10 2024-04-20T12:31:54.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.628+0000 7f2bff87c740 1 -- 172.21.15.135:0/2873389888 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bf001ed10 con 0x55ec2e172e10 2024-04-20T12:31:54.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.629+0000 7f2bddffb640 1 -- 172.21.15.135:0/2873389888 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2be80b5050 con 0x55ec2e172e10 2024-04-20T12:31:54.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.629+0000 7f2bff87c740 10 client.18303 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:54.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.629+0000 7f2bff87c740 1 -- 172.21.15.135:0/2873389888 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ec2e1f31a0 con 0x55ec2e172e10 2024-04-20T12:31:54.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.629+0000 7f2bddffb640 1 -- 172.21.15.135:0/2873389888 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bf001ed10 con 0x55ec2e172e10 2024-04-20T12:31:54.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.629+0000 7f2bddffb640 1 -- 172.21.15.135:0/2873389888 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2be80cdcd0 con 0x55ec2e172e10 2024-04-20T12:31:54.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.629+0000 7f2bff87c740 10 client.18303 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:54.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.629+0000 7f2bff87c740 10 client.18303 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:31:54.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.629+0000 7f2bff87c740 20 client.18303 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:54.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.629+0000 7f2bff87c740 1 --2- 172.21.15.135:0/2873389888 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ec2e1f38d0 0x55ec2e1f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.629+0000 7f2bff87c740 4 client.18303 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:31:54.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.629+0000 7f2bff87c740 1 -- 172.21.15.135:0/2873389888 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ec2e0df9a0 con 0x55ec2e1f38d0 2024-04-20T12:31:54.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.629+0000 7f2bf5d9b640 1 --2- 172.21.15.135:0/2873389888 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ec2e1f38d0 0x55ec2e1f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.629+0000 7f2bddffb640 10 client.18303 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:31:54.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.629+0000 7f2bf5d9b640 1 --2- 172.21.15.135:0/2873389888 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ec2e1f38d0 0x55ec2e1f5cf0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ed8deb6fca84242f server_cookie=813482adb80edeba in_seq=0 out_seq=0 2024-04-20T12:31:54.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bddffb640 1 -- 172.21.15.135:0/2873389888 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ec2e0df9a0 con 0x55ec2e1f38d0 2024-04-20T12:31:54.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bddffb640 10 client.18303 handle_command_reply: tid=0 2024-04-20T12:31:54.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bff87c740 1 client.18303 shutdown 2024-04-20T12:31:54.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bff87c740 1 -- 172.21.15.135:0/2873389888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e172e10 msgr2=0x55ec2e1843b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bff87c740 1 --2- 172.21.15.135:0/2873389888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e172e10 0x55ec2e1843b0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f2be8098700 tx=0x7f2be806bb80 comp rx=0 tx=0).stop 2024-04-20T12:31:54.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bff87c740 1 -- 172.21.15.135:0/2873389888 shutdown_connections 2024-04-20T12:31:54.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bff87c740 1 --2- 172.21.15.135:0/2873389888 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ec2e1f38d0 0x55ec2e1f5cf0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bff87c740 1 --2- 172.21.15.135:0/2873389888 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ec2e17c310 0x55ec2e181380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bddffb640 0 client.18303 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:31:54.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bff87c740 1 --2- 172.21.15.135:0/2873389888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ec2e173730 0x55ec2e1848f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bff87c740 1 --2- 172.21.15.135:0/2873389888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e172e10 0x55ec2e1843b0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bff87c740 1 -- 172.21.15.135:0/2873389888 >> 172.21.15.135:0/2873389888 conn(0x55ec2e16d540 msgr2=0x55ec2e16be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bff87c740 1 -- 172.21.15.135:0/2873389888 shutdown_connections 2024-04-20T12:31:54.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bff87c740 1 -- 172.21.15.135:0/2873389888 wait complete. 2024-04-20T12:31:54.644 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bff87c740 20 client.18303 trim_cache size 0 max 16384 2024-04-20T12:31:54.645 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:31:54.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bfcc81640 1 -- 172.21.15.135:0/2093115547 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2be00a3d20 msgr2=0x7f2be00a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bfcc81640 1 --2- 172.21.15.135:0/2093115547 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2be00a3d20 0x7f2be00a61e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0005cc0 tx=0x7f2bf0004a40 comp rx=0 tx=0).stop 2024-04-20T12:31:54.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bfcc81640 1 -- 172.21.15.135:0/2093115547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf81010a0 msgr2=0x7f2bf819e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bfcc81640 1 --2- 172.21.15.135:0/2093115547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf81010a0 0x7f2bf819e450 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f2be800d770 tx=0x7f2be800dc30 comp rx=0 tx=0).stop 2024-04-20T12:31:54.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bfcc81640 1 -- 172.21.15.135:0/2093115547 shutdown_connections 2024-04-20T12:31:54.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bfcc81640 1 --2- 172.21.15.135:0/2093115547 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2be00a3d20 0x7f2be00a61e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bfcc81640 1 --2- 172.21.15.135:0/2093115547 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2bf8198600 0x7f2bf8198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bfcc81640 1 --2- 172.21.15.135:0/2093115547 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2bf8106170 0x7f2bf819e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bfcc81640 1 --2- 172.21.15.135:0/2093115547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2bf81010a0 0x7f2bf819e450 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.630+0000 7f2bfcc81640 1 -- 172.21.15.135:0/2093115547 >> 172.21.15.135:0/2093115547 conn(0x7f2bf80771e0 msgr2=0x7f2bf80fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.631+0000 7f2bfcc81640 1 -- 172.21.15.135:0/2093115547 shutdown_connections 2024-04-20T12:31:54.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.631+0000 7f2bfcc81640 1 -- 172.21.15.135:0/2093115547 wait complete. 2024-04-20T12:31:54.647 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:31:54.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.748+0000 7f38df0c1640 1 -- 172.21.15.135:0/2495950890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d81021b0 msgr2=0x7f38d8102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.748+0000 7f38df0c1640 1 --2- 172.21.15.135:0/2495950890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d81021b0 0x7f38d8102590 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009900 tx=0x7f38cc02bc30 comp rx=0 tx=0).stop 2024-04-20T12:31:54.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.748+0000 7f38df0c1640 1 -- 172.21.15.135:0/2495950890 shutdown_connections 2024-04-20T12:31:54.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.748+0000 7f38df0c1640 1 --2- 172.21.15.135:0/2495950890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d8107280 0x7f38d810ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.748+0000 7f38df0c1640 1 --2- 172.21.15.135:0/2495950890 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38d8102b60 0x7f38d8106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.748+0000 7f38df0c1640 1 --2- 172.21.15.135:0/2495950890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d81021b0 0x7f38d8102590 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.748+0000 7f38df0c1640 1 -- 172.21.15.135:0/2495950890 >> 172.21.15.135:0/2495950890 conn(0x7f38d80793f0 msgr2=0x7f38d8079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.748+0000 7f38df0c1640 1 -- 172.21.15.135:0/2495950890 shutdown_connections 2024-04-20T12:31:54.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.748+0000 7f38df0c1640 1 -- 172.21.15.135:0/2495950890 wait complete. 2024-04-20T12:31:54.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.748+0000 7f38df0c1640 1 Processor -- start 2024-04-20T12:31:54.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.748+0000 7f38df0c1640 1 -- start start 2024-04-20T12:31:54.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.748+0000 7f38df0c1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d81021b0 0x7f38d819e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.748+0000 7f38df0c1640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d8107280 0x7f38d819eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.748+0000 7f38df0c1640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38d8198630 0x7f38d8198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38df0c1640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f38d8112310 con 0x7f38d81021b0 2024-04-20T12:31:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38df0c1640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f38d8112190 con 0x7f38d8198630 2024-04-20T12:31:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38df0c1640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38d8112490 con 0x7f38d8107280 2024-04-20T12:31:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38dce5d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d81021b0 0x7f38d819e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38dce5d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d81021b0 0x7f38d819e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59296/0 (socket says 172.21.15.135:59296) 2024-04-20T12:31:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38dce5d640 1 -- 172.21.15.135:0/187582926 learned_addr learned my addr 172.21.15.135:0/187582926 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38dd65e640 1 --2- 172.21.15.135:0/187582926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38d8198630 0x7f38d8198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38d7fff640 1 --2- 172.21.15.135:0/187582926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d8107280 0x7f38d819eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38dce5d640 1 -- 172.21.15.135:0/187582926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d8107280 msgr2=0x7f38d819eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38dce5d640 1 --2- 172.21.15.135:0/187582926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d8107280 0x7f38d819eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38dce5d640 1 -- 172.21.15.135:0/187582926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38d8198630 msgr2=0x7f38d8198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38dce5d640 1 --2- 172.21.15.135:0/187582926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38d8198630 0x7f38d8198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38dce5d640 1 -- 172.21.15.135:0/187582926 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d8199230 con 0x7f38d81021b0 2024-04-20T12:31:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38dce5d640 1 --2- 172.21.15.135:0/187582926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d81021b0 0x7f38d819e570 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f38cc006010 tx=0x7f38cc02cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38d5ffb640 1 -- 172.21.15.135:0/187582926 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc041070 con 0x7f38d81021b0 2024-04-20T12:31:54.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38df0c1640 1 -- 172.21.15.135:0/187582926 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d81994c0 con 0x7f38d81021b0 2024-04-20T12:31:54.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38d5ffb640 1 -- 172.21.15.135:0/187582926 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38cc004450 con 0x7f38d81021b0 2024-04-20T12:31:54.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38d5ffb640 1 -- 172.21.15.135:0/187582926 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc003e00 con 0x7f38d81021b0 2024-04-20T12:31:54.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.749+0000 7f38df0c1640 1 -- 172.21.15.135:0/187582926 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d81a5600 con 0x7f38d81021b0 2024-04-20T12:31:54.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38d5ffb640 1 -- 172.21.15.135:0/187582926 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f38cc044070 con 0x7f38d81021b0 2024-04-20T12:31:54.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38e1d92740 1 Processor -- start 2024-04-20T12:31:54.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38e1d92740 1 -- start start 2024-04-20T12:31:54.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38e1d92740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f6e10 0x55ae4d6f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38e1d92740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d6f7730 0x55ae4d6ffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38e1d92740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d700310 0x55ae4d702700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38e1d92740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ae4d65c110 con 0x55ae4d700310 2024-04-20T12:31:54.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38e1d92740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ae4d5f9550 con 0x55ae4d6f7730 2024-04-20T12:31:54.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38e1d92740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ae4d6580d0 con 0x55ae4d6f6e10 2024-04-20T12:31:54.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38d5ffb640 1 --2- 172.21.15.135:0/187582926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38c80a3d20 0x7f38c80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38d7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d700310 0x55ae4d702700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38d7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d700310 0x55ae4d702700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59308/0 (socket says 172.21.15.135:59308) 2024-04-20T12:31:54.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38d7fff640 1 -- 172.21.15.135:0/600815818 learned_addr learned my addr 172.21.15.135:0/600815818 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38dd65e640 1 --2- 172.21.15.135:0/187582926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38c80a3d20 0x7f38c80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38dd65e640 1 --2- 172.21.15.135:0/600815818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f6e10 0x55ae4d6f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38d5ffb640 1 -- 172.21.15.135:0/187582926 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f38cc0f2620 con 0x7f38d81021b0 2024-04-20T12:31:54.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.752+0000 7f38dce5d640 1 --2- 172.21.15.135:0/600815818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d6f7730 0x55ae4d6ffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.753+0000 7f38d7fff640 1 -- 172.21.15.135:0/600815818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f6e10 msgr2=0x55ae4d6f71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.753+0000 7f38d7fff640 1 --2- 172.21.15.135:0/600815818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f6e10 0x55ae4d6f71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.753+0000 7f38d7fff640 1 -- 172.21.15.135:0/600815818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d6f7730 msgr2=0x55ae4d6ffdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.753+0000 7f38d7fff640 1 --2- 172.21.15.135:0/600815818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d6f7730 0x55ae4d6ffdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.753+0000 7f38d7fff640 1 -- 172.21.15.135:0/600815818 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae4d621900 con 0x55ae4d700310 2024-04-20T12:31:54.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.753+0000 7f38dd65e640 1 --2- 172.21.15.135:0/187582926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38c80a3d20 0x7f38c80a61e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f38d00098b0 tx=0x7f38d0009d90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.753+0000 7f38d7fff640 1 --2- 172.21.15.135:0/600815818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d700310 0x55ae4d702700 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009bf0 tx=0x7f38c40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d1c21c8cf77058 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.753+0000 7f38c2ffd640 1 -- 172.21.15.135:0/600815818 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4004020 con 0x55ae4d700310 2024-04-20T12:31:54.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.753+0000 7f38c2ffd640 1 -- 172.21.15.135:0/600815818 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38c40041c0 con 0x55ae4d700310 2024-04-20T12:31:54.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.753+0000 7f38c2ffd640 1 -- 172.21.15.135:0/600815818 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c40126b0 con 0x55ae4d700310 2024-04-20T12:31:54.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.753+0000 7f38e1d92740 1 -- 172.21.15.135:0/600815818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d700310 msgr2=0x55ae4d702700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.753+0000 7f38e1d92740 1 --2- 172.21.15.135:0/600815818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d700310 0x55ae4d702700 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009bf0 tx=0x7f38c40117b0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 1 -- 172.21.15.135:0/600815818 shutdown_connections 2024-04-20T12:31:54.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 1 --2- 172.21.15.135:0/600815818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d700310 0x55ae4d702700 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 1 --2- 172.21.15.135:0/600815818 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d6f7730 0x55ae4d6ffdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 1 --2- 172.21.15.135:0/600815818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f6e10 0x55ae4d6f71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 1 -- 172.21.15.135:0/600815818 >> 172.21.15.135:0/600815818 conn(0x55ae4d6f1540 msgr2=0x55ae4d6f1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 1 -- 172.21.15.135:0/600815818 shutdown_connections 2024-04-20T12:31:54.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 1 -- 172.21.15.135:0/600815818 wait complete. 2024-04-20T12:31:54.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 1 -- start start 2024-04-20T12:31:54.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 1 Processor -- start 2024-04-20T12:31:54.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f6e10 0x55ae4d6fd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f7730 0x55ae4d6fd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d700310 0x55ae4d6fde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ae4d703040 con 0x55ae4d6f7730 2024-04-20T12:31:54.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ae4d615500 con 0x55ae4d700310 2024-04-20T12:31:54.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ae4d7031c0 con 0x55ae4d6f6e10 2024-04-20T12:31:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.754+0000 7f38e1d92740 10 client.0 _ll_register_callbacks cb 0x55ae4d5fa2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38d7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f7730 0x55ae4d6fd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38d7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f7730 0x55ae4d6fd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59320/0 (socket says 172.21.15.135:59320) 2024-04-20T12:31:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38d7fff640 1 -- 172.21.15.135:0/4049201689 learned_addr learned my addr 172.21.15.135:0/4049201689 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38dd65e640 1 --2- 172.21.15.135:0/4049201689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d700310 0x55ae4d6fde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38dce5d640 1 --2- 172.21.15.135:0/4049201689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f6e10 0x55ae4d6fd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38d7fff640 1 -- 172.21.15.135:0/4049201689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f6e10 msgr2=0x55ae4d6fd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38d7fff640 1 --2- 172.21.15.135:0/4049201689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f6e10 0x55ae4d6fd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38d7fff640 1 -- 172.21.15.135:0/4049201689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d700310 msgr2=0x55ae4d6fde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38d7fff640 1 --2- 172.21.15.135:0/4049201689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d700310 0x55ae4d6fde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38d7fff640 1 -- 172.21.15.135:0/4049201689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae4d36e3f0 con 0x55ae4d6f7730 2024-04-20T12:31:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38d7fff640 1 --2- 172.21.15.135:0/4049201689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f7730 0x55ae4d6fd910 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f38c4003d50 tx=0x7f38c4003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de86c12447ccf6cc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:54.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38b7fff640 1 -- 172.21.15.135:0/4049201689 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c40037f0 con 0x55ae4d6f7730 2024-04-20T12:31:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38b7fff640 1 -- 172.21.15.135:0/4049201689 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f38c4005050 con 0x55ae4d6f7730 2024-04-20T12:31:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38e1d92740 1 -- 172.21.15.135:0/4049201689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38c40041c0 con 0x55ae4d6f7730 2024-04-20T12:31:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38b7fff640 1 -- 172.21.15.135:0/4049201689 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f38c4031050 con 0x55ae4d6f7730 2024-04-20T12:31:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38e1d92740 10 client.18315 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.755+0000 7f38e1d92740 1 -- 172.21.15.135:0/4049201689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ae4d4387d0 con 0x55ae4d6f7730 2024-04-20T12:31:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.756+0000 7f38b7fff640 1 -- 172.21.15.135:0/4049201689 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38c40041c0 con 0x55ae4d6f7730 2024-04-20T12:31:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.756+0000 7f38b7fff640 1 -- 172.21.15.135:0/4049201689 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f38c4023450 con 0x55ae4d6f7730 2024-04-20T12:31:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.756+0000 7f38e1d92740 10 client.18315 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.756+0000 7f38e1d92740 10 client.18315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.756+0000 7f38e1d92740 20 client.18315 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.756+0000 7f38e1d92740 1 --2- 172.21.15.135:0/4049201689 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ae4d710580 0x55ae4d712970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.756+0000 7f38e1d92740 4 client.18315 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.756+0000 7f38e1d92740 1 -- 172.21.15.135:0/4049201689 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae4d669b30 con 0x55ae4d710580 2024-04-20T12:31:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.756+0000 7f38dce5d640 1 --2- 172.21.15.135:0/4049201689 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ae4d710580 0x55ae4d712970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.756+0000 7f38dce5d640 1 --2- 172.21.15.135:0/4049201689 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ae4d710580 0x55ae4d712970 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e61c3bfc76df4aa9 server_cookie=e5c74b33671a9392 in_seq=0 out_seq=0 2024-04-20T12:31:54.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.756+0000 7f38b7fff640 10 client.18315 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:54.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.757+0000 7f38b7fff640 1 -- 172.21.15.135:0/4049201689 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ae4d669b30 con 0x55ae4d710580 2024-04-20T12:31:54.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.757+0000 7f38b7fff640 10 client.18315 handle_command_reply: tid=0 2024-04-20T12:31:54.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.757+0000 7f38e1d92740 1 client.18315 shutdown 2024-04-20T12:31:54.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.757+0000 7f38e1d92740 1 -- 172.21.15.135:0/4049201689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f7730 msgr2=0x55ae4d6fd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.757+0000 7f38e1d92740 1 --2- 172.21.15.135:0/4049201689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f7730 0x55ae4d6fd910 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f38c4003d50 tx=0x7f38c4003c60 comp rx=0 tx=0).stop 2024-04-20T12:31:54.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.757+0000 7f38e1d92740 1 -- 172.21.15.135:0/4049201689 shutdown_connections 2024-04-20T12:31:54.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.757+0000 7f38e1d92740 1 --2- 172.21.15.135:0/4049201689 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ae4d710580 0x55ae4d712970 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.757+0000 7f38e1d92740 1 --2- 172.21.15.135:0/4049201689 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d700310 0x55ae4d6fde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.757+0000 7f38b7fff640 0 client.18315 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:54.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.757+0000 7f38e1d92740 1 --2- 172.21.15.135:0/4049201689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f7730 0x55ae4d6fd910 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.757+0000 7f38e1d92740 1 --2- 172.21.15.135:0/4049201689 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f6e10 0x55ae4d6fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.757+0000 7f38e1d92740 1 -- 172.21.15.135:0/4049201689 >> 172.21.15.135:0/4049201689 conn(0x55ae4d6f1540 msgr2=0x55ae4d6f3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.758+0000 7f38e1d92740 1 -- 172.21.15.135:0/4049201689 shutdown_connections 2024-04-20T12:31:54.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.758+0000 7f38e1d92740 1 -- 172.21.15.135:0/4049201689 wait complete. 2024-04-20T12:31:54.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.758+0000 7f38e1d92740 20 client.18315 trim_cache size 0 max 16384 2024-04-20T12:31:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38e1d92740 1 Processor -- start 2024-04-20T12:31:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38e1d92740 1 -- start start 2024-04-20T12:31:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38e1d92740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d6f6e10 0x55ae4d6ffb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38e1d92740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f7730 0x55ae4d70bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38e1d92740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d700310 0x55ae4d6fc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.776 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38e1d92740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f38d81af520 con 0x55ae4d6f7730 2024-04-20T12:31:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38e1d92740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f38d81b1060 con 0x55ae4d6f6e10 2024-04-20T12:31:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38e1d92740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38d81afbf0 con 0x55ae4d700310 2024-04-20T12:31:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38d7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f7730 0x55ae4d70bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38d7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f7730 0x55ae4d70bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59326/0 (socket says 172.21.15.135:59326) 2024-04-20T12:31:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38d7fff640 1 -- 172.21.15.135:0/1679877385 learned_addr learned my addr 172.21.15.135:0/1679877385 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38dce5d640 1 --2- 172.21.15.135:0/1679877385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d6f6e10 0x55ae4d6ffb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38d7fff640 1 -- 172.21.15.135:0/1679877385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d700310 msgr2=0x55ae4d6fc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38d7fff640 1 --2- 172.21.15.135:0/1679877385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d700310 0x55ae4d6fc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38d7fff640 1 -- 172.21.15.135:0/1679877385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d6f6e10 msgr2=0x55ae4d6ffb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38d7fff640 1 --2- 172.21.15.135:0/1679877385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d6f6e10 0x55ae4d6ffb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38d7fff640 1 -- 172.21.15.135:0/1679877385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae4d6ecbe0 con 0x55ae4d6f7730 2024-04-20T12:31:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.771+0000 7f38d7fff640 1 --2- 172.21.15.135:0/1679877385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f7730 0x55ae4d70bf60 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009bf0 tx=0x7f38c40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b76a456a66463f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.772+0000 7f38c27fc640 1 -- 172.21.15.135:0/1679877385 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4009530 con 0x55ae4d6f7730 2024-04-20T12:31:54.777 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.772+0000 7f38c27fc640 1 -- 172.21.15.135:0/1679877385 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38c4028070 con 0x55ae4d6f7730 2024-04-20T12:31:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.772+0000 7f38c27fc640 1 -- 172.21.15.135:0/1679877385 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4005070 con 0x55ae4d6f7730 2024-04-20T12:31:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.772+0000 7f38e1d92740 1 -- 172.21.15.135:0/1679877385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f7730 msgr2=0x55ae4d70bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.772+0000 7f38e1d92740 1 --2- 172.21.15.135:0/1679877385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f7730 0x55ae4d70bf60 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009bf0 tx=0x7f38c40117b0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.772+0000 7f38e1d92740 1 -- 172.21.15.135:0/1679877385 shutdown_connections 2024-04-20T12:31:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.772+0000 7f38e1d92740 1 --2- 172.21.15.135:0/1679877385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d700310 0x55ae4d6fc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.772+0000 7f38e1d92740 1 --2- 172.21.15.135:0/1679877385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f7730 0x55ae4d70bf60 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.772+0000 7f38e1d92740 1 --2- 172.21.15.135:0/1679877385 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d6f6e10 0x55ae4d6ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.772+0000 7f38e1d92740 1 -- 172.21.15.135:0/1679877385 >> 172.21.15.135:0/1679877385 conn(0x55ae4d6f1540 msgr2=0x55ae4d6efe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.772+0000 7f38e1d92740 1 -- 172.21.15.135:0/1679877385 shutdown_connections 2024-04-20T12:31:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.772+0000 7f38e1d92740 1 -- 172.21.15.135:0/1679877385 wait complete. 2024-04-20T12:31:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.772+0000 7f38e1d92740 1 -- start start 2024-04-20T12:31:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38e1d92740 1 Processor -- start 2024-04-20T12:31:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38e1d92740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f6e10 0x55ae4d708470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38e1d92740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f7730 0x55ae4d7089b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38e1d92740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d700310 0x55ae4d6f9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38e1d92740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f38d81b0990 con 0x55ae4d6f6e10 2024-04-20T12:31:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38e1d92740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f38d81b02c0 con 0x55ae4d700310 2024-04-20T12:31:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38e1d92740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f38d81ad4f0 con 0x55ae4d6f7730 2024-04-20T12:31:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38e1d92740 10 client.0 _ll_register_callbacks cb 0x7f38d00126d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:54.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38dce5d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f6e10 0x55ae4d708470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38dce5d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f6e10 0x55ae4d708470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59340/0 (socket says 172.21.15.135:59340) 2024-04-20T12:31:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38dce5d640 1 -- 172.21.15.135:0/1018463270 learned_addr learned my addr 172.21.15.135:0/1018463270 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38dd65e640 1 --2- 172.21.15.135:0/1018463270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d700310 0x55ae4d6f9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38d7fff640 1 --2- 172.21.15.135:0/1018463270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f7730 0x55ae4d7089b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38dce5d640 1 -- 172.21.15.135:0/1018463270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f7730 msgr2=0x55ae4d7089b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38dce5d640 1 --2- 172.21.15.135:0/1018463270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f7730 0x55ae4d7089b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38dce5d640 1 -- 172.21.15.135:0/1018463270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d700310 msgr2=0x55ae4d6f9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38dce5d640 1 --2- 172.21.15.135:0/1018463270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d700310 0x55ae4d6f9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38dce5d640 1 -- 172.21.15.135:0/1018463270 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae4d6fa320 con 0x55ae4d6f6e10 2024-04-20T12:31:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38dd65e640 1 --2- 172.21.15.135:0/1018463270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d700310 0x55ae4d6f9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38d7fff640 1 --2- 172.21.15.135:0/1018463270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f7730 0x55ae4d7089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38dce5d640 1 --2- 172.21.15.135:0/1018463270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f6e10 0x55ae4d708470 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0efb10 tx=0x7f38cc0bdd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239715521995c782 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.773+0000 7f38b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:54.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.774+0000 7f38b7fff640 1 -- 172.21.15.135:0/1018463270 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc04b040 con 0x55ae4d6f6e10 2024-04-20T12:31:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.774+0000 7f38b7fff640 1 -- 172.21.15.135:0/1018463270 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f38cc0035f0 con 0x55ae4d6f6e10 2024-04-20T12:31:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.774+0000 7f38e1d92740 1 -- 172.21.15.135:0/1018463270 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38c4028070 con 0x55ae4d6f6e10 2024-04-20T12:31:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.774+0000 7f38b7fff640 1 -- 172.21.15.135:0/1018463270 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f38cc0c26b0 con 0x55ae4d6f6e10 2024-04-20T12:31:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.774+0000 7f38e1d92740 10 client.18321 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.774+0000 7f38e1d92740 1 -- 172.21.15.135:0/1018463270 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ae4d776510 con 0x55ae4d6f6e10 2024-04-20T12:31:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.774+0000 7f38b7fff640 1 -- 172.21.15.135:0/1018463270 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f38c4028070 con 0x55ae4d6f6e10 2024-04-20T12:31:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.774+0000 7f38b7fff640 1 -- 172.21.15.135:0/1018463270 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f38cc0efc20 con 0x55ae4d6f6e10 2024-04-20T12:31:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.774+0000 7f38e1d92740 10 client.18321 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.774+0000 7f38e1d92740 10 client.18321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.774+0000 7f38e1d92740 20 client.18321 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.774+0000 7f38e1d92740 1 --2- 172.21.15.135:0/1018463270 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ae4d776be0 0x55ae4d779000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.774+0000 7f38e1d92740 4 client.18321 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:31:54.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.774+0000 7f38e1d92740 1 -- 172.21.15.135:0/1018463270 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ae4d6639a0 con 0x55ae4d776be0 2024-04-20T12:31:54.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.774+0000 7f38d7fff640 1 --2- 172.21.15.135:0/1018463270 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ae4d776be0 0x55ae4d779000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:54.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38b7fff640 10 client.18321 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:54.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38d7fff640 1 --2- 172.21.15.135:0/1018463270 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ae4d776be0 0x55ae4d779000 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d48fc1f501e65e4 server_cookie=c83535d899f2b7ef in_seq=0 out_seq=0 2024-04-20T12:31:54.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38b7fff640 1 -- 172.21.15.135:0/1018463270 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ae4d6639a0 con 0x55ae4d776be0 2024-04-20T12:31:54.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38b7fff640 10 client.18321 handle_command_reply: tid=0 2024-04-20T12:31:54.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38e1d92740 1 client.18321 shutdown 2024-04-20T12:31:54.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38e1d92740 1 -- 172.21.15.135:0/1018463270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f6e10 msgr2=0x55ae4d708470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38e1d92740 1 --2- 172.21.15.135:0/1018463270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f6e10 0x55ae4d708470 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0efb10 tx=0x7f38cc0bdd20 comp rx=0 tx=0).stop 2024-04-20T12:31:54.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38e1d92740 1 -- 172.21.15.135:0/1018463270 shutdown_connections 2024-04-20T12:31:54.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38e1d92740 1 --2- 172.21.15.135:0/1018463270 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55ae4d776be0 0x55ae4d779000 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38e1d92740 1 --2- 172.21.15.135:0/1018463270 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ae4d700310 0x55ae4d6f9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38b7fff640 0 client.18321 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:54.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38e1d92740 1 --2- 172.21.15.135:0/1018463270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ae4d6f7730 0x55ae4d7089b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38e1d92740 1 --2- 172.21.15.135:0/1018463270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ae4d6f6e10 0x55ae4d708470 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38e1d92740 1 -- 172.21.15.135:0/1018463270 >> 172.21.15.135:0/1018463270 conn(0x55ae4d6f1540 msgr2=0x55ae4d6efe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38e1d92740 1 -- 172.21.15.135:0/1018463270 shutdown_connections 2024-04-20T12:31:54.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38e1d92740 1 -- 172.21.15.135:0/1018463270 wait complete. 2024-04-20T12:31:54.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.775+0000 7f38e1d92740 20 client.18321 trim_cache size 0 max 16384 2024-04-20T12:31:54.783 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:31:54.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.776+0000 7f38df0c1640 1 -- 172.21.15.135:0/187582926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38c80a3d20 msgr2=0x7f38c80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.776+0000 7f38df0c1640 1 --2- 172.21.15.135:0/187582926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38c80a3d20 0x7f38c80a61e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f38d00098b0 tx=0x7f38d0009d90 comp rx=0 tx=0).stop 2024-04-20T12:31:54.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.776+0000 7f38df0c1640 1 -- 172.21.15.135:0/187582926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d81021b0 msgr2=0x7f38d819e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:54.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.776+0000 7f38df0c1640 1 --2- 172.21.15.135:0/187582926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d81021b0 0x7f38d819e570 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f38cc006010 tx=0x7f38cc02cb30 comp rx=0 tx=0).stop 2024-04-20T12:31:54.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.776+0000 7f38df0c1640 1 -- 172.21.15.135:0/187582926 shutdown_connections 2024-04-20T12:31:54.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.776+0000 7f38df0c1640 1 --2- 172.21.15.135:0/187582926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f38d8198630 0x7f38d8198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.776+0000 7f38df0c1640 1 --2- 172.21.15.135:0/187582926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38c80a3d20 0x7f38c80a61e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.776+0000 7f38df0c1640 1 --2- 172.21.15.135:0/187582926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f38d8107280 0x7f38d819eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.776+0000 7f38df0c1640 1 --2- 172.21.15.135:0/187582926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38d81021b0 0x7f38d819e570 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:54.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.776+0000 7f38df0c1640 1 -- 172.21.15.135:0/187582926 >> 172.21.15.135:0/187582926 conn(0x7f38d80793f0 msgr2=0x7f38d80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:54.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.776+0000 7f38df0c1640 1 -- 172.21.15.135:0/187582926 shutdown_connections 2024-04-20T12:31:54.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:54.776+0000 7f38df0c1640 1 -- 172.21.15.135:0/187582926 wait complete. 2024-04-20T12:31:55.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:55 smithi139 ceph-mon[21834]: pgmap v270: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:31:55.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:55 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/264245271' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:31:55.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:55 smithi135 ceph-mon[18264]: pgmap v270: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:31:55.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:55 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/264245271' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:31:55.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:55 smithi154 ceph-mon[22073]: pgmap v270: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:31:55.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:55 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/264245271' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:31:55.787 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:31:55.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:31:55.788 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:31:55.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.902+0000 7f6f5bd4b640 1 -- 172.21.15.135:0/1726564449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f54102b50 msgr2=0x7f6f54106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:55.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.902+0000 7f6f5bd4b640 1 --2- 172.21.15.135:0/1726564449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f54102b50 0x7f6f54106b90 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009900 tx=0x7f6f4802bc30 comp rx=0 tx=0).stop 2024-04-20T12:31:55.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.902+0000 7f6f5bd4b640 1 -- 172.21.15.135:0/1726564449 shutdown_connections 2024-04-20T12:31:55.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.902+0000 7f6f5bd4b640 1 --2- 172.21.15.135:0/1726564449 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f54107270 0x7f6f5410ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.902+0000 7f6f5bd4b640 1 --2- 172.21.15.135:0/1726564449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f54102b50 0x7f6f54106b90 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.902+0000 7f6f5bd4b640 1 --2- 172.21.15.135:0/1726564449 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f541021a0 0x7f6f54102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.902+0000 7f6f5bd4b640 1 -- 172.21.15.135:0/1726564449 >> 172.21.15.135:0/1726564449 conn(0x7f6f540793b0 msgr2=0x7f6f540797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:55.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.902+0000 7f6f5bd4b640 1 -- 172.21.15.135:0/1726564449 shutdown_connections 2024-04-20T12:31:55.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.902+0000 7f6f5bd4b640 1 -- 172.21.15.135:0/1726564449 wait complete. 2024-04-20T12:31:55.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.903+0000 7f6f5bd4b640 1 Processor -- start 2024-04-20T12:31:55.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.903+0000 7f6f5bd4b640 1 -- start start 2024-04-20T12:31:55.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.903+0000 7f6f5bd4b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f541021a0 0x7f6f54074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.903+0000 7f6f5bd4b640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f54107270 0x7f6f540747a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.903+0000 7f6f5bd4b640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f54074ce0 0x7f6f541a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.903+0000 7f6f5bd4b640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f541122e0 con 0x7f6f541021a0 2024-04-20T12:31:55.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.903+0000 7f6f5bd4b640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6f54112160 con 0x7f6f54107270 2024-04-20T12:31:55.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.903+0000 7f6f5bd4b640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6f54112460 con 0x7f6f54074ce0 2024-04-20T12:31:55.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.903+0000 7f6f59ae7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f541021a0 0x7f6f54074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.903+0000 7f6f59ae7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f541021a0 0x7f6f54074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59370/0 (socket says 172.21.15.135:59370) 2024-04-20T12:31:55.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.903+0000 7f6f59ae7640 1 -- 172.21.15.135:0/3526725783 learned_addr learned my addr 172.21.15.135:0/3526725783 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:55.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.903+0000 7f6f592e6640 1 --2- 172.21.15.135:0/3526725783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f54107270 0x7f6f540747a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.903+0000 7f6f5a2e8640 1 --2- 172.21.15.135:0/3526725783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f54074ce0 0x7f6f541a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.904+0000 7f6f59ae7640 1 -- 172.21.15.135:0/3526725783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f54074ce0 msgr2=0x7f6f541a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:55.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.904+0000 7f6f59ae7640 1 --2- 172.21.15.135:0/3526725783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f54074ce0 0x7f6f541a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.904+0000 7f6f59ae7640 1 -- 172.21.15.135:0/3526725783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f54107270 msgr2=0x7f6f540747a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:55.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.904+0000 7f6f59ae7640 1 --2- 172.21.15.135:0/3526725783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f54107270 0x7f6f540747a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.904+0000 7f6f59ae7640 1 -- 172.21.15.135:0/3526725783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f541a7150 con 0x7f6f541021a0 2024-04-20T12:31:55.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.904+0000 7f6f59ae7640 1 --2- 172.21.15.135:0/3526725783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f541021a0 0x7f6f54074260 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00db80 tx=0x7f6f4c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:55.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.904+0000 7f6f52ffd640 1 -- 172.21.15.135:0/3526725783 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c017070 con 0x7f6f541021a0 2024-04-20T12:31:55.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.904+0000 7f6f52ffd640 1 -- 172.21.15.135:0/3526725783 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f4c003b70 con 0x7f6f541021a0 2024-04-20T12:31:55.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.904+0000 7f6f5bd4b640 1 -- 172.21.15.135:0/3526725783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f541a7440 con 0x7f6f541021a0 2024-04-20T12:31:55.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.904+0000 7f6f52ffd640 1 -- 172.21.15.135:0/3526725783 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0106c0 con 0x7f6f541021a0 2024-04-20T12:31:55.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.904+0000 7f6f5bd4b640 1 -- 172.21.15.135:0/3526725783 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f541a7960 con 0x7f6f541021a0 2024-04-20T12:31:55.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.907+0000 7f6f5ea11740 1 Processor -- start 2024-04-20T12:31:55.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.907+0000 7f6f52ffd640 1 -- 172.21.15.135:0/3526725783 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f6f4c004020 con 0x7f6f541021a0 2024-04-20T12:31:55.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.907+0000 7f6f5ea11740 1 -- start start 2024-04-20T12:31:55.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5ea11740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226a4fe0 0x5626226a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5ea11740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a5900 0x5626226adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5ea11740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226ae4e0 0x5626226b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5ea11740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562622609f00 con 0x5626226ae4e0 2024-04-20T12:31:55.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5ea11740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5626225a7530 con 0x5626226a4fe0 2024-04-20T12:31:55.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5ea11740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x562622605ec0 con 0x5626226a5900 2024-04-20T12:31:55.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5a2e8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226a4fe0 0x5626226a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.915 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f592e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226ae4e0 0x5626226b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5a2e8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226a4fe0 0x5626226a53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.139:3300/0 says I am v2:172.21.15.135:43178/0 (socket says 172.21.15.135:43178) 2024-04-20T12:31:55.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5a2e8640 1 -- 172.21.15.135:0/3554969234 learned_addr learned my addr 172.21.15.135:0/3554969234 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:55.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f52ffd640 1 --2- 172.21.15.135:0/3526725783 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6f3c0a3d50 0x7f6f3c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f59ae7640 1 --2- 172.21.15.135:0/3554969234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a5900 0x5626226adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5a2e8640 1 -- 172.21.15.135:0/3554969234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a5900 msgr2=0x5626226adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:55.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5a2e8640 1 --2- 172.21.15.135:0/3554969234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a5900 0x5626226adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5a2e8640 1 -- 172.21.15.135:0/3554969234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226ae4e0 msgr2=0x5626226b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:55.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5a2e8640 1 --2- 172.21.15.135:0/3554969234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226ae4e0 0x5626226b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5a2e8640 1 -- 172.21.15.135:0/3554969234 --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626223e47e0 con 0x5626226a4fe0 2024-04-20T12:31:55.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f592e6640 1 --2- 172.21.15.135:0/3554969234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226ae4e0 0x5626226b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:31:55.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5a2e8640 1 --2- 172.21.15.135:0/3526725783 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6f3c0a3d50 0x7f6f3c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f52ffd640 1 -- 172.21.15.135:0/3526725783 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f6f4c0d08c0 con 0x7f6f541021a0 2024-04-20T12:31:55.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.908+0000 7f6f5a2e8640 1 --2- 172.21.15.135:0/3554969234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226a4fe0 0x5626226a53c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400b780 tx=0x7f6f4400bc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=795543dfb4630374 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:55.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.909+0000 7f6f3bfff640 1 -- 172.21.15.135:0/3554969234 <== mon.2 v2:172.21.15.139:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44024070 con 0x5626226a4fe0 2024-04-20T12:31:55.916 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.909+0000 7f6f5a2e8640 1 --2- 172.21.15.135:0/3526725783 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6f3c0a3d50 0x7f6f3c0a6210 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6f44021000 tx=0x7f6f4401e000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:55.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.909+0000 7f6f3bfff640 1 -- 172.21.15.135:0/3554969234 <== mon.2 v2:172.21.15.139:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f4401e960 con 0x5626226a4fe0 2024-04-20T12:31:55.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.909+0000 7f6f3bfff640 1 -- 172.21.15.135:0/3554969234 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44011960 con 0x5626226a4fe0 2024-04-20T12:31:55.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.909+0000 7f6f5ea11740 1 -- 172.21.15.135:0/3554969234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226a4fe0 msgr2=0x5626226a53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:55.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.909+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/3554969234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226a4fe0 0x5626226a53c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400b780 tx=0x7f6f4400bc40 comp rx=0 tx=0).stop 2024-04-20T12:31:55.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.909+0000 7f6f5ea11740 1 -- 172.21.15.135:0/3554969234 shutdown_connections 2024-04-20T12:31:55.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.909+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/3554969234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226ae4e0 0x5626226b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.909+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/3554969234 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a5900 0x5626226adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.909+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/3554969234 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226a4fe0 0x5626226a53c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.909+0000 7f6f5ea11740 1 -- 172.21.15.135:0/3554969234 >> 172.21.15.135:0/3554969234 conn(0x56262269f710 msgr2=0x56262269faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:55.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.910+0000 7f6f5ea11740 1 -- 172.21.15.135:0/3554969234 shutdown_connections 2024-04-20T12:31:55.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.910+0000 7f6f5ea11740 1 -- 172.21.15.135:0/3554969234 wait complete. 2024-04-20T12:31:55.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.910+0000 7f6f5ea11740 1 -- start start 2024-04-20T12:31:55.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.910+0000 7f6f5ea11740 1 Processor -- start 2024-04-20T12:31:55.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.910+0000 7f6f5ea11740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226a4fe0 0x5626226adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.910+0000 7f6f5ea11740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a5900 0x5626226ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.910+0000 7f6f5ea11740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226ae4e0 0x5626226ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.910+0000 7f6f5ea11740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5626226b12d0 con 0x5626226a4fe0 2024-04-20T12:31:55.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.910+0000 7f6f5ea11740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x562622592480 con 0x5626226ae4e0 2024-04-20T12:31:55.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.910+0000 7f6f5ea11740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5626226b1450 con 0x5626226a5900 2024-04-20T12:31:55.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.910+0000 7f6f5ea11740 10 client.0 _ll_register_callbacks cb 0x562622591e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:55.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.910+0000 7f6f59ae7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226a4fe0 0x5626226adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f59ae7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226a4fe0 0x5626226adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59386/0 (socket says 172.21.15.135:59386) 2024-04-20T12:31:55.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f59ae7640 1 -- 172.21.15.135:0/918219310 learned_addr learned my addr 172.21.15.135:0/918219310 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:55.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f5a2e8640 1 --2- 172.21.15.135:0/918219310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226ae4e0 0x5626226ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f592e6640 1 --2- 172.21.15.135:0/918219310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a5900 0x5626226ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f59ae7640 1 -- 172.21.15.135:0/918219310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a5900 msgr2=0x5626226ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:55.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f59ae7640 1 --2- 172.21.15.135:0/918219310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a5900 0x5626226ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f59ae7640 1 -- 172.21.15.135:0/918219310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226ae4e0 msgr2=0x5626226ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:55.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f59ae7640 1 --2- 172.21.15.135:0/918219310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226ae4e0 0x5626226ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f59ae7640 1 -- 172.21.15.135:0/918219310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562622444f70 con 0x5626226a4fe0 2024-04-20T12:31:55.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f592e6640 1 --2- 172.21.15.135:0/918219310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a5900 0x5626226ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:55.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f59ae7640 1 --2- 172.21.15.135:0/918219310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226a4fe0 0x5626226adf20 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c09c190 tx=0x7f6f4c00de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547df51560d435fb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:55.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f397fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:55.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f397fa640 1 -- 172.21.15.135:0/918219310 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c09cb90 con 0x5626226a4fe0 2024-04-20T12:31:55.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f397fa640 1 -- 172.21.15.135:0/918219310 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f6f4c098b00 con 0x5626226a4fe0 2024-04-20T12:31:55.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f5ea11740 1 -- 172.21.15.135:0/918219310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f4401e960 con 0x5626226a4fe0 2024-04-20T12:31:55.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f397fa640 1 -- 172.21.15.135:0/918219310 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6f4c0a0840 con 0x5626226a4fe0 2024-04-20T12:31:55.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f5ea11740 10 client.18333 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:55.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f5ea11740 1 -- 172.21.15.135:0/918219310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5626222dc170 con 0x5626226a4fe0 2024-04-20T12:31:55.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.911+0000 7f6f397fa640 1 -- 172.21.15.135:0/918219310 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f4401e960 con 0x5626226a4fe0 2024-04-20T12:31:55.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.912+0000 7f6f397fa640 1 -- 172.21.15.135:0/918219310 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f6f4c09b8e0 con 0x5626226a4fe0 2024-04-20T12:31:55.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.912+0000 7f6f5ea11740 10 client.18333 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:55.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.912+0000 7f6f5ea11740 10 client.18333 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:55.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.912+0000 7f6f5ea11740 20 client.18333 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:55.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.912+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/918219310 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5626226be6a0 0x5626226c0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.912+0000 7f6f5ea11740 4 client.18333 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:55.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.912+0000 7f6f5ea11740 1 -- 172.21.15.135:0/918219310 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562622617920 con 0x5626226be6a0 2024-04-20T12:31:55.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.912+0000 7f6f592e6640 1 --2- 172.21.15.135:0/918219310 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5626226be6a0 0x5626226c0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.912+0000 7f6f397fa640 10 client.18333 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:55.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.912+0000 7f6f592e6640 1 --2- 172.21.15.135:0/918219310 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5626226be6a0 0x5626226c0ad0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8f74c2de37b5066 server_cookie=1de92d95f7bb4fb1 in_seq=0 out_seq=0 2024-04-20T12:31:55.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.913+0000 7f6f397fa640 1 -- 172.21.15.135:0/918219310 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562622617920 con 0x5626226be6a0 2024-04-20T12:31:55.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.913+0000 7f6f397fa640 10 client.18333 handle_command_reply: tid=0 2024-04-20T12:31:55.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.913+0000 7f6f5ea11740 1 client.18333 shutdown 2024-04-20T12:31:55.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.913+0000 7f6f5ea11740 1 -- 172.21.15.135:0/918219310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226a4fe0 msgr2=0x5626226adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:55.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.913+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/918219310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226a4fe0 0x5626226adf20 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c09c190 tx=0x7f6f4c00de80 comp rx=0 tx=0).stop 2024-04-20T12:31:55.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.913+0000 7f6f5ea11740 1 -- 172.21.15.135:0/918219310 shutdown_connections 2024-04-20T12:31:55.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.913+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/918219310 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5626226be6a0 0x5626226c0ad0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.913+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/918219310 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226ae4e0 0x5626226ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.913+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/918219310 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a5900 0x5626226ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.913+0000 7f6f397fa640 0 client.18333 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:55.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.913+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/918219310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226a4fe0 0x5626226adf20 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.913+0000 7f6f5ea11740 1 -- 172.21.15.135:0/918219310 >> 172.21.15.135:0/918219310 conn(0x56262269f710 msgr2=0x5626226a1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:55.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.913+0000 7f6f5ea11740 1 -- 172.21.15.135:0/918219310 shutdown_connections 2024-04-20T12:31:55.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.913+0000 7f6f5ea11740 1 -- 172.21.15.135:0/918219310 wait complete. 2024-04-20T12:31:55.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.913+0000 7f6f5ea11740 20 client.18333 trim_cache size 0 max 16384 2024-04-20T12:31:55.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5ea11740 1 Processor -- start 2024-04-20T12:31:55.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5ea11740 1 -- start start 2024-04-20T12:31:55.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5ea11740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226a4fe0 0x5626226c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5ea11740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a5900 0x5626226c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5ea11740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226ae4e0 0x56262269e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5ea11740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f541b16a0 con 0x5626226ae4e0 2024-04-20T12:31:55.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5ea11740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6f541b31e0 con 0x5626226a4fe0 2024-04-20T12:31:55.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5ea11740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6f541b1d70 con 0x5626226a5900 2024-04-20T12:31:55.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5a2e8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226ae4e0 0x56262269e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5a2e8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226ae4e0 0x56262269e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59394/0 (socket says 172.21.15.135:59394) 2024-04-20T12:31:55.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5a2e8640 1 -- 172.21.15.135:0/47669580 learned_addr learned my addr 172.21.15.135:0/47669580 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:55.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f59ae7640 1 --2- 172.21.15.135:0/47669580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226a4fe0 0x5626226c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5a2e8640 1 -- 172.21.15.135:0/47669580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a5900 msgr2=0x5626226c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:55.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5a2e8640 1 --2- 172.21.15.135:0/47669580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a5900 0x5626226c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5a2e8640 1 -- 172.21.15.135:0/47669580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226a4fe0 msgr2=0x5626226c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:55.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5a2e8640 1 --2- 172.21.15.135:0/47669580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226a4fe0 0x5626226c63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5a2e8640 1 -- 172.21.15.135:0/47669580 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626226b0c40 con 0x5626226ae4e0 2024-04-20T12:31:55.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f59ae7640 1 --2- 172.21.15.135:0/47669580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226a4fe0 0x5626226c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:31:55.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f5a2e8640 1 --2- 172.21.15.135:0/47669580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226ae4e0 0x56262269e3d0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f6f440114b0 tx=0x7f6f44011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96dd9c570314eea server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:55.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.931+0000 7f6f3b7fe640 1 -- 172.21.15.135:0/47669580 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44024040 con 0x5626226ae4e0 2024-04-20T12:31:55.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.932+0000 7f6f3b7fe640 1 -- 172.21.15.135:0/47669580 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f44005530 con 0x5626226ae4e0 2024-04-20T12:31:55.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.932+0000 7f6f3b7fe640 1 -- 172.21.15.135:0/47669580 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f440048a0 con 0x5626226ae4e0 2024-04-20T12:31:55.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.932+0000 7f6f5ea11740 1 -- 172.21.15.135:0/47669580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226ae4e0 msgr2=0x56262269e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:55.972 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.932+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/47669580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226ae4e0 0x56262269e3d0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f6f440114b0 tx=0x7f6f44011440 comp rx=0 tx=0).stop 2024-04-20T12:31:55.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.932+0000 7f6f5ea11740 1 -- 172.21.15.135:0/47669580 shutdown_connections 2024-04-20T12:31:55.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.932+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/47669580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226ae4e0 0x56262269e3d0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.932+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/47669580 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a5900 0x5626226c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.932+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/47669580 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226a4fe0 0x5626226c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.932+0000 7f6f5ea11740 1 -- 172.21.15.135:0/47669580 >> 172.21.15.135:0/47669580 conn(0x56262269f710 msgr2=0x56262269dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:55.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.932+0000 7f6f5ea11740 1 -- 172.21.15.135:0/47669580 shutdown_connections 2024-04-20T12:31:55.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.932+0000 7f6f5ea11740 1 -- 172.21.15.135:0/47669580 wait complete. 2024-04-20T12:31:55.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.932+0000 7f6f5ea11740 1 -- start start 2024-04-20T12:31:55.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f5ea11740 1 Processor -- start 2024-04-20T12:31:55.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f5ea11740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a4fe0 0x5626226b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f5ea11740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226a5900 0x5626226b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f5ea11740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226ae4e0 0x5626226b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f5ea11740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f541b2b10 con 0x5626226a5900 2024-04-20T12:31:55.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f5ea11740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f6f541b2440 con 0x5626226ae4e0 2024-04-20T12:31:55.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f5ea11740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f6f541af670 con 0x5626226a4fe0 2024-04-20T12:31:55.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f5ea11740 10 client.0 _ll_register_callbacks cb 0x7f6f4c0980d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:55.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f592e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226a5900 0x5626226b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f592e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226a5900 0x5626226b6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59400/0 (socket says 172.21.15.135:59400) 2024-04-20T12:31:55.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f592e6640 1 -- 172.21.15.135:0/3862783409 learned_addr learned my addr 172.21.15.135:0/3862783409 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:55.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f5a2e8640 1 --2- 172.21.15.135:0/3862783409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226ae4e0 0x5626226b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f59ae7640 1 --2- 172.21.15.135:0/3862783409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a4fe0 0x5626226b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f592e6640 1 -- 172.21.15.135:0/3862783409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a4fe0 msgr2=0x5626226b6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:55.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f592e6640 1 --2- 172.21.15.135:0/3862783409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a4fe0 0x5626226b6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f592e6640 1 -- 172.21.15.135:0/3862783409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226ae4e0 msgr2=0x5626226b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:55.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f592e6640 1 --2- 172.21.15.135:0/3862783409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226ae4e0 0x5626226b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.933+0000 7f6f592e6640 1 -- 172.21.15.135:0/3862783409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626226b33e0 con 0x5626226a5900 2024-04-20T12:31:55.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f592e6640 1 --2- 172.21.15.135:0/3862783409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226a5900 0x5626226b6ba0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f6f4802cfd0 tx=0x7f6f4802cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764ef5ad1a8c4c9b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:55.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f397fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:55.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f397fa640 1 -- 172.21.15.135:0/3862783409 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48046bc0 con 0x5626226a5900 2024-04-20T12:31:55.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f397fa640 1 -- 172.21.15.135:0/3862783409 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f6f48046d60 con 0x5626226a5900 2024-04-20T12:31:55.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f5ea11740 1 -- 172.21.15.135:0/3862783409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f44005530 con 0x5626226a5900 2024-04-20T12:31:55.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f397fa640 1 -- 172.21.15.135:0/3862783409 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6f48054050 con 0x5626226a5900 2024-04-20T12:31:55.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f5ea11740 10 client.18339 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:55.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f5ea11740 1 -- 172.21.15.135:0/3862783409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5626227258a0 con 0x5626226a5900 2024-04-20T12:31:55.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f397fa640 1 -- 172.21.15.135:0/3862783409 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f44005530 con 0x5626226a5900 2024-04-20T12:31:55.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f397fa640 1 -- 172.21.15.135:0/3862783409 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f6f480046c0 con 0x5626226a5900 2024-04-20T12:31:55.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f5ea11740 10 client.18339 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:55.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f5ea11740 10 client.18339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:55.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f5ea11740 20 client.18339 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:55.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/3862783409 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5626227260a0 0x5626227284c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:55.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f5ea11740 4 client.18339 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:31:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f5ea11740 1 -- 172.21.15.135:0/3862783409 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562622611790 con 0x5626227260a0 2024-04-20T12:31:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.934+0000 7f6f59ae7640 1 --2- 172.21.15.135:0/3862783409 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5626227260a0 0x5626227284c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.935+0000 7f6f59ae7640 1 --2- 172.21.15.135:0/3862783409 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5626227260a0 0x5626227284c0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ef8516d0572f393 server_cookie=22781085e729bdbe in_seq=0 out_seq=0 2024-04-20T12:31:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.935+0000 7f6f397fa640 10 client.18339 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.936+0000 7f6f397fa640 1 -- 172.21.15.135:0/3862783409 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562622611790 con 0x5626227260a0 2024-04-20T12:31:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.936+0000 7f6f397fa640 10 client.18339 handle_command_reply: tid=0 2024-04-20T12:31:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.936+0000 7f6f5ea11740 1 client.18339 shutdown 2024-04-20T12:31:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.936+0000 7f6f5ea11740 1 -- 172.21.15.135:0/3862783409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226a5900 msgr2=0x5626226b6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.936+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/3862783409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226a5900 0x5626226b6ba0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f6f4802cfd0 tx=0x7f6f4802cb10 comp rx=0 tx=0).stop 2024-04-20T12:31:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.936+0000 7f6f5ea11740 1 -- 172.21.15.135:0/3862783409 shutdown_connections 2024-04-20T12:31:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.936+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/3862783409 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5626227260a0 0x5626227284c0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.936+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/3862783409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5626226ae4e0 0x5626226b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.936+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/3862783409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5626226a5900 0x5626226b6ba0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.936+0000 7f6f397fa640 0 client.18339 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:55.976 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.936+0000 7f6f5ea11740 1 --2- 172.21.15.135:0/3862783409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5626226a4fe0 0x5626226b6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.936+0000 7f6f5ea11740 1 -- 172.21.15.135:0/3862783409 >> 172.21.15.135:0/3862783409 conn(0x56262269f710 msgr2=0x56262269dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:55.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.936+0000 7f6f5ea11740 1 -- 172.21.15.135:0/3862783409 shutdown_connections 2024-04-20T12:31:55.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.936+0000 7f6f5ea11740 1 -- 172.21.15.135:0/3862783409 wait complete. 2024-04-20T12:31:55.977 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.936+0000 7f6f5ea11740 20 client.18339 trim_cache size 0 max 16384 2024-04-20T12:31:55.977 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:31:55.977 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:31:55.977 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "28c2fd2d-0a30-4df2-a2a0-c0c90f01e27f", 2024-04-20T12:31:55.977 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:31:55.978 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:31:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.937+0000 7f6f5bd4b640 1 -- 172.21.15.135:0/3526725783 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6f3c0a3d50 msgr2=0x7f6f3c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.937+0000 7f6f5bd4b640 1 --2- 172.21.15.135:0/3526725783 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6f3c0a3d50 0x7f6f3c0a6210 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6f44021000 tx=0x7f6f4401e000 comp rx=0 tx=0).stop 2024-04-20T12:31:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.937+0000 7f6f5bd4b640 1 -- 172.21.15.135:0/3526725783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f541021a0 msgr2=0x7f6f54074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.937+0000 7f6f5bd4b640 1 --2- 172.21.15.135:0/3526725783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f541021a0 0x7f6f54074260 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00db80 tx=0x7f6f4c00b630 comp rx=0 tx=0).stop 2024-04-20T12:31:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.937+0000 7f6f5bd4b640 1 -- 172.21.15.135:0/3526725783 shutdown_connections 2024-04-20T12:31:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.937+0000 7f6f5bd4b640 1 --2- 172.21.15.135:0/3526725783 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f6f3c0a3d50 0x7f6f3c0a6210 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.937+0000 7f6f5bd4b640 1 --2- 172.21.15.135:0/3526725783 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f54074ce0 0x7f6f541a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.937+0000 7f6f5bd4b640 1 --2- 172.21.15.135:0/3526725783 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f6f54107270 0x7f6f540747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.937+0000 7f6f5bd4b640 1 --2- 172.21.15.135:0/3526725783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f541021a0 0x7f6f54074260 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:55.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.937+0000 7f6f5bd4b640 1 -- 172.21.15.135:0/3526725783 >> 172.21.15.135:0/3526725783 conn(0x7f6f540793b0 msgr2=0x7f6f540ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:55.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.937+0000 7f6f5bd4b640 1 -- 172.21.15.135:0/3526725783 shutdown_connections 2024-04-20T12:31:55.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:55.937+0000 7f6f5bd4b640 1 -- 172.21.15.135:0/3526725783 wait complete. 2024-04-20T12:31:55.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:31:55.980 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:31:56.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.081+0000 7f455affd640 1 -- 172.21.15.135:0/1437872010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45541072f0 msgr2=0x7f455410eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:56.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.081+0000 7f455affd640 1 --2- 172.21.15.135:0/1437872010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45541072f0 0x7f455410eec0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f454c009ca0 tx=0x7f454c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.081+0000 7f455affd640 1 -- 172.21.15.135:0/1437872010 shutdown_connections 2024-04-20T12:31:56.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.081+0000 7f455affd640 1 --2- 172.21.15.135:0/1437872010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45541072f0 0x7f455410eec0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.081+0000 7f455affd640 1 --2- 172.21.15.135:0/1437872010 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4554102bd0 0x7f4554106c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.081+0000 7f455affd640 1 --2- 172.21.15.135:0/1437872010 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4554102220 0x7f4554102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.081+0000 7f455affd640 1 -- 172.21.15.135:0/1437872010 >> 172.21.15.135:0/1437872010 conn(0x7f45540fdac0 msgr2=0x7f45540ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:56.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.082+0000 7f455affd640 1 -- 172.21.15.135:0/1437872010 shutdown_connections 2024-04-20T12:31:56.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.082+0000 7f455affd640 1 -- 172.21.15.135:0/1437872010 wait complete. 2024-04-20T12:31:56.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.082+0000 7f455affd640 1 Processor -- start 2024-04-20T12:31:56.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.082+0000 7f455affd640 1 -- start start 2024-04-20T12:31:56.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.082+0000 7f455affd640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4554102220 0x7f455419e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.082+0000 7f455affd640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45541072f0 0x7f455419e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.082+0000 7f455affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4554198610 0x7f4554198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.082+0000 7f455affd640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4554112390 con 0x7f4554198610 2024-04-20T12:31:56.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.082+0000 7f455affd640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4554112210 con 0x7f45541072f0 2024-04-20T12:31:56.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.082+0000 7f455affd640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4554112510 con 0x7f4554102220 2024-04-20T12:31:56.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.082+0000 7f455959a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4554198610 0x7f4554198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.082+0000 7f455959a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4554198610 0x7f4554198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59410/0 (socket says 172.21.15.135:59410) 2024-04-20T12:31:56.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.082+0000 7f455959a640 1 -- 172.21.15.135:0/1745465110 learned_addr learned my addr 172.21.15.135:0/1745465110 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:56.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.083+0000 7f4558d99640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4554102220 0x7f455419e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.083+0000 7f4553fff640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45541072f0 0x7f455419e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.083+0000 7f455959a640 1 -- 172.21.15.135:0/1745465110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4554102220 msgr2=0x7f455419e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:56.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.083+0000 7f455959a640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4554102220 0x7f455419e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.083+0000 7f455959a640 1 -- 172.21.15.135:0/1745465110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45541072f0 msgr2=0x7f455419e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:56.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.083+0000 7f455959a640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45541072f0 0x7f455419e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.083+0000 7f455959a640 1 -- 172.21.15.135:0/1745465110 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4554199130 con 0x7f4554198610 2024-04-20T12:31:56.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.083+0000 7f4558d99640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4554102220 0x7f455419e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:56.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.083+0000 7f4553fff640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45541072f0 0x7f455419e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:56.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.083+0000 7f455959a640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4554198610 0x7f4554198ac0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f454c02c700 tx=0x7f454c032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:56.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.083+0000 7f4551ffb640 1 -- 172.21.15.135:0/1745465110 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c041020 con 0x7f4554198610 2024-04-20T12:31:56.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.083+0000 7f4551ffb640 1 -- 172.21.15.135:0/1745465110 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f454c034cd0 con 0x7f4554198610 2024-04-20T12:31:56.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.083+0000 7f455affd640 1 -- 172.21.15.135:0/1745465110 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45541993c0 con 0x7f4554198610 2024-04-20T12:31:56.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.083+0000 7f4551ffb640 1 -- 172.21.15.135:0/1745465110 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c039040 con 0x7f4554198610 2024-04-20T12:31:56.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.083+0000 7f455affd640 1 -- 172.21.15.135:0/1745465110 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45541a55b0 con 0x7f4554198610 2024-04-20T12:31:56.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.085+0000 7f4551ffb640 1 -- 172.21.15.135:0/1745465110 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f454c044020 con 0x7f4554198610 2024-04-20T12:31:56.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f455dbdf740 1 Processor -- start 2024-04-20T12:31:56.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f455dbdf740 1 -- start start 2024-04-20T12:31:56.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f455dbdf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b66d20 0x55a112b67100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f455dbdf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b67640 0x55a112b6fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f455dbdf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b70220 0x55a112b72610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f455dbdf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a112acc1b0 con 0x55a112b70220 2024-04-20T12:31:56.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f455dbdf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a112a69390 con 0x55a112b67640 2024-04-20T12:31:56.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f455dbdf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a112ac8170 con 0x55a112b66d20 2024-04-20T12:31:56.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f4553fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b70220 0x55a112b72610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f4553fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b70220 0x55a112b72610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59414/0 (socket says 172.21.15.135:59414) 2024-04-20T12:31:56.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f4553fff640 1 -- 172.21.15.135:0/3435736620 learned_addr learned my addr 172.21.15.135:0/3435736620 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:56.093 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f4551ffb640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f453c0a3d20 0x7f453c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f4553fff640 1 --2- 172.21.15.135:0/3435736620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b66d20 0x55a112b67100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f455959a640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f453c0a3d20 0x7f453c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f4558d99640 1 --2- 172.21.15.135:0/3435736620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b67640 0x55a112b6fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f4553fff640 1 -- 172.21.15.135:0/3435736620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b66d20 msgr2=0x55a112b67100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:56.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f4553fff640 1 --2- 172.21.15.135:0/3435736620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b66d20 0x55a112b67100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f4553fff640 1 -- 172.21.15.135:0/3435736620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b67640 msgr2=0x55a112b6fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:56.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f4553fff640 1 --2- 172.21.15.135:0/3435736620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b67640 0x55a112b6fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f4553fff640 1 -- 172.21.15.135:0/3435736620 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1128a87d0 con 0x55a112b70220 2024-04-20T12:31:56.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f4551ffb640 1 -- 172.21.15.135:0/1745465110 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f454c0f29c0 con 0x7f4554198610 2024-04-20T12:31:56.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.086+0000 7f4553fff640 1 --2- 172.21.15.135:0/3435736620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b70220 0x55a112b72610 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f454800f390 tx=0x7f454800b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2eed278cebf34a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:56.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.087+0000 7f453affd640 1 -- 172.21.15.135:0/3435736620 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548005220 con 0x55a112b70220 2024-04-20T12:31:56.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.087+0000 7f455959a640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f453c0a3d20 0x7f453c0a61e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f454c0be3a0 tx=0x7f454c0b0040 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:56.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.087+0000 7f453affd640 1 -- 172.21.15.135:0/3435736620 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4548004c80 con 0x55a112b70220 2024-04-20T12:31:56.094 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.087+0000 7f453affd640 1 -- 172.21.15.135:0/3435736620 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548012a80 con 0x55a112b70220 2024-04-20T12:31:56.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.087+0000 7f455dbdf740 1 -- 172.21.15.135:0/3435736620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b70220 msgr2=0x55a112b72610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:56.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.087+0000 7f455dbdf740 1 --2- 172.21.15.135:0/3435736620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b70220 0x55a112b72610 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f454800f390 tx=0x7f454800b500 comp rx=0 tx=0).stop 2024-04-20T12:31:56.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.087+0000 7f455dbdf740 1 -- 172.21.15.135:0/3435736620 shutdown_connections 2024-04-20T12:31:56.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.087+0000 7f455dbdf740 1 --2- 172.21.15.135:0/3435736620 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b70220 0x55a112b72610 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.087+0000 7f455dbdf740 1 --2- 172.21.15.135:0/3435736620 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b67640 0x55a112b6fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.087+0000 7f455dbdf740 1 --2- 172.21.15.135:0/3435736620 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b66d20 0x55a112b67100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.087+0000 7f455dbdf740 1 -- 172.21.15.135:0/3435736620 >> 172.21.15.135:0/3435736620 conn(0x55a112b61450 msgr2=0x55a112b61830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:56.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.087+0000 7f455dbdf740 1 -- 172.21.15.135:0/3435736620 shutdown_connections 2024-04-20T12:31:56.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.087+0000 7f455dbdf740 1 -- 172.21.15.135:0/3435736620 wait complete. 2024-04-20T12:31:56.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f455dbdf740 1 -- start start 2024-04-20T12:31:56.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f455dbdf740 1 Processor -- start 2024-04-20T12:31:56.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f455dbdf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b6d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f455dbdf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b67640 0x55a112b6d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f455dbdf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b70220 0x55a112b6dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f455dbdf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a112b73010 con 0x55a112b66d20 2024-04-20T12:31:56.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f455dbdf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55a112a852f0 con 0x55a112b70220 2024-04-20T12:31:56.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f455dbdf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55a112b73190 con 0x55a112b67640 2024-04-20T12:31:56.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f455dbdf740 10 client.0 _ll_register_callbacks cb 0x55a112a4f4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:56.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f4553fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b6d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f4553fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b6d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59430/0 (socket says 172.21.15.135:59430) 2024-04-20T12:31:56.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f4553fff640 1 -- 172.21.15.135:0/3623947091 learned_addr learned my addr 172.21.15.135:0/3623947091 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:56.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f4553fff640 1 --2- 172.21.15.135:0/3623947091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b70220 0x55a112b6dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f4558d99640 1 --2- 172.21.15.135:0/3623947091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b67640 0x55a112b6d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f4553fff640 1 -- 172.21.15.135:0/3623947091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b67640 msgr2=0x55a112b6d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:56.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f4553fff640 1 --2- 172.21.15.135:0/3623947091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b67640 0x55a112b6d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f4553fff640 1 -- 172.21.15.135:0/3623947091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b70220 msgr2=0x55a112b6dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:56.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f4553fff640 1 --2- 172.21.15.135:0/3623947091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b70220 0x55a112b6dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f4553fff640 1 -- 172.21.15.135:0/3623947091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1127de3f0 con 0x55a112b66d20 2024-04-20T12:31:56.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.088+0000 7f4558d99640 1 --2- 172.21.15.135:0/3623947091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b67640 0x55a112b6d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:31:56.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f4553fff640 1 --2- 172.21.15.135:0/3623947091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b6d2e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f4548010010 tx=0x7f4548005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6a6df7990d2238 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:56.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f4533fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:56.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f4533fff640 1 -- 172.21.15.135:0/3623947091 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548016070 con 0x55a112b66d20 2024-04-20T12:31:56.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f4533fff640 1 -- 172.21.15.135:0/3623947091 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f45480046c0 con 0x55a112b66d20 2024-04-20T12:31:56.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f455dbdf740 1 -- 172.21.15.135:0/3623947091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4548004c80 con 0x55a112b66d20 2024-04-20T12:31:56.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f4533fff640 1 -- 172.21.15.135:0/3623947091 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4548031050 con 0x55a112b66d20 2024-04-20T12:31:56.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f455dbdf740 10 client.18351 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:56.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f455dbdf740 1 -- 172.21.15.135:0/3623947091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a11279e0f0 con 0x55a112b66d20 2024-04-20T12:31:56.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f4533fff640 1 -- 172.21.15.135:0/3623947091 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4548004c80 con 0x55a112b66d20 2024-04-20T12:31:56.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f4533fff640 1 -- 172.21.15.135:0/3623947091 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f454801d570 con 0x55a112b66d20 2024-04-20T12:31:56.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f455dbdf740 10 client.18351 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:56.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f455dbdf740 10 client.18351 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:56.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f455dbdf740 20 client.18351 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:56.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f455dbdf740 1 --2- 172.21.15.135:0/3623947091 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a112b805d0 0x55a112b829c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f455dbdf740 4 client.18351 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:31:56.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.089+0000 7f455dbdf740 1 -- 172.21.15.135:0/3623947091 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a112ad9bd0 con 0x55a112b805d0 2024-04-20T12:31:56.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.090+0000 7f4558d99640 1 --2- 172.21.15.135:0/3623947091 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a112b805d0 0x55a112b829c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.090+0000 7f4558d99640 1 --2- 172.21.15.135:0/3623947091 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a112b805d0 0x55a112b829c0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=723f608cf4bbcd31 server_cookie=bd1162950c7bced8 in_seq=0 out_seq=0 2024-04-20T12:31:56.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.090+0000 7f4533fff640 10 client.18351 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:56.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.091+0000 7f4533fff640 1 -- 172.21.15.135:0/3623947091 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a112ad9bd0 con 0x55a112b805d0 2024-04-20T12:31:56.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.091+0000 7f4533fff640 10 client.18351 handle_command_reply: tid=0 2024-04-20T12:31:56.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.091+0000 7f455dbdf740 1 client.18351 shutdown 2024-04-20T12:31:56.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.091+0000 7f455dbdf740 1 -- 172.21.15.135:0/3623947091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 msgr2=0x55a112b6d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:56.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.091+0000 7f455dbdf740 1 --2- 172.21.15.135:0/3623947091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b6d2e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f4548010010 tx=0x7f4548005c50 comp rx=0 tx=0).stop 2024-04-20T12:31:56.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.091+0000 7f455dbdf740 1 -- 172.21.15.135:0/3623947091 shutdown_connections 2024-04-20T12:31:56.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.091+0000 7f455dbdf740 1 --2- 172.21.15.135:0/3623947091 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a112b805d0 0x55a112b829c0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.091+0000 7f455dbdf740 1 --2- 172.21.15.135:0/3623947091 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b70220 0x55a112b6dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.091+0000 7f455dbdf740 1 --2- 172.21.15.135:0/3623947091 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b67640 0x55a112b6d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.091+0000 7f4533fff640 0 client.18351 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:56.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.091+0000 7f455dbdf740 1 --2- 172.21.15.135:0/3623947091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b6d2e0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.091+0000 7f455dbdf740 1 -- 172.21.15.135:0/3623947091 >> 172.21.15.135:0/3623947091 conn(0x55a112b61450 msgr2=0x55a112b631a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:56.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.091+0000 7f455dbdf740 1 -- 172.21.15.135:0/3623947091 shutdown_connections 2024-04-20T12:31:56.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.091+0000 7f455dbdf740 1 -- 172.21.15.135:0/3623947091 wait complete. 2024-04-20T12:31:56.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.091+0000 7f455dbdf740 20 client.18351 trim_cache size 0 max 16384 2024-04-20T12:31:56.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.108+0000 7f455dbdf740 1 Processor -- start 2024-04-20T12:31:56.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.108+0000 7f455dbdf740 1 -- start start 2024-04-20T12:31:56.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.108+0000 7f455dbdf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b7bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.108+0000 7f455dbdf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b67640 0x55a112b6db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.108+0000 7f455dbdf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b70220 0x55a112b88170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.108+0000 7f455dbdf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f45541af460 con 0x55a112b66d20 2024-04-20T12:31:56.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.108+0000 7f455dbdf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f45541b0fa0 con 0x55a112b70220 2024-04-20T12:31:56.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.108+0000 7f455dbdf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45541afb30 con 0x55a112b67640 2024-04-20T12:31:56.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.109+0000 7f4553fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b7bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.109+0000 7f4553fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b7bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59444/0 (socket says 172.21.15.135:59444) 2024-04-20T12:31:56.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.109+0000 7f4553fff640 1 -- 172.21.15.135:0/2149952954 learned_addr learned my addr 172.21.15.135:0/2149952954 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:56.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.109+0000 7f4558d99640 1 --2- 172.21.15.135:0/2149952954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b67640 0x55a112b6db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.109+0000 7f4553fff640 1 -- 172.21.15.135:0/2149952954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b67640 msgr2=0x55a112b6db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:56.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.109+0000 7f4553fff640 1 --2- 172.21.15.135:0/2149952954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b67640 0x55a112b6db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.109+0000 7f4553fff640 1 -- 172.21.15.135:0/2149952954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b70220 msgr2=0x55a112b88170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:56.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.109+0000 7f4553fff640 1 --2- 172.21.15.135:0/2149952954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b70220 0x55a112b88170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.109+0000 7f4553fff640 1 -- 172.21.15.135:0/2149952954 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a112b67470 con 0x55a112b66d20 2024-04-20T12:31:56.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.109+0000 7f4553fff640 1 --2- 172.21.15.135:0/2149952954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b7bed0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f454800fe60 tx=0x7f454800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90e5b5bb6e9fc24 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:56.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.109+0000 7f453a7fc640 1 -- 172.21.15.135:0/2149952954 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454803c070 con 0x55a112b66d20 2024-04-20T12:31:56.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.109+0000 7f453a7fc640 1 -- 172.21.15.135:0/2149952954 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4548005da0 con 0x55a112b66d20 2024-04-20T12:31:56.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.109+0000 7f453a7fc640 1 -- 172.21.15.135:0/2149952954 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548016040 con 0x55a112b66d20 2024-04-20T12:31:56.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.110+0000 7f455dbdf740 1 -- 172.21.15.135:0/2149952954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 msgr2=0x55a112b7bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:56.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.110+0000 7f455dbdf740 1 --2- 172.21.15.135:0/2149952954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b7bed0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f454800fe60 tx=0x7f454800bb10 comp rx=0 tx=0).stop 2024-04-20T12:31:56.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.110+0000 7f455dbdf740 1 -- 172.21.15.135:0/2149952954 shutdown_connections 2024-04-20T12:31:56.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.110+0000 7f455dbdf740 1 --2- 172.21.15.135:0/2149952954 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b70220 0x55a112b88170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.110+0000 7f455dbdf740 1 --2- 172.21.15.135:0/2149952954 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b67640 0x55a112b6db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.110+0000 7f455dbdf740 1 --2- 172.21.15.135:0/2149952954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b7bed0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.110+0000 7f455dbdf740 1 -- 172.21.15.135:0/2149952954 >> 172.21.15.135:0/2149952954 conn(0x55a112b61450 msgr2=0x55a112b60630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:56.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.110+0000 7f455dbdf740 1 -- 172.21.15.135:0/2149952954 shutdown_connections 2024-04-20T12:31:56.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.110+0000 7f455dbdf740 1 -- 172.21.15.135:0/2149952954 wait complete. 2024-04-20T12:31:56.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.110+0000 7f455dbdf740 1 -- start start 2024-04-20T12:31:56.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.110+0000 7f455dbdf740 1 Processor -- start 2024-04-20T12:31:56.117 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f455dbdf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b75fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f455dbdf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b67640 0x55a112b76510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f455dbdf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b70220 0x55a112b76a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f455dbdf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f45541b08d0 con 0x55a112b66d20 2024-04-20T12:31:56.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f455dbdf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f45541b0200 con 0x55a112b67640 2024-04-20T12:31:56.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f455dbdf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f45541ad430 con 0x55a112b70220 2024-04-20T12:31:56.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f455dbdf740 10 client.0 _ll_register_callbacks cb 0x7f454800bee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:31:56.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f4553fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b75fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f4553fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b75fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:59452/0 (socket says 172.21.15.135:59452) 2024-04-20T12:31:56.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f4553fff640 1 -- 172.21.15.135:0/4150782974 learned_addr learned my addr 172.21.15.135:0/4150782974 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:31:56.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f4558d99640 1 --2- 172.21.15.135:0/4150782974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b67640 0x55a112b76510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f4553fff640 1 -- 172.21.15.135:0/4150782974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b70220 msgr2=0x55a112b76a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:56.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f4553fff640 1 --2- 172.21.15.135:0/4150782974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b70220 0x55a112b76a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.118 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f4553fff640 1 -- 172.21.15.135:0/4150782974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b67640 msgr2=0x55a112b76510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:31:56.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f4553fff640 1 --2- 172.21.15.135:0/4150782974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b67640 0x55a112b76510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f4553fff640 1 -- 172.21.15.135:0/4150782974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a112be5bf0 con 0x55a112b66d20 2024-04-20T12:31:56.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f4553fff640 1 --2- 172.21.15.135:0/4150782974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b75fd0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f454801da80 tx=0x7f454801d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db8fb5a20190c56 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:31:56.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f4533fff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:31:56.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f4533fff640 1 -- 172.21.15.135:0/4150782974 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454803c040 con 0x55a112b66d20 2024-04-20T12:31:56.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f4533fff640 1 -- 172.21.15.135:0/4150782974 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 9504+0+0 (secure 0 0 0) 0x7f4548005410 con 0x55a112b66d20 2024-04-20T12:31:56.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f455dbdf740 1 -- 172.21.15.135:0/4150782974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4548005da0 con 0x55a112b66d20 2024-04-20T12:31:56.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f4533fff640 1 -- 172.21.15.135:0/4150782974 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4548048050 con 0x55a112b66d20 2024-04-20T12:31:56.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f455dbdf740 10 client.18357 fetch_fsmap learned FSMap version 29 2024-04-20T12:31:56.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f455dbdf740 1 -- 172.21.15.135:0/4150782974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a112be6ea0 con 0x55a112b66d20 2024-04-20T12:31:56.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.111+0000 7f4533fff640 1 -- 172.21.15.135:0/4150782974 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4548005da0 con 0x55a112b66d20 2024-04-20T12:31:56.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.112+0000 7f4533fff640 1 -- 172.21.15.135:0/4150782974 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f454803f070 con 0x55a112b66d20 2024-04-20T12:31:56.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.112+0000 7f455dbdf740 10 client.18357 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:31:56.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.112+0000 7f455dbdf740 10 client.18357 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:31:56.119 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.112+0000 7f455dbdf740 20 client.18357 populate_metadata read hostname 'smithi135' 2024-04-20T12:31:56.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.112+0000 7f455dbdf740 1 --2- 172.21.15.135:0/4150782974 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a112be74f0 0x55a112be98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:31:56.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.112+0000 7f455dbdf740 4 client.18357 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:31:56.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.112+0000 7f455dbdf740 1 -- 172.21.15.135:0/4150782974 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a112ad3a40 con 0x55a112be74f0 2024-04-20T12:31:56.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.112+0000 7f4558d99640 1 --2- 172.21.15.135:0/4150782974 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a112be74f0 0x55a112be98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:31:56.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.112+0000 7f4533fff640 10 client.18357 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:56.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.112+0000 7f4558d99640 1 --2- 172.21.15.135:0/4150782974 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a112be74f0 0x55a112be98e0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9813cec018bcfd0 server_cookie=c928e3c21261fe4 in_seq=0 out_seq=0 2024-04-20T12:31:56.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.112+0000 7f4533fff640 1 -- 172.21.15.135:0/4150782974 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a112ad3a40 con 0x55a112be74f0 2024-04-20T12:31:56.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.112+0000 7f4533fff640 10 client.18357 handle_command_reply: tid=0 2024-04-20T12:31:56.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.112+0000 7f455dbdf740 1 client.18357 shutdown 2024-04-20T12:31:56.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455dbdf740 1 -- 172.21.15.135:0/4150782974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 msgr2=0x55a112b75fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:56.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455dbdf740 1 --2- 172.21.15.135:0/4150782974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b75fd0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f454801da80 tx=0x7f454801d7c0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455dbdf740 1 -- 172.21.15.135:0/4150782974 shutdown_connections 2024-04-20T12:31:56.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455dbdf740 1 --2- 172.21.15.135:0/4150782974 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55a112be74f0 0x55a112be98e0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455dbdf740 1 --2- 172.21.15.135:0/4150782974 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55a112b70220 0x55a112b76a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.120 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f4533fff640 0 client.18357 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:31:56.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455dbdf740 1 --2- 172.21.15.135:0/4150782974 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55a112b67640 0x55a112b76510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455dbdf740 1 --2- 172.21.15.135:0/4150782974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a112b66d20 0x55a112b75fd0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455dbdf740 1 -- 172.21.15.135:0/4150782974 >> 172.21.15.135:0/4150782974 conn(0x55a112b61450 msgr2=0x55a112b5fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:56.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455dbdf740 1 -- 172.21.15.135:0/4150782974 shutdown_connections 2024-04-20T12:31:56.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455dbdf740 1 -- 172.21.15.135:0/4150782974 wait complete. 2024-04-20T12:31:56.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455dbdf740 20 client.18357 trim_cache size 0 max 16384 2024-04-20T12:31:56.121 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:31:56.121 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:31:56.121 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:31:56.121 INFO:teuthology.orchestra.run.smithi135.stdout: "28c2fd2d-0a30-4df2-a2a0-c0c90f01e27f": { 2024-04-20T12:31:56.122 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:31:56.122 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "28c2fd2d-0a30-4df2-a2a0-c0c90f01e27f", 2024-04-20T12:31:56.122 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:31:56.122 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:31:56.122 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:31:56.122 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:31:56.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455affd640 1 -- 172.21.15.135:0/1745465110 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f453c0a3d20 msgr2=0x7f453c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:56.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455affd640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f453c0a3d20 0x7f453c0a61e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f454c0be3a0 tx=0x7f454c0b0040 comp rx=0 tx=0).stop 2024-04-20T12:31:56.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455affd640 1 -- 172.21.15.135:0/1745465110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4554198610 msgr2=0x7f4554198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:31:56.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455affd640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4554198610 0x7f4554198ac0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f454c02c700 tx=0x7f454c032f20 comp rx=0 tx=0).stop 2024-04-20T12:31:56.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455affd640 1 -- 172.21.15.135:0/1745465110 shutdown_connections 2024-04-20T12:31:56.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455affd640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4554198610 0x7f4554198ac0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455affd640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f45541072f0 0x7f455419e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455affd640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f453c0a3d20 0x7f453c0a61e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455affd640 1 --2- 172.21.15.135:0/1745465110 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4554102220 0x7f455419e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:31:56.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.113+0000 7f455affd640 1 -- 172.21.15.135:0/1745465110 >> 172.21.15.135:0/1745465110 conn(0x7f45540fdac0 msgr2=0x7f45540fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:31:56.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.114+0000 7f455affd640 1 -- 172.21.15.135:0/1745465110 shutdown_connections 2024-04-20T12:31:56.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:31:56.114+0000 7f455affd640 1 -- 172.21.15.135:0/1745465110 wait complete. 2024-04-20T12:31:56.124 INFO:tasks.cephfs.filesystem:scrub status for tag:28c2fd2d-0a30-4df2-a2a0-c0c90f01e27f - {'path': '/', 'tag': '28c2fd2d-0a30-4df2-a2a0-c0c90f01e27f', 'options': 'recursive,force'} 2024-04-20T12:31:57.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:57 smithi139 ceph-mon[21834]: pgmap v271: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:57.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:57 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:31:57.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:57 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:31:57.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:57 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:31:57.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:57 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:31:57.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:57 smithi135 ceph-mon[18264]: pgmap v271: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:57.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:57 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:31:57.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:57 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:31:57.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:57 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:31:57.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:57 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:31:57.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:57 smithi154 ceph-mon[22073]: pgmap v271: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:57.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:57 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:31:57.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:57 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:31:57.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:57 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:31:57.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:57 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:31:58.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:58 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:31:58.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:58 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:31:58.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:58 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:31:59.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:31:59 smithi139 ceph-mon[21834]: pgmap v272: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:59.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:31:59 smithi135 ceph-mon[18264]: pgmap v272: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:31:59.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:31:59 smithi154 ceph-mon[22073]: pgmap v272: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:01.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:01 smithi139 ceph-mon[21834]: pgmap v273: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:32:01.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:01 smithi135 ceph-mon[18264]: pgmap v273: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:32:01.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:01 smithi154 ceph-mon[22073]: pgmap v273: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:32:03.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:03 smithi139 ceph-mon[21834]: pgmap v274: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:32:03.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:03 smithi135 ceph-mon[18264]: pgmap v274: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:32:03.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:03 smithi154 ceph-mon[22073]: pgmap v274: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:32:05.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:05 smithi139 ceph-mon[21834]: pgmap v275: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-20T12:32:05.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:05 smithi135 ceph-mon[18264]: pgmap v275: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-20T12:32:05.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:05 smithi154 ceph-mon[22073]: pgmap v275: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-20T12:32:07.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:07 smithi139 ceph-mon[21834]: pgmap v276: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-20T12:32:07.366 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:07 smithi135 ceph-mon[18264]: pgmap v276: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-20T12:32:07.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:07 smithi154 ceph-mon[22073]: pgmap v276: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-20T12:32:09.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:09 smithi139 ceph-mon[21834]: pgmap v277: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-20T12:32:09.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:09 smithi139 ceph-mon[21834]: osdmap e100: 12 total, 12 up, 12 in 2024-04-20T12:32:09.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:09 smithi135 ceph-mon[18264]: pgmap v277: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-20T12:32:09.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:09 smithi135 ceph-mon[18264]: osdmap e100: 12 total, 12 up, 12 in 2024-04-20T12:32:09.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:09 smithi154 ceph-mon[22073]: pgmap v277: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-20T12:32:09.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:09 smithi154 ceph-mon[22073]: osdmap e100: 12 total, 12 up, 12 in 2024-04-20T12:32:11.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:11 smithi139 ceph-mon[21834]: pgmap v279: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:32:11.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:11 smithi135 ceph-mon[18264]: pgmap v279: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:32:11.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:11 smithi154 ceph-mon[22073]: pgmap v279: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:32:13.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:13 smithi139 ceph-mon[21834]: pgmap v280: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:32:13.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:13 smithi135 ceph-mon[18264]: pgmap v280: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:32:13.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:13 smithi154 ceph-mon[22073]: pgmap v280: 129 pgs: 129 active+clean; 12 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 30 op/s 2024-04-20T12:32:15.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:15 smithi139 ceph-mon[21834]: pgmap v281: 129 pgs: 129 active+clean; 12 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:32:15.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:15 smithi135 ceph-mon[18264]: pgmap v281: 129 pgs: 129 active+clean; 12 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:32:15.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:15 smithi154 ceph-mon[22073]: pgmap v281: 129 pgs: 129 active+clean; 12 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:32:17.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:17 smithi139 ceph-mon[21834]: pgmap v282: 129 pgs: 129 active+clean; 12 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:32:17.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:17 smithi135 ceph-mon[18264]: pgmap v282: 129 pgs: 129 active+clean; 12 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:32:17.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:17 smithi154 ceph-mon[22073]: pgmap v282: 129 pgs: 129 active+clean; 12 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:32:19.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:19 smithi139 ceph-mon[21834]: pgmap v283: 129 pgs: 129 active+clean; 12 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:32:19.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:19 smithi139 ceph-mon[21834]: osdmap e101: 12 total, 12 up, 12 in 2024-04-20T12:32:19.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:19 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:32:19.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:19 smithi135 ceph-mon[18264]: pgmap v283: 129 pgs: 129 active+clean; 12 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:32:19.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:19 smithi135 ceph-mon[18264]: osdmap e101: 12 total, 12 up, 12 in 2024-04-20T12:32:19.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:19 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:32:19.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:19 smithi154 ceph-mon[22073]: pgmap v283: 129 pgs: 129 active+clean; 12 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:32:19.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:19 smithi154 ceph-mon[22073]: osdmap e101: 12 total, 12 up, 12 in 2024-04-20T12:32:19.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:19 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:32:20.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:20 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:32:20.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:20 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:32:20.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:20 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:32:20.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:20 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:32:20.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:20 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:32:20.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:20 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:32:20.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:20 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:32:20.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:20 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:32:20.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:20 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:32:21.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:21 smithi139 ceph-mon[21834]: pgmap v285: 129 pgs: 129 active+clean; 12 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:32:21.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:21 smithi135 ceph-mon[18264]: pgmap v285: 129 pgs: 129 active+clean; 12 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:32:21.402 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:21 smithi154 ceph-mon[22073]: pgmap v285: 129 pgs: 129 active+clean; 12 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:32:23.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:23 smithi139 ceph-mon[21834]: pgmap v286: 129 pgs: 129 active+clean; 12 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:32:23.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:23 smithi135 ceph-mon[18264]: pgmap v286: 129 pgs: 129 active+clean; 12 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:32:23.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:23 smithi154 ceph-mon[22073]: pgmap v286: 129 pgs: 129 active+clean; 12 MiB data, 484 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-04-20T12:32:25.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:25 smithi135 ceph-mon[18264]: pgmap v287: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-20T12:32:25.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:25 smithi154 ceph-mon[22073]: pgmap v287: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-20T12:32:25.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:25 smithi139 ceph-mon[21834]: pgmap v287: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-20T12:32:26.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:32:26.126 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:32:26.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.239+0000 7f2af47ce640 1 -- 172.21.15.135:0/1304067701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2aec103b00 msgr2=0x7f2aec10bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.239+0000 7f2af47ce640 1 --2- 172.21.15.135:0/1304067701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2aec103b00 0x7f2aec10bfe0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f2adc009900 tx=0x7f2adc02bd60 comp rx=0 tx=0).stop 2024-04-20T12:32:26.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.239+0000 7f2af47ce640 1 -- 172.21.15.135:0/1304067701 shutdown_connections 2024-04-20T12:32:26.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.239+0000 7f2af47ce640 1 --2- 172.21.15.135:0/1304067701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec10c520 0x7f2aec10e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.239+0000 7f2af47ce640 1 --2- 172.21.15.135:0/1304067701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2aec103b00 0x7f2aec10bfe0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.239+0000 7f2af47ce640 1 --2- 172.21.15.135:0/1304067701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2aec1031e0 0x7f2aec1035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.239+0000 7f2af47ce640 1 -- 172.21.15.135:0/1304067701 >> 172.21.15.135:0/1304067701 conn(0x7f2aec077f60 msgr2=0x7f2aec078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.239+0000 7f2af47ce640 1 -- 172.21.15.135:0/1304067701 shutdown_connections 2024-04-20T12:32:26.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.239+0000 7f2af47ce640 1 -- 172.21.15.135:0/1304067701 wait complete. 2024-04-20T12:32:26.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.240+0000 7f2af47ce640 1 Processor -- start 2024-04-20T12:32:26.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.240+0000 7f2af47ce640 1 -- start start 2024-04-20T12:32:26.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.240+0000 7f2af47ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2aec1031e0 0x7f2aec1a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.240+0000 7f2af47ce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2aec103b00 0x7f2aec1a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.240+0000 7f2af47ce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec10c520 0x7f2aec19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.240+0000 7f2af47ce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec112350 con 0x7f2aec1031e0 2024-04-20T12:32:26.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.240+0000 7f2af47ce640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1121d0 con 0x7f2aec103b00 2024-04-20T12:32:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.240+0000 7f2af47ce640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1124d0 con 0x7f2aec10c520 2024-04-20T12:32:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.240+0000 7f2af256a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2aec1031e0 0x7f2aec1a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.240+0000 7f2af256a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2aec1031e0 0x7f2aec1a0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37648/0 (socket says 172.21.15.135:37648) 2024-04-20T12:32:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.240+0000 7f2af256a640 1 -- 172.21.15.135:0/1717486005 learned_addr learned my addr 172.21.15.135:0/1717486005 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.240+0000 7f2af1d69640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2aec103b00 0x7f2aec1a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.240+0000 7f2af2d6b640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec10c520 0x7f2aec19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.240+0000 7f2af256a640 1 -- 172.21.15.135:0/1717486005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec10c520 msgr2=0x7f2aec19a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.240+0000 7f2af256a640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec10c520 0x7f2aec19a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.241+0000 7f2af256a640 1 -- 172.21.15.135:0/1717486005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2aec103b00 msgr2=0x7f2aec1a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.241+0000 7f2af256a640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2aec103b00 0x7f2aec1a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.241+0000 7f2af256a640 1 -- 172.21.15.135:0/1717486005 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec19b0a0 con 0x7f2aec1031e0 2024-04-20T12:32:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.241+0000 7f2af2d6b640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec10c520 0x7f2aec19a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:26.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.241+0000 7f2af1d69640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2aec103b00 0x7f2aec1a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:26.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.241+0000 7f2af256a640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2aec1031e0 0x7f2aec1a0720 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800d950 tx=0x7f2ae800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.241+0000 7f2ae37fe640 1 -- 172.21.15.135:0/1717486005 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae8017070 con 0x7f2aec1031e0 2024-04-20T12:32:26.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.241+0000 7f2af47ce640 1 -- 172.21.15.135:0/1717486005 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aec19b390 con 0x7f2aec1031e0 2024-04-20T12:32:26.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.241+0000 7f2ae37fe640 1 -- 172.21.15.135:0/1717486005 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ae8009c30 con 0x7f2aec1031e0 2024-04-20T12:32:26.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.241+0000 7f2ae37fe640 1 -- 172.21.15.135:0/1717486005 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae800f6b0 con 0x7f2aec1031e0 2024-04-20T12:32:26.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.241+0000 7f2af47ce640 1 -- 172.21.15.135:0/1717486005 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aec1a75e0 con 0x7f2aec1031e0 2024-04-20T12:32:26.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.243+0000 7f2ae37fe640 1 -- 172.21.15.135:0/1717486005 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f2ae80109d0 con 0x7f2aec1031e0 2024-04-20T12:32:26.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.243+0000 7f2af73bf740 1 Processor -- start 2024-04-20T12:32:26.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af73bf740 1 -- start start 2024-04-20T12:32:26.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af73bf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b35d20 0x55eb90b36100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2ae37fe640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2ad80a3d20 0x7f2ad80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af73bf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b36640 0x55eb90b3ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af73bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b3f220 0x55eb90b41610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af73bf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55eb90a9b1b0 con 0x55eb90b35d20 2024-04-20T12:32:26.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af73bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55eb90a38390 con 0x55eb90b3f220 2024-04-20T12:32:26.251 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af73bf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55eb90a97170 con 0x55eb90b36640 2024-04-20T12:32:26.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af2d6b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b35d20 0x55eb90b36100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af256a640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2ad80a3d20 0x7f2ad80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af2d6b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b35d20 0x55eb90b36100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37650/0 (socket says 172.21.15.135:37650) 2024-04-20T12:32:26.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af2d6b640 1 -- 172.21.15.135:0/232528587 learned_addr learned my addr 172.21.15.135:0/232528587 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2ae37fe640 1 -- 172.21.15.135:0/1717486005 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f2ae80d08d0 con 0x7f2aec1031e0 2024-04-20T12:32:26.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af1d69640 1 --2- 172.21.15.135:0/232528587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b36640 0x55eb90b3ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af2d6b640 1 -- 172.21.15.135:0/232528587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b36640 msgr2=0x55eb90b3ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af2d6b640 1 --2- 172.21.15.135:0/232528587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b36640 0x55eb90b3ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af2d6b640 1 -- 172.21.15.135:0/232528587 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b3f220 msgr2=0x55eb90b41610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af2d6b640 1 --2- 172.21.15.135:0/232528587 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b3f220 0x55eb90b41610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af2d6b640 1 -- 172.21.15.135:0/232528587 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb908777d0 con 0x55eb90b35d20 2024-04-20T12:32:26.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.244+0000 7f2af256a640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2ad80a3d20 0x7f2ad80a61e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2ae809c1a0 tx=0x7f2ae8000bc0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.245+0000 7f2af2d6b640 1 --2- 172.21.15.135:0/232528587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b35d20 0x55eb90b36100 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4008e10 tx=0x7f2ae400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b5bc0d53c49dca server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.252 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.245+0000 7f2ae0ff9640 1 -- 172.21.15.135:0/232528587 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4015070 con 0x55eb90b35d20 2024-04-20T12:32:26.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.245+0000 7f2ae0ff9640 1 -- 172.21.15.135:0/232528587 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ae4011d60 con 0x55eb90b35d20 2024-04-20T12:32:26.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.245+0000 7f2ae0ff9640 1 -- 172.21.15.135:0/232528587 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4010cb0 con 0x55eb90b35d20 2024-04-20T12:32:26.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.245+0000 7f2af73bf740 1 -- 172.21.15.135:0/232528587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b35d20 msgr2=0x55eb90b36100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.245+0000 7f2af73bf740 1 --2- 172.21.15.135:0/232528587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b35d20 0x55eb90b36100 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4008e10 tx=0x7f2ae400f730 comp rx=0 tx=0).stop 2024-04-20T12:32:26.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.245+0000 7f2af73bf740 1 -- 172.21.15.135:0/232528587 shutdown_connections 2024-04-20T12:32:26.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.245+0000 7f2af73bf740 1 --2- 172.21.15.135:0/232528587 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b3f220 0x55eb90b41610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.245+0000 7f2af73bf740 1 --2- 172.21.15.135:0/232528587 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b36640 0x55eb90b3ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.245+0000 7f2af73bf740 1 --2- 172.21.15.135:0/232528587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b35d20 0x55eb90b36100 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.245+0000 7f2af73bf740 1 -- 172.21.15.135:0/232528587 >> 172.21.15.135:0/232528587 conn(0x55eb90b30450 msgr2=0x55eb90b30830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.246+0000 7f2af73bf740 1 -- 172.21.15.135:0/232528587 shutdown_connections 2024-04-20T12:32:26.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.246+0000 7f2af73bf740 1 -- 172.21.15.135:0/232528587 wait complete. 2024-04-20T12:32:26.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.246+0000 7f2af73bf740 1 -- start start 2024-04-20T12:32:26.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.246+0000 7f2af73bf740 1 Processor -- start 2024-04-20T12:32:26.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.246+0000 7f2af73bf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b35d20 0x55eb90b3c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.253 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.246+0000 7f2af73bf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b36640 0x55eb90b3c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.246+0000 7f2af73bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b3f220 0x55eb90b3cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.246+0000 7f2af73bf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55eb90b42010 con 0x55eb90b35d20 2024-04-20T12:32:26.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.246+0000 7f2af73bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55eb90a542f0 con 0x55eb90b3f220 2024-04-20T12:32:26.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.246+0000 7f2af73bf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55eb90b42190 con 0x55eb90b36640 2024-04-20T12:32:26.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.246+0000 7f2af73bf740 10 client.0 _ll_register_callbacks cb 0x55eb90a1e4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:26.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.246+0000 7f2af2d6b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b35d20 0x55eb90b3c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.246+0000 7f2af2d6b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b35d20 0x55eb90b3c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37660/0 (socket says 172.21.15.135:37660) 2024-04-20T12:32:26.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.246+0000 7f2af2d6b640 1 -- 172.21.15.135:0/834254824 learned_addr learned my addr 172.21.15.135:0/834254824 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.246+0000 7f2af1d69640 1 --2- 172.21.15.135:0/834254824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b36640 0x55eb90b3c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2af2d6b640 1 -- 172.21.15.135:0/834254824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b36640 msgr2=0x55eb90b3c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2af2d6b640 1 --2- 172.21.15.135:0/834254824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b36640 0x55eb90b3c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2af2d6b640 1 -- 172.21.15.135:0/834254824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b3f220 msgr2=0x55eb90b3cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2af2d6b640 1 --2- 172.21.15.135:0/834254824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b3f220 0x55eb90b3cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2af2d6b640 1 -- 172.21.15.135:0/834254824 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb907ad3f0 con 0x55eb90b35d20 2024-04-20T12:32:26.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2af2d6b640 1 --2- 172.21.15.135:0/834254824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b35d20 0x55eb90b3c2d0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4005c30 tx=0x7f2ae4008ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2932b078dccd4f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2ad5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:26.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2ad5ffb640 1 -- 172.21.15.135:0/834254824 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4015050 con 0x55eb90b35d20 2024-04-20T12:32:26.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2ad5ffb640 1 -- 172.21.15.135:0/834254824 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f2ae4011880 con 0x55eb90b35d20 2024-04-20T12:32:26.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2af73bf740 1 -- 172.21.15.135:0/834254824 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ae4011d60 con 0x55eb90b35d20 2024-04-20T12:32:26.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2ad5ffb640 1 -- 172.21.15.135:0/834254824 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ae4010e90 con 0x55eb90b35d20 2024-04-20T12:32:26.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2af73bf740 10 client.18369 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:26.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2af73bf740 1 -- 172.21.15.135:0/834254824 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55eb9076d0f0 con 0x55eb90b35d20 2024-04-20T12:32:26.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2ad5ffb640 1 -- 172.21.15.135:0/834254824 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ae4011d60 con 0x55eb90b35d20 2024-04-20T12:32:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2ad5ffb640 1 -- 172.21.15.135:0/834254824 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2ae40254a0 con 0x55eb90b35d20 2024-04-20T12:32:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2af73bf740 10 client.18369 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2af73bf740 10 client.18369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:32:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2af73bf740 20 client.18369 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2af73bf740 1 --2- 172.21.15.135:0/834254824 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55eb90b4f5d0 0x55eb90b519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2af73bf740 4 client.18369 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:32:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.247+0000 7f2af73bf740 1 -- 172.21.15.135:0/834254824 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb90aa8bd0 con 0x55eb90b4f5d0 2024-04-20T12:32:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.248+0000 7f2af1d69640 1 --2- 172.21.15.135:0/834254824 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55eb90b4f5d0 0x55eb90b519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.248+0000 7f2af1d69640 1 --2- 172.21.15.135:0/834254824 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55eb90b4f5d0 0x55eb90b519c0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ee3cdbf2023f033 server_cookie=59537c758ad37cb0 in_seq=0 out_seq=0 2024-04-20T12:32:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.248+0000 7f2ad5ffb640 10 client.18369 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.249+0000 7f2ad5ffb640 1 -- 172.21.15.135:0/834254824 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55eb90aa8bd0 con 0x55eb90b4f5d0 2024-04-20T12:32:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.249+0000 7f2ad5ffb640 10 client.18369 handle_command_reply: tid=0 2024-04-20T12:32:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.249+0000 7f2af73bf740 1 client.18369 shutdown 2024-04-20T12:32:26.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.249+0000 7f2af73bf740 1 -- 172.21.15.135:0/834254824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b35d20 msgr2=0x55eb90b3c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.249+0000 7f2af73bf740 1 --2- 172.21.15.135:0/834254824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b35d20 0x55eb90b3c2d0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4005c30 tx=0x7f2ae4008ae0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.249+0000 7f2af73bf740 1 -- 172.21.15.135:0/834254824 shutdown_connections 2024-04-20T12:32:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.249+0000 7f2af73bf740 1 --2- 172.21.15.135:0/834254824 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55eb90b4f5d0 0x55eb90b519c0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.249+0000 7f2af73bf740 1 --2- 172.21.15.135:0/834254824 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b3f220 0x55eb90b3cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.249+0000 7f2af73bf740 1 --2- 172.21.15.135:0/834254824 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b36640 0x55eb90b3c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.249+0000 7f2ad5ffb640 0 client.18369 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.249+0000 7f2af73bf740 1 --2- 172.21.15.135:0/834254824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b35d20 0x55eb90b3c2d0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.249+0000 7f2af73bf740 1 -- 172.21.15.135:0/834254824 >> 172.21.15.135:0/834254824 conn(0x55eb90b30450 msgr2=0x55eb90b321a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.249+0000 7f2af73bf740 1 -- 172.21.15.135:0/834254824 shutdown_connections 2024-04-20T12:32:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.249+0000 7f2af73bf740 1 -- 172.21.15.135:0/834254824 wait complete. 2024-04-20T12:32:26.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.249+0000 7f2af73bf740 20 client.18369 trim_cache size 0 max 16384 2024-04-20T12:32:26.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.266+0000 7f2af73bf740 1 Processor -- start 2024-04-20T12:32:26.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.266+0000 7f2af73bf740 1 -- start start 2024-04-20T12:32:26.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af73bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b35d20 0x55eb90b4aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af73bf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b36640 0x55eb90b2f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af73bf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b3f220 0x55eb90b3cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af73bf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1b17f0 con 0x55eb90b3f220 2024-04-20T12:32:26.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af73bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1b3330 con 0x55eb90b35d20 2024-04-20T12:32:26.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af73bf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1b1ec0 con 0x55eb90b36640 2024-04-20T12:32:26.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af2d6b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b3f220 0x55eb90b3cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af2d6b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b3f220 0x55eb90b3cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37672/0 (socket says 172.21.15.135:37672) 2024-04-20T12:32:26.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af2d6b640 1 -- 172.21.15.135:0/3800234739 learned_addr learned my addr 172.21.15.135:0/3800234739 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af2d6b640 1 --2- 172.21.15.135:0/3800234739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b35d20 0x55eb90b4aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af2d6b640 1 -- 172.21.15.135:0/3800234739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b36640 msgr2=0x55eb90b2f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af2d6b640 1 --2- 172.21.15.135:0/3800234739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b36640 0x55eb90b2f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af2d6b640 1 -- 172.21.15.135:0/3800234739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b35d20 msgr2=0x55eb90b4aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af2d6b640 1 --2- 172.21.15.135:0/3800234739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b35d20 0x55eb90b4aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af2d6b640 1 -- 172.21.15.135:0/3800234739 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb90b37e90 con 0x55eb90b3f220 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2af2d6b640 1 --2- 172.21.15.135:0/3800234739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b3f220 0x55eb90b3cb70 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40258f0 tx=0x7f2ae40109e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d91e33c138c513 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2ad7fff640 1 -- 172.21.15.135:0/3800234739 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4015050 con 0x55eb90b3f220 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2ad7fff640 1 -- 172.21.15.135:0/3800234739 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ae4021070 con 0x55eb90b3f220 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.267+0000 7f2ad7fff640 1 -- 172.21.15.135:0/3800234739 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4025670 con 0x55eb90b3f220 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.268+0000 7f2af73bf740 1 -- 172.21.15.135:0/3800234739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b3f220 msgr2=0x55eb90b3cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.268+0000 7f2af73bf740 1 --2- 172.21.15.135:0/3800234739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b3f220 0x55eb90b3cb70 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40258f0 tx=0x7f2ae40109e0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.268+0000 7f2af73bf740 1 -- 172.21.15.135:0/3800234739 shutdown_connections 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.268+0000 7f2af73bf740 1 --2- 172.21.15.135:0/3800234739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b3f220 0x55eb90b3cb70 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.268+0000 7f2af73bf740 1 --2- 172.21.15.135:0/3800234739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b36640 0x55eb90b2f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.268+0000 7f2af73bf740 1 --2- 172.21.15.135:0/3800234739 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b35d20 0x55eb90b4aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.268+0000 7f2af73bf740 1 -- 172.21.15.135:0/3800234739 >> 172.21.15.135:0/3800234739 conn(0x55eb90b30450 msgr2=0x55eb90b3b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.268+0000 7f2af73bf740 1 -- 172.21.15.135:0/3800234739 shutdown_connections 2024-04-20T12:32:26.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.268+0000 7f2af73bf740 1 -- 172.21.15.135:0/3800234739 wait complete. 2024-04-20T12:32:26.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.268+0000 7f2af73bf740 1 -- start start 2024-04-20T12:32:26.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.268+0000 7f2af73bf740 1 Processor -- start 2024-04-20T12:32:26.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.268+0000 7f2af73bf740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b35d20 0x55eb90b47420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.268+0000 7f2af73bf740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b36640 0x55eb90b47960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.268+0000 7f2af73bf740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b3f220 0x55eb90b44bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af73bf740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1b2c60 con 0x55eb90b3f220 2024-04-20T12:32:26.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af73bf740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1b2590 con 0x55eb90b36640 2024-04-20T12:32:26.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af73bf740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec1af7c0 con 0x55eb90b35d20 2024-04-20T12:32:26.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af73bf740 10 client.0 _ll_register_callbacks cb 0x7f2ae4008ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:26.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af2d6b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b3f220 0x55eb90b44bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af2d6b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b3f220 0x55eb90b44bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37680/0 (socket says 172.21.15.135:37680) 2024-04-20T12:32:26.273 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af2d6b640 1 -- 172.21.15.135:0/96149657 learned_addr learned my addr 172.21.15.135:0/96149657 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af1d69640 1 --2- 172.21.15.135:0/96149657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b36640 0x55eb90b47960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af2d6b640 1 -- 172.21.15.135:0/96149657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b35d20 msgr2=0x55eb90b47420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af2d6b640 1 --2- 172.21.15.135:0/96149657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b35d20 0x55eb90b47420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af2d6b640 1 -- 172.21.15.135:0/96149657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b36640 msgr2=0x55eb90b47960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af2d6b640 1 --2- 172.21.15.135:0/96149657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b36640 0x55eb90b47960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af2d6b640 1 -- 172.21.15.135:0/96149657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb90b453b0 con 0x55eb90b3f220 2024-04-20T12:32:26.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af2d6b640 1 --2- 172.21.15.135:0/96149657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b3f220 0x55eb90b44bb0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4002210 tx=0x7f2ae400fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b27b57c8b612a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2ad5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:26.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2ad5ffb640 1 -- 172.21.15.135:0/96149657 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4045060 con 0x55eb90b3f220 2024-04-20T12:32:26.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2ad5ffb640 1 -- 172.21.15.135:0/96149657 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f2ae4025410 con 0x55eb90b3f220 2024-04-20T12:32:26.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af73bf740 1 -- 172.21.15.135:0/96149657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ae4021070 con 0x55eb90b3f220 2024-04-20T12:32:26.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2ad5ffb640 1 -- 172.21.15.135:0/96149657 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ae4015040 con 0x55eb90b3f220 2024-04-20T12:32:26.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af73bf740 10 client.18375 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:26.274 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.269+0000 7f2af73bf740 1 -- 172.21.15.135:0/96149657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55eb90bb5680 con 0x55eb90b3f220 2024-04-20T12:32:26.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.270+0000 7f2ad5ffb640 1 -- 172.21.15.135:0/96149657 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ae4021070 con 0x55eb90b3f220 2024-04-20T12:32:26.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.270+0000 7f2ad5ffb640 1 -- 172.21.15.135:0/96149657 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2ae4032070 con 0x55eb90b3f220 2024-04-20T12:32:26.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.270+0000 7f2af73bf740 10 client.18375 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:26.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.270+0000 7f2af73bf740 10 client.18375 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:32:26.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.270+0000 7f2af73bf740 20 client.18375 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:26.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.270+0000 7f2af73bf740 1 --2- 172.21.15.135:0/96149657 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55eb90bb5c90 0x55eb90bb80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.270+0000 7f2af73bf740 4 client.18375 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:32:26.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.270+0000 7f2af73bf740 1 -- 172.21.15.135:0/96149657 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55eb90aa2a40 con 0x55eb90bb5c90 2024-04-20T12:32:26.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.270+0000 7f2af1d69640 1 --2- 172.21.15.135:0/96149657 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55eb90bb5c90 0x55eb90bb80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.270+0000 7f2ad5ffb640 10 client.18375 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:26.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.270+0000 7f2af1d69640 1 --2- 172.21.15.135:0/96149657 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55eb90bb5c90 0x55eb90bb80b0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c673e4bf2b913843 server_cookie=5c50169e2abb0a9b in_seq=0 out_seq=0 2024-04-20T12:32:26.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2ad5ffb640 1 -- 172.21.15.135:0/96149657 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55eb90aa2a40 con 0x55eb90bb5c90 2024-04-20T12:32:26.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2ad5ffb640 10 client.18375 handle_command_reply: tid=0 2024-04-20T12:32:26.275 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af73bf740 1 client.18375 shutdown 2024-04-20T12:32:26.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af73bf740 1 -- 172.21.15.135:0/96149657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b3f220 msgr2=0x55eb90b44bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af73bf740 1 --2- 172.21.15.135:0/96149657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b3f220 0x55eb90b44bb0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4002210 tx=0x7f2ae400fc30 comp rx=0 tx=0).stop 2024-04-20T12:32:26.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af73bf740 1 -- 172.21.15.135:0/96149657 shutdown_connections 2024-04-20T12:32:26.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af73bf740 1 --2- 172.21.15.135:0/96149657 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55eb90bb5c90 0x55eb90bb80b0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af73bf740 1 --2- 172.21.15.135:0/96149657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb90b3f220 0x55eb90b44bb0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af73bf740 1 --2- 172.21.15.135:0/96149657 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55eb90b36640 0x55eb90b47960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af73bf740 1 --2- 172.21.15.135:0/96149657 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55eb90b35d20 0x55eb90b47420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2ad5ffb640 0 client.18375 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:26.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af73bf740 1 -- 172.21.15.135:0/96149657 >> 172.21.15.135:0/96149657 conn(0x55eb90b30450 msgr2=0x55eb90b320a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af73bf740 1 -- 172.21.15.135:0/96149657 shutdown_connections 2024-04-20T12:32:26.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af73bf740 1 -- 172.21.15.135:0/96149657 wait complete. 2024-04-20T12:32:26.276 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af73bf740 20 client.18375 trim_cache size 0 max 16384 2024-04-20T12:32:26.277 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:32:26.277 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:32:26.277 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:32:26.277 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:32:26.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af47ce640 1 -- 172.21.15.135:0/1717486005 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2ad80a3d20 msgr2=0x7f2ad80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af47ce640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2ad80a3d20 0x7f2ad80a61e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2ae809c1a0 tx=0x7f2ae8000bc0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af47ce640 1 -- 172.21.15.135:0/1717486005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2aec1031e0 msgr2=0x7f2aec1a0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af47ce640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2aec1031e0 0x7f2aec1a0720 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f2ae800d950 tx=0x7f2ae800de10 comp rx=0 tx=0).stop 2024-04-20T12:32:26.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af47ce640 1 -- 172.21.15.135:0/1717486005 shutdown_connections 2024-04-20T12:32:26.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af47ce640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2ad80a3d20 0x7f2ad80a61e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af47ce640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2aec10c520 0x7f2aec19a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af47ce640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2aec103b00 0x7f2aec1a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af47ce640 1 --2- 172.21.15.135:0/1717486005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2aec1031e0 0x7f2aec1a0720 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af47ce640 1 -- 172.21.15.135:0/1717486005 >> 172.21.15.135:0/1717486005 conn(0x7f2aec077f60 msgr2=0x7f2aec1084d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.271+0000 7f2af47ce640 1 -- 172.21.15.135:0/1717486005 shutdown_connections 2024-04-20T12:32:26.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.272+0000 7f2af47ce640 1 -- 172.21.15.135:0/1717486005 wait complete. 2024-04-20T12:32:26.281 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:32:26.281 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:32:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.380+0000 7f33f7306640 1 -- 172.21.15.135:0/1146093409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0102250 msgr2=0x7f33f0102630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.380+0000 7f33f7306640 1 --2- 172.21.15.135:0/1146093409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0102250 0x7f33f0102630 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009900 tx=0x7f33ec02bc50 comp rx=0 tx=0).stop 2024-04-20T12:32:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.380+0000 7f33f7306640 1 -- 172.21.15.135:0/1146093409 shutdown_connections 2024-04-20T12:32:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.380+0000 7f33f7306640 1 --2- 172.21.15.135:0/1146093409 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f0107290 0x7f33f010ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.380+0000 7f33f7306640 1 --2- 172.21.15.135:0/1146093409 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33f0102c00 0x7f33f0106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.380+0000 7f33f7306640 1 --2- 172.21.15.135:0/1146093409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0102250 0x7f33f0102630 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.380+0000 7f33f7306640 1 -- 172.21.15.135:0/1146093409 >> 172.21.15.135:0/1146093409 conn(0x7f33f00790f0 msgr2=0x7f33f0079500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.380+0000 7f33f7306640 1 -- 172.21.15.135:0/1146093409 shutdown_connections 2024-04-20T12:32:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.380+0000 7f33f7306640 1 -- 172.21.15.135:0/1146093409 wait complete. 2024-04-20T12:32:26.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f7306640 1 Processor -- start 2024-04-20T12:32:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f7306640 1 -- start start 2024-04-20T12:32:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f7306640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33f0102250 0x7f33f019e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f7306640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0107290 0x7f33f019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f7306640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f01987a0 0x7f33f0198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f7306640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33f0112420 con 0x7f33f0107290 2024-04-20T12:32:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f7306640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f33f01122a0 con 0x7f33f0102250 2024-04-20T12:32:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f7306640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f33f01125a0 con 0x7f33f01987a0 2024-04-20T12:32:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f48a1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0107290 0x7f33f019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f48a1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0107290 0x7f33f019eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37694/0 (socket says 172.21.15.135:37694) 2024-04-20T12:32:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f48a1640 1 -- 172.21.15.135:0/1288178164 learned_addr learned my addr 172.21.15.135:0/1288178164 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f50a2640 1 --2- 172.21.15.135:0/1288178164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33f0102250 0x7f33f019e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f48a1640 1 -- 172.21.15.135:0/1288178164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f01987a0 msgr2=0x7f33f0198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f48a1640 1 --2- 172.21.15.135:0/1288178164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f01987a0 0x7f33f0198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f48a1640 1 -- 172.21.15.135:0/1288178164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33f0102250 msgr2=0x7f33f019e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.383 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f48a1640 1 --2- 172.21.15.135:0/1288178164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33f0102250 0x7f33f019e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f48a1640 1 -- 172.21.15.135:0/1288178164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f0199330 con 0x7f33f0107290 2024-04-20T12:32:26.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33f48a1640 1 --2- 172.21.15.135:0/1288178164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0107290 0x7f33f019eb70 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f33e0006fd0 tx=0x7f33e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.381+0000 7f33e67fc640 1 -- 172.21.15.135:0/1288178164 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0011830 con 0x7f33f0107290 2024-04-20T12:32:26.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.382+0000 7f33e67fc640 1 -- 172.21.15.135:0/1288178164 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33e0016070 con 0x7f33f0107290 2024-04-20T12:32:26.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.382+0000 7f33f7306640 1 -- 172.21.15.135:0/1288178164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f0199620 con 0x7f33f0107290 2024-04-20T12:32:26.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.382+0000 7f33e67fc640 1 -- 172.21.15.135:0/1288178164 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e000f2e0 con 0x7f33f0107290 2024-04-20T12:32:26.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.382+0000 7f33f7306640 1 -- 172.21.15.135:0/1288178164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f01a5800 con 0x7f33f0107290 2024-04-20T12:32:26.384 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.382+0000 7f33f7306640 1 -- 172.21.15.135:0/1288178164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f0103690 con 0x7f33f0107290 2024-04-20T12:32:26.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.384+0000 7f33e67fc640 1 -- 172.21.15.135:0/1288178164 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f33e001b460 con 0x7f33f0107290 2024-04-20T12:32:26.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.384+0000 7f33e67fc640 1 --2- 172.21.15.135:0/1288178164 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33dc0a3d20 0x7f33dc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.384+0000 7f33f50a2640 1 --2- 172.21.15.135:0/1288178164 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33dc0a3d20 0x7f33dc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.384+0000 7f33e67fc640 1 -- 172.21.15.135:0/1288178164 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f33e00d0860 con 0x7f33f0107290 2024-04-20T12:32:26.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.385+0000 7f33f50a2640 1 --2- 172.21.15.135:0/1288178164 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33dc0a3d20 0x7f33dc0a61e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009230 tx=0x7f33ec004f10 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.388+0000 7f33e67fc640 1 -- 172.21.15.135:0/1288178164 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f33f0199620 con 0x7f33f0107290 2024-04-20T12:32:26.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.605+0000 7f33f7306640 1 -- 172.21.15.135:0/1288178164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33f00691d0 con 0x7f33f0107290 2024-04-20T12:32:26.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.606+0000 7f33e67fc640 1 -- 172.21.15.135:0/1288178164 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7f33f00691d0 con 0x7f33f0107290 2024-04-20T12:32:26.604 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:32:26.605 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:32:26.605 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:32:26.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.608+0000 7f33f7306640 1 -- 172.21.15.135:0/1288178164 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33dc0a3d20 msgr2=0x7f33dc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.608+0000 7f33f7306640 1 --2- 172.21.15.135:0/1288178164 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33dc0a3d20 0x7f33dc0a61e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009230 tx=0x7f33ec004f10 comp rx=0 tx=0).stop 2024-04-20T12:32:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.608+0000 7f33f7306640 1 -- 172.21.15.135:0/1288178164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0107290 msgr2=0x7f33f019eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.608+0000 7f33f7306640 1 --2- 172.21.15.135:0/1288178164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0107290 0x7f33f019eb70 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f33e0006fd0 tx=0x7f33e000b8e0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.608+0000 7f33f7306640 1 -- 172.21.15.135:0/1288178164 shutdown_connections 2024-04-20T12:32:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.608+0000 7f33f7306640 1 --2- 172.21.15.135:0/1288178164 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33dc0a3d20 0x7f33dc0a61e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.608+0000 7f33f7306640 1 --2- 172.21.15.135:0/1288178164 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f01987a0 0x7f33f0198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.608+0000 7f33f7306640 1 --2- 172.21.15.135:0/1288178164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33f0107290 0x7f33f019eb70 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.608+0000 7f33f7306640 1 --2- 172.21.15.135:0/1288178164 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33f0102250 0x7f33f019e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.608+0000 7f33f7306640 1 -- 172.21.15.135:0/1288178164 >> 172.21.15.135:0/1288178164 conn(0x7f33f00790f0 msgr2=0x7f33f0101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.608+0000 7f33f7306640 1 -- 172.21.15.135:0/1288178164 shutdown_connections 2024-04-20T12:32:26.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.608+0000 7f33f7306640 1 -- 172.21.15.135:0/1288178164 wait complete. 2024-04-20T12:32:26.618 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:32:26.720 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 -- 172.21.15.135:0/28830118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d6010c510 msgr2=0x7f9d6010e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 --2- 172.21.15.135:0/28830118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d6010c510 0x7f9d6010e9b0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009ca0 tx=0x7f9d5802c230 comp rx=0 tx=0).stop 2024-04-20T12:32:26.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 -- 172.21.15.135:0/28830118 shutdown_connections 2024-04-20T12:32:26.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 --2- 172.21.15.135:0/28830118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d6010c510 0x7f9d6010e9b0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 --2- 172.21.15.135:0/28830118 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d60103af0 0x7f9d6010bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 --2- 172.21.15.135:0/28830118 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d601031d0 0x7f9d601035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 -- 172.21.15.135:0/28830118 >> 172.21.15.135:0/28830118 conn(0x7f9d60078010 msgr2=0x7f9d60078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 -- 172.21.15.135:0/28830118 shutdown_connections 2024-04-20T12:32:26.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 -- 172.21.15.135:0/28830118 wait complete. 2024-04-20T12:32:26.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 Processor -- start 2024-04-20T12:32:26.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 -- start start 2024-04-20T12:32:26.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d601031d0 0x7f9d60198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.721 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d60103af0 0x7f9d60198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d6010c510 0x7f9d6019cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601122d0 con 0x7f9d601031d0 2024-04-20T12:32:26.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60112150 con 0x7f9d60103af0 2024-04-20T12:32:26.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.720+0000 7f9d67f2c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60112450 con 0x7f9d6010c510 2024-04-20T12:32:26.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d65cc8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d601031d0 0x7f9d60198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d65cc8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d601031d0 0x7f9d60198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37712/0 (socket says 172.21.15.135:37712) 2024-04-20T12:32:26.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d65cc8640 1 -- 172.21.15.135:0/95042488 learned_addr learned my addr 172.21.15.135:0/95042488 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d654c7640 1 --2- 172.21.15.135:0/95042488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d60103af0 0x7f9d60198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d65cc8640 1 -- 172.21.15.135:0/95042488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d6010c510 msgr2=0x7f9d6019cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d664c9640 1 --2- 172.21.15.135:0/95042488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d6010c510 0x7f9d6019cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d65cc8640 1 --2- 172.21.15.135:0/95042488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d6010c510 0x7f9d6019cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d65cc8640 1 -- 172.21.15.135:0/95042488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d60103af0 msgr2=0x7f9d60198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d65cc8640 1 --2- 172.21.15.135:0/95042488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d60103af0 0x7f9d60198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.722 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d65cc8640 1 -- 172.21.15.135:0/95042488 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6019d700 con 0x7f9d601031d0 2024-04-20T12:32:26.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d654c7640 1 --2- 172.21.15.135:0/95042488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d60103af0 0x7f9d60198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:26.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d65cc8640 1 --2- 172.21.15.135:0/95042488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d601031d0 0x7f9d60198710 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000e9f0 tx=0x7f9d5000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d5effd640 1 -- 172.21.15.135:0/95042488 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5000cd80 con 0x7f9d601031d0 2024-04-20T12:32:26.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d5effd640 1 -- 172.21.15.135:0/95042488 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d50010910 con 0x7f9d601031d0 2024-04-20T12:32:26.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d67f2c640 1 -- 172.21.15.135:0/95042488 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6019d9f0 con 0x7f9d601031d0 2024-04-20T12:32:26.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d5effd640 1 -- 172.21.15.135:0/95042488 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d50018990 con 0x7f9d601031d0 2024-04-20T12:32:26.723 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.721+0000 7f9d67f2c640 1 -- 172.21.15.135:0/95042488 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d601a5280 con 0x7f9d601031d0 2024-04-20T12:32:26.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.724+0000 7f9d6abf1740 1 Processor -- start 2024-04-20T12:32:26.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.724+0000 7f9d6abf1740 1 -- start start 2024-04-20T12:32:26.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.724+0000 7f9d5effd640 1 -- 172.21.15.135:0/95042488 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f9d50010ac0 con 0x7f9d601031d0 2024-04-20T12:32:26.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.724+0000 7f9d6abf1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.724+0000 7f9d6abf1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab0730 0x55d6d5ab8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.724+0000 7f9d6abf1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab9310 0x55d6d5abb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.724+0000 7f9d6abf1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d6d5a15110 con 0x55d6d5ab9310 2024-04-20T12:32:26.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.724+0000 7f9d6abf1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d6d59b2550 con 0x55d6d5ab0730 2024-04-20T12:32:26.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.724+0000 7f9d6abf1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d6d5a110d0 con 0x55d6d5aafe10 2024-04-20T12:32:26.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d654c7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab9310 0x55d6d5abb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d654c7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab9310 0x55d6d5abb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37726/0 (socket says 172.21.15.135:37726) 2024-04-20T12:32:26.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d654c7640 1 -- 172.21.15.135:0/3486143168 learned_addr learned my addr 172.21.15.135:0/3486143168 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d65cc8640 1 --2- 172.21.15.135:0/3486143168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab0730 0x55d6d5ab8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d664c9640 1 --2- 172.21.15.135:0/3486143168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d654c7640 1 -- 172.21.15.135:0/3486143168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 msgr2=0x55d6d5ab01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d654c7640 1 --2- 172.21.15.135:0/3486143168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d5effd640 1 --2- 172.21.15.135:0/95042488 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9d480a3d20 0x7f9d480a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d654c7640 1 -- 172.21.15.135:0/3486143168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab0730 msgr2=0x55d6d5ab8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d654c7640 1 --2- 172.21.15.135:0/3486143168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab0730 0x55d6d5ab8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d654c7640 1 -- 172.21.15.135:0/3486143168 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6d59da900 con 0x55d6d5ab9310 2024-04-20T12:32:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d65cc8640 1 --2- 172.21.15.135:0/3486143168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab0730 0x55d6d5ab8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d664c9640 1 --2- 172.21.15.135:0/3486143168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d664c9640 1 --2- 172.21.15.135:0/95042488 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9d480a3d20 0x7f9d480a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d5effd640 1 -- 172.21.15.135:0/95042488 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f9d500d1050 con 0x7f9d601031d0 2024-04-20T12:32:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d654c7640 1 --2- 172.21.15.135:0/3486143168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab9310 0x55d6d5abb700 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f9d54008ba0 tx=0x7f9d5400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cdc35f34743f49d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d47fff640 1 -- 172.21.15.135:0/3486143168 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54014070 con 0x55d6d5ab9310 2024-04-20T12:32:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d47fff640 1 -- 172.21.15.135:0/3486143168 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d540047a0 con 0x55d6d5ab9310 2024-04-20T12:32:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.725+0000 7f9d47fff640 1 -- 172.21.15.135:0/3486143168 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54010690 con 0x55d6d5ab9310 2024-04-20T12:32:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.726+0000 7f9d6abf1740 1 -- 172.21.15.135:0/3486143168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab9310 msgr2=0x55d6d5abb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.726+0000 7f9d664c9640 1 --2- 172.21.15.135:0/95042488 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9d480a3d20 0x7f9d480a61e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9d58037040 tx=0x7f9d58005d80 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.726+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/3486143168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab9310 0x55d6d5abb700 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f9d54008ba0 tx=0x7f9d5400e720 comp rx=0 tx=0).stop 2024-04-20T12:32:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.726+0000 7f9d6abf1740 1 -- 172.21.15.135:0/3486143168 shutdown_connections 2024-04-20T12:32:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.726+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/3486143168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab9310 0x55d6d5abb700 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.726+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/3486143168 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab0730 0x55d6d5ab8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.726+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/3486143168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.726+0000 7f9d6abf1740 1 -- 172.21.15.135:0/3486143168 >> 172.21.15.135:0/3486143168 conn(0x55d6d5aaa540 msgr2=0x55d6d5aaa920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.726+0000 7f9d6abf1740 1 -- 172.21.15.135:0/3486143168 shutdown_connections 2024-04-20T12:32:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.726+0000 7f9d6abf1740 1 -- 172.21.15.135:0/3486143168 wait complete. 2024-04-20T12:32:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.726+0000 7f9d6abf1740 1 -- start start 2024-04-20T12:32:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d6abf1740 1 Processor -- start 2024-04-20T12:32:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d6abf1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d6abf1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab0730 0x55d6d5ab69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d6abf1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab9310 0x55d6d5ab6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d6abf1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d6d5abbfe0 con 0x55d6d5ab0730 2024-04-20T12:32:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d6abf1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55d6d59ce500 con 0x55d6d5ab9310 2024-04-20T12:32:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d6abf1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55d6d5abc160 con 0x55d6d5aafe10 2024-04-20T12:32:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d6abf1740 10 client.0 _ll_register_callbacks cb 0x55d6d59b32f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d654c7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab0730 0x55d6d5ab69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d654c7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab0730 0x55d6d5ab69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37728/0 (socket says 172.21.15.135:37728) 2024-04-20T12:32:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d654c7640 1 -- 172.21.15.135:0/2822635179 learned_addr learned my addr 172.21.15.135:0/2822635179 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d664c9640 1 --2- 172.21.15.135:0/2822635179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab9310 0x55d6d5ab6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d65cc8640 1 --2- 172.21.15.135:0/2822635179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d654c7640 1 -- 172.21.15.135:0/2822635179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 msgr2=0x55d6d5ab6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d654c7640 1 --2- 172.21.15.135:0/2822635179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d654c7640 1 -- 172.21.15.135:0/2822635179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab9310 msgr2=0x55d6d5ab6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d654c7640 1 --2- 172.21.15.135:0/2822635179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab9310 0x55d6d5ab6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.727+0000 7f9d654c7640 1 -- 172.21.15.135:0/2822635179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6d57273f0 con 0x55d6d5ab0730 2024-04-20T12:32:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d654c7640 1 --2- 172.21.15.135:0/2822635179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab0730 0x55d6d5ab69c0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f9d54008720 tx=0x7f9d54005150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306a7c0efc443e4c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d457fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d457fa640 1 -- 172.21.15.135:0/2822635179 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54014070 con 0x55d6d5ab0730 2024-04-20T12:32:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d457fa640 1 -- 172.21.15.135:0/2822635179 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f9d54004030 con 0x55d6d5ab0730 2024-04-20T12:32:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2822635179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d540047a0 con 0x55d6d5ab0730 2024-04-20T12:32:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d457fa640 1 -- 172.21.15.135:0/2822635179 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9d5402d050 con 0x55d6d5ab0730 2024-04-20T12:32:26.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d6abf1740 10 client.18393 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:26.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2822635179 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d6d57f17d0 con 0x55d6d5ab0730 2024-04-20T12:32:26.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d457fa640 1 -- 172.21.15.135:0/2822635179 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d540047a0 con 0x55d6d5ab0730 2024-04-20T12:32:26.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d457fa640 1 -- 172.21.15.135:0/2822635179 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f9d54003cb0 con 0x55d6d5ab0730 2024-04-20T12:32:26.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d6abf1740 10 client.18393 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:26.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d6abf1740 10 client.18393 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:32:26.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d6abf1740 20 client.18393 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:26.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/2822635179 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55d6d5ac94f0 0x55d6d5acb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d6abf1740 4 client.18393 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:32:26.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2822635179 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6d5a22b30 con 0x55d6d5ac94f0 2024-04-20T12:32:26.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.728+0000 7f9d65cc8640 1 --2- 172.21.15.135:0/2822635179 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55d6d5ac94f0 0x55d6d5acb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.729+0000 7f9d457fa640 10 client.18393 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:32:26.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.729+0000 7f9d65cc8640 1 --2- 172.21.15.135:0/2822635179 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55d6d5ac94f0 0x55d6d5acb8e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b5d7f93b14fa03c5 server_cookie=1fce5e664bf61f68 in_seq=0 out_seq=0 2024-04-20T12:32:26.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.729+0000 7f9d457fa640 1 -- 172.21.15.135:0/2822635179 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d6d5a22b30 con 0x55d6d5ac94f0 2024-04-20T12:32:26.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.729+0000 7f9d457fa640 10 client.18393 handle_command_reply: tid=0 2024-04-20T12:32:26.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.729+0000 7f9d6abf1740 1 client.18393 shutdown 2024-04-20T12:32:26.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.729+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2822635179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab0730 msgr2=0x55d6d5ab69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.729+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/2822635179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab0730 0x55d6d5ab69c0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f9d54008720 tx=0x7f9d54005150 comp rx=0 tx=0).stop 2024-04-20T12:32:26.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.730+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2822635179 shutdown_connections 2024-04-20T12:32:26.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.730+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/2822635179 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55d6d5ac94f0 0x55d6d5acb8e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.730+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/2822635179 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab9310 0x55d6d5ab6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.730+0000 7f9d457fa640 0 client.18393 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:32:26.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.730+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/2822635179 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab0730 0x55d6d5ab69c0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.730+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/2822635179 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.730+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2822635179 >> 172.21.15.135:0/2822635179 conn(0x55d6d5aaa540 msgr2=0x55d6d5aac290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.730+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2822635179 shutdown_connections 2024-04-20T12:32:26.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.730+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2822635179 wait complete. 2024-04-20T12:32:26.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.730+0000 7f9d6abf1740 20 client.18393 trim_cache size 0 max 16384 2024-04-20T12:32:26.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d6abf1740 1 Processor -- start 2024-04-20T12:32:26.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d6abf1740 1 -- start start 2024-04-20T12:32:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d6abf1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d6abf1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab0730 0x55d6d5ad0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d6abf1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5ab9310 0x55d6d5ad14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d6abf1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601af560 con 0x55d6d5ab0730 2024-04-20T12:32:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d6abf1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601b10a0 con 0x55d6d5aafe10 2024-04-20T12:32:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d6abf1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601afc30 con 0x55d6d5ab9310 2024-04-20T12:32:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d654c7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab0730 0x55d6d5ad0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d654c7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab0730 0x55d6d5ad0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37738/0 (socket says 172.21.15.135:37738) 2024-04-20T12:32:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d654c7640 1 -- 172.21.15.135:0/3961911913 learned_addr learned my addr 172.21.15.135:0/3961911913 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d65cc8640 1 --2- 172.21.15.135:0/3961911913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d654c7640 1 -- 172.21.15.135:0/3961911913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5ab9310 msgr2=0x55d6d5ad14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d654c7640 1 --2- 172.21.15.135:0/3961911913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5ab9310 0x55d6d5ad14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d654c7640 1 -- 172.21.15.135:0/3961911913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5aafe10 msgr2=0x55d6d5ab8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d654c7640 1 --2- 172.21.15.135:0/3961911913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d654c7640 1 -- 172.21.15.135:0/3961911913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6d5acbd40 con 0x55d6d5ab0730 2024-04-20T12:32:26.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.743+0000 7f9d654c7640 1 --2- 172.21.15.135:0/3961911913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab0730 0x55d6d5ad0f70 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9d540106a0 tx=0x7f9d5400efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d06f5f233f8d80 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.744+0000 7f9d477fe640 1 -- 172.21.15.135:0/3961911913 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54036070 con 0x55d6d5ab0730 2024-04-20T12:32:26.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.744+0000 7f9d477fe640 1 -- 172.21.15.135:0/3961911913 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d5400ec20 con 0x55d6d5ab0730 2024-04-20T12:32:26.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.744+0000 7f9d477fe640 1 -- 172.21.15.135:0/3961911913 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54014070 con 0x55d6d5ab0730 2024-04-20T12:32:26.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.744+0000 7f9d6abf1740 1 -- 172.21.15.135:0/3961911913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab0730 msgr2=0x55d6d5ad0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.744+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/3961911913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab0730 0x55d6d5ad0f70 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9d540106a0 tx=0x7f9d5400efd0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.744+0000 7f9d6abf1740 1 -- 172.21.15.135:0/3961911913 shutdown_connections 2024-04-20T12:32:26.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.744+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/3961911913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5ab9310 0x55d6d5ad14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.744+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/3961911913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab0730 0x55d6d5ad0f70 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.744+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/3961911913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.744+0000 7f9d6abf1740 1 -- 172.21.15.135:0/3961911913 >> 172.21.15.135:0/3961911913 conn(0x55d6d5aaa540 msgr2=0x55d6d5aa96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.749 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.744+0000 7f9d6abf1740 1 -- 172.21.15.135:0/3961911913 shutdown_connections 2024-04-20T12:32:26.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.744+0000 7f9d6abf1740 1 -- 172.21.15.135:0/3961911913 wait complete. 2024-04-20T12:32:26.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.744+0000 7f9d6abf1740 1 -- start start 2024-04-20T12:32:26.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d6abf1740 1 Processor -- start 2024-04-20T12:32:26.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d6abf1740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d6abf1740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab0730 0x55d6d5ab3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d6abf1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab9310 0x55d6d5ab3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d6abf1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601b09d0 con 0x55d6d5ab9310 2024-04-20T12:32:26.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d6abf1740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601b0300 con 0x55d6d5ab0730 2024-04-20T12:32:26.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d6abf1740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601ad530 con 0x55d6d5aafe10 2024-04-20T12:32:26.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d6abf1740 10 client.0 _ll_register_callbacks cb 0x7f9d54008a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:26.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d664c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab9310 0x55d6d5ab3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d664c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab9310 0x55d6d5ab3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37740/0 (socket says 172.21.15.135:37740) 2024-04-20T12:32:26.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d664c9640 1 -- 172.21.15.135:0/2727080994 learned_addr learned my addr 172.21.15.135:0/2727080994 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d654c7640 1 --2- 172.21.15.135:0/2727080994 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab0730 0x55d6d5ab3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d65cc8640 1 --2- 172.21.15.135:0/2727080994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d664c9640 1 -- 172.21.15.135:0/2727080994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 msgr2=0x55d6d5ab3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d664c9640 1 --2- 172.21.15.135:0/2727080994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d664c9640 1 -- 172.21.15.135:0/2727080994 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab0730 msgr2=0x55d6d5ab3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d664c9640 1 --2- 172.21.15.135:0/2727080994 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab0730 0x55d6d5ab3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d664c9640 1 -- 172.21.15.135:0/2727080994 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6d5b2e7e0 con 0x55d6d5ab9310 2024-04-20T12:32:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.745+0000 7f9d65cc8640 1 --2- 172.21.15.135:0/2727080994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d664c9640 1 --2- 172.21.15.135:0/2727080994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab9310 0x55d6d5ab3ad0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009ca0 tx=0x7f9d5802c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b446778f2b8f8271 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d457fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d457fa640 1 -- 172.21.15.135:0/2727080994 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58039040 con 0x55d6d5ab9310 2024-04-20T12:32:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2727080994 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d5400ec20 con 0x55d6d5ab9310 2024-04-20T12:32:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d457fa640 1 -- 172.21.15.135:0/2727080994 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f9d58004040 con 0x55d6d5ab9310 2024-04-20T12:32:26.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d457fa640 1 -- 172.21.15.135:0/2727080994 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9d58004240 con 0x55d6d5ab9310 2024-04-20T12:32:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d6abf1740 10 client.18399 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2727080994 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d6d5b2f9c0 con 0x55d6d5ab9310 2024-04-20T12:32:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d457fa640 1 -- 172.21.15.135:0/2727080994 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d5400ec20 con 0x55d6d5ab9310 2024-04-20T12:32:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d457fa640 1 -- 172.21.15.135:0/2727080994 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f9d5803fc50 con 0x55d6d5ab9310 2024-04-20T12:32:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d6abf1740 10 client.18399 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d6abf1740 10 client.18399 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:32:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d6abf1740 20 client.18399 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/2727080994 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55d6d5b301f0 0x55d6d5b32610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d6abf1740 4 client.18399 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:32:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2727080994 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d6d5a1c9a0 con 0x55d6d5b301f0 2024-04-20T12:32:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.746+0000 7f9d65cc8640 1 --2- 172.21.15.135:0/2727080994 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55d6d5b301f0 0x55d6d5b32610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d457fa640 10 client.18399 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:32:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d65cc8640 1 --2- 172.21.15.135:0/2727080994 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55d6d5b301f0 0x55d6d5b32610 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=14f885ab3c3dbd3d server_cookie=5104a417cb5110a4 in_seq=0 out_seq=0 2024-04-20T12:32:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d457fa640 1 -- 172.21.15.135:0/2727080994 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d6d5a1c9a0 con 0x55d6d5b301f0 2024-04-20T12:32:26.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d457fa640 10 client.18399 handle_command_reply: tid=0 2024-04-20T12:32:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d6abf1740 1 client.18399 shutdown 2024-04-20T12:32:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2727080994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab9310 msgr2=0x55d6d5ab3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/2727080994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab9310 0x55d6d5ab3ad0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009ca0 tx=0x7f9d5802c230 comp rx=0 tx=0).stop 2024-04-20T12:32:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2727080994 shutdown_connections 2024-04-20T12:32:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/2727080994 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x55d6d5b301f0 0x55d6d5b32610 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/2727080994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d6d5ab9310 0x55d6d5ab3ad0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/2727080994 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55d6d5ab0730 0x55d6d5ab3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d6abf1740 1 --2- 172.21.15.135:0/2727080994 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55d6d5aafe10 0x55d6d5ab3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d457fa640 0 client.18399 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:32:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2727080994 >> 172.21.15.135:0/2727080994 conn(0x55d6d5aaa540 msgr2=0x55d6d5ab6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2727080994 shutdown_connections 2024-04-20T12:32:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d6abf1740 1 -- 172.21.15.135:0/2727080994 wait complete. 2024-04-20T12:32:26.753 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.747+0000 7f9d6abf1740 20 client.18399 trim_cache size 0 max 16384 2024-04-20T12:32:26.754 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:32:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.748+0000 7f9d67f2c640 1 -- 172.21.15.135:0/95042488 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9d480a3d20 msgr2=0x7f9d480a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.748+0000 7f9d67f2c640 1 --2- 172.21.15.135:0/95042488 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9d480a3d20 0x7f9d480a61e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9d58037040 tx=0x7f9d58005d80 comp rx=0 tx=0).stop 2024-04-20T12:32:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.748+0000 7f9d67f2c640 1 -- 172.21.15.135:0/95042488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d601031d0 msgr2=0x7f9d60198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.748+0000 7f9d67f2c640 1 --2- 172.21.15.135:0/95042488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d601031d0 0x7f9d60198710 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000e9f0 tx=0x7f9d5000eeb0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.748+0000 7f9d67f2c640 1 -- 172.21.15.135:0/95042488 shutdown_connections 2024-04-20T12:32:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.748+0000 7f9d67f2c640 1 --2- 172.21.15.135:0/95042488 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9d480a3d20 0x7f9d480a61e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.748+0000 7f9d67f2c640 1 --2- 172.21.15.135:0/95042488 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9d6010c510 0x7f9d6019cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.748+0000 7f9d67f2c640 1 --2- 172.21.15.135:0/95042488 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9d60103af0 0x7f9d60198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.748+0000 7f9d67f2c640 1 --2- 172.21.15.135:0/95042488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d601031d0 0x7f9d60198710 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.748+0000 7f9d67f2c640 1 -- 172.21.15.135:0/95042488 >> 172.21.15.135:0/95042488 conn(0x7f9d60078010 msgr2=0x7f9d600fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.748+0000 7f9d67f2c640 1 -- 172.21.15.135:0/95042488 shutdown_connections 2024-04-20T12:32:26.755 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.748+0000 7f9d67f2c640 1 -- 172.21.15.135:0/95042488 wait complete. 2024-04-20T12:32:26.757 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:32:26.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.859+0000 7febb2b7e640 1 -- 172.21.15.135:0/3289784965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febac101090 msgr2=0x7febac101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.860 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.859+0000 7febb2b7e640 1 --2- 172.21.15.135:0/3289784965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febac101090 0x7febac101470 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7feba0009900 tx=0x7feba002bc30 comp rx=0 tx=0).stop 2024-04-20T12:32:26.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.859+0000 7febb2b7e640 1 -- 172.21.15.135:0/3289784965 shutdown_connections 2024-04-20T12:32:26.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.859+0000 7febb2b7e640 1 --2- 172.21.15.135:0/3289784965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febac106160 0x7febac10dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.859+0000 7febb2b7e640 1 --2- 172.21.15.135:0/3289784965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febac101a40 0x7febac105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.859+0000 7febb2b7e640 1 --2- 172.21.15.135:0/3289784965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febac101090 0x7febac101470 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.859+0000 7febb2b7e640 1 -- 172.21.15.135:0/3289784965 >> 172.21.15.135:0/3289784965 conn(0x7febac078010 msgr2=0x7febac078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.859+0000 7febb2b7e640 1 -- 172.21.15.135:0/3289784965 shutdown_connections 2024-04-20T12:32:26.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.859+0000 7febb2b7e640 1 -- 172.21.15.135:0/3289784965 wait complete. 2024-04-20T12:32:26.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.859+0000 7febb2b7e640 1 Processor -- start 2024-04-20T12:32:26.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.859+0000 7febb2b7e640 1 -- start start 2024-04-20T12:32:26.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.859+0000 7febb2b7e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febac101090 0x7febac199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.861 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.859+0000 7febb2b7e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febac106160 0x7febac199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb2b7e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febac19a0f0 0x7febac1a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb2b7e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7febac111220 con 0x7febac19a0f0 2024-04-20T12:32:26.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb2b7e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7febac1110a0 con 0x7febac106160 2024-04-20T12:32:26.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb2b7e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7febac1113a0 con 0x7febac101090 2024-04-20T12:32:26.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb111b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febac19a0f0 0x7febac1a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb111b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febac19a0f0 0x7febac1a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37754/0 (socket says 172.21.15.135:37754) 2024-04-20T12:32:26.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb111b640 1 -- 172.21.15.135:0/2903550073 learned_addr learned my addr 172.21.15.135:0/2903550073 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febabfff640 1 --2- 172.21.15.135:0/2903550073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febac106160 0x7febac199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb091a640 1 --2- 172.21.15.135:0/2903550073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febac101090 0x7febac199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb111b640 1 -- 172.21.15.135:0/2903550073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febac101090 msgr2=0x7febac199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.862 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb111b640 1 --2- 172.21.15.135:0/2903550073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febac101090 0x7febac199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb111b640 1 -- 172.21.15.135:0/2903550073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febac106160 msgr2=0x7febac199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb111b640 1 --2- 172.21.15.135:0/2903550073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febac106160 0x7febac199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb111b640 1 -- 172.21.15.135:0/2903550073 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febac1a4ea0 con 0x7febac19a0f0 2024-04-20T12:32:26.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb111b640 1 --2- 172.21.15.135:0/2903550073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febac19a0f0 0x7febac1a46a0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7feba400eb10 tx=0x7feba400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7feba9ffb640 1 -- 172.21.15.135:0/2903550073 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4004b20 con 0x7febac19a0f0 2024-04-20T12:32:26.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb2b7e640 1 -- 172.21.15.135:0/2903550073 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febac1a5190 con 0x7febac19a0f0 2024-04-20T12:32:26.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7feba9ffb640 1 -- 172.21.15.135:0/2903550073 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feba4004cc0 con 0x7febac19a0f0 2024-04-20T12:32:26.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7feba9ffb640 1 -- 172.21.15.135:0/2903550073 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4010760 con 0x7febac19a0f0 2024-04-20T12:32:26.863 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.860+0000 7febb2b7e640 1 -- 172.21.15.135:0/2903550073 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febac1a56e0 con 0x7febac19a0f0 2024-04-20T12:32:26.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.862+0000 7feba9ffb640 1 -- 172.21.15.135:0/2903550073 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7feba4005020 con 0x7febac19a0f0 2024-04-20T12:32:26.870 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febb576b740 1 Processor -- start 2024-04-20T12:32:26.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febb576b740 1 -- start start 2024-04-20T12:32:26.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febb576b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3748b40 0x5639a3748f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febb576b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3749460 0x5639a37561e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7feba9ffb640 1 --2- 172.21.15.135:0/2903550073 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feb9c0a3d20 0x7feb9c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febb576b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3756720 0x5639a3758b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febb576b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5639a36ae110 con 0x5639a3756720 2024-04-20T12:32:26.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febb576b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5639a364b550 con 0x5639a3749460 2024-04-20T12:32:26.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febb576b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5639a36aa0d0 con 0x5639a3748b40 2024-04-20T12:32:26.871 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febb111b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3756720 0x5639a3758b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febabfff640 1 --2- 172.21.15.135:0/2903550073 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feb9c0a3d20 0x7feb9c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febb111b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3756720 0x5639a3758b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37764/0 (socket says 172.21.15.135:37764) 2024-04-20T12:32:26.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febb111b640 1 -- 172.21.15.135:0/2675062583 learned_addr learned my addr 172.21.15.135:0/2675062583 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7feba9ffb640 1 -- 172.21.15.135:0/2903550073 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7feba40d1200 con 0x7febac19a0f0 2024-04-20T12:32:26.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febabfff640 1 --2- 172.21.15.135:0/2675062583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3748b40 0x5639a3748f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febb091a640 1 --2- 172.21.15.135:0/2675062583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3749460 0x5639a37561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febb111b640 1 -- 172.21.15.135:0/2675062583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3748b40 msgr2=0x5639a3748f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.863+0000 7febb111b640 1 --2- 172.21.15.135:0/2675062583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3748b40 0x5639a3748f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.872 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.864+0000 7febb111b640 1 -- 172.21.15.135:0/2675062583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3749460 msgr2=0x5639a37561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.864+0000 7febb111b640 1 --2- 172.21.15.135:0/2675062583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3749460 0x5639a37561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.864+0000 7febb111b640 1 -- 172.21.15.135:0/2675062583 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639a3673900 con 0x5639a3756720 2024-04-20T12:32:26.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.864+0000 7febb091a640 1 --2- 172.21.15.135:0/2675062583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3749460 0x5639a37561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:26.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.864+0000 7febabfff640 1 --2- 172.21.15.135:0/2903550073 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feb9c0a3d20 0x7feb9c0a61e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7febac069c60 tx=0x7feb9800bad0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.864+0000 7febb111b640 1 --2- 172.21.15.135:0/2675062583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3756720 0x5639a3758b10 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7feba409cd60 tx=0x7feba401bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384948164513170a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.864+0000 7feb96ffd640 1 -- 172.21.15.135:0/2675062583 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba409c730 con 0x5639a3756720 2024-04-20T12:32:26.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.864+0000 7feb96ffd640 1 -- 172.21.15.135:0/2675062583 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feba40a6900 con 0x5639a3756720 2024-04-20T12:32:26.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.864+0000 7feb96ffd640 1 -- 172.21.15.135:0/2675062583 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba407fc00 con 0x5639a3756720 2024-04-20T12:32:26.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.864+0000 7febb576b740 1 -- 172.21.15.135:0/2675062583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3756720 msgr2=0x5639a3758b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.864+0000 7febb576b740 1 --2- 172.21.15.135:0/2675062583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3756720 0x5639a3758b10 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7feba409cd60 tx=0x7feba401bb30 comp rx=0 tx=0).stop 2024-04-20T12:32:26.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 1 -- 172.21.15.135:0/2675062583 shutdown_connections 2024-04-20T12:32:26.873 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 1 --2- 172.21.15.135:0/2675062583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3756720 0x5639a3758b10 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 1 --2- 172.21.15.135:0/2675062583 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3749460 0x5639a37561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 1 --2- 172.21.15.135:0/2675062583 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3748b40 0x5639a3748f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 1 -- 172.21.15.135:0/2675062583 >> 172.21.15.135:0/2675062583 conn(0x5639a3743540 msgr2=0x5639a3743920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 1 -- 172.21.15.135:0/2675062583 shutdown_connections 2024-04-20T12:32:26.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 1 -- 172.21.15.135:0/2675062583 wait complete. 2024-04-20T12:32:26.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 1 -- start start 2024-04-20T12:32:26.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 1 Processor -- start 2024-04-20T12:32:26.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3748b40 0x5639a3753710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3749460 0x5639a3753c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3756720 0x5639a3754190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5639a37594e0 con 0x5639a3748b40 2024-04-20T12:32:26.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5639a3667500 con 0x5639a3749460 2024-04-20T12:32:26.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5639a3759660 con 0x5639a3756720 2024-04-20T12:32:26.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb576b740 10 client.0 _ll_register_callbacks cb 0x5639a364c2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:26.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb091a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3748b40 0x5639a3753710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb091a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3748b40 0x5639a3753710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37766/0 (socket says 172.21.15.135:37766) 2024-04-20T12:32:26.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.865+0000 7febb091a640 1 -- 172.21.15.135:0/1353678260 learned_addr learned my addr 172.21.15.135:0/1353678260 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7febb111b640 1 --2- 172.21.15.135:0/1353678260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3756720 0x5639a3754190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7febb091a640 1 -- 172.21.15.135:0/1353678260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3756720 msgr2=0x5639a3754190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7febb091a640 1 --2- 172.21.15.135:0/1353678260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3756720 0x5639a3754190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7febb091a640 1 -- 172.21.15.135:0/1353678260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3749460 msgr2=0x5639a3753c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7febabfff640 1 --2- 172.21.15.135:0/1353678260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3749460 0x5639a3753c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7febb091a640 1 --2- 172.21.15.135:0/1353678260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3749460 0x5639a3753c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7febb091a640 1 -- 172.21.15.135:0/1353678260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639a33c03f0 con 0x5639a3748b40 2024-04-20T12:32:26.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7febb091a640 1 --2- 172.21.15.135:0/1353678260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3748b40 0x5639a3753710 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7feba002c170 tx=0x7feba0005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90993ffdb80d97a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7feb8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:26.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7feb8bfff640 1 -- 172.21.15.135:0/1353678260 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0042070 con 0x5639a3748b40 2024-04-20T12:32:26.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7feb8bfff640 1 -- 172.21.15.135:0/1353678260 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7feba0004450 con 0x5639a3748b40 2024-04-20T12:32:26.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7febb576b740 1 -- 172.21.15.135:0/1353678260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feba40a6900 con 0x5639a3748b40 2024-04-20T12:32:26.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7feb8bfff640 1 -- 172.21.15.135:0/1353678260 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feba00046c0 con 0x5639a3748b40 2024-04-20T12:32:26.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7febb576b740 10 client.18411 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:26.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7febb576b740 1 -- 172.21.15.135:0/1353678260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5639a348a7d0 con 0x5639a3748b40 2024-04-20T12:32:26.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.866+0000 7feb8bfff640 1 -- 172.21.15.135:0/1353678260 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feba40a6900 con 0x5639a3748b40 2024-04-20T12:32:26.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.867+0000 7feb8bfff640 1 -- 172.21.15.135:0/1353678260 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7feba0003680 con 0x5639a3748b40 2024-04-20T12:32:26.876 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.867+0000 7febb576b740 10 client.18411 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:26.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.867+0000 7febb576b740 10 client.18411 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:32:26.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.867+0000 7febb576b740 20 client.18411 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:26.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.867+0000 7febb576b740 1 --2- 172.21.15.135:0/1353678260 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5639a37669d0 0x5639a3768e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.867+0000 7febb576b740 4 client.18411 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:32:26.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.867+0000 7febb576b740 1 -- 172.21.15.135:0/1353678260 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639a36bbb30 con 0x5639a37669d0 2024-04-20T12:32:26.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.867+0000 7febabfff640 1 --2- 172.21.15.135:0/1353678260 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5639a37669d0 0x5639a3768e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.867+0000 7febabfff640 1 --2- 172.21.15.135:0/1353678260 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5639a37669d0 0x5639a3768e90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bdd464648ec7841b server_cookie=c02d2b5b2a416eeb in_seq=0 out_seq=0 2024-04-20T12:32:26.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.867+0000 7feb8bfff640 10 client.18411 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:32:26.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.868+0000 7feb8bfff640 1 -- 172.21.15.135:0/1353678260 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5639a36bbb30 con 0x5639a37669d0 2024-04-20T12:32:26.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.868+0000 7feb8bfff640 10 client.18411 handle_command_reply: tid=0 2024-04-20T12:32:26.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.868+0000 7febb576b740 1 client.18411 shutdown 2024-04-20T12:32:26.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.868+0000 7febb576b740 1 -- 172.21.15.135:0/1353678260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3748b40 msgr2=0x5639a3753710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.868+0000 7febb576b740 1 --2- 172.21.15.135:0/1353678260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3748b40 0x5639a3753710 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7feba002c170 tx=0x7feba0005c00 comp rx=0 tx=0).stop 2024-04-20T12:32:26.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.868+0000 7febb576b740 1 -- 172.21.15.135:0/1353678260 shutdown_connections 2024-04-20T12:32:26.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.868+0000 7febb576b740 1 --2- 172.21.15.135:0/1353678260 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5639a37669d0 0x5639a3768e90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.868+0000 7febb576b740 1 --2- 172.21.15.135:0/1353678260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3756720 0x5639a3754190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.868+0000 7febb576b740 1 --2- 172.21.15.135:0/1353678260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3749460 0x5639a3753c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.868+0000 7febb576b740 1 --2- 172.21.15.135:0/1353678260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3748b40 0x5639a3753710 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.868+0000 7febb576b740 1 -- 172.21.15.135:0/1353678260 >> 172.21.15.135:0/1353678260 conn(0x5639a3743540 msgr2=0x5639a3745290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.868+0000 7feb8bfff640 0 client.18411 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:32:26.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.868+0000 7febb576b740 1 -- 172.21.15.135:0/1353678260 shutdown_connections 2024-04-20T12:32:26.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.868+0000 7febb576b740 1 -- 172.21.15.135:0/1353678260 wait complete. 2024-04-20T12:32:26.880 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.868+0000 7febb576b740 20 client.18411 trim_cache size 0 max 16384 2024-04-20T12:32:26.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.881+0000 7febb576b740 1 Processor -- start 2024-04-20T12:32:26.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.881+0000 7febb576b740 1 -- start start 2024-04-20T12:32:26.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7febb576b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3748b40 0x5639a3755e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7febb576b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3749460 0x5639a37623e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7febb576b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3756720 0x5639a376e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7febb576b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7febac1ad360 con 0x5639a3749460 2024-04-20T12:32:26.887 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7febb576b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7febac1aeea0 con 0x5639a3756720 2024-04-20T12:32:26.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7febb576b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7febac1ada30 con 0x5639a3748b40 2024-04-20T12:32:26.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7febabfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3749460 0x5639a37623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7febabfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3749460 0x5639a37623e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37772/0 (socket says 172.21.15.135:37772) 2024-04-20T12:32:26.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7febabfff640 1 -- 172.21.15.135:0/2185462658 learned_addr learned my addr 172.21.15.135:0/2185462658 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7febabfff640 1 -- 172.21.15.135:0/2185462658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3748b40 msgr2=0x5639a3755e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7febabfff640 1 --2- 172.21.15.135:0/2185462658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3748b40 0x5639a3755e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7febabfff640 1 -- 172.21.15.135:0/2185462658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3756720 msgr2=0x5639a376e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7febabfff640 1 --2- 172.21.15.135:0/2185462658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3756720 0x5639a376e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7febabfff640 1 -- 172.21.15.135:0/2185462658 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639a3744110 con 0x5639a3749460 2024-04-20T12:32:26.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7febabfff640 1 --2- 172.21.15.135:0/2185462658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3749460 0x5639a37623e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7feb98012440 tx=0x7feb98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90eb16b630d0cc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7feb967fc640 1 -- 172.21.15.135:0/2185462658 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9800b6e0 con 0x5639a3749460 2024-04-20T12:32:26.888 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7feb967fc640 1 -- 172.21.15.135:0/2185462658 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb9802f070 con 0x5639a3749460 2024-04-20T12:32:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.882+0000 7feb967fc640 1 -- 172.21.15.135:0/2185462658 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9802a580 con 0x5639a3749460 2024-04-20T12:32:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.883+0000 7febb576b740 1 -- 172.21.15.135:0/2185462658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3749460 msgr2=0x5639a37623e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.883+0000 7febb576b740 1 --2- 172.21.15.135:0/2185462658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3749460 0x5639a37623e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7feb98012440 tx=0x7feb98004730 comp rx=0 tx=0).stop 2024-04-20T12:32:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.883+0000 7febb576b740 1 -- 172.21.15.135:0/2185462658 shutdown_connections 2024-04-20T12:32:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.883+0000 7febb576b740 1 --2- 172.21.15.135:0/2185462658 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3756720 0x5639a376e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.883+0000 7febb576b740 1 --2- 172.21.15.135:0/2185462658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3749460 0x5639a37623e0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.883+0000 7febb576b740 1 --2- 172.21.15.135:0/2185462658 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3748b40 0x5639a3755e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.883+0000 7febb576b740 1 -- 172.21.15.135:0/2185462658 >> 172.21.15.135:0/2185462658 conn(0x5639a3743540 msgr2=0x5639a374ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.883+0000 7febb576b740 1 -- 172.21.15.135:0/2185462658 shutdown_connections 2024-04-20T12:32:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.883+0000 7febb576b740 1 -- 172.21.15.135:0/2185462658 wait complete. 2024-04-20T12:32:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.883+0000 7febb576b740 1 -- start start 2024-04-20T12:32:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.883+0000 7febb576b740 1 Processor -- start 2024-04-20T12:32:26.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.883+0000 7febb576b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3748b40 0x5639a375eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.883+0000 7febb576b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3749460 0x5639a374ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.883+0000 7febb576b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3756720 0x5639a3750520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febb576b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7febac1ae7d0 con 0x5639a3749460 2024-04-20T12:32:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febb576b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7febac1ae100 con 0x5639a3748b40 2024-04-20T12:32:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febb576b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7febac1ab330 con 0x5639a3756720 2024-04-20T12:32:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febb576b740 10 client.0 _ll_register_callbacks cb 0x7feba002cdf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febabfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3749460 0x5639a374ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febabfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3749460 0x5639a374ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37784/0 (socket says 172.21.15.135:37784) 2024-04-20T12:32:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febabfff640 1 -- 172.21.15.135:0/568716382 learned_addr learned my addr 172.21.15.135:0/568716382 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febb091a640 1 --2- 172.21.15.135:0/568716382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3748b40 0x5639a375eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febb111b640 1 --2- 172.21.15.135:0/568716382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3756720 0x5639a3750520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febabfff640 1 -- 172.21.15.135:0/568716382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3756720 msgr2=0x5639a3750520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febabfff640 1 --2- 172.21.15.135:0/568716382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3756720 0x5639a3750520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febabfff640 1 -- 172.21.15.135:0/568716382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3748b40 msgr2=0x5639a375eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:26.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febabfff640 1 --2- 172.21.15.135:0/568716382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3748b40 0x5639a375eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febabfff640 1 -- 172.21.15.135:0/568716382 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639a3750b90 con 0x5639a3749460 2024-04-20T12:32:26.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febb091a640 1 --2- 172.21.15.135:0/568716382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3748b40 0x5639a375eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:26.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febabfff640 1 --2- 172.21.15.135:0/568716382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3749460 0x5639a374ffe0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7feb9800b3d0 tx=0x7feb98010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1ceccbab8bfa42 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:26.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7feb8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:26.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7feb8bfff640 1 -- 172.21.15.135:0/568716382 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb98039020 con 0x5639a3749460 2024-04-20T12:32:26.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7feb8bfff640 1 -- 172.21.15.135:0/568716382 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7feb98020950 con 0x5639a3749460 2024-04-20T12:32:26.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febb576b740 1 -- 172.21.15.135:0/568716382 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb9802f070 con 0x5639a3749460 2024-04-20T12:32:26.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7feb8bfff640 1 -- 172.21.15.135:0/568716382 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feb98020b50 con 0x5639a3749460 2024-04-20T12:32:26.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febb576b740 10 client.18417 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:26.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7febb576b740 1 -- 172.21.15.135:0/568716382 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5639a37cce40 con 0x5639a3749460 2024-04-20T12:32:26.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.884+0000 7feb8bfff640 1 -- 172.21.15.135:0/568716382 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb9802f070 con 0x5639a3749460 2024-04-20T12:32:26.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.885+0000 7feb8bfff640 1 -- 172.21.15.135:0/568716382 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7feb9801f070 con 0x5639a3749460 2024-04-20T12:32:26.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.885+0000 7febb576b740 10 client.18417 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:26.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.885+0000 7febb576b740 10 client.18417 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:32:26.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.885+0000 7febb576b740 20 client.18417 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:26.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.885+0000 7febb576b740 1 --2- 172.21.15.135:0/568716382 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5639a37cd590 0x5639a37cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:26.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.885+0000 7febb576b740 4 client.18417 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:32:26.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.885+0000 7febb576b740 1 -- 172.21.15.135:0/568716382 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5639a36b59a0 con 0x5639a37cd590 2024-04-20T12:32:26.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.885+0000 7febb091a640 1 --2- 172.21.15.135:0/568716382 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5639a37cd590 0x5639a37cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:26.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.885+0000 7feb8bfff640 10 client.18417 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:32:26.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.885+0000 7febb091a640 1 --2- 172.21.15.135:0/568716382 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5639a37cd590 0x5639a37cf9b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8bcdcb77389d1058 server_cookie=1243e8ff07dc2b19 in_seq=0 out_seq=0 2024-04-20T12:32:26.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.885+0000 7feb8bfff640 1 -- 172.21.15.135:0/568716382 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5639a36b59a0 con 0x5639a37cd590 2024-04-20T12:32:26.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.885+0000 7feb8bfff640 10 client.18417 handle_command_reply: tid=0 2024-04-20T12:32:26.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.885+0000 7febb576b740 1 client.18417 shutdown 2024-04-20T12:32:26.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb576b740 1 -- 172.21.15.135:0/568716382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3749460 msgr2=0x5639a374ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb576b740 1 --2- 172.21.15.135:0/568716382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3749460 0x5639a374ffe0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7feb9800b3d0 tx=0x7feb98010f90 comp rx=0 tx=0).stop 2024-04-20T12:32:26.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb576b740 1 -- 172.21.15.135:0/568716382 shutdown_connections 2024-04-20T12:32:26.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb576b740 1 --2- 172.21.15.135:0/568716382 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5639a37cd590 0x5639a37cf9b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb576b740 1 --2- 172.21.15.135:0/568716382 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5639a3756720 0x5639a3750520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb576b740 1 --2- 172.21.15.135:0/568716382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639a3749460 0x5639a374ffe0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7feb8bfff640 0 client.18417 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:32:26.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb576b740 1 --2- 172.21.15.135:0/568716382 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5639a3748b40 0x5639a375eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb576b740 1 -- 172.21.15.135:0/568716382 >> 172.21.15.135:0/568716382 conn(0x5639a3743540 msgr2=0x5639a3744990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb576b740 1 -- 172.21.15.135:0/568716382 shutdown_connections 2024-04-20T12:32:26.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb576b740 1 -- 172.21.15.135:0/568716382 wait complete. 2024-04-20T12:32:26.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb576b740 20 client.18417 trim_cache size 0 max 16384 2024-04-20T12:32:26.894 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:32:26.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb2b7e640 1 -- 172.21.15.135:0/2903550073 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feb9c0a3d20 msgr2=0x7feb9c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb2b7e640 1 --2- 172.21.15.135:0/2903550073 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feb9c0a3d20 0x7feb9c0a61e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7febac069c60 tx=0x7feb9800bad0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb2b7e640 1 -- 172.21.15.135:0/2903550073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febac19a0f0 msgr2=0x7febac1a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:26.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb2b7e640 1 --2- 172.21.15.135:0/2903550073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febac19a0f0 0x7febac1a46a0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7feba400eb10 tx=0x7feba400c2d0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb2b7e640 1 -- 172.21.15.135:0/2903550073 shutdown_connections 2024-04-20T12:32:26.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb2b7e640 1 --2- 172.21.15.135:0/2903550073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febac19a0f0 0x7febac1a46a0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb2b7e640 1 --2- 172.21.15.135:0/2903550073 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7febac106160 0x7febac199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb2b7e640 1 --2- 172.21.15.135:0/2903550073 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feb9c0a3d20 0x7feb9c0a61e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb2b7e640 1 --2- 172.21.15.135:0/2903550073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7febac101090 0x7febac199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:26.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb2b7e640 1 -- 172.21.15.135:0/2903550073 >> 172.21.15.135:0/2903550073 conn(0x7febac078010 msgr2=0x7febac0fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:26.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb2b7e640 1 -- 172.21.15.135:0/2903550073 shutdown_connections 2024-04-20T12:32:26.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.886+0000 7febb2b7e640 1 -- 172.21.15.135:0/2903550073 wait complete. 2024-04-20T12:32:26.897 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:32:27.000 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.999+0000 7fbc215b2640 1 -- 172.21.15.135:0/2662764503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc1c106170 msgr2=0x7fbc1c10dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.999+0000 7fbc215b2640 1 --2- 172.21.15.135:0/2662764503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc1c106170 0x7fbc1c10dd40 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009900 tx=0x7fbc1402bc30 comp rx=0 tx=0).stop 2024-04-20T12:32:27.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.999+0000 7fbc215b2640 1 -- 172.21.15.135:0/2662764503 shutdown_connections 2024-04-20T12:32:27.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.999+0000 7fbc215b2640 1 --2- 172.21.15.135:0/2662764503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc1c106170 0x7fbc1c10dd40 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.999+0000 7fbc215b2640 1 --2- 172.21.15.135:0/2662764503 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc1c101a50 0x7fbc1c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.999+0000 7fbc215b2640 1 --2- 172.21.15.135:0/2662764503 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c1010a0 0x7fbc1c101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.999+0000 7fbc215b2640 1 -- 172.21.15.135:0/2662764503 >> 172.21.15.135:0/2662764503 conn(0x7fbc1c0771e0 msgr2=0x7fbc1c0775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.999+0000 7fbc215b2640 1 -- 172.21.15.135:0/2662764503 shutdown_connections 2024-04-20T12:32:27.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:26.999+0000 7fbc215b2640 1 -- 172.21.15.135:0/2662764503 wait complete. 2024-04-20T12:32:27.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.000+0000 7fbc215b2640 1 Processor -- start 2024-04-20T12:32:27.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.000+0000 7fbc215b2640 1 -- start start 2024-04-20T12:32:27.001 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.000+0000 7fbc215b2640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc1c1010a0 0x7fbc1c19e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.000+0000 7fbc215b2640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c106170 0x7fbc1c19e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.000+0000 7fbc215b2640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc1c198620 0x7fbc1c198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.000+0000 7fbc215b2640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c112340 con 0x7fbc1c198620 2024-04-20T12:32:27.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.000+0000 7fbc215b2640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c1121c0 con 0x7fbc1c1010a0 2024-04-20T12:32:27.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.000+0000 7fbc215b2640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c1124c0 con 0x7fbc1c106170 2024-04-20T12:32:27.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.000+0000 7fbc1b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc1c198620 0x7fbc1c198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.000+0000 7fbc1b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc1c198620 0x7fbc1c198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37798/0 (socket says 172.21.15.135:37798) 2024-04-20T12:32:27.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.000+0000 7fbc1b7fe640 1 -- 172.21.15.135:0/2044397042 learned_addr learned my addr 172.21.15.135:0/2044397042 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:27.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.000+0000 7fbc1a7fc640 1 --2- 172.21.15.135:0/2044397042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c106170 0x7fbc1c19e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.001+0000 7fbc1affd640 1 --2- 172.21.15.135:0/2044397042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc1c1010a0 0x7fbc1c19e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.001+0000 7fbc1b7fe640 1 -- 172.21.15.135:0/2044397042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c106170 msgr2=0x7fbc1c19e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.002 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.001+0000 7fbc1b7fe640 1 --2- 172.21.15.135:0/2044397042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c106170 0x7fbc1c19e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.001+0000 7fbc1b7fe640 1 -- 172.21.15.135:0/2044397042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc1c1010a0 msgr2=0x7fbc1c19e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.001+0000 7fbc1b7fe640 1 --2- 172.21.15.135:0/2044397042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc1c1010a0 0x7fbc1c19e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.001+0000 7fbc1b7fe640 1 -- 172.21.15.135:0/2044397042 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc1c199140 con 0x7fbc1c198620 2024-04-20T12:32:27.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.001+0000 7fbc1b7fe640 1 --2- 172.21.15.135:0/2044397042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc1c198620 0x7fbc1c198ad0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009230 tx=0x7fbc1402cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.001+0000 7fbc03fff640 1 -- 172.21.15.135:0/2044397042 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc14041070 con 0x7fbc1c198620 2024-04-20T12:32:27.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.001+0000 7fbc215b2640 1 -- 172.21.15.135:0/2044397042 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc1c1993d0 con 0x7fbc1c198620 2024-04-20T12:32:27.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.001+0000 7fbc03fff640 1 -- 172.21.15.135:0/2044397042 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc14004450 con 0x7fbc1c198620 2024-04-20T12:32:27.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.001+0000 7fbc03fff640 1 -- 172.21.15.135:0/2044397042 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc14034440 con 0x7fbc1c198620 2024-04-20T12:32:27.003 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.001+0000 7fbc215b2640 1 -- 172.21.15.135:0/2044397042 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc1c1a5580 con 0x7fbc1c198620 2024-04-20T12:32:27.012 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.003+0000 7fbc03fff640 1 -- 172.21.15.135:0/2044397042 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fbc14044070 con 0x7fbc1c198620 2024-04-20T12:32:27.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.003+0000 7fbc241a5740 1 Processor -- start 2024-04-20T12:32:27.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc241a5740 1 -- start start 2024-04-20T12:32:27.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc03fff640 1 --2- 172.21.15.135:0/2044397042 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbc040a3d20 0x7fbc040a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc241a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeae10 0x55cf5abeb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc241a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeb730 0x55cf5abf3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc241a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abf4310 0x55cf5abf6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc241a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cf5ab50110 con 0x55cf5abeb730 2024-04-20T12:32:27.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc241a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cf5aaed550 con 0x55cf5abeae10 2024-04-20T12:32:27.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc241a5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cf5ab4c0d0 con 0x55cf5abf4310 2024-04-20T12:32:27.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc1a7fc640 1 --2- 172.21.15.135:0/2044397042 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbc040a3d20 0x7fbc040a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc03fff640 1 -- 172.21.15.135:0/2044397042 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7fbc140f2690 con 0x7fbc1c198620 2024-04-20T12:32:27.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc1a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeb730 0x55cf5abf3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc1a7fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeb730 0x55cf5abf3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37808/0 (socket says 172.21.15.135:37808) 2024-04-20T12:32:27.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc1a7fc640 1 -- 172.21.15.135:0/3800702919 learned_addr learned my addr 172.21.15.135:0/3800702919 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:27.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc1affd640 1 --2- 172.21.15.135:0/3800702919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeae10 0x55cf5abeb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc1b7fe640 1 --2- 172.21.15.135:0/3800702919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abf4310 0x55cf5abf6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc1a7fc640 1 -- 172.21.15.135:0/3800702919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abf4310 msgr2=0x55cf5abf6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc1a7fc640 1 --2- 172.21.15.135:0/3800702919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abf4310 0x55cf5abf6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc1a7fc640 1 -- 172.21.15.135:0/3800702919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeae10 msgr2=0x55cf5abeb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc1a7fc640 1 --2- 172.21.15.135:0/3800702919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeae10 0x55cf5abeb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc1a7fc640 1 -- 172.21.15.135:0/3800702919 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf5ab15900 con 0x55cf5abeb730 2024-04-20T12:32:27.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc1b7fe640 1 --2- 172.21.15.135:0/3800702919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abf4310 0x55cf5abf6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:27.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc1affd640 1 --2- 172.21.15.135:0/3800702919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeae10 0x55cf5abeb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:32:27.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc1a7fc640 1 --2- 172.21.15.135:0/2044397042 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbc040a3d20 0x7fbc040a61e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbc10012880 tx=0x7fbc1000ba90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.004+0000 7fbc1a7fc640 1 --2- 172.21.15.135:0/3800702919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeb730 0x55cf5abf3dd0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fbc10010740 tx=0x7fbc1001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf441dab44e2bb2b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.005+0000 7fbc017fa640 1 -- 172.21.15.135:0/3800702919 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10024070 con 0x55cf5abeb730 2024-04-20T12:32:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.005+0000 7fbc017fa640 1 -- 172.21.15.135:0/3800702919 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc10010e00 con 0x55cf5abeb730 2024-04-20T12:32:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.005+0000 7fbc017fa640 1 -- 172.21.15.135:0/3800702919 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10012e60 con 0x55cf5abeb730 2024-04-20T12:32:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.005+0000 7fbc241a5740 1 -- 172.21.15.135:0/3800702919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeb730 msgr2=0x55cf5abf3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.005+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3800702919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeb730 0x55cf5abf3dd0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fbc10010740 tx=0x7fbc1001c000 comp rx=0 tx=0).stop 2024-04-20T12:32:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.005+0000 7fbc241a5740 1 -- 172.21.15.135:0/3800702919 shutdown_connections 2024-04-20T12:32:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.005+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3800702919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abf4310 0x55cf5abf6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.005+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3800702919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeb730 0x55cf5abf3dd0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.005+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3800702919 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeae10 0x55cf5abeb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.005+0000 7fbc241a5740 1 -- 172.21.15.135:0/3800702919 >> 172.21.15.135:0/3800702919 conn(0x55cf5abe5540 msgr2=0x55cf5abe5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.005+0000 7fbc241a5740 1 -- 172.21.15.135:0/3800702919 shutdown_connections 2024-04-20T12:32:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.005+0000 7fbc241a5740 1 -- 172.21.15.135:0/3800702919 wait complete. 2024-04-20T12:32:27.015 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc241a5740 1 -- start start 2024-04-20T12:32:27.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc241a5740 1 Processor -- start 2024-04-20T12:32:27.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc241a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeae10 0x55cf5abf13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc241a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeb730 0x55cf5abf1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc241a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abf4310 0x55cf5abf1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc241a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cf5abf7040 con 0x55cf5abeae10 2024-04-20T12:32:27.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc241a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55cf5ab09500 con 0x55cf5abeb730 2024-04-20T12:32:27.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc241a5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55cf5abf71c0 con 0x55cf5abf4310 2024-04-20T12:32:27.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc241a5740 10 client.0 _ll_register_callbacks cb 0x55cf5aaee2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:27.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc1affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeae10 0x55cf5abf13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc1affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeae10 0x55cf5abf13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37816/0 (socket says 172.21.15.135:37816) 2024-04-20T12:32:27.016 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc1affd640 1 -- 172.21.15.135:0/3412164947 learned_addr learned my addr 172.21.15.135:0/3412164947 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:27.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc1b7fe640 1 --2- 172.21.15.135:0/3412164947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abf4310 0x55cf5abf1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc1affd640 1 -- 172.21.15.135:0/3412164947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abf4310 msgr2=0x55cf5abf1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc1affd640 1 --2- 172.21.15.135:0/3412164947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abf4310 0x55cf5abf1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc1affd640 1 -- 172.21.15.135:0/3412164947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeb730 msgr2=0x55cf5abf1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc1affd640 1 --2- 172.21.15.135:0/3412164947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeb730 0x55cf5abf1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc1affd640 1 -- 172.21.15.135:0/3412164947 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf5a8623f0 con 0x55cf5abeae10 2024-04-20T12:32:27.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbc1affd640 1 --2- 172.21.15.135:0/3412164947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeae10 0x55cf5abf13d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c012700 tx=0x7fbc0c012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2b719e13b36454 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.006+0000 7fbbfeff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:27.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.007+0000 7fbbfeff5640 1 -- 172.21.15.135:0/3412164947 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c010e00 con 0x55cf5abeae10 2024-04-20T12:32:27.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.007+0000 7fbbfeff5640 1 -- 172.21.15.135:0/3412164947 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7fbc0c003970 con 0x55cf5abeae10 2024-04-20T12:32:27.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.007+0000 7fbc241a5740 1 -- 172.21.15.135:0/3412164947 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc10010e00 con 0x55cf5abeae10 2024-04-20T12:32:27.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.007+0000 7fbbfeff5640 1 -- 172.21.15.135:0/3412164947 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbc0c025050 con 0x55cf5abeae10 2024-04-20T12:32:27.017 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.007+0000 7fbc241a5740 10 client.18429 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:27.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.007+0000 7fbc241a5740 1 -- 172.21.15.135:0/3412164947 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cf5a92c7d0 con 0x55cf5abeae10 2024-04-20T12:32:27.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.007+0000 7fbbfeff5640 1 -- 172.21.15.135:0/3412164947 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc10010e00 con 0x55cf5abeae10 2024-04-20T12:32:27.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.007+0000 7fbbfeff5640 1 -- 172.21.15.135:0/3412164947 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fbc0c019030 con 0x55cf5abeae10 2024-04-20T12:32:27.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.007+0000 7fbc241a5740 10 client.18429 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:27.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.007+0000 7fbc241a5740 10 client.18429 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:32:27.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.007+0000 7fbc241a5740 20 client.18429 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:27.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.007+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3412164947 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55cf5ac04730 0x55cf5ac06bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.007+0000 7fbc241a5740 4 client.18429 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:32:27.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.007+0000 7fbc241a5740 1 -- 172.21.15.135:0/3412164947 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf5ab5db30 con 0x55cf5ac04730 2024-04-20T12:32:27.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.007+0000 7fbc1a7fc640 1 --2- 172.21.15.135:0/3412164947 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55cf5ac04730 0x55cf5ac06bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.008+0000 7fbc1a7fc640 1 --2- 172.21.15.135:0/3412164947 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55cf5ac04730 0x55cf5ac06bb0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3a77c225aef85042 server_cookie=2342ae6d5088d9f9 in_seq=0 out_seq=0 2024-04-20T12:32:27.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.008+0000 7fbbfeff5640 10 client.18429 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:32:27.018 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.009+0000 7fbbfeff5640 1 -- 172.21.15.135:0/3412164947 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cf5ab5db30 con 0x55cf5ac04730 2024-04-20T12:32:27.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.009+0000 7fbbfeff5640 10 client.18429 handle_command_reply: tid=0 2024-04-20T12:32:27.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.009+0000 7fbc241a5740 1 client.18429 shutdown 2024-04-20T12:32:27.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.009+0000 7fbc241a5740 1 -- 172.21.15.135:0/3412164947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeae10 msgr2=0x55cf5abf13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.009+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3412164947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeae10 0x55cf5abf13d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c012700 tx=0x7fbc0c012bc0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.009+0000 7fbc241a5740 1 -- 172.21.15.135:0/3412164947 shutdown_connections 2024-04-20T12:32:27.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.009+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3412164947 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55cf5ac04730 0x55cf5ac06bb0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.009+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3412164947 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abf4310 0x55cf5abf1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.009+0000 7fbbfeff5640 0 client.18429 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:32:27.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.009+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3412164947 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeb730 0x55cf5abf1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.009+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3412164947 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeae10 0x55cf5abf13d0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.009+0000 7fbc241a5740 1 -- 172.21.15.135:0/3412164947 >> 172.21.15.135:0/3412164947 conn(0x55cf5abe5540 msgr2=0x55cf5abe7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.009+0000 7fbc241a5740 1 -- 172.21.15.135:0/3412164947 shutdown_connections 2024-04-20T12:32:27.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.009+0000 7fbc241a5740 1 -- 172.21.15.135:0/3412164947 wait complete. 2024-04-20T12:32:27.019 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.009+0000 7fbc241a5740 20 client.18429 trim_cache size 0 max 16384 2024-04-20T12:32:27.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc241a5740 1 Processor -- start 2024-04-20T12:32:27.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc241a5740 1 -- start start 2024-04-20T12:32:27.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc241a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeae10 0x55cf5abf3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.032 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc241a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeb730 0x55cf5abfffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc241a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abf4310 0x55cf5abfc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc241a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c1af450 con 0x55cf5abeae10 2024-04-20T12:32:27.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc241a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c1b0f90 con 0x55cf5abeb730 2024-04-20T12:32:27.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc241a5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c1afb20 con 0x55cf5abf4310 2024-04-20T12:32:27.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc1affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeae10 0x55cf5abf3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc1affd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeae10 0x55cf5abf3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37822/0 (socket says 172.21.15.135:37822) 2024-04-20T12:32:27.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc1affd640 1 -- 172.21.15.135:0/2395927960 learned_addr learned my addr 172.21.15.135:0/2395927960 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:27.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc1affd640 1 -- 172.21.15.135:0/2395927960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abf4310 msgr2=0x55cf5abfc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc1affd640 1 --2- 172.21.15.135:0/2395927960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abf4310 0x55cf5abfc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc1affd640 1 -- 172.21.15.135:0/2395927960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeb730 msgr2=0x55cf5abfffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc1affd640 1 --2- 172.21.15.135:0/2395927960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeb730 0x55cf5abfffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc1affd640 1 -- 172.21.15.135:0/2395927960 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf5abe0e10 con 0x55cf5abeae10 2024-04-20T12:32:27.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.022+0000 7fbc1affd640 1 --2- 172.21.15.135:0/2395927960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeae10 0x55cf5abf3b00 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c009670 tx=0x7fbc0c005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac206cda592941 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.023+0000 7fbc00ff9640 1 -- 172.21.15.135:0/2395927960 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c02d070 con 0x55cf5abeae10 2024-04-20T12:32:27.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.023+0000 7fbc00ff9640 1 -- 172.21.15.135:0/2395927960 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc0c010c00 con 0x55cf5abeae10 2024-04-20T12:32:27.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.023+0000 7fbc00ff9640 1 -- 172.21.15.135:0/2395927960 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c005020 con 0x55cf5abeae10 2024-04-20T12:32:27.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.023+0000 7fbc241a5740 1 -- 172.21.15.135:0/2395927960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeae10 msgr2=0x55cf5abf3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.023+0000 7fbc241a5740 1 --2- 172.21.15.135:0/2395927960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeae10 0x55cf5abf3b00 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c009670 tx=0x7fbc0c005b70 comp rx=0 tx=0).stop 2024-04-20T12:32:27.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.023+0000 7fbc241a5740 1 -- 172.21.15.135:0/2395927960 shutdown_connections 2024-04-20T12:32:27.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.023+0000 7fbc241a5740 1 --2- 172.21.15.135:0/2395927960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abf4310 0x55cf5abfc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.023+0000 7fbc241a5740 1 --2- 172.21.15.135:0/2395927960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeb730 0x55cf5abfffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.023+0000 7fbc241a5740 1 --2- 172.21.15.135:0/2395927960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abeae10 0x55cf5abf3b00 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.023+0000 7fbc241a5740 1 -- 172.21.15.135:0/2395927960 >> 172.21.15.135:0/2395927960 conn(0x55cf5abe5540 msgr2=0x55cf5abe0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.023+0000 7fbc241a5740 1 -- 172.21.15.135:0/2395927960 shutdown_connections 2024-04-20T12:32:27.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.023+0000 7fbc241a5740 1 -- 172.21.15.135:0/2395927960 wait complete. 2024-04-20T12:32:27.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.023+0000 7fbc241a5740 1 -- start start 2024-04-20T12:32:27.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc241a5740 1 Processor -- start 2024-04-20T12:32:27.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc241a5740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abeae10 0x55cf5abed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc241a5740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeb730 0x55cf5abedbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc241a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abf4310 0x55cf5abee210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc241a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c1b08c0 con 0x55cf5abf4310 2024-04-20T12:32:27.037 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc241a5740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c1b01f0 con 0x55cf5abeb730 2024-04-20T12:32:27.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc241a5740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c1ad420 con 0x55cf5abeae10 2024-04-20T12:32:27.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc241a5740 10 client.0 _ll_register_callbacks cb 0x7fbc0c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:27.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc1b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abf4310 0x55cf5abee210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc1b7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abf4310 0x55cf5abee210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37824/0 (socket says 172.21.15.135:37824) 2024-04-20T12:32:27.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc1b7fe640 1 -- 172.21.15.135:0/3566278937 learned_addr learned my addr 172.21.15.135:0/3566278937 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:27.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc1a7fc640 1 --2- 172.21.15.135:0/3566278937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeb730 0x55cf5abedbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc1affd640 1 --2- 172.21.15.135:0/3566278937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abeae10 0x55cf5abed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc1b7fe640 1 -- 172.21.15.135:0/3566278937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abeae10 msgr2=0x55cf5abed6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc1b7fe640 1 --2- 172.21.15.135:0/3566278937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abeae10 0x55cf5abed6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc1b7fe640 1 -- 172.21.15.135:0/3566278937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeb730 msgr2=0x55cf5abedbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc1b7fe640 1 --2- 172.21.15.135:0/3566278937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeb730 0x55cf5abedbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc1b7fe640 1 -- 172.21.15.135:0/3566278937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf5abeea10 con 0x55cf5abf4310 2024-04-20T12:32:27.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc1a7fc640 1 --2- 172.21.15.135:0/3566278937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeb730 0x55cf5abedbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:27.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc1affd640 1 --2- 172.21.15.135:0/3566278937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abeae10 0x55cf5abed6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:27.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc1b7fe640 1 --2- 172.21.15.135:0/3566278937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abf4310 0x55cf5abee210 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009430 tx=0x7fbc140bdf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5632d58cefb9ff server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbbfeff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:27.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbbfeff5640 1 -- 172.21.15.135:0/3566278937 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc140bea70 con 0x55cf5abf4310 2024-04-20T12:32:27.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbbfeff5640 1 -- 172.21.15.135:0/3566278937 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7fbc140a1e10 con 0x55cf5abf4310 2024-04-20T12:32:27.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc241a5740 1 -- 172.21.15.135:0/3566278937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc0c010c00 con 0x55cf5abf4310 2024-04-20T12:32:27.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbbfeff5640 1 -- 172.21.15.135:0/3566278937 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbc1404b020 con 0x55cf5abf4310 2024-04-20T12:32:27.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc241a5740 10 client.18435 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:27.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.024+0000 7fbc241a5740 1 -- 172.21.15.135:0/3566278937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cf5ac6f3e0 con 0x55cf5abf4310 2024-04-20T12:32:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.025+0000 7fbbfeff5640 1 -- 172.21.15.135:0/3566278937 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc0c010c00 con 0x55cf5abf4310 2024-04-20T12:32:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.025+0000 7fbbfeff5640 1 -- 172.21.15.135:0/3566278937 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fbc140a2230 con 0x55cf5abf4310 2024-04-20T12:32:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.025+0000 7fbc241a5740 10 client.18435 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.025+0000 7fbc241a5740 10 client.18435 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:32:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.025+0000 7fbc241a5740 20 client.18435 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:27.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.025+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3566278937 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55cf5ac6fb00 0x55cf5ac71ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.025+0000 7fbc241a5740 4 client.18435 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:32:27.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.025+0000 7fbc241a5740 1 -- 172.21.15.135:0/3566278937 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cf5ab579a0 con 0x55cf5ac6fb00 2024-04-20T12:32:27.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.025+0000 7fbc1affd640 1 --2- 172.21.15.135:0/3566278937 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55cf5ac6fb00 0x55cf5ac71ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.025+0000 7fbbfeff5640 10 client.18435 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:32:27.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.025+0000 7fbc1affd640 1 --2- 172.21.15.135:0/3566278937 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55cf5ac6fb00 0x55cf5ac71ef0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9a0a6615d97cee0 server_cookie=3bfe5f0202263d6a in_seq=0 out_seq=0 2024-04-20T12:32:27.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbbfeff5640 1 -- 172.21.15.135:0/3566278937 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cf5ab579a0 con 0x55cf5ac6fb00 2024-04-20T12:32:27.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbbfeff5640 10 client.18435 handle_command_reply: tid=0 2024-04-20T12:32:27.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc241a5740 1 client.18435 shutdown 2024-04-20T12:32:27.043 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc241a5740 1 -- 172.21.15.135:0/3566278937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abf4310 msgr2=0x55cf5abee210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3566278937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abf4310 0x55cf5abee210 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009430 tx=0x7fbc140bdf70 comp rx=0 tx=0).stop 2024-04-20T12:32:27.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc241a5740 1 -- 172.21.15.135:0/3566278937 shutdown_connections 2024-04-20T12:32:27.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3566278937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cf5abf4310 0x55cf5abee210 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3566278937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55cf5abeb730 0x55cf5abedbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.044 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3566278937 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55cf5ac6fb00 0x55cf5ac71ef0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc241a5740 1 --2- 172.21.15.135:0/3566278937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55cf5abeae10 0x55cf5abed6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc241a5740 1 -- 172.21.15.135:0/3566278937 >> 172.21.15.135:0/3566278937 conn(0x55cf5abe5540 msgr2=0x55cf5abefc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbbfeff5640 0 client.18435 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:32:27.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc241a5740 1 -- 172.21.15.135:0/3566278937 shutdown_connections 2024-04-20T12:32:27.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc241a5740 1 -- 172.21.15.135:0/3566278937 wait complete. 2024-04-20T12:32:27.045 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc241a5740 20 client.18435 trim_cache size 0 max 16384 2024-04-20T12:32:27.045 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:32:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc215b2640 1 -- 172.21.15.135:0/2044397042 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbc040a3d20 msgr2=0x7fbc040a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc215b2640 1 --2- 172.21.15.135:0/2044397042 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbc040a3d20 0x7fbc040a61e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbc10012880 tx=0x7fbc1000ba90 comp rx=0 tx=0).stop 2024-04-20T12:32:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc215b2640 1 -- 172.21.15.135:0/2044397042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc1c198620 msgr2=0x7fbc1c198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.047 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc215b2640 1 --2- 172.21.15.135:0/2044397042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc1c198620 0x7fbc1c198ad0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009230 tx=0x7fbc1402cbf0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc215b2640 1 -- 172.21.15.135:0/2044397042 shutdown_connections 2024-04-20T12:32:27.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc215b2640 1 --2- 172.21.15.135:0/2044397042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc1c198620 0x7fbc1c198ad0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc215b2640 1 --2- 172.21.15.135:0/2044397042 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbc040a3d20 0x7fbc040a61e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc215b2640 1 --2- 172.21.15.135:0/2044397042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc1c106170 0x7fbc1c19e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc215b2640 1 --2- 172.21.15.135:0/2044397042 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbc1c1010a0 0x7fbc1c19e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc215b2640 1 -- 172.21.15.135:0/2044397042 >> 172.21.15.135:0/2044397042 conn(0x7fbc1c0771e0 msgr2=0x7fbc1c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc215b2640 1 -- 172.21.15.135:0/2044397042 shutdown_connections 2024-04-20T12:32:27.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.026+0000 7fbc215b2640 1 -- 172.21.15.135:0/2044397042 wait complete. 2024-04-20T12:32:27.049 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:32:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.151+0000 7f2879c6d640 1 -- 172.21.15.135:0/3265102690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28741021b0 msgr2=0x7f2874102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.151+0000 7f2879c6d640 1 --2- 172.21.15.135:0/3265102690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28741021b0 0x7f2874102590 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f2864009900 tx=0x7f286402bc30 comp rx=0 tx=0).stop 2024-04-20T12:32:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.151+0000 7f2879c6d640 1 -- 172.21.15.135:0/3265102690 shutdown_connections 2024-04-20T12:32:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.151+0000 7f2879c6d640 1 --2- 172.21.15.135:0/3265102690 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2874107280 0x7f287410ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.152 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.151+0000 7f2879c6d640 1 --2- 172.21.15.135:0/3265102690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874102b60 0x7f2874106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.151+0000 7f2879c6d640 1 --2- 172.21.15.135:0/3265102690 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f28741021b0 0x7f2874102590 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.151+0000 7f2879c6d640 1 -- 172.21.15.135:0/3265102690 >> 172.21.15.135:0/3265102690 conn(0x7f28740793f0 msgr2=0x7f2874079800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.151+0000 7f2879c6d640 1 -- 172.21.15.135:0/3265102690 shutdown_connections 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.151+0000 7f2879c6d640 1 -- 172.21.15.135:0/3265102690 wait complete. 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2879c6d640 1 Processor -- start 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2879c6d640 1 -- start start 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2879c6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874107280 0x7f287419e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2879c6d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f287419ec00 0x7f2874198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2879c6d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2874198d70 0x7f28741991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2879c6d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2874112360 con 0x7f2874198d70 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2879c6d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f28741121e0 con 0x7f287419ec00 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2879c6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f28741124e0 con 0x7f2874107280 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2873fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2874198d70 0x7f28741991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2873fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2874198d70 0x7f28741991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37844/0 (socket says 172.21.15.135:37844) 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2873fff640 1 -- 172.21.15.135:0/1692394157 learned_addr learned my addr 172.21.15.135:0/1692394157 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:27.153 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2872ffd640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f287419ec00 0x7f2874198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f28737fe640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874107280 0x7f287419e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2873fff640 1 -- 172.21.15.135:0/1692394157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874107280 msgr2=0x7f287419e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2873fff640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874107280 0x7f287419e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2873fff640 1 -- 172.21.15.135:0/1692394157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f287419ec00 msgr2=0x7f2874198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2873fff640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f287419ec00 0x7f2874198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2873fff640 1 -- 172.21.15.135:0/1692394157 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28741a5510 con 0x7f2874198d70 2024-04-20T12:32:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f28737fe640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874107280 0x7f287419e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.152+0000 7f2872ffd640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f287419ec00 0x7f2874198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.153+0000 7f2873fff640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2874198d70 0x7f28741991f0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f286c00eaa0 tx=0x7f286c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.153+0000 7f2870ff9640 1 -- 172.21.15.135:0/1692394157 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c00cdb0 con 0x7f2874198d70 2024-04-20T12:32:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.153+0000 7f2879c6d640 1 -- 172.21.15.135:0/1692394157 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28741a5740 con 0x7f2874198d70 2024-04-20T12:32:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.153+0000 7f2870ff9640 1 -- 172.21.15.135:0/1692394157 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f286c005020 con 0x7f2874198d70 2024-04-20T12:32:27.154 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.153+0000 7f2870ff9640 1 -- 172.21.15.135:0/1692394157 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286c0116b0 con 0x7f2874198d70 2024-04-20T12:32:27.155 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.153+0000 7f2879c6d640 1 -- 172.21.15.135:0/1692394157 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28741a5c90 con 0x7f2874198d70 2024-04-20T12:32:27.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.155+0000 7f2870ff9640 1 -- 172.21.15.135:0/1692394157 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f286c005560 con 0x7f2874198d70 2024-04-20T12:32:27.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.155+0000 7f287c865740 1 Processor -- start 2024-04-20T12:32:27.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.155+0000 7f287c865740 1 -- start start 2024-04-20T12:32:27.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.155+0000 7f287c865740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9bfe10 0x55ee4e9c01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.155+0000 7f287c865740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 0x55ee4e9c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.155+0000 7f287c865740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.162 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.155+0000 7f287c865740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ee4e925110 con 0x55ee4e9c9310 2024-04-20T12:32:27.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.155+0000 7f287c865740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee4e8c2550 con 0x55ee4e9bfe10 2024-04-20T12:32:27.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.155+0000 7f287c865740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ee4e9210d0 con 0x55ee4e9c0730 2024-04-20T12:32:27.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2872ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2872ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37860/0 (socket says 172.21.15.135:37860) 2024-04-20T12:32:27.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2872ffd640 1 -- 172.21.15.135:0/904477744 learned_addr learned my addr 172.21.15.135:0/904477744 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:27.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2870ff9640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f285c0a3d20 0x7f285c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2872ffd640 1 --2- 172.21.15.135:0/904477744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9bfe10 0x55ee4e9c01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f28737fe640 1 --2- 172.21.15.135:0/904477744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 0x55ee4e9c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2873fff640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f285c0a3d20 0x7f285c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.163 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2872ffd640 1 -- 172.21.15.135:0/904477744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 msgr2=0x55ee4e9c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2872ffd640 1 --2- 172.21.15.135:0/904477744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 0x55ee4e9c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2872ffd640 1 -- 172.21.15.135:0/904477744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9bfe10 msgr2=0x55ee4e9c01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2872ffd640 1 --2- 172.21.15.135:0/904477744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9bfe10 0x55ee4e9c01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2872ffd640 1 -- 172.21.15.135:0/904477744 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee4e8ea900 con 0x55ee4e9c9310 2024-04-20T12:32:27.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2870ff9640 1 -- 172.21.15.135:0/1692394157 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f286c0d0ed0 con 0x7f2874198d70 2024-04-20T12:32:27.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2872ffd640 1 --2- 172.21.15.135:0/904477744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9cb700 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f28680149f0 tx=0x7f286800b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd77140d53dceaf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2873fff640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f285c0a3d20 0x7f285c0a61e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f286c09c7a0 tx=0x7f286c06b450 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2859ffb640 1 -- 172.21.15.135:0/904477744 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28680142d0 con 0x55ee4e9c9310 2024-04-20T12:32:27.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2859ffb640 1 -- 172.21.15.135:0/904477744 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2868005020 con 0x55ee4e9c9310 2024-04-20T12:32:27.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.156+0000 7f2859ffb640 1 -- 172.21.15.135:0/904477744 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2868004b00 con 0x55ee4e9c9310 2024-04-20T12:32:27.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.157+0000 7f287c865740 1 -- 172.21.15.135:0/904477744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 msgr2=0x55ee4e9cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.164 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.157+0000 7f287c865740 1 --2- 172.21.15.135:0/904477744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9cb700 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f28680149f0 tx=0x7f286800b540 comp rx=0 tx=0).stop 2024-04-20T12:32:27.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.157+0000 7f287c865740 1 -- 172.21.15.135:0/904477744 shutdown_connections 2024-04-20T12:32:27.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.157+0000 7f287c865740 1 --2- 172.21.15.135:0/904477744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9cb700 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.157+0000 7f287c865740 1 --2- 172.21.15.135:0/904477744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 0x55ee4e9c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.157+0000 7f287c865740 1 --2- 172.21.15.135:0/904477744 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9bfe10 0x55ee4e9c01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.157+0000 7f287c865740 1 -- 172.21.15.135:0/904477744 >> 172.21.15.135:0/904477744 conn(0x55ee4e9ba540 msgr2=0x55ee4e9ba920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.157+0000 7f287c865740 1 -- 172.21.15.135:0/904477744 shutdown_connections 2024-04-20T12:32:27.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.157+0000 7f287c865740 1 -- 172.21.15.135:0/904477744 wait complete. 2024-04-20T12:32:27.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.157+0000 7f287c865740 1 -- start start 2024-04-20T12:32:27.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f287c865740 1 Processor -- start 2024-04-20T12:32:27.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f287c865740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9bfe10 0x55ee4e9c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.165 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f287c865740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 0x55ee4e9c6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f287c865740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f287c865740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ee4e9cc0a0 con 0x55ee4e9c9310 2024-04-20T12:32:27.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f287c865740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ee4e8de500 con 0x55ee4e9bfe10 2024-04-20T12:32:27.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f287c865740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ee4e9cc220 con 0x55ee4e9c0730 2024-04-20T12:32:27.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f287c865740 10 client.0 _ll_register_callbacks cb 0x55ee4e8c32f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:27.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f2872ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f2872ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37872/0 (socket says 172.21.15.135:37872) 2024-04-20T12:32:27.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f2872ffd640 1 -- 172.21.15.135:0/1850482879 learned_addr learned my addr 172.21.15.135:0/1850482879 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:27.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f2872ffd640 1 --2- 172.21.15.135:0/1850482879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9bfe10 0x55ee4e9c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f28737fe640 1 --2- 172.21.15.135:0/1850482879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 0x55ee4e9c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f2872ffd640 1 -- 172.21.15.135:0/1850482879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 msgr2=0x55ee4e9c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.166 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f2872ffd640 1 --2- 172.21.15.135:0/1850482879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 0x55ee4e9c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f2872ffd640 1 -- 172.21.15.135:0/1850482879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9bfe10 msgr2=0x55ee4e9c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f2872ffd640 1 --2- 172.21.15.135:0/1850482879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9bfe10 0x55ee4e9c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f2872ffd640 1 -- 172.21.15.135:0/1850482879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee4e6373f0 con 0x55ee4e9c9310 2024-04-20T12:32:27.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f2872ffd640 1 --2- 172.21.15.135:0/1850482879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9c6e50 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f2868001eb0 tx=0x7f28680045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf4d6de48bd7b5d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.158+0000 7f2852ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:27.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.159+0000 7f2852ffd640 1 -- 172.21.15.135:0/1850482879 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2868004ab0 con 0x55ee4e9c9310 2024-04-20T12:32:27.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.159+0000 7f2852ffd640 1 -- 172.21.15.135:0/1850482879 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f2868004c50 con 0x55ee4e9c9310 2024-04-20T12:32:27.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.159+0000 7f287c865740 1 -- 172.21.15.135:0/1850482879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2868005020 con 0x55ee4e9c9310 2024-04-20T12:32:27.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.159+0000 7f2852ffd640 1 -- 172.21.15.135:0/1850482879 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2868004e50 con 0x55ee4e9c9310 2024-04-20T12:32:27.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.159+0000 7f287c865740 10 client.18447 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:27.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.159+0000 7f287c865740 1 -- 172.21.15.135:0/1850482879 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ee4e7017d0 con 0x55ee4e9c9310 2024-04-20T12:32:27.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.159+0000 7f2852ffd640 1 -- 172.21.15.135:0/1850482879 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2868005020 con 0x55ee4e9c9310 2024-04-20T12:32:27.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.159+0000 7f2852ffd640 1 -- 172.21.15.135:0/1850482879 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f28680126f0 con 0x55ee4e9c9310 2024-04-20T12:32:27.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.159+0000 7f287c865740 10 client.18447 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:27.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.159+0000 7f287c865740 10 client.18447 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:32:27.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.159+0000 7f287c865740 20 client.18447 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:27.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.159+0000 7f287c865740 1 --2- 172.21.15.135:0/1850482879 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ee4e9d9580 0x55ee4e9db970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.159+0000 7f287c865740 4 client.18447 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:32:27.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.159+0000 7f287c865740 1 -- 172.21.15.135:0/1850482879 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee4e932b30 con 0x55ee4e9d9580 2024-04-20T12:32:27.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.159+0000 7f28737fe640 1 --2- 172.21.15.135:0/1850482879 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ee4e9d9580 0x55ee4e9db970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.160+0000 7f28737fe640 1 --2- 172.21.15.135:0/1850482879 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ee4e9d9580 0x55ee4e9db970 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=814fc690b3ada774 server_cookie=fb797d935c649b39 in_seq=0 out_seq=0 2024-04-20T12:32:27.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.160+0000 7f2852ffd640 10 client.18447 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:32:27.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.160+0000 7f2852ffd640 1 -- 172.21.15.135:0/1850482879 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ee4e932b30 con 0x55ee4e9d9580 2024-04-20T12:32:27.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.161+0000 7f2852ffd640 10 client.18447 handle_command_reply: tid=0 2024-04-20T12:32:27.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.161+0000 7f287c865740 1 client.18447 shutdown 2024-04-20T12:32:27.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.161+0000 7f287c865740 1 -- 172.21.15.135:0/1850482879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 msgr2=0x55ee4e9c6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.161+0000 7f287c865740 1 --2- 172.21.15.135:0/1850482879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9c6e50 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f2868001eb0 tx=0x7f28680045b0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.161+0000 7f287c865740 1 -- 172.21.15.135:0/1850482879 shutdown_connections 2024-04-20T12:32:27.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.161+0000 7f287c865740 1 --2- 172.21.15.135:0/1850482879 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ee4e9d9580 0x55ee4e9db970 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.161+0000 7f287c865740 1 --2- 172.21.15.135:0/1850482879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9c6e50 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.161+0000 7f287c865740 1 --2- 172.21.15.135:0/1850482879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 0x55ee4e9c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.161+0000 7f2852ffd640 0 client.18447 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:32:27.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.161+0000 7f287c865740 1 --2- 172.21.15.135:0/1850482879 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9bfe10 0x55ee4e9c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.161+0000 7f287c865740 1 -- 172.21.15.135:0/1850482879 >> 172.21.15.135:0/1850482879 conn(0x55ee4e9ba540 msgr2=0x55ee4e9bc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.161+0000 7f287c865740 1 -- 172.21.15.135:0/1850482879 shutdown_connections 2024-04-20T12:32:27.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.161+0000 7f287c865740 1 -- 172.21.15.135:0/1850482879 wait complete. 2024-04-20T12:32:27.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.161+0000 7f287c865740 20 client.18447 trim_cache size 0 max 16384 2024-04-20T12:32:27.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f287c865740 1 Processor -- start 2024-04-20T12:32:27.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f287c865740 1 -- start start 2024-04-20T12:32:27.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f287c865740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9bfe10 0x55ee4e9c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f287c865740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9c0730 0x55ee4e9c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f287c865740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9e1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f287c865740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f28741afb80 con 0x55ee4e9c9310 2024-04-20T12:32:27.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f287c865740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f28741b16c0 con 0x55ee4e9c0730 2024-04-20T12:32:27.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f287c865740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f28741b0250 con 0x55ee4e9bfe10 2024-04-20T12:32:27.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f2872ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9e1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f2872ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9e1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37880/0 (socket says 172.21.15.135:37880) 2024-04-20T12:32:27.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f2872ffd640 1 -- 172.21.15.135:0/272180644 learned_addr learned my addr 172.21.15.135:0/272180644 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:27.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f2872ffd640 1 --2- 172.21.15.135:0/272180644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9bfe10 0x55ee4e9c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f2872ffd640 1 -- 172.21.15.135:0/272180644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9bfe10 msgr2=0x55ee4e9c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f2872ffd640 1 --2- 172.21.15.135:0/272180644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9bfe10 0x55ee4e9c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f2872ffd640 1 -- 172.21.15.135:0/272180644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9c0730 msgr2=0x55ee4e9c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.174+0000 7f28737fe640 1 --2- 172.21.15.135:0/272180644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9c0730 0x55ee4e9c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f2872ffd640 1 --2- 172.21.15.135:0/272180644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9c0730 0x55ee4e9c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f2872ffd640 1 -- 172.21.15.135:0/272180644 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee4e9cb700 con 0x55ee4e9c9310 2024-04-20T12:32:27.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f28737fe640 1 --2- 172.21.15.135:0/272180644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9c0730 0x55ee4e9c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:27.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f2872ffd640 1 --2- 172.21.15.135:0/272180644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9e1060 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f286800bdd0 tx=0x7f2868024040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7cdc33aaca192f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f28597fa640 1 -- 172.21.15.135:0/272180644 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286800b9e0 con 0x55ee4e9c9310 2024-04-20T12:32:27.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f28597fa640 1 -- 172.21.15.135:0/272180644 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f286800fe80 con 0x55ee4e9c9310 2024-04-20T12:32:27.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f28597fa640 1 -- 172.21.15.135:0/272180644 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2868005180 con 0x55ee4e9c9310 2024-04-20T12:32:27.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f287c865740 1 -- 172.21.15.135:0/272180644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 msgr2=0x55ee4e9e1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f287c865740 1 --2- 172.21.15.135:0/272180644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9e1060 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f286800bdd0 tx=0x7f2868024040 comp rx=0 tx=0).stop 2024-04-20T12:32:27.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f287c865740 1 -- 172.21.15.135:0/272180644 shutdown_connections 2024-04-20T12:32:27.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f287c865740 1 --2- 172.21.15.135:0/272180644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9e1060 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f287c865740 1 --2- 172.21.15.135:0/272180644 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9c0730 0x55ee4e9c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f287c865740 1 --2- 172.21.15.135:0/272180644 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9bfe10 0x55ee4e9c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.182 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f287c865740 1 -- 172.21.15.135:0/272180644 >> 172.21.15.135:0/272180644 conn(0x55ee4e9ba540 msgr2=0x55ee4e9b96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f287c865740 1 -- 172.21.15.135:0/272180644 shutdown_connections 2024-04-20T12:32:27.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.175+0000 7f287c865740 1 -- 172.21.15.135:0/272180644 wait complete. 2024-04-20T12:32:27.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f287c865740 1 -- start start 2024-04-20T12:32:27.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f287c865740 1 Processor -- start 2024-04-20T12:32:27.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f287c865740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9bfe10 0x55ee4e9cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f287c865740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 0x55ee4e9cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f287c865740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f287c865740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f28741b0ff0 con 0x55ee4e9c9310 2024-04-20T12:32:27.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f287c865740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f28741b0920 con 0x55ee4e9bfe10 2024-04-20T12:32:27.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f287c865740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f28741adb50 con 0x55ee4e9c0730 2024-04-20T12:32:27.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f287c865740 10 client.0 _ll_register_callbacks cb 0x7f2868014470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:27.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f2872ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f2872ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37888/0 (socket says 172.21.15.135:37888) 2024-04-20T12:32:27.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f2872ffd640 1 -- 172.21.15.135:0/973395795 learned_addr learned my addr 172.21.15.135:0/973395795 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:27.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f28737fe640 1 --2- 172.21.15.135:0/973395795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 0x55ee4e9cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f2872ffd640 1 -- 172.21.15.135:0/973395795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 msgr2=0x55ee4e9cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f2872ffd640 1 --2- 172.21.15.135:0/973395795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 0x55ee4e9cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f2872ffd640 1 -- 172.21.15.135:0/973395795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9bfe10 msgr2=0x55ee4e9cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f2872ffd640 1 --2- 172.21.15.135:0/973395795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9bfe10 0x55ee4e9cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f2872ffd640 1 -- 172.21.15.135:0/973395795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee4ea41dd0 con 0x55ee4e9c9310 2024-04-20T12:32:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.176+0000 7f28737fe640 1 --2- 172.21.15.135:0/973395795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 0x55ee4e9cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f2872ffd640 1 --2- 172.21.15.135:0/973395795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9cceb0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2868005fd0 tx=0x7f2868014700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62257fad8f2e5d92 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f2852ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f2852ffd640 1 -- 172.21.15.135:0/973395795 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2868005160 con 0x55ee4e9c9310 2024-04-20T12:32:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f2852ffd640 1 -- 172.21.15.135:0/973395795 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f286800b720 con 0x55ee4e9c9310 2024-04-20T12:32:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f287c865740 1 -- 172.21.15.135:0/973395795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee4e92c9a0 con 0x55ee4e9c9310 2024-04-20T12:32:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f2852ffd640 1 -- 172.21.15.135:0/973395795 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2868012660 con 0x55ee4e9c9310 2024-04-20T12:32:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f287c865740 10 client.18453 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:27.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f287c865740 1 -- 172.21.15.135:0/973395795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ee4ea43040 con 0x55ee4e9c9310 2024-04-20T12:32:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f2852ffd640 1 -- 172.21.15.135:0/973395795 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ee4e92c9a0 con 0x55ee4e9c9310 2024-04-20T12:32:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f2852ffd640 1 -- 172.21.15.135:0/973395795 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2868041030 con 0x55ee4e9c9310 2024-04-20T12:32:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f287c865740 10 client.18453 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f287c865740 10 client.18453 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:32:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f287c865740 20 client.18453 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f287c865740 1 --2- 172.21.15.135:0/973395795 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ee4e9d9580 0x55ee4ea45570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f287c865740 4 client.18453 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:32:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.177+0000 7f287c865740 1 -- 172.21.15.135:0/973395795 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ee4e8a86e0 con 0x55ee4e9d9580 2024-04-20T12:32:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f28737fe640 1 --2- 172.21.15.135:0/973395795 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ee4e9d9580 0x55ee4ea45570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f28737fe640 1 --2- 172.21.15.135:0/973395795 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ee4e9d9580 0x55ee4ea45570 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8b8c270b8e808682 server_cookie=f0c13c24f9a61ac9 in_seq=0 out_seq=0 2024-04-20T12:32:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f2852ffd640 10 client.18453 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:32:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f2852ffd640 1 -- 172.21.15.135:0/973395795 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ee4e8a86e0 con 0x55ee4e9d9580 2024-04-20T12:32:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f2852ffd640 10 client.18453 handle_command_reply: tid=0 2024-04-20T12:32:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f287c865740 1 client.18453 shutdown 2024-04-20T12:32:27.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f287c865740 1 -- 172.21.15.135:0/973395795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 msgr2=0x55ee4e9cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f287c865740 1 --2- 172.21.15.135:0/973395795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9cceb0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f2868005fd0 tx=0x7f2868014700 comp rx=0 tx=0).stop 2024-04-20T12:32:27.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f287c865740 1 -- 172.21.15.135:0/973395795 shutdown_connections 2024-04-20T12:32:27.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f287c865740 1 --2- 172.21.15.135:0/973395795 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55ee4e9d9580 0x55ee4ea45570 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f287c865740 1 --2- 172.21.15.135:0/973395795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee4e9c9310 0x55ee4e9cceb0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f2852ffd640 0 client.18453 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:32:27.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f287c865740 1 --2- 172.21.15.135:0/973395795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ee4e9c0730 0x55ee4e9cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f287c865740 1 --2- 172.21.15.135:0/973395795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ee4e9bfe10 0x55ee4e9cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f287c865740 1 -- 172.21.15.135:0/973395795 >> 172.21.15.135:0/973395795 conn(0x55ee4e9ba540 msgr2=0x55ee4e9c6390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f287c865740 1 -- 172.21.15.135:0/973395795 shutdown_connections 2024-04-20T12:32:27.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.178+0000 7f287c865740 1 -- 172.21.15.135:0/973395795 wait complete. 2024-04-20T12:32:27.187 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.179+0000 7f287c865740 20 client.18453 trim_cache size 0 max 16384 2024-04-20T12:32:27.188 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:32:27.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.179+0000 7f2879c6d640 1 -- 172.21.15.135:0/1692394157 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f285c0a3d20 msgr2=0x7f285c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.188 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.179+0000 7f2879c6d640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f285c0a3d20 0x7f285c0a61e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f286c09c7a0 tx=0x7f286c06b450 comp rx=0 tx=0).stop 2024-04-20T12:32:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.179+0000 7f2879c6d640 1 -- 172.21.15.135:0/1692394157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2874198d70 msgr2=0x7f28741991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.179+0000 7f2879c6d640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2874198d70 0x7f28741991f0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f286c00eaa0 tx=0x7f286c00ef60 comp rx=0 tx=0).stop 2024-04-20T12:32:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.179+0000 7f2879c6d640 1 -- 172.21.15.135:0/1692394157 shutdown_connections 2024-04-20T12:32:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.179+0000 7f2879c6d640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2874198d70 0x7f28741991f0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.179+0000 7f2879c6d640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f287419ec00 0x7f2874198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.179+0000 7f2879c6d640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f285c0a3d20 0x7f285c0a61e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.179+0000 7f2879c6d640 1 --2- 172.21.15.135:0/1692394157 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2874107280 0x7f287419e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.179+0000 7f2879c6d640 1 -- 172.21.15.135:0/1692394157 >> 172.21.15.135:0/1692394157 conn(0x7f28740793f0 msgr2=0x7f28740ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.179+0000 7f2879c6d640 1 -- 172.21.15.135:0/1692394157 shutdown_connections 2024-04-20T12:32:27.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.179+0000 7f2879c6d640 1 -- 172.21.15.135:0/1692394157 wait complete. 2024-04-20T12:32:27.189 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:27 smithi135 ceph-mon[18264]: pgmap v288: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-20T12:32:27.190 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:27 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1288178164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:32:27.190 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:32:27.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.293+0000 7f1508985640 1 -- 172.21.15.135:0/1545775159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1504108070 msgr2=0x7f1504108450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.293+0000 7f1508985640 1 --2- 172.21.15.135:0/1545775159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1504108070 0x7f1504108450 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009930 tx=0x7f14f402bc30 comp rx=0 tx=0).stop 2024-04-20T12:32:27.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.293+0000 7f1508985640 1 -- 172.21.15.135:0/1545775159 shutdown_connections 2024-04-20T12:32:27.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.293+0000 7f1508985640 1 --2- 172.21.15.135:0/1545775159 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150406af80 0x7f150410edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.293+0000 7f1508985640 1 --2- 172.21.15.135:0/1545775159 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f150406a5c0 0x7f150406aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.293+0000 7f1508985640 1 --2- 172.21.15.135:0/1545775159 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1504108070 0x7f1504108450 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.293+0000 7f1508985640 1 -- 172.21.15.135:0/1545775159 >> 172.21.15.135:0/1545775159 conn(0x7f1504077c50 msgr2=0x7f1504078060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.293+0000 7f1508985640 1 -- 172.21.15.135:0/1545775159 shutdown_connections 2024-04-20T12:32:27.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.293+0000 7f1508985640 1 -- 172.21.15.135:0/1545775159 wait complete. 2024-04-20T12:32:27.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1508985640 1 Processor -- start 2024-04-20T12:32:27.294 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1508985640 1 -- start start 2024-04-20T12:32:27.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1508985640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f150406a5c0 0x7f1504198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1508985640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150406af80 0x7f1504198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1508985640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1504108070 0x7f150419d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1508985640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1504112300 con 0x7f1504108070 2024-04-20T12:32:27.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1508985640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f1504112180 con 0x7f150406a5c0 2024-04-20T12:32:27.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1508985640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f1504112480 con 0x7f150406af80 2024-04-20T12:32:27.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1502d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1504108070 0x7f150419d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1502d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1504108070 0x7f150419d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37914/0 (socket says 172.21.15.135:37914) 2024-04-20T12:32:27.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1502d9d640 1 -- 172.21.15.135:0/1028213478 learned_addr learned my addr 172.21.15.135:0/1028213478 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:27.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f150259c640 1 --2- 172.21.15.135:0/1028213478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f150406a5c0 0x7f1504198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1501d9b640 1 --2- 172.21.15.135:0/1028213478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150406af80 0x7f1504198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.295 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1502d9d640 1 -- 172.21.15.135:0/1028213478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150406af80 msgr2=0x7f1504198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1502d9d640 1 --2- 172.21.15.135:0/1028213478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150406af80 0x7f1504198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1502d9d640 1 -- 172.21.15.135:0/1028213478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f150406a5c0 msgr2=0x7f1504198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1502d9d640 1 --2- 172.21.15.135:0/1028213478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f150406a5c0 0x7f1504198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1502d9d640 1 -- 172.21.15.135:0/1028213478 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150419d750 con 0x7f1504108070 2024-04-20T12:32:27.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.294+0000 7f1502d9d640 1 --2- 172.21.15.135:0/1028213478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1504108070 0x7f150419d020 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00eaa0 tx=0x7f14fc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.295+0000 7f14f37fe640 1 -- 172.21.15.135:0/1028213478 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc00cdb0 con 0x7f1504108070 2024-04-20T12:32:27.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.295+0000 7f14f37fe640 1 -- 172.21.15.135:0/1028213478 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14fc005020 con 0x7f1504108070 2024-04-20T12:32:27.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.295+0000 7f14f37fe640 1 -- 172.21.15.135:0/1028213478 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0116b0 con 0x7f1504108070 2024-04-20T12:32:27.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.295+0000 7f1508985640 1 -- 172.21.15.135:0/1028213478 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f150419da40 con 0x7f1504108070 2024-04-20T12:32:27.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.295+0000 7f1508985640 1 -- 172.21.15.135:0/1028213478 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15041a52d0 con 0x7f1504108070 2024-04-20T12:32:27.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.297+0000 7f14f37fe640 1 -- 172.21.15.135:0/1028213478 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f14fc005560 con 0x7f1504108070 2024-04-20T12:32:27.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.297+0000 7f150b571740 1 Processor -- start 2024-04-20T12:32:27.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.297+0000 7f150b571740 1 -- start start 2024-04-20T12:32:27.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f150b571740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d74e10 0x5597e8d751f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f150b571740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d7ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f150b571740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d7e310 0x5597e8d80700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f150b571740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5597e8cda110 con 0x5597e8d74e10 2024-04-20T12:32:27.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f150b571740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5597e8c77550 con 0x5597e8d75730 2024-04-20T12:32:27.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f150b571740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5597e8cd60d0 con 0x5597e8d7e310 2024-04-20T12:32:27.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f14f37fe640 1 --2- 172.21.15.135:0/1028213478 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f14ec0a3d20 0x7f14ec0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f1501d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d74e10 0x5597e8d751f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f1501d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d74e10 0x5597e8d751f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37918/0 (socket says 172.21.15.135:37918) 2024-04-20T12:32:27.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f1501d9b640 1 -- 172.21.15.135:0/1061616130 learned_addr learned my addr 172.21.15.135:0/1061616130 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:27.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f150259c640 1 --2- 172.21.15.135:0/1061616130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d7ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f1502d9d640 1 --2- 172.21.15.135:0/1028213478 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f14ec0a3d20 0x7f14ec0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f1501d9b640 1 -- 172.21.15.135:0/1061616130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d7e310 msgr2=0x5597e8d80700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f14f37fe640 1 -- 172.21.15.135:0/1028213478 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f14fc0d0d80 con 0x7f1504108070 2024-04-20T12:32:27.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f1501d9b640 1 --2- 172.21.15.135:0/1061616130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d7e310 0x5597e8d80700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f1501d9b640 1 -- 172.21.15.135:0/1061616130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 msgr2=0x5597e8d7ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f1501d9b640 1 --2- 172.21.15.135:0/1061616130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d7ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f1501d9b640 1 -- 172.21.15.135:0/1061616130 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597e8c9f900 con 0x5597e8d74e10 2024-04-20T12:32:27.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f150259c640 1 --2- 172.21.15.135:0/1061616130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d7ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:32:27.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f1501d9b640 1 --2- 172.21.15.135:0/1061616130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d74e10 0x5597e8d751f0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f14f800ccd0 tx=0x7f14f8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40a02300a05e754 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f1502d9d640 1 --2- 172.21.15.135:0/1028213478 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f14ec0a3d20 0x7f14ec0a61e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f14fc09c650 tx=0x7f14fc0bd040 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.298+0000 7f14f0ff9640 1 -- 172.21.15.135:0/1061616130 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8016070 con 0x5597e8d74e10 2024-04-20T12:32:27.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.299+0000 7f14f0ff9640 1 -- 172.21.15.135:0/1061616130 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14f8012b60 con 0x5597e8d74e10 2024-04-20T12:32:27.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.299+0000 7f14f0ff9640 1 -- 172.21.15.135:0/1061616130 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8011c10 con 0x5597e8d74e10 2024-04-20T12:32:27.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.299+0000 7f150b571740 1 -- 172.21.15.135:0/1061616130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d74e10 msgr2=0x5597e8d751f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.299+0000 7f150b571740 1 --2- 172.21.15.135:0/1061616130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d74e10 0x5597e8d751f0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f14f800ccd0 tx=0x7f14f8010740 comp rx=0 tx=0).stop 2024-04-20T12:32:27.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.299+0000 7f150b571740 1 -- 172.21.15.135:0/1061616130 shutdown_connections 2024-04-20T12:32:27.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.299+0000 7f150b571740 1 --2- 172.21.15.135:0/1061616130 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d7e310 0x5597e8d80700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.299+0000 7f150b571740 1 --2- 172.21.15.135:0/1061616130 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d7ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.299+0000 7f150b571740 1 --2- 172.21.15.135:0/1061616130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d74e10 0x5597e8d751f0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.299+0000 7f150b571740 1 -- 172.21.15.135:0/1061616130 >> 172.21.15.135:0/1061616130 conn(0x5597e8d6f540 msgr2=0x5597e8d6f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.299+0000 7f150b571740 1 -- 172.21.15.135:0/1061616130 shutdown_connections 2024-04-20T12:32:27.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.299+0000 7f150b571740 1 -- 172.21.15.135:0/1061616130 wait complete. 2024-04-20T12:32:27.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f150b571740 1 -- start start 2024-04-20T12:32:27.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f150b571740 1 Processor -- start 2024-04-20T12:32:27.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f150b571740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d74e10 0x5597e8d7b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f150b571740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d7bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f150b571740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d7e310 0x5597e8d8a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f150b571740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5597e8d80fe0 con 0x5597e8d74e10 2024-04-20T12:32:27.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f150b571740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5597e8c93500 con 0x5597e8d75730 2024-04-20T12:32:27.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f150b571740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5597e8d81160 con 0x5597e8d7e310 2024-04-20T12:32:27.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f150b571740 10 client.0 _ll_register_callbacks cb 0x5597e8c782f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:27.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f1501d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d74e10 0x5597e8d7b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f1501d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d74e10 0x5597e8d7b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37920/0 (socket says 172.21.15.135:37920) 2024-04-20T12:32:27.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f1501d9b640 1 -- 172.21.15.135:0/373654838 learned_addr learned my addr 172.21.15.135:0/373654838 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:27.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f150259c640 1 --2- 172.21.15.135:0/373654838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d7bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f1501d9b640 1 -- 172.21.15.135:0/373654838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d7e310 msgr2=0x5597e8d8a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f1501d9b640 1 --2- 172.21.15.135:0/373654838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d7e310 0x5597e8d8a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f1501d9b640 1 -- 172.21.15.135:0/373654838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 msgr2=0x5597e8d7bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f1501d9b640 1 --2- 172.21.15.135:0/373654838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d7bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f1501d9b640 1 -- 172.21.15.135:0/373654838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597e89ec3f0 con 0x5597e8d74e10 2024-04-20T12:32:27.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f150259c640 1 --2- 172.21.15.135:0/373654838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d7bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:27.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.300+0000 7f1501d9b640 1 --2- 172.21.15.135:0/373654838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d74e10 0x5597e8d7b590 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f14f80118d0 tx=0x7f14f8012f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4f9f44578af0b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f14e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:27.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f14e9ffb640 1 -- 172.21.15.135:0/373654838 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8016030 con 0x5597e8d74e10 2024-04-20T12:32:27.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f150b571740 1 -- 172.21.15.135:0/373654838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14f8012b60 con 0x5597e8d74e10 2024-04-20T12:32:27.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f14e9ffb640 1 -- 172.21.15.135:0/373654838 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f14f8004320 con 0x5597e8d74e10 2024-04-20T12:32:27.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f14e9ffb640 1 -- 172.21.15.135:0/373654838 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f14f80119b0 con 0x5597e8d74e10 2024-04-20T12:32:27.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f150b571740 10 client.18465 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:27.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f150b571740 1 -- 172.21.15.135:0/373654838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5597e8ab67d0 con 0x5597e8d74e10 2024-04-20T12:32:27.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f14e9ffb640 1 -- 172.21.15.135:0/373654838 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14f8012b60 con 0x5597e8d74e10 2024-04-20T12:32:27.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f14e9ffb640 1 -- 172.21.15.135:0/373654838 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f14f8005160 con 0x5597e8d74e10 2024-04-20T12:32:27.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f150b571740 10 client.18465 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:27.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f150b571740 10 client.18465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:32:27.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f150b571740 20 client.18465 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:27.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f150b571740 1 --2- 172.21.15.135:0/373654838 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5597e8d8e6e0 0x5597e8d90ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f150b571740 4 client.18465 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:32:27.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f150b571740 1 -- 172.21.15.135:0/373654838 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597e8ce7b30 con 0x5597e8d8e6e0 2024-04-20T12:32:27.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.301+0000 7f150259c640 1 --2- 172.21.15.135:0/373654838 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5597e8d8e6e0 0x5597e8d90ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.302+0000 7f14e9ffb640 10 client.18465 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:27.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.302+0000 7f150259c640 1 --2- 172.21.15.135:0/373654838 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5597e8d8e6e0 0x5597e8d90ad0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4269f93d6d5a2d server_cookie=31930c2c93bd0083 in_seq=0 out_seq=0 2024-04-20T12:32:27.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.302+0000 7f14e9ffb640 1 -- 172.21.15.135:0/373654838 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5597e8ce7b30 con 0x5597e8d8e6e0 2024-04-20T12:32:27.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.302+0000 7f14e9ffb640 10 client.18465 handle_command_reply: tid=0 2024-04-20T12:32:27.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.302+0000 7f150b571740 1 client.18465 shutdown 2024-04-20T12:32:27.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.303+0000 7f150b571740 1 -- 172.21.15.135:0/373654838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d74e10 msgr2=0x5597e8d7b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.303+0000 7f150b571740 1 --2- 172.21.15.135:0/373654838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d74e10 0x5597e8d7b590 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f14f80118d0 tx=0x7f14f8012f20 comp rx=0 tx=0).stop 2024-04-20T12:32:27.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.303+0000 7f150b571740 1 -- 172.21.15.135:0/373654838 shutdown_connections 2024-04-20T12:32:27.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.303+0000 7f150b571740 1 --2- 172.21.15.135:0/373654838 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5597e8d8e6e0 0x5597e8d90ad0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.303+0000 7f150b571740 1 --2- 172.21.15.135:0/373654838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d7e310 0x5597e8d8a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.303+0000 7f150b571740 1 --2- 172.21.15.135:0/373654838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d7bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.303+0000 7f14e9ffb640 0 client.18465 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:27.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.303+0000 7f150b571740 1 --2- 172.21.15.135:0/373654838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d74e10 0x5597e8d7b590 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.303+0000 7f150b571740 1 -- 172.21.15.135:0/373654838 >> 172.21.15.135:0/373654838 conn(0x5597e8d6f540 msgr2=0x5597e8d71290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.303+0000 7f150b571740 1 -- 172.21.15.135:0/373654838 shutdown_connections 2024-04-20T12:32:27.310 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.303+0000 7f150b571740 1 -- 172.21.15.135:0/373654838 wait complete. 2024-04-20T12:32:27.311 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.303+0000 7f150b571740 20 client.18465 trim_cache size 0 max 16384 2024-04-20T12:32:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f150b571740 1 Processor -- start 2024-04-20T12:32:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f150b571740 1 -- start start 2024-04-20T12:32:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f150b571740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d6f540 0x5597e8d7dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f150b571740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d74e10 0x5597e8d6a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f150b571740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d6e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f150b571740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f15041af540 con 0x5597e8d6f540 2024-04-20T12:32:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f150b571740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f15041b1080 con 0x5597e8d75730 2024-04-20T12:32:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f150b571740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f15041afc10 con 0x5597e8d74e10 2024-04-20T12:32:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f1501d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d6f540 0x5597e8d7dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f1501d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d6f540 0x5597e8d7dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37924/0 (socket says 172.21.15.135:37924) 2024-04-20T12:32:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f1501d9b640 1 -- 172.21.15.135:0/2411872057 learned_addr learned my addr 172.21.15.135:0/2411872057 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f150259c640 1 --2- 172.21.15.135:0/2411872057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d74e10 0x5597e8d6a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f1501d9b640 1 -- 172.21.15.135:0/2411872057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d74e10 msgr2=0x5597e8d6a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f1501d9b640 1 --2- 172.21.15.135:0/2411872057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d74e10 0x5597e8d6a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f1501d9b640 1 -- 172.21.15.135:0/2411872057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 msgr2=0x5597e8d6e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f1501d9b640 1 --2- 172.21.15.135:0/2411872057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d6e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f1501d9b640 1 -- 172.21.15.135:0/2411872057 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597e8d91060 con 0x5597e8d6f540 2024-04-20T12:32:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.316+0000 7f150259c640 1 --2- 172.21.15.135:0/2411872057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d74e10 0x5597e8d6a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.317+0000 7f1501d9b640 1 --2- 172.21.15.135:0/2411872057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d6f540 0x5597e8d7dcc0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f14f8005580 tx=0x7f14f800c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245440351d3656e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.317+0000 7f14ebfff640 1 -- 172.21.15.135:0/2411872057 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8039070 con 0x5597e8d6f540 2024-04-20T12:32:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.317+0000 7f14ebfff640 1 -- 172.21.15.135:0/2411872057 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14f800c7a0 con 0x5597e8d6f540 2024-04-20T12:32:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.317+0000 7f14ebfff640 1 -- 172.21.15.135:0/2411872057 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8016070 con 0x5597e8d6f540 2024-04-20T12:32:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.317+0000 7f150b571740 1 -- 172.21.15.135:0/2411872057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d6f540 msgr2=0x5597e8d7dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.317+0000 7f150b571740 1 --2- 172.21.15.135:0/2411872057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d6f540 0x5597e8d7dcc0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f14f8005580 tx=0x7f14f800c670 comp rx=0 tx=0).stop 2024-04-20T12:32:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.317+0000 7f150b571740 1 -- 172.21.15.135:0/2411872057 shutdown_connections 2024-04-20T12:32:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.317+0000 7f150b571740 1 --2- 172.21.15.135:0/2411872057 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d6e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.317+0000 7f150b571740 1 --2- 172.21.15.135:0/2411872057 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d74e10 0x5597e8d6a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.317+0000 7f150b571740 1 --2- 172.21.15.135:0/2411872057 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d6f540 0x5597e8d7dcc0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.317+0000 7f150b571740 1 -- 172.21.15.135:0/2411872057 >> 172.21.15.135:0/2411872057 conn(0x5597e8d7bc30 msgr2=0x5597e8d6de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.317+0000 7f150b571740 1 -- 172.21.15.135:0/2411872057 shutdown_connections 2024-04-20T12:32:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.317+0000 7f150b571740 1 -- 172.21.15.135:0/2411872057 wait complete. 2024-04-20T12:32:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f150b571740 1 -- start start 2024-04-20T12:32:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f150b571740 1 Processor -- start 2024-04-20T12:32:27.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f150b571740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d6f540 0x5597e8d86680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f150b571740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d74e10 0x5597e8d77e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f150b571740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d78380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f150b571740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f15041b09b0 con 0x5597e8d6f540 2024-04-20T12:32:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f150b571740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f15041b02e0 con 0x5597e8d75730 2024-04-20T12:32:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f150b571740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f15041ad510 con 0x5597e8d74e10 2024-04-20T12:32:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f150b571740 10 client.0 _ll_register_callbacks cb 0x7f14f4009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f1501d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d6f540 0x5597e8d86680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f1501d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d6f540 0x5597e8d86680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37934/0 (socket says 172.21.15.135:37934) 2024-04-20T12:32:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f1501d9b640 1 -- 172.21.15.135:0/3030150982 learned_addr learned my addr 172.21.15.135:0/3030150982 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f150259c640 1 --2- 172.21.15.135:0/3030150982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d74e10 0x5597e8d77e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f1501d9b640 1 -- 172.21.15.135:0/3030150982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d74e10 msgr2=0x5597e8d77e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f1501d9b640 1 --2- 172.21.15.135:0/3030150982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d74e10 0x5597e8d77e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f1501d9b640 1 -- 172.21.15.135:0/3030150982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 msgr2=0x5597e8d78380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-20T12:32:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f1501d9b640 1 --2- 172.21.15.135:0/3030150982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d78380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.323 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f1501d9b640 1 -- 172.21.15.135:0/3030150982 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597e8d78ac0 con 0x5597e8d6f540 2024-04-20T12:32:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f1501d9b640 1 --2- 172.21.15.135:0/3030150982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d6f540 0x5597e8d86680 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f14f8004840 tx=0x7f14f8011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b886428c0d37bd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f14e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.318+0000 7f14e9ffb640 1 -- 172.21.15.135:0/3030150982 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8016070 con 0x5597e8d6f540 2024-04-20T12:32:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.319+0000 7f14e9ffb640 1 -- 172.21.15.135:0/3030150982 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f14f8012480 con 0x5597e8d6f540 2024-04-20T12:32:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.319+0000 7f150b571740 1 -- 172.21.15.135:0/3030150982 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14f800c7a0 con 0x5597e8d6f540 2024-04-20T12:32:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.319+0000 7f14e9ffb640 1 -- 172.21.15.135:0/3030150982 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f14f8045050 con 0x5597e8d6f540 2024-04-20T12:32:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.319+0000 7f150b571740 10 client.18471 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.319+0000 7f150b571740 1 -- 172.21.15.135:0/3030150982 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5597e8df49a0 con 0x5597e8d6f540 2024-04-20T12:32:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.319+0000 7f14e9ffb640 1 -- 172.21.15.135:0/3030150982 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14f800c7a0 con 0x5597e8d6f540 2024-04-20T12:32:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.319+0000 7f14e9ffb640 1 -- 172.21.15.135:0/3030150982 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f14f8003970 con 0x5597e8d6f540 2024-04-20T12:32:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.319+0000 7f150b571740 10 client.18471 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.319+0000 7f150b571740 10 client.18471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:32:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.319+0000 7f150b571740 20 client.18471 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.319+0000 7f150b571740 1 --2- 172.21.15.135:0/3030150982 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5597e8d7e310 0x5597e8df6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:27.324 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.319+0000 7f150b571740 4 client.18471 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:32:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.319+0000 7f150b571740 1 -- 172.21.15.135:0/3030150982 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5597e8ce19a0 con 0x5597e8d7e310 2024-04-20T12:32:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.319+0000 7f150259c640 1 --2- 172.21.15.135:0/3030150982 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5597e8d7e310 0x5597e8df6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f14e9ffb640 10 client.18471 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f150259c640 1 --2- 172.21.15.135:0/3030150982 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5597e8d7e310 0x5597e8df6d70 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=445bee1e4d6d7b63 server_cookie=3bcfd0df21f57fc2 in_seq=0 out_seq=0 2024-04-20T12:32:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f14e9ffb640 1 -- 172.21.15.135:0/3030150982 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5597e8ce19a0 con 0x5597e8d7e310 2024-04-20T12:32:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f14e9ffb640 10 client.18471 handle_command_reply: tid=0 2024-04-20T12:32:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f150b571740 1 client.18471 shutdown 2024-04-20T12:32:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f150b571740 1 -- 172.21.15.135:0/3030150982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d6f540 msgr2=0x5597e8d86680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f150b571740 1 --2- 172.21.15.135:0/3030150982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d6f540 0x5597e8d86680 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f14f8004840 tx=0x7f14f8011e00 comp rx=0 tx=0).stop 2024-04-20T12:32:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f150b571740 1 -- 172.21.15.135:0/3030150982 shutdown_connections 2024-04-20T12:32:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f150b571740 1 --2- 172.21.15.135:0/3030150982 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x5597e8d7e310 0x5597e8df6d70 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f150b571740 1 --2- 172.21.15.135:0/3030150982 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5597e8d75730 0x5597e8d78380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f150b571740 1 --2- 172.21.15.135:0/3030150982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5597e8d74e10 0x5597e8d77e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f14e9ffb640 0 client.18471 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:27.325 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f150b571740 1 --2- 172.21.15.135:0/3030150982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5597e8d6f540 0x5597e8d86680 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f150b571740 1 -- 172.21.15.135:0/3030150982 >> 172.21.15.135:0/3030150982 conn(0x5597e8d7bc30 msgr2=0x5597e8d7a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f150b571740 1 -- 172.21.15.135:0/3030150982 shutdown_connections 2024-04-20T12:32:27.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f150b571740 1 -- 172.21.15.135:0/3030150982 wait complete. 2024-04-20T12:32:27.326 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.320+0000 7f150b571740 20 client.18471 trim_cache size 0 max 16384 2024-04-20T12:32:27.326 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:32:27.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.321+0000 7f1508985640 1 -- 172.21.15.135:0/1028213478 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f14ec0a3d20 msgr2=0x7f14ec0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.321+0000 7f1508985640 1 --2- 172.21.15.135:0/1028213478 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f14ec0a3d20 0x7f14ec0a61e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f14fc09c650 tx=0x7f14fc0bd040 comp rx=0 tx=0).stop 2024-04-20T12:32:27.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.321+0000 7f1508985640 1 -- 172.21.15.135:0/1028213478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1504108070 msgr2=0x7f150419d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:27.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.321+0000 7f1508985640 1 --2- 172.21.15.135:0/1028213478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1504108070 0x7f150419d020 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00eaa0 tx=0x7f14fc00ef60 comp rx=0 tx=0).stop 2024-04-20T12:32:27.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.321+0000 7f1508985640 1 -- 172.21.15.135:0/1028213478 shutdown_connections 2024-04-20T12:32:27.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.321+0000 7f1508985640 1 --2- 172.21.15.135:0/1028213478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1504108070 0x7f150419d020 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.321+0000 7f1508985640 1 --2- 172.21.15.135:0/1028213478 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f14ec0a3d20 0x7f14ec0a61e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.321+0000 7f1508985640 1 --2- 172.21.15.135:0/1028213478 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f150406af80 0x7f1504198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.321+0000 7f1508985640 1 --2- 172.21.15.135:0/1028213478 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f150406a5c0 0x7f1504198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:27.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.321+0000 7f1508985640 1 -- 172.21.15.135:0/1028213478 >> 172.21.15.135:0/1028213478 conn(0x7f1504077c50 msgr2=0x7f15040ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:27.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.321+0000 7f1508985640 1 -- 172.21.15.135:0/1028213478 shutdown_connections 2024-04-20T12:32:27.328 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:27.321+0000 7f1508985640 1 -- 172.21.15.135:0/1028213478 wait complete. 2024-04-20T12:32:27.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:27 smithi154 ceph-mon[22073]: pgmap v288: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-20T12:32:27.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:27 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1288178164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:32:27.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:27 smithi139 ceph-mon[21834]: pgmap v288: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-20T12:32:27.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:27 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1288178164' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:32:28.331 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:32:28.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:32:28.331 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:32:28.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.447+0000 7f2c79bce640 1 -- 172.21.15.135:0/296355553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c74106390 msgr2=0x7f2c7410df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.447+0000 7f2c79bce640 1 --2- 172.21.15.135:0/296355553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c74106390 0x7f2c7410df60 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009ca0 tx=0x7f2c6c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.447+0000 7f2c79bce640 1 -- 172.21.15.135:0/296355553 shutdown_connections 2024-04-20T12:32:28.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.447+0000 7f2c79bce640 1 --2- 172.21.15.135:0/296355553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c74106390 0x7f2c7410df60 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.447+0000 7f2c79bce640 1 --2- 172.21.15.135:0/296355553 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c74102190 0x7f2c74105cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.447+0000 7f2c79bce640 1 --2- 172.21.15.135:0/296355553 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c741017e0 0x7f2c74101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.447+0000 7f2c79bce640 1 -- 172.21.15.135:0/296355553 >> 172.21.15.135:0/296355553 conn(0x7f2c74077420 msgr2=0x7f2c740fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:28.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.447+0000 7f2c79bce640 1 -- 172.21.15.135:0/296355553 shutdown_connections 2024-04-20T12:32:28.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.447+0000 7f2c79bce640 1 -- 172.21.15.135:0/296355553 wait complete. 2024-04-20T12:32:28.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.448+0000 7f2c79bce640 1 Processor -- start 2024-04-20T12:32:28.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.448+0000 7f2c79bce640 1 -- start start 2024-04-20T12:32:28.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.448+0000 7f2c79bce640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c741017e0 0x7f2c7419e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.448+0000 7f2c79bce640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c74106390 0x7f2c7419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.448+0000 7f2c79bce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c741987a0 0x7f2c74198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.448+0000 7f2c79bce640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2c74111430 con 0x7f2c741987a0 2024-04-20T12:32:28.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.448+0000 7f2c79bce640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2c741112b0 con 0x7f2c741017e0 2024-04-20T12:32:28.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.448+0000 7f2c79bce640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c741115b0 con 0x7f2c74106390 2024-04-20T12:32:28.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.448+0000 7f2c73fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c741987a0 0x7f2c74198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.448+0000 7f2c73fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c741987a0 0x7f2c74198c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37944/0 (socket says 172.21.15.135:37944) 2024-04-20T12:32:28.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.448+0000 7f2c73fff640 1 -- 172.21.15.135:0/2809776951 learned_addr learned my addr 172.21.15.135:0/2809776951 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:28.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.448+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/2809776951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c74106390 0x7f2c7419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.448+0000 7f2c737fe640 1 --2- 172.21.15.135:0/2809776951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c741017e0 0x7f2c7419e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.449+0000 7f2c73fff640 1 -- 172.21.15.135:0/2809776951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c74106390 msgr2=0x7f2c7419eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.449+0000 7f2c73fff640 1 --2- 172.21.15.135:0/2809776951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c74106390 0x7f2c7419eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.449+0000 7f2c73fff640 1 -- 172.21.15.135:0/2809776951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c741017e0 msgr2=0x7f2c7419e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.449+0000 7f2c73fff640 1 --2- 172.21.15.135:0/2809776951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c741017e0 0x7f2c7419e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.449+0000 7f2c73fff640 1 -- 172.21.15.135:0/2809776951 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c74199330 con 0x7f2c741987a0 2024-04-20T12:32:28.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.449+0000 7f2c737fe640 1 --2- 172.21.15.135:0/2809776951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c741017e0 0x7f2c7419e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:28.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.449+0000 7f2c73fff640 1 --2- 172.21.15.135:0/2809776951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c741987a0 0x7f2c74198c50 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c02c700 tx=0x7f2c6c035b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:28.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.449+0000 7f2c70ff9640 1 -- 172.21.15.135:0/2809776951 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c039040 con 0x7f2c741987a0 2024-04-20T12:32:28.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.449+0000 7f2c70ff9640 1 -- 172.21.15.135:0/2809776951 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c6c044070 con 0x7f2c741987a0 2024-04-20T12:32:28.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.449+0000 7f2c79bce640 1 -- 172.21.15.135:0/2809776951 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c741995c0 con 0x7f2c741987a0 2024-04-20T12:32:28.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.449+0000 7f2c70ff9640 1 -- 172.21.15.135:0/2809776951 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0043a0 con 0x7f2c741987a0 2024-04-20T12:32:28.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.449+0000 7f2c79bce640 1 -- 172.21.15.135:0/2809776951 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c741a5770 con 0x7f2c741987a0 2024-04-20T12:32:28.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.451+0000 7f2c70ff9640 1 -- 172.21.15.135:0/2809776951 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f2c6c004540 con 0x7f2c741987a0 2024-04-20T12:32:28.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c7c7c4740 1 Processor -- start 2024-04-20T12:32:28.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c7c7c4740 1 -- start start 2024-04-20T12:32:28.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c7c7c4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa0b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c7c7c4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 0x56154fa13fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c7c7c4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa144e0 0x56154fa168d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c7c7c4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56154f96ff00 con 0x56154fa0afe0 2024-04-20T12:32:28.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c7c7c4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56154f90d530 con 0x56154fa144e0 2024-04-20T12:32:28.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c7c7c4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56154f96bec0 con 0x56154fa0b900 2024-04-20T12:32:28.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c70ff9640 1 --2- 172.21.15.135:0/2809776951 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2c5c0a3d20 0x7f2c5c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c72ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa0b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c72ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa0b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37950/0 (socket says 172.21.15.135:37950) 2024-04-20T12:32:28.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c72ffd640 1 -- 172.21.15.135:0/3915134960 learned_addr learned my addr 172.21.15.135:0/3915134960 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c73fff640 1 --2- 172.21.15.135:0/2809776951 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2c5c0a3d20 0x7f2c5c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/3915134960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa144e0 0x56154fa168d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c737fe640 1 --2- 172.21.15.135:0/3915134960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 0x56154fa13fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c70ff9640 1 -- 172.21.15.135:0/2809776951 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f2c6c0f2fe0 con 0x7f2c741987a0 2024-04-20T12:32:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c72ffd640 1 -- 172.21.15.135:0/3915134960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 msgr2=0x56154fa13fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/3915134960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 0x56154fa13fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c72ffd640 1 -- 172.21.15.135:0/3915134960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa144e0 msgr2=0x56154fa168d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/3915134960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa144e0 0x56154fa168d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c72ffd640 1 -- 172.21.15.135:0/3915134960 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56154f74a7e0 con 0x56154fa0afe0 2024-04-20T12:32:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.452+0000 7f2c737fe640 1 --2- 172.21.15.135:0/3915134960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 0x56154fa13fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.453+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/3915134960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa0b3c0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f2c68013810 tx=0x7f2c6800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8e682dfe7d1d19 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.453+0000 7f2c73fff640 1 --2- 172.21.15.135:0/2809776951 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2c5c0a3d20 0x7f2c5c0a61e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0bb120 tx=0x7f2c6c090700 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.453+0000 7f2c59ffb640 1 -- 172.21.15.135:0/3915134960 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c68004220 con 0x56154fa0afe0 2024-04-20T12:32:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.453+0000 7f2c59ffb640 1 -- 172.21.15.135:0/3915134960 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c68013e50 con 0x56154fa0afe0 2024-04-20T12:32:28.455 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.453+0000 7f2c59ffb640 1 -- 172.21.15.135:0/3915134960 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c680049e0 con 0x56154fa0afe0 2024-04-20T12:32:28.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.453+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/3915134960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 msgr2=0x56154fa0b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.453+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/3915134960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa0b3c0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f2c68013810 tx=0x7f2c6800a660 comp rx=0 tx=0).stop 2024-04-20T12:32:28.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/3915134960 shutdown_connections 2024-04-20T12:32:28.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/3915134960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa144e0 0x56154fa168d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/3915134960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 0x56154fa13fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/3915134960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa0b3c0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/3915134960 >> 172.21.15.135:0/3915134960 conn(0x56154fa05710 msgr2=0x56154fa05af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:28.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/3915134960 shutdown_connections 2024-04-20T12:32:28.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/3915134960 wait complete. 2024-04-20T12:32:28.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 1 -- start start 2024-04-20T12:32:28.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 1 Processor -- start 2024-04-20T12:32:28.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa0afe0 0x56154fa13e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 0x56154fa111f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa144e0 0x56154fa11770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.460 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56154fa17270 con 0x56154fa144e0 2024-04-20T12:32:28.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56154f8f8480 con 0x56154fa0afe0 2024-04-20T12:32:28.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x56154fa173f0 con 0x56154fa0b900 2024-04-20T12:32:28.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.454+0000 7f2c7c7c4740 10 client.0 _ll_register_callbacks cb 0x56154f8f7e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:28.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c72ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa144e0 0x56154fa11770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c72ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa144e0 0x56154fa11770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37956/0 (socket says 172.21.15.135:37956) 2024-04-20T12:32:28.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c72ffd640 1 -- 172.21.15.135:0/1333635797 learned_addr learned my addr 172.21.15.135:0/1333635797 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:28.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/1333635797 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa0afe0 0x56154fa13e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c737fe640 1 --2- 172.21.15.135:0/1333635797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 0x56154fa111f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c72ffd640 1 -- 172.21.15.135:0/1333635797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 msgr2=0x56154fa111f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/1333635797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 0x56154fa111f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c72ffd640 1 -- 172.21.15.135:0/1333635797 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa0afe0 msgr2=0x56154fa13e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/1333635797 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa0afe0 0x56154fa13e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c72ffd640 1 -- 172.21.15.135:0/1333635797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56154f7aaf70 con 0x56154fa144e0 2024-04-20T12:32:28.461 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/1333635797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa144e0 0x56154fa11770 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f2c68004fc0 tx=0x7f2c68005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac0b41557dcf5c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:28.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:28.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c52ffd640 1 -- 172.21.15.135:0/1333635797 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c68005000 con 0x56154fa144e0 2024-04-20T12:32:28.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c52ffd640 1 -- 172.21.15.135:0/1333635797 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f2c680051a0 con 0x56154fa144e0 2024-04-20T12:32:28.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1333635797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c68013e50 con 0x56154fa144e0 2024-04-20T12:32:28.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c52ffd640 1 -- 172.21.15.135:0/1333635797 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2c680053a0 con 0x56154fa144e0 2024-04-20T12:32:28.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c7c7c4740 10 client.18483 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:28.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.455+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1333635797 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56154f642170 con 0x56154fa144e0 2024-04-20T12:32:28.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.456+0000 7f2c52ffd640 1 -- 172.21.15.135:0/1333635797 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c68013e50 con 0x56154fa144e0 2024-04-20T12:32:28.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.456+0000 7f2c52ffd640 1 -- 172.21.15.135:0/1333635797 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2c6800f710 con 0x56154fa144e0 2024-04-20T12:32:28.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.456+0000 7f2c7c7c4740 10 client.18483 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:28.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.456+0000 7f2c7c7c4740 10 client.18483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:32:28.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.456+0000 7f2c7c7c4740 20 client.18483 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:28.462 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.456+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/1333635797 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56154fa24380 0x56154fa26770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.456+0000 7f2c7c7c4740 4 client.18483 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:32:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.456+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1333635797 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56154f97d920 con 0x56154fa24380 2024-04-20T12:32:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.456+0000 7f2c737fe640 1 --2- 172.21.15.135:0/1333635797 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56154fa24380 0x56154fa26770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.456+0000 7f2c737fe640 1 --2- 172.21.15.135:0/1333635797 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56154fa24380 0x56154fa26770 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93e534d28a4b5f98 server_cookie=412c14d46567caba in_seq=0 out_seq=0 2024-04-20T12:32:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.457+0000 7f2c52ffd640 10 client.18483 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.457+0000 7f2c52ffd640 1 -- 172.21.15.135:0/1333635797 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56154f97d920 con 0x56154fa24380 2024-04-20T12:32:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.457+0000 7f2c52ffd640 10 client.18483 handle_command_reply: tid=0 2024-04-20T12:32:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.457+0000 7f2c7c7c4740 1 client.18483 shutdown 2024-04-20T12:32:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.457+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1333635797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa144e0 msgr2=0x56154fa11770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.457+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/1333635797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa144e0 0x56154fa11770 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f2c68004fc0 tx=0x7f2c68005640 comp rx=0 tx=0).stop 2024-04-20T12:32:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.457+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1333635797 shutdown_connections 2024-04-20T12:32:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.457+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/1333635797 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56154fa24380 0x56154fa26770 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.457+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/1333635797 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa144e0 0x56154fa11770 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.457+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/1333635797 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 0x56154fa111f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.463 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.457+0000 7f2c52ffd640 0 client.18483 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:28.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.457+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/1333635797 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa0afe0 0x56154fa13e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.457+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1333635797 >> 172.21.15.135:0/1333635797 conn(0x56154fa05710 msgr2=0x56154fa07460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:28.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.457+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1333635797 shutdown_connections 2024-04-20T12:32:28.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.458+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1333635797 wait complete. 2024-04-20T12:32:28.464 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.458+0000 7f2c7c7c4740 20 client.18483 trim_cache size 0 max 16384 2024-04-20T12:32:28.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c7c7c4740 1 Processor -- start 2024-04-20T12:32:28.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c7c7c4740 1 -- start start 2024-04-20T12:32:28.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c7c7c4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa20130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c7c7c4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 0x56154fa13920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c7c7c4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa144e0 0x56154fa13e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c7c7c4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2c741af450 con 0x56154fa0afe0 2024-04-20T12:32:28.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c7c7c4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2c741b0f90 con 0x56154fa144e0 2024-04-20T12:32:28.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c7c7c4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c741afb20 con 0x56154fa0b900 2024-04-20T12:32:28.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c72ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa20130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c72ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa20130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37964/0 (socket says 172.21.15.135:37964) 2024-04-20T12:32:28.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c72ffd640 1 -- 172.21.15.135:0/2330155251 learned_addr learned my addr 172.21.15.135:0/2330155251 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:28.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c737fe640 1 --2- 172.21.15.135:0/2330155251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 0x56154fa13920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c72ffd640 1 -- 172.21.15.135:0/2330155251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 msgr2=0x56154fa13920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/2330155251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 0x56154fa13920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c72ffd640 1 -- 172.21.15.135:0/2330155251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa144e0 msgr2=0x56154fa13e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/2330155251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa144e0 0x56154fa13e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c72ffd640 1 -- 172.21.15.135:0/2330155251 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56154fa0b730 con 0x56154fa0afe0 2024-04-20T12:32:28.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c737fe640 1 --2- 172.21.15.135:0/2330155251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 0x56154fa13920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:28.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.475+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/2330155251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa20130 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f2c68000c00 tx=0x7f2c680058c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e40de96b0a96666 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:28.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.476+0000 7f2c597fa640 1 -- 172.21.15.135:0/2330155251 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c68037070 con 0x56154fa0afe0 2024-04-20T12:32:28.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.476+0000 7f2c597fa640 1 -- 172.21.15.135:0/2330155251 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c68017070 con 0x56154fa0afe0 2024-04-20T12:32:28.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.476+0000 7f2c597fa640 1 -- 172.21.15.135:0/2330155251 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800f450 con 0x56154fa0afe0 2024-04-20T12:32:28.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.476+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/2330155251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 msgr2=0x56154fa20130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.476+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/2330155251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa20130 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f2c68000c00 tx=0x7f2c680058c0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.476+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/2330155251 shutdown_connections 2024-04-20T12:32:28.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.476+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/2330155251 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa144e0 0x56154fa13e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.476+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/2330155251 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa0b900 0x56154fa13920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.476+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/2330155251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa20130 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.476+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/2330155251 >> 172.21.15.135:0/2330155251 conn(0x56154fa05710 msgr2=0x56154fa04720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:28.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.476+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/2330155251 shutdown_connections 2024-04-20T12:32:28.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.476+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/2330155251 wait complete. 2024-04-20T12:32:28.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c7c7c4740 1 -- start start 2024-04-20T12:32:28.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c7c7c4740 1 Processor -- start 2024-04-20T12:32:28.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c7c7c4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa0e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c7c7c4740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa0b900 0x56154fa0ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c7c7c4740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa144e0 0x56154fa89720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c7c7c4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2c741b08c0 con 0x56154fa0afe0 2024-04-20T12:32:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c7c7c4740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f2c741b01f0 con 0x56154fa0b900 2024-04-20T12:32:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c7c7c4740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f2c741ad420 con 0x56154fa144e0 2024-04-20T12:32:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c7c7c4740 10 client.0 _ll_register_callbacks cb 0x7f2c680046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c72ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa0e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c72ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa0e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37978/0 (socket says 172.21.15.135:37978) 2024-04-20T12:32:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c72ffd640 1 -- 172.21.15.135:0/1423076399 learned_addr learned my addr 172.21.15.135:0/1423076399 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c737fe640 1 --2- 172.21.15.135:0/1423076399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa0b900 0x56154fa0ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/1423076399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa144e0 0x56154fa89720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c72ffd640 1 -- 172.21.15.135:0/1423076399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa144e0 msgr2=0x56154fa89720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/1423076399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa144e0 0x56154fa89720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c72ffd640 1 -- 172.21.15.135:0/1423076399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa0b900 msgr2=0x56154fa0ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.483 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/1423076399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa0b900 0x56154fa0ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.477+0000 7f2c72ffd640 1 -- 172.21.15.135:0/1423076399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56154fa89c60 con 0x56154fa0afe0 2024-04-20T12:32:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c72ffd640 1 --2- 172.21.15.135:0/1423076399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa0e500 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800af30 tx=0x7f2c6800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7a926e7e5faefd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c52ffd640 1 -- 172.21.15.135:0/1423076399 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c68037040 con 0x56154fa0afe0 2024-04-20T12:32:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c52ffd640 1 -- 172.21.15.135:0/1423076399 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f2c68004020 con 0x56154fa0afe0 2024-04-20T12:32:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1423076399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c68017070 con 0x56154fa0afe0 2024-04-20T12:32:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c52ffd640 1 -- 172.21.15.135:0/1423076399 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2c6800aac0 con 0x56154fa0afe0 2024-04-20T12:32:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c7c7c4740 10 client.18489 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1423076399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56154fa8ae20 con 0x56154fa0afe0 2024-04-20T12:32:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c52ffd640 1 -- 172.21.15.135:0/1423076399 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c68017070 con 0x56154fa0afe0 2024-04-20T12:32:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c52ffd640 1 -- 172.21.15.135:0/1423076399 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f2c680118d0 con 0x56154fa0afe0 2024-04-20T12:32:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c7c7c4740 10 client.18489 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c7c7c4740 10 client.18489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:32:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c7c7c4740 20 client.18489 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:28.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/1423076399 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56154fa8b480 0x56154fa8d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c7c7c4740 4 client.18489 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:32:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1423076399 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56154f977790 con 0x56154fa8b480 2024-04-20T12:32:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.478+0000 7f2c737fe640 1 --2- 172.21.15.135:0/1423076399 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56154fa8b480 0x56154fa8d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.479+0000 7f2c737fe640 1 --2- 172.21.15.135:0/1423076399 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56154fa8b480 0x56154fa8d870 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3f66e087f8cdd55 server_cookie=f2960606e4771dfe in_seq=0 out_seq=0 2024-04-20T12:32:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.479+0000 7f2c52ffd640 10 client.18489 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.480+0000 7f2c52ffd640 1 -- 172.21.15.135:0/1423076399 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56154f977790 con 0x56154fa8b480 2024-04-20T12:32:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.480+0000 7f2c52ffd640 10 client.18489 handle_command_reply: tid=0 2024-04-20T12:32:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.480+0000 7f2c7c7c4740 1 client.18489 shutdown 2024-04-20T12:32:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.480+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1423076399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 msgr2=0x56154fa0e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.480+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/1423076399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa0e500 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800af30 tx=0x7f2c6800aec0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.480+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1423076399 shutdown_connections 2024-04-20T12:32:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.480+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/1423076399 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x56154fa8b480 0x56154fa8d870 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.480+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/1423076399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x56154fa144e0 0x56154fa89720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.485 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.480+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/1423076399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x56154fa0b900 0x56154fa0ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.480+0000 7f2c7c7c4740 1 --2- 172.21.15.135:0/1423076399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154fa0afe0 0x56154fa0e500 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.480+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1423076399 >> 172.21.15.135:0/1423076399 conn(0x56154fa05710 msgr2=0x56154fa06940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.480+0000 7f2c52ffd640 0 client.18489 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.480+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1423076399 shutdown_connections 2024-04-20T12:32:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.480+0000 7f2c7c7c4740 1 -- 172.21.15.135:0/1423076399 wait complete. 2024-04-20T12:32:28.486 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.480+0000 7f2c7c7c4740 20 client.18489 trim_cache size 0 max 16384 2024-04-20T12:32:28.486 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:32:28.486 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:32:28.487 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "ef131071-f328-41ed-bb35-a7d8a77e5a47", 2024-04-20T12:32:28.487 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:32:28.487 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:32:28.487 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.481+0000 7f2c79bce640 1 -- 172.21.15.135:0/2809776951 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2c5c0a3d20 msgr2=0x7f2c5c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.481+0000 7f2c79bce640 1 --2- 172.21.15.135:0/2809776951 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2c5c0a3d20 0x7f2c5c0a61e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0bb120 tx=0x7f2c6c090700 comp rx=0 tx=0).stop 2024-04-20T12:32:28.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.481+0000 7f2c79bce640 1 -- 172.21.15.135:0/2809776951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c741987a0 msgr2=0x7f2c74198c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.481+0000 7f2c79bce640 1 --2- 172.21.15.135:0/2809776951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c741987a0 0x7f2c74198c50 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c02c700 tx=0x7f2c6c035b60 comp rx=0 tx=0).stop 2024-04-20T12:32:28.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.481+0000 7f2c79bce640 1 -- 172.21.15.135:0/2809776951 shutdown_connections 2024-04-20T12:32:28.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.481+0000 7f2c79bce640 1 --2- 172.21.15.135:0/2809776951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2c741987a0 0x7f2c74198c50 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.481+0000 7f2c79bce640 1 --2- 172.21.15.135:0/2809776951 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f2c5c0a3d20 0x7f2c5c0a61e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.481+0000 7f2c79bce640 1 --2- 172.21.15.135:0/2809776951 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2c74106390 0x7f2c7419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.481+0000 7f2c79bce640 1 --2- 172.21.15.135:0/2809776951 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f2c741017e0 0x7f2c7419e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.481+0000 7f2c79bce640 1 -- 172.21.15.135:0/2809776951 >> 172.21.15.135:0/2809776951 conn(0x7f2c74077420 msgr2=0x7f2c741006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:28.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.481+0000 7f2c79bce640 1 -- 172.21.15.135:0/2809776951 shutdown_connections 2024-04-20T12:32:28.488 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.481+0000 7f2c79bce640 1 -- 172.21.15.135:0/2809776951 wait complete. 2024-04-20T12:32:28.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:32:28.491 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:32:28.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 -- 172.21.15.135:0/3714900165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb2c106170 msgr2=0x7feb2c10dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 --2- 172.21.15.135:0/3714900165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb2c106170 0x7feb2c10dd40 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7feb24009ca0 tx=0x7feb2402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 -- 172.21.15.135:0/3714900165 shutdown_connections 2024-04-20T12:32:28.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 --2- 172.21.15.135:0/3714900165 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb2c106170 0x7feb2c10dd40 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 --2- 172.21.15.135:0/3714900165 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb2c101a50 0x7feb2c105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 --2- 172.21.15.135:0/3714900165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb2c1010a0 0x7feb2c101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 -- 172.21.15.135:0/3714900165 >> 172.21.15.135:0/3714900165 conn(0x7feb2c077f60 msgr2=0x7feb2c078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:28.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 -- 172.21.15.135:0/3714900165 shutdown_connections 2024-04-20T12:32:28.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 -- 172.21.15.135:0/3714900165 wait complete. 2024-04-20T12:32:28.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 Processor -- start 2024-04-20T12:32:28.594 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 -- start start 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb2c1010a0 0x7feb2c19e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb2c106170 0x7feb2c19e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb2c1985c0 0x7feb2c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c112340 con 0x7feb2c1985c0 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c1121c0 con 0x7feb2c106170 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.593+0000 7feb3312c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c1124c0 con 0x7feb2c1010a0 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb316c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb2c1985c0 0x7feb2c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb316c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb2c1985c0 0x7feb2c198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38002/0 (socket says 172.21.15.135:38002) 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb316c9640 1 -- 172.21.15.135:0/16153262 learned_addr learned my addr 172.21.15.135:0/16153262 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb30ec8640 1 --2- 172.21.15.135:0/16153262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb2c1010a0 0x7feb2c19e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb2bfff640 1 --2- 172.21.15.135:0/16153262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb2c106170 0x7feb2c19e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb316c9640 1 -- 172.21.15.135:0/16153262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb2c1010a0 msgr2=0x7feb2c19e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb316c9640 1 --2- 172.21.15.135:0/16153262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb2c1010a0 0x7feb2c19e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb316c9640 1 -- 172.21.15.135:0/16153262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb2c106170 msgr2=0x7feb2c19e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb316c9640 1 --2- 172.21.15.135:0/16153262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb2c106170 0x7feb2c19e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.595 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb316c9640 1 -- 172.21.15.135:0/16153262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2c1990e0 con 0x7feb2c1985c0 2024-04-20T12:32:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb2bfff640 1 --2- 172.21.15.135:0/16153262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb2c106170 0x7feb2c19e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb316c9640 1 --2- 172.21.15.135:0/16153262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb2c1985c0 0x7feb2c198a70 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7feb2402c700 tx=0x7feb24032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb29ffb640 1 -- 172.21.15.135:0/16153262 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb24041020 con 0x7feb2c1985c0 2024-04-20T12:32:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb29ffb640 1 -- 172.21.15.135:0/16153262 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb24034cd0 con 0x7feb2c1985c0 2024-04-20T12:32:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb3312c640 1 -- 172.21.15.135:0/16153262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2c199370 con 0x7feb2c1985c0 2024-04-20T12:32:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb29ffb640 1 -- 172.21.15.135:0/16153262 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb24039040 con 0x7feb2c1985c0 2024-04-20T12:32:28.596 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.594+0000 7feb3312c640 1 -- 172.21.15.135:0/16153262 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb2c1a5560 con 0x7feb2c1985c0 2024-04-20T12:32:28.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.597+0000 7feb29ffb640 1 -- 172.21.15.135:0/16153262 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7feb24044020 con 0x7feb2c1985c0 2024-04-20T12:32:28.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.597+0000 7feb35df0740 1 Processor -- start 2024-04-20T12:32:28.602 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.597+0000 7feb35df0740 1 -- start start 2024-04-20T12:32:28.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.597+0000 7feb29ffb640 1 --2- 172.21.15.135:0/16153262 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feb1c0a3d20 0x7feb1c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.597+0000 7feb35df0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca4d20 0x561fa8ca5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.597+0000 7feb35df0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca5640 0x561fa8cadce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.597+0000 7feb35df0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8cae220 0x561fa8cb0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.597+0000 7feb35df0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561fa8c0a1b0 con 0x561fa8ca4d20 2024-04-20T12:32:28.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.597+0000 7feb35df0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561fa8ba7390 con 0x561fa8cae220 2024-04-20T12:32:28.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.597+0000 7feb35df0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561fa8c06170 con 0x561fa8ca5640 2024-04-20T12:32:28.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.597+0000 7feb29ffb640 1 -- 172.21.15.135:0/16153262 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7feb240f2820 con 0x7feb2c1985c0 2024-04-20T12:32:28.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.597+0000 7feb30ec8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca4d20 0x561fa8ca5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.597+0000 7feb30ec8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca4d20 0x561fa8ca5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38004/0 (socket says 172.21.15.135:38004) 2024-04-20T12:32:28.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.597+0000 7feb30ec8640 1 -- 172.21.15.135:0/4267463898 learned_addr learned my addr 172.21.15.135:0/4267463898 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:28.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.597+0000 7feb2bfff640 1 --2- 172.21.15.135:0/16153262 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feb1c0a3d20 0x7feb1c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.603 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.598+0000 7feb2bfff640 1 --2- 172.21.15.135:0/4267463898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca5640 0x561fa8cadce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.598+0000 7feb316c9640 1 --2- 172.21.15.135:0/4267463898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8cae220 0x561fa8cb0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.598+0000 7feb30ec8640 1 -- 172.21.15.135:0/4267463898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca5640 msgr2=0x561fa8cadce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.598+0000 7feb30ec8640 1 --2- 172.21.15.135:0/4267463898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca5640 0x561fa8cadce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.598+0000 7feb30ec8640 1 -- 172.21.15.135:0/4267463898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8cae220 msgr2=0x561fa8cb0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.598+0000 7feb30ec8640 1 --2- 172.21.15.135:0/4267463898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8cae220 0x561fa8cb0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.598+0000 7feb30ec8640 1 -- 172.21.15.135:0/4267463898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fa89e67d0 con 0x561fa8ca4d20 2024-04-20T12:32:28.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.598+0000 7feb30ec8640 1 --2- 172.21.15.135:0/4267463898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca4d20 0x561fa8ca5100 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7feb20009d20 tx=0x7feb20011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933c08b6c7d28c78 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:28.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.598+0000 7feb2bfff640 1 --2- 172.21.15.135:0/16153262 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feb1c0a3d20 0x7feb1c0a61e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x561fa8ca47f0 tx=0x7feb180095f0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:28.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.598+0000 7feb16ffd640 1 -- 172.21.15.135:0/4267463898 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2001e070 con 0x561fa8ca4d20 2024-04-20T12:32:28.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.598+0000 7feb16ffd640 1 -- 172.21.15.135:0/4267463898 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb20019b10 con 0x561fa8ca4d20 2024-04-20T12:32:28.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.598+0000 7feb16ffd640 1 -- 172.21.15.135:0/4267463898 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2000eb90 con 0x561fa8ca4d20 2024-04-20T12:32:28.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 -- 172.21.15.135:0/4267463898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca4d20 msgr2=0x561fa8ca5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 --2- 172.21.15.135:0/4267463898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca4d20 0x561fa8ca5100 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7feb20009d20 tx=0x7feb20011810 comp rx=0 tx=0).stop 2024-04-20T12:32:28.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 -- 172.21.15.135:0/4267463898 shutdown_connections 2024-04-20T12:32:28.604 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 --2- 172.21.15.135:0/4267463898 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8cae220 0x561fa8cb0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 --2- 172.21.15.135:0/4267463898 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca5640 0x561fa8cadce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 --2- 172.21.15.135:0/4267463898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca4d20 0x561fa8ca5100 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 -- 172.21.15.135:0/4267463898 >> 172.21.15.135:0/4267463898 conn(0x561fa8c9f450 msgr2=0x561fa8c9f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:28.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 -- 172.21.15.135:0/4267463898 shutdown_connections 2024-04-20T12:32:28.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 -- 172.21.15.135:0/4267463898 wait complete. 2024-04-20T12:32:28.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 -- start start 2024-04-20T12:32:28.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 Processor -- start 2024-04-20T12:32:28.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8ca4d20 0x561fa8cab260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca5640 0x561fa8cab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8cae220 0x561fa8cabce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561fa8cb5420 con 0x561fa8cae220 2024-04-20T12:32:28.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561fa8bc32f0 con 0x561fa8ca4d20 2024-04-20T12:32:28.605 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.599+0000 7feb35df0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561fa8cb55a0 con 0x561fa8ca5640 2024-04-20T12:32:28.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb35df0740 10 client.0 _ll_register_callbacks cb 0x561fa8b8d4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:28.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb316c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8cae220 0x561fa8cabce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb316c9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8cae220 0x561fa8cabce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38016/0 (socket says 172.21.15.135:38016) 2024-04-20T12:32:28.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb316c9640 1 -- 172.21.15.135:0/2352193362 learned_addr learned my addr 172.21.15.135:0/2352193362 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:28.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb30ec8640 1 --2- 172.21.15.135:0/2352193362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8ca4d20 0x561fa8cab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb2bfff640 1 --2- 172.21.15.135:0/2352193362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca5640 0x561fa8cab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb316c9640 1 -- 172.21.15.135:0/2352193362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca5640 msgr2=0x561fa8cab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb316c9640 1 --2- 172.21.15.135:0/2352193362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca5640 0x561fa8cab7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb316c9640 1 -- 172.21.15.135:0/2352193362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8ca4d20 msgr2=0x561fa8cab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb316c9640 1 --2- 172.21.15.135:0/2352193362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8ca4d20 0x561fa8cab260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb316c9640 1 -- 172.21.15.135:0/2352193362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fa891c3f0 con 0x561fa8cae220 2024-04-20T12:32:28.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb2bfff640 1 --2- 172.21.15.135:0/2352193362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca5640 0x561fa8cab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:28.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb30ec8640 1 --2- 172.21.15.135:0/2352193362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8ca4d20 0x561fa8cab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:28.606 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb316c9640 1 --2- 172.21.15.135:0/2352193362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8cae220 0x561fa8cabce0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7feb24009430 tx=0x7feb240ba860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22b71099b6a4360 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:28.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:28.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb0bfff640 1 -- 172.21.15.135:0/2352193362 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb24034920 con 0x561fa8cae220 2024-04-20T12:32:28.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb0bfff640 1 -- 172.21.15.135:0/2352193362 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7feb240c6ce0 con 0x561fa8cae220 2024-04-20T12:32:28.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb35df0740 1 -- 172.21.15.135:0/2352193362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb20019b10 con 0x561fa8cae220 2024-04-20T12:32:28.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb0bfff640 1 -- 172.21.15.135:0/2352193362 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feb240bec00 con 0x561fa8cae220 2024-04-20T12:32:28.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb35df0740 10 client.18501 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:28.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb35df0740 1 -- 172.21.15.135:0/2352193362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561fa88dc0f0 con 0x561fa8cae220 2024-04-20T12:32:28.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.600+0000 7feb0bfff640 1 -- 172.21.15.135:0/2352193362 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb20019b10 con 0x561fa8cae220 2024-04-20T12:32:28.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.601+0000 7feb0bfff640 1 -- 172.21.15.135:0/2352193362 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7feb240f1070 con 0x561fa8cae220 2024-04-20T12:32:28.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.601+0000 7feb35df0740 10 client.18501 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:28.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.601+0000 7feb35df0740 10 client.18501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:32:28.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.601+0000 7feb35df0740 20 client.18501 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:28.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.601+0000 7feb35df0740 1 --2- 172.21.15.135:0/2352193362 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561fa8cc28b0 0x561fa8cc4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.601+0000 7feb35df0740 4 client.18501 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:32:28.607 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.601+0000 7feb35df0740 1 -- 172.21.15.135:0/2352193362 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fa8c17bd0 con 0x561fa8cc28b0 2024-04-20T12:32:28.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.601+0000 7feb30ec8640 1 --2- 172.21.15.135:0/2352193362 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561fa8cc28b0 0x561fa8cc4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.601+0000 7feb0bfff640 10 client.18501 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:28.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.601+0000 7feb30ec8640 1 --2- 172.21.15.135:0/2352193362 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561fa8cc28b0 0x561fa8cc4d20 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2dd54e1f66dfa95 server_cookie=6777a531a21fc72f in_seq=0 out_seq=0 2024-04-20T12:32:28.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.602+0000 7feb0bfff640 1 -- 172.21.15.135:0/2352193362 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561fa8c17bd0 con 0x561fa8cc28b0 2024-04-20T12:32:28.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.602+0000 7feb0bfff640 10 client.18501 handle_command_reply: tid=0 2024-04-20T12:32:28.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.602+0000 7feb35df0740 1 client.18501 shutdown 2024-04-20T12:32:28.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.602+0000 7feb35df0740 1 -- 172.21.15.135:0/2352193362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8cae220 msgr2=0x561fa8cabce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.602+0000 7feb35df0740 1 --2- 172.21.15.135:0/2352193362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8cae220 0x561fa8cabce0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7feb24009430 tx=0x7feb240ba860 comp rx=0 tx=0).stop 2024-04-20T12:32:28.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.602+0000 7feb35df0740 1 -- 172.21.15.135:0/2352193362 shutdown_connections 2024-04-20T12:32:28.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.602+0000 7feb35df0740 1 --2- 172.21.15.135:0/2352193362 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561fa8cc28b0 0x561fa8cc4d20 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.602+0000 7feb35df0740 1 --2- 172.21.15.135:0/2352193362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8cae220 0x561fa8cabce0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.602+0000 7feb0bfff640 0 client.18501 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:28.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.602+0000 7feb35df0740 1 --2- 172.21.15.135:0/2352193362 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca5640 0x561fa8cab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.602+0000 7feb35df0740 1 --2- 172.21.15.135:0/2352193362 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8ca4d20 0x561fa8cab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.602+0000 7feb35df0740 1 -- 172.21.15.135:0/2352193362 >> 172.21.15.135:0/2352193362 conn(0x561fa8c9f450 msgr2=0x561fa8ca11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:28.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.602+0000 7feb35df0740 1 -- 172.21.15.135:0/2352193362 shutdown_connections 2024-04-20T12:32:28.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.602+0000 7feb35df0740 1 -- 172.21.15.135:0/2352193362 wait complete. 2024-04-20T12:32:28.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.602+0000 7feb35df0740 20 client.18501 trim_cache size 0 max 16384 2024-04-20T12:32:28.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.619+0000 7feb35df0740 1 Processor -- start 2024-04-20T12:32:28.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.619+0000 7feb35df0740 1 -- start start 2024-04-20T12:32:28.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb35df0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca4d20 0x561fa8cad990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb35df0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca5640 0x561fa8cbe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb35df0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8cae220 0x561fa8caa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.623 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb35df0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c1ad260 con 0x561fa8ca5640 2024-04-20T12:32:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb35df0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c1aeda0 con 0x561fa8cae220 2024-04-20T12:32:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb35df0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c1ad930 con 0x561fa8ca4d20 2024-04-20T12:32:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb2bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca5640 0x561fa8cbe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb2bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca5640 0x561fa8cbe2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38030/0 (socket says 172.21.15.135:38030) 2024-04-20T12:32:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb2bfff640 1 -- 172.21.15.135:0/3113617497 learned_addr learned my addr 172.21.15.135:0/3113617497 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb316c9640 1 --2- 172.21.15.135:0/3113617497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8cae220 0x561fa8caa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb2bfff640 1 -- 172.21.15.135:0/3113617497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca4d20 msgr2=0x561fa8cad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb2bfff640 1 --2- 172.21.15.135:0/3113617497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca4d20 0x561fa8cad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb2bfff640 1 -- 172.21.15.135:0/3113617497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8cae220 msgr2=0x561fa8caa3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb2bfff640 1 --2- 172.21.15.135:0/3113617497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8cae220 0x561fa8caa3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb2bfff640 1 -- 172.21.15.135:0/3113617497 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fa8ca5470 con 0x561fa8ca5640 2024-04-20T12:32:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb2bfff640 1 --2- 172.21.15.135:0/3113617497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca5640 0x561fa8cbe2e0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7feb2c06b6f0 tx=0x7feb18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9bc8695096ae84 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb167fc640 1 -- 172.21.15.135:0/3113617497 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1801d040 con 0x561fa8ca5640 2024-04-20T12:32:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb167fc640 1 -- 172.21.15.135:0/3113617497 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb18027070 con 0x561fa8ca5640 2024-04-20T12:32:28.624 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.620+0000 7feb167fc640 1 -- 172.21.15.135:0/3113617497 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb18010a80 con 0x561fa8ca5640 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.621+0000 7feb35df0740 1 -- 172.21.15.135:0/3113617497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca5640 msgr2=0x561fa8cbe2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.621+0000 7feb35df0740 1 --2- 172.21.15.135:0/3113617497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca5640 0x561fa8cbe2e0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7feb2c06b6f0 tx=0x7feb18004730 comp rx=0 tx=0).stop 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.621+0000 7feb35df0740 1 -- 172.21.15.135:0/3113617497 shutdown_connections 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.621+0000 7feb35df0740 1 --2- 172.21.15.135:0/3113617497 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8cae220 0x561fa8caa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.621+0000 7feb35df0740 1 --2- 172.21.15.135:0/3113617497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca5640 0x561fa8cbe2e0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.621+0000 7feb35df0740 1 --2- 172.21.15.135:0/3113617497 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca4d20 0x561fa8cad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.621+0000 7feb35df0740 1 -- 172.21.15.135:0/3113617497 >> 172.21.15.135:0/3113617497 conn(0x561fa8c9f450 msgr2=0x561fa8c9dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.621+0000 7feb35df0740 1 -- 172.21.15.135:0/3113617497 shutdown_connections 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.621+0000 7feb35df0740 1 -- 172.21.15.135:0/3113617497 wait complete. 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.621+0000 7feb35df0740 1 -- start start 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.621+0000 7feb35df0740 1 Processor -- start 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb35df0740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca4d20 0x561fa8cb7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb35df0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca5640 0x561fa8cb8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb35df0740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8cae220 0x561fa8cba230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb35df0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c1ae6d0 con 0x561fa8ca5640 2024-04-20T12:32:28.625 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb35df0740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c1ae000 con 0x561fa8cae220 2024-04-20T12:32:28.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb35df0740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c1ab230 con 0x561fa8ca4d20 2024-04-20T12:32:28.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb35df0740 10 client.0 _ll_register_callbacks cb 0x7feb24005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:28.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb2bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca5640 0x561fa8cb8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb2bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca5640 0x561fa8cb8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:38032/0 (socket says 172.21.15.135:38032) 2024-04-20T12:32:28.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb2bfff640 1 -- 172.21.15.135:0/3653126007 learned_addr learned my addr 172.21.15.135:0/3653126007 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:28.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb316c9640 1 --2- 172.21.15.135:0/3653126007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8cae220 0x561fa8cba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb30ec8640 1 --2- 172.21.15.135:0/3653126007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca4d20 0x561fa8cb7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb2bfff640 1 -- 172.21.15.135:0/3653126007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca4d20 msgr2=0x561fa8cb7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb2bfff640 1 --2- 172.21.15.135:0/3653126007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca4d20 0x561fa8cb7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb2bfff640 1 -- 172.21.15.135:0/3653126007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8cae220 msgr2=0x561fa8cba230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:28.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb2bfff640 1 --2- 172.21.15.135:0/3653126007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8cae220 0x561fa8cba230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb2bfff640 1 -- 172.21.15.135:0/3653126007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fa8cba870 con 0x561fa8ca5640 2024-04-20T12:32:28.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb2bfff640 1 --2- 172.21.15.135:0/3653126007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca5640 0x561fa8cb8300 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7feb18006010 tx=0x7feb180104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d161ca6410d9142b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:28.626 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb0bfff640 1 -- 172.21.15.135:0/3653126007 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb18004230 con 0x561fa8ca5640 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb0bfff640 1 -- 172.21.15.135:0/3653126007 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7feb180043d0 con 0x561fa8ca5640 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb35df0740 1 -- 172.21.15.135:0/3653126007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb18027070 con 0x561fa8ca5640 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.622+0000 7feb0bfff640 1 -- 172.21.15.135:0/3653126007 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feb1803c050 con 0x561fa8ca5640 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.623+0000 7feb35df0740 10 client.18507 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.623+0000 7feb35df0740 1 -- 172.21.15.135:0/3653126007 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561fa8d289e0 con 0x561fa8ca5640 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.623+0000 7feb0bfff640 1 -- 172.21.15.135:0/3653126007 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb18027070 con 0x561fa8ca5640 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.623+0000 7feb0bfff640 1 -- 172.21.15.135:0/3653126007 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7feb1800f040 con 0x561fa8ca5640 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.623+0000 7feb35df0740 10 client.18507 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.623+0000 7feb35df0740 10 client.18507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.623+0000 7feb35df0740 20 client.18507 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.623+0000 7feb35df0740 1 --2- 172.21.15.135:0/3653126007 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561fa8cc28b0 0x561fa8d2b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.623+0000 7feb35df0740 4 client.18507 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.623+0000 7feb35df0740 1 -- 172.21.15.135:0/3653126007 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561fa8c11a40 con 0x561fa8cc28b0 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.623+0000 7feb30ec8640 1 --2- 172.21.15.135:0/3653126007 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561fa8cc28b0 0x561fa8d2b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:28.627 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.623+0000 7feb0bfff640 10 client.18507 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.623+0000 7feb30ec8640 1 --2- 172.21.15.135:0/3653126007 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561fa8cc28b0 0x561fa8d2b1c0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ba7824c961a23d0 server_cookie=fdc42dba3e1f7dd9 in_seq=0 out_seq=0 2024-04-20T12:32:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb0bfff640 1 -- 172.21.15.135:0/3653126007 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x561fa8c11a40 con 0x561fa8cc28b0 2024-04-20T12:32:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb0bfff640 10 client.18507 handle_command_reply: tid=0 2024-04-20T12:32:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb35df0740 1 client.18507 shutdown 2024-04-20T12:32:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb35df0740 1 -- 172.21.15.135:0/3653126007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca5640 msgr2=0x561fa8cb8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb35df0740 1 --2- 172.21.15.135:0/3653126007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca5640 0x561fa8cb8300 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7feb18006010 tx=0x7feb180104a0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb35df0740 1 -- 172.21.15.135:0/3653126007 shutdown_connections 2024-04-20T12:32:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb35df0740 1 --2- 172.21.15.135:0/3653126007 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561fa8cc28b0 0x561fa8d2b1c0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb35df0740 1 --2- 172.21.15.135:0/3653126007 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561fa8cae220 0x561fa8cba230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb0bfff640 0 client.18507 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb35df0740 1 --2- 172.21.15.135:0/3653126007 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561fa8ca5640 0x561fa8cb8300 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb35df0740 1 --2- 172.21.15.135:0/3653126007 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561fa8ca4d20 0x561fa8cb7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb35df0740 1 -- 172.21.15.135:0/3653126007 >> 172.21.15.135:0/3653126007 conn(0x561fa8c9f450 msgr2=0x561fa8c9dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb35df0740 1 -- 172.21.15.135:0/3653126007 shutdown_connections 2024-04-20T12:32:28.628 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb35df0740 1 -- 172.21.15.135:0/3653126007 wait complete. 2024-04-20T12:32:28.629 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb35df0740 20 client.18507 trim_cache size 0 max 16384 2024-04-20T12:32:28.629 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:32:28.629 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:32:28.629 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:32:28.629 INFO:teuthology.orchestra.run.smithi135.stdout: "ef131071-f328-41ed-bb35-a7d8a77e5a47": { 2024-04-20T12:32:28.629 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:32:28.629 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "ef131071-f328-41ed-bb35-a7d8a77e5a47", 2024-04-20T12:32:28.629 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:32:28.629 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:32:28.629 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:32:28.630 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:32:28.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb3312c640 1 -- 172.21.15.135:0/16153262 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feb1c0a3d20 msgr2=0x7feb1c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.630 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb3312c640 1 --2- 172.21.15.135:0/16153262 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feb1c0a3d20 0x7feb1c0a61e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x561fa8ca47f0 tx=0x7feb180095f0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb3312c640 1 -- 172.21.15.135:0/16153262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb2c1985c0 msgr2=0x7feb2c198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:28.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.624+0000 7feb3312c640 1 --2- 172.21.15.135:0/16153262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb2c1985c0 0x7feb2c198a70 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7feb2402c700 tx=0x7feb24032f20 comp rx=0 tx=0).stop 2024-04-20T12:32:28.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.625+0000 7feb3312c640 1 -- 172.21.15.135:0/16153262 shutdown_connections 2024-04-20T12:32:28.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.625+0000 7feb3312c640 1 --2- 172.21.15.135:0/16153262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feb2c1985c0 0x7feb2c198a70 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.625+0000 7feb3312c640 1 --2- 172.21.15.135:0/16153262 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7feb2c106170 0x7feb2c19e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.625+0000 7feb3312c640 1 --2- 172.21.15.135:0/16153262 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7feb1c0a3d20 0x7feb1c0a61e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.625+0000 7feb3312c640 1 --2- 172.21.15.135:0/16153262 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb2c1010a0 0x7feb2c19e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:28.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.625+0000 7feb3312c640 1 -- 172.21.15.135:0/16153262 >> 172.21.15.135:0/16153262 conn(0x7feb2c077f60 msgr2=0x7feb2c0fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:28.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.625+0000 7feb3312c640 1 -- 172.21.15.135:0/16153262 shutdown_connections 2024-04-20T12:32:28.631 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:28.625+0000 7feb3312c640 1 -- 172.21.15.135:0/16153262 wait complete. 2024-04-20T12:32:28.634 INFO:tasks.cephfs.filesystem:scrub status for tag:ef131071-f328-41ed-bb35-a7d8a77e5a47 - {'path': '/', 'tag': 'ef131071-f328-41ed-bb35-a7d8a77e5a47', 'options': 'recursive,force'} 2024-04-20T12:32:29.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:29 smithi135 ceph-mon[18264]: pgmap v289: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-20T12:32:29.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:29 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:32:29.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:29 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:32:29.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:29 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:32:29.364 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:29 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:32:29.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:29 smithi154 ceph-mon[22073]: pgmap v289: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-20T12:32:29.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:29 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:32:29.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:29 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:32:29.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:29 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:32:29.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:29 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:32:29.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:29 smithi139 ceph-mon[21834]: pgmap v289: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-04-20T12:32:29.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:29 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:32:29.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:29 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:32:29.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:29 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:32:29.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:29 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:32:31.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:31 smithi135 ceph-mon[18264]: pgmap v290: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-20T12:32:31.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:31 smithi154 ceph-mon[22073]: pgmap v290: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-20T12:32:31.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:31 smithi139 ceph-mon[21834]: pgmap v290: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-04-20T12:32:32.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:32 smithi154 ceph-mon[22073]: pgmap v291: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:32.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:32 smithi139 ceph-mon[21834]: pgmap v291: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:32.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:32 smithi135 ceph-mon[18264]: pgmap v291: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:33.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:33 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:32:33.580 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:33 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:32:33.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:33 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:32:34.501 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:34 smithi154 ceph-mon[22073]: pgmap v292: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:32:34.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:34 smithi139 ceph-mon[21834]: pgmap v292: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:32:34.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:34 smithi135 ceph-mon[18264]: pgmap v292: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:32:36.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:36 smithi139 ceph-mon[21834]: pgmap v293: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:32:36.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:36 smithi135 ceph-mon[18264]: pgmap v293: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:32:36.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:36 smithi154 ceph-mon[22073]: pgmap v293: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:32:38.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:38 smithi139 ceph-mon[21834]: pgmap v294: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:32:38.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:38 smithi135 ceph-mon[18264]: pgmap v294: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:32:38.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:38 smithi154 ceph-mon[22073]: pgmap v294: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:32:40.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:40 smithi139 ceph-mon[21834]: pgmap v295: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:32:40.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:40 smithi135 ceph-mon[18264]: pgmap v295: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:32:40.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:40 smithi154 ceph-mon[22073]: pgmap v295: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:32:42.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:42 smithi139 ceph-mon[21834]: pgmap v296: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:32:42.614 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:42 smithi135 ceph-mon[18264]: pgmap v296: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:32:42.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:42 smithi154 ceph-mon[22073]: pgmap v296: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-04-20T12:32:44.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:44 smithi139 ceph-mon[21834]: pgmap v297: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:32:44.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:44 smithi135 ceph-mon[18264]: pgmap v297: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:32:44.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:44 smithi154 ceph-mon[22073]: pgmap v297: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 13 op/s 2024-04-20T12:32:46.579 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:46 smithi139 ceph-mon[21834]: pgmap v298: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:46.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:46 smithi135 ceph-mon[18264]: pgmap v298: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:46.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:46 smithi154 ceph-mon[22073]: pgmap v298: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:48.613 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:48 smithi135 ceph-mon[18264]: pgmap v299: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:48.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:48 smithi154 ceph-mon[22073]: pgmap v299: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:48.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:48 smithi139 ceph-mon[21834]: pgmap v299: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:50.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:50 smithi154 ceph-mon[22073]: pgmap v300: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:32:50.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:50 smithi139 ceph-mon[21834]: pgmap v300: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:32:50.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:50 smithi135 ceph-mon[18264]: pgmap v300: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:32:52.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:52 smithi154 ceph-mon[22073]: pgmap v301: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:52.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:52 smithi139 ceph-mon[21834]: pgmap v301: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:52.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:52 smithi135 ceph-mon[18264]: pgmap v301: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:54.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:54 smithi154 ceph-mon[22073]: pgmap v302: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:32:54.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:54 smithi139 ceph-mon[21834]: pgmap v302: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:32:54.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:54 smithi135 ceph-mon[18264]: pgmap v302: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:32:56.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:56 smithi154 ceph-mon[22073]: pgmap v303: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:56.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:56 smithi139 ceph-mon[21834]: pgmap v303: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:56.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:56 smithi135 ceph-mon[18264]: pgmap v303: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:58.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:32:58.635 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:32:58.747 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.747+0000 7f7308b59640 1 -- 172.21.15.135:0/689546789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7304105e30 msgr2=0x7f7304106210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.747+0000 7f7308b59640 1 --2- 172.21.15.135:0/689546789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7304105e30 0x7f7304106210 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009ca0 tx=0x7f72f402c140 comp rx=0 tx=0).stop 2024-04-20T12:32:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.748+0000 7f7308b59640 1 -- 172.21.15.135:0/689546789 shutdown_connections 2024-04-20T12:32:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.748+0000 7f7308b59640 1 --2- 172.21.15.135:0/689546789 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7304101f70 0x7f730410dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.748+0000 7f7308b59640 1 --2- 172.21.15.135:0/689546789 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73041015d0 0x7f7304101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.748+0000 7f7308b59640 1 --2- 172.21.15.135:0/689546789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7304105e30 0x7f7304106210 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.748+0000 7f7308b59640 1 -- 172.21.15.135:0/689546789 >> 172.21.15.135:0/689546789 conn(0x7f7304077420 msgr2=0x7f73040fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.748+0000 7f7308b59640 1 -- 172.21.15.135:0/689546789 shutdown_connections 2024-04-20T12:32:58.748 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.748+0000 7f7308b59640 1 -- 172.21.15.135:0/689546789 wait complete. 2024-04-20T12:32:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.748+0000 7f7308b59640 1 Processor -- start 2024-04-20T12:32:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.748+0000 7f7308b59640 1 -- start start 2024-04-20T12:32:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7308b59640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73041015d0 0x7f7304199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7308b59640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7304101f70 0x7f7304199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.750 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7308b59640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7304105e30 0x7f73041a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7308b59640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f73041112f0 con 0x7f7304105e30 2024-04-20T12:32:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7308b59640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7304111170 con 0x7f73041015d0 2024-04-20T12:32:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7308b59640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7304111470 con 0x7f7304101f70 2024-04-20T12:32:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7302d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7304105e30 0x7f73041a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7302d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7304105e30 0x7f73041a47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46478/0 (socket says 172.21.15.135:46478) 2024-04-20T12:32:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7302d9d640 1 -- 172.21.15.135:0/2394105769 learned_addr learned my addr 172.21.15.135:0/2394105769 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f730259c640 1 --2- 172.21.15.135:0/2394105769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73041015d0 0x7f7304199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7301d9b640 1 --2- 172.21.15.135:0/2394105769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7304101f70 0x7f7304199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7302d9d640 1 -- 172.21.15.135:0/2394105769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7304101f70 msgr2=0x7f7304199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7302d9d640 1 --2- 172.21.15.135:0/2394105769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7304101f70 0x7f7304199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7302d9d640 1 -- 172.21.15.135:0/2394105769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73041015d0 msgr2=0x7f7304199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7302d9d640 1 --2- 172.21.15.135:0/2394105769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73041015d0 0x7f7304199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7302d9d640 1 -- 172.21.15.135:0/2394105769 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73041a4d10 con 0x7f7304105e30 2024-04-20T12:32:58.751 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7301d9b640 1 --2- 172.21.15.135:0/2394105769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7304101f70 0x7f7304199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f7302d9d640 1 --2- 172.21.15.135:0/2394105769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7304105e30 0x7f73041a47d0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00d750 tx=0x7f72fc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.749+0000 7f72f37fe640 1 -- 172.21.15.135:0/2394105769 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc017070 con 0x7f7304105e30 2024-04-20T12:32:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.750+0000 7f72f37fe640 1 -- 172.21.15.135:0/2394105769 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72fc005500 con 0x7f7304105e30 2024-04-20T12:32:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.750+0000 7f7308b59640 1 -- 172.21.15.135:0/2394105769 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73041a4ee0 con 0x7f7304105e30 2024-04-20T12:32:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.750+0000 7f72f37fe640 1 -- 172.21.15.135:0/2394105769 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72fc004d90 con 0x7f7304105e30 2024-04-20T12:32:58.752 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.750+0000 7f7308b59640 1 -- 172.21.15.135:0/2394105769 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73041a5350 con 0x7f7304105e30 2024-04-20T12:32:58.752 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:58 smithi154 ceph-mon[22073]: pgmap v304: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:58.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.752+0000 7f72f37fe640 1 -- 172.21.15.135:0/2394105769 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f72fc004f30 con 0x7f7304105e30 2024-04-20T12:32:58.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.752+0000 7f730b82b740 1 Processor -- start 2024-04-20T12:32:58.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.752+0000 7f730b82b740 1 -- start start 2024-04-20T12:32:58.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.752+0000 7f730b82b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc97d20 0x561a3cc98100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.752+0000 7f730b82b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc98640 0x561a3cca0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.752+0000 7f730b82b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cca1220 0x561a3cca3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f730b82b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561a3cbfd1b0 con 0x561a3cc98640 2024-04-20T12:32:58.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f730b82b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561a3cb9a390 con 0x561a3cc97d20 2024-04-20T12:32:58.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f730b82b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561a3cbf9170 con 0x561a3cca1220 2024-04-20T12:32:58.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f72f37fe640 1 --2- 172.21.15.135:0/2394105769 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72ec0a3d20 0x7f72ec0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f730259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc98640 0x561a3cca0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f730259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc98640 0x561a3cca0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46486/0 (socket says 172.21.15.135:46486) 2024-04-20T12:32:58.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f730259c640 1 -- 172.21.15.135:0/2618584656 learned_addr learned my addr 172.21.15.135:0/2618584656 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:58.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f7302d9d640 1 --2- 172.21.15.135:0/2394105769 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72ec0a3d20 0x7f72ec0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f7301d9b640 1 --2- 172.21.15.135:0/2618584656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cca1220 0x561a3cca3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f7301d9b640 1 --2- 172.21.15.135:0/2618584656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc97d20 0x561a3cc98100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f72f37fe640 1 -- 172.21.15.135:0/2394105769 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f72fc0d04c0 con 0x7f7304105e30 2024-04-20T12:32:58.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f730259c640 1 -- 172.21.15.135:0/2618584656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cca1220 msgr2=0x561a3cca3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:58.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f730259c640 1 --2- 172.21.15.135:0/2618584656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cca1220 0x561a3cca3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f730259c640 1 -- 172.21.15.135:0/2618584656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc97d20 msgr2=0x561a3cc98100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:58.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f730259c640 1 --2- 172.21.15.135:0/2618584656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc97d20 0x561a3cc98100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f730259c640 1 -- 172.21.15.135:0/2618584656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a3c9d97d0 con 0x561a3cc98640 2024-04-20T12:32:58.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f7302d9d640 1 --2- 172.21.15.135:0/2394105769 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72ec0a3d20 0x7f72ec0a61e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72fc09bd90 tx=0x7f72fc005bb0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:58.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f730259c640 1 --2- 172.21.15.135:0/2618584656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc98640 0x561a3cca0ce0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f72f4004af0 tx=0x7f72f4009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6177e18e8514caea server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:58.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f72f0ff9640 1 -- 172.21.15.135:0/2618584656 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4045020 con 0x561a3cc98640 2024-04-20T12:32:58.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f72f0ff9640 1 -- 172.21.15.135:0/2618584656 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72f403a040 con 0x561a3cc98640 2024-04-20T12:32:58.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.753+0000 7f72f0ff9640 1 -- 172.21.15.135:0/2618584656 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4039040 con 0x561a3cc98640 2024-04-20T12:32:58.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.754+0000 7f730b82b740 1 -- 172.21.15.135:0/2618584656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc98640 msgr2=0x561a3cca0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:58.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.754+0000 7f730b82b740 1 --2- 172.21.15.135:0/2618584656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc98640 0x561a3cca0ce0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f72f4004af0 tx=0x7f72f4009930 comp rx=0 tx=0).stop 2024-04-20T12:32:58.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.754+0000 7f730b82b740 1 -- 172.21.15.135:0/2618584656 shutdown_connections 2024-04-20T12:32:58.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.754+0000 7f730b82b740 1 --2- 172.21.15.135:0/2618584656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cca1220 0x561a3cca3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.754+0000 7f730b82b740 1 --2- 172.21.15.135:0/2618584656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc98640 0x561a3cca0ce0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.754+0000 7f730b82b740 1 --2- 172.21.15.135:0/2618584656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc97d20 0x561a3cc98100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.754+0000 7f730b82b740 1 -- 172.21.15.135:0/2618584656 >> 172.21.15.135:0/2618584656 conn(0x561a3cc92450 msgr2=0x561a3cc92830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:58.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.754+0000 7f730b82b740 1 -- 172.21.15.135:0/2618584656 shutdown_connections 2024-04-20T12:32:58.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.754+0000 7f730b82b740 1 -- 172.21.15.135:0/2618584656 wait complete. 2024-04-20T12:32:58.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f730b82b740 1 -- start start 2024-04-20T12:32:58.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f730b82b740 1 Processor -- start 2024-04-20T12:32:58.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f730b82b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cc97d20 0x561a3cc9e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f730b82b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc98640 0x561a3cc9e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f730b82b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cca1220 0x561a3cc9ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f730b82b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561a3cca3fb0 con 0x561a3cca1220 2024-04-20T12:32:58.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f730b82b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x561a3cbb62f0 con 0x561a3cc98640 2024-04-20T12:32:58.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f730b82b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x561a3cca4130 con 0x561a3cc97d20 2024-04-20T12:32:58.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f730b82b740 10 client.0 _ll_register_callbacks cb 0x561a3cb804e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:58.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f7301d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cca1220 0x561a3cc9ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f7301d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cca1220 0x561a3cc9ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46496/0 (socket says 172.21.15.135:46496) 2024-04-20T12:32:58.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f7301d9b640 1 -- 172.21.15.135:0/2963939117 learned_addr learned my addr 172.21.15.135:0/2963939117 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f730259c640 1 --2- 172.21.15.135:0/2963939117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc98640 0x561a3cc9e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f7301d9b640 1 --2- 172.21.15.135:0/2963939117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cc97d20 0x561a3cc9e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f7301d9b640 1 -- 172.21.15.135:0/2963939117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cc97d20 msgr2=0x561a3cc9e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f7301d9b640 1 --2- 172.21.15.135:0/2963939117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cc97d20 0x561a3cc9e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f7301d9b640 1 -- 172.21.15.135:0/2963939117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc98640 msgr2=0x561a3cc9e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f7301d9b640 1 --2- 172.21.15.135:0/2963939117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc98640 0x561a3cc9e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.755+0000 7f7301d9b640 1 -- 172.21.15.135:0/2963939117 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a3c90f3f0 con 0x561a3cca1220 2024-04-20T12:32:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f7301d9b640 1 --2- 172.21.15.135:0/2963939117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cca1220 0x561a3cc9ecb0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f72f8014f60 tx=0x7f72f8016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308c320c46239236 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f72e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f72e9ffb640 1 -- 172.21.15.135:0/2963939117 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8014110 con 0x561a3cca1220 2024-04-20T12:32:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f72e9ffb640 1 -- 172.21.15.135:0/2963939117 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f72f8005020 con 0x561a3cca1220 2024-04-20T12:32:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f730b82b740 1 -- 172.21.15.135:0/2963939117 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72f403a040 con 0x561a3cca1220 2024-04-20T12:32:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f72e9ffb640 1 -- 172.21.15.135:0/2963939117 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f72f8027050 con 0x561a3cca1220 2024-04-20T12:32:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f730b82b740 10 client.18519 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:58.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f730b82b740 1 -- 172.21.15.135:0/2963939117 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561a3c8cf0f0 con 0x561a3cca1220 2024-04-20T12:32:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f72e9ffb640 1 -- 172.21.15.135:0/2963939117 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72f403a040 con 0x561a3cca1220 2024-04-20T12:32:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f72e9ffb640 1 -- 172.21.15.135:0/2963939117 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f72f8004c60 con 0x561a3cca1220 2024-04-20T12:32:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f730b82b740 10 client.18519 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f730b82b740 10 client.18519 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:32:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f730b82b740 20 client.18519 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f730b82b740 1 --2- 172.21.15.135:0/2963939117 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561a3ccb15b0 0x561a3ccb3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f730b82b740 4 client.18519 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:32:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.756+0000 7f730b82b740 1 -- 172.21.15.135:0/2963939117 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a3cc0abd0 con 0x561a3ccb15b0 2024-04-20T12:32:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.757+0000 7f730259c640 1 --2- 172.21.15.135:0/2963939117 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561a3ccb15b0 0x561a3ccb3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.757+0000 7f730259c640 1 --2- 172.21.15.135:0/2963939117 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561a3ccb15b0 0x561a3ccb3a00 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=767b24d34372a16a server_cookie=a34644b3a77a6b0e in_seq=0 out_seq=0 2024-04-20T12:32:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.757+0000 7f72e9ffb640 10 client.18519 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.758+0000 7f72e9ffb640 1 -- 172.21.15.135:0/2963939117 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561a3cc0abd0 con 0x561a3ccb15b0 2024-04-20T12:32:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.758+0000 7f72e9ffb640 10 client.18519 handle_command_reply: tid=0 2024-04-20T12:32:58.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.758+0000 7f730b82b740 1 client.18519 shutdown 2024-04-20T12:32:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.758+0000 7f730b82b740 1 -- 172.21.15.135:0/2963939117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cca1220 msgr2=0x561a3cc9ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.758+0000 7f730b82b740 1 --2- 172.21.15.135:0/2963939117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cca1220 0x561a3cc9ecb0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f72f8014f60 tx=0x7f72f8016040 comp rx=0 tx=0).stop 2024-04-20T12:32:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.758+0000 7f730b82b740 1 -- 172.21.15.135:0/2963939117 shutdown_connections 2024-04-20T12:32:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.758+0000 7f730b82b740 1 --2- 172.21.15.135:0/2963939117 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561a3ccb15b0 0x561a3ccb3a00 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.758+0000 7f730b82b740 1 --2- 172.21.15.135:0/2963939117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cca1220 0x561a3cc9ecb0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.758+0000 7f730b82b740 1 --2- 172.21.15.135:0/2963939117 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc98640 0x561a3cc9e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.758+0000 7f72e9ffb640 0 client.18519 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.758+0000 7f730b82b740 1 --2- 172.21.15.135:0/2963939117 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cc97d20 0x561a3cc9e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.758+0000 7f730b82b740 1 -- 172.21.15.135:0/2963939117 >> 172.21.15.135:0/2963939117 conn(0x561a3cc92450 msgr2=0x561a3cc941a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.758+0000 7f730b82b740 1 -- 172.21.15.135:0/2963939117 shutdown_connections 2024-04-20T12:32:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.758+0000 7f730b82b740 1 -- 172.21.15.135:0/2963939117 wait complete. 2024-04-20T12:32:58.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.758+0000 7f730b82b740 20 client.18519 trim_cache size 0 max 16384 2024-04-20T12:32:58.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.775+0000 7f730b82b740 1 Processor -- start 2024-04-20T12:32:58.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.775+0000 7f730b82b740 1 -- start start 2024-04-20T12:32:58.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.775+0000 7f730b82b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc97d20 0x561a3cca0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.775+0000 7f730b82b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc98640 0x561a3ccacea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.775+0000 7f730b82b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cca1220 0x561a3cc92830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.775+0000 7f730b82b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f73041af550 con 0x561a3cc97d20 2024-04-20T12:32:58.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.775+0000 7f730b82b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f73041b1090 con 0x561a3cc98640 2024-04-20T12:32:58.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.775+0000 7f730b82b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73041afc20 con 0x561a3cca1220 2024-04-20T12:32:58.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.775+0000 7f7301d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc97d20 0x561a3cca0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.775+0000 7f7301d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc97d20 0x561a3cca0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46500/0 (socket says 172.21.15.135:46500) 2024-04-20T12:32:58.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.775+0000 7f7301d9b640 1 -- 172.21.15.135:0/2577906629 learned_addr learned my addr 172.21.15.135:0/2577906629 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:58.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.775+0000 7f7301d9b640 1 -- 172.21.15.135:0/2577906629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cca1220 msgr2=0x561a3cc92830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:58.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.775+0000 7f7301d9b640 1 --2- 172.21.15.135:0/2577906629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cca1220 0x561a3cc92830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f7301d9b640 1 -- 172.21.15.135:0/2577906629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc98640 msgr2=0x561a3ccacea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:58.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f730259c640 1 --2- 172.21.15.135:0/2577906629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc98640 0x561a3ccacea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f7301d9b640 1 --2- 172.21.15.135:0/2577906629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc98640 0x561a3ccacea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f7301d9b640 1 -- 172.21.15.135:0/2577906629 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a3cc98470 con 0x561a3cc97d20 2024-04-20T12:32:58.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f730259c640 1 --2- 172.21.15.135:0/2577906629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc98640 0x561a3ccacea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f7301d9b640 1 --2- 172.21.15.135:0/2577906629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc97d20 0x561a3cca0960 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f72f8016010 tx=0x7f72f8005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8118de078ad054a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f72ebfff640 1 -- 172.21.15.135:0/2577906629 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f800c3d0 con 0x561a3cc97d20 2024-04-20T12:32:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f72ebfff640 1 -- 172.21.15.135:0/2577906629 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72f800c8d0 con 0x561a3cc97d20 2024-04-20T12:32:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f72ebfff640 1 -- 172.21.15.135:0/2577906629 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8005280 con 0x561a3cc97d20 2024-04-20T12:32:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f730b82b740 1 -- 172.21.15.135:0/2577906629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc97d20 msgr2=0x561a3cca0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f730b82b740 1 --2- 172.21.15.135:0/2577906629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc97d20 0x561a3cca0960 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f72f8016010 tx=0x7f72f8005bf0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f730b82b740 1 -- 172.21.15.135:0/2577906629 shutdown_connections 2024-04-20T12:32:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f730b82b740 1 --2- 172.21.15.135:0/2577906629 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cca1220 0x561a3cc92830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f730b82b740 1 --2- 172.21.15.135:0/2577906629 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc98640 0x561a3ccacea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f730b82b740 1 --2- 172.21.15.135:0/2577906629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc97d20 0x561a3cca0960 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f730b82b740 1 -- 172.21.15.135:0/2577906629 >> 172.21.15.135:0/2577906629 conn(0x561a3cc92450 msgr2=0x561a3cc90da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f730b82b740 1 -- 172.21.15.135:0/2577906629 shutdown_connections 2024-04-20T12:32:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.776+0000 7f730b82b740 1 -- 172.21.15.135:0/2577906629 wait complete. 2024-04-20T12:32:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730b82b740 1 -- start start 2024-04-20T12:32:58.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730b82b740 1 Processor -- start 2024-04-20T12:32:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730b82b740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc97d20 0x561a3cd146a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730b82b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc98640 0x561a3cd14be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730b82b740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cca1220 0x561a3ccb8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730b82b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f73041b09c0 con 0x561a3cc98640 2024-04-20T12:32:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730b82b740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f73041b02f0 con 0x561a3cc97d20 2024-04-20T12:32:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730b82b740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f73041ad520 con 0x561a3cca1220 2024-04-20T12:32:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730b82b740 10 client.0 _ll_register_callbacks cb 0x7f72f800ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc98640 0x561a3cd14be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc98640 0x561a3cd14be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46512/0 (socket says 172.21.15.135:46512) 2024-04-20T12:32:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730259c640 1 -- 172.21.15.135:0/3987771525 learned_addr learned my addr 172.21.15.135:0/3987771525 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f7301d9b640 1 --2- 172.21.15.135:0/3987771525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc97d20 0x561a3cd146a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f7301d9b640 1 --2- 172.21.15.135:0/3987771525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cca1220 0x561a3ccb8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730259c640 1 -- 172.21.15.135:0/3987771525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cca1220 msgr2=0x561a3ccb8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730259c640 1 --2- 172.21.15.135:0/3987771525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cca1220 0x561a3ccb8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730259c640 1 -- 172.21.15.135:0/3987771525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc97d20 msgr2=0x561a3cd146a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730259c640 1 --2- 172.21.15.135:0/3987771525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc97d20 0x561a3cd146a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f730259c640 1 -- 172.21.15.135:0/3987771525 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a3ccb94e0 con 0x561a3cc98640 2024-04-20T12:32:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.777+0000 7f7301d9b640 1 --2- 172.21.15.135:0/3987771525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc97d20 0x561a3cd146a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f730259c640 1 --2- 172.21.15.135:0/3987771525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc98640 0x561a3cd14be0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f72f4004af0 tx=0x7f72f4003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c884b84de0c388c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f72e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f72e9ffb640 1 -- 172.21.15.135:0/3987771525 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f4045040 con 0x561a3cc98640 2024-04-20T12:32:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f72e9ffb640 1 -- 172.21.15.135:0/3987771525 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f72f4032d70 con 0x561a3cc98640 2024-04-20T12:32:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f730b82b740 1 -- 172.21.15.135:0/3987771525 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72f800c8d0 con 0x561a3cc98640 2024-04-20T12:32:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f72e9ffb640 1 -- 172.21.15.135:0/3987771525 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f72f4039040 con 0x561a3cc98640 2024-04-20T12:32:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f730b82b740 10 client.18525 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f730b82b740 1 -- 172.21.15.135:0/3987771525 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561a3cd1be80 con 0x561a3cc98640 2024-04-20T12:32:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f72e9ffb640 1 -- 172.21.15.135:0/3987771525 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72f800c8d0 con 0x561a3cc98640 2024-04-20T12:32:58.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f72e9ffb640 1 -- 172.21.15.135:0/3987771525 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f72f40544c0 con 0x561a3cc98640 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f730b82b740 10 client.18525 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f730b82b740 10 client.18525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f730b82b740 20 client.18525 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f730b82b740 1 --2- 172.21.15.135:0/3987771525 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561a3ccb15b0 0x561a3cd1e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f730b82b740 4 client.18525 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f730b82b740 1 -- 172.21.15.135:0/3987771525 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561a3cc04a40 con 0x561a3ccb15b0 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.778+0000 7f7301d9b640 1 --2- 172.21.15.135:0/3987771525 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561a3ccb15b0 0x561a3cd1e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f72e9ffb640 10 client.18525 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f7301d9b640 1 --2- 172.21.15.135:0/3987771525 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561a3ccb15b0 0x561a3cd1e1d0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1eac81bca44198c0 server_cookie=87470802f3a4302c in_seq=0 out_seq=0 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f72e9ffb640 1 -- 172.21.15.135:0/3987771525 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561a3cc04a40 con 0x561a3ccb15b0 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f72e9ffb640 10 client.18525 handle_command_reply: tid=0 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f730b82b740 1 client.18525 shutdown 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f730b82b740 1 -- 172.21.15.135:0/3987771525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc98640 msgr2=0x561a3cd14be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f730b82b740 1 --2- 172.21.15.135:0/3987771525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc98640 0x561a3cd14be0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f72f4004af0 tx=0x7f72f4003b80 comp rx=0 tx=0).stop 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f730b82b740 1 -- 172.21.15.135:0/3987771525 shutdown_connections 2024-04-20T12:32:58.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f730b82b740 1 --2- 172.21.15.135:0/3987771525 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x561a3ccb15b0 0x561a3cd1e1d0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f730b82b740 1 --2- 172.21.15.135:0/3987771525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x561a3cca1220 0x561a3ccb8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f730b82b740 1 --2- 172.21.15.135:0/3987771525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a3cc98640 0x561a3cd14be0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f730b82b740 1 --2- 172.21.15.135:0/3987771525 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x561a3cc97d20 0x561a3cd146a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f730b82b740 1 -- 172.21.15.135:0/3987771525 >> 172.21.15.135:0/3987771525 conn(0x561a3cc92450 msgr2=0x561a3cc91630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f72e9ffb640 0 client.18525 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f730b82b740 1 -- 172.21.15.135:0/3987771525 shutdown_connections 2024-04-20T12:32:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f730b82b740 1 -- 172.21.15.135:0/3987771525 wait complete. 2024-04-20T12:32:58.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.779+0000 7f730b82b740 20 client.18525 trim_cache size 0 max 16384 2024-04-20T12:32:58.786 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:32:58.786 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:32:58.786 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:32:58.787 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:32:58.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.780+0000 7f7308b59640 1 -- 172.21.15.135:0/2394105769 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72ec0a3d20 msgr2=0x7f72ec0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:58.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.780+0000 7f7308b59640 1 --2- 172.21.15.135:0/2394105769 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72ec0a3d20 0x7f72ec0a61e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72fc09bd90 tx=0x7f72fc005bb0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.780+0000 7f7308b59640 1 -- 172.21.15.135:0/2394105769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7304105e30 msgr2=0x7f73041a47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:58.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.780+0000 7f7308b59640 1 --2- 172.21.15.135:0/2394105769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7304105e30 0x7f73041a47d0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f72fc00d750 tx=0x7f72fc00dc10 comp rx=0 tx=0).stop 2024-04-20T12:32:58.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.780+0000 7f7308b59640 1 -- 172.21.15.135:0/2394105769 shutdown_connections 2024-04-20T12:32:58.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.780+0000 7f7308b59640 1 --2- 172.21.15.135:0/2394105769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7304105e30 0x7f73041a47d0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.780+0000 7f7308b59640 1 --2- 172.21.15.135:0/2394105769 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f72ec0a3d20 0x7f72ec0a61e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.780+0000 7f7308b59640 1 --2- 172.21.15.135:0/2394105769 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7304101f70 0x7f7304199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.780+0000 7f7308b59640 1 --2- 172.21.15.135:0/2394105769 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f73041015d0 0x7f7304199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.780+0000 7f7308b59640 1 -- 172.21.15.135:0/2394105769 >> 172.21.15.135:0/2394105769 conn(0x7f7304077420 msgr2=0x7f7304103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:58.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.780+0000 7f7308b59640 1 -- 172.21.15.135:0/2394105769 shutdown_connections 2024-04-20T12:32:58.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.780+0000 7f7308b59640 1 -- 172.21.15.135:0/2394105769 wait complete. 2024-04-20T12:32:58.789 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:58 smithi135 ceph-mon[18264]: pgmap v304: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:58.790 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:32:58.791 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:32:58.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:58 smithi139 ceph-mon[21834]: pgmap v304: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:32:58.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.888+0000 7fdea6cc0640 1 -- 172.21.15.135:0/2869935143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea0101690 msgr2=0x7fdea010e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.888+0000 7fdea6cc0640 1 --2- 172.21.15.135:0/2869935143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea0101690 0x7fdea010e3e0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fde94009900 tx=0x7fde9402bc30 comp rx=0 tx=0).stop 2024-04-20T12:32:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.888+0000 7fdea6cc0640 1 -- 172.21.15.135:0/2869935143 shutdown_connections 2024-04-20T12:32:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.888+0000 7fdea6cc0640 1 --2- 172.21.15.135:0/2869935143 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea010e920 0x7fdea0110d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.889+0000 7fdea6cc0640 1 --2- 172.21.15.135:0/2869935143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea0101690 0x7fdea010e3e0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.889+0000 7fdea6cc0640 1 --2- 172.21.15.135:0/2869935143 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdea0100d70 0x7fdea0101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.889+0000 7fdea6cc0640 1 -- 172.21.15.135:0/2869935143 >> 172.21.15.135:0/2869935143 conn(0x7fdea0077f60 msgr2=0x7fdea0078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.889+0000 7fdea6cc0640 1 -- 172.21.15.135:0/2869935143 shutdown_connections 2024-04-20T12:32:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.889+0000 7fdea6cc0640 1 -- 172.21.15.135:0/2869935143 wait complete. 2024-04-20T12:32:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.889+0000 7fdea6cc0640 1 Processor -- start 2024-04-20T12:32:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.889+0000 7fdea6cc0640 1 -- start start 2024-04-20T12:32:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.889+0000 7fdea6cc0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdea0100d70 0x7fdea01a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.889+0000 7fdea6cc0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea0101690 0x7fdea01a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.889+0000 7fdea6cc0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea010e920 0x7fdea019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.889+0000 7fdea6cc0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdea0114530 con 0x7fdea010e920 2024-04-20T12:32:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.889+0000 7fdea6cc0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01143b0 con 0x7fdea0100d70 2024-04-20T12:32:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.889+0000 7fdea6cc0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fdea01146b0 con 0x7fdea0101690 2024-04-20T12:32:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.889+0000 7fdea525d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea010e920 0x7fdea019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.889+0000 7fdea525d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea010e920 0x7fdea019a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46524/0 (socket says 172.21.15.135:46524) 2024-04-20T12:32:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.890+0000 7fdea525d640 1 -- 172.21.15.135:0/1775731141 learned_addr learned my addr 172.21.15.135:0/1775731141 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.890+0000 7fde9ffff640 1 --2- 172.21.15.135:0/1775731141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea0101690 0x7fdea01a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.890+0000 7fdea4a5c640 1 --2- 172.21.15.135:0/1775731141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdea0100d70 0x7fdea01a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.890+0000 7fdea525d640 1 -- 172.21.15.135:0/1775731141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea0101690 msgr2=0x7fdea01a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.890+0000 7fdea525d640 1 --2- 172.21.15.135:0/1775731141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea0101690 0x7fdea01a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.890+0000 7fdea525d640 1 -- 172.21.15.135:0/1775731141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdea0100d70 msgr2=0x7fdea01a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:58.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.890+0000 7fdea525d640 1 --2- 172.21.15.135:0/1775731141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdea0100d70 0x7fdea01a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:58.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.890+0000 7fdea525d640 1 -- 172.21.15.135:0/1775731141 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea019afc0 con 0x7fdea010e920 2024-04-20T12:32:58.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.890+0000 7fdea4a5c640 1 --2- 172.21.15.135:0/1775731141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdea0100d70 0x7fdea01a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:58.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.890+0000 7fdea525d640 1 --2- 172.21.15.135:0/1775731141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea010e920 0x7fdea019a7f0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fde9800ccb0 tx=0x7fde9800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:58.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.890+0000 7fde9dffb640 1 -- 172.21.15.135:0/1775731141 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98003970 con 0x7fdea010e920 2024-04-20T12:32:58.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.890+0000 7fde9dffb640 1 -- 172.21.15.135:0/1775731141 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde98004030 con 0x7fdea010e920 2024-04-20T12:32:58.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.890+0000 7fdea6cc0640 1 -- 172.21.15.135:0/1775731141 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea019b2b0 con 0x7fdea010e920 2024-04-20T12:32:58.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.890+0000 7fde9dffb640 1 -- 172.21.15.135:0/1775731141 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9800f720 con 0x7fdea010e920 2024-04-20T12:32:58.893 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.890+0000 7fdea6cc0640 1 -- 172.21.15.135:0/1775731141 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea01a74d0 con 0x7fdea010e920 2024-04-20T12:32:58.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.891+0000 7fdea6cc0640 1 -- 172.21.15.135:0/1775731141 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdea00698f0 con 0x7fdea010e920 2024-04-20T12:32:58.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.892+0000 7fde9dffb640 1 -- 172.21.15.135:0/1775731141 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fde980041e0 con 0x7fdea010e920 2024-04-20T12:32:58.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.893+0000 7fde9dffb640 1 --2- 172.21.15.135:0/1775731141 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde880a3d20 0x7fde880a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:58.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.893+0000 7fdea4a5c640 1 --2- 172.21.15.135:0/1775731141 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde880a3d20 0x7fde880a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:58.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.893+0000 7fde9dffb640 1 -- 172.21.15.135:0/1775731141 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7fde980d0ce0 con 0x7fdea010e920 2024-04-20T12:32:58.894 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.893+0000 7fdea4a5c640 1 --2- 172.21.15.135:0/1775731141 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde880a3d20 0x7fde880a61e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fde90009b50 tx=0x7fde90005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:58.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:58.898+0000 7fde9dffb640 1 -- 172.21.15.135:0/1775731141 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fde98014070 con 0x7fdea010e920 2024-04-20T12:32:59.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.113+0000 7fdea6cc0640 1 -- 172.21.15.135:0/1775731141 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdea002d5d0 con 0x7fdea010e920 2024-04-20T12:32:59.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.114+0000 7fde9dffb640 1 -- 172.21.15.135:0/1775731141 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7fde9809cfb0 con 0x7fdea010e920 2024-04-20T12:32:59.113 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:32:59.114 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:32:59.114 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:32:59.115 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.116+0000 7fdea6cc0640 1 -- 172.21.15.135:0/1775731141 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde880a3d20 msgr2=0x7fde880a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.116+0000 7fdea6cc0640 1 --2- 172.21.15.135:0/1775731141 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde880a3d20 0x7fde880a61e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fde90009b50 tx=0x7fde90005f90 comp rx=0 tx=0).stop 2024-04-20T12:32:59.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.116+0000 7fdea6cc0640 1 -- 172.21.15.135:0/1775731141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea010e920 msgr2=0x7fdea019a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.116+0000 7fdea6cc0640 1 --2- 172.21.15.135:0/1775731141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea010e920 0x7fdea019a7f0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fde9800ccb0 tx=0x7fde9800a620 comp rx=0 tx=0).stop 2024-04-20T12:32:59.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.116+0000 7fdea6cc0640 1 -- 172.21.15.135:0/1775731141 shutdown_connections 2024-04-20T12:32:59.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.116+0000 7fdea6cc0640 1 --2- 172.21.15.135:0/1775731141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdea010e920 0x7fdea019a7f0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.116+0000 7fdea6cc0640 1 --2- 172.21.15.135:0/1775731141 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fde880a3d20 0x7fde880a61e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.116+0000 7fdea6cc0640 1 --2- 172.21.15.135:0/1775731141 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdea0101690 0x7fdea01a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.116+0000 7fdea6cc0640 1 --2- 172.21.15.135:0/1775731141 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fdea0100d70 0x7fdea01a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.116+0000 7fdea6cc0640 1 -- 172.21.15.135:0/1775731141 >> 172.21.15.135:0/1775731141 conn(0x7fdea0077f60 msgr2=0x7fdea010fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.116+0000 7fdea6cc0640 1 -- 172.21.15.135:0/1775731141 shutdown_connections 2024-04-20T12:32:59.116 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.116+0000 7fdea6cc0640 1 -- 172.21.15.135:0/1775731141 wait complete. 2024-04-20T12:32:59.126 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:32:59.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.227+0000 7f3a796e0640 1 -- 172.21.15.135:0/3629503515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a741010a0 msgr2=0x7f3a74101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.227+0000 7f3a796e0640 1 --2- 172.21.15.135:0/3629503515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a741010a0 0x7f3a74101480 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009900 tx=0x7f3a6c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:32:59.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.227+0000 7f3a796e0640 1 -- 172.21.15.135:0/3629503515 shutdown_connections 2024-04-20T12:32:59.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.227+0000 7f3a796e0640 1 --2- 172.21.15.135:0/3629503515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a74106170 0x7f3a7410dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.227+0000 7f3a796e0640 1 --2- 172.21.15.135:0/3629503515 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a74101a50 0x7f3a74105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.227+0000 7f3a796e0640 1 --2- 172.21.15.135:0/3629503515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a741010a0 0x7f3a74101480 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.227+0000 7f3a796e0640 1 -- 172.21.15.135:0/3629503515 >> 172.21.15.135:0/3629503515 conn(0x7f3a740771e0 msgr2=0x7f3a740775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.227+0000 7f3a796e0640 1 -- 172.21.15.135:0/3629503515 shutdown_connections 2024-04-20T12:32:59.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.227+0000 7f3a796e0640 1 -- 172.21.15.135:0/3629503515 wait complete. 2024-04-20T12:32:59.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.227+0000 7f3a796e0640 1 Processor -- start 2024-04-20T12:32:59.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.227+0000 7f3a796e0640 1 -- start start 2024-04-20T12:32:59.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a796e0640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a741010a0 0x7f3a74199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a796e0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a74106170 0x7f3a74199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a796e0640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a7419a110 0x7f3a741a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a796e0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a74111230 con 0x7f3a74106170 2024-04-20T12:32:59.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a796e0640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3a741110b0 con 0x7f3a741010a0 2024-04-20T12:32:59.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a796e0640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a741113b0 con 0x7f3a7419a110 2024-04-20T12:32:59.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a727fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a74106170 0x7f3a74199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a727fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a74106170 0x7f3a74199bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46546/0 (socket says 172.21.15.135:46546) 2024-04-20T12:32:59.229 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a727fc640 1 -- 172.21.15.135:0/1701487260 learned_addr learned my addr 172.21.15.135:0/1701487260 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a72ffd640 1 --2- 172.21.15.135:0/1701487260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a741010a0 0x7f3a74199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a727fc640 1 -- 172.21.15.135:0/1701487260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a7419a110 msgr2=0x7f3a741a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a727fc640 1 --2- 172.21.15.135:0/1701487260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a7419a110 0x7f3a741a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a727fc640 1 -- 172.21.15.135:0/1701487260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a741010a0 msgr2=0x7f3a74199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a727fc640 1 --2- 172.21.15.135:0/1701487260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a741010a0 0x7f3a74199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a727fc640 1 -- 172.21.15.135:0/1701487260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a741a4eb0 con 0x7f3a74106170 2024-04-20T12:32:59.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a727fc640 1 --2- 172.21.15.135:0/1701487260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a74106170 0x7f3a74199bd0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800ea80 tx=0x7f3a6800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a5bfff640 1 -- 172.21.15.135:0/1701487260 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6800ce40 con 0x7f3a74106170 2024-04-20T12:32:59.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a5bfff640 1 -- 172.21.15.135:0/1701487260 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a68011950 con 0x7f3a74106170 2024-04-20T12:32:59.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a796e0640 1 -- 172.21.15.135:0/1701487260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a741a51a0 con 0x7f3a74106170 2024-04-20T12:32:59.230 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a5bfff640 1 -- 172.21.15.135:0/1701487260 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6801ab70 con 0x7f3a74106170 2024-04-20T12:32:59.231 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.228+0000 7f3a796e0640 1 -- 172.21.15.135:0/1701487260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a741a56f0 con 0x7f3a74106170 2024-04-20T12:32:59.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a5bfff640 1 -- 172.21.15.135:0/1701487260 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f3a6801ad10 con 0x7f3a74106170 2024-04-20T12:32:59.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a7c3af740 1 Processor -- start 2024-04-20T12:32:59.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a7c3af740 1 -- start start 2024-04-20T12:32:59.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a7c3af740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e706220 0x564a1e706600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.237 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a7c3af740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e706b40 0x564a1e70f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a7c3af740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e70f720 0x564a1e711b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a7c3af740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564a1e667110 con 0x564a1e70f720 2024-04-20T12:32:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a7c3af740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x564a1e604550 con 0x564a1e706220 2024-04-20T12:32:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a7c3af740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564a1e6630d0 con 0x564a1e706b40 2024-04-20T12:32:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a727fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e70f720 0x564a1e711b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a737fe640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e706220 0x564a1e706600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a727fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e70f720 0x564a1e711b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46560/0 (socket says 172.21.15.135:46560) 2024-04-20T12:32:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a727fc640 1 -- 172.21.15.135:0/2531319273 learned_addr learned my addr 172.21.15.135:0/2531319273 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a72ffd640 1 --2- 172.21.15.135:0/2531319273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e706b40 0x564a1e70f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a727fc640 1 -- 172.21.15.135:0/2531319273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e706b40 msgr2=0x564a1e70f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a727fc640 1 --2- 172.21.15.135:0/2531319273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e706b40 0x564a1e70f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a5bfff640 1 --2- 172.21.15.135:0/1701487260 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3a5c0a3d50 0x7f3a5c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.238 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a727fc640 1 -- 172.21.15.135:0/2531319273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e706220 msgr2=0x564a1e706600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a727fc640 1 --2- 172.21.15.135:0/2531319273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e706220 0x564a1e706600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.231+0000 7f3a727fc640 1 -- 172.21.15.135:0/2531319273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a1e62c900 con 0x564a1e70f720 2024-04-20T12:32:59.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.232+0000 7f3a737fe640 1 --2- 172.21.15.135:0/1701487260 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3a5c0a3d50 0x7f3a5c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.232+0000 7f3a727fc640 1 --2- 172.21.15.135:0/2531319273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e70f720 0x564a1e711b10 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f3a680ce470 tx=0x7f3a68099020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8308b5585552c563 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.232+0000 7f3a5bfff640 1 -- 172.21.15.135:0/1701487260 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f3a680d11b0 con 0x7f3a74106170 2024-04-20T12:32:59.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.232+0000 7f3a597fa640 1 -- 172.21.15.135:0/2531319273 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6809cb50 con 0x564a1e70f720 2024-04-20T12:32:59.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.232+0000 7f3a597fa640 1 -- 172.21.15.135:0/2531319273 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a680a59f0 con 0x564a1e70f720 2024-04-20T12:32:59.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.232+0000 7f3a597fa640 1 -- 172.21.15.135:0/2531319273 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a680a5560 con 0x564a1e70f720 2024-04-20T12:32:59.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.232+0000 7f3a7c3af740 1 -- 172.21.15.135:0/2531319273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e70f720 msgr2=0x564a1e711b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.232+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/2531319273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e70f720 0x564a1e711b10 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f3a680ce470 tx=0x7f3a68099020 comp rx=0 tx=0).stop 2024-04-20T12:32:59.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.232+0000 7f3a737fe640 1 --2- 172.21.15.135:0/1701487260 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3a5c0a3d50 0x7f3a5c0a6210 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3a640058c0 tx=0x7f3a640046c0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 1 -- 172.21.15.135:0/2531319273 shutdown_connections 2024-04-20T12:32:59.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/2531319273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e70f720 0x564a1e711b10 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/2531319273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e706b40 0x564a1e70f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.239 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/2531319273 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e706220 0x564a1e706600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 1 -- 172.21.15.135:0/2531319273 >> 172.21.15.135:0/2531319273 conn(0x564a1e700950 msgr2=0x564a1e700d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 1 -- 172.21.15.135:0/2531319273 shutdown_connections 2024-04-20T12:32:59.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 1 -- 172.21.15.135:0/2531319273 wait complete. 2024-04-20T12:32:59.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 1 -- start start 2024-04-20T12:32:59.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 1 Processor -- start 2024-04-20T12:32:59.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706220 0x564a1e70c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e706b40 0x564a1e70ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e70f720 0x564a1e70d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564a1e712510 con 0x564a1e706220 2024-04-20T12:32:59.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x564a1e620500 con 0x564a1e70f720 2024-04-20T12:32:59.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x564a1e712690 con 0x564a1e706b40 2024-04-20T12:32:59.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a7c3af740 10 client.0 _ll_register_callbacks cb 0x564a1e6052f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:59.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a72ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706220 0x564a1e70c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.240 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a72ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706220 0x564a1e70c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46562/0 (socket says 172.21.15.135:46562) 2024-04-20T12:32:59.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a72ffd640 1 -- 172.21.15.135:0/639110579 learned_addr learned my addr 172.21.15.135:0/639110579 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a727fc640 1 --2- 172.21.15.135:0/639110579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e706b40 0x564a1e70ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.233+0000 7f3a737fe640 1 --2- 172.21.15.135:0/639110579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e70f720 0x564a1e70d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a72ffd640 1 -- 172.21.15.135:0/639110579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e706b40 msgr2=0x564a1e70ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a72ffd640 1 --2- 172.21.15.135:0/639110579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e706b40 0x564a1e70ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a72ffd640 1 -- 172.21.15.135:0/639110579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e70f720 msgr2=0x564a1e70d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a72ffd640 1 --2- 172.21.15.135:0/639110579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e70f720 0x564a1e70d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a72ffd640 1 -- 172.21.15.135:0/639110579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a1e3793f0 con 0x564a1e706220 2024-04-20T12:32:59.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a737fe640 1 --2- 172.21.15.135:0/639110579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e70f720 0x564a1e70d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:59.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a72ffd640 1 --2- 172.21.15.135:0/639110579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706220 0x564a1e70c790 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c02c170 tx=0x7f3a6c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d8defd62cff7fd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a56ff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:59.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a56ff5640 1 -- 172.21.15.135:0/639110579 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c004380 con 0x564a1e706220 2024-04-20T12:32:59.241 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a56ff5640 1 -- 172.21.15.135:0/639110579 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f3a6c0046c0 con 0x564a1e706220 2024-04-20T12:32:59.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a7c3af740 1 -- 172.21.15.135:0/639110579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564a1e674b30 con 0x564a1e706220 2024-04-20T12:32:59.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a56ff5640 1 -- 172.21.15.135:0/639110579 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3a6c0048c0 con 0x564a1e706220 2024-04-20T12:32:59.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a7c3af740 10 client.18543 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:59.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a7c3af740 1 -- 172.21.15.135:0/639110579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564a1e4437d0 con 0x564a1e706220 2024-04-20T12:32:59.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a56ff5640 1 -- 172.21.15.135:0/639110579 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564a1e674b30 con 0x564a1e706220 2024-04-20T12:32:59.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a56ff5640 1 -- 172.21.15.135:0/639110579 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f3a6c0035f0 con 0x564a1e706220 2024-04-20T12:32:59.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a7c3af740 10 client.18543 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:59.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a7c3af740 10 client.18543 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:32:59.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a7c3af740 20 client.18543 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:59.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/639110579 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x564a1e71fb40 0x564a1e721f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a7c3af740 4 client.18543 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:32:59.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.234+0000 7f3a7c3af740 1 -- 172.21.15.135:0/639110579 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a1e66e9a0 con 0x564a1e71fb40 2024-04-20T12:32:59.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.235+0000 7f3a727fc640 1 --2- 172.21.15.135:0/639110579 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x564a1e71fb40 0x564a1e721f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.235+0000 7f3a727fc640 1 --2- 172.21.15.135:0/639110579 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x564a1e71fb40 0x564a1e721f90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a1d1f9ed399938af server_cookie=d6fe4f2148047134 in_seq=0 out_seq=0 2024-04-20T12:32:59.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.235+0000 7f3a56ff5640 10 client.18543 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:32:59.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.235+0000 7f3a56ff5640 1 -- 172.21.15.135:0/639110579 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564a1e66e9a0 con 0x564a1e71fb40 2024-04-20T12:32:59.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.235+0000 7f3a56ff5640 10 client.18543 handle_command_reply: tid=0 2024-04-20T12:32:59.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.235+0000 7f3a7c3af740 1 client.18543 shutdown 2024-04-20T12:32:59.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.236+0000 7f3a7c3af740 1 -- 172.21.15.135:0/639110579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706220 msgr2=0x564a1e70c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.236+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/639110579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706220 0x564a1e70c790 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c02c170 tx=0x7f3a6c0095c0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.236+0000 7f3a7c3af740 1 -- 172.21.15.135:0/639110579 shutdown_connections 2024-04-20T12:32:59.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.236+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/639110579 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x564a1e71fb40 0x564a1e721f90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.236+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/639110579 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e70f720 0x564a1e70d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.236+0000 7f3a56ff5640 0 client.18543 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:32:59.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.236+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/639110579 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e706b40 0x564a1e70ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.236+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/639110579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706220 0x564a1e70c790 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.236+0000 7f3a7c3af740 1 -- 172.21.15.135:0/639110579 >> 172.21.15.135:0/639110579 conn(0x564a1e700950 msgr2=0x564a1e6fb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.236+0000 7f3a7c3af740 1 -- 172.21.15.135:0/639110579 shutdown_connections 2024-04-20T12:32:59.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.236+0000 7f3a7c3af740 1 -- 172.21.15.135:0/639110579 wait complete. 2024-04-20T12:32:59.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.236+0000 7f3a7c3af740 20 client.18543 trim_cache size 0 max 16384 2024-04-20T12:32:59.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a7c3af740 1 Processor -- start 2024-04-20T12:32:59.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a7c3af740 1 -- start start 2024-04-20T12:32:59.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a7c3af740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e706220 0x564a1e70eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a7c3af740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706b40 0x564a1e71b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a7c3af740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e70f720 0x564a1e6fb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a7c3af740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a741ad310 con 0x564a1e706b40 2024-04-20T12:32:59.254 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a7c3af740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3a741aee50 con 0x564a1e706220 2024-04-20T12:32:59.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a7c3af740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a741ad9e0 con 0x564a1e70f720 2024-04-20T12:32:59.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a727fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706b40 0x564a1e71b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a727fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706b40 0x564a1e71b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46572/0 (socket says 172.21.15.135:46572) 2024-04-20T12:32:59.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a727fc640 1 -- 172.21.15.135:0/2497741115 learned_addr learned my addr 172.21.15.135:0/2497741115 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a72ffd640 1 --2- 172.21.15.135:0/2497741115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e706220 0x564a1e70eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a727fc640 1 -- 172.21.15.135:0/2497741115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e70f720 msgr2=0x564a1e6fb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a727fc640 1 --2- 172.21.15.135:0/2497741115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e70f720 0x564a1e6fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a727fc640 1 -- 172.21.15.135:0/2497741115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e706220 msgr2=0x564a1e70eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a727fc640 1 --2- 172.21.15.135:0/2497741115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e706220 0x564a1e70eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a727fc640 1 -- 172.21.15.135:0/2497741115 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a1e700780 con 0x564a1e706b40 2024-04-20T12:32:59.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a727fc640 1 --2- 172.21.15.135:0/2497741115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706b40 0x564a1e71b3d0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800c700 tx=0x7f3a68000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b48252f2deda40 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a58ff9640 1 -- 172.21.15.135:0/2497741115 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6809c6e0 con 0x564a1e706b40 2024-04-20T12:32:59.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a58ff9640 1 -- 172.21.15.135:0/2497741115 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a6809d480 con 0x564a1e706b40 2024-04-20T12:32:59.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.249+0000 7f3a58ff9640 1 -- 172.21.15.135:0/2497741115 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6809c8c0 con 0x564a1e706b40 2024-04-20T12:32:59.255 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.250+0000 7f3a7c3af740 1 -- 172.21.15.135:0/2497741115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706b40 msgr2=0x564a1e71b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.250+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/2497741115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706b40 0x564a1e71b3d0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800c700 tx=0x7f3a68000f40 comp rx=0 tx=0).stop 2024-04-20T12:32:59.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.250+0000 7f3a7c3af740 1 -- 172.21.15.135:0/2497741115 shutdown_connections 2024-04-20T12:32:59.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.250+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/2497741115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e70f720 0x564a1e6fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.250+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/2497741115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706b40 0x564a1e71b3d0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.250+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/2497741115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e706220 0x564a1e70eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.250+0000 7f3a7c3af740 1 -- 172.21.15.135:0/2497741115 >> 172.21.15.135:0/2497741115 conn(0x564a1e700950 msgr2=0x564a1e6fae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.250+0000 7f3a7c3af740 1 -- 172.21.15.135:0/2497741115 shutdown_connections 2024-04-20T12:32:59.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.250+0000 7f3a7c3af740 1 -- 172.21.15.135:0/2497741115 wait complete. 2024-04-20T12:32:59.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.250+0000 7f3a7c3af740 1 -- start start 2024-04-20T12:32:59.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.250+0000 7f3a7c3af740 1 Processor -- start 2024-04-20T12:32:59.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a7c3af740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e706220 0x564a1e77e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a7c3af740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706b40 0x564a1e77e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a7c3af740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e70f720 0x564a1e712cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a7c3af740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3a741ae780 con 0x564a1e706b40 2024-04-20T12:32:59.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a7c3af740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3a741ae0b0 con 0x564a1e706220 2024-04-20T12:32:59.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a7c3af740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3a741ab2e0 con 0x564a1e70f720 2024-04-20T12:32:59.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a7c3af740 10 client.0 _ll_register_callbacks cb 0x7f3a6c005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:59.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a727fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706b40 0x564a1e77e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a727fc640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706b40 0x564a1e77e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46576/0 (socket says 172.21.15.135:46576) 2024-04-20T12:32:59.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a727fc640 1 -- 172.21.15.135:0/817937945 learned_addr learned my addr 172.21.15.135:0/817937945 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a72ffd640 1 --2- 172.21.15.135:0/817937945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e706220 0x564a1e77e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a727fc640 1 -- 172.21.15.135:0/817937945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e70f720 msgr2=0x564a1e712cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a727fc640 1 --2- 172.21.15.135:0/817937945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e70f720 0x564a1e712cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a727fc640 1 -- 172.21.15.135:0/817937945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e706220 msgr2=0x564a1e77e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a727fc640 1 --2- 172.21.15.135:0/817937945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e706220 0x564a1e77e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a727fc640 1 -- 172.21.15.135:0/817937945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a1e713410 con 0x564a1e706b40 2024-04-20T12:32:59.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a727fc640 1 --2- 172.21.15.135:0/817937945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706b40 0x564a1e77e950 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f3a6809ca80 tx=0x7f3a6801a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efaabd51263ef463 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a56ff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:59.257 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a56ff5640 1 -- 172.21.15.135:0/817937945 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6809c8c0 con 0x564a1e706b40 2024-04-20T12:32:59.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a56ff5640 1 -- 172.21.15.135:0/817937945 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f3a6809b080 con 0x564a1e706b40 2024-04-20T12:32:59.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a7c3af740 1 -- 172.21.15.135:0/817937945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a6809d480 con 0x564a1e706b40 2024-04-20T12:32:59.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a56ff5640 1 -- 172.21.15.135:0/817937945 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3a6809c6e0 con 0x564a1e706b40 2024-04-20T12:32:59.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a7c3af740 10 client.18549 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:59.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.251+0000 7f3a7c3af740 1 -- 172.21.15.135:0/817937945 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564a1e785c10 con 0x564a1e706b40 2024-04-20T12:32:59.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a56ff5640 1 -- 172.21.15.135:0/817937945 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a6809d480 con 0x564a1e706b40 2024-04-20T12:32:59.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a56ff5640 1 -- 172.21.15.135:0/817937945 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f3a68022030 con 0x564a1e706b40 2024-04-20T12:32:59.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a7c3af740 10 client.18549 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:59.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a7c3af740 10 client.18549 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:32:59.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a7c3af740 20 client.18549 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:59.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/817937945 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x564a1e785e30 0x564a1e788220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a7c3af740 4 client.18549 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:32:59.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a7c3af740 1 -- 172.21.15.135:0/817937945 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564a1e5ea6e0 con 0x564a1e785e30 2024-04-20T12:32:59.258 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a72ffd640 1 --2- 172.21.15.135:0/817937945 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x564a1e785e30 0x564a1e788220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a56ff5640 10 client.18549 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:32:59.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a72ffd640 1 --2- 172.21.15.135:0/817937945 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x564a1e785e30 0x564a1e788220 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=388dbf7161f1289e server_cookie=c1b7b2e17fa670e1 in_seq=0 out_seq=0 2024-04-20T12:32:59.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a56ff5640 1 -- 172.21.15.135:0/817937945 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564a1e5ea6e0 con 0x564a1e785e30 2024-04-20T12:32:59.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a56ff5640 10 client.18549 handle_command_reply: tid=0 2024-04-20T12:32:59.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a7c3af740 1 client.18549 shutdown 2024-04-20T12:32:59.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a7c3af740 1 -- 172.21.15.135:0/817937945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706b40 msgr2=0x564a1e77e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/817937945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706b40 0x564a1e77e950 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f3a6809ca80 tx=0x7f3a6801a610 comp rx=0 tx=0).stop 2024-04-20T12:32:59.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a7c3af740 1 -- 172.21.15.135:0/817937945 shutdown_connections 2024-04-20T12:32:59.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/817937945 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x564a1e785e30 0x564a1e788220 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/817937945 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x564a1e70f720 0x564a1e712cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a56ff5640 0 client.18549 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:32:59.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/817937945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564a1e706b40 0x564a1e77e950 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a7c3af740 1 --2- 172.21.15.135:0/817937945 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x564a1e706220 0x564a1e77e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.259 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.252+0000 7f3a7c3af740 1 -- 172.21.15.135:0/817937945 >> 172.21.15.135:0/817937945 conn(0x564a1e700950 msgr2=0x564a1e6fb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.253+0000 7f3a7c3af740 1 -- 172.21.15.135:0/817937945 shutdown_connections 2024-04-20T12:32:59.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.253+0000 7f3a7c3af740 1 -- 172.21.15.135:0/817937945 wait complete. 2024-04-20T12:32:59.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.253+0000 7f3a7c3af740 20 client.18549 trim_cache size 0 max 16384 2024-04-20T12:32:59.260 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:32:59.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.253+0000 7f3a796e0640 1 -- 172.21.15.135:0/1701487260 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3a5c0a3d50 msgr2=0x7f3a5c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.253+0000 7f3a796e0640 1 --2- 172.21.15.135:0/1701487260 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3a5c0a3d50 0x7f3a5c0a6210 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3a640058c0 tx=0x7f3a640046c0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.253+0000 7f3a796e0640 1 -- 172.21.15.135:0/1701487260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a74106170 msgr2=0x7f3a74199bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.253+0000 7f3a796e0640 1 --2- 172.21.15.135:0/1701487260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a74106170 0x7f3a74199bd0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800ea80 tx=0x7f3a6800ef40 comp rx=0 tx=0).stop 2024-04-20T12:32:59.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.253+0000 7f3a796e0640 1 -- 172.21.15.135:0/1701487260 shutdown_connections 2024-04-20T12:32:59.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.253+0000 7f3a796e0640 1 --2- 172.21.15.135:0/1701487260 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3a5c0a3d50 0x7f3a5c0a6210 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.253+0000 7f3a796e0640 1 --2- 172.21.15.135:0/1701487260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a7419a110 0x7f3a741a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.253+0000 7f3a796e0640 1 --2- 172.21.15.135:0/1701487260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3a74106170 0x7f3a74199bd0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.253+0000 7f3a796e0640 1 --2- 172.21.15.135:0/1701487260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3a741010a0 0x7f3a74199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.253+0000 7f3a796e0640 1 -- 172.21.15.135:0/1701487260 >> 172.21.15.135:0/1701487260 conn(0x7f3a740771e0 msgr2=0x7f3a740feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.253+0000 7f3a796e0640 1 -- 172.21.15.135:0/1701487260 shutdown_connections 2024-04-20T12:32:59.261 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.253+0000 7f3a796e0640 1 -- 172.21.15.135:0/1701487260 wait complete. 2024-04-20T12:32:59.263 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:32:59.365 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.363+0000 7f0034e3f640 1 -- 172.21.15.135:0/2322344715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0030103b20 msgr2=0x7f003010c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.363+0000 7f0034e3f640 1 --2- 172.21.15.135:0/2322344715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0030103b20 0x7f003010c000 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f0024009900 tx=0x7f002402bd60 comp rx=0 tx=0).stop 2024-04-20T12:32:59.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.364+0000 7f0034e3f640 1 -- 172.21.15.135:0/2322344715 shutdown_connections 2024-04-20T12:32:59.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.364+0000 7f0034e3f640 1 --2- 172.21.15.135:0/2322344715 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f003010c540 0x7f003010e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.364+0000 7f0034e3f640 1 --2- 172.21.15.135:0/2322344715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0030103b20 0x7f003010c000 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.364+0000 7f0034e3f640 1 --2- 172.21.15.135:0/2322344715 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0030103200 0x7f00301035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.364+0000 7f0034e3f640 1 -- 172.21.15.135:0/2322344715 >> 172.21.15.135:0/2322344715 conn(0x7f00300771e0 msgr2=0x7f00300775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.364+0000 7f0034e3f640 1 -- 172.21.15.135:0/2322344715 shutdown_connections 2024-04-20T12:32:59.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.364+0000 7f0034e3f640 1 -- 172.21.15.135:0/2322344715 wait complete. 2024-04-20T12:32:59.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.364+0000 7f0034e3f640 1 Processor -- start 2024-04-20T12:32:59.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.364+0000 7f0034e3f640 1 -- start start 2024-04-20T12:32:59.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.364+0000 7f0034e3f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0030103200 0x7f003019e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.366 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f0034e3f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0030103b20 0x7f003019e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f0034e3f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f003010c540 0x7f00301985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f0034e3f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0030112370 con 0x7f0030103200 2024-04-20T12:32:59.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f0034e3f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f00301121f0 con 0x7f0030103b20 2024-04-20T12:32:59.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f0034e3f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00301124f0 con 0x7f003010c540 2024-04-20T12:32:59.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f002e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0030103200 0x7f003019e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f002e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0030103200 0x7f003019e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46600/0 (socket says 172.21.15.135:46600) 2024-04-20T12:32:59.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f002e59c640 1 -- 172.21.15.135:0/2248486470 learned_addr learned my addr 172.21.15.135:0/2248486470 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f002dd9b640 1 --2- 172.21.15.135:0/2248486470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0030103b20 0x7f003019e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f002ed9d640 1 --2- 172.21.15.135:0/2248486470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f003010c540 0x7f00301985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f002e59c640 1 -- 172.21.15.135:0/2248486470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f003010c540 msgr2=0x7f00301985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f002e59c640 1 --2- 172.21.15.135:0/2248486470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f003010c540 0x7f00301985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f002e59c640 1 -- 172.21.15.135:0/2248486470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0030103b20 msgr2=0x7f003019e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.367 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f002e59c640 1 --2- 172.21.15.135:0/2248486470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0030103b20 0x7f003019e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f002e59c640 1 -- 172.21.15.135:0/2248486470 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0030198d70 con 0x7f0030103200 2024-04-20T12:32:59.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f002ed9d640 1 --2- 172.21.15.135:0/2248486470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f003010c540 0x7f00301985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:59.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f002e59c640 1 --2- 172.21.15.135:0/2248486470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0030103200 0x7f003019e440 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f002000e9f0 tx=0x7f002000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f001f7fe640 1 -- 172.21.15.135:0/2248486470 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002000cd80 con 0x7f0030103200 2024-04-20T12:32:59.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f001f7fe640 1 -- 172.21.15.135:0/2248486470 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0020005500 con 0x7f0030103200 2024-04-20T12:32:59.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f0034e3f640 1 -- 172.21.15.135:0/2248486470 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0030199060 con 0x7f0030103200 2024-04-20T12:32:59.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f001f7fe640 1 -- 172.21.15.135:0/2248486470 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0020010690 con 0x7f0030103200 2024-04-20T12:32:59.368 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.365+0000 7f0034e3f640 1 -- 172.21.15.135:0/2248486470 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00301a5300 con 0x7f0030103200 2024-04-20T12:32:59.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.368+0000 7f001f7fe640 1 -- 172.21.15.135:0/2248486470 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f00200046c0 con 0x7f0030103200 2024-04-20T12:32:59.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.368+0000 7f0037a2e740 1 Processor -- start 2024-04-20T12:32:59.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.368+0000 7f0037a2e740 1 -- start start 2024-04-20T12:32:59.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f0037a2e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259427e10 0x5602594281f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f0037a2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259430dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f0037a2e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259431310 0x560259433700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f0037a2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56025938d110 con 0x560259428730 2024-04-20T12:32:59.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f0037a2e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x56025932a550 con 0x560259427e10 2024-04-20T12:32:59.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f0037a2e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5602593890d0 con 0x560259431310 2024-04-20T12:32:59.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f002e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259430dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.375 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f002e59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259430dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46604/0 (socket says 172.21.15.135:46604) 2024-04-20T12:32:59.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f002e59c640 1 -- 172.21.15.135:0/1077069835 learned_addr learned my addr 172.21.15.135:0/1077069835 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f002ed9d640 1 --2- 172.21.15.135:0/1077069835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259427e10 0x5602594281f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f002dd9b640 1 --2- 172.21.15.135:0/1077069835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259431310 0x560259433700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f001f7fe640 1 --2- 172.21.15.135:0/2248486470 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f00180a3d20 0x7f00180a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f002e59c640 1 -- 172.21.15.135:0/1077069835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259431310 msgr2=0x560259433700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f002e59c640 1 --2- 172.21.15.135:0/1077069835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259431310 0x560259433700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f002e59c640 1 -- 172.21.15.135:0/1077069835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259427e10 msgr2=0x5602594281f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f002e59c640 1 --2- 172.21.15.135:0/1077069835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259427e10 0x5602594281f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f002e59c640 1 -- 172.21.15.135:0/1077069835 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560259352900 con 0x560259428730 2024-04-20T12:32:59.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f002ed9d640 1 --2- 172.21.15.135:0/1077069835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259427e10 0x5602594281f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:59.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f002dd9b640 1 --2- 172.21.15.135:0/1077069835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259431310 0x560259433700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:59.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f002ed9d640 1 --2- 172.21.15.135:0/2248486470 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f00180a3d20 0x7f00180a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f001f7fe640 1 -- 172.21.15.135:0/2248486470 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f00200d10d0 con 0x7f0030103200 2024-04-20T12:32:59.376 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f002e59c640 1 --2- 172.21.15.135:0/1077069835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259430dd0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f00200ce350 tx=0x7f002000a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1809f69a8c12b278 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f001cff9640 1 -- 172.21.15.135:0/1077069835 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002009ca30 con 0x560259428730 2024-04-20T12:32:59.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f001cff9640 1 -- 172.21.15.135:0/1077069835 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f002000a250 con 0x560259428730 2024-04-20T12:32:59.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.369+0000 7f001cff9640 1 -- 172.21.15.135:0/1077069835 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002009c5c0 con 0x560259428730 2024-04-20T12:32:59.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.370+0000 7f0037a2e740 1 -- 172.21.15.135:0/1077069835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 msgr2=0x560259430dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.370+0000 7f002ed9d640 1 --2- 172.21.15.135:0/2248486470 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f00180a3d20 0x7f00180a61e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0028005fd0 tx=0x7f0028004a40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.370+0000 7f0037a2e740 1 --2- 172.21.15.135:0/1077069835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259430dd0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f00200ce350 tx=0x7f002000a440 comp rx=0 tx=0).stop 2024-04-20T12:32:59.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.370+0000 7f0037a2e740 1 -- 172.21.15.135:0/1077069835 shutdown_connections 2024-04-20T12:32:59.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.370+0000 7f0037a2e740 1 --2- 172.21.15.135:0/1077069835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259431310 0x560259433700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.370+0000 7f0037a2e740 1 --2- 172.21.15.135:0/1077069835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259430dd0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.370+0000 7f0037a2e740 1 --2- 172.21.15.135:0/1077069835 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259427e10 0x5602594281f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.370+0000 7f0037a2e740 1 -- 172.21.15.135:0/1077069835 >> 172.21.15.135:0/1077069835 conn(0x560259422540 msgr2=0x560259422920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.370+0000 7f0037a2e740 1 -- 172.21.15.135:0/1077069835 shutdown_connections 2024-04-20T12:32:59.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.370+0000 7f0037a2e740 1 -- 172.21.15.135:0/1077069835 wait complete. 2024-04-20T12:32:59.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f0037a2e740 1 -- start start 2024-04-20T12:32:59.377 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f0037a2e740 1 Processor -- start 2024-04-20T12:32:59.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f0037a2e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259427e10 0x56025942e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f0037a2e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259428730 0x56025942ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f0037a2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259431310 0x56025942ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f0037a2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560259433fe0 con 0x560259431310 2024-04-20T12:32:59.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f0037a2e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x560259346500 con 0x560259427e10 2024-04-20T12:32:59.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f0037a2e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x560259434160 con 0x560259428730 2024-04-20T12:32:59.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f0037a2e740 10 client.0 _ll_register_callbacks cb 0x56025932b2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:59.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f002ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259431310 0x56025942ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f002ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259431310 0x56025942ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46614/0 (socket says 172.21.15.135:46614) 2024-04-20T12:32:59.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f002ed9d640 1 -- 172.21.15.135:0/3081446430 learned_addr learned my addr 172.21.15.135:0/3081446430 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f002dd9b640 1 --2- 172.21.15.135:0/3081446430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259428730 0x56025942ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f002e59c640 1 --2- 172.21.15.135:0/3081446430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259427e10 0x56025942e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.378 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f002ed9d640 1 -- 172.21.15.135:0/3081446430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259428730 msgr2=0x56025942ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f002ed9d640 1 --2- 172.21.15.135:0/3081446430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259428730 0x56025942ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f002ed9d640 1 -- 172.21.15.135:0/3081446430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259427e10 msgr2=0x56025942e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f002ed9d640 1 --2- 172.21.15.135:0/3081446430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259427e10 0x56025942e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f002ed9d640 1 -- 172.21.15.135:0/3081446430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56025909f3f0 con 0x560259431310 2024-04-20T12:32:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f002e59c640 1 --2- 172.21.15.135:0/3081446430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259427e10 0x56025942e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f002ed9d640 1 --2- 172.21.15.135:0/3081446430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259431310 0x56025942ef90 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f0028011d40 tx=0x7f0028004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71842317ee29299f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.371+0000 7f0015ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.372+0000 7f0015ffb640 1 -- 172.21.15.135:0/3081446430 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002802a060 con 0x560259431310 2024-04-20T12:32:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.372+0000 7f0015ffb640 1 -- 172.21.15.135:0/3081446430 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f0028017070 con 0x560259431310 2024-04-20T12:32:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.372+0000 7f0037a2e740 1 -- 172.21.15.135:0/3081446430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56025939ab30 con 0x560259431310 2024-04-20T12:32:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.372+0000 7f0015ffb640 1 -- 172.21.15.135:0/3081446430 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0028031050 con 0x560259431310 2024-04-20T12:32:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.372+0000 7f0037a2e740 10 client.18561 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.372+0000 7f0037a2e740 1 -- 172.21.15.135:0/3081446430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5602591697d0 con 0x560259431310 2024-04-20T12:32:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.372+0000 7f0015ffb640 1 -- 172.21.15.135:0/3081446430 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56025939ab30 con 0x560259431310 2024-04-20T12:32:59.379 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.372+0000 7f0015ffb640 1 -- 172.21.15.135:0/3081446430 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f002800f3c0 con 0x560259431310 2024-04-20T12:32:59.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.372+0000 7f0037a2e740 10 client.18561 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:59.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.372+0000 7f0037a2e740 10 client.18561 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:32:59.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.372+0000 7f0037a2e740 20 client.18561 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:59.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.372+0000 7f0037a2e740 1 --2- 172.21.15.135:0/3081446430 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x560259441b50 0x560259443fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.372+0000 7f0037a2e740 4 client.18561 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:32:59.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.372+0000 7f0037a2e740 1 -- 172.21.15.135:0/3081446430 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602593949a0 con 0x560259441b50 2024-04-20T12:32:59.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.373+0000 7f002e59c640 1 --2- 172.21.15.135:0/3081446430 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x560259441b50 0x560259443fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.373+0000 7f002e59c640 1 --2- 172.21.15.135:0/3081446430 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x560259441b50 0x560259443fb0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c0d1a8f906159940 server_cookie=488dcf1209f56239 in_seq=0 out_seq=0 2024-04-20T12:32:59.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.373+0000 7f0015ffb640 10 client.18561 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:32:59.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.374+0000 7f0015ffb640 1 -- 172.21.15.135:0/3081446430 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5602593949a0 con 0x560259441b50 2024-04-20T12:32:59.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.374+0000 7f0015ffb640 10 client.18561 handle_command_reply: tid=0 2024-04-20T12:32:59.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.374+0000 7f0037a2e740 1 client.18561 shutdown 2024-04-20T12:32:59.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.374+0000 7f0037a2e740 1 -- 172.21.15.135:0/3081446430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259431310 msgr2=0x56025942ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.374+0000 7f0037a2e740 1 --2- 172.21.15.135:0/3081446430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259431310 0x56025942ef90 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f0028011d40 tx=0x7f0028004ab0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.380 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.374+0000 7f0037a2e740 1 -- 172.21.15.135:0/3081446430 shutdown_connections 2024-04-20T12:32:59.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.374+0000 7f0037a2e740 1 --2- 172.21.15.135:0/3081446430 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x560259441b50 0x560259443fb0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.374+0000 7f0037a2e740 1 --2- 172.21.15.135:0/3081446430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259431310 0x56025942ef90 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.374+0000 7f0037a2e740 1 --2- 172.21.15.135:0/3081446430 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259428730 0x56025942ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.374+0000 7f0037a2e740 1 --2- 172.21.15.135:0/3081446430 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259427e10 0x56025942e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.374+0000 7f0015ffb640 0 client.18561 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:32:59.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.374+0000 7f0037a2e740 1 -- 172.21.15.135:0/3081446430 >> 172.21.15.135:0/3081446430 conn(0x560259422540 msgr2=0x560259424290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.374+0000 7f0037a2e740 1 -- 172.21.15.135:0/3081446430 shutdown_connections 2024-04-20T12:32:59.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.374+0000 7f0037a2e740 1 -- 172.21.15.135:0/3081446430 wait complete. 2024-04-20T12:32:59.381 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.374+0000 7f0037a2e740 20 client.18561 trim_cache size 0 max 16384 2024-04-20T12:32:59.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.387+0000 7f0037a2e740 1 Processor -- start 2024-04-20T12:32:59.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.387+0000 7f0037a2e740 1 -- start start 2024-04-20T12:32:59.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.387+0000 7f0037a2e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259427e10 0x5602594498c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.387+0000 7f0037a2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259449e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.387+0000 7f0037a2e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259431310 0x56025942b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.387+0000 7f0037a2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00301af520 con 0x560259428730 2024-04-20T12:32:59.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.387+0000 7f0037a2e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f00301b1060 con 0x560259431310 2024-04-20T12:32:59.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.387+0000 7f0037a2e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00301afbf0 con 0x560259427e10 2024-04-20T12:32:59.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.388+0000 7f002dd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259449e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.388+0000 7f002dd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259449e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46624/0 (socket says 172.21.15.135:46624) 2024-04-20T12:32:59.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.388+0000 7f002dd9b640 1 -- 172.21.15.135:0/1177009725 learned_addr learned my addr 172.21.15.135:0/1177009725 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.388+0000 7f002e59c640 1 --2- 172.21.15.135:0/1177009725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259427e10 0x5602594498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.388+0000 7f002ed9d640 1 --2- 172.21.15.135:0/1177009725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259431310 0x56025942b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.388+0000 7f002dd9b640 1 -- 172.21.15.135:0/1177009725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259427e10 msgr2=0x5602594498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.393 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.388+0000 7f002dd9b640 1 --2- 172.21.15.135:0/1177009725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259427e10 0x5602594498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.388+0000 7f002dd9b640 1 -- 172.21.15.135:0/1177009725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259431310 msgr2=0x56025942b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.388+0000 7f002dd9b640 1 --2- 172.21.15.135:0/1177009725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259431310 0x56025942b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.388+0000 7f002dd9b640 1 -- 172.21.15.135:0/1177009725 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560259433a70 con 0x560259428730 2024-04-20T12:32:59.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.388+0000 7f002dd9b640 1 --2- 172.21.15.135:0/1177009725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259449e00 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0024009900 tx=0x7f002402c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496e060a86e67074 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.388+0000 7f0017fff640 1 -- 172.21.15.135:0/1177009725 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024004100 con 0x560259428730 2024-04-20T12:32:59.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.388+0000 7f0017fff640 1 -- 172.21.15.135:0/1177009725 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0024044070 con 0x560259428730 2024-04-20T12:32:59.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.388+0000 7f0017fff640 1 -- 172.21.15.135:0/1177009725 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024004ec0 con 0x560259428730 2024-04-20T12:32:59.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.389+0000 7f0037a2e740 1 -- 172.21.15.135:0/1177009725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 msgr2=0x560259449e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.389+0000 7f0037a2e740 1 --2- 172.21.15.135:0/1177009725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259449e00 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0024009900 tx=0x7f002402c700 comp rx=0 tx=0).stop 2024-04-20T12:32:59.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.389+0000 7f0037a2e740 1 -- 172.21.15.135:0/1177009725 shutdown_connections 2024-04-20T12:32:59.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.389+0000 7f0037a2e740 1 --2- 172.21.15.135:0/1177009725 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259431310 0x56025942b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.389+0000 7f0037a2e740 1 --2- 172.21.15.135:0/1177009725 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259449e00 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.389+0000 7f0037a2e740 1 --2- 172.21.15.135:0/1177009725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259427e10 0x5602594498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.394 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.389+0000 7f0037a2e740 1 -- 172.21.15.135:0/1177009725 >> 172.21.15.135:0/1177009725 conn(0x560259422540 msgr2=0x560259429860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.389+0000 7f0037a2e740 1 -- 172.21.15.135:0/1177009725 shutdown_connections 2024-04-20T12:32:59.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.389+0000 7f0037a2e740 1 -- 172.21.15.135:0/1177009725 wait complete. 2024-04-20T12:32:59.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.389+0000 7f0037a2e740 1 -- start start 2024-04-20T12:32:59.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.389+0000 7f0037a2e740 1 Processor -- start 2024-04-20T12:32:59.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f0037a2e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259427e10 0x5602594397e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f0037a2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259434b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f0037a2e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259431310 0x5602594350b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f0037a2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00301b0990 con 0x560259428730 2024-04-20T12:32:59.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f0037a2e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f00301b02c0 con 0x560259431310 2024-04-20T12:32:59.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f0037a2e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f00301ad4f0 con 0x560259427e10 2024-04-20T12:32:59.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f0037a2e740 10 client.0 _ll_register_callbacks cb 0x7f0028009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:59.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f002dd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259434b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f002dd9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259434b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46630/0 (socket says 172.21.15.135:46630) 2024-04-20T12:32:59.395 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f002dd9b640 1 -- 172.21.15.135:0/372918936 learned_addr learned my addr 172.21.15.135:0/372918936 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f002e59c640 1 --2- 172.21.15.135:0/372918936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259427e10 0x5602594397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f002ed9d640 1 --2- 172.21.15.135:0/372918936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259431310 0x5602594350b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f002dd9b640 1 -- 172.21.15.135:0/372918936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259427e10 msgr2=0x5602594397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f002dd9b640 1 --2- 172.21.15.135:0/372918936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259427e10 0x5602594397e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f002dd9b640 1 -- 172.21.15.135:0/372918936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259431310 msgr2=0x5602594350b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f002dd9b640 1 --2- 172.21.15.135:0/372918936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259431310 0x5602594350b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f002dd9b640 1 -- 172.21.15.135:0/372918936 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602594358e0 con 0x560259428730 2024-04-20T12:32:59.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f002dd9b640 1 --2- 172.21.15.135:0/372918936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259434b50 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f0024006010 tx=0x7f00240043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617a5ebe4bdc4927 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f0015ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:59.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f0015ffb640 1 -- 172.21.15.135:0/372918936 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002402cdc0 con 0x560259428730 2024-04-20T12:32:59.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f0015ffb640 1 -- 172.21.15.135:0/372918936 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f0024004ec0 con 0x560259428730 2024-04-20T12:32:59.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f0037a2e740 1 -- 172.21.15.135:0/372918936 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0024044070 con 0x560259428730 2024-04-20T12:32:59.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f0015ffb640 1 -- 172.21.15.135:0/372918936 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f002405a050 con 0x560259428730 2024-04-20T12:32:59.396 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f0037a2e740 10 client.18567 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:59.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.390+0000 7f0037a2e740 1 -- 172.21.15.135:0/372918936 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5602594a81c0 con 0x560259428730 2024-04-20T12:32:59.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.391+0000 7f0015ffb640 1 -- 172.21.15.135:0/372918936 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0024044070 con 0x560259428730 2024-04-20T12:32:59.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.391+0000 7f0015ffb640 1 -- 172.21.15.135:0/372918936 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f00240039b0 con 0x560259428730 2024-04-20T12:32:59.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.391+0000 7f0037a2e740 10 client.18567 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:59.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.391+0000 7f0037a2e740 10 client.18567 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:32:59.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.391+0000 7f0037a2e740 20 client.18567 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:59.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.391+0000 7f0037a2e740 1 --2- 172.21.15.135:0/372918936 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5602594a8880 0x5602594aac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.391+0000 7f0037a2e740 4 client.18567 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:32:59.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.391+0000 7f0037a2e740 1 -- 172.21.15.135:0/372918936 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5602593106e0 con 0x5602594a8880 2024-04-20T12:32:59.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.391+0000 7f002e59c640 1 --2- 172.21.15.135:0/372918936 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5602594a8880 0x5602594aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.391+0000 7f0015ffb640 10 client.18567 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:32:59.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.391+0000 7f002e59c640 1 --2- 172.21.15.135:0/372918936 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5602594a8880 0x5602594aac70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f4fb0f36c95f5853 server_cookie=45746ff8a8f5d52c in_seq=0 out_seq=0 2024-04-20T12:32:59.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0015ffb640 1 -- 172.21.15.135:0/372918936 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5602593106e0 con 0x5602594a8880 2024-04-20T12:32:59.397 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0015ffb640 10 client.18567 handle_command_reply: tid=0 2024-04-20T12:32:59.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0037a2e740 1 client.18567 shutdown 2024-04-20T12:32:59.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0037a2e740 1 -- 172.21.15.135:0/372918936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 msgr2=0x560259434b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0037a2e740 1 --2- 172.21.15.135:0/372918936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259434b50 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f0024006010 tx=0x7f00240043b0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0037a2e740 1 -- 172.21.15.135:0/372918936 shutdown_connections 2024-04-20T12:32:59.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0037a2e740 1 --2- 172.21.15.135:0/372918936 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x5602594a8880 0x5602594aac70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0037a2e740 1 --2- 172.21.15.135:0/372918936 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x560259431310 0x5602594350b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0037a2e740 1 --2- 172.21.15.135:0/372918936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560259428730 0x560259434b50 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0015ffb640 0 client.18567 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:32:59.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0037a2e740 1 --2- 172.21.15.135:0/372918936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x560259427e10 0x5602594397e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0037a2e740 1 -- 172.21.15.135:0/372918936 >> 172.21.15.135:0/372918936 conn(0x560259422540 msgr2=0x560259423970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0037a2e740 1 -- 172.21.15.135:0/372918936 shutdown_connections 2024-04-20T12:32:59.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0037a2e740 1 -- 172.21.15.135:0/372918936 wait complete. 2024-04-20T12:32:59.398 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0037a2e740 20 client.18567 trim_cache size 0 max 16384 2024-04-20T12:32:59.399 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:32:59.399 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0034e3f640 1 -- 172.21.15.135:0/2248486470 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f00180a3d20 msgr2=0x7f00180a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0034e3f640 1 --2- 172.21.15.135:0/2248486470 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f00180a3d20 0x7f00180a61e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0028005fd0 tx=0x7f0028004a40 comp rx=0 tx=0).stop 2024-04-20T12:32:59.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0034e3f640 1 -- 172.21.15.135:0/2248486470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0030103200 msgr2=0x7f003019e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0034e3f640 1 --2- 172.21.15.135:0/2248486470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0030103200 0x7f003019e440 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f002000e9f0 tx=0x7f002000edf0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0034e3f640 1 -- 172.21.15.135:0/2248486470 shutdown_connections 2024-04-20T12:32:59.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0034e3f640 1 --2- 172.21.15.135:0/2248486470 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f00180a3d20 0x7f00180a61e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0034e3f640 1 --2- 172.21.15.135:0/2248486470 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f003010c540 0x7f00301985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0034e3f640 1 --2- 172.21.15.135:0/2248486470 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0030103b20 0x7f003019e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0034e3f640 1 --2- 172.21.15.135:0/2248486470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0030103200 0x7f003019e440 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.392+0000 7f0034e3f640 1 -- 172.21.15.135:0/2248486470 >> 172.21.15.135:0/2248486470 conn(0x7f00300771e0 msgr2=0x7f00300fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.393+0000 7f0034e3f640 1 -- 172.21.15.135:0/2248486470 shutdown_connections 2024-04-20T12:32:59.400 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.393+0000 7f0034e3f640 1 -- 172.21.15.135:0/2248486470 wait complete. 2024-04-20T12:32:59.403 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:32:59.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.504+0000 7f40303f4640 1 -- 172.21.15.135:0/80386696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40281011b0 msgr2=0x7f4028101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.504+0000 7f40303f4640 1 --2- 172.21.15.135:0/80386696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40281011b0 0x7f4028101610 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f4018009900 tx=0x7f401802bc30 comp rx=0 tx=0).stop 2024-04-20T12:32:59.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.504+0000 7f40303f4640 1 -- 172.21.15.135:0/80386696 shutdown_connections 2024-04-20T12:32:59.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.504+0000 7f40303f4640 1 --2- 172.21.15.135:0/80386696 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4028101b50 0x7f402810dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.504+0000 7f40303f4640 1 --2- 172.21.15.135:0/80386696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40281011b0 0x7f4028101610 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.504+0000 7f40303f4640 1 --2- 172.21.15.135:0/80386696 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4028106fa0 0x7f4028107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.505+0000 7f40303f4640 1 -- 172.21.15.135:0/80386696 >> 172.21.15.135:0/80386696 conn(0x7f4028076c60 msgr2=0x7f4028077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.507 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.505+0000 7f40303f4640 1 -- 172.21.15.135:0/80386696 shutdown_connections 2024-04-20T12:32:59.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.505+0000 7f40303f4640 1 -- 172.21.15.135:0/80386696 wait complete. 2024-04-20T12:32:59.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.505+0000 7f40303f4640 1 Processor -- start 2024-04-20T12:32:59.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.505+0000 7f40303f4640 1 -- start start 2024-04-20T12:32:59.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.505+0000 7f40303f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40281011b0 0x7f402819e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.505+0000 7f40303f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4028101b50 0x7f402819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.505+0000 7f40303f4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4028106fa0 0x7f40281986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.505+0000 7f40303f4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f40281123a0 con 0x7f4028106fa0 2024-04-20T12:32:59.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.505+0000 7f40303f4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4028112220 con 0x7f4028101b50 2024-04-20T12:32:59.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.505+0000 7f40303f4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4028112520 con 0x7f40281011b0 2024-04-20T12:32:59.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.505+0000 7f402e991640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4028106fa0 0x7f40281986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.505+0000 7f402e991640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4028106fa0 0x7f40281986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46652/0 (socket says 172.21.15.135:46652) 2024-04-20T12:32:59.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.505+0000 7f402e991640 1 -- 172.21.15.135:0/3764108656 learned_addr learned my addr 172.21.15.135:0/3764108656 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.505+0000 7f402e190640 1 --2- 172.21.15.135:0/3764108656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40281011b0 0x7f402819e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.506+0000 7f402e991640 1 -- 172.21.15.135:0/3764108656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40281011b0 msgr2=0x7f402819e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.506+0000 7f402e991640 1 --2- 172.21.15.135:0/3764108656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40281011b0 0x7f402819e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.506+0000 7f402d98f640 1 --2- 172.21.15.135:0/3764108656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4028101b50 0x7f402819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.506+0000 7f402e991640 1 -- 172.21.15.135:0/3764108656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4028101b50 msgr2=0x7f402819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.506+0000 7f402e991640 1 --2- 172.21.15.135:0/3764108656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4028101b50 0x7f402819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.506+0000 7f402e991640 1 -- 172.21.15.135:0/3764108656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4028198f80 con 0x7f4028106fa0 2024-04-20T12:32:59.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.506+0000 7f402d98f640 1 --2- 172.21.15.135:0/3764108656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4028101b50 0x7f402819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:59.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.506+0000 7f402e991640 1 --2- 172.21.15.135:0/3764108656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4028106fa0 0x7f40281986c0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f402000e960 tx=0x7f402000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.506+0000 7f401f7fe640 1 -- 172.21.15.135:0/3764108656 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4020004d20 con 0x7f4028106fa0 2024-04-20T12:32:59.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.506+0000 7f40303f4640 1 -- 172.21.15.135:0/3764108656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4028199270 con 0x7f4028106fa0 2024-04-20T12:32:59.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.506+0000 7f401f7fe640 1 -- 172.21.15.135:0/3764108656 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4020005020 con 0x7f4028106fa0 2024-04-20T12:32:59.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.506+0000 7f401f7fe640 1 -- 172.21.15.135:0/3764108656 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40200116d0 con 0x7f4028106fa0 2024-04-20T12:32:59.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.506+0000 7f40303f4640 1 -- 172.21.15.135:0/3764108656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40281a5580 con 0x7f4028106fa0 2024-04-20T12:32:59.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.508+0000 7f401f7fe640 1 -- 172.21.15.135:0/3764108656 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f4020005560 con 0x7f4028106fa0 2024-04-20T12:32:59.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f4032fed740 1 Processor -- start 2024-04-20T12:32:59.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f4032fed740 1 -- start start 2024-04-20T12:32:59.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f4032fed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca57a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.517 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f4032fed740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca57a730 0x5588ca582dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f4032fed740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca583310 0x5588ca585700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f4032fed740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5588ca4df110 con 0x5588ca579e10 2024-04-20T12:32:59.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f4032fed740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5588ca47c550 con 0x5588ca57a730 2024-04-20T12:32:59.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f4032fed740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5588ca4db0d0 con 0x5588ca583310 2024-04-20T12:32:59.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f402d98f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca57a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f402d98f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca57a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46668/0 (socket says 172.21.15.135:46668) 2024-04-20T12:32:59.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f402d98f640 1 -- 172.21.15.135:0/26203414 learned_addr learned my addr 172.21.15.135:0/26203414 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f401f7fe640 1 --2- 172.21.15.135:0/3764108656 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f40140a3d20 0x7f40140a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f402d98f640 1 --2- 172.21.15.135:0/26203414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca583310 0x5588ca585700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f402e190640 1 --2- 172.21.15.135:0/26203414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca57a730 0x5588ca582dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.518 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f402e991640 1 --2- 172.21.15.135:0/3764108656 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f40140a3d20 0x7f40140a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f402d98f640 1 -- 172.21.15.135:0/26203414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca583310 msgr2=0x5588ca585700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f402d98f640 1 --2- 172.21.15.135:0/26203414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca583310 0x5588ca585700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f402d98f640 1 -- 172.21.15.135:0/26203414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca57a730 msgr2=0x5588ca582dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f402d98f640 1 --2- 172.21.15.135:0/26203414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca57a730 0x5588ca582dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.509+0000 7f402d98f640 1 -- 172.21.15.135:0/26203414 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ca4a4900 con 0x5588ca579e10 2024-04-20T12:32:59.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.510+0000 7f401f7fe640 1 -- 172.21.15.135:0/3764108656 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f40200d0da0 con 0x7f4028106fa0 2024-04-20T12:32:59.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.510+0000 7f402d98f640 1 --2- 172.21.15.135:0/26203414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca57a1f0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f4018005ab0 tx=0x7f4018005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6292a52389241fc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.510+0000 7f401cbfe640 1 -- 172.21.15.135:0/26203414 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018004020 con 0x5588ca579e10 2024-04-20T12:32:59.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.510+0000 7f402e991640 1 --2- 172.21.15.135:0/3764108656 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f40140a3d20 0x7f40140a61e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f402009c670 tx=0x7f40200054d0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.510+0000 7f401cbfe640 1 -- 172.21.15.135:0/26203414 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4018005520 con 0x5588ca579e10 2024-04-20T12:32:59.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.510+0000 7f401cbfe640 1 -- 172.21.15.135:0/26203414 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018004ae0 con 0x5588ca579e10 2024-04-20T12:32:59.519 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 -- 172.21.15.135:0/26203414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 msgr2=0x5588ca57a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 --2- 172.21.15.135:0/26203414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca57a1f0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f4018005ab0 tx=0x7f4018005b50 comp rx=0 tx=0).stop 2024-04-20T12:32:59.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 -- 172.21.15.135:0/26203414 shutdown_connections 2024-04-20T12:32:59.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 --2- 172.21.15.135:0/26203414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca583310 0x5588ca585700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 --2- 172.21.15.135:0/26203414 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca57a730 0x5588ca582dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 --2- 172.21.15.135:0/26203414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca57a1f0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 -- 172.21.15.135:0/26203414 >> 172.21.15.135:0/26203414 conn(0x5588ca574540 msgr2=0x5588ca574920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 -- 172.21.15.135:0/26203414 shutdown_connections 2024-04-20T12:32:59.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 -- 172.21.15.135:0/26203414 wait complete. 2024-04-20T12:32:59.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 -- start start 2024-04-20T12:32:59.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 Processor -- start 2024-04-20T12:32:59.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca580410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.520 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca57a730 0x5588ca580950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca583310 0x5588ca580e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5588ca585fe0 con 0x5588ca579e10 2024-04-20T12:32:59.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5588ca498500 con 0x5588ca583310 2024-04-20T12:32:59.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5588ca586160 con 0x5588ca57a730 2024-04-20T12:32:59.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f4032fed740 10 client.0 _ll_register_callbacks cb 0x5588ca47d2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:59.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f402d98f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca580410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f402d98f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca580410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46680/0 (socket says 172.21.15.135:46680) 2024-04-20T12:32:59.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.511+0000 7f402d98f640 1 -- 172.21.15.135:0/2839992422 learned_addr learned my addr 172.21.15.135:0/2839992422 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f402d98f640 1 --2- 172.21.15.135:0/2839992422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca583310 0x5588ca580e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f402e190640 1 --2- 172.21.15.135:0/2839992422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca57a730 0x5588ca580950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f402d98f640 1 -- 172.21.15.135:0/2839992422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca57a730 msgr2=0x5588ca580950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.521 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f402d98f640 1 --2- 172.21.15.135:0/2839992422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca57a730 0x5588ca580950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f402d98f640 1 -- 172.21.15.135:0/2839992422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca583310 msgr2=0x5588ca580e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f402d98f640 1 --2- 172.21.15.135:0/2839992422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca583310 0x5588ca580e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f402d98f640 1 -- 172.21.15.135:0/2839992422 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588ca1f13f0 con 0x5588ca579e10 2024-04-20T12:32:59.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f402d98f640 1 --2- 172.21.15.135:0/2839992422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca580410 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f4018005a80 tx=0x7f401802c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22e34a926517e67 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f4011ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:59.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f4011ffb640 1 -- 172.21.15.135:0/2839992422 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018055060 con 0x5588ca579e10 2024-04-20T12:32:59.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f4011ffb640 1 -- 172.21.15.135:0/2839992422 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f4018003a00 con 0x5588ca579e10 2024-04-20T12:32:59.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f4032fed740 1 -- 172.21.15.135:0/2839992422 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4018005520 con 0x5588ca579e10 2024-04-20T12:32:59.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f4011ffb640 1 -- 172.21.15.135:0/2839992422 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4018003c00 con 0x5588ca579e10 2024-04-20T12:32:59.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f4032fed740 10 client.18579 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:59.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f4032fed740 1 -- 172.21.15.135:0/2839992422 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5588ca2bb7d0 con 0x5588ca579e10 2024-04-20T12:32:59.522 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.512+0000 7f4011ffb640 1 -- 172.21.15.135:0/2839992422 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4018005520 con 0x5588ca579e10 2024-04-20T12:32:59.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.513+0000 7f4011ffb640 1 -- 172.21.15.135:0/2839992422 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f4018034560 con 0x5588ca579e10 2024-04-20T12:32:59.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.513+0000 7f4032fed740 10 client.18579 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:59.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.513+0000 7f4032fed740 10 client.18579 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:32:59.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.513+0000 7f4032fed740 20 client.18579 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:59.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.513+0000 7f4032fed740 1 --2- 172.21.15.135:0/2839992422 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5588ca5934a0 0x5588ca595890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.513+0000 7f4032fed740 4 client.18579 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:32:59.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.513+0000 7f4032fed740 1 -- 172.21.15.135:0/2839992422 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588ca4ecb30 con 0x5588ca5934a0 2024-04-20T12:32:59.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.513+0000 7f402e190640 1 --2- 172.21.15.135:0/2839992422 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5588ca5934a0 0x5588ca595890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.513+0000 7f4011ffb640 10 client.18579 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:32:59.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.513+0000 7f402e190640 1 --2- 172.21.15.135:0/2839992422 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5588ca5934a0 0x5588ca595890 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fe157f3672538004 server_cookie=3aee6b7b89ec03f2 in_seq=0 out_seq=0 2024-04-20T12:32:59.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.514+0000 7f4011ffb640 1 -- 172.21.15.135:0/2839992422 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5588ca4ecb30 con 0x5588ca5934a0 2024-04-20T12:32:59.523 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.514+0000 7f4011ffb640 10 client.18579 handle_command_reply: tid=0 2024-04-20T12:32:59.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.514+0000 7f4032fed740 1 client.18579 shutdown 2024-04-20T12:32:59.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.514+0000 7f4032fed740 1 -- 172.21.15.135:0/2839992422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 msgr2=0x5588ca580410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.514+0000 7f4032fed740 1 --2- 172.21.15.135:0/2839992422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca580410 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f4018005a80 tx=0x7f401802c5d0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.514+0000 7f4032fed740 1 -- 172.21.15.135:0/2839992422 shutdown_connections 2024-04-20T12:32:59.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.514+0000 7f4032fed740 1 --2- 172.21.15.135:0/2839992422 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca583310 0x5588ca580e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.514+0000 7f4032fed740 1 --2- 172.21.15.135:0/2839992422 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5588ca5934a0 0x5588ca595890 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.514+0000 7f4032fed740 1 --2- 172.21.15.135:0/2839992422 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca57a730 0x5588ca580950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.514+0000 7f4032fed740 1 --2- 172.21.15.135:0/2839992422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca580410 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.514+0000 7f4011ffb640 0 client.18579 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:32:59.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.514+0000 7f4032fed740 1 -- 172.21.15.135:0/2839992422 >> 172.21.15.135:0/2839992422 conn(0x5588ca574540 msgr2=0x5588ca576290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.514+0000 7f4032fed740 1 -- 172.21.15.135:0/2839992422 shutdown_connections 2024-04-20T12:32:59.524 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.514+0000 7f4032fed740 1 -- 172.21.15.135:0/2839992422 wait complete. 2024-04-20T12:32:59.525 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.515+0000 7f4032fed740 20 client.18579 trim_cache size 0 max 16384 2024-04-20T12:32:59.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f4032fed740 1 Processor -- start 2024-04-20T12:32:59.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f4032fed740 1 -- start start 2024-04-20T12:32:59.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f4032fed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca582b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f4032fed740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca57a730 0x5588ca57d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.533 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f4032fed740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca583310 0x5588ca57dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f4032fed740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f40281af510 con 0x5588ca579e10 2024-04-20T12:32:59.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f4032fed740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f40281b1050 con 0x5588ca583310 2024-04-20T12:32:59.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f4032fed740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f40281afbe0 con 0x5588ca57a730 2024-04-20T12:32:59.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f402d98f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca582b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f402d98f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca582b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46696/0 (socket says 172.21.15.135:46696) 2024-04-20T12:32:59.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f402d98f640 1 -- 172.21.15.135:0/2124932719 learned_addr learned my addr 172.21.15.135:0/2124932719 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f402d98f640 1 -- 172.21.15.135:0/2124932719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca57a730 msgr2=0x5588ca57d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f402d98f640 1 --2- 172.21.15.135:0/2124932719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca57a730 0x5588ca57d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f402d98f640 1 -- 172.21.15.135:0/2124932719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca583310 msgr2=0x5588ca57dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f402d98f640 1 --2- 172.21.15.135:0/2124932719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca583310 0x5588ca57dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.534 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f402d98f640 1 -- 172.21.15.135:0/2124932719 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ca57e980 con 0x5588ca579e10 2024-04-20T12:32:59.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f402d98f640 1 --2- 172.21.15.135:0/2124932719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca582b40 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f4018005ec0 tx=0x7f4018000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d334c971107c507 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f4013fff640 1 -- 172.21.15.135:0/2124932719 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018055040 con 0x5588ca579e10 2024-04-20T12:32:59.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f4013fff640 1 -- 172.21.15.135:0/2124932719 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40180044b0 con 0x5588ca579e10 2024-04-20T12:32:59.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.528+0000 7f4013fff640 1 -- 172.21.15.135:0/2124932719 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018005040 con 0x5588ca579e10 2024-04-20T12:32:59.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.529+0000 7f4032fed740 1 -- 172.21.15.135:0/2124932719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 msgr2=0x5588ca582b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.529+0000 7f4032fed740 1 --2- 172.21.15.135:0/2124932719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca582b40 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f4018005ec0 tx=0x7f4018000bc0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.529+0000 7f4032fed740 1 -- 172.21.15.135:0/2124932719 shutdown_connections 2024-04-20T12:32:59.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.529+0000 7f4032fed740 1 --2- 172.21.15.135:0/2124932719 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca583310 0x5588ca57dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.529+0000 7f4032fed740 1 --2- 172.21.15.135:0/2124932719 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca57a730 0x5588ca57d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.529+0000 7f4032fed740 1 --2- 172.21.15.135:0/2124932719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca582b40 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.529+0000 7f4032fed740 1 -- 172.21.15.135:0/2124932719 >> 172.21.15.135:0/2124932719 conn(0x5588ca574540 msgr2=0x5588ca574920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.535 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.529+0000 7f4032fed740 1 -- 172.21.15.135:0/2124932719 shutdown_connections 2024-04-20T12:32:59.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.529+0000 7f4032fed740 1 -- 172.21.15.135:0/2124932719 wait complete. 2024-04-20T12:32:59.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.529+0000 7f4032fed740 1 -- start start 2024-04-20T12:32:59.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.529+0000 7f4032fed740 1 Processor -- start 2024-04-20T12:32:59.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f4032fed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca596a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f4032fed740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca57a730 0x5588ca596f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f4032fed740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca583310 0x5588ca5f8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f4032fed740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f40281b0980 con 0x5588ca579e10 2024-04-20T12:32:59.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f4032fed740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f40281b02b0 con 0x5588ca57a730 2024-04-20T12:32:59.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f4032fed740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f40281ad4e0 con 0x5588ca583310 2024-04-20T12:32:59.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f4032fed740 10 client.0 _ll_register_callbacks cb 0x7f401802c880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:59.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f402d98f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca596a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f402d98f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca596a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46702/0 (socket says 172.21.15.135:46702) 2024-04-20T12:32:59.536 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f402d98f640 1 -- 172.21.15.135:0/583154253 learned_addr learned my addr 172.21.15.135:0/583154253 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f402e190640 1 --2- 172.21.15.135:0/583154253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca57a730 0x5588ca596f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f402d98f640 1 --2- 172.21.15.135:0/583154253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca583310 0x5588ca5f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f402d98f640 1 -- 172.21.15.135:0/583154253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca583310 msgr2=0x5588ca5f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f402d98f640 1 --2- 172.21.15.135:0/583154253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca583310 0x5588ca5f8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f402d98f640 1 -- 172.21.15.135:0/583154253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca57a730 msgr2=0x5588ca596f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f402d98f640 1 --2- 172.21.15.135:0/583154253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca57a730 0x5588ca596f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f402d98f640 1 -- 172.21.15.135:0/583154253 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588ca5f8bc0 con 0x5588ca579e10 2024-04-20T12:32:59.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f402d98f640 1 --2- 172.21.15.135:0/583154253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca596a40 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f4018034bd0 tx=0x7f4018005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd932313979f442 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f4011ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:59.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f4011ffb640 1 -- 172.21.15.135:0/583154253 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018067070 con 0x5588ca579e10 2024-04-20T12:32:59.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f4011ffb640 1 -- 172.21.15.135:0/583154253 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f4018003900 con 0x5588ca579e10 2024-04-20T12:32:59.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f4032fed740 1 -- 172.21.15.135:0/583154253 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40180044b0 con 0x5588ca579e10 2024-04-20T12:32:59.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f4011ffb640 1 -- 172.21.15.135:0/583154253 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4018073050 con 0x5588ca579e10 2024-04-20T12:32:59.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f4032fed740 10 client.18585 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:59.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.530+0000 7f4032fed740 1 -- 172.21.15.135:0/583154253 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5588ca5f9ec0 con 0x5588ca579e10 2024-04-20T12:32:59.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.531+0000 7f4011ffb640 1 -- 172.21.15.135:0/583154253 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40180044b0 con 0x5588ca579e10 2024-04-20T12:32:59.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.531+0000 7f4011ffb640 1 -- 172.21.15.135:0/583154253 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f40180046c0 con 0x5588ca579e10 2024-04-20T12:32:59.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.531+0000 7f4032fed740 10 client.18585 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:59.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.531+0000 7f4032fed740 10 client.18585 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:32:59.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.531+0000 7f4032fed740 20 client.18585 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:59.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.531+0000 7f4032fed740 1 --2- 172.21.15.135:0/583154253 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5588ca5fa4c0 0x5588ca5fc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.531+0000 7f4032fed740 4 client.18585 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:32:59.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.531+0000 7f4032fed740 1 -- 172.21.15.135:0/583154253 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5588ca4e69a0 con 0x5588ca5fa4c0 2024-04-20T12:32:59.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.531+0000 7f402e190640 1 --2- 172.21.15.135:0/583154253 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5588ca5fa4c0 0x5588ca5fc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.531+0000 7f4011ffb640 10 client.18585 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:32:59.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.531+0000 7f402e190640 1 --2- 172.21.15.135:0/583154253 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5588ca5fa4c0 0x5588ca5fc8e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4595e31fd08e1394 server_cookie=d6d7a391730c296c in_seq=0 out_seq=0 2024-04-20T12:32:59.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f4011ffb640 1 -- 172.21.15.135:0/583154253 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5588ca4e69a0 con 0x5588ca5fa4c0 2024-04-20T12:32:59.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f4011ffb640 10 client.18585 handle_command_reply: tid=0 2024-04-20T12:32:59.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f4032fed740 1 client.18585 shutdown 2024-04-20T12:32:59.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f4032fed740 1 -- 172.21.15.135:0/583154253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 msgr2=0x5588ca596a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f4032fed740 1 --2- 172.21.15.135:0/583154253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca596a40 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f4018034bd0 tx=0x7f4018005b50 comp rx=0 tx=0).stop 2024-04-20T12:32:59.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f4032fed740 1 -- 172.21.15.135:0/583154253 shutdown_connections 2024-04-20T12:32:59.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f4032fed740 1 --2- 172.21.15.135:0/583154253 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x5588ca5fa4c0 0x5588ca5fc8e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f4032fed740 1 --2- 172.21.15.135:0/583154253 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5588ca583310 0x5588ca5f8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f4011ffb640 0 client.18585 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:32:59.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f4032fed740 1 --2- 172.21.15.135:0/583154253 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5588ca57a730 0x5588ca596f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f4032fed740 1 --2- 172.21.15.135:0/583154253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ca579e10 0x5588ca596a40 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f4032fed740 1 -- 172.21.15.135:0/583154253 >> 172.21.15.135:0/583154253 conn(0x5588ca574540 msgr2=0x5588ca575820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f4032fed740 1 -- 172.21.15.135:0/583154253 shutdown_connections 2024-04-20T12:32:59.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f4032fed740 1 -- 172.21.15.135:0/583154253 wait complete. 2024-04-20T12:32:59.540 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f4032fed740 20 client.18585 trim_cache size 0 max 16384 2024-04-20T12:32:59.540 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:32:59.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f40303f4640 1 -- 172.21.15.135:0/3764108656 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f40140a3d20 msgr2=0x7f40140a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f40303f4640 1 --2- 172.21.15.135:0/3764108656 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f40140a3d20 0x7f40140a61e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f402009c670 tx=0x7f40200054d0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f40303f4640 1 -- 172.21.15.135:0/3764108656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4028106fa0 msgr2=0x7f40281986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.541 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f40303f4640 1 --2- 172.21.15.135:0/3764108656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4028106fa0 0x7f40281986c0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f402000e960 tx=0x7f402000ee20 comp rx=0 tx=0).stop 2024-04-20T12:32:59.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f40303f4640 1 -- 172.21.15.135:0/3764108656 shutdown_connections 2024-04-20T12:32:59.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f40303f4640 1 --2- 172.21.15.135:0/3764108656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4028106fa0 0x7f40281986c0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f40303f4640 1 --2- 172.21.15.135:0/3764108656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4028101b50 0x7f402819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f40303f4640 1 --2- 172.21.15.135:0/3764108656 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f40140a3d20 0x7f40140a61e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f40303f4640 1 --2- 172.21.15.135:0/3764108656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f40281011b0 0x7f402819e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f40303f4640 1 -- 172.21.15.135:0/3764108656 >> 172.21.15.135:0/3764108656 conn(0x7f4028076c60 msgr2=0x7f4028100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f40303f4640 1 -- 172.21.15.135:0/3764108656 shutdown_connections 2024-04-20T12:32:59.542 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.532+0000 7f40303f4640 1 -- 172.21.15.135:0/3764108656 wait complete. 2024-04-20T12:32:59.543 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:32:59.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.643+0000 7f709bba4640 1 -- 172.21.15.135:0/1529123085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7094107280 msgr2=0x7f709410ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.643+0000 7f709bba4640 1 --2- 172.21.15.135:0/1529123085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7094107280 0x7f709410ee50 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f708c009ca0 tx=0x7f708c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.643+0000 7f709bba4640 1 -- 172.21.15.135:0/1529123085 shutdown_connections 2024-04-20T12:32:59.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.643+0000 7f709bba4640 1 --2- 172.21.15.135:0/1529123085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7094107280 0x7f709410ee50 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.643+0000 7f709bba4640 1 --2- 172.21.15.135:0/1529123085 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7094102b60 0x7f7094106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.643+0000 7f709bba4640 1 --2- 172.21.15.135:0/1529123085 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70941021b0 0x7f7094102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.643+0000 7f709bba4640 1 -- 172.21.15.135:0/1529123085 >> 172.21.15.135:0/1529123085 conn(0x7f70940fda50 msgr2=0x7f70940ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.645 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.643+0000 7f709bba4640 1 -- 172.21.15.135:0/1529123085 shutdown_connections 2024-04-20T12:32:59.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.643+0000 7f709bba4640 1 -- 172.21.15.135:0/1529123085 wait complete. 2024-04-20T12:32:59.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f709bba4640 1 Processor -- start 2024-04-20T12:32:59.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f709bba4640 1 -- start start 2024-04-20T12:32:59.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f709bba4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70941021b0 0x7f709419e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f709bba4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7094107280 0x7f709419e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f709bba4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7094198620 0x7f7094198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f709bba4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7094112340 con 0x7f70941021b0 2024-04-20T12:32:59.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f709bba4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f70941121c0 con 0x7f7094107280 2024-04-20T12:32:59.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f709bba4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70941124c0 con 0x7f7094198620 2024-04-20T12:32:59.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f7099940640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70941021b0 0x7f709419e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f7099940640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70941021b0 0x7f709419e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46720/0 (socket says 172.21.15.135:46720) 2024-04-20T12:32:59.646 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f7099940640 1 -- 172.21.15.135:0/3734073926 learned_addr learned my addr 172.21.15.135:0/3734073926 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f7099940640 1 -- 172.21.15.135:0/3734073926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7094198620 msgr2=0x7f7094198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f7099940640 1 --2- 172.21.15.135:0/3734073926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7094198620 0x7f7094198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f7099940640 1 -- 172.21.15.135:0/3734073926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7094107280 msgr2=0x7f709419e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f7099940640 1 --2- 172.21.15.135:0/3734073926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7094107280 0x7f709419e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.644+0000 7f7099940640 1 -- 172.21.15.135:0/3734073926 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7094199140 con 0x7f70941021b0 2024-04-20T12:32:59.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.645+0000 7f7099940640 1 --2- 172.21.15.135:0/3734073926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70941021b0 0x7f709419e470 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f709000d770 tx=0x7f709000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.645+0000 7f708affd640 1 -- 172.21.15.135:0/3734073926 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090017070 con 0x7f70941021b0 2024-04-20T12:32:59.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.645+0000 7f709bba4640 1 -- 172.21.15.135:0/3734073926 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7094199430 con 0x7f70941021b0 2024-04-20T12:32:59.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.645+0000 7f708affd640 1 -- 172.21.15.135:0/3734073926 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7090005500 con 0x7f70941021b0 2024-04-20T12:32:59.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.645+0000 7f708affd640 1 -- 172.21.15.135:0/3734073926 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090004e00 con 0x7f70941021b0 2024-04-20T12:32:59.647 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.645+0000 7f709bba4640 1 -- 172.21.15.135:0/3734073926 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70941a5630 con 0x7f70941021b0 2024-04-20T12:32:59.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.647+0000 7f708affd640 1 -- 172.21.15.135:0/3734073926 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f7090004fa0 con 0x7f70941021b0 2024-04-20T12:32:59.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.647+0000 7f709e790740 1 Processor -- start 2024-04-20T12:32:59.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.647+0000 7f709e790740 1 -- start start 2024-04-20T12:32:59.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709e790740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631dce10 0x55fe631dd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.648 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709e790740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dd730 0x55fe631e5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709e790740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631e6310 0x55fe631e8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709e790740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fe63142110 con 0x55fe631dce10 2024-04-20T12:32:59.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709e790740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fe630df550 con 0x55fe631e6310 2024-04-20T12:32:59.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709e790740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fe6313e0d0 con 0x55fe631dd730 2024-04-20T12:32:59.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709a141640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631dce10 0x55fe631dd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709a141640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631dce10 0x55fe631dd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46736/0 (socket says 172.21.15.135:46736) 2024-04-20T12:32:59.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709a141640 1 -- 172.21.15.135:0/1826959780 learned_addr learned my addr 172.21.15.135:0/1826959780 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709913f640 1 --2- 172.21.15.135:0/1826959780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631e6310 0x55fe631e8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.655 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f708affd640 1 --2- 172.21.15.135:0/3734073926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f70800a3d20 0x7f70800a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f7099940640 1 --2- 172.21.15.135:0/1826959780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dd730 0x55fe631e5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709a141640 1 -- 172.21.15.135:0/1826959780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dd730 msgr2=0x55fe631e5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709a141640 1 --2- 172.21.15.135:0/1826959780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dd730 0x55fe631e5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709a141640 1 -- 172.21.15.135:0/1826959780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631e6310 msgr2=0x55fe631e8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709a141640 1 --2- 172.21.15.135:0/1826959780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631e6310 0x55fe631e8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709a141640 1 -- 172.21.15.135:0/1826959780 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe63107900 con 0x55fe631dce10 2024-04-20T12:32:59.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709a141640 1 --2- 172.21.15.135:0/3734073926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f70800a3d20 0x7f70800a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f708affd640 1 -- 172.21.15.135:0/3734073926 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f70900d06d0 con 0x7f70941021b0 2024-04-20T12:32:59.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f709a141640 1 --2- 172.21.15.135:0/1826959780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631dce10 0x55fe631dd1f0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f708c02c700 tx=0x7f708c0323f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4835d4106b150ef0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.648+0000 7f707ffff640 1 -- 172.21.15.135:0/1826959780 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c043040 con 0x55fe631dce10 2024-04-20T12:32:59.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.649+0000 7f709a141640 1 --2- 172.21.15.135:0/3734073926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f70800a3d20 0x7f70800a61e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f708c004af0 tx=0x7f708c04a000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.649+0000 7f707ffff640 1 -- 172.21.15.135:0/1826959780 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f708c003b70 con 0x55fe631dce10 2024-04-20T12:32:59.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.649+0000 7f707ffff640 1 -- 172.21.15.135:0/1826959780 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c039040 con 0x55fe631dce10 2024-04-20T12:32:59.656 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.649+0000 7f709e790740 1 -- 172.21.15.135:0/1826959780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631dce10 msgr2=0x55fe631dd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.649+0000 7f709e790740 1 --2- 172.21.15.135:0/1826959780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631dce10 0x55fe631dd1f0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f708c02c700 tx=0x7f708c0323f0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.649+0000 7f709e790740 1 -- 172.21.15.135:0/1826959780 shutdown_connections 2024-04-20T12:32:59.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.649+0000 7f709e790740 1 --2- 172.21.15.135:0/1826959780 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631e6310 0x55fe631e8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.649+0000 7f709e790740 1 --2- 172.21.15.135:0/1826959780 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dd730 0x55fe631e5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.657 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.649+0000 7f709e790740 1 --2- 172.21.15.135:0/1826959780 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631dce10 0x55fe631dd1f0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.649+0000 7f709e790740 1 -- 172.21.15.135:0/1826959780 >> 172.21.15.135:0/1826959780 conn(0x55fe631d7540 msgr2=0x55fe631d7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.649+0000 7f709e790740 1 -- 172.21.15.135:0/1826959780 shutdown_connections 2024-04-20T12:32:59.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.649+0000 7f709e790740 1 -- 172.21.15.135:0/1826959780 wait complete. 2024-04-20T12:32:59.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.650+0000 7f709e790740 1 -- start start 2024-04-20T12:32:59.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.650+0000 7f709e790740 1 Processor -- start 2024-04-20T12:32:59.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.650+0000 7f709e790740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631dce10 0x55fe631e3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.650+0000 7f709e790740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dd730 0x55fe631e3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.650+0000 7f709e790740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631e6310 0x55fe631e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.650+0000 7f709e790740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fe631e8fe0 con 0x55fe631e6310 2024-04-20T12:32:59.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.650+0000 7f709e790740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fe630fb500 con 0x55fe631dce10 2024-04-20T12:32:59.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.650+0000 7f709e790740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fe631e9160 con 0x55fe631dd730 2024-04-20T12:32:59.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.650+0000 7f709e790740 10 client.0 _ll_register_callbacks cb 0x55fe630e02f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:59.658 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.650+0000 7f709a141640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631e6310 0x55fe631e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.650+0000 7f709a141640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631e6310 0x55fe631e3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46752/0 (socket says 172.21.15.135:46752) 2024-04-20T12:32:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.650+0000 7f709a141640 1 -- 172.21.15.135:0/267090684 learned_addr learned my addr 172.21.15.135:0/267090684 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.650+0000 7f709913f640 1 --2- 172.21.15.135:0/267090684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dd730 0x55fe631e3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.650+0000 7f7099940640 1 --2- 172.21.15.135:0/267090684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631dce10 0x55fe631e3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f709a141640 1 -- 172.21.15.135:0/267090684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dd730 msgr2=0x55fe631e3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f709a141640 1 --2- 172.21.15.135:0/267090684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dd730 0x55fe631e3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f709a141640 1 -- 172.21.15.135:0/267090684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631dce10 msgr2=0x55fe631e3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f709a141640 1 --2- 172.21.15.135:0/267090684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631dce10 0x55fe631e3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f709a141640 1 -- 172.21.15.135:0/267090684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe62e543f0 con 0x55fe631e6310 2024-04-20T12:32:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f709a141640 1 --2- 172.21.15.135:0/267090684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631e6310 0x55fe631e3f90 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f708c005dc0 tx=0x7f708c004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee413c8040e6755 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f707d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f707d7fa640 1 -- 172.21.15.135:0/267090684 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c039070 con 0x55fe631e6310 2024-04-20T12:32:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f707d7fa640 1 -- 172.21.15.135:0/267090684 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f708c004440 con 0x55fe631e6310 2024-04-20T12:32:59.659 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f709e790740 1 -- 172.21.15.135:0/267090684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f708c003b70 con 0x55fe631e6310 2024-04-20T12:32:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f707d7fa640 1 -- 172.21.15.135:0/267090684 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f708c043040 con 0x55fe631e6310 2024-04-20T12:32:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f709e790740 10 client.18597 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f709e790740 1 -- 172.21.15.135:0/267090684 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fe62f1e7d0 con 0x55fe631e6310 2024-04-20T12:32:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f707d7fa640 1 -- 172.21.15.135:0/267090684 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f708c003b70 con 0x55fe631e6310 2024-04-20T12:32:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f707d7fa640 1 -- 172.21.15.135:0/267090684 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f708c047070 con 0x55fe631e6310 2024-04-20T12:32:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f709e790740 10 client.18597 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f709e790740 10 client.18597 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:32:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f709e790740 20 client.18597 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f709e790740 1 --2- 172.21.15.135:0/267090684 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55fe631f6570 0x55fe631f8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f709e790740 4 client.18597 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:32:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.651+0000 7f709e790740 1 -- 172.21.15.135:0/267090684 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe6314fb30 con 0x55fe631f6570 2024-04-20T12:32:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.652+0000 7f7099940640 1 --2- 172.21.15.135:0/267090684 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55fe631f6570 0x55fe631f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.652+0000 7f707d7fa640 10 client.18597 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:32:59.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.652+0000 7f7099940640 1 --2- 172.21.15.135:0/267090684 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55fe631f6570 0x55fe631f8960 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cbf9af2bbad3053 server_cookie=108474870deb169e in_seq=0 out_seq=0 2024-04-20T12:32:59.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.653+0000 7f707d7fa640 1 -- 172.21.15.135:0/267090684 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fe6314fb30 con 0x55fe631f6570 2024-04-20T12:32:59.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.653+0000 7f707d7fa640 10 client.18597 handle_command_reply: tid=0 2024-04-20T12:32:59.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.653+0000 7f709e790740 1 client.18597 shutdown 2024-04-20T12:32:59.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.653+0000 7f709e790740 1 -- 172.21.15.135:0/267090684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631e6310 msgr2=0x55fe631e3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.653+0000 7f709e790740 1 --2- 172.21.15.135:0/267090684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631e6310 0x55fe631e3f90 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f708c005dc0 tx=0x7f708c004250 comp rx=0 tx=0).stop 2024-04-20T12:32:59.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.653+0000 7f709e790740 1 -- 172.21.15.135:0/267090684 shutdown_connections 2024-04-20T12:32:59.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.653+0000 7f709e790740 1 --2- 172.21.15.135:0/267090684 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55fe631f6570 0x55fe631f8960 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.653+0000 7f709e790740 1 --2- 172.21.15.135:0/267090684 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631e6310 0x55fe631e3f90 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.653+0000 7f707d7fa640 0 client.18597 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:32:59.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.653+0000 7f709e790740 1 --2- 172.21.15.135:0/267090684 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dd730 0x55fe631e3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.653+0000 7f709e790740 1 --2- 172.21.15.135:0/267090684 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631dce10 0x55fe631e3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.653+0000 7f709e790740 1 -- 172.21.15.135:0/267090684 >> 172.21.15.135:0/267090684 conn(0x55fe631d7540 msgr2=0x55fe631d9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.653+0000 7f709e790740 1 -- 172.21.15.135:0/267090684 shutdown_connections 2024-04-20T12:32:59.661 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.653+0000 7f709e790740 1 -- 172.21.15.135:0/267090684 wait complete. 2024-04-20T12:32:59.662 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.653+0000 7f709e790740 20 client.18597 trim_cache size 0 max 16384 2024-04-20T12:32:59.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709e790740 1 Processor -- start 2024-04-20T12:32:59.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709e790740 1 -- start start 2024-04-20T12:32:59.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709e790740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dce10 0x55fe631e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.672 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709e790740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631dd730 0x55fe631e2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709e790740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631e6310 0x55fe631fdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709e790740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70941af580 con 0x55fe631e6310 2024-04-20T12:32:59.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709e790740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f70941b10c0 con 0x55fe631dd730 2024-04-20T12:32:59.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709e790740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70941afc50 con 0x55fe631dce10 2024-04-20T12:32:59.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709a141640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631e6310 0x55fe631fdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709a141640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631e6310 0x55fe631fdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46766/0 (socket says 172.21.15.135:46766) 2024-04-20T12:32:59.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709a141640 1 -- 172.21.15.135:0/2206439088 learned_addr learned my addr 172.21.15.135:0/2206439088 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709913f640 1 --2- 172.21.15.135:0/2206439088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631dd730 0x55fe631e2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f7099940640 1 --2- 172.21.15.135:0/2206439088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dce10 0x55fe631e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709a141640 1 -- 172.21.15.135:0/2206439088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dce10 msgr2=0x55fe631e5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709a141640 1 --2- 172.21.15.135:0/2206439088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dce10 0x55fe631e5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709a141640 1 -- 172.21.15.135:0/2206439088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631dd730 msgr2=0x55fe631e2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709a141640 1 --2- 172.21.15.135:0/2206439088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631dd730 0x55fe631e2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.673 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709a141640 1 -- 172.21.15.135:0/2206439088 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe631d2e10 con 0x55fe631e6310 2024-04-20T12:32:59.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.667+0000 7f709a141640 1 --2- 172.21.15.135:0/2206439088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631e6310 0x55fe631fdf60 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f708c02c860 tx=0x7f708c032340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80e3d035d58e570 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.668+0000 7f707f7fe640 1 -- 172.21.15.135:0/2206439088 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c039040 con 0x55fe631e6310 2024-04-20T12:32:59.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.668+0000 7f707f7fe640 1 -- 172.21.15.135:0/2206439088 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f708c032960 con 0x55fe631e6310 2024-04-20T12:32:59.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.668+0000 7f707f7fe640 1 -- 172.21.15.135:0/2206439088 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c004520 con 0x55fe631e6310 2024-04-20T12:32:59.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.668+0000 7f709e790740 1 -- 172.21.15.135:0/2206439088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631e6310 msgr2=0x55fe631fdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.668+0000 7f709e790740 1 --2- 172.21.15.135:0/2206439088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631e6310 0x55fe631fdf60 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f708c02c860 tx=0x7f708c032340 comp rx=0 tx=0).stop 2024-04-20T12:32:59.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.668+0000 7f709e790740 1 -- 172.21.15.135:0/2206439088 shutdown_connections 2024-04-20T12:32:59.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.668+0000 7f709e790740 1 --2- 172.21.15.135:0/2206439088 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631e6310 0x55fe631fdf60 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.668+0000 7f709e790740 1 --2- 172.21.15.135:0/2206439088 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631dd730 0x55fe631e2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.668+0000 7f709e790740 1 --2- 172.21.15.135:0/2206439088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dce10 0x55fe631e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.668+0000 7f709e790740 1 -- 172.21.15.135:0/2206439088 >> 172.21.15.135:0/2206439088 conn(0x55fe631d7540 msgr2=0x55fe631ddc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.668+0000 7f709e790740 1 -- 172.21.15.135:0/2206439088 shutdown_connections 2024-04-20T12:32:59.674 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.668+0000 7f709e790740 1 -- 172.21.15.135:0/2206439088 wait complete. 2024-04-20T12:32:59.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f709e790740 1 -- start start 2024-04-20T12:32:59.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f709e790740 1 Processor -- start 2024-04-20T12:32:59.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f709e790740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631dce10 0x55fe631ee180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f709e790740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dd730 0x55fe631ee6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f709e790740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631e6310 0x55fe631dfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f709e790740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70941b09f0 con 0x55fe631dce10 2024-04-20T12:32:59.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f709e790740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f70941b0320 con 0x55fe631e6310 2024-04-20T12:32:59.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f709e790740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70941ad550 con 0x55fe631dd730 2024-04-20T12:32:59.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f709e790740 10 client.0 _ll_register_callbacks cb 0x7f7084005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:59.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f7099940640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631dce10 0x55fe631ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f7099940640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631dce10 0x55fe631ee180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46772/0 (socket says 172.21.15.135:46772) 2024-04-20T12:32:59.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f7099940640 1 -- 172.21.15.135:0/3083576186 learned_addr learned my addr 172.21.15.135:0/3083576186 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f709a141640 1 --2- 172.21.15.135:0/3083576186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631e6310 0x55fe631dfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.675 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f7099940640 1 -- 172.21.15.135:0/3083576186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dd730 msgr2=0x55fe631ee6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f7099940640 1 --2- 172.21.15.135:0/3083576186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dd730 0x55fe631ee6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f7099940640 1 -- 172.21.15.135:0/3083576186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631e6310 msgr2=0x55fe631dfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f7099940640 1 --2- 172.21.15.135:0/3083576186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631e6310 0x55fe631dfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f7099940640 1 -- 172.21.15.135:0/3083576186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe631e0270 con 0x55fe631dce10 2024-04-20T12:32:59.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f709a141640 1 --2- 172.21.15.135:0/3083576186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631e6310 0x55fe631dfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:59.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f7099940640 1 --2- 172.21.15.135:0/3083576186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631dce10 0x55fe631ee180 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f70900cdab0 tx=0x7f709009bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d820947ba569ce07 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.669+0000 7f707d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:59.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.670+0000 7f707d7fa640 1 -- 172.21.15.135:0/3083576186 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090020040 con 0x55fe631dce10 2024-04-20T12:32:59.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.670+0000 7f707d7fa640 1 -- 172.21.15.135:0/3083576186 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f7090009cc0 con 0x55fe631dce10 2024-04-20T12:32:59.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.670+0000 7f709e790740 1 -- 172.21.15.135:0/3083576186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f708c032960 con 0x55fe631dce10 2024-04-20T12:32:59.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.670+0000 7f707d7fa640 1 -- 172.21.15.135:0/3083576186 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f70900a0650 con 0x55fe631dce10 2024-04-20T12:32:59.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.670+0000 7f709e790740 10 client.18603 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:59.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.670+0000 7f709e790740 1 -- 172.21.15.135:0/3083576186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fe6325c1f0 con 0x55fe631dce10 2024-04-20T12:32:59.676 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.670+0000 7f707d7fa640 1 -- 172.21.15.135:0/3083576186 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f708c032960 con 0x55fe631dce10 2024-04-20T12:32:59.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.670+0000 7f707d7fa640 1 -- 172.21.15.135:0/3083576186 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f70900cdcd0 con 0x55fe631dce10 2024-04-20T12:32:59.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.670+0000 7f709e790740 10 client.18603 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:59.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.670+0000 7f709e790740 10 client.18603 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:32:59.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.670+0000 7f709e790740 20 client.18603 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:59.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.670+0000 7f709e790740 1 --2- 172.21.15.135:0/3083576186 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55fe6325c8c0 0x55fe6325ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.670+0000 7f709e790740 4 client.18603 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:32:59.677 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.670+0000 7f709e790740 1 -- 172.21.15.135:0/3083576186 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fe631499a0 con 0x55fe6325c8c0 2024-04-20T12:32:59.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.670+0000 7f709913f640 1 --2- 172.21.15.135:0/3083576186 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55fe6325c8c0 0x55fe6325ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f709913f640 1 --2- 172.21.15.135:0/3083576186 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55fe6325c8c0 0x55fe6325ed20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=50a24e9bdd25e667 server_cookie=e7e95be6737f4426 in_seq=0 out_seq=0 2024-04-20T12:32:59.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f707d7fa640 10 client.18603 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:32:59.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f707d7fa640 1 -- 172.21.15.135:0/3083576186 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fe631499a0 con 0x55fe6325c8c0 2024-04-20T12:32:59.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f707d7fa640 10 client.18603 handle_command_reply: tid=0 2024-04-20T12:32:59.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f709e790740 1 client.18603 shutdown 2024-04-20T12:32:59.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f709e790740 1 -- 172.21.15.135:0/3083576186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631dce10 msgr2=0x55fe631ee180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f709e790740 1 --2- 172.21.15.135:0/3083576186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631dce10 0x55fe631ee180 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f70900cdab0 tx=0x7f709009bf10 comp rx=0 tx=0).stop 2024-04-20T12:32:59.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f709e790740 1 -- 172.21.15.135:0/3083576186 shutdown_connections 2024-04-20T12:32:59.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f709e790740 1 --2- 172.21.15.135:0/3083576186 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x55fe6325c8c0 0x55fe6325ed20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f709e790740 1 --2- 172.21.15.135:0/3083576186 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fe631e6310 0x55fe631dfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f709e790740 1 --2- 172.21.15.135:0/3083576186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fe631dd730 0x55fe631ee6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f707d7fa640 0 client.18603 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:32:59.678 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f709e790740 1 --2- 172.21.15.135:0/3083576186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fe631dce10 0x55fe631ee180 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f709e790740 1 -- 172.21.15.135:0/3083576186 >> 172.21.15.135:0/3083576186 conn(0x55fe631d7540 msgr2=0x55fe631d5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f709e790740 1 -- 172.21.15.135:0/3083576186 shutdown_connections 2024-04-20T12:32:59.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.671+0000 7f709e790740 1 -- 172.21.15.135:0/3083576186 wait complete. 2024-04-20T12:32:59.679 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.672+0000 7f709e790740 20 client.18603 trim_cache size 0 max 16384 2024-04-20T12:32:59.679 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:32:59.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.672+0000 7f709bba4640 1 -- 172.21.15.135:0/3734073926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f70800a3d20 msgr2=0x7f70800a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.672+0000 7f709bba4640 1 --2- 172.21.15.135:0/3734073926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f70800a3d20 0x7f70800a61e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f708c004af0 tx=0x7f708c04a000 comp rx=0 tx=0).stop 2024-04-20T12:32:59.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.672+0000 7f709bba4640 1 -- 172.21.15.135:0/3734073926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70941021b0 msgr2=0x7f709419e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.672+0000 7f709bba4640 1 --2- 172.21.15.135:0/3734073926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70941021b0 0x7f709419e470 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f709000d770 tx=0x7f709000dc30 comp rx=0 tx=0).stop 2024-04-20T12:32:59.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.672+0000 7f709bba4640 1 -- 172.21.15.135:0/3734073926 shutdown_connections 2024-04-20T12:32:59.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.672+0000 7f709bba4640 1 --2- 172.21.15.135:0/3734073926 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f70800a3d20 0x7f70800a61e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.672+0000 7f709bba4640 1 --2- 172.21.15.135:0/3734073926 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7094198620 0x7f7094198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.672+0000 7f709bba4640 1 --2- 172.21.15.135:0/3734073926 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7094107280 0x7f709419e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.680 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.672+0000 7f709bba4640 1 --2- 172.21.15.135:0/3734073926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70941021b0 0x7f709419e470 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.672+0000 7f709bba4640 1 -- 172.21.15.135:0/3734073926 >> 172.21.15.135:0/3734073926 conn(0x7f70940fda50 msgr2=0x7f70940ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.672+0000 7f709bba4640 1 -- 172.21.15.135:0/3734073926 shutdown_connections 2024-04-20T12:32:59.681 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.672+0000 7f709bba4640 1 -- 172.21.15.135:0/3734073926 wait complete. 2024-04-20T12:32:59.681 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:32:59 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1775731141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:32:59.682 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:32:59.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:32:59 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1775731141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:32:59.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.783+0000 7f0bd5aa5640 1 -- 172.21.15.135:0/538393281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd0102190 msgr2=0x7f0bd0105cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.783+0000 7f0bd5aa5640 1 --2- 172.21.15.135:0/538393281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd0102190 0x7f0bd0105cb0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009900 tx=0x7f0bc402bc30 comp rx=0 tx=0).stop 2024-04-20T12:32:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.783+0000 7f0bd5aa5640 1 -- 172.21.15.135:0/538393281 shutdown_connections 2024-04-20T12:32:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.783+0000 7f0bd5aa5640 1 --2- 172.21.15.135:0/538393281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bd0106390 0x7f0bd010df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.783+0000 7f0bd5aa5640 1 --2- 172.21.15.135:0/538393281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd0102190 0x7f0bd0105cb0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.783+0000 7f0bd5aa5640 1 --2- 172.21.15.135:0/538393281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bd01017e0 0x7f0bd0101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.783+0000 7f0bd5aa5640 1 -- 172.21.15.135:0/538393281 >> 172.21.15.135:0/538393281 conn(0x7f0bd0077420 msgr2=0x7f0bd00fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.783+0000 7f0bd5aa5640 1 -- 172.21.15.135:0/538393281 shutdown_connections 2024-04-20T12:32:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.783+0000 7f0bd5aa5640 1 -- 172.21.15.135:0/538393281 wait complete. 2024-04-20T12:32:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.783+0000 7f0bd5aa5640 1 Processor -- start 2024-04-20T12:32:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bd5aa5640 1 -- start start 2024-04-20T12:32:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bd5aa5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd01017e0 0x7f0bd019e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bd5aa5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bd0106390 0x7f0bd019ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bd5aa5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bd0198860 0x7f0bd0198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bd5aa5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd0111400 con 0x7f0bd01017e0 2024-04-20T12:32:59.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bd5aa5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd0111280 con 0x7f0bd0106390 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bd5aa5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd0111580 con 0x7f0bd0198860 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd01017e0 0x7f0bd019e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd01017e0 0x7f0bd019e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46794/0 (socket says 172.21.15.135:46794) 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/2641991320 learned_addr learned my addr 172.21.15.135:0/2641991320 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bceffd640 1 --2- 172.21.15.135:0/2641991320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bd0106390 0x7f0bd019ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/2641991320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bd0198860 msgr2=0x7f0bd0198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bcf7fe640 1 --2- 172.21.15.135:0/2641991320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bd0198860 0x7f0bd0198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/2641991320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bd0106390 msgr2=0x7f0bd019ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bcf7fe640 1 --2- 172.21.15.135:0/2641991320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bd0106390 0x7f0bd019ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/2641991320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd0199380 con 0x7f0bd01017e0 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bcf7fe640 1 --2- 172.21.15.135:0/2641991320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd01017e0 0x7f0bd019e6b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000e9f0 tx=0x7f0bc000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bccff9640 1 -- 172.21.15.135:0/2641991320 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc000cd80 con 0x7f0bd01017e0 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bccff9640 1 -- 172.21.15.135:0/2641991320 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc0010910 con 0x7f0bd01017e0 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bd5aa5640 1 -- 172.21.15.135:0/2641991320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd0199670 con 0x7f0bd01017e0 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bccff9640 1 -- 172.21.15.135:0/2641991320 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00188f0 con 0x7f0bd01017e0 2024-04-20T12:32:59.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.784+0000 7f0bd5aa5640 1 -- 172.21.15.135:0/2641991320 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd01a58c0 con 0x7f0bd01017e0 2024-04-20T12:32:59.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bccff9640 1 -- 172.21.15.135:0/2641991320 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f0bc0010ac0 con 0x7f0bd01017e0 2024-04-20T12:32:59.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bd8773740 1 Processor -- start 2024-04-20T12:32:59.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bd8773740 1 -- start start 2024-04-20T12:32:59.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bd8773740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d9877ce10 0x556d9877d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bd8773740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877d730 0x556d98785dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bd8773740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d98786310 0x556d98788700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bd8773740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556d986e2110 con 0x556d9877d730 2024-04-20T12:32:59.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bd8773740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556d9867f550 con 0x556d9877ce10 2024-04-20T12:32:59.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bd8773740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556d986de0d0 con 0x556d98786310 2024-04-20T12:32:59.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877d730 0x556d98785dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877d730 0x556d98785dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46806/0 (socket says 172.21.15.135:46806) 2024-04-20T12:32:59.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bccff9640 1 --2- 172.21.15.135:0/2641991320 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0bb80a3d20 0x7f0bb80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/651698795 learned_addr learned my addr 172.21.15.135:0/651698795 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bcffff640 1 --2- 172.21.15.135:0/2641991320 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0bb80a3d20 0x7f0bb80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bcffff640 1 --2- 172.21.15.135:0/651698795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d9877ce10 0x556d9877d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bceffd640 1 --2- 172.21.15.135:0/651698795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d98786310 0x556d98788700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.790 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bccff9640 1 -- 172.21.15.135:0/2641991320 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f0bc00d1020 con 0x7f0bd01017e0 2024-04-20T12:32:59.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/651698795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d98786310 msgr2=0x556d98788700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bcf7fe640 1 --2- 172.21.15.135:0/651698795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d98786310 0x556d98788700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/651698795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d9877ce10 msgr2=0x556d9877d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.787+0000 7f0bcf7fe640 1 --2- 172.21.15.135:0/651698795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d9877ce10 0x556d9877d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.788+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/651698795 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d986a7900 con 0x556d9877d730 2024-04-20T12:32:59.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.788+0000 7f0bceffd640 1 --2- 172.21.15.135:0/651698795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d98786310 0x556d98788700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:59.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.788+0000 7f0bcffff640 1 --2- 172.21.15.135:0/651698795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d9877ce10 0x556d9877d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:59.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.788+0000 7f0bcffff640 1 --2- 172.21.15.135:0/2641991320 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0bb80a3d20 0x7f0bb80a61e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009370 tx=0x7f0bc8009240 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.788+0000 7f0bcf7fe640 1 --2- 172.21.15.135:0/651698795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877d730 0x556d98785dd0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f0bc009cb80 tx=0x7f0bc001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed97aced4b726c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.788+0000 7f0bb5ffb640 1 -- 172.21.15.135:0/651698795 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00a5860 con 0x556d9877d730 2024-04-20T12:32:59.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.788+0000 7f0bb5ffb640 1 -- 172.21.15.135:0/651698795 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc0099260 con 0x556d9877d730 2024-04-20T12:32:59.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.788+0000 7f0bb5ffb640 1 -- 172.21.15.135:0/651698795 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00d3070 con 0x556d9877d730 2024-04-20T12:32:59.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 -- 172.21.15.135:0/651698795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877d730 msgr2=0x556d98785dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 --2- 172.21.15.135:0/651698795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877d730 0x556d98785dd0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f0bc009cb80 tx=0x7f0bc001f000 comp rx=0 tx=0).stop 2024-04-20T12:32:59.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 -- 172.21.15.135:0/651698795 shutdown_connections 2024-04-20T12:32:59.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 --2- 172.21.15.135:0/651698795 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d98786310 0x556d98788700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 --2- 172.21.15.135:0/651698795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877d730 0x556d98785dd0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 --2- 172.21.15.135:0/651698795 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d9877ce10 0x556d9877d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 -- 172.21.15.135:0/651698795 >> 172.21.15.135:0/651698795 conn(0x556d98777540 msgr2=0x556d98777920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 -- 172.21.15.135:0/651698795 shutdown_connections 2024-04-20T12:32:59.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 -- 172.21.15.135:0/651698795 wait complete. 2024-04-20T12:32:59.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 -- start start 2024-04-20T12:32:59.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 Processor -- start 2024-04-20T12:32:59.792 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d98783450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d9877d730 0x556d98783990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d98786310 0x556d98783ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.796 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556d98788fe0 con 0x556d9877ce10 2024-04-20T12:32:59.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x556d9869b500 con 0x556d98786310 2024-04-20T12:32:59.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x556d98789160 con 0x556d9877d730 2024-04-20T12:32:59.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bd8773740 10 client.0 _ll_register_callbacks cb 0x556d986802f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:59.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.789+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d98783450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d98783450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46812/0 (socket says 172.21.15.135:46812) 2024-04-20T12:32:59.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/3093205762 learned_addr learned my addr 172.21.15.135:0/3093205762 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bcffff640 1 --2- 172.21.15.135:0/3093205762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d98786310 0x556d98783ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bceffd640 1 --2- 172.21.15.135:0/3093205762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d9877d730 0x556d98783990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/3093205762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d9877d730 msgr2=0x556d98783990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bcf7fe640 1 --2- 172.21.15.135:0/3093205762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d9877d730 0x556d98783990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/3093205762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d98786310 msgr2=0x556d98783ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bcf7fe640 1 --2- 172.21.15.135:0/3093205762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d98786310 0x556d98783ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.797 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/3093205762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d983f43f0 con 0x556d9877ce10 2024-04-20T12:32:59.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bcffff640 1 --2- 172.21.15.135:0/3093205762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d98786310 0x556d98783ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:59.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bcf7fe640 1 --2- 172.21.15.135:0/3093205762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d98783450 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f0bc00a5330 tx=0x7f0bc00bd280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afacdd2e3d293aaf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0baeffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:59.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0baeffd640 1 -- 172.21.15.135:0/3093205762 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00a55e0 con 0x556d9877ce10 2024-04-20T12:32:59.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0baeffd640 1 -- 172.21.15.135:0/3093205762 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f0bc009c040 con 0x556d9877ce10 2024-04-20T12:32:59.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bd8773740 1 -- 172.21.15.135:0/3093205762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bc0099260 con 0x556d9877ce10 2024-04-20T12:32:59.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0baeffd640 1 -- 172.21.15.135:0/3093205762 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0bc009c240 con 0x556d9877ce10 2024-04-20T12:32:59.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bd8773740 10 client.18615 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:59.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bd8773740 1 -- 172.21.15.135:0/3093205762 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556d984be7d0 con 0x556d9877ce10 2024-04-20T12:32:59.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0baeffd640 1 -- 172.21.15.135:0/3093205762 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc0099260 con 0x556d9877ce10 2024-04-20T12:32:59.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0baeffd640 1 -- 172.21.15.135:0/3093205762 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f0bc0098940 con 0x556d9877ce10 2024-04-20T12:32:59.798 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bd8773740 10 client.18615 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:59.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.790+0000 7f0bd8773740 10 client.18615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:32:59.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.791+0000 7f0bd8773740 20 client.18615 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:59.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.791+0000 7f0bd8773740 1 --2- 172.21.15.135:0/3093205762 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d98796400 0x556d987987f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.791+0000 7f0bd8773740 4 client.18615 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:32:59.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.791+0000 7f0bd8773740 1 -- 172.21.15.135:0/3093205762 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d986efb30 con 0x556d98796400 2024-04-20T12:32:59.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.791+0000 7f0bceffd640 1 --2- 172.21.15.135:0/3093205762 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d98796400 0x556d987987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.791+0000 7f0baeffd640 10 client.18615 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:59.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.791+0000 7f0bceffd640 1 --2- 172.21.15.135:0/3093205762 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d98796400 0x556d987987f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0ad9b20689441e8 server_cookie=b7770fbcf57b0d03 in_seq=0 out_seq=0 2024-04-20T12:32:59.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.792+0000 7f0baeffd640 1 -- 172.21.15.135:0/3093205762 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556d986efb30 con 0x556d98796400 2024-04-20T12:32:59.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.792+0000 7f0baeffd640 10 client.18615 handle_command_reply: tid=0 2024-04-20T12:32:59.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.792+0000 7f0bd8773740 1 client.18615 shutdown 2024-04-20T12:32:59.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.792+0000 7f0bd8773740 1 -- 172.21.15.135:0/3093205762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 msgr2=0x556d98783450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.792+0000 7f0bd8773740 1 --2- 172.21.15.135:0/3093205762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d98783450 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f0bc00a5330 tx=0x7f0bc00bd280 comp rx=0 tx=0).stop 2024-04-20T12:32:59.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.792+0000 7f0bd8773740 1 -- 172.21.15.135:0/3093205762 shutdown_connections 2024-04-20T12:32:59.799 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.792+0000 7f0bd8773740 1 --2- 172.21.15.135:0/3093205762 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d98796400 0x556d987987f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.792+0000 7f0bd8773740 1 --2- 172.21.15.135:0/3093205762 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d98786310 0x556d98783ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.792+0000 7f0bd8773740 1 --2- 172.21.15.135:0/3093205762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d9877d730 0x556d98783990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.792+0000 7f0baeffd640 0 client.18615 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:59.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.792+0000 7f0bd8773740 1 --2- 172.21.15.135:0/3093205762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d98783450 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.792+0000 7f0bd8773740 1 -- 172.21.15.135:0/3093205762 >> 172.21.15.135:0/3093205762 conn(0x556d98777540 msgr2=0x556d98779290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.792+0000 7f0bd8773740 1 -- 172.21.15.135:0/3093205762 shutdown_connections 2024-04-20T12:32:59.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.792+0000 7f0bd8773740 1 -- 172.21.15.135:0/3093205762 wait complete. 2024-04-20T12:32:59.800 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.792+0000 7f0bd8773740 20 client.18615 trim_cache size 0 max 16384 2024-04-20T12:32:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.805+0000 7f0bd8773740 1 Processor -- start 2024-04-20T12:32:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.805+0000 7f0bd8773740 1 -- start start 2024-04-20T12:32:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.805+0000 7f0bd8773740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d98785b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.805 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.805+0000 7f0bd8773740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d9877d730 0x556d9879b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.805+0000 7f0bd8773740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d98786310 0x556d9879bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.807 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.805+0000 7f0bd8773740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01af5d0 con 0x556d9877ce10 2024-04-20T12:32:59.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.805+0000 7f0bd8773740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01b1110 con 0x556d98786310 2024-04-20T12:32:59.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.805+0000 7f0bd8773740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01afca0 con 0x556d9877d730 2024-04-20T12:32:59.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.805+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d98785b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.805+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d98785b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46824/0 (socket says 172.21.15.135:46824) 2024-04-20T12:32:59.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.805+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/1885300241 learned_addr learned my addr 172.21.15.135:0/1885300241 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/1885300241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d9877d730 msgr2=0x556d9879b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bceffd640 1 --2- 172.21.15.135:0/1885300241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d9877d730 0x556d9879b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bcf7fe640 1 --2- 172.21.15.135:0/1885300241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d9877d730 0x556d9879b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/1885300241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d98786310 msgr2=0x556d9879bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bcf7fe640 1 --2- 172.21.15.135:0/1885300241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d98786310 0x556d9879bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/1885300241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d98771b80 con 0x556d9877ce10 2024-04-20T12:32:59.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bceffd640 1 --2- 172.21.15.135:0/1885300241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d9877d730 0x556d9879b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:32:59.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bcf7fe640 1 --2- 172.21.15.135:0/1885300241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d98785b80 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f0bc009cb30 tx=0x7f0bc00bd3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c9bd24161c36e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.808 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bb57fa640 1 -- 172.21.15.135:0/1885300241 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00a55e0 con 0x556d9877ce10 2024-04-20T12:32:59.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bb57fa640 1 -- 172.21.15.135:0/1885300241 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc00b6080 con 0x556d9877ce10 2024-04-20T12:32:59.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bb57fa640 1 -- 172.21.15.135:0/1885300241 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0098940 con 0x556d9877ce10 2024-04-20T12:32:59.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bd8773740 1 -- 172.21.15.135:0/1885300241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 msgr2=0x556d98785b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bd8773740 1 --2- 172.21.15.135:0/1885300241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d98785b80 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f0bc009cb30 tx=0x7f0bc00bd3a0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bd8773740 1 -- 172.21.15.135:0/1885300241 shutdown_connections 2024-04-20T12:32:59.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bd8773740 1 --2- 172.21.15.135:0/1885300241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d98786310 0x556d9879bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bd8773740 1 --2- 172.21.15.135:0/1885300241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d9877d730 0x556d9879b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bd8773740 1 --2- 172.21.15.135:0/1885300241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d98785b80 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.806+0000 7f0bd8773740 1 -- 172.21.15.135:0/1885300241 >> 172.21.15.135:0/1885300241 conn(0x556d98777540 msgr2=0x556d98791c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.807+0000 7f0bd8773740 1 -- 172.21.15.135:0/1885300241 shutdown_connections 2024-04-20T12:32:59.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.807+0000 7f0bd8773740 1 -- 172.21.15.135:0/1885300241 wait complete. 2024-04-20T12:32:59.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.807+0000 7f0bd8773740 1 -- start start 2024-04-20T12:32:59.809 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.807+0000 7f0bd8773740 1 Processor -- start 2024-04-20T12:32:59.810 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.807+0000 7f0bd8773740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d9879bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.807+0000 7f0bd8773740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d9877d730 0x556d98798e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.807+0000 7f0bd8773740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d98786310 0x556d98799390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.813 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.807+0000 7f0bd8773740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01b0a40 con 0x556d9877ce10 2024-04-20T12:32:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.807+0000 7f0bd8773740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01b0370 con 0x556d9877d730 2024-04-20T12:32:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.807+0000 7f0bd8773740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd01ad5a0 con 0x556d98786310 2024-04-20T12:32:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.807+0000 7f0bd8773740 10 client.0 _ll_register_callbacks cb 0x7f0bc0009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:32:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.807+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d9879bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.807+0000 7f0bcf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d9879bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:46836/0 (socket says 172.21.15.135:46836) 2024-04-20T12:32:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.807+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/1637229668 learned_addr learned my addr 172.21.15.135:0/1637229668 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:32:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.807+0000 7f0bcffff640 1 --2- 172.21.15.135:0/1637229668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d98786310 0x556d98799390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bceffd640 1 --2- 172.21.15.135:0/1637229668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d9877d730 0x556d98798e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/1637229668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d98786310 msgr2=0x556d98799390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bcf7fe640 1 --2- 172.21.15.135:0/1637229668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d98786310 0x556d98799390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/1637229668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d9877d730 msgr2=0x556d98798e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:32:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bcf7fe640 1 --2- 172.21.15.135:0/1637229668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d9877d730 0x556d98798e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bcf7fe640 1 -- 172.21.15.135:0/1637229668 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d98799b90 con 0x556d9877ce10 2024-04-20T12:32:59.814 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bcffff640 1 --2- 172.21.15.135:0/1637229668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d98786310 0x556d98799390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:32:59.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bcf7fe640 1 --2- 172.21.15.135:0/1637229668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d9879bac0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f0bc00a5a20 tx=0x7f0bc00b6230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb4cdeac7a38779 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:32:59.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0baeffd640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:32:59.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0baeffd640 1 -- 172.21.15.135:0/1637229668 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00d5030 con 0x556d9877ce10 2024-04-20T12:32:59.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0baeffd640 1 -- 172.21.15.135:0/1637229668 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f0bc009c040 con 0x556d9877ce10 2024-04-20T12:32:59.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bd8773740 1 -- 172.21.15.135:0/1637229668 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bc00b6080 con 0x556d9877ce10 2024-04-20T12:32:59.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0baeffd640 1 -- 172.21.15.135:0/1637229668 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0bc0099300 con 0x556d9877ce10 2024-04-20T12:32:59.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bd8773740 10 client.18621 fetch_fsmap learned FSMap version 29 2024-04-20T12:32:59.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bd8773740 1 -- 172.21.15.135:0/1637229668 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556d987fc490 con 0x556d9877ce10 2024-04-20T12:32:59.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0baeffd640 1 -- 172.21.15.135:0/1637229668 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bc00b6080 con 0x556d9877ce10 2024-04-20T12:32:59.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0baeffd640 1 -- 172.21.15.135:0/1637229668 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f0bc009bab0 con 0x556d9877ce10 2024-04-20T12:32:59.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bd8773740 10 client.18621 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:32:59.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bd8773740 10 client.18621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:32:59.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bd8773740 20 client.18621 populate_metadata read hostname 'smithi135' 2024-04-20T12:32:59.815 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bd8773740 1 --2- 172.21.15.135:0/1637229668 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d987fc910 0x556d987fed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:32:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bd8773740 4 client.18621 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:32:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.808+0000 7f0bd8773740 1 -- 172.21.15.135:0/1637229668 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556d986e99a0 con 0x556d987fc910 2024-04-20T12:32:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.809+0000 7f0bceffd640 1 --2- 172.21.15.135:0/1637229668 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d987fc910 0x556d987fed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:32:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.809+0000 7f0baeffd640 10 client.18621 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.809+0000 7f0bceffd640 1 --2- 172.21.15.135:0/1637229668 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d987fc910 0x556d987fed00 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=856b9cc4a25632b3 server_cookie=30199660ff59cfad in_seq=0 out_seq=0 2024-04-20T12:32:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.809+0000 7f0baeffd640 1 -- 172.21.15.135:0/1637229668 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556d986e99a0 con 0x556d987fc910 2024-04-20T12:32:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.809+0000 7f0baeffd640 10 client.18621 handle_command_reply: tid=0 2024-04-20T12:32:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.809+0000 7f0bd8773740 1 client.18621 shutdown 2024-04-20T12:32:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.809+0000 7f0bd8773740 1 -- 172.21.15.135:0/1637229668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 msgr2=0x556d9879bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.809+0000 7f0bd8773740 1 --2- 172.21.15.135:0/1637229668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d9879bac0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f0bc00a5a20 tx=0x7f0bc00b6230 comp rx=0 tx=0).stop 2024-04-20T12:32:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.809+0000 7f0bd8773740 1 -- 172.21.15.135:0/1637229668 shutdown_connections 2024-04-20T12:32:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.809+0000 7f0bd8773740 1 --2- 172.21.15.135:0/1637229668 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x556d987fc910 0x556d987fed00 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd8773740 1 --2- 172.21.15.135:0/1637229668 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x556d98786310 0x556d98799390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.816 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd8773740 1 --2- 172.21.15.135:0/1637229668 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x556d9877d730 0x556d98798e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0baeffd640 0 client.18621 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:32:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd8773740 1 --2- 172.21.15.135:0/1637229668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556d9877ce10 0x556d9879bac0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd8773740 1 -- 172.21.15.135:0/1637229668 >> 172.21.15.135:0/1637229668 conn(0x556d98777540 msgr2=0x556d98775e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd8773740 1 -- 172.21.15.135:0/1637229668 shutdown_connections 2024-04-20T12:32:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd8773740 1 -- 172.21.15.135:0/1637229668 wait complete. 2024-04-20T12:32:59.817 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd8773740 20 client.18621 trim_cache size 0 max 16384 2024-04-20T12:32:59.817 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:32:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd5aa5640 1 -- 172.21.15.135:0/2641991320 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0bb80a3d20 msgr2=0x7f0bb80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd5aa5640 1 --2- 172.21.15.135:0/2641991320 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0bb80a3d20 0x7f0bb80a61e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009370 tx=0x7f0bc8009240 comp rx=0 tx=0).stop 2024-04-20T12:32:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd5aa5640 1 -- 172.21.15.135:0/2641991320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd01017e0 msgr2=0x7f0bd019e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:32:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd5aa5640 1 --2- 172.21.15.135:0/2641991320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd01017e0 0x7f0bd019e6b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000e9f0 tx=0x7f0bc000eeb0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd5aa5640 1 -- 172.21.15.135:0/2641991320 shutdown_connections 2024-04-20T12:32:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd5aa5640 1 --2- 172.21.15.135:0/2641991320 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0bb80a3d20 0x7f0bb80a61e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd5aa5640 1 --2- 172.21.15.135:0/2641991320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bd0198860 0x7f0bd0198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.818 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd5aa5640 1 --2- 172.21.15.135:0/2641991320 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bd0106390 0x7f0bd019ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd5aa5640 1 --2- 172.21.15.135:0/2641991320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bd01017e0 0x7f0bd019e6b0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:32:59.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd5aa5640 1 -- 172.21.15.135:0/2641991320 >> 172.21.15.135:0/2641991320 conn(0x7f0bd0077420 msgr2=0x7f0bd0100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:32:59.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd5aa5640 1 -- 172.21.15.135:0/2641991320 shutdown_connections 2024-04-20T12:32:59.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:32:59.810+0000 7f0bd5aa5640 1 -- 172.21.15.135:0/2641991320 wait complete. 2024-04-20T12:32:59.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:32:59 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1775731141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:33:00.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:00 smithi154 ceph-mon[22073]: pgmap v305: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:00.821 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-04-20T12:33:00.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:33:00.822 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-04-20T12:33:00.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:00 smithi139 ceph-mon[21834]: pgmap v305: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:00.842 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:00 smithi135 ceph-mon[18264]: pgmap v305: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:00.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.925+0000 7f5232f75640 1 -- 172.21.15.135:0/2414833024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f522c1031f0 msgr2=0x7f522c1035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:00.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.925+0000 7f5232f75640 1 --2- 172.21.15.135:0/2414833024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f522c1031f0 0x7f522c1035d0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f5220009900 tx=0x7f522002bd60 comp rx=0 tx=0).stop 2024-04-20T12:33:00.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.925+0000 7f5232f75640 1 -- 172.21.15.135:0/2414833024 shutdown_connections 2024-04-20T12:33:00.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.925+0000 7f5232f75640 1 --2- 172.21.15.135:0/2414833024 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f522c10c530 0x7f522c10e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.925+0000 7f5232f75640 1 --2- 172.21.15.135:0/2414833024 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f522c103b10 0x7f522c10bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.927 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.925+0000 7f5232f75640 1 --2- 172.21.15.135:0/2414833024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f522c1031f0 0x7f522c1035d0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.925+0000 7f5232f75640 1 -- 172.21.15.135:0/2414833024 >> 172.21.15.135:0/2414833024 conn(0x7f522c0771e0 msgr2=0x7f522c0775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:00.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.925+0000 7f5232f75640 1 -- 172.21.15.135:0/2414833024 shutdown_connections 2024-04-20T12:33:00.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.925+0000 7f5232f75640 1 -- 172.21.15.135:0/2414833024 wait complete. 2024-04-20T12:33:00.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5232f75640 1 Processor -- start 2024-04-20T12:33:00.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5232f75640 1 -- start start 2024-04-20T12:33:00.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5232f75640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f522c1031f0 0x7f522c100e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5232f75640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f522c103b10 0x7f522c101380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5232f75640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f522c10c530 0x7f522c1018c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5232f75640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f522c112440 con 0x7f522c10c530 2024-04-20T12:33:00.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5232f75640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1122c0 con 0x7f522c1031f0 2024-04-20T12:33:00.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5232f75640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1125c0 con 0x7f522c103b10 2024-04-20T12:33:00.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5231512640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f522c10c530 0x7f522c1018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5231512640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f522c10c530 0x7f522c1018c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37516/0 (socket says 172.21.15.135:37516) 2024-04-20T12:33:00.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5231512640 1 -- 172.21.15.135:0/3988927582 learned_addr learned my addr 172.21.15.135:0/3988927582 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:00.928 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5230d11640 1 --2- 172.21.15.135:0/3988927582 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f522c1031f0 0x7f522c100e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f522bfff640 1 --2- 172.21.15.135:0/3988927582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f522c103b10 0x7f522c101380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5231512640 1 -- 172.21.15.135:0/3988927582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f522c103b10 msgr2=0x7f522c101380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:00.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5231512640 1 --2- 172.21.15.135:0/3988927582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f522c103b10 0x7f522c101380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5231512640 1 -- 172.21.15.135:0/3988927582 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f522c1031f0 msgr2=0x7f522c100e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:00.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5231512640 1 --2- 172.21.15.135:0/3988927582 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f522c1031f0 0x7f522c100e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.926+0000 7f5231512640 1 -- 172.21.15.135:0/3988927582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522c1a6de0 con 0x7f522c10c530 2024-04-20T12:33:00.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.927+0000 7f5231512640 1 --2- 172.21.15.135:0/3988927582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f522c10c530 0x7f522c1018c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f522400b970 tx=0x7f522400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:00.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.927+0000 7f5229ffb640 1 -- 172.21.15.135:0/3988927582 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224019070 con 0x7f522c10c530 2024-04-20T12:33:00.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.927+0000 7f5229ffb640 1 -- 172.21.15.135:0/3988927582 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f522400cb40 con 0x7f522c10c530 2024-04-20T12:33:00.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.927+0000 7f5232f75640 1 -- 172.21.15.135:0/3988927582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f522c1a70d0 con 0x7f522c10c530 2024-04-20T12:33:00.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.927+0000 7f5229ffb640 1 -- 172.21.15.135:0/3988927582 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224007650 con 0x7f522c10c530 2024-04-20T12:33:00.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.927+0000 7f5232f75640 1 -- 172.21.15.135:0/3988927582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f522c1a75d0 con 0x7f522c10c530 2024-04-20T12:33:00.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.929+0000 7f5229ffb640 1 -- 172.21.15.135:0/3988927582 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f522401c070 con 0x7f522c10c530 2024-04-20T12:33:00.936 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.929+0000 7f5229ffb640 1 --2- 172.21.15.135:0/3988927582 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f521c0a3d20 0x7f521c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.929+0000 7f5235b63740 1 Processor -- start 2024-04-20T12:33:00.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.929+0000 7f5235b63740 1 -- start start 2024-04-20T12:33:00.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.929+0000 7f5230d11640 1 --2- 172.21.15.135:0/3988927582 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f521c0a3d20 0x7f521c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5229ffb640 1 -- 172.21.15.135:0/3988927582 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f52240d0080 con 0x7f522c10c530 2024-04-20T12:33:00.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5235b63740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167a7fe0 0x55c0167a83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5235b63740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a8900 0x55c0167b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5235b63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167b14e0 0x55c0167b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5235b63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c01670cf00 con 0x55c0167b14e0 2024-04-20T12:33:00.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5235b63740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c0166aa530 con 0x55c0167a8900 2024-04-20T12:33:00.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5235b63740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c016708ec0 con 0x55c0167a7fe0 2024-04-20T12:33:00.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5231512640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167b14e0 0x55c0167b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5231512640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167b14e0 0x55c0167b38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37528/0 (socket says 172.21.15.135:37528) 2024-04-20T12:33:00.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5231512640 1 -- 172.21.15.135:0/1389973081 learned_addr learned my addr 172.21.15.135:0/1389973081 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:00.937 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f522bfff640 1 --2- 172.21.15.135:0/1389973081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a8900 0x55c0167b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5231512640 1 -- 172.21.15.135:0/1389973081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167a7fe0 msgr2=0x55c0167a83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5231512640 1 --2- 172.21.15.135:0/1389973081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167a7fe0 0x55c0167a83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5231512640 1 -- 172.21.15.135:0/1389973081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a8900 msgr2=0x55c0167b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5231512640 1 --2- 172.21.15.135:0/1389973081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a8900 0x55c0167b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5230d11640 1 --2- 172.21.15.135:0/3988927582 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f521c0a3d20 0x7f521c0a61e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5220005ab0 tx=0x7f522002c880 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5231512640 1 -- 172.21.15.135:0/1389973081 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0164e77e0 con 0x55c0167b14e0 2024-04-20T12:33:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5231512640 1 --2- 172.21.15.135:0/1389973081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167b14e0 0x55c0167b38d0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f52240a44a0 tx=0x7f522409be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9158932a56ecb11 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5216ffd640 1 -- 172.21.15.135:0/1389973081 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52240a49d0 con 0x55c0167b14e0 2024-04-20T12:33:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5216ffd640 1 -- 172.21.15.135:0/1389973081 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f522400ccf0 con 0x55c0167b14e0 2024-04-20T12:33:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.930+0000 7f5216ffd640 1 -- 172.21.15.135:0/1389973081 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52240a47a0 con 0x55c0167b14e0 2024-04-20T12:33:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.931+0000 7f5235b63740 1 -- 172.21.15.135:0/1389973081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167b14e0 msgr2=0x55c0167b38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.931+0000 7f5235b63740 1 --2- 172.21.15.135:0/1389973081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167b14e0 0x55c0167b38d0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f52240a44a0 tx=0x7f522409be10 comp rx=0 tx=0).stop 2024-04-20T12:33:00.938 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.931+0000 7f5235b63740 1 -- 172.21.15.135:0/1389973081 shutdown_connections 2024-04-20T12:33:00.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.931+0000 7f5235b63740 1 --2- 172.21.15.135:0/1389973081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167b14e0 0x55c0167b38d0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.931+0000 7f5235b63740 1 --2- 172.21.15.135:0/1389973081 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a8900 0x55c0167b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.931+0000 7f5235b63740 1 --2- 172.21.15.135:0/1389973081 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167a7fe0 0x55c0167a83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.931+0000 7f5235b63740 1 -- 172.21.15.135:0/1389973081 >> 172.21.15.135:0/1389973081 conn(0x55c0167a2710 msgr2=0x55c0167a2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:00.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.931+0000 7f5235b63740 1 -- 172.21.15.135:0/1389973081 shutdown_connections 2024-04-20T12:33:00.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.931+0000 7f5235b63740 1 -- 172.21.15.135:0/1389973081 wait complete. 2024-04-20T12:33:00.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.931+0000 7f5235b63740 1 -- start start 2024-04-20T12:33:00.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.931+0000 7f5235b63740 1 Processor -- start 2024-04-20T12:33:00.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5235b63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167a7fe0 0x55c0167b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5235b63740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a8900 0x55c0167ae290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5235b63740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167b14e0 0x55c0167ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5235b63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c0167b4270 con 0x55c0167a7fe0 2024-04-20T12:33:00.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5235b63740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55c016695480 con 0x55c0167a8900 2024-04-20T12:33:00.939 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5235b63740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55c0167b43f0 con 0x55c0167b14e0 2024-04-20T12:33:00.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5235b63740 10 client.0 _ll_register_callbacks cb 0x55c016694e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:00.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5230d11640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167a7fe0 0x55c0167b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5230d11640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167a7fe0 0x55c0167b0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37538/0 (socket says 172.21.15.135:37538) 2024-04-20T12:33:00.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5230d11640 1 -- 172.21.15.135:0/2529297838 learned_addr learned my addr 172.21.15.135:0/2529297838 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:00.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f522bfff640 1 --2- 172.21.15.135:0/2529297838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a8900 0x55c0167ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5231512640 1 --2- 172.21.15.135:0/2529297838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167b14e0 0x55c0167ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5230d11640 1 -- 172.21.15.135:0/2529297838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167b14e0 msgr2=0x55c0167ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:00.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5230d11640 1 --2- 172.21.15.135:0/2529297838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167b14e0 0x55c0167ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5230d11640 1 -- 172.21.15.135:0/2529297838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a8900 msgr2=0x55c0167ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:00.940 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5230d11640 1 --2- 172.21.15.135:0/2529297838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a8900 0x55c0167ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5230d11640 1 -- 172.21.15.135:0/2529297838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c016547f70 con 0x55c0167a7fe0 2024-04-20T12:33:00.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f5230d11640 1 --2- 172.21.15.135:0/2529297838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167a7fe0 0x55c0167b0f00 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f5220004f50 tx=0x7f522002bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbc7eeed9745f8f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:00.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f520bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:00.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.932+0000 7f520bfff640 1 -- 172.21.15.135:0/2529297838 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5220005000 con 0x55c0167a7fe0 2024-04-20T12:33:00.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.933+0000 7f520bfff640 1 -- 172.21.15.135:0/2529297838 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f52200051a0 con 0x55c0167a7fe0 2024-04-20T12:33:00.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.933+0000 7f5235b63740 1 -- 172.21.15.135:0/2529297838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f522400ccf0 con 0x55c0167a7fe0 2024-04-20T12:33:00.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.933+0000 7f520bfff640 1 -- 172.21.15.135:0/2529297838 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f522005a050 con 0x55c0167a7fe0 2024-04-20T12:33:00.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.933+0000 7f5235b63740 10 client.18633 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:00.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.933+0000 7f5235b63740 1 -- 172.21.15.135:0/2529297838 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c0163df170 con 0x55c0167a7fe0 2024-04-20T12:33:00.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.933+0000 7f520bfff640 1 -- 172.21.15.135:0/2529297838 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f522400ccf0 con 0x55c0167a7fe0 2024-04-20T12:33:00.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.933+0000 7f520bfff640 1 -- 172.21.15.135:0/2529297838 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f5220041460 con 0x55c0167a7fe0 2024-04-20T12:33:00.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.933+0000 7f5235b63740 10 client.18633 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:00.941 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.933+0000 7f5235b63740 10 client.18633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:33:00.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.933+0000 7f5235b63740 20 client.18633 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:00.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.933+0000 7f5235b63740 1 --2- 172.21.15.135:0/2529297838 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c0167c15e0 0x55c0167c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.933+0000 7f5235b63740 4 client.18633 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:33:00.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.933+0000 7f5235b63740 1 -- 172.21.15.135:0/2529297838 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c01671a920 con 0x55c0167c15e0 2024-04-20T12:33:00.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.933+0000 7f522bfff640 1 --2- 172.21.15.135:0/2529297838 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c0167c15e0 0x55c0167c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.934+0000 7f520bfff640 10 client.18633 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:00.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.934+0000 7f522bfff640 1 --2- 172.21.15.135:0/2529297838 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c0167c15e0 0x55c0167c3a60 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=986a610a7e6bdb1 server_cookie=db20875dfcafac6e in_seq=0 out_seq=0 2024-04-20T12:33:00.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.934+0000 7f520bfff640 1 -- 172.21.15.135:0/2529297838 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c01671a920 con 0x55c0167c15e0 2024-04-20T12:33:00.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.934+0000 7f520bfff640 10 client.18633 handle_command_reply: tid=0 2024-04-20T12:33:00.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.934+0000 7f5235b63740 1 client.18633 shutdown 2024-04-20T12:33:00.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.934+0000 7f5235b63740 1 -- 172.21.15.135:0/2529297838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167a7fe0 msgr2=0x55c0167b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:00.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.934+0000 7f5235b63740 1 --2- 172.21.15.135:0/2529297838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167a7fe0 0x55c0167b0f00 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f5220004f50 tx=0x7f522002bd60 comp rx=0 tx=0).stop 2024-04-20T12:33:00.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.934+0000 7f5235b63740 1 -- 172.21.15.135:0/2529297838 shutdown_connections 2024-04-20T12:33:00.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.934+0000 7f5235b63740 1 --2- 172.21.15.135:0/2529297838 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c0167c15e0 0x55c0167c3a60 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.934+0000 7f5235b63740 1 --2- 172.21.15.135:0/2529297838 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167b14e0 0x55c0167ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.934+0000 7f520bfff640 0 client.18633 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:00.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.934+0000 7f5235b63740 1 --2- 172.21.15.135:0/2529297838 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a8900 0x55c0167ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.934+0000 7f5235b63740 1 --2- 172.21.15.135:0/2529297838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167a7fe0 0x55c0167b0f00 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.934+0000 7f5235b63740 1 -- 172.21.15.135:0/2529297838 >> 172.21.15.135:0/2529297838 conn(0x55c0167a2710 msgr2=0x55c0167a4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:00.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.935+0000 7f5235b63740 1 -- 172.21.15.135:0/2529297838 shutdown_connections 2024-04-20T12:33:00.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.935+0000 7f5235b63740 1 -- 172.21.15.135:0/2529297838 wait complete. 2024-04-20T12:33:00.943 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.935+0000 7f5235b63740 20 client.18633 trim_cache size 0 max 16384 2024-04-20T12:33:00.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f5235b63740 1 Processor -- start 2024-04-20T12:33:00.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f5235b63740 1 -- start start 2024-04-20T12:33:00.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f5235b63740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a7fe0 0x55c0167a1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f5235b63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167a8900 0x55c0167b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f5235b63740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167b14e0 0x55c0167b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f5235b63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1b1730 con 0x55c0167a8900 2024-04-20T12:33:00.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f5235b63740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1b3270 con 0x55c0167a7fe0 2024-04-20T12:33:00.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f5235b63740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1b1e00 con 0x55c0167b14e0 2024-04-20T12:33:00.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f522bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167a8900 0x55c0167b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f522bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167a8900 0x55c0167b09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37548/0 (socket says 172.21.15.135:37548) 2024-04-20T12:33:00.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f522bfff640 1 -- 172.21.15.135:0/3264075726 learned_addr learned my addr 172.21.15.135:0/3264075726 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:00.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f5230d11640 1 --2- 172.21.15.135:0/3264075726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a7fe0 0x55c0167a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f5231512640 1 --2- 172.21.15.135:0/3264075726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167b14e0 0x55c0167b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.958 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f522bfff640 1 -- 172.21.15.135:0/3264075726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167b14e0 msgr2=0x55c0167b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f522bfff640 1 --2- 172.21.15.135:0/3264075726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167b14e0 0x55c0167b0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f522bfff640 1 -- 172.21.15.135:0/3264075726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a7fe0 msgr2=0x55c0167a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f522bfff640 1 --2- 172.21.15.135:0/3264075726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a7fe0 0x55c0167a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f522bfff640 1 -- 172.21.15.135:0/3264075726 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0167a32e0 con 0x55c0167a8900 2024-04-20T12:33:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.952+0000 7f5230d11640 1 --2- 172.21.15.135:0/3264075726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a7fe0 0x55c0167a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:33:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.953+0000 7f522bfff640 1 --2- 172.21.15.135:0/3264075726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167a8900 0x55c0167b09c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f521800b680 tx=0x7f5218008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd182e2cc8a1d349 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.953+0000 7f52167fc640 1 -- 172.21.15.135:0/3264075726 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218020070 con 0x55c0167a8900 2024-04-20T12:33:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.953+0000 7f52167fc640 1 -- 172.21.15.135:0/3264075726 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f521801cc10 con 0x55c0167a8900 2024-04-20T12:33:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.953+0000 7f52167fc640 1 -- 172.21.15.135:0/3264075726 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52180133b0 con 0x55c0167a8900 2024-04-20T12:33:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.953+0000 7f5235b63740 1 -- 172.21.15.135:0/3264075726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167a8900 msgr2=0x55c0167b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.953+0000 7f5235b63740 1 --2- 172.21.15.135:0/3264075726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167a8900 0x55c0167b09c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f521800b680 tx=0x7f5218008040 comp rx=0 tx=0).stop 2024-04-20T12:33:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.953+0000 7f5235b63740 1 -- 172.21.15.135:0/3264075726 shutdown_connections 2024-04-20T12:33:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.953+0000 7f5235b63740 1 --2- 172.21.15.135:0/3264075726 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167b14e0 0x55c0167b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.959 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.953+0000 7f5235b63740 1 --2- 172.21.15.135:0/3264075726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167a8900 0x55c0167b09c0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.953+0000 7f5235b63740 1 --2- 172.21.15.135:0/3264075726 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a7fe0 0x55c0167a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.953+0000 7f5235b63740 1 -- 172.21.15.135:0/3264075726 >> 172.21.15.135:0/3264075726 conn(0x55c0167a2710 msgr2=0x55c0167a42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.953+0000 7f5235b63740 1 -- 172.21.15.135:0/3264075726 shutdown_connections 2024-04-20T12:33:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.953+0000 7f5235b63740 1 -- 172.21.15.135:0/3264075726 wait complete. 2024-04-20T12:33:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5235b63740 1 -- start start 2024-04-20T12:33:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5235b63740 1 Processor -- start 2024-04-20T12:33:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5235b63740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a7fe0 0x55c0167b9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5235b63740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167a8900 0x55c0167b6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5235b63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167b14e0 0x55c0167b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5235b63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1b2ba0 con 0x55c0167b14e0 2024-04-20T12:33:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5235b63740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1b24d0 con 0x55c0167a7fe0 2024-04-20T12:33:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5235b63740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f522c1af700 con 0x55c0167a8900 2024-04-20T12:33:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5235b63740 10 client.0 _ll_register_callbacks cb 0x7f522002c9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5231512640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167b14e0 0x55c0167b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5231512640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167b14e0 0x55c0167b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37556/0 (socket says 172.21.15.135:37556) 2024-04-20T12:33:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5231512640 1 -- 172.21.15.135:0/2270241916 learned_addr learned my addr 172.21.15.135:0/2270241916 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f522bfff640 1 --2- 172.21.15.135:0/2270241916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167a8900 0x55c0167b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5230d11640 1 --2- 172.21.15.135:0/2270241916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a7fe0 0x55c0167b9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5231512640 1 -- 172.21.15.135:0/2270241916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167a8900 msgr2=0x55c0167b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5231512640 1 --2- 172.21.15.135:0/2270241916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167a8900 0x55c0167b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5231512640 1 -- 172.21.15.135:0/2270241916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a7fe0 msgr2=0x55c0167b9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5231512640 1 --2- 172.21.15.135:0/2270241916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a7fe0 0x55c0167b9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5231512640 1 -- 172.21.15.135:0/2270241916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0167b7380 con 0x55c0167b14e0 2024-04-20T12:33:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f522bfff640 1 --2- 172.21.15.135:0/2270241916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167a8900 0x55c0167b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:33:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.954+0000 7f5230d11640 1 --2- 172.21.15.135:0/2270241916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a7fe0 0x55c0167b9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:33:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f5231512640 1 --2- 172.21.15.135:0/2270241916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167b14e0 0x55c0167b6b50 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f52240a44a0 tx=0x7f5224009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd7d0610605a757 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f520bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f520bfff640 1 -- 172.21.15.135:0/2270241916 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52240b5070 con 0x55c0167b14e0 2024-04-20T12:33:00.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f520bfff640 1 -- 172.21.15.135:0/2270241916 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f52240cd680 con 0x55c0167b14e0 2024-04-20T12:33:00.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f5235b63740 1 -- 172.21.15.135:0/2270241916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f521801cc10 con 0x55c0167b14e0 2024-04-20T12:33:00.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f520bfff640 1 -- 172.21.15.135:0/2270241916 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f52240a49d0 con 0x55c0167b14e0 2024-04-20T12:33:00.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f5235b63740 10 client.18639 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:00.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f5235b63740 1 -- 172.21.15.135:0/2270241916 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c016828c80 con 0x55c0167b14e0 2024-04-20T12:33:00.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f520bfff640 1 -- 172.21.15.135:0/2270241916 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f521801cc10 con 0x55c0167b14e0 2024-04-20T12:33:00.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f520bfff640 1 -- 172.21.15.135:0/2270241916 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f52240bc0b0 con 0x55c0167b14e0 2024-04-20T12:33:00.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f5235b63740 10 client.18639 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:00.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f5235b63740 10 client.18639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:33:00.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f5235b63740 20 client.18639 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:00.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f5235b63740 1 --2- 172.21.15.135:0/2270241916 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c016828fc0 0x55c01682b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:00.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f5235b63740 4 client.18639 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-04-20T12:33:00.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.955+0000 7f5235b63740 1 -- 172.21.15.135:0/2270241916 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c016714790 con 0x55c016828fc0 2024-04-20T12:33:00.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.956+0000 7f5230d11640 1 --2- 172.21.15.135:0/2270241916 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c016828fc0 0x55c01682b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:00.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.956+0000 7f5230d11640 1 --2- 172.21.15.135:0/2270241916 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c016828fc0 0x55c01682b3b0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdb8299194859098 server_cookie=a6e11cd9eed89d62 in_seq=0 out_seq=0 2024-04-20T12:33:00.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.956+0000 7f520bfff640 10 client.18639 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:00.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.957+0000 7f520bfff640 1 -- 172.21.15.135:0/2270241916 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c016714790 con 0x55c016828fc0 2024-04-20T12:33:00.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.957+0000 7f520bfff640 10 client.18639 handle_command_reply: tid=0 2024-04-20T12:33:00.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.957+0000 7f5235b63740 1 client.18639 shutdown 2024-04-20T12:33:00.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.957+0000 7f5235b63740 1 -- 172.21.15.135:0/2270241916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167b14e0 msgr2=0x55c0167b6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:00.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.957+0000 7f5235b63740 1 --2- 172.21.15.135:0/2270241916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167b14e0 0x55c0167b6b50 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f52240a44a0 tx=0x7f5224009930 comp rx=0 tx=0).stop 2024-04-20T12:33:00.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.957+0000 7f5235b63740 1 -- 172.21.15.135:0/2270241916 shutdown_connections 2024-04-20T12:33:00.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.957+0000 7f5235b63740 1 --2- 172.21.15.135:0/2270241916 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55c016828fc0 0x55c01682b3b0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.957+0000 7f5235b63740 1 --2- 172.21.15.135:0/2270241916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0167b14e0 0x55c0167b6b50 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.957+0000 7f520bfff640 0 client.18639 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:00.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.957+0000 7f5235b63740 1 --2- 172.21.15.135:0/2270241916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55c0167a8900 0x55c0167b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.963 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.957+0000 7f5235b63740 1 --2- 172.21.15.135:0/2270241916 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55c0167a7fe0 0x55c0167b9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.957+0000 7f5235b63740 1 -- 172.21.15.135:0/2270241916 >> 172.21.15.135:0/2270241916 conn(0x55c0167a2710 msgr2=0x55c0167a38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:00.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.957+0000 7f5235b63740 1 -- 172.21.15.135:0/2270241916 shutdown_connections 2024-04-20T12:33:00.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.957+0000 7f5235b63740 1 -- 172.21.15.135:0/2270241916 wait complete. 2024-04-20T12:33:00.964 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.957+0000 7f5235b63740 20 client.18639 trim_cache size 0 max 16384 2024-04-20T12:33:00.964 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:33:00.964 INFO:teuthology.orchestra.run.smithi135.stdout: "return_code": 0, 2024-04-20T12:33:00.964 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_tag": "b76d1a0b-702e-4db8-92bd-53821934b39c", 2024-04-20T12:33:00.964 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": "asynchronous" 2024-04-20T12:33:00.964 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:33:00.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.958+0000 7f5232f75640 1 -- 172.21.15.135:0/3988927582 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f521c0a3d20 msgr2=0x7f521c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:00.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.958+0000 7f5232f75640 1 --2- 172.21.15.135:0/3988927582 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f521c0a3d20 0x7f521c0a61e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5220005ab0 tx=0x7f522002c880 comp rx=0 tx=0).stop 2024-04-20T12:33:00.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.958+0000 7f5232f75640 1 -- 172.21.15.135:0/3988927582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f522c10c530 msgr2=0x7f522c1018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:00.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.958+0000 7f5232f75640 1 --2- 172.21.15.135:0/3988927582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f522c10c530 0x7f522c1018c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f522400b970 tx=0x7f522400be30 comp rx=0 tx=0).stop 2024-04-20T12:33:00.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.958+0000 7f5232f75640 1 -- 172.21.15.135:0/3988927582 shutdown_connections 2024-04-20T12:33:00.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.958+0000 7f5232f75640 1 --2- 172.21.15.135:0/3988927582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f522c10c530 0x7f522c1018c0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.958+0000 7f5232f75640 1 --2- 172.21.15.135:0/3988927582 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f521c0a3d20 0x7f521c0a61e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.958+0000 7f5232f75640 1 --2- 172.21.15.135:0/3988927582 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f522c103b10 0x7f522c101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.958+0000 7f5232f75640 1 --2- 172.21.15.135:0/3988927582 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f522c1031f0 0x7f522c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:00.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.958+0000 7f5232f75640 1 -- 172.21.15.135:0/3988927582 >> 172.21.15.135:0/3988927582 conn(0x7f522c0771e0 msgr2=0x7f522c0fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:00.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.958+0000 7f5232f75640 1 -- 172.21.15.135:0/3988927582 shutdown_connections 2024-04-20T12:33:00.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:00.958+0000 7f5232f75640 1 -- 172.21.15.135:0/3988927582 wait complete. 2024-04-20T12:33:00.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:33:00.968 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:33:01.109 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.109+0000 7f8ee6411640 1 -- 172.21.15.135:0/1398296875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ee010c530 msgr2=0x7f8ee010e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:01.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.109+0000 7f8ee6411640 1 --2- 172.21.15.135:0/1398296875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ee010c530 0x7f8ee010e9d0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009ca0 tx=0x7f8ed802c230 comp rx=0 tx=0).stop 2024-04-20T12:33:01.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.109+0000 7f8ee6411640 1 -- 172.21.15.135:0/1398296875 shutdown_connections 2024-04-20T12:33:01.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.109+0000 7f8ee6411640 1 --2- 172.21.15.135:0/1398296875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ee010c530 0x7f8ee010e9d0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.109+0000 7f8ee6411640 1 --2- 172.21.15.135:0/1398296875 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ee0103b10 0x7f8ee010bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.109+0000 7f8ee6411640 1 --2- 172.21.15.135:0/1398296875 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee01031f0 0x7f8ee01035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.109+0000 7f8ee6411640 1 -- 172.21.15.135:0/1398296875 >> 172.21.15.135:0/1398296875 conn(0x7f8ee00771e0 msgr2=0x7f8ee00775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:01.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.109+0000 7f8ee6411640 1 -- 172.21.15.135:0/1398296875 shutdown_connections 2024-04-20T12:33:01.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.109+0000 7f8ee6411640 1 -- 172.21.15.135:0/1398296875 wait complete. 2024-04-20T12:33:01.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.110+0000 7f8ee6411640 1 Processor -- start 2024-04-20T12:33:01.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.110+0000 7f8ee6411640 1 -- start start 2024-04-20T12:33:01.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.110+0000 7f8ee6411640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ee01031f0 0x7f8ee019e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.110+0000 7f8ee6411640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ee0103b10 0x7f8ee019e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.110+0000 7f8ee6411640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee010c530 0x7f8ee0198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.110+0000 7f8ee6411640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0112310 con 0x7f8ee01031f0 2024-04-20T12:33:01.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.110+0000 7f8ee6411640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0112190 con 0x7f8ee0103b10 2024-04-20T12:33:01.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.110+0000 7f8ee6411640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0112490 con 0x7f8ee010c530 2024-04-20T12:33:01.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.110+0000 7f8edffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ee01031f0 0x7f8ee019e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.112 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.110+0000 7f8edffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ee01031f0 0x7f8ee019e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37572/0 (socket says 172.21.15.135:37572) 2024-04-20T12:33:01.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.110+0000 7f8edffff640 1 -- 172.21.15.135:0/2534478660 learned_addr learned my addr 172.21.15.135:0/2534478660 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:01.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.111+0000 7f8ee49ae640 1 --2- 172.21.15.135:0/2534478660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee010c530 0x7f8ee0198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.111+0000 7f8edf7fe640 1 --2- 172.21.15.135:0/2534478660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ee0103b10 0x7f8ee019e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.111+0000 7f8edffff640 1 -- 172.21.15.135:0/2534478660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee010c530 msgr2=0x7f8ee0198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:01.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.111+0000 7f8edffff640 1 --2- 172.21.15.135:0/2534478660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee010c530 0x7f8ee0198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.111+0000 7f8edffff640 1 -- 172.21.15.135:0/2534478660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ee0103b10 msgr2=0x7f8ee019e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:01.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.111+0000 7f8edffff640 1 --2- 172.21.15.135:0/2534478660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ee0103b10 0x7f8ee019e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.111+0000 7f8edffff640 1 -- 172.21.15.135:0/2534478660 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee0198d90 con 0x7f8ee01031f0 2024-04-20T12:33:01.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.111+0000 7f8edf7fe640 1 --2- 172.21.15.135:0/2534478660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ee0103b10 0x7f8ee019e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:33:01.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.111+0000 7f8edffff640 1 --2- 172.21.15.135:0/2534478660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ee01031f0 0x7f8ee019e460 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000d770 tx=0x7f8ed000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:01.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.111+0000 7f8edd7fa640 1 -- 172.21.15.135:0/2534478660 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0017070 con 0x7f8ee01031f0 2024-04-20T12:33:01.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.111+0000 7f8edd7fa640 1 -- 172.21.15.135:0/2534478660 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ed0005500 con 0x7f8ee01031f0 2024-04-20T12:33:01.113 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.111+0000 7f8ee6411640 1 -- 172.21.15.135:0/2534478660 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee0199080 con 0x7f8ee01031f0 2024-04-20T12:33:01.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.111+0000 7f8edd7fa640 1 -- 172.21.15.135:0/2534478660 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed0004e00 con 0x7f8ee01031f0 2024-04-20T12:33:01.114 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.111+0000 7f8ee6411640 1 -- 172.21.15.135:0/2534478660 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee01a5320 con 0x7f8ee01031f0 2024-04-20T12:33:01.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.114+0000 7f8edd7fa640 1 -- 172.21.15.135:0/2534478660 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f8ed0004fa0 con 0x7f8ee01031f0 2024-04-20T12:33:01.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.114+0000 7f8ee9002740 1 Processor -- start 2024-04-20T12:33:01.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.114+0000 7f8ee9002740 1 -- start start 2024-04-20T12:33:01.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.114+0000 7f8ee9002740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d5fd20 0x55fac5d60100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.114+0000 7f8ee9002740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d60640 0x55fac5d68ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.121 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.114+0000 7f8ee9002740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d69220 0x55fac5d6b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.114+0000 7f8ee9002740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fac5cc51b0 con 0x55fac5d5fd20 2024-04-20T12:33:01.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.114+0000 7f8ee9002740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fac5c62390 con 0x55fac5d60640 2024-04-20T12:33:01.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.114+0000 7f8ee9002740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fac5cc1170 con 0x55fac5d69220 2024-04-20T12:33:01.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.114+0000 7f8ee49ae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d5fd20 0x55fac5d60100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.114+0000 7f8ee49ae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d5fd20 0x55fac5d60100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37586/0 (socket says 172.21.15.135:37586) 2024-04-20T12:33:01.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.114+0000 7f8ee49ae640 1 -- 172.21.15.135:0/1738250322 learned_addr learned my addr 172.21.15.135:0/1738250322 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:01.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.114+0000 7f8edf7fe640 1 --2- 172.21.15.135:0/1738250322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d69220 0x55fac5d6b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.115+0000 7f8edd7fa640 1 --2- 172.21.15.135:0/2534478660 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8ec80a3d20 0x7f8ec80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.115+0000 7f8edffff640 1 --2- 172.21.15.135:0/1738250322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d60640 0x55fac5d68ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.115+0000 7f8ee49ae640 1 -- 172.21.15.135:0/1738250322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d69220 msgr2=0x55fac5d6b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:01.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.115+0000 7f8ee49ae640 1 --2- 172.21.15.135:0/1738250322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d69220 0x55fac5d6b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.115+0000 7f8ee49ae640 1 -- 172.21.15.135:0/1738250322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d60640 msgr2=0x55fac5d68ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:01.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.115+0000 7f8ee49ae640 1 --2- 172.21.15.135:0/1738250322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d60640 0x55fac5d68ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.122 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.115+0000 7f8ee49ae640 1 -- 172.21.15.135:0/1738250322 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fac5aa17d0 con 0x55fac5d5fd20 2024-04-20T12:33:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.115+0000 7f8edffff640 1 --2- 172.21.15.135:0/1738250322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d60640 0x55fac5d68ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:33:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.115+0000 7f8edd7fa640 1 -- 172.21.15.135:0/2534478660 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f8ed00d0700 con 0x7f8ee01031f0 2024-04-20T12:33:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.115+0000 7f8ee49ae640 1 --2- 172.21.15.135:0/2534478660 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8ec80a3d20 0x7f8ec80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.115+0000 7f8ee49ae640 1 --2- 172.21.15.135:0/1738250322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d5fd20 0x55fac5d60100 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8005e30 tx=0x7f8ed8009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce1787eb9d73795 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.115+0000 7f8ec67fc640 1 -- 172.21.15.135:0/1738250322 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8039050 con 0x55fac5d5fd20 2024-04-20T12:33:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.115+0000 7f8ec67fc640 1 -- 172.21.15.135:0/1738250322 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ed8046030 con 0x55fac5d5fd20 2024-04-20T12:33:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.115+0000 7f8ec67fc640 1 -- 172.21.15.135:0/1738250322 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8034640 con 0x55fac5d5fd20 2024-04-20T12:33:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.115+0000 7f8ee49ae640 1 --2- 172.21.15.135:0/2534478660 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8ec80a3d20 0x7f8ec80a61e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009430 tx=0x7f8ed804b000 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.116+0000 7f8ee9002740 1 -- 172.21.15.135:0/1738250322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d5fd20 msgr2=0x55fac5d60100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.116+0000 7f8ee9002740 1 --2- 172.21.15.135:0/1738250322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d5fd20 0x55fac5d60100 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8005e30 tx=0x7f8ed8009990 comp rx=0 tx=0).stop 2024-04-20T12:33:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.116+0000 7f8ee9002740 1 -- 172.21.15.135:0/1738250322 shutdown_connections 2024-04-20T12:33:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.116+0000 7f8ee9002740 1 --2- 172.21.15.135:0/1738250322 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d69220 0x55fac5d6b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.116+0000 7f8ee9002740 1 --2- 172.21.15.135:0/1738250322 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d60640 0x55fac5d68ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.116+0000 7f8ee9002740 1 --2- 172.21.15.135:0/1738250322 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d5fd20 0x55fac5d60100 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.123 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.116+0000 7f8ee9002740 1 -- 172.21.15.135:0/1738250322 >> 172.21.15.135:0/1738250322 conn(0x55fac5d5a450 msgr2=0x55fac5d5a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:01.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.116+0000 7f8ee9002740 1 -- 172.21.15.135:0/1738250322 shutdown_connections 2024-04-20T12:33:01.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.116+0000 7f8ee9002740 1 -- 172.21.15.135:0/1738250322 wait complete. 2024-04-20T12:33:01.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.116+0000 7f8ee9002740 1 -- start start 2024-04-20T12:33:01.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.116+0000 7f8ee9002740 1 Processor -- start 2024-04-20T12:33:01.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8ee9002740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d5fd20 0x55fac5d66320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8ee9002740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d60640 0x55fac5d66860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8ee9002740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d69220 0x55fac5d66da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8ee9002740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fac5d6c010 con 0x55fac5d60640 2024-04-20T12:33:01.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8ee9002740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fac5c7e2f0 con 0x55fac5d69220 2024-04-20T12:33:01.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8ee9002740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fac5d6c190 con 0x55fac5d5fd20 2024-04-20T12:33:01.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8ee9002740 10 client.0 _ll_register_callbacks cb 0x55fac5c484e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:01.124 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8edf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d60640 0x55fac5d66860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8edf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d60640 0x55fac5d66860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37596/0 (socket says 172.21.15.135:37596) 2024-04-20T12:33:01.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8edf7fe640 1 -- 172.21.15.135:0/966338344 learned_addr learned my addr 172.21.15.135:0/966338344 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:01.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8ee49ae640 1 --2- 172.21.15.135:0/966338344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d69220 0x55fac5d66da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8edffff640 1 --2- 172.21.15.135:0/966338344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d5fd20 0x55fac5d66320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8edf7fe640 1 -- 172.21.15.135:0/966338344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d5fd20 msgr2=0x55fac5d66320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:01.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8edf7fe640 1 --2- 172.21.15.135:0/966338344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d5fd20 0x55fac5d66320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8edf7fe640 1 -- 172.21.15.135:0/966338344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d69220 msgr2=0x55fac5d66da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:01.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8edf7fe640 1 --2- 172.21.15.135:0/966338344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d69220 0x55fac5d66da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8edf7fe640 1 -- 172.21.15.135:0/966338344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fac59d73f0 con 0x55fac5d60640 2024-04-20T12:33:01.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8ee49ae640 1 --2- 172.21.15.135:0/966338344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d69220 0x55fac5d66da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:33:01.125 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8edf7fe640 1 --2- 172.21.15.135:0/966338344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d60640 0x55fac5d66860 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4010670 tx=0x7f8ed4010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac39e74fea1d8afa server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8ebf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8ebf7fe640 1 -- 172.21.15.135:0/966338344 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4004220 con 0x55fac5d60640 2024-04-20T12:33:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8ebf7fe640 1 -- 172.21.15.135:0/966338344 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f8ed40043c0 con 0x55fac5d60640 2024-04-20T12:33:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.117+0000 7f8ee9002740 1 -- 172.21.15.135:0/966338344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ed8046030 con 0x55fac5d60640 2024-04-20T12:33:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.118+0000 7f8ebf7fe640 1 -- 172.21.15.135:0/966338344 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8ed4024050 con 0x55fac5d60640 2024-04-20T12:33:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.118+0000 7f8ee9002740 10 client.18651 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.118+0000 7f8ee9002740 1 -- 172.21.15.135:0/966338344 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fac59970f0 con 0x55fac5d60640 2024-04-20T12:33:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.118+0000 7f8ebf7fe640 1 -- 172.21.15.135:0/966338344 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ed8046030 con 0x55fac5d60640 2024-04-20T12:33:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.118+0000 7f8ebf7fe640 1 -- 172.21.15.135:0/966338344 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f8ed400f040 con 0x55fac5d60640 2024-04-20T12:33:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.118+0000 7f8ee9002740 10 client.18651 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.118+0000 7f8ee9002740 10 client.18651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:33:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.118+0000 7f8ee9002740 20 client.18651 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.118+0000 7f8ee9002740 1 --2- 172.21.15.135:0/966338344 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fac5d79720 0x55fac5d7bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.118+0000 7f8ee9002740 4 client.18651 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:33:01.126 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.118+0000 7f8ee9002740 1 -- 172.21.15.135:0/966338344 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fac5cd2bd0 con 0x55fac5d79720 2024-04-20T12:33:01.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.118+0000 7f8edffff640 1 --2- 172.21.15.135:0/966338344 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fac5d79720 0x55fac5d7bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.119+0000 7f8edffff640 1 --2- 172.21.15.135:0/966338344 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fac5d79720 0x55fac5d7bb30 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df2e7571498a7cba server_cookie=d500ecff8b8eab55 in_seq=0 out_seq=0 2024-04-20T12:33:01.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.119+0000 7f8ebf7fe640 10 client.18651 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:01.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.119+0000 7f8ebf7fe640 1 -- 172.21.15.135:0/966338344 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fac5cd2bd0 con 0x55fac5d79720 2024-04-20T12:33:01.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.119+0000 7f8ebf7fe640 10 client.18651 handle_command_reply: tid=0 2024-04-20T12:33:01.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.119+0000 7f8ee9002740 1 client.18651 shutdown 2024-04-20T12:33:01.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.119+0000 7f8ee9002740 1 -- 172.21.15.135:0/966338344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d60640 msgr2=0x55fac5d66860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:01.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.119+0000 7f8ee9002740 1 --2- 172.21.15.135:0/966338344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d60640 0x55fac5d66860 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4010670 tx=0x7f8ed4010b30 comp rx=0 tx=0).stop 2024-04-20T12:33:01.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.119+0000 7f8ee9002740 1 -- 172.21.15.135:0/966338344 shutdown_connections 2024-04-20T12:33:01.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.119+0000 7f8ee9002740 1 --2- 172.21.15.135:0/966338344 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fac5d79720 0x55fac5d7bb30 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.119+0000 7f8ee9002740 1 --2- 172.21.15.135:0/966338344 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d69220 0x55fac5d66da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.119+0000 7f8ee9002740 1 --2- 172.21.15.135:0/966338344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d60640 0x55fac5d66860 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.127 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.119+0000 7f8ee9002740 1 --2- 172.21.15.135:0/966338344 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d5fd20 0x55fac5d66320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.119+0000 7f8ebf7fe640 0 client.18651 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:01.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.119+0000 7f8ee9002740 1 -- 172.21.15.135:0/966338344 >> 172.21.15.135:0/966338344 conn(0x55fac5d5a450 msgr2=0x55fac5d5c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:01.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.120+0000 7f8ee9002740 1 -- 172.21.15.135:0/966338344 shutdown_connections 2024-04-20T12:33:01.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.120+0000 7f8ee9002740 1 -- 172.21.15.135:0/966338344 wait complete. 2024-04-20T12:33:01.128 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.120+0000 7f8ee9002740 20 client.18651 trim_cache size 0 max 16384 2024-04-20T12:33:01.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8ee9002740 1 Processor -- start 2024-04-20T12:33:01.142 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8ee9002740 1 -- start start 2024-04-20T12:33:01.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8ee9002740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d5fd20 0x55fac5d68a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8ee9002740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d60640 0x55fac5d74f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8ee9002740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d69220 0x55fac5d654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8ee9002740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01af4d0 con 0x55fac5d60640 2024-04-20T12:33:01.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8ee9002740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01b1010 con 0x55fac5d5fd20 2024-04-20T12:33:01.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8ee9002740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01afba0 con 0x55fac5d69220 2024-04-20T12:33:01.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8edf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d60640 0x55fac5d74f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8edf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d60640 0x55fac5d74f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37610/0 (socket says 172.21.15.135:37610) 2024-04-20T12:33:01.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8edf7fe640 1 -- 172.21.15.135:0/2173102124 learned_addr learned my addr 172.21.15.135:0/2173102124 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:01.143 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8edf7fe640 1 -- 172.21.15.135:0/2173102124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d69220 msgr2=0x55fac5d654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8edf7fe640 1 --2- 172.21.15.135:0/2173102124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d69220 0x55fac5d654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8edf7fe640 1 -- 172.21.15.135:0/2173102124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d5fd20 msgr2=0x55fac5d68a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8edf7fe640 1 --2- 172.21.15.135:0/2173102124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d5fd20 0x55fac5d68a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8edf7fe640 1 -- 172.21.15.135:0/2173102124 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fac5d6b980 con 0x55fac5d60640 2024-04-20T12:33:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8edf7fe640 1 --2- 172.21.15.135:0/2173102124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d60640 0x55fac5d74f00 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4003b50 tx=0x7f8ed40092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f96836d06c52356 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8ec5ffb640 1 -- 172.21.15.135:0/2173102124 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4010e70 con 0x55fac5d60640 2024-04-20T12:33:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8ec5ffb640 1 -- 172.21.15.135:0/2173102124 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ed4021070 con 0x55fac5d60640 2024-04-20T12:33:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.137+0000 7f8ec5ffb640 1 -- 172.21.15.135:0/2173102124 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4004020 con 0x55fac5d60640 2024-04-20T12:33:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.138+0000 7f8ee9002740 1 -- 172.21.15.135:0/2173102124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d60640 msgr2=0x55fac5d74f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.138+0000 7f8ee9002740 1 --2- 172.21.15.135:0/2173102124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d60640 0x55fac5d74f00 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4003b50 tx=0x7f8ed40092a0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.138+0000 7f8ee9002740 1 -- 172.21.15.135:0/2173102124 shutdown_connections 2024-04-20T12:33:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.138+0000 7f8ee9002740 1 --2- 172.21.15.135:0/2173102124 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d69220 0x55fac5d654a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.138+0000 7f8ee9002740 1 --2- 172.21.15.135:0/2173102124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d60640 0x55fac5d74f00 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.144 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.138+0000 7f8ee9002740 1 --2- 172.21.15.135:0/2173102124 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d5fd20 0x55fac5d68a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.138+0000 7f8ee9002740 1 -- 172.21.15.135:0/2173102124 >> 172.21.15.135:0/2173102124 conn(0x55fac5d5a450 msgr2=0x55fac5d5a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:01.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.138+0000 7f8ee9002740 1 -- 172.21.15.135:0/2173102124 shutdown_connections 2024-04-20T12:33:01.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.138+0000 7f8ee9002740 1 -- 172.21.15.135:0/2173102124 wait complete. 2024-04-20T12:33:01.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.138+0000 7f8ee9002740 1 -- start start 2024-04-20T12:33:01.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.138+0000 7f8ee9002740 1 Processor -- start 2024-04-20T12:33:01.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee9002740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d5fd20 0x55fac5d71450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee9002740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d60640 0x55fac5d71990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee9002740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d69220 0x55fac5d6ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee9002740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01b0940 con 0x55fac5d69220 2024-04-20T12:33:01.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee9002740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01b0270 con 0x55fac5d5fd20 2024-04-20T12:33:01.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee9002740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01ad4a0 con 0x55fac5d60640 2024-04-20T12:33:01.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee9002740 10 client.0 _ll_register_callbacks cb 0x7f8ed4009380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:01.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee49ae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d69220 0x55fac5d6ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee49ae640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d69220 0x55fac5d6ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:37618/0 (socket says 172.21.15.135:37618) 2024-04-20T12:33:01.145 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee49ae640 1 -- 172.21.15.135:0/1330785921 learned_addr learned my addr 172.21.15.135:0/1330785921 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:01.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8edffff640 1 --2- 172.21.15.135:0/1330785921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d5fd20 0x55fac5d71450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8edf7fe640 1 --2- 172.21.15.135:0/1330785921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d60640 0x55fac5d71990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee49ae640 1 -- 172.21.15.135:0/1330785921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d60640 msgr2=0x55fac5d71990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:01.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee49ae640 1 --2- 172.21.15.135:0/1330785921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d60640 0x55fac5d71990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee49ae640 1 -- 172.21.15.135:0/1330785921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d5fd20 msgr2=0x55fac5d71450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:01.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee49ae640 1 --2- 172.21.15.135:0/1330785921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d5fd20 0x55fac5d71450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee49ae640 1 -- 172.21.15.135:0/1330785921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fac5d6f3e0 con 0x55fac5d69220 2024-04-20T12:33:01.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee49ae640 1 --2- 172.21.15.135:0/1330785921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d69220 0x55fac5d6ebe0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8005f80 tx=0x7f8ed8005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94204a7257708015 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:01.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ebf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:01.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ebf7fe640 1 -- 172.21.15.135:0/1330785921 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8059060 con 0x55fac5d69220 2024-04-20T12:33:01.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ee9002740 1 -- 172.21.15.135:0/1330785921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ed4021070 con 0x55fac5d69220 2024-04-20T12:33:01.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.139+0000 7f8ebf7fe640 1 -- 172.21.15.135:0/1330785921 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9504+0+0 (secure 0 0 0) 0x7f8ed8034440 con 0x55fac5d69220 2024-04-20T12:33:01.146 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.140+0000 7f8ebf7fe640 1 -- 172.21.15.135:0/1330785921 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8ed8039020 con 0x55fac5d69220 2024-04-20T12:33:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.140+0000 7f8ee9002740 10 client.18657 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.140+0000 7f8ee9002740 1 -- 172.21.15.135:0/1330785921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fac5ddfa10 con 0x55fac5d69220 2024-04-20T12:33:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.140+0000 7f8ebf7fe640 1 -- 172.21.15.135:0/1330785921 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ed4021070 con 0x55fac5d69220 2024-04-20T12:33:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.140+0000 7f8ebf7fe640 1 -- 172.21.15.135:0/1330785921 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f8ed8004160 con 0x55fac5d69220 2024-04-20T12:33:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.140+0000 7f8ee9002740 10 client.18657 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.140+0000 7f8ee9002740 10 client.18657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:33:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.140+0000 7f8ee9002740 20 client.18657 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.140+0000 7f8ee9002740 1 --2- 172.21.15.135:0/1330785921 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fac5ddfdd0 0x55fac5de21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.140+0000 7f8ee9002740 4 client.18657 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:33:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.140+0000 7f8ee9002740 1 -- 172.21.15.135:0/1330785921 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fac5ccca40 con 0x55fac5ddfdd0 2024-04-20T12:33:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.140+0000 7f8edffff640 1 --2- 172.21.15.135:0/1330785921 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fac5ddfdd0 0x55fac5de21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ebf7fe640 10 client.18657 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8edffff640 1 --2- 172.21.15.135:0/1330785921 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fac5ddfdd0 0x55fac5de21c0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbbcc7837ead57fc server_cookie=2c31c7893f7f793b in_seq=0 out_seq=0 2024-04-20T12:33:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ebf7fe640 1 -- 172.21.15.135:0/1330785921 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55fac5ccca40 con 0x55fac5ddfdd0 2024-04-20T12:33:01.147 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ebf7fe640 10 client.18657 handle_command_reply: tid=0 2024-04-20T12:33:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ee9002740 1 client.18657 shutdown 2024-04-20T12:33:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ee9002740 1 -- 172.21.15.135:0/1330785921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d69220 msgr2=0x55fac5d6ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ee9002740 1 --2- 172.21.15.135:0/1330785921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d69220 0x55fac5d6ebe0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8005f80 tx=0x7f8ed8005fb0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ee9002740 1 -- 172.21.15.135:0/1330785921 shutdown_connections 2024-04-20T12:33:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ee9002740 1 --2- 172.21.15.135:0/1330785921 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x55fac5ddfdd0 0x55fac5de21c0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ee9002740 1 --2- 172.21.15.135:0/1330785921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fac5d69220 0x55fac5d6ebe0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ee9002740 1 --2- 172.21.15.135:0/1330785921 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fac5d60640 0x55fac5d71990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ebf7fe640 0 client.18657 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ee9002740 1 --2- 172.21.15.135:0/1330785921 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fac5d5fd20 0x55fac5d71450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ee9002740 1 -- 172.21.15.135:0/1330785921 >> 172.21.15.135:0/1330785921 conn(0x55fac5d5a450 msgr2=0x55fac5d58da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ee9002740 1 -- 172.21.15.135:0/1330785921 shutdown_connections 2024-04-20T12:33:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ee9002740 1 -- 172.21.15.135:0/1330785921 wait complete. 2024-04-20T12:33:01.148 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.141+0000 7f8ee9002740 20 client.18657 trim_cache size 0 max 16384 2024-04-20T12:33:01.149 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:33:01.149 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-20T12:33:01.149 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": { 2024-04-20T12:33:01.149 INFO:teuthology.orchestra.run.smithi135.stdout: "b76d1a0b-702e-4db8-92bd-53821934b39c": { 2024-04-20T12:33:01.149 INFO:teuthology.orchestra.run.smithi135.stdout: "path": "/", 2024-04-20T12:33:01.149 INFO:teuthology.orchestra.run.smithi135.stdout: "tag": "b76d1a0b-702e-4db8-92bd-53821934b39c", 2024-04-20T12:33:01.149 INFO:teuthology.orchestra.run.smithi135.stdout: "options": "recursive,force" 2024-04-20T12:33:01.149 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:01.149 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:01.149 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:33:01.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.142+0000 7f8ee6411640 1 -- 172.21.15.135:0/2534478660 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8ec80a3d20 msgr2=0x7f8ec80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:01.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.142+0000 7f8ee6411640 1 --2- 172.21.15.135:0/2534478660 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8ec80a3d20 0x7f8ec80a61e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009430 tx=0x7f8ed804b000 comp rx=0 tx=0).stop 2024-04-20T12:33:01.150 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.142+0000 7f8ee6411640 1 -- 172.21.15.135:0/2534478660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ee01031f0 msgr2=0x7f8ee019e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:01.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.142+0000 7f8ee6411640 1 --2- 172.21.15.135:0/2534478660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ee01031f0 0x7f8ee019e460 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000d770 tx=0x7f8ed000dc30 comp rx=0 tx=0).stop 2024-04-20T12:33:01.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.142+0000 7f8ee6411640 1 -- 172.21.15.135:0/2534478660 shutdown_connections 2024-04-20T12:33:01.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.142+0000 7f8ee6411640 1 --2- 172.21.15.135:0/2534478660 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8ec80a3d20 0x7f8ec80a61e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.142+0000 7f8ee6411640 1 --2- 172.21.15.135:0/2534478660 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8ee010c530 0x7f8ee0198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.142+0000 7f8ee6411640 1 --2- 172.21.15.135:0/2534478660 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8ee0103b10 0x7f8ee019e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.142+0000 7f8ee6411640 1 --2- 172.21.15.135:0/2534478660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ee01031f0 0x7f8ee019e460 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:01.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.142+0000 7f8ee6411640 1 -- 172.21.15.135:0/2534478660 >> 172.21.15.135:0/2534478660 conn(0x7f8ee00771e0 msgr2=0x7f8ee00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:01.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.142+0000 7f8ee6411640 1 -- 172.21.15.135:0/2534478660 shutdown_connections 2024-04-20T12:33:01.151 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:01.142+0000 7f8ee6411640 1 -- 172.21.15.135:0/2534478660 wait complete. 2024-04-20T12:33:01.152 INFO:tasks.cephfs.filesystem:scrub status for tag:b76d1a0b-702e-4db8-92bd-53821934b39c - {'path': '/', 'tag': 'b76d1a0b-702e-4db8-92bd-53821934b39c', 'options': 'recursive,force'} 2024-04-20T12:33:02.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:02 smithi154 ceph-mon[22073]: scrub queued for path: / 2024-04-20T12:33:02.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:02 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:33:02.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:02 smithi154 ceph-mon[22073]: scrub summary: active paths [/] 2024-04-20T12:33:02.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:02 smithi154 ceph-mon[22073]: scrub summary: idle+waiting paths [/] 2024-04-20T12:33:02.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:02 smithi154 ceph-mon[22073]: pgmap v306: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:02.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:02 smithi139 ceph-mon[21834]: scrub queued for path: / 2024-04-20T12:33:02.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:02 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:33:02.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:02 smithi139 ceph-mon[21834]: scrub summary: active paths [/] 2024-04-20T12:33:02.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:02 smithi139 ceph-mon[21834]: scrub summary: idle+waiting paths [/] 2024-04-20T12:33:02.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:02 smithi139 ceph-mon[21834]: pgmap v306: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:02.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:02 smithi135 ceph-mon[18264]: scrub queued for path: / 2024-04-20T12:33:02.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:02 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:33:02.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:02 smithi135 ceph-mon[18264]: scrub summary: active paths [/] 2024-04-20T12:33:02.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:02 smithi135 ceph-mon[18264]: scrub summary: idle+waiting paths [/] 2024-04-20T12:33:02.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:02 smithi135 ceph-mon[18264]: pgmap v306: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:03.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:03 smithi154 ceph-mon[22073]: scrub summary: idle 2024-04-20T12:33:03.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:03 smithi139 ceph-mon[21834]: scrub summary: idle 2024-04-20T12:33:03.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:03 smithi135 ceph-mon[18264]: scrub summary: idle 2024-04-20T12:33:04.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:04 smithi154 ceph-mon[22073]: pgmap v307: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-20T12:33:04.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:04 smithi139 ceph-mon[21834]: pgmap v307: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-20T12:33:04.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:04 smithi135 ceph-mon[18264]: pgmap v307: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-04-20T12:33:06.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:06 smithi154 ceph-mon[22073]: pgmap v308: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-20T12:33:06.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:06 smithi139 ceph-mon[21834]: pgmap v308: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-20T12:33:06.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:06 smithi135 ceph-mon[18264]: pgmap v308: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-20T12:33:08.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:08 smithi139 ceph-mon[21834]: pgmap v309: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-20T12:33:08.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:08 smithi139 ceph-mon[21834]: osdmap e102: 12 total, 12 up, 12 in 2024-04-20T12:33:08.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:08 smithi135 ceph-mon[18264]: pgmap v309: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-20T12:33:08.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:08 smithi135 ceph-mon[18264]: osdmap e102: 12 total, 12 up, 12 in 2024-04-20T12:33:09.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:08 smithi154 ceph-mon[22073]: pgmap v309: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-04-20T12:33:09.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:08 smithi154 ceph-mon[22073]: osdmap e102: 12 total, 12 up, 12 in 2024-04-20T12:33:10.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:10 smithi139 ceph-mon[21834]: pgmap v311: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-20T12:33:10.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:10 smithi135 ceph-mon[18264]: pgmap v311: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-20T12:33:11.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:10 smithi154 ceph-mon[22073]: pgmap v311: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-20T12:33:12.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:12 smithi139 ceph-mon[21834]: pgmap v312: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-20T12:33:12.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:12 smithi135 ceph-mon[18264]: pgmap v312: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-20T12:33:13.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:12 smithi154 ceph-mon[22073]: pgmap v312: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-04-20T12:33:14.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:14 smithi154 ceph-mon[22073]: pgmap v313: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:33:14.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:14 smithi154 ceph-mon[22073]: osdmap e103: 12 total, 12 up, 12 in 2024-04-20T12:33:14.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:14 smithi139 ceph-mon[21834]: pgmap v313: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:33:14.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:14 smithi139 ceph-mon[21834]: osdmap e103: 12 total, 12 up, 12 in 2024-04-20T12:33:14.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:14 smithi135 ceph-mon[18264]: pgmap v313: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-04-20T12:33:14.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:14 smithi135 ceph-mon[18264]: osdmap e103: 12 total, 12 up, 12 in 2024-04-20T12:33:16.130 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-04-20T12:33:16.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.241+0000 7f85e258f640 1 -- 172.21.15.135:0/507191379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85dc06b3f0 msgr2=0x7f85dc106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:16.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.241+0000 7f85e258f640 1 --2- 172.21.15.135:0/507191379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85dc06b3f0 0x7f85dc106bc0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f85cc009900 tx=0x7f85cc02bc30 comp rx=0 tx=0).stop 2024-04-20T12:33:16.242 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.241+0000 7f85e258f640 1 -- 172.21.15.135:0/507191379 shutdown_connections 2024-04-20T12:33:16.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.241+0000 7f85e258f640 1 --2- 172.21.15.135:0/507191379 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85dc1072f0 0x7f85dc10ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.241+0000 7f85e258f640 1 --2- 172.21.15.135:0/507191379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85dc06b3f0 0x7f85dc106bc0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.241+0000 7f85e258f640 1 --2- 172.21.15.135:0/507191379 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85dc06aa40 0x7f85dc06ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.241+0000 7f85e258f640 1 -- 172.21.15.135:0/507191379 >> 172.21.15.135:0/507191379 conn(0x7f85dc077bb0 msgr2=0x7f85dc077fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:16.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.241+0000 7f85e258f640 1 -- 172.21.15.135:0/507191379 shutdown_connections 2024-04-20T12:33:16.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.241+0000 7f85e258f640 1 -- 172.21.15.135:0/507191379 wait complete. 2024-04-20T12:33:16.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.242+0000 7f85e258f640 1 Processor -- start 2024-04-20T12:33:16.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.242+0000 7f85e258f640 1 -- start start 2024-04-20T12:33:16.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.242+0000 7f85e258f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85dc06aa40 0x7f85dc1a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:16.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.242+0000 7f85e258f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85dc1072f0 0x7f85dc1a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:16.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.242+0000 7f85e258f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85dc19a7f0 0x7f85dc19aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:16.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.242+0000 7f85e258f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc112330 con 0x7f85dc06aa40 2024-04-20T12:33:16.243 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.242+0000 7f85e258f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc1121b0 con 0x7f85dc19a7f0 2024-04-20T12:33:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.242+0000 7f85e258f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc1124b0 con 0x7f85dc1072f0 2024-04-20T12:33:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.242+0000 7f85dbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85dc06aa40 0x7f85dc1a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.242+0000 7f85dbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85dc06aa40 0x7f85dc1a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39342/0 (socket says 172.21.15.135:39342) 2024-04-20T12:33:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.242+0000 7f85dbfff640 1 -- 172.21.15.135:0/2216588966 learned_addr learned my addr 172.21.15.135:0/2216588966 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.243+0000 7f85db7fe640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85dc1072f0 0x7f85dc1a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.243+0000 7f85e0b2c640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85dc19a7f0 0x7f85dc19aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.243+0000 7f85dbfff640 1 -- 172.21.15.135:0/2216588966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85dc1072f0 msgr2=0x7f85dc1a0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.243+0000 7f85dbfff640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85dc1072f0 0x7f85dc1a0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.243+0000 7f85dbfff640 1 -- 172.21.15.135:0/2216588966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85dc19a7f0 msgr2=0x7f85dc19aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.243+0000 7f85dbfff640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85dc19a7f0 0x7f85dc19aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.243+0000 7f85dbfff640 1 -- 172.21.15.135:0/2216588966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85dc19b380 con 0x7f85dc06aa40 2024-04-20T12:33:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.243+0000 7f85e0b2c640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85dc19a7f0 0x7f85dc19aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:33:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.243+0000 7f85db7fe640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85dc1072f0 0x7f85dc1a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:33:16.244 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.243+0000 7f85dbfff640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85dc06aa40 0x7f85dc1a0630 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f85d000d950 tx=0x7f85d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:16.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.243+0000 7f85d97fa640 1 -- 172.21.15.135:0/2216588966 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d0017070 con 0x7f85dc06aa40 2024-04-20T12:33:16.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.243+0000 7f85e258f640 1 -- 172.21.15.135:0/2216588966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85dc19b670 con 0x7f85dc06aa40 2024-04-20T12:33:16.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.243+0000 7f85d97fa640 1 -- 172.21.15.135:0/2216588966 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f85d0009c30 con 0x7f85dc06aa40 2024-04-20T12:33:16.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.243+0000 7f85d97fa640 1 -- 172.21.15.135:0/2216588966 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d000f6b0 con 0x7f85dc06aa40 2024-04-20T12:33:16.245 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.243+0000 7f85e258f640 1 -- 172.21.15.135:0/2216588966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85dc1a7800 con 0x7f85dc06aa40 2024-04-20T12:33:16.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.244+0000 7f85e258f640 1 -- 172.21.15.135:0/2216588966 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85dc1036a0 con 0x7f85dc06aa40 2024-04-20T12:33:16.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.245+0000 7f85d97fa640 1 -- 172.21.15.135:0/2216588966 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f85d00109d0 con 0x7f85dc06aa40 2024-04-20T12:33:16.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.246+0000 7f85d97fa640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f85c40a3dc0 0x7f85c40a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:16.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.246+0000 7f85db7fe640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f85c40a3dc0 0x7f85c40a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:16.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.246+0000 7f85d97fa640 1 -- 172.21.15.135:0/2216588966 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f85d00d08c0 con 0x7f85dc06aa40 2024-04-20T12:33:16.246 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.246+0000 7f85db7fe640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f85c40a3dc0 0x7f85c40a6280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0fe980 tx=0x7f85cc000bc0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:16.249 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.250+0000 7f85d97fa640 1 -- 172.21.15.135:0/2216588966 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f85dc19b670 con 0x7f85dc06aa40 2024-04-20T12:33:16.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.448+0000 7f85e258f640 1 -- 172.21.15.135:0/2216588966 --> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f85dc06b500 con 0x7f85c40a3dc0 2024-04-20T12:33:16.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.455+0000 7f85d97fa640 1 -- 172.21.15.135:0/2216588966 <== mgr.25093 v2:172.21.15.135:6800/15232286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f85dc06b500 con 0x7f85c40a3dc0 2024-04-20T12:33:16.454 INFO:teuthology.orchestra.run.smithi135.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-04-20T00:00:00", "created": "2024-04-20T12:23:15", "first": "2024-04-20T12:24:00", "last": "2024-04-20T12:33:00", "last_pruned": "2024-04-20T12:33:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-04-20T12:33:16.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.457+0000 7f85e258f640 1 -- 172.21.15.135:0/2216588966 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f85c40a3dc0 msgr2=0x7f85c40a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:16.456 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.457+0000 7f85e258f640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f85c40a3dc0 0x7f85c40a6280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0fe980 tx=0x7f85cc000bc0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.457+0000 7f85e258f640 1 -- 172.21.15.135:0/2216588966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85dc06aa40 msgr2=0x7f85dc1a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:16.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.457+0000 7f85e258f640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85dc06aa40 0x7f85dc1a0630 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f85d000d950 tx=0x7f85d000de10 comp rx=0 tx=0).stop 2024-04-20T12:33:16.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.458+0000 7f85e258f640 1 -- 172.21.15.135:0/2216588966 shutdown_connections 2024-04-20T12:33:16.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.458+0000 7f85e258f640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f85dc19a7f0 0x7f85dc19aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.458+0000 7f85e258f640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f85c40a3dc0 0x7f85c40a6280 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.458+0000 7f85e258f640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85dc1072f0 0x7f85dc1a0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.458+0000 7f85e258f640 1 --2- 172.21.15.135:0/2216588966 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85dc06aa40 0x7f85dc1a0630 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.458+0000 7f85e258f640 1 -- 172.21.15.135:0/2216588966 >> 172.21.15.135:0/2216588966 conn(0x7f85dc077bb0 msgr2=0x7f85dc10d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:16.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.458+0000 7f85e258f640 1 -- 172.21.15.135:0/2216588966 shutdown_connections 2024-04-20T12:33:16.457 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.458+0000 7f85e258f640 1 -- 172.21.15.135:0/2216588966 wait complete. 2024-04-20T12:33:16.467 DEBUG:teuthology.orchestra.run.smithi135:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-04-20T12:33:16.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.568+0000 7f98674c8640 1 -- 172.21.15.135:0/1857917517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9860100e20 msgr2=0x7f986010edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:16.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.568+0000 7f98674c8640 1 --2- 172.21.15.135:0/1857917517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9860100e20 0x7f986010edf0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f9858009cd0 tx=0x7f985802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.569 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.568+0000 7f98674c8640 1 -- 172.21.15.135:0/1857917517 shutdown_connections 2024-04-20T12:33:16.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.568+0000 7f98674c8640 1 --2- 172.21.15.135:0/1857917517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9860100e20 0x7f986010edf0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.568+0000 7f98674c8640 1 --2- 172.21.15.135:0/1857917517 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9860100460 0x7f98601008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.568+0000 7f98674c8640 1 --2- 172.21.15.135:0/1857917517 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9860106f40 0x7f9860107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.568+0000 7f98674c8640 1 -- 172.21.15.135:0/1857917517 >> 172.21.15.135:0/1857917517 conn(0x7f98600773e0 msgr2=0x7f98600fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:16.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.568+0000 7f98674c8640 1 -- 172.21.15.135:0/1857917517 shutdown_connections 2024-04-20T12:33:16.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.568+0000 7f98674c8640 1 -- 172.21.15.135:0/1857917517 wait complete. 2024-04-20T12:33:16.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f98674c8640 1 Processor -- start 2024-04-20T12:33:16.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f98674c8640 1 -- start start 2024-04-20T12:33:16.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f98674c8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9860100460 0x7f986019e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:16.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f98674c8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9860100e20 0x7f986019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:16.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f98674c8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9860106f40 0x7f9860198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:16.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f98674c8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9860112400 con 0x7f9860100460 2024-04-20T12:33:16.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f98674c8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9860112280 con 0x7f9860100e20 2024-04-20T12:33:16.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f98674c8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9860112580 con 0x7f9860106f40 2024-04-20T12:33:16.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f9865264640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9860100460 0x7f986019e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:16.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f9865264640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9860100460 0x7f986019e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:39374/0 (socket says 172.21.15.135:39374) 2024-04-20T12:33:16.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f9865264640 1 -- 172.21.15.135:0/3244738680 learned_addr learned my addr 172.21.15.135:0/3244738680 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:16.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f9864a63640 1 --2- 172.21.15.135:0/3244738680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9860100e20 0x7f986019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:16.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f9865a65640 1 --2- 172.21.15.135:0/3244738680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9860106f40 0x7f9860198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:16.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f9865264640 1 -- 172.21.15.135:0/3244738680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9860106f40 msgr2=0x7f9860198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:16.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f9865264640 1 --2- 172.21.15.135:0/3244738680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9860106f40 0x7f9860198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f9865264640 1 -- 172.21.15.135:0/3244738680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9860100e20 msgr2=0x7f986019eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:16.571 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f9865264640 1 --2- 172.21.15.135:0/3244738680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9860100e20 0x7f986019eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f9865264640 1 -- 172.21.15.135:0/3244738680 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9860198f40 con 0x7f9860100460 2024-04-20T12:33:16.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.569+0000 7f9865a65640 1 --2- 172.21.15.135:0/3244738680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9860106f40 0x7f9860198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:33:16.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.570+0000 7f9865264640 1 --2- 172.21.15.135:0/3244738680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9860100460 0x7f986019e5c0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f985c00d950 tx=0x7f985c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:16.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.570+0000 7f98567fc640 1 -- 172.21.15.135:0/3244738680 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c017030 con 0x7f9860100460 2024-04-20T12:33:16.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.570+0000 7f98567fc640 1 -- 172.21.15.135:0/3244738680 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f985c004020 con 0x7f9860100460 2024-04-20T12:33:16.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.570+0000 7f98674c8640 1 -- 172.21.15.135:0/3244738680 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9860199230 con 0x7f9860100460 2024-04-20T12:33:16.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.570+0000 7f98567fc640 1 -- 172.21.15.135:0/3244738680 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985c0047a0 con 0x7f9860100460 2024-04-20T12:33:16.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.570+0000 7f98674c8640 1 -- 172.21.15.135:0/3244738680 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98601a5540 con 0x7f9860100460 2024-04-20T12:33:16.572 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.571+0000 7f98674c8640 1 -- 172.21.15.135:0/3244738680 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9860103780 con 0x7f9860100460 2024-04-20T12:33:16.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.572+0000 7f98567fc640 1 -- 172.21.15.135:0/3244738680 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f985c0041d0 con 0x7f9860100460 2024-04-20T12:33:16.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.572+0000 7f98567fc640 1 --2- 172.21.15.135:0/3244738680 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f984c0a3dc0 0x7f984c0a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:16.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.573+0000 7f9864a63640 1 --2- 172.21.15.135:0/3244738680 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f984c0a3dc0 0x7f984c0a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:16.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.573+0000 7f98567fc640 1 -- 172.21.15.135:0/3244738680 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f985c0d0b70 con 0x7f9860100460 2024-04-20T12:33:16.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.573+0000 7f9864a63640 1 --2- 172.21.15.135:0/3244738680 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f984c0a3dc0 0x7f984c0a6280 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9860199ed0 tx=0x7f985000a250 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:16.575 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.576+0000 7f98567fc640 1 -- 172.21.15.135:0/3244738680 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f985c09ce40 con 0x7f9860100460 2024-04-20T12:33:16.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:16 smithi154 ceph-mon[22073]: pgmap v315: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-20T12:33:16.773 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.774+0000 7f98674c8640 1 -- 172.21.15.135:0/3244738680 --> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f98600623a0 con 0x7f984c0a3dc0 2024-04-20T12:33:16.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.781+0000 7f98567fc640 1 -- 172.21.15.135:0/3244738680 <== mgr.25093 v2:172.21.15.135:6800/15232286 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f98600623a0 con 0x7f984c0a3dc0 2024-04-20T12:33:16.780 INFO:teuthology.orchestra.run.smithi135.stdout:/ 1m 6m3h 2024-04-20T12:33:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.783+0000 7f98674c8640 1 -- 172.21.15.135:0/3244738680 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f984c0a3dc0 msgr2=0x7f984c0a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.783+0000 7f98674c8640 1 --2- 172.21.15.135:0/3244738680 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f984c0a3dc0 0x7f984c0a6280 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9860199ed0 tx=0x7f985000a250 comp rx=0 tx=0).stop 2024-04-20T12:33:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.783+0000 7f98674c8640 1 -- 172.21.15.135:0/3244738680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9860100460 msgr2=0x7f986019e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.783+0000 7f98674c8640 1 --2- 172.21.15.135:0/3244738680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9860100460 0x7f986019e5c0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f985c00d950 tx=0x7f985c00de10 comp rx=0 tx=0).stop 2024-04-20T12:33:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.784+0000 7f98674c8640 1 -- 172.21.15.135:0/3244738680 shutdown_connections 2024-04-20T12:33:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.784+0000 7f98674c8640 1 --2- 172.21.15.135:0/3244738680 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f984c0a3dc0 0x7f984c0a6280 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.784+0000 7f98674c8640 1 --2- 172.21.15.135:0/3244738680 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9860106f40 0x7f9860198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.784+0000 7f98674c8640 1 --2- 172.21.15.135:0/3244738680 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9860100e20 0x7f986019eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.784+0000 7f98674c8640 1 --2- 172.21.15.135:0/3244738680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9860100460 0x7f986019e5c0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.784+0000 7f98674c8640 1 -- 172.21.15.135:0/3244738680 >> 172.21.15.135:0/3244738680 conn(0x7f98600773e0 msgr2=0x7f9860104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:16.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.784+0000 7f98674c8640 1 -- 172.21.15.135:0/3244738680 shutdown_connections 2024-04-20T12:33:16.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:16.784+0000 7f98674c8640 1 -- 172.21.15.135:0/3244738680 wait complete. 2024-04-20T12:33:16.792 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:16 smithi135 ceph-mon[18264]: pgmap v315: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-20T12:33:16.793 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-04-20T12:33:16.804 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-04-20T12:33:16.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:16 smithi139 ceph-mon[21834]: pgmap v315: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 255 B/s wr, 12 op/s 2024-04-20T12:33:17.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:17 smithi154 ceph-mon[22073]: from='client.18663 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:33:17.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:17 smithi154 ceph-mon[22073]: from='client.18669 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:33:17.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:17 smithi139 ceph-mon[21834]: from='client.18663 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:33:17.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:17 smithi139 ceph-mon[21834]: from='client.18669 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:33:17.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:17 smithi135 ceph-mon[18264]: from='client.18663 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:33:17.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:17 smithi135 ceph-mon[18264]: from='client.18669 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-20T12:33:18.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:18 smithi154 ceph-mon[22073]: pgmap v316: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2024-04-20T12:33:18.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:18 smithi139 ceph-mon[21834]: pgmap v316: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2024-04-20T12:33:18.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:18 smithi135 ceph-mon[18264]: pgmap v316: 129 pgs: 129 active+clean; 12 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 209 B/s wr, 10 op/s 2024-04-20T12:33:20.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:20 smithi154 ceph-mon[22073]: pgmap v317: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-20T12:33:20.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:20 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:33:20.827 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:20 smithi139 ceph-mon[21834]: pgmap v317: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-20T12:33:20.827 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:20 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:33:20.855 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:20 smithi135 ceph-mon[18264]: pgmap v317: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-20T12:33:20.855 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:20 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-20T12:33:22.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: pgmap v318: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-20T12:33:22.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:22.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:22.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:22.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:22.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:22.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:22.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.831 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.832 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.833 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.833 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.833 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:33:22.833 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:33:22.833 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:22 smithi139 ceph-mon[21834]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:22.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: pgmap v318: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-20T12:33:22.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:22.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:22.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:22.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:22.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:22.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:22.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.865 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:22.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:33:22.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:33:22.866 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:22 smithi135 ceph-mon[18264]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:23.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: pgmap v318: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 102 B/s wr, 13 op/s 2024-04-20T12:33:23.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:23.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:23.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:23.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:23.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:23.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:23.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-04-20T12:33:23.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-20T12:33:23.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-20T12:33:23.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:22 smithi154 ceph-mon[22073]: from='mgr.25093 ' entity='mgr.x' 2024-04-20T12:33:23.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:23 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi154 to 176.2M 2024-04-20T12:33:23.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:23 smithi139 ceph-mon[21834]: Unable to set osd_memory_target on smithi154 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-20T12:33:23.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:23 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi139 to 176.2M 2024-04-20T12:33:23.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:23 smithi139 ceph-mon[21834]: Unable to set osd_memory_target on smithi139 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-20T12:33:23.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:23 smithi139 ceph-mon[21834]: Adjusting osd_memory_target on smithi135 to 176.2M 2024-04-20T12:33:23.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:23 smithi139 ceph-mon[21834]: Unable to set osd_memory_target on smithi135 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-20T12:33:23.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:23 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi154 to 176.2M 2024-04-20T12:33:23.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:23 smithi135 ceph-mon[18264]: Unable to set osd_memory_target on smithi154 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-20T12:33:23.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:23 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi139 to 176.2M 2024-04-20T12:33:23.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:23 smithi135 ceph-mon[18264]: Unable to set osd_memory_target on smithi139 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-20T12:33:23.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:23 smithi135 ceph-mon[18264]: Adjusting osd_memory_target on smithi135 to 176.2M 2024-04-20T12:33:23.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:23 smithi135 ceph-mon[18264]: Unable to set osd_memory_target on smithi135 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-20T12:33:24.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:23 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi154 to 176.2M 2024-04-20T12:33:24.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:23 smithi154 ceph-mon[22073]: Unable to set osd_memory_target on smithi154 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-04-20T12:33:24.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:23 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi139 to 176.2M 2024-04-20T12:33:24.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:23 smithi154 ceph-mon[22073]: Unable to set osd_memory_target on smithi139 to 184770252: error parsing value: Value '184770252' is below minimum 939524096 2024-04-20T12:33:24.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:23 smithi154 ceph-mon[22073]: Adjusting osd_memory_target on smithi135 to 176.2M 2024-04-20T12:33:24.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:23 smithi154 ceph-mon[22073]: Unable to set osd_memory_target on smithi135 to 184770969: error parsing value: Value '184770969' is below minimum 939524096 2024-04-20T12:33:24.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:24 smithi139 ceph-mon[21834]: pgmap v319: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-20T12:33:24.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:24 smithi135 ceph-mon[18264]: pgmap v319: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-20T12:33:25.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:24 smithi154 ceph-mon[22073]: pgmap v319: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 0 B/s wr, 12 op/s 2024-04-20T12:33:26.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:26 smithi139 ceph-mon[21834]: pgmap v320: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-20T12:33:26.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:26 smithi135 ceph-mon[18264]: pgmap v320: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-20T12:33:27.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:26 smithi154 ceph-mon[22073]: pgmap v320: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 0 B/s wr, 11 op/s 2024-04-20T12:33:28.834 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:28 smithi139 ceph-mon[21834]: pgmap v321: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-20T12:33:28.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:28 smithi135 ceph-mon[18264]: pgmap v321: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-20T12:33:29.004 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:28 smithi154 ceph-mon[22073]: pgmap v321: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-04-20T12:33:30.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:30 smithi139 ceph-mon[21834]: pgmap v322: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-20T12:33:30.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:30 smithi135 ceph-mon[18264]: pgmap v322: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-20T12:33:31.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:30 smithi154 ceph-mon[22073]: pgmap v322: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 0 B/s wr, 14 op/s 2024-04-20T12:33:31.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-04-20T12:33:31.154 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-04-20T12:33:31.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.268+0000 7f3c530b3640 1 -- 172.21.15.135:0/326828656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4c1021a0 msgr2=0x7f3c4c102580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.268+0000 7f3c530b3640 1 --2- 172.21.15.135:0/326828656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4c1021a0 0x7f3c4c102580 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009900 tx=0x7f3c4002bc30 comp rx=0 tx=0).stop 2024-04-20T12:33:31.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.268+0000 7f3c530b3640 1 -- 172.21.15.135:0/326828656 shutdown_connections 2024-04-20T12:33:31.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.268+0000 7f3c530b3640 1 --2- 172.21.15.135:0/326828656 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c4c107270 0x7f3c4c10ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.268+0000 7f3c530b3640 1 --2- 172.21.15.135:0/326828656 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c4c102b50 0x7f3c4c106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.268+0000 7f3c530b3640 1 --2- 172.21.15.135:0/326828656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4c1021a0 0x7f3c4c102580 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.268+0000 7f3c530b3640 1 -- 172.21.15.135:0/326828656 >> 172.21.15.135:0/326828656 conn(0x7f3c4c0793b0 msgr2=0x7f3c4c0797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.268+0000 7f3c530b3640 1 -- 172.21.15.135:0/326828656 shutdown_connections 2024-04-20T12:33:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.268+0000 7f3c530b3640 1 -- 172.21.15.135:0/326828656 wait complete. 2024-04-20T12:33:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.268+0000 7f3c530b3640 1 Processor -- start 2024-04-20T12:33:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c530b3640 1 -- start start 2024-04-20T12:33:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c530b3640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c4c1021a0 0x7f3c4c074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c530b3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4c107270 0x7f3c4c0747a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c530b3640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c4c074ce0 0x7f3c4c1a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c530b3640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c112320 con 0x7f3c4c107270 2024-04-20T12:33:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c530b3640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c1121a0 con 0x7f3c4c074ce0 2024-04-20T12:33:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c530b3640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c1124a0 con 0x7f3c4c1021a0 2024-04-20T12:33:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c4bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4c107270 0x7f3c4c0747a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.271 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c4bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4c107270 0x7f3c4c0747a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49018/0 (socket says 172.21.15.135:49018) 2024-04-20T12:33:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c4bfff640 1 -- 172.21.15.135:0/2499336728 learned_addr learned my addr 172.21.15.135:0/2499336728 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c51650640 1 --2- 172.21.15.135:0/2499336728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c4c074ce0 0x7f3c4c1a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c50e4f640 1 --2- 172.21.15.135:0/2499336728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c4c1021a0 0x7f3c4c074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c4bfff640 1 -- 172.21.15.135:0/2499336728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c4c1021a0 msgr2=0x7f3c4c074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c4bfff640 1 --2- 172.21.15.135:0/2499336728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c4c1021a0 0x7f3c4c074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c4bfff640 1 -- 172.21.15.135:0/2499336728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c4c074ce0 msgr2=0x7f3c4c1a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c4bfff640 1 --2- 172.21.15.135:0/2499336728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c4c074ce0 0x7f3c4c1a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c4bfff640 1 -- 172.21.15.135:0/2499336728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c1a7150 con 0x7f3c4c107270 2024-04-20T12:33:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c4bfff640 1 --2- 172.21.15.135:0/2499336728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4c107270 0x7f3c4c0747a0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800d740 tx=0x7f3c3800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c49ffb640 1 -- 172.21.15.135:0/2499336728 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c38017070 con 0x7f3c4c107270 2024-04-20T12:33:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c49ffb640 1 -- 172.21.15.135:0/2499336728 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c3800de50 con 0x7f3c4c107270 2024-04-20T12:33:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c530b3640 1 -- 172.21.15.135:0/2499336728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4c1a7440 con 0x7f3c4c107270 2024-04-20T12:33:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.269+0000 7f3c49ffb640 1 -- 172.21.15.135:0/2499336728 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c38004e00 con 0x7f3c4c107270 2024-04-20T12:33:31.272 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.270+0000 7f3c530b3640 1 -- 172.21.15.135:0/2499336728 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c4c1a7940 con 0x7f3c4c107270 2024-04-20T12:33:31.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.272+0000 7f3c49ffb640 1 -- 172.21.15.135:0/2499336728 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f3c38004fa0 con 0x7f3c4c107270 2024-04-20T12:33:31.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.272+0000 7f3c55d80740 1 Processor -- start 2024-04-20T12:33:31.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.272+0000 7f3c55d80740 1 -- start start 2024-04-20T12:33:31.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.272+0000 7f3c49ffb640 1 --2- 172.21.15.135:0/2499336728 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3c3c0a3d50 0x7f3c3c0a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c55d80740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5969bd20 0x557f5969c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c51650640 1 --2- 172.21.15.135:0/2499336728 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3c3c0a3d50 0x7f3c3c0a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c55d80740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 0x557f596a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c55d80740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f596a5220 0x557f596a7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c55d80740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557f596011b0 con 0x557f596a5220 2024-04-20T12:33:31.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c55d80740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557f5959e390 con 0x557f5969c640 2024-04-20T12:33:31.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c55d80740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557f595fd170 con 0x557f5969bd20 2024-04-20T12:33:31.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c49ffb640 1 -- 172.21.15.135:0/2499336728 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f3c380d04d0 con 0x7f3c4c107270 2024-04-20T12:33:31.279 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c51650640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f596a5220 0x557f596a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c51650640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f596a5220 0x557f596a7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49030/0 (socket says 172.21.15.135:49030) 2024-04-20T12:33:31.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c51650640 1 -- 172.21.15.135:0/3190139519 learned_addr learned my addr 172.21.15.135:0/3190139519 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c4bfff640 1 --2- 172.21.15.135:0/3190139519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 0x557f596a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c50e4f640 1 --2- 172.21.15.135:0/3190139519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5969bd20 0x557f5969c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c51650640 1 --2- 172.21.15.135:0/2499336728 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3c3c0a3d50 0x7f3c3c0a6210 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3c44012780 tx=0x7f3c44012b80 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c51650640 1 -- 172.21.15.135:0/3190139519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5969bd20 msgr2=0x557f5969c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c51650640 1 --2- 172.21.15.135:0/3190139519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5969bd20 0x557f5969c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c51650640 1 -- 172.21.15.135:0/3190139519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 msgr2=0x557f596a4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c51650640 1 --2- 172.21.15.135:0/3190139519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 0x557f596a4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c51650640 1 -- 172.21.15.135:0/3190139519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f593dd7d0 con 0x557f596a5220 2024-04-20T12:33:31.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c4bfff640 1 --2- 172.21.15.135:0/3190139519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 0x557f596a4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:33:31.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.273+0000 7f3c51650640 1 --2- 172.21.15.135:0/3190139519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f596a5220 0x557f596a7610 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009d90 tx=0x7f3c4401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f10fd0fcc8ebc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.274+0000 7f3c36ffd640 1 -- 172.21.15.135:0/3190139519 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c44003b70 con 0x557f596a5220 2024-04-20T12:33:31.280 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.274+0000 7f3c36ffd640 1 -- 172.21.15.135:0/3190139519 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c44023070 con 0x557f596a5220 2024-04-20T12:33:31.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.274+0000 7f3c36ffd640 1 -- 172.21.15.135:0/3190139519 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c44004560 con 0x557f596a5220 2024-04-20T12:33:31.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.274+0000 7f3c55d80740 1 -- 172.21.15.135:0/3190139519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f596a5220 msgr2=0x557f596a7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.274+0000 7f3c55d80740 1 --2- 172.21.15.135:0/3190139519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f596a5220 0x557f596a7610 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009d90 tx=0x7f3c4401e000 comp rx=0 tx=0).stop 2024-04-20T12:33:31.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.274+0000 7f3c55d80740 1 -- 172.21.15.135:0/3190139519 shutdown_connections 2024-04-20T12:33:31.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.274+0000 7f3c55d80740 1 --2- 172.21.15.135:0/3190139519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f596a5220 0x557f596a7610 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.274+0000 7f3c55d80740 1 --2- 172.21.15.135:0/3190139519 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 0x557f596a4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.274+0000 7f3c55d80740 1 --2- 172.21.15.135:0/3190139519 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5969bd20 0x557f5969c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.274+0000 7f3c55d80740 1 -- 172.21.15.135:0/3190139519 >> 172.21.15.135:0/3190139519 conn(0x557f59696450 msgr2=0x557f59696830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.274+0000 7f3c55d80740 1 -- 172.21.15.135:0/3190139519 shutdown_connections 2024-04-20T12:33:31.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.274+0000 7f3c55d80740 1 -- 172.21.15.135:0/3190139519 wait complete. 2024-04-20T12:33:31.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.275+0000 7f3c55d80740 1 -- start start 2024-04-20T12:33:31.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.275+0000 7f3c55d80740 1 Processor -- start 2024-04-20T12:33:31.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.275+0000 7f3c55d80740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5969bd20 0x557f596a22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.275+0000 7f3c55d80740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 0x557f596a2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.281 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.275+0000 7f3c55d80740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f596a5220 0x557f596a2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.275+0000 7f3c55d80740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557f596a7fb0 con 0x557f5969bd20 2024-04-20T12:33:31.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.275+0000 7f3c55d80740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x557f595ba2f0 con 0x557f5969c640 2024-04-20T12:33:31.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.275+0000 7f3c55d80740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x557f596a8130 con 0x557f596a5220 2024-04-20T12:33:31.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.275+0000 7f3c55d80740 10 client.0 _ll_register_callbacks cb 0x557f595844e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:31.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.275+0000 7f3c50e4f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5969bd20 0x557f596a22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.275+0000 7f3c50e4f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5969bd20 0x557f596a22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49034/0 (socket says 172.21.15.135:49034) 2024-04-20T12:33:31.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.275+0000 7f3c50e4f640 1 -- 172.21.15.135:0/120819041 learned_addr learned my addr 172.21.15.135:0/120819041 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c51650640 1 --2- 172.21.15.135:0/120819041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f596a5220 0x557f596a2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c4bfff640 1 --2- 172.21.15.135:0/120819041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 0x557f596a2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c50e4f640 1 -- 172.21.15.135:0/120819041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f596a5220 msgr2=0x557f596a2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c50e4f640 1 --2- 172.21.15.135:0/120819041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f596a5220 0x557f596a2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c50e4f640 1 -- 172.21.15.135:0/120819041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 msgr2=0x557f596a2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c50e4f640 1 --2- 172.21.15.135:0/120819041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 0x557f596a2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c50e4f640 1 -- 172.21.15.135:0/120819041 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f593133f0 con 0x557f5969bd20 2024-04-20T12:33:31.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c4bfff640 1 --2- 172.21.15.135:0/120819041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 0x557f596a2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:33:31.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c51650640 1 --2- 172.21.15.135:0/120819041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f596a5220 0x557f596a2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:33:31.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c50e4f640 1 --2- 172.21.15.135:0/120819041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5969bd20 0x557f596a22e0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f3c4002c170 tx=0x7f3c4002ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881cd25897fa6e3e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:31.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c2bfff640 1 -- 172.21.15.135:0/120819041 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c40004380 con 0x557f5969bd20 2024-04-20T12:33:31.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c2bfff640 1 -- 172.21.15.135:0/120819041 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f3c400046c0 con 0x557f5969bd20 2024-04-20T12:33:31.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c55d80740 1 -- 172.21.15.135:0/120819041 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c44023070 con 0x557f5969bd20 2024-04-20T12:33:31.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c2bfff640 1 -- 172.21.15.135:0/120819041 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3c400048c0 con 0x557f5969bd20 2024-04-20T12:33:31.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c55d80740 10 client.18681 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:31.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c55d80740 1 -- 172.21.15.135:0/120819041 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557f592d30f0 con 0x557f5969bd20 2024-04-20T12:33:31.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.276+0000 7f3c2bfff640 1 -- 172.21.15.135:0/120819041 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c44023070 con 0x557f5969bd20 2024-04-20T12:33:31.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.277+0000 7f3c2bfff640 1 -- 172.21.15.135:0/120819041 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f3c400035f0 con 0x557f5969bd20 2024-04-20T12:33:31.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.277+0000 7f3c55d80740 10 client.18681 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:31.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.277+0000 7f3c55d80740 10 client.18681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:33:31.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.277+0000 7f3c55d80740 20 client.18681 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.277+0000 7f3c55d80740 1 --2- 172.21.15.135:0/120819041 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f596b5620 0x557f596b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.277+0000 7f3c55d80740 4 client.18681 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:33:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.277+0000 7f3c55d80740 1 -- 172.21.15.135:0/120819041 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f5960ebd0 con 0x557f596b5620 2024-04-20T12:33:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.277+0000 7f3c4bfff640 1 --2- 172.21.15.135:0/120819041 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f596b5620 0x557f596b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.277+0000 7f3c2bfff640 10 client.18681 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.277+0000 7f3c4bfff640 1 --2- 172.21.15.135:0/120819041 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f596b5620 0x557f596b7a50 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e17af26d17a388 server_cookie=6d4d9c774f821968 in_seq=0 out_seq=0 2024-04-20T12:33:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.278+0000 7f3c2bfff640 1 -- 172.21.15.135:0/120819041 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557f5960ebd0 con 0x557f596b5620 2024-04-20T12:33:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.278+0000 7f3c2bfff640 10 client.18681 handle_command_reply: tid=0 2024-04-20T12:33:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.278+0000 7f3c55d80740 1 client.18681 shutdown 2024-04-20T12:33:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.278+0000 7f3c55d80740 1 -- 172.21.15.135:0/120819041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5969bd20 msgr2=0x557f596a22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.278+0000 7f3c55d80740 1 --2- 172.21.15.135:0/120819041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5969bd20 0x557f596a22e0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f3c4002c170 tx=0x7f3c4002ce30 comp rx=0 tx=0).stop 2024-04-20T12:33:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.278+0000 7f3c55d80740 1 -- 172.21.15.135:0/120819041 shutdown_connections 2024-04-20T12:33:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.278+0000 7f3c55d80740 1 --2- 172.21.15.135:0/120819041 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f596b5620 0x557f596b7a50 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.278+0000 7f3c55d80740 1 --2- 172.21.15.135:0/120819041 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f596a5220 0x557f596a2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.278+0000 7f3c55d80740 1 --2- 172.21.15.135:0/120819041 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 0x557f596a2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.278+0000 7f3c2bfff640 0 client.18681 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:31.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.278+0000 7f3c55d80740 1 --2- 172.21.15.135:0/120819041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5969bd20 0x557f596a22e0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.278+0000 7f3c55d80740 1 -- 172.21.15.135:0/120819041 >> 172.21.15.135:0/120819041 conn(0x557f59696450 msgr2=0x557f596981a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.279+0000 7f3c55d80740 1 -- 172.21.15.135:0/120819041 shutdown_connections 2024-04-20T12:33:31.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.279+0000 7f3c55d80740 1 -- 172.21.15.135:0/120819041 wait complete. 2024-04-20T12:33:31.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.279+0000 7f3c55d80740 20 client.18681 trim_cache size 0 max 16384 2024-04-20T12:33:31.300 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c55d80740 1 Processor -- start 2024-04-20T12:33:31.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c55d80740 1 -- start start 2024-04-20T12:33:31.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c55d80740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5969bd20 0x557f596b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c55d80740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5969c640 0x557f596bd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c55d80740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f596a5220 0x557f596bd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c55d80740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c1b1720 con 0x557f5969c640 2024-04-20T12:33:31.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c55d80740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c1b3260 con 0x557f596a5220 2024-04-20T12:33:31.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c55d80740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c1b1df0 con 0x557f5969bd20 2024-04-20T12:33:31.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c4bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5969c640 0x557f596bd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c4bfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5969c640 0x557f596bd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49038/0 (socket says 172.21.15.135:49038) 2024-04-20T12:33:31.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c4bfff640 1 -- 172.21.15.135:0/4277456123 learned_addr learned my addr 172.21.15.135:0/4277456123 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c4bfff640 1 -- 172.21.15.135:0/4277456123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5969bd20 msgr2=0x557f596b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c4bfff640 1 --2- 172.21.15.135:0/4277456123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5969bd20 0x557f596b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.301 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c4bfff640 1 -- 172.21.15.135:0/4277456123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f596a5220 msgr2=0x557f596bd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c4bfff640 1 --2- 172.21.15.135:0/4277456123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f596a5220 0x557f596bd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c4bfff640 1 -- 172.21.15.135:0/4277456123 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f596a7980 con 0x557f5969c640 2024-04-20T12:33:31.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.296+0000 7f3c4bfff640 1 --2- 172.21.15.135:0/4277456123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5969c640 0x557f596bd320 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f3c38005d00 tx=0x7f3c38009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f2fb1ef0bee00e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.297+0000 7f3c367fc640 1 -- 172.21.15.135:0/4277456123 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c380ba070 con 0x557f5969c640 2024-04-20T12:33:31.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.297+0000 7f3c367fc640 1 -- 172.21.15.135:0/4277456123 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c3809a510 con 0x557f5969c640 2024-04-20T12:33:31.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.297+0000 7f3c367fc640 1 -- 172.21.15.135:0/4277456123 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c380b4030 con 0x557f5969c640 2024-04-20T12:33:31.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.297+0000 7f3c55d80740 1 -- 172.21.15.135:0/4277456123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5969c640 msgr2=0x557f596bd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.297+0000 7f3c55d80740 1 --2- 172.21.15.135:0/4277456123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5969c640 0x557f596bd320 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f3c38005d00 tx=0x7f3c38009c30 comp rx=0 tx=0).stop 2024-04-20T12:33:31.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.297+0000 7f3c55d80740 1 -- 172.21.15.135:0/4277456123 shutdown_connections 2024-04-20T12:33:31.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.297+0000 7f3c55d80740 1 --2- 172.21.15.135:0/4277456123 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f596a5220 0x557f596bd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.297+0000 7f3c55d80740 1 --2- 172.21.15.135:0/4277456123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f5969c640 0x557f596bd320 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.297+0000 7f3c55d80740 1 --2- 172.21.15.135:0/4277456123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5969bd20 0x557f596b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.297+0000 7f3c55d80740 1 -- 172.21.15.135:0/4277456123 >> 172.21.15.135:0/4277456123 conn(0x557f59696450 msgr2=0x557f59695630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.297+0000 7f3c55d80740 1 -- 172.21.15.135:0/4277456123 shutdown_connections 2024-04-20T12:33:31.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.297+0000 7f3c55d80740 1 -- 172.21.15.135:0/4277456123 wait complete. 2024-04-20T12:33:31.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.297+0000 7f3c55d80740 1 -- start start 2024-04-20T12:33:31.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c55d80740 1 Processor -- start 2024-04-20T12:33:31.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c55d80740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5969bd20 0x557f59714580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c55d80740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 0x557f59714ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c55d80740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f596a5220 0x557f596acd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c55d80740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c1b2b90 con 0x557f596a5220 2024-04-20T12:33:31.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c55d80740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c1b24c0 con 0x557f5969c640 2024-04-20T12:33:31.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c55d80740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c1af6f0 con 0x557f5969bd20 2024-04-20T12:33:31.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c55d80740 10 client.0 _ll_register_callbacks cb 0x7f3c40009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:31.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c51650640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f596a5220 0x557f596acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c51650640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f596a5220 0x557f596acd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49054/0 (socket says 172.21.15.135:49054) 2024-04-20T12:33:31.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c51650640 1 -- 172.21.15.135:0/1943145260 learned_addr learned my addr 172.21.15.135:0/1943145260 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c50e4f640 1 --2- 172.21.15.135:0/1943145260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5969bd20 0x557f59714580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c4bfff640 1 --2- 172.21.15.135:0/1943145260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 0x557f59714ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c51650640 1 -- 172.21.15.135:0/1943145260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5969bd20 msgr2=0x557f59714580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c51650640 1 --2- 172.21.15.135:0/1943145260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5969bd20 0x557f59714580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c51650640 1 -- 172.21.15.135:0/1943145260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 msgr2=0x557f59714ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c51650640 1 --2- 172.21.15.135:0/1943145260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 0x557f59714ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c51650640 1 -- 172.21.15.135:0/1943145260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f596ad3f0 con 0x557f596a5220 2024-04-20T12:33:31.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c4bfff640 1 --2- 172.21.15.135:0/1943145260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 0x557f59714ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:33:31.304 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.298+0000 7f3c51650640 1 --2- 172.21.15.135:0/1943145260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f596a5220 0x557f596acd00 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009f10 tx=0x7f3c4401eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d723c47f7e9ab9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c2bfff640 1 -- 172.21.15.135:0/1943145260 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c44003b70 con 0x557f596a5220 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c2bfff640 1 -- 172.21.15.135:0/1943145260 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f3c44003d10 con 0x557f596a5220 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c55d80740 1 -- 172.21.15.135:0/1943145260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557f59608a40 con 0x557f596a5220 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c2bfff640 1 -- 172.21.15.135:0/1943145260 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3c44039680 con 0x557f596a5220 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c55d80740 10 client.18687 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c55d80740 1 -- 172.21.15.135:0/1943145260 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557f5971bd90 con 0x557f596a5220 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c2bfff640 1 -- 172.21.15.135:0/1943145260 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x557f59608a40 con 0x557f596a5220 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c2bfff640 1 -- 172.21.15.135:0/1943145260 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f3c440052d0 con 0x557f596a5220 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c55d80740 10 client.18687 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c55d80740 10 client.18687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c55d80740 20 client.18687 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c55d80740 1 --2- 172.21.15.135:0/1943145260 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f5971c280 0x557f5971e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c55d80740 4 client.18687 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c55d80740 1 -- 172.21.15.135:0/1943145260 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557f59584590 con 0x557f5971c280 2024-04-20T12:33:31.305 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.299+0000 7f3c50e4f640 1 --2- 172.21.15.135:0/1943145260 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f5971c280 0x557f5971e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c2bfff640 10 client.18687 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:31.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c50e4f640 1 --2- 172.21.15.135:0/1943145260 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f5971c280 0x557f5971e670 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44610ec16e9c952c server_cookie=11da5b7e65f08208 in_seq=0 out_seq=0 2024-04-20T12:33:31.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c2bfff640 1 -- 172.21.15.135:0/1943145260 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557f59584590 con 0x557f5971c280 2024-04-20T12:33:31.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c2bfff640 10 client.18687 handle_command_reply: tid=0 2024-04-20T12:33:31.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c55d80740 1 client.18687 shutdown 2024-04-20T12:33:31.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c55d80740 1 -- 172.21.15.135:0/1943145260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f596a5220 msgr2=0x557f596acd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c55d80740 1 --2- 172.21.15.135:0/1943145260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f596a5220 0x557f596acd00 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009f10 tx=0x7f3c4401eae0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c55d80740 1 -- 172.21.15.135:0/1943145260 shutdown_connections 2024-04-20T12:33:31.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c55d80740 1 --2- 172.21.15.135:0/1943145260 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x557f5971c280 0x557f5971e670 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c55d80740 1 --2- 172.21.15.135:0/1943145260 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557f596a5220 0x557f596acd00 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c55d80740 1 --2- 172.21.15.135:0/1943145260 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x557f5969c640 0x557f59714ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c2bfff640 0 client.18687 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:31.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c55d80740 1 --2- 172.21.15.135:0/1943145260 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x557f5969bd20 0x557f59714580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c55d80740 1 -- 172.21.15.135:0/1943145260 >> 172.21.15.135:0/1943145260 conn(0x557f59696450 msgr2=0x557f59697610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c55d80740 1 -- 172.21.15.135:0/1943145260 shutdown_connections 2024-04-20T12:33:31.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c55d80740 1 -- 172.21.15.135:0/1943145260 wait complete. 2024-04-20T12:33:31.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.300+0000 7f3c55d80740 20 client.18687 trim_cache size 0 max 16384 2024-04-20T12:33:31.307 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:33:31.307 INFO:teuthology.orchestra.run.smithi135.stdout: "status": "no active scrubs running", 2024-04-20T12:33:31.307 INFO:teuthology.orchestra.run.smithi135.stdout: "scrubs": {} 2024-04-20T12:33:31.308 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:33:31.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.301+0000 7f3c530b3640 1 -- 172.21.15.135:0/2499336728 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3c3c0a3d50 msgr2=0x7f3c3c0a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.301+0000 7f3c530b3640 1 --2- 172.21.15.135:0/2499336728 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3c3c0a3d50 0x7f3c3c0a6210 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3c44012780 tx=0x7f3c44012b80 comp rx=0 tx=0).stop 2024-04-20T12:33:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.301+0000 7f3c530b3640 1 -- 172.21.15.135:0/2499336728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4c107270 msgr2=0x7f3c4c0747a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.301+0000 7f3c530b3640 1 --2- 172.21.15.135:0/2499336728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4c107270 0x7f3c4c0747a0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800d740 tx=0x7f3c3800dc00 comp rx=0 tx=0).stop 2024-04-20T12:33:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.301+0000 7f3c530b3640 1 -- 172.21.15.135:0/2499336728 shutdown_connections 2024-04-20T12:33:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.301+0000 7f3c530b3640 1 --2- 172.21.15.135:0/2499336728 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3c4c074ce0 0x7f3c4c1a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.301+0000 7f3c530b3640 1 --2- 172.21.15.135:0/2499336728 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3c4c107270 0x7f3c4c0747a0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.301+0000 7f3c530b3640 1 --2- 172.21.15.135:0/2499336728 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f3c3c0a3d50 0x7f3c3c0a6210 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.301+0000 7f3c530b3640 1 --2- 172.21.15.135:0/2499336728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c4c1021a0 0x7f3c4c074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.301+0000 7f3c530b3640 1 -- 172.21.15.135:0/2499336728 >> 172.21.15.135:0/2499336728 conn(0x7f3c4c0793b0 msgr2=0x7f3c4c0fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.301+0000 7f3c530b3640 1 -- 172.21.15.135:0/2499336728 shutdown_connections 2024-04-20T12:33:31.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.301+0000 7f3c530b3640 1 -- 172.21.15.135:0/2499336728 wait complete. 2024-04-20T12:33:31.311 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-20T12:33:31.312 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:33:31.411 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.410+0000 7f9c6679d640 1 -- 172.21.15.135:0/1067216894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c60106180 msgr2=0x7f9c6010dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.410+0000 7f9c6679d640 1 --2- 172.21.15.135:0/1067216894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c60106180 0x7f9c6010dd50 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f9c58009ca0 tx=0x7f9c5802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.410+0000 7f9c6679d640 1 -- 172.21.15.135:0/1067216894 shutdown_connections 2024-04-20T12:33:31.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.410+0000 7f9c6679d640 1 --2- 172.21.15.135:0/1067216894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c60106180 0x7f9c6010dd50 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.410+0000 7f9c6679d640 1 --2- 172.21.15.135:0/1067216894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c60101a60 0x7f9c60105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.410+0000 7f9c6679d640 1 --2- 172.21.15.135:0/1067216894 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c601010b0 0x7f9c60101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.410+0000 7f9c6679d640 1 -- 172.21.15.135:0/1067216894 >> 172.21.15.135:0/1067216894 conn(0x7f9c60077f60 msgr2=0x7f9c60078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.410+0000 7f9c6679d640 1 -- 172.21.15.135:0/1067216894 shutdown_connections 2024-04-20T12:33:31.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.410+0000 7f9c6679d640 1 -- 172.21.15.135:0/1067216894 wait complete. 2024-04-20T12:33:31.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.410+0000 7f9c6679d640 1 Processor -- start 2024-04-20T12:33:31.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.410+0000 7f9c6679d640 1 -- start start 2024-04-20T12:33:31.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c6679d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c601010b0 0x7f9c6019e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c6679d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c60106180 0x7f9c6019e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.412 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c6679d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c60198620 0x7f9c60198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c6679d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c60111240 con 0x7f9c60106180 2024-04-20T12:33:31.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c6679d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9c601110c0 con 0x7f9c60198620 2024-04-20T12:33:31.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c6679d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9c601113c0 con 0x7f9c601010b0 2024-04-20T12:33:31.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c5f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c60106180 0x7f9c6019e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c5f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c60106180 0x7f9c6019e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49080/0 (socket says 172.21.15.135:49080) 2024-04-20T12:33:31.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c5f7fe640 1 -- 172.21.15.135:0/472410829 learned_addr learned my addr 172.21.15.135:0/472410829 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c5ffff640 1 --2- 172.21.15.135:0/472410829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c601010b0 0x7f9c6019e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c64d3a640 1 --2- 172.21.15.135:0/472410829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c60198620 0x7f9c60198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c5f7fe640 1 -- 172.21.15.135:0/472410829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c601010b0 msgr2=0x7f9c6019e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c5f7fe640 1 --2- 172.21.15.135:0/472410829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c601010b0 0x7f9c6019e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c5f7fe640 1 -- 172.21.15.135:0/472410829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c60198620 msgr2=0x7f9c60198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c5f7fe640 1 --2- 172.21.15.135:0/472410829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c60198620 0x7f9c60198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c5f7fe640 1 -- 172.21.15.135:0/472410829 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c60199140 con 0x7f9c60106180 2024-04-20T12:33:31.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.411+0000 7f9c5f7fe640 1 --2- 172.21.15.135:0/472410829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c60106180 0x7f9c6019e960 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000e9f0 tx=0x7f9c5000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.412+0000 7f9c5d7fa640 1 -- 172.21.15.135:0/472410829 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000ccc0 con 0x7f9c60106180 2024-04-20T12:33:31.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.412+0000 7f9c5d7fa640 1 -- 172.21.15.135:0/472410829 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c50005500 con 0x7f9c60106180 2024-04-20T12:33:31.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.412+0000 7f9c6679d640 1 -- 172.21.15.135:0/472410829 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c60199430 con 0x7f9c60106180 2024-04-20T12:33:31.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.412+0000 7f9c5d7fa640 1 -- 172.21.15.135:0/472410829 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50010690 con 0x7f9c60106180 2024-04-20T12:33:31.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.412+0000 7f9c6679d640 1 -- 172.21.15.135:0/472410829 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c601a55e0 con 0x7f9c60106180 2024-04-20T12:33:31.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.413+0000 7f9c6679d640 1 -- 172.21.15.135:0/472410829 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c60068d80 con 0x7f9c60106180 2024-04-20T12:33:31.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.414+0000 7f9c5d7fa640 1 -- 172.21.15.135:0/472410829 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f9c500046c0 con 0x7f9c60106180 2024-04-20T12:33:31.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.414+0000 7f9c5d7fa640 1 --2- 172.21.15.135:0/472410829 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9c4c0a3d20 0x7f9c4c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.414+0000 7f9c5ffff640 1 --2- 172.21.15.135:0/472410829 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9c4c0a3d20 0x7f9c4c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.414+0000 7f9c5d7fa640 1 -- 172.21.15.135:0/472410829 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f9c500d1190 con 0x7f9c60106180 2024-04-20T12:33:31.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.415+0000 7f9c5ffff640 1 --2- 172.21.15.135:0/472410829 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9c4c0a3d20 0x7f9c4c0a61e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9c48005d00 tx=0x7f9c4800b410 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.418+0000 7f9c5d7fa640 1 -- 172.21.15.135:0/472410829 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f9c50053ff0 con 0x7f9c60106180 2024-04-20T12:33:31.635 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.636+0000 7f9c6679d640 1 -- 172.21.15.135:0/472410829 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c60199b00 con 0x7f9c60106180 2024-04-20T12:33:31.636 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.637+0000 7f9c5d7fa640 1 -- 172.21.15.135:0/472410829 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7f9c60199b00 con 0x7f9c60106180 2024-04-20T12:33:31.636 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:33:31.636 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:33:31.637 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:33:31.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.639+0000 7f9c6679d640 1 -- 172.21.15.135:0/472410829 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9c4c0a3d20 msgr2=0x7f9c4c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.638 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.639+0000 7f9c6679d640 1 --2- 172.21.15.135:0/472410829 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9c4c0a3d20 0x7f9c4c0a61e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9c48005d00 tx=0x7f9c4800b410 comp rx=0 tx=0).stop 2024-04-20T12:33:31.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.639+0000 7f9c6679d640 1 -- 172.21.15.135:0/472410829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c60106180 msgr2=0x7f9c6019e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.639+0000 7f9c6679d640 1 --2- 172.21.15.135:0/472410829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c60106180 0x7f9c6019e960 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000e9f0 tx=0x7f9c5000eeb0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.639+0000 7f9c6679d640 1 -- 172.21.15.135:0/472410829 shutdown_connections 2024-04-20T12:33:31.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.639+0000 7f9c6679d640 1 --2- 172.21.15.135:0/472410829 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9c60198620 0x7f9c60198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.639+0000 7f9c6679d640 1 --2- 172.21.15.135:0/472410829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c60106180 0x7f9c6019e960 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.639+0000 7f9c6679d640 1 --2- 172.21.15.135:0/472410829 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f9c4c0a3d20 0x7f9c4c0a61e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.639+0000 7f9c6679d640 1 --2- 172.21.15.135:0/472410829 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9c601010b0 0x7f9c6019e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.639+0000 7f9c6679d640 1 -- 172.21.15.135:0/472410829 >> 172.21.15.135:0/472410829 conn(0x7f9c60077f60 msgr2=0x7f9c60069370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.639+0000 7f9c6679d640 1 -- 172.21.15.135:0/472410829 shutdown_connections 2024-04-20T12:33:31.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.639+0000 7f9c6679d640 1 -- 172.21.15.135:0/472410829 wait complete. 2024-04-20T12:33:31.649 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-04-20T12:33:31.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.750+0000 7fcd989c7640 1 -- 172.21.15.135:0/4147708863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd94108070 msgr2=0x7fcd94108450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.750+0000 7fcd989c7640 1 --2- 172.21.15.135:0/4147708863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd94108070 0x7fcd94108450 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009930 tx=0x7fcd8402bc30 comp rx=0 tx=0).stop 2024-04-20T12:33:31.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.750+0000 7fcd989c7640 1 -- 172.21.15.135:0/4147708863 shutdown_connections 2024-04-20T12:33:31.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.750+0000 7fcd989c7640 1 --2- 172.21.15.135:0/4147708863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9406af80 0x7fcd9410edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.763 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.750+0000 7fcd989c7640 1 --2- 172.21.15.135:0/4147708863 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd9406a5c0 0x7fcd9406aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.750+0000 7fcd989c7640 1 --2- 172.21.15.135:0/4147708863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd94108070 0x7fcd94108450 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.750+0000 7fcd989c7640 1 -- 172.21.15.135:0/4147708863 >> 172.21.15.135:0/4147708863 conn(0x7fcd94077c50 msgr2=0x7fcd94078060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.750+0000 7fcd989c7640 1 -- 172.21.15.135:0/4147708863 shutdown_connections 2024-04-20T12:33:31.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.750+0000 7fcd989c7640 1 -- 172.21.15.135:0/4147708863 wait complete. 2024-04-20T12:33:31.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.750+0000 7fcd989c7640 1 Processor -- start 2024-04-20T12:33:31.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd989c7640 1 -- start start 2024-04-20T12:33:31.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd989c7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd9406a5c0 0x7fcd941987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd989c7640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9406af80 0x7fcd94198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd989c7640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd94108070 0x7fcd9419d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd989c7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941122e0 con 0x7fcd9406a5c0 2024-04-20T12:33:31.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd989c7640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94112160 con 0x7fcd94108070 2024-04-20T12:33:31.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd989c7640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd94112460 con 0x7fcd9406af80 2024-04-20T12:33:31.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd9259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd9406a5c0 0x7fcd941987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.764 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd9259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd9406a5c0 0x7fcd941987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49094/0 (socket says 172.21.15.135:49094) 2024-04-20T12:33:31.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd9259c640 1 -- 172.21.15.135:0/3717393119 learned_addr learned my addr 172.21.15.135:0/3717393119 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd9259c640 1 -- 172.21.15.135:0/3717393119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9406af80 msgr2=0x7fcd94198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd9259c640 1 --2- 172.21.15.135:0/3717393119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9406af80 0x7fcd94198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd9259c640 1 -- 172.21.15.135:0/3717393119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd94108070 msgr2=0x7fcd9419d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd92d9d640 1 --2- 172.21.15.135:0/3717393119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd94108070 0x7fcd9419d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd9259c640 1 --2- 172.21.15.135:0/3717393119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd94108070 0x7fcd9419d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd9259c640 1 -- 172.21.15.135:0/3717393119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9419d740 con 0x7fcd9406a5c0 2024-04-20T12:33:31.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd9259c640 1 --2- 172.21.15.135:0/3717393119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd9406a5c0 0x7fcd941987a0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009230 tx=0x7fcd8402cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd837fe640 1 -- 172.21.15.135:0/3717393119 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd84041070 con 0x7fcd9406a5c0 2024-04-20T12:33:31.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd837fe640 1 -- 172.21.15.135:0/3717393119 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd84004450 con 0x7fcd9406a5c0 2024-04-20T12:33:31.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd989c7640 1 -- 172.21.15.135:0/3717393119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9419d9d0 con 0x7fcd9406a5c0 2024-04-20T12:33:31.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.751+0000 7fcd837fe640 1 -- 172.21.15.135:0/3717393119 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd84034440 con 0x7fcd9406a5c0 2024-04-20T12:33:31.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.752+0000 7fcd989c7640 1 -- 172.21.15.135:0/3717393119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd941a52c0 con 0x7fcd9406a5c0 2024-04-20T12:33:31.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.754+0000 7fcd837fe640 1 -- 172.21.15.135:0/3717393119 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fcd84044070 con 0x7fcd9406a5c0 2024-04-20T12:33:31.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.754+0000 7fcd9b5bc740 1 Processor -- start 2024-04-20T12:33:31.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.754+0000 7fcd9b5bc740 1 -- start start 2024-04-20T12:33:31.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.754+0000 7fcd9b5bc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eab40 0x5628d43eaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.754+0000 7fcd9b5bc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eb460 0x5628d43f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.754+0000 7fcd9b5bc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43fab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.754+0000 7fcd9b5bc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5628d4350110 con 0x5628d43eb460 2024-04-20T12:33:31.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.754+0000 7fcd9b5bc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5628d42ed550 con 0x5628d43eab40 2024-04-20T12:33:31.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.754+0000 7fcd9b5bc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5628d434c0d0 con 0x5628d43f8720 2024-04-20T12:33:31.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd9259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eb460 0x5628d43f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd837fe640 1 --2- 172.21.15.135:0/3717393119 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd7c0a3d20 0x7fcd7c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd9259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eb460 0x5628d43f81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49096/0 (socket says 172.21.15.135:49096) 2024-04-20T12:33:31.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd9259c640 1 -- 172.21.15.135:0/1179946701 learned_addr learned my addr 172.21.15.135:0/1179946701 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd92d9d640 1 --2- 172.21.15.135:0/1179946701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eab40 0x5628d43eaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.766 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd92d9d640 1 --2- 172.21.15.135:0/3717393119 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd7c0a3d20 0x7fcd7c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd91d9b640 1 --2- 172.21.15.135:0/1179946701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43fab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd837fe640 1 -- 172.21.15.135:0/3717393119 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7fcd840f25c0 con 0x7fcd9406a5c0 2024-04-20T12:33:31.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd9259c640 1 -- 172.21.15.135:0/1179946701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 msgr2=0x5628d43fab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd9259c640 1 --2- 172.21.15.135:0/1179946701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43fab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd9259c640 1 -- 172.21.15.135:0/1179946701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eab40 msgr2=0x5628d43eaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd9259c640 1 --2- 172.21.15.135:0/1179946701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eab40 0x5628d43eaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd9259c640 1 -- 172.21.15.135:0/1179946701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628d4315900 con 0x5628d43eb460 2024-04-20T12:33:31.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd92d9d640 1 --2- 172.21.15.135:0/1179946701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eab40 0x5628d43eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:33:31.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd9259c640 1 --2- 172.21.15.135:0/1179946701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eb460 0x5628d43f81e0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fcd840bac70 tx=0x7fcd84000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35907439e73c0102 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd92d9d640 1 --2- 172.21.15.135:0/3717393119 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd7c0a3d20 0x7fcd7c0a61e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009fd0 tx=0x7fcd8c004a40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd80ff9640 1 -- 172.21.15.135:0/1179946701 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8404b020 con 0x5628d43eb460 2024-04-20T12:33:31.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd80ff9640 1 -- 172.21.15.135:0/1179946701 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd84004c80 con 0x5628d43eb460 2024-04-20T12:33:31.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.755+0000 7fcd80ff9640 1 -- 172.21.15.135:0/1179946701 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd840035f0 con 0x5628d43eb460 2024-04-20T12:33:31.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.756+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/1179946701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eb460 msgr2=0x5628d43f81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.767 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.756+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/1179946701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eb460 0x5628d43f81e0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fcd840bac70 tx=0x7fcd84000bc0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.756+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/1179946701 shutdown_connections 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.756+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/1179946701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43fab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.756+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/1179946701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eb460 0x5628d43f81e0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.756+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/1179946701 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eab40 0x5628d43eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.756+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/1179946701 >> 172.21.15.135:0/1179946701 conn(0x5628d43e5540 msgr2=0x5628d43e5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.756+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/1179946701 shutdown_connections 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.756+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/1179946701 wait complete. 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.756+0000 7fcd9b5bc740 1 -- start start 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9b5bc740 1 Processor -- start 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9b5bc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eab40 0x5628d43f5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9b5bc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eb460 0x5628d43f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9b5bc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9b5bc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5628d43fb2a0 con 0x5628d43eab40 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9b5bc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x5628d4309500 con 0x5628d43eb460 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9b5bc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x5628d43fb420 con 0x5628d43f8720 2024-04-20T12:33:31.768 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9b5bc740 10 client.0 _ll_register_callbacks cb 0x5628d42ee2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:31.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eab40 0x5628d43f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eab40 0x5628d43f5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49106/0 (socket says 172.21.15.135:49106) 2024-04-20T12:33:31.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9259c640 1 -- 172.21.15.135:0/3588146451 learned_addr learned my addr 172.21.15.135:0/3588146451 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd91d9b640 1 --2- 172.21.15.135:0/3588146451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eb460 0x5628d43f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd92d9d640 1 --2- 172.21.15.135:0/3588146451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9259c640 1 -- 172.21.15.135:0/3588146451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 msgr2=0x5628d43f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9259c640 1 --2- 172.21.15.135:0/3588146451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9259c640 1 -- 172.21.15.135:0/3588146451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eb460 msgr2=0x5628d43f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9259c640 1 --2- 172.21.15.135:0/3588146451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eb460 0x5628d43f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9259c640 1 -- 172.21.15.135:0/3588146451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628d40623f0 con 0x5628d43eab40 2024-04-20T12:33:31.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9259c640 1 --2- 172.21.15.135:0/3588146451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eab40 0x5628d43f5740 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fcd840f28f0 tx=0x7fcd84003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7320d0ac924655b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:31.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd79ffb640 1 -- 172.21.15.135:0/3588146451 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8404b040 con 0x5628d43eab40 2024-04-20T12:33:31.769 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd79ffb640 1 -- 172.21.15.135:0/3588146451 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7fcd840f21b0 con 0x5628d43eab40 2024-04-20T12:33:31.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.757+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/3588146451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd84004c80 con 0x5628d43eab40 2024-04-20T12:33:31.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.758+0000 7fcd79ffb640 1 -- 172.21.15.135:0/3588146451 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd840ba540 con 0x5628d43eab40 2024-04-20T12:33:31.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.758+0000 7fcd9b5bc740 10 client.18705 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:31.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.758+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/3588146451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5628d412c7d0 con 0x5628d43eab40 2024-04-20T12:33:31.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.758+0000 7fcd79ffb640 1 -- 172.21.15.135:0/3588146451 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd84004c80 con 0x5628d43eab40 2024-04-20T12:33:31.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.758+0000 7fcd79ffb640 1 -- 172.21.15.135:0/3588146451 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fcd840c2120 con 0x5628d43eab40 2024-04-20T12:33:31.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.758+0000 7fcd9b5bc740 10 client.18705 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:31.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.758+0000 7fcd9b5bc740 10 client.18705 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:33:31.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.758+0000 7fcd9b5bc740 20 client.18705 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:31.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.758+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/3588146451 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5628d4408610 0x5628d440aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.758+0000 7fcd9b5bc740 4 client.18705 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:33:31.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.758+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/3588146451 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628d435db30 con 0x5628d4408610 2024-04-20T12:33:31.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.758+0000 7fcd91d9b640 1 --2- 172.21.15.135:0/3588146451 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5628d4408610 0x5628d440aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.770 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.758+0000 7fcd79ffb640 10 client.18705 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:33:31.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.758+0000 7fcd91d9b640 1 --2- 172.21.15.135:0/3588146451 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5628d4408610 0x5628d440aa00 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c74b47f4a1984717 server_cookie=60ec3c94e74baf7 in_seq=0 out_seq=0 2024-04-20T12:33:31.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.759+0000 7fcd79ffb640 1 -- 172.21.15.135:0/3588146451 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5628d435db30 con 0x5628d4408610 2024-04-20T12:33:31.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.759+0000 7fcd79ffb640 10 client.18705 handle_command_reply: tid=0 2024-04-20T12:33:31.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.759+0000 7fcd9b5bc740 1 client.18705 shutdown 2024-04-20T12:33:31.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.759+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/3588146451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eab40 msgr2=0x5628d43f5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.759+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/3588146451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eab40 0x5628d43f5740 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fcd840f28f0 tx=0x7fcd84003820 comp rx=0 tx=0).stop 2024-04-20T12:33:31.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.759+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/3588146451 shutdown_connections 2024-04-20T12:33:31.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.759+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/3588146451 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5628d4408610 0x5628d440aa00 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.759+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/3588146451 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.759+0000 7fcd79ffb640 0 client.18705 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:33:31.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.759+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/3588146451 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eb460 0x5628d43f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.759+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/3588146451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eab40 0x5628d43f5740 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.759+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/3588146451 >> 172.21.15.135:0/3588146451 conn(0x5628d43e5540 msgr2=0x5628d43e7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.759+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/3588146451 shutdown_connections 2024-04-20T12:33:31.771 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.759+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/3588146451 wait complete. 2024-04-20T12:33:31.772 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.759+0000 7fcd9b5bc740 20 client.18705 trim_cache size 0 max 16384 2024-04-20T12:33:31.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.772+0000 7fcd9b5bc740 1 Processor -- start 2024-04-20T12:33:31.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.772+0000 7fcd9b5bc740 1 -- start start 2024-04-20T12:33:31.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.772+0000 7fcd9b5bc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eab40 0x5628d43f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.772+0000 7fcd9b5bc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eb460 0x5628d44040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.772+0000 7fcd9b5bc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43e4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.772+0000 7fcd9b5bc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941ad2a0 con 0x5628d43eb460 2024-04-20T12:33:31.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.772+0000 7fcd9b5bc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941aede0 con 0x5628d43eab40 2024-04-20T12:33:31.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.772+0000 7fcd9b5bc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941ad970 con 0x5628d43f8720 2024-04-20T12:33:31.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.773+0000 7fcd91d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eb460 0x5628d44040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.773+0000 7fcd91d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eb460 0x5628d44040d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49118/0 (socket says 172.21.15.135:49118) 2024-04-20T12:33:31.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.773+0000 7fcd91d9b640 1 -- 172.21.15.135:0/2412818442 learned_addr learned my addr 172.21.15.135:0/2412818442 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.773+0000 7fcd92d9d640 1 --2- 172.21.15.135:0/2412818442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43e4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.778 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.773+0000 7fcd9259c640 1 --2- 172.21.15.135:0/2412818442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eab40 0x5628d43f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.773+0000 7fcd91d9b640 1 -- 172.21.15.135:0/2412818442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 msgr2=0x5628d43e4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.773+0000 7fcd91d9b640 1 --2- 172.21.15.135:0/2412818442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43e4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.773+0000 7fcd91d9b640 1 -- 172.21.15.135:0/2412818442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eab40 msgr2=0x5628d43f7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.773+0000 7fcd91d9b640 1 --2- 172.21.15.135:0/2412818442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eab40 0x5628d43f7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.773+0000 7fcd91d9b640 1 -- 172.21.15.135:0/2412818442 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628d43fab10 con 0x5628d43eb460 2024-04-20T12:33:31.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.773+0000 7fcd91d9b640 1 --2- 172.21.15.135:0/2412818442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eb460 0x5628d44040d0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x5628d43f4fa0 tx=0x7fcd88010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af61e817cc142007 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.773+0000 7fcd7bfff640 1 -- 172.21.15.135:0/2412818442 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88004050 con 0x5628d43eb460 2024-04-20T12:33:31.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.773+0000 7fcd7bfff640 1 -- 172.21.15.135:0/2412818442 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd88022070 con 0x5628d43eb460 2024-04-20T12:33:31.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.773+0000 7fcd7bfff640 1 -- 172.21.15.135:0/2412818442 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd88003bf0 con 0x5628d43eb460 2024-04-20T12:33:31.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/2412818442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eb460 msgr2=0x5628d44040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/2412818442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eb460 0x5628d44040d0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x5628d43f4fa0 tx=0x7fcd88010800 comp rx=0 tx=0).stop 2024-04-20T12:33:31.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/2412818442 shutdown_connections 2024-04-20T12:33:31.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/2412818442 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43e4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.779 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/2412818442 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eb460 0x5628d44040d0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/2412818442 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eab40 0x5628d43f7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/2412818442 >> 172.21.15.135:0/2412818442 conn(0x5628d43e5540 msgr2=0x5628d43e3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/2412818442 shutdown_connections 2024-04-20T12:33:31.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/2412818442 wait complete. 2024-04-20T12:33:31.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 -- start start 2024-04-20T12:33:31.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 Processor -- start 2024-04-20T12:33:31.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eab40 0x5628d44007f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eb460 0x5628d43fbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43fc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941ae710 con 0x5628d43eab40 2024-04-20T12:33:31.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941ae040 con 0x5628d43eb460 2024-04-20T12:33:31.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcd941ab270 con 0x5628d43f8720 2024-04-20T12:33:31.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9b5bc740 10 client.0 _ll_register_callbacks cb 0x7fcd8c009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:31.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eab40 0x5628d44007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.780 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9259c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eab40 0x5628d44007f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49120/0 (socket says 172.21.15.135:49120) 2024-04-20T12:33:31.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.774+0000 7fcd9259c640 1 -- 172.21.15.135:0/2423817960 learned_addr learned my addr 172.21.15.135:0/2423817960 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd92d9d640 1 --2- 172.21.15.135:0/2423817960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43fc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd91d9b640 1 --2- 172.21.15.135:0/2423817960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eb460 0x5628d43fbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd9259c640 1 -- 172.21.15.135:0/2423817960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 msgr2=0x5628d43fc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd9259c640 1 --2- 172.21.15.135:0/2423817960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43fc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd9259c640 1 -- 172.21.15.135:0/2423817960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eb460 msgr2=0x5628d43fbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd9259c640 1 --2- 172.21.15.135:0/2423817960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eb460 0x5628d43fbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd9259c640 1 -- 172.21.15.135:0/2423817960 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628d43fc6e0 con 0x5628d43eab40 2024-04-20T12:33:31.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd92d9d640 1 --2- 172.21.15.135:0/2423817960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43fc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:33:31.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd91d9b640 1 --2- 172.21.15.135:0/2423817960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eb460 0x5628d43fbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:33:31.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd9259c640 1 --2- 172.21.15.135:0/2423817960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eab40 0x5628d44007f0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fcd840bac20 tx=0x7fcd8402bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63885cad8d0f9e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:31.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd79ffb640 1 -- 172.21.15.135:0/2423817960 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8404b040 con 0x5628d43eab40 2024-04-20T12:33:31.781 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd79ffb640 1 -- 172.21.15.135:0/2423817960 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7fcd840bd6f0 con 0x5628d43eab40 2024-04-20T12:33:31.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/2423817960 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd88022070 con 0x5628d43eab40 2024-04-20T12:33:31.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd79ffb640 1 -- 172.21.15.135:0/2423817960 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fcd840efdd0 con 0x5628d43eab40 2024-04-20T12:33:31.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd9b5bc740 10 client.18711 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:31.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/2423817960 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5628d43fc6e0 con 0x5628d43eab40 2024-04-20T12:33:31.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd79ffb640 1 -- 172.21.15.135:0/2423817960 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd88022070 con 0x5628d43eab40 2024-04-20T12:33:31.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd79ffb640 1 -- 172.21.15.135:0/2423817960 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fcd840bd160 con 0x5628d43eab40 2024-04-20T12:33:31.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd9b5bc740 10 client.18711 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:31.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd9b5bc740 10 client.18711 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.a 2024-04-20T12:33:31.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.775+0000 7fcd9b5bc740 20 client.18711 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:31.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/2423817960 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5628d446ecb0 0x5628d44710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd9b5bc740 4 client.18711 mds_command: new command op to 14634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:33:31.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/2423817960 --> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628d43579a0 con 0x5628d446ecb0 2024-04-20T12:33:31.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd91d9b640 1 --2- 172.21.15.135:0/2423817960 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5628d446ecb0 0x5628d44710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.782 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd91d9b640 1 --2- 172.21.15.135:0/2423817960 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5628d446ecb0 0x5628d44710d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e279a899b8750350 server_cookie=57ad9bebaefa36c1 in_seq=0 out_seq=0 2024-04-20T12:33:31.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd79ffb640 10 client.18711 ms_handle_connect on v2:172.21.15.135:6840/212699479 2024-04-20T12:33:31.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd79ffb640 1 -- 172.21.15.135:0/2423817960 <== mds.4 v2:172.21.15.135:6840/212699479 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628d43579a0 con 0x5628d446ecb0 2024-04-20T12:33:31.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd79ffb640 10 client.18711 handle_command_reply: tid=0 2024-04-20T12:33:31.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd9b5bc740 1 client.18711 shutdown 2024-04-20T12:33:31.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/2423817960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eab40 msgr2=0x5628d44007f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/2423817960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eab40 0x5628d44007f0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fcd840bac20 tx=0x7fcd8402bc30 comp rx=0 tx=0).stop 2024-04-20T12:33:31.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/2423817960 shutdown_connections 2024-04-20T12:33:31.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/2423817960 >> [v2:172.21.15.135:6840/212699479,v1:172.21.15.135:6841/212699479] conn(0x5628d446ecb0 0x5628d44710d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/2423817960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x5628d43f8720 0x5628d43fc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/2423817960 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x5628d43eb460 0x5628d43fbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd9b5bc740 1 --2- 172.21.15.135:0/2423817960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628d43eab40 0x5628d44007f0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd79ffb640 0 client.18711 ms_handle_reset on v2:172.21.15.135:6840/212699479 2024-04-20T12:33:31.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/2423817960 >> 172.21.15.135:0/2423817960 conn(0x5628d43e5540 msgr2=0x5628d43e46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/2423817960 shutdown_connections 2024-04-20T12:33:31.783 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd9b5bc740 1 -- 172.21.15.135:0/2423817960 wait complete. 2024-04-20T12:33:31.784 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.776+0000 7fcd9b5bc740 20 client.18711 trim_cache size 0 max 16384 2024-04-20T12:33:31.784 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:33:31.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.777+0000 7fcd989c7640 1 -- 172.21.15.135:0/3717393119 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd7c0a3d20 msgr2=0x7fcd7c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.777+0000 7fcd989c7640 1 --2- 172.21.15.135:0/3717393119 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd7c0a3d20 0x7fcd7c0a61e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009fd0 tx=0x7fcd8c004a40 comp rx=0 tx=0).stop 2024-04-20T12:33:31.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.777+0000 7fcd989c7640 1 -- 172.21.15.135:0/3717393119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd9406a5c0 msgr2=0x7fcd941987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.777+0000 7fcd989c7640 1 --2- 172.21.15.135:0/3717393119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd9406a5c0 0x7fcd941987a0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fcd84009230 tx=0x7fcd8402cba0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.777+0000 7fcd989c7640 1 -- 172.21.15.135:0/3717393119 shutdown_connections 2024-04-20T12:33:31.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.777+0000 7fcd989c7640 1 --2- 172.21.15.135:0/3717393119 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcd94108070 0x7fcd9419d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.777+0000 7fcd989c7640 1 --2- 172.21.15.135:0/3717393119 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcd7c0a3d20 0x7fcd7c0a61e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.777+0000 7fcd989c7640 1 --2- 172.21.15.135:0/3717393119 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcd9406af80 0x7fcd94198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.777+0000 7fcd989c7640 1 --2- 172.21.15.135:0/3717393119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd9406a5c0 0x7fcd941987a0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.777+0000 7fcd989c7640 1 -- 172.21.15.135:0/3717393119 >> 172.21.15.135:0/3717393119 conn(0x7fcd94077c50 msgr2=0x7fcd940ffd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.777+0000 7fcd989c7640 1 -- 172.21.15.135:0/3717393119 shutdown_connections 2024-04-20T12:33:31.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.777+0000 7fcd989c7640 1 -- 172.21.15.135:0/3717393119 wait complete. 2024-04-20T12:33:31.787 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-04-20T12:33:31.889 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.887+0000 7fa0b5243640 1 -- 172.21.15.135:0/1573077280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0106fa0 msgr2=0x7fa0b0107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.887+0000 7fa0b5243640 1 --2- 172.21.15.135:0/1573077280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0106fa0 0x7fa0b0107380 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009900 tx=0x7fa0a002bc30 comp rx=0 tx=0).stop 2024-04-20T12:33:31.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.887+0000 7fa0b5243640 1 -- 172.21.15.135:0/1573077280 shutdown_connections 2024-04-20T12:33:31.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.887+0000 7fa0b5243640 1 --2- 172.21.15.135:0/1573077280 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0b0101b50 0x7fa0b010dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.887+0000 7fa0b5243640 1 --2- 172.21.15.135:0/1573077280 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0b01011b0 0x7fa0b0101610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.887+0000 7fa0b5243640 1 --2- 172.21.15.135:0/1573077280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0106fa0 0x7fa0b0107380 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.887+0000 7fa0b5243640 1 -- 172.21.15.135:0/1573077280 >> 172.21.15.135:0/1573077280 conn(0x7fa0b0076c60 msgr2=0x7fa0b0077070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.887+0000 7fa0b5243640 1 -- 172.21.15.135:0/1573077280 shutdown_connections 2024-04-20T12:33:31.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.887+0000 7fa0b5243640 1 -- 172.21.15.135:0/1573077280 wait complete. 2024-04-20T12:33:31.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.888+0000 7fa0b5243640 1 Processor -- start 2024-04-20T12:33:31.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.888+0000 7fa0b5243640 1 -- start start 2024-04-20T12:33:31.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.888+0000 7fa0b5243640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0b01011b0 0x7fa0b0197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.888+0000 7fa0b5243640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0101b50 0x7fa0b0197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.890 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.888+0000 7fa0b5243640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0b0106fa0 0x7fa0b019bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.888+0000 7fa0b5243640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b0111250 con 0x7fa0b0101b50 2024-04-20T12:33:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.888+0000 7fa0b5243640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b01110d0 con 0x7fa0b01011b0 2024-04-20T12:33:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.888+0000 7fa0b5243640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b01113d0 con 0x7fa0b0106fa0 2024-04-20T12:33:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.888+0000 7fa0a7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0101b50 0x7fa0b0197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.888+0000 7fa0a7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0101b50 0x7fa0b0197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49148/0 (socket says 172.21.15.135:49148) 2024-04-20T12:33:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.888+0000 7fa0a7fff640 1 -- 172.21.15.135:0/2368991623 learned_addr learned my addr 172.21.15.135:0/2368991623 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.889+0000 7fa0aed9d640 1 --2- 172.21.15.135:0/2368991623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0b01011b0 0x7fa0b0197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.889+0000 7fa0a7fff640 1 -- 172.21.15.135:0/2368991623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0b0106fa0 msgr2=0x7fa0b019bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.889+0000 7fa0a7fff640 1 --2- 172.21.15.135:0/2368991623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0b0106fa0 0x7fa0b019bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.889+0000 7fa0a7fff640 1 -- 172.21.15.135:0/2368991623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0b01011b0 msgr2=0x7fa0b0197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.889+0000 7fa0a7fff640 1 --2- 172.21.15.135:0/2368991623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0b01011b0 0x7fa0b0197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.889+0000 7fa0a7fff640 1 -- 172.21.15.135:0/2368991623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b019c720 con 0x7fa0b0101b50 2024-04-20T12:33:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.889+0000 7fa0aed9d640 1 --2- 172.21.15.135:0/2368991623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0b01011b0 0x7fa0b0197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:33:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.889+0000 7fa0a7fff640 1 --2- 172.21.15.135:0/2368991623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0101b50 0x7fa0b0197c70 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fa09800d950 tx=0x7fa09800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.891 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.889+0000 7fa0acd99640 1 -- 172.21.15.135:0/2368991623 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa098017070 con 0x7fa0b0101b50 2024-04-20T12:33:31.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.889+0000 7fa0b5243640 1 -- 172.21.15.135:0/2368991623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b019ca10 con 0x7fa0b0101b50 2024-04-20T12:33:31.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.889+0000 7fa0acd99640 1 -- 172.21.15.135:0/2368991623 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa098009c30 con 0x7fa0b0101b50 2024-04-20T12:33:31.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.889+0000 7fa0acd99640 1 -- 172.21.15.135:0/2368991623 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09800f6b0 con 0x7fa0b0101b50 2024-04-20T12:33:31.892 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.889+0000 7fa0b5243640 1 -- 172.21.15.135:0/2368991623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b01a42a0 con 0x7fa0b0101b50 2024-04-20T12:33:31.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.891+0000 7fa0acd99640 1 -- 172.21.15.135:0/2368991623 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fa0980109d0 con 0x7fa0b0101b50 2024-04-20T12:33:31.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.892+0000 7fa0b7e36740 1 Processor -- start 2024-04-20T12:33:31.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.892+0000 7fa0b7e36740 1 -- start start 2024-04-20T12:33:31.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.892+0000 7fa0b7e36740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1c3e10 0x55fb1f1c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.895 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.892+0000 7fa0b7e36740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c4730 0x55fb1f1ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.892+0000 7fa0b7e36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.892+0000 7fa0b7e36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fb1f129110 con 0x55fb1f1cd310 2024-04-20T12:33:31.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.892+0000 7fa0b7e36740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fb1f0c6550 con 0x55fb1f1c4730 2024-04-20T12:33:31.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.892+0000 7fa0b7e36740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fb1f1250d0 con 0x55fb1f1c3e10 2024-04-20T12:33:31.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.892+0000 7fa0a7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.892+0000 7fa0acd99640 1 --2- 172.21.15.135:0/2368991623 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa09c0a3d20 0x7fa09c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.892+0000 7fa0a7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1cf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49154/0 (socket says 172.21.15.135:49154) 2024-04-20T12:33:31.896 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.892+0000 7fa0a7fff640 1 -- 172.21.15.135:0/2387341645 learned_addr learned my addr 172.21.15.135:0/2387341645 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.892+0000 7fa0af59e640 1 --2- 172.21.15.135:0/2387341645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1c3e10 0x55fb1f1c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.892+0000 7fa0aed9d640 1 --2- 172.21.15.135:0/2387341645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c4730 0x55fb1f1ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.893+0000 7fa0af59e640 1 --2- 172.21.15.135:0/2368991623 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa09c0a3d20 0x7fa09c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.893+0000 7fa0acd99640 1 -- 172.21.15.135:0/2368991623 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7fa0980d08d0 con 0x7fa0b0101b50 2024-04-20T12:33:31.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.893+0000 7fa0a7fff640 1 -- 172.21.15.135:0/2387341645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1c3e10 msgr2=0x55fb1f1c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.893+0000 7fa0a7fff640 1 --2- 172.21.15.135:0/2387341645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1c3e10 0x55fb1f1c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.893+0000 7fa0a7fff640 1 -- 172.21.15.135:0/2387341645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c4730 msgr2=0x55fb1f1ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.893+0000 7fa0a7fff640 1 --2- 172.21.15.135:0/2387341645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c4730 0x55fb1f1ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.893+0000 7fa0a7fff640 1 -- 172.21.15.135:0/2387341645 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb1f0ee900 con 0x55fb1f1cd310 2024-04-20T12:33:31.897 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.893+0000 7fa0a7fff640 1 --2- 172.21.15.135:0/2387341645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1cf700 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fa0980cdb80 tx=0x7fa098010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbaafae1fdf8147 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.893+0000 7fa0af59e640 1 --2- 172.21.15.135:0/2368991623 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa09c0a3d20 0x7fa09c0a61e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009fd0 tx=0x7fa0a80093c0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.893+0000 7fa0a57fa640 1 -- 172.21.15.135:0/2387341645 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa098020070 con 0x55fb1f1cd310 2024-04-20T12:33:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.893+0000 7fa0a57fa640 1 -- 172.21.15.135:0/2387341645 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0980a0810 con 0x55fb1f1cd310 2024-04-20T12:33:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.893+0000 7fa0a57fa640 1 -- 172.21.15.135:0/2387341645 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09809b8b0 con 0x55fb1f1cd310 2024-04-20T12:33:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 -- 172.21.15.135:0/2387341645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 msgr2=0x55fb1f1cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/2387341645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1cf700 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fa0980cdb80 tx=0x7fa098010d70 comp rx=0 tx=0).stop 2024-04-20T12:33:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 -- 172.21.15.135:0/2387341645 shutdown_connections 2024-04-20T12:33:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/2387341645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1cf700 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/2387341645 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c4730 0x55fb1f1ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/2387341645 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1c3e10 0x55fb1f1c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 -- 172.21.15.135:0/2387341645 >> 172.21.15.135:0/2387341645 conn(0x55fb1f1be540 msgr2=0x55fb1f1be920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 -- 172.21.15.135:0/2387341645 shutdown_connections 2024-04-20T12:33:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 -- 172.21.15.135:0/2387341645 wait complete. 2024-04-20T12:33:31.898 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 -- start start 2024-04-20T12:33:31.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 Processor -- start 2024-04-20T12:33:31.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c3e10 0x55fb1f1d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.899 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1c4730 0x55fb1f1d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1cd310 0x55fb1f1db3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55fb1f1cffe0 con 0x55fb1f1c4730 2024-04-20T12:33:31.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55fb1f0e2500 con 0x55fb1f1c3e10 2024-04-20T12:33:31.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.894+0000 7fa0b7e36740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55fb1f1d0160 con 0x55fb1f1cd310 2024-04-20T12:33:31.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0b7e36740 10 client.0 _ll_register_callbacks cb 0x55fb1f0c72f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:31.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0a7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1c4730 0x55fb1f1d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.903 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0a7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1c4730 0x55fb1f1d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49160/0 (socket says 172.21.15.135:49160) 2024-04-20T12:33:31.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0a7fff640 1 -- 172.21.15.135:0/700538604 learned_addr learned my addr 172.21.15.135:0/700538604 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0aed9d640 1 --2- 172.21.15.135:0/700538604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c3e10 0x55fb1f1d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0af59e640 1 --2- 172.21.15.135:0/700538604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1cd310 0x55fb1f1db3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0a7fff640 1 -- 172.21.15.135:0/700538604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1cd310 msgr2=0x55fb1f1db3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.904 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0a7fff640 1 --2- 172.21.15.135:0/700538604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1cd310 0x55fb1f1db3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0a7fff640 1 -- 172.21.15.135:0/700538604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c3e10 msgr2=0x55fb1f1d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0a7fff640 1 --2- 172.21.15.135:0/700538604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c3e10 0x55fb1f1d0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0a7fff640 1 -- 172.21.15.135:0/700538604 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb1ee3b3f0 con 0x55fb1f1c4730 2024-04-20T12:33:31.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0aed9d640 1 --2- 172.21.15.135:0/700538604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c3e10 0x55fb1f1d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:33:31.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0a7fff640 1 --2- 172.21.15.135:0/700538604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1c4730 0x55fb1f1d0aa0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa098010fd0 tx=0x7fa0980a5140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2c1fd6590ca81d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0967fc640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:31.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0967fc640 1 -- 172.21.15.135:0/700538604 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa098020030 con 0x55fb1f1c4730 2024-04-20T12:33:31.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0b7e36740 1 -- 172.21.15.135:0/700538604 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0980a0810 con 0x55fb1f1c4730 2024-04-20T12:33:31.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0967fc640 1 -- 172.21.15.135:0/700538604 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7fa0980b5be0 con 0x55fb1f1c4730 2024-04-20T12:33:31.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0967fc640 1 -- 172.21.15.135:0/700538604 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa0980ce090 con 0x55fb1f1c4730 2024-04-20T12:33:31.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0b7e36740 10 client.18723 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:31.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0b7e36740 1 -- 172.21.15.135:0/700538604 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fb1ef057d0 con 0x55fb1f1c4730 2024-04-20T12:33:31.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.895+0000 7fa0967fc640 1 -- 172.21.15.135:0/700538604 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0980a0810 con 0x55fb1f1c4730 2024-04-20T12:33:31.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.896+0000 7fa0967fc640 1 -- 172.21.15.135:0/700538604 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fa098010460 con 0x55fb1f1c4730 2024-04-20T12:33:31.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.896+0000 7fa0b7e36740 10 client.18723 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:31.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.896+0000 7fa0b7e36740 10 client.18723 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:33:31.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.896+0000 7fa0b7e36740 20 client.18723 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:31.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.896+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/700538604 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55fb1f1df790 0x55fb1f1e1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.896+0000 7fa0b7e36740 4 client.18723 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:33:31.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.896+0000 7fa0b7e36740 1 -- 172.21.15.135:0/700538604 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb1f136b30 con 0x55fb1f1df790 2024-04-20T12:33:31.906 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.896+0000 7fa0aed9d640 1 --2- 172.21.15.135:0/700538604 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55fb1f1df790 0x55fb1f1e1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.896+0000 7fa0967fc640 10 client.18723 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:33:31.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.896+0000 7fa0aed9d640 1 --2- 172.21.15.135:0/700538604 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55fb1f1df790 0x55fb1f1e1b80 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=18b6b109a167a5e5 server_cookie=4b7bb792a0b45bdf in_seq=0 out_seq=0 2024-04-20T12:33:31.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.897+0000 7fa0967fc640 1 -- 172.21.15.135:0/700538604 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fb1f136b30 con 0x55fb1f1df790 2024-04-20T12:33:31.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.897+0000 7fa0967fc640 10 client.18723 handle_command_reply: tid=0 2024-04-20T12:33:31.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.897+0000 7fa0b7e36740 1 client.18723 shutdown 2024-04-20T12:33:31.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.897+0000 7fa0b7e36740 1 -- 172.21.15.135:0/700538604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1c4730 msgr2=0x55fb1f1d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.897+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/700538604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1c4730 0x55fb1f1d0aa0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa098010fd0 tx=0x7fa0980a5140 comp rx=0 tx=0).stop 2024-04-20T12:33:31.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.897+0000 7fa0b7e36740 1 -- 172.21.15.135:0/700538604 shutdown_connections 2024-04-20T12:33:31.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.897+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/700538604 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55fb1f1df790 0x55fb1f1e1b80 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.897+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/700538604 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1cd310 0x55fb1f1db3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.897+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/700538604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1c4730 0x55fb1f1d0aa0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.897+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/700538604 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c3e10 0x55fb1f1d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.897+0000 7fa0967fc640 0 client.18723 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:33:31.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.897+0000 7fa0b7e36740 1 -- 172.21.15.135:0/700538604 >> 172.21.15.135:0/700538604 conn(0x55fb1f1be540 msgr2=0x55fb1f1c0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.897+0000 7fa0b7e36740 1 -- 172.21.15.135:0/700538604 shutdown_connections 2024-04-20T12:33:31.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.897+0000 7fa0b7e36740 1 -- 172.21.15.135:0/700538604 wait complete. 2024-04-20T12:33:31.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.897+0000 7fa0b7e36740 20 client.18723 trim_cache size 0 max 16384 2024-04-20T12:33:31.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.910+0000 7fa0b7e36740 1 Processor -- start 2024-04-20T12:33:31.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.910+0000 7fa0b7e36740 1 -- start start 2024-04-20T12:33:31.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0b7e36740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c3e10 0x55fb1f1c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0b7e36740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1c4730 0x55fb1f1e4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0b7e36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1e50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0b7e36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b01ad350 con 0x55fb1f1cd310 2024-04-20T12:33:31.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0b7e36740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b01aee90 con 0x55fb1f1c3e10 2024-04-20T12:33:31.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0b7e36740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b01ada20 con 0x55fb1f1c4730 2024-04-20T12:33:31.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0af59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1e50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.911 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0af59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1e50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49176/0 (socket says 172.21.15.135:49176) 2024-04-20T12:33:31.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0af59e640 1 -- 172.21.15.135:0/1637691667 learned_addr learned my addr 172.21.15.135:0/1637691667 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0af59e640 1 -- 172.21.15.135:0/1637691667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1c4730 msgr2=0x55fb1f1e4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0af59e640 1 --2- 172.21.15.135:0/1637691667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1c4730 0x55fb1f1e4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0af59e640 1 -- 172.21.15.135:0/1637691667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c3e10 msgr2=0x55fb1f1c00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0af59e640 1 --2- 172.21.15.135:0/1637691667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c3e10 0x55fb1f1c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0af59e640 1 -- 172.21.15.135:0/1637691667 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb1f1d0060 con 0x55fb1f1cd310 2024-04-20T12:33:31.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0af59e640 1 --2- 172.21.15.135:0/1637691667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1e50f0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800fa90 tx=0x7fa0a8014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650f04e6e5db0e08 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0a4ff9640 1 -- 172.21.15.135:0/1637691667 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a801ebd0 con 0x55fb1f1cd310 2024-04-20T12:33:31.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0a4ff9640 1 -- 172.21.15.135:0/1637691667 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0a800fe90 con 0x55fb1f1cd310 2024-04-20T12:33:31.912 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.911+0000 7fa0a4ff9640 1 -- 172.21.15.135:0/1637691667 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80283f0 con 0x55fb1f1cd310 2024-04-20T12:33:31.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.912+0000 7fa0b7e36740 1 -- 172.21.15.135:0/1637691667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 msgr2=0x55fb1f1e50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.912+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/1637691667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1e50f0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800fa90 tx=0x7fa0a8014040 comp rx=0 tx=0).stop 2024-04-20T12:33:31.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.912+0000 7fa0b7e36740 1 -- 172.21.15.135:0/1637691667 shutdown_connections 2024-04-20T12:33:31.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.912+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/1637691667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1e50f0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.912+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/1637691667 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1c4730 0x55fb1f1e4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.912+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/1637691667 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c3e10 0x55fb1f1c00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.912+0000 7fa0b7e36740 1 -- 172.21.15.135:0/1637691667 >> 172.21.15.135:0/1637691667 conn(0x55fb1f1be540 msgr2=0x55fb1f1bf990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.912+0000 7fa0b7e36740 1 -- 172.21.15.135:0/1637691667 shutdown_connections 2024-04-20T12:33:31.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.912+0000 7fa0b7e36740 1 -- 172.21.15.135:0/1637691667 wait complete. 2024-04-20T12:33:31.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.912+0000 7fa0b7e36740 1 -- start start 2024-04-20T12:33:31.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.912+0000 7fa0b7e36740 1 Processor -- start 2024-04-20T12:33:31.917 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0b7e36740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c3e10 0x55fb1f23e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0b7e36740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1c4730 0x55fb1f23e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0b7e36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1e4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0b7e36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b01ae7c0 con 0x55fb1f1cd310 2024-04-20T12:33:31.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0b7e36740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b01ae0f0 con 0x55fb1f1c3e10 2024-04-20T12:33:31.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0b7e36740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b01ab320 con 0x55fb1f1c4730 2024-04-20T12:33:31.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0b7e36740 10 client.0 _ll_register_callbacks cb 0x7fa0a0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:31.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0af59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1e4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0af59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1e4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49184/0 (socket says 172.21.15.135:49184) 2024-04-20T12:33:31.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0af59e640 1 -- 172.21.15.135:0/503683895 learned_addr learned my addr 172.21.15.135:0/503683895 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:31.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0aed9d640 1 --2- 172.21.15.135:0/503683895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c3e10 0x55fb1f23e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0af59e640 1 -- 172.21.15.135:0/503683895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1c4730 msgr2=0x55fb1f23e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0af59e640 1 --2- 172.21.15.135:0/503683895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1c4730 0x55fb1f23e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0af59e640 1 -- 172.21.15.135:0/503683895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c3e10 msgr2=0x55fb1f23e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:31.918 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0af59e640 1 --2- 172.21.15.135:0/503683895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c3e10 0x55fb1f23e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0af59e640 1 -- 172.21.15.135:0/503683895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb1f1e4c30 con 0x55fb1f1cd310 2024-04-20T12:33:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0af59e640 1 --2- 172.21.15.135:0/503683895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1e4540 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8014010 tx=0x7fa0a8009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d80f287a3632a3c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0967fc640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0967fc640 1 -- 172.21.15.135:0/503683895 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8037070 con 0x55fb1f1cd310 2024-04-20T12:33:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0967fc640 1 -- 172.21.15.135:0/503683895 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7fa0a8004d20 con 0x55fb1f1cd310 2024-04-20T12:33:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0b7e36740 1 -- 172.21.15.135:0/503683895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0a800fe90 con 0x55fb1f1cd310 2024-04-20T12:33:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0967fc640 1 -- 172.21.15.135:0/503683895 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa0a8009b60 con 0x55fb1f1cd310 2024-04-20T12:33:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0b7e36740 10 client.18729 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.913+0000 7fa0b7e36740 1 -- 172.21.15.135:0/503683895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fb1f245c00 con 0x55fb1f1cd310 2024-04-20T12:33:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.914+0000 7fa0967fc640 1 -- 172.21.15.135:0/503683895 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0a800fe90 con 0x55fb1f1cd310 2024-04-20T12:33:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.914+0000 7fa0967fc640 1 -- 172.21.15.135:0/503683895 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7fa0a801b040 con 0x55fb1f1cd310 2024-04-20T12:33:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.914+0000 7fa0b7e36740 10 client.18729 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.914+0000 7fa0b7e36740 10 client.18729 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-04-20T12:33:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.914+0000 7fa0b7e36740 20 client.18729 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:31.919 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.914+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/503683895 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55fb1f246260 0x55fb1f248680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.914+0000 7fa0b7e36740 4 client.18729 mds_command: new command op to 24457 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:33:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.914+0000 7fa0b7e36740 1 -- 172.21.15.135:0/503683895 --> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fb1f1309a0 con 0x55fb1f246260 2024-04-20T12:33:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.914+0000 7fa0aed9d640 1 --2- 172.21.15.135:0/503683895 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55fb1f246260 0x55fb1f248680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.914+0000 7fa0aed9d640 1 --2- 172.21.15.135:0/503683895 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55fb1f246260 0x55fb1f248680 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b3258ab6fed882d9 server_cookie=bf66fd59076cd9e5 in_seq=0 out_seq=0 2024-04-20T12:33:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.914+0000 7fa0967fc640 10 client.18729 ms_handle_connect on v2:172.21.15.154:6834/1522201664 2024-04-20T12:33:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.914+0000 7fa0967fc640 1 -- 172.21.15.135:0/503683895 <== mds.3 v2:172.21.15.154:6834/1522201664 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fb1f1309a0 con 0x55fb1f246260 2024-04-20T12:33:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.914+0000 7fa0967fc640 10 client.18729 handle_command_reply: tid=0 2024-04-20T12:33:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b7e36740 1 client.18729 shutdown 2024-04-20T12:33:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b7e36740 1 -- 172.21.15.135:0/503683895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 msgr2=0x55fb1f1e4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/503683895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1e4540 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8014010 tx=0x7fa0a8009930 comp rx=0 tx=0).stop 2024-04-20T12:33:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b7e36740 1 -- 172.21.15.135:0/503683895 shutdown_connections 2024-04-20T12:33:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/503683895 >> [v2:172.21.15.154:6834/1522201664,v1:172.21.15.154:6835/1522201664] conn(0x55fb1f246260 0x55fb1f248680 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/503683895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55fb1f1cd310 0x55fb1f1e4540 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.920 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/503683895 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55fb1f1c4730 0x55fb1f23e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b7e36740 1 --2- 172.21.15.135:0/503683895 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55fb1f1c3e10 0x55fb1f23e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0967fc640 0 client.18729 ms_handle_reset on v2:172.21.15.154:6834/1522201664 2024-04-20T12:33:31.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b7e36740 1 -- 172.21.15.135:0/503683895 >> 172.21.15.135:0/503683895 conn(0x55fb1f1be540 msgr2=0x55fb1f1bd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b7e36740 1 -- 172.21.15.135:0/503683895 shutdown_connections 2024-04-20T12:33:31.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b7e36740 1 -- 172.21.15.135:0/503683895 wait complete. 2024-04-20T12:33:31.921 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b7e36740 20 client.18729 trim_cache size 0 max 16384 2024-04-20T12:33:31.921 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:33:31.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b5243640 1 -- 172.21.15.135:0/2368991623 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa09c0a3d20 msgr2=0x7fa09c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b5243640 1 --2- 172.21.15.135:0/2368991623 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa09c0a3d20 0x7fa09c0a61e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009fd0 tx=0x7fa0a80093c0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b5243640 1 -- 172.21.15.135:0/2368991623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0101b50 msgr2=0x7fa0b0197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:31.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b5243640 1 --2- 172.21.15.135:0/2368991623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0101b50 0x7fa0b0197c70 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fa09800d950 tx=0x7fa09800de10 comp rx=0 tx=0).stop 2024-04-20T12:33:31.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b5243640 1 -- 172.21.15.135:0/2368991623 shutdown_connections 2024-04-20T12:33:31.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b5243640 1 --2- 172.21.15.135:0/2368991623 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa09c0a3d20 0x7fa09c0a61e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b5243640 1 --2- 172.21.15.135:0/2368991623 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa0b0106fa0 0x7fa0b019bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b5243640 1 --2- 172.21.15.135:0/2368991623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0101b50 0x7fa0b0197c70 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.922 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b5243640 1 --2- 172.21.15.135:0/2368991623 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa0b01011b0 0x7fa0b0197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:31.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b5243640 1 -- 172.21.15.135:0/2368991623 >> 172.21.15.135:0/2368991623 conn(0x7fa0b0076c60 msgr2=0x7fa0b00fffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:31.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b5243640 1 -- 172.21.15.135:0/2368991623 shutdown_connections 2024-04-20T12:33:31.923 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:31.915+0000 7fa0b5243640 1 -- 172.21.15.135:0/2368991623 wait complete. 2024-04-20T12:33:31.926 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-04-20T12:33:32.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.026+0000 7f056105c640 1 -- 172.21.15.135:0/1535088240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c106160 msgr2=0x7f055c10dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.026+0000 7f056105c640 1 --2- 172.21.15.135:0/1535088240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c106160 0x7f055c10dd30 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f0554009ca0 tx=0x7f055402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.026+0000 7f056105c640 1 -- 172.21.15.135:0/1535088240 shutdown_connections 2024-04-20T12:33:32.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.026+0000 7f056105c640 1 --2- 172.21.15.135:0/1535088240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c106160 0x7f055c10dd30 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.026+0000 7f056105c640 1 --2- 172.21.15.135:0/1535088240 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f055c101a40 0x7f055c105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.026+0000 7f056105c640 1 --2- 172.21.15.135:0/1535088240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c101090 0x7f055c101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.026+0000 7f056105c640 1 -- 172.21.15.135:0/1535088240 >> 172.21.15.135:0/1535088240 conn(0x7f055c078010 msgr2=0x7f055c078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.026+0000 7f056105c640 1 -- 172.21.15.135:0/1535088240 shutdown_connections 2024-04-20T12:33:32.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.026+0000 7f056105c640 1 -- 172.21.15.135:0/1535088240 wait complete. 2024-04-20T12:33:32.026 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.026+0000 7f056105c640 1 Processor -- start 2024-04-20T12:33:32.028 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f056105c640 1 -- start start 2024-04-20T12:33:32.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f056105c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f055c101090 0x7f055c19e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f056105c640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c106160 0x7f055c19e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f056105c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c1985b0 0x7f055c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f056105c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f055c112330 con 0x7f055c1985b0 2024-04-20T12:33:32.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f056105c640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f055c1121b0 con 0x7f055c101090 2024-04-20T12:33:32.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f056105c640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f055c1124b0 con 0x7f055c106160 2024-04-20T12:33:32.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f055b59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c1985b0 0x7f055c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f055b59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c1985b0 0x7f055c198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49198/0 (socket says 172.21.15.135:49198) 2024-04-20T12:33:32.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f055b59e640 1 -- 172.21.15.135:0/1394521263 learned_addr learned my addr 172.21.15.135:0/1394521263 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:32.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f055ad9d640 1 --2- 172.21.15.135:0/1394521263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f055c101090 0x7f055c19e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f055a59c640 1 --2- 172.21.15.135:0/1394521263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c106160 0x7f055c19e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f055b59e640 1 -- 172.21.15.135:0/1394521263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c106160 msgr2=0x7f055c19e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f055b59e640 1 --2- 172.21.15.135:0/1394521263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c106160 0x7f055c19e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f055b59e640 1 -- 172.21.15.135:0/1394521263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f055c101090 msgr2=0x7f055c19e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.029 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f055b59e640 1 --2- 172.21.15.135:0/1394521263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f055c101090 0x7f055c19e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f055b59e640 1 -- 172.21.15.135:0/1394521263 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055c1990d0 con 0x7f055c1985b0 2024-04-20T12:33:32.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f055ad9d640 1 --2- 172.21.15.135:0/1394521263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f055c101090 0x7f055c19e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T12:33:32.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.027+0000 7f055b59e640 1 --2- 172.21.15.135:0/1394521263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c1985b0 0x7f055c198a60 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f055402c700 tx=0x7f0554032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.028+0000 7f0543fff640 1 -- 172.21.15.135:0/1394521263 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554039040 con 0x7f055c1985b0 2024-04-20T12:33:32.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.028+0000 7f056105c640 1 -- 172.21.15.135:0/1394521263 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055c199360 con 0x7f055c1985b0 2024-04-20T12:33:32.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.028+0000 7f056105c640 1 -- 172.21.15.135:0/1394521263 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f055c1a55b0 con 0x7f055c1985b0 2024-04-20T12:33:32.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.028+0000 7f0543fff640 1 -- 172.21.15.135:0/1394521263 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0554044070 con 0x7f055c1985b0 2024-04-20T12:33:32.030 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.028+0000 7f0543fff640 1 -- 172.21.15.135:0/1394521263 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0554003e60 con 0x7f055c1985b0 2024-04-20T12:33:32.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.030+0000 7f0543fff640 1 -- 172.21.15.135:0/1394521263 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f0554032590 con 0x7f055c1985b0 2024-04-20T12:33:32.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.030+0000 7f0563c4e740 1 Processor -- start 2024-04-20T12:33:32.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.030+0000 7f0563c4e740 1 -- start start 2024-04-20T12:33:32.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.030+0000 7f0543fff640 1 --2- 172.21.15.135:0/1394521263 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f05440a3d20 0x7f05440a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.030+0000 7f0563c4e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b1e10 0x55ea711b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.030+0000 7f0563c4e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711b2730 0x55ea711badd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f0563c4e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711bb310 0x55ea711bd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f0563c4e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ea71117110 con 0x55ea711b1e10 2024-04-20T12:33:32.033 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f0563c4e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ea710b4550 con 0x55ea711bb310 2024-04-20T12:33:32.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f0563c4e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ea711130d0 con 0x55ea711b2730 2024-04-20T12:33:32.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f0543fff640 1 -- 172.21.15.135:0/1394521263 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f05540f2ad0 con 0x7f055c1985b0 2024-04-20T12:33:32.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f055a59c640 1 --2- 172.21.15.135:0/1394521263 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f05440a3d20 0x7f05440a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f055ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b1e10 0x55ea711b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f055ad9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b1e10 0x55ea711b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49214/0 (socket says 172.21.15.135:49214) 2024-04-20T12:33:32.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f055ad9d640 1 -- 172.21.15.135:0/697951399 learned_addr learned my addr 172.21.15.135:0/697951399 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:32.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f055a59c640 1 --2- 172.21.15.135:0/697951399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711b2730 0x55ea711badd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f055b59e640 1 --2- 172.21.15.135:0/697951399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711bb310 0x55ea711bd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f055ad9d640 1 -- 172.21.15.135:0/697951399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711b2730 msgr2=0x55ea711badd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f055ad9d640 1 --2- 172.21.15.135:0/697951399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711b2730 0x55ea711badd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f055ad9d640 1 -- 172.21.15.135:0/697951399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711bb310 msgr2=0x55ea711bd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f055ad9d640 1 --2- 172.21.15.135:0/697951399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711bb310 0x55ea711bd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f055ad9d640 1 -- 172.21.15.135:0/697951399 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea710dc900 con 0x55ea711b1e10 2024-04-20T12:33:32.034 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f055a59c640 1 --2- 172.21.15.135:0/1394521263 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f05440a3d20 0x7f05440a61e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f054c0058a0 tx=0x7f054c00b760 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f055ad9d640 1 --2- 172.21.15.135:0/697951399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b1e10 0x55ea711b21f0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f05500104d0 tx=0x7f0550010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a562458d98023a3c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f05417fa640 1 -- 172.21.15.135:0/697951399 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0550011760 con 0x55ea711b1e10 2024-04-20T12:33:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f05417fa640 1 -- 172.21.15.135:0/697951399 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0550011de0 con 0x55ea711b1e10 2024-04-20T12:33:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.031+0000 7f05417fa640 1 -- 172.21.15.135:0/697951399 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055001a380 con 0x55ea711b1e10 2024-04-20T12:33:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.032+0000 7f0563c4e740 1 -- 172.21.15.135:0/697951399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b1e10 msgr2=0x55ea711b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.032+0000 7f0563c4e740 1 --2- 172.21.15.135:0/697951399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b1e10 0x55ea711b21f0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f05500104d0 tx=0x7f0550010990 comp rx=0 tx=0).stop 2024-04-20T12:33:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.032+0000 7f0563c4e740 1 -- 172.21.15.135:0/697951399 shutdown_connections 2024-04-20T12:33:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.032+0000 7f0563c4e740 1 --2- 172.21.15.135:0/697951399 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711bb310 0x55ea711bd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.032+0000 7f0563c4e740 1 --2- 172.21.15.135:0/697951399 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711b2730 0x55ea711badd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.032+0000 7f0563c4e740 1 --2- 172.21.15.135:0/697951399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b1e10 0x55ea711b21f0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.032+0000 7f0563c4e740 1 -- 172.21.15.135:0/697951399 >> 172.21.15.135:0/697951399 conn(0x55ea711ac540 msgr2=0x55ea711ac920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.032+0000 7f0563c4e740 1 -- 172.21.15.135:0/697951399 shutdown_connections 2024-04-20T12:33:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.032+0000 7f0563c4e740 1 -- 172.21.15.135:0/697951399 wait complete. 2024-04-20T12:33:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.032+0000 7f0563c4e740 1 -- start start 2024-04-20T12:33:32.035 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.032+0000 7f0563c4e740 1 Processor -- start 2024-04-20T12:33:32.036 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f0563c4e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711b1e10 0x55ea711b8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f0563c4e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711b2730 0x55ea711b8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f0563c4e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711bb310 0x55ea711b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f0563c4e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ea711bdfe0 con 0x55ea711bb310 2024-04-20T12:33:32.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f0563c4e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x55ea710d0500 con 0x55ea711b2730 2024-04-20T12:33:32.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f0563c4e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x55ea711be160 con 0x55ea711b1e10 2024-04-20T12:33:32.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f0563c4e740 10 client.0 _ll_register_callbacks cb 0x55ea710b52f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:32.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f055b59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711bb310 0x55ea711b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f055a59c640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711b2730 0x55ea711b8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f055b59e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711bb310 0x55ea711b8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49220/0 (socket says 172.21.15.135:49220) 2024-04-20T12:33:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f055b59e640 1 -- 172.21.15.135:0/395646514 learned_addr learned my addr 172.21.15.135:0/395646514 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f055ad9d640 1 --2- 172.21.15.135:0/395646514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711b1e10 0x55ea711b8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f055b59e640 1 -- 172.21.15.135:0/395646514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711b1e10 msgr2=0x55ea711b8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f055b59e640 1 --2- 172.21.15.135:0/395646514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711b1e10 0x55ea711b8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f055b59e640 1 -- 172.21.15.135:0/395646514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711b2730 msgr2=0x55ea711b8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f055b59e640 1 --2- 172.21.15.135:0/395646514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711b2730 0x55ea711b8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f055b59e640 1 -- 172.21.15.135:0/395646514 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea70e293f0 con 0x55ea711bb310 2024-04-20T12:33:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f055b59e640 1 --2- 172.21.15.135:0/395646514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711bb310 0x55ea711b8ec0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f05540be7d0 tx=0x7f05540be610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef3b8caea061cbd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f053eff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f053eff5640 1 -- 172.21.15.135:0/395646514 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05540bef40 con 0x55ea711bb310 2024-04-20T12:33:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f053eff5640 1 -- 172.21.15.135:0/395646514 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f05540baeb0 con 0x55ea711bb310 2024-04-20T12:33:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f0563c4e740 1 -- 172.21.15.135:0/395646514 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0550011de0 con 0x55ea711bb310 2024-04-20T12:33:32.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.033+0000 7f053eff5640 1 -- 172.21.15.135:0/395646514 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f05540be840 con 0x55ea711bb310 2024-04-20T12:33:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.034+0000 7f0563c4e740 10 client.18741 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.034+0000 7f0563c4e740 1 -- 172.21.15.135:0/395646514 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ea70ef37d0 con 0x55ea711bb310 2024-04-20T12:33:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.034+0000 7f053eff5640 1 -- 172.21.15.135:0/395646514 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0550011de0 con 0x55ea711bb310 2024-04-20T12:33:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.034+0000 7f053eff5640 1 -- 172.21.15.135:0/395646514 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f055403c030 con 0x55ea711bb310 2024-04-20T12:33:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.034+0000 7f0563c4e740 10 client.18741 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.034+0000 7f0563c4e740 10 client.18741 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:33:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.034+0000 7f0563c4e740 20 client.18741 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.034+0000 7f0563c4e740 1 --2- 172.21.15.135:0/395646514 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ea711cb680 0x55ea711cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.034+0000 7f0563c4e740 4 client.18741 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:33:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.034+0000 7f0563c4e740 1 -- 172.21.15.135:0/395646514 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea71124b30 con 0x55ea711cb680 2024-04-20T12:33:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.034+0000 7f055ad9d640 1 --2- 172.21.15.135:0/395646514 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ea711cb680 0x55ea711cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.034+0000 7f053eff5640 10 client.18741 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:33:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.034+0000 7f055ad9d640 1 --2- 172.21.15.135:0/395646514 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ea711cb680 0x55ea711cdac0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3f044055e4275ecc server_cookie=819e4daa7982c1a3 in_seq=0 out_seq=0 2024-04-20T12:33:32.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.035+0000 7f053eff5640 1 -- 172.21.15.135:0/395646514 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ea71124b30 con 0x55ea711cb680 2024-04-20T12:33:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.035+0000 7f053eff5640 10 client.18741 handle_command_reply: tid=0 2024-04-20T12:33:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.035+0000 7f0563c4e740 1 client.18741 shutdown 2024-04-20T12:33:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.035+0000 7f0563c4e740 1 -- 172.21.15.135:0/395646514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711bb310 msgr2=0x55ea711b8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.035+0000 7f0563c4e740 1 --2- 172.21.15.135:0/395646514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711bb310 0x55ea711b8ec0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f05540be7d0 tx=0x7f05540be610 comp rx=0 tx=0).stop 2024-04-20T12:33:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.035+0000 7f0563c4e740 1 -- 172.21.15.135:0/395646514 shutdown_connections 2024-04-20T12:33:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.035+0000 7f0563c4e740 1 --2- 172.21.15.135:0/395646514 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711bb310 0x55ea711b8ec0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.035+0000 7f0563c4e740 1 --2- 172.21.15.135:0/395646514 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711b2730 0x55ea711b8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.035+0000 7f0563c4e740 1 --2- 172.21.15.135:0/395646514 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ea711cb680 0x55ea711cdac0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.035+0000 7f0563c4e740 1 --2- 172.21.15.135:0/395646514 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711b1e10 0x55ea711b8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.035+0000 7f053eff5640 0 client.18741 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:33:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.035+0000 7f0563c4e740 1 -- 172.21.15.135:0/395646514 >> 172.21.15.135:0/395646514 conn(0x55ea711ac540 msgr2=0x55ea711ae290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.035+0000 7f0563c4e740 1 -- 172.21.15.135:0/395646514 shutdown_connections 2024-04-20T12:33:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.035+0000 7f0563c4e740 1 -- 172.21.15.135:0/395646514 wait complete. 2024-04-20T12:33:32.042 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.035+0000 7f0563c4e740 20 client.18741 trim_cache size 0 max 16384 2024-04-20T12:33:32.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.048+0000 7f0563c4e740 1 Processor -- start 2024-04-20T12:33:32.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.048+0000 7f0563c4e740 1 -- start start 2024-04-20T12:33:32.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f0563c4e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711b1e10 0x55ea711bab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f0563c4e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b2730 0x55ea711d33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.048 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f0563c4e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711bb310 0x55ea711d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.049 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f0563c4e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f055c1af420 con 0x55ea711b2730 2024-04-20T12:33:32.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f0563c4e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f055c1b0f60 con 0x55ea711b1e10 2024-04-20T12:33:32.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f0563c4e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f055c1afaf0 con 0x55ea711bb310 2024-04-20T12:33:32.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f055a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b2730 0x55ea711d33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.054 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f055a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b2730 0x55ea711d33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49224/0 (socket says 172.21.15.135:49224) 2024-04-20T12:33:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f055a59c640 1 -- 172.21.15.135:0/1711101686 learned_addr learned my addr 172.21.15.135:0/1711101686 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f055ad9d640 1 --2- 172.21.15.135:0/1711101686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711b1e10 0x55ea711bab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f055a59c640 1 -- 172.21.15.135:0/1711101686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711bb310 msgr2=0x55ea711d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f055a59c640 1 --2- 172.21.15.135:0/1711101686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711bb310 0x55ea711d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f055a59c640 1 -- 172.21.15.135:0/1711101686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711b1e10 msgr2=0x55ea711bab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f055a59c640 1 --2- 172.21.15.135:0/1711101686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711b1e10 0x55ea711bab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f055a59c640 1 -- 172.21.15.135:0/1711101686 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea711a7be0 con 0x55ea711b2730 2024-04-20T12:33:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f055a59c640 1 --2- 172.21.15.135:0/1711101686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b2730 0x55ea711d33d0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f055c06b700 tx=0x7f054c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a53d083bfef97e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f0540ff9640 1 -- 172.21.15.135:0/1711101686 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c0120d0 con 0x55ea711b2730 2024-04-20T12:33:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f0540ff9640 1 -- 172.21.15.135:0/1711101686 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f054c010910 con 0x55ea711b2730 2024-04-20T12:33:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.049+0000 7f0540ff9640 1 -- 172.21.15.135:0/1711101686 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c01f930 con 0x55ea711b2730 2024-04-20T12:33:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 -- 172.21.15.135:0/1711101686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b2730 msgr2=0x55ea711d33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 --2- 172.21.15.135:0/1711101686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b2730 0x55ea711d33d0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f055c06b700 tx=0x7f054c01d000 comp rx=0 tx=0).stop 2024-04-20T12:33:32.055 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 -- 172.21.15.135:0/1711101686 shutdown_connections 2024-04-20T12:33:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 --2- 172.21.15.135:0/1711101686 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711bb310 0x55ea711d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 --2- 172.21.15.135:0/1711101686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b2730 0x55ea711d33d0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 --2- 172.21.15.135:0/1711101686 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711b1e10 0x55ea711bab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 -- 172.21.15.135:0/1711101686 >> 172.21.15.135:0/1711101686 conn(0x55ea711ac540 msgr2=0x55ea711b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 -- 172.21.15.135:0/1711101686 shutdown_connections 2024-04-20T12:33:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 -- 172.21.15.135:0/1711101686 wait complete. 2024-04-20T12:33:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 -- start start 2024-04-20T12:33:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 Processor -- start 2024-04-20T12:33:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711b1e10 0x55ea711c3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b2730 0x55ea711b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711bb310 0x55ea711b5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f055c1b0890 con 0x55ea711b2730 2024-04-20T12:33:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f055c1b01c0 con 0x55ea711bb310 2024-04-20T12:33:32.056 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f055c1ad3f0 con 0x55ea711b1e10 2024-04-20T12:33:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f0563c4e740 10 client.0 _ll_register_callbacks cb 0x7f05540ba420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.050+0000 7f055a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b2730 0x55ea711b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f055a59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b2730 0x55ea711b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49232/0 (socket says 172.21.15.135:49232) 2024-04-20T12:33:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f055a59c640 1 -- 172.21.15.135:0/434739507 learned_addr learned my addr 172.21.15.135:0/434739507 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f055b59e640 1 --2- 172.21.15.135:0/434739507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711bb310 0x55ea711b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f055a59c640 1 -- 172.21.15.135:0/434739507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711b1e10 msgr2=0x55ea711c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f055a59c640 1 --2- 172.21.15.135:0/434739507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711b1e10 0x55ea711c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f055a59c640 1 -- 172.21.15.135:0/434739507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711bb310 msgr2=0x55ea711b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f055a59c640 1 --2- 172.21.15.135:0/434739507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711bb310 0x55ea711b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f055a59c640 1 -- 172.21.15.135:0/434739507 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea711b5880 con 0x55ea711b2730 2024-04-20T12:33:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f055b59e640 1 --2- 172.21.15.135:0/434739507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711bb310 0x55ea711b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:33:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f055a59c640 1 --2- 172.21.15.135:0/434739507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b2730 0x55ea711b4cd0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f054c028000 tx=0x7f054c010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fd54ae53934151 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f053eff5640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f053eff5640 1 -- 172.21.15.135:0/434739507 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c010ac0 con 0x55ea711b2730 2024-04-20T12:33:32.057 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f053eff5640 1 -- 172.21.15.135:0/434739507 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f054c010c60 con 0x55ea711b2730 2024-04-20T12:33:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f0563c4e740 1 -- 172.21.15.135:0/434739507 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f054c010910 con 0x55ea711b2730 2024-04-20T12:33:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f053eff5640 1 -- 172.21.15.135:0/434739507 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f054c005040 con 0x55ea711b2730 2024-04-20T12:33:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f0563c4e740 10 client.18747 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f0563c4e740 1 -- 172.21.15.135:0/434739507 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ea71231ab0 con 0x55ea711b2730 2024-04-20T12:33:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f053eff5640 1 -- 172.21.15.135:0/434739507 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f054c010910 con 0x55ea711b2730 2024-04-20T12:33:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f053eff5640 1 -- 172.21.15.135:0/434739507 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f054c004cd0 con 0x55ea711b2730 2024-04-20T12:33:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f0563c4e740 10 client.18747 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f0563c4e740 10 client.18747 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-04-20T12:33:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.051+0000 7f0563c4e740 20 client.18747 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.052+0000 7f0563c4e740 1 --2- 172.21.15.135:0/434739507 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ea712321b0 0x55ea712345d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.052+0000 7f0563c4e740 4 client.18747 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:33:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.052+0000 7f0563c4e740 1 -- 172.21.15.135:0/434739507 --> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea7111e9a0 con 0x55ea712321b0 2024-04-20T12:33:32.058 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.052+0000 7f055ad9d640 1 --2- 172.21.15.135:0/434739507 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ea712321b0 0x55ea712345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.052+0000 7f053eff5640 10 client.18747 ms_handle_connect on v2:172.21.15.154:6836/2792228805 2024-04-20T12:33:32.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.052+0000 7f055ad9d640 1 --2- 172.21.15.135:0/434739507 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ea712321b0 0x55ea712345d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6df2a7f07416560b server_cookie=b52e6a481fd057d9 in_seq=0 out_seq=0 2024-04-20T12:33:32.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f053eff5640 1 -- 172.21.15.135:0/434739507 <== mds.2 v2:172.21.15.154:6836/2792228805 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea7111e9a0 con 0x55ea712321b0 2024-04-20T12:33:32.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f053eff5640 10 client.18747 handle_command_reply: tid=0 2024-04-20T12:33:32.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f0563c4e740 1 client.18747 shutdown 2024-04-20T12:33:32.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f0563c4e740 1 -- 172.21.15.135:0/434739507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b2730 msgr2=0x55ea711b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f0563c4e740 1 --2- 172.21.15.135:0/434739507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b2730 0x55ea711b4cd0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f054c028000 tx=0x7f054c010660 comp rx=0 tx=0).stop 2024-04-20T12:33:32.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f0563c4e740 1 -- 172.21.15.135:0/434739507 shutdown_connections 2024-04-20T12:33:32.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f0563c4e740 1 --2- 172.21.15.135:0/434739507 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x55ea711bb310 0x55ea711b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f0563c4e740 1 --2- 172.21.15.135:0/434739507 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ea711b2730 0x55ea711b4cd0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f0563c4e740 1 --2- 172.21.15.135:0/434739507 >> [v2:172.21.15.154:6836/2792228805,v1:172.21.15.154:6837/2792228805] conn(0x55ea712321b0 0x55ea712345d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f0563c4e740 1 --2- 172.21.15.135:0/434739507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55ea711b1e10 0x55ea711c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f0563c4e740 1 -- 172.21.15.135:0/434739507 >> 172.21.15.135:0/434739507 conn(0x55ea711ac540 msgr2=0x55ea711aae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f053eff5640 0 client.18747 ms_handle_reset on v2:172.21.15.154:6836/2792228805 2024-04-20T12:33:32.059 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f0563c4e740 1 -- 172.21.15.135:0/434739507 shutdown_connections 2024-04-20T12:33:32.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f0563c4e740 1 -- 172.21.15.135:0/434739507 wait complete. 2024-04-20T12:33:32.060 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f0563c4e740 20 client.18747 trim_cache size 0 max 16384 2024-04-20T12:33:32.060 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:33:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f056105c640 1 -- 172.21.15.135:0/1394521263 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f05440a3d20 msgr2=0x7f05440a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f056105c640 1 --2- 172.21.15.135:0/1394521263 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f05440a3d20 0x7f05440a61e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f054c0058a0 tx=0x7f054c00b760 comp rx=0 tx=0).stop 2024-04-20T12:33:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f056105c640 1 -- 172.21.15.135:0/1394521263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c1985b0 msgr2=0x7f055c198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f056105c640 1 --2- 172.21.15.135:0/1394521263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c1985b0 0x7f055c198a60 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f055402c700 tx=0x7f0554032f20 comp rx=0 tx=0).stop 2024-04-20T12:33:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f056105c640 1 -- 172.21.15.135:0/1394521263 shutdown_connections 2024-04-20T12:33:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f056105c640 1 --2- 172.21.15.135:0/1394521263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f055c1985b0 0x7f055c198a60 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f056105c640 1 --2- 172.21.15.135:0/1394521263 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f05440a3d20 0x7f05440a61e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f056105c640 1 --2- 172.21.15.135:0/1394521263 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f055c106160 0x7f055c19e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f056105c640 1 --2- 172.21.15.135:0/1394521263 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f055c101090 0x7f055c19e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.053+0000 7f056105c640 1 -- 172.21.15.135:0/1394521263 >> 172.21.15.135:0/1394521263 conn(0x7f055c078010 msgr2=0x7f055c0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.054+0000 7f056105c640 1 -- 172.21.15.135:0/1394521263 shutdown_connections 2024-04-20T12:33:32.061 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.054+0000 7f056105c640 1 -- 172.21.15.135:0/1394521263 wait complete. 2024-04-20T12:33:32.064 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-04-20T12:33:32.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.165+0000 7f333be48640 1 -- 172.21.15.135:0/1255923448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341031d0 msgr2=0x7f33341035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.167 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.165+0000 7f333be48640 1 --2- 172.21.15.135:0/1255923448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341031d0 0x7f33341035b0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f3330009ca0 tx=0x7f333002c230 comp rx=0 tx=0).stop 2024-04-20T12:33:32.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.165+0000 7f333be48640 1 -- 172.21.15.135:0/1255923448 shutdown_connections 2024-04-20T12:33:32.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.165+0000 7f333be48640 1 --2- 172.21.15.135:0/1255923448 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f333410c510 0x7f333410e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.165+0000 7f333be48640 1 --2- 172.21.15.135:0/1255923448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3334103af0 0x7f333410bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.165+0000 7f333be48640 1 --2- 172.21.15.135:0/1255923448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33341031d0 0x7f33341035b0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.165+0000 7f333be48640 1 -- 172.21.15.135:0/1255923448 >> 172.21.15.135:0/1255923448 conn(0x7f3334078010 msgr2=0x7f3334078420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.165+0000 7f333be48640 1 -- 172.21.15.135:0/1255923448 shutdown_connections 2024-04-20T12:33:32.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.165+0000 7f333be48640 1 -- 172.21.15.135:0/1255923448 wait complete. 2024-04-20T12:33:32.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.165+0000 7f333be48640 1 Processor -- start 2024-04-20T12:33:32.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.165+0000 7f333be48640 1 -- start start 2024-04-20T12:33:32.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333be48640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33341031d0 0x7f33341a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333be48640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3334103af0 0x7f33341a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333be48640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333410c510 0x7f333419a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.168 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333be48640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3334114550 con 0x7f333410c510 2024-04-20T12:33:32.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333be48640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f33341143d0 con 0x7f3334103af0 2024-04-20T12:33:32.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333be48640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f33341146d0 con 0x7f33341031d0 2024-04-20T12:33:32.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333a3e5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333410c510 0x7f333419a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333a3e5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333410c510 0x7f333419a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49242/0 (socket says 172.21.15.135:49242) 2024-04-20T12:33:32.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333a3e5640 1 -- 172.21.15.135:0/1766802965 learned_addr learned my addr 172.21.15.135:0/1766802965 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:32.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f33393e3640 1 --2- 172.21.15.135:0/1766802965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3334103af0 0x7f33341a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f3339be4640 1 --2- 172.21.15.135:0/1766802965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33341031d0 0x7f33341a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333a3e5640 1 -- 172.21.15.135:0/1766802965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33341031d0 msgr2=0x7f33341a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333a3e5640 1 --2- 172.21.15.135:0/1766802965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33341031d0 0x7f33341a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333a3e5640 1 -- 172.21.15.135:0/1766802965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3334103af0 msgr2=0x7f33341a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333a3e5640 1 --2- 172.21.15.135:0/1766802965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3334103af0 0x7f33341a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333a3e5640 1 -- 172.21.15.135:0/1766802965 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333419aff0 con 0x7f333410c510 2024-04-20T12:33:32.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333a3e5640 1 --2- 172.21.15.135:0/1766802965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333410c510 0x7f333419a870 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f332c00d950 tx=0x7f332c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.169 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f332affd640 1 -- 172.21.15.135:0/1766802965 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c017030 con 0x7f333410c510 2024-04-20T12:33:32.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f332affd640 1 -- 172.21.15.135:0/1766802965 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f332c004020 con 0x7f333410c510 2024-04-20T12:33:32.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333be48640 1 -- 172.21.15.135:0/1766802965 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333419b2e0 con 0x7f333410c510 2024-04-20T12:33:32.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f332affd640 1 -- 172.21.15.135:0/1766802965 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c003c00 con 0x7f333410c510 2024-04-20T12:33:32.170 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.166+0000 7f333be48640 1 -- 172.21.15.135:0/1766802965 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33341a7580 con 0x7f333410c510 2024-04-20T12:33:32.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.169+0000 7f332affd640 1 -- 172.21.15.135:0/1766802965 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f332c01a070 con 0x7f333410c510 2024-04-20T12:33:32.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.169+0000 7f333ea30740 1 Processor -- start 2024-04-20T12:33:32.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.169+0000 7f333ea30740 1 -- start start 2024-04-20T12:33:32.171 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f333ea30740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61645e10 0x558a616461f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f333ea30740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a61646730 0x558a6164edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.175 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f333ea30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a6164f310 0x558a61651700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f333ea30740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558a615ab110 con 0x558a61645e10 2024-04-20T12:33:32.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f333ea30740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558a61548550 con 0x558a61646730 2024-04-20T12:33:32.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f333ea30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a615a70d0 con 0x558a6164f310 2024-04-20T12:33:32.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f33393e3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61645e10 0x558a616461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f332affd640 1 --2- 172.21.15.135:0/1766802965 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33200a3d20 0x7f33200a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f33393e3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61645e10 0x558a616461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49256/0 (socket says 172.21.15.135:49256) 2024-04-20T12:33:32.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f33393e3640 1 -- 172.21.15.135:0/4088803561 learned_addr learned my addr 172.21.15.135:0/4088803561 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:32.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f3339be4640 1 --2- 172.21.15.135:0/4088803561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a61646730 0x558a6164edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f333a3e5640 1 --2- 172.21.15.135:0/1766802965 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33200a3d20 0x7f33200a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f33393e3640 1 -- 172.21.15.135:0/4088803561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a6164f310 msgr2=0x558a61651700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.176 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f33393e3640 1 --2- 172.21.15.135:0/4088803561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a6164f310 0x558a61651700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f33393e3640 1 -- 172.21.15.135:0/4088803561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a61646730 msgr2=0x558a6164edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f33393e3640 1 --2- 172.21.15.135:0/4088803561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a61646730 0x558a6164edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f332affd640 1 -- 172.21.15.135:0/1766802965 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f332c0d0810 con 0x7f333410c510 2024-04-20T12:33:32.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f33393e3640 1 -- 172.21.15.135:0/4088803561 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a61570900 con 0x558a61645e10 2024-04-20T12:33:32.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f33393e3640 1 --2- 172.21.15.135:0/4088803561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61645e10 0x558a616461f0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f332400b9f0 tx=0x7f332400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f470e7ca6f4eb57 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.170+0000 7f333a3e5640 1 --2- 172.21.15.135:0/1766802965 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33200a3d20 0x7f33200a61e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f332c098840 tx=0x7f332c06eed0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.171+0000 7f331ffff640 1 -- 172.21.15.135:0/4088803561 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332400fc90 con 0x558a61645e10 2024-04-20T12:33:32.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.171+0000 7f331ffff640 1 -- 172.21.15.135:0/4088803561 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3324010040 con 0x558a61645e10 2024-04-20T12:33:32.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.171+0000 7f331ffff640 1 -- 172.21.15.135:0/4088803561 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324013750 con 0x558a61645e10 2024-04-20T12:33:32.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.171+0000 7f333ea30740 1 -- 172.21.15.135:0/4088803561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61645e10 msgr2=0x558a616461f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.171+0000 7f333ea30740 1 --2- 172.21.15.135:0/4088803561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61645e10 0x558a616461f0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f332400b9f0 tx=0x7f332400beb0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.171+0000 7f333ea30740 1 -- 172.21.15.135:0/4088803561 shutdown_connections 2024-04-20T12:33:32.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.171+0000 7f333ea30740 1 --2- 172.21.15.135:0/4088803561 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a6164f310 0x558a61651700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.171+0000 7f333ea30740 1 --2- 172.21.15.135:0/4088803561 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a61646730 0x558a6164edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.171+0000 7f333ea30740 1 --2- 172.21.15.135:0/4088803561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61645e10 0x558a616461f0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.171+0000 7f333ea30740 1 -- 172.21.15.135:0/4088803561 >> 172.21.15.135:0/4088803561 conn(0x558a61640540 msgr2=0x558a61640920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.171+0000 7f333ea30740 1 -- 172.21.15.135:0/4088803561 shutdown_connections 2024-04-20T12:33:32.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.171+0000 7f333ea30740 1 -- 172.21.15.135:0/4088803561 wait complete. 2024-04-20T12:33:32.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.172+0000 7f333ea30740 1 -- start start 2024-04-20T12:33:32.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.172+0000 7f333ea30740 1 Processor -- start 2024-04-20T12:33:32.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.172+0000 7f333ea30740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a61645e10 0x558a6164c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.172+0000 7f333ea30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a61646730 0x558a6164c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.172+0000 7f333ea30740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a6164f310 0x558a6164ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.172+0000 7f333ea30740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558a61652040 con 0x558a6164f310 2024-04-20T12:33:32.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.172+0000 7f333ea30740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x558a61564500 con 0x558a61645e10 2024-04-20T12:33:32.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.172+0000 7f333ea30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x558a616521c0 con 0x558a61646730 2024-04-20T12:33:32.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.172+0000 7f333ea30740 10 client.0 _ll_register_callbacks cb 0x558a615492f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:32.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.172+0000 7f33393e3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a6164f310 0x558a6164ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.172+0000 7f33393e3640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a6164f310 0x558a6164ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49270/0 (socket says 172.21.15.135:49270) 2024-04-20T12:33:32.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.172+0000 7f33393e3640 1 -- 172.21.15.135:0/2173079595 learned_addr learned my addr 172.21.15.135:0/2173079595 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:32.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.172+0000 7f3339be4640 1 --2- 172.21.15.135:0/2173079595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a61646730 0x558a6164c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.172+0000 7f33393e3640 1 --2- 172.21.15.135:0/2173079595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a61645e10 0x558a6164c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f33393e3640 1 -- 172.21.15.135:0/2173079595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a61646730 msgr2=0x558a6164c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f33393e3640 1 --2- 172.21.15.135:0/2173079595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a61646730 0x558a6164c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f33393e3640 1 -- 172.21.15.135:0/2173079595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a61645e10 msgr2=0x558a6164c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f33393e3640 1 --2- 172.21.15.135:0/2173079595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a61645e10 0x558a6164c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f33393e3640 1 -- 172.21.15.135:0/2173079595 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a612bd3f0 con 0x558a6164f310 2024-04-20T12:33:32.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f33393e3640 1 --2- 172.21.15.135:0/2173079595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a6164f310 0x558a6164ce50 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f3324015fd0 tx=0x7f3324013460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea98d152036306a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f331d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:32.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f331d7fa640 1 -- 172.21.15.135:0/2173079595 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324027020 con 0x558a6164f310 2024-04-20T12:33:32.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f331d7fa640 1 -- 172.21.15.135:0/2173079595 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f3324013d80 con 0x558a6164f310 2024-04-20T12:33:32.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f333ea30740 1 -- 172.21.15.135:0/2173079595 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3324010040 con 0x558a6164f310 2024-04-20T12:33:32.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f331d7fa640 1 -- 172.21.15.135:0/2173079595 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3324032050 con 0x558a6164f310 2024-04-20T12:33:32.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f333ea30740 10 client.18759 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:32.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f333ea30740 1 -- 172.21.15.135:0/2173079595 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558a613877d0 con 0x558a6164f310 2024-04-20T12:33:32.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f331d7fa640 1 -- 172.21.15.135:0/2173079595 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3324010040 con 0x558a6164f310 2024-04-20T12:33:32.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f331d7fa640 1 -- 172.21.15.135:0/2173079595 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f33240206d0 con 0x558a6164f310 2024-04-20T12:33:32.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f333ea30740 10 client.18759 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:32.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.173+0000 7f333ea30740 10 client.18759 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:33:32.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.174+0000 7f333ea30740 20 client.18759 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:32.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.174+0000 7f333ea30740 1 --2- 172.21.15.135:0/2173079595 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x558a6165f610 0x558a61661a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.174+0000 7f333ea30740 4 client.18759 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:33:32.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.174+0000 7f333ea30740 1 -- 172.21.15.135:0/2173079595 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a615b8b30 con 0x558a6165f610 2024-04-20T12:33:32.183 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.174+0000 7f3339be4640 1 --2- 172.21.15.135:0/2173079595 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x558a6165f610 0x558a61661a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.174+0000 7f3339be4640 1 --2- 172.21.15.135:0/2173079595 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x558a6165f610 0x558a61661a00 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=21f6caf49b326e50 server_cookie=c38148c42b9eadaf in_seq=0 out_seq=0 2024-04-20T12:33:32.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.174+0000 7f331d7fa640 10 client.18759 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:33:32.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.175+0000 7f331d7fa640 1 -- 172.21.15.135:0/2173079595 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558a615b8b30 con 0x558a6165f610 2024-04-20T12:33:32.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.175+0000 7f331d7fa640 10 client.18759 handle_command_reply: tid=0 2024-04-20T12:33:32.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.175+0000 7f333ea30740 1 client.18759 shutdown 2024-04-20T12:33:32.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.175+0000 7f333ea30740 1 -- 172.21.15.135:0/2173079595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a6164f310 msgr2=0x558a6164ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.175+0000 7f333ea30740 1 --2- 172.21.15.135:0/2173079595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a6164f310 0x558a6164ce50 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f3324015fd0 tx=0x7f3324013460 comp rx=0 tx=0).stop 2024-04-20T12:33:32.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.175+0000 7f333ea30740 1 -- 172.21.15.135:0/2173079595 shutdown_connections 2024-04-20T12:33:32.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.175+0000 7f333ea30740 1 --2- 172.21.15.135:0/2173079595 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x558a6165f610 0x558a61661a00 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.175+0000 7f333ea30740 1 --2- 172.21.15.135:0/2173079595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a6164f310 0x558a6164ce50 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.175+0000 7f333ea30740 1 --2- 172.21.15.135:0/2173079595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a61646730 0x558a6164c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.175+0000 7f333ea30740 1 --2- 172.21.15.135:0/2173079595 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a61645e10 0x558a6164c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.175+0000 7f331d7fa640 0 client.18759 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:33:32.184 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.175+0000 7f333ea30740 1 -- 172.21.15.135:0/2173079595 >> 172.21.15.135:0/2173079595 conn(0x558a61640540 msgr2=0x558a61642290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.175+0000 7f333ea30740 1 -- 172.21.15.135:0/2173079595 shutdown_connections 2024-04-20T12:33:32.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.175+0000 7f333ea30740 1 -- 172.21.15.135:0/2173079595 wait complete. 2024-04-20T12:33:32.185 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.175+0000 7f333ea30740 20 client.18759 trim_cache size 0 max 16384 2024-04-20T12:33:32.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.188+0000 7f333ea30740 1 Processor -- start 2024-04-20T12:33:32.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.188+0000 7f333ea30740 1 -- start start 2024-04-20T12:33:32.189 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.188+0000 7f333ea30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a61645e10 0x558a6164eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.188+0000 7f333ea30740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61646730 0x558a6164bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.188+0000 7f333ea30740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a6164f310 0x558a61667190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.188+0000 7f333ea30740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33341b1710 con 0x558a61646730 2024-04-20T12:33:32.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.188+0000 7f333ea30740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f33341b3250 con 0x558a6164f310 2024-04-20T12:33:32.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.188+0000 7f333ea30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f33341b1de0 con 0x558a61645e10 2024-04-20T12:33:32.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.188+0000 7f3339be4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61646730 0x558a6164bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.188+0000 7f3339be4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61646730 0x558a6164bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49284/0 (socket says 172.21.15.135:49284) 2024-04-20T12:33:32.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.188+0000 7f3339be4640 1 -- 172.21.15.135:0/1946916897 learned_addr learned my addr 172.21.15.135:0/1946916897 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:32.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.189+0000 7f3339be4640 1 -- 172.21.15.135:0/1946916897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a61645e10 msgr2=0x558a6164eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.189+0000 7f33393e3640 1 --2- 172.21.15.135:0/1946916897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a61645e10 0x558a6164eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.189+0000 7f3339be4640 1 --2- 172.21.15.135:0/1946916897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a61645e10 0x558a6164eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.189+0000 7f3339be4640 1 -- 172.21.15.135:0/1946916897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a6164f310 msgr2=0x558a61667190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.190 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.189+0000 7f3339be4640 1 --2- 172.21.15.135:0/1946916897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a6164f310 0x558a61667190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.189+0000 7f3339be4640 1 -- 172.21.15.135:0/1946916897 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a61646560 con 0x558a61646730 2024-04-20T12:33:32.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.189+0000 7f33393e3640 1 --2- 172.21.15.135:0/1946916897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a61645e10 0x558a6164eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:33:32.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.189+0000 7f3339be4640 1 --2- 172.21.15.135:0/1946916897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61646730 0x558a6164bb80 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f333002c770 tx=0x7f3330009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d46ccfb9163b25 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.189+0000 7f331f7fe640 1 -- 172.21.15.135:0/1946916897 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330050070 con 0x558a61646730 2024-04-20T12:33:32.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.189+0000 7f331f7fe640 1 -- 172.21.15.135:0/1946916897 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3330009540 con 0x558a61646730 2024-04-20T12:33:32.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.189+0000 7f331f7fe640 1 -- 172.21.15.135:0/1946916897 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330039040 con 0x558a61646730 2024-04-20T12:33:32.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 -- 172.21.15.135:0/1946916897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61646730 msgr2=0x558a6164bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 --2- 172.21.15.135:0/1946916897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61646730 0x558a6164bb80 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f333002c770 tx=0x7f3330009360 comp rx=0 tx=0).stop 2024-04-20T12:33:32.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 -- 172.21.15.135:0/1946916897 shutdown_connections 2024-04-20T12:33:32.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 --2- 172.21.15.135:0/1946916897 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a6164f310 0x558a61667190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 --2- 172.21.15.135:0/1946916897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61646730 0x558a6164bb80 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 --2- 172.21.15.135:0/1946916897 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a61645e10 0x558a6164eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.191 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 -- 172.21.15.135:0/1946916897 >> 172.21.15.135:0/1946916897 conn(0x558a61640540 msgr2=0x558a6163f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 -- 172.21.15.135:0/1946916897 shutdown_connections 2024-04-20T12:33:32.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 -- 172.21.15.135:0/1946916897 wait complete. 2024-04-20T12:33:32.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 -- start start 2024-04-20T12:33:32.192 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 Processor -- start 2024-04-20T12:33:32.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a61645e10 0x558a616575c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61646730 0x558a61652a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a6164f310 0x558a61652fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33341b2b80 con 0x558a61646730 2024-04-20T12:33:32.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f33341b24b0 con 0x558a61645e10 2024-04-20T12:33:32.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f33341af6e0 con 0x558a6164f310 2024-04-20T12:33:32.195 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f333ea30740 10 client.0 _ll_register_callbacks cb 0x7f3330037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:32.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.190+0000 7f3339be4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61646730 0x558a61652a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f3339be4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61646730 0x558a61652a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49300/0 (socket says 172.21.15.135:49300) 2024-04-20T12:33:32.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f3339be4640 1 -- 172.21.15.135:0/2053836511 learned_addr learned my addr 172.21.15.135:0/2053836511 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:32.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f33393e3640 1 --2- 172.21.15.135:0/2053836511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a6164f310 0x558a61652fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f33393e3640 1 --2- 172.21.15.135:0/2053836511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a61645e10 0x558a616575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.196 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f3339be4640 1 -- 172.21.15.135:0/2053836511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a6164f310 msgr2=0x558a61652fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f3339be4640 1 --2- 172.21.15.135:0/2053836511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a6164f310 0x558a61652fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f3339be4640 1 -- 172.21.15.135:0/2053836511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a61645e10 msgr2=0x558a616575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f3339be4640 1 --2- 172.21.15.135:0/2053836511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a61645e10 0x558a616575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f3339be4640 1 -- 172.21.15.135:0/2053836511 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a61653510 con 0x558a61646730 2024-04-20T12:33:32.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f3339be4640 1 --2- 172.21.15.135:0/2053836511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61646730 0x558a61652a60 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f333004e040 tx=0x7f3330003b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23dca1f644df3c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f331d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:32.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f331d7fa640 1 -- 172.21.15.135:0/2053836511 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330059060 con 0x558a61646730 2024-04-20T12:33:32.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f331d7fa640 1 -- 172.21.15.135:0/2053836511 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f3330047050 con 0x558a61646730 2024-04-20T12:33:32.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f333ea30740 1 -- 172.21.15.135:0/2053836511 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3330009540 con 0x558a61646730 2024-04-20T12:33:32.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f331d7fa640 1 -- 172.21.15.135:0/2053836511 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3330060050 con 0x558a61646730 2024-04-20T12:33:32.197 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f333ea30740 10 client.18765 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:32.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f333ea30740 1 -- 172.21.15.135:0/2053836511 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558a616c5740 con 0x558a61646730 2024-04-20T12:33:32.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f331d7fa640 1 -- 172.21.15.135:0/2053836511 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3330009540 con 0x558a61646730 2024-04-20T12:33:32.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.191+0000 7f331d7fa640 1 -- 172.21.15.135:0/2053836511 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f333004b470 con 0x558a61646730 2024-04-20T12:33:32.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.192+0000 7f333ea30740 10 client.18765 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:32.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.192+0000 7f333ea30740 10 client.18765 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-04-20T12:33:32.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.192+0000 7f333ea30740 20 client.18765 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:32.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.192+0000 7f333ea30740 1 --2- 172.21.15.135:0/2053836511 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x558a616c5ea0 0x558a616c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.192+0000 7f333ea30740 4 client.18765 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:33:32.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.192+0000 7f333ea30740 1 -- 172.21.15.135:0/2053836511 --> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558a615b29a0 con 0x558a616c5ea0 2024-04-20T12:33:32.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.192+0000 7f33393e3640 1 --2- 172.21.15.135:0/2053836511 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x558a616c5ea0 0x558a616c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.192+0000 7f331d7fa640 10 client.18765 ms_handle_connect on v2:172.21.15.139:6838/3819947532 2024-04-20T12:33:32.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.192+0000 7f33393e3640 1 --2- 172.21.15.135:0/2053836511 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x558a616c5ea0 0x558a616c82c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3e3ba3b30202ade0 server_cookie=50e63fcdb535f37b in_seq=0 out_seq=0 2024-04-20T12:33:32.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.192+0000 7f331d7fa640 1 -- 172.21.15.135:0/2053836511 <== mds.1 v2:172.21.15.139:6838/3819947532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558a615b29a0 con 0x558a616c5ea0 2024-04-20T12:33:32.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.192+0000 7f331d7fa640 10 client.18765 handle_command_reply: tid=0 2024-04-20T12:33:32.198 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.192+0000 7f333ea30740 1 client.18765 shutdown 2024-04-20T12:33:32.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.192+0000 7f333ea30740 1 -- 172.21.15.135:0/2053836511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61646730 msgr2=0x558a61652a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.192+0000 7f333ea30740 1 --2- 172.21.15.135:0/2053836511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61646730 0x558a61652a60 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f333004e040 tx=0x7f3330003b50 comp rx=0 tx=0).stop 2024-04-20T12:33:32.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333ea30740 1 -- 172.21.15.135:0/2053836511 shutdown_connections 2024-04-20T12:33:32.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333ea30740 1 --2- 172.21.15.135:0/2053836511 >> [v2:172.21.15.139:6838/3819947532,v1:172.21.15.139:6839/3819947532] conn(0x558a616c5ea0 0x558a616c82c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333ea30740 1 --2- 172.21.15.135:0/2053836511 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x558a6164f310 0x558a61652fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f331d7fa640 0 client.18765 ms_handle_reset on v2:172.21.15.139:6838/3819947532 2024-04-20T12:33:32.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333ea30740 1 --2- 172.21.15.135:0/2053836511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a61646730 0x558a61652a60 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333ea30740 1 --2- 172.21.15.135:0/2053836511 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x558a61645e10 0x558a616575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333ea30740 1 -- 172.21.15.135:0/2053836511 >> 172.21.15.135:0/2053836511 conn(0x558a61640540 msgr2=0x558a616418f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333ea30740 1 -- 172.21.15.135:0/2053836511 shutdown_connections 2024-04-20T12:33:32.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333ea30740 1 -- 172.21.15.135:0/2053836511 wait complete. 2024-04-20T12:33:32.199 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333ea30740 20 client.18765 trim_cache size 0 max 16384 2024-04-20T12:33:32.200 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:33:32.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333be48640 1 -- 172.21.15.135:0/1766802965 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33200a3d20 msgr2=0x7f33200a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333be48640 1 --2- 172.21.15.135:0/1766802965 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33200a3d20 0x7f33200a61e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f332c098840 tx=0x7f332c06eed0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333be48640 1 -- 172.21.15.135:0/1766802965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333410c510 msgr2=0x7f333419a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333be48640 1 --2- 172.21.15.135:0/1766802965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333410c510 0x7f333419a870 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f332c00d950 tx=0x7f332c00de10 comp rx=0 tx=0).stop 2024-04-20T12:33:32.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333be48640 1 -- 172.21.15.135:0/1766802965 shutdown_connections 2024-04-20T12:33:32.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333be48640 1 --2- 172.21.15.135:0/1766802965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f333410c510 0x7f333419a870 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333be48640 1 --2- 172.21.15.135:0/1766802965 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3334103af0 0x7f33341a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333be48640 1 --2- 172.21.15.135:0/1766802965 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33200a3d20 0x7f33200a61e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333be48640 1 --2- 172.21.15.135:0/1766802965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33341031d0 0x7f33341a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.201 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333be48640 1 -- 172.21.15.135:0/1766802965 >> 172.21.15.135:0/1766802965 conn(0x7f3334078010 msgr2=0x7f33340fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333be48640 1 -- 172.21.15.135:0/1766802965 shutdown_connections 2024-04-20T12:33:32.202 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.193+0000 7f333be48640 1 -- 172.21.15.135:0/1766802965 wait complete. 2024-04-20T12:33:32.204 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-04-20T12:33:32.306 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.304+0000 7f12d4ec8640 1 -- 172.21.15.135:0/4288872560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d0101770 msgr2=0x7f12d0101b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.304+0000 7f12d4ec8640 1 --2- 172.21.15.135:0/4288872560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d0101770 0x7f12d0101b50 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f12c0009900 tx=0x7f12c002bc30 comp rx=0 tx=0).stop 2024-04-20T12:33:32.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.304+0000 7f12d4ec8640 1 -- 172.21.15.135:0/4288872560 shutdown_connections 2024-04-20T12:33:32.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.304+0000 7f12d4ec8640 1 --2- 172.21.15.135:0/4288872560 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d01061c0 0x7f12d010ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.304+0000 7f12d4ec8640 1 --2- 172.21.15.135:0/4288872560 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12d0102120 0x7f12d0105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.304+0000 7f12d4ec8640 1 --2- 172.21.15.135:0/4288872560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d0101770 0x7f12d0101b50 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.304+0000 7f12d4ec8640 1 -- 172.21.15.135:0/4288872560 >> 172.21.15.135:0/4288872560 conn(0x7f12d0077370 msgr2=0x7f12d00fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.305+0000 7f12d4ec8640 1 -- 172.21.15.135:0/4288872560 shutdown_connections 2024-04-20T12:33:32.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.305+0000 7f12d4ec8640 1 -- 172.21.15.135:0/4288872560 wait complete. 2024-04-20T12:33:32.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.305+0000 7f12d4ec8640 1 Processor -- start 2024-04-20T12:33:32.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.305+0000 7f12d4ec8640 1 -- start start 2024-04-20T12:33:32.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.305+0000 7f12d4ec8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d0101770 0x7f12d01a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.307 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.305+0000 7f12d4ec8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d01061c0 0x7f12d01a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.305+0000 7f12d4ec8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12d019a880 0x7f12d019ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.305+0000 7f12d4ec8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12d0111290 con 0x7f12d0101770 2024-04-20T12:33:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.305+0000 7f12d4ec8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f12d0111110 con 0x7f12d01061c0 2024-04-20T12:33:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.305+0000 7f12d4ec8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12d0111410 con 0x7f12d019a880 2024-04-20T12:33:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12ce59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d0101770 0x7f12d01a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12ce59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d0101770 0x7f12d01a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49312/0 (socket says 172.21.15.135:49312) 2024-04-20T12:33:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12ce59c640 1 -- 172.21.15.135:0/23302637 learned_addr learned my addr 172.21.15.135:0/23302637 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12c7fff640 1 --2- 172.21.15.135:0/23302637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d01061c0 0x7f12d01a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12ce59c640 1 -- 172.21.15.135:0/23302637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12d019a880 msgr2=0x7f12d019ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12ce59c640 1 --2- 172.21.15.135:0/23302637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12d019a880 0x7f12d019ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12ce59c640 1 -- 172.21.15.135:0/23302637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d01061c0 msgr2=0x7f12d01a0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12ce59c640 1 --2- 172.21.15.135:0/23302637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d01061c0 0x7f12d01a0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12ce59c640 1 -- 172.21.15.135:0/23302637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d019b3a0 con 0x7f12d0101770 2024-04-20T12:33:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12c7fff640 1 --2- 172.21.15.135:0/23302637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d01061c0 0x7f12d01a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:33:32.308 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12ce59c640 1 --2- 172.21.15.135:0/23302637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d0101770 0x7f12d01a06d0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f12c0006010 tx=0x7f12c002cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12c77fe640 1 -- 172.21.15.135:0/23302637 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c0041070 con 0x7f12d0101770 2024-04-20T12:33:32.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12d4ec8640 1 -- 172.21.15.135:0/23302637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d019b630 con 0x7f12d0101770 2024-04-20T12:33:32.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12c77fe640 1 -- 172.21.15.135:0/23302637 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12c0004450 con 0x7f12d0101770 2024-04-20T12:33:32.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12c77fe640 1 -- 172.21.15.135:0/23302637 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c0034440 con 0x7f12d0101770 2024-04-20T12:33:32.309 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.306+0000 7f12d4ec8640 1 -- 172.21.15.135:0/23302637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d01a7880 con 0x7f12d0101770 2024-04-20T12:33:32.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.309+0000 7f12c77fe640 1 -- 172.21.15.135:0/23302637 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f12c0044070 con 0x7f12d0101770 2024-04-20T12:33:32.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.309+0000 7f12d7b98740 1 Processor -- start 2024-04-20T12:33:32.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.309+0000 7f12d7b98740 1 -- start start 2024-04-20T12:33:32.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.309+0000 7f12d7b98740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e055e10 0x559e0e0561f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.309+0000 7f12d7b98740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e056730 0x559e0e05edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12d7b98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e05f310 0x559e0e061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12d7b98740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559e0dfbb110 con 0x559e0e056730 2024-04-20T12:33:32.316 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12d7b98740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559e0df58550 con 0x559e0e055e10 2024-04-20T12:33:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12d7b98740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e0dfb70d0 con 0x559e0e05f310 2024-04-20T12:33:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12ce59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e056730 0x559e0e05edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12ce59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e056730 0x559e0e05edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49328/0 (socket says 172.21.15.135:49328) 2024-04-20T12:33:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12ce59c640 1 -- 172.21.15.135:0/3225133911 learned_addr learned my addr 172.21.15.135:0/3225133911 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12ced9d640 1 --2- 172.21.15.135:0/3225133911 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e055e10 0x559e0e0561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12c7fff640 1 --2- 172.21.15.135:0/3225133911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e05f310 0x559e0e061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12ce59c640 1 -- 172.21.15.135:0/3225133911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e05f310 msgr2=0x559e0e061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12c77fe640 1 --2- 172.21.15.135:0/23302637 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12bc0a3d20 0x7f12bc0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12ce59c640 1 --2- 172.21.15.135:0/3225133911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e05f310 0x559e0e061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12ce59c640 1 -- 172.21.15.135:0/3225133911 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e055e10 msgr2=0x559e0e0561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12ce59c640 1 --2- 172.21.15.135:0/3225133911 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e055e10 0x559e0e0561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12ce59c640 1 -- 172.21.15.135:0/3225133911 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e0df80900 con 0x559e0e056730 2024-04-20T12:33:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12ced9d640 1 --2- 172.21.15.135:0/3225133911 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e055e10 0x559e0e0561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:33:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12c7fff640 1 --2- 172.21.15.135:0/3225133911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e05f310 0x559e0e061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:33:32.317 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12ced9d640 1 --2- 172.21.15.135:0/23302637 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12bc0a3d20 0x7f12bc0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12c77fe640 1 -- 172.21.15.135:0/23302637 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f12c00f27d0 con 0x7f12d0101770 2024-04-20T12:33:32.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12ce59c640 1 --2- 172.21.15.135:0/3225133911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e056730 0x559e0e05edd0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f12c00efba0 tx=0x7f12c00ba580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57aa1054dd859817 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12c4ff9640 1 -- 172.21.15.135:0/3225133911 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c004b070 con 0x559e0e056730 2024-04-20T12:33:32.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12c4ff9640 1 -- 172.21.15.135:0/3225133911 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12c00cdcb0 con 0x559e0e056730 2024-04-20T12:33:32.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.310+0000 7f12c4ff9640 1 -- 172.21.15.135:0/3225133911 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c00bdff0 con 0x559e0e056730 2024-04-20T12:33:32.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.311+0000 7f12d7b98740 1 -- 172.21.15.135:0/3225133911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e056730 msgr2=0x559e0e05edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.311+0000 7f12d7b98740 1 --2- 172.21.15.135:0/3225133911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e056730 0x559e0e05edd0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f12c00efba0 tx=0x7f12c00ba580 comp rx=0 tx=0).stop 2024-04-20T12:33:32.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.311+0000 7f12ced9d640 1 --2- 172.21.15.135:0/23302637 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12bc0a3d20 0x7f12bc0a61e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f12c8005c40 tx=0x7f12c8004a40 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.311+0000 7f12d7b98740 1 -- 172.21.15.135:0/3225133911 shutdown_connections 2024-04-20T12:33:32.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.311+0000 7f12d7b98740 1 --2- 172.21.15.135:0/3225133911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e05f310 0x559e0e061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.311+0000 7f12d7b98740 1 --2- 172.21.15.135:0/3225133911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e056730 0x559e0e05edd0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.311+0000 7f12d7b98740 1 --2- 172.21.15.135:0/3225133911 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e055e10 0x559e0e0561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.311+0000 7f12d7b98740 1 -- 172.21.15.135:0/3225133911 >> 172.21.15.135:0/3225133911 conn(0x559e0e050540 msgr2=0x559e0e050920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.318 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.311+0000 7f12d7b98740 1 -- 172.21.15.135:0/3225133911 shutdown_connections 2024-04-20T12:33:32.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.311+0000 7f12d7b98740 1 -- 172.21.15.135:0/3225133911 wait complete. 2024-04-20T12:33:32.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12d7b98740 1 -- start start 2024-04-20T12:33:32.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12d7b98740 1 Processor -- start 2024-04-20T12:33:32.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12d7b98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e055e10 0x559e0e05c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12d7b98740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e056730 0x559e0e05c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12d7b98740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e05f310 0x559e0e05ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12d7b98740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559e0e061ec0 con 0x559e0e056730 2024-04-20T12:33:32.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12d7b98740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x559e0df74500 con 0x559e0e05f310 2024-04-20T12:33:32.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12d7b98740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x559e0e062040 con 0x559e0e055e10 2024-04-20T12:33:32.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12d7b98740 10 client.0 _ll_register_callbacks cb 0x559e0df592f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:32.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12c7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e056730 0x559e0e05c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12c7fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e056730 0x559e0e05c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49334/0 (socket says 172.21.15.135:49334) 2024-04-20T12:33:32.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12c7fff640 1 -- 172.21.15.135:0/879718151 learned_addr learned my addr 172.21.15.135:0/879718151 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:32.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12ce59c640 1 --2- 172.21.15.135:0/879718151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e055e10 0x559e0e05c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.319 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12ced9d640 1 --2- 172.21.15.135:0/879718151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e05f310 0x559e0e05ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12c7fff640 1 -- 172.21.15.135:0/879718151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e055e10 msgr2=0x559e0e05c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12c7fff640 1 --2- 172.21.15.135:0/879718151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e055e10 0x559e0e05c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12c7fff640 1 -- 172.21.15.135:0/879718151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e05f310 msgr2=0x559e0e05ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12c7fff640 1 --2- 172.21.15.135:0/879718151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e05f310 0x559e0e05ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12c7fff640 1 -- 172.21.15.135:0/879718151 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e0dccd3f0 con 0x559e0e056730 2024-04-20T12:33:32.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12ce59c640 1 --2- 172.21.15.135:0/879718151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e055e10 0x559e0e05c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:33:32.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12c7fff640 1 --2- 172.21.15.135:0/879718151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e056730 0x559e0e05c950 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f12d0074670 tx=0x7f12b8010b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3341df0b062dd20e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.312+0000 7f12b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:32.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.313+0000 7f12b5ffb640 1 -- 172.21.15.135:0/879718151 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b8017070 con 0x559e0e056730 2024-04-20T12:33:32.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.313+0000 7f12b5ffb640 1 -- 172.21.15.135:0/879718151 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f12b800bac0 con 0x559e0e056730 2024-04-20T12:33:32.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.313+0000 7f12d7b98740 1 -- 172.21.15.135:0/879718151 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559e0dfc8b30 con 0x559e0e056730 2024-04-20T12:33:32.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.313+0000 7f12b5ffb640 1 -- 172.21.15.135:0/879718151 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f12b8026050 con 0x559e0e056730 2024-04-20T12:33:32.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.313+0000 7f12d7b98740 10 client.18777 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:32.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.313+0000 7f12d7b98740 1 -- 172.21.15.135:0/879718151 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559e0dd977d0 con 0x559e0e056730 2024-04-20T12:33:32.320 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.313+0000 7f12b5ffb640 1 -- 172.21.15.135:0/879718151 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x559e0dfc8b30 con 0x559e0e056730 2024-04-20T12:33:32.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.313+0000 7f12b5ffb640 1 -- 172.21.15.135:0/879718151 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f12b801b400 con 0x559e0e056730 2024-04-20T12:33:32.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.313+0000 7f12d7b98740 10 client.18777 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:32.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.313+0000 7f12d7b98740 10 client.18777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:33:32.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.313+0000 7f12d7b98740 20 client.18777 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:32.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.313+0000 7f12d7b98740 1 --2- 172.21.15.135:0/879718151 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e0e06f440 0x559e0e0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.313+0000 7f12d7b98740 4 client.18777 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T12:33:32.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.313+0000 7f12d7b98740 1 -- 172.21.15.135:0/879718151 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e0dfc29a0 con 0x559e0e06f440 2024-04-20T12:33:32.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.313+0000 7f12ce59c640 1 --2- 172.21.15.135:0/879718151 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e0e06f440 0x559e0e0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.314+0000 7f12b5ffb640 10 client.18777 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:32.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.314+0000 7f12ce59c640 1 --2- 172.21.15.135:0/879718151 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e0e06f440 0x559e0e0718c0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e290a57e02830af5 server_cookie=f11c2f419e57f6e3 in_seq=0 out_seq=0 2024-04-20T12:33:32.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.314+0000 7f12b5ffb640 1 -- 172.21.15.135:0/879718151 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559e0dfc29a0 con 0x559e0e06f440 2024-04-20T12:33:32.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.314+0000 7f12b5ffb640 10 client.18777 handle_command_reply: tid=0 2024-04-20T12:33:32.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.315+0000 7f12d7b98740 1 client.18777 shutdown 2024-04-20T12:33:32.321 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.315+0000 7f12d7b98740 1 -- 172.21.15.135:0/879718151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e056730 msgr2=0x559e0e05c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.315+0000 7f12d7b98740 1 --2- 172.21.15.135:0/879718151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e056730 0x559e0e05c950 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f12d0074670 tx=0x7f12b8010b60 comp rx=0 tx=0).stop 2024-04-20T12:33:32.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.315+0000 7f12d7b98740 1 -- 172.21.15.135:0/879718151 shutdown_connections 2024-04-20T12:33:32.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.315+0000 7f12d7b98740 1 --2- 172.21.15.135:0/879718151 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e0e06f440 0x559e0e0718c0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.315+0000 7f12d7b98740 1 --2- 172.21.15.135:0/879718151 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e05f310 0x559e0e05ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.315+0000 7f12d7b98740 1 --2- 172.21.15.135:0/879718151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e056730 0x559e0e05c950 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.315+0000 7f12b5ffb640 0 client.18777 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:32.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.315+0000 7f12d7b98740 1 --2- 172.21.15.135:0/879718151 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e055e10 0x559e0e05c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.315+0000 7f12d7b98740 1 -- 172.21.15.135:0/879718151 >> 172.21.15.135:0/879718151 conn(0x559e0e050540 msgr2=0x559e0e052290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.315+0000 7f12d7b98740 1 -- 172.21.15.135:0/879718151 shutdown_connections 2024-04-20T12:33:32.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.315+0000 7f12d7b98740 1 -- 172.21.15.135:0/879718151 wait complete. 2024-04-20T12:33:32.322 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.315+0000 7f12d7b98740 20 client.18777 trim_cache size 0 max 16384 2024-04-20T12:33:32.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12d7b98740 1 Processor -- start 2024-04-20T12:33:32.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12d7b98740 1 -- start start 2024-04-20T12:33:32.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12d7b98740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e055e10 0x559e0e05eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12d7b98740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e056730 0x559e0e06b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12d7b98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e05f310 0x559e0e06abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12d7b98740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01b17d0 con 0x559e0e055e10 2024-04-20T12:33:32.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12d7b98740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01b3310 con 0x559e0e056730 2024-04-20T12:33:32.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12d7b98740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01b1ea0 con 0x559e0e05f310 2024-04-20T12:33:32.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12ce59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e055e10 0x559e0e05eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12ce59c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e055e10 0x559e0e05eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49336/0 (socket says 172.21.15.135:49336) 2024-04-20T12:33:32.333 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12ce59c640 1 -- 172.21.15.135:0/3517442149 learned_addr learned my addr 172.21.15.135:0/3517442149 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:32.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12ce59c640 1 -- 172.21.15.135:0/3517442149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e05f310 msgr2=0x559e0e06abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12ce59c640 1 --2- 172.21.15.135:0/3517442149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e05f310 0x559e0e06abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12ce59c640 1 -- 172.21.15.135:0/3517442149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e056730 msgr2=0x559e0e06b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12ce59c640 1 --2- 172.21.15.135:0/3517442149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e056730 0x559e0e06b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.328+0000 7f12ce59c640 1 -- 172.21.15.135:0/3517442149 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e0e05b3c0 con 0x559e0e055e10 2024-04-20T12:33:32.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.329+0000 7f12ce59c640 1 --2- 172.21.15.135:0/3517442149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e055e10 0x559e0e05eb40 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f12c00be440 tx=0x7f12c002bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a40ff7f7992c85 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.329+0000 7f12b7fff640 1 -- 172.21.15.135:0/3517442149 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c004b040 con 0x559e0e055e10 2024-04-20T12:33:32.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.329+0000 7f12b7fff640 1 -- 172.21.15.135:0/3517442149 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12c00f8380 con 0x559e0e055e10 2024-04-20T12:33:32.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.329+0000 7f12b7fff640 1 -- 172.21.15.135:0/3517442149 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c00cdab0 con 0x559e0e055e10 2024-04-20T12:33:32.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.329+0000 7f12d7b98740 1 -- 172.21.15.135:0/3517442149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e055e10 msgr2=0x559e0e05eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.329+0000 7f12d7b98740 1 --2- 172.21.15.135:0/3517442149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e055e10 0x559e0e05eb40 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f12c00be440 tx=0x7f12c002bc30 comp rx=0 tx=0).stop 2024-04-20T12:33:32.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.329+0000 7f12d7b98740 1 -- 172.21.15.135:0/3517442149 shutdown_connections 2024-04-20T12:33:32.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.329+0000 7f12d7b98740 1 --2- 172.21.15.135:0/3517442149 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e05f310 0x559e0e06abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.329+0000 7f12d7b98740 1 --2- 172.21.15.135:0/3517442149 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e056730 0x559e0e06b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.334 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.329+0000 7f12d7b98740 1 --2- 172.21.15.135:0/3517442149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e055e10 0x559e0e05eb40 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.329+0000 7f12d7b98740 1 -- 172.21.15.135:0/3517442149 >> 172.21.15.135:0/3517442149 conn(0x559e0e050540 msgr2=0x559e0e050920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.329+0000 7f12d7b98740 1 -- 172.21.15.135:0/3517442149 shutdown_connections 2024-04-20T12:33:32.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.329+0000 7f12d7b98740 1 -- 172.21.15.135:0/3517442149 wait complete. 2024-04-20T12:33:32.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12d7b98740 1 -- start start 2024-04-20T12:33:32.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12d7b98740 1 Processor -- start 2024-04-20T12:33:32.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12d7b98740 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e055e10 0x559e0e062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12d7b98740 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e056730 0x559e0e062fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12d7b98740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e05f310 0x559e0e063510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12d7b98740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01b2c40 con 0x559e0e05f310 2024-04-20T12:33:32.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12d7b98740 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01b2570 con 0x559e0e056730 2024-04-20T12:33:32.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12d7b98740 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01af7a0 con 0x559e0e055e10 2024-04-20T12:33:32.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12d7b98740 10 client.0 _ll_register_callbacks cb 0x7f12b800e370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T12:33:32.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12ced9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e05f310 0x559e0e063510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.335 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12ced9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e05f310 0x559e0e063510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49352/0 (socket says 172.21.15.135:49352) 2024-04-20T12:33:32.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12ced9d640 1 -- 172.21.15.135:0/2165303079 learned_addr learned my addr 172.21.15.135:0/2165303079 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:32.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12c7fff640 1 --2- 172.21.15.135:0/2165303079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e056730 0x559e0e062fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12ce59c640 1 --2- 172.21.15.135:0/2165303079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e055e10 0x559e0e062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12ced9d640 1 -- 172.21.15.135:0/2165303079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e055e10 msgr2=0x559e0e062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12ced9d640 1 --2- 172.21.15.135:0/2165303079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e055e10 0x559e0e062a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12ced9d640 1 -- 172.21.15.135:0/2165303079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e056730 msgr2=0x559e0e062fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T12:33:32.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12ced9d640 1 --2- 172.21.15.135:0/2165303079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e056730 0x559e0e062fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.330+0000 7f12ced9d640 1 -- 172.21.15.135:0/2165303079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e0e0d4a40 con 0x559e0e05f310 2024-04-20T12:33:32.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12ced9d640 1 --2- 172.21.15.135:0/2165303079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e05f310 0x559e0e063510 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f12c801e7b0 tx=0x7f12c801ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c6ba90e6ebd295 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:32.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-04-20T12:33:32.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12b5ffb640 1 -- 172.21.15.135:0/2165303079 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8012c80 con 0x559e0e05f310 2024-04-20T12:33:32.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12b5ffb640 1 -- 172.21.15.135:0/2165303079 <== mon.0 v2:172.21.15.135:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f12c801b450 con 0x559e0e05f310 2024-04-20T12:33:32.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12d7b98740 1 -- 172.21.15.135:0/2165303079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12c00f8380 con 0x559e0e05f310 2024-04-20T12:33:32.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12b5ffb640 1 -- 172.21.15.135:0/2165303079 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f12c8012e20 con 0x559e0e05f310 2024-04-20T12:33:32.336 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12d7b98740 10 client.18783 fetch_fsmap learned FSMap version 29 2024-04-20T12:33:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12d7b98740 1 -- 172.21.15.135:0/2165303079 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559e0e0d5ca0 con 0x559e0e05f310 2024-04-20T12:33:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12b5ffb640 1 -- 172.21.15.135:0/2165303079 <== mon.0 v2:172.21.15.135:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12c00f8380 con 0x559e0e05f310 2024-04-20T12:33:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12b5ffb640 1 -- 172.21.15.135:0/2165303079 <== mon.0 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8363+0+0 (secure 0 0 0) 0x7f12c8025070 con 0x559e0e05f310 2024-04-20T12:33:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12d7b98740 10 client.18783 fetch_fsmap finished waiting for FSMap version 29 2024-04-20T12:33:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12d7b98740 10 client.18783 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-04-20T12:33:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12d7b98740 20 client.18783 populate_metadata read hostname 'smithi135' 2024-04-20T12:33:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12d7b98740 1 --2- 172.21.15.135:0/2165303079 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e0e0d64a0 0x559e0e0d88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12d7b98740 4 client.18783 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-04-20T12:33:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12d7b98740 1 -- 172.21.15.135:0/2165303079 --> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e0df3e6e0 con 0x559e0e0d64a0 2024-04-20T12:33:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.331+0000 7f12ce59c640 1 --2- 172.21.15.135:0/2165303079 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e0e0d64a0 0x559e0e0d88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12b5ffb640 10 client.18783 ms_handle_connect on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12ce59c640 1 --2- 172.21.15.135:0/2165303079 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e0e0d64a0 0x559e0e0d88c0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa98d0fd03209c50 server_cookie=7f27629e68db67fd in_seq=0 out_seq=0 2024-04-20T12:33:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12b5ffb640 1 -- 172.21.15.135:0/2165303079 <== mds.0 v2:172.21.15.154:6838/1672287462 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e0df3e6e0 con 0x559e0e0d64a0 2024-04-20T12:33:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12b5ffb640 10 client.18783 handle_command_reply: tid=0 2024-04-20T12:33:32.337 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12d7b98740 1 client.18783 shutdown 2024-04-20T12:33:32.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12d7b98740 1 -- 172.21.15.135:0/2165303079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e05f310 msgr2=0x559e0e063510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12d7b98740 1 --2- 172.21.15.135:0/2165303079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e05f310 0x559e0e063510 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f12c801e7b0 tx=0x7f12c801ebb0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12d7b98740 1 -- 172.21.15.135:0/2165303079 shutdown_connections 2024-04-20T12:33:32.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12d7b98740 1 --2- 172.21.15.135:0/2165303079 >> [v2:172.21.15.154:6838/1672287462,v1:172.21.15.154:6839/1672287462] conn(0x559e0e0d64a0 0x559e0e0d88c0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12d7b98740 1 --2- 172.21.15.135:0/2165303079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e0e05f310 0x559e0e063510 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12d7b98740 1 --2- 172.21.15.135:0/2165303079 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x559e0e056730 0x559e0e062fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12b5ffb640 0 client.18783 ms_handle_reset on v2:172.21.15.154:6838/1672287462 2024-04-20T12:33:32.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12d7b98740 1 --2- 172.21.15.135:0/2165303079 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559e0e055e10 0x559e0e062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12d7b98740 1 -- 172.21.15.135:0/2165303079 >> 172.21.15.135:0/2165303079 conn(0x559e0e050540 msgr2=0x559e0e05cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12d7b98740 1 -- 172.21.15.135:0/2165303079 shutdown_connections 2024-04-20T12:33:32.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12d7b98740 1 -- 172.21.15.135:0/2165303079 wait complete. 2024-04-20T12:33:32.338 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.332+0000 7f12d7b98740 20 client.18783 trim_cache size 0 max 16384 2024-04-20T12:33:32.339 INFO:teuthology.orchestra.run.smithi135.stdout:[] 2024-04-20T12:33:32.339 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.333+0000 7f12d4ec8640 1 -- 172.21.15.135:0/23302637 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12bc0a3d20 msgr2=0x7f12bc0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.333+0000 7f12d4ec8640 1 --2- 172.21.15.135:0/23302637 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12bc0a3d20 0x7f12bc0a61e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f12c8005c40 tx=0x7f12c8004a40 comp rx=0 tx=0).stop 2024-04-20T12:33:32.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.333+0000 7f12d4ec8640 1 -- 172.21.15.135:0/23302637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d0101770 msgr2=0x7f12d01a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:32.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.333+0000 7f12d4ec8640 1 --2- 172.21.15.135:0/23302637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d0101770 0x7f12d01a06d0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f12c0006010 tx=0x7f12c002cc70 comp rx=0 tx=0).stop 2024-04-20T12:33:32.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.333+0000 7f12d4ec8640 1 -- 172.21.15.135:0/23302637 shutdown_connections 2024-04-20T12:33:32.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.333+0000 7f12d4ec8640 1 --2- 172.21.15.135:0/23302637 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12bc0a3d20 0x7f12bc0a61e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.333+0000 7f12d4ec8640 1 --2- 172.21.15.135:0/23302637 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12d019a880 0x7f12d019ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.333+0000 7f12d4ec8640 1 --2- 172.21.15.135:0/23302637 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12d01061c0 0x7f12d01a0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.333+0000 7f12d4ec8640 1 --2- 172.21.15.135:0/23302637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d0101770 0x7f12d01a06d0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:32.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.333+0000 7f12d4ec8640 1 -- 172.21.15.135:0/23302637 >> 172.21.15.135:0/23302637 conn(0x7f12d0077370 msgr2=0x7f12d0105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:32.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.333+0000 7f12d4ec8640 1 -- 172.21.15.135:0/23302637 shutdown_connections 2024-04-20T12:33:32.340 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:32.333+0000 7f12d4ec8640 1 -- 172.21.15.135:0/23302637 wait complete. 2024-04-20T12:33:32.829 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:32 smithi139 ceph-mon[21834]: pgmap v323: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:32.830 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:32 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/472410829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:33:32.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:32 smithi135 ceph-mon[18264]: pgmap v323: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:32.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:32 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/472410829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:33:33.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:32 smithi154 ceph-mon[22073]: pgmap v323: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:33.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:32 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/472410829' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:33:33.344 INFO:tasks.fwd_scrub.fs.[cephfs]:end scrubbing fs: cephfs 2024-04-20T12:33:33.344 INFO:tasks.fwd_scrub:done joining 2024-04-20T12:33:33.345 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-04-20T12:33:33.363 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:33:33.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.476+0000 7fc8c581e640 1 -- 172.21.15.135:0/2021707182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8c0107280 msgr2=0x7fc8c010ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:33.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.476+0000 7fc8c581e640 1 --2- 172.21.15.135:0/2021707182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8c0107280 0x7fc8c010ee50 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009ca0 tx=0x7fc8b802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.476+0000 7fc8c581e640 1 -- 172.21.15.135:0/2021707182 shutdown_connections 2024-04-20T12:33:33.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.476+0000 7fc8c581e640 1 --2- 172.21.15.135:0/2021707182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8c0107280 0x7fc8c010ee50 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.476+0000 7fc8c581e640 1 --2- 172.21.15.135:0/2021707182 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8c006b2a0 0x7fc8c0106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.476+0000 7fc8c581e640 1 --2- 172.21.15.135:0/2021707182 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c006a8f0 0x7fc8c006acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.476+0000 7fc8c581e640 1 -- 172.21.15.135:0/2021707182 >> 172.21.15.135:0/2021707182 conn(0x7fc8c0077f30 msgr2=0x7fc8c0078340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:33.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.476+0000 7fc8c581e640 1 -- 172.21.15.135:0/2021707182 shutdown_connections 2024-04-20T12:33:33.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.476+0000 7fc8c581e640 1 -- 172.21.15.135:0/2021707182 wait complete. 2024-04-20T12:33:33.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.476+0000 7fc8c581e640 1 Processor -- start 2024-04-20T12:33:33.477 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8c581e640 1 -- start start 2024-04-20T12:33:33.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8c581e640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c006a8f0 0x7fc8c019e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:33.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8c581e640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8c0107280 0x7fc8c019e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:33.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8c581e640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8c0198650 0x7fc8c0198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:33.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8c581e640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c0112390 con 0x7fc8c0198650 2024-04-20T12:33:33.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8c581e640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c0112210 con 0x7fc8c0107280 2024-04-20T12:33:33.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8c581e640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c0112510 con 0x7fc8c006a8f0 2024-04-20T12:33:33.479 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8bf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8c0198650 0x7fc8c0198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:33.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8bf7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8c0198650 0x7fc8c0198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49370/0 (socket says 172.21.15.135:49370) 2024-04-20T12:33:33.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8bf7fe640 1 -- 172.21.15.135:0/799522592 learned_addr learned my addr 172.21.15.135:0/799522592 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:33.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8be7fc640 1 --2- 172.21.15.135:0/799522592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8c0107280 0x7fc8c019e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:33.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8beffd640 1 --2- 172.21.15.135:0/799522592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c006a8f0 0x7fc8c019e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:33.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8bf7fe640 1 -- 172.21.15.135:0/799522592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c006a8f0 msgr2=0x7fc8c019e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:33.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8bf7fe640 1 --2- 172.21.15.135:0/799522592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c006a8f0 0x7fc8c019e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8bf7fe640 1 -- 172.21.15.135:0/799522592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8c0107280 msgr2=0x7fc8c019e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:33.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8bf7fe640 1 --2- 172.21.15.135:0/799522592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8c0107280 0x7fc8c019e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.477+0000 7fc8bf7fe640 1 -- 172.21.15.135:0/799522592 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c0199170 con 0x7fc8c0198650 2024-04-20T12:33:33.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.478+0000 7fc8bf7fe640 1 --2- 172.21.15.135:0/799522592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8c0198650 0x7fc8c0198b00 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fc8b802c700 tx=0x7fc8b8035b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:33.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.478+0000 7fc8c481c640 1 -- 172.21.15.135:0/799522592 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8039040 con 0x7fc8c0198650 2024-04-20T12:33:33.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.478+0000 7fc8c481c640 1 -- 172.21.15.135:0/799522592 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8b8044070 con 0x7fc8c0198650 2024-04-20T12:33:33.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.478+0000 7fc8c581e640 1 -- 172.21.15.135:0/799522592 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c0199400 con 0x7fc8c0198650 2024-04-20T12:33:33.480 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.478+0000 7fc8c481c640 1 -- 172.21.15.135:0/799522592 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b80043a0 con 0x7fc8c0198650 2024-04-20T12:33:33.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.478+0000 7fc8c581e640 1 -- 172.21.15.135:0/799522592 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c01a55a0 con 0x7fc8c0198650 2024-04-20T12:33:33.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.479+0000 7fc8c581e640 1 -- 172.21.15.135:0/799522592 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c00691d0 con 0x7fc8c0198650 2024-04-20T12:33:33.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.480+0000 7fc8c481c640 1 -- 172.21.15.135:0/799522592 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fc8b8004540 con 0x7fc8c0198650 2024-04-20T12:33:33.481 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.480+0000 7fc8c481c640 1 --2- 172.21.15.135:0/799522592 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc8a80a3d20 0x7fc8a80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:33.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.480+0000 7fc8beffd640 1 --2- 172.21.15.135:0/799522592 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc8a80a3d20 0x7fc8a80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:33.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.481+0000 7fc8c481c640 1 -- 172.21.15.135:0/799522592 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7fc8b80f3010 con 0x7fc8c0198650 2024-04-20T12:33:33.482 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.481+0000 7fc8beffd640 1 --2- 172.21.15.135:0/799522592 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc8a80a3d20 0x7fc8a80a61e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009890 tx=0x7fc8b0008040 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:33.484 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.485+0000 7fc8c481c640 1 -- 172.21.15.135:0/799522592 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fc8b80bf3f0 con 0x7fc8c0198650 2024-04-20T12:33:33.666 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.667+0000 7fc8c581e640 1 -- 172.21.15.135:0/799522592 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8c010a4e0 con 0x7fc8c0198650 2024-04-20T12:33:33.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.668+0000 7fc8c481c640 1 -- 172.21.15.135:0/799522592 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+25383 (secure 0 0 0) 0x7fc8b80becf0 con 0x7fc8c0198650 2024-04-20T12:33:33.668 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:33:33.668 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":103,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:33:13.461396+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":102,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2052292307":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/669936771":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/4276159294":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6800/3831149339":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/1087722944":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6801/3831149339":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:33:33.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.670+0000 7fc8c581e640 1 -- 172.21.15.135:0/799522592 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc8a80a3d20 msgr2=0x7fc8a80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:33.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.670+0000 7fc8c581e640 1 --2- 172.21.15.135:0/799522592 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc8a80a3d20 0x7fc8a80a61e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009890 tx=0x7fc8b0008040 comp rx=0 tx=0).stop 2024-04-20T12:33:33.670 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.670+0000 7fc8c581e640 1 -- 172.21.15.135:0/799522592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8c0198650 msgr2=0x7fc8c0198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:33.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.670+0000 7fc8c581e640 1 --2- 172.21.15.135:0/799522592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8c0198650 0x7fc8c0198b00 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fc8b802c700 tx=0x7fc8b8035b60 comp rx=0 tx=0).stop 2024-04-20T12:33:33.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.671+0000 7fc8c581e640 1 -- 172.21.15.135:0/799522592 shutdown_connections 2024-04-20T12:33:33.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.671+0000 7fc8c581e640 1 --2- 172.21.15.135:0/799522592 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc8c0198650 0x7fc8c0198b00 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.671+0000 7fc8c581e640 1 --2- 172.21.15.135:0/799522592 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fc8c0107280 0x7fc8c019e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.671+0000 7fc8c581e640 1 --2- 172.21.15.135:0/799522592 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fc8a80a3d20 0x7fc8a80a61e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.671+0000 7fc8c581e640 1 --2- 172.21.15.135:0/799522592 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc8c006a8f0 0x7fc8c019e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.671+0000 7fc8c581e640 1 -- 172.21.15.135:0/799522592 >> 172.21.15.135:0/799522592 conn(0x7fc8c0077f30 msgr2=0x7fc8c00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:33.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.671+0000 7fc8c581e640 1 -- 172.21.15.135:0/799522592 shutdown_connections 2024-04-20T12:33:33.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.671+0000 7fc8c581e640 1 -- 172.21.15.135:0/799522592 wait complete. 2024-04-20T12:33:33.682 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T12:16:02.802023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T12:20:39.656129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T12:20:40.312827+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 102, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T12:20:44.307136+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 102, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T12:33:33.682 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T12:33:33.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.783+0000 7fbeb4759640 1 -- 172.21.15.135:0/4269864977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbeac106180 msgr2=0x7fbeac10dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:33.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.783+0000 7fbeb4759640 1 --2- 172.21.15.135:0/4269864977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbeac106180 0x7fbeac10dd50 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009ca0 tx=0x7fbea402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.783+0000 7fbeb4759640 1 -- 172.21.15.135:0/4269864977 shutdown_connections 2024-04-20T12:33:33.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.783+0000 7fbeb4759640 1 --2- 172.21.15.135:0/4269864977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbeac106180 0x7fbeac10dd50 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.783+0000 7fbeb4759640 1 --2- 172.21.15.135:0/4269864977 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeac101a60 0x7fbeac105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.783+0000 7fbeb4759640 1 --2- 172.21.15.135:0/4269864977 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbeac1010b0 0x7fbeac101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.783+0000 7fbeb4759640 1 -- 172.21.15.135:0/4269864977 >> 172.21.15.135:0/4269864977 conn(0x7fbeac077ec0 msgr2=0x7fbeac0782d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:33.785 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.783+0000 7fbeb4759640 1 -- 172.21.15.135:0/4269864977 shutdown_connections 2024-04-20T12:33:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.783+0000 7fbeb4759640 1 -- 172.21.15.135:0/4269864977 wait complete. 2024-04-20T12:33:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb4759640 1 Processor -- start 2024-04-20T12:33:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb4759640 1 -- start start 2024-04-20T12:33:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb4759640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbeac1010b0 0x7fbeac1977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb4759640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeac106180 0x7fbeac197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb4759640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbeac19c020 0x7fbeac19c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb4759640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac111310 con 0x7fbeac19c020 2024-04-20T12:33:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb4759640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac111190 con 0x7fbeac1010b0 2024-04-20T12:33:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb4759640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac111490 con 0x7fbeac106180 2024-04-20T12:33:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb2cf6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbeac19c020 0x7fbeac19c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb2cf6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbeac19c020 0x7fbeac19c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49388/0 (socket says 172.21.15.135:49388) 2024-04-20T12:33:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb2cf6640 1 -- 172.21.15.135:0/1257755373 learned_addr learned my addr 172.21.15.135:0/1257755373 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb24f5640 1 --2- 172.21.15.135:0/1257755373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbeac1010b0 0x7fbeac1977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb2cf6640 1 -- 172.21.15.135:0/1257755373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeac106180 msgr2=0x7fbeac197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:33.786 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb1cf4640 1 --2- 172.21.15.135:0/1257755373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeac106180 0x7fbeac197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:33.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb2cf6640 1 --2- 172.21.15.135:0/1257755373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeac106180 0x7fbeac197cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb2cf6640 1 -- 172.21.15.135:0/1257755373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbeac1010b0 msgr2=0x7fbeac1977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:33.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb2cf6640 1 --2- 172.21.15.135:0/1257755373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbeac1010b0 0x7fbeac1977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb2cf6640 1 -- 172.21.15.135:0/1257755373 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeac19cb10 con 0x7fbeac19c020 2024-04-20T12:33:33.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.784+0000 7fbeb24f5640 1 --2- 172.21.15.135:0/1257755373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbeac1010b0 0x7fbeac1977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:33:33.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.785+0000 7fbeb2cf6640 1 --2- 172.21.15.135:0/1257755373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbeac19c020 0x7fbeac19c4d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fbea402c700 tx=0x7fbea4035b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:33.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.785+0000 7fbea37fe640 1 -- 172.21.15.135:0/1257755373 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea4039040 con 0x7fbeac19c020 2024-04-20T12:33:33.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.785+0000 7fbeb4759640 1 -- 172.21.15.135:0/1257755373 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeac19cda0 con 0x7fbeac19c020 2024-04-20T12:33:33.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.785+0000 7fbea37fe640 1 -- 172.21.15.135:0/1257755373 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbea4044070 con 0x7fbeac19c020 2024-04-20T12:33:33.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.785+0000 7fbea37fe640 1 -- 172.21.15.135:0/1257755373 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea40043a0 con 0x7fbeac19c020 2024-04-20T12:33:33.787 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.785+0000 7fbeb4759640 1 -- 172.21.15.135:0/1257755373 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeac1a4560 con 0x7fbeac19c020 2024-04-20T12:33:33.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.786+0000 7fbeb4759640 1 -- 172.21.15.135:0/1257755373 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeac0691d0 con 0x7fbeac19c020 2024-04-20T12:33:33.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.787+0000 7fbea37fe640 1 -- 172.21.15.135:0/1257755373 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fbea4004540 con 0x7fbeac19c020 2024-04-20T12:33:33.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.787+0000 7fbea37fe640 1 --2- 172.21.15.135:0/1257755373 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbe980a3d20 0x7fbe980a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:33.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.787+0000 7fbeb24f5640 1 --2- 172.21.15.135:0/1257755373 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbe980a3d20 0x7fbe980a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:33.788 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.787+0000 7fbea37fe640 1 -- 172.21.15.135:0/1257755373 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7fbea40f3140 con 0x7fbeac19c020 2024-04-20T12:33:33.789 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.788+0000 7fbeb24f5640 1 --2- 172.21.15.135:0/1257755373 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbe980a3d20 0x7fbe980a61e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbea8006fd0 tx=0x7fbea8008040 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:33.791 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.792+0000 7fbea37fe640 1 -- 172.21.15.135:0/1257755373 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fbea40bf520 con 0x7fbeac19c020 2024-04-20T12:33:33.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.968+0000 7fbeb4759640 1 -- 172.21.15.135:0/1257755373 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbeac101a60 con 0x7fbeac19c020 2024-04-20T12:33:33.968 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.969+0000 7fbea37fe640 1 -- 172.21.15.135:0/1257755373 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) ==== 93+0+10 (secure 0 0 0) 0x7fbea40bee20 con 0x7fbeac19c020 2024-04-20T12:33:33.969 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-04-20T12:33:33.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.971+0000 7fbeb4759640 1 -- 172.21.15.135:0/1257755373 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbe980a3d20 msgr2=0x7fbe980a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:33.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.971+0000 7fbeb4759640 1 --2- 172.21.15.135:0/1257755373 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbe980a3d20 0x7fbe980a61e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbea8006fd0 tx=0x7fbea8008040 comp rx=0 tx=0).stop 2024-04-20T12:33:33.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.971+0000 7fbeb4759640 1 -- 172.21.15.135:0/1257755373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbeac19c020 msgr2=0x7fbeac19c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:33.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.971+0000 7fbeb4759640 1 --2- 172.21.15.135:0/1257755373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbeac19c020 0x7fbeac19c4d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fbea402c700 tx=0x7fbea4035b60 comp rx=0 tx=0).stop 2024-04-20T12:33:33.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.971+0000 7fbeb4759640 1 -- 172.21.15.135:0/1257755373 shutdown_connections 2024-04-20T12:33:33.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.971+0000 7fbeb4759640 1 --2- 172.21.15.135:0/1257755373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbeac19c020 0x7fbeac19c4d0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.971+0000 7fbeb4759640 1 --2- 172.21.15.135:0/1257755373 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fbe980a3d20 0x7fbe980a61e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.971+0000 7fbeb4759640 1 --2- 172.21.15.135:0/1257755373 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeac106180 0x7fbeac197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.971+0000 7fbeb4759640 1 --2- 172.21.15.135:0/1257755373 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fbeac1010b0 0x7fbeac1977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:33.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.971+0000 7fbeb4759640 1 -- 172.21.15.135:0/1257755373 >> 172.21.15.135:0/1257755373 conn(0x7fbeac077ec0 msgr2=0x7fbeac0fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:33.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.971+0000 7fbeb4759640 1 -- 172.21.15.135:0/1257755373 shutdown_connections 2024-04-20T12:33:33.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:33.971+0000 7fbeb4759640 1 -- 172.21.15.135:0/1257755373 wait complete. 2024-04-20T12:33:33.981 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T12:33:34.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.083+0000 7f7d8d3e6640 1 -- 172.21.15.135:0/1105961985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d881010a0 msgr2=0x7f7d88101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.083+0000 7f7d8d3e6640 1 --2- 172.21.15.135:0/1105961985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d881010a0 0x7f7d88101480 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009900 tx=0x7f7d7c02bc30 comp rx=0 tx=0).stop 2024-04-20T12:33:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.083+0000 7f7d8d3e6640 1 -- 172.21.15.135:0/1105961985 shutdown_connections 2024-04-20T12:33:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.083+0000 7f7d8d3e6640 1 --2- 172.21.15.135:0/1105961985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d88106170 0x7f7d8810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.083+0000 7f7d8d3e6640 1 --2- 172.21.15.135:0/1105961985 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d88101a50 0x7f7d88105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.083+0000 7f7d8d3e6640 1 --2- 172.21.15.135:0/1105961985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d881010a0 0x7f7d88101480 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.083+0000 7f7d8d3e6640 1 -- 172.21.15.135:0/1105961985 >> 172.21.15.135:0/1105961985 conn(0x7f7d880771e0 msgr2=0x7f7d880775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.083+0000 7f7d8d3e6640 1 -- 172.21.15.135:0/1105961985 shutdown_connections 2024-04-20T12:33:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.083+0000 7f7d8d3e6640 1 -- 172.21.15.135:0/1105961985 wait complete. 2024-04-20T12:33:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.083+0000 7f7d8d3e6640 1 Processor -- start 2024-04-20T12:33:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.083+0000 7f7d8d3e6640 1 -- start start 2024-04-20T12:33:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d8d3e6640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d881010a0 0x7f7d88199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d8d3e6640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d88106170 0x7f7d88199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.085 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d8d3e6640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d8819a120 0x7f7d881a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d8d3e6640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88111230 con 0x7f7d8819a120 2024-04-20T12:33:34.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d8d3e6640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881110b0 con 0x7f7d881010a0 2024-04-20T12:33:34.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d8d3e6640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7d881113b0 con 0x7f7d88106170 2024-04-20T12:33:34.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d877fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d8819a120 0x7f7d881a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:34.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d877fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d8819a120 0x7f7d881a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49394/0 (socket says 172.21.15.135:49394) 2024-04-20T12:33:34.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d877fe640 1 -- 172.21.15.135:0/1598946624 learned_addr learned my addr 172.21.15.135:0/1598946624 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:34.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d86ffd640 1 --2- 172.21.15.135:0/1598946624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d881010a0 0x7f7d88199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:34.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d867fc640 1 --2- 172.21.15.135:0/1598946624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d88106170 0x7f7d88199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:34.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d877fe640 1 -- 172.21.15.135:0/1598946624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d88106170 msgr2=0x7f7d88199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d877fe640 1 --2- 172.21.15.135:0/1598946624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d88106170 0x7f7d88199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d877fe640 1 -- 172.21.15.135:0/1598946624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d881010a0 msgr2=0x7f7d88199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d877fe640 1 --2- 172.21.15.135:0/1598946624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d881010a0 0x7f7d88199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d877fe640 1 -- 172.21.15.135:0/1598946624 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d881a4ed0 con 0x7f7d8819a120 2024-04-20T12:33:34.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d877fe640 1 --2- 172.21.15.135:0/1598946624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d8819a120 0x7f7d881a46d0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000eaa0 tx=0x7f7d8000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:34.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d6ffff640 1 -- 172.21.15.135:0/1598946624 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000cdb0 con 0x7f7d8819a120 2024-04-20T12:33:34.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d8d3e6640 1 -- 172.21.15.135:0/1598946624 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d881a51c0 con 0x7f7d8819a120 2024-04-20T12:33:34.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d6ffff640 1 -- 172.21.15.135:0/1598946624 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d80005020 con 0x7f7d8819a120 2024-04-20T12:33:34.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d6ffff640 1 -- 172.21.15.135:0/1598946624 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d800116d0 con 0x7f7d8819a120 2024-04-20T12:33:34.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.084+0000 7f7d8d3e6640 1 -- 172.21.15.135:0/1598946624 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d881a5710 con 0x7f7d8819a120 2024-04-20T12:33:34.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.085+0000 7f7d8d3e6640 1 -- 172.21.15.135:0/1598946624 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d88102570 con 0x7f7d8819a120 2024-04-20T12:33:34.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.086+0000 7f7d6ffff640 1 -- 172.21.15.135:0/1598946624 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f7d800054d0 con 0x7f7d8819a120 2024-04-20T12:33:34.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.087+0000 7f7d6ffff640 1 --2- 172.21.15.135:0/1598946624 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7d700a3d20 0x7f7d700a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.087+0000 7f7d86ffd640 1 --2- 172.21.15.135:0/1598946624 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7d700a3d20 0x7f7d700a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:34.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.087+0000 7f7d6ffff640 1 -- 172.21.15.135:0/1598946624 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f7d800d0dd0 con 0x7f7d8819a120 2024-04-20T12:33:34.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.087+0000 7f7d86ffd640 1 --2- 172.21.15.135:0/1598946624 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7d700a3d20 0x7f7d700a61e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c006010 tx=0x7f7d7c005dd0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:34.091 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.091+0000 7f7d6ffff640 1 -- 172.21.15.135:0/1598946624 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f7d800d4030 con 0x7f7d8819a120 2024-04-20T12:33:34.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.267+0000 7f7d8d3e6640 1 -- 172.21.15.135:0/1598946624 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7d881093a0 con 0x7f7d8819a120 2024-04-20T12:33:34.267 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.267+0000 7f7d6ffff640 1 -- 172.21.15.135:0/1598946624 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) ==== 104+0+11 (secure 0 0 0) 0x7f7d80016030 con 0x7f7d8819a120 2024-04-20T12:33:34.267 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:33:34.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.269+0000 7f7d8d3e6640 1 -- 172.21.15.135:0/1598946624 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7d700a3d20 msgr2=0x7f7d700a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.269+0000 7f7d8d3e6640 1 --2- 172.21.15.135:0/1598946624 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7d700a3d20 0x7f7d700a61e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c006010 tx=0x7f7d7c005dd0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.269+0000 7f7d8d3e6640 1 -- 172.21.15.135:0/1598946624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d8819a120 msgr2=0x7f7d881a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.269+0000 7f7d8d3e6640 1 --2- 172.21.15.135:0/1598946624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d8819a120 0x7f7d881a46d0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000eaa0 tx=0x7f7d8000ef60 comp rx=0 tx=0).stop 2024-04-20T12:33:34.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.269+0000 7f7d8d3e6640 1 -- 172.21.15.135:0/1598946624 shutdown_connections 2024-04-20T12:33:34.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.269+0000 7f7d8d3e6640 1 --2- 172.21.15.135:0/1598946624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7d8819a120 0x7f7d881a46d0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.269+0000 7f7d8d3e6640 1 --2- 172.21.15.135:0/1598946624 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f7d700a3d20 0x7f7d700a61e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.269 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.269+0000 7f7d8d3e6640 1 --2- 172.21.15.135:0/1598946624 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7d88106170 0x7f7d88199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.269+0000 7f7d8d3e6640 1 --2- 172.21.15.135:0/1598946624 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7d881010a0 0x7f7d88199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.269+0000 7f7d8d3e6640 1 -- 172.21.15.135:0/1598946624 >> 172.21.15.135:0/1598946624 conn(0x7f7d880771e0 msgr2=0x7f7d880fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:34.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.269+0000 7f7d8d3e6640 1 -- 172.21.15.135:0/1598946624 shutdown_connections 2024-04-20T12:33:34.270 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.269+0000 7f7d8d3e6640 1 -- 172.21.15.135:0/1598946624 wait complete. 2024-04-20T12:33:34.280 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T12:33:34.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.383+0000 7fcb60dd5640 1 -- 172.21.15.135:0/922251648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb5c107280 msgr2=0x7fcb5c10ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.383+0000 7fcb60dd5640 1 --2- 172.21.15.135:0/922251648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb5c107280 0x7fcb5c10ee50 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009ca0 tx=0x7fcb4c02c0f0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.385 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.383+0000 7fcb60dd5640 1 -- 172.21.15.135:0/922251648 shutdown_connections 2024-04-20T12:33:34.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.383+0000 7fcb60dd5640 1 --2- 172.21.15.135:0/922251648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb5c107280 0x7fcb5c10ee50 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.383+0000 7fcb60dd5640 1 --2- 172.21.15.135:0/922251648 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb5c06b240 0x7fcb5c106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.383+0000 7fcb60dd5640 1 --2- 172.21.15.135:0/922251648 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb5c06a890 0x7fcb5c06ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.383+0000 7fcb60dd5640 1 -- 172.21.15.135:0/922251648 >> 172.21.15.135:0/922251648 conn(0x7fcb5c077ec0 msgr2=0x7fcb5c0782d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:34.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.384+0000 7fcb60dd5640 1 -- 172.21.15.135:0/922251648 shutdown_connections 2024-04-20T12:33:34.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.384+0000 7fcb60dd5640 1 -- 172.21.15.135:0/922251648 wait complete. 2024-04-20T12:33:34.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.384+0000 7fcb60dd5640 1 Processor -- start 2024-04-20T12:33:34.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.384+0000 7fcb60dd5640 1 -- start start 2024-04-20T12:33:34.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.384+0000 7fcb60dd5640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb5c06a890 0x7fcb5c198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.384+0000 7fcb60dd5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb5c107280 0x7fcb5c198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.384+0000 7fcb60dd5640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb5c19cfa0 0x7fcb5c19d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.384+0000 7fcb60dd5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c112310 con 0x7fcb5c107280 2024-04-20T12:33:34.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.384+0000 7fcb60dd5640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c112190 con 0x7fcb5c06a890 2024-04-20T12:33:34.386 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.384+0000 7fcb60dd5640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c112490 con 0x7fcb5c19cfa0 2024-04-20T12:33:34.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.385+0000 7fcb59d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb5c107280 0x7fcb5c198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:34.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.385+0000 7fcb59d9b640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb5c107280 0x7fcb5c198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49424/0 (socket says 172.21.15.135:49424) 2024-04-20T12:33:34.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.385+0000 7fcb59d9b640 1 -- 172.21.15.135:0/526217241 learned_addr learned my addr 172.21.15.135:0/526217241 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:34.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.385+0000 7fcb5a59c640 1 --2- 172.21.15.135:0/526217241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb5c06a890 0x7fcb5c198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:34.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.385+0000 7fcb59d9b640 1 -- 172.21.15.135:0/526217241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb5c19cfa0 msgr2=0x7fcb5c19d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.385+0000 7fcb59d9b640 1 --2- 172.21.15.135:0/526217241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb5c19cfa0 0x7fcb5c19d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.385+0000 7fcb59d9b640 1 -- 172.21.15.135:0/526217241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb5c06a890 msgr2=0x7fcb5c198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.385+0000 7fcb59d9b640 1 --2- 172.21.15.135:0/526217241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb5c06a890 0x7fcb5c198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.385+0000 7fcb59d9b640 1 -- 172.21.15.135:0/526217241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5c19da90 con 0x7fcb5c107280 2024-04-20T12:33:34.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.385+0000 7fcb59d9b640 1 --2- 172.21.15.135:0/526217241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb5c107280 0x7fcb5c198c70 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000e9c0 tx=0x7fcb5000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:34.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.385+0000 7fcb4b7fe640 1 -- 172.21.15.135:0/526217241 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5000cd80 con 0x7fcb5c107280 2024-04-20T12:33:34.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.385+0000 7fcb4b7fe640 1 -- 172.21.15.135:0/526217241 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb50005500 con 0x7fcb5c107280 2024-04-20T12:33:34.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.385+0000 7fcb60dd5640 1 -- 172.21.15.135:0/526217241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5c19dd80 con 0x7fcb5c107280 2024-04-20T12:33:34.387 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.385+0000 7fcb4b7fe640 1 -- 172.21.15.135:0/526217241 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb50010690 con 0x7fcb5c107280 2024-04-20T12:33:34.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.385+0000 7fcb60dd5640 1 -- 172.21.15.135:0/526217241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb5c1a5570 con 0x7fcb5c107280 2024-04-20T12:33:34.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.386+0000 7fcb60dd5640 1 -- 172.21.15.135:0/526217241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb5c0691d0 con 0x7fcb5c107280 2024-04-20T12:33:34.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.387+0000 7fcb4b7fe640 1 -- 172.21.15.135:0/526217241 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fcb500046c0 con 0x7fcb5c107280 2024-04-20T12:33:34.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.388+0000 7fcb4b7fe640 1 --2- 172.21.15.135:0/526217241 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcb440a3d20 0x7fcb440a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.388 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.388+0000 7fcb4b7fe640 1 -- 172.21.15.135:0/526217241 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7fcb500d1000 con 0x7fcb5c107280 2024-04-20T12:33:34.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.388+0000 7fcb5a59c640 1 --2- 172.21.15.135:0/526217241 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcb440a3d20 0x7fcb440a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:34.389 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.388+0000 7fcb5a59c640 1 --2- 172.21.15.135:0/526217241 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcb440a3d20 0x7fcb440a61e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcb54005e10 tx=0x7fcb54005da0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:34.392 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.392+0000 7fcb4b7fe640 1 -- 172.21.15.135:0/526217241 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fcb5009d2d0 con 0x7fcb5c107280 2024-04-20T12:33:34.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.570+0000 7fcb60dd5640 1 -- 172.21.15.135:0/526217241 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcb5c06b420 con 0x7fcb5c107280 2024-04-20T12:33:34.570 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.571+0000 7fcb4b7fe640 1 -- 172.21.15.135:0/526217241 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) ==== 100+0+11 (secure 0 0 0) 0x7fcb5009cbd0 con 0x7fcb5c107280 2024-04-20T12:33:34.571 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-04-20T12:33:34.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.573+0000 7fcb60dd5640 1 -- 172.21.15.135:0/526217241 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcb440a3d20 msgr2=0x7fcb440a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.573+0000 7fcb60dd5640 1 --2- 172.21.15.135:0/526217241 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcb440a3d20 0x7fcb440a61e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcb54005e10 tx=0x7fcb54005da0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.573+0000 7fcb60dd5640 1 -- 172.21.15.135:0/526217241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb5c107280 msgr2=0x7fcb5c198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.573+0000 7fcb60dd5640 1 --2- 172.21.15.135:0/526217241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb5c107280 0x7fcb5c198c70 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000e9c0 tx=0x7fcb5000ee80 comp rx=0 tx=0).stop 2024-04-20T12:33:34.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.573+0000 7fcb60dd5640 1 -- 172.21.15.135:0/526217241 shutdown_connections 2024-04-20T12:33:34.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.573+0000 7fcb60dd5640 1 --2- 172.21.15.135:0/526217241 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fcb440a3d20 0x7fcb440a61e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.573+0000 7fcb60dd5640 1 --2- 172.21.15.135:0/526217241 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcb5c19cfa0 0x7fcb5c19d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.573 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.573+0000 7fcb60dd5640 1 --2- 172.21.15.135:0/526217241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb5c107280 0x7fcb5c198c70 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.573+0000 7fcb60dd5640 1 --2- 172.21.15.135:0/526217241 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fcb5c06a890 0x7fcb5c198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.573+0000 7fcb60dd5640 1 -- 172.21.15.135:0/526217241 >> 172.21.15.135:0/526217241 conn(0x7fcb5c077ec0 msgr2=0x7fcb5c0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.573+0000 7fcb60dd5640 1 -- 172.21.15.135:0/526217241 shutdown_connections 2024-04-20T12:33:34.574 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.573+0000 7fcb60dd5640 1 -- 172.21.15.135:0/526217241 wait complete. 2024-04-20T12:33:34.584 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T12:33:34.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.686+0000 7f333d167640 1 -- 172.21.15.135:0/3864257440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3338106180 msgr2=0x7f333810dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.686+0000 7f333d167640 1 --2- 172.21.15.135:0/3864257440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3338106180 0x7f333810dd50 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f3330009ca0 tx=0x7f333002c0f0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.690 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.686+0000 7f333d167640 1 -- 172.21.15.135:0/3864257440 shutdown_connections 2024-04-20T12:33:34.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.686+0000 7f333d167640 1 --2- 172.21.15.135:0/3864257440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3338106180 0x7f333810dd50 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.686+0000 7f333d167640 1 --2- 172.21.15.135:0/3864257440 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3338101a60 0x7f3338105aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.686+0000 7f333d167640 1 --2- 172.21.15.135:0/3864257440 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33381010b0 0x7f3338101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.686+0000 7f333d167640 1 -- 172.21.15.135:0/3864257440 >> 172.21.15.135:0/3864257440 conn(0x7f33380771e0 msgr2=0x7f33380775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:34.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.686+0000 7f333d167640 1 -- 172.21.15.135:0/3864257440 shutdown_connections 2024-04-20T12:33:34.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.686+0000 7f333d167640 1 -- 172.21.15.135:0/3864257440 wait complete. 2024-04-20T12:33:34.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.686+0000 7f333d167640 1 Processor -- start 2024-04-20T12:33:34.691 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333d167640 1 -- start start 2024-04-20T12:33:34.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333d167640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33381010b0 0x7f333819e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333d167640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3338106180 0x7f333819eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333d167640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3338198640 0x7f3338198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333d167640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3338111240 con 0x7f3338106180 2024-04-20T12:33:34.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333d167640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f33381110c0 con 0x7f33381010b0 2024-04-20T12:33:34.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333d167640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f33381113c0 con 0x7f3338198640 2024-04-20T12:33:34.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3338106180 0x7f333819eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:34.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3338106180 0x7f333819eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49454/0 (socket says 172.21.15.135:49454) 2024-04-20T12:33:34.692 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333659c640 1 -- 172.21.15.135:0/1945768642 learned_addr learned my addr 172.21.15.135:0/1945768642 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:34.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333759e640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3338198640 0x7f3338198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:34.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f3336d9d640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33381010b0 0x7f333819e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:34.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333659c640 1 -- 172.21.15.135:0/1945768642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3338198640 msgr2=0x7f3338198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333659c640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3338198640 0x7f3338198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333659c640 1 -- 172.21.15.135:0/1945768642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33381010b0 msgr2=0x7f333819e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333659c640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33381010b0 0x7f333819e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333659c640 1 -- 172.21.15.135:0/1945768642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3338199240 con 0x7f3338106180 2024-04-20T12:33:34.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f3336d9d640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33381010b0 0x7f333819e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:33:34.693 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333759e640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3338198640 0x7f3338198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:33:34.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.687+0000 7f333659c640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3338106180 0x7f333819eac0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f332800d740 tx=0x7f332800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:34.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.688+0000 7f332ffff640 1 -- 172.21.15.135:0/1945768642 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328017070 con 0x7f3338106180 2024-04-20T12:33:34.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.688+0000 7f332ffff640 1 -- 172.21.15.135:0/1945768642 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f332800de50 con 0x7f3338106180 2024-04-20T12:33:34.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.688+0000 7f333d167640 1 -- 172.21.15.135:0/1945768642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33381a5320 con 0x7f3338106180 2024-04-20T12:33:34.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.688+0000 7f332ffff640 1 -- 172.21.15.135:0/1945768642 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328004e00 con 0x7f3338106180 2024-04-20T12:33:34.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.688+0000 7f333d167640 1 -- 172.21.15.135:0/1945768642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33381a56d0 con 0x7f3338106180 2024-04-20T12:33:34.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.689+0000 7f333d167640 1 -- 172.21.15.135:0/1945768642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3338102580 con 0x7f3338106180 2024-04-20T12:33:34.694 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.690+0000 7f332ffff640 1 -- 172.21.15.135:0/1945768642 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f3328004fa0 con 0x7f3338106180 2024-04-20T12:33:34.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.690+0000 7f332ffff640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33240a3d20 0x7f33240a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.690+0000 7f3336d9d640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33240a3d20 0x7f33240a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:34.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.690+0000 7f332ffff640 1 -- 172.21.15.135:0/1945768642 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f33280d05a0 con 0x7f3338106180 2024-04-20T12:33:34.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.691+0000 7f3336d9d640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33240a3d20 0x7f33240a61e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3320009b40 tx=0x7f3320005e50 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:34.695 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.695+0000 7f332ffff640 1 -- 172.21.15.135:0/1945768642 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f332809c870 con 0x7f3338106180 2024-04-20T12:33:34.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:34 smithi135 ceph-mon[18264]: pgmap v324: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:34.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:34 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/799522592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:33:34.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:34 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1257755373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:33:34.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:34 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1598946624' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:33:34.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:34 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/526217241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:33:34.874 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.875+0000 7f333d167640 1 -- 172.21.15.135:0/1945768642 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f3338101a60 con 0x7f3338106180 2024-04-20T12:33:34.875 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.875+0000 7f332ffff640 1 -- 172.21.15.135:0/1945768642 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v103) ==== 103+0+11 (secure 0 0 0) 0x7f332809c170 con 0x7f3338106180 2024-04-20T12:33:34.875 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:33:34.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.878+0000 7f333d167640 1 -- 172.21.15.135:0/1945768642 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33240a3d20 msgr2=0x7f33240a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.878+0000 7f333d167640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33240a3d20 0x7f33240a61e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3320009b40 tx=0x7f3320005e50 comp rx=0 tx=0).stop 2024-04-20T12:33:34.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.878+0000 7f333d167640 1 -- 172.21.15.135:0/1945768642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3338106180 msgr2=0x7f333819eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.878+0000 7f333d167640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3338106180 0x7f333819eac0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f332800d740 tx=0x7f332800dc00 comp rx=0 tx=0).stop 2024-04-20T12:33:34.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.878+0000 7f333d167640 1 -- 172.21.15.135:0/1945768642 shutdown_connections 2024-04-20T12:33:34.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.878+0000 7f333d167640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f33240a3d20 0x7f33240a61e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.878+0000 7f333d167640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3338198640 0x7f3338198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.878+0000 7f333d167640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3338106180 0x7f333819eac0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.878+0000 7f333d167640 1 --2- 172.21.15.135:0/1945768642 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f33381010b0 0x7f333819e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.878+0000 7f333d167640 1 -- 172.21.15.135:0/1945768642 >> 172.21.15.135:0/1945768642 conn(0x7f33380771e0 msgr2=0x7f3338104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:34.878 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.878+0000 7f333d167640 1 -- 172.21.15.135:0/1945768642 shutdown_connections 2024-04-20T12:33:34.879 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.878+0000 7f333d167640 1 -- 172.21.15.135:0/1945768642 wait complete. 2024-04-20T12:33:34.888 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-04-20T12:33:34.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.988+0000 7f7102055640 1 -- 172.21.15.135:0/851053129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70fc0690f0 msgr2=0x7f70fc069570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.988+0000 7f7102055640 1 --2- 172.21.15.135:0/851053129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70fc0690f0 0x7f70fc069570 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009900 tx=0x7f70e402bc30 comp rx=0 tx=0).stop 2024-04-20T12:33:34.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.988+0000 7f7102055640 1 -- 172.21.15.135:0/851053129 shutdown_connections 2024-04-20T12:33:34.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.988+0000 7f7102055640 1 --2- 172.21.15.135:0/851053129 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70fc069ab0 0x7f70fc10edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.990 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.988+0000 7f7102055640 1 --2- 172.21.15.135:0/851053129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70fc0690f0 0x7f70fc069570 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.988+0000 7f7102055640 1 --2- 172.21.15.135:0/851053129 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70fc106f60 0x7f70fc107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.988+0000 7f7102055640 1 -- 172.21.15.135:0/851053129 >> 172.21.15.135:0/851053129 conn(0x7f70fc077e40 msgr2=0x7f70fc078250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.988+0000 7f7102055640 1 -- 172.21.15.135:0/851053129 shutdown_connections 2024-04-20T12:33:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.988+0000 7f7102055640 1 -- 172.21.15.135:0/851053129 wait complete. 2024-04-20T12:33:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f7102055640 1 Processor -- start 2024-04-20T12:33:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f7102055640 1 -- start start 2024-04-20T12:33:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f7102055640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70fc0690f0 0x7f70fc198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f7102055640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70fc069ab0 0x7f70fc198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f7102055640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70fc106f60 0x7f70fc19d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f7102055640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc112320 con 0x7f70fc106f60 2024-04-20T12:33:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f7102055640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc1121a0 con 0x7f70fc069ab0 2024-04-20T12:33:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f7102055640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f70fc1124a0 con 0x7f70fc0690f0 2024-04-20T12:33:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f70fbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70fc106f60 0x7f70fc19d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:34.991 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f70fbfff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70fc106f60 0x7f70fc19d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49478/0 (socket says 172.21.15.135:49478) 2024-04-20T12:33:34.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f70fbfff640 1 -- 172.21.15.135:0/2082138201 learned_addr learned my addr 172.21.15.135:0/2082138201 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:33:34.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f70f3fff640 1 --2- 172.21.15.135:0/2082138201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70fc069ab0 0x7f70fc198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:34.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f70fb7fe640 1 --2- 172.21.15.135:0/2082138201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70fc0690f0 0x7f70fc198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:34.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f70fbfff640 1 -- 172.21.15.135:0/2082138201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70fc0690f0 msgr2=0x7f70fc198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f70fbfff640 1 --2- 172.21.15.135:0/2082138201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70fc0690f0 0x7f70fc198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f70fbfff640 1 -- 172.21.15.135:0/2082138201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70fc069ab0 msgr2=0x7f70fc198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:34.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f70fbfff640 1 --2- 172.21.15.135:0/2082138201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70fc069ab0 0x7f70fc198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:34.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f70fbfff640 1 -- 172.21.15.135:0/2082138201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70fc19d750 con 0x7f70fc106f60 2024-04-20T12:33:34.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f70fbfff640 1 --2- 172.21.15.135:0/2082138201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70fc106f60 0x7f70fc19d020 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f70f400eb10 tx=0x7f70f400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:34.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.989+0000 7f70f97fa640 1 -- 172.21.15.135:0/2082138201 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f4004b20 con 0x7f70fc106f60 2024-04-20T12:33:34.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.990+0000 7f70f97fa640 1 -- 172.21.15.135:0/2082138201 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70f4004cc0 con 0x7f70fc106f60 2024-04-20T12:33:34.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.990+0000 7f7102055640 1 -- 172.21.15.135:0/2082138201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70fc19da40 con 0x7f70fc106f60 2024-04-20T12:33:34.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.990+0000 7f70f97fa640 1 -- 172.21.15.135:0/2082138201 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f4010760 con 0x7f70fc106f60 2024-04-20T12:33:34.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.990+0000 7f7102055640 1 -- 172.21.15.135:0/2082138201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70fc1a52d0 con 0x7f70fc106f60 2024-04-20T12:33:34.992 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.991+0000 7f7102055640 1 -- 172.21.15.135:0/2082138201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70fc068df0 con 0x7f70fc106f60 2024-04-20T12:33:34.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.992+0000 7f70f97fa640 1 -- 172.21.15.135:0/2082138201 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f70f4010900 con 0x7f70fc106f60 2024-04-20T12:33:34.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.992+0000 7f70f97fa640 1 --2- 172.21.15.135:0/2082138201 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f70e80a3d20 0x7f70e80a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:33:34.993 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.992+0000 7f70fb7fe640 1 --2- 172.21.15.135:0/2082138201 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f70e80a3d20 0x7f70e80a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:33:34.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.992+0000 7f70f97fa640 1 -- 172.21.15.135:0/2082138201 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9504+0+0 (secure 0 0 0) 0x7f70f40d1360 con 0x7f70fc106f60 2024-04-20T12:33:34.994 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.993+0000 7f70fb7fe640 1 --2- 172.21.15.135:0/2082138201 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f70e80a3d20 0x7f70e80a61e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70ec005fd0 tx=0x7f70ec00b390 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:33:34.995 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:34.996+0000 7f70f97fa640 1 -- 172.21.15.135:0/2082138201 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f70f4053ff0 con 0x7f70fc106f60 2024-04-20T12:33:35.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:34 smithi154 ceph-mon[22073]: pgmap v324: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:35.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:34 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/799522592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:33:35.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:34 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1257755373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:33:35.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:34 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1598946624' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:33:35.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:34 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/526217241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:33:35.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:34 smithi139 ceph-mon[21834]: pgmap v324: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:35.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:34 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/799522592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:33:35.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:34 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1257755373' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:33:35.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:34 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1598946624' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:33:35.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:34 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/526217241' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:33:35.220 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:35.220+0000 7f7102055640 1 -- 172.21.15.135:0/2082138201 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f70fc109e90 con 0x7f70fc106f60 2024-04-20T12:33:35.228 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:35.228+0000 7f70f97fa640 1 -- 172.21.15.135:0/2082138201 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+746066 (secure 0 0 0) 0x7f70f409d630 con 0x7f70fc106f60 2024-04-20T12:33:35.238 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:33:35.238 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:33:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: "epoch": 26, 2024-04-20T12:33:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: "active_gid": 25093, 2024-04-20T12:33:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: "active_name": "x", 2024-04-20T12:33:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: "active_addrs": { 2024-04-20T12:33:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-04-20T12:33:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-04-20T12:33:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:6800", 2024-04-20T12:33:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 15232286 2024-04-20T12:33:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v1", 2024-04-20T12:33:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:6801", 2024-04-20T12:33:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 15232286 2024-04-20T12:33:35.240 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.240 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-04-20T12:33:35.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.240 INFO:teuthology.orchestra.run.smithi135.stdout: "active_addr": "172.21.15.135:6801/15232286", 2024-04-20T12:33:35.240 INFO:teuthology.orchestra.run.smithi135.stdout: "active_change": "2024-04-20T12:23:07.080336+0000", 2024-04-20T12:33:35.240 INFO:teuthology.orchestra.run.smithi135.stdout: "active_mgr_features": 4540701547738038271, 2024-04-20T12:33:35.240 INFO:teuthology.orchestra.run.smithi135.stdout: "available": true, 2024-04-20T12:33:35.240 INFO:teuthology.orchestra.run.smithi135.stdout: "standbys": [ 2024-04-20T12:33:35.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.240 INFO:teuthology.orchestra.run.smithi135.stdout: "gid": 25043, 2024-04-20T12:33:35.240 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "y", 2024-04-20T12:33:35.240 INFO:teuthology.orchestra.run.smithi135.stdout: "mgr_features": 4540701547738038271, 2024-04-20T12:33:35.240 INFO:teuthology.orchestra.run.smithi135.stdout: "available_modules": [ 2024-04-20T12:33:35.240 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.241 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "alerts", 2024-04-20T12:33:35.241 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.241 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.241 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.241 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-04-20T12:33:35.241 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-04-20T12:33:35.241 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.241 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.241 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.241 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-04-20T12:33:35.241 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.241 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.241 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.241 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How frequently to reexamine health status", 2024-04-20T12:33:35.241 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.242 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.242 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.242 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.242 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.242 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.242 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.242 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.242 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.242 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.242 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.242 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.242 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.242 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.243 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.243 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.243 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.243 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.243 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.243 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.243 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.243 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.243 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.244 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.244 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.244 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.244 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.244 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.244 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.244 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.244 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.244 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.244 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.244 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.244 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.244 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.244 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.245 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.245 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.245 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.245 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.245 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.245 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.245 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.245 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.245 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.245 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.245 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.245 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.245 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.245 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.245 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.246 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.246 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.246 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.246 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.246 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.246 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.246 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.246 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.246 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.246 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.246 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.246 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.246 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_destination": { 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_destination", 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email address to send alerts to", 2024-04-20T12:33:35.247 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_from_name": { 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_from_name", 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "Ceph", 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email From: name", 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.248 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_host": { 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_host", 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP server", 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.249 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_password": { 2024-04-20T12:33:35.250 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_password", 2024-04-20T12:33:35.250 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.250 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.250 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.250 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.250 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.250 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.250 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.250 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Password to authenticate with", 2024-04-20T12:33:35.250 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.250 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.250 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.250 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_port": { 2024-04-20T12:33:35.251 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_port", 2024-04-20T12:33:35.251 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.251 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.251 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.251 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "465", 2024-04-20T12:33:35.251 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.251 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.251 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.251 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP port", 2024-04-20T12:33:35.251 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.251 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.251 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.251 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_sender": { 2024-04-20T12:33:35.251 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_sender", 2024-04-20T12:33:35.252 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.252 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.252 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.252 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.252 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.252 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.252 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.252 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP envelope sender", 2024-04-20T12:33:35.252 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.252 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.252 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.252 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.252 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_ssl": { 2024-04-20T12:33:35.252 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_ssl", 2024-04-20T12:33:35.253 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.253 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.253 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.253 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.253 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.253 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.253 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.253 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-20T12:33:35.253 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.253 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.253 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.253 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_user": { 2024-04-20T12:33:35.253 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_user", 2024-04-20T12:33:35.253 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.254 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.254 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.254 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.254 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.254 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.254 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.254 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "User to authenticate as", 2024-04-20T12:33:35.254 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.254 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.254 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.254 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.254 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.254 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.255 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "balancer", 2024-04-20T12:33:35.255 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.255 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.255 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.255 INFO:teuthology.orchestra.run.smithi135.stdout: "active": { 2024-04-20T12:33:35.255 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "active", 2024-04-20T12:33:35.255 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.255 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.255 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.255 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.255 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.255 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.255 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.255 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically balance PGs across cluster", 2024-04-20T12:33:35.255 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.256 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.256 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.256 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_time": { 2024-04-20T12:33:35.256 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_time", 2024-04-20T12:33:35.256 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.256 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.256 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.256 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0000", 2024-04-20T12:33:35.256 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.256 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.256 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.256 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "beginning time of day to automatically balance", 2024-04-20T12:33:35.256 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-20T12:33:35.257 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.257 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.257 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_weekday": { 2024-04-20T12:33:35.257 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_weekday", 2024-04-20T12:33:35.257 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-04-20T12:33:35.257 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.257 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.257 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-04-20T12:33:35.257 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-04-20T12:33:35.257 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-04-20T12:33:35.257 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.257 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-20T12:33:35.257 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-20T12:33:35.258 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.258 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.258 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_max_iterations": { 2024-04-20T12:33:35.258 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_max_iterations", 2024-04-20T12:33:35.258 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-04-20T12:33:35.258 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.258 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.258 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "25", 2024-04-20T12:33:35.258 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-04-20T12:33:35.258 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "250", 2024-04-20T12:33:35.258 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.258 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-20T12:33:35.258 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.259 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.259 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.259 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_metrics": { 2024-04-20T12:33:35.259 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_metrics", 2024-04-20T12:33:35.259 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.259 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.259 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.259 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "pgs,objects,bytes", 2024-04-20T12:33:35.259 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.259 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.259 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.259 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-20T12:33:35.259 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-20T12:33:35.259 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.260 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.260 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_step": { 2024-04-20T12:33:35.260 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_step", 2024-04-20T12:33:35.260 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:35.260 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.260 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.260 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.5", 2024-04-20T12:33:35.260 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0.001", 2024-04-20T12:33:35.260 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "0.999", 2024-04-20T12:33:35.260 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.260 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "aggressiveness of optimization", 2024-04-20T12:33:35.260 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: "end_time": { 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_time", 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2359", 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ending time of day to automatically balance", 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.261 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.262 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.262 INFO:teuthology.orchestra.run.smithi135.stdout: "end_weekday": { 2024-04-20T12:33:35.262 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_weekday", 2024-04-20T12:33:35.262 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-04-20T12:33:35.262 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.262 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.262 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-04-20T12:33:35.262 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-04-20T12:33:35.262 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-04-20T12:33:35.262 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.262 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-20T12:33:35.262 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-20T12:33:35.262 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.263 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.264 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.264 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.264 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.264 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.264 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.264 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.264 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.264 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.264 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.264 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.264 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.264 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.264 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.265 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.265 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.265 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.265 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.265 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.265 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.265 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.265 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.265 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.265 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.265 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.265 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.265 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.266 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.266 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.266 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.266 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.266 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.266 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.266 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.266 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.266 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.266 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.266 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.266 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: "min_score": { 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_score", 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-04-20T12:33:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-04-20T12:33:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "upmap", 2024-04-20T12:33:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: "crush-compat", 2024-04-20T12:33:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: "none", 2024-04-20T12:33:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: "read", 2024-04-20T12:33:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap", 2024-04-20T12:33:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap-read" 2024-04-20T12:33:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.269 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Balancer mode", 2024-04-20T12:33:35.270 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.270 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.270 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.270 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.270 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_ids": { 2024-04-20T12:33:35.270 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_ids", 2024-04-20T12:33:35.270 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.270 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.270 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.270 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.270 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.270 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.270 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.270 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-20T12:33:35.270 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.271 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.271 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.271 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-04-20T12:33:35.271 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-04-20T12:33:35.271 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.271 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.271 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.271 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-04-20T12:33:35.271 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.271 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.271 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.271 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-20T12:33:35.271 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.271 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.272 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.272 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_deviation": { 2024-04-20T12:33:35.272 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_deviation", 2024-04-20T12:33:35.272 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.272 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.272 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.272 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-04-20T12:33:35.272 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-04-20T12:33:35.272 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.272 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.272 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-20T12:33:35.272 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-20T12:33:35.272 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.272 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_optimizations": { 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_optimizations", 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.273 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.274 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.274 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cephadm", 2024-04-20T12:33:35.274 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.274 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.274 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.274 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_down_multiplier": { 2024-04-20T12:33:35.274 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_down_multiplier", 2024-04-20T12:33:35.274 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:35.274 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.274 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.274 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-04-20T12:33:35.274 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.274 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_refresh_rate": { 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_refresh_rate", 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "20", 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.275 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-20T12:33:35.276 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.276 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.276 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.276 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_starting_port": { 2024-04-20T12:33:35.276 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_starting_port", 2024-04-20T12:33:35.276 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.276 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.276 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.276 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4721", 2024-04-20T12:33:35.276 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.276 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.276 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.276 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-20T12:33:35.277 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.277 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.277 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.277 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_ptrace": { 2024-04-20T12:33:35.277 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_ptrace", 2024-04-20T12:33:35.277 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.277 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.277 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.277 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.277 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.277 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.277 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.277 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-20T12:33:35.277 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-20T12:33:35.278 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.278 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.278 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_interval": { 2024-04-20T12:33:35.278 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_interval", 2024-04-20T12:33:35.278 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.278 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.278 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.278 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-04-20T12:33:35.278 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.278 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.278 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.278 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-20T12:33:35.278 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.279 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.279 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.279 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_memory_target_ratio": { 2024-04-20T12:33:35.279 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_memory_target_ratio", 2024-04-20T12:33:35.279 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:35.279 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.279 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.279 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.7", 2024-04-20T12:33:35.279 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.279 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.279 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.279 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-20T12:33:35.279 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.280 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.280 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.280 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm_log_destination": { 2024-04-20T12:33:35.280 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cephadm_log_destination", 2024-04-20T12:33:35.280 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.280 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.280 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.280 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.280 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.280 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.280 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.280 INFO:teuthology.orchestra.run.smithi135.stdout: "file", 2024-04-20T12:33:35.280 INFO:teuthology.orchestra.run.smithi135.stdout: "file,syslog", 2024-04-20T12:33:35.280 INFO:teuthology.orchestra.run.smithi135.stdout: "syslog" 2024-04-20T12:33:35.281 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.281 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-20T12:33:35.281 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.281 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.281 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.281 INFO:teuthology.orchestra.run.smithi135.stdout: "cgroups_split": { 2024-04-20T12:33:35.281 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cgroups_split", 2024-04-20T12:33:35.281 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.281 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.281 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.281 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.281 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.281 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.282 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.282 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-20T12:33:35.282 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.282 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.282 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.282 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.282 INFO:teuthology.orchestra.run.smithi135.stdout: "config_checks_enabled": { 2024-04-20T12:33:35.282 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_checks_enabled", 2024-04-20T12:33:35.282 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.282 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.282 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.282 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.282 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.282 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.282 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.283 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-20T12:33:35.283 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.283 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.283 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.283 INFO:teuthology.orchestra.run.smithi135.stdout: "config_dashboard": { 2024-04-20T12:33:35.283 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_dashboard", 2024-04-20T12:33:35.283 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.283 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.283 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.283 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.283 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.283 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.283 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_alertmanager": { 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_alertmanager", 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-04-20T12:33:35.284 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.285 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.285 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.285 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_base": { 2024-04-20T12:33:35.285 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_base", 2024-04-20T12:33:35.285 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.285 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.285 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.285 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-20T12:33:35.285 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.285 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.285 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.285 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Container image name, without the tag", 2024-04-20T12:33:35.285 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.285 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.286 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.286 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_elasticsearch": { 2024-04-20T12:33:35.286 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_elasticsearch", 2024-04-20T12:33:35.286 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.286 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.286 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.286 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-20T12:33:35.286 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.286 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.286 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.286 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "elasticsearch container image", 2024-04-20T12:33:35.286 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.286 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.286 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_grafana": { 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_grafana", 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.287 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_haproxy": { 2024-04-20T12:33:35.288 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_haproxy", 2024-04-20T12:33:35.288 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.288 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.288 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.288 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-20T12:33:35.288 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.288 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.288 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.288 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "HAproxy container image", 2024-04-20T12:33:35.288 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.288 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.288 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.288 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_agent": { 2024-04-20T12:33:35.288 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_agent", 2024-04-20T12:33:35.289 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.289 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.289 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.289 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-20T12:33:35.289 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.289 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.289 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.289 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger agent container image", 2024-04-20T12:33:35.289 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.289 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.289 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.289 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_collector": { 2024-04-20T12:33:35.289 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_collector", 2024-04-20T12:33:35.289 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.290 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.290 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.290 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-20T12:33:35.290 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.290 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.290 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.290 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger collector container image", 2024-04-20T12:33:35.290 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.290 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.290 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.290 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_query": { 2024-04-20T12:33:35.290 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_query", 2024-04-20T12:33:35.290 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger query container image", 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_keepalived": { 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_keepalived", 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.291 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-20T12:33:35.292 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.292 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.292 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.292 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Keepalived container image", 2024-04-20T12:33:35.292 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.292 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.292 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.292 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.292 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_loki": { 2024-04-20T12:33:35.292 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_loki", 2024-04-20T12:33:35.292 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.292 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.292 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.292 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-20T12:33:35.292 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.293 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.293 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.293 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Loki container image", 2024-04-20T12:33:35.293 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.293 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.293 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.293 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_node_exporter": { 2024-04-20T12:33:35.293 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_node_exporter", 2024-04-20T12:33:35.293 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.293 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.293 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.293 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-20T12:33:35.293 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.293 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.294 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.294 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-04-20T12:33:35.294 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.294 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.294 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.294 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_nvmeof": { 2024-04-20T12:33:35.294 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_nvmeof", 2024-04-20T12:33:35.294 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.294 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.294 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.294 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-20T12:33:35.294 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.294 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.294 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.295 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Nvme-of container image", 2024-04-20T12:33:35.295 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.295 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.295 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.295 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_prometheus": { 2024-04-20T12:33:35.295 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_prometheus", 2024-04-20T12:33:35.295 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.295 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.295 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.295 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-20T12:33:35.295 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.295 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.295 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.295 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_promtail": { 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_promtail", 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Promtail container image", 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.296 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_samba": { 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_samba", 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Samba/SMB container image", 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.297 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_snmp_gateway": { 2024-04-20T12:33:35.298 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_snmp_gateway", 2024-04-20T12:33:35.298 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.298 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.298 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.298 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-20T12:33:35.298 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.298 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.298 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.298 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SNMP Gateway container image", 2024-04-20T12:33:35.298 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.298 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.298 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.298 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.298 INFO:teuthology.orchestra.run.smithi135.stdout: "container_init": { 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_init", 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Run podman/docker with `--init`", 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: "daemon_cache_timeout": { 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "daemon_cache_timeout", 2024-04-20T12:33:35.299 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.300 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.300 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.300 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-04-20T12:33:35.300 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.300 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.300 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.300 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-20T12:33:35.300 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.300 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.300 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.300 INFO:teuthology.orchestra.run.smithi135.stdout: "default_cephadm_command_timeout": { 2024-04-20T12:33:35.300 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_cephadm_command_timeout", 2024-04-20T12:33:35.300 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.300 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "900", 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: "default_registry": { 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_registry", 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.301 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io", 2024-04-20T12:33:35.302 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.302 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.302 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.302 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-20T12:33:35.302 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.302 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.302 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.302 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.302 INFO:teuthology.orchestra.run.smithi135.stdout: "device_cache_timeout": { 2024-04-20T12:33:35.302 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_cache_timeout", 2024-04-20T12:33:35.302 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.302 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.302 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.302 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1800", 2024-04-20T12:33:35.303 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.303 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.303 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.303 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache device inventory", 2024-04-20T12:33:35.303 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.303 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.303 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.303 INFO:teuthology.orchestra.run.smithi135.stdout: "device_enhanced_scan": { 2024-04-20T12:33:35.303 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_enhanced_scan", 2024-04-20T12:33:35.303 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.303 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.303 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.303 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.303 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.304 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.304 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.304 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-20T12:33:35.304 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.304 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.304 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.304 INFO:teuthology.orchestra.run.smithi135.stdout: "facts_cache_timeout": { 2024-04-20T12:33:35.304 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "facts_cache_timeout", 2024-04-20T12:33:35.304 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.304 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.304 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.304 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-04-20T12:33:35.304 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.305 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.305 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.305 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache host facts data", 2024-04-20T12:33:35.305 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.305 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.305 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.305 INFO:teuthology.orchestra.run.smithi135.stdout: "grafana_dashboards_path": { 2024-04-20T12:33:35.305 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "grafana_dashboards_path", 2024-04-20T12:33:35.305 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.305 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.305 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.305 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-20T12:33:35.305 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.305 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.306 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.306 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-20T12:33:35.306 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.306 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.306 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.306 INFO:teuthology.orchestra.run.smithi135.stdout: "host_check_interval": { 2024-04-20T12:33:35.306 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "host_check_interval", 2024-04-20T12:33:35.306 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.306 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.306 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.306 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-04-20T12:33:35.306 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.306 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.306 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to perform a host check", 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: "hw_monitoring": { 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hw_monitoring", 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-20T12:33:35.307 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: "inventory_list_all": { 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "inventory_list_all", 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.308 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.309 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.310 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.310 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.310 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.310 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.310 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.310 INFO:teuthology.orchestra.run.smithi135.stdout: "log_refresh_metadata": { 2024-04-20T12:33:35.310 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_refresh_metadata", 2024-04-20T12:33:35.310 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.310 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.310 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.310 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.310 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.310 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.311 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.311 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-20T12:33:35.311 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.311 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.311 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.311 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.311 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.311 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.311 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.311 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.311 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.311 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.311 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.311 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.312 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-20T12:33:35.312 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.312 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.312 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.312 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.312 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.312 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.312 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.312 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.312 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.312 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.312 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.312 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.312 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.312 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.313 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.314 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.314 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.314 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.314 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.314 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.314 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.314 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.314 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.314 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-20T12:33:35.314 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-20T12:33:35.314 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.314 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.314 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.314 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "*", 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.315 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: "max_count_per_host": { 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_count_per_host", 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.316 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of daemons per service per host", 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: "max_osd_draining_count": { 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_osd_draining_count", 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.317 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: "migration_current": { 2024-04-20T12:33:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "migration_current", 2024-04-20T12:33:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "internal - do not modify", 2024-04-20T12:33:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "root", 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm-package", 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: "root" 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "mode for remote execution of cephadm", 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.319 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.320 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.320 INFO:teuthology.orchestra.run.smithi135.stdout: "oob_default_addr": { 2024-04-20T12:33:35.320 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "oob_default_addr", 2024-04-20T12:33:35.320 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.320 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.320 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.320 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "169.254.1.1", 2024-04-20T12:33:35.320 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.320 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.320 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.320 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-20T12:33:35.320 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.320 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.320 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: "prometheus_alerts_path": { 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus_alerts_path", 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.321 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_insecure": { 2024-04-20T12:33:35.322 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_insecure", 2024-04-20T12:33:35.322 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.322 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.322 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.322 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.322 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.322 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.322 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.322 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-20T12:33:35.322 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.322 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.322 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.323 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_password": { 2024-04-20T12:33:35.323 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_password", 2024-04-20T12:33:35.323 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.323 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.323 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.323 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.323 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.323 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.323 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.323 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-20T12:33:35.323 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.323 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.323 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.323 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.323 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_url": { 2024-04-20T12:33:35.324 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_url", 2024-04-20T12:33:35.324 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.324 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.324 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.324 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.324 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.324 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.324 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.324 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-20T12:33:35.324 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.324 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.324 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.324 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_username": { 2024-04-20T12:33:35.324 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_username", 2024-04-20T12:33:35.325 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.325 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.325 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.325 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.325 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.325 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.325 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.325 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-20T12:33:35.325 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.325 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.325 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.325 INFO:teuthology.orchestra.run.smithi135.stdout: "secure_monitoring_stack": { 2024-04-20T12:33:35.325 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "secure_monitoring_stack", 2024-04-20T12:33:35.325 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.326 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.326 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.326 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.326 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.326 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.326 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.326 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-20T12:33:35.326 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.326 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.326 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.326 INFO:teuthology.orchestra.run.smithi135.stdout: "service_discovery_port": { 2024-04-20T12:33:35.326 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "service_discovery_port", 2024-04-20T12:33:35.326 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.326 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8765", 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "cephadm service discovery port", 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: "ssh_config_file": { 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssh_config_file", 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.327 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.328 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.328 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.328 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.328 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-20T12:33:35.328 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.328 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.328 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.328 INFO:teuthology.orchestra.run.smithi135.stdout: "use_agent": { 2024-04-20T12:33:35.328 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_agent", 2024-04-20T12:33:35.328 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.328 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.328 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.328 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.328 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.329 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.329 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.329 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-20T12:33:35.329 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.329 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.329 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.329 INFO:teuthology.orchestra.run.smithi135.stdout: "use_repo_digest": { 2024-04-20T12:33:35.329 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_repo_digest", 2024-04-20T12:33:35.329 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.329 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.329 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.329 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.329 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.329 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.330 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.330 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-20T12:33:35.330 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.330 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.330 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.330 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_failed_host_check": { 2024-04-20T12:33:35.330 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_failed_host_check", 2024-04-20T12:33:35.330 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.330 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.330 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.330 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.330 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.330 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.330 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if the host check fails", 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_daemons": { 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_daemons", 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-20T12:33:35.331 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_hosts": { 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_hosts", 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.333 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.333 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.333 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.333 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crash", 2024-04-20T12:33:35.333 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.333 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.333 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.333 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.333 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.333 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.333 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.333 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.333 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.333 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.334 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.334 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.334 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.334 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.334 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.334 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.334 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.334 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.334 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.334 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.334 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.334 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.334 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.335 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.335 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.335 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.335 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.335 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.335 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.335 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.335 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.335 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.335 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.335 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.335 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.335 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.335 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.336 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.337 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.337 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.337 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.337 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.337 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.337 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.337 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.337 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.337 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.337 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.337 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.337 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.337 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.337 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.338 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.338 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.338 INFO:teuthology.orchestra.run.smithi135.stdout: "retain_interval": { 2024-04-20T12:33:35.338 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retain_interval", 2024-04-20T12:33:35.338 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.338 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.338 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.338 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "31536000", 2024-04-20T12:33:35.338 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.338 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.338 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.338 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-20T12:33:35.338 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_recent_interval": { 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_recent_interval", 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1209600", 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.339 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dashboard", 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.340 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_HOST": { 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.341 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.342 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.342 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.342 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.342 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.342 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-20T12:33:35.342 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-20T12:33:35.342 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.342 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.342 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.342 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.342 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.342 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.342 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.342 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.342 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_ENABLED": { 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_ENABLED", 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.343 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.344 INFO:teuthology.orchestra.run.smithi135.stdout: "ENABLE_BROWSABLE_API": { 2024-04-20T12:33:35.345 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-20T12:33:35.345 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.345 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.345 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.345 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.345 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.345 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.345 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.345 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.345 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.345 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.345 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.345 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-20T12:33:35.346 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-20T12:33:35.346 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.346 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.346 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.346 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.346 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.346 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.346 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.346 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.346 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.346 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.346 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.346 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.346 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-20T12:33:35.347 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-20T12:33:35.347 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.347 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.347 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.347 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.347 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.347 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.347 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.347 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.347 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.347 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.347 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.347 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.347 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-20T12:33:35.347 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-20T12:33:35.348 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.348 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.348 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.348 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.348 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.348 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.348 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.348 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.348 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.348 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.348 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.348 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.348 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-20T12:33:35.348 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-20T12:33:35.349 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.349 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.349 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.349 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.349 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.349 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.349 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.349 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.349 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.349 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.349 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.349 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-20T12:33:35.349 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-20T12:33:35.349 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.350 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.350 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.350 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.350 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.350 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.350 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.350 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.350 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.350 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.350 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.350 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-20T12:33:35.350 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-20T12:33:35.350 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.351 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.352 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_PASSWORD": { 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.353 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-20T12:33:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-20T12:33:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.354 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_URL": { 2024-04-20T12:33:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_URL", 2024-04-20T12:33:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.355 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_USERNAME": { 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.356 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.357 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-20T12:33:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-20T12:33:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.358 INFO:teuthology.orchestra.run.smithi135.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-20T12:33:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-20T12:33:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-20T12:33:35.359 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.360 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "[]", 2024-04-20T12:33:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "MULTICLUSTER_CONFIG": { 2024-04-20T12:33:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-20T12:33:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.361 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "{}", 2024-04-20T12:33:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_HOST": { 2024-04-20T12:33:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-20T12:33:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.362 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.363 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.364 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.365 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-20T12:33:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-20T12:33:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.366 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-20T12:33:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-20T12:33:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.368 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-20T12:33:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-20T12:33:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-20T12:33:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-20T12:33:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.370 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_ENABLED": { 2024-04-20T12:33:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-20T12:33:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.371 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-20T12:33:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-20T12:33:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-20T12:33:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.372 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-20T12:33:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-20T12:33:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.373 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-20T12:33:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-20T12:33:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8", 2024-04-20T12:33:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.374 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "45", 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.375 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ACCESS_KEY": { 2024-04-20T12:33:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-20T12:33:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-20T12:33:35.376 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-20T12:33:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-04-20T12:33:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SECRET_KEY": { 2024-04-20T12:33:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-20T12:33:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SSL_VERIFY": { 2024-04-20T12:33:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-20T12:33:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.378 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "UNSAFE_TLS_v1_2": { 2024-04-20T12:33:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-20T12:33:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.379 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-20T12:33:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-20T12:33:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.380 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-04-20T12:33:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-20T12:33:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-20T12:33:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.381 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-20T12:33:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-20T12:33:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.382 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-04-20T12:33:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "cross_origin_url": { 2024-04-20T12:33:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cross_origin_url", 2024-04-20T12:33:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.383 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "crt_file": { 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crt_file", 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.384 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "debug": { 2024-04-20T12:33:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "debug", 2024-04-20T12:33:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.385 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable/disable debug options", 2024-04-20T12:33:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "jwt_token_ttl": { 2024-04-20T12:33:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "jwt_token_ttl", 2024-04-20T12:33:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "28800", 2024-04-20T12:33:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.386 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.387 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.388 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.389 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.390 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.391 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "motd": { 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "motd", 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.392 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "The message of the day", 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect_resolve_ip_addr": { 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "redirect_resolve_ip_addr", 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-04-20T12:33:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-04-20T12:33:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-04-20T12:33:35.394 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8080", 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.395 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-04-20T12:33:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-04-20T12:33:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.396 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl_server_port": { 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl_server_port", 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8443", 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.397 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-04-20T12:33:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-04-20T12:33:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "redirect", 2024-04-20T12:33:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect" 2024-04-20T12:33:35.398 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-04-20T12:33:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-04-20T12:33:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-04-20T12:33:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-04-20T12:33:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-04-20T12:33:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.399 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "url_prefix": { 2024-04-20T12:33:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url_prefix", 2024-04-20T12:33:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.400 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "devicehealth", 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_monitoring": { 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_monitoring", 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.401 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "monitor device health metrics", 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.402 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.403 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.404 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.405 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "mark_out_threshold": { 2024-04-20T12:33:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mark_out_threshold", 2024-04-20T12:33:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2419200", 2024-04-20T12:33:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-20T12:33:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_name": { 2024-04-20T12:33:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_name", 2024-04-20T12:33:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "device_health_metrics", 2024-04-20T12:33:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-20T12:33:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.408 INFO:teuthology.orchestra.run.smithi135.stdout: "retention_period": { 2024-04-20T12:33:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retention_period", 2024-04-20T12:33:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15552000", 2024-04-20T12:33:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain device health metrics", 2024-04-20T12:33:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_frequency": { 2024-04-20T12:33:35.409 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_frequency", 2024-04-20T12:33:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-04-20T12:33:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-20T12:33:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "self_heal": { 2024-04-20T12:33:35.410 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "self_heal", 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.411 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-04-20T12:33:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and check device health", 2024-04-20T12:33:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_threshold": { 2024-04-20T12:33:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_threshold", 2024-04-20T12:33:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.412 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7257600", 2024-04-20T12:33:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-20T12:33:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "diskprediction_local", 2024-04-20T12:33:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.413 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.414 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.415 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.416 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.417 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "predict_interval": { 2024-04-20T12:33:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predict_interval", 2024-04-20T12:33:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-04-20T12:33:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.418 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "predictor_model": { 2024-04-20T12:33:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predictor_model", 2024-04-20T12:33:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "prophetstor", 2024-04-20T12:33:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.419 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-04-20T12:33:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-04-20T12:33:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-04-20T12:33:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.420 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "influx", 2024-04-20T12:33:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": false, 2024-04-20T12:33:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "influxdb python module not found", 2024-04-20T12:33:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "batch_size": { 2024-04-20T12:33:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "batch_size", 2024-04-20T12:33:35.421 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5000", 2024-04-20T12:33:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-20T12:33:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "database": { 2024-04-20T12:33:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "database", 2024-04-20T12:33:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.422 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "ceph", 2024-04-20T12:33:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-20T12:33:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": { 2024-04-20T12:33:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hostname", 2024-04-20T12:33:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.423 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server hostname", 2024-04-20T12:33:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-04-20T12:33:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-04-20T12:33:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.424 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "30", 2024-04-20T12:33:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "5", 2024-04-20T12:33:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-20T12:33:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.425 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.426 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.427 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.428 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.429 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "password": { 2024-04-20T12:33:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "password", 2024-04-20T12:33:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "password of InfluxDB server user", 2024-04-20T12:33:35.430 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "port": { 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "port", 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8086", 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server port", 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.431 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-04-20T12:33:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-04-20T12:33:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "false", 2024-04-20T12:33:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-20T12:33:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "threads": { 2024-04-20T12:33:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threads", 2024-04-20T12:33:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-04-20T12:33:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-04-20T12:33:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "32", 2024-04-20T12:33:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-20T12:33:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.433 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "username": { 2024-04-20T12:33:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "username", 2024-04-20T12:33:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "username of InfluxDB server user", 2024-04-20T12:33:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: "verify_ssl": { 2024-04-20T12:33:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "verify_ssl", 2024-04-20T12:33:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.435 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "true", 2024-04-20T12:33:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-20T12:33:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "insights", 2024-04-20T12:33:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.438 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.439 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.440 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.442 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "iostat", 2024-04-20T12:33:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.443 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.444 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.445 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.446 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.447 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "k8sevents", 2024-04-20T12:33:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_event_retention_days": { 2024-04-20T12:33:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ceph_event_retention_days", 2024-04-20T12:33:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7", 2024-04-20T12:33:35.448 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-20T12:33:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "config_check_secs": { 2024-04-20T12:33:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_check_secs", 2024-04-20T12:33:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "10", 2024-04-20T12:33:35.449 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-20T12:33:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.450 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.451 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.452 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.453 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.454 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "localpool", 2024-04-20T12:33:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "failure_domain": { 2024-04-20T12:33:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "failure_domain", 2024-04-20T12:33:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.455 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "host", 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "failure domain for any created local pool", 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.456 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.458 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.459 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.460 INFO:teuthology.orchestra.run.smithi135.stdout: "min_size": { 2024-04-20T12:33:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_size", 2024-04-20T12:33:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default min_size for any created local pool", 2024-04-20T12:33:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-20T12:33:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.461 INFO:teuthology.orchestra.run.smithi135.stdout: "num_rep": { 2024-04-20T12:33:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "num_rep", 2024-04-20T12:33:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3", 2024-04-20T12:33:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default replica count for any created local pool", 2024-04-20T12:33:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.462 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_num": { 2024-04-20T12:33:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_num", 2024-04-20T12:33:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "128", 2024-04-20T12:33:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default pg_num for any created local pool", 2024-04-20T12:33:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.463 INFO:teuthology.orchestra.run.smithi135.stdout: "prefix": { 2024-04-20T12:33:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prefix", 2024-04-20T12:33:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name prefix for any created local pool", 2024-04-20T12:33:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.464 INFO:teuthology.orchestra.run.smithi135.stdout: "subtree": { 2024-04-20T12:33:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "subtree", 2024-04-20T12:33:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "rack", 2024-04-20T12:33:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-20T12:33:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-20T12:33:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.465 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mds_autoscaler", 2024-04-20T12:33:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.466 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.467 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.468 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.469 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.469 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.469 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.469 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.469 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.469 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.469 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.469 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.469 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.469 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.469 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.469 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.469 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.469 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.469 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.470 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.470 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.470 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.470 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.470 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.470 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.470 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.470 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.470 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.470 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.470 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.470 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.470 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.470 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.471 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.471 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.471 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.471 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.471 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirroring", 2024-04-20T12:33:35.471 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.471 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.471 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.471 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.471 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.471 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.471 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.471 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.471 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.471 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.472 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.472 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.472 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.472 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.472 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.472 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.472 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.472 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.472 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.472 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.472 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.472 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.472 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.473 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.474 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.474 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.474 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.474 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.474 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.474 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.474 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.474 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.474 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.474 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.474 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.474 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.474 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.475 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.475 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.475 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.475 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.475 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.475 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.475 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.475 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.475 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.475 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.475 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.475 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.475 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.475 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.475 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.476 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.476 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.476 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.476 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.476 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.476 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.476 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.476 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.476 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.476 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "nfs", 2024-04-20T12:33:35.476 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.476 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.476 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.476 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.477 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.477 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.477 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.477 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.477 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.477 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.477 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.477 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.477 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.477 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.477 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.477 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.477 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.477 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.478 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.478 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.478 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.478 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.478 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.478 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.478 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.478 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.478 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.478 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.478 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.478 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.478 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.478 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.479 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.479 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.479 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.479 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.479 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.479 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.479 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.479 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.479 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.479 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.479 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.479 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.479 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.479 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.479 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.480 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.481 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.481 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.481 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.481 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.481 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.481 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.481 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.481 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.481 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.481 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.481 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.481 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.481 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.481 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-04-20T12:33:35.481 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.482 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.482 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.482 INFO:teuthology.orchestra.run.smithi135.stdout: "fail_fs": { 2024-04-20T12:33:35.482 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "fail_fs", 2024-04-20T12:33:35.482 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.482 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.482 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.482 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.482 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.482 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.482 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.482 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-20T12:33:35.482 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.482 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.483 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.483 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.483 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.483 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.483 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.483 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.483 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.483 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.483 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.483 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.483 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.483 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.483 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.483 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.483 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.484 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.485 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.486 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.486 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.486 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.486 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.486 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.486 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.486 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.486 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.486 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.486 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.486 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.486 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.486 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.486 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.487 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.487 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.487 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.487 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.487 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.487 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.487 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.487 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.487 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.487 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.487 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.487 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator": { 2024-04-20T12:33:35.487 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-04-20T12:33:35.487 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.487 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm", 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: "rook", 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: "test_orchestrator" 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Orchestrator backend", 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.488 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_perf_query", 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.489 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.490 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.490 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.490 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.490 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.490 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.490 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.490 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.490 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.490 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.490 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.490 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.490 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.490 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.490 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.491 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.492 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.493 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_support", 2024-04-20T12:33:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.494 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.495 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.496 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.497 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.497 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.497 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.497 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.497 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.497 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.497 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.497 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.497 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.497 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.497 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.497 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.497 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.497 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.498 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.498 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.498 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.498 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.498 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.498 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.498 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.498 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.498 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.498 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.498 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.498 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.498 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.498 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.498 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.499 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.499 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_autoscaler", 2024-04-20T12:33:35.499 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.499 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.499 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.499 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.499 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.499 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.499 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.499 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.499 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.499 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.499 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.499 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.499 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.500 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.501 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.502 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.502 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.502 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.502 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.502 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.502 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.502 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.502 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.502 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.502 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.502 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.502 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.502 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-04-20T12:33:35.503 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-04-20T12:33:35.504 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.504 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.504 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.504 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-04-20T12:33:35.504 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.504 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.504 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.504 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.504 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.504 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.504 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.504 INFO:teuthology.orchestra.run.smithi135.stdout: "threshold": { 2024-04-20T12:33:35.504 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threshold", 2024-04-20T12:33:35.505 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:35.505 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.505 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.505 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-04-20T12:33:35.505 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1.0", 2024-04-20T12:33:35.505 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.505 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.505 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "scaling threshold", 2024-04-20T12:33:35.505 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-20T12:33:35.505 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.505 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.505 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.505 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.506 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.506 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "progress", 2024-04-20T12:33:35.506 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.506 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.506 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.506 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_pg_recovery_event": { 2024-04-20T12:33:35.506 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_pg_recovery_event", 2024-04-20T12:33:35.506 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.506 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.506 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.506 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.506 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.506 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.507 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.507 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-20T12:33:35.507 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.507 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.507 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.507 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.507 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-04-20T12:33:35.507 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-04-20T12:33:35.507 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.507 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.507 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.507 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.507 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.507 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.508 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.508 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.508 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.508 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.508 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.508 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.508 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.508 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.508 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.508 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.508 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.508 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.508 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.508 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.509 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.509 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.509 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.509 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.509 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.509 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.509 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.509 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.509 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.509 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.509 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.509 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.509 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.510 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.510 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.510 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.510 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.510 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.510 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.510 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.510 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.510 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.510 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.510 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.510 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.510 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.510 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.511 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.511 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.511 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.511 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.511 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.511 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.511 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.511 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.511 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.511 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.511 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.511 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.511 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.511 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.511 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.512 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.512 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.512 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.512 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.512 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.512 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.512 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.512 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.512 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.512 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.512 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.512 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.512 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.512 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.513 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.513 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.513 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.513 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.513 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.513 INFO:teuthology.orchestra.run.smithi135.stdout: "max_completed_events": { 2024-04-20T12:33:35.513 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_completed_events", 2024-04-20T12:33:35.513 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.513 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.513 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.513 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "50", 2024-04-20T12:33:35.513 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.513 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.514 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.514 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "number of past completed events to remember", 2024-04-20T12:33:35.514 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.514 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.514 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.514 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.514 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-04-20T12:33:35.514 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-04-20T12:33:35.514 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.514 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.514 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.514 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-04-20T12:33:35.514 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.514 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.515 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.515 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long the module is going to sleep", 2024-04-20T12:33:35.515 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.515 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.515 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.515 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.515 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.515 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.515 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.515 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus", 2024-04-20T12:33:35.515 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.515 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.515 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.515 INFO:teuthology.orchestra.run.smithi135.stdout: "cache": { 2024-04-20T12:33:35.516 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cache", 2024-04-20T12:33:35.516 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.516 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.516 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.516 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.516 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.516 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.516 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.516 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.516 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.516 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.516 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.516 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.516 INFO:teuthology.orchestra.run.smithi135.stdout: "exclude_perf_counters": { 2024-04-20T12:33:35.517 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "exclude_perf_counters", 2024-04-20T12:33:35.517 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.517 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.517 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.517 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.517 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.517 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.517 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.517 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-20T12:33:35.517 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-20T12:33:35.517 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.517 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.517 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.517 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.518 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.518 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.518 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.518 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.518 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.518 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.518 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.518 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.518 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.518 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.518 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.518 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.518 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.518 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.519 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.520 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.520 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.520 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.520 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.520 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.520 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.520 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.520 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.520 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.520 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.520 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.520 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.520 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.520 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.521 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.522 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.522 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.522 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.522 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.522 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.522 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.522 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.522 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.522 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.522 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools": { 2024-04-20T12:33:35.522 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools", 2024-04-20T12:33:35.522 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.522 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.523 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.523 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.523 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.523 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.523 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.523 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.523 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.523 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.523 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.523 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.523 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-20T12:33:35.523 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-20T12:33:35.523 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.523 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.523 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.524 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "300", 2024-04-20T12:33:35.524 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.524 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.524 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.524 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.524 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.524 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.524 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.524 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.524 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_interval": { 2024-04-20T12:33:35.524 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_interval", 2024-04-20T12:33:35.524 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:35.524 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.524 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.524 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15.0", 2024-04-20T12:33:35.525 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.525 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.525 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.525 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.525 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.525 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.525 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.525 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.525 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-04-20T12:33:35.525 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-04-20T12:33:35.525 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.525 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.525 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.525 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-04-20T12:33:35.526 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.526 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.526 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.526 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-20T12:33:35.526 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.526 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.526 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.526 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.526 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-04-20T12:33:35.526 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-04-20T12:33:35.526 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.526 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.526 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.526 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "9283", 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "stale_cache_strategy": { 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stale_cache_strategy", 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "log", 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.527 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "default", 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: "default", 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: "error" 2024-04-20T12:33:35.528 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.529 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.530 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.530 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.530 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.530 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.530 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.530 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_support", 2024-04-20T12:33:35.530 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.530 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.530 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.530 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.530 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.530 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.530 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.530 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.530 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.531 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.531 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.531 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.531 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.531 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.531 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.531 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.531 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.531 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.531 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.531 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.531 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.531 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.531 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.531 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.532 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.533 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.533 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.533 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.533 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.533 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.533 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.533 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.533 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.533 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.533 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.533 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.533 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.533 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.533 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.533 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.534 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.534 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.534 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.534 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.534 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.534 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.534 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.534 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.534 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.534 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.534 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.534 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.534 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.534 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_snap_create": { 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_snap_create", 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.535 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.536 INFO:teuthology.orchestra.run.smithi135.stdout: "mirror_snapshot_schedule": { 2024-04-20T12:33:35.536 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirror_snapshot_schedule", 2024-04-20T12:33:35.536 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.536 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.536 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.536 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.536 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.536 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.536 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.536 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.536 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.536 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.536 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.536 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.536 INFO:teuthology.orchestra.run.smithi135.stdout: "trash_purge_schedule": { 2024-04-20T12:33:35.537 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "trash_purge_schedule", 2024-04-20T12:33:35.537 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.537 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.537 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.537 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.537 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.537 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.537 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.537 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.537 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.537 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.537 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.538 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.538 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.538 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.538 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.538 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "restful", 2024-04-20T12:33:35.538 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.538 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.538 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.538 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_auth": { 2024-04-20T12:33:35.538 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_auth", 2024-04-20T12:33:35.538 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.538 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.538 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.538 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.539 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.540 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.541 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.542 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.542 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.542 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.542 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.542 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.542 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.542 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.542 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.542 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.542 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.542 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.542 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.542 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.542 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.542 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.543 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.543 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.543 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.543 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.543 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.543 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.543 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.543 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.543 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.543 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.543 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.543 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.543 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.543 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.543 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-04-20T12:33:35.544 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.545 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.546 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.546 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.546 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.546 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.546 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.546 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.546 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.546 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.546 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.546 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.546 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.546 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.546 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.546 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rgw", 2024-04-20T12:33:35.546 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.547 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.547 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.547 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.547 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.547 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.547 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.547 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.547 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.547 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.547 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.547 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.547 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.547 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.547 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.548 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.548 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.548 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.548 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.548 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.548 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.548 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.548 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.548 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.548 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.548 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.548 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.548 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.548 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.548 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.549 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.549 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.549 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.549 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.549 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.549 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.549 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.549 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.549 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.549 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.549 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.549 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.549 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.549 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.549 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.550 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.550 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.550 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.550 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.550 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.550 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.550 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.550 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.550 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.550 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.550 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.550 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.550 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.551 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.551 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.551 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.551 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.551 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.551 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.551 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.551 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.551 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.551 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.551 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.551 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.551 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.551 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.551 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rook", 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.552 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.553 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.554 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.554 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.554 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.554 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.554 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.554 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.554 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.554 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.554 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.554 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.554 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.554 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.554 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.554 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.555 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.555 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.555 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.555 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.555 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.555 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.555 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.555 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.555 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.555 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.555 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.555 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.555 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.555 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.556 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.557 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.557 INFO:teuthology.orchestra.run.smithi135.stdout: "storage_class": { 2024-04-20T12:33:35.557 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "storage_class", 2024-04-20T12:33:35.557 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.557 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.557 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.557 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "local", 2024-04-20T12:33:35.557 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.557 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.557 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.557 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-20T12:33:35.557 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.557 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.557 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.557 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "selftest", 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.558 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.559 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.560 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.561 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.562 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.562 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.562 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.562 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.562 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.562 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.562 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.562 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.562 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.562 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.562 INFO:teuthology.orchestra.run.smithi135.stdout: "roption1": { 2024-04-20T12:33:35.562 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption1", 2024-04-20T12:33:35.562 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.562 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: "roption2": { 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption2", 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.563 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "xyz", 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption1": { 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption1", 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.564 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption2": { 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption2", 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.565 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.566 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.566 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.566 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.566 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.566 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption3": { 2024-04-20T12:33:35.566 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption3", 2024-04-20T12:33:35.566 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:35.566 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.566 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.566 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.566 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.566 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.566 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.566 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.566 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.567 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.567 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.567 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.567 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption4": { 2024-04-20T12:33:35.567 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption4", 2024-04-20T12:33:35.567 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.567 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.567 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.567 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.567 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.567 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.567 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.567 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.567 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.567 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.568 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.568 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.568 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption5": { 2024-04-20T12:33:35.568 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption5", 2024-04-20T12:33:35.568 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.568 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.568 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.568 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.568 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.568 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.568 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.568 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.568 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.568 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.568 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption6": { 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption6", 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.569 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption7": { 2024-04-20T12:33:35.570 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption7", 2024-04-20T12:33:35.570 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.570 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.570 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.570 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.570 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-04-20T12:33:35.570 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "42", 2024-04-20T12:33:35.570 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.570 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.570 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.570 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.570 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.570 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.570 INFO:teuthology.orchestra.run.smithi135.stdout: "testkey": { 2024-04-20T12:33:35.570 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testkey", 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: "testlkey": { 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testlkey", 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.571 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: "testnewline": { 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testnewline", 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.572 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.573 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.573 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.573 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.573 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.573 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.573 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.573 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.573 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.573 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.573 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.573 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.573 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snap_schedule", 2024-04-20T12:33:35.573 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.573 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.573 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.574 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_m_granularity": { 2024-04-20T12:33:35.574 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_m_granularity", 2024-04-20T12:33:35.574 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.574 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.574 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.574 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.574 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.574 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.574 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.574 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow minute scheduled snapshots", 2024-04-20T12:33:35.574 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.574 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.574 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.574 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.574 INFO:teuthology.orchestra.run.smithi135.stdout: "dump_on_update": { 2024-04-20T12:33:35.575 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dump_on_update", 2024-04-20T12:33:35.575 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.575 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.575 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.575 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.575 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.575 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.575 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.575 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "dump database to debug log on update", 2024-04-20T12:33:35.575 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.575 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.575 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.575 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.575 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.575 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.576 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.577 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.577 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.577 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.577 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.577 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.577 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.577 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.577 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.577 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.577 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.577 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.577 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.577 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.577 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.577 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.578 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.578 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.578 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.578 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.578 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.578 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.578 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.578 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.578 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.578 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.578 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.578 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.578 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.578 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.579 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stats", 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.580 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.581 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.582 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.582 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.582 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.582 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.582 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.582 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.582 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.582 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.582 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.582 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.582 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.582 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.582 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.582 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.582 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.583 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.584 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.584 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.584 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.584 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.584 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.584 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.584 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.584 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.584 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.584 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.584 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.584 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.584 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.584 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.584 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "status", 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.585 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.586 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.586 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.586 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.586 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.586 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.586 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.586 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.586 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.586 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.586 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.586 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.586 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.586 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.586 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.587 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.587 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.587 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.587 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.587 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.587 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.587 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.587 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.587 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.587 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.587 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.587 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.587 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.587 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.588 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.588 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.588 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.588 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.588 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.588 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.588 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.588 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.588 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.588 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.588 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.588 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.588 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.588 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.588 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.589 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.590 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.590 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.590 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.590 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.590 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.590 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.590 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.590 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.590 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.590 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.590 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telegraf", 2024-04-20T12:33:35.590 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.590 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.590 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: "address": { 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "address", 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-04-20T12:33:35.591 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15", 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.592 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.593 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.594 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.594 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.594 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.594 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.594 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.594 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.594 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.594 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.594 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.594 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.594 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.594 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.594 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.594 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.595 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.595 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.595 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.595 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.595 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.595 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.595 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.595 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.595 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.595 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.595 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.595 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.595 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.595 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.595 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.596 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.596 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.596 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.596 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.596 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.596 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.596 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.596 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.596 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.596 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.596 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.596 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.596 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.596 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.597 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.597 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.597 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.597 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.597 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.597 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.597 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.597 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.597 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.597 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telemetry", 2024-04-20T12:33:35.597 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.597 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.597 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.597 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_basic": { 2024-04-20T12:33:35.598 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_basic", 2024-04-20T12:33:35.598 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.598 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.598 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.598 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.598 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.598 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.598 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.598 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-20T12:33:35.598 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.598 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.598 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.598 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.599 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_crash": { 2024-04-20T12:33:35.599 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_crash", 2024-04-20T12:33:35.599 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.599 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.599 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.599 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.599 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.599 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.599 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.599 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-20T12:33:35.599 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.599 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.599 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.599 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.600 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_device": { 2024-04-20T12:33:35.600 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_device", 2024-04-20T12:33:35.600 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.600 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.600 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.600 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.600 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.600 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.600 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.600 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-20T12:33:35.600 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.600 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.600 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.600 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.601 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_ident": { 2024-04-20T12:33:35.601 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_ident", 2024-04-20T12:33:35.601 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.601 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.601 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.601 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.601 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.601 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.601 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.601 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-20T12:33:35.601 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.601 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.601 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.601 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.601 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_perf": { 2024-04-20T12:33:35.602 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_perf", 2024-04-20T12:33:35.602 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.602 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.602 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.602 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.602 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.602 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.602 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.602 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-20T12:33:35.602 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.602 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.602 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.602 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.602 INFO:teuthology.orchestra.run.smithi135.stdout: "contact": { 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "contact", 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "description": { 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "description", 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.603 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "device_url": { 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_url", 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.604 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-04-20T12:33:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-04-20T12:33:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.605 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-04-20T12:33:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-04-20T12:33:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "24", 2024-04-20T12:33:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "8", 2024-04-20T12:33:35.606 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: "last_opt_revision": { 2024-04-20T12:33:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "last_opt_revision", 2024-04-20T12:33:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1", 2024-04-20T12:33:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.607 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard": { 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard", 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.608 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.609 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.609 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.609 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.609 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard_description": { 2024-04-20T12:33:35.609 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard_description", 2024-04-20T12:33:35.609 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.609 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.609 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.609 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.609 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.609 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.609 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.609 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.609 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.609 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.610 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.610 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.610 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.610 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.610 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.610 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.610 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.610 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.610 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.610 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.610 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.610 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.610 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.610 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.611 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.612 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.612 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.612 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.612 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.612 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.612 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.612 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.612 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.612 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.612 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.612 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.612 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.612 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.612 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.613 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.613 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.613 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.613 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.613 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.613 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.613 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.613 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.613 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.613 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.613 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.613 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.613 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.613 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.613 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.614 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.614 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.614 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.614 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.614 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.614 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.614 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.614 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.614 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.614 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.614 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.614 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.614 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.614 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.615 INFO:teuthology.orchestra.run.smithi135.stdout: "organization": { 2024-04-20T12:33:35.615 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "organization", 2024-04-20T12:33:35.615 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.615 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.615 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.615 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.615 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.615 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.615 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.615 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.615 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.615 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.615 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.615 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.615 INFO:teuthology.orchestra.run.smithi135.stdout: "proxy": { 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "proxy", 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: "url": { 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url", 2024-04-20T12:33:35.616 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "test_orchestrator", 2024-04-20T12:33:35.617 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.618 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.618 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.618 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.618 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.618 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.618 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.618 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.618 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.618 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.618 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.618 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.618 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.618 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.618 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.618 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.619 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.619 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.619 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.619 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.619 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.619 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.619 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.619 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.619 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.619 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.619 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.619 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.619 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.619 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.619 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.620 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.621 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.622 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.622 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.622 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.622 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.622 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.622 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.622 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.622 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.622 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.622 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.622 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.622 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.622 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "volumes", 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.623 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.624 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.624 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.624 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.624 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.624 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.624 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.624 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.624 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.624 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.624 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.624 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.624 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.624 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.624 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.624 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.625 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.626 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.626 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.626 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.626 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.626 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.626 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.626 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.626 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.626 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.626 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.626 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.626 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.626 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.626 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_clones": { 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_clones", 2024-04-20T12:33:35.627 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.628 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.628 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.628 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4", 2024-04-20T12:33:35.628 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.628 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.628 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.628 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-20T12:33:35.628 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.628 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.628 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.628 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.628 INFO:teuthology.orchestra.run.smithi135.stdout: "periodic_async_work": { 2024-04-20T12:33:35.628 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "periodic_async_work", 2024-04-20T12:33:35.628 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.628 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.629 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.629 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.629 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.629 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.629 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.629 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Periodically check for async work", 2024-04-20T12:33:35.629 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.629 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.629 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.629 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.629 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_delay": { 2024-04-20T12:33:35.629 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_delay", 2024-04-20T12:33:35.629 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.629 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.629 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.630 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-04-20T12:33:35.630 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.630 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.630 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.630 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-20T12:33:35.630 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.630 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.630 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.630 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.630 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_no_wait": { 2024-04-20T12:33:35.630 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_no_wait", 2024-04-20T12:33:35.630 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.630 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.630 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.630 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.631 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.631 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.631 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.631 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-20T12:33:35.631 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.631 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.631 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.631 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.631 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.631 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.631 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.631 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix", 2024-04-20T12:33:35.631 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.631 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.631 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: "discovery_interval": { 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "discovery_interval", 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "100", 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: "identifier": { 2024-04-20T12:33:35.632 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "identifier", 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.633 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.634 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.635 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.635 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.635 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.635 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.635 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.635 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.635 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.635 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.635 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.635 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.635 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.635 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.635 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.635 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.635 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.636 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.636 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.636 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.636 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.636 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.636 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.636 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.636 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.636 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.636 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.636 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.636 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.636 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.636 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.636 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.637 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.638 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.638 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.638 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.638 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.638 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.638 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.638 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.638 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.638 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.638 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.638 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.638 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.638 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.638 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.638 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.639 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.639 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.639 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.639 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_host": { 2024-04-20T12:33:35.639 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_host", 2024-04-20T12:33:35.639 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.639 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.639 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.639 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.639 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.639 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.639 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.639 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.639 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.639 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_port": { 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_port", 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10051", 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.640 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.641 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_sender": { 2024-04-20T12:33:35.641 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_sender", 2024-04-20T12:33:35.641 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.641 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.641 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.641 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-20T12:33:35.641 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.641 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.641 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.641 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.641 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.641 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.641 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.641 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.641 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.642 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.642 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-04-20T12:33:35.642 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.642 INFO:teuthology.orchestra.run.smithi135.stdout: "gid": 25090, 2024-04-20T12:33:35.642 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "z", 2024-04-20T12:33:35.642 INFO:teuthology.orchestra.run.smithi135.stdout: "mgr_features": 4540701547738038271, 2024-04-20T12:33:35.642 INFO:teuthology.orchestra.run.smithi135.stdout: "available_modules": [ 2024-04-20T12:33:35.642 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.642 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "alerts", 2024-04-20T12:33:35.642 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.642 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.642 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.642 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-04-20T12:33:35.642 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-04-20T12:33:35.643 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.643 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.643 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.643 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-04-20T12:33:35.643 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.643 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.643 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.643 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How frequently to reexamine health status", 2024-04-20T12:33:35.643 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.643 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.643 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.643 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.643 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.643 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.644 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.645 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.646 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.647 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.647 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.647 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.647 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.647 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.647 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.647 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.647 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.647 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.647 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.647 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.647 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.647 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.647 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.647 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_destination": { 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_destination", 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email address to send alerts to", 2024-04-20T12:33:35.648 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.649 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.649 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.649 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_from_name": { 2024-04-20T12:33:35.649 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_from_name", 2024-04-20T12:33:35.649 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.649 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.649 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.649 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "Ceph", 2024-04-20T12:33:35.649 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.649 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.649 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.649 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email From: name", 2024-04-20T12:33:35.649 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.649 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.650 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.650 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_host": { 2024-04-20T12:33:35.650 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_host", 2024-04-20T12:33:35.650 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.650 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.650 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.650 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.650 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.650 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.650 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.650 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP server", 2024-04-20T12:33:35.650 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.650 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.650 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.651 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_password": { 2024-04-20T12:33:35.651 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_password", 2024-04-20T12:33:35.651 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.651 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.651 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.651 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.651 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.651 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.651 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.651 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Password to authenticate with", 2024-04-20T12:33:35.651 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.651 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.651 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.652 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_port": { 2024-04-20T12:33:35.652 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_port", 2024-04-20T12:33:35.652 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.652 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.652 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.652 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "465", 2024-04-20T12:33:35.652 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.652 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.652 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.652 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP port", 2024-04-20T12:33:35.652 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.652 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.652 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_sender": { 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_sender", 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP envelope sender", 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.653 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_ssl": { 2024-04-20T12:33:35.654 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_ssl", 2024-04-20T12:33:35.654 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.654 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.654 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.654 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.654 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.654 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.654 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.654 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-20T12:33:35.654 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.654 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.654 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.655 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_user": { 2024-04-20T12:33:35.655 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_user", 2024-04-20T12:33:35.655 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.655 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.655 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.655 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.655 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.655 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.655 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.655 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "User to authenticate as", 2024-04-20T12:33:35.655 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.655 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.655 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.656 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.656 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.656 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.656 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "balancer", 2024-04-20T12:33:35.656 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.656 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.656 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.656 INFO:teuthology.orchestra.run.smithi135.stdout: "active": { 2024-04-20T12:33:35.656 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "active", 2024-04-20T12:33:35.656 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.656 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.656 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.656 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.657 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.657 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.657 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.657 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically balance PGs across cluster", 2024-04-20T12:33:35.657 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.657 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.657 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.657 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.657 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_time": { 2024-04-20T12:33:35.657 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_time", 2024-04-20T12:33:35.657 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.657 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.657 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.657 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0000", 2024-04-20T12:33:35.657 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.658 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.658 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.658 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "beginning time of day to automatically balance", 2024-04-20T12:33:35.658 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-20T12:33:35.658 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.658 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.658 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.658 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_weekday": { 2024-04-20T12:33:35.658 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_weekday", 2024-04-20T12:33:35.658 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-04-20T12:33:35.658 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.658 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.658 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-04-20T12:33:35.658 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-04-20T12:33:35.659 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-04-20T12:33:35.659 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.659 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-20T12:33:35.659 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-20T12:33:35.659 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.659 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.659 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.659 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_max_iterations": { 2024-04-20T12:33:35.659 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_max_iterations", 2024-04-20T12:33:35.659 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-04-20T12:33:35.659 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.659 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.659 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "25", 2024-04-20T12:33:35.659 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-04-20T12:33:35.659 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "250", 2024-04-20T12:33:35.660 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.660 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-20T12:33:35.660 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.660 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.660 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.660 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.660 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_metrics": { 2024-04-20T12:33:35.660 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_metrics", 2024-04-20T12:33:35.660 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.660 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.660 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.660 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "pgs,objects,bytes", 2024-04-20T12:33:35.660 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.660 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.660 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.661 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-20T12:33:35.661 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-20T12:33:35.661 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.661 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.661 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.661 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_step": { 2024-04-20T12:33:35.661 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_step", 2024-04-20T12:33:35.661 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:35.661 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.661 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.661 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.5", 2024-04-20T12:33:35.661 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0.001", 2024-04-20T12:33:35.661 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "0.999", 2024-04-20T12:33:35.661 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.661 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "aggressiveness of optimization", 2024-04-20T12:33:35.662 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-20T12:33:35.662 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.662 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.662 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.662 INFO:teuthology.orchestra.run.smithi135.stdout: "end_time": { 2024-04-20T12:33:35.662 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_time", 2024-04-20T12:33:35.662 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.662 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.662 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.662 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2359", 2024-04-20T12:33:35.662 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.662 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.662 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.662 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ending time of day to automatically balance", 2024-04-20T12:33:35.662 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-20T12:33:35.663 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.663 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.663 INFO:teuthology.orchestra.run.smithi135.stdout: "end_weekday": { 2024-04-20T12:33:35.663 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_weekday", 2024-04-20T12:33:35.663 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-04-20T12:33:35.663 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.663 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.663 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-04-20T12:33:35.663 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-04-20T12:33:35.663 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-04-20T12:33:35.663 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.663 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-20T12:33:35.663 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-20T12:33:35.664 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.664 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.664 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.664 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.664 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.664 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.664 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.664 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.664 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.664 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.664 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.664 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.664 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.664 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.664 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.665 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.666 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.666 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.666 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.666 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.666 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.666 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.666 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.666 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.666 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.666 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.666 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.666 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.667 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.667 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.667 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.667 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.667 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.667 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.667 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.667 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.667 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.667 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.667 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.667 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.667 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.667 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.668 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.668 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.668 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.668 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.668 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.668 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.668 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.668 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.668 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.668 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.668 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.668 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.668 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.668 INFO:teuthology.orchestra.run.smithi135.stdout: "min_score": { 2024-04-20T12:33:35.669 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_score", 2024-04-20T12:33:35.669 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:35.669 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.669 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.669 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-04-20T12:33:35.669 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.669 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.669 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.669 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-20T12:33:35.669 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.669 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.669 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.669 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-04-20T12:33:35.669 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-04-20T12:33:35.670 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.670 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.670 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.670 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "upmap", 2024-04-20T12:33:35.670 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.670 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.670 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.670 INFO:teuthology.orchestra.run.smithi135.stdout: "crush-compat", 2024-04-20T12:33:35.670 INFO:teuthology.orchestra.run.smithi135.stdout: "none", 2024-04-20T12:33:35.670 INFO:teuthology.orchestra.run.smithi135.stdout: "read", 2024-04-20T12:33:35.670 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap", 2024-04-20T12:33:35.670 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap-read" 2024-04-20T12:33:35.670 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.670 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Balancer mode", 2024-04-20T12:33:35.671 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.671 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.671 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.671 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_ids": { 2024-04-20T12:33:35.671 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_ids", 2024-04-20T12:33:35.671 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.671 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.671 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.671 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.671 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.671 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.671 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.671 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-20T12:33:35.671 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-04-20T12:33:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-04-20T12:33:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-04-20T12:33:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-20T12:33:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.672 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.673 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.673 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_deviation": { 2024-04-20T12:33:35.673 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_deviation", 2024-04-20T12:33:35.673 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.673 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.673 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.673 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-04-20T12:33:35.673 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-04-20T12:33:35.673 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.673 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.673 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-20T12:33:35.673 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-20T12:33:35.673 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.673 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.674 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_optimizations": { 2024-04-20T12:33:35.674 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_optimizations", 2024-04-20T12:33:35.674 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-04-20T12:33:35.674 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.674 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.674 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.674 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.674 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.674 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.674 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-20T12:33:35.674 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.674 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.674 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.675 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.675 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.675 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.675 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cephadm", 2024-04-20T12:33:35.675 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.675 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.675 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.675 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_down_multiplier": { 2024-04-20T12:33:35.675 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_down_multiplier", 2024-04-20T12:33:35.675 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:35.675 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.675 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.675 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-04-20T12:33:35.675 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.676 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.676 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.676 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-20T12:33:35.676 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.676 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.676 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.676 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_refresh_rate": { 2024-04-20T12:33:35.676 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_refresh_rate", 2024-04-20T12:33:35.676 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.676 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.676 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.676 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "20", 2024-04-20T12:33:35.676 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.676 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.677 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.677 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-20T12:33:35.677 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.677 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.677 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.677 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_starting_port": { 2024-04-20T12:33:35.677 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_starting_port", 2024-04-20T12:33:35.677 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.677 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.677 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.677 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4721", 2024-04-20T12:33:35.677 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.677 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.677 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.678 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-20T12:33:35.678 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.678 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.678 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.678 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_ptrace": { 2024-04-20T12:33:35.678 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_ptrace", 2024-04-20T12:33:35.678 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.678 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.678 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.678 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.678 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.678 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.678 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.678 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-20T12:33:35.679 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-20T12:33:35.679 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.679 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.679 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_interval": { 2024-04-20T12:33:35.679 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_interval", 2024-04-20T12:33:35.679 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.679 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.679 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.679 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-04-20T12:33:35.679 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.679 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.679 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.679 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-20T12:33:35.679 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.680 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.680 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.680 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_memory_target_ratio": { 2024-04-20T12:33:35.680 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_memory_target_ratio", 2024-04-20T12:33:35.680 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:35.680 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.680 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.680 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.7", 2024-04-20T12:33:35.680 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.680 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.680 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.680 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-20T12:33:35.680 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm_log_destination": { 2024-04-20T12:33:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cephadm_log_destination", 2024-04-20T12:33:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: "file", 2024-04-20T12:33:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: "file,syslog", 2024-04-20T12:33:35.681 INFO:teuthology.orchestra.run.smithi135.stdout: "syslog" 2024-04-20T12:33:35.682 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.682 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-20T12:33:35.682 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.682 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.682 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.682 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.682 INFO:teuthology.orchestra.run.smithi135.stdout: "cgroups_split": { 2024-04-20T12:33:35.682 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cgroups_split", 2024-04-20T12:33:35.682 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.682 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.682 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.682 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.682 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.682 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.682 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-20T12:33:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: "config_checks_enabled": { 2024-04-20T12:33:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_checks_enabled", 2024-04-20T12:33:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.683 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-20T12:33:35.684 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.684 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.684 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.684 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.684 INFO:teuthology.orchestra.run.smithi135.stdout: "config_dashboard": { 2024-04-20T12:33:35.684 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_dashboard", 2024-04-20T12:33:35.684 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.684 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.684 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.684 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.684 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.684 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.684 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.684 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-20T12:33:35.684 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_alertmanager": { 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_alertmanager", 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.685 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.686 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_base": { 2024-04-20T12:33:35.686 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_base", 2024-04-20T12:33:35.686 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.686 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.686 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.686 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-20T12:33:35.686 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.686 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.686 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.686 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Container image name, without the tag", 2024-04-20T12:33:35.686 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.686 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.686 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.687 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_elasticsearch": { 2024-04-20T12:33:35.687 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_elasticsearch", 2024-04-20T12:33:35.687 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.687 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.687 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.687 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-20T12:33:35.687 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.687 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.687 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.687 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "elasticsearch container image", 2024-04-20T12:33:35.687 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.687 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.687 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_grafana": { 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_grafana", 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_haproxy": { 2024-04-20T12:33:35.688 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_haproxy", 2024-04-20T12:33:35.689 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.689 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.689 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.689 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-20T12:33:35.689 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.689 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.689 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.689 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "HAproxy container image", 2024-04-20T12:33:35.689 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.689 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.689 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.689 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.689 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_agent": { 2024-04-20T12:33:35.689 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_agent", 2024-04-20T12:33:35.690 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.690 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.690 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.690 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-20T12:33:35.690 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.690 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.690 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.690 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger agent container image", 2024-04-20T12:33:35.690 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.690 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.690 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.690 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.690 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_collector": { 2024-04-20T12:33:35.690 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_collector", 2024-04-20T12:33:35.691 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.691 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.691 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.691 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-20T12:33:35.691 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.691 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.691 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.691 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger collector container image", 2024-04-20T12:33:35.691 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.691 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.691 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.691 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_query": { 2024-04-20T12:33:35.691 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_query", 2024-04-20T12:33:35.691 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.692 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.692 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.692 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-20T12:33:35.692 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.692 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.692 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.692 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger query container image", 2024-04-20T12:33:35.692 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.692 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.692 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.692 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_keepalived": { 2024-04-20T12:33:35.692 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_keepalived", 2024-04-20T12:33:35.692 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.692 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Keepalived container image", 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_loki": { 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_loki", 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.693 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-20T12:33:35.694 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.694 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.694 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.694 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Loki container image", 2024-04-20T12:33:35.694 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.694 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.694 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.694 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_node_exporter": { 2024-04-20T12:33:35.694 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_node_exporter", 2024-04-20T12:33:35.694 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.694 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.694 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.694 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-20T12:33:35.695 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.695 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.695 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.695 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-04-20T12:33:35.695 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.695 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.695 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.695 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.695 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_nvmeof": { 2024-04-20T12:33:35.695 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_nvmeof", 2024-04-20T12:33:35.695 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.695 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.695 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.695 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-20T12:33:35.695 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.696 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.696 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.696 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Nvme-of container image", 2024-04-20T12:33:35.696 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.696 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.696 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.696 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_prometheus": { 2024-04-20T12:33:35.696 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_prometheus", 2024-04-20T12:33:35.696 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.696 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.696 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.696 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-20T12:33:35.696 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.696 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.697 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.697 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-04-20T12:33:35.697 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.697 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.697 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.697 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_promtail": { 2024-04-20T12:33:35.697 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_promtail", 2024-04-20T12:33:35.698 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.698 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.698 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.698 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-20T12:33:35.698 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.698 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.698 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.698 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Promtail container image", 2024-04-20T12:33:35.698 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.699 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.699 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.699 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.699 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_samba": { 2024-04-20T12:33:35.699 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_samba", 2024-04-20T12:33:35.699 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.699 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.699 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.700 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-20T12:33:35.700 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.700 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.700 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.700 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Samba/SMB container image", 2024-04-20T12:33:35.700 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.700 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.700 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.700 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.700 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_snmp_gateway": { 2024-04-20T12:33:35.700 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_snmp_gateway", 2024-04-20T12:33:35.700 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.700 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.700 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SNMP Gateway container image", 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: "container_init": { 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_init", 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.701 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.702 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.702 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.702 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Run podman/docker with `--init`", 2024-04-20T12:33:35.702 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.702 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.702 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.702 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.702 INFO:teuthology.orchestra.run.smithi135.stdout: "daemon_cache_timeout": { 2024-04-20T12:33:35.702 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "daemon_cache_timeout", 2024-04-20T12:33:35.702 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.702 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.702 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.702 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-04-20T12:33:35.702 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.703 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.703 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.703 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-20T12:33:35.703 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.703 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.703 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.703 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.703 INFO:teuthology.orchestra.run.smithi135.stdout: "default_cephadm_command_timeout": { 2024-04-20T12:33:35.703 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_cephadm_command_timeout", 2024-04-20T12:33:35.703 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.703 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.703 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.703 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "900", 2024-04-20T12:33:35.703 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.703 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: "default_registry": { 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_registry", 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io", 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.704 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-20T12:33:35.705 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.705 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.705 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.705 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.705 INFO:teuthology.orchestra.run.smithi135.stdout: "device_cache_timeout": { 2024-04-20T12:33:35.705 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_cache_timeout", 2024-04-20T12:33:35.705 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.705 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.705 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.705 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1800", 2024-04-20T12:33:35.705 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.705 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.705 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.705 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache device inventory", 2024-04-20T12:33:35.705 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.706 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.706 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.706 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.706 INFO:teuthology.orchestra.run.smithi135.stdout: "device_enhanced_scan": { 2024-04-20T12:33:35.706 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_enhanced_scan", 2024-04-20T12:33:35.706 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.706 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.706 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.706 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.706 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.706 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.706 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.706 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-20T12:33:35.706 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.706 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: "facts_cache_timeout": { 2024-04-20T12:33:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "facts_cache_timeout", 2024-04-20T12:33:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-04-20T12:33:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache host facts data", 2024-04-20T12:33:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.707 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: "grafana_dashboards_path": { 2024-04-20T12:33:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "grafana_dashboards_path", 2024-04-20T12:33:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-20T12:33:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-20T12:33:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.708 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.709 INFO:teuthology.orchestra.run.smithi135.stdout: "host_check_interval": { 2024-04-20T12:33:35.709 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "host_check_interval", 2024-04-20T12:33:35.709 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.709 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.709 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.709 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-04-20T12:33:35.709 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.709 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.709 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.709 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to perform a host check", 2024-04-20T12:33:35.709 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.709 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.709 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.709 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.710 INFO:teuthology.orchestra.run.smithi135.stdout: "hw_monitoring": { 2024-04-20T12:33:35.710 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hw_monitoring", 2024-04-20T12:33:35.710 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.710 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.710 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.710 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.710 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.710 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.710 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.710 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-20T12:33:35.710 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.710 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.710 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.710 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.710 INFO:teuthology.orchestra.run.smithi135.stdout: "inventory_list_all": { 2024-04-20T12:33:35.711 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "inventory_list_all", 2024-04-20T12:33:35.711 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.711 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.711 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.711 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.711 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.711 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.711 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.711 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-20T12:33:35.711 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.711 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.711 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.711 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.711 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.712 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.712 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.712 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.712 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.712 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.712 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.712 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.712 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.712 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.712 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.712 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.712 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.712 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.712 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.712 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.713 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.713 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.713 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.713 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.713 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.713 INFO:teuthology.orchestra.run.smithi135.stdout: "log_refresh_metadata": { 2024-04-20T12:33:35.713 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_refresh_metadata", 2024-04-20T12:33:35.713 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.713 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.713 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.713 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.713 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.713 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.713 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.713 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-20T12:33:35.714 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.714 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.714 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.714 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.714 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.714 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.714 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.714 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.714 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.714 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.714 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.714 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.714 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.714 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-20T12:33:35.715 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.715 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.715 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.715 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.715 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.715 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.715 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.715 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.715 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.715 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.715 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.715 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.715 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.715 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.715 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.716 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.717 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.717 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.717 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.717 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.717 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.717 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.717 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.717 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.717 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-20T12:33:35.717 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-20T12:33:35.717 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.717 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.717 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.717 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.717 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.718 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.718 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.718 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-20T12:33:35.718 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.718 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.718 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.718 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.718 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-20T12:33:35.718 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-20T12:33:35.718 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.718 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.718 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.718 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "*", 2024-04-20T12:33:35.718 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.719 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.719 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.719 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-20T12:33:35.719 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.719 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.719 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.719 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.719 INFO:teuthology.orchestra.run.smithi135.stdout: "max_count_per_host": { 2024-04-20T12:33:35.719 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_count_per_host", 2024-04-20T12:33:35.719 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.719 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.719 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.719 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.719 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.719 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.720 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.720 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of daemons per service per host", 2024-04-20T12:33:35.720 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.720 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.720 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.720 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.720 INFO:teuthology.orchestra.run.smithi135.stdout: "max_osd_draining_count": { 2024-04-20T12:33:35.720 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_osd_draining_count", 2024-04-20T12:33:35.720 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.720 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.720 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.720 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.720 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.720 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.720 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: "migration_current": { 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "migration_current", 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "internal - do not modify", 2024-04-20T12:33:35.721 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.722 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.722 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.722 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.722 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-04-20T12:33:35.722 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-04-20T12:33:35.722 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.722 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.722 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.722 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "root", 2024-04-20T12:33:35.722 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.722 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.722 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.722 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm-package", 2024-04-20T12:33:35.722 INFO:teuthology.orchestra.run.smithi135.stdout: "root" 2024-04-20T12:33:35.722 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "mode for remote execution of cephadm", 2024-04-20T12:33:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: "oob_default_addr": { 2024-04-20T12:33:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "oob_default_addr", 2024-04-20T12:33:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "169.254.1.1", 2024-04-20T12:33:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.723 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-20T12:33:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: "prometheus_alerts_path": { 2024-04-20T12:33:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus_alerts_path", 2024-04-20T12:33:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-20T12:33:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.724 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-20T12:33:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_insecure": { 2024-04-20T12:33:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_insecure", 2024-04-20T12:33:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-20T12:33:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_password": { 2024-04-20T12:33:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_password", 2024-04-20T12:33:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.726 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-20T12:33:35.727 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.727 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.727 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.727 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.727 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_url": { 2024-04-20T12:33:35.727 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_url", 2024-04-20T12:33:35.727 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.727 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.727 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.727 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.727 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.727 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.727 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.727 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-20T12:33:35.727 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.728 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.728 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.728 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.728 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_username": { 2024-04-20T12:33:35.728 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_username", 2024-04-20T12:33:35.728 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.728 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.728 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.728 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.728 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.728 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.728 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.728 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-20T12:33:35.728 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.728 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.729 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.729 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.729 INFO:teuthology.orchestra.run.smithi135.stdout: "secure_monitoring_stack": { 2024-04-20T12:33:35.729 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "secure_monitoring_stack", 2024-04-20T12:33:35.729 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.729 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.729 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.729 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.729 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.729 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.729 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.729 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-20T12:33:35.729 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.729 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.729 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.730 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.730 INFO:teuthology.orchestra.run.smithi135.stdout: "service_discovery_port": { 2024-04-20T12:33:35.730 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "service_discovery_port", 2024-04-20T12:33:35.730 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.730 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.730 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.730 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8765", 2024-04-20T12:33:35.730 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.730 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.730 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.730 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "cephadm service discovery port", 2024-04-20T12:33:35.730 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.730 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.730 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.731 INFO:teuthology.orchestra.run.smithi135.stdout: "ssh_config_file": { 2024-04-20T12:33:35.731 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssh_config_file", 2024-04-20T12:33:35.731 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.731 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.731 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.731 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.731 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.731 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.731 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.731 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-20T12:33:35.731 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.731 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.731 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.731 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: "use_agent": { 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_agent", 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: "use_repo_digest": { 2024-04-20T12:33:35.732 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_repo_digest", 2024-04-20T12:33:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-20T12:33:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_failed_host_check": { 2024-04-20T12:33:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_failed_host_check", 2024-04-20T12:33:35.733 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if the host check fails", 2024-04-20T12:33:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_daemons": { 2024-04-20T12:33:35.734 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_daemons", 2024-04-20T12:33:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-20T12:33:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_hosts": { 2024-04-20T12:33:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_hosts", 2024-04-20T12:33:35.735 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-20T12:33:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.736 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crash", 2024-04-20T12:33:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.737 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.738 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.739 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.740 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "retain_interval": { 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retain_interval", 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.741 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "31536000", 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_recent_interval": { 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_recent_interval", 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1209600", 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.742 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dashboard", 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-20T12:33:35.743 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_HOST": { 2024-04-20T12:33:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-20T12:33:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.744 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.745 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_ENABLED": { 2024-04-20T12:33:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_ENABLED", 2024-04-20T12:33:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.746 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-20T12:33:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-20T12:33:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.747 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.748 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.748 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.748 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.748 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.748 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.748 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.748 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.748 INFO:teuthology.orchestra.run.smithi135.stdout: "ENABLE_BROWSABLE_API": { 2024-04-20T12:33:35.748 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-20T12:33:35.748 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.748 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.748 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.748 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.748 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.748 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.749 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.750 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.750 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.750 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.750 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.750 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-20T12:33:35.750 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-20T12:33:35.750 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.750 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.750 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.750 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.750 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.750 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.750 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.750 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.750 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.751 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-20T12:33:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-20T12:33:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.752 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-20T12:33:35.753 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-20T12:33:35.754 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.754 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.754 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.754 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.754 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.754 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.754 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.754 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.754 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.754 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.754 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.754 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.754 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-20T12:33:35.754 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.755 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.756 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.756 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.756 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.756 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.756 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.756 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.756 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.756 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.756 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.756 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.756 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_PASSWORD": { 2024-04-20T12:33:35.756 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-20T12:33:35.756 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.756 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.757 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.757 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-04-20T12:33:35.757 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.757 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.757 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.757 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.757 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.757 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.757 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.757 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.757 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-20T12:33:35.757 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-20T12:33:35.757 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.757 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.757 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.758 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.758 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.758 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.758 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.758 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.758 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.758 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.758 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.758 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.758 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_URL": { 2024-04-20T12:33:35.758 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_URL", 2024-04-20T12:33:35.758 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.758 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.758 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.759 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.759 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.759 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.759 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.759 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.759 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.759 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.759 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.759 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.759 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_USERNAME": { 2024-04-20T12:33:35.759 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-20T12:33:35.759 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.759 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.760 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.760 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-04-20T12:33:35.760 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.760 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.760 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.760 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.760 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.760 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.760 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.760 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.760 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-20T12:33:35.760 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-20T12:33:35.760 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.760 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.760 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.761 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.761 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.761 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.761 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.761 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.761 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.761 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.761 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.761 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.761 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-20T12:33:35.761 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-20T12:33:35.761 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.761 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.761 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.761 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.762 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.762 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.762 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.762 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.762 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.762 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.762 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.762 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.762 INFO:teuthology.orchestra.run.smithi135.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-20T12:33:35.762 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-20T12:33:35.762 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.762 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.762 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.762 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.763 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.763 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.763 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.763 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.763 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.763 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.763 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.763 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.763 INFO:teuthology.orchestra.run.smithi135.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-20T12:33:35.763 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-20T12:33:35.763 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.763 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.763 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.763 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "[]", 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.764 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.765 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.765 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.765 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.765 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.765 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.765 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.765 INFO:teuthology.orchestra.run.smithi135.stdout: "MULTICLUSTER_CONFIG": { 2024-04-20T12:33:35.765 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-20T12:33:35.765 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.765 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.765 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.765 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "{}", 2024-04-20T12:33:35.765 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.765 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.765 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.766 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.766 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.766 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.766 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.766 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.766 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_HOST": { 2024-04-20T12:33:35.766 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-20T12:33:35.766 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.766 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.766 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.766 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.766 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.766 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.766 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.766 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.767 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.767 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.767 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.767 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.767 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-20T12:33:35.767 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-20T12:33:35.767 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.767 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.767 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.767 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.767 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.767 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.767 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.767 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.767 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-20T12:33:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-20T12:33:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-20T12:33:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-20T12:33:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.769 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.770 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-20T12:33:35.770 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-20T12:33:35.770 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.770 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.770 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.770 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.770 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.770 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.770 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.770 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.770 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.770 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.770 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.770 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.771 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-20T12:33:35.771 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-20T12:33:35.771 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.771 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.771 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.771 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.771 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.771 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.771 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.771 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.771 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.771 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.771 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.771 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.771 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-20T12:33:35.772 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-20T12:33:35.772 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.772 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.772 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.772 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.772 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.772 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.772 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.772 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.772 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.772 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.772 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.772 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.772 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-20T12:33:35.772 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-20T12:33:35.773 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.773 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.773 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.773 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.773 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.773 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.773 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.773 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.773 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.773 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.773 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.773 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.773 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-20T12:33:35.773 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-20T12:33:35.773 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.774 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.774 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.774 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.774 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.774 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.774 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.774 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.774 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.774 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.774 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.774 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.774 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_ENABLED": { 2024-04-20T12:33:35.774 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-20T12:33:35.774 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.775 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.776 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-20T12:33:35.776 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.776 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.776 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.776 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.776 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.776 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.776 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.776 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.776 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-20T12:33:35.776 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-20T12:33:35.776 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.776 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.776 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.776 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8", 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.777 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.778 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.778 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.778 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.778 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.778 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.778 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.778 INFO:teuthology.orchestra.run.smithi135.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-20T12:33:35.778 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-20T12:33:35.778 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.778 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.778 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.778 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "45", 2024-04-20T12:33:35.778 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.778 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.779 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.779 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.779 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.779 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.779 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.779 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.779 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ACCESS_KEY": { 2024-04-20T12:33:35.779 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-20T12:33:35.779 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.779 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.779 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.779 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.779 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.779 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.779 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.780 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.780 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.780 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.780 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.780 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.780 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-20T12:33:35.780 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-20T12:33:35.780 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.780 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.780 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.780 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-04-20T12:33:35.780 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.780 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.780 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.780 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SECRET_KEY": { 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.781 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SSL_VERIFY": { 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.782 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.783 INFO:teuthology.orchestra.run.smithi135.stdout: "UNSAFE_TLS_v1_2": { 2024-04-20T12:33:35.783 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-20T12:33:35.783 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.783 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.783 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.783 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.783 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.783 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.783 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.783 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.783 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.783 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.783 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.783 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-20T12:33:35.784 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-20T12:33:35.785 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.785 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.785 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.785 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.785 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.785 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.785 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.785 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.785 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.785 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.785 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.785 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.785 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-20T12:33:35.785 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-20T12:33:35.785 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-04-20T12:33:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: "cross_origin_url": { 2024-04-20T12:33:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cross_origin_url", 2024-04-20T12:33:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.786 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.787 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.787 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.787 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.787 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.787 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.787 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.787 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.787 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.787 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.787 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.787 INFO:teuthology.orchestra.run.smithi135.stdout: "crt_file": { 2024-04-20T12:33:35.787 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crt_file", 2024-04-20T12:33:35.787 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.787 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.787 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: "debug": { 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "debug", 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.788 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable/disable debug options", 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: "jwt_token_ttl": { 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "jwt_token_ttl", 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "28800", 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.789 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.790 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.790 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.790 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.790 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.790 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.790 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-04-20T12:33:35.790 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-04-20T12:33:35.790 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.790 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.790 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.790 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.790 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.790 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.790 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.790 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.791 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.791 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.791 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.791 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.791 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.791 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.791 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.791 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.791 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.791 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.791 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.791 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.791 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.791 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.791 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.792 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.793 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.793 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.793 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.793 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.793 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.793 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.793 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.793 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.793 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.793 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.793 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.793 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.793 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.793 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.793 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.794 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "motd": { 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "motd", 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.795 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "The message of the day", 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect_resolve_ip_addr": { 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "redirect_resolve_ip_addr", 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.797 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.798 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.798 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.798 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.798 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.798 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-04-20T12:33:35.798 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-04-20T12:33:35.798 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.798 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.798 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.798 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8080", 2024-04-20T12:33:35.798 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.798 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.798 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.798 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.798 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.799 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.799 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.799 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.799 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-04-20T12:33:35.799 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-04-20T12:33:35.799 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.799 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.799 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.799 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.799 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.799 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.799 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.799 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.799 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.799 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl_server_port": { 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl_server_port", 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8443", 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.800 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.801 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-04-20T12:33:35.801 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-04-20T12:33:35.801 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.801 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.801 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.801 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "redirect", 2024-04-20T12:33:35.801 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.801 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.801 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.801 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.801 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect" 2024-04-20T12:33:35.801 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.801 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.801 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.801 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.802 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.802 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.802 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-04-20T12:33:35.802 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-04-20T12:33:35.802 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.802 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.802 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.802 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-04-20T12:33:35.802 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-04-20T12:33:35.802 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-04-20T12:33:35.802 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.802 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.802 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.802 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.803 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.803 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.803 INFO:teuthology.orchestra.run.smithi135.stdout: "url_prefix": { 2024-04-20T12:33:35.803 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url_prefix", 2024-04-20T12:33:35.803 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.803 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.803 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.803 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.803 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.803 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.803 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.803 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.803 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.803 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.803 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "devicehealth", 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_monitoring": { 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_monitoring", 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.804 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.805 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.805 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "monitor device health metrics", 2024-04-20T12:33:35.805 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.805 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.805 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.805 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.805 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.805 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.805 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.805 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.805 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.805 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.805 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.805 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.805 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.806 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.806 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.806 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.806 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.806 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.806 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.806 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.806 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.806 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.806 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.806 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.806 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.806 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.806 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.807 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.807 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.807 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.807 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.807 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.807 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.807 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.807 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.807 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.807 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.807 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.807 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.807 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.807 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.807 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.808 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.809 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.810 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.810 INFO:teuthology.orchestra.run.smithi135.stdout: "mark_out_threshold": { 2024-04-20T12:33:35.810 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mark_out_threshold", 2024-04-20T12:33:35.810 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.810 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.810 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.810 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2419200", 2024-04-20T12:33:35.810 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.810 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.810 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.810 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-20T12:33:35.810 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.810 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.810 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.811 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.811 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_name": { 2024-04-20T12:33:35.811 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_name", 2024-04-20T12:33:35.811 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.811 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.811 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.811 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "device_health_metrics", 2024-04-20T12:33:35.811 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.811 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.811 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.811 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-20T12:33:35.811 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.811 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.811 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.812 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.812 INFO:teuthology.orchestra.run.smithi135.stdout: "retention_period": { 2024-04-20T12:33:35.812 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retention_period", 2024-04-20T12:33:35.812 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.812 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.812 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.812 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15552000", 2024-04-20T12:33:35.812 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.812 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.812 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.812 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain device health metrics", 2024-04-20T12:33:35.812 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.812 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.812 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.812 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_frequency": { 2024-04-20T12:33:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_frequency", 2024-04-20T12:33:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-04-20T12:33:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-20T12:33:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.813 INFO:teuthology.orchestra.run.smithi135.stdout: "self_heal": { 2024-04-20T12:33:35.814 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "self_heal", 2024-04-20T12:33:35.814 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.814 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.814 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.814 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.814 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.814 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.814 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.814 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-20T12:33:35.814 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.814 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.814 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.814 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.814 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-04-20T12:33:35.815 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-04-20T12:33:35.815 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.815 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.815 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.815 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-04-20T12:33:35.815 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.815 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.815 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.815 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and check device health", 2024-04-20T12:33:35.815 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.815 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.815 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.815 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_threshold": { 2024-04-20T12:33:35.815 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_threshold", 2024-04-20T12:33:35.816 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.816 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.816 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.816 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7257600", 2024-04-20T12:33:35.816 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.816 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.816 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.816 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-20T12:33:35.816 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.816 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.816 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.816 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.816 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.817 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.817 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "diskprediction_local", 2024-04-20T12:33:35.817 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.817 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.817 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.817 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.817 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.817 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.817 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.817 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.817 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.817 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.817 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.817 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.817 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.818 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.818 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.818 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.818 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.818 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.818 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.818 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.818 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.818 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.818 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.818 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.818 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.818 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.819 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.820 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.820 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.820 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.820 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.820 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.820 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.820 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.820 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.820 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.820 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.820 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.820 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.820 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.820 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.821 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.821 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.821 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.821 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.821 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.821 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.821 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.821 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.821 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.821 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.821 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.821 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.822 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.822 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.822 INFO:teuthology.orchestra.run.smithi135.stdout: "predict_interval": { 2024-04-20T12:33:35.822 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predict_interval", 2024-04-20T12:33:35.822 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.822 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.822 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.822 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-04-20T12:33:35.822 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.822 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.822 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.822 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.822 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.823 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.823 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.823 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.823 INFO:teuthology.orchestra.run.smithi135.stdout: "predictor_model": { 2024-04-20T12:33:35.823 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predictor_model", 2024-04-20T12:33:35.823 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.823 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.823 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.823 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "prophetstor", 2024-04-20T12:33:35.823 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.823 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.823 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.823 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.823 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.823 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.824 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.824 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.824 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-04-20T12:33:35.824 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-04-20T12:33:35.824 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.824 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.824 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.824 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-04-20T12:33:35.824 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.824 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.824 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.824 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.824 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.824 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.824 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "influx", 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": false, 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "influxdb python module not found", 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: "batch_size": { 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "batch_size", 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5000", 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.825 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.826 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.826 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-20T12:33:35.826 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.826 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.826 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.826 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.826 INFO:teuthology.orchestra.run.smithi135.stdout: "database": { 2024-04-20T12:33:35.826 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "database", 2024-04-20T12:33:35.826 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.826 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.826 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.826 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "ceph", 2024-04-20T12:33:35.826 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.826 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.827 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.827 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-20T12:33:35.827 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.827 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.827 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.827 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": { 2024-04-20T12:33:35.827 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hostname", 2024-04-20T12:33:35.827 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.827 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.827 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.827 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.827 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.827 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.827 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server hostname", 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "30", 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "5", 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.828 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.829 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.830 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.830 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.830 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.830 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.830 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.830 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.830 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.830 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.830 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.830 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.830 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.830 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.830 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.830 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.831 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.832 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.832 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.832 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.832 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.832 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.832 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.832 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.832 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.832 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.832 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.832 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.832 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.832 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.832 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.833 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.833 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.833 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.833 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.833 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.833 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.833 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.833 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.833 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.833 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.833 INFO:teuthology.orchestra.run.smithi135.stdout: "password": { 2024-04-20T12:33:35.833 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "password", 2024-04-20T12:33:35.833 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.833 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.834 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.834 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.834 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.834 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.834 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.834 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "password of InfluxDB server user", 2024-04-20T12:33:35.834 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.834 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.834 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.834 INFO:teuthology.orchestra.run.smithi135.stdout: "port": { 2024-04-20T12:33:35.834 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "port", 2024-04-20T12:33:35.834 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.835 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.835 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.835 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8086", 2024-04-20T12:33:35.835 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.835 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.835 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.835 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server port", 2024-04-20T12:33:35.835 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.835 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.835 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.835 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-04-20T12:33:35.835 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-04-20T12:33:35.835 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.835 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.836 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.836 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "false", 2024-04-20T12:33:35.836 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.836 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.836 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.836 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-20T12:33:35.836 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.836 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.836 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.836 INFO:teuthology.orchestra.run.smithi135.stdout: "threads": { 2024-04-20T12:33:35.836 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threads", 2024-04-20T12:33:35.836 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.836 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.836 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.837 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-04-20T12:33:35.837 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-04-20T12:33:35.837 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "32", 2024-04-20T12:33:35.837 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.837 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-20T12:33:35.837 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.837 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.837 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.837 INFO:teuthology.orchestra.run.smithi135.stdout: "username": { 2024-04-20T12:33:35.837 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "username", 2024-04-20T12:33:35.837 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.837 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.837 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.837 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.838 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.838 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.838 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.838 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "username of InfluxDB server user", 2024-04-20T12:33:35.838 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.838 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.838 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.838 INFO:teuthology.orchestra.run.smithi135.stdout: "verify_ssl": { 2024-04-20T12:33:35.838 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "verify_ssl", 2024-04-20T12:33:35.838 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.838 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.838 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.838 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "true", 2024-04-20T12:33:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-20T12:33:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "insights", 2024-04-20T12:33:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.839 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.840 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.840 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.840 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.840 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.840 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.840 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.840 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.840 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.840 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.840 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.840 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.840 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.840 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.840 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.841 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.841 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.841 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.841 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.841 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.841 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.841 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.841 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.841 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.841 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.841 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.841 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.841 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.841 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.842 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.842 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.842 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.842 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.842 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.842 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.842 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.842 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.842 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.842 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.842 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.842 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.842 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.843 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.843 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.843 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.843 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.843 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.843 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.843 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.843 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.843 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.843 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.843 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.843 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.843 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.843 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.844 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.844 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.844 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.844 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.844 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.844 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.844 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.844 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.844 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.844 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.844 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.844 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.844 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.844 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "iostat", 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.845 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.846 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.846 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.846 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.846 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.846 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.846 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.846 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.846 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.846 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.846 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.846 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.846 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.846 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.848 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.848 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.848 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.848 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.848 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.848 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.848 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.848 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.848 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.848 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.848 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.848 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.848 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.848 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.848 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.849 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.849 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.849 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.849 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.849 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.849 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.849 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.849 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.849 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.849 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.849 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.849 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.849 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.849 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.849 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.850 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.850 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "k8sevents", 2024-04-20T12:33:35.850 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.850 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.850 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.850 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_event_retention_days": { 2024-04-20T12:33:35.850 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ceph_event_retention_days", 2024-04-20T12:33:35.850 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.850 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.850 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.850 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7", 2024-04-20T12:33:35.850 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.850 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.850 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.850 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-20T12:33:35.851 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.851 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.851 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.851 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.851 INFO:teuthology.orchestra.run.smithi135.stdout: "config_check_secs": { 2024-04-20T12:33:35.851 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_check_secs", 2024-04-20T12:33:35.851 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.851 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.851 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.851 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.851 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "10", 2024-04-20T12:33:35.851 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.851 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.851 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-20T12:33:35.851 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.852 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.852 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.852 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.852 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.852 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.852 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.852 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.852 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.852 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.852 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.852 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.852 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.852 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.853 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.854 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.854 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.854 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.854 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.854 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.854 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.854 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.854 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.854 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.854 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.854 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.854 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.854 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.854 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.855 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.855 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.855 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.855 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.855 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.855 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.855 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.855 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.855 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.855 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.855 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.855 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.855 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.855 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.855 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.856 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "localpool", 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "failure_domain": { 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "failure_domain", 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "host", 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "failure domain for any created local pool", 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-20T12:33:35.857 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.858 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.858 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.858 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.858 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.858 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.858 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.858 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.858 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.858 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.858 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.858 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.858 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.858 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.858 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.859 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.859 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.859 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.859 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.859 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.859 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.859 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.859 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.859 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.859 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.859 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.860 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.861 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.861 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.861 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.861 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.861 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.861 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.861 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.861 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.861 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.861 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.861 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.861 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.861 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.861 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.862 INFO:teuthology.orchestra.run.smithi135.stdout: "min_size": { 2024-04-20T12:33:35.863 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_size", 2024-04-20T12:33:35.863 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.863 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.863 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.863 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.863 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.863 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.863 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.863 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default min_size for any created local pool", 2024-04-20T12:33:35.863 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-20T12:33:35.863 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.863 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.863 INFO:teuthology.orchestra.run.smithi135.stdout: "num_rep": { 2024-04-20T12:33:35.863 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "num_rep", 2024-04-20T12:33:35.864 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.864 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.864 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.864 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3", 2024-04-20T12:33:35.864 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.864 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.864 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.864 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default replica count for any created local pool", 2024-04-20T12:33:35.864 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.864 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.864 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.864 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.864 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_num": { 2024-04-20T12:33:35.864 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_num", 2024-04-20T12:33:35.864 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.865 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.865 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.865 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "128", 2024-04-20T12:33:35.865 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.865 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.865 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.865 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default pg_num for any created local pool", 2024-04-20T12:33:35.865 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.865 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.865 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.865 INFO:teuthology.orchestra.run.smithi135.stdout: "prefix": { 2024-04-20T12:33:35.865 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prefix", 2024-04-20T12:33:35.865 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.865 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.866 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.866 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.866 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.866 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.866 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.866 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name prefix for any created local pool", 2024-04-20T12:33:35.866 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.866 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.866 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.866 INFO:teuthology.orchestra.run.smithi135.stdout: "subtree": { 2024-04-20T12:33:35.866 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "subtree", 2024-04-20T12:33:35.866 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.866 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.866 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "rack", 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mds_autoscaler", 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.867 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.868 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.868 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.868 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.868 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.868 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.868 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.868 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.868 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.868 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.868 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.868 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.868 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.868 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.868 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.868 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.869 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.869 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.869 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.869 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.869 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.869 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.869 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.869 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.869 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.869 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.869 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.869 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.869 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.869 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.869 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.870 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.870 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.870 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.870 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.870 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.870 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.870 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.870 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.870 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.870 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.870 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.870 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.870 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.870 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.870 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.871 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.871 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.871 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.871 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.871 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.871 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.871 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.871 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.871 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.871 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.871 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.871 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.871 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.871 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.871 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.872 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.872 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.872 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.872 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.872 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.872 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.872 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.872 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.872 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.872 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.872 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.872 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.872 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.872 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirroring", 2024-04-20T12:33:35.873 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.873 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.873 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.873 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.873 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.873 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.873 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.873 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.873 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.873 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.873 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.873 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.873 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.873 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.874 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.874 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.874 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.874 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.874 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.874 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.874 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.874 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.874 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.874 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.874 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.874 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.874 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.874 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.875 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.876 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.877 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.878 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "nfs", 2024-04-20T12:33:35.878 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.878 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.878 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.878 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.878 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.878 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.878 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.878 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.878 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.878 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.878 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.878 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.878 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.878 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.879 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.879 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.879 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.879 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.879 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.879 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.879 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.879 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.879 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.879 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.879 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.879 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.879 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.879 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.879 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.880 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.881 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.881 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.881 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.881 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.881 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.881 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.881 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.881 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.881 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.881 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.881 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.881 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.881 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.881 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.881 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.882 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.882 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.882 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.882 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.882 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.882 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.882 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.882 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.882 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.882 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.882 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.882 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.882 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.882 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.882 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.883 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.883 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-04-20T12:33:35.883 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.883 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.883 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.883 INFO:teuthology.orchestra.run.smithi135.stdout: "fail_fs": { 2024-04-20T12:33:35.883 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "fail_fs", 2024-04-20T12:33:35.883 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.883 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.883 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.883 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.883 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.883 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.883 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.883 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-20T12:33:35.884 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.884 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.884 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.884 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.884 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.884 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.884 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.884 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.884 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.884 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.884 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.884 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.884 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.884 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.885 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.885 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.885 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.885 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.885 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.885 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.885 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.885 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.885 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.885 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.885 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.885 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.885 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.885 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.885 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.886 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.886 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.886 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.886 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.886 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.886 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.886 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.886 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.886 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.886 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.886 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.886 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.886 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.886 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.887 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.887 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.887 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.887 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.887 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.887 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.887 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.887 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.887 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.887 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.887 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.887 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.887 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.887 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.888 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.889 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.889 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator": { 2024-04-20T12:33:35.889 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-04-20T12:33:35.889 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.889 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.889 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.889 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.889 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.889 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.889 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.889 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm", 2024-04-20T12:33:35.889 INFO:teuthology.orchestra.run.smithi135.stdout: "rook", 2024-04-20T12:33:35.889 INFO:teuthology.orchestra.run.smithi135.stdout: "test_orchestrator" 2024-04-20T12:33:35.889 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.890 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Orchestrator backend", 2024-04-20T12:33:35.890 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.890 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.890 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.890 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.890 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.890 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.890 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.890 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_perf_query", 2024-04-20T12:33:35.890 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.890 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.890 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.890 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.890 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.891 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.892 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.893 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.894 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_support", 2024-04-20T12:33:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.895 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.896 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.896 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.896 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.896 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.896 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.896 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.896 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.896 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.896 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.896 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.896 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.896 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.896 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.896 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.896 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.898 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.898 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.898 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.898 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.898 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.898 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.898 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.898 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.898 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.898 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.898 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.898 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.898 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.898 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.898 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.899 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.899 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.899 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.899 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.899 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.899 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.899 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.899 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.899 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.899 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.899 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.899 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.899 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.899 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.899 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.900 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.900 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.900 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.900 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.900 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.900 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.900 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.900 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.900 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.900 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.900 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.900 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.900 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.900 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_autoscaler", 2024-04-20T12:33:35.901 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.901 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.901 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.901 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.901 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.901 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.901 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.901 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.901 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.901 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.901 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.901 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.901 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.901 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.901 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.902 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.902 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.902 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.902 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.902 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.902 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.902 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.902 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.902 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.902 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.902 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.902 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.903 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.903 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.903 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.903 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.903 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.903 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.903 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.903 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.903 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.903 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.903 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.903 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.903 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.903 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.903 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.904 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.904 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.904 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.904 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.904 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.904 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.904 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.904 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.904 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.904 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.904 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.904 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.904 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.904 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.904 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.905 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.906 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-04-20T12:33:35.906 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-04-20T12:33:35.906 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.906 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.906 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.906 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-04-20T12:33:35.906 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.906 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.906 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.906 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.906 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.906 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.906 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.906 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.907 INFO:teuthology.orchestra.run.smithi135.stdout: "threshold": { 2024-04-20T12:33:35.907 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threshold", 2024-04-20T12:33:35.907 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:35.907 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.907 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.907 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-04-20T12:33:35.907 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1.0", 2024-04-20T12:33:35.907 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.907 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.907 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "scaling threshold", 2024-04-20T12:33:35.907 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-20T12:33:35.907 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.907 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.907 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.907 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "progress", 2024-04-20T12:33:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_pg_recovery_event": { 2024-04-20T12:33:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_pg_recovery_event", 2024-04-20T12:33:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.908 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.909 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-20T12:33:35.909 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.909 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.909 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.909 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.909 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-04-20T12:33:35.909 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-04-20T12:33:35.909 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.909 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.909 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.909 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.909 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.909 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.909 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.909 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.910 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.910 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.910 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.910 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.910 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.910 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.910 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.910 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.910 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.910 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.910 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.910 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.910 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.910 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.910 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.911 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.911 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.911 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.911 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.911 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.911 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.911 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.911 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.911 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.911 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.911 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.911 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.911 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.911 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.911 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.912 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.912 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.912 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.912 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.912 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.912 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.912 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.912 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.912 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.912 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.912 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.912 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.912 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.912 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.912 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.913 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.913 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.913 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.913 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.913 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.913 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.913 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.913 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.913 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.913 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.913 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.913 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.913 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.913 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.914 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.914 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.914 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.914 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.914 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.914 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.914 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.914 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.914 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.914 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.914 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.914 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.914 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.914 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.915 INFO:teuthology.orchestra.run.smithi135.stdout: "max_completed_events": { 2024-04-20T12:33:35.915 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_completed_events", 2024-04-20T12:33:35.915 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.915 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.915 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.915 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "50", 2024-04-20T12:33:35.915 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.915 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.915 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.915 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "number of past completed events to remember", 2024-04-20T12:33:35.915 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.915 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.915 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.915 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.916 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-04-20T12:33:35.916 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-04-20T12:33:35.916 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.916 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.916 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.916 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-04-20T12:33:35.916 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.916 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.916 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.916 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long the module is going to sleep", 2024-04-20T12:33:35.916 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.916 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.916 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.916 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.916 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.917 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.917 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.917 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus", 2024-04-20T12:33:35.917 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.917 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.917 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.917 INFO:teuthology.orchestra.run.smithi135.stdout: "cache": { 2024-04-20T12:33:35.917 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cache", 2024-04-20T12:33:35.917 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.917 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.917 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.917 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.917 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.917 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.917 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.918 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.918 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.918 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.918 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.918 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.918 INFO:teuthology.orchestra.run.smithi135.stdout: "exclude_perf_counters": { 2024-04-20T12:33:35.918 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "exclude_perf_counters", 2024-04-20T12:33:35.918 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.918 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.918 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.918 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.918 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.918 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.918 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.918 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-20T12:33:35.919 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-20T12:33:35.919 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.919 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.919 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.919 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.919 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.919 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.919 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.919 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.919 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.919 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.919 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.919 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.919 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.919 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.920 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.920 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.920 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.920 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.920 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.920 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.920 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.920 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.920 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.920 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.920 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.920 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.920 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.920 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.920 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.921 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.922 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.922 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.922 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.922 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.922 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.922 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.922 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.922 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.922 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.922 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.922 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.922 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.922 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.922 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.922 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools": { 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools", 2024-04-20T12:33:35.923 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.924 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.924 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.924 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.924 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.924 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.924 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.924 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.924 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.924 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.924 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.924 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.924 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-20T12:33:35.924 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-20T12:33:35.924 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.925 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.925 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.925 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "300", 2024-04-20T12:33:35.925 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.925 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.925 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.925 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.925 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.925 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.925 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.925 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.925 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_interval": { 2024-04-20T12:33:35.925 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_interval", 2024-04-20T12:33:35.925 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:35.926 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.926 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.926 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15.0", 2024-04-20T12:33:35.926 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.926 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.926 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.926 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.926 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.926 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.926 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.926 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.926 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-04-20T12:33:35.926 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-04-20T12:33:35.926 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.926 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.927 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.927 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-04-20T12:33:35.927 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.927 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.927 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.927 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-20T12:33:35.927 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.927 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.927 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.927 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.927 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-04-20T12:33:35.927 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-04-20T12:33:35.927 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.927 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.927 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "9283", 2024-04-20T12:33:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-20T12:33:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: "stale_cache_strategy": { 2024-04-20T12:33:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stale_cache_strategy", 2024-04-20T12:33:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.928 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "log", 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "default", 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.929 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.930 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.930 INFO:teuthology.orchestra.run.smithi135.stdout: "default", 2024-04-20T12:33:35.930 INFO:teuthology.orchestra.run.smithi135.stdout: "error" 2024-04-20T12:33:35.930 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.930 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.930 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.930 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.930 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.930 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.930 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-04-20T12:33:35.930 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-04-20T12:33:35.930 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.930 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.930 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.930 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-04-20T12:33:35.931 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-04-20T12:33:35.931 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-04-20T12:33:35.931 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.931 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.931 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.931 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.931 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.931 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.931 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.931 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.931 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.931 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_support", 2024-04-20T12:33:35.931 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.931 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.931 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.932 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.932 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.932 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.932 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.932 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.932 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.932 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.932 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.932 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.932 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.932 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.932 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.932 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.932 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.932 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.934 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.934 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.934 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.934 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.934 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.934 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.934 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.934 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.934 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.934 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.934 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.934 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.934 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.935 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.935 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.935 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.935 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.935 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.935 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.935 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.935 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.935 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.935 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.935 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.935 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.935 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.935 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.936 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.936 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.936 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.936 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.936 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.936 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.936 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.936 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.936 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.936 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.936 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.936 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.936 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.938 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_snap_create": { 2024-04-20T12:33:35.938 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_snap_create", 2024-04-20T12:33:35.938 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.938 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.938 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.938 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "mirror_snapshot_schedule": { 2024-04-20T12:33:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirror_snapshot_schedule", 2024-04-20T12:33:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.939 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: "trash_purge_schedule": { 2024-04-20T12:33:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "trash_purge_schedule", 2024-04-20T12:33:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.940 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.941 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.941 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.941 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.941 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.941 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.941 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.941 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.941 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.941 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.941 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.941 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "restful", 2024-04-20T12:33:35.941 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.941 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.941 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.941 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_auth": { 2024-04-20T12:33:35.942 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_auth", 2024-04-20T12:33:35.942 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.942 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.942 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.942 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.942 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.942 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.942 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.942 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.942 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.942 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.942 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.942 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.942 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-04-20T12:33:35.943 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-04-20T12:33:35.943 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.943 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.943 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.943 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.943 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.943 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.943 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.943 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.943 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.943 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.943 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.943 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.943 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.944 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.945 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.946 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.946 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.946 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.946 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.946 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.946 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.946 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.946 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.946 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.946 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.946 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.946 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.946 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.946 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.947 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.947 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.947 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.947 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.947 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.947 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.947 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.947 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.947 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.947 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.947 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.947 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.947 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.947 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.947 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.948 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.948 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.948 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.948 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.948 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.948 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.948 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.948 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.948 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-04-20T12:33:35.948 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-04-20T12:33:35.948 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.948 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.948 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.948 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.948 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-04-20T12:33:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-04-20T12:33:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.949 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.950 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.950 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.950 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.950 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.950 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.950 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.950 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.950 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.950 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.950 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rgw", 2024-04-20T12:33:35.950 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.950 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.950 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.950 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.951 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.951 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.951 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.951 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.951 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.951 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.951 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.951 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.951 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.951 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.951 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.951 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.951 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.951 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.952 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.952 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.952 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.952 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.952 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.952 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.952 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.952 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.952 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.952 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.952 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.952 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.952 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.952 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.952 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.953 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.954 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.954 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.954 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.954 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.954 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.954 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.954 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.954 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.954 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.954 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.954 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.954 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.954 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.954 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.955 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.955 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.955 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.955 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.955 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.955 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.955 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.955 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.955 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.955 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.955 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.955 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.955 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.955 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.956 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rook", 2024-04-20T12:33:35.956 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.956 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.956 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.956 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.956 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.956 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.956 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.956 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.956 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.956 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.956 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.956 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.956 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.957 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.957 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.957 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.957 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.957 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.957 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.957 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.957 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.957 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.957 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.957 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.957 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.957 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.957 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.957 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.958 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.958 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.958 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.958 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.958 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.958 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.958 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.958 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.958 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.958 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.958 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.958 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.958 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.958 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.959 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.960 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.960 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.960 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.960 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.960 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.960 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.960 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.960 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.960 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.960 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.960 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.960 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.960 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.960 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.961 INFO:teuthology.orchestra.run.smithi135.stdout: "storage_class": { 2024-04-20T12:33:35.961 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "storage_class", 2024-04-20T12:33:35.961 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.961 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.961 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.961 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "local", 2024-04-20T12:33:35.961 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.961 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.961 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.961 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-20T12:33:35.961 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.961 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.961 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.961 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.961 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.962 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.962 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.962 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "selftest", 2024-04-20T12:33:35.962 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.962 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.962 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.962 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.962 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.962 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.962 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.962 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.962 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.962 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.962 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.962 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.963 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.963 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.963 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.963 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.963 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.963 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.963 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.963 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.963 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.963 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.963 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.963 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.963 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.963 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.964 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.965 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.965 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.965 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.965 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.965 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.965 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.965 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.965 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.965 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.965 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.965 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.965 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.965 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.965 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.966 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.966 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.966 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.966 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.966 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.966 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.966 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.966 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.966 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.966 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.966 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.966 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.966 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.966 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: "roption1": { 2024-04-20T12:33:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption1", 2024-04-20T12:33:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.967 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.968 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.968 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.968 INFO:teuthology.orchestra.run.smithi135.stdout: "roption2": { 2024-04-20T12:33:35.968 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption2", 2024-04-20T12:33:35.968 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.968 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.968 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.968 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "xyz", 2024-04-20T12:33:35.968 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.968 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.968 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.968 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.968 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.968 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.969 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.969 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.969 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption1": { 2024-04-20T12:33:35.969 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption1", 2024-04-20T12:33:35.969 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.969 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.969 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.969 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.969 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.969 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.969 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.969 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.969 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.969 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.969 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.970 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption2": { 2024-04-20T12:33:35.970 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption2", 2024-04-20T12:33:35.970 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.970 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.970 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.970 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.970 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.970 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.970 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.970 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.970 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.970 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.970 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.970 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption3": { 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption3", 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption4": { 2024-04-20T12:33:35.971 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption4", 2024-04-20T12:33:35.972 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.972 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.972 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.972 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.972 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.972 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.972 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.972 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.972 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.972 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.972 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.972 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.972 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption5": { 2024-04-20T12:33:35.972 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption5", 2024-04-20T12:33:35.972 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.973 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.973 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.973 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.973 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.973 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.973 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.973 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.973 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.973 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.973 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.973 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.973 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption6": { 2024-04-20T12:33:35.973 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption6", 2024-04-20T12:33:35.973 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.974 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.974 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.974 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:35.974 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.974 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.974 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.974 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.974 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.974 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.974 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.974 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.974 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption7": { 2024-04-20T12:33:35.974 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption7", 2024-04-20T12:33:35.974 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:35.974 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.975 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.975 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.975 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-04-20T12:33:35.975 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "42", 2024-04-20T12:33:35.975 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.975 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.975 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.975 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.975 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.975 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.975 INFO:teuthology.orchestra.run.smithi135.stdout: "testkey": { 2024-04-20T12:33:35.975 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testkey", 2024-04-20T12:33:35.975 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.975 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.975 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.976 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.976 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.976 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.976 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.976 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.976 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.976 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.976 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.976 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.976 INFO:teuthology.orchestra.run.smithi135.stdout: "testlkey": { 2024-04-20T12:33:35.976 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testlkey", 2024-04-20T12:33:35.976 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.976 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.976 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.976 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: "testnewline": { 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testnewline", 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.977 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.978 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.978 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.978 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.978 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.978 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.978 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.978 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.978 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.978 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.978 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snap_schedule", 2024-04-20T12:33:35.978 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.978 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.978 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.978 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_m_granularity": { 2024-04-20T12:33:35.979 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_m_granularity", 2024-04-20T12:33:35.979 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.979 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.979 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.979 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.979 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.979 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.979 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.979 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow minute scheduled snapshots", 2024-04-20T12:33:35.979 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.979 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.979 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.979 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.979 INFO:teuthology.orchestra.run.smithi135.stdout: "dump_on_update": { 2024-04-20T12:33:35.979 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dump_on_update", 2024-04-20T12:33:35.980 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.980 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.980 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.980 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.980 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.980 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.980 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.980 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "dump database to debug log on update", 2024-04-20T12:33:35.980 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.980 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.980 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.980 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.980 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.980 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.980 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.981 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.981 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.981 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.981 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.981 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.981 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.981 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.981 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.981 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.981 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.981 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.981 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.981 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.981 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.981 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.982 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.982 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.982 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.982 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.982 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.982 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.982 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.982 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.982 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.982 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.982 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.982 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.982 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.982 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.983 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.984 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.984 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.984 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.984 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.984 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.984 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.984 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.984 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.984 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.984 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.984 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.984 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.984 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.984 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.984 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.985 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.985 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.985 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.985 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.985 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.985 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.985 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.985 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.985 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.985 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.985 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.985 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stats", 2024-04-20T12:33:35.985 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.985 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.985 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.986 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.986 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.986 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.986 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.986 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.986 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.986 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.986 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.986 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.986 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.986 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.986 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.986 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.986 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.988 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.988 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.988 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.988 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.988 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.988 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.988 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.988 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.988 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.988 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.988 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.988 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.988 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.988 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.988 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.989 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.990 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.990 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.990 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.990 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.990 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.990 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.990 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.990 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.990 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.990 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.990 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.990 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.990 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.990 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.990 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "status", 2024-04-20T12:33:35.991 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.991 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.991 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.991 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.991 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.991 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.991 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.991 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.991 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.991 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.991 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.991 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.991 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.991 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.991 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.992 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.993 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.993 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.993 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.993 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.993 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.993 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.993 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.993 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.993 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:35.993 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:35.993 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.993 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.993 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.993 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:35.993 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.994 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.994 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.994 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.994 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.994 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.994 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.994 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.994 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.994 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.994 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.994 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.994 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.994 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.994 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:35.995 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telegraf", 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: "address": { 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "address", 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.996 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.997 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.997 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.997 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.997 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-04-20T12:33:35.997 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-04-20T12:33:35.997 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:35.997 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.997 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:35.997 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15", 2024-04-20T12:33:35.997 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.997 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.997 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:35.997 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.997 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.997 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.998 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.998 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.998 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:35.998 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:35.998 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:35.998 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.998 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.998 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:35.998 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:35.998 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:35.998 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:35.998 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:35.998 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:35.998 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:35.999 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:35.999 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:35.999 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:35.999 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:35.999 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:35.999 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:35.999 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:35.999 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:35.999 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:35.999 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:35.999 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:35.999 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:35.999 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:35.999 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:35.999 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.000 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.001 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.001 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.001 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.001 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.001 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.001 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.001 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.001 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.001 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.001 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.001 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.001 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.001 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.001 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.001 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.002 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.002 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.002 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.002 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.002 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.002 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.002 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.002 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.002 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.002 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.002 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.002 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.002 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.002 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.003 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.003 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telemetry", 2024-04-20T12:33:36.003 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.003 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.003 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.003 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_basic": { 2024-04-20T12:33:36.003 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_basic", 2024-04-20T12:33:36.003 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.003 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.003 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.003 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.003 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.003 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.003 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.003 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-20T12:33:36.004 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.004 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.004 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.004 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.004 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_crash": { 2024-04-20T12:33:36.004 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_crash", 2024-04-20T12:33:36.004 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.004 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.004 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.004 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.004 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.004 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.004 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.004 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-20T12:33:36.005 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.005 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.005 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.005 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.005 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_device": { 2024-04-20T12:33:36.005 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_device", 2024-04-20T12:33:36.005 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.005 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.005 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.005 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.005 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.005 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.005 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.005 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-20T12:33:36.005 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.006 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.006 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.006 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.006 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_ident": { 2024-04-20T12:33:36.006 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_ident", 2024-04-20T12:33:36.006 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.006 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.006 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.006 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.006 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.006 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.006 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.006 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-20T12:33:36.006 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.006 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.007 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.007 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.007 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_perf": { 2024-04-20T12:33:36.007 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_perf", 2024-04-20T12:33:36.007 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.007 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.007 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.007 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.007 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.007 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.007 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.007 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-20T12:33:36.007 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.007 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.008 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.008 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.008 INFO:teuthology.orchestra.run.smithi135.stdout: "contact": { 2024-04-20T12:33:36.008 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "contact", 2024-04-20T12:33:36.008 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.008 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.008 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.008 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.008 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.008 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.008 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.008 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.008 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.008 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.008 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: "description": { 2024-04-20T12:33:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "description", 2024-04-20T12:33:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.009 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.010 INFO:teuthology.orchestra.run.smithi135.stdout: "device_url": { 2024-04-20T12:33:36.010 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_url", 2024-04-20T12:33:36.010 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.010 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.010 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.010 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-20T12:33:36.010 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.010 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.010 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.010 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.010 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.010 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.010 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.010 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.010 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-04-20T12:33:36.011 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-04-20T12:33:36.011 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.011 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.011 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.011 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.011 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.011 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.011 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.011 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.011 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.011 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.011 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.011 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.011 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-04-20T12:33:36.011 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "24", 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "8", 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: "last_opt_revision": { 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "last_opt_revision", 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.012 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.013 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.013 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1", 2024-04-20T12:33:36.013 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.013 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.013 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.013 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.013 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.013 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.013 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.013 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.013 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard": { 2024-04-20T12:33:36.013 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard", 2024-04-20T12:33:36.013 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.013 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.013 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.014 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.014 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.014 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.014 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.014 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.014 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.014 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.014 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.014 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.014 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard_description": { 2024-04-20T12:33:36.014 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard_description", 2024-04-20T12:33:36.014 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.014 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.014 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.014 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.015 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.016 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.017 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.017 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.017 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.017 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.017 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.017 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.017 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.017 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.017 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.017 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.017 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.017 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.017 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.017 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.017 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.018 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.018 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.018 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.018 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.018 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.018 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.018 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.018 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.018 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.018 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.018 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.018 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.018 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.018 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.018 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.019 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.019 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.019 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.019 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.019 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.019 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.019 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.019 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.019 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.019 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.019 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.019 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.019 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.019 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.019 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.020 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.020 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.020 INFO:teuthology.orchestra.run.smithi135.stdout: "organization": { 2024-04-20T12:33:36.020 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "organization", 2024-04-20T12:33:36.020 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.020 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.020 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.020 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.020 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.020 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.020 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.020 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.020 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.020 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.020 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: "proxy": { 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "proxy", 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.021 INFO:teuthology.orchestra.run.smithi135.stdout: "url": { 2024-04-20T12:33:36.022 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url", 2024-04-20T12:33:36.022 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.022 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.022 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.022 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-20T12:33:36.022 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.022 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.022 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.022 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.022 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.022 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.022 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.022 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.022 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "test_orchestrator", 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.023 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.024 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.024 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.024 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.024 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.024 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.024 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.024 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.024 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.024 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.024 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.024 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.024 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.024 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.024 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.024 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.025 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.025 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.025 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.025 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.025 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.025 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.025 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.025 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.025 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.025 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.025 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.025 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.025 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.025 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.025 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.026 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.026 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.026 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.026 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.026 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.026 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.026 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.026 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.026 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.026 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.026 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.026 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.026 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.026 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.027 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.028 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.028 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.028 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.028 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "volumes", 2024-04-20T12:33:36.028 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.028 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.028 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.028 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.028 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.028 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.028 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.028 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.028 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.028 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.029 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.030 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.030 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.030 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.030 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.030 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.030 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.030 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.030 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.030 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.030 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.030 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.030 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.030 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.031 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_clones": { 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_clones", 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4", 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.034 INFO:teuthology.orchestra.run.smithi135.stdout: "periodic_async_work": { 2024-04-20T12:33:36.034 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "periodic_async_work", 2024-04-20T12:33:36.034 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.034 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.034 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.034 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.034 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.034 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.034 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.034 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Periodically check for async work", 2024-04-20T12:33:36.034 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.034 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.034 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.034 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_delay": { 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_delay", 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_no_wait": { 2024-04-20T12:33:36.035 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_no_wait", 2024-04-20T12:33:36.036 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.036 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.036 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.036 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.036 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.036 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.036 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.036 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-20T12:33:36.036 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.036 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.036 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.036 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.036 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.036 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.036 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.037 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix", 2024-04-20T12:33:36.037 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.037 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.037 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.037 INFO:teuthology.orchestra.run.smithi135.stdout: "discovery_interval": { 2024-04-20T12:33:36.037 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "discovery_interval", 2024-04-20T12:33:36.037 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-04-20T12:33:36.037 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.037 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.037 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "100", 2024-04-20T12:33:36.037 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.037 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.037 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.037 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.037 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.038 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.038 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.038 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.038 INFO:teuthology.orchestra.run.smithi135.stdout: "identifier": { 2024-04-20T12:33:36.038 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "identifier", 2024-04-20T12:33:36.038 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.038 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.038 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.038 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.038 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.038 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.038 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.038 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.038 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.039 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.039 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.039 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.039 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-04-20T12:33:36.039 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-04-20T12:33:36.039 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.039 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.039 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.039 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-04-20T12:33:36.039 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.039 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.039 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.039 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.039 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.039 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.040 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.040 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.040 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.040 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.040 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.040 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.040 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.040 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.040 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.040 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.040 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.040 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.040 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.040 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.040 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.041 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.041 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.041 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.041 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.041 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.041 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.041 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.041 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.041 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.041 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.041 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.041 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.041 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.041 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.041 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.042 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.042 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.042 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.042 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.042 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.042 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.042 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.042 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.042 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.042 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.042 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.042 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.042 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.042 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.043 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.043 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.043 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.043 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.043 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.043 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.043 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.043 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.043 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.043 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.043 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.043 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.043 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.043 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.043 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.044 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.044 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.044 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.044 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.044 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.044 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.044 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.044 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.044 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.044 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.044 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.044 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.044 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.044 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_host": { 2024-04-20T12:33:36.044 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_host", 2024-04-20T12:33:36.045 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.045 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.045 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.045 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.045 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.045 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.045 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.045 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.045 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.045 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.045 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.045 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.045 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_port": { 2024-04-20T12:33:36.045 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_port", 2024-04-20T12:33:36.045 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.046 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.046 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.046 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10051", 2024-04-20T12:33:36.046 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.046 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.046 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.046 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.046 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.046 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.046 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.046 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.046 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_sender": { 2024-04-20T12:33:36.046 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_sender", 2024-04-20T12:33:36.046 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.047 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.047 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.047 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-20T12:33:36.047 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.047 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.047 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.047 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.047 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.047 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.047 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.047 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.047 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.047 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.047 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-04-20T12:33:36.047 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.048 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.048 INFO:teuthology.orchestra.run.smithi135.stdout: "modules": [ 2024-04-20T12:33:36.048 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm", 2024-04-20T12:33:36.048 INFO:teuthology.orchestra.run.smithi135.stdout: "dashboard", 2024-04-20T12:33:36.048 INFO:teuthology.orchestra.run.smithi135.stdout: "iostat", 2024-04-20T12:33:36.048 INFO:teuthology.orchestra.run.smithi135.stdout: "nfs", 2024-04-20T12:33:36.048 INFO:teuthology.orchestra.run.smithi135.stdout: "restful", 2024-04-20T12:33:36.048 INFO:teuthology.orchestra.run.smithi135.stdout: "snap_schedule" 2024-04-20T12:33:36.048 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.048 INFO:teuthology.orchestra.run.smithi135.stdout: "available_modules": [ 2024-04-20T12:33:36.048 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.048 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "alerts", 2024-04-20T12:33:36.048 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.048 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How frequently to reexamine health status", 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.049 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.050 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.051 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.051 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.051 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.051 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.051 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.051 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.051 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.051 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.051 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.051 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.051 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.051 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.052 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.052 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.052 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.052 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.052 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.052 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.052 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.052 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.052 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.052 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.052 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.052 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.053 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.054 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.054 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.054 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.054 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.054 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.054 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.054 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.054 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.054 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.054 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.054 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.054 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.054 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.054 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.054 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_destination": { 2024-04-20T12:33:36.055 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_destination", 2024-04-20T12:33:36.055 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.055 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.055 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.055 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.055 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.055 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.055 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.055 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email address to send alerts to", 2024-04-20T12:33:36.055 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.055 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.055 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.055 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.055 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_from_name": { 2024-04-20T12:33:36.055 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_from_name", 2024-04-20T12:33:36.056 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.056 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.056 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.056 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "Ceph", 2024-04-20T12:33:36.056 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.056 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.056 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.056 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Email From: name", 2024-04-20T12:33:36.056 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.056 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.056 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.056 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.056 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_host": { 2024-04-20T12:33:36.056 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_host", 2024-04-20T12:33:36.056 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP server", 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_password": { 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_password", 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.057 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.058 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.058 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.058 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.058 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.058 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Password to authenticate with", 2024-04-20T12:33:36.058 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.058 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.058 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.058 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.058 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_port": { 2024-04-20T12:33:36.058 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_port", 2024-04-20T12:33:36.058 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.058 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.058 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.058 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "465", 2024-04-20T12:33:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP port", 2024-04-20T12:33:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_sender": { 2024-04-20T12:33:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_sender", 2024-04-20T12:33:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.060 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.060 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.060 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SMTP envelope sender", 2024-04-20T12:33:36.060 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.060 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.060 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.060 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.060 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_ssl": { 2024-04-20T12:33:36.060 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_ssl", 2024-04-20T12:33:36.060 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.060 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.060 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.060 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.060 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.060 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.061 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.061 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use SSL to connect to SMTP server", 2024-04-20T12:33:36.061 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.061 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.061 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.061 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.061 INFO:teuthology.orchestra.run.smithi135.stdout: "smtp_user": { 2024-04-20T12:33:36.061 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "smtp_user", 2024-04-20T12:33:36.061 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.061 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.061 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.061 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.061 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.061 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.062 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.062 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "User to authenticate as", 2024-04-20T12:33:36.062 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.062 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.062 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.062 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.062 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.062 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.062 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.062 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "balancer", 2024-04-20T12:33:36.062 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.062 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.062 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.062 INFO:teuthology.orchestra.run.smithi135.stdout: "active": { 2024-04-20T12:33:36.063 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "active", 2024-04-20T12:33:36.063 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.063 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.063 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.063 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.063 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.063 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.063 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.063 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically balance PGs across cluster", 2024-04-20T12:33:36.063 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.064 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.065 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.065 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.065 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_time": { 2024-04-20T12:33:36.065 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_time", 2024-04-20T12:33:36.065 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.065 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.065 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.065 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0000", 2024-04-20T12:33:36.065 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.065 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.065 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.065 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "beginning time of day to automatically balance", 2024-04-20T12:33:36.065 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-20T12:33:36.065 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.066 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.066 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.066 INFO:teuthology.orchestra.run.smithi135.stdout: "begin_weekday": { 2024-04-20T12:33:36.066 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "begin_weekday", 2024-04-20T12:33:36.066 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-04-20T12:33:36.066 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.066 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.066 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-04-20T12:33:36.066 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-04-20T12:33:36.066 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-04-20T12:33:36.066 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.066 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-04-20T12:33:36.066 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-20T12:33:36.066 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.067 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.067 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.067 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_max_iterations": { 2024-04-20T12:33:36.067 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_max_iterations", 2024-04-20T12:33:36.067 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-04-20T12:33:36.067 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.067 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.067 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "25", 2024-04-20T12:33:36.067 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-04-20T12:33:36.067 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "250", 2024-04-20T12:33:36.067 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.067 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-04-20T12:33:36.067 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.067 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.067 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.068 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_metrics": { 2024-04-20T12:33:36.068 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_metrics", 2024-04-20T12:33:36.068 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.068 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.068 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.068 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "pgs,objects,bytes", 2024-04-20T12:33:36.068 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.068 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.068 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.068 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-04-20T12:33:36.068 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-04-20T12:33:36.068 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.068 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.068 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.069 INFO:teuthology.orchestra.run.smithi135.stdout: "crush_compat_step": { 2024-04-20T12:33:36.069 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crush_compat_step", 2024-04-20T12:33:36.069 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:36.069 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.069 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.069 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.5", 2024-04-20T12:33:36.069 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0.001", 2024-04-20T12:33:36.069 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "0.999", 2024-04-20T12:33:36.069 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.069 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "aggressiveness of optimization", 2024-04-20T12:33:36.069 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-04-20T12:33:36.069 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.069 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.069 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.069 INFO:teuthology.orchestra.run.smithi135.stdout: "end_time": { 2024-04-20T12:33:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_time", 2024-04-20T12:33:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2359", 2024-04-20T12:33:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ending time of day to automatically balance", 2024-04-20T12:33:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-04-20T12:33:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: "end_weekday": { 2024-04-20T12:33:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "end_weekday", 2024-04-20T12:33:36.071 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-04-20T12:33:36.071 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.071 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.071 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-04-20T12:33:36.071 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "0", 2024-04-20T12:33:36.071 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "6", 2024-04-20T12:33:36.071 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.071 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-04-20T12:33:36.071 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-04-20T12:33:36.071 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.071 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.071 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.071 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.071 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.071 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.072 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.073 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.073 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.073 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.073 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.073 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.073 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.073 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.073 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.073 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.073 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.073 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.073 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.073 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.073 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.074 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.074 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.074 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.074 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.074 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.074 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.074 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.074 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.074 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.074 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.074 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.074 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.074 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.074 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.075 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.075 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.075 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.075 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.075 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.075 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.075 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.075 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.075 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.075 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.075 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.075 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.075 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.075 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.075 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: "min_score": { 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_score", 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.076 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.077 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.077 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-04-20T12:33:36.077 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.077 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.077 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.077 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.077 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-04-20T12:33:36.077 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-04-20T12:33:36.077 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.077 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.077 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.077 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "upmap", 2024-04-20T12:33:36.077 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.077 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.078 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.078 INFO:teuthology.orchestra.run.smithi135.stdout: "crush-compat", 2024-04-20T12:33:36.078 INFO:teuthology.orchestra.run.smithi135.stdout: "none", 2024-04-20T12:33:36.078 INFO:teuthology.orchestra.run.smithi135.stdout: "read", 2024-04-20T12:33:36.078 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap", 2024-04-20T12:33:36.078 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap-read" 2024-04-20T12:33:36.078 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.078 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Balancer mode", 2024-04-20T12:33:36.078 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.078 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.078 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.078 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.078 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_ids": { 2024-04-20T12:33:36.078 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_ids", 2024-04-20T12:33:36.079 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.079 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.079 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.079 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.079 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.079 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.079 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.079 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-04-20T12:33:36.079 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.079 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.079 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.079 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.079 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-04-20T12:33:36.079 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-04-20T12:33:36.079 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.080 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.080 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.080 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-04-20T12:33:36.080 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.080 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.080 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.080 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-04-20T12:33:36.080 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.080 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.080 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.080 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.080 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_deviation": { 2024-04-20T12:33:36.080 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_deviation", 2024-04-20T12:33:36.080 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.080 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "deviation below which no optimization is attempted", 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: "upmap_max_optimizations": { 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "upmap_max_optimizations", 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.081 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:36.082 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.082 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.082 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.082 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-04-20T12:33:36.082 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.082 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.082 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.082 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.082 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.082 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.082 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.082 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cephadm", 2024-04-20T12:33:36.082 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.082 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.082 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_down_multiplier": { 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_down_multiplier", 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_refresh_rate": { 2024-04-20T12:33:36.083 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_refresh_rate", 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "20", 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: "agent_starting_port": { 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "agent_starting_port", 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.084 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.085 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.085 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4721", 2024-04-20T12:33:36.085 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.085 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.085 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.085 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-04-20T12:33:36.085 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.085 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.085 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.085 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.085 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_ptrace": { 2024-04-20T12:33:36.085 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_ptrace", 2024-04-20T12:33:36.085 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.085 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.085 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.086 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.086 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.086 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.086 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.086 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-04-20T12:33:36.086 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-04-20T12:33:36.086 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.086 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.086 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.086 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_interval": { 2024-04-20T12:33:36.086 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_interval", 2024-04-20T12:33:36.086 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.086 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.086 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to autotune daemon memory", 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: "autotune_memory_target_ratio": { 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "autotune_memory_target_ratio", 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0.7", 2024-04-20T12:33:36.087 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.088 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.088 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.088 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-04-20T12:33:36.088 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.088 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.088 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.088 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.088 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm_log_destination": { 2024-04-20T12:33:36.088 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cephadm_log_destination", 2024-04-20T12:33:36.088 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.088 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.088 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.088 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.088 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.088 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: "file", 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: "file,syslog", 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: "syslog" 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: "cgroups_split": { 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cgroups_split", 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.089 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.090 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.090 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.090 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.090 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-04-20T12:33:36.090 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.090 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.090 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.090 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.090 INFO:teuthology.orchestra.run.smithi135.stdout: "config_checks_enabled": { 2024-04-20T12:33:36.090 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_checks_enabled", 2024-04-20T12:33:36.090 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.090 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.090 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.090 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.091 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.091 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.091 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.091 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-04-20T12:33:36.091 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.091 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.091 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.091 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.091 INFO:teuthology.orchestra.run.smithi135.stdout: "config_dashboard": { 2024-04-20T12:33:36.091 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_dashboard", 2024-04-20T12:33:36.091 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.091 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.091 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.091 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.091 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.092 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.092 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.092 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-04-20T12:33:36.092 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.092 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.092 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.092 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.092 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_alertmanager": { 2024-04-20T12:33:36.092 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_alertmanager", 2024-04-20T12:33:36.092 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.092 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.092 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.092 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-04-20T12:33:36.092 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_base": { 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_base", 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/ceph", 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.093 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.094 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Container image name, without the tag", 2024-04-20T12:33:36.094 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.094 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.094 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.094 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.094 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_elasticsearch": { 2024-04-20T12:33:36.094 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_elasticsearch", 2024-04-20T12:33:36.094 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.094 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.094 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.094 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-04-20T12:33:36.094 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.094 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.095 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.095 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "elasticsearch container image", 2024-04-20T12:33:36.095 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.095 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.095 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.095 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.095 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_grafana": { 2024-04-20T12:33:36.095 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_grafana", 2024-04-20T12:33:36.095 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.095 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.095 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.095 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-04-20T12:33:36.095 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.095 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.095 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.096 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-04-20T12:33:36.096 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.096 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.096 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.096 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.096 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_haproxy": { 2024-04-20T12:33:36.096 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_haproxy", 2024-04-20T12:33:36.096 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.096 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.096 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.096 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-04-20T12:33:36.096 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.096 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.096 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.096 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "HAproxy container image", 2024-04-20T12:33:36.097 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.097 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.097 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.097 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.097 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_agent": { 2024-04-20T12:33:36.097 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_agent", 2024-04-20T12:33:36.097 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.097 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.097 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.097 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-04-20T12:33:36.097 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.097 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.097 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.097 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger agent container image", 2024-04-20T12:33:36.097 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.098 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.098 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.098 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.098 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_collector": { 2024-04-20T12:33:36.098 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_collector", 2024-04-20T12:33:36.098 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.098 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.098 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.098 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-04-20T12:33:36.098 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.098 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.098 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.098 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger collector container image", 2024-04-20T12:33:36.098 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.098 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_jaeger_query": { 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_jaeger_query", 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Jaeger query container image", 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.099 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.100 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_keepalived": { 2024-04-20T12:33:36.100 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_keepalived", 2024-04-20T12:33:36.100 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.100 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.100 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.100 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-04-20T12:33:36.100 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.100 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.100 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.100 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Keepalived container image", 2024-04-20T12:33:36.100 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.100 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.100 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.100 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.100 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_loki": { 2024-04-20T12:33:36.101 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_loki", 2024-04-20T12:33:36.101 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.101 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.101 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.101 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-04-20T12:33:36.101 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.101 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.101 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.101 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Loki container image", 2024-04-20T12:33:36.101 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.101 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.101 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.101 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.101 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_node_exporter": { 2024-04-20T12:33:36.101 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_node_exporter", 2024-04-20T12:33:36.102 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.102 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.102 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.102 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-04-20T12:33:36.102 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.102 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.102 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.102 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-04-20T12:33:36.102 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.102 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.102 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.102 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.102 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_nvmeof": { 2024-04-20T12:33:36.102 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_nvmeof", 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Nvme-of container image", 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_prometheus": { 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_prometheus", 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.104 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.104 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-04-20T12:33:36.104 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.104 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.104 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.104 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Prometheus container image", 2024-04-20T12:33:36.104 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.104 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.104 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.104 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.104 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_promtail": { 2024-04-20T12:33:36.104 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_promtail", 2024-04-20T12:33:36.104 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.104 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.104 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.105 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-04-20T12:33:36.105 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.105 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.105 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.105 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Promtail container image", 2024-04-20T12:33:36.105 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.105 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.105 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.105 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.105 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_samba": { 2024-04-20T12:33:36.105 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_samba", 2024-04-20T12:33:36.105 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.105 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.105 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.106 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-04-20T12:33:36.106 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.106 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.106 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.106 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Samba/SMB container image", 2024-04-20T12:33:36.106 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.106 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.106 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.106 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.106 INFO:teuthology.orchestra.run.smithi135.stdout: "container_image_snmp_gateway": { 2024-04-20T12:33:36.106 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_image_snmp_gateway", 2024-04-20T12:33:36.106 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.106 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.106 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "SNMP Gateway container image", 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: "container_init": { 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "container_init", 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.107 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Run podman/docker with `--init`", 2024-04-20T12:33:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: "daemon_cache_timeout": { 2024-04-20T12:33:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "daemon_cache_timeout", 2024-04-20T12:33:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-04-20T12:33:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.108 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-04-20T12:33:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: "default_cephadm_command_timeout": { 2024-04-20T12:33:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_cephadm_command_timeout", 2024-04-20T12:33:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "900", 2024-04-20T12:33:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.109 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-04-20T12:33:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: "default_registry": { 2024-04-20T12:33:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "default_registry", 2024-04-20T12:33:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "docker.io", 2024-04-20T12:33:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.110 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-04-20T12:33:36.111 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.111 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.111 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.111 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.111 INFO:teuthology.orchestra.run.smithi135.stdout: "device_cache_timeout": { 2024-04-20T12:33:36.111 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_cache_timeout", 2024-04-20T12:33:36.111 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.111 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.111 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.111 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1800", 2024-04-20T12:33:36.111 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.111 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.111 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.111 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache device inventory", 2024-04-20T12:33:36.111 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.112 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.112 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.112 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.112 INFO:teuthology.orchestra.run.smithi135.stdout: "device_enhanced_scan": { 2024-04-20T12:33:36.112 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_enhanced_scan", 2024-04-20T12:33:36.112 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.112 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.112 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.112 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.112 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.112 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.112 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.112 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use libstoragemgmt during device scans", 2024-04-20T12:33:36.112 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.112 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.113 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.113 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.113 INFO:teuthology.orchestra.run.smithi135.stdout: "facts_cache_timeout": { 2024-04-20T12:33:36.113 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "facts_cache_timeout", 2024-04-20T12:33:36.113 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.113 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.113 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.113 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-04-20T12:33:36.113 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.113 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.113 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.113 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "seconds to cache host facts data", 2024-04-20T12:33:36.113 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.113 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.113 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.114 INFO:teuthology.orchestra.run.smithi135.stdout: "grafana_dashboards_path": { 2024-04-20T12:33:36.114 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "grafana_dashboards_path", 2024-04-20T12:33:36.114 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.114 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.114 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.114 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-04-20T12:33:36.114 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.114 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.114 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.114 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-04-20T12:33:36.114 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.114 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.114 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.114 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.115 INFO:teuthology.orchestra.run.smithi135.stdout: "host_check_interval": { 2024-04-20T12:33:36.115 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "host_check_interval", 2024-04-20T12:33:36.115 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.115 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.115 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.115 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-04-20T12:33:36.115 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.115 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.115 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.115 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to perform a host check", 2024-04-20T12:33:36.115 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.115 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.115 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.115 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.115 INFO:teuthology.orchestra.run.smithi135.stdout: "hw_monitoring": { 2024-04-20T12:33:36.116 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hw_monitoring", 2024-04-20T12:33:36.116 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.116 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.116 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.116 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.116 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.116 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.116 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.116 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-04-20T12:33:36.116 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.116 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.116 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.116 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.116 INFO:teuthology.orchestra.run.smithi135.stdout: "inventory_list_all": { 2024-04-20T12:33:36.116 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "inventory_list_all", 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.118 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.118 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.118 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.118 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.118 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.118 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.118 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.118 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.118 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.118 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.118 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.118 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.118 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.118 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.119 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.119 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.119 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.119 INFO:teuthology.orchestra.run.smithi135.stdout: "log_refresh_metadata": { 2024-04-20T12:33:36.119 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_refresh_metadata", 2024-04-20T12:33:36.119 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.119 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.119 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.119 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.119 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.119 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.119 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.119 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-04-20T12:33:36.119 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.119 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.120 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.121 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.121 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.121 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.121 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.121 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.121 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.121 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.121 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.121 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.121 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.121 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.121 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.121 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.121 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.121 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.122 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.122 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.122 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.122 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.122 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.122 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.122 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.122 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.122 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.122 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.122 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.122 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.122 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.122 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.122 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf": { 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-04-20T12:33:36.123 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.124 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.124 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.124 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.124 INFO:teuthology.orchestra.run.smithi135.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-04-20T12:33:36.124 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-04-20T12:33:36.124 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.124 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.124 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.124 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "*", 2024-04-20T12:33:36.124 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.124 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.124 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.124 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-04-20T12:33:36.124 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.124 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.125 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.125 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.125 INFO:teuthology.orchestra.run.smithi135.stdout: "max_count_per_host": { 2024-04-20T12:33:36.125 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_count_per_host", 2024-04-20T12:33:36.125 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.125 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.125 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.125 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:36.125 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.125 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.125 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.125 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of daemons per service per host", 2024-04-20T12:33:36.125 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.125 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.126 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.126 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.126 INFO:teuthology.orchestra.run.smithi135.stdout: "max_osd_draining_count": { 2024-04-20T12:33:36.126 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_osd_draining_count", 2024-04-20T12:33:36.126 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.126 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.126 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.126 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:36.126 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.126 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.126 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.126 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-04-20T12:33:36.126 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.126 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.127 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.127 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.127 INFO:teuthology.orchestra.run.smithi135.stdout: "migration_current": { 2024-04-20T12:33:36.127 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "migration_current", 2024-04-20T12:33:36.127 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.127 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.127 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.127 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.127 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.127 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.127 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.127 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "internal - do not modify", 2024-04-20T12:33:36.127 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.127 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: "mode": { 2024-04-20T12:33:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mode", 2024-04-20T12:33:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "root", 2024-04-20T12:33:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm-package", 2024-04-20T12:33:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: "root" 2024-04-20T12:33:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.128 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "mode for remote execution of cephadm", 2024-04-20T12:33:36.129 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.129 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.129 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.129 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.129 INFO:teuthology.orchestra.run.smithi135.stdout: "oob_default_addr": { 2024-04-20T12:33:36.129 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "oob_default_addr", 2024-04-20T12:33:36.129 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.129 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.129 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.129 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "169.254.1.1", 2024-04-20T12:33:36.129 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.129 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.129 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.129 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Default address for RedFish API (oob management).", 2024-04-20T12:33:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: "prometheus_alerts_path": { 2024-04-20T12:33:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus_alerts_path", 2024-04-20T12:33:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-04-20T12:33:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.130 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-04-20T12:33:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_insecure": { 2024-04-20T12:33:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_insecure", 2024-04-20T12:33:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-04-20T12:33:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.132 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.132 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.132 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.132 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_password": { 2024-04-20T12:33:36.132 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_password", 2024-04-20T12:33:36.132 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.132 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.132 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.132 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.132 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.132 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.132 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.132 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-04-20T12:33:36.132 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.132 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_url": { 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_url", 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.133 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.134 INFO:teuthology.orchestra.run.smithi135.stdout: "registry_username": { 2024-04-20T12:33:36.134 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "registry_username", 2024-04-20T12:33:36.134 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.134 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.134 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.134 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.134 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.134 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.134 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.134 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-04-20T12:33:36.134 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.134 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.134 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.134 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.134 INFO:teuthology.orchestra.run.smithi135.stdout: "secure_monitoring_stack": { 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "secure_monitoring_stack", 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: "service_discovery_port": { 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "service_discovery_port", 2024-04-20T12:33:36.135 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.136 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.136 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.136 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8765", 2024-04-20T12:33:36.136 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.136 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.136 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.136 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "cephadm service discovery port", 2024-04-20T12:33:36.136 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.136 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.136 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.136 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.136 INFO:teuthology.orchestra.run.smithi135.stdout: "ssh_config_file": { 2024-04-20T12:33:36.136 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssh_config_file", 2024-04-20T12:33:36.136 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.136 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.137 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.137 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.137 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.137 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.137 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.137 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-04-20T12:33:36.137 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.137 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.137 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.137 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.137 INFO:teuthology.orchestra.run.smithi135.stdout: "use_agent": { 2024-04-20T12:33:36.137 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_agent", 2024-04-20T12:33:36.137 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.137 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.137 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.138 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.138 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.138 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.138 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.138 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-04-20T12:33:36.138 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.138 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.138 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.138 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.138 INFO:teuthology.orchestra.run.smithi135.stdout: "use_repo_digest": { 2024-04-20T12:33:36.138 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "use_repo_digest", 2024-04-20T12:33:36.138 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.138 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.138 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.138 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.139 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.139 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.139 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.139 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-04-20T12:33:36.139 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.139 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.139 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.139 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.139 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_failed_host_check": { 2024-04-20T12:33:36.139 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_failed_host_check", 2024-04-20T12:33:36.139 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.139 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.139 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.139 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.139 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.140 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.140 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.140 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if the host check fails", 2024-04-20T12:33:36.140 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.140 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.140 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.140 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.140 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_daemons": { 2024-04-20T12:33:36.140 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_daemons", 2024-04-20T12:33:36.140 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.140 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.140 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.140 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.140 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.140 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_on_stray_hosts": { 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_on_stray_hosts", 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.141 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-04-20T12:33:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crash", 2024-04-20T12:33:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.142 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.143 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.143 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.143 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.143 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.143 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.143 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.143 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.143 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.143 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.143 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.143 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.143 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.143 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.143 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.144 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.146 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.146 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.146 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.146 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.146 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.146 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.146 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.146 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.146 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.146 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.146 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.146 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.146 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.146 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.147 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.147 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.147 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.147 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.147 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.147 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.147 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.147 INFO:teuthology.orchestra.run.smithi135.stdout: "retain_interval": { 2024-04-20T12:33:36.147 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retain_interval", 2024-04-20T12:33:36.147 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.147 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.147 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.147 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "31536000", 2024-04-20T12:33:36.147 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.148 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.148 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.148 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain crashes before pruning them", 2024-04-20T12:33:36.148 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.148 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.148 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.148 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.148 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_recent_interval": { 2024-04-20T12:33:36.148 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_recent_interval", 2024-04-20T12:33:36.148 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.148 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.148 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.148 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1209600", 2024-04-20T12:33:36.148 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.148 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.149 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.149 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "time interval in which to warn about recent crashes", 2024-04-20T12:33:36.149 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.149 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.149 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.149 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.149 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.149 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.149 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.149 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dashboard", 2024-04-20T12:33:36.149 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.149 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.149 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.149 INFO:teuthology.orchestra.run.smithi135.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-04-20T12:33:36.149 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-04-20T12:33:36.150 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.150 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.150 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.150 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:36.150 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.150 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.150 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.150 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.150 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.150 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.150 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.150 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.150 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_HOST": { 2024-04-20T12:33:36.150 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_HOST", 2024-04-20T12:33:36.151 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.151 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.151 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.151 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.151 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.151 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.151 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.151 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.151 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.151 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.151 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.151 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.151 INFO:teuthology.orchestra.run.smithi135.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-04-20T12:33:36.151 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-04-20T12:33:36.151 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.152 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.152 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.152 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.152 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.152 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.152 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.152 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.152 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.152 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.152 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.152 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.152 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_ENABLED": { 2024-04-20T12:33:36.152 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_ENABLED", 2024-04-20T12:33:36.152 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.153 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.154 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.154 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.154 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.154 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.154 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.154 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.154 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.154 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.154 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.154 INFO:teuthology.orchestra.run.smithi135.stdout: "ENABLE_BROWSABLE_API": { 2024-04-20T12:33:36.154 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ENABLE_BROWSABLE_API", 2024-04-20T12:33:36.154 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.154 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.154 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.155 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.155 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.155 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.155 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.155 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.155 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.155 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.155 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.155 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.155 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-04-20T12:33:36.155 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-04-20T12:33:36.155 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.155 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.155 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.156 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.157 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.157 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.157 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.157 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.157 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.157 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.157 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-04-20T12:33:36.157 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-04-20T12:33:36.157 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.157 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.157 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.157 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.157 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.157 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.158 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.158 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.158 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.158 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.158 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.158 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-04-20T12:33:36.158 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-04-20T12:33:36.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:35.234+0000 7f7102055640 1 -- 172.21.15.135:0/2082138201 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f70e80a3d20 msgr2=0x7f70e80a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:36.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:35.234+0000 7f7102055640 1 --2- 172.21.15.135:0/2082138201 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f70e80a3d20 0x7f70e80a61e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70ec005fd0 tx=0x7f70ec00b390 comp rx=0 tx=0).stop 2024-04-20T12:33:36.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:35.234+0000 7f7102055640 1 -- 172.21.15.135:0/2082138201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70fc106f60 msgr2=0x7f70fc19d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:33:36.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:35.234+0000 7f7102055640 1 --2- 172.21.15.135:0/2082138201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70fc106f60 0x7f70fc19d020 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f70f400eb10 tx=0x7f70f400c2d0 comp rx=0 tx=0).stop 2024-04-20T12:33:36.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:35.234+0000 7f7102055640 1 -- 172.21.15.135:0/2082138201 shutdown_connections 2024-04-20T12:33:36.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:35.234+0000 7f7102055640 1 --2- 172.21.15.135:0/2082138201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70fc106f60 0x7f70fc19d020 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:36.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:35.234+0000 7f7102055640 1 --2- 172.21.15.135:0/2082138201 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f70fc069ab0 0x7f70fc198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:36.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:35.234+0000 7f7102055640 1 --2- 172.21.15.135:0/2082138201 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f70e80a3d20 0x7f70e80a61e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:36.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:35.234+0000 7f7102055640 1 --2- 172.21.15.135:0/2082138201 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70fc0690f0 0x7f70fc198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:33:36.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:35.234+0000 7f7102055640 1 -- 172.21.15.135:0/2082138201 >> 172.21.15.135:0/2082138201 conn(0x7f70fc077e40 msgr2=0x7f70fc0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:33:36.159 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:35.234+0000 7f7102055640 1 -- 172.21.15.135:0/2082138201 shutdown_connections 2024-04-20T12:33:36.160 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:33:35.234+0000 7f7102055640 1 -- 172.21.15.135:0/2082138201 wait complete. 2024-04-20T12:33:36.161 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.161 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.162 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.162 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.162 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.162 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.162 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.162 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.162 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.162 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.162 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.162 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_NFS": { 2024-04-20T12:33:36.162 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-04-20T12:33:36.162 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.162 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RBD": { 2024-04-20T12:33:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-04-20T12:33:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.163 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.164 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.164 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.164 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.164 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.164 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.164 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.164 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.164 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.164 INFO:teuthology.orchestra.run.smithi135.stdout: "FEATURE_TOGGLE_RGW": { 2024-04-20T12:33:36.164 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-04-20T12:33:36.164 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.164 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.164 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.164 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.165 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.165 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.165 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.165 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.165 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.165 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.165 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.165 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.165 INFO:teuthology.orchestra.run.smithi135.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-04-20T12:33:36.165 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-04-20T12:33:36.165 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.165 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.165 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.165 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.165 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.166 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.166 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.166 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.166 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.166 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.166 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.166 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.166 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_PASSWORD": { 2024-04-20T12:33:36.166 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_PASSWORD", 2024-04-20T12:33:36.166 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.166 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.166 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.166 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-04-20T12:33:36.166 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.166 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.167 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.167 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.167 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.167 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.167 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.167 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.167 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-04-20T12:33:36.167 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-04-20T12:33:36.167 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.167 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.167 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.167 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.167 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.167 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.167 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.168 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.168 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.168 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.168 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.168 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_URL": { 2024-04-20T12:33:36.168 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_URL", 2024-04-20T12:33:36.168 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.168 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.168 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.168 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.168 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.168 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.168 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.168 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_API_USERNAME": { 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_API_USERNAME", 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.169 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.170 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.170 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-04-20T12:33:36.170 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-04-20T12:33:36.170 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.170 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.170 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.170 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.170 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.170 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.170 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.170 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.170 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.170 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.170 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.171 INFO:teuthology.orchestra.run.smithi135.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: "ISSUE_TRACKER_API_KEY": { 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-04-20T12:33:36.172 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: "MANAGED_BY_CLUSTERS": { 2024-04-20T12:33:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-04-20T12:33:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.174 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.174 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "[]", 2024-04-20T12:33:36.174 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.174 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.174 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.174 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.174 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.174 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.174 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.174 INFO:teuthology.orchestra.run.smithi135.stdout: "MULTICLUSTER_CONFIG": { 2024-04-20T12:33:36.174 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "MULTICLUSTER_CONFIG", 2024-04-20T12:33:36.174 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.174 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "{}", 2024-04-20T12:33:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_HOST": { 2024-04-20T12:33:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_HOST", 2024-04-20T12:33:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.175 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.176 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.176 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.176 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.176 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.176 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.176 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.176 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.176 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.176 INFO:teuthology.orchestra.run.smithi135.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-04-20T12:33:36.176 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-04-20T12:33:36.176 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.176 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.176 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.176 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.177 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.177 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.177 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.177 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.177 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.177 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.177 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.177 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.177 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-04-20T12:33:36.177 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-04-20T12:33:36.177 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.177 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.177 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.177 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.177 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.178 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.178 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.178 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.178 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.178 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.178 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.178 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-04-20T12:33:36.178 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-04-20T12:33:36.178 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.178 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.178 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.178 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.178 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.178 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.179 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.180 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.180 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.180 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.180 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-04-20T12:33:36.180 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-04-20T12:33:36.180 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.180 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.180 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.180 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.180 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.180 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.180 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.180 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.181 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.182 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.182 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-04-20T12:33:36.182 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-04-20T12:33:36.182 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.182 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.182 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.182 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.182 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.182 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.182 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.182 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.182 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.182 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.183 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.183 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-04-20T12:33:36.183 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-04-20T12:33:36.183 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.183 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.183 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.183 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.183 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.183 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.183 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.183 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.183 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.183 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.183 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_ENABLED": { 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_ENABLED", 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.184 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-04-20T12:33:36.185 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-04-20T12:33:36.185 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.185 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.185 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.185 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-04-20T12:33:36.185 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.185 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.185 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.185 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.185 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.185 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.185 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.185 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-04-20T12:33:36.185 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-04-20T12:33:36.186 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.186 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.186 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.186 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:36.186 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.186 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.186 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.186 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.186 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.186 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.186 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.186 INFO:teuthology.orchestra.run.smithi135.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-04-20T12:33:36.186 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-04-20T12:33:36.186 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.187 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.187 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.187 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8", 2024-04-20T12:33:36.187 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.187 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.187 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.187 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.187 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.187 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.187 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.187 INFO:teuthology.orchestra.run.smithi135.stdout: "REST_REQUESTS_TIMEOUT": { 2024-04-20T12:33:36.187 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-04-20T12:33:36.187 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.187 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.188 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.188 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "45", 2024-04-20T12:33:36.188 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.188 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.188 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.188 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.188 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.188 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.188 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.188 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ACCESS_KEY": { 2024-04-20T12:33:36.188 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ACCESS_KEY", 2024-04-20T12:33:36.188 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.188 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.188 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "admin", 2024-04-20T12:33:36.189 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.190 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.190 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.190 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.190 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.190 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.190 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.190 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SECRET_KEY": { 2024-04-20T12:33:36.190 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SECRET_KEY", 2024-04-20T12:33:36.190 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.190 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.190 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.190 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.190 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.190 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.191 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.191 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.191 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.191 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.191 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.191 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.191 INFO:teuthology.orchestra.run.smithi135.stdout: "RGW_API_SSL_VERIFY": { 2024-04-20T12:33:36.191 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "RGW_API_SSL_VERIFY", 2024-04-20T12:33:36.191 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.191 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.191 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.191 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.191 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.191 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: "UNSAFE_TLS_v1_2": { 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "UNSAFE_TLS_v1_2", 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.192 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.193 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.193 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.193 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.193 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.193 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-04-20T12:33:36.193 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-04-20T12:33:36.193 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.193 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.193 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.193 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-04-20T12:33:36.193 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.193 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.193 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.193 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.193 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.194 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.194 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.194 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.194 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-04-20T12:33:36.194 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-04-20T12:33:36.194 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.194 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.194 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.194 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:36.194 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.194 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.194 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.194 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.194 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.195 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.196 INFO:teuthology.orchestra.run.smithi135.stdout: "cross_origin_url": { 2024-04-20T12:33:36.196 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cross_origin_url", 2024-04-20T12:33:36.196 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.196 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.196 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.196 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.196 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.196 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.196 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.196 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.196 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.196 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.196 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.197 INFO:teuthology.orchestra.run.smithi135.stdout: "crt_file": { 2024-04-20T12:33:36.197 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "crt_file", 2024-04-20T12:33:36.197 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.197 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.197 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.197 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.197 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.197 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.197 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.197 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.197 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.197 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.197 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.197 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.197 INFO:teuthology.orchestra.run.smithi135.stdout: "debug": { 2024-04-20T12:33:36.198 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "debug", 2024-04-20T12:33:36.198 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.198 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.198 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.198 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.198 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.198 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.198 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.198 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Enable/disable debug options", 2024-04-20T12:33:36.198 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.198 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.198 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.198 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.198 INFO:teuthology.orchestra.run.smithi135.stdout: "jwt_token_ttl": { 2024-04-20T12:33:36.199 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "jwt_token_ttl", 2024-04-20T12:33:36.199 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.199 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.199 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.199 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "28800", 2024-04-20T12:33:36.199 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.199 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.199 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.199 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.199 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.199 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.199 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.199 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.199 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-04-20T12:33:36.199 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.200 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.201 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.202 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.203 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.203 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.203 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.203 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.203 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.203 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.203 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.203 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.203 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.203 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.203 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.203 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.203 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.203 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.204 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.204 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.204 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.204 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.204 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.204 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.204 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.204 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.204 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.204 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.204 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.204 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.204 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.204 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.205 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.205 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.205 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.205 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.205 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.205 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.205 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.205 INFO:teuthology.orchestra.run.smithi135.stdout: "motd": { 2024-04-20T12:33:36.205 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "motd", 2024-04-20T12:33:36.205 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.205 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.205 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.205 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.206 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.206 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.206 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.206 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "The message of the day", 2024-04-20T12:33:36.206 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.206 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.206 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.206 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.206 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect_resolve_ip_addr": { 2024-04-20T12:33:36.206 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "redirect_resolve_ip_addr", 2024-04-20T12:33:36.206 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.206 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.206 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.206 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.207 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.207 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.207 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.207 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.207 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.207 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.207 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.207 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-04-20T12:33:36.207 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-04-20T12:33:36.207 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.207 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.207 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.207 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-04-20T12:33:36.208 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.208 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.208 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.208 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.208 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.208 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.208 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.208 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-04-20T12:33:36.208 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-04-20T12:33:36.208 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.208 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.208 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.208 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8080", 2024-04-20T12:33:36.209 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.209 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.209 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.209 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.209 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.209 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.209 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.209 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.209 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-04-20T12:33:36.209 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-04-20T12:33:36.209 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.209 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.209 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.209 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl_server_port": { 2024-04-20T12:33:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl_server_port", 2024-04-20T12:33:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8443", 2024-04-20T12:33:36.210 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.211 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.211 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.211 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.211 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.211 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.211 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.211 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-04-20T12:33:36.211 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-04-20T12:33:36.211 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.211 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.211 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.211 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "redirect", 2024-04-20T12:33:36.211 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.212 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.212 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.212 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.212 INFO:teuthology.orchestra.run.smithi135.stdout: "redirect" 2024-04-20T12:33:36.212 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.212 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.212 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.212 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.212 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.212 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.212 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-04-20T12:33:36.212 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-04-20T12:33:36.212 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.212 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.212 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.213 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-04-20T12:33:36.213 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-04-20T12:33:36.213 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-04-20T12:33:36.213 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.213 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.213 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.213 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.213 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.213 INFO:teuthology.orchestra.run.smithi135.stdout: "url_prefix": { 2024-04-20T12:33:36.213 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url_prefix", 2024-04-20T12:33:36.213 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.213 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.213 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.214 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.214 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.214 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.214 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.214 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.214 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.214 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.214 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.214 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.214 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.214 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.214 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "devicehealth", 2024-04-20T12:33:36.214 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.214 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.215 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.215 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_monitoring": { 2024-04-20T12:33:36.215 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_monitoring", 2024-04-20T12:33:36.215 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.215 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.215 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.215 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.215 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.215 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.215 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.215 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "monitor device health metrics", 2024-04-20T12:33:36.215 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.215 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.215 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.216 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.216 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.216 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.216 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.216 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.216 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.216 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.216 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.216 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.216 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.216 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.216 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.216 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.216 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.216 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.217 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.218 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.218 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.218 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.218 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.218 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.218 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.218 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.218 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.218 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.218 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.218 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.218 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.218 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.219 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.219 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.219 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.219 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.219 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.219 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.219 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.219 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.219 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.219 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.219 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.219 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.219 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.219 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.219 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.220 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.220 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.220 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.220 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.220 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.220 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.220 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.220 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.220 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.220 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.220 INFO:teuthology.orchestra.run.smithi135.stdout: "mark_out_threshold": { 2024-04-20T12:33:36.220 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mark_out_threshold", 2024-04-20T12:33:36.220 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.220 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.220 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.221 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "2419200", 2024-04-20T12:33:36.221 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.221 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.221 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.221 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-04-20T12:33:36.221 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.221 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.221 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.221 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.221 INFO:teuthology.orchestra.run.smithi135.stdout: "pool_name": { 2024-04-20T12:33:36.221 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pool_name", 2024-04-20T12:33:36.221 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.221 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.221 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.221 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "device_health_metrics", 2024-04-20T12:33:36.222 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.222 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.222 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.222 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name of pool in which to store device health metrics", 2024-04-20T12:33:36.222 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.222 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.222 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.222 INFO:teuthology.orchestra.run.smithi135.stdout: "retention_period": { 2024-04-20T12:33:36.222 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "retention_period", 2024-04-20T12:33:36.222 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.222 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.222 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.222 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15552000", 2024-04-20T12:33:36.222 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.223 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.223 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.223 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long to retain device health metrics", 2024-04-20T12:33:36.223 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.223 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.223 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.223 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_frequency": { 2024-04-20T12:33:36.223 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_frequency", 2024-04-20T12:33:36.223 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.223 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.223 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.223 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-04-20T12:33:36.223 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.223 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.224 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.224 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to scrape device health metrics", 2024-04-20T12:33:36.224 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.224 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.224 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.224 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.224 INFO:teuthology.orchestra.run.smithi135.stdout: "self_heal": { 2024-04-20T12:33:36.224 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "self_heal", 2024-04-20T12:33:36.224 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.224 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.224 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.224 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.224 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.224 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.224 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.225 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-04-20T12:33:36.225 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.225 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.225 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.225 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-04-20T12:33:36.225 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-04-20T12:33:36.225 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.225 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.225 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.225 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-04-20T12:33:36.225 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.225 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.225 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.225 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how frequently to wake up and check device health", 2024-04-20T12:33:36.226 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.226 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.226 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.226 INFO:teuthology.orchestra.run.smithi135.stdout: "warn_threshold": { 2024-04-20T12:33:36.226 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "warn_threshold", 2024-04-20T12:33:36.226 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.226 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.226 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.226 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7257600", 2024-04-20T12:33:36.226 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.226 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.226 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.226 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-04-20T12:33:36.226 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.227 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.227 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.227 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.227 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.227 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.227 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "diskprediction_local", 2024-04-20T12:33:36.227 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.227 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.227 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.227 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.227 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.227 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.227 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.227 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.228 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.228 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.228 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.228 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.228 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.228 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.228 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.228 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.228 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.228 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.228 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.228 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.228 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.228 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.228 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.229 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.229 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.229 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.229 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.229 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.229 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.229 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.229 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.229 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.229 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.229 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.229 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.229 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.230 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.230 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.230 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.230 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.230 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.230 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.230 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.230 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.230 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.230 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.230 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.230 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.230 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.230 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.230 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.231 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.232 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.232 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.232 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.232 INFO:teuthology.orchestra.run.smithi135.stdout: "predict_interval": { 2024-04-20T12:33:36.232 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predict_interval", 2024-04-20T12:33:36.232 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.232 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.232 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.232 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "86400", 2024-04-20T12:33:36.232 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.232 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.232 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.232 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.232 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: "predictor_model": { 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "predictor_model", 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "prophetstor", 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.233 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.234 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-04-20T12:33:36.234 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-04-20T12:33:36.234 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.234 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.234 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.234 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "600", 2024-04-20T12:33:36.234 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.234 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.234 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.234 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.234 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.234 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.234 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.235 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.235 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.235 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.235 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "influx", 2024-04-20T12:33:36.235 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": false, 2024-04-20T12:33:36.235 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "influxdb python module not found", 2024-04-20T12:33:36.235 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.235 INFO:teuthology.orchestra.run.smithi135.stdout: "batch_size": { 2024-04-20T12:33:36.235 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "batch_size", 2024-04-20T12:33:36.236 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.236 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.236 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.236 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5000", 2024-04-20T12:33:36.236 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.236 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.236 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.237 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-04-20T12:33:36.237 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.237 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.237 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.237 INFO:teuthology.orchestra.run.smithi135.stdout: "database": { 2024-04-20T12:33:36.237 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "database", 2024-04-20T12:33:36.238 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.238 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.238 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.238 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "ceph", 2024-04-20T12:33:36.238 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.238 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.238 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.238 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-04-20T12:33:36.239 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.239 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.239 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.239 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.239 INFO:teuthology.orchestra.run.smithi135.stdout: "hostname": { 2024-04-20T12:33:36.239 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "hostname", 2024-04-20T12:33:36.239 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.239 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.239 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.239 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.239 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.239 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.239 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.239 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server hostname", 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "30", 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "5", 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.240 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.241 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.242 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.242 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.242 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.242 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.242 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.242 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.242 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.242 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.242 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.242 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.242 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.242 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.242 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.242 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.243 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.244 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "password": { 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "password", 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.245 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.246 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.246 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.246 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.246 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "password of InfluxDB server user", 2024-04-20T12:33:36.246 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.246 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.246 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.246 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.246 INFO:teuthology.orchestra.run.smithi135.stdout: "port": { 2024-04-20T12:33:36.246 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "port", 2024-04-20T12:33:36.246 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.246 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.246 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.246 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "8086", 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "InfluxDB server port", 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: "ssl": { 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ssl", 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "false", 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.247 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: "threads": { 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threads", 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "32", 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.248 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-04-20T12:33:36.249 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.249 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.249 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.249 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.249 INFO:teuthology.orchestra.run.smithi135.stdout: "username": { 2024-04-20T12:33:36.249 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "username", 2024-04-20T12:33:36.249 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.249 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.249 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.249 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.249 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.249 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.249 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.249 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "username of InfluxDB server user", 2024-04-20T12:33:36.249 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.250 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.250 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.250 INFO:teuthology.orchestra.run.smithi135.stdout: "verify_ssl": { 2024-04-20T12:33:36.250 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "verify_ssl", 2024-04-20T12:33:36.250 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.250 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.250 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.250 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "true", 2024-04-20T12:33:36.250 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.250 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.250 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.250 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-04-20T12:33:36.251 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.251 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.251 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.251 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.251 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.251 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.251 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "insights", 2024-04-20T12:33:36.251 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.251 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.251 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.251 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.251 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.251 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.251 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.252 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.252 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.252 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.252 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.252 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.252 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.252 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.252 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.252 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.252 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.252 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.252 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.252 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.252 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.253 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.253 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.253 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.253 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.253 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.253 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.253 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.253 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.253 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.253 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.253 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.253 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.253 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.254 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.254 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.254 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.254 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.254 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.254 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.254 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.254 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.254 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.254 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.254 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.254 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.254 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.254 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.255 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.255 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.255 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.255 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.255 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.255 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.255 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.255 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.255 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.255 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.255 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.255 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "iostat", 2024-04-20T12:33:36.256 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.257 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.257 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.257 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.257 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.257 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.257 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.257 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.257 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.257 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.257 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.257 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.257 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.257 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.257 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.257 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.258 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.258 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.258 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.258 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.258 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.258 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.258 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.258 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.258 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.258 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.258 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.258 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.258 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.258 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.259 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.260 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "k8sevents", 2024-04-20T12:33:36.261 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.262 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.262 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.262 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_event_retention_days": { 2024-04-20T12:33:36.262 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "ceph_event_retention_days", 2024-04-20T12:33:36.262 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.262 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.262 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.262 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "7", 2024-04-20T12:33:36.262 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.262 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.262 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.262 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Days to hold ceph event information within local cache", 2024-04-20T12:33:36.262 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.262 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.263 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.263 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.263 INFO:teuthology.orchestra.run.smithi135.stdout: "config_check_secs": { 2024-04-20T12:33:36.263 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "config_check_secs", 2024-04-20T12:33:36.263 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.263 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.263 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.263 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:36.263 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "10", 2024-04-20T12:33:36.263 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.263 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.263 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-04-20T12:33:36.263 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.263 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.263 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.264 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.265 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.265 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.265 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.265 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.265 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.265 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.265 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.265 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.265 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.265 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.265 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.265 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.265 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.265 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.265 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.266 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.266 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.266 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.266 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.266 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.266 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.266 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.266 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.266 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.266 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.266 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.266 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.266 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.266 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.266 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "localpool", 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.268 INFO:teuthology.orchestra.run.smithi135.stdout: "failure_domain": { 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "failure_domain", 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "host", 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "failure domain for any created local pool", 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.269 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.270 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.270 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.270 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.270 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.270 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.270 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.270 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.270 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.270 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.270 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.270 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.270 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.270 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.270 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.270 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.271 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.272 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.272 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.272 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.272 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.272 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.272 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.272 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.272 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.272 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.272 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.272 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.272 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.272 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.272 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.272 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.273 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.274 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.274 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.274 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.274 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.274 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.274 INFO:teuthology.orchestra.run.smithi135.stdout: "min_size": { 2024-04-20T12:33:36.274 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "min_size", 2024-04-20T12:33:36.274 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.274 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.274 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.274 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.274 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.274 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.274 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.274 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default min_size for any created local pool", 2024-04-20T12:33:36.275 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-04-20T12:33:36.275 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.275 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.275 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.275 INFO:teuthology.orchestra.run.smithi135.stdout: "num_rep": { 2024-04-20T12:33:36.275 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "num_rep", 2024-04-20T12:33:36.275 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.275 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.275 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.275 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3", 2024-04-20T12:33:36.275 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.275 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.275 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.275 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default replica count for any created local pool", 2024-04-20T12:33:36.276 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.276 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.276 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.276 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.276 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_num": { 2024-04-20T12:33:36.276 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_num", 2024-04-20T12:33:36.276 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.276 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.276 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.276 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "128", 2024-04-20T12:33:36.276 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.276 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.276 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.276 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "default pg_num for any created local pool", 2024-04-20T12:33:36.276 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: "prefix": { 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prefix", 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "name prefix for any created local pool", 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.277 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.278 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.278 INFO:teuthology.orchestra.run.smithi135.stdout: "subtree": { 2024-04-20T12:33:36.278 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "subtree", 2024-04-20T12:33:36.278 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.278 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.278 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.278 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "rack", 2024-04-20T12:33:36.278 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.278 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.278 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.278 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "CRUSH level for which to create a local pool", 2024-04-20T12:33:36.278 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-04-20T12:33:36.278 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.278 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mds_autoscaler", 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.279 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.280 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.280 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.280 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.280 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.280 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.280 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.280 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.280 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.280 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.280 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.280 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.280 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.280 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.280 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.280 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.281 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.281 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.281 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.281 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.281 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.281 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.281 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.281 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.281 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.281 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.281 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.281 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.281 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.281 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.281 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.282 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.282 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.282 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.282 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.282 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.282 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.282 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.282 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.282 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.282 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.282 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.282 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.282 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.282 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.282 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.283 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.283 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.283 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.283 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.283 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.283 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.283 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.283 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.283 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.283 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.283 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.283 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.283 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.283 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.283 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirroring", 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.284 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.285 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.286 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.286 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.286 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.286 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.286 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.286 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.286 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.286 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.286 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.286 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.286 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.286 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.286 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.287 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.288 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.288 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.288 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.288 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.288 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.288 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.288 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.288 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.288 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.288 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.288 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.288 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.288 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.288 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.288 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "nfs", 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.289 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.290 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.290 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.290 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.290 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.290 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.290 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.290 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.290 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.290 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.290 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.290 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.290 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.290 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.290 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.290 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.291 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.291 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.291 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.291 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.291 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.291 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.291 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.291 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.291 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.291 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.291 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.291 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.291 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.291 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.291 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.292 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.292 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.292 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.292 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.292 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.292 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.292 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.292 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.292 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.292 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.292 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.292 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.292 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.292 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.292 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.293 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.294 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.294 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.294 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.294 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.294 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.294 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.294 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-04-20T12:33:36.294 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.294 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.294 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.294 INFO:teuthology.orchestra.run.smithi135.stdout: "fail_fs": { 2024-04-20T12:33:36.294 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "fail_fs", 2024-04-20T12:33:36.294 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.294 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.295 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.296 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.296 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.296 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.296 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.296 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.296 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.296 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.296 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.296 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.296 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.296 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.296 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.296 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.296 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.296 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.297 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.297 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.297 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.297 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.297 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.297 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.297 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.297 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.297 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.297 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.297 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.297 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.297 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.297 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.297 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.298 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.298 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.298 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.298 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.298 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.298 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.298 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.298 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.298 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.298 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.298 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.298 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.298 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.298 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.298 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.299 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.299 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.299 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.299 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.299 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.299 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.299 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.299 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.299 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.299 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.299 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.299 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.299 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.299 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.299 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator": { 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "orchestrator", 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: "cephadm", 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: "rook", 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: "test_orchestrator" 2024-04-20T12:33:36.300 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Orchestrator backend", 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_perf_query", 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.301 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.302 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.302 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.302 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.302 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.302 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.302 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.302 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.302 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.302 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.302 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.302 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.302 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.302 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.302 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.303 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.304 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.304 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.304 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.304 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.304 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.304 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.304 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.304 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.304 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.304 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.304 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.304 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.304 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.304 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.305 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.305 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.305 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.305 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.305 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.305 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.305 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.305 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.305 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.305 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.305 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.305 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.305 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.305 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.306 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.306 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.306 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.306 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.306 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.306 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.306 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.306 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.306 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "osd_support", 2024-04-20T12:33:36.306 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.306 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.306 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.306 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.306 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.307 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.308 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.308 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.308 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.308 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.308 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.308 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.308 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.308 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.308 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.308 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.308 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.308 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.308 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.308 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.308 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.309 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.310 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.310 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.310 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.310 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.310 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.310 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.310 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.310 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.310 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.310 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.310 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.310 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.310 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.310 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.310 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.311 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.311 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.311 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.311 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.311 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.311 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.311 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.311 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.311 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "pg_autoscaler", 2024-04-20T12:33:36.311 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.311 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.311 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.311 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.311 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.312 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.313 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.313 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.313 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.313 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.313 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.313 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.313 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.313 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.313 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.313 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.313 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.313 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.313 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.313 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.313 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.314 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.315 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.316 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.316 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.316 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.316 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.316 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.316 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-04-20T12:33:36.316 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-04-20T12:33:36.316 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.316 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.316 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.316 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-04-20T12:33:36.316 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.316 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.316 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.316 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.317 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.317 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.317 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.317 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.317 INFO:teuthology.orchestra.run.smithi135.stdout: "threshold": { 2024-04-20T12:33:36.317 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "threshold", 2024-04-20T12:33:36.317 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:36.317 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.317 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.317 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "3.0", 2024-04-20T12:33:36.317 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1.0", 2024-04-20T12:33:36.317 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.317 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.317 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "scaling threshold", 2024-04-20T12:33:36.317 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-04-20T12:33:36.318 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.318 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.318 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.318 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.318 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.318 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.318 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "progress", 2024-04-20T12:33:36.318 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.318 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.318 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.318 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_pg_recovery_event": { 2024-04-20T12:33:36.318 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_pg_recovery_event", 2024-04-20T12:33:36.318 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.318 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.319 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.319 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.319 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.319 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.319 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.319 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow the module to show pg recovery progress", 2024-04-20T12:33:36.319 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.319 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.319 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.319 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.319 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-04-20T12:33:36.319 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-04-20T12:33:36.319 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.319 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.320 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.321 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.321 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.321 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.321 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.321 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.321 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.321 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.321 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.321 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.321 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.321 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.321 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.321 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.321 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.321 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.322 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.322 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.322 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.322 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.322 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.322 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.322 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.322 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.322 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.322 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.322 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.322 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.322 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.322 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.323 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.324 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.324 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.324 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.324 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.324 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.324 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.324 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.324 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.324 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.324 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.324 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.324 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.324 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.324 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.324 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: "max_completed_events": { 2024-04-20T12:33:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_completed_events", 2024-04-20T12:33:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "50", 2024-04-20T12:33:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.325 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "number of past completed events to remember", 2024-04-20T12:33:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: "sleep_interval": { 2024-04-20T12:33:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "sleep_interval", 2024-04-20T12:33:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "5", 2024-04-20T12:33:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "how long the module is going to sleep", 2024-04-20T12:33:36.326 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "prometheus", 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: "cache": { 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "cache", 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.327 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.328 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.328 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.328 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.328 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.328 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.328 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.328 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.328 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.328 INFO:teuthology.orchestra.run.smithi135.stdout: "exclude_perf_counters": { 2024-04-20T12:33:36.328 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "exclude_perf_counters", 2024-04-20T12:33:36.328 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.328 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.328 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.328 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.328 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.329 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.331 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.331 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.331 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.331 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.331 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.331 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.331 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.331 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.331 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.331 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.331 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.331 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.331 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.331 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.332 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.332 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.332 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.332 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.332 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.332 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.332 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.332 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.332 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.332 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.332 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.332 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.332 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.332 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.332 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.333 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.333 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.333 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.333 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.333 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.333 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.333 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.333 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.333 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.333 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.333 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.333 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.333 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.334 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.334 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.334 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools": { 2024-04-20T12:33:36.334 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools", 2024-04-20T12:33:36.334 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.334 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.334 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.334 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.334 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.334 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.334 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.334 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.334 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.334 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_stats_pools_refresh_interval": { 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "300", 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: "scrape_interval": { 2024-04-20T12:33:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "scrape_interval", 2024-04-20T12:33:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15.0", 2024-04-20T12:33:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.336 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-04-20T12:33:36.337 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-04-20T12:33:36.337 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.337 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.337 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.337 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "::", 2024-04-20T12:33:36.337 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.337 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.337 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.337 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-04-20T12:33:36.337 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.337 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.337 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.337 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-04-20T12:33:36.338 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-04-20T12:33:36.338 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.338 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.338 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.338 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "9283", 2024-04-20T12:33:36.338 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.338 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.338 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.338 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-04-20T12:33:36.338 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.338 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.338 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.338 INFO:teuthology.orchestra.run.smithi135.stdout: "stale_cache_strategy": { 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stale_cache_strategy", 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "log", 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_behaviour": { 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_behaviour", 2024-04-20T12:33:36.339 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.340 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.340 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.340 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "default", 2024-04-20T12:33:36.340 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.340 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.340 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.340 INFO:teuthology.orchestra.run.smithi135.stdout: "default", 2024-04-20T12:33:36.340 INFO:teuthology.orchestra.run.smithi135.stdout: "error" 2024-04-20T12:33:36.340 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.340 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.340 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.340 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.340 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.340 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.340 INFO:teuthology.orchestra.run.smithi135.stdout: "standby_error_status_code": { 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "standby_error_status_code", 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "500", 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "400", 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "599", 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.341 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.342 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_support", 2024-04-20T12:33:36.342 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.342 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.342 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.342 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.342 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.342 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.342 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.342 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.342 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.342 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.342 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.342 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.342 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.342 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.343 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.343 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.343 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.343 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.343 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.343 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.343 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.343 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.343 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.343 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.343 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.343 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.343 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.343 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.344 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.345 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.345 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.345 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.345 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.345 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.345 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.345 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.345 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.345 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.345 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.345 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.345 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.345 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.345 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.346 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.346 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.346 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.346 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.346 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.346 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.346 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.346 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.346 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.346 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.346 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.346 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.346 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.346 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_snap_create": { 2024-04-20T12:33:36.346 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_snap_create", 2024-04-20T12:33:36.347 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.347 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.347 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.347 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10", 2024-04-20T12:33:36.347 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.347 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.347 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.347 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.347 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.347 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.347 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.347 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.347 INFO:teuthology.orchestra.run.smithi135.stdout: "mirror_snapshot_schedule": { 2024-04-20T12:33:36.347 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "mirror_snapshot_schedule", 2024-04-20T12:33:36.347 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: "trash_purge_schedule": { 2024-04-20T12:33:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "trash_purge_schedule", 2024-04-20T12:33:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.348 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.349 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.349 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.349 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.349 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.349 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.349 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.349 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.349 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.349 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.349 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.349 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.349 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.349 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "restful", 2024-04-20T12:33:36.349 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.350 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.350 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.350 INFO:teuthology.orchestra.run.smithi135.stdout: "enable_auth": { 2024-04-20T12:33:36.350 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enable_auth", 2024-04-20T12:33:36.350 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.350 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.350 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.350 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.350 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.350 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.350 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.350 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.350 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.350 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.350 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: "key_file": { 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "key_file", 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.351 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.352 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.352 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.352 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.352 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.352 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.352 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.352 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.352 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.352 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.352 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.352 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.352 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.352 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.352 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.352 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.353 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.354 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.354 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.354 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.354 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.354 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.354 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.354 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.354 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.354 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.354 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.354 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.354 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.354 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.354 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.355 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.355 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.355 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.355 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.355 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.355 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.355 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.355 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.355 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.355 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.355 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.355 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.355 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.355 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: "server_addr": { 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_addr", 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.356 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: "server_port": { 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "server_port", 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.357 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.358 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.358 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.358 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.358 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.358 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.358 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.358 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rgw", 2024-04-20T12:33:36.358 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.358 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.358 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.358 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.358 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.358 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.358 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.359 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.360 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.360 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.360 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.360 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.360 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.360 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.360 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.360 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.360 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.360 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.360 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.360 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.360 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.361 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.362 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.362 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.362 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.362 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.362 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.362 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.362 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.362 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.362 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.362 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.362 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.362 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.362 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.362 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.362 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.363 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.363 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.363 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.363 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.363 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.363 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.363 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.363 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.363 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rook", 2024-04-20T12:33:36.363 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.363 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.363 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.363 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.364 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.364 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.364 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.364 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.364 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.364 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.364 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.364 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.364 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.364 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.364 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.364 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.364 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.364 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.364 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.365 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.365 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.365 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.365 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.365 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.365 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.365 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.365 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.365 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.365 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.365 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.365 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.365 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.365 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.366 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.367 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.367 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.367 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.367 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.367 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.367 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.367 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.367 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.367 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.367 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.367 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.367 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.367 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.367 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.367 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.368 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.368 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.368 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.368 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.368 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.368 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.368 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.368 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.368 INFO:teuthology.orchestra.run.smithi135.stdout: "storage_class": { 2024-04-20T12:33:36.368 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "storage_class", 2024-04-20T12:33:36.368 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.368 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.368 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.368 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "local", 2024-04-20T12:33:36.368 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-04-20T12:33:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "selftest", 2024-04-20T12:33:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.369 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.370 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.370 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.370 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.370 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.370 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.370 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.370 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.370 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.370 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.370 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.370 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.370 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.370 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.370 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.371 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.372 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.372 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.372 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.372 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.372 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.372 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.372 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.372 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.372 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.372 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.372 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.372 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.372 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.372 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.373 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: "roption1": { 2024-04-20T12:33:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption1", 2024-04-20T12:33:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.374 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: "roption2": { 2024-04-20T12:33:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "roption2", 2024-04-20T12:33:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.375 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "xyz", 2024-04-20T12:33:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption1": { 2024-04-20T12:33:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption1", 2024-04-20T12:33:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.376 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption2": { 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption2", 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.377 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.378 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.378 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.378 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.378 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.378 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption3": { 2024-04-20T12:33:36.378 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption3", 2024-04-20T12:33:36.378 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "float", 2024-04-20T12:33:36.378 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.378 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.378 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.378 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.378 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.378 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.378 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.379 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.379 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.379 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.379 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.379 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption4": { 2024-04-20T12:33:36.379 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption4", 2024-04-20T12:33:36.379 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.379 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.379 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.379 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.379 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.379 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.379 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.379 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.379 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption5": { 2024-04-20T12:33:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption5", 2024-04-20T12:33:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.380 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption6": { 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption6", 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.381 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.382 INFO:teuthology.orchestra.run.smithi135.stdout: "rwoption7": { 2024-04-20T12:33:36.382 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rwoption7", 2024-04-20T12:33:36.382 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.382 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.382 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.382 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.382 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "1", 2024-04-20T12:33:36.382 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "42", 2024-04-20T12:33:36.382 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.382 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.382 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.382 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.382 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.382 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: "testkey": { 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testkey", 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: "testlkey": { 2024-04-20T12:33:36.383 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testlkey", 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: "testnewline": { 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "testnewline", 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.384 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.385 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.385 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.385 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.385 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.385 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.385 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.385 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.385 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.385 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.385 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.385 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.385 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.385 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.385 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snap_schedule", 2024-04-20T12:33:36.385 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.386 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.386 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.386 INFO:teuthology.orchestra.run.smithi135.stdout: "allow_m_granularity": { 2024-04-20T12:33:36.386 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "allow_m_granularity", 2024-04-20T12:33:36.386 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.386 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.386 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.386 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.386 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.386 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.386 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.386 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "allow minute scheduled snapshots", 2024-04-20T12:33:36.386 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.386 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.386 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.387 INFO:teuthology.orchestra.run.smithi135.stdout: "dump_on_update": { 2024-04-20T12:33:36.387 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "dump_on_update", 2024-04-20T12:33:36.387 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.387 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.387 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.387 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.387 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.387 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.387 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.387 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "dump database to debug log on update", 2024-04-20T12:33:36.387 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.387 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.387 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.387 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.388 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.389 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.389 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.389 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.389 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.389 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.389 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.389 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.389 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.389 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.389 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.389 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.389 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.389 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.389 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.389 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.390 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.390 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.390 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.390 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.390 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.390 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.390 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.390 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.390 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.390 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.390 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.390 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.390 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.390 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.391 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.392 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.392 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.392 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.392 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.392 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.392 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.392 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.392 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.392 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.392 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.392 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.392 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "stats", 2024-04-20T12:33:36.392 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.392 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.392 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.393 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.393 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.393 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.393 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.393 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.393 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.393 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.393 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.393 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.393 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.393 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.393 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.393 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.393 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.393 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.394 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.394 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.394 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.394 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.394 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.394 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.394 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.394 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.394 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.394 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.394 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.394 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.394 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.394 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.394 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.395 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.395 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.395 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.395 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.395 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.395 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.395 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.395 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.395 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.395 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.395 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.395 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.395 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.395 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.395 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.396 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.397 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.397 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.397 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.397 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.397 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.397 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.397 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.397 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.397 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.397 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.397 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.397 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.397 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.397 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "status", 2024-04-20T12:33:36.397 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.398 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.398 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.398 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.398 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.398 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.398 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.398 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.398 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.398 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.398 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.398 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.398 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.398 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.398 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.398 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.399 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.399 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.399 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.399 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.399 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.399 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.399 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.399 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.399 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.399 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.399 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.399 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.399 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.399 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.399 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.400 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.400 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.400 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.400 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.400 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.400 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.400 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.400 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.400 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.400 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.400 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.400 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.400 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.400 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.400 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.401 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.401 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.401 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.401 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.401 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.401 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.401 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.401 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.401 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.401 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.401 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.401 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.401 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.401 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.402 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.403 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telegraf", 2024-04-20T12:33:36.403 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.403 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.403 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.403 INFO:teuthology.orchestra.run.smithi135.stdout: "address": { 2024-04-20T12:33:36.403 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "address", 2024-04-20T12:33:36.403 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.403 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.403 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.403 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-04-20T12:33:36.403 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.403 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.403 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.403 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.404 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.404 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.404 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.404 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.404 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-04-20T12:33:36.404 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-04-20T12:33:36.404 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.404 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.404 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.404 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "15", 2024-04-20T12:33:36.404 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.404 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.404 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.404 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.404 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.405 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.405 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.405 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.405 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.405 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.405 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.405 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.405 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.405 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.405 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.405 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.405 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.405 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.405 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.405 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.406 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.406 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.406 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.406 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.406 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.406 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.406 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.406 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.406 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.406 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.406 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.406 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.406 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.406 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.406 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.407 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.408 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.408 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.408 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.408 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.408 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.408 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.408 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.408 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.408 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.408 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.408 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.408 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.408 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.408 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.408 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.409 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "telemetry", 2024-04-20T12:33:36.410 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.410 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.410 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.410 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_basic": { 2024-04-20T12:33:36.410 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_basic", 2024-04-20T12:33:36.410 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.410 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.410 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.410 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.410 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.410 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.410 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.410 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share basic cluster information (size, version)", 2024-04-20T12:33:36.410 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.410 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.411 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.411 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_crash": { 2024-04-20T12:33:36.411 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_crash", 2024-04-20T12:33:36.411 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.411 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.411 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.411 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.411 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.411 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.411 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.411 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-04-20T12:33:36.411 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.411 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.412 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.412 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_device": { 2024-04-20T12:33:36.412 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_device", 2024-04-20T12:33:36.412 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.412 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.412 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.412 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.412 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.412 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.412 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.412 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-04-20T12:33:36.412 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.412 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.412 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.413 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_ident": { 2024-04-20T12:33:36.413 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_ident", 2024-04-20T12:33:36.413 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.413 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.413 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.413 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.413 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.413 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.413 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.413 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-04-20T12:33:36.413 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.413 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.413 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.414 INFO:teuthology.orchestra.run.smithi135.stdout: "channel_perf": { 2024-04-20T12:33:36.414 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "channel_perf", 2024-04-20T12:33:36.414 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.414 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.414 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.414 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.414 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.414 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.414 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.414 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Share various performance metrics of a cluster", 2024-04-20T12:33:36.414 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.414 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.414 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.415 INFO:teuthology.orchestra.run.smithi135.stdout: "contact": { 2024-04-20T12:33:36.415 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "contact", 2024-04-20T12:33:36.415 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.415 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.415 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.415 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.415 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.415 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.415 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.415 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.415 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.415 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.415 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.415 INFO:teuthology.orchestra.run.smithi135.stdout: "description": { 2024-04-20T12:33:36.416 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "description", 2024-04-20T12:33:36.416 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.416 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.416 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.416 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.416 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.416 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.416 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.416 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.416 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.416 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.416 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.416 INFO:teuthology.orchestra.run.smithi135.stdout: "device_url": { 2024-04-20T12:33:36.416 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "device_url", 2024-04-20T12:33:36.417 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.417 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.417 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.417 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-04-20T12:33:36.417 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.417 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.417 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.417 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.417 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.417 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.417 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.417 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.417 INFO:teuthology.orchestra.run.smithi135.stdout: "enabled": { 2024-04-20T12:33:36.417 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "enabled", 2024-04-20T12:33:36.417 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-04-20T12:33:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-04-20T12:33:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.418 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.419 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.419 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "24", 2024-04-20T12:33:36.419 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "8", 2024-04-20T12:33:36.419 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.419 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.419 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.419 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.419 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.419 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.419 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.419 INFO:teuthology.orchestra.run.smithi135.stdout: "last_opt_revision": { 2024-04-20T12:33:36.419 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "last_opt_revision", 2024-04-20T12:33:36.419 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.419 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.419 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.420 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "1", 2024-04-20T12:33:36.420 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.420 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.420 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.420 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.420 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.420 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.420 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.420 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard": { 2024-04-20T12:33:36.420 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard", 2024-04-20T12:33:36.420 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.420 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.420 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.420 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.421 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.421 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.421 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.421 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.421 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.421 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.421 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.421 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.421 INFO:teuthology.orchestra.run.smithi135.stdout: "leaderboard_description": { 2024-04-20T12:33:36.421 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "leaderboard_description", 2024-04-20T12:33:36.421 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.421 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.421 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.421 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.421 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.422 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.423 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.424 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.424 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.424 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.424 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.424 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.424 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.424 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.424 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.424 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.424 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.424 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.424 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.424 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.425 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.425 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.425 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.425 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.425 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.425 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.425 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.425 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.425 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.425 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.426 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.426 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.426 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.426 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.426 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.426 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.426 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.426 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.426 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.426 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.427 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.427 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.427 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.427 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.427 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.427 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.427 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.427 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.427 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.427 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.428 INFO:teuthology.orchestra.run.smithi135.stdout: "organization": { 2024-04-20T12:33:36.428 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "organization", 2024-04-20T12:33:36.428 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.428 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.428 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.428 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.428 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.428 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.428 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.428 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.428 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.428 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.428 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: "proxy": { 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "proxy", 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: "url": { 2024-04-20T12:33:36.429 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "url", 2024-04-20T12:33:36.430 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.430 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.430 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.430 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-04-20T12:33:36.430 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.430 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.430 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.430 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.430 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.430 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.430 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.430 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.430 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.431 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.431 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "test_orchestrator", 2024-04-20T12:33:36.431 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.431 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.431 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.431 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.431 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.431 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.431 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.431 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.431 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.431 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.431 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.431 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.431 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.432 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.434 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.434 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.434 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.434 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.434 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.434 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.434 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.434 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.434 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.434 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.434 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.434 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.434 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.434 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.435 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.436 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.436 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "volumes", 2024-04-20T12:33:36.436 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.436 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.436 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.436 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.436 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.436 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.436 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.436 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.436 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.436 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.436 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.436 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.437 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.438 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.438 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.438 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.438 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.438 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.438 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.438 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.438 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.438 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.438 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.438 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.438 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.438 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.438 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "max_concurrent_clones": { 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "max_concurrent_clones", 2024-04-20T12:33:36.440 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.441 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.441 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.441 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "4", 2024-04-20T12:33:36.441 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.441 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.441 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.441 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Number of asynchronous cloner threads", 2024-04-20T12:33:36.441 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.441 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.441 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.441 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.441 INFO:teuthology.orchestra.run.smithi135.stdout: "periodic_async_work": { 2024-04-20T12:33:36.441 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "periodic_async_work", 2024-04-20T12:33:36.441 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.441 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.442 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.442 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.442 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.442 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.442 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.442 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Periodically check for async work", 2024-04-20T12:33:36.442 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.442 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.442 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.442 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.442 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_delay": { 2024-04-20T12:33:36.442 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_delay", 2024-04-20T12:33:36.442 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.442 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.442 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "0", 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: "snapshot_clone_no_wait": { 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snapshot_clone_no_wait", 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "True", 2024-04-20T12:33:36.443 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.444 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.444 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.444 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-04-20T12:33:36.444 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.444 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.444 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.444 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.444 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.444 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.444 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix", 2024-04-20T12:33:36.444 INFO:teuthology.orchestra.run.smithi135.stdout: "can_run": true, 2024-04-20T12:33:36.444 INFO:teuthology.orchestra.run.smithi135.stdout: "error_string": "", 2024-04-20T12:33:36.444 INFO:teuthology.orchestra.run.smithi135.stdout: "module_options": { 2024-04-20T12:33:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: "discovery_interval": { 2024-04-20T12:33:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "discovery_interval", 2024-04-20T12:33:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "uint", 2024-04-20T12:33:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "100", 2024-04-20T12:33:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.445 INFO:teuthology.orchestra.run.smithi135.stdout: "identifier": { 2024-04-20T12:33:36.446 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "identifier", 2024-04-20T12:33:36.446 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.446 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.446 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.446 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.446 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.446 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.446 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.446 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.446 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.446 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.446 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.446 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.446 INFO:teuthology.orchestra.run.smithi135.stdout: "interval": { 2024-04-20T12:33:36.446 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "interval", 2024-04-20T12:33:36.447 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "secs", 2024-04-20T12:33:36.447 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.447 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.447 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "60", 2024-04-20T12:33:36.447 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.447 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.447 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.447 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.447 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.447 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.447 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.447 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.447 INFO:teuthology.orchestra.run.smithi135.stdout: "log_level": { 2024-04-20T12:33:36.447 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_level", 2024-04-20T12:33:36.447 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.448 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.448 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.448 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.448 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.448 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.448 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.448 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.448 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.448 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.448 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.448 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.448 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.448 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.448 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster": { 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster", 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.449 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.450 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.450 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_cluster_level": { 2024-04-20T12:33:36.450 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_cluster_level", 2024-04-20T12:33:36.450 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.450 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.450 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.450 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "info", 2024-04-20T12:33:36.450 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.450 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.450 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [ 2024-04-20T12:33:36.450 INFO:teuthology.orchestra.run.smithi135.stdout: "", 2024-04-20T12:33:36.450 INFO:teuthology.orchestra.run.smithi135.stdout: "critical", 2024-04-20T12:33:36.450 INFO:teuthology.orchestra.run.smithi135.stdout: "debug", 2024-04-20T12:33:36.451 INFO:teuthology.orchestra.run.smithi135.stdout: "error", 2024-04-20T12:33:36.451 INFO:teuthology.orchestra.run.smithi135.stdout: "info", 2024-04-20T12:33:36.451 INFO:teuthology.orchestra.run.smithi135.stdout: "warning" 2024-04-20T12:33:36.451 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.451 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.451 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.451 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.451 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.451 INFO:teuthology.orchestra.run.smithi135.stdout: "log_to_file": { 2024-04-20T12:33:36.451 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "log_to_file", 2024-04-20T12:33:36.451 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "bool", 2024-04-20T12:33:36.451 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.451 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 1, 2024-04-20T12:33:36.451 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "False", 2024-04-20T12:33:36.452 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.452 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.452 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.452 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.452 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.452 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.452 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.452 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.452 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_host": { 2024-04-20T12:33:36.452 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_host", 2024-04-20T12:33:36.452 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.452 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.452 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.452 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "", 2024-04-20T12:33:36.452 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.453 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.453 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.453 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.453 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.453 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.453 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.453 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_port": { 2024-04-20T12:33:36.453 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_port", 2024-04-20T12:33:36.453 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "int", 2024-04-20T12:33:36.453 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.453 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.453 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "10051", 2024-04-20T12:33:36.453 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.453 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.454 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.454 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.454 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.454 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.454 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.454 INFO:teuthology.orchestra.run.smithi135.stdout: "zabbix_sender": { 2024-04-20T12:33:36.454 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "zabbix_sender", 2024-04-20T12:33:36.454 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "str", 2024-04-20T12:33:36.454 INFO:teuthology.orchestra.run.smithi135.stdout: "level": "advanced", 2024-04-20T12:33:36.454 INFO:teuthology.orchestra.run.smithi135.stdout: "flags": 0, 2024-04-20T12:33:36.454 INFO:teuthology.orchestra.run.smithi135.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-04-20T12:33:36.454 INFO:teuthology.orchestra.run.smithi135.stdout: "min": "", 2024-04-20T12:33:36.454 INFO:teuthology.orchestra.run.smithi135.stdout: "max": "", 2024-04-20T12:33:36.454 INFO:teuthology.orchestra.run.smithi135.stdout: "enum_allowed": [], 2024-04-20T12:33:36.455 INFO:teuthology.orchestra.run.smithi135.stdout: "desc": "", 2024-04-20T12:33:36.455 INFO:teuthology.orchestra.run.smithi135.stdout: "long_desc": "", 2024-04-20T12:33:36.455 INFO:teuthology.orchestra.run.smithi135.stdout: "tags": [], 2024-04-20T12:33:36.455 INFO:teuthology.orchestra.run.smithi135.stdout: "see_also": [] 2024-04-20T12:33:36.455 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.455 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.455 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.455 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.455 INFO:teuthology.orchestra.run.smithi135.stdout: "services": { 2024-04-20T12:33:36.455 INFO:teuthology.orchestra.run.smithi135.stdout: "dashboard": "https://172.21.15.135:8443/" 2024-04-20T12:33:36.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.455 INFO:teuthology.orchestra.run.smithi135.stdout: "always_on_modules": { 2024-04-20T12:33:36.455 INFO:teuthology.orchestra.run.smithi135.stdout: "octopus": [ 2024-04-20T12:33:36.455 INFO:teuthology.orchestra.run.smithi135.stdout: "balancer", 2024-04-20T12:33:36.455 INFO:teuthology.orchestra.run.smithi135.stdout: "crash", 2024-04-20T12:33:36.456 INFO:teuthology.orchestra.run.smithi135.stdout: "devicehealth", 2024-04-20T12:33:36.456 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator", 2024-04-20T12:33:36.456 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_autoscaler", 2024-04-20T12:33:36.456 INFO:teuthology.orchestra.run.smithi135.stdout: "progress", 2024-04-20T12:33:36.456 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_support", 2024-04-20T12:33:36.456 INFO:teuthology.orchestra.run.smithi135.stdout: "status", 2024-04-20T12:33:36.456 INFO:teuthology.orchestra.run.smithi135.stdout: "telemetry", 2024-04-20T12:33:36.456 INFO:teuthology.orchestra.run.smithi135.stdout: "volumes" 2024-04-20T12:33:36.456 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.456 INFO:teuthology.orchestra.run.smithi135.stdout: "pacific": [ 2024-04-20T12:33:36.456 INFO:teuthology.orchestra.run.smithi135.stdout: "balancer", 2024-04-20T12:33:36.456 INFO:teuthology.orchestra.run.smithi135.stdout: "crash", 2024-04-20T12:33:36.456 INFO:teuthology.orchestra.run.smithi135.stdout: "devicehealth", 2024-04-20T12:33:36.456 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator", 2024-04-20T12:33:36.456 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_autoscaler", 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: "progress", 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_support", 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: "status", 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: "telemetry", 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: "volumes" 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: "quincy": [ 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: "balancer", 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: "crash", 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: "devicehealth", 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator", 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_autoscaler", 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: "progress", 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_support", 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: "status", 2024-04-20T12:33:36.457 INFO:teuthology.orchestra.run.smithi135.stdout: "telemetry", 2024-04-20T12:33:36.458 INFO:teuthology.orchestra.run.smithi135.stdout: "volumes" 2024-04-20T12:33:36.458 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.458 INFO:teuthology.orchestra.run.smithi135.stdout: "reef": [ 2024-04-20T12:33:36.458 INFO:teuthology.orchestra.run.smithi135.stdout: "balancer", 2024-04-20T12:33:36.458 INFO:teuthology.orchestra.run.smithi135.stdout: "crash", 2024-04-20T12:33:36.458 INFO:teuthology.orchestra.run.smithi135.stdout: "devicehealth", 2024-04-20T12:33:36.458 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator", 2024-04-20T12:33:36.458 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_autoscaler", 2024-04-20T12:33:36.458 INFO:teuthology.orchestra.run.smithi135.stdout: "progress", 2024-04-20T12:33:36.458 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_support", 2024-04-20T12:33:36.458 INFO:teuthology.orchestra.run.smithi135.stdout: "status", 2024-04-20T12:33:36.458 INFO:teuthology.orchestra.run.smithi135.stdout: "telemetry", 2024-04-20T12:33:36.458 INFO:teuthology.orchestra.run.smithi135.stdout: "volumes" 2024-04-20T12:33:36.458 INFO:teuthology.orchestra.run.smithi135.stdout: ], 2024-04-20T12:33:36.458 INFO:teuthology.orchestra.run.smithi135.stdout: "squid": [ 2024-04-20T12:33:36.459 INFO:teuthology.orchestra.run.smithi135.stdout: "balancer", 2024-04-20T12:33:36.459 INFO:teuthology.orchestra.run.smithi135.stdout: "crash", 2024-04-20T12:33:36.459 INFO:teuthology.orchestra.run.smithi135.stdout: "devicehealth", 2024-04-20T12:33:36.459 INFO:teuthology.orchestra.run.smithi135.stdout: "orchestrator", 2024-04-20T12:33:36.459 INFO:teuthology.orchestra.run.smithi135.stdout: "pg_autoscaler", 2024-04-20T12:33:36.459 INFO:teuthology.orchestra.run.smithi135.stdout: "progress", 2024-04-20T12:33:36.459 INFO:teuthology.orchestra.run.smithi135.stdout: "rbd_support", 2024-04-20T12:33:36.459 INFO:teuthology.orchestra.run.smithi135.stdout: "status", 2024-04-20T12:33:36.459 INFO:teuthology.orchestra.run.smithi135.stdout: "telemetry", 2024-04-20T12:33:36.459 INFO:teuthology.orchestra.run.smithi135.stdout: "volumes" 2024-04-20T12:33:36.459 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-04-20T12:33:36.459 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.459 INFO:teuthology.orchestra.run.smithi135.stdout: "last_failure_osd_epoch": 95, 2024-04-20T12:33:36.459 INFO:teuthology.orchestra.run.smithi135.stdout: "active_clients": [ 2024-04-20T12:33:36.459 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "devicehealth", 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 1885280884 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "libcephsqlite", 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-04-20T12:33:36.460 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 1096415801 2024-04-20T12:33:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-04-20T12:33:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "rbd_support", 2024-04-20T12:33:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-04-20T12:33:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-04-20T12:33:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-04-20T12:33:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 2589937619 2024-04-20T12:33:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-04-20T12:33:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.461 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snap_schedule", 2024-04-20T12:33:36.462 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-04-20T12:33:36.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.462 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-04-20T12:33:36.462 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-04-20T12:33:36.462 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 2143457951 2024-04-20T12:33:36.462 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.462 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-04-20T12:33:36.462 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.462 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "snap_schedule", 2024-04-20T12:33:36.462 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-04-20T12:33:36.462 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.462 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-04-20T12:33:36.462 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-04-20T12:33:36.462 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 3445369434 2024-04-20T12:33:36.463 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.463 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-04-20T12:33:36.463 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:36.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.463 INFO:teuthology.orchestra.run.smithi135.stdout: "name": "volumes", 2024-04-20T12:33:36.463 INFO:teuthology.orchestra.run.smithi135.stdout: "addrvec": [ 2024-04-20T12:33:36.463 INFO:teuthology.orchestra.run.smithi135.stdout: { 2024-04-20T12:33:36.463 INFO:teuthology.orchestra.run.smithi135.stdout: "type": "v2", 2024-04-20T12:33:36.463 INFO:teuthology.orchestra.run.smithi135.stdout: "addr": "172.21.15.135:0", 2024-04-20T12:33:36.463 INFO:teuthology.orchestra.run.smithi135.stdout: "nonce": 744578653 2024-04-20T12:33:36.463 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.463 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-04-20T12:33:36.463 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:36.463 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-04-20T12:33:36.463 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:33:36.469 DEBUG:tasks.check_counter:Getting stats from a 2024-04-20T12:33:36.470 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph daemon mds.a perf dump 2024-04-20T12:33:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:35 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1945768642' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:33:36.470 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:35 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2082138201' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-20T12:33:36.471 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:35 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1945768642' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:33:36.471 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:35 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2082138201' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-20T12:33:36.471 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:35 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1945768642' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:33:36.471 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:35 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2082138201' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-04-20T12:33:36.719 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:33:36.841 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:36 smithi135 ceph-mon[18264]: pgmap v325: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:37.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:36 smithi154 ceph-mon[22073]: pgmap v325: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:37.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:36 smithi139 ceph-mon[21834]: pgmap v325: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:38.648 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:33:38.648 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-04-20T12:33:38.648 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1263, 2024-04-20T12:33:38.648 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1085, 2024-04-20T12:33:38.648 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 1936339, 2024-04-20T12:33:38.648 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 551660, 2024-04-20T12:33:38.648 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 11, 2024-04-20T12:33:38.648 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 4, 2024-04-20T12:33:38.649 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.137120091, 2024-04-20T12:33:38.649 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.051667477, 2024-04-20T12:33:38.649 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.092285343, 2024-04-20T12:33:38.649 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.009354271, 2024-04-20T12:33:38.649 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:38.649 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1085, 2024-04-20T12:33:38.649 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.047581190, 2024-04-20T12:33:38.649 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000043853 2024-04-20T12:33:38.649 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.650 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:38.650 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1753, 2024-04-20T12:33:38.650 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000401927, 2024-04-20T12:33:38.650 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000229 2024-04-20T12:33:38.650 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.650 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1647216, 2024-04-20T12:33:38.651 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 147376 2024-04-20T12:33:38.651 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.651 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-04-20T12:33:38.651 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 66, 2024-04-20T12:33:38.651 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 102, 2024-04-20T12:33:38.651 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 12715, 2024-04-20T12:33:38.651 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 615624, 2024-04-20T12:33:38.651 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 51, 2024-04-20T12:33:38.651 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 7, 2024-04-20T12:33:38.651 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.024595606, 2024-04-20T12:33:38.651 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.005292617, 2024-04-20T12:33:38.651 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.016636783, 2024-04-20T12:33:38.651 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000278259, 2024-04-20T12:33:38.651 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:38.652 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 99, 2024-04-20T12:33:38.652 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.024458824, 2024-04-20T12:33:38.652 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000247058 2024-04-20T12:33:38.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.652 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:38.652 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 65, 2024-04-20T12:33:38.652 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000009216, 2024-04-20T12:33:38.652 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000141 2024-04-20T12:33:38.652 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.652 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-04-20T12:33:38.652 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 134384 2024-04-20T12:33:38.653 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.653 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-04-20T12:33:38.653 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 31, 2024-04-20T12:33:38.653 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 188, 2024-04-20T12:33:38.653 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 6792, 2024-04-20T12:33:38.653 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 331627, 2024-04-20T12:33:38.653 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 8, 2024-04-20T12:33:38.653 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 6, 2024-04-20T12:33:38.653 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.022513633, 2024-04-20T12:33:38.653 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.014726270, 2024-04-20T12:33:38.653 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.005738558, 2024-04-20T12:33:38.653 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000388072, 2024-04-20T12:33:38.653 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:38.653 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 186, 2024-04-20T12:33:38.654 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.029444978, 2024-04-20T12:33:38.654 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000158306 2024-04-20T12:33:38.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.654 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:38.654 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 38, 2024-04-20T12:33:38.654 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000024890, 2024-04-20T12:33:38.654 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000655 2024-04-20T12:33:38.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.654 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-20T12:33:38.654 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 315472 2024-04-20T12:33:38.654 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.654 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-04-20T12:33:38.654 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-04-20T12:33:38.655 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-04-20T12:33:38.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.655 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-04-20T12:33:38.655 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-04-20T12:33:38.655 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-04-20T12:33:38.655 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 55, 2024-04-20T12:33:38.655 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.001693856, 2024-04-20T12:33:38.655 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000030797 2024-04-20T12:33:38.655 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:38.655 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.655 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-04-20T12:33:38.655 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-04-20T12:33:38.655 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-04-20T12:33:38.655 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2, 2024-04-20T12:33:38.656 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000013633, 2024-04-20T12:33:38.656 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000006816 2024-04-20T12:33:38.656 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:38.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.656 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-04-20T12:33:38.656 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 9, 2024-04-20T12:33:38.656 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 7, 2024-04-20T12:33:38.656 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-04-20T12:33:38.656 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 7, 2024-04-20T12:33:38.656 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.003761528, 2024-04-20T12:33:38.656 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000537361 2024-04-20T12:33:38.656 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.656 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-04-20T12:33:38.656 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 2, 2024-04-20T12:33:38.657 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2024-04-20T12:33:38.657 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-04-20T12:33:38.657 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 11, 2024-04-20T12:33:38.657 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-04-20T12:33:38.657 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-04-20T12:33:38.657 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 17, 2024-04-20T12:33:38.658 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 1, 2024-04-20T12:33:38.658 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 16, 2024-04-20T12:33:38.658 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 0, 2024-04-20T12:33:38.658 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 13, 2024-04-20T12:33:38.658 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 9, 2024-04-20T12:33:38.658 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 1, 2024-04-20T12:33:38.659 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 1, 2024-04-20T12:33:38.659 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 3, 2024-04-20T12:33:38.659 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 20, 2024-04-20T12:33:38.659 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 14, 2024-04-20T12:33:38.659 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 1, 2024-04-20T12:33:38.659 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 3, 2024-04-20T12:33:38.659 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-04-20T12:33:38.660 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-04-20T12:33:38.660 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2024-04-20T12:33:38.660 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2024-04-20T12:33:38.660 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-04-20T12:33:38.660 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2024-04-20T12:33:38.661 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2024-04-20T12:33:38.661 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2024-04-20T12:33:38.661 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2024-04-20T12:33:38.661 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-04-20T12:33:38.661 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2024-04-20T12:33:38.661 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-04-20T12:33:38.661 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 4, 2024-04-20T12:33:38.661 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 234, 2024-04-20T12:33:38.661 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 6, 2024-04-20T12:33:38.661 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2024-04-20T12:33:38.661 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-04-20T12:33:38.662 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-04-20T12:33:38.662 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-04-20T12:33:38.662 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2024-04-20T12:33:38.662 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-04-20T12:33:38.662 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2024-04-20T12:33:38.662 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2024-04-20T12:33:38.662 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2024-04-20T12:33:38.662 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2024-04-20T12:33:38.662 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2024-04-20T12:33:38.662 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-04-20T12:33:38.662 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-20T12:33:38.663 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-20T12:33:38.663 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2024-04-20T12:33:38.663 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2024-04-20T12:33:38.663 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2024-04-20T12:33:38.663 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2024-04-20T12:33:38.663 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.663 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-04-20T12:33:38.663 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2024-04-20T12:33:38.663 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 10, 2024-04-20T12:33:38.663 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 6, 2024-04-20T12:33:38.663 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 8, 2024-04-20T12:33:38.663 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2024-04-20T12:33:38.663 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-04-20T12:33:38.663 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-04-20T12:33:38.664 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-04-20T12:33:38.664 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2024-04-20T12:33:38.664 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2024-04-20T12:33:38.664 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-04-20T12:33:38.664 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-04-20T12:33:38.664 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-04-20T12:33:38.664 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-04-20T12:33:38.664 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-04-20T12:33:38.664 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-04-20T12:33:38.664 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-04-20T12:33:38.664 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 0, 2024-04-20T12:33:38.664 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 0, 2024-04-20T12:33:38.664 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-04-20T12:33:38.664 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2024-04-20T12:33:38.664 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-04-20T12:33:38.665 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-04-20T12:33:38.665 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-04-20T12:33:38.665 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2024-04-20T12:33:38.665 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.665 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-04-20T12:33:38.665 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-04-20T12:33:38.665 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 10, 2024-04-20T12:33:38.665 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-04-20T12:33:38.665 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-04-20T12:33:38.665 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 10, 2024-04-20T12:33:38.665 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-04-20T12:33:38.665 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-04-20T12:33:38.665 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 2, 2024-04-20T12:33:38.665 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-04-20T12:33:38.666 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-04-20T12:33:38.666 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 2, 2024-04-20T12:33:38.666 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 2, 2024-04-20T12:33:38.666 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-04-20T12:33:38.666 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-04-20T12:33:38.666 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2024-04-20T12:33:38.666 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 4197187, 2024-04-20T12:33:38.666 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 0, 2024-04-20T12:33:38.666 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-04-20T12:33:38.666 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 9, 2024-04-20T12:33:38.666 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.018876889, 2024-04-20T12:33:38.666 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002097432 2024-04-20T12:33:38.666 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.666 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 0 2024-04-20T12:33:38.667 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.667 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-04-20T12:33:38.667 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 21, 2024-04-20T12:33:38.667 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 27, 2024-04-20T12:33:38.667 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 6, 2024-04-20T12:33:38.667 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 20, 2024-04-20T12:33:38.667 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 25, 2024-04-20T12:33:38.667 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 5, 2024-04-20T12:33:38.667 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 17, 2024-04-20T12:33:38.667 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 26, 2024-04-20T12:33:38.667 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 9, 2024-04-20T12:33:38.667 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 1, 2024-04-20T12:33:38.667 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 6, 2024-04-20T12:33:38.667 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 5, 2024-04-20T12:33:38.668 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 51908, 2024-04-20T12:33:38.668 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 223608 2024-04-20T12:33:38.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.668 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-04-20T12:33:38.668 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 13, 2024-04-20T12:33:38.668 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2024-04-20T12:33:38.668 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 9, 2024-04-20T12:33:38.668 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 29, 2024-04-20T12:33:38.668 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 1, 2024-04-20T12:33:38.668 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-04-20T12:33:38.668 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.668 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.668 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.668 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.668 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-04-20T12:33:38.669 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2, 2024-04-20T12:33:38.669 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.002170157, 2024-04-20T12:33:38.669 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001085078 2024-04-20T12:33:38.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.669 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-04-20T12:33:38.669 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.669 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.669 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.669 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.669 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-04-20T12:33:38.669 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.669 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.670 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.670 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-04-20T12:33:38.670 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4, 2024-04-20T12:33:38.670 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.001469668, 2024-04-20T12:33:38.670 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000367417 2024-04-20T12:33:38.670 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.670 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-04-20T12:33:38.670 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.671 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.671 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.671 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-04-20T12:33:38.671 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1, 2024-04-20T12:33:38.671 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000121703, 2024-04-20T12:33:38.671 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000121703 2024-04-20T12:33:38.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.671 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-04-20T12:33:38.671 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.671 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.671 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.671 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.671 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-04-20T12:33:38.672 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.672 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.672 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.672 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-04-20T12:33:38.672 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.672 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.672 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.672 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-04-20T12:33:38.672 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.672 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.672 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.672 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.672 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-04-20T12:33:38.673 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.673 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.673 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.673 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.673 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-04-20T12:33:38.674 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.674 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.674 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.674 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-04-20T12:33:38.674 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.674 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.674 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.674 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.674 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-04-20T12:33:38.674 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.674 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.674 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.675 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-04-20T12:33:38.675 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.675 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.675 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.675 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-04-20T12:33:38.675 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.675 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.675 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.675 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.675 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-04-20T12:33:38.675 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.675 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.676 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.676 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-04-20T12:33:38.676 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.676 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.676 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.676 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-04-20T12:33:38.676 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.676 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.676 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.676 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.676 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-04-20T12:33:38.676 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.677 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.677 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.677 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-04-20T12:33:38.677 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.677 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.677 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.677 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-04-20T12:33:38.677 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.677 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.677 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.677 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.677 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-04-20T12:33:38.678 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.678 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.678 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.678 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-04-20T12:33:38.678 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.678 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.678 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.678 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.678 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-04-20T12:33:38.678 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.678 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.679 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.679 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-04-20T12:33:38.679 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.679 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.679 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.679 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-04-20T12:33:38.679 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.679 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.679 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.679 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.679 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-04-20T12:33:38.679 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.680 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.680 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.680 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-04-20T12:33:38.680 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-04-20T12:33:38.680 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-04-20T12:33:38.680 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.680 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.680 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.680 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:38.680 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.680 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-04-20T12:33:38.680 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 2, 2024-04-20T12:33:38.681 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 5, 2024-04-20T12:33:38.681 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 3, 2024-04-20T12:33:38.681 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 2, 2024-04-20T12:33:38.681 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-04-20T12:33:38.681 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 6, 2024-04-20T12:33:38.681 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 1, 2024-04-20T12:33:38.681 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 599, 2024-04-20T12:33:38.681 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-04-20T12:33:38.681 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.681 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-04-20T12:33:38.681 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-04-20T12:33:38.681 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-04-20T12:33:38.681 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-04-20T12:33:38.681 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-04-20T12:33:38.682 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-04-20T12:33:38.682 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-04-20T12:33:38.682 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-20T12:33:38.682 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-04-20T12:33:38.682 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-20T12:33:38.682 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-04-20T12:33:38.682 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-04-20T12:33:38.682 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-04-20T12:33:38.682 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-20T12:33:38.682 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-04-20T12:33:38.682 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-04-20T12:33:38.682 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-04-20T12:33:38.682 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-04-20T12:33:38.683 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-04-20T12:33:38.683 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-20T12:33:38.683 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-04-20T12:33:38.683 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-20T12:33:38.683 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-04-20T12:33:38.683 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-04-20T12:33:38.683 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-04-20T12:33:38.683 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-04-20T12:33:38.683 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-04-20T12:33:38.683 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-20T12:33:38.683 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-04-20T12:33:38.683 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-04-20T12:33:38.683 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-04-20T12:33:38.683 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-04-20T12:33:38.684 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-04-20T12:33:38.684 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-04-20T12:33:38.684 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-04-20T12:33:38.684 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-04-20T12:33:38.684 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-04-20T12:33:38.684 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 281029, 2024-04-20T12:33:38.684 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 111, 2024-04-20T12:33:38.684 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 88, 2024-04-20T12:33:38.684 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 1, 2024-04-20T12:33:38.684 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-04-20T12:33:38.684 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-04-20T12:33:38.684 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-04-20T12:33:38.684 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-04-20T12:33:38.684 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-04-20T12:33:38.685 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-04-20T12:33:38.685 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 9520, 2024-04-20T12:33:38.685 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 183, 2024-04-20T12:33:38.685 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-04-20T12:33:38.685 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-04-20T12:33:38.685 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-04-20T12:33:38.685 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-04-20T12:33:38.685 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 88933, 2024-04-20T12:33:38.685 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 356, 2024-04-20T12:33:38.685 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-04-20T12:33:38.685 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-04-20T12:33:38.685 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-04-20T12:33:38.685 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-04-20T12:33:38.685 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.686 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-04-20T12:33:38.686 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-04-20T12:33:38.686 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-04-20T12:33:38.686 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 50, 2024-04-20T12:33:38.686 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 13737, 2024-04-20T12:33:38.686 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 33, 2024-04-20T12:33:38.686 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 50, 2024-04-20T12:33:38.686 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-04-20T12:33:38.686 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 50, 2024-04-20T12:33:38.686 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.235995085, 2024-04-20T12:33:38.686 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.004719901 2024-04-20T12:33:38.686 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.686 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-04-20T12:33:38.686 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-04-20T12:33:38.687 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 50, 2024-04-20T12:33:38.687 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 76 2024-04-20T12:33:38.687 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.687 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 50, 2024-04-20T12:33:38.687 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 0, 2024-04-20T12:33:38.687 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 50, 2024-04-20T12:33:38.687 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-04-20T12:33:38.687 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-04-20T12:33:38.687 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2024-04-20T12:33:38.687 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 10, 2024-04-20T12:33:38.687 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 0, 2024-04-20T12:33:38.687 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 9, 2024-04-20T12:33:38.687 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 8, 2024-04-20T12:33:38.687 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-04-20T12:33:38.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-04-20T12:33:38.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-04-20T12:33:38.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-04-20T12:33:38.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 6, 2024-04-20T12:33:38.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-04-20T12:33:38.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-04-20T12:33:38.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-04-20T12:33:38.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 0, 2024-04-20T12:33:38.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 20, 2024-04-20T12:33:38.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-04-20T12:33:38.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-04-20T12:33:38.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-04-20T12:33:38.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-04-20T12:33:38.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-04-20T12:33:38.688 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-04-20T12:33:38.689 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-04-20T12:33:38.689 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-04-20T12:33:38.689 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-04-20T12:33:38.689 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-04-20T12:33:38.689 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-04-20T12:33:38.689 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-04-20T12:33:38.689 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-04-20T12:33:38.689 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-04-20T12:33:38.689 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-04-20T12:33:38.689 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-04-20T12:33:38.689 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-04-20T12:33:38.689 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-04-20T12:33:38.689 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-04-20T12:33:38.689 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-04-20T12:33:38.689 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-04-20T12:33:38.690 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-04-20T12:33:38.690 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-04-20T12:33:38.690 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-04-20T12:33:38.690 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-04-20T12:33:38.690 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-04-20T12:33:38.690 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 103, 2024-04-20T12:33:38.690 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-04-20T12:33:38.690 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 13, 2024-04-20T12:33:38.690 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 10, 2024-04-20T12:33:38.690 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 10, 2024-04-20T12:33:38.690 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-04-20T12:33:38.690 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-04-20T12:33:38.690 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 22, 2024-04-20T12:33:38.690 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 0, 2024-04-20T12:33:38.691 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 1 2024-04-20T12:33:38.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.691 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-04-20T12:33:38.691 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 1, 2024-04-20T12:33:38.691 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-04-20T12:33:38.691 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-04-20T12:33:38.691 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-04-20T12:33:38.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.691 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2024-04-20T12:33:38.691 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-04-20T12:33:38.691 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.691 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-04-20T12:33:38.691 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-04-20T12:33:38.691 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2024-04-20T12:33:38.691 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 0, 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 1356, 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1815795, 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 1356, 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-20T12:33:38.692 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 1356, 2024-04-20T12:33:38.693 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1815795, 2024-04-20T12:33:38.693 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-20T12:33:38.693 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.693 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.693 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.693 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:38.693 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.693 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-04-20T12:33:38.693 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-20T12:33:38.693 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-04-20T12:33:38.693 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-20T12:33:38.693 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-20T12:33:38.693 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-20T12:33:38.693 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:38.694 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:38.694 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 50, 2024-04-20T12:33:38.694 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 13737, 2024-04-20T12:33:38.694 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 50, 2024-04-20T12:33:38.694 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 13737, 2024-04-20T12:33:38.694 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-20T12:33:38.694 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.694 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.694 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.694 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:38.694 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.694 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-04-20T12:33:38.694 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-20T12:33:38.694 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-04-20T12:33:38.695 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-20T12:33:38.695 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-20T12:33:38.695 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-20T12:33:38.695 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:38.695 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:38.695 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 50, 2024-04-20T12:33:38.695 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 50, 2024-04-20T12:33:38.695 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 50, 2024-04-20T12:33:38.695 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 50, 2024-04-20T12:33:38.695 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-20T12:33:38.695 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.696 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.696 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.696 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:38.696 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.696 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-04-20T12:33:38.696 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-20T12:33:38.696 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-04-20T12:33:38.696 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-20T12:33:38.696 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-20T12:33:38.696 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-20T12:33:38.696 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:38.696 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:38.696 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-20T12:33:38.696 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-20T12:33:38.696 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-04-20T12:33:38.697 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-04-20T12:33:38.697 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-20T12:33:38.697 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.697 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.697 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.697 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:38.697 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:38.697 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55c38f652500": { 2024-04-20T12:33:38.697 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-20T12:33:38.697 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-04-20T12:33:38.697 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-20T12:33:38.697 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 10, 2024-04-20T12:33:38.697 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 2883, 2024-04-20T12:33:38.697 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:38.698 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 10, 2024-04-20T12:33:38.698 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-20T12:33:38.698 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-20T12:33:38.698 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 9, 2024-04-20T12:33:38.698 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2883, 2024-04-20T12:33:38.698 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-20T12:33:38.698 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:38.698 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:38.698 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:38.698 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:38.698 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:38.698 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:33:38.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:38 smithi135 ceph-mon[18264]: pgmap v326: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:39.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:38 smithi154 ceph-mon[22073]: pgmap v326: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:39.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:38 smithi139 ceph-mon[21834]: pgmap v326: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:39.500 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-04-20T12:33:39.500 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-04-20T12:33:39.500 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-04-20T12:33:39.500 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=10 2024-04-20T12:33:39.500 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=6 2024-04-20T12:33:39.500 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-04-20T12:33:39.500 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-04-20T12:33:39.500 DEBUG:tasks.check_counter:Getting stats from d 2024-04-20T12:33:39.501 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph daemon mds.d perf dump 2024-04-20T12:33:39.753 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:33:40.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:40 smithi135 ceph-mon[18264]: pgmap v327: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:41.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:40 smithi154 ceph-mon[22073]: pgmap v327: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:41.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:40 smithi139 ceph-mon[21834]: pgmap v327: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:41.499 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:33:41.500 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-04-20T12:33:41.500 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 0, 2024-04-20T12:33:41.500 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 2, 2024-04-20T12:33:41.500 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 0, 2024-04-20T12:33:41.500 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 0, 2024-04-20T12:33:41.500 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 4, 2024-04-20T12:33:41.500 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 0, 2024-04-20T12:33:41.500 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.001122176, 2024-04-20T12:33:41.500 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.000000000, 2024-04-20T12:33:41.500 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.000198272, 2024-04-20T12:33:41.500 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-20T12:33:41.500 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:41.501 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:41.501 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:41.501 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:41.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:41.501 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:41.501 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:41.501 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:41.501 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:41.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:41.501 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-20T12:33:41.501 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-04-20T12:33:41.501 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:41.501 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-04-20T12:33:41.501 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 6, 2024-04-20T12:33:41.501 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 168, 2024-04-20T12:33:41.502 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 3392, 2024-04-20T12:33:41.502 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 186000, 2024-04-20T12:33:41.502 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 5, 2024-04-20T12:33:41.502 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2024-04-20T12:33:41.502 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.015274850, 2024-04-20T12:33:41.502 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.010525479, 2024-04-20T12:33:41.502 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.002336133, 2024-04-20T12:33:41.502 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-20T12:33:41.502 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:41.502 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 166, 2024-04-20T12:33:41.502 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.014433146, 2024-04-20T12:33:41.502 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000086946 2024-04-20T12:33:41.502 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:41.502 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:41.502 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:41.503 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:41.503 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:41.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:41.503 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-04-20T12:33:41.503 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 186000 2024-04-20T12:33:41.503 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:41.503 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-04-20T12:33:41.503 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 229, 2024-04-20T12:33:41.503 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 218, 2024-04-20T12:33:41.503 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 1591920, 2024-04-20T12:33:41.503 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 133824, 2024-04-20T12:33:41.503 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 2, 2024-04-20T12:33:41.503 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 1, 2024-04-20T12:33:41.503 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.043760807, 2024-04-20T12:33:41.503 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.014320178, 2024-04-20T12:33:41.504 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.035140366, 2024-04-20T12:33:41.504 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.004624958, 2024-04-20T12:33:41.504 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:41.504 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 217, 2024-04-20T12:33:41.504 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.011396830, 2024-04-20T12:33:41.504 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000052519 2024-04-20T12:33:41.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:41.504 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:41.504 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:41.504 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:41.504 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:41.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:41.504 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1591920, 2024-04-20T12:33:41.504 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 133824 2024-04-20T12:33:41.504 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:41.505 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-04-20T12:33:41.505 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 0, 2024-04-20T12:33:41.505 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-04-20T12:33:41.505 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:41.505 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-04-20T12:33:41.505 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-04-20T12:33:41.505 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-04-20T12:33:41.505 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-04-20T12:33:41.505 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-04-20T12:33:41.505 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-04-20T12:33:41.505 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-04-20T12:33:41.505 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-20T12:33:41.505 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-04-20T12:33:41.505 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-20T12:33:41.505 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-04-20T12:33:41.506 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-04-20T12:33:41.506 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-04-20T12:33:41.506 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-20T12:33:41.506 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-04-20T12:33:41.506 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-04-20T12:33:41.506 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-04-20T12:33:41.506 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-04-20T12:33:41.506 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-04-20T12:33:41.506 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-20T12:33:41.506 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-04-20T12:33:41.506 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-20T12:33:41.506 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-04-20T12:33:41.506 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-04-20T12:33:41.506 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-04-20T12:33:41.507 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-04-20T12:33:41.507 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-04-20T12:33:41.507 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-20T12:33:41.507 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-04-20T12:33:41.507 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-04-20T12:33:41.507 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-04-20T12:33:41.507 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-04-20T12:33:41.507 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-04-20T12:33:41.507 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-04-20T12:33:41.507 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-04-20T12:33:41.507 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-04-20T12:33:41.507 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-04-20T12:33:41.507 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 148994, 2024-04-20T12:33:41.507 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 31, 2024-04-20T12:33:41.507 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-04-20T12:33:41.508 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-04-20T12:33:41.508 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-04-20T12:33:41.508 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-04-20T12:33:41.508 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-04-20T12:33:41.508 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-04-20T12:33:41.508 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-04-20T12:33:41.508 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-04-20T12:33:41.508 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 0, 2024-04-20T12:33:41.508 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 0, 2024-04-20T12:33:41.508 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-04-20T12:33:41.508 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-04-20T12:33:41.508 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-04-20T12:33:41.508 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-04-20T12:33:41.508 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 928, 2024-04-20T12:33:41.508 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 2, 2024-04-20T12:33:41.509 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-04-20T12:33:41.509 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-04-20T12:33:41.509 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-04-20T12:33:41.509 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-04-20T12:33:41.509 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:41.509 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-20T12:33:41.509 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-20T12:33:41.509 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-04-20T12:33:41.509 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-20T12:33:41.509 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 231, 2024-04-20T12:33:41.509 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1559627, 2024-04-20T12:33:41.509 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:41.509 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 231, 2024-04-20T12:33:41.509 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-20T12:33:41.509 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-20T12:33:41.510 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 231, 2024-04-20T12:33:41.510 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1559627, 2024-04-20T12:33:41.510 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-20T12:33:41.510 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:41.510 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:41.510 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:41.510 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:41.510 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:41.510 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:33:42.255 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-04-20T12:33:42.255 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-04-20T12:33:42.255 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-04-20T12:33:42.255 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-04-20T12:33:42.255 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-04-20T12:33:42.255 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-04-20T12:33:42.255 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-04-20T12:33:42.255 DEBUG:tasks.check_counter:Getting stats from g 2024-04-20T12:33:42.256 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph daemon mds.g perf dump 2024-04-20T12:33:42.504 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:33:42.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:42 smithi135 ceph-mon[18264]: pgmap v328: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:43.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:42 smithi154 ceph-mon[22073]: pgmap v328: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:43.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:42 smithi139 ceph-mon[21834]: pgmap v328: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:44.331 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:33:44.332 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-04-20T12:33:44.332 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 755, 2024-04-20T12:33:44.332 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 757, 2024-04-20T12:33:44.332 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 253625, 2024-04-20T12:33:44.332 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 240091, 2024-04-20T12:33:44.332 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 6, 2024-04-20T12:33:44.332 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 2, 2024-04-20T12:33:44.332 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.086781143, 2024-04-20T12:33:44.332 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.036884598, 2024-04-20T12:33:44.332 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.017899213, 2024-04-20T12:33:44.332 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.022994455, 2024-04-20T12:33:44.332 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 755, 2024-04-20T12:33:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.040911219, 2024-04-20T12:33:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000054187 2024-04-20T12:33:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-20T12:33:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-04-20T12:33:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-04-20T12:33:44.333 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1399, 2024-04-20T12:33:44.334 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1560, 2024-04-20T12:33:44.334 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 358993, 2024-04-20T12:33:44.334 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 890287, 2024-04-20T12:33:44.334 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 7, 2024-04-20T12:33:44.334 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2024-04-20T12:33:44.334 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.102155610, 2024-04-20T12:33:44.334 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.033466295, 2024-04-20T12:33:44.334 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.024975815, 2024-04-20T12:33:44.334 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.035060668, 2024-04-20T12:33:44.334 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:44.334 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1557, 2024-04-20T12:33:44.334 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.050823919, 2024-04-20T12:33:44.334 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000032642 2024-04-20T12:33:44.334 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.335 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:44.335 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.335 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.335 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.335 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-20T12:33:44.335 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 445984 2024-04-20T12:33:44.335 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.335 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-04-20T12:33:44.335 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 251, 2024-04-20T12:33:44.335 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 237, 2024-04-20T12:33:44.335 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 1628244, 2024-04-20T12:33:44.335 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 135797, 2024-04-20T12:33:44.335 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 4, 2024-04-20T12:33:44.336 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2024-04-20T12:33:44.336 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.045724234, 2024-04-20T12:33:44.336 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.014498574, 2024-04-20T12:33:44.336 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.038102395, 2024-04-20T12:33:44.336 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.004348453, 2024-04-20T12:33:44.336 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:44.336 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 237, 2024-04-20T12:33:44.336 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.012865185, 2024-04-20T12:33:44.336 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000054283 2024-04-20T12:33:44.336 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.336 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:44.336 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.336 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.336 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.337 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1626896, 2024-04-20T12:33:44.337 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 134832 2024-04-20T12:33:44.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.337 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-04-20T12:33:44.337 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-04-20T12:33:44.337 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-04-20T12:33:44.337 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.337 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-04-20T12:33:44.337 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-04-20T12:33:44.337 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-04-20T12:33:44.337 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3662, 2024-04-20T12:33:44.337 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.092360356, 2024-04-20T12:33:44.337 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000025221 2024-04-20T12:33:44.337 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:44.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.338 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-04-20T12:33:44.338 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-04-20T12:33:44.338 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-04-20T12:33:44.338 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.338 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.338 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.338 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:44.338 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.338 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-04-20T12:33:44.338 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2024-04-20T12:33:44.338 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2024-04-20T12:33:44.338 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-04-20T12:33:44.338 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.339 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.339 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.339 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.339 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-04-20T12:33:44.339 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2024-04-20T12:33:44.339 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2024-04-20T12:33:44.339 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-04-20T12:33:44.339 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2024-04-20T12:33:44.339 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-04-20T12:33:44.339 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-04-20T12:33:44.339 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 0, 2024-04-20T12:33:44.339 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 0, 2024-04-20T12:33:44.339 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 0, 2024-04-20T12:33:44.340 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 0, 2024-04-20T12:33:44.340 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 0, 2024-04-20T12:33:44.340 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 0, 2024-04-20T12:33:44.340 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2024-04-20T12:33:44.340 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2024-04-20T12:33:44.340 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 1, 2024-04-20T12:33:44.340 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2024-04-20T12:33:44.340 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2024-04-20T12:33:44.340 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2024-04-20T12:33:44.340 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2024-04-20T12:33:44.340 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-04-20T12:33:44.340 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-04-20T12:33:44.340 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2024-04-20T12:33:44.340 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2024-04-20T12:33:44.341 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-04-20T12:33:44.341 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2024-04-20T12:33:44.341 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2024-04-20T12:33:44.341 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2024-04-20T12:33:44.341 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2024-04-20T12:33:44.341 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-04-20T12:33:44.341 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2024-04-20T12:33:44.341 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-04-20T12:33:44.341 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 0, 2024-04-20T12:33:44.341 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 0, 2024-04-20T12:33:44.341 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2024-04-20T12:33:44.341 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2024-04-20T12:33:44.341 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-04-20T12:33:44.341 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-04-20T12:33:44.341 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-04-20T12:33:44.342 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2024-04-20T12:33:44.342 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-04-20T12:33:44.342 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2024-04-20T12:33:44.342 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2024-04-20T12:33:44.342 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2024-04-20T12:33:44.342 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2024-04-20T12:33:44.342 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2024-04-20T12:33:44.342 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-04-20T12:33:44.342 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-20T12:33:44.342 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-20T12:33:44.342 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2024-04-20T12:33:44.343 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2024-04-20T12:33:44.343 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2024-04-20T12:33:44.343 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2024-04-20T12:33:44.343 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.343 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-04-20T12:33:44.343 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2024-04-20T12:33:44.343 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2024-04-20T12:33:44.343 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2024-04-20T12:33:44.343 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2024-04-20T12:33:44.343 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2024-04-20T12:33:44.343 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-04-20T12:33:44.343 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-04-20T12:33:44.343 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-04-20T12:33:44.343 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2024-04-20T12:33:44.343 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2024-04-20T12:33:44.344 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-04-20T12:33:44.344 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-04-20T12:33:44.344 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-04-20T12:33:44.344 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-04-20T12:33:44.344 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-04-20T12:33:44.344 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-04-20T12:33:44.344 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-04-20T12:33:44.344 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 0, 2024-04-20T12:33:44.344 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 0, 2024-04-20T12:33:44.344 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-04-20T12:33:44.344 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2024-04-20T12:33:44.344 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-04-20T12:33:44.344 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-04-20T12:33:44.344 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-04-20T12:33:44.344 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2024-04-20T12:33:44.345 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.345 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-04-20T12:33:44.345 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-04-20T12:33:44.345 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2024-04-20T12:33:44.345 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-04-20T12:33:44.345 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-04-20T12:33:44.345 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 10, 2024-04-20T12:33:44.345 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-04-20T12:33:44.345 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-04-20T12:33:44.345 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2024-04-20T12:33:44.346 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-04-20T12:33:44.346 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-04-20T12:33:44.346 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 2, 2024-04-20T12:33:44.346 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 2, 2024-04-20T12:33:44.346 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-04-20T12:33:44.346 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-04-20T12:33:44.346 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2024-04-20T12:33:44.346 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 4197187, 2024-04-20T12:33:44.346 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 4197046, 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 10 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 3, 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 3, 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 0, 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 1, 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 1, 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 0, 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 0, 2024-04-20T12:33:44.347 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 0, 2024-04-20T12:33:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 0, 2024-04-20T12:33:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2024-04-20T12:33:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2024-04-20T12:33:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2024-04-20T12:33:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 53064, 2024-04-20T12:33:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 215416 2024-04-20T12:33:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-04-20T12:33:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2024-04-20T12:33:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2024-04-20T12:33:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2024-04-20T12:33:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2024-04-20T12:33:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2024-04-20T12:33:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-04-20T12:33:44.348 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.349 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.349 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.349 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-04-20T12:33:44.349 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.349 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.349 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.349 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-04-20T12:33:44.349 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.349 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.349 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.349 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.349 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-04-20T12:33:44.349 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-04-20T12:33:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-04-20T12:33:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.350 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-04-20T12:33:44.351 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.351 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.351 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.351 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-04-20T12:33:44.351 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.351 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.351 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.351 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-04-20T12:33:44.351 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.351 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.351 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.351 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.351 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-04-20T12:33:44.352 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.352 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.352 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.352 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-04-20T12:33:44.352 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.352 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.352 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.352 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.352 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-04-20T12:33:44.352 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.353 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.353 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.353 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.353 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-04-20T12:33:44.353 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.353 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.353 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.353 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.353 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-04-20T12:33:44.353 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.354 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.354 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.354 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-04-20T12:33:44.354 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.354 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.354 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.354 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-04-20T12:33:44.354 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.354 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.354 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.354 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.354 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-04-20T12:33:44.355 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.355 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.355 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.355 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-04-20T12:33:44.355 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.355 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.355 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.355 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-04-20T12:33:44.355 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.355 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.355 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.355 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.355 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-04-20T12:33:44.356 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.356 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.356 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.356 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-04-20T12:33:44.356 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.356 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.356 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.356 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-04-20T12:33:44.356 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.356 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.356 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.356 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.356 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-04-20T12:33:44.357 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.357 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.357 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.357 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-04-20T12:33:44.357 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.357 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.357 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.357 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-04-20T12:33:44.357 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.357 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.357 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.357 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.358 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-04-20T12:33:44.358 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.358 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.358 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.358 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-04-20T12:33:44.358 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.358 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.358 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.358 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.358 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-04-20T12:33:44.358 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.358 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.358 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.359 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-04-20T12:33:44.359 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.359 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.359 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.359 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-04-20T12:33:44.359 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-04-20T12:33:44.359 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-04-20T12:33:44.359 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.359 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.359 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.359 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:44.359 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.360 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-04-20T12:33:44.360 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 2, 2024-04-20T12:33:44.360 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 5, 2024-04-20T12:33:44.360 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 3, 2024-04-20T12:33:44.360 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 5, 2024-04-20T12:33:44.360 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-04-20T12:33:44.360 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2024-04-20T12:33:44.360 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2024-04-20T12:33:44.360 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 3332, 2024-04-20T12:33:44.360 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-04-20T12:33:44.360 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.360 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-04-20T12:33:44.360 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-04-20T12:33:44.360 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-04-20T12:33:44.360 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-04-20T12:33:44.361 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-20T12:33:44.362 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-04-20T12:33:44.362 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-20T12:33:44.362 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-04-20T12:33:44.362 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-04-20T12:33:44.362 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-04-20T12:33:44.362 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-04-20T12:33:44.362 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-04-20T12:33:44.362 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-20T12:33:44.362 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-04-20T12:33:44.362 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-04-20T12:33:44.362 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-04-20T12:33:44.362 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-04-20T12:33:44.362 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-04-20T12:33:44.362 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-04-20T12:33:44.363 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-04-20T12:33:44.363 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-04-20T12:33:44.363 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-04-20T12:33:44.363 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 197530, 2024-04-20T12:33:44.363 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 57, 2024-04-20T12:33:44.363 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-04-20T12:33:44.363 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-04-20T12:33:44.363 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-04-20T12:33:44.363 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-04-20T12:33:44.363 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-04-20T12:33:44.363 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-04-20T12:33:44.363 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-04-20T12:33:44.363 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-04-20T12:33:44.363 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 9520, 2024-04-20T12:33:44.363 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 183, 2024-04-20T12:33:44.364 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-04-20T12:33:44.364 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-04-20T12:33:44.364 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-04-20T12:33:44.364 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-04-20T12:33:44.364 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 8512, 2024-04-20T12:33:44.364 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 13, 2024-04-20T12:33:44.364 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-04-20T12:33:44.364 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-04-20T12:33:44.364 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-04-20T12:33:44.364 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-04-20T12:33:44.364 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.364 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-04-20T12:33:44.364 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-04-20T12:33:44.364 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-04-20T12:33:44.365 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 2155, 2024-04-20T12:33:44.365 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 21, 2024-04-20T12:33:44.365 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 3, 2024-04-20T12:33:44.365 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 2155, 2024-04-20T12:33:44.365 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-04-20T12:33:44.365 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2155, 2024-04-20T12:33:44.365 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.076977570, 2024-04-20T12:33:44.365 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000499757 2024-04-20T12:33:44.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.365 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-04-20T12:33:44.365 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-04-20T12:33:44.365 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 2155, 2024-04-20T12:33:44.365 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 2156 2024-04-20T12:33:44.365 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.365 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 2155, 2024-04-20T12:33:44.366 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 2155, 2024-04-20T12:33:44.366 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-04-20T12:33:44.366 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-04-20T12:33:44.366 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-04-20T12:33:44.366 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 1390, 2024-04-20T12:33:44.366 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-04-20T12:33:44.366 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 763, 2024-04-20T12:33:44.366 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-04-20T12:33:44.366 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-04-20T12:33:44.366 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-04-20T12:33:44.366 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-04-20T12:33:44.366 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-04-20T12:33:44.366 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-04-20T12:33:44.366 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-04-20T12:33:44.367 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-04-20T12:33:44.367 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-04-20T12:33:44.367 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-04-20T12:33:44.367 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1, 2024-04-20T12:33:44.367 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-04-20T12:33:44.367 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-04-20T12:33:44.367 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-04-20T12:33:44.367 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-04-20T12:33:44.367 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-04-20T12:33:44.367 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-04-20T12:33:44.367 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-04-20T12:33:44.367 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-04-20T12:33:44.367 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-04-20T12:33:44.367 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-04-20T12:33:44.368 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-04-20T12:33:44.368 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-04-20T12:33:44.368 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-04-20T12:33:44.368 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-04-20T12:33:44.368 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-04-20T12:33:44.368 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-04-20T12:33:44.368 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-04-20T12:33:44.368 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-04-20T12:33:44.368 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-04-20T12:33:44.368 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-04-20T12:33:44.368 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-04-20T12:33:44.368 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-04-20T12:33:44.368 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-04-20T12:33:44.368 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-04-20T12:33:44.368 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-04-20T12:33:44.369 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-04-20T12:33:44.369 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-04-20T12:33:44.369 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 103, 2024-04-20T12:33:44.369 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-04-20T12:33:44.369 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 13, 2024-04-20T12:33:44.369 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 6, 2024-04-20T12:33:44.369 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 6, 2024-04-20T12:33:44.369 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-04-20T12:33:44.369 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-04-20T12:33:44.369 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-04-20T12:33:44.369 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2024-04-20T12:33:44.369 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-04-20T12:33:44.369 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.369 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-04-20T12:33:44.369 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2024-04-20T12:33:44.370 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-04-20T12:33:44.370 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-04-20T12:33:44.370 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-04-20T12:33:44.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.370 INFO:teuthology.orchestra.run.smithi135.stdout: "osd-slow-ops": { 2024-04-20T12:33:44.370 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-04-20T12:33:44.370 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.370 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-04-20T12:33:44.370 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-04-20T12:33:44.370 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2024-04-20T12:33:44.370 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-04-20T12:33:44.370 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2024-04-20T12:33:44.370 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 0, 2024-04-20T12:33:44.370 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2024-04-20T12:33:44.371 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-04-20T12:33:44.371 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.371 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-20T12:33:44.371 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-20T12:33:44.371 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-04-20T12:33:44.371 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-20T12:33:44.371 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 2401, 2024-04-20T12:33:44.371 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 2009207, 2024-04-20T12:33:44.371 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:44.371 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 2401, 2024-04-20T12:33:44.371 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-20T12:33:44.371 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-20T12:33:44.371 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2401, 2024-04-20T12:33:44.371 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2009207, 2024-04-20T12:33:44.371 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-20T12:33:44.372 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.372 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.372 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.372 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:44.372 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.372 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-04-20T12:33:44.372 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-20T12:33:44.372 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-04-20T12:33:44.372 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-20T12:33:44.372 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-20T12:33:44.372 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-20T12:33:44.372 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:44.372 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:44.372 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 2155, 2024-04-20T12:33:44.372 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 2888, 2024-04-20T12:33:44.373 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2155, 2024-04-20T12:33:44.373 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2888, 2024-04-20T12:33:44.373 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-20T12:33:44.373 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.373 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.373 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.373 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:44.373 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.373 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-04-20T12:33:44.373 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-20T12:33:44.373 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-04-20T12:33:44.373 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-20T12:33:44.373 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-20T12:33:44.373 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-20T12:33:44.374 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:44.374 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:44.374 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 2155, 2024-04-20T12:33:44.374 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 2155, 2024-04-20T12:33:44.374 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 2155, 2024-04-20T12:33:44.374 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2155, 2024-04-20T12:33:44.374 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-20T12:33:44.374 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.374 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.374 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.374 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:44.374 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.374 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-04-20T12:33:44.375 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-20T12:33:44.375 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-04-20T12:33:44.375 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-20T12:33:44.375 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-20T12:33:44.375 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-20T12:33:44.375 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:44.375 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:44.375 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-20T12:33:44.375 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-20T12:33:44.375 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-04-20T12:33:44.375 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-04-20T12:33:44.375 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-20T12:33:44.375 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.375 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x56272790a5a0": { 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-04-20T12:33:44.376 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-20T12:33:44.377 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:44.377 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:44.377 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:44.377 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:44.377 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:44.377 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:33:44.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:44 smithi135 ceph-mon[18264]: pgmap v329: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:45.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:44 smithi154 ceph-mon[22073]: pgmap v329: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:45.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:44 smithi139 ceph-mon[21834]: pgmap v329: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:45.245 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-04-20T12:33:45.245 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-04-20T12:33:45.245 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-04-20T12:33:45.245 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-04-20T12:33:45.245 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-04-20T12:33:45.245 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-04-20T12:33:45.245 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-04-20T12:33:45.245 DEBUG:tasks.check_counter:Getting stats from j 2024-04-20T12:33:45.246 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph daemon mds.j perf dump 2024-04-20T12:33:45.489 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.a/config 2024-04-20T12:33:46.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:46 smithi135 ceph-mon[18264]: pgmap v330: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:47.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:46 smithi154 ceph-mon[22073]: pgmap v330: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:47.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:46 smithi139 ceph-mon[21834]: pgmap v330: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:47.301 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-04-20T12:33:47.302 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-04-20T12:33:47.302 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 0, 2024-04-20T12:33:47.302 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 2, 2024-04-20T12:33:47.302 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 0, 2024-04-20T12:33:47.302 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 0, 2024-04-20T12:33:47.302 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 4, 2024-04-20T12:33:47.302 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 0, 2024-04-20T12:33:47.302 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.001083891, 2024-04-20T12:33:47.302 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.000000000, 2024-04-20T12:33:47.303 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.000261820, 2024-04-20T12:33:47.303 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-20T12:33:47.303 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:47.303 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:47.303 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:47.303 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:47.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:47.303 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:47.303 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:47.303 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:47.303 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:47.303 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:47.303 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-20T12:33:47.303 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-04-20T12:33:47.304 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:47.304 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-04-20T12:33:47.304 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 2, 2024-04-20T12:33:47.304 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 167, 2024-04-20T12:33:47.304 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 320, 2024-04-20T12:33:47.304 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 185728, 2024-04-20T12:33:47.304 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 5, 2024-04-20T12:33:47.304 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2024-04-20T12:33:47.304 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.015812897, 2024-04-20T12:33:47.304 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.011103937, 2024-04-20T12:33:47.304 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.002071906, 2024-04-20T12:33:47.304 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-04-20T12:33:47.304 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:47.304 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 164, 2024-04-20T12:33:47.304 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.019329831, 2024-04-20T12:33:47.305 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000117864 2024-04-20T12:33:47.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:47.305 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:47.305 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:47.305 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:47.305 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:47.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:47.305 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-20T12:33:47.305 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 185728 2024-04-20T12:33:47.305 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:47.305 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-04-20T12:33:47.305 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 235, 2024-04-20T12:33:47.305 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 222, 2024-04-20T12:33:47.305 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 1595536, 2024-04-20T12:33:47.306 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 135552, 2024-04-20T12:33:47.306 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 2, 2024-04-20T12:33:47.306 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 1, 2024-04-20T12:33:47.306 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.043213066, 2024-04-20T12:33:47.306 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.014140095, 2024-04-20T12:33:47.306 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.034497576, 2024-04-20T12:33:47.306 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.004413772, 2024-04-20T12:33:47.306 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:47.306 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 222, 2024-04-20T12:33:47.306 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.011483605, 2024-04-20T12:33:47.306 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000051727 2024-04-20T12:33:47.306 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:47.306 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:47.306 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:47.306 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:47.307 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:47.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:47.307 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1595536, 2024-04-20T12:33:47.307 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 135552 2024-04-20T12:33:47.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:47.307 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-04-20T12:33:47.307 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 0, 2024-04-20T12:33:47.307 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-04-20T12:33:47.307 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:47.307 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-04-20T12:33:47.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-04-20T12:33:47.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-04-20T12:33:47.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-04-20T12:33:47.307 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-04-20T12:33:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-04-20T12:33:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-04-20T12:33:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-20T12:33:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-04-20T12:33:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-20T12:33:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-04-20T12:33:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-04-20T12:33:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-04-20T12:33:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-20T12:33:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-04-20T12:33:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-04-20T12:33:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-04-20T12:33:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-04-20T12:33:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-04-20T12:33:47.308 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-20T12:33:47.309 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-04-20T12:33:47.309 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-20T12:33:47.309 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-04-20T12:33:47.309 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-04-20T12:33:47.309 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-04-20T12:33:47.309 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-04-20T12:33:47.309 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-04-20T12:33:47.309 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-20T12:33:47.309 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-04-20T12:33:47.309 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-04-20T12:33:47.309 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-04-20T12:33:47.309 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-04-20T12:33:47.309 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-04-20T12:33:47.309 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-04-20T12:33:47.310 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-04-20T12:33:47.310 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-04-20T12:33:47.310 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-04-20T12:33:47.310 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 149057, 2024-04-20T12:33:47.310 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 32, 2024-04-20T12:33:47.310 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-04-20T12:33:47.310 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-04-20T12:33:47.310 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-04-20T12:33:47.310 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-04-20T12:33:47.310 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-04-20T12:33:47.310 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-04-20T12:33:47.310 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-04-20T12:33:47.310 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-04-20T12:33:47.311 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 0, 2024-04-20T12:33:47.311 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 0, 2024-04-20T12:33:47.311 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-04-20T12:33:47.311 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-04-20T12:33:47.311 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-04-20T12:33:47.311 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-04-20T12:33:47.311 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 928, 2024-04-20T12:33:47.311 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 2, 2024-04-20T12:33:47.311 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-04-20T12:33:47.311 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-04-20T12:33:47.311 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-04-20T12:33:47.311 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-04-20T12:33:47.311 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-04-20T12:33:47.311 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-20T12:33:47.311 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-04-20T12:33:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-04-20T12:33:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-04-20T12:33:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 233, 2024-04-20T12:33:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1559887, 2024-04-20T12:33:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 233, 2024-04-20T12:33:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-04-20T12:33:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-04-20T12:33:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 233, 2024-04-20T12:33:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1559887, 2024-04-20T12:33:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-04-20T12:33:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-04-20T12:33:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-04-20T12:33:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-04-20T12:33:47.312 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:47.313 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-04-20T12:33:47.313 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-04-20T12:33:48.002 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-04-20T12:33:48.002 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-04-20T12:33:48.002 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-04-20T12:33:48.002 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-04-20T12:33:48.002 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-04-20T12:33:48.002 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-04-20T12:33:48.003 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-04-20T12:33:48.003 DEBUG:tasks.check_counter:Getting stats from b 2024-04-20T12:33:48.003 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph daemon mds.b perf dump 2024-04-20T12:33:48.253 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.b/config 2024-04-20T12:33:48.643 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:48 smithi139 ceph-mon[21834]: pgmap v331: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:48.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:48 smithi135 ceph-mon[18264]: pgmap v331: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:49.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:48 smithi154 ceph-mon[22073]: pgmap v331: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:50.274 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-20T12:33:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-04-20T12:33:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 1273, 2024-04-20T12:33:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 1077, 2024-04-20T12:33:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 1960934, 2024-04-20T12:33:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 362138, 2024-04-20T12:33:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 11, 2024-04-20T12:33:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 3, 2024-04-20T12:33:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.134467681, 2024-04-20T12:33:50.274 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.047606621, 2024-04-20T12:33:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.092487632, 2024-04-20T12:33:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.009856646, 2024-04-20T12:33:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1076, 2024-04-20T12:33:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.056788038, 2024-04-20T12:33:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000052776 2024-04-20T12:33:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1744, 2024-04-20T12:33:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000374100, 2024-04-20T12:33:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000214 2024-04-20T12:33:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 1659184, 2024-04-20T12:33:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 139824 2024-04-20T12:33:50.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-04-20T12:33:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 61, 2024-04-20T12:33:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 93, 2024-04-20T12:33:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 13369, 2024-04-20T12:33:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 583686, 2024-04-20T12:33:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 48, 2024-04-20T12:33:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 5, 2024-04-20T12:33:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.019100769, 2024-04-20T12:33:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.002674137, 2024-04-20T12:33:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.014648446, 2024-04-20T12:33:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.000197766, 2024-04-20T12:33:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 91, 2024-04-20T12:33:50.276 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.013997199, 2024-04-20T12:33:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000153815 2024-04-20T12:33:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 54, 2024-04-20T12:33:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000005109, 2024-04-20T12:33:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000094 2024-04-20T12:33:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 5088, 2024-04-20T12:33:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 132560 2024-04-20T12:33:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-04-20T12:33:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 16, 2024-04-20T12:33:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 147, 2024-04-20T12:33:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 4277, 2024-04-20T12:33:50.277 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 331519, 2024-04-20T12:33:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 7, 2024-04-20T12:33:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 5, 2024-04-20T12:33:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.010685722, 2024-04-20T12:33:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.006564211, 2024-04-20T12:33:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.002474332, 2024-04-20T12:33:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.000422664, 2024-04-20T12:33:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 145, 2024-04-20T12:33:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.026671637, 2024-04-20T12:33:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000183942 2024-04-20T12:33:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.278 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 160, 2024-04-20T12:33:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 319056 2024-04-20T12:33:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-04-20T12:33:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2024-04-20T12:33:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-04-20T12:33:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2024-04-20T12:33:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-20T12:33:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-20T12:33:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 39, 2024-04-20T12:33:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.001900997, 2024-04-20T12:33:50.279 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000048743 2024-04-20T12:33:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2024-04-20T12:33:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-20T12:33:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-20T12:33:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2, 2024-04-20T12:33:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000007095, 2024-04-20T12:33:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000003547 2024-04-20T12:33:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2024-04-20T12:33:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 0, 2024-04-20T12:33:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 0, 2024-04-20T12:33:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2024-04-20T12:33:50.280 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2024-04-20T12:33:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 0, 2024-04-20T12:33:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 0, 2024-04-20T12:33:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2024-04-20T12:33:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 11, 2024-04-20T12:33:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 0, 2024-04-20T12:33:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2024-04-20T12:33:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 18, 2024-04-20T12:33:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 2, 2024-04-20T12:33:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 16, 2024-04-20T12:33:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 0, 2024-04-20T12:33:50.281 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 13, 2024-04-20T12:33:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 8, 2024-04-20T12:33:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 0, 2024-04-20T12:33:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 0, 2024-04-20T12:33:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 3, 2024-04-20T12:33:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 9, 2024-04-20T12:33:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 6, 2024-04-20T12:33:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 0, 2024-04-20T12:33:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 3, 2024-04-20T12:33:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 0, 2024-04-20T12:33:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2024-04-20T12:33:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 0, 2024-04-20T12:33:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2024-04-20T12:33:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2024-04-20T12:33:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 0, 2024-04-20T12:33:50.282 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 0, 2024-04-20T12:33:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 0, 2024-04-20T12:33:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 0, 2024-04-20T12:33:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2024-04-20T12:33:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 0, 2024-04-20T12:33:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2024-04-20T12:33:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 4, 2024-04-20T12:33:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 234, 2024-04-20T12:33:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 6, 2024-04-20T12:33:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 0, 2024-04-20T12:33:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2024-04-20T12:33:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2024-04-20T12:33:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2024-04-20T12:33:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 0, 2024-04-20T12:33:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2024-04-20T12:33:50.283 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 0, 2024-04-20T12:33:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 0, 2024-04-20T12:33:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 0, 2024-04-20T12:33:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 0, 2024-04-20T12:33:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 0, 2024-04-20T12:33:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2024-04-20T12:33:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-20T12:33:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-20T12:33:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 0, 2024-04-20T12:33:50.284 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 0, 2024-04-20T12:33:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 0, 2024-04-20T12:33:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 0 2024-04-20T12:33:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2024-04-20T12:33:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 0, 2024-04-20T12:33:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 15, 2024-04-20T12:33:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 9, 2024-04-20T12:33:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 10, 2024-04-20T12:33:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 0, 2024-04-20T12:33:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 0, 2024-04-20T12:33:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2024-04-20T12:33:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2024-04-20T12:33:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 0, 2024-04-20T12:33:50.285 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 0, 2024-04-20T12:33:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2024-04-20T12:33:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2024-04-20T12:33:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2024-04-20T12:33:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2024-04-20T12:33:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2024-04-20T12:33:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2024-04-20T12:33:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2024-04-20T12:33:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_path": 0, 2024-04-20T12:33:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_inode": 0, 2024-04-20T12:33:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2024-04-20T12:33:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 0, 2024-04-20T12:33:50.286 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2024-04-20T12:33:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 0, 2024-04-20T12:33:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2024-04-20T12:33:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2024-04-20T12:33:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2024-04-20T12:33:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "evlrg": 0, 2024-04-20T12:33:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 6, 2024-04-20T12:33:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2024-04-20T12:33:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2024-04-20T12:33:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 6, 2024-04-20T12:33:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2024-04-20T12:33:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2024-04-20T12:33:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 2, 2024-04-20T12:33:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2024-04-20T12:33:50.287 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 2, 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "segmjr": 2, 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 4194304, 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 4195956, 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 0, 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 5, 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.010867060, 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.002173412 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 0 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2024-04-20T12:33:50.288 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 22, 2024-04-20T12:33:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 28, 2024-04-20T12:33:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 6, 2024-04-20T12:33:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 21, 2024-04-20T12:33:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 26, 2024-04-20T12:33:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 5, 2024-04-20T12:33:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 18, 2024-04-20T12:33:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 26, 2024-04-20T12:33:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 8, 2024-04-20T12:33:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 0, 2024-04-20T12:33:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 0, 2024-04-20T12:33:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 0, 2024-04-20T12:33:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 52120, 2024-04-20T12:33:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 223608 2024-04-20T12:33:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.289 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2024-04-20T12:33:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 0, 2024-04-20T12:33:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 0, 2024-04-20T12:33:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 0, 2024-04-20T12:33:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 8, 2024-04-20T12:33:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 0, 2024-04-20T12:33:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2024-04-20T12:33:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2024-04-20T12:33:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.290 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2024-04-20T12:33:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2024-04-20T12:33:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2024-04-20T12:33:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2024-04-20T12:33:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2024-04-20T12:33:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.292 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2024-04-20T12:33:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2024-04-20T12:33:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2024-04-20T12:33:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2024-04-20T12:33:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2024-04-20T12:33:50.294 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2024-04-20T12:33:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2024-04-20T12:33:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.295 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2024-04-20T12:33:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2024-04-20T12:33:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.296 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2024-04-20T12:33:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2024-04-20T12:33:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2024-04-20T12:33:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.297 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2024-04-20T12:33:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2024-04-20T12:33:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2024-04-20T12:33:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.298 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2024-04-20T12:33:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2024-04-20T12:33:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2024-04-20T12:33:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.299 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2024-04-20T12:33:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2024-04-20T12:33:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2024-04-20T12:33:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.300 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2024-04-20T12:33:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2024-04-20T12:33:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2024-04-20T12:33:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2024-04-20T12:33:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2024-04-20T12:33:50.301 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 0, 2024-04-20T12:33:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 2, 2024-04-20T12:33:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 2, 2024-04-20T12:33:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 0, 2024-04-20T12:33:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2024-04-20T12:33:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 0, 2024-04-20T12:33:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 0, 2024-04-20T12:33:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 88, 2024-04-20T12:33:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2024-04-20T12:33:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-04-20T12:33:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2024-04-20T12:33:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2024-04-20T12:33:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-04-20T12:33:50.302 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-04-20T12:33:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-04-20T12:33:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-04-20T12:33:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-20T12:33:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-04-20T12:33:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-20T12:33:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-04-20T12:33:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-04-20T12:33:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-04-20T12:33:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-20T12:33:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-04-20T12:33:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-04-20T12:33:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-04-20T12:33:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-04-20T12:33:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-04-20T12:33:50.303 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-20T12:33:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-04-20T12:33:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-20T12:33:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-04-20T12:33:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-04-20T12:33:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-04-20T12:33:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-04-20T12:33:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-04-20T12:33:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-20T12:33:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-04-20T12:33:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-04-20T12:33:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-04-20T12:33:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-04-20T12:33:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-04-20T12:33:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-04-20T12:33:50.304 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 246199, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 79, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 0, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 0, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 9520, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 183, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-04-20T12:33:50.305 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-04-20T12:33:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-04-20T12:33:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-04-20T12:33:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 92629, 2024-04-20T12:33:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 351, 2024-04-20T12:33:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-04-20T12:33:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-04-20T12:33:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-04-20T12:33:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-04-20T12:33:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2024-04-20T12:33:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2024-04-20T12:33:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2024-04-20T12:33:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 41, 2024-04-20T12:33:50.306 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 11954, 2024-04-20T12:33:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 33, 2024-04-20T12:33:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 41, 2024-04-20T12:33:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2024-04-20T12:33:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 41, 2024-04-20T12:33:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.229994976, 2024-04-20T12:33:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.005609633 2024-04-20T12:33:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2024-04-20T12:33:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2024-04-20T12:33:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 41, 2024-04-20T12:33:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 63 2024-04-20T12:33:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 41, 2024-04-20T12:33:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 0, 2024-04-20T12:33:50.307 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 41, 2024-04-20T12:33:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2024-04-20T12:33:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2024-04-20T12:33:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 0, 2024-04-20T12:33:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 10, 2024-04-20T12:33:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 0, 2024-04-20T12:33:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 5, 2024-04-20T12:33:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 7, 2024-04-20T12:33:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2024-04-20T12:33:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2024-04-20T12:33:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2024-04-20T12:33:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 0, 2024-04-20T12:33:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 6, 2024-04-20T12:33:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2024-04-20T12:33:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2024-04-20T12:33:50.308 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 0, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 20, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2024-04-20T12:33:50.309 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2024-04-20T12:33:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2024-04-20T12:33:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2024-04-20T12:33:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2024-04-20T12:33:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2024-04-20T12:33:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2024-04-20T12:33:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2024-04-20T12:33:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2024-04-20T12:33:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2024-04-20T12:33:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2024-04-20T12:33:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2024-04-20T12:33:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2024-04-20T12:33:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2024-04-20T12:33:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 103, 2024-04-20T12:33:50.310 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2024-04-20T12:33:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 13, 2024-04-20T12:33:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 9, 2024-04-20T12:33:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 9, 2024-04-20T12:33:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2024-04-20T12:33:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2024-04-20T12:33:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 14, 2024-04-20T12:33:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 0, 2024-04-20T12:33:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 1 2024-04-20T12:33:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2024-04-20T12:33:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 1, 2024-04-20T12:33:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2024-04-20T12:33:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2024-04-20T12:33:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2024-04-20T12:33:50.311 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2024-04-20T12:33:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2024-04-20T12:33:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2024-04-20T12:33:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2024-04-20T12:33:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 0, 2024-04-20T12:33:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2024-04-20T12:33:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 0, 2024-04-20T12:33:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed_ops": 0, 2024-04-20T12:33:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 0, 2024-04-20T12:33:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2024-04-20T12:33:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-20T12:33:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:50.312 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-20T12:33:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 1346, 2024-04-20T12:33:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 1839723, 2024-04-20T12:33:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 1346, 2024-04-20T12:33:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-20T12:33:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-20T12:33:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 1346, 2024-04-20T12:33:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 1839723, 2024-04-20T12:33:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:50.313 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2024-04-20T12:33:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-20T12:33:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-20T12:33:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-20T12:33:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 41, 2024-04-20T12:33:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 11954, 2024-04-20T12:33:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 41, 2024-04-20T12:33:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 11954, 2024-04-20T12:33:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.314 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2024-04-20T12:33:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2024-04-20T12:33:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-20T12:33:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-20T12:33:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 41, 2024-04-20T12:33:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 41, 2024-04-20T12:33:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 41, 2024-04-20T12:33:50.315 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 41, 2024-04-20T12:33:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2024-04-20T12:33:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-20T12:33:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-20T12:33:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-20T12:33:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:50.316 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-20T12:33:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-20T12:33:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2024-04-20T12:33:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2024-04-20T12:33:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x55fe527bc500": { 2024-04-20T12:33:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-20T12:33:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 6, 2024-04-20T12:33:50.317 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 1652, 2024-04-20T12:33:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 6, 2024-04-20T12:33:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-20T12:33:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-20T12:33:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 5, 2024-04-20T12:33:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 1652, 2024-04-20T12:33:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:50.318 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:50.318 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-20T12:33:50.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:50 smithi135 ceph-mon[18264]: pgmap v332: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:50.922 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:50 smithi139 ceph-mon[21834]: pgmap v332: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:51.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:50 smithi154 ceph-mon[22073]: pgmap v332: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:51.053 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-04-20T12:33:51.053 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-04-20T12:33:51.053 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=0 2024-04-20T12:33:51.053 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=15 2024-04-20T12:33:51.053 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-04-20T12:33:51.053 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-04-20T12:33:51.053 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-04-20T12:33:51.053 DEBUG:tasks.check_counter:Getting stats from e 2024-04-20T12:33:51.054 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph daemon mds.e perf dump 2024-04-20T12:33:51.289 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.b/config 2024-04-20T12:33:52.717 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:52 smithi139 ceph-mon[21834]: pgmap v333: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:53.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:52 smithi154 ceph-mon[22073]: pgmap v333: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:53.033 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-20T12:33:53.033 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-04-20T12:33:53.033 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 2176, 2024-04-20T12:33:53.033 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 2177, 2024-04-20T12:33:53.033 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 618629, 2024-04-20T12:33:53.033 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 691657, 2024-04-20T12:33:53.033 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 6, 2024-04-20T12:33:53.033 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 2, 2024-04-20T12:33:53.033 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.165926725, 2024-04-20T12:33:53.033 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.053585371, 2024-04-20T12:33:53.034 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.040496185, 2024-04-20T12:33:53.034 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.058099431, 2024-04-20T12:33:53.034 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:53.034 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2175, 2024-04-20T12:33:53.034 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.066227168, 2024-04-20T12:33:53.034 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000030449 2024-04-20T12:33:53.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.034 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:53.034 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.034 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.034 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.034 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.034 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-20T12:33:53.034 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 0 2024-04-20T12:33:53.035 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.035 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-04-20T12:33:53.035 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 255, 2024-04-20T12:33:53.035 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 240, 2024-04-20T12:33:53.035 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 1643884, 2024-04-20T12:33:53.035 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 138922, 2024-04-20T12:33:53.035 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 3, 2024-04-20T12:33:53.035 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 2, 2024-04-20T12:33:53.035 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.049658815, 2024-04-20T12:33:53.035 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.014724931, 2024-04-20T12:33:53.035 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.039713643, 2024-04-20T12:33:53.035 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.005647219, 2024-04-20T12:33:53.035 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:53.035 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 239, 2024-04-20T12:33:53.035 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.014537041, 2024-04-20T12:33:53.036 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000060824 2024-04-20T12:33:53.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.036 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:53.036 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.036 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.036 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.036 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 1643328, 2024-04-20T12:33:53.036 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 138224 2024-04-20T12:33:53.036 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.036 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-04-20T12:33:53.036 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 7, 2024-04-20T12:33:53.036 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 170, 2024-04-20T12:33:53.036 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 3660, 2024-04-20T12:33:53.036 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 449070, 2024-04-20T12:33:53.037 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 6, 2024-04-20T12:33:53.037 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 4, 2024-04-20T12:33:53.037 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.010968053, 2024-04-20T12:33:53.037 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.006930064, 2024-04-20T12:33:53.037 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.002335780, 2024-04-20T12:33:53.037 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.000023978, 2024-04-20T12:33:53.037 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:53.037 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 168, 2024-04-20T12:33:53.037 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.020845452, 2024-04-20T12:33:53.037 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000124080 2024-04-20T12:33:53.037 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.037 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:53.037 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.037 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.037 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.038 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-04-20T12:33:53.038 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 448752 2024-04-20T12:33:53.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.038 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-04-20T12:33:53.038 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2024-04-20T12:33:53.038 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-04-20T12:33:53.038 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.038 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2024-04-20T12:33:53.038 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-20T12:33:53.038 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-20T12:33:53.038 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 3695, 2024-04-20T12:33:53.038 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.087582514, 2024-04-20T12:33:53.038 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000023702 2024-04-20T12:33:53.039 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:53.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.039 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2024-04-20T12:33:53.039 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-20T12:33:53.039 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-20T12:33:53.039 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.039 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.039 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.039 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:53.039 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.039 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2024-04-20T12:33:53.039 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 0, 2024-04-20T12:33:53.039 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 0, 2024-04-20T12:33:53.039 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2024-04-20T12:33:53.039 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.040 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.040 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.040 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.040 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2024-04-20T12:33:53.040 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 0, 2024-04-20T12:33:53.040 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 0, 2024-04-20T12:33:53.040 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2024-04-20T12:33:53.040 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 0, 2024-04-20T12:33:53.040 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 0, 2024-04-20T12:33:53.040 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2024-04-20T12:33:53.040 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 0, 2024-04-20T12:33:53.041 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 0, 2024-04-20T12:33:53.041 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 0, 2024-04-20T12:33:53.041 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 0, 2024-04-20T12:33:53.041 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 0, 2024-04-20T12:33:53.041 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 0, 2024-04-20T12:33:53.041 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 0, 2024-04-20T12:33:53.041 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 0, 2024-04-20T12:33:53.041 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 1, 2024-04-20T12:33:53.041 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 0, 2024-04-20T12:33:53.041 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 0, 2024-04-20T12:33:53.041 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 0, 2024-04-20T12:33:53.041 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 0, 2024-04-20T12:33:53.041 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 0, 2024-04-20T12:33:53.042 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2024-04-20T12:33:53.042 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 0, 2024-04-20T12:33:53.042 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2024-04-20T12:33:53.042 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2024-04-20T12:33:53.042 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 0, 2024-04-20T12:33:53.042 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 0, 2024-04-20T12:33:53.042 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 0, 2024-04-20T12:33:53.042 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 0, 2024-04-20T12:33:53.042 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2024-04-20T12:33:53.042 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 0, 2024-04-20T12:33:53.042 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2024-04-20T12:33:53.042 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 0, 2024-04-20T12:33:53.042 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 0, 2024-04-20T12:33:53.042 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 0, 2024-04-20T12:33:53.042 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 0, 2024-04-20T12:33:53.043 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2024-04-20T12:33:53.043 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2024-04-20T12:33:53.043 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2024-04-20T12:33:53.043 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 0, 2024-04-20T12:33:53.043 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2024-04-20T12:33:53.043 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 0, 2024-04-20T12:33:53.043 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 0, 2024-04-20T12:33:53.043 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 0, 2024-04-20T12:33:53.043 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 0, 2024-04-20T12:33:53.043 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 0, 2024-04-20T12:33:53.043 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2024-04-20T12:33:53.043 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-20T12:33:53.043 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-20T12:33:53.043 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 0, 2024-04-20T12:33:53.043 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 0, 2024-04-20T12:33:53.044 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 0, 2024-04-20T12:33:53.044 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 0 2024-04-20T12:33:53.044 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.044 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2024-04-20T12:33:53.044 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 0, 2024-04-20T12:33:53.044 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 0, 2024-04-20T12:33:53.044 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 0, 2024-04-20T12:33:53.044 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 0, 2024-04-20T12:33:53.044 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 0, 2024-04-20T12:33:53.044 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 0, 2024-04-20T12:33:53.044 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2024-04-20T12:33:53.044 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2024-04-20T12:33:53.044 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 0, 2024-04-20T12:33:53.044 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 0, 2024-04-20T12:33:53.044 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_path": 0, 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_inode": 0, 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 0, 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 0, 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.045 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2024-04-20T12:33:53.046 INFO:teuthology.orchestra.run.smithi139.stdout: "evlrg": 0, 2024-04-20T12:33:53.046 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 0, 2024-04-20T12:33:53.046 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2024-04-20T12:33:53.046 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2024-04-20T12:33:53.046 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 6, 2024-04-20T12:33:53.046 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2024-04-20T12:33:53.046 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2024-04-20T12:33:53.046 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 0, 2024-04-20T12:33:53.046 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2024-04-20T12:33:53.046 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2024-04-20T12:33:53.046 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 2, 2024-04-20T12:33:53.046 INFO:teuthology.orchestra.run.smithi139.stdout: "segmjr": 2, 2024-04-20T12:33:53.046 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2024-04-20T12:33:53.046 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2024-04-20T12:33:53.046 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 4194304, 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 4195956, 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 4195815, 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 6 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 3, 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 3, 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 0, 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 1, 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 1, 2024-04-20T12:33:53.047 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 0, 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 0, 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 0, 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 0, 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 0, 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 0, 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 0, 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 52940, 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 215416 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 0, 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 0, 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 0, 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 0, 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 0, 2024-04-20T12:33:53.048 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2024-04-20T12:33:53.049 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.050 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.050 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.050 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2024-04-20T12:33:53.050 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.050 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.050 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.050 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2024-04-20T12:33:53.050 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.050 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.050 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.050 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.050 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2024-04-20T12:33:53.050 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.051 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.051 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.051 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2024-04-20T12:33:53.051 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.051 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.051 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.051 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.051 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2024-04-20T12:33:53.052 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.052 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.052 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.052 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2024-04-20T12:33:53.052 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.052 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.052 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.052 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2024-04-20T12:33:53.052 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.052 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.052 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.052 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.052 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2024-04-20T12:33:53.053 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.053 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.053 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.053 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.053 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2024-04-20T12:33:53.053 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.054 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.054 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.054 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2024-04-20T12:33:53.054 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.054 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.054 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.054 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2024-04-20T12:33:53.054 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.054 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.054 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.054 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.054 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2024-04-20T12:33:53.055 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.055 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.055 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.055 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2024-04-20T12:33:53.055 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.055 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.055 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.055 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2024-04-20T12:33:53.055 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.055 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.055 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.055 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.055 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2024-04-20T12:33:53.056 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.056 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.056 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.056 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2024-04-20T12:33:53.056 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.056 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.056 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.056 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2024-04-20T12:33:53.056 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.056 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.056 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.056 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.056 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2024-04-20T12:33:53.057 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.058 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.058 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.058 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2024-04-20T12:33:53.058 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.058 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.058 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.058 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2024-04-20T12:33:53.058 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.058 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.058 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.058 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.058 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2024-04-20T12:33:53.059 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.059 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.059 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.059 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2024-04-20T12:33:53.059 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.059 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.059 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.059 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.059 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2024-04-20T12:33:53.059 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2024-04-20T12:33:53.059 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2024-04-20T12:33:53.059 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.059 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.059 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.060 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:53.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.060 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2024-04-20T12:33:53.060 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 0, 2024-04-20T12:33:53.060 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 2, 2024-04-20T12:33:53.060 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 2, 2024-04-20T12:33:53.060 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 2, 2024-04-20T12:33:53.060 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2024-04-20T12:33:53.060 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 0, 2024-04-20T12:33:53.060 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 0, 2024-04-20T12:33:53.060 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 1173, 2024-04-20T12:33:53.060 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2024-04-20T12:33:53.060 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.060 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-04-20T12:33:53.061 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2024-04-20T12:33:53.061 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2024-04-20T12:33:53.061 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-04-20T12:33:53.061 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-04-20T12:33:53.061 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-04-20T12:33:53.061 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-04-20T12:33:53.061 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-20T12:33:53.061 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-04-20T12:33:53.061 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-20T12:33:53.062 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-04-20T12:33:53.062 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-04-20T12:33:53.062 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-04-20T12:33:53.062 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-20T12:33:53.062 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-04-20T12:33:53.062 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-04-20T12:33:53.062 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-04-20T12:33:53.062 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-04-20T12:33:53.062 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-04-20T12:33:53.062 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-20T12:33:53.062 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-04-20T12:33:53.062 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-20T12:33:53.062 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-04-20T12:33:53.062 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-04-20T12:33:53.063 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-04-20T12:33:53.063 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-04-20T12:33:53.063 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-04-20T12:33:53.063 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-20T12:33:53.063 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-04-20T12:33:53.063 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-04-20T12:33:53.063 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-04-20T12:33:53.063 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-04-20T12:33:53.063 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-04-20T12:33:53.063 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-04-20T12:33:53.063 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-04-20T12:33:53.063 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-04-20T12:33:53.063 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-04-20T12:33:53.063 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 181347, 2024-04-20T12:33:53.063 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 49, 2024-04-20T12:33:53.064 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 0, 2024-04-20T12:33:53.064 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 0, 2024-04-20T12:33:53.064 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-04-20T12:33:53.064 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-04-20T12:33:53.064 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-04-20T12:33:53.064 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-04-20T12:33:53.064 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-04-20T12:33:53.064 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-04-20T12:33:53.064 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 9520, 2024-04-20T12:33:53.064 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 183, 2024-04-20T12:33:53.064 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-04-20T12:33:53.064 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-04-20T12:33:53.064 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-04-20T12:33:53.064 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-04-20T12:33:53.064 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 8512, 2024-04-20T12:33:53.065 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 13, 2024-04-20T12:33:53.065 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-04-20T12:33:53.065 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-04-20T12:33:53.065 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-04-20T12:33:53.065 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-04-20T12:33:53.065 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.065 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2024-04-20T12:33:53.065 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2024-04-20T12:33:53.065 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2024-04-20T12:33:53.065 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 2178, 2024-04-20T12:33:53.065 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 21, 2024-04-20T12:33:53.065 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 3, 2024-04-20T12:33:53.065 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 2178, 2024-04-20T12:33:53.065 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2024-04-20T12:33:53.065 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2178, 2024-04-20T12:33:53.066 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 1.791960519, 2024-04-20T12:33:53.066 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000822755 2024-04-20T12:33:53.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.066 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2024-04-20T12:33:53.066 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2024-04-20T12:33:53.066 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2178, 2024-04-20T12:33:53.066 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 2179 2024-04-20T12:33:53.066 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.066 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 2178, 2024-04-20T12:33:53.066 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 2178, 2024-04-20T12:33:53.066 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 0, 2024-04-20T12:33:53.066 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2024-04-20T12:33:53.066 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2024-04-20T12:33:53.066 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 1407, 2024-04-20T12:33:53.066 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 0, 2024-04-20T12:33:53.067 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 769, 2024-04-20T12:33:53.067 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 0, 2024-04-20T12:33:53.067 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 0, 2024-04-20T12:33:53.067 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2024-04-20T12:33:53.067 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2024-04-20T12:33:53.067 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2024-04-20T12:33:53.067 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 0, 2024-04-20T12:33:53.067 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 0, 2024-04-20T12:33:53.067 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2024-04-20T12:33:53.067 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2024-04-20T12:33:53.067 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2024-04-20T12:33:53.067 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 1, 2024-04-20T12:33:53.067 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 0, 2024-04-20T12:33:53.067 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2024-04-20T12:33:53.068 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2024-04-20T12:33:53.068 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2024-04-20T12:33:53.068 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2024-04-20T12:33:53.068 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2024-04-20T12:33:53.068 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2024-04-20T12:33:53.068 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2024-04-20T12:33:53.068 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2024-04-20T12:33:53.068 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2024-04-20T12:33:53.068 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2024-04-20T12:33:53.068 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2024-04-20T12:33:53.068 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2024-04-20T12:33:53.068 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2024-04-20T12:33:53.068 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2024-04-20T12:33:53.068 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2024-04-20T12:33:53.068 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 103, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 13, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 4, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 4, 2024-04-20T12:33:53.069 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2024-04-20T12:33:53.070 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2024-04-20T12:33:53.070 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 0, 2024-04-20T12:33:53.070 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 2, 2024-04-20T12:33:53.070 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 0 2024-04-20T12:33:53.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.070 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2024-04-20T12:33:53.070 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 0, 2024-04-20T12:33:53.070 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2024-04-20T12:33:53.070 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2024-04-20T12:33:53.070 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2024-04-20T12:33:53.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.070 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2024-04-20T12:33:53.070 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2024-04-20T12:33:53.070 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.070 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2024-04-20T12:33:53.071 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2024-04-20T12:33:53.071 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 0, 2024-04-20T12:33:53.071 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2024-04-20T12:33:53.071 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 0, 2024-04-20T12:33:53.071 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed_ops": 0, 2024-04-20T12:33:53.071 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 0, 2024-04-20T12:33:53.071 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2024-04-20T12:33:53.071 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.071 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-20T12:33:53.071 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:53.071 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-20T12:33:53.071 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:53.071 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 2434, 2024-04-20T12:33:53.071 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 2031088, 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 2434, 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2434, 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 2031088, 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-20T12:33:53.072 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-20T12:33:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-20T12:33:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 2178, 2024-04-20T12:33:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 1657, 2024-04-20T12:33:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2178, 2024-04-20T12:33:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 1657, 2024-04-20T12:33:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2024-04-20T12:33:53.074 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:53.074 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2024-04-20T12:33:53.074 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:53.074 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-20T12:33:53.074 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-20T12:33:53.074 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:53.074 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:53.074 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 2178, 2024-04-20T12:33:53.074 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 2178, 2024-04-20T12:33:53.074 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2178, 2024-04-20T12:33:53.074 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 2178, 2024-04-20T12:33:53.074 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:53.074 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.074 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.074 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:53.075 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x5624abd346e0": { 2024-04-20T12:33:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-20T12:33:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-20T12:33:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-20T12:33:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-20T12:33:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-20T12:33:53.076 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2024-04-20T12:33:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2024-04-20T12:33:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:53.077 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:53.077 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-20T12:33:53.114 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:52 smithi135 ceph-mon[18264]: pgmap v333: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:53.846 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-04-20T12:33:53.846 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-04-20T12:33:53.846 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-04-20T12:33:53.846 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-04-20T12:33:53.846 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-04-20T12:33:53.846 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-04-20T12:33:53.846 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-04-20T12:33:53.846 DEBUG:tasks.check_counter:Getting stats from h 2024-04-20T12:33:53.847 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph daemon mds.h perf dump 2024-04-20T12:33:54.095 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.b/config 2024-04-20T12:33:55.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:54 smithi154 ceph-mon[22073]: pgmap v334: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:55.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:54 smithi139 ceph-mon[21834]: pgmap v334: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:55.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:54 smithi135 ceph-mon[18264]: pgmap v334: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:33:55.798 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-20T12:33:55.798 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-04-20T12:33:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 1557, 2024-04-20T12:33:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 1559, 2024-04-20T12:33:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 4650615, 2024-04-20T12:33:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 495136, 2024-04-20T12:33:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 6, 2024-04-20T12:33:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 2, 2024-04-20T12:33:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.141738068, 2024-04-20T12:33:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.053356749, 2024-04-20T12:33:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.031996467, 2024-04-20T12:33:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.042820548, 2024-04-20T12:33:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1557, 2024-04-20T12:33:55.799 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.057350771, 2024-04-20T12:33:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000036834 2024-04-20T12:33:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-20T12:33:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 0 2024-04-20T12:33:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-04-20T12:33:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 842, 2024-04-20T12:33:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 825, 2024-04-20T12:33:55.800 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 8478989, 2024-04-20T12:33:55.801 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 323966, 2024-04-20T12:33:55.801 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 4, 2024-04-20T12:33:55.801 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 3, 2024-04-20T12:33:55.801 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.098881064, 2024-04-20T12:33:55.801 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.028752597, 2024-04-20T12:33:55.801 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.054898977, 2024-04-20T12:33:55.801 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.020049781, 2024-04-20T12:33:55.801 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:55.801 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 825, 2024-04-20T12:33:55.801 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.044448125, 2024-04-20T12:33:55.801 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000053876 2024-04-20T12:33:55.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.801 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:55.801 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.802 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.802 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.802 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 1646016, 2024-04-20T12:33:55.802 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 137552 2024-04-20T12:33:55.802 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.802 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-04-20T12:33:55.802 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 259, 2024-04-20T12:33:55.802 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 423, 2024-04-20T12:33:55.802 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 4258385, 2024-04-20T12:33:55.802 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 532945, 2024-04-20T12:33:55.802 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 6, 2024-04-20T12:33:55.802 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 4, 2024-04-20T12:33:55.802 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.033276894, 2024-04-20T12:33:55.803 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.012367578, 2024-04-20T12:33:55.803 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.009044691, 2024-04-20T12:33:55.803 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.008241981, 2024-04-20T12:33:55.803 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:55.803 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 420, 2024-04-20T12:33:55.803 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.025004566, 2024-04-20T12:33:55.803 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000059534 2024-04-20T12:33:55.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.803 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:55.803 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.803 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.803 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.803 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.803 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 320, 2024-04-20T12:33:55.804 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 451536 2024-04-20T12:33:55.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.804 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-04-20T12:33:55.804 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2024-04-20T12:33:55.804 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-04-20T12:33:55.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.804 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2024-04-20T12:33:55.804 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-20T12:33:55.804 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-20T12:33:55.804 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 4001, 2024-04-20T12:33:55.804 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.097690771, 2024-04-20T12:33:55.804 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000024416 2024-04-20T12:33:55.804 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:55.804 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.804 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2024-04-20T12:33:55.805 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-20T12:33:55.805 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-20T12:33:55.805 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.805 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.805 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.805 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:55.805 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.805 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2024-04-20T12:33:55.805 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 0, 2024-04-20T12:33:55.805 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 0, 2024-04-20T12:33:55.805 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2024-04-20T12:33:55.805 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.805 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.805 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.806 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.806 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2024-04-20T12:33:55.806 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 0, 2024-04-20T12:33:55.806 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 0, 2024-04-20T12:33:55.806 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2024-04-20T12:33:55.806 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 0, 2024-04-20T12:33:55.806 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 0, 2024-04-20T12:33:55.806 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2024-04-20T12:33:55.806 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 1238, 2024-04-20T12:33:55.806 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 350, 2024-04-20T12:33:55.806 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 888, 2024-04-20T12:33:55.806 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 0, 2024-04-20T12:33:55.806 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 740, 2024-04-20T12:33:55.806 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 0, 2024-04-20T12:33:55.807 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 0, 2024-04-20T12:33:55.807 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 0, 2024-04-20T12:33:55.807 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 2, 2024-04-20T12:33:55.807 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 0, 2024-04-20T12:33:55.807 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 0, 2024-04-20T12:33:55.807 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 0, 2024-04-20T12:33:55.807 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 0, 2024-04-20T12:33:55.807 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 0, 2024-04-20T12:33:55.807 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2024-04-20T12:33:55.807 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 0, 2024-04-20T12:33:55.807 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2024-04-20T12:33:55.807 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2024-04-20T12:33:55.807 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 0, 2024-04-20T12:33:55.807 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 0, 2024-04-20T12:33:55.808 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 0, 2024-04-20T12:33:55.808 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 0, 2024-04-20T12:33:55.808 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2024-04-20T12:33:55.808 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 0, 2024-04-20T12:33:55.808 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2024-04-20T12:33:55.808 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 4, 2024-04-20T12:33:55.808 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 234, 2024-04-20T12:33:55.808 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 6, 2024-04-20T12:33:55.808 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 0, 2024-04-20T12:33:55.808 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2024-04-20T12:33:55.808 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2024-04-20T12:33:55.808 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2024-04-20T12:33:55.808 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 0, 2024-04-20T12:33:55.808 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2024-04-20T12:33:55.808 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 0, 2024-04-20T12:33:55.809 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 0, 2024-04-20T12:33:55.809 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 0, 2024-04-20T12:33:55.809 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 0, 2024-04-20T12:33:55.809 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 0, 2024-04-20T12:33:55.809 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2024-04-20T12:33:55.809 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-20T12:33:55.809 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-20T12:33:55.809 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 0, 2024-04-20T12:33:55.809 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 0, 2024-04-20T12:33:55.809 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 0, 2024-04-20T12:33:55.809 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 0 2024-04-20T12:33:55.809 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.809 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2024-04-20T12:33:55.809 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 0, 2024-04-20T12:33:55.809 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 0, 2024-04-20T12:33:55.810 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 0, 2024-04-20T12:33:55.810 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 0, 2024-04-20T12:33:55.810 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 0, 2024-04-20T12:33:55.810 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 0, 2024-04-20T12:33:55.810 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2024-04-20T12:33:55.810 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2024-04-20T12:33:55.810 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 0, 2024-04-20T12:33:55.810 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 0, 2024-04-20T12:33:55.810 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2024-04-20T12:33:55.810 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2024-04-20T12:33:55.810 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2024-04-20T12:33:55.810 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2024-04-20T12:33:55.810 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2024-04-20T12:33:55.810 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2024-04-20T12:33:55.811 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2024-04-20T12:33:55.811 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_path": 0, 2024-04-20T12:33:55.811 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_inode": 0, 2024-04-20T12:33:55.811 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2024-04-20T12:33:55.811 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 0, 2024-04-20T12:33:55.811 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2024-04-20T12:33:55.811 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 0, 2024-04-20T12:33:55.811 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2024-04-20T12:33:55.811 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2024-04-20T12:33:55.811 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.811 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2024-04-20T12:33:55.811 INFO:teuthology.orchestra.run.smithi139.stdout: "evlrg": 0, 2024-04-20T12:33:55.811 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 0, 2024-04-20T12:33:55.811 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2024-04-20T12:33:55.811 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2024-04-20T12:33:55.812 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 6194, 2024-04-20T12:33:55.812 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2024-04-20T12:33:55.812 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2024-04-20T12:33:55.812 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 0, 2024-04-20T12:33:55.812 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2024-04-20T12:33:55.812 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2024-04-20T12:33:55.812 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 5, 2024-04-20T12:33:55.812 INFO:teuthology.orchestra.run.smithi139.stdout: "segmjr": 10, 2024-04-20T12:33:55.812 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2024-04-20T12:33:55.812 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2024-04-20T12:33:55.812 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 10260043, 2024-04-20T12:33:55.812 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 19262465, 2024-04-20T12:33:55.812 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 19262329, 2024-04-20T12:33:55.812 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2024-04-20T12:33:55.812 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.813 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.813 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.813 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 6194 2024-04-20T12:33:55.813 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.813 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2024-04-20T12:33:55.813 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 24, 2024-04-20T12:33:55.813 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 1234, 2024-04-20T12:33:55.813 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 1210, 2024-04-20T12:33:55.813 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 18, 2024-04-20T12:33:55.813 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 22, 2024-04-20T12:33:55.813 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 4, 2024-04-20T12:33:55.813 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 1238, 2024-04-20T12:33:55.813 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 1243, 2024-04-20T12:33:55.813 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 5, 2024-04-20T12:33:55.814 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 0, 2024-04-20T12:33:55.814 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 0, 2024-04-20T12:33:55.814 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 0, 2024-04-20T12:33:55.814 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 55008, 2024-04-20T12:33:55.814 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 215416 2024-04-20T12:33:55.814 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.814 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2024-04-20T12:33:55.814 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 0, 2024-04-20T12:33:55.814 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 0, 2024-04-20T12:33:55.814 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 0, 2024-04-20T12:33:55.814 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 0, 2024-04-20T12:33:55.814 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 0, 2024-04-20T12:33:55.814 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2024-04-20T12:33:55.814 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.815 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.815 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.815 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2024-04-20T12:33:55.815 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.815 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.815 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.815 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2024-04-20T12:33:55.815 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.815 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.815 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.815 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.815 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2024-04-20T12:33:55.815 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.816 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.816 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.816 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2024-04-20T12:33:55.816 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.816 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.816 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.816 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2024-04-20T12:33:55.816 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.816 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.816 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.816 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.816 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2024-04-20T12:33:55.816 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.817 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.817 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.817 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2024-04-20T12:33:55.817 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.817 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.817 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.817 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2024-04-20T12:33:55.817 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.817 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.817 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.817 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.817 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2024-04-20T12:33:55.817 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.818 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.818 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.818 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2024-04-20T12:33:55.818 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.818 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.818 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.818 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.818 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2024-04-20T12:33:55.819 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.819 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.819 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.819 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2024-04-20T12:33:55.819 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.819 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.819 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.819 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.820 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2024-04-20T12:33:55.820 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.820 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.820 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.820 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2024-04-20T12:33:55.820 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.820 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.820 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.820 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2024-04-20T12:33:55.820 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.820 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.820 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.820 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.821 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2024-04-20T12:33:55.821 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.821 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.821 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.821 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2024-04-20T12:33:55.821 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.821 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.821 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.821 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.821 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2024-04-20T12:33:55.821 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.821 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.821 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.822 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2024-04-20T12:33:55.822 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.822 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.822 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.822 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2024-04-20T12:33:55.822 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.822 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.822 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.822 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.822 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2024-04-20T12:33:55.822 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.822 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.823 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.823 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2024-04-20T12:33:55.823 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.823 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.823 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.823 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2024-04-20T12:33:55.823 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.823 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.823 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.823 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.823 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2024-04-20T12:33:55.823 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.823 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.824 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.824 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2024-04-20T12:33:55.824 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.824 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.824 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.824 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2024-04-20T12:33:55.824 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.824 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.824 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.824 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.824 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2024-04-20T12:33:55.824 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.824 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.825 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.825 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2024-04-20T12:33:55.825 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.825 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.825 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.825 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2024-04-20T12:33:55.825 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2024-04-20T12:33:55.825 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2024-04-20T12:33:55.825 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.825 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.825 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.825 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:55.825 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.826 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2024-04-20T12:33:55.826 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 2, 2024-04-20T12:33:55.826 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 7, 2024-04-20T12:33:55.826 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 5, 2024-04-20T12:33:55.826 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 5, 2024-04-20T12:33:55.826 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2024-04-20T12:33:55.826 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 0, 2024-04-20T12:33:55.826 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 0, 2024-04-20T12:33:55.826 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 3360, 2024-04-20T12:33:55.826 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2024-04-20T12:33:55.826 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.826 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-04-20T12:33:55.826 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2024-04-20T12:33:55.826 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2024-04-20T12:33:55.827 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-04-20T12:33:55.827 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-04-20T12:33:55.827 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-04-20T12:33:55.827 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-04-20T12:33:55.827 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-20T12:33:55.827 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-04-20T12:33:55.827 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-20T12:33:55.827 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-04-20T12:33:55.827 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-04-20T12:33:55.827 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-04-20T12:33:55.827 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-20T12:33:55.827 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-04-20T12:33:55.827 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-04-20T12:33:55.827 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-04-20T12:33:55.827 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-04-20T12:33:55.828 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-04-20T12:33:55.828 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-20T12:33:55.828 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-04-20T12:33:55.828 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-20T12:33:55.828 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-04-20T12:33:55.828 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-04-20T12:33:55.828 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-04-20T12:33:55.828 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-04-20T12:33:55.828 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-04-20T12:33:55.828 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-20T12:33:55.828 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-04-20T12:33:55.828 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-04-20T12:33:55.828 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-04-20T12:33:55.828 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-04-20T12:33:55.829 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-04-20T12:33:55.829 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-04-20T12:33:55.829 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-04-20T12:33:55.829 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-04-20T12:33:55.829 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-04-20T12:33:55.829 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 189655, 2024-04-20T12:33:55.829 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 58, 2024-04-20T12:33:55.829 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 0, 2024-04-20T12:33:55.829 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 0, 2024-04-20T12:33:55.829 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-04-20T12:33:55.829 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-04-20T12:33:55.829 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-04-20T12:33:55.829 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-04-20T12:33:55.829 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-04-20T12:33:55.829 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-04-20T12:33:55.830 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 9520, 2024-04-20T12:33:55.830 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 183, 2024-04-20T12:33:55.830 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-04-20T12:33:55.830 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-04-20T12:33:55.830 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-04-20T12:33:55.830 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-04-20T12:33:55.830 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 963922, 2024-04-20T12:33:55.830 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 5518, 2024-04-20T12:33:55.830 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-04-20T12:33:55.830 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-04-20T12:33:55.830 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-04-20T12:33:55.830 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-04-20T12:33:55.830 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.830 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2024-04-20T12:33:55.831 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2024-04-20T12:33:55.831 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2024-04-20T12:33:55.831 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 2399, 2024-04-20T12:33:55.831 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 26, 2024-04-20T12:33:55.831 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 4, 2024-04-20T12:33:55.831 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 2399, 2024-04-20T12:33:55.831 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2024-04-20T12:33:55.831 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2399, 2024-04-20T12:33:55.831 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 1.599964798, 2024-04-20T12:33:55.831 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000666929 2024-04-20T12:33:55.831 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.831 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2024-04-20T12:33:55.831 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2024-04-20T12:33:55.831 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2399, 2024-04-20T12:33:55.831 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 2400 2024-04-20T12:33:55.832 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.832 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 2399, 2024-04-20T12:33:55.832 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 2399, 2024-04-20T12:33:55.832 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 0, 2024-04-20T12:33:55.832 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2024-04-20T12:33:55.832 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2024-04-20T12:33:55.832 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 1539, 2024-04-20T12:33:55.832 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 0, 2024-04-20T12:33:55.832 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 857, 2024-04-20T12:33:55.832 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 0, 2024-04-20T12:33:55.832 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 0, 2024-04-20T12:33:55.832 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2024-04-20T12:33:55.832 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2024-04-20T12:33:55.832 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2024-04-20T12:33:55.832 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 0, 2024-04-20T12:33:55.833 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 0, 2024-04-20T12:33:55.833 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2024-04-20T12:33:55.833 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2024-04-20T12:33:55.833 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2024-04-20T12:33:55.833 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 2, 2024-04-20T12:33:55.833 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 0, 2024-04-20T12:33:55.833 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2024-04-20T12:33:55.833 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2024-04-20T12:33:55.833 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2024-04-20T12:33:55.833 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2024-04-20T12:33:55.833 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2024-04-20T12:33:55.833 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2024-04-20T12:33:55.833 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2024-04-20T12:33:55.833 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2024-04-20T12:33:55.833 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2024-04-20T12:33:55.834 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2024-04-20T12:33:55.834 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2024-04-20T12:33:55.834 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2024-04-20T12:33:55.834 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2024-04-20T12:33:55.834 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2024-04-20T12:33:55.834 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2024-04-20T12:33:55.834 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2024-04-20T12:33:55.834 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2024-04-20T12:33:55.834 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2024-04-20T12:33:55.834 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2024-04-20T12:33:55.834 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2024-04-20T12:33:55.834 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2024-04-20T12:33:55.834 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2024-04-20T12:33:55.834 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2024-04-20T12:33:55.834 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2024-04-20T12:33:55.835 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2024-04-20T12:33:55.835 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2024-04-20T12:33:55.835 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 103, 2024-04-20T12:33:55.835 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2024-04-20T12:33:55.835 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 13, 2024-04-20T12:33:55.835 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 5, 2024-04-20T12:33:55.835 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 5, 2024-04-20T12:33:55.835 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2024-04-20T12:33:55.835 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2024-04-20T12:33:55.835 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 0, 2024-04-20T12:33:55.835 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 2, 2024-04-20T12:33:55.835 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 0 2024-04-20T12:33:55.835 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.835 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2024-04-20T12:33:55.835 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 0, 2024-04-20T12:33:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2024-04-20T12:33:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2024-04-20T12:33:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2024-04-20T12:33:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2024-04-20T12:33:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2024-04-20T12:33:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2024-04-20T12:33:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2024-04-20T12:33:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 0, 2024-04-20T12:33:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2024-04-20T12:33:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 0, 2024-04-20T12:33:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed_ops": 0, 2024-04-20T12:33:55.836 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 0, 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 2654, 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 17133162, 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 2654, 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2654, 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 17133162, 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:55.837 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.838 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.838 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.838 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:55.838 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.838 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2024-04-20T12:33:55.838 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:55.838 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-20T12:33:55.838 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:55.838 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-20T12:33:55.838 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-20T12:33:55.838 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:55.838 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:55.838 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 2399, 2024-04-20T12:33:55.838 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 15068171, 2024-04-20T12:33:55.839 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2399, 2024-04-20T12:33:55.839 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 15068171, 2024-04-20T12:33:55.839 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:55.839 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.839 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.839 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.839 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:55.839 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.839 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2024-04-20T12:33:55.839 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:55.839 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2024-04-20T12:33:55.839 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:55.839 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-20T12:33:55.840 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-20T12:33:55.840 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:55.840 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:55.840 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 2399, 2024-04-20T12:33:55.840 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 2399, 2024-04-20T12:33:55.840 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2399, 2024-04-20T12:33:55.840 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 2399, 2024-04-20T12:33:55.840 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:55.840 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.840 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.840 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.840 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:55.840 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.840 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2024-04-20T12:33:55.840 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:55.841 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-20T12:33:55.841 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:55.841 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-20T12:33:55.841 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-20T12:33:55.841 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:55.841 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:55.841 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-20T12:33:55.841 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-20T12:33:55.841 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2024-04-20T12:33:55.841 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2024-04-20T12:33:55.841 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:55.841 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.841 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.841 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.841 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:55.842 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:55.842 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x55f7f97106e0": { 2024-04-20T12:33:55.842 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:55.842 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-20T12:33:55.842 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:55.842 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-20T12:33:55.842 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-20T12:33:55.842 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:55.842 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:55.842 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-20T12:33:55.842 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-20T12:33:55.842 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2024-04-20T12:33:55.842 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2024-04-20T12:33:55.842 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:55.843 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:55.843 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:55.843 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:55.843 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:55.843 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:55.843 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-20T12:33:56.619 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-04-20T12:33:56.619 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-04-20T12:33:56.619 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-04-20T12:33:56.619 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-04-20T12:33:56.619 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-04-20T12:33:56.619 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-04-20T12:33:56.619 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-04-20T12:33:56.620 DEBUG:tasks.check_counter:Getting stats from k 2024-04-20T12:33:56.620 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph daemon mds.k perf dump 2024-04-20T12:33:56.857 INFO:teuthology.orchestra.run.smithi139.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.b/config 2024-04-20T12:33:56.979 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:56 smithi139 ceph-mon[21834]: pgmap v335: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:57.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:56 smithi154 ceph-mon[22073]: pgmap v335: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:57.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:56 smithi135 ceph-mon[18264]: pgmap v335: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:58.632 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2024-04-20T12:33:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-0": { 2024-04-20T12:33:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 1026, 2024-04-20T12:33:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 1011, 2024-04-20T12:33:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 1902864, 2024-04-20T12:33:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 385004, 2024-04-20T12:33:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 5, 2024-04-20T12:33:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 1, 2024-04-20T12:33:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.136307033, 2024-04-20T12:33:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.050621307, 2024-04-20T12:33:58.633 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.057272934, 2024-04-20T12:33:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.028349156, 2024-04-20T12:33:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 1010, 2024-04-20T12:33:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.059949811, 2024-04-20T12:33:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000059356 2024-04-20T12:33:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 1644144, 2024-04-20T12:33:58.634 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 140144 2024-04-20T12:33:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-1": { 2024-04-20T12:33:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 660, 2024-04-20T12:33:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 827, 2024-04-20T12:33:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 164928, 2024-04-20T12:33:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 660728, 2024-04-20T12:33:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 7, 2024-04-20T12:33:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 5, 2024-04-20T12:33:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.071948197, 2024-04-20T12:33:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.020859838, 2024-04-20T12:33:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.017645988, 2024-04-20T12:33:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.024901186, 2024-04-20T12:33:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:58.635 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 825, 2024-04-20T12:33:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.037585764, 2024-04-20T12:33:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000045558 2024-04-20T12:33:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-04-20T12:33:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 452688 2024-04-20T12:33:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "AsyncMessenger::Worker-2": { 2024-04-20T12:33:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_messages": 776, 2024-04-20T12:33:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages": 778, 2024-04-20T12:33:58.636 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_bytes": 204925, 2024-04-20T12:33:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_bytes": 246769, 2024-04-20T12:33:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_created_connections": 4, 2024-04-20T12:33:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_active_connections": 3, 2024-04-20T12:33:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_total_time": 0.062379838, 2024-04-20T12:33:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_send_time": 0.018308230, 2024-04-20T12:33:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_recv_time": 0.018201906, 2024-04-20T12:33:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_running_fast_dispatch_time": 0.020174297, 2024-04-20T12:33:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:33:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 776, 2024-04-20T12:33:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.023961884, 2024-04-20T12:33:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000030878 2024-04-20T12:33:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.637 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:33:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-20T12:33:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "msgr_send_encrypted_bytes": 0 2024-04-20T12:33:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "cct": { 2024-04-20T12:33:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "total_workers": 1, 2024-04-20T12:33:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "unhealthy_workers": 0 2024-04-20T12:33:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-MDSRank": { 2024-04-20T12:33:58.638 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-20T12:33:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-20T12:33:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 3563, 2024-04-20T12:33:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.091640562, 2024-04-20T12:33:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000025720 2024-04-20T12:33:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "finisher-PurgeQueue": { 2024-04-20T12:33:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "queue_len": 0, 2024-04-20T12:33:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "complete_latency": { 2024-04-20T12:33:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.639 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:58.640 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.640 INFO:teuthology.orchestra.run.smithi139.stdout: "mds": { 2024-04-20T12:33:58.640 INFO:teuthology.orchestra.run.smithi139.stdout: "request": 0, 2024-04-20T12:33:58.640 INFO:teuthology.orchestra.run.smithi139.stdout: "reply": 0, 2024-04-20T12:33:58.640 INFO:teuthology.orchestra.run.smithi139.stdout: "reply_latency": { 2024-04-20T12:33:58.640 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_reply": 0, 2024-04-20T12:33:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "forward": 0, 2024-04-20T12:33:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_complete": 0, 2024-04-20T12:33:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_fetch_keys": 0, 2024-04-20T12:33:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_commit": 0, 2024-04-20T12:33:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_split": 0, 2024-04-20T12:33:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_merge": 0, 2024-04-20T12:33:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes": 0, 2024-04-20T12:33:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_top": 0, 2024-04-20T12:33:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_bottom": 0, 2024-04-20T12:33:58.641 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pin_tail": 0, 2024-04-20T12:33:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_pinned": 0, 2024-04-20T12:33:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_expired": 0, 2024-04-20T12:33:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "inodes_with_caps": 0, 2024-04-20T12:33:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "caps": 0, 2024-04-20T12:33:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "subtrees": 1, 2024-04-20T12:33:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse": 0, 2024-04-20T12:33:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_hit": 0, 2024-04-20T12:33:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_forward": 0, 2024-04-20T12:33:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_discover": 0, 2024-04-20T12:33:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_dir_fetch": 0, 2024-04-20T12:33:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_remote_ino": 0, 2024-04-20T12:33:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "traverse_lock": 0, 2024-04-20T12:33:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "load_cent": 0, 2024-04-20T12:33:58.642 INFO:teuthology.orchestra.run.smithi139.stdout: "q": 0, 2024-04-20T12:33:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "exported": 0, 2024-04-20T12:33:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "exported_inodes": 0, 2024-04-20T12:33:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "imported": 0, 2024-04-20T12:33:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "imported_inodes": 0, 2024-04-20T12:33:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_dir_fetch": 0, 2024-04-20T12:33:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_backtrace_fetch": 0, 2024-04-20T12:33:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "openino_peer_discover": 0, 2024-04-20T12:33:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rfiles": 0, 2024-04-20T12:33:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rbytes": 0, 2024-04-20T12:33:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "root_rsnaps": 0, 2024-04-20T12:33:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_fetch": 0, 2024-04-20T12:33:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_set_tag": 0, 2024-04-20T12:33:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_backtrace_repaired": 0, 2024-04-20T12:33:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_inotable_repaired": 0, 2024-04-20T12:33:58.643 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_inodes": 0, 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dir_base_inodes": 0, 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_dirfrag_rstats": 0, 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "scrub_file_inodes": 0, 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_inode_file_caps": 0, 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_revoke": 0, 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_grant": 0, 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_trunc": 0, 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps": 0, 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_caps_dirty": 0, 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_cap_release": 0, 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "process_request_cap_release": 0 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_cache": { 2024-04-20T12:33:58.644 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_update_receipt": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_try_discover": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_send_discover": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "dir_handle_discover": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_delayed": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "num_strays_enqueuing": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_created": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_enqueued": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_reintegrated": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "strays_migrated": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_processing": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_enqueued": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "num_recovering_prioritized": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_started": 0, 2024-04-20T12:33:58.645 INFO:teuthology.orchestra.run.smithi139.stdout: "recovery_completed": 0, 2024-04-20T12:33:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_path": 0, 2024-04-20T12:33:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_quiesce_inode": 0, 2024-04-20T12:33:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_enqueue_scrub": 0, 2024-04-20T12:33:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_exportdir": 0, 2024-04-20T12:33:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_flush": 0, 2024-04-20T12:33:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragmentdir": 0, 2024-04-20T12:33:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_fragstats": 0, 2024-04-20T12:33:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "ireq_inodestats": 0 2024-04-20T12:33:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_log": { 2024-04-20T12:33:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "evlrg": 0, 2024-04-20T12:33:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "evadd": 0, 2024-04-20T12:33:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "evex": 0, 2024-04-20T12:33:58.646 INFO:teuthology.orchestra.run.smithi139.stdout: "evtrm": 0, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "ev": 6, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "evexg": 0, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "evexd": 0, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "segadd": 0, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "segex": 0, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "segtrm": 0, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "seg": 2, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "segmjr": 2, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "segexg": 0, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "segexd": 0, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "expos": 4194304, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "wrpos": 4195956, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "rdpos": 4195815, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "jlat": { 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.647 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "replayed": 6 2024-04-20T12:33:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_mem": { 2024-04-20T12:33:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "ino": 3, 2024-04-20T12:33:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "ino+": 3, 2024-04-20T12:33:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "ino-": 0, 2024-04-20T12:33:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "dir": 1, 2024-04-20T12:33:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "dir+": 1, 2024-04-20T12:33:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "dir-": 0, 2024-04-20T12:33:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "dn": 0, 2024-04-20T12:33:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "dn+": 0, 2024-04-20T12:33:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "dn-": 0, 2024-04-20T12:33:58.648 INFO:teuthology.orchestra.run.smithi139.stdout: "cap": 0, 2024-04-20T12:33:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "cap+": 0, 2024-04-20T12:33:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "cap-": 0, 2024-04-20T12:33:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "rss": 50568, 2024-04-20T12:33:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "heap": 215416 2024-04-20T12:33:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_server": { 2024-04-20T12:33:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_client_request": 0, 2024-04-20T12:33:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "dispatch_server_request": 0, 2024-04-20T12:33:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_request": 0, 2024-04-20T12:33:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_client_session": 0, 2024-04-20T12:33:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "handle_peer_request": 0, 2024-04-20T12:33:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "req_create_latency": { 2024-04-20T12:33:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.649 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getattr_latency": { 2024-04-20T12:33:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.650 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getfilelock_latency": { 2024-04-20T12:33:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: "req_link_latency": { 2024-04-20T12:33:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookup_latency": { 2024-04-20T12:33:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.651 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookuphash_latency": { 2024-04-20T12:33:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupino_latency": { 2024-04-20T12:33:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.652 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupname_latency": { 2024-04-20T12:33:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.653 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupparent_latency": { 2024-04-20T12:33:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lookupsnap_latency": { 2024-04-20T12:33:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.654 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: "req_lssnap_latency": { 2024-04-20T12:33:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.655 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mkdir_latency": { 2024-04-20T12:33:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.656 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mknod_latency": { 2024-04-20T12:33:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: "req_mksnap_latency": { 2024-04-20T12:33:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: "req_open_latency": { 2024-04-20T12:33:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.657 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: "req_readdir_latency": { 2024-04-20T12:33:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rename_latency": { 2024-04-20T12:33:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: "req_renamesnap_latency": { 2024-04-20T12:33:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.658 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: "req_snapdiff_latency": { 2024-04-20T12:33:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmdir_latency": { 2024-04-20T12:33:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmsnap_latency": { 2024-04-20T12:33:58.659 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.660 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.660 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.660 INFO:teuthology.orchestra.run.smithi139.stdout: "req_rmxattr_latency": { 2024-04-20T12:33:58.660 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.660 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.660 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.660 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setattr_latency": { 2024-04-20T12:33:58.660 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.660 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.660 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.660 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.661 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setdirlayout_latency": { 2024-04-20T12:33:58.661 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.661 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.661 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.661 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setfilelock_latency": { 2024-04-20T12:33:58.661 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.661 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.661 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.661 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.662 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setlayout_latency": { 2024-04-20T12:33:58.662 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.662 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.662 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.662 INFO:teuthology.orchestra.run.smithi139.stdout: "req_setxattr_latency": { 2024-04-20T12:33:58.662 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.662 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.662 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.662 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.663 INFO:teuthology.orchestra.run.smithi139.stdout: "req_symlink_latency": { 2024-04-20T12:33:58.663 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.663 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.663 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.663 INFO:teuthology.orchestra.run.smithi139.stdout: "req_unlink_latency": { 2024-04-20T12:33:58.663 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.663 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.663 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.663 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.664 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_revoke_eviction": 0, 2024-04-20T12:33:58.664 INFO:teuthology.orchestra.run.smithi139.stdout: "cap_acquisition_throttle": 0, 2024-04-20T12:33:58.664 INFO:teuthology.orchestra.run.smithi139.stdout: "req_getvxattr_latency": { 2024-04-20T12:33:58.664 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.664 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.664 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.664 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:58.664 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.664 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_sessions": { 2024-04-20T12:33:58.664 INFO:teuthology.orchestra.run.smithi139.stdout: "session_count": 0, 2024-04-20T12:33:58.664 INFO:teuthology.orchestra.run.smithi139.stdout: "session_add": 2, 2024-04-20T12:33:58.664 INFO:teuthology.orchestra.run.smithi139.stdout: "session_remove": 2, 2024-04-20T12:33:58.664 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_open": 2, 2024-04-20T12:33:58.664 INFO:teuthology.orchestra.run.smithi139.stdout: "sessions_stale": 0, 2024-04-20T12:33:58.665 INFO:teuthology.orchestra.run.smithi139.stdout: "total_load": 0, 2024-04-20T12:33:58.665 INFO:teuthology.orchestra.run.smithi139.stdout: "average_load": 0, 2024-04-20T12:33:58.665 INFO:teuthology.orchestra.run.smithi139.stdout: "avg_session_uptime": 1174, 2024-04-20T12:33:58.665 INFO:teuthology.orchestra.run.smithi139.stdout: "mdthresh_evicted": 0 2024-04-20T12:33:58.665 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.665 INFO:teuthology.orchestra.run.smithi139.stdout: "mempool": { 2024-04-20T12:33:58.665 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_bytes": 0, 2024-04-20T12:33:58.665 INFO:teuthology.orchestra.run.smithi139.stdout: "bloom_filter_items": 0, 2024-04-20T12:33:58.665 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_bytes": 0, 2024-04-20T12:33:58.665 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_alloc_items": 0, 2024-04-20T12:33:58.665 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_bytes": 0, 2024-04-20T12:33:58.665 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_data_items": 0, 2024-04-20T12:33:58.665 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-20T12:33:58.665 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_onode_items": 0, 2024-04-20T12:33:58.665 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-20T12:33:58.666 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_meta_items": 0, 2024-04-20T12:33:58.666 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_bytes": 0, 2024-04-20T12:33:58.666 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_other_items": 0, 2024-04-20T12:33:58.666 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-20T12:33:58.666 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_cache_buffer_items": 0, 2024-04-20T12:33:58.666 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_bytes": 0, 2024-04-20T12:33:58.666 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_extent_items": 0, 2024-04-20T12:33:58.666 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_bytes": 0, 2024-04-20T12:33:58.666 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_blob_items": 0, 2024-04-20T12:33:58.666 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-20T12:33:58.666 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_shared_blob_items": 0, 2024-04-20T12:33:58.666 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-20T12:33:58.666 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_inline_bl_items": 0, 2024-04-20T12:33:58.667 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_bytes": 0, 2024-04-20T12:33:58.667 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_fsck_items": 0, 2024-04-20T12:33:58.667 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_bytes": 0, 2024-04-20T12:33:58.667 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_txc_items": 0, 2024-04-20T12:33:58.667 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-20T12:33:58.667 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_deferred_items": 0, 2024-04-20T12:33:58.667 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_bytes": 0, 2024-04-20T12:33:58.667 INFO:teuthology.orchestra.run.smithi139.stdout: "bluestore_writing_items": 0, 2024-04-20T12:33:58.667 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_bytes": 0, 2024-04-20T12:33:58.667 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_items": 0, 2024-04-20T12:33:58.667 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_bytes": 0, 2024-04-20T12:33:58.667 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_reader_items": 0, 2024-04-20T12:33:58.667 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_bytes": 0, 2024-04-20T12:33:58.668 INFO:teuthology.orchestra.run.smithi139.stdout: "bluefs_file_writer_items": 0, 2024-04-20T12:33:58.668 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_bytes": 191182, 2024-04-20T12:33:58.668 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_anon_items": 52, 2024-04-20T12:33:58.668 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_bytes": 0, 2024-04-20T12:33:58.668 INFO:teuthology.orchestra.run.smithi139.stdout: "buffer_meta_items": 0, 2024-04-20T12:33:58.668 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_bytes": 0, 2024-04-20T12:33:58.668 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_items": 0, 2024-04-20T12:33:58.668 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_bytes": 0, 2024-04-20T12:33:58.668 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_mapbl_items": 0, 2024-04-20T12:33:58.668 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_bytes": 0, 2024-04-20T12:33:58.668 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_pglog_items": 0, 2024-04-20T12:33:58.669 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_bytes": 9520, 2024-04-20T12:33:58.669 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_items": 183, 2024-04-20T12:33:58.669 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_bytes": 0, 2024-04-20T12:33:58.669 INFO:teuthology.orchestra.run.smithi139.stdout: "osdmap_mapping_items": 0, 2024-04-20T12:33:58.669 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_bytes": 0, 2024-04-20T12:33:58.669 INFO:teuthology.orchestra.run.smithi139.stdout: "pgmap_items": 0, 2024-04-20T12:33:58.669 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_bytes": 8512, 2024-04-20T12:33:58.669 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_co_items": 13, 2024-04-20T12:33:58.669 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_bytes": 0, 2024-04-20T12:33:58.669 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_1_items": 0, 2024-04-20T12:33:58.669 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_bytes": 0, 2024-04-20T12:33:58.669 INFO:teuthology.orchestra.run.smithi139.stdout: "unittest_2_items": 0 2024-04-20T12:33:58.669 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.669 INFO:teuthology.orchestra.run.smithi139.stdout: "objecter": { 2024-04-20T12:33:58.669 INFO:teuthology.orchestra.run.smithi139.stdout: "op_active": 0, 2024-04-20T12:33:58.670 INFO:teuthology.orchestra.run.smithi139.stdout: "op_laggy": 0, 2024-04-20T12:33:58.670 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send": 2200, 2024-04-20T12:33:58.670 INFO:teuthology.orchestra.run.smithi139.stdout: "op_send_bytes": 21, 2024-04-20T12:33:58.670 INFO:teuthology.orchestra.run.smithi139.stdout: "op_resend": 3, 2024-04-20T12:33:58.670 INFO:teuthology.orchestra.run.smithi139.stdout: "op_reply": 2200, 2024-04-20T12:33:58.670 INFO:teuthology.orchestra.run.smithi139.stdout: "op_latency": { 2024-04-20T12:33:58.670 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2200, 2024-04-20T12:33:58.670 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 1.168974129, 2024-04-20T12:33:58.670 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000531351 2024-04-20T12:33:58.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.670 INFO:teuthology.orchestra.run.smithi139.stdout: "op_inflight": 0, 2024-04-20T12:33:58.670 INFO:teuthology.orchestra.run.smithi139.stdout: "oplen_avg": { 2024-04-20T12:33:58.670 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 2200, 2024-04-20T12:33:58.670 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 2201 2024-04-20T12:33:58.670 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.671 INFO:teuthology.orchestra.run.smithi139.stdout: "op": 2200, 2024-04-20T12:33:58.671 INFO:teuthology.orchestra.run.smithi139.stdout: "op_r": 2200, 2024-04-20T12:33:58.671 INFO:teuthology.orchestra.run.smithi139.stdout: "op_w": 0, 2024-04-20T12:33:58.671 INFO:teuthology.orchestra.run.smithi139.stdout: "op_rmw": 0, 2024-04-20T12:33:58.671 INFO:teuthology.orchestra.run.smithi139.stdout: "op_pg": 0, 2024-04-20T12:33:58.671 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_stat": 1421, 2024-04-20T12:33:58.671 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_create": 0, 2024-04-20T12:33:58.671 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_read": 777, 2024-04-20T12:33:58.672 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_write": 0, 2024-04-20T12:33:58.672 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writefull": 0, 2024-04-20T12:33:58.672 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_writesame": 0, 2024-04-20T12:33:58.672 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_append": 0, 2024-04-20T12:33:58.672 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_zero": 0, 2024-04-20T12:33:58.672 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_truncate": 0, 2024-04-20T12:33:58.672 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_delete": 0, 2024-04-20T12:33:58.672 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_mapext": 0, 2024-04-20T12:33:58.672 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_sparse_read": 0, 2024-04-20T12:33:58.673 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_clonerange": 0, 2024-04-20T12:33:58.673 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_getxattr": 1, 2024-04-20T12:33:58.673 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_setxattr": 0, 2024-04-20T12:33:58.673 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_cmpxattr": 0, 2024-04-20T12:33:58.673 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_rmxattr": 0, 2024-04-20T12:33:58.673 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_resetxattrs": 0, 2024-04-20T12:33:58.673 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_call": 0, 2024-04-20T12:33:58.673 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_watch": 0, 2024-04-20T12:33:58.673 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_notify": 0, 2024-04-20T12:33:58.673 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_src_cmpxattr": 0, 2024-04-20T12:33:58.673 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls": 0, 2024-04-20T12:33:58.673 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_pgls_filter": 0, 2024-04-20T12:33:58.673 INFO:teuthology.orchestra.run.smithi139.stdout: "osdop_other": 0, 2024-04-20T12:33:58.673 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_active": 0, 2024-04-20T12:33:58.674 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_send": 0, 2024-04-20T12:33:58.674 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_resend": 0, 2024-04-20T12:33:58.674 INFO:teuthology.orchestra.run.smithi139.stdout: "linger_ping": 0, 2024-04-20T12:33:58.674 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_active": 0, 2024-04-20T12:33:58.674 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_send": 0, 2024-04-20T12:33:58.674 INFO:teuthology.orchestra.run.smithi139.stdout: "poolop_resend": 0, 2024-04-20T12:33:58.674 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_active": 0, 2024-04-20T12:33:58.674 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_send": 0, 2024-04-20T12:33:58.674 INFO:teuthology.orchestra.run.smithi139.stdout: "poolstat_resend": 0, 2024-04-20T12:33:58.674 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_active": 0, 2024-04-20T12:33:58.674 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_send": 0, 2024-04-20T12:33:58.674 INFO:teuthology.orchestra.run.smithi139.stdout: "statfs_resend": 0, 2024-04-20T12:33:58.674 INFO:teuthology.orchestra.run.smithi139.stdout: "command_active": 0, 2024-04-20T12:33:58.674 INFO:teuthology.orchestra.run.smithi139.stdout: "command_send": 0, 2024-04-20T12:33:58.674 INFO:teuthology.orchestra.run.smithi139.stdout: "command_resend": 0, 2024-04-20T12:33:58.675 INFO:teuthology.orchestra.run.smithi139.stdout: "map_epoch": 103, 2024-04-20T12:33:58.675 INFO:teuthology.orchestra.run.smithi139.stdout: "map_full": 0, 2024-04-20T12:33:58.675 INFO:teuthology.orchestra.run.smithi139.stdout: "map_inc": 13, 2024-04-20T12:33:58.675 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_sessions": 5, 2024-04-20T12:33:58.675 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_open": 5, 2024-04-20T12:33:58.675 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_session_close": 0, 2024-04-20T12:33:58.675 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_laggy": 0, 2024-04-20T12:33:58.675 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_wr": 0, 2024-04-20T12:33:58.675 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_rd": 2, 2024-04-20T12:33:58.675 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_del": 0 2024-04-20T12:33:58.675 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.675 INFO:teuthology.orchestra.run.smithi139.stdout: "oft": { 2024-04-20T12:33:58.675 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_objs": 0, 2024-04-20T12:33:58.675 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_kv_pairs": 0, 2024-04-20T12:33:58.675 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_updates": 0, 2024-04-20T12:33:58.676 INFO:teuthology.orchestra.run.smithi139.stdout: "omap_total_removes": 0 2024-04-20T12:33:58.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.676 INFO:teuthology.orchestra.run.smithi139.stdout: "osd-slow-ops": { 2024-04-20T12:33:58.676 INFO:teuthology.orchestra.run.smithi139.stdout: "slow_ops_count": 0 2024-04-20T12:33:58.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.676 INFO:teuthology.orchestra.run.smithi139.stdout: "purge_queue": { 2024-04-20T12:33:58.676 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops": 0, 2024-04-20T12:33:58.676 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_ops_high_water": 0, 2024-04-20T12:33:58.676 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing": 0, 2024-04-20T12:33:58.676 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executing_high_water": 0, 2024-04-20T12:33:58.676 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed_ops": 0, 2024-04-20T12:33:58.676 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_executed": 0, 2024-04-20T12:33:58.676 INFO:teuthology.orchestra.run.smithi139.stdout: "pq_item_in_journal": 0 2024-04-20T12:33:58.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.676 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 2458, 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 2035316, 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 2458, 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2458, 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 2035316, 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.677 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:58.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.678 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_bytes": { 2024-04-20T12:33:58.678 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:58.678 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 104857600, 2024-04-20T12:33:58.678 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:58.678 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-20T12:33:58.678 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-20T12:33:58.678 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:58.678 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:58.678 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 2200, 2024-04-20T12:33:58.678 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 1657, 2024-04-20T12:33:58.678 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2200, 2024-04-20T12:33:58.678 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 1657, 2024-04-20T12:33:58.678 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:58.679 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.679 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.679 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.679 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:58.679 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.679 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-objecter_ops": { 2024-04-20T12:33:58.679 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:58.679 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 1024, 2024-04-20T12:33:58.679 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:58.679 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-20T12:33:58.679 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-20T12:33:58.679 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:58.680 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:58.680 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 2200, 2024-04-20T12:33:58.680 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 2200, 2024-04-20T12:33:58.680 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 2200, 2024-04-20T12:33:58.680 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 2200, 2024-04-20T12:33:58.680 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:58.680 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.680 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.680 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.680 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:58.680 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.680 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle": { 2024-04-20T12:33:58.680 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:58.680 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-20T12:33:58.681 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:58.681 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-20T12:33:58.681 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-20T12:33:58.681 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:58.681 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:58.681 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-20T12:33:58.681 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-20T12:33:58.681 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2024-04-20T12:33:58.681 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2024-04-20T12:33:58.681 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:58.682 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.682 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.682 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.682 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:58.682 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2024-04-20T12:33:58.682 INFO:teuthology.orchestra.run.smithi139.stdout: "throttle-write_buf_throttle-0x5624592be6e0": { 2024-04-20T12:33:58.682 INFO:teuthology.orchestra.run.smithi139.stdout: "val": 0, 2024-04-20T12:33:58.682 INFO:teuthology.orchestra.run.smithi139.stdout: "max": 3758096384, 2024-04-20T12:33:58.682 INFO:teuthology.orchestra.run.smithi139.stdout: "get_started": 0, 2024-04-20T12:33:58.682 INFO:teuthology.orchestra.run.smithi139.stdout: "get": 0, 2024-04-20T12:33:58.682 INFO:teuthology.orchestra.run.smithi139.stdout: "get_sum": 0, 2024-04-20T12:33:58.682 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_fail": 0, 2024-04-20T12:33:58.682 INFO:teuthology.orchestra.run.smithi139.stdout: "get_or_fail_success": 0, 2024-04-20T12:33:58.682 INFO:teuthology.orchestra.run.smithi139.stdout: "take": 0, 2024-04-20T12:33:58.683 INFO:teuthology.orchestra.run.smithi139.stdout: "take_sum": 0, 2024-04-20T12:33:58.683 INFO:teuthology.orchestra.run.smithi139.stdout: "put": 0, 2024-04-20T12:33:58.683 INFO:teuthology.orchestra.run.smithi139.stdout: "put_sum": 0, 2024-04-20T12:33:58.683 INFO:teuthology.orchestra.run.smithi139.stdout: "wait": { 2024-04-20T12:33:58.683 INFO:teuthology.orchestra.run.smithi139.stdout: "avgcount": 0, 2024-04-20T12:33:58.683 INFO:teuthology.orchestra.run.smithi139.stdout: "sum": 0.000000000, 2024-04-20T12:33:58.683 INFO:teuthology.orchestra.run.smithi139.stdout: "avgtime": 0.000000000 2024-04-20T12:33:58.683 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:58.683 INFO:teuthology.orchestra.run.smithi139.stdout: } 2024-04-20T12:33:58.683 INFO:teuthology.orchestra.run.smithi139.stdout:} 2024-04-20T12:33:58.683 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:33:58 smithi139 ceph-mon[21834]: pgmap v336: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:59.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:33:58 smithi154 ceph-mon[22073]: pgmap v336: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:59.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:33:58 smithi135 ceph-mon[18264]: pgmap v336: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:33:59.413 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-04-20T12:33:59.413 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-04-20T12:33:59.413 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-04-20T12:33:59.413 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-04-20T12:33:59.413 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-04-20T12:33:59.413 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-04-20T12:33:59.414 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-04-20T12:33:59.414 DEBUG:tasks.check_counter:Getting stats from c 2024-04-20T12:33:59.414 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph daemon mds.c perf dump 2024-04-20T12:33:59.665 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:34:00.991 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:00 smithi154 ceph-mon[22073]: pgmap v337: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:34:01.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:00 smithi139 ceph-mon[21834]: pgmap v337: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:34:01.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:00 smithi135 ceph-mon[18264]: pgmap v337: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-04-20T12:34:01.412 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-20T12:34:01.412 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-04-20T12:34:01.412 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 318, 2024-04-20T12:34:01.412 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 316, 2024-04-20T12:34:01.412 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 1663012, 2024-04-20T12:34:01.412 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 226786, 2024-04-20T12:34:01.413 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 14, 2024-04-20T12:34:01.413 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-04-20T12:34:01.413 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.062861253, 2024-04-20T12:34:01.413 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.018052970, 2024-04-20T12:34:01.413 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.043826977, 2024-04-20T12:34:01.413 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.006005264, 2024-04-20T12:34:01.413 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:34:01.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 315, 2024-04-20T12:34:01.413 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.033569848, 2024-04-20T12:34:01.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000106570 2024-04-20T12:34:01.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.413 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:34:01.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 32, 2024-04-20T12:34:01.413 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000020438, 2024-04-20T12:34:01.413 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000638 2024-04-20T12:34:01.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.414 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 1656832, 2024-04-20T12:34:01.414 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 143664 2024-04-20T12:34:01.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.414 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-04-20T12:34:01.414 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 54, 2024-04-20T12:34:01.414 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 221, 2024-04-20T12:34:01.414 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 9951, 2024-04-20T12:34:01.414 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 864973, 2024-04-20T12:34:01.414 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 43, 2024-04-20T12:34:01.414 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 6, 2024-04-20T12:34:01.414 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.024593205, 2024-04-20T12:34:01.415 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.007757423, 2024-04-20T12:34:01.415 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.013371380, 2024-04-20T12:34:01.415 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000633126, 2024-04-20T12:34:01.415 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:34:01.415 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 218, 2024-04-20T12:34:01.415 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.029633034, 2024-04-20T12:34:01.415 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000135931 2024-04-20T12:34:01.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.415 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:34:01.415 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 42, 2024-04-20T12:34:01.415 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000004662, 2024-04-20T12:34:01.415 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000111 2024-04-20T12:34:01.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.415 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 1248, 2024-04-20T12:34:01.416 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 454304 2024-04-20T12:34:01.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.416 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-04-20T12:34:01.416 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 1011, 2024-04-20T12:34:01.416 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 862, 2024-04-20T12:34:01.416 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 312675, 2024-04-20T12:34:01.416 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 403007, 2024-04-20T12:34:01.416 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 9, 2024-04-20T12:34:01.416 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-04-20T12:34:01.416 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.094397745, 2024-04-20T12:34:01.416 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.044452598, 2024-04-20T12:34:01.416 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.052255280, 2024-04-20T12:34:01.416 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.004059632, 2024-04-20T12:34:01.416 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:34:01.416 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 861, 2024-04-20T12:34:01.417 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.039358248, 2024-04-20T12:34:01.417 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000045712 2024-04-20T12:34:01.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.417 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:34:01.417 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1812, 2024-04-20T12:34:01.417 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000404209, 2024-04-20T12:34:01.417 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000223 2024-04-20T12:34:01.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.417 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 6208, 2024-04-20T12:34:01.417 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 12512 2024-04-20T12:34:01.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.417 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-04-20T12:34:01.417 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-04-20T12:34:01.418 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-04-20T12:34:01.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.418 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-04-20T12:34:01.418 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-04-20T12:34:01.418 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-04-20T12:34:01.418 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 34, 2024-04-20T12:34:01.418 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.002005969, 2024-04-20T12:34:01.418 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000058999 2024-04-20T12:34:01.418 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:01.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.418 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-04-20T12:34:01.418 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-04-20T12:34:01.418 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-04-20T12:34:01.419 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-04-20T12:34:01.419 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000006481, 2024-04-20T12:34:01.419 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000003240 2024-04-20T12:34:01.419 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:01.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.419 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-04-20T12:34:01.419 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 6, 2024-04-20T12:34:01.419 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 3, 2024-04-20T12:34:01.419 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-04-20T12:34:01.419 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3, 2024-04-20T12:34:01.419 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000530199, 2024-04-20T12:34:01.419 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000176733 2024-04-20T12:34:01.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.419 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-04-20T12:34:01.419 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 3, 2024-04-20T12:34:01.420 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-04-20T12:34:01.420 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-04-20T12:34:01.420 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 11, 2024-04-20T12:34:01.420 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-04-20T12:34:01.420 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-04-20T12:34:01.420 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 18, 2024-04-20T12:34:01.420 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 2, 2024-04-20T12:34:01.420 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 16, 2024-04-20T12:34:01.420 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-04-20T12:34:01.420 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 13, 2024-04-20T12:34:01.420 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 8, 2024-04-20T12:34:01.420 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 1, 2024-04-20T12:34:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 1, 2024-04-20T12:34:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 3, 2024-04-20T12:34:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 17, 2024-04-20T12:34:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 12, 2024-04-20T12:34:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 1, 2024-04-20T12:34:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 3, 2024-04-20T12:34:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-04-20T12:34:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-04-20T12:34:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-04-20T12:34:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-04-20T12:34:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-04-20T12:34:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-04-20T12:34:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-04-20T12:34:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-04-20T12:34:01.421 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-04-20T12:34:01.422 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-04-20T12:34:01.422 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-04-20T12:34:01.422 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-04-20T12:34:01.422 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-04-20T12:34:01.422 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-04-20T12:34:01.422 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 6, 2024-04-20T12:34:01.422 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-04-20T12:34:01.422 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-04-20T12:34:01.422 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-04-20T12:34:01.422 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-04-20T12:34:01.422 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-04-20T12:34:01.422 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-04-20T12:34:01.422 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 15, 2024-04-20T12:34:01.423 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 9, 2024-04-20T12:34:01.424 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 10, 2024-04-20T12:34:01.424 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-04-20T12:34:01.424 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-04-20T12:34:01.424 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-04-20T12:34:01.424 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-04-20T12:34:01.424 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-04-20T12:34:01.424 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-04-20T12:34:01.424 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-04-20T12:34:01.424 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-04-20T12:34:01.424 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-04-20T12:34:01.424 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-04-20T12:34:01.424 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-04-20T12:34:01.424 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-04-20T12:34:01.424 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-04-20T12:34:01.425 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-04-20T12:34:01.425 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-04-20T12:34:01.425 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-04-20T12:34:01.425 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-04-20T12:34:01.425 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-04-20T12:34:01.425 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-04-20T12:34:01.425 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-04-20T12:34:01.425 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-04-20T12:34:01.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.425 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-04-20T12:34:01.425 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-04-20T12:34:01.425 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 6, 2024-04-20T12:34:01.425 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-04-20T12:34:01.425 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-04-20T12:34:01.426 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 6, 2024-04-20T12:34:01.426 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-04-20T12:34:01.426 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-04-20T12:34:01.426 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 2, 2024-04-20T12:34:01.426 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-04-20T12:34:01.426 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-04-20T12:34:01.426 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-04-20T12:34:01.426 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-04-20T12:34:01.426 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-04-20T12:34:01.426 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-04-20T12:34:01.426 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-04-20T12:34:01.427 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4196123, 2024-04-20T12:34:01.427 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-04-20T12:34:01.427 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-04-20T12:34:01.427 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 5, 2024-04-20T12:34:01.427 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.008840346, 2024-04-20T12:34:01.427 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001768069 2024-04-20T12:34:01.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.427 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-04-20T12:34:01.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.427 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-04-20T12:34:01.427 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 22, 2024-04-20T12:34:01.427 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 28, 2024-04-20T12:34:01.427 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 6, 2024-04-20T12:34:01.427 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 21, 2024-04-20T12:34:01.428 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 26, 2024-04-20T12:34:01.428 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 5, 2024-04-20T12:34:01.428 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 18, 2024-04-20T12:34:01.428 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 26, 2024-04-20T12:34:01.428 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 8, 2024-04-20T12:34:01.428 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 1, 2024-04-20T12:34:01.428 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 1, 2024-04-20T12:34:01.428 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-04-20T12:34:01.428 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 52664, 2024-04-20T12:34:01.428 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 223608 2024-04-20T12:34:01.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.428 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-04-20T12:34:01.428 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 6, 2024-04-20T12:34:01.428 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-04-20T12:34:01.429 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 6, 2024-04-20T12:34:01.429 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 21, 2024-04-20T12:34:01.429 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-04-20T12:34:01.429 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-04-20T12:34:01.429 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.429 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.429 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.429 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-04-20T12:34:01.429 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3, 2024-04-20T12:34:01.429 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000530199, 2024-04-20T12:34:01.429 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000176733 2024-04-20T12:34:01.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.429 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-04-20T12:34:01.429 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.430 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.430 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.430 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-04-20T12:34:01.430 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.430 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.430 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.430 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-04-20T12:34:01.430 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.430 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.430 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.430 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-04-20T12:34:01.430 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.431 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.431 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.431 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-04-20T12:34:01.431 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.431 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.431 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.431 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-04-20T12:34:01.431 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.431 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.431 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.431 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-04-20T12:34:01.431 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.432 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.432 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.432 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-04-20T12:34:01.432 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.432 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.432 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.432 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-04-20T12:34:01.432 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.432 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.432 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.432 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-04-20T12:34:01.433 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.433 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.433 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.434 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-04-20T12:34:01.434 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.434 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.434 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.434 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-04-20T12:34:01.434 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.434 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.434 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.434 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-04-20T12:34:01.434 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.434 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.435 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.435 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-04-20T12:34:01.435 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.435 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.435 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.435 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-04-20T12:34:01.435 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.435 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.435 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.435 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-04-20T12:34:01.435 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.436 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.436 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.436 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-04-20T12:34:01.436 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.436 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.436 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.436 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-04-20T12:34:01.436 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.436 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.436 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.436 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-04-20T12:34:01.436 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.437 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.437 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.437 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-04-20T12:34:01.437 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.437 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.437 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.437 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-04-20T12:34:01.437 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.437 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.437 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.437 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-04-20T12:34:01.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.438 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.438 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-04-20T12:34:01.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.438 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.438 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-04-20T12:34:01.438 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.438 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.439 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.439 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-04-20T12:34:01.439 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.439 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.439 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.439 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-04-20T12:34:01.439 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.439 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.439 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.439 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-04-20T12:34:01.439 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.440 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.440 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.440 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-04-20T12:34:01.440 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-04-20T12:34:01.440 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-04-20T12:34:01.440 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.440 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.440 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.440 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:01.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.440 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-04-20T12:34:01.440 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 2, 2024-04-20T12:34:01.440 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 3, 2024-04-20T12:34:01.440 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 1, 2024-04-20T12:34:01.441 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 2, 2024-04-20T12:34:01.441 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-04-20T12:34:01.441 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 2, 2024-04-20T12:34:01.441 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-04-20T12:34:01.441 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 623, 2024-04-20T12:34:01.441 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-04-20T12:34:01.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.441 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-04-20T12:34:01.441 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-04-20T12:34:01.441 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-04-20T12:34:01.441 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-04-20T12:34:01.441 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-04-20T12:34:01.441 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-04-20T12:34:01.441 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-04-20T12:34:01.442 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-20T12:34:01.442 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-04-20T12:34:01.442 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-20T12:34:01.442 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-04-20T12:34:01.442 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-04-20T12:34:01.442 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-04-20T12:34:01.442 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-20T12:34:01.442 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-04-20T12:34:01.442 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-04-20T12:34:01.442 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-04-20T12:34:01.442 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-04-20T12:34:01.442 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-04-20T12:34:01.442 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-20T12:34:01.442 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-04-20T12:34:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-20T12:34:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-04-20T12:34:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-04-20T12:34:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-04-20T12:34:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-04-20T12:34:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-04-20T12:34:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-20T12:34:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-04-20T12:34:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-04-20T12:34:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-04-20T12:34:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-04-20T12:34:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-04-20T12:34:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-04-20T12:34:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-04-20T12:34:01.443 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-04-20T12:34:01.444 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-04-20T12:34:01.444 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 247641, 2024-04-20T12:34:01.444 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 88, 2024-04-20T12:34:01.444 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 88, 2024-04-20T12:34:01.444 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 1, 2024-04-20T12:34:01.444 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-04-20T12:34:01.444 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-04-20T12:34:01.444 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-04-20T12:34:01.444 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-04-20T12:34:01.444 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-04-20T12:34:01.444 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-04-20T12:34:01.444 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 9520, 2024-04-20T12:34:01.444 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 183, 2024-04-20T12:34:01.444 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-04-20T12:34:01.444 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-04-20T12:34:01.445 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-04-20T12:34:01.445 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-04-20T12:34:01.445 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 93029, 2024-04-20T12:34:01.445 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 357, 2024-04-20T12:34:01.445 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-04-20T12:34:01.445 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-04-20T12:34:01.445 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-04-20T12:34:01.445 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-04-20T12:34:01.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.445 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-04-20T12:34:01.445 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-04-20T12:34:01.445 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-04-20T12:34:01.445 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 42, 2024-04-20T12:34:01.445 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 12211, 2024-04-20T12:34:01.445 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 33, 2024-04-20T12:34:01.446 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 42, 2024-04-20T12:34:01.446 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-04-20T12:34:01.446 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 42, 2024-04-20T12:34:01.446 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.236993466, 2024-04-20T12:34:01.446 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.005642701 2024-04-20T12:34:01.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.446 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-04-20T12:34:01.446 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-04-20T12:34:01.446 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 42, 2024-04-20T12:34:01.446 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 64 2024-04-20T12:34:01.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.446 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 42, 2024-04-20T12:34:01.446 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 0, 2024-04-20T12:34:01.446 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 42, 2024-04-20T12:34:01.446 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-04-20T12:34:01.447 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-04-20T12:34:01.447 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 0, 2024-04-20T12:34:01.447 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 10, 2024-04-20T12:34:01.447 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 0, 2024-04-20T12:34:01.447 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 5, 2024-04-20T12:34:01.447 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 8, 2024-04-20T12:34:01.447 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-04-20T12:34:01.447 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-04-20T12:34:01.447 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-04-20T12:34:01.447 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-04-20T12:34:01.447 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 6, 2024-04-20T12:34:01.447 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-04-20T12:34:01.447 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-04-20T12:34:01.448 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-04-20T12:34:01.448 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 0, 2024-04-20T12:34:01.448 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 20, 2024-04-20T12:34:01.448 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-04-20T12:34:01.448 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-04-20T12:34:01.448 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-04-20T12:34:01.448 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-04-20T12:34:01.448 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-04-20T12:34:01.448 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-04-20T12:34:01.448 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-04-20T12:34:01.448 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-04-20T12:34:01.448 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-04-20T12:34:01.448 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-04-20T12:34:01.448 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-04-20T12:34:01.448 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-04-20T12:34:01.449 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-04-20T12:34:01.449 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-04-20T12:34:01.449 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-04-20T12:34:01.449 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-04-20T12:34:01.449 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-04-20T12:34:01.449 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-04-20T12:34:01.449 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-04-20T12:34:01.449 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-04-20T12:34:01.449 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-04-20T12:34:01.449 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-04-20T12:34:01.449 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-04-20T12:34:01.449 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-04-20T12:34:01.449 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-04-20T12:34:01.449 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-04-20T12:34:01.449 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 103, 2024-04-20T12:34:01.450 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-04-20T12:34:01.450 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 13, 2024-04-20T12:34:01.450 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 8, 2024-04-20T12:34:01.450 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 8, 2024-04-20T12:34:01.450 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-04-20T12:34:01.450 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-04-20T12:34:01.450 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 14, 2024-04-20T12:34:01.450 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-04-20T12:34:01.450 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 1 2024-04-20T12:34:01.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.450 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-04-20T12:34:01.450 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-04-20T12:34:01.450 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-04-20T12:34:01.450 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-04-20T12:34:01.451 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-04-20T12:34:01.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.451 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-04-20T12:34:01.451 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-04-20T12:34:01.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.451 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-04-20T12:34:01.451 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-04-20T12:34:01.451 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-04-20T12:34:01.451 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-04-20T12:34:01.451 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-04-20T12:34:01.451 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-04-20T12:34:01.451 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-04-20T12:34:01.451 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-04-20T12:34:01.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.452 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-20T12:34:01.452 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:01.452 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-04-20T12:34:01.452 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:01.452 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 1379, 2024-04-20T12:34:01.452 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 1843345, 2024-04-20T12:34:01.452 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:01.452 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 1379, 2024-04-20T12:34:01.452 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-04-20T12:34:01.452 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-04-20T12:34:01.452 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1379, 2024-04-20T12:34:01.452 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1843345, 2024-04-20T12:34:01.452 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:01.452 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-04-20T12:34:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-04-20T12:34:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-04-20T12:34:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-04-20T12:34:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-04-20T12:34:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 42, 2024-04-20T12:34:01.453 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 12211, 2024-04-20T12:34:01.454 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 42, 2024-04-20T12:34:01.454 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 12211, 2024-04-20T12:34:01.454 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:01.454 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.454 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.454 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.454 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:01.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.454 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-04-20T12:34:01.454 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:01.454 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-04-20T12:34:01.454 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:01.454 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-04-20T12:34:01.455 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-04-20T12:34:01.455 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:01.455 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-04-20T12:34:01.455 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 42, 2024-04-20T12:34:01.455 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 42, 2024-04-20T12:34:01.455 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 42, 2024-04-20T12:34:01.455 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 42, 2024-04-20T12:34:01.455 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:01.455 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.455 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.455 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.455 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:01.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.455 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-04-20T12:34:01.456 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:01.456 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-04-20T12:34:01.456 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:01.456 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-04-20T12:34:01.456 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-04-20T12:34:01.456 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:01.456 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-04-20T12:34:01.456 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-04-20T12:34:01.456 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-04-20T12:34:01.456 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-04-20T12:34:01.456 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-04-20T12:34:01.456 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:01.456 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.456 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.456 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.457 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:01.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:01.457 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x562517be0500": { 2024-04-20T12:34:01.457 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:01.457 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-04-20T12:34:01.457 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:01.457 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 6, 2024-04-20T12:34:01.457 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 1819, 2024-04-20T12:34:01.457 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:01.457 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 6, 2024-04-20T12:34:01.457 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-04-20T12:34:01.457 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-04-20T12:34:01.457 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 5, 2024-04-20T12:34:01.457 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1819, 2024-04-20T12:34:01.457 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:01.458 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:01.458 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:01.458 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:01.458 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:01.458 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:01.458 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-20T12:34:02.165 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-04-20T12:34:02.165 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-04-20T12:34:02.166 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-04-20T12:34:02.166 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=15 2024-04-20T12:34:02.166 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-04-20T12:34:02.166 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-04-20T12:34:02.166 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-04-20T12:34:02.166 DEBUG:tasks.check_counter:Getting stats from f 2024-04-20T12:34:02.166 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph daemon mds.f perf dump 2024-04-20T12:34:02.417 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:34:02.728 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:02 smithi154 ceph-mon[22073]: pgmap v338: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:34:03.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:02 smithi139 ceph-mon[21834]: pgmap v338: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:34:03.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:02 smithi135 ceph-mon[18264]: pgmap v338: 129 pgs: 129 active+clean; 12 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-04-20T12:34:04.096 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-20T12:34:04.096 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-04-20T12:34:04.096 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 313, 2024-04-20T12:34:04.096 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 297, 2024-04-20T12:34:04.097 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 1658129, 2024-04-20T12:34:04.097 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 248458, 2024-04-20T12:34:04.097 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 16, 2024-04-20T12:34:04.097 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-04-20T12:34:04.097 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.057252261, 2024-04-20T12:34:04.097 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.015227800, 2024-04-20T12:34:04.097 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.044255150, 2024-04-20T12:34:04.097 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.006182473, 2024-04-20T12:34:04.097 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:34:04.097 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 296, 2024-04-20T12:34:04.097 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.022434735, 2024-04-20T12:34:04.097 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000075793 2024-04-20T12:34:04.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.097 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:34:04.097 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 8, 2024-04-20T12:34:04.098 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000704, 2024-04-20T12:34:04.098 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000088 2024-04-20T12:34:04.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.098 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 1652160, 2024-04-20T12:34:04.098 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 144944 2024-04-20T12:34:04.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.098 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-04-20T12:34:04.098 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 55, 2024-04-20T12:34:04.098 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 225, 2024-04-20T12:34:04.098 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 10364, 2024-04-20T12:34:04.098 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 862444, 2024-04-20T12:34:04.098 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 43, 2024-04-20T12:34:04.098 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 7, 2024-04-20T12:34:04.099 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.026063659, 2024-04-20T12:34:04.099 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.008689805, 2024-04-20T12:34:04.099 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.013974581, 2024-04-20T12:34:04.099 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.000537663, 2024-04-20T12:34:04.099 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:34:04.099 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 222, 2024-04-20T12:34:04.099 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.025091390, 2024-04-20T12:34:04.099 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000113024 2024-04-20T12:34:04.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.099 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:34:04.099 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 49, 2024-04-20T12:34:04.099 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000005736, 2024-04-20T12:34:04.099 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000117 2024-04-20T12:34:04.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.099 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 2160, 2024-04-20T12:34:04.100 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 458208 2024-04-20T12:34:04.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.100 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-04-20T12:34:04.100 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 996, 2024-04-20T12:34:04.100 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 813, 2024-04-20T12:34:04.100 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 306841, 2024-04-20T12:34:04.100 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 178069, 2024-04-20T12:34:04.100 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 7, 2024-04-20T12:34:04.100 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-04-20T12:34:04.100 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.089697846, 2024-04-20T12:34:04.100 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.042076491, 2024-04-20T12:34:04.100 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.050164093, 2024-04-20T12:34:04.100 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.003980452, 2024-04-20T12:34:04.100 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:34:04.101 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 812, 2024-04-20T12:34:04.101 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.040982685, 2024-04-20T12:34:04.101 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000050471 2024-04-20T12:34:04.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.101 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:34:04.101 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1752, 2024-04-20T12:34:04.101 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000440871, 2024-04-20T12:34:04.101 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000251 2024-04-20T12:34:04.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.101 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 4000, 2024-04-20T12:34:04.101 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 1424 2024-04-20T12:34:04.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.101 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-04-20T12:34:04.101 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-04-20T12:34:04.102 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-04-20T12:34:04.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.102 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-04-20T12:34:04.102 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-04-20T12:34:04.102 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-04-20T12:34:04.102 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 50, 2024-04-20T12:34:04.102 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.002015560, 2024-04-20T12:34:04.102 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000040311 2024-04-20T12:34:04.102 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:04.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.102 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-04-20T12:34:04.102 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-04-20T12:34:04.102 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-04-20T12:34:04.103 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-04-20T12:34:04.103 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000004966, 2024-04-20T12:34:04.103 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000002483 2024-04-20T12:34:04.103 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:04.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.103 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-04-20T12:34:04.103 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 3, 2024-04-20T12:34:04.103 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 2, 2024-04-20T12:34:04.103 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-04-20T12:34:04.103 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-04-20T12:34:04.103 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000384476, 2024-04-20T12:34:04.103 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000192238 2024-04-20T12:34:04.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.103 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-04-20T12:34:04.104 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 1, 2024-04-20T12:34:04.104 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-04-20T12:34:04.104 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-04-20T12:34:04.104 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 11, 2024-04-20T12:34:04.104 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-04-20T12:34:04.104 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-04-20T12:34:04.104 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 18, 2024-04-20T12:34:04.104 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 2, 2024-04-20T12:34:04.104 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 16, 2024-04-20T12:34:04.104 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-04-20T12:34:04.104 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 13, 2024-04-20T12:34:04.104 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 8, 2024-04-20T12:34:04.104 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-04-20T12:34:04.104 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-04-20T12:34:04.105 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 3, 2024-04-20T12:34:04.105 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 13, 2024-04-20T12:34:04.105 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 9, 2024-04-20T12:34:04.105 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 1, 2024-04-20T12:34:04.105 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 3, 2024-04-20T12:34:04.105 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-04-20T12:34:04.105 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-04-20T12:34:04.105 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-04-20T12:34:04.105 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-04-20T12:34:04.105 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-04-20T12:34:04.105 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-04-20T12:34:04.105 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-04-20T12:34:04.105 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-04-20T12:34:04.106 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-04-20T12:34:04.106 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-04-20T12:34:04.106 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-04-20T12:34:04.106 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-04-20T12:34:04.106 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-04-20T12:34:04.106 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-04-20T12:34:04.106 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 6, 2024-04-20T12:34:04.106 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-04-20T12:34:04.106 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-04-20T12:34:04.106 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-04-20T12:34:04.106 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-04-20T12:34:04.106 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-04-20T12:34:04.106 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-04-20T12:34:04.106 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-04-20T12:34:04.107 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-04-20T12:34:04.107 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-04-20T12:34:04.107 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-04-20T12:34:04.107 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-04-20T12:34:04.107 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-04-20T12:34:04.107 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-20T12:34:04.107 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-20T12:34:04.107 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-04-20T12:34:04.107 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-04-20T12:34:04.107 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-04-20T12:34:04.107 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-04-20T12:34:04.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.107 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-04-20T12:34:04.107 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-04-20T12:34:04.107 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 13, 2024-04-20T12:34:04.108 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 8, 2024-04-20T12:34:04.108 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 9, 2024-04-20T12:34:04.108 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-04-20T12:34:04.108 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-04-20T12:34:04.108 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-04-20T12:34:04.108 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-04-20T12:34:04.108 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-04-20T12:34:04.108 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-04-20T12:34:04.108 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-04-20T12:34:04.108 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-04-20T12:34:04.108 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-04-20T12:34:04.108 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-04-20T12:34:04.108 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-04-20T12:34:04.108 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-04-20T12:34:04.109 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-04-20T12:34:04.109 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-04-20T12:34:04.109 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-04-20T12:34:04.109 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-04-20T12:34:04.109 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-04-20T12:34:04.109 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-04-20T12:34:04.109 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-04-20T12:34:04.109 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-04-20T12:34:04.109 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-04-20T12:34:04.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.109 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-04-20T12:34:04.109 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-04-20T12:34:04.109 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 6, 2024-04-20T12:34:04.109 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-04-20T12:34:04.109 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-04-20T12:34:04.110 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 6, 2024-04-20T12:34:04.110 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-04-20T12:34:04.110 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-04-20T12:34:04.110 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 2, 2024-04-20T12:34:04.110 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-04-20T12:34:04.110 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-04-20T12:34:04.110 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-04-20T12:34:04.110 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-04-20T12:34:04.110 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-04-20T12:34:04.110 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-04-20T12:34:04.110 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-04-20T12:34:04.110 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4195956, 2024-04-20T12:34:04.110 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-04-20T12:34:04.110 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-04-20T12:34:04.111 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 5, 2024-04-20T12:34:04.111 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.009154444, 2024-04-20T12:34:04.111 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001830888 2024-04-20T12:34:04.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.111 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-04-20T12:34:04.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.111 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-04-20T12:34:04.111 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 22, 2024-04-20T12:34:04.111 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 28, 2024-04-20T12:34:04.111 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 6, 2024-04-20T12:34:04.111 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 21, 2024-04-20T12:34:04.111 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 25, 2024-04-20T12:34:04.111 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 4, 2024-04-20T12:34:04.111 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 18, 2024-04-20T12:34:04.112 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 26, 2024-04-20T12:34:04.112 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 8, 2024-04-20T12:34:04.112 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-04-20T12:34:04.112 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 2, 2024-04-20T12:34:04.112 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 2, 2024-04-20T12:34:04.112 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 53352, 2024-04-20T12:34:04.112 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 223608 2024-04-20T12:34:04.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.112 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-04-20T12:34:04.112 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 3, 2024-04-20T12:34:04.112 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-04-20T12:34:04.112 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 3, 2024-04-20T12:34:04.112 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 8, 2024-04-20T12:34:04.112 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-04-20T12:34:04.112 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-04-20T12:34:04.113 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.113 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.113 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.113 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-04-20T12:34:04.113 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1, 2024-04-20T12:34:04.113 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000221254, 2024-04-20T12:34:04.113 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000221254 2024-04-20T12:34:04.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.113 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-04-20T12:34:04.113 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.113 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.113 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-04-20T12:34:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-04-20T12:34:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1, 2024-04-20T12:34:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000163222, 2024-04-20T12:34:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000163222 2024-04-20T12:34:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-04-20T12:34:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-04-20T12:34:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-04-20T12:34:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-04-20T12:34:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.116 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-04-20T12:34:04.116 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.116 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.116 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.116 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-04-20T12:34:04.116 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.116 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.116 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.116 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-04-20T12:34:04.116 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.117 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.117 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.117 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-04-20T12:34:04.117 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.117 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.117 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.117 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-04-20T12:34:04.117 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.118 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.118 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.118 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-04-20T12:34:04.118 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.118 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.118 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.118 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-04-20T12:34:04.118 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.118 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.118 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.118 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-04-20T12:34:04.119 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.119 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.119 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.119 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-04-20T12:34:04.119 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.119 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.119 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.119 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-04-20T12:34:04.119 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.119 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.119 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.120 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-04-20T12:34:04.120 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.120 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.120 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.120 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-04-20T12:34:04.120 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.120 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.120 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.120 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-04-20T12:34:04.120 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.120 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.120 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.121 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-04-20T12:34:04.121 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.121 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.121 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.121 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-04-20T12:34:04.121 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.121 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.121 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.121 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-04-20T12:34:04.121 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.121 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.122 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.122 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-04-20T12:34:04.122 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.122 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.122 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.122 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-04-20T12:34:04.122 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.122 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.122 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.123 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-04-20T12:34:04.123 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.123 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.123 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.123 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-04-20T12:34:04.123 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.123 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.123 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.123 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-04-20T12:34:04.124 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-04-20T12:34:04.124 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-04-20T12:34:04.124 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.124 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.124 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.124 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:04.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.124 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-04-20T12:34:04.124 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 0, 2024-04-20T12:34:04.124 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 2, 2024-04-20T12:34:04.124 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 2, 2024-04-20T12:34:04.124 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 0, 2024-04-20T12:34:04.124 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-04-20T12:34:04.124 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 1, 2024-04-20T12:34:04.125 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 1, 2024-04-20T12:34:04.125 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 86, 2024-04-20T12:34:04.125 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-04-20T12:34:04.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.125 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-04-20T12:34:04.125 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-04-20T12:34:04.125 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-04-20T12:34:04.125 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-04-20T12:34:04.125 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-04-20T12:34:04.125 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-04-20T12:34:04.125 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-04-20T12:34:04.125 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-20T12:34:04.125 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-04-20T12:34:04.125 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-20T12:34:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-04-20T12:34:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-04-20T12:34:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-04-20T12:34:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-20T12:34:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-04-20T12:34:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-04-20T12:34:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-04-20T12:34:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-04-20T12:34:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-04-20T12:34:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-20T12:34:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-04-20T12:34:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-20T12:34:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-04-20T12:34:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-04-20T12:34:04.126 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-04-20T12:34:04.127 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-04-20T12:34:04.127 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-04-20T12:34:04.127 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-20T12:34:04.127 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-04-20T12:34:04.127 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-04-20T12:34:04.127 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-04-20T12:34:04.127 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-04-20T12:34:04.127 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-04-20T12:34:04.127 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-04-20T12:34:04.127 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-04-20T12:34:04.127 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-04-20T12:34:04.127 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-04-20T12:34:04.127 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 254951, 2024-04-20T12:34:04.127 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 86, 2024-04-20T12:34:04.128 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-04-20T12:34:04.128 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-04-20T12:34:04.128 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-04-20T12:34:04.128 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-04-20T12:34:04.128 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-04-20T12:34:04.128 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-04-20T12:34:04.128 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-04-20T12:34:04.128 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-04-20T12:34:04.128 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 9520, 2024-04-20T12:34:04.128 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 183, 2024-04-20T12:34:04.128 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-04-20T12:34:04.128 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-04-20T12:34:04.128 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-04-20T12:34:04.128 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-04-20T12:34:04.128 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 92677, 2024-04-20T12:34:04.129 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 357, 2024-04-20T12:34:04.129 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-04-20T12:34:04.129 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-04-20T12:34:04.129 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-04-20T12:34:04.129 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-04-20T12:34:04.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.129 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-04-20T12:34:04.129 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-04-20T12:34:04.129 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-04-20T12:34:04.129 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 43, 2024-04-20T12:34:04.129 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 12099, 2024-04-20T12:34:04.129 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 33, 2024-04-20T12:34:04.129 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 43, 2024-04-20T12:34:04.129 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-04-20T12:34:04.129 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 43, 2024-04-20T12:34:04.130 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.222993840, 2024-04-20T12:34:04.130 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.005185903 2024-04-20T12:34:04.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.130 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-04-20T12:34:04.130 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-04-20T12:34:04.130 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 43, 2024-04-20T12:34:04.130 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 67 2024-04-20T12:34:04.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.130 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 43, 2024-04-20T12:34:04.130 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 0, 2024-04-20T12:34:04.130 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 43, 2024-04-20T12:34:04.130 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-04-20T12:34:04.130 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-04-20T12:34:04.130 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 0, 2024-04-20T12:34:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 10, 2024-04-20T12:34:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 0, 2024-04-20T12:34:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 5, 2024-04-20T12:34:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 7, 2024-04-20T12:34:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-04-20T12:34:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-04-20T12:34:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-04-20T12:34:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-04-20T12:34:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 6, 2024-04-20T12:34:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-04-20T12:34:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-04-20T12:34:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-04-20T12:34:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 0, 2024-04-20T12:34:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 20, 2024-04-20T12:34:04.131 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-04-20T12:34:04.132 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-04-20T12:34:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-04-20T12:34:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-04-20T12:34:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-04-20T12:34:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-04-20T12:34:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-04-20T12:34:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-04-20T12:34:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-04-20T12:34:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-04-20T12:34:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-04-20T12:34:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 103, 2024-04-20T12:34:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-04-20T12:34:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 13, 2024-04-20T12:34:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 9, 2024-04-20T12:34:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 9, 2024-04-20T12:34:04.133 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-04-20T12:34:04.134 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-04-20T12:34:04.134 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 17, 2024-04-20T12:34:04.134 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-04-20T12:34:04.134 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 2 2024-04-20T12:34:04.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.134 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-04-20T12:34:04.134 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-04-20T12:34:04.134 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-04-20T12:34:04.134 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-04-20T12:34:04.134 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-04-20T12:34:04.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.134 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-04-20T12:34:04.135 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-04-20T12:34:04.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.135 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-04-20T12:34:04.135 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-04-20T12:34:04.135 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-04-20T12:34:04.135 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-04-20T12:34:04.135 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-04-20T12:34:04.135 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-04-20T12:34:04.135 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-04-20T12:34:04.135 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-04-20T12:34:04.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.135 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-20T12:34:04.135 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:04.135 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-04-20T12:34:04.136 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:04.136 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 1360, 2024-04-20T12:34:04.136 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 1834858, 2024-04-20T12:34:04.136 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:04.136 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 1360, 2024-04-20T12:34:04.136 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-04-20T12:34:04.136 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-04-20T12:34:04.136 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 1360, 2024-04-20T12:34:04.136 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1834858, 2024-04-20T12:34:04.136 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:04.136 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.136 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.136 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:04.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.137 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-04-20T12:34:04.137 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:04.137 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-04-20T12:34:04.137 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:04.137 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-04-20T12:34:04.137 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-04-20T12:34:04.137 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:04.137 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-04-20T12:34:04.137 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 43, 2024-04-20T12:34:04.137 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 12099, 2024-04-20T12:34:04.137 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 43, 2024-04-20T12:34:04.137 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 12099, 2024-04-20T12:34:04.137 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:04.137 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.137 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.138 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.138 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:04.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.138 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-04-20T12:34:04.138 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:04.138 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-04-20T12:34:04.138 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:04.138 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-04-20T12:34:04.138 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-04-20T12:34:04.138 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:04.138 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-04-20T12:34:04.138 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 43, 2024-04-20T12:34:04.138 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 43, 2024-04-20T12:34:04.138 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 43, 2024-04-20T12:34:04.139 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 43, 2024-04-20T12:34:04.139 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:04.139 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.139 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.139 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.139 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:04.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.139 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-04-20T12:34:04.139 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:04.139 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-04-20T12:34:04.139 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:04.139 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-04-20T12:34:04.139 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-04-20T12:34:04.139 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:04.140 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-04-20T12:34:04.140 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-04-20T12:34:04.140 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-04-20T12:34:04.140 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-04-20T12:34:04.140 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-04-20T12:34:04.140 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:04.140 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.140 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.140 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.140 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:04.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:04.140 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x560c2e5e2500": { 2024-04-20T12:34:04.140 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:04.140 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-04-20T12:34:04.140 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:04.141 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 6, 2024-04-20T12:34:04.141 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 1652, 2024-04-20T12:34:04.141 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:04.141 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 6, 2024-04-20T12:34:04.141 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-04-20T12:34:04.141 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-04-20T12:34:04.141 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 5, 2024-04-20T12:34:04.141 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1652, 2024-04-20T12:34:04.141 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:04.141 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:04.141 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:04.141 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:04.141 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:04.141 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:04.141 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-20T12:34:04.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:04 smithi154 ceph-mon[22073]: pgmap v339: 129 pgs: 129 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-20T12:34:04.812 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-04-20T12:34:04.812 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-04-20T12:34:04.812 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-04-20T12:34:04.812 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=13 2024-04-20T12:34:04.813 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-04-20T12:34:04.813 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-04-20T12:34:04.813 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-04-20T12:34:04.813 DEBUG:tasks.check_counter:Getting stats from i 2024-04-20T12:34:04.813 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph daemon mds.i perf dump 2024-04-20T12:34:05.052 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:34:05.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:04 smithi139 ceph-mon[21834]: pgmap v339: 129 pgs: 129 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-20T12:34:05.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:04 smithi135 ceph-mon[18264]: pgmap v339: 129 pgs: 129 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-04-20T12:34:06.743 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:06 smithi154 ceph-mon[22073]: pgmap v340: 129 pgs: 129 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:34:06.743 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-20T12:34:06.743 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-04-20T12:34:06.744 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 4860, 2024-04-20T12:34:06.744 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 5337, 2024-04-20T12:34:06.744 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 1408201, 2024-04-20T12:34:06.744 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 10552155, 2024-04-20T12:34:06.744 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 26, 2024-04-20T12:34:06.744 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 5, 2024-04-20T12:34:06.744 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.400777896, 2024-04-20T12:34:06.744 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.135536739, 2024-04-20T12:34:06.744 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.122873549, 2024-04-20T12:34:06.744 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.110247073, 2024-04-20T12:34:06.744 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:34:06.744 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 5339, 2024-04-20T12:34:06.744 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.529627894, 2024-04-20T12:34:06.744 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000099199 2024-04-20T12:34:06.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.745 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:34:06.745 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3522, 2024-04-20T12:34:06.745 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000736003, 2024-04-20T12:34:06.745 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000208 2024-04-20T12:34:06.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.745 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3232, 2024-04-20T12:34:06.745 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 327632 2024-04-20T12:34:06.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.745 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-04-20T12:34:06.745 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 4062, 2024-04-20T12:34:06.745 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 4134, 2024-04-20T12:34:06.745 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 2936487, 2024-04-20T12:34:06.745 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 5787935, 2024-04-20T12:34:06.745 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 12, 2024-04-20T12:34:06.745 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 7, 2024-04-20T12:34:06.746 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.371667127, 2024-04-20T12:34:06.746 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.137678661, 2024-04-20T12:34:06.746 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.137253996, 2024-04-20T12:34:06.746 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.095081601, 2024-04-20T12:34:06.746 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:34:06.746 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 4133, 2024-04-20T12:34:06.746 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.067823836, 2024-04-20T12:34:06.746 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000258365 2024-04-20T12:34:06.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.746 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:34:06.746 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1862, 2024-04-20T12:34:06.746 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000488369, 2024-04-20T12:34:06.746 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000262 2024-04-20T12:34:06.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.747 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 1723232, 2024-04-20T12:34:06.747 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 170864 2024-04-20T12:34:06.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.747 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-04-20T12:34:06.747 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 9852, 2024-04-20T12:34:06.747 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 13458, 2024-04-20T12:34:06.747 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 3028565, 2024-04-20T12:34:06.747 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 9858496, 2024-04-20T12:34:06.747 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 174, 2024-04-20T12:34:06.747 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 9, 2024-04-20T12:34:06.747 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.780187840, 2024-04-20T12:34:06.747 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.264816565, 2024-04-20T12:34:06.748 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.420081030, 2024-04-20T12:34:06.748 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.166457975, 2024-04-20T12:34:06.748 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:34:06.748 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 13452, 2024-04-20T12:34:06.748 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.862577923, 2024-04-20T12:34:06.748 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000064122 2024-04-20T12:34:06.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.748 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:34:06.748 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 11338, 2024-04-20T12:34:06.748 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.003347159, 2024-04-20T12:34:06.748 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000295 2024-04-20T12:34:06.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.748 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 463248, 2024-04-20T12:34:06.748 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 293888 2024-04-20T12:34:06.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.749 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-04-20T12:34:06.749 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-04-20T12:34:06.749 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-04-20T12:34:06.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.749 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-04-20T12:34:06.749 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-04-20T12:34:06.749 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-04-20T12:34:06.749 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 4884, 2024-04-20T12:34:06.749 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2.670319796, 2024-04-20T12:34:06.749 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000546748 2024-04-20T12:34:06.749 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:06.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.749 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-04-20T12:34:06.749 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-04-20T12:34:06.750 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-04-20T12:34:06.750 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 5458, 2024-04-20T12:34:06.750 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.270134379, 2024-04-20T12:34:06.750 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000049493 2024-04-20T12:34:06.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:06.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.750 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-04-20T12:34:06.750 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 2605, 2024-04-20T12:34:06.750 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 2605, 2024-04-20T12:34:06.750 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-04-20T12:34:06.750 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2605, 2024-04-20T12:34:06.750 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 3.342388434, 2024-04-20T12:34:06.750 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001283066 2024-04-20T12:34:06.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.751 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-04-20T12:34:06.751 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-04-20T12:34:06.751 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-04-20T12:34:06.751 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-04-20T12:34:06.751 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 45, 2024-04-20T12:34:06.751 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-04-20T12:34:06.751 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-04-20T12:34:06.751 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 70, 2024-04-20T12:34:06.751 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 7, 2024-04-20T12:34:06.751 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 63, 2024-04-20T12:34:06.751 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-04-20T12:34:06.751 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 59, 2024-04-20T12:34:06.751 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-04-20T12:34:06.751 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 2, 2024-04-20T12:34:06.751 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 3, 2024-04-20T12:34:06.752 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 2, 2024-04-20T12:34:06.752 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 2678, 2024-04-20T12:34:06.752 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 2663, 2024-04-20T12:34:06.752 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-04-20T12:34:06.752 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-04-20T12:34:06.752 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-04-20T12:34:06.752 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-04-20T12:34:06.752 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-04-20T12:34:06.752 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-04-20T12:34:06.752 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-04-20T12:34:06.752 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-04-20T12:34:06.752 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-04-20T12:34:06.752 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-04-20T12:34:06.752 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-04-20T12:34:06.753 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-04-20T12:34:06.753 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 214, 2024-04-20T12:34:06.753 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-04-20T12:34:06.753 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 4, 2024-04-20T12:34:06.753 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 234, 2024-04-20T12:34:06.753 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 6, 2024-04-20T12:34:06.753 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 214, 2024-04-20T12:34:06.753 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-04-20T12:34:06.753 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-04-20T12:34:06.753 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-04-20T12:34:06.753 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 137, 2024-04-20T12:34:06.753 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 19, 2024-04-20T12:34:06.753 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 118, 2024-04-20T12:34:06.753 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 77, 2024-04-20T12:34:06.754 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-04-20T12:34:06.754 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 21, 2024-04-20T12:34:06.754 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 3640, 2024-04-20T12:34:06.754 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-04-20T12:34:06.754 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-20T12:34:06.754 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-20T12:34:06.754 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 2439, 2024-04-20T12:34:06.754 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 1213, 2024-04-20T12:34:06.754 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 12, 2024-04-20T12:34:06.754 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 1244 2024-04-20T12:34:06.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.754 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-04-20T12:34:06.754 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 21, 2024-04-20T12:34:06.754 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-04-20T12:34:06.755 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-04-20T12:34:06.755 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-04-20T12:34:06.755 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 37, 2024-04-20T12:34:06.755 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 2, 2024-04-20T12:34:06.755 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-04-20T12:34:06.755 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-04-20T12:34:06.755 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 1212, 2024-04-20T12:34:06.755 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 1210, 2024-04-20T12:34:06.755 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-04-20T12:34:06.755 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-04-20T12:34:06.755 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-04-20T12:34:06.755 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-04-20T12:34:06.755 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-04-20T12:34:06.755 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-04-20T12:34:06.756 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-04-20T12:34:06.756 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-04-20T12:34:06.756 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-04-20T12:34:06.756 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 19, 2024-04-20T12:34:06.756 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-04-20T12:34:06.756 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-04-20T12:34:06.756 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-04-20T12:34:06.756 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-04-20T12:34:06.756 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-04-20T12:34:06.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.756 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-04-20T12:34:06.756 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-04-20T12:34:06.756 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 6202, 2024-04-20T12:34:06.756 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 2667, 2024-04-20T12:34:06.756 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 2667, 2024-04-20T12:34:06.757 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 3535, 2024-04-20T12:34:06.757 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-04-20T12:34:06.757 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 2594, 2024-04-20T12:34:06.757 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 16, 2024-04-20T12:34:06.757 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 11, 2024-04-20T12:34:06.757 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 11, 2024-04-20T12:34:06.757 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 5, 2024-04-20T12:34:06.757 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 1, 2024-04-20T12:34:06.757 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-04-20T12:34:06.757 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 3, 2024-04-20T12:34:06.757 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 10260043, 2024-04-20T12:34:06.757 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 19265723, 2024-04-20T12:34:06.757 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 0, 2024-04-20T12:34:06.757 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-04-20T12:34:06.757 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2515, 2024-04-20T12:34:06.758 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 4.078137344, 2024-04-20T12:34:06.758 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001621525 2024-04-20T12:34:06.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.758 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 0 2024-04-20T12:34:06.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.758 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-04-20T12:34:06.758 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 26, 2024-04-20T12:34:06.758 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 1255, 2024-04-20T12:34:06.758 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 1229, 2024-04-20T12:34:06.758 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 20, 2024-04-20T12:34:06.758 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 24, 2024-04-20T12:34:06.758 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 4, 2024-04-20T12:34:06.758 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 70, 2024-04-20T12:34:06.758 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 1248, 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 1178, 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 3, 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 1228, 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 1225, 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 60108, 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 231800 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 2892, 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 1, 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 2605, 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 41, 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 2, 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1210, 2024-04-20T12:34:06.759 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.376364424, 2024-04-20T12:34:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001137491 2024-04-20T12:34:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-04-20T12:34:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 121, 2024-04-20T12:34:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.022871385, 2024-04-20T12:34:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000189019 2024-04-20T12:34:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-04-20T12:34:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-04-20T12:34:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.760 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.761 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.761 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-04-20T12:34:06.761 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-04-20T12:34:06.761 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000392661, 2024-04-20T12:34:06.761 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000196330 2024-04-20T12:34:06.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.761 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-04-20T12:34:06.761 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.761 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.761 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.761 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-04-20T12:34:06.761 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1, 2024-04-20T12:34:06.761 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000189051, 2024-04-20T12:34:06.762 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000189051 2024-04-20T12:34:06.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.762 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-04-20T12:34:06.762 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.762 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.762 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.762 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-04-20T12:34:06.762 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.762 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.762 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.762 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-04-20T12:34:06.762 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.762 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.763 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.763 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-04-20T12:34:06.763 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 11, 2024-04-20T12:34:06.763 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.001577002, 2024-04-20T12:34:06.763 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000143363 2024-04-20T12:34:06.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.764 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-04-20T12:34:06.764 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 12, 2024-04-20T12:34:06.764 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.017134058, 2024-04-20T12:34:06.764 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001427838 2024-04-20T12:34:06.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.764 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-04-20T12:34:06.764 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.764 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.764 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.764 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-04-20T12:34:06.764 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 11, 2024-04-20T12:34:06.764 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.060591805, 2024-04-20T12:34:06.764 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.005508345 2024-04-20T12:34:06.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.765 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-04-20T12:34:06.765 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1, 2024-04-20T12:34:06.765 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000189014, 2024-04-20T12:34:06.765 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000189014 2024-04-20T12:34:06.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.765 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-04-20T12:34:06.765 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 6, 2024-04-20T12:34:06.765 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.006837195, 2024-04-20T12:34:06.765 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001139532 2024-04-20T12:34:06.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.765 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-04-20T12:34:06.765 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-04-20T12:34:06.765 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.002117782, 2024-04-20T12:34:06.766 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001058891 2024-04-20T12:34:06.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.766 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-04-20T12:34:06.766 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.766 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.766 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.766 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-04-20T12:34:06.766 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.766 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.766 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.767 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-04-20T12:34:06.767 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 6, 2024-04-20T12:34:06.767 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.038235016, 2024-04-20T12:34:06.767 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.006372502 2024-04-20T12:34:06.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.767 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-04-20T12:34:06.767 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 5, 2024-04-20T12:34:06.767 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.022135467, 2024-04-20T12:34:06.767 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.004427093 2024-04-20T12:34:06.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.767 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-04-20T12:34:06.767 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.767 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.767 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.768 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-04-20T12:34:06.768 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2, 2024-04-20T12:34:06.768 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.001273945, 2024-04-20T12:34:06.768 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000636972 2024-04-20T12:34:06.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.768 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-04-20T12:34:06.768 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.768 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.768 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.768 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-04-20T12:34:06.768 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.768 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.768 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.769 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-04-20T12:34:06.769 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.769 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.769 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.769 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-04-20T12:34:06.769 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 9, 2024-04-20T12:34:06.769 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.027453349, 2024-04-20T12:34:06.769 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.003050372 2024-04-20T12:34:06.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.769 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-04-20T12:34:06.769 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.769 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.769 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.770 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-04-20T12:34:06.770 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 1206, 2024-04-20T12:34:06.770 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.765026280, 2024-04-20T12:34:06.770 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.001463537 2024-04-20T12:34:06.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.770 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-04-20T12:34:06.770 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-04-20T12:34:06.770 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-04-20T12:34:06.770 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.770 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.770 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.770 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:06.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.771 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-04-20T12:34:06.771 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 2, 2024-04-20T12:34:06.771 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 7, 2024-04-20T12:34:06.771 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 5, 2024-04-20T12:34:06.771 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 2, 2024-04-20T12:34:06.771 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-04-20T12:34:06.771 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 32, 2024-04-20T12:34:06.771 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 16, 2024-04-20T12:34:06.771 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 629, 2024-04-20T12:34:06.771 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-04-20T12:34:06.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.771 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-04-20T12:34:06.771 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-04-20T12:34:06.771 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-04-20T12:34:06.772 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-04-20T12:34:06.772 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-04-20T12:34:06.772 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-04-20T12:34:06.772 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-04-20T12:34:06.772 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-20T12:34:06.772 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-04-20T12:34:06.772 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-20T12:34:06.772 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-04-20T12:34:06.772 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-04-20T12:34:06.772 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-04-20T12:34:06.772 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-20T12:34:06.772 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-04-20T12:34:06.772 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-04-20T12:34:06.772 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-04-20T12:34:06.772 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-04-20T12:34:06.773 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-04-20T12:34:06.773 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-20T12:34:06.773 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-04-20T12:34:06.773 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-20T12:34:06.773 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-04-20T12:34:06.773 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-04-20T12:34:06.773 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-04-20T12:34:06.773 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-04-20T12:34:06.773 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-04-20T12:34:06.773 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-20T12:34:06.773 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-04-20T12:34:06.773 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-04-20T12:34:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-04-20T12:34:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-04-20T12:34:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-04-20T12:34:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-04-20T12:34:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-04-20T12:34:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-04-20T12:34:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-04-20T12:34:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 351534, 2024-04-20T12:34:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 148, 2024-04-20T12:34:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 792, 2024-04-20T12:34:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 9, 2024-04-20T12:34:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-04-20T12:34:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 9520, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 183, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 155730, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 1439, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-04-20T12:34:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-04-20T12:34:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-04-20T12:34:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-04-20T12:34:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-04-20T12:34:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 8336, 2024-04-20T12:34:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 15412608, 2024-04-20T12:34:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 37, 2024-04-20T12:34:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 8336, 2024-04-20T12:34:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-04-20T12:34:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 8336, 2024-04-20T12:34:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 38.479938022, 2024-04-20T12:34:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.004616115 2024-04-20T12:34:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-04-20T12:34:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-04-20T12:34:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 8336, 2024-04-20T12:34:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 8636 2024-04-20T12:34:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 8336, 2024-04-20T12:34:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 285, 2024-04-20T12:34:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 8051, 2024-04-20T12:34:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-04-20T12:34:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-04-20T12:34:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 24, 2024-04-20T12:34:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 112, 2024-04-20T12:34:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 52, 2024-04-20T12:34:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 2548, 2024-04-20T12:34:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 67, 2024-04-20T12:34:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-04-20T12:34:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-04-20T12:34:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-04-20T12:34:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-04-20T12:34:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 5218, 2024-04-20T12:34:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-04-20T12:34:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-04-20T12:34:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-04-20T12:34:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 233, 2024-04-20T12:34:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 181, 2024-04-20T12:34:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-04-20T12:34:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-04-20T12:34:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-04-20T12:34:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-04-20T12:34:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-04-20T12:34:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-04-20T12:34:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-04-20T12:34:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-04-20T12:34:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-04-20T12:34:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-04-20T12:34:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-04-20T12:34:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 103, 2024-04-20T12:34:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-04-20T12:34:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 19, 2024-04-20T12:34:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 12, 2024-04-20T12:34:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 12, 2024-04-20T12:34:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-04-20T12:34:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-04-20T12:34:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 178, 2024-04-20T12:34:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 0, 2024-04-20T12:34:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 23 2024-04-20T12:34:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-04-20T12:34:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 1, 2024-04-20T12:34:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-04-20T12:34:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-04-20T12:34:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-04-20T12:34:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-04-20T12:34:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-04-20T12:34:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-04-20T12:34:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-04-20T12:34:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 12, 2024-04-20T12:34:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-04-20T12:34:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 4, 2024-04-20T12:34:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 4702, 2024-04-20T12:34:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 1210, 2024-04-20T12:34:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-04-20T12:34:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-20T12:34:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-04-20T12:34:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 18770, 2024-04-20T12:34:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 5699644, 2024-04-20T12:34:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 18770, 2024-04-20T12:34:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-04-20T12:34:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-04-20T12:34:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 18770, 2024-04-20T12:34:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 5699644, 2024-04-20T12:34:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-04-20T12:34:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-04-20T12:34:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-04-20T12:34:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-04-20T12:34:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-04-20T12:34:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 8336, 2024-04-20T12:34:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 15544474, 2024-04-20T12:34:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 8336, 2024-04-20T12:34:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 15544474, 2024-04-20T12:34:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-04-20T12:34:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-04-20T12:34:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-04-20T12:34:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-04-20T12:34:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-04-20T12:34:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 8336, 2024-04-20T12:34:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 8336, 2024-04-20T12:34:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 8336, 2024-04-20T12:34:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 8336, 2024-04-20T12:34:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-04-20T12:34:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-04-20T12:34:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 1210, 2024-04-20T12:34:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 131866, 2024-04-20T12:34:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 1210, 2024-04-20T12:34:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-04-20T12:34:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-04-20T12:34:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 33, 2024-04-20T12:34:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 131866, 2024-04-20T12:34:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x55edf9240500": { 2024-04-20T12:34:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 60, 2024-04-20T12:34:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-04-20T12:34:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 6202, 2024-04-20T12:34:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 15071419, 2024-04-20T12:34:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 6202, 2024-04-20T12:34:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-04-20T12:34:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-04-20T12:34:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2515, 2024-04-20T12:34:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 15071359, 2024-04-20T12:34:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:06.789 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-20T12:34:07.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:06 smithi139 ceph-mon[21834]: pgmap v340: 129 pgs: 129 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:34:07.115 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:06 smithi135 ceph-mon[18264]: pgmap v340: 129 pgs: 129 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:34:07.524 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-04-20T12:34:07.524 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-04-20T12:34:07.524 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=21 2024-04-20T12:34:07.524 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=0 2024-04-20T12:34:07.524 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-04-20T12:34:07.524 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=11 2024-04-20T12:34:07.524 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=5 2024-04-20T12:34:07.524 DEBUG:tasks.check_counter:Getting stats from l 2024-04-20T12:34:07.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda shell --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 -- ceph daemon mds.l perf dump 2024-04-20T12:34:07.765 INFO:teuthology.orchestra.run.smithi154.stderr:Inferring config /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/mon.c/config 2024-04-20T12:34:08.931 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:08 smithi154 ceph-mon[22073]: pgmap v341: 129 pgs: 129 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:34:08.931 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:08 smithi154 ceph-mon[22073]: osdmap e104: 12 total, 12 up, 12 in 2024-04-20T12:34:09.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:08 smithi139 ceph-mon[21834]: pgmap v341: 129 pgs: 129 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:34:09.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:08 smithi139 ceph-mon[21834]: osdmap e104: 12 total, 12 up, 12 in 2024-04-20T12:34:09.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:08 smithi135 ceph-mon[18264]: pgmap v341: 129 pgs: 129 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-04-20T12:34:09.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:08 smithi135 ceph-mon[18264]: osdmap e104: 12 total, 12 up, 12 in 2024-04-20T12:34:09.469 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-20T12:34:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-0": { 2024-04-20T12:34:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 788, 2024-04-20T12:34:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 790, 2024-04-20T12:34:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 208834, 2024-04-20T12:34:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 250648, 2024-04-20T12:34:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 6, 2024-04-20T12:34:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 2, 2024-04-20T12:34:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.067998201, 2024-04-20T12:34:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.023042900, 2024-04-20T12:34:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.017371686, 2024-04-20T12:34:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.019834284, 2024-04-20T12:34:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:34:09.470 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 788, 2024-04-20T12:34:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.027859162, 2024-04-20T12:34:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000035354 2024-04-20T12:34:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:34:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 0, 2024-04-20T12:34:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 0 2024-04-20T12:34:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-1": { 2024-04-20T12:34:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 926, 2024-04-20T12:34:09.471 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 911, 2024-04-20T12:34:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 1810156, 2024-04-20T12:34:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 354355, 2024-04-20T12:34:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 4, 2024-04-20T12:34:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 3, 2024-04-20T12:34:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.111641251, 2024-04-20T12:34:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.032892734, 2024-04-20T12:34:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.054283084, 2024-04-20T12:34:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.029752728, 2024-04-20T12:34:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:34:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 910, 2024-04-20T12:34:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.032797736, 2024-04-20T12:34:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000036041 2024-04-20T12:34:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:34:09.472 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 1646544, 2024-04-20T12:34:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 142880 2024-04-20T12:34:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "AsyncMessenger::Worker-2": { 2024-04-20T12:34:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_messages": 786, 2024-04-20T12:34:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages": 956, 2024-04-20T12:34:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_bytes": 265472, 2024-04-20T12:34:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_bytes": 706104, 2024-04-20T12:34:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_created_connections": 6, 2024-04-20T12:34:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_active_connections": 4, 2024-04-20T12:34:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_total_time": 0.107515807, 2024-04-20T12:34:09.473 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_send_time": 0.037186148, 2024-04-20T12:34:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_recv_time": 0.026110537, 2024-04-20T12:34:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_running_fast_dispatch_time": 0.032691941, 2024-04-20T12:34:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_messages_queue_lat": { 2024-04-20T12:34:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 954, 2024-04-20T12:34:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.063451506, 2024-04-20T12:34:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000066511 2024-04-20T12:34:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_handle_ack_lat": { 2024-04-20T12:34:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-04-20T12:34:09.474 INFO:teuthology.orchestra.run.smithi154.stdout: "msgr_send_encrypted_bytes": 458064 2024-04-20T12:34:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "cct": { 2024-04-20T12:34:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "total_workers": 1, 2024-04-20T12:34:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "unhealthy_workers": 0 2024-04-20T12:34:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-MDSRank": { 2024-04-20T12:34:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-04-20T12:34:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-04-20T12:34:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 3677, 2024-04-20T12:34:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.116082195, 2024-04-20T12:34:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000031569 2024-04-20T12:34:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "finisher-PurgeQueue": { 2024-04-20T12:34:09.475 INFO:teuthology.orchestra.run.smithi154.stdout: "queue_len": 0, 2024-04-20T12:34:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: "complete_latency": { 2024-04-20T12:34:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: "mds": { 2024-04-20T12:34:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: "request": 0, 2024-04-20T12:34:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: "reply": 0, 2024-04-20T12:34:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: "reply_latency": { 2024-04-20T12:34:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.476 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_reply": 0, 2024-04-20T12:34:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: "forward": 0, 2024-04-20T12:34:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_complete": 0, 2024-04-20T12:34:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_fetch_keys": 0, 2024-04-20T12:34:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_commit": 0, 2024-04-20T12:34:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_split": 0, 2024-04-20T12:34:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_merge": 0, 2024-04-20T12:34:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes": 0, 2024-04-20T12:34:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_top": 0, 2024-04-20T12:34:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_bottom": 0, 2024-04-20T12:34:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pin_tail": 0, 2024-04-20T12:34:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_pinned": 0, 2024-04-20T12:34:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_expired": 0, 2024-04-20T12:34:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: "inodes_with_caps": 0, 2024-04-20T12:34:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: "caps": 0, 2024-04-20T12:34:09.477 INFO:teuthology.orchestra.run.smithi154.stdout: "subtrees": 1, 2024-04-20T12:34:09.478 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse": 0, 2024-04-20T12:34:09.478 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_hit": 0, 2024-04-20T12:34:09.478 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_forward": 0, 2024-04-20T12:34:09.478 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_discover": 0, 2024-04-20T12:34:09.478 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_dir_fetch": 0, 2024-04-20T12:34:09.478 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_remote_ino": 0, 2024-04-20T12:34:09.478 INFO:teuthology.orchestra.run.smithi154.stdout: "traverse_lock": 0, 2024-04-20T12:34:09.478 INFO:teuthology.orchestra.run.smithi154.stdout: "load_cent": 0, 2024-04-20T12:34:09.478 INFO:teuthology.orchestra.run.smithi154.stdout: "q": 0, 2024-04-20T12:34:09.478 INFO:teuthology.orchestra.run.smithi154.stdout: "exported": 0, 2024-04-20T12:34:09.478 INFO:teuthology.orchestra.run.smithi154.stdout: "exported_inodes": 0, 2024-04-20T12:34:09.478 INFO:teuthology.orchestra.run.smithi154.stdout: "imported": 0, 2024-04-20T12:34:09.478 INFO:teuthology.orchestra.run.smithi154.stdout: "imported_inodes": 0, 2024-04-20T12:34:09.478 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_dir_fetch": 0, 2024-04-20T12:34:09.478 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_backtrace_fetch": 0, 2024-04-20T12:34:09.479 INFO:teuthology.orchestra.run.smithi154.stdout: "openino_peer_discover": 0, 2024-04-20T12:34:09.479 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rfiles": 0, 2024-04-20T12:34:09.479 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rbytes": 0, 2024-04-20T12:34:09.479 INFO:teuthology.orchestra.run.smithi154.stdout: "root_rsnaps": 0, 2024-04-20T12:34:09.479 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_fetch": 0, 2024-04-20T12:34:09.479 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_set_tag": 0, 2024-04-20T12:34:09.479 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_backtrace_repaired": 0, 2024-04-20T12:34:09.479 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_inotable_repaired": 0, 2024-04-20T12:34:09.479 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_inodes": 0, 2024-04-20T12:34:09.479 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dir_base_inodes": 0, 2024-04-20T12:34:09.479 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_dirfrag_rstats": 0, 2024-04-20T12:34:09.479 INFO:teuthology.orchestra.run.smithi154.stdout: "scrub_file_inodes": 0, 2024-04-20T12:34:09.479 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_inode_file_caps": 0, 2024-04-20T12:34:09.479 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_revoke": 0, 2024-04-20T12:34:09.479 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_grant": 0, 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_trunc": 0, 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_cap_op_flush_ack": 0, 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps": 0, 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_caps_dirty": 0, 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_cap_release": 0, 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: "process_request_cap_release": 0 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_cache": { 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update": 0, 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_update_receipt": 0, 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_try_discover": 0, 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_send_discover": 0, 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: "dir_handle_discover": 0, 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays": 0, 2024-04-20T12:34:09.480 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_delayed": 0, 2024-04-20T12:34:09.481 INFO:teuthology.orchestra.run.smithi154.stdout: "num_strays_enqueuing": 0, 2024-04-20T12:34:09.481 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_created": 0, 2024-04-20T12:34:09.481 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_enqueued": 0, 2024-04-20T12:34:09.481 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_reintegrated": 0, 2024-04-20T12:34:09.481 INFO:teuthology.orchestra.run.smithi154.stdout: "strays_migrated": 0, 2024-04-20T12:34:09.481 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_processing": 0, 2024-04-20T12:34:09.481 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_enqueued": 0, 2024-04-20T12:34:09.481 INFO:teuthology.orchestra.run.smithi154.stdout: "num_recovering_prioritized": 0, 2024-04-20T12:34:09.481 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_started": 0, 2024-04-20T12:34:09.481 INFO:teuthology.orchestra.run.smithi154.stdout: "recovery_completed": 0, 2024-04-20T12:34:09.481 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_path": 0, 2024-04-20T12:34:09.481 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_quiesce_inode": 0, 2024-04-20T12:34:09.481 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_enqueue_scrub": 0, 2024-04-20T12:34:09.481 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_exportdir": 0, 2024-04-20T12:34:09.481 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_flush": 0, 2024-04-20T12:34:09.482 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragmentdir": 0, 2024-04-20T12:34:09.482 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_fragstats": 0, 2024-04-20T12:34:09.482 INFO:teuthology.orchestra.run.smithi154.stdout: "ireq_inodestats": 0 2024-04-20T12:34:09.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.482 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_log": { 2024-04-20T12:34:09.482 INFO:teuthology.orchestra.run.smithi154.stdout: "evlrg": 0, 2024-04-20T12:34:09.482 INFO:teuthology.orchestra.run.smithi154.stdout: "evadd": 0, 2024-04-20T12:34:09.482 INFO:teuthology.orchestra.run.smithi154.stdout: "evex": 0, 2024-04-20T12:34:09.482 INFO:teuthology.orchestra.run.smithi154.stdout: "evtrm": 0, 2024-04-20T12:34:09.482 INFO:teuthology.orchestra.run.smithi154.stdout: "ev": 6, 2024-04-20T12:34:09.482 INFO:teuthology.orchestra.run.smithi154.stdout: "evexg": 0, 2024-04-20T12:34:09.482 INFO:teuthology.orchestra.run.smithi154.stdout: "evexd": 0, 2024-04-20T12:34:09.482 INFO:teuthology.orchestra.run.smithi154.stdout: "segadd": 0, 2024-04-20T12:34:09.482 INFO:teuthology.orchestra.run.smithi154.stdout: "segex": 0, 2024-04-20T12:34:09.483 INFO:teuthology.orchestra.run.smithi154.stdout: "segtrm": 0, 2024-04-20T12:34:09.483 INFO:teuthology.orchestra.run.smithi154.stdout: "seg": 2, 2024-04-20T12:34:09.483 INFO:teuthology.orchestra.run.smithi154.stdout: "segmjr": 2, 2024-04-20T12:34:09.483 INFO:teuthology.orchestra.run.smithi154.stdout: "segexg": 0, 2024-04-20T12:34:09.483 INFO:teuthology.orchestra.run.smithi154.stdout: "segexd": 0, 2024-04-20T12:34:09.483 INFO:teuthology.orchestra.run.smithi154.stdout: "expos": 4194304, 2024-04-20T12:34:09.483 INFO:teuthology.orchestra.run.smithi154.stdout: "wrpos": 4196123, 2024-04-20T12:34:09.483 INFO:teuthology.orchestra.run.smithi154.stdout: "rdpos": 4195982, 2024-04-20T12:34:09.483 INFO:teuthology.orchestra.run.smithi154.stdout: "jlat": { 2024-04-20T12:34:09.483 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.483 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.483 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.483 INFO:teuthology.orchestra.run.smithi154.stdout: "replayed": 6 2024-04-20T12:34:09.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.484 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_mem": { 2024-04-20T12:34:09.484 INFO:teuthology.orchestra.run.smithi154.stdout: "ino": 3, 2024-04-20T12:34:09.484 INFO:teuthology.orchestra.run.smithi154.stdout: "ino+": 3, 2024-04-20T12:34:09.484 INFO:teuthology.orchestra.run.smithi154.stdout: "ino-": 0, 2024-04-20T12:34:09.484 INFO:teuthology.orchestra.run.smithi154.stdout: "dir": 1, 2024-04-20T12:34:09.484 INFO:teuthology.orchestra.run.smithi154.stdout: "dir+": 1, 2024-04-20T12:34:09.484 INFO:teuthology.orchestra.run.smithi154.stdout: "dir-": 0, 2024-04-20T12:34:09.484 INFO:teuthology.orchestra.run.smithi154.stdout: "dn": 0, 2024-04-20T12:34:09.484 INFO:teuthology.orchestra.run.smithi154.stdout: "dn+": 0, 2024-04-20T12:34:09.484 INFO:teuthology.orchestra.run.smithi154.stdout: "dn-": 0, 2024-04-20T12:34:09.484 INFO:teuthology.orchestra.run.smithi154.stdout: "cap": 0, 2024-04-20T12:34:09.484 INFO:teuthology.orchestra.run.smithi154.stdout: "cap+": 0, 2024-04-20T12:34:09.484 INFO:teuthology.orchestra.run.smithi154.stdout: "cap-": 0, 2024-04-20T12:34:09.484 INFO:teuthology.orchestra.run.smithi154.stdout: "rss": 52804, 2024-04-20T12:34:09.484 INFO:teuthology.orchestra.run.smithi154.stdout: "heap": 215416 2024-04-20T12:34:09.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.485 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_server": { 2024-04-20T12:34:09.485 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_client_request": 0, 2024-04-20T12:34:09.485 INFO:teuthology.orchestra.run.smithi154.stdout: "dispatch_server_request": 0, 2024-04-20T12:34:09.485 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_request": 0, 2024-04-20T12:34:09.485 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_client_session": 0, 2024-04-20T12:34:09.485 INFO:teuthology.orchestra.run.smithi154.stdout: "handle_peer_request": 0, 2024-04-20T12:34:09.485 INFO:teuthology.orchestra.run.smithi154.stdout: "req_create_latency": { 2024-04-20T12:34:09.485 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.485 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.485 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.485 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getattr_latency": { 2024-04-20T12:34:09.485 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.485 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.486 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.486 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getfilelock_latency": { 2024-04-20T12:34:09.486 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.486 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.486 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.486 INFO:teuthology.orchestra.run.smithi154.stdout: "req_link_latency": { 2024-04-20T12:34:09.486 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.486 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.486 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.486 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookup_latency": { 2024-04-20T12:34:09.486 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.486 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookuphash_latency": { 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupino_latency": { 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupname_latency": { 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.487 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.488 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupparent_latency": { 2024-04-20T12:34:09.488 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.488 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.488 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.488 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lookupsnap_latency": { 2024-04-20T12:34:09.488 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.488 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.488 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.488 INFO:teuthology.orchestra.run.smithi154.stdout: "req_lssnap_latency": { 2024-04-20T12:34:09.488 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.488 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.488 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.489 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mkdir_latency": { 2024-04-20T12:34:09.489 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.489 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.489 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.490 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mknod_latency": { 2024-04-20T12:34:09.490 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.490 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.490 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.490 INFO:teuthology.orchestra.run.smithi154.stdout: "req_mksnap_latency": { 2024-04-20T12:34:09.490 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.490 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.490 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.490 INFO:teuthology.orchestra.run.smithi154.stdout: "req_open_latency": { 2024-04-20T12:34:09.490 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.490 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.491 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.491 INFO:teuthology.orchestra.run.smithi154.stdout: "req_readdir_latency": { 2024-04-20T12:34:09.491 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.491 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.491 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.491 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rename_latency": { 2024-04-20T12:34:09.491 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.491 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.491 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.491 INFO:teuthology.orchestra.run.smithi154.stdout: "req_renamesnap_latency": { 2024-04-20T12:34:09.491 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.491 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: "req_snapdiff_latency": { 2024-04-20T12:34:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmdir_latency": { 2024-04-20T12:34:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmsnap_latency": { 2024-04-20T12:34:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.492 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: "req_rmxattr_latency": { 2024-04-20T12:34:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setattr_latency": { 2024-04-20T12:34:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setdirlayout_latency": { 2024-04-20T12:34:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.493 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.494 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.494 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setfilelock_latency": { 2024-04-20T12:34:09.494 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.494 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.494 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.494 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setlayout_latency": { 2024-04-20T12:34:09.494 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.494 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.494 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.494 INFO:teuthology.orchestra.run.smithi154.stdout: "req_setxattr_latency": { 2024-04-20T12:34:09.494 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.495 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.495 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.495 INFO:teuthology.orchestra.run.smithi154.stdout: "req_symlink_latency": { 2024-04-20T12:34:09.495 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.495 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.495 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.495 INFO:teuthology.orchestra.run.smithi154.stdout: "req_unlink_latency": { 2024-04-20T12:34:09.495 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.495 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.495 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.495 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_revoke_eviction": 0, 2024-04-20T12:34:09.495 INFO:teuthology.orchestra.run.smithi154.stdout: "cap_acquisition_throttle": 0, 2024-04-20T12:34:09.496 INFO:teuthology.orchestra.run.smithi154.stdout: "req_getvxattr_latency": { 2024-04-20T12:34:09.496 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.496 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.496 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.496 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:09.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.496 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_sessions": { 2024-04-20T12:34:09.496 INFO:teuthology.orchestra.run.smithi154.stdout: "session_count": 2, 2024-04-20T12:34:09.496 INFO:teuthology.orchestra.run.smithi154.stdout: "session_add": 3, 2024-04-20T12:34:09.496 INFO:teuthology.orchestra.run.smithi154.stdout: "session_remove": 1, 2024-04-20T12:34:09.496 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_open": 3, 2024-04-20T12:34:09.496 INFO:teuthology.orchestra.run.smithi154.stdout: "sessions_stale": 0, 2024-04-20T12:34:09.496 INFO:teuthology.orchestra.run.smithi154.stdout: "total_load": 0, 2024-04-20T12:34:09.496 INFO:teuthology.orchestra.run.smithi154.stdout: "average_load": 0, 2024-04-20T12:34:09.497 INFO:teuthology.orchestra.run.smithi154.stdout: "avg_session_uptime": 2251, 2024-04-20T12:34:09.497 INFO:teuthology.orchestra.run.smithi154.stdout: "mdthresh_evicted": 0 2024-04-20T12:34:09.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.497 INFO:teuthology.orchestra.run.smithi154.stdout: "mempool": { 2024-04-20T12:34:09.497 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_bytes": 0, 2024-04-20T12:34:09.497 INFO:teuthology.orchestra.run.smithi154.stdout: "bloom_filter_items": 0, 2024-04-20T12:34:09.497 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_bytes": 0, 2024-04-20T12:34:09.497 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_alloc_items": 0, 2024-04-20T12:34:09.497 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_bytes": 0, 2024-04-20T12:34:09.497 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_data_items": 0, 2024-04-20T12:34:09.497 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_bytes": 0, 2024-04-20T12:34:09.497 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_onode_items": 0, 2024-04-20T12:34:09.497 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_bytes": 0, 2024-04-20T12:34:09.497 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_meta_items": 0, 2024-04-20T12:34:09.498 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_bytes": 0, 2024-04-20T12:34:09.498 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_other_items": 0, 2024-04-20T12:34:09.498 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_bytes": 0, 2024-04-20T12:34:09.498 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_cache_buffer_items": 0, 2024-04-20T12:34:09.498 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_bytes": 0, 2024-04-20T12:34:09.498 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_extent_items": 0, 2024-04-20T12:34:09.498 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_bytes": 0, 2024-04-20T12:34:09.498 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_blob_items": 0, 2024-04-20T12:34:09.498 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_bytes": 0, 2024-04-20T12:34:09.498 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_shared_blob_items": 0, 2024-04-20T12:34:09.498 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_bytes": 0, 2024-04-20T12:34:09.498 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_inline_bl_items": 0, 2024-04-20T12:34:09.498 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_bytes": 0, 2024-04-20T12:34:09.498 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_fsck_items": 0, 2024-04-20T12:34:09.499 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_bytes": 0, 2024-04-20T12:34:09.499 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_txc_items": 0, 2024-04-20T12:34:09.499 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_bytes": 0, 2024-04-20T12:34:09.499 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_deferred_items": 0, 2024-04-20T12:34:09.499 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_bytes": 0, 2024-04-20T12:34:09.499 INFO:teuthology.orchestra.run.smithi154.stdout: "bluestore_writing_items": 0, 2024-04-20T12:34:09.499 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_bytes": 0, 2024-04-20T12:34:09.499 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_items": 0, 2024-04-20T12:34:09.499 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_bytes": 0, 2024-04-20T12:34:09.499 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_reader_items": 0, 2024-04-20T12:34:09.499 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_bytes": 0, 2024-04-20T12:34:09.499 INFO:teuthology.orchestra.run.smithi154.stdout: "bluefs_file_writer_items": 0, 2024-04-20T12:34:09.499 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_bytes": 190207, 2024-04-20T12:34:09.499 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_anon_items": 53, 2024-04-20T12:34:09.500 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_bytes": 0, 2024-04-20T12:34:09.500 INFO:teuthology.orchestra.run.smithi154.stdout: "buffer_meta_items": 0, 2024-04-20T12:34:09.500 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_bytes": 0, 2024-04-20T12:34:09.500 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_items": 0, 2024-04-20T12:34:09.500 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_bytes": 0, 2024-04-20T12:34:09.500 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_mapbl_items": 0, 2024-04-20T12:34:09.500 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_bytes": 0, 2024-04-20T12:34:09.500 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_pglog_items": 0, 2024-04-20T12:34:09.500 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_bytes": 9760, 2024-04-20T12:34:09.500 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_items": 189, 2024-04-20T12:34:09.500 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_bytes": 0, 2024-04-20T12:34:09.500 INFO:teuthology.orchestra.run.smithi154.stdout: "osdmap_mapping_items": 0, 2024-04-20T12:34:09.500 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_bytes": 0, 2024-04-20T12:34:09.500 INFO:teuthology.orchestra.run.smithi154.stdout: "pgmap_items": 0, 2024-04-20T12:34:09.500 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_bytes": 8512, 2024-04-20T12:34:09.501 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_co_items": 13, 2024-04-20T12:34:09.501 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_bytes": 0, 2024-04-20T12:34:09.501 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_1_items": 0, 2024-04-20T12:34:09.501 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_bytes": 0, 2024-04-20T12:34:09.501 INFO:teuthology.orchestra.run.smithi154.stdout: "unittest_2_items": 0 2024-04-20T12:34:09.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.501 INFO:teuthology.orchestra.run.smithi154.stdout: "objecter": { 2024-04-20T12:34:09.501 INFO:teuthology.orchestra.run.smithi154.stdout: "op_active": 0, 2024-04-20T12:34:09.501 INFO:teuthology.orchestra.run.smithi154.stdout: "op_laggy": 0, 2024-04-20T12:34:09.501 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send": 2233, 2024-04-20T12:34:09.501 INFO:teuthology.orchestra.run.smithi154.stdout: "op_send_bytes": 21, 2024-04-20T12:34:09.501 INFO:teuthology.orchestra.run.smithi154.stdout: "op_resend": 3, 2024-04-20T12:34:09.501 INFO:teuthology.orchestra.run.smithi154.stdout: "op_reply": 2233, 2024-04-20T12:34:09.501 INFO:teuthology.orchestra.run.smithi154.stdout: "op_latency": { 2024-04-20T12:34:09.501 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2233, 2024-04-20T12:34:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 1.101969486, 2024-04-20T12:34:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000493492 2024-04-20T12:34:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: "op_inflight": 0, 2024-04-20T12:34:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: "oplen_avg": { 2024-04-20T12:34:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 2233, 2024-04-20T12:34:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 2234 2024-04-20T12:34:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: "op": 2233, 2024-04-20T12:34:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: "op_r": 2233, 2024-04-20T12:34:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: "op_w": 0, 2024-04-20T12:34:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: "op_rmw": 0, 2024-04-20T12:34:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: "op_pg": 0, 2024-04-20T12:34:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_stat": 1443, 2024-04-20T12:34:09.502 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_create": 0, 2024-04-20T12:34:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_read": 788, 2024-04-20T12:34:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_write": 0, 2024-04-20T12:34:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writefull": 0, 2024-04-20T12:34:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_writesame": 0, 2024-04-20T12:34:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_append": 0, 2024-04-20T12:34:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_zero": 0, 2024-04-20T12:34:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_truncate": 0, 2024-04-20T12:34:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_delete": 0, 2024-04-20T12:34:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_mapext": 0, 2024-04-20T12:34:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_sparse_read": 0, 2024-04-20T12:34:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_clonerange": 0, 2024-04-20T12:34:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_getxattr": 1, 2024-04-20T12:34:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_setxattr": 0, 2024-04-20T12:34:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_cmpxattr": 0, 2024-04-20T12:34:09.503 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_rmxattr": 0, 2024-04-20T12:34:09.504 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_resetxattrs": 0, 2024-04-20T12:34:09.504 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_call": 0, 2024-04-20T12:34:09.504 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_watch": 0, 2024-04-20T12:34:09.504 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_notify": 0, 2024-04-20T12:34:09.504 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_src_cmpxattr": 0, 2024-04-20T12:34:09.504 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls": 0, 2024-04-20T12:34:09.504 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_pgls_filter": 0, 2024-04-20T12:34:09.504 INFO:teuthology.orchestra.run.smithi154.stdout: "osdop_other": 0, 2024-04-20T12:34:09.504 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_active": 0, 2024-04-20T12:34:09.504 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_send": 0, 2024-04-20T12:34:09.504 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_resend": 0, 2024-04-20T12:34:09.504 INFO:teuthology.orchestra.run.smithi154.stdout: "linger_ping": 0, 2024-04-20T12:34:09.504 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_active": 0, 2024-04-20T12:34:09.504 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_send": 0, 2024-04-20T12:34:09.505 INFO:teuthology.orchestra.run.smithi154.stdout: "poolop_resend": 0, 2024-04-20T12:34:09.505 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_active": 0, 2024-04-20T12:34:09.505 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_send": 0, 2024-04-20T12:34:09.505 INFO:teuthology.orchestra.run.smithi154.stdout: "poolstat_resend": 0, 2024-04-20T12:34:09.505 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_active": 0, 2024-04-20T12:34:09.505 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_send": 0, 2024-04-20T12:34:09.505 INFO:teuthology.orchestra.run.smithi154.stdout: "statfs_resend": 0, 2024-04-20T12:34:09.505 INFO:teuthology.orchestra.run.smithi154.stdout: "command_active": 0, 2024-04-20T12:34:09.505 INFO:teuthology.orchestra.run.smithi154.stdout: "command_send": 0, 2024-04-20T12:34:09.505 INFO:teuthology.orchestra.run.smithi154.stdout: "command_resend": 0, 2024-04-20T12:34:09.505 INFO:teuthology.orchestra.run.smithi154.stdout: "map_epoch": 104, 2024-04-20T12:34:09.505 INFO:teuthology.orchestra.run.smithi154.stdout: "map_full": 0, 2024-04-20T12:34:09.506 INFO:teuthology.orchestra.run.smithi154.stdout: "map_inc": 14, 2024-04-20T12:34:09.506 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_sessions": 5, 2024-04-20T12:34:09.506 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_open": 5, 2024-04-20T12:34:09.506 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_session_close": 0, 2024-04-20T12:34:09.506 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_laggy": 0, 2024-04-20T12:34:09.506 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_wr": 0, 2024-04-20T12:34:09.506 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_rd": 2, 2024-04-20T12:34:09.506 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_del": 0 2024-04-20T12:34:09.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.506 INFO:teuthology.orchestra.run.smithi154.stdout: "oft": { 2024-04-20T12:34:09.506 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_objs": 0, 2024-04-20T12:34:09.506 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_kv_pairs": 0, 2024-04-20T12:34:09.506 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_updates": 0, 2024-04-20T12:34:09.506 INFO:teuthology.orchestra.run.smithi154.stdout: "omap_total_removes": 0 2024-04-20T12:34:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: "osd-slow-ops": { 2024-04-20T12:34:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: "slow_ops_count": 0 2024-04-20T12:34:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: "purge_queue": { 2024-04-20T12:34:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops": 0, 2024-04-20T12:34:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_ops_high_water": 0, 2024-04-20T12:34:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing": 0, 2024-04-20T12:34:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executing_high_water": 0, 2024-04-20T12:34:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed_ops": 0, 2024-04-20T12:34:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_executed": 0, 2024-04-20T12:34:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: "pq_item_in_journal": 0 2024-04-20T12:34:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-04-20T12:34:09.507 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:09.508 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-04-20T12:34:09.508 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:09.508 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 2496, 2024-04-20T12:34:09.508 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 2043383, 2024-04-20T12:34:09.508 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:09.508 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 2496, 2024-04-20T12:34:09.508 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-04-20T12:34:09.508 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-04-20T12:34:09.508 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2496, 2024-04-20T12:34:09.508 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 2043383, 2024-04-20T12:34:09.508 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:09.508 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.508 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.508 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.508 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:09.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.509 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_bytes": { 2024-04-20T12:34:09.509 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:09.509 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 104857600, 2024-04-20T12:34:09.509 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:09.509 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-04-20T12:34:09.509 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-04-20T12:34:09.509 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:09.509 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-04-20T12:34:09.509 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 2233, 2024-04-20T12:34:09.509 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 1824, 2024-04-20T12:34:09.509 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2233, 2024-04-20T12:34:09.509 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 1824, 2024-04-20T12:34:09.509 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:09.509 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.510 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.510 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.510 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:09.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.510 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-objecter_ops": { 2024-04-20T12:34:09.510 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:09.510 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 1024, 2024-04-20T12:34:09.510 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:09.510 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-04-20T12:34:09.510 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-04-20T12:34:09.510 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:09.510 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-04-20T12:34:09.510 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 2233, 2024-04-20T12:34:09.510 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 2233, 2024-04-20T12:34:09.510 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 2233, 2024-04-20T12:34:09.511 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 2233, 2024-04-20T12:34:09.511 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:09.511 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.511 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.511 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:09.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.511 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle": { 2024-04-20T12:34:09.511 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:09.511 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-04-20T12:34:09.511 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:09.511 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-04-20T12:34:09.511 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-04-20T12:34:09.511 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: "throttle-write_buf_throttle-0x557f087386e0": { 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: "val": 0, 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: "max": 3758096384, 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: "get_started": 0, 2024-04-20T12:34:09.512 INFO:teuthology.orchestra.run.smithi154.stdout: "get": 0, 2024-04-20T12:34:09.513 INFO:teuthology.orchestra.run.smithi154.stdout: "get_sum": 0, 2024-04-20T12:34:09.513 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_fail": 0, 2024-04-20T12:34:09.513 INFO:teuthology.orchestra.run.smithi154.stdout: "get_or_fail_success": 0, 2024-04-20T12:34:09.513 INFO:teuthology.orchestra.run.smithi154.stdout: "take": 0, 2024-04-20T12:34:09.513 INFO:teuthology.orchestra.run.smithi154.stdout: "take_sum": 0, 2024-04-20T12:34:09.513 INFO:teuthology.orchestra.run.smithi154.stdout: "put": 0, 2024-04-20T12:34:09.513 INFO:teuthology.orchestra.run.smithi154.stdout: "put_sum": 0, 2024-04-20T12:34:09.513 INFO:teuthology.orchestra.run.smithi154.stdout: "wait": { 2024-04-20T12:34:09.513 INFO:teuthology.orchestra.run.smithi154.stdout: "avgcount": 0, 2024-04-20T12:34:09.513 INFO:teuthology.orchestra.run.smithi154.stdout: "sum": 0.000000000, 2024-04-20T12:34:09.513 INFO:teuthology.orchestra.run.smithi154.stdout: "avgtime": 0.000000000 2024-04-20T12:34:09.513 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:09.513 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-20T12:34:09.513 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-20T12:34:10.262 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-04-20T12:34:10.262 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-04-20T12:34:10.262 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-04-20T12:34:10.262 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-04-20T12:34:10.262 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-04-20T12:34:10.262 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-04-20T12:34:10.262 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-04-20T12:34:10.263 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-20T12:34:10.276 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-20T12:34:10.277 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:34:10.277 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T12:34:10.298 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-04-20T12:34:10.298 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T12:34:10.357 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:34:10.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.507+0000 7f307c1f4640 1 -- 172.21.15.135:0/1192594447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307410c540 msgr2=0x7f307410e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:10.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.507+0000 7f307c1f4640 1 --2- 172.21.15.135:0/1192594447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307410c540 0x7f307410e9e0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f306c009ca0 tx=0x7f306c02c230 comp rx=0 tx=0).stop 2024-04-20T12:34:10.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.507+0000 7f307c1f4640 1 -- 172.21.15.135:0/1192594447 shutdown_connections 2024-04-20T12:34:10.508 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.507+0000 7f307c1f4640 1 --2- 172.21.15.135:0/1192594447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f307410c540 0x7f307410e9e0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:10.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.507+0000 7f307c1f4640 1 --2- 172.21.15.135:0/1192594447 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3074103b20 0x7f307410c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:10.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.507+0000 7f307c1f4640 1 --2- 172.21.15.135:0/1192594447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3074103200 0x7f30741035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:10.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.507+0000 7f307c1f4640 1 -- 172.21.15.135:0/1192594447 >> 172.21.15.135:0/1192594447 conn(0x7f3074077f60 msgr2=0x7f3074078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:10.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.507+0000 7f307c1f4640 1 -- 172.21.15.135:0/1192594447 shutdown_connections 2024-04-20T12:34:10.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.507+0000 7f307c1f4640 1 -- 172.21.15.135:0/1192594447 wait complete. 2024-04-20T12:34:10.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.507+0000 7f307c1f4640 1 Processor -- start 2024-04-20T12:34:10.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.507+0000 7f307c1f4640 1 -- start start 2024-04-20T12:34:10.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307c1f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3074103200 0x7f307419e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:10.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307c1f4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3074103b20 0x7f307419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:10.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307c1f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f307410c540 0x7f3074198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:10.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307c1f4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3074112320 con 0x7f3074103b20 2024-04-20T12:34:10.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307c1f4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f30741121a0 con 0x7f3074103200 2024-04-20T12:34:10.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307c1f4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f30741124a0 con 0x7f307410c540 2024-04-20T12:34:10.509 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307978f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3074103b20 0x7f307419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:10.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307978f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3074103b20 0x7f307419e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55410/0 (socket says 172.21.15.135:55410) 2024-04-20T12:34:10.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307978f640 1 -- 172.21.15.135:0/2192245913 learned_addr learned my addr 172.21.15.135:0/2192245913 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:34:10.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f3079f90640 1 --2- 172.21.15.135:0/2192245913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3074103200 0x7f307419e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:10.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307a791640 1 --2- 172.21.15.135:0/2192245913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f307410c540 0x7f3074198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:10.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307978f640 1 -- 172.21.15.135:0/2192245913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f307410c540 msgr2=0x7f3074198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:10.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307978f640 1 --2- 172.21.15.135:0/2192245913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f307410c540 0x7f3074198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:10.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307978f640 1 -- 172.21.15.135:0/2192245913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3074103200 msgr2=0x7f307419e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:10.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307978f640 1 --2- 172.21.15.135:0/2192245913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3074103200 0x7f307419e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:10.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307978f640 1 -- 172.21.15.135:0/2192245913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3074198da0 con 0x7f3074103b20 2024-04-20T12:34:10.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307978f640 1 --2- 172.21.15.135:0/2192245913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3074103b20 0x7f307419e960 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f306400d950 tx=0x7f306400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:10.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f306affd640 1 -- 172.21.15.135:0/2192245913 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064017070 con 0x7f3074103b20 2024-04-20T12:34:10.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307c1f4640 1 -- 172.21.15.135:0/2192245913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3074199090 con 0x7f3074103b20 2024-04-20T12:34:10.510 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f306affd640 1 -- 172.21.15.135:0/2192245913 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3064009c30 con 0x7f3074103b20 2024-04-20T12:34:10.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f306affd640 1 -- 172.21.15.135:0/2192245913 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306400f6b0 con 0x7f3074103b20 2024-04-20T12:34:10.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.508+0000 7f307c1f4640 1 -- 172.21.15.135:0/2192245913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30741a52e0 con 0x7f3074103b20 2024-04-20T12:34:10.511 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.510+0000 7f307c1f4640 1 -- 172.21.15.135:0/2192245913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30740691d0 con 0x7f3074103b20 2024-04-20T12:34:10.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.511+0000 7f306affd640 1 -- 172.21.15.135:0/2192245913 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f30640109d0 con 0x7f3074103b20 2024-04-20T12:34:10.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.511+0000 7f306affd640 1 --2- 172.21.15.135:0/2192245913 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f30600a3d20 0x7f30600a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:10.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.511+0000 7f3079f90640 1 --2- 172.21.15.135:0/2192245913 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f30600a3d20 0x7f30600a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:10.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.511+0000 7f306affd640 1 -- 172.21.15.135:0/2192245913 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9592+0+0 (secure 0 0 0) 0x7f30640d0700 con 0x7f3074103b20 2024-04-20T12:34:10.512 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.512+0000 7f3079f90640 1 --2- 172.21.15.135:0/2192245913 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f30600a3d20 0x7f30600a61e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3070009bd0 tx=0x7f3070005f90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:10.515 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.516+0000 7f306affd640 1 -- 172.21.15.135:0/2192245913 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f3064009de0 con 0x7f3074103b20 2024-04-20T12:34:10.698 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.698+0000 7f307c1f4640 1 -- 172.21.15.135:0/2192245913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30741076f0 con 0x7f3074103b20 2024-04-20T12:34:10.699 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.700+0000 7f306affd640 1 -- 172.21.15.135:0/2192245913 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+25518 (secure 0 0 0) 0x7f306409c320 con 0x7f3074103b20 2024-04-20T12:34:10.700 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:34:10.700 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":104,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:34:07.636126+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2052292307":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/669936771":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/4276159294":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6800/3831149339":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/1087722944":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6801/3831149339":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:34:10.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.702+0000 7f307c1f4640 1 -- 172.21.15.135:0/2192245913 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f30600a3d20 msgr2=0x7f30600a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:10.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.702+0000 7f307c1f4640 1 --2- 172.21.15.135:0/2192245913 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f30600a3d20 0x7f30600a61e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3070009bd0 tx=0x7f3070005f90 comp rx=0 tx=0).stop 2024-04-20T12:34:10.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.702+0000 7f307c1f4640 1 -- 172.21.15.135:0/2192245913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3074103b20 msgr2=0x7f307419e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:10.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.702+0000 7f307c1f4640 1 --2- 172.21.15.135:0/2192245913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3074103b20 0x7f307419e960 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f306400d950 tx=0x7f306400de10 comp rx=0 tx=0).stop 2024-04-20T12:34:10.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.702+0000 7f307c1f4640 1 -- 172.21.15.135:0/2192245913 shutdown_connections 2024-04-20T12:34:10.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.702+0000 7f307c1f4640 1 --2- 172.21.15.135:0/2192245913 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f30600a3d20 0x7f30600a61e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:10.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.702+0000 7f307c1f4640 1 --2- 172.21.15.135:0/2192245913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f307410c540 0x7f3074198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:10.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.702+0000 7f307c1f4640 1 --2- 172.21.15.135:0/2192245913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3074103b20 0x7f307419e960 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:10.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.702+0000 7f307c1f4640 1 --2- 172.21.15.135:0/2192245913 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3074103200 0x7f307419e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:10.702 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.702+0000 7f307c1f4640 1 -- 172.21.15.135:0/2192245913 >> 172.21.15.135:0/2192245913 conn(0x7f3074077f60 msgr2=0x7f30740fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:10.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.702+0000 7f307c1f4640 1 -- 172.21.15.135:0/2192245913 shutdown_connections 2024-04-20T12:34:10.703 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.702+0000 7f307c1f4640 1 -- 172.21.15.135:0/2192245913 wait complete. 2024-04-20T12:34:10.711 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:10 smithi135 ceph-mon[18264]: pgmap v343: 129 pgs: 129 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-20T12:34:10.713 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T12:16:02.802023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-20T12:20:39.656129+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-20T12:20:40.312827+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-20T12:20:44.307136+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-20T12:34:10.713 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T12:34:10.819 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.818+0000 7f389bc31640 1 -- 172.21.15.135:0/3539470718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f389410e800 msgr2=0x7f3894110bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.818+0000 7f389bc31640 1 --2- 172.21.15.135:0/3539470718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f389410e800 0x7f3894110bf0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f388c009ca0 tx=0x7f388c02c180 comp rx=0 tx=0).stop 2024-04-20T12:34:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.818+0000 7f389bc31640 1 -- 172.21.15.135:0/3539470718 shutdown_connections 2024-04-20T12:34:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.818+0000 7f389bc31640 1 --2- 172.21.15.135:0/3539470718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f389410e800 0x7f3894110bf0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.818+0000 7f389bc31640 1 --2- 172.21.15.135:0/3539470718 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3894074c30 0x7f389410e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.818+0000 7f389bc31640 1 --2- 172.21.15.135:0/3539470718 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3894074310 0x7f38940746f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.818+0000 7f389bc31640 1 -- 172.21.15.135:0/3539470718 >> 172.21.15.135:0/3539470718 conn(0x7f3894079360 msgr2=0x7f3894079770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.818+0000 7f389bc31640 1 -- 172.21.15.135:0/3539470718 shutdown_connections 2024-04-20T12:34:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.818+0000 7f389bc31640 1 -- 172.21.15.135:0/3539470718 wait complete. 2024-04-20T12:34:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389bc31640 1 Processor -- start 2024-04-20T12:34:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389bc31640 1 -- start start 2024-04-20T12:34:10.820 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389bc31640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3894074310 0x7f38941a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389bc31640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3894074c30 0x7f38941a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389bc31640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f389410e800 0x7f389419a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389bc31640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3894114500 con 0x7f389410e800 2024-04-20T12:34:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389bc31640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f3894114380 con 0x7f3894074310 2024-04-20T12:34:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389bc31640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f3894114680 con 0x7f3894074c30 2024-04-20T12:34:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389a1ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f389410e800 0x7f389419a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389a1ce640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f389410e800 0x7f389419a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55430/0 (socket says 172.21.15.135:55430) 2024-04-20T12:34:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389a1ce640 1 -- 172.21.15.135:0/4166538677 learned_addr learned my addr 172.21.15.135:0/4166538677 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:34:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f38991cc640 1 --2- 172.21.15.135:0/4166538677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3894074c30 0x7f38941a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f38999cd640 1 --2- 172.21.15.135:0/4166538677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3894074310 0x7f38941a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389a1ce640 1 -- 172.21.15.135:0/4166538677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3894074c30 msgr2=0x7f38941a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389a1ce640 1 --2- 172.21.15.135:0/4166538677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3894074c30 0x7f38941a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389a1ce640 1 -- 172.21.15.135:0/4166538677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3894074310 msgr2=0x7f38941a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:10.821 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389a1ce640 1 --2- 172.21.15.135:0/4166538677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3894074310 0x7f38941a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:10.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.819+0000 7f389a1ce640 1 -- 172.21.15.135:0/4166538677 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389419aff0 con 0x7f389410e800 2024-04-20T12:34:10.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.820+0000 7f389a1ce640 1 --2- 172.21.15.135:0/4166538677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f389410e800 0x7f389419a820 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f388c02c790 tx=0x7f388c035ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:10.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.820+0000 7f388affd640 1 -- 172.21.15.135:0/4166538677 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c039040 con 0x7f389410e800 2024-04-20T12:34:10.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.820+0000 7f388affd640 1 -- 172.21.15.135:0/4166538677 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f388c044070 con 0x7f389410e800 2024-04-20T12:34:10.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.820+0000 7f389bc31640 1 -- 172.21.15.135:0/4166538677 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389419b280 con 0x7f389410e800 2024-04-20T12:34:10.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.820+0000 7f388affd640 1 -- 172.21.15.135:0/4166538677 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c0329f0 con 0x7f389410e800 2024-04-20T12:34:10.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.820+0000 7f389bc31640 1 -- 172.21.15.135:0/4166538677 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38941a7500 con 0x7f389410e800 2024-04-20T12:34:10.822 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.821+0000 7f389bc31640 1 -- 172.21.15.135:0/4166538677 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38940759c0 con 0x7f389410e800 2024-04-20T12:34:10.823 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.823+0000 7f388affd640 1 -- 172.21.15.135:0/4166538677 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f388c032b90 con 0x7f389410e800 2024-04-20T12:34:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.824+0000 7f388affd640 1 --2- 172.21.15.135:0/4166538677 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38800a3d20 0x7f38800a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.824+0000 7f38999cd640 1 --2- 172.21.15.135:0/4166538677 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38800a3d20 0x7f38800a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.824+0000 7f388affd640 1 -- 172.21.15.135:0/4166538677 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9592+0+0 (secure 0 0 0) 0x7f388c0f36b0 con 0x7f389410e800 2024-04-20T12:34:10.824 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.824+0000 7f38999cd640 1 --2- 172.21.15.135:0/4166538677 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38800a3d20 0x7f38800a61e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f388400bbe0 tx=0x7f388400b390 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:10.826 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:10.827+0000 7f388affd640 1 -- 172.21.15.135:0/4166538677 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f388c0bfa30 con 0x7f389410e800 2024-04-20T12:34:11.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:10 smithi154 ceph-mon[22073]: pgmap v343: 129 pgs: 129 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-20T12:34:11.010 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.011+0000 7f389bc31640 1 -- 172.21.15.135:0/4166538677 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f38941a76d0 con 0x7f389410e800 2024-04-20T12:34:11.011 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.011+0000 7f388affd640 1 -- 172.21.15.135:0/4166538677 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) ==== 93+0+10 (secure 0 0 0) 0x7f388c0bf330 con 0x7f389410e800 2024-04-20T12:34:11.011 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 1 2024-04-20T12:34:11.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.013+0000 7f389bc31640 1 -- 172.21.15.135:0/4166538677 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38800a3d20 msgr2=0x7f38800a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.013+0000 7f389bc31640 1 --2- 172.21.15.135:0/4166538677 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38800a3d20 0x7f38800a61e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f388400bbe0 tx=0x7f388400b390 comp rx=0 tx=0).stop 2024-04-20T12:34:11.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.013+0000 7f389bc31640 1 -- 172.21.15.135:0/4166538677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f389410e800 msgr2=0x7f389419a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.013+0000 7f389bc31640 1 --2- 172.21.15.135:0/4166538677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f389410e800 0x7f389419a820 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f388c02c790 tx=0x7f388c035ed0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.013+0000 7f389bc31640 1 -- 172.21.15.135:0/4166538677 shutdown_connections 2024-04-20T12:34:11.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.013+0000 7f389bc31640 1 --2- 172.21.15.135:0/4166538677 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f389410e800 0x7f389419a820 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.013+0000 7f389bc31640 1 --2- 172.21.15.135:0/4166538677 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f38800a3d20 0x7f38800a61e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.013 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.013+0000 7f389bc31640 1 --2- 172.21.15.135:0/4166538677 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3894074c30 0x7f38941a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.013+0000 7f389bc31640 1 --2- 172.21.15.135:0/4166538677 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f3894074310 0x7f38941a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.013+0000 7f389bc31640 1 -- 172.21.15.135:0/4166538677 >> 172.21.15.135:0/4166538677 conn(0x7f3894079360 msgr2=0x7f38940fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.013+0000 7f389bc31640 1 -- 172.21.15.135:0/4166538677 shutdown_connections 2024-04-20T12:34:11.014 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.013+0000 7f389bc31640 1 -- 172.21.15.135:0/4166538677 wait complete. 2024-04-20T12:34:11.024 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-20T12:34:11.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:10 smithi139 ceph-mon[21834]: pgmap v343: 129 pgs: 129 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-20T12:34:11.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.130+0000 7fb0d1ed9640 1 -- 172.21.15.135:0/2928834544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0cc107270 msgr2=0x7fb0cc10ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.130+0000 7fb0d1ed9640 1 --2- 172.21.15.135:0/2928834544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0cc107270 0x7fb0cc10ee40 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009ca0 tx=0x7fb0c402c0f0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.130+0000 7fb0d1ed9640 1 -- 172.21.15.135:0/2928834544 shutdown_connections 2024-04-20T12:34:11.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.130+0000 7fb0d1ed9640 1 --2- 172.21.15.135:0/2928834544 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0cc107270 0x7fb0cc10ee40 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.130+0000 7fb0d1ed9640 1 --2- 172.21.15.135:0/2928834544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc102b50 0x7fb0cc106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.132 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.130+0000 7fb0d1ed9640 1 --2- 172.21.15.135:0/2928834544 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0cc1021a0 0x7fb0cc102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.130+0000 7fb0d1ed9640 1 -- 172.21.15.135:0/2928834544 >> 172.21.15.135:0/2928834544 conn(0x7fb0cc0793b0 msgr2=0x7fb0cc0797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:11.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.130+0000 7fb0d1ed9640 1 -- 172.21.15.135:0/2928834544 shutdown_connections 2024-04-20T12:34:11.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.130+0000 7fb0d1ed9640 1 -- 172.21.15.135:0/2928834544 wait complete. 2024-04-20T12:34:11.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.130+0000 7fb0d1ed9640 1 Processor -- start 2024-04-20T12:34:11.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0d1ed9640 1 -- start start 2024-04-20T12:34:11.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0d1ed9640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc1021a0 0x7fb0cc19e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:11.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0d1ed9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0cc107270 0x7fb0cc19e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:11.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0d1ed9640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0cc198590 0x7fb0cc198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:11.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0d1ed9640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc112310 con 0x7fb0cc107270 2024-04-20T12:34:11.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0d1ed9640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc112190 con 0x7fb0cc198590 2024-04-20T12:34:11.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0d1ed9640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc112490 con 0x7fb0cc1021a0 2024-04-20T12:34:11.133 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0caffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0cc107270 0x7fb0cc19e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:11.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0caffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0cc107270 0x7fb0cc19e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55444/0 (socket says 172.21.15.135:55444) 2024-04-20T12:34:11.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0caffd640 1 -- 172.21.15.135:0/1544062217 learned_addr learned my addr 172.21.15.135:0/1544062217 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:34:11.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0cbfff640 1 --2- 172.21.15.135:0/1544062217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0cc198590 0x7fb0cc198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:11.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0cb7fe640 1 --2- 172.21.15.135:0/1544062217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc1021a0 0x7fb0cc19e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:11.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0caffd640 1 -- 172.21.15.135:0/1544062217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc1021a0 msgr2=0x7fb0cc19e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0caffd640 1 --2- 172.21.15.135:0/1544062217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc1021a0 0x7fb0cc19e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0caffd640 1 -- 172.21.15.135:0/1544062217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0cc198590 msgr2=0x7fb0cc198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0caffd640 1 --2- 172.21.15.135:0/1544062217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0cc198590 0x7fb0cc198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0caffd640 1 -- 172.21.15.135:0/1544062217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0cc1990b0 con 0x7fb0cc107270 2024-04-20T12:34:11.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.131+0000 7fb0caffd640 1 --2- 172.21.15.135:0/1544062217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0cc107270 0x7fb0cc19e920 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000e9c0 tx=0x7fb0c000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:11.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.132+0000 7fb0c8ff9640 1 -- 172.21.15.135:0/1544062217 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c000ccc0 con 0x7fb0cc107270 2024-04-20T12:34:11.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.132+0000 7fb0c8ff9640 1 -- 172.21.15.135:0/1544062217 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0c0005500 con 0x7fb0cc107270 2024-04-20T12:34:11.134 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.132+0000 7fb0c8ff9640 1 -- 172.21.15.135:0/1544062217 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0010430 con 0x7fb0cc107270 2024-04-20T12:34:11.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.132+0000 7fb0d1ed9640 1 -- 172.21.15.135:0/1544062217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0cc1993a0 con 0x7fb0cc107270 2024-04-20T12:34:11.135 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.132+0000 7fb0d1ed9640 1 -- 172.21.15.135:0/1544062217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0cc1a5640 con 0x7fb0cc107270 2024-04-20T12:34:11.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.133+0000 7fb0d1ed9640 1 -- 172.21.15.135:0/1544062217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0cc0684f0 con 0x7fb0cc107270 2024-04-20T12:34:11.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.134+0000 7fb0c8ff9640 1 -- 172.21.15.135:0/1544062217 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fb0c0005000 con 0x7fb0cc107270 2024-04-20T12:34:11.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.134+0000 7fb0c8ff9640 1 --2- 172.21.15.135:0/1544062217 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb0b40a3da0 0x7fb0b40a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:11.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.134+0000 7fb0cb7fe640 1 --2- 172.21.15.135:0/1544062217 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb0b40a3da0 0x7fb0b40a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:11.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.134+0000 7fb0c8ff9640 1 -- 172.21.15.135:0/1544062217 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9592+0+0 (secure 0 0 0) 0x7fb0c00d0f60 con 0x7fb0cc107270 2024-04-20T12:34:11.136 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.135+0000 7fb0cb7fe640 1 --2- 172.21.15.135:0/1544062217 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb0b40a3da0 0x7fb0b40a6260 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00abe0 tx=0x7fb0bc00a2d0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:11.140 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.141+0000 7fb0c8ff9640 1 -- 172.21.15.135:0/1544062217 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fb0c009d1d0 con 0x7fb0cc107270 2024-04-20T12:34:11.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.327+0000 7fb0d1ed9640 1 -- 172.21.15.135:0/1544062217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb0cc10a4a0 con 0x7fb0cc107270 2024-04-20T12:34:11.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.327+0000 7fb0c8ff9640 1 -- 172.21.15.135:0/1544062217 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v104) ==== 104+0+11 (secure 0 0 0) 0x7fb0c009cad0 con 0x7fb0cc107270 2024-04-20T12:34:11.327 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:34:11.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.329+0000 7fb0d1ed9640 1 -- 172.21.15.135:0/1544062217 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb0b40a3da0 msgr2=0x7fb0b40a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.329+0000 7fb0d1ed9640 1 --2- 172.21.15.135:0/1544062217 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb0b40a3da0 0x7fb0b40a6260 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00abe0 tx=0x7fb0bc00a2d0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.329+0000 7fb0d1ed9640 1 -- 172.21.15.135:0/1544062217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0cc107270 msgr2=0x7fb0cc19e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.329+0000 7fb0d1ed9640 1 --2- 172.21.15.135:0/1544062217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0cc107270 0x7fb0cc19e920 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000e9c0 tx=0x7fb0c000edc0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.329+0000 7fb0d1ed9640 1 -- 172.21.15.135:0/1544062217 shutdown_connections 2024-04-20T12:34:11.329 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.329+0000 7fb0d1ed9640 1 --2- 172.21.15.135:0/1544062217 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fb0cc198590 0x7fb0cc198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.329+0000 7fb0d1ed9640 1 --2- 172.21.15.135:0/1544062217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb0cc107270 0x7fb0cc19e920 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.329+0000 7fb0d1ed9640 1 --2- 172.21.15.135:0/1544062217 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fb0b40a3da0 0x7fb0b40a6260 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.329+0000 7fb0d1ed9640 1 --2- 172.21.15.135:0/1544062217 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb0cc1021a0 0x7fb0cc19e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.329+0000 7fb0d1ed9640 1 -- 172.21.15.135:0/1544062217 >> 172.21.15.135:0/1544062217 conn(0x7fb0cc0793b0 msgr2=0x7fb0cc0ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:11.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.329+0000 7fb0d1ed9640 1 -- 172.21.15.135:0/1544062217 shutdown_connections 2024-04-20T12:34:11.330 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.329+0000 7fb0d1ed9640 1 -- 172.21.15.135:0/1544062217 wait complete. 2024-04-20T12:34:11.340 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-20T12:34:11.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.445+0000 7f654cb5f640 1 -- 172.21.15.135:0/3214264308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6548106170 msgr2=0x7f654810dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.445+0000 7f654cb5f640 1 --2- 172.21.15.135:0/3214264308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6548106170 0x7f654810dd40 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f6538009900 tx=0x7f653802bc30 comp rx=0 tx=0).stop 2024-04-20T12:34:11.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.445+0000 7f654cb5f640 1 -- 172.21.15.135:0/3214264308 shutdown_connections 2024-04-20T12:34:11.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.445+0000 7f654cb5f640 1 --2- 172.21.15.135:0/3214264308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6548106170 0x7f654810dd40 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.445+0000 7f654cb5f640 1 --2- 172.21.15.135:0/3214264308 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6548101a50 0x7f6548105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.447 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.445+0000 7f654cb5f640 1 --2- 172.21.15.135:0/3214264308 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65481010a0 0x7f6548101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.445+0000 7f654cb5f640 1 -- 172.21.15.135:0/3214264308 >> 172.21.15.135:0/3214264308 conn(0x7f6548077f60 msgr2=0x7f6548078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:11.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.445+0000 7f654cb5f640 1 -- 172.21.15.135:0/3214264308 shutdown_connections 2024-04-20T12:34:11.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.445+0000 7f654cb5f640 1 -- 172.21.15.135:0/3214264308 wait complete. 2024-04-20T12:34:11.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654cb5f640 1 Processor -- start 2024-04-20T12:34:11.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654cb5f640 1 -- start start 2024-04-20T12:34:11.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654cb5f640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65481010a0 0x7f654819e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:11.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654cb5f640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6548106170 0x7f654819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:11.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654cb5f640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65481985e0 0x7f6548198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:11.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654cb5f640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6548112340 con 0x7f65481010a0 2024-04-20T12:34:11.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654cb5f640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f65481121c0 con 0x7f65481985e0 2024-04-20T12:34:11.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654cb5f640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f65481124c0 con 0x7f6548106170 2024-04-20T12:34:11.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65481010a0 0x7f654819e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:11.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65481010a0 0x7f654819e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55458/0 (socket says 172.21.15.135:55458) 2024-04-20T12:34:11.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654659c640 1 -- 172.21.15.135:0/3291455889 learned_addr learned my addr 172.21.15.135:0/3291455889 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:34:11.448 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f6545d9b640 1 --2- 172.21.15.135:0/3291455889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6548106170 0x7f654819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:11.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f6546d9d640 1 --2- 172.21.15.135:0/3291455889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65481985e0 0x7f6548198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:11.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654659c640 1 -- 172.21.15.135:0/3291455889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6548106170 msgr2=0x7f654819e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654659c640 1 --2- 172.21.15.135:0/3291455889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6548106170 0x7f654819e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654659c640 1 -- 172.21.15.135:0/3291455889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65481985e0 msgr2=0x7f6548198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654659c640 1 --2- 172.21.15.135:0/3291455889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65481985e0 0x7f6548198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.446+0000 7f654659c640 1 -- 172.21.15.135:0/3291455889 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6548199100 con 0x7f65481010a0 2024-04-20T12:34:11.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.447+0000 7f6545d9b640 1 --2- 172.21.15.135:0/3291455889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6548106170 0x7f654819e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:34:11.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.447+0000 7f654659c640 1 --2- 172.21.15.135:0/3291455889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65481010a0 0x7f654819e430 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f654000eab0 tx=0x7f654000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:11.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.447+0000 7f65377fe640 1 -- 172.21.15.135:0/3291455889 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654000ce40 con 0x7f65481010a0 2024-04-20T12:34:11.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.447+0000 7f654cb5f640 1 -- 172.21.15.135:0/3291455889 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65481993f0 con 0x7f65481010a0 2024-04-20T12:34:11.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.447+0000 7f65377fe640 1 -- 172.21.15.135:0/3291455889 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6540011950 con 0x7f65481010a0 2024-04-20T12:34:11.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.447+0000 7f65377fe640 1 -- 172.21.15.135:0/3291455889 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6540010ae0 con 0x7f65481010a0 2024-04-20T12:34:11.449 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.447+0000 7f654cb5f640 1 -- 172.21.15.135:0/3291455889 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65481a5640 con 0x7f65481010a0 2024-04-20T12:34:11.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.448+0000 7f654cb5f640 1 -- 172.21.15.135:0/3291455889 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6548068d80 con 0x7f65481010a0 2024-04-20T12:34:11.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.450+0000 7f65377fe640 1 -- 172.21.15.135:0/3291455889 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f6540011b00 con 0x7f65481010a0 2024-04-20T12:34:11.450 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.450+0000 7f65377fe640 1 --2- 172.21.15.135:0/3291455889 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f65300a3d20 0x7f65300a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:11.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.450+0000 7f65377fe640 1 -- 172.21.15.135:0/3291455889 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9592+0+0 (secure 0 0 0) 0x7f65400d13d0 con 0x7f65481010a0 2024-04-20T12:34:11.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.450+0000 7f6545d9b640 1 --2- 172.21.15.135:0/3291455889 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f65300a3d20 0x7f65300a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:11.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.451+0000 7f6545d9b640 1 --2- 172.21.15.135:0/3291455889 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f65300a3d20 0x7f65300a61e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f653c005fd0 tx=0x7f653c005850 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:11.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.455+0000 7f65377fe640 1 -- 172.21.15.135:0/3291455889 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f6540016030 con 0x7f65481010a0 2024-04-20T12:34:11.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.639+0000 7f654cb5f640 1 -- 172.21.15.135:0/3291455889 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6548101a50 con 0x7f65481010a0 2024-04-20T12:34:11.639 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.640+0000 7f65377fe640 1 -- 172.21.15.135:0/3291455889 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v104) ==== 100+0+11 (secure 0 0 0) 0x7f654009d640 con 0x7f65481010a0 2024-04-20T12:34:11.640 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 64 2024-04-20T12:34:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.642+0000 7f654cb5f640 1 -- 172.21.15.135:0/3291455889 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f65300a3d20 msgr2=0x7f65300a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.642+0000 7f654cb5f640 1 --2- 172.21.15.135:0/3291455889 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f65300a3d20 0x7f65300a61e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f653c005fd0 tx=0x7f653c005850 comp rx=0 tx=0).stop 2024-04-20T12:34:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.642+0000 7f654cb5f640 1 -- 172.21.15.135:0/3291455889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65481010a0 msgr2=0x7f654819e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.642+0000 7f654cb5f640 1 --2- 172.21.15.135:0/3291455889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65481010a0 0x7f654819e430 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f654000eab0 tx=0x7f654000ef70 comp rx=0 tx=0).stop 2024-04-20T12:34:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.642+0000 7f654cb5f640 1 -- 172.21.15.135:0/3291455889 shutdown_connections 2024-04-20T12:34:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.642+0000 7f654cb5f640 1 --2- 172.21.15.135:0/3291455889 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f65481985e0 0x7f6548198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.642+0000 7f654cb5f640 1 --2- 172.21.15.135:0/3291455889 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f65300a3d20 0x7f65300a61e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.642+0000 7f654cb5f640 1 --2- 172.21.15.135:0/3291455889 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6548106170 0x7f654819e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.642+0000 7f654cb5f640 1 --2- 172.21.15.135:0/3291455889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f65481010a0 0x7f654819e430 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.642 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.642+0000 7f654cb5f640 1 -- 172.21.15.135:0/3291455889 >> 172.21.15.135:0/3291455889 conn(0x7f6548077f60 msgr2=0x7f65480feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.642+0000 7f654cb5f640 1 -- 172.21.15.135:0/3291455889 shutdown_connections 2024-04-20T12:34:11.643 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.642+0000 7f654cb5f640 1 -- 172.21.15.135:0/3291455889 wait complete. 2024-04-20T12:34:11.653 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-20T12:34:11.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.756+0000 7f7137406640 1 -- 172.21.15.135:0/1721674513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7130106170 msgr2=0x7f713010dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.758 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.756+0000 7f7137406640 1 --2- 172.21.15.135:0/1721674513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7130106170 0x7f713010dd40 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f7128009ca0 tx=0x7f712802c0f0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.757+0000 7f7137406640 1 -- 172.21.15.135:0/1721674513 shutdown_connections 2024-04-20T12:34:11.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.757+0000 7f7137406640 1 --2- 172.21.15.135:0/1721674513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7130106170 0x7f713010dd40 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.757+0000 7f7137406640 1 --2- 172.21.15.135:0/1721674513 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7130101a50 0x7f7130105a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.757+0000 7f7137406640 1 --2- 172.21.15.135:0/1721674513 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f71301010a0 0x7f7130101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.757+0000 7f7137406640 1 -- 172.21.15.135:0/1721674513 >> 172.21.15.135:0/1721674513 conn(0x7f7130077f60 msgr2=0x7f7130078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:11.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.757+0000 7f7137406640 1 -- 172.21.15.135:0/1721674513 shutdown_connections 2024-04-20T12:34:11.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.757+0000 7f7137406640 1 -- 172.21.15.135:0/1721674513 wait complete. 2024-04-20T12:34:11.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.757+0000 7f7137406640 1 Processor -- start 2024-04-20T12:34:11.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.757+0000 7f7137406640 1 -- start start 2024-04-20T12:34:11.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.757+0000 7f7137406640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71301010a0 0x7f71301995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:11.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.757+0000 7f7137406640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7130106170 0x7f7130199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:11.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.757+0000 7f7137406640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f713019a0a0 0x7f71301a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:11.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.757+0000 7f7137406640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7130111210 con 0x7f7130106170 2024-04-20T12:34:11.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.757+0000 7f7137406640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f7130111090 con 0x7f713019a0a0 2024-04-20T12:34:11.759 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.757+0000 7f7137406640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f7130111390 con 0x7f71301010a0 2024-04-20T12:34:11.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f71349a1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7130106170 0x7f7130199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:11.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f71349a1640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7130106170 0x7f7130199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55476/0 (socket says 172.21.15.135:55476) 2024-04-20T12:34:11.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f71349a1640 1 -- 172.21.15.135:0/3434108281 learned_addr learned my addr 172.21.15.135:0/3434108281 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:34:11.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f71359a3640 1 --2- 172.21.15.135:0/3434108281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f713019a0a0 0x7f71301a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:11.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f71351a2640 1 --2- 172.21.15.135:0/3434108281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71301010a0 0x7f71301995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:11.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f71349a1640 1 -- 172.21.15.135:0/3434108281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71301010a0 msgr2=0x7f71301995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f71349a1640 1 --2- 172.21.15.135:0/3434108281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71301010a0 0x7f71301995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f71349a1640 1 -- 172.21.15.135:0/3434108281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f713019a0a0 msgr2=0x7f71301a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f71349a1640 1 --2- 172.21.15.135:0/3434108281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f713019a0a0 0x7f71301a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f71349a1640 1 -- 172.21.15.135:0/3434108281 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71301a4e20 con 0x7f7130106170 2024-04-20T12:34:11.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f71349a1640 1 --2- 172.21.15.135:0/3434108281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7130106170 0x7f7130199b10 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f712c00c970 tx=0x7f712c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:11.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f71267fc640 1 -- 172.21.15.135:0/3434108281 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c014070 con 0x7f7130106170 2024-04-20T12:34:11.760 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f71267fc640 1 -- 172.21.15.135:0/3434108281 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f712c004440 con 0x7f7130106170 2024-04-20T12:34:11.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f7137406640 1 -- 172.21.15.135:0/3434108281 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71301a5110 con 0x7f7130106170 2024-04-20T12:34:11.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f71267fc640 1 -- 172.21.15.135:0/3434108281 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c00f450 con 0x7f7130106170 2024-04-20T12:34:11.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.758+0000 7f7137406640 1 -- 172.21.15.135:0/3434108281 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71301a5660 con 0x7f7130106170 2024-04-20T12:34:11.761 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.760+0000 7f7137406640 1 -- 172.21.15.135:0/3434108281 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7130068d80 con 0x7f7130106170 2024-04-20T12:34:11.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.760+0000 7f71267fc640 1 -- 172.21.15.135:0/3434108281 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f712c017070 con 0x7f7130106170 2024-04-20T12:34:11.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.761+0000 7f71267fc640 1 --2- 172.21.15.135:0/3434108281 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f711c0a3d20 0x7f711c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:11.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.761+0000 7f71351a2640 1 --2- 172.21.15.135:0/3434108281 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f711c0a3d20 0x7f711c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:11.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.761+0000 7f71267fc640 1 -- 172.21.15.135:0/3434108281 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9592+0+0 (secure 0 0 0) 0x7f712c0d09e0 con 0x7f7130106170 2024-04-20T12:34:11.762 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.761+0000 7f71351a2640 1 --2- 172.21.15.135:0/3434108281 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f711c0a3d20 0x7f711c0a61e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7120005fd0 tx=0x7f7120005850 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:11.765 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.765+0000 7f71267fc640 1 -- 172.21.15.135:0/3434108281 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f712c01e020 con 0x7f7130106170 2024-04-20T12:34:11.963 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:11 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2192245913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:34:11.963 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:11 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/4166538677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:34:11.963 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:11 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1544062217' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:34:11.964 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:11 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3291455889' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:34:11.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.970+0000 7f7137406640 1 -- 172.21.15.135:0/3434108281 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7130101a50 con 0x7f7130106170 2024-04-20T12:34:11.970 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.971+0000 7f71267fc640 1 -- 172.21.15.135:0/3434108281 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v104) ==== 103+0+11 (secure 0 0 0) 0x7f712c09cc50 con 0x7f7130106170 2024-04-20T12:34:11.970 INFO:teuthology.orchestra.run.smithi135.stdout:pg_num: 32 2024-04-20T12:34:11.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.973+0000 7f7137406640 1 -- 172.21.15.135:0/3434108281 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f711c0a3d20 msgr2=0x7f711c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.973+0000 7f7137406640 1 --2- 172.21.15.135:0/3434108281 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f711c0a3d20 0x7f711c0a61e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7120005fd0 tx=0x7f7120005850 comp rx=0 tx=0).stop 2024-04-20T12:34:11.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.973+0000 7f7137406640 1 -- 172.21.15.135:0/3434108281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7130106170 msgr2=0x7f7130199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:11.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.973+0000 7f7137406640 1 --2- 172.21.15.135:0/3434108281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7130106170 0x7f7130199b10 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f712c00c970 tx=0x7f712c00ce30 comp rx=0 tx=0).stop 2024-04-20T12:34:11.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.973+0000 7f7137406640 1 -- 172.21.15.135:0/3434108281 shutdown_connections 2024-04-20T12:34:11.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.973+0000 7f7137406640 1 --2- 172.21.15.135:0/3434108281 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f713019a0a0 0x7f71301a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.973+0000 7f7137406640 1 --2- 172.21.15.135:0/3434108281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7130106170 0x7f7130199b10 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.973+0000 7f7137406640 1 --2- 172.21.15.135:0/3434108281 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f711c0a3d20 0x7f711c0a61e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.973+0000 7f7137406640 1 --2- 172.21.15.135:0/3434108281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71301010a0 0x7f71301995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:11.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.973+0000 7f7137406640 1 -- 172.21.15.135:0/3434108281 >> 172.21.15.135:0/3434108281 conn(0x7f7130077f60 msgr2=0x7f71300fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:11.973 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.973+0000 7f7137406640 1 -- 172.21.15.135:0/3434108281 shutdown_connections 2024-04-20T12:34:11.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:11.973+0000 7f7137406640 1 -- 172.21.15.135:0/3434108281 wait complete. 2024-04-20T12:34:11.984 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T12:34:12.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:11 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2192245913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:34:12.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:11 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/4166538677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:34:12.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:11 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1544062217' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:34:12.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:11 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3291455889' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:34:12.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:11 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2192245913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:34:12.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:11 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/4166538677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-20T12:34:12.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:11 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1544062217' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-04-20T12:34:12.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:11 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3291455889' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-04-20T12:34:12.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.084+0000 7fd6bcba4640 1 -- 172.21.15.135:0/2587766292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6b8105e30 msgr2=0x7fd6b8106210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:12.083 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.084+0000 7fd6bcba4640 1 --2- 172.21.15.135:0/2587766292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6b8105e30 0x7fd6b8106210 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009ca0 tx=0x7fd6b002c140 comp rx=0 tx=0).stop 2024-04-20T12:34:12.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.084+0000 7fd6bcba4640 1 -- 172.21.15.135:0/2587766292 shutdown_connections 2024-04-20T12:34:12.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.084+0000 7fd6bcba4640 1 --2- 172.21.15.135:0/2587766292 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6b8101f70 0x7fd6b810dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.084+0000 7fd6bcba4640 1 --2- 172.21.15.135:0/2587766292 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6b81015d0 0x7fd6b8101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.084+0000 7fd6bcba4640 1 --2- 172.21.15.135:0/2587766292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6b8105e30 0x7fd6b8106210 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.084+0000 7fd6bcba4640 1 -- 172.21.15.135:0/2587766292 >> 172.21.15.135:0/2587766292 conn(0x7fd6b8077420 msgr2=0x7fd6b80fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:12.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.084+0000 7fd6bcba4640 1 -- 172.21.15.135:0/2587766292 shutdown_connections 2024-04-20T12:34:12.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.084+0000 7fd6bcba4640 1 -- 172.21.15.135:0/2587766292 wait complete. 2024-04-20T12:34:12.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.084+0000 7fd6bcba4640 1 Processor -- start 2024-04-20T12:34:12.086 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6bcba4640 1 -- start start 2024-04-20T12:34:12.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6bcba4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6b81015d0 0x7fd6b819d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:12.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6bcba4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6b8101f70 0x7fd6b819dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:12.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6bcba4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6b8105e30 0x7fd6b81976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:12.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6bcba4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b8111350 con 0x7fd6b81015d0 2024-04-20T12:34:12.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6bcba4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b81111d0 con 0x7fd6b8105e30 2024-04-20T12:34:12.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6bcba4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b81114d0 con 0x7fd6b8101f70 2024-04-20T12:34:12.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6b659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6b81015d0 0x7fd6b819d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:12.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6b659c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6b81015d0 0x7fd6b819d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55492/0 (socket says 172.21.15.135:55492) 2024-04-20T12:34:12.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6b659c640 1 -- 172.21.15.135:0/689118469 learned_addr learned my addr 172.21.15.135:0/689118469 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:34:12.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6b5d9b640 1 --2- 172.21.15.135:0/689118469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6b8101f70 0x7fd6b819dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:12.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6b6d9d640 1 --2- 172.21.15.135:0/689118469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6b8105e30 0x7fd6b81976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:12.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6b659c640 1 -- 172.21.15.135:0/689118469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6b8101f70 msgr2=0x7fd6b819dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:12.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6b659c640 1 --2- 172.21.15.135:0/689118469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6b8101f70 0x7fd6b819dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6b659c640 1 -- 172.21.15.135:0/689118469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6b8105e30 msgr2=0x7fd6b81976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:12.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6b659c640 1 --2- 172.21.15.135:0/689118469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6b8105e30 0x7fd6b81976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6b659c640 1 -- 172.21.15.135:0/689118469 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b8197f70 con 0x7fd6b81015d0 2024-04-20T12:34:12.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6b6d9d640 1 --2- 172.21.15.135:0/689118469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6b8105e30 0x7fd6b81976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:34:12.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6b659c640 1 --2- 172.21.15.135:0/689118469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6b81015d0 0x7fd6b819d5a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0005e30 tx=0x7fd6b00346f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:12.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6af7fe640 1 -- 172.21.15.135:0/689118469 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0039050 con 0x7fd6b81015d0 2024-04-20T12:34:12.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6af7fe640 1 -- 172.21.15.135:0/689118469 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6b0045070 con 0x7fd6b81015d0 2024-04-20T12:34:12.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.085+0000 7fd6af7fe640 1 -- 172.21.15.135:0/689118469 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0004650 con 0x7fd6b81015d0 2024-04-20T12:34:12.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.086+0000 7fd6bcba4640 1 -- 172.21.15.135:0/689118469 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b8198200 con 0x7fd6b81015d0 2024-04-20T12:34:12.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.086+0000 7fd6bcba4640 1 -- 172.21.15.135:0/689118469 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b81a4340 con 0x7fd6b81015d0 2024-04-20T12:34:12.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.087+0000 7fd6bcba4640 1 -- 172.21.15.135:0/689118469 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6b81025e0 con 0x7fd6b81015d0 2024-04-20T12:34:12.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.088+0000 7fd6af7fe640 1 -- 172.21.15.135:0/689118469 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fd6b0003970 con 0x7fd6b81015d0 2024-04-20T12:34:12.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.088+0000 7fd6af7fe640 1 --2- 172.21.15.135:0/689118469 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd6a40a3d20 0x7fd6a40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:12.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.088+0000 7fd6b5d9b640 1 --2- 172.21.15.135:0/689118469 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd6a40a3d20 0x7fd6a40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:12.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.088+0000 7fd6af7fe640 1 -- 172.21.15.135:0/689118469 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9592+0+0 (secure 0 0 0) 0x7fd6b00f3510 con 0x7fd6b81015d0 2024-04-20T12:34:12.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.089+0000 7fd6b5d9b640 1 --2- 172.21.15.135:0/689118469 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd6a40a3d20 0x7fd6a40a61e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8198eb0 tx=0x7fd6a0009110 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:12.092 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.093+0000 7fd6af7fe640 1 -- 172.21.15.135:0/689118469 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fd6b00bf930 con 0x7fd6b81015d0 2024-04-20T12:34:12.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.282+0000 7fd6bcba4640 1 -- 172.21.15.135:0/689118469 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd6b8198b90 con 0x7fd6b81015d0 2024-04-20T12:34:12.282 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.282+0000 7fd6af7fe640 1 -- 172.21.15.135:0/689118469 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v104) ==== 81+0+958 (secure 0 0 0) 0x7fd6b00bf230 con 0x7fd6b81015d0 2024-04-20T12:34:12.282 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/2052292307 2024-04-21T12:23:07.080062+0000 2024-04-20T12:34:12.282 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/669936771 2024-04-21T12:23:07.080062+0000 2024-04-20T12:34:12.282 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/4276159294 2024-04-21T12:23:07.080062+0000 2024-04-20T12:34:12.282 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6800/3831149339 2024-04-21T12:23:07.080062+0000 2024-04-20T12:34:12.283 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6800/2178168771 2024-04-21T12:13:36.719889+0000 2024-04-20T12:34:12.283 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/152375197 2024-04-21T12:13:36.719889+0000 2024-04-20T12:34:12.283 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/1087722944 2024-04-21T12:23:07.080062+0000 2024-04-20T12:34:12.283 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6801/3831149339 2024-04-21T12:23:07.080062+0000 2024-04-20T12:34:12.283 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/4252118847 2024-04-21T12:13:36.719889+0000 2024-04-20T12:34:12.283 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/3207517469 2024-04-21T12:13:10.061188+0000 2024-04-20T12:34:12.283 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6801/2178168771 2024-04-21T12:13:36.719889+0000 2024-04-20T12:34:12.283 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/2737907457 2024-04-21T12:13:10.061188+0000 2024-04-20T12:34:12.283 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6800/469891744 2024-04-21T12:13:10.061188+0000 2024-04-20T12:34:12.283 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:6801/469891744 2024-04-21T12:13:10.061188+0000 2024-04-20T12:34:12.283 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/2298786540 2024-04-21T12:13:10.061188+0000 2024-04-20T12:34:12.283 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135:0/3680323343 2024-04-21T12:13:36.719889+0000 2024-04-20T12:34:12.284 INFO:teuthology.orchestra.run.smithi135.stderr:listed 16 entries 2024-04-20T12:34:12.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.284+0000 7fd6bcba4640 1 -- 172.21.15.135:0/689118469 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd6a40a3d20 msgr2=0x7fd6a40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:12.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.284+0000 7fd6bcba4640 1 --2- 172.21.15.135:0/689118469 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd6a40a3d20 0x7fd6a40a61e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8198eb0 tx=0x7fd6a0009110 comp rx=0 tx=0).stop 2024-04-20T12:34:12.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.284+0000 7fd6bcba4640 1 -- 172.21.15.135:0/689118469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6b81015d0 msgr2=0x7fd6b819d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:12.284 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.284+0000 7fd6bcba4640 1 --2- 172.21.15.135:0/689118469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6b81015d0 0x7fd6b819d5a0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0005e30 tx=0x7fd6b00346f0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.284+0000 7fd6bcba4640 1 -- 172.21.15.135:0/689118469 shutdown_connections 2024-04-20T12:34:12.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.284+0000 7fd6bcba4640 1 --2- 172.21.15.135:0/689118469 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fd6b8105e30 0x7fd6b81976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.284+0000 7fd6bcba4640 1 --2- 172.21.15.135:0/689118469 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fd6a40a3d20 0x7fd6a40a61e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.284+0000 7fd6bcba4640 1 --2- 172.21.15.135:0/689118469 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd6b8101f70 0x7fd6b819dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.284+0000 7fd6bcba4640 1 --2- 172.21.15.135:0/689118469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd6b81015d0 0x7fd6b819d5a0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.284+0000 7fd6bcba4640 1 -- 172.21.15.135:0/689118469 >> 172.21.15.135:0/689118469 conn(0x7fd6b8077420 msgr2=0x7fd6b8103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:12.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.285+0000 7fd6bcba4640 1 -- 172.21.15.135:0/689118469 shutdown_connections 2024-04-20T12:34:12.285 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.285+0000 7fd6bcba4640 1 -- 172.21.15.135:0/689118469 wait complete. 2024-04-20T12:34:12.295 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-20T12:34:12.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:34:12.295 DEBUG:teuthology.orchestra.run.smithi135:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-20T12:34:12.332 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi135.front.sepia.ceph.com 2024-04-20T12:34:12.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:34:12.332 DEBUG:teuthology.orchestra.run.smithi135:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-20T12:34:12.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:34:12.388 DEBUG:teuthology.orchestra.run.smithi135:> ip netns list 2024-04-20T12:34:12.443 INFO:teuthology.orchestra.run.smithi135.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-20T12:34:12.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:34:12.444 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T12:34:12.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T12:34:12.509 DEBUG:teuthology.orchestra.run.smithi135:> sudo ip link delete ceph-brx 2024-04-20T12:34:12.616 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-20T12:34:12.629 INFO:tasks.cephadm:Teardown begin 2024-04-20T12:34:12.630 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-20T12:34:12.630 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:34:12.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.731+0000 7f0bff923640 1 -- 172.21.15.135:0/2756226821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bf8102b40 msgr2=0x7f0bf8106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:12.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.731+0000 7f0bff923640 1 --2- 172.21.15.135:0/2756226821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bf8102b40 0x7f0bf8106b80 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009900 tx=0x7f0bf402bc30 comp rx=0 tx=0).stop 2024-04-20T12:34:12.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.731+0000 7f0bff923640 1 -- 172.21.15.135:0/2756226821 shutdown_connections 2024-04-20T12:34:12.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.731+0000 7f0bff923640 1 --2- 172.21.15.135:0/2756226821 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf8107260 0x7f0bf810ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.731+0000 7f0bff923640 1 --2- 172.21.15.135:0/2756226821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bf8102b40 0x7f0bf8106b80 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.731+0000 7f0bff923640 1 --2- 172.21.15.135:0/2756226821 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bf8102190 0x7f0bf8102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.731+0000 7f0bff923640 1 -- 172.21.15.135:0/2756226821 >> 172.21.15.135:0/2756226821 conn(0x7f0bf8079360 msgr2=0x7f0bf8079770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:12.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.731+0000 7f0bff923640 1 -- 172.21.15.135:0/2756226821 shutdown_connections 2024-04-20T12:34:12.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.731+0000 7f0bff923640 1 -- 172.21.15.135:0/2756226821 wait complete. 2024-04-20T12:34:12.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.731+0000 7f0bff923640 1 Processor -- start 2024-04-20T12:34:12.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.731+0000 7f0bff923640 1 -- start start 2024-04-20T12:34:12.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bff923640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bf8102190 0x7f0bf819e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:12.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bff923640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bf8107260 0x7f0bf819eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:12.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bff923640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf8198670 0x7f0bf8198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:12.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bff923640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf81122f0 con 0x7f0bf8102190 2024-04-20T12:34:12.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bff923640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf8112170 con 0x7f0bf8107260 2024-04-20T12:34:12.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bff923640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf8112470 con 0x7f0bf8198670 2024-04-20T12:34:12.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bfd6bf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bf8102190 0x7f0bf819e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:12.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bfd6bf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bf8102190 0x7f0bf819e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55516/0 (socket says 172.21.15.135:55516) 2024-04-20T12:34:12.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bfd6bf640 1 -- 172.21.15.135:0/1841426884 learned_addr learned my addr 172.21.15.135:0/1841426884 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:34:12.734 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bfcebe640 1 --2- 172.21.15.135:0/1841426884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bf8107260 0x7f0bf819eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:12.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bfdec0640 1 --2- 172.21.15.135:0/1841426884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf8198670 0x7f0bf8198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:12.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bfd6bf640 1 -- 172.21.15.135:0/1841426884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf8198670 msgr2=0x7f0bf8198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:12.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bfd6bf640 1 --2- 172.21.15.135:0/1841426884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf8198670 0x7f0bf8198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bfd6bf640 1 -- 172.21.15.135:0/1841426884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bf8107260 msgr2=0x7f0bf819eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:12.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bfd6bf640 1 --2- 172.21.15.135:0/1841426884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bf8107260 0x7f0bf819eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bfd6bf640 1 -- 172.21.15.135:0/1841426884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf8199270 con 0x7f0bf8102190 2024-04-20T12:34:12.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bfdec0640 1 --2- 172.21.15.135:0/1841426884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf8198670 0x7f0bf8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:34:12.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bfd6bf640 1 --2- 172.21.15.135:0/1841426884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bf8102190 0x7f0bf819e5b0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f0be800d950 tx=0x7f0be800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:12.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bee7fc640 1 -- 172.21.15.135:0/1841426884 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be8017070 con 0x7f0bf8102190 2024-04-20T12:34:12.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bff923640 1 -- 172.21.15.135:0/1841426884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf81a5350 con 0x7f0bf8102190 2024-04-20T12:34:12.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bee7fc640 1 -- 172.21.15.135:0/1841426884 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0be8009c30 con 0x7f0bf8102190 2024-04-20T12:34:12.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bee7fc640 1 -- 172.21.15.135:0/1841426884 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be800f6b0 con 0x7f0bf8102190 2024-04-20T12:34:12.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.732+0000 7f0bff923640 1 -- 172.21.15.135:0/1841426884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf81a5750 con 0x7f0bf8102190 2024-04-20T12:34:12.735 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.733+0000 7f0bff923640 1 -- 172.21.15.135:0/1841426884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf8103660 con 0x7f0bf8102190 2024-04-20T12:34:12.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.734+0000 7f0bee7fc640 1 -- 172.21.15.135:0/1841426884 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f0be80109d0 con 0x7f0bf8102190 2024-04-20T12:34:12.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.735+0000 7f0bee7fc640 1 --2- 172.21.15.135:0/1841426884 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0be40a3d20 0x7f0be40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:12.736 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.735+0000 7f0bfcebe640 1 --2- 172.21.15.135:0/1841426884 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0be40a3d20 0x7f0be40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:12.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.735+0000 7f0bee7fc640 1 -- 172.21.15.135:0/1841426884 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9592+0+0 (secure 0 0 0) 0x7f0be80d0840 con 0x7f0bf8102190 2024-04-20T12:34:12.737 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.735+0000 7f0bfcebe640 1 --2- 172.21.15.135:0/1841426884 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0be40a3d20 0x7f0be40a61e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009230 tx=0x7f0bf4005fd0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:12.739 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.739+0000 7f0bee7fc640 1 -- 172.21.15.135:0/1841426884 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f0be8009de0 con 0x7f0bf8102190 2024-04-20T12:34:12.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:12 smithi135 ceph-mon[18264]: pgmap v344: 129 pgs: 129 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-20T12:34:12.863 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:12 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3434108281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:34:12.864 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:12 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/689118469' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-20T12:34:12.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.957+0000 7f0bff923640 1 -- 172.21.15.135:0/1841426884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0bf810a490 con 0x7f0bf8102190 2024-04-20T12:34:12.957 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.958+0000 7f0bee7fc640 1 -- 172.21.15.135:0/1841426884 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7f0be809cab0 con 0x7f0bf8102190 2024-04-20T12:34:12.958 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:34:12.958 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:34:12.958 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:34:12.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.960+0000 7f0bff923640 1 -- 172.21.15.135:0/1841426884 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0be40a3d20 msgr2=0x7f0be40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:12.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.960+0000 7f0bff923640 1 --2- 172.21.15.135:0/1841426884 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0be40a3d20 0x7f0be40a61e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4009230 tx=0x7f0bf4005fd0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.960+0000 7f0bff923640 1 -- 172.21.15.135:0/1841426884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bf8102190 msgr2=0x7f0bf819e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:12.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.960+0000 7f0bff923640 1 --2- 172.21.15.135:0/1841426884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bf8102190 0x7f0bf819e5b0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f0be800d950 tx=0x7f0be800de10 comp rx=0 tx=0).stop 2024-04-20T12:34:12.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.960+0000 7f0bff923640 1 -- 172.21.15.135:0/1841426884 shutdown_connections 2024-04-20T12:34:12.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.960+0000 7f0bff923640 1 --2- 172.21.15.135:0/1841426884 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f0be40a3d20 0x7f0be40a61e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.960+0000 7f0bff923640 1 --2- 172.21.15.135:0/1841426884 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0bf8198670 0x7f0bf8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.960+0000 7f0bff923640 1 --2- 172.21.15.135:0/1841426884 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f0bf8107260 0x7f0bf819eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.960 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.960+0000 7f0bff923640 1 --2- 172.21.15.135:0/1841426884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0bf8102190 0x7f0bf819e5b0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:12.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.960+0000 7f0bff923640 1 -- 172.21.15.135:0/1841426884 >> 172.21.15.135:0/1841426884 conn(0x7f0bf8079360 msgr2=0x7f0bf81000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:12.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.960+0000 7f0bff923640 1 -- 172.21.15.135:0/1841426884 shutdown_connections 2024-04-20T12:34:12.961 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:12.960+0000 7f0bff923640 1 -- 172.21.15.135:0/1841426884 wait complete. 2024-04-20T12:34:12.971 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T12:34:13.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:12 smithi154 ceph-mon[22073]: pgmap v344: 129 pgs: 129 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-20T12:34:13.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:12 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3434108281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:34:13.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:12 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/689118469' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-20T12:34:13.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.070+0000 7f12c8cc8640 1 -- 172.21.15.135:0/3486620741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12c4100d70 msgr2=0x7f12c4101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:13.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.070+0000 7f12c8cc8640 1 --2- 172.21.15.135:0/3486620741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12c4100d70 0x7f12c4101150 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009900 tx=0x7f12ac02bc30 comp rx=0 tx=0).stop 2024-04-20T12:34:13.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.070+0000 7f12c8cc8640 1 -- 172.21.15.135:0/3486620741 shutdown_connections 2024-04-20T12:34:13.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.070+0000 7f12c8cc8640 1 --2- 172.21.15.135:0/3486620741 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12c410e920 0x7f12c4110d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.070+0000 7f12c8cc8640 1 --2- 172.21.15.135:0/3486620741 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c4101690 0x7f12c410e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.070+0000 7f12c8cc8640 1 --2- 172.21.15.135:0/3486620741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12c4100d70 0x7f12c4101150 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.070+0000 7f12c8cc8640 1 -- 172.21.15.135:0/3486620741 >> 172.21.15.135:0/3486620741 conn(0x7f12c4077f60 msgr2=0x7f12c4078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:13.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.070+0000 7f12c8cc8640 1 -- 172.21.15.135:0/3486620741 shutdown_connections 2024-04-20T12:34:13.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.070+0000 7f12c8cc8640 1 -- 172.21.15.135:0/3486620741 wait complete. 2024-04-20T12:34:13.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.070+0000 7f12c8cc8640 1 Processor -- start 2024-04-20T12:34:13.072 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.070+0000 7f12c8cc8640 1 -- start start 2024-04-20T12:34:13.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c8cc8640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12c4100d70 0x7f12c41a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:13.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c8cc8640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c4101690 0x7f12c41a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:13.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c8cc8640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12c410e920 0x7f12c419a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:13.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c8cc8640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12c4114540 con 0x7f12c410e920 2024-04-20T12:34:13.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c8cc8640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41143c0 con 0x7f12c4100d70 2024-04-20T12:34:13.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c8cc8640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f12c41146c0 con 0x7f12c4101690 2024-04-20T12:34:13.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12c410e920 0x7f12c419a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:13.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c2d9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12c410e920 0x7f12c419a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55534/0 (socket says 172.21.15.135:55534) 2024-04-20T12:34:13.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c2d9d640 1 -- 172.21.15.135:0/767016121 learned_addr learned my addr 172.21.15.135:0/767016121 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:34:13.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c259c640 1 --2- 172.21.15.135:0/767016121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12c4100d70 0x7f12c41a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:13.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c2d9d640 1 -- 172.21.15.135:0/767016121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c4101690 msgr2=0x7f12c41a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:13.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c1d9b640 1 --2- 172.21.15.135:0/767016121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c4101690 0x7f12c41a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:13.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c2d9d640 1 --2- 172.21.15.135:0/767016121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c4101690 0x7f12c41a0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.073 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c2d9d640 1 -- 172.21.15.135:0/767016121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12c4100d70 msgr2=0x7f12c41a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:13.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c2d9d640 1 --2- 172.21.15.135:0/767016121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12c4100d70 0x7f12c41a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c2d9d640 1 -- 172.21.15.135:0/767016121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c419afe0 con 0x7f12c410e920 2024-04-20T12:34:13.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c2d9d640 1 --2- 172.21.15.135:0/767016121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12c410e920 0x7f12c419a860 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00cad0 tx=0x7f12bc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:13.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12bb7fe640 1 -- 172.21.15.135:0/767016121 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00ae20 con 0x7f12c410e920 2024-04-20T12:34:13.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12bb7fe640 1 -- 172.21.15.135:0/767016121 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f12bc004030 con 0x7f12c410e920 2024-04-20T12:34:13.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c8cc8640 1 -- 172.21.15.135:0/767016121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c419b2d0 con 0x7f12c410e920 2024-04-20T12:34:13.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12bb7fe640 1 -- 172.21.15.135:0/767016121 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00f7c0 con 0x7f12c410e920 2024-04-20T12:34:13.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.071+0000 7f12c8cc8640 1 -- 172.21.15.135:0/767016121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c41a7570 con 0x7f12c410e920 2024-04-20T12:34:13.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.073+0000 7f12c8cc8640 1 -- 172.21.15.135:0/767016121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12c4068d80 con 0x7f12c410e920 2024-04-20T12:34:13.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.074+0000 7f12bb7fe640 1 -- 172.21.15.135:0/767016121 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f12bc0041e0 con 0x7f12c410e920 2024-04-20T12:34:13.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.074+0000 7f12bb7fe640 1 --2- 172.21.15.135:0/767016121 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12b00a3da0 0x7f12b00a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:13.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.075+0000 7f12c259c640 1 --2- 172.21.15.135:0/767016121 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12b00a3da0 0x7f12b00a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:13.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.075+0000 7f12bb7fe640 1 -- 172.21.15.135:0/767016121 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9592+0+0 (secure 0 0 0) 0x7f12bc0d0bc0 con 0x7f12c410e920 2024-04-20T12:34:13.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.075+0000 7f12c259c640 1 --2- 172.21.15.135:0/767016121 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12b00a3da0 0x7f12b00a6260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f12ac02efd0 tx=0x7f12ac02cf90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:13.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.079+0000 7f12bb7fe640 1 -- 172.21.15.135:0/767016121 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f12bc014070 con 0x7f12c410e920 2024-04-20T12:34:13.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:12 smithi139 ceph-mon[21834]: pgmap v344: 129 pgs: 129 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 53 KiB/s wr, 31 op/s 2024-04-20T12:34:13.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:12 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3434108281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-04-20T12:34:13.079 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:12 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/689118469' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-20T12:34:13.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.299+0000 7f12c8cc8640 1 -- 172.21.15.135:0/767016121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12c402d5d0 con 0x7f12c410e920 2024-04-20T12:34:13.299 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.300+0000 7f12bb7fe640 1 -- 172.21.15.135:0/767016121 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11973 (secure 0 0 0) 0x7f12bc09ce30 con 0x7f12c410e920 2024-04-20T12:34:13.300 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:34:13.300 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/4052830457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":4052830457},{"type":"v1","addr":"172.21.15.135:6835","nonce":4052830457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/2239466224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":2239466224},{"type":"v1","addr":"172.21.15.135:6837","nonce":2239466224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-20T12:20:41.367288+0000","modified":"2024-04-20T12:23:05.667522+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24490,"mds_1":24476,"mds_2":24475,"mds_3":24457,"mds_4":14634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14622":{"gid":14622,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6839/3001818614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":3001818614},{"type":"v1","addr":"172.21.15.135:6839","nonce":3001818614}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14634":{"gid":14634,"name":"a","rank":4,"incarnation":26,"state":"up:active","state_seq":10,"addr":"172.21.15.135:6841/212699479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6840","nonce":212699479},{"type":"v1","addr":"172.21.15.135:6841","nonce":212699479}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24389":{"gid":24389,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6833/2012805307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6832","nonce":2012805307},{"type":"v1","addr":"172.21.15.139:6833","nonce":2012805307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.154:6833/406581782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":406581782},{"type":"v1","addr":"172.21.15.154:6833","nonce":406581782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24416":{"gid":24416,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6835/1816377265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6834","nonce":1816377265},{"type":"v1","addr":"172.21.15.139:6835","nonce":1816377265}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.139:6837/2426010804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6836","nonce":2426010804},{"type":"v1","addr":"172.21.15.139:6837","nonce":2426010804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"f","rank":3,"incarnation":24,"state":"up:active","state_seq":14,"addr":"172.21.15.154:6835/1522201664","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6834","nonce":1522201664},{"type":"v1","addr":"172.21.15.154:6835","nonce":1522201664}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":13,"addr":"172.21.15.154:6837/2792228805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6836","nonce":2792228805},{"type":"v1","addr":"172.21.15.154:6837","nonce":2792228805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":1,"incarnation":20,"state":"up:active","state_seq":9,"addr":"172.21.15.139:6839/3819947532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6838","nonce":3819947532},{"type":"v1","addr":"172.21.15.139:6839","nonce":3819947532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.154:6839/1672287462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6838","nonce":1672287462},{"type":"v1","addr":"172.21.15.154:6839","nonce":1672287462}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24490,"qdb_cluster":[24475,24457,14634,24490,24476]},"id":1}]} 2024-04-20T12:34:13.300 INFO:teuthology.orchestra.run.smithi135.stderr:dumped fsmap epoch 29 2024-04-20T12:34:13.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.302+0000 7f12c8cc8640 1 -- 172.21.15.135:0/767016121 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12b00a3da0 msgr2=0x7f12b00a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:13.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.302+0000 7f12c8cc8640 1 --2- 172.21.15.135:0/767016121 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12b00a3da0 0x7f12b00a6260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f12ac02efd0 tx=0x7f12ac02cf90 comp rx=0 tx=0).stop 2024-04-20T12:34:13.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.302+0000 7f12c8cc8640 1 -- 172.21.15.135:0/767016121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12c410e920 msgr2=0x7f12c419a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:13.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.302+0000 7f12c8cc8640 1 --2- 172.21.15.135:0/767016121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12c410e920 0x7f12c419a860 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00cad0 tx=0x7f12bc00cf90 comp rx=0 tx=0).stop 2024-04-20T12:34:13.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.302+0000 7f12c8cc8640 1 -- 172.21.15.135:0/767016121 shutdown_connections 2024-04-20T12:34:13.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.302+0000 7f12c8cc8640 1 --2- 172.21.15.135:0/767016121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12c410e920 0x7f12c419a860 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.302+0000 7f12c8cc8640 1 --2- 172.21.15.135:0/767016121 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f12b00a3da0 0x7f12b00a6260 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.302+0000 7f12c8cc8640 1 --2- 172.21.15.135:0/767016121 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f12c4101690 0x7f12c41a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.302+0000 7f12c8cc8640 1 --2- 172.21.15.135:0/767016121 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f12c4100d70 0x7f12c41a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.302 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.302+0000 7f12c8cc8640 1 -- 172.21.15.135:0/767016121 >> 172.21.15.135:0/767016121 conn(0x7f12c4077f60 msgr2=0x7f12c410fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:13.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.302+0000 7f12c8cc8640 1 -- 172.21.15.135:0/767016121 shutdown_connections 2024-04-20T12:34:13.303 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.302+0000 7f12c8cc8640 1 -- 172.21.15.135:0/767016121 wait complete. 2024-04-20T12:34:13.313 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T12:34:13.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.411+0000 7f965df15640 1 -- 172.21.15.135:0/385894615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9658103ae0 msgr2=0x7f965810bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:13.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.411+0000 7f965df15640 1 --2- 172.21.15.135:0/385894615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9658103ae0 0x7f965810bfc0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f964c009ca0 tx=0x7f964c02c180 comp rx=0 tx=0).stop 2024-04-20T12:34:13.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.412+0000 7f965df15640 1 -- 172.21.15.135:0/385894615 shutdown_connections 2024-04-20T12:34:13.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.412+0000 7f965df15640 1 --2- 172.21.15.135:0/385894615 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f965810c590 0x7f965810e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.413 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.412+0000 7f965df15640 1 --2- 172.21.15.135:0/385894615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9658103ae0 0x7f965810bfc0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.412+0000 7f965df15640 1 --2- 172.21.15.135:0/385894615 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f96581031c0 0x7f96581035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.412+0000 7f965df15640 1 -- 172.21.15.135:0/385894615 >> 172.21.15.135:0/385894615 conn(0x7f96580771e0 msgr2=0x7f96580775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:13.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.412+0000 7f965df15640 1 -- 172.21.15.135:0/385894615 shutdown_connections 2024-04-20T12:34:13.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.412+0000 7f965df15640 1 -- 172.21.15.135:0/385894615 wait complete. 2024-04-20T12:34:13.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.412+0000 7f965df15640 1 Processor -- start 2024-04-20T12:34:13.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.412+0000 7f965df15640 1 -- start start 2024-04-20T12:34:13.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.412+0000 7f965df15640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96581031c0 0x7f965819e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:13.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.412+0000 7f965df15640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9658103ae0 0x7f965819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:13.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.412+0000 7f965df15640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f965810c590 0x7f96581986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:13.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.412+0000 7f965df15640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9658112380 con 0x7f965810c590 2024-04-20T12:34:13.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.412+0000 7f965df15640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f9658112200 con 0x7f9658103ae0 2024-04-20T12:34:13.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.412+0000 7f965df15640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f9658112500 con 0x7f96581031c0 2024-04-20T12:34:13.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f9657fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f965810c590 0x7f96581986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:13.414 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f9657fff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f965810c590 0x7f96581986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55556/0 (socket says 172.21.15.135:55556) 2024-04-20T12:34:13.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f9657fff640 1 -- 172.21.15.135:0/2838820472 learned_addr learned my addr 172.21.15.135:0/2838820472 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:34:13.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f9656ffd640 1 --2- 172.21.15.135:0/2838820472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9658103ae0 0x7f965819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:13.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f96577fe640 1 --2- 172.21.15.135:0/2838820472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96581031c0 0x7f965819e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:13.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f9657fff640 1 -- 172.21.15.135:0/2838820472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96581031c0 msgr2=0x7f965819e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:13.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f9657fff640 1 --2- 172.21.15.135:0/2838820472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96581031c0 0x7f965819e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f9657fff640 1 -- 172.21.15.135:0/2838820472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9658103ae0 msgr2=0x7f965819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:13.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f9657fff640 1 --2- 172.21.15.135:0/2838820472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9658103ae0 0x7f965819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f9657fff640 1 -- 172.21.15.135:0/2838820472 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9658198f80 con 0x7f965810c590 2024-04-20T12:34:13.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f9657fff640 1 --2- 172.21.15.135:0/2838820472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f965810c590 0x7f96581986c0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f965000b3f0 tx=0x7f965000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:13.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f9654ff9640 1 -- 172.21.15.135:0/2838820472 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9650015020 con 0x7f965810c590 2024-04-20T12:34:13.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f9654ff9640 1 -- 172.21.15.135:0/2838820472 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9650011d10 con 0x7f965810c590 2024-04-20T12:34:13.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f965df15640 1 -- 172.21.15.135:0/2838820472 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9658199270 con 0x7f965810c590 2024-04-20T12:34:13.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f9654ff9640 1 -- 172.21.15.135:0/2838820472 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965000f2e0 con 0x7f965810c590 2024-04-20T12:34:13.415 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.413+0000 7f965df15640 1 -- 172.21.15.135:0/2838820472 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96581a5580 con 0x7f965810c590 2024-04-20T12:34:13.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.414+0000 7f965df15640 1 -- 172.21.15.135:0/2838820472 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96581995b0 con 0x7f965810c590 2024-04-20T12:34:13.416 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.415+0000 7f9654ff9640 1 -- 172.21.15.135:0/2838820472 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f9650018020 con 0x7f965810c590 2024-04-20T12:34:13.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.416+0000 7f9654ff9640 1 --2- 172.21.15.135:0/2838820472 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f96400a3d20 0x7f96400a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:13.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.416+0000 7f96577fe640 1 --2- 172.21.15.135:0/2838820472 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f96400a3d20 0x7f96400a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:13.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.416+0000 7f9654ff9640 1 -- 172.21.15.135:0/2838820472 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9592+0+0 (secure 0 0 0) 0x7f96500d0a00 con 0x7f965810c590 2024-04-20T12:34:13.417 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.417+0000 7f96577fe640 1 --2- 172.21.15.135:0/2838820472 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f96400a3d20 0x7f96400a61e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f96480058c0 tx=0x7f964800a4c0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:13.419 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.420+0000 7f9654ff9640 1 -- 172.21.15.135:0/2838820472 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f965001f020 con 0x7f965810c590 2024-04-20T12:34:13.608 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.608+0000 7f965df15640 1 -- 172.21.15.135:0/2838820472 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96580691d0 con 0x7f965810c590 2024-04-20T12:34:13.609 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.610+0000 7f9654ff9640 1 -- 172.21.15.135:0/2838820472 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+25383 (secure 0 0 0) 0x7f965009cd20 con 0x7f965810c590 2024-04-20T12:34:13.609 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-04-20T12:34:13.610 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":105,"fsid":"22180be8-ff0f-11ee-bc92-c7b262605968","created":"2024-04-20T12:12:43.366193+0000","modified":"2024-04-20T12:34:13.474933+0000","last_up_change":"2024-04-20T12:19:51.566723+0000","last_in_change":"2024-04-20T12:19:31.653652+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T12:16:02.802023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-20T12:20:39.656129+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-20T12:20:40.312827+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-20T12:20:44.307136+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"57163598-6432-4dc1-b390-bcf40e339545","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6803","nonce":231033144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6805","nonce":231033144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6809","nonce":231033144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":231033144},{"type":"v1","addr":"172.21.15.135:6807","nonce":231033144}]},"public_addr":"172.21.15.135:6803/231033144","cluster_addr":"172.21.15.135:6805/231033144","heartbeat_back_addr":"172.21.15.135:6809/231033144","heartbeat_front_addr":"172.21.15.135:6807/231033144","state":["exists","up"]},{"osd":1,"uuid":"c049f1ea-0ec4-4aa5-9971-8d989b8c366a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6801","nonce":4149997416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6803","nonce":4149997416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6807","nonce":4149997416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":4149997416},{"type":"v1","addr":"172.21.15.139:6805","nonce":4149997416}]},"public_addr":"172.21.15.139:6801/4149997416","cluster_addr":"172.21.15.139:6803/4149997416","heartbeat_back_addr":"172.21.15.139:6807/4149997416","heartbeat_front_addr":"172.21.15.139:6805/4149997416","state":["exists","up"]},{"osd":2,"uuid":"248b1c85-1ec2-42c9-8f11-f1a57cb258a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6801","nonce":4166169084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6803","nonce":4166169084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6807","nonce":4166169084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":4166169084},{"type":"v1","addr":"172.21.15.154:6805","nonce":4166169084}]},"public_addr":"172.21.15.154:6801/4166169084","cluster_addr":"172.21.15.154:6803/4166169084","heartbeat_back_addr":"172.21.15.154:6807/4166169084","heartbeat_front_addr":"172.21.15.154:6805/4166169084","state":["exists","up"]},{"osd":3,"uuid":"70d9c325-bfce-44ca-b2b6-fbe6126a820c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6811","nonce":3478243444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6813","nonce":3478243444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6817","nonce":3478243444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":3478243444},{"type":"v1","addr":"172.21.15.135:6815","nonce":3478243444}]},"public_addr":"172.21.15.135:6811/3478243444","cluster_addr":"172.21.15.135:6813/3478243444","heartbeat_back_addr":"172.21.15.135:6817/3478243444","heartbeat_front_addr":"172.21.15.135:6815/3478243444","state":["exists","up"]},{"osd":4,"uuid":"73f90e0c-3a6a-4c13-8543-a3d50f08d2d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6809","nonce":450289913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6811","nonce":450289913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6815","nonce":450289913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":450289913},{"type":"v1","addr":"172.21.15.139:6813","nonce":450289913}]},"public_addr":"172.21.15.139:6809/450289913","cluster_addr":"172.21.15.139:6811/450289913","heartbeat_back_addr":"172.21.15.139:6815/450289913","heartbeat_front_addr":"172.21.15.139:6813/450289913","state":["exists","up"]},{"osd":5,"uuid":"5f0a8f64-2120-43e3-a452-c19a3323a645","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6809","nonce":512519935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6811","nonce":512519935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6815","nonce":512519935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":512519935},{"type":"v1","addr":"172.21.15.154:6813","nonce":512519935}]},"public_addr":"172.21.15.154:6809/512519935","cluster_addr":"172.21.15.154:6811/512519935","heartbeat_back_addr":"172.21.15.154:6815/512519935","heartbeat_front_addr":"172.21.15.154:6813/512519935","state":["exists","up"]},{"osd":6,"uuid":"ddd0e044-f07f-46a8-b2d2-56c0c14a1c14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6819","nonce":2765424966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6821","nonce":2765424966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6825","nonce":2765424966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":2765424966},{"type":"v1","addr":"172.21.15.135:6823","nonce":2765424966}]},"public_addr":"172.21.15.135:6819/2765424966","cluster_addr":"172.21.15.135:6821/2765424966","heartbeat_back_addr":"172.21.15.135:6825/2765424966","heartbeat_front_addr":"172.21.15.135:6823/2765424966","state":["exists","up"]},{"osd":7,"uuid":"ea3e9f8b-d627-413a-9146-bd3fea8948a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6817","nonce":3279788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6819","nonce":3279788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6823","nonce":3279788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":3279788017},{"type":"v1","addr":"172.21.15.139:6821","nonce":3279788017}]},"public_addr":"172.21.15.139:6817/3279788017","cluster_addr":"172.21.15.139:6819/3279788017","heartbeat_back_addr":"172.21.15.139:6823/3279788017","heartbeat_front_addr":"172.21.15.139:6821/3279788017","state":["exists","up"]},{"osd":8,"uuid":"3afbaac4-d30b-401e-b363-174bb38023c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6817","nonce":2723868018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6819","nonce":2723868018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6823","nonce":2723868018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":2723868018},{"type":"v1","addr":"172.21.15.154:6821","nonce":2723868018}]},"public_addr":"172.21.15.154:6817/2723868018","cluster_addr":"172.21.15.154:6819/2723868018","heartbeat_back_addr":"172.21.15.154:6823/2723868018","heartbeat_front_addr":"172.21.15.154:6821/2723868018","state":["exists","up"]},{"osd":9,"uuid":"e4f7257b-a6c1-47df-af14-ef8a5cdab68e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6827","nonce":3054405376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6829","nonce":3054405376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6833","nonce":3054405376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":3054405376},{"type":"v1","addr":"172.21.15.135:6831","nonce":3054405376}]},"public_addr":"172.21.15.135:6827/3054405376","cluster_addr":"172.21.15.135:6829/3054405376","heartbeat_back_addr":"172.21.15.135:6833/3054405376","heartbeat_front_addr":"172.21.15.135:6831/3054405376","state":["exists","up"]},{"osd":10,"uuid":"5be0ab8c-4f88-4d25-b656-d40245b76d01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6824","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6825","nonce":367683232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6826","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6827","nonce":367683232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6830","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6831","nonce":367683232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6828","nonce":367683232},{"type":"v1","addr":"172.21.15.139:6829","nonce":367683232}]},"public_addr":"172.21.15.139:6825/367683232","cluster_addr":"172.21.15.139:6827/367683232","heartbeat_back_addr":"172.21.15.139:6831/367683232","heartbeat_front_addr":"172.21.15.139:6829/367683232","state":["exists","up"]},{"osd":11,"uuid":"c88673e8-c6e7-44f8-ac95-e7c00f413f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6825","nonce":4024362144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6827","nonce":4024362144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6831","nonce":4024362144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":4024362144},{"type":"v1","addr":"172.21.15.154:6829","nonce":4024362144}]},"public_addr":"172.21.15.154:6825/4024362144","cluster_addr":"172.21.15.154:6827/4024362144","heartbeat_back_addr":"172.21.15.154:6831/4024362144","heartbeat_front_addr":"172.21.15.154:6829/4024362144","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:11.825000+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:35.916664+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:15:59.734589+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:24.306106+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:16:49.577700+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:14.540148+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:17:39.732710+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:05.145010+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:31.604180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:18:58.236194+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:23.808329+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T12:19:50.219971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11},{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.12","mappings":[{"from":9,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.135:0/2052292307":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/669936771":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/4276159294":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6800/3831149339":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6800/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/152375197":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/1087722944":"2024-04-21T12:23:07.080062+0000","172.21.15.135:6801/3831149339":"2024-04-21T12:23:07.080062+0000","172.21.15.135:0/4252118847":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/3207517469":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/2178168771":"2024-04-21T12:13:36.719889+0000","172.21.15.135:0/2737907457":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6800/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:6801/469891744":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/2298786540":"2024-04-21T12:13:10.061188+0000","172.21.15.135:0/3680323343":"2024-04-21T12:13:36.719889+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T12:34:13.611 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.612+0000 7f965df15640 1 -- 172.21.15.135:0/2838820472 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f96400a3d20 msgr2=0x7f96400a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:13.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.612+0000 7f965df15640 1 --2- 172.21.15.135:0/2838820472 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f96400a3d20 0x7f96400a61e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f96480058c0 tx=0x7f964800a4c0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.612+0000 7f965df15640 1 -- 172.21.15.135:0/2838820472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f965810c590 msgr2=0x7f96581986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:13.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.612+0000 7f965df15640 1 --2- 172.21.15.135:0/2838820472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f965810c590 0x7f96581986c0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f965000b3f0 tx=0x7f965000b8b0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.612+0000 7f965df15640 1 -- 172.21.15.135:0/2838820472 shutdown_connections 2024-04-20T12:34:13.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.612+0000 7f965df15640 1 --2- 172.21.15.135:0/2838820472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f965810c590 0x7f96581986c0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.612+0000 7f965df15640 1 --2- 172.21.15.135:0/2838820472 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f9658103ae0 0x7f965819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.612+0000 7f965df15640 1 --2- 172.21.15.135:0/2838820472 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f96400a3d20 0x7f96400a61e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.612+0000 7f965df15640 1 --2- 172.21.15.135:0/2838820472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96581031c0 0x7f965819e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.612+0000 7f965df15640 1 -- 172.21.15.135:0/2838820472 >> 172.21.15.135:0/2838820472 conn(0x7f96580771e0 msgr2=0x7f96580fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:13.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.612+0000 7f965df15640 1 -- 172.21.15.135:0/2838820472 shutdown_connections 2024-04-20T12:34:13.612 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.612+0000 7f965df15640 1 -- 172.21.15.135:0/2838820472 wait complete. 2024-04-20T12:34:13.623 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-20T12:34:13.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.726+0000 7f8d77959640 1 -- 172.21.15.135:0/3116168152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d70102b50 msgr2=0x7f8d70106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:13.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.726+0000 7f8d77959640 1 --2- 172.21.15.135:0/3116168152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d70102b50 0x7f8d70106b90 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009900 tx=0x7f8d6002bc30 comp rx=0 tx=0).stop 2024-04-20T12:34:13.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.726+0000 7f8d77959640 1 -- 172.21.15.135:0/3116168152 shutdown_connections 2024-04-20T12:34:13.728 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.726+0000 7f8d77959640 1 --2- 172.21.15.135:0/3116168152 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d70107270 0x7f8d7010ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.726+0000 7f8d77959640 1 --2- 172.21.15.135:0/3116168152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d70102b50 0x7f8d70106b90 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.726+0000 7f8d77959640 1 --2- 172.21.15.135:0/3116168152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d701021a0 0x7f8d70102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.726+0000 7f8d77959640 1 -- 172.21.15.135:0/3116168152 >> 172.21.15.135:0/3116168152 conn(0x7f8d700793b0 msgr2=0x7f8d700797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:13.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.726+0000 7f8d77959640 1 -- 172.21.15.135:0/3116168152 shutdown_connections 2024-04-20T12:34:13.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.726+0000 7f8d77959640 1 -- 172.21.15.135:0/3116168152 wait complete. 2024-04-20T12:34:13.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d77959640 1 Processor -- start 2024-04-20T12:34:13.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d77959640 1 -- start start 2024-04-20T12:34:13.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d77959640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d701021a0 0x7f8d70074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:13.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d77959640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d70107270 0x7f8d700747a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:13.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d77959640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d70074ce0 0x7f8d701a69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:13.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d77959640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70112300 con 0x7f8d701021a0 2024-04-20T12:34:13.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d77959640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70112180 con 0x7f8d70107270 2024-04-20T12:34:13.729 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d77959640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70112480 con 0x7f8d70074ce0 2024-04-20T12:34:13.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d756f5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d701021a0 0x7f8d70074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:13.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d756f5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d701021a0 0x7f8d70074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55574/0 (socket says 172.21.15.135:55574) 2024-04-20T12:34:13.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d756f5640 1 -- 172.21.15.135:0/941880768 learned_addr learned my addr 172.21.15.135:0/941880768 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:34:13.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d75ef6640 1 --2- 172.21.15.135:0/941880768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d70074ce0 0x7f8d701a69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:13.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d756f5640 1 -- 172.21.15.135:0/941880768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d70074ce0 msgr2=0x7f8d701a69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:13.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d74ef4640 1 --2- 172.21.15.135:0/941880768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d70107270 0x7f8d700747a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:13.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d756f5640 1 --2- 172.21.15.135:0/941880768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d70074ce0 0x7f8d701a69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d756f5640 1 -- 172.21.15.135:0/941880768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d70107270 msgr2=0x7f8d700747a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:13.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.727+0000 7f8d756f5640 1 --2- 172.21.15.135:0/941880768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d70107270 0x7f8d700747a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.728+0000 7f8d756f5640 1 -- 172.21.15.135:0/941880768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d701a7070 con 0x7f8d701021a0 2024-04-20T12:34:13.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.728+0000 7f8d75ef6640 1 --2- 172.21.15.135:0/941880768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d70074ce0 0x7f8d701a69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:34:13.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.728+0000 7f8d756f5640 1 --2- 172.21.15.135:0/941880768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d701021a0 0x7f8d70074260 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00e9f0 tx=0x7f8d6c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:13.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.728+0000 7f8d667fc640 1 -- 172.21.15.135:0/941880768 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c00cd80 con 0x7f8d701021a0 2024-04-20T12:34:13.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.728+0000 7f8d667fc640 1 -- 172.21.15.135:0/941880768 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d6c005500 con 0x7f8d701021a0 2024-04-20T12:34:13.730 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.728+0000 7f8d77959640 1 -- 172.21.15.135:0/941880768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d701a7360 con 0x7f8d701021a0 2024-04-20T12:34:13.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.728+0000 7f8d667fc640 1 -- 172.21.15.135:0/941880768 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c010690 con 0x7f8d701021a0 2024-04-20T12:34:13.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.728+0000 7f8d77959640 1 -- 172.21.15.135:0/941880768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d701a7860 con 0x7f8d701021a0 2024-04-20T12:34:13.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.729+0000 7f8d77959640 1 -- 172.21.15.135:0/941880768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d700691d0 con 0x7f8d701021a0 2024-04-20T12:34:13.731 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.730+0000 7f8d667fc640 1 -- 172.21.15.135:0/941880768 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f8d6c0046c0 con 0x7f8d701021a0 2024-04-20T12:34:13.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.730+0000 7f8d667fc640 1 --2- 172.21.15.135:0/941880768 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8d5c0a3d20 0x7f8d5c0a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:13.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.731+0000 7f8d74ef4640 1 --2- 172.21.15.135:0/941880768 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8d5c0a3d20 0x7f8d5c0a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:13.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.731+0000 7f8d667fc640 1 -- 172.21.15.135:0/941880768 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9504+0+0 (secure 0 0 0) 0x7f8d6c0d1350 con 0x7f8d701021a0 2024-04-20T12:34:13.732 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.731+0000 7f8d74ef4640 1 --2- 172.21.15.135:0/941880768 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8d5c0a3d20 0x7f8d5c0a61e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8d60036040 tx=0x7f8d60005fd0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:13.733 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.734+0000 7f8d667fc640 1 -- 172.21.15.135:0/941880768 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f8d6c053ff0 con 0x7f8d701021a0 2024-04-20T12:34:13.750 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:13 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/1841426884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:34:13.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:13 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/767016121' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:34:13.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:13 smithi154 ceph-mon[22073]: osdmap e105: 12 total, 12 up, 12 in 2024-04-20T12:34:13.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:13 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2838820472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:34:13.947 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.948+0000 7f8d77959640 1 -- 172.21.15.135:0/941880768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8d70075740 con 0x7f8d701021a0 2024-04-20T12:34:13.949 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:13 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/1841426884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:34:13.949 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:13 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/767016121' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:34:13.949 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:13 smithi135 ceph-mon[18264]: osdmap e105: 12 total, 12 up, 12 in 2024-04-20T12:34:13.950 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:13 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2838820472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:34:13.950 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.950+0000 7f8d667fc640 1 -- 172.21.15.135:0/941880768 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7f8d70075740 con 0x7f8d701021a0 2024-04-20T12:34:13.950 INFO:teuthology.orchestra.run.smithi135.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-20T12:34:13.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.953+0000 7f8d77959640 1 -- 172.21.15.135:0/941880768 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8d5c0a3d20 msgr2=0x7f8d5c0a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:13.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.953+0000 7f8d77959640 1 --2- 172.21.15.135:0/941880768 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8d5c0a3d20 0x7f8d5c0a61e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8d60036040 tx=0x7f8d60005fd0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.953+0000 7f8d77959640 1 -- 172.21.15.135:0/941880768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d701021a0 msgr2=0x7f8d70074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:13.953 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.953+0000 7f8d77959640 1 --2- 172.21.15.135:0/941880768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d701021a0 0x7f8d70074260 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00e9f0 tx=0x7f8d6c00edf0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.953+0000 7f8d77959640 1 -- 172.21.15.135:0/941880768 shutdown_connections 2024-04-20T12:34:13.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.954+0000 7f8d77959640 1 --2- 172.21.15.135:0/941880768 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f8d5c0a3d20 0x7f8d5c0a61e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.954+0000 7f8d77959640 1 --2- 172.21.15.135:0/941880768 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8d70074ce0 0x7f8d701a69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.954+0000 7f8d77959640 1 --2- 172.21.15.135:0/941880768 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f8d70107270 0x7f8d700747a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.954+0000 7f8d77959640 1 --2- 172.21.15.135:0/941880768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d701021a0 0x7f8d70074260 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:13.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.954+0000 7f8d77959640 1 -- 172.21.15.135:0/941880768 >> 172.21.15.135:0/941880768 conn(0x7f8d700793b0 msgr2=0x7f8d700ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:13.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.954+0000 7f8d77959640 1 -- 172.21.15.135:0/941880768 shutdown_connections 2024-04-20T12:34:13.954 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:13.954+0000 7f8d77959640 1 -- 172.21.15.135:0/941880768 wait complete. 2024-04-20T12:34:13.965 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-20T12:34:13.994 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:13 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/1841426884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:34:13.994 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:13 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/767016121' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-20T12:34:13.994 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:13 smithi139 ceph-mon[21834]: osdmap e105: 12 total, 12 up, 12 in 2024-04-20T12:34:13.994 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:13 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2838820472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-20T12:34:14.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.071+0000 7fa18d3f4640 1 -- 172.21.15.135:0/1574962115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa188101a50 msgr2=0x7fa188105a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:14.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.071+0000 7fa18d3f4640 1 --2- 172.21.15.135:0/1574962115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa188101a50 0x7fa188105a90 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fa178009900 tx=0x7fa17802bc30 comp rx=0 tx=0).stop 2024-04-20T12:34:14.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.071+0000 7fa18d3f4640 1 -- 172.21.15.135:0/1574962115 shutdown_connections 2024-04-20T12:34:14.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.071+0000 7fa18d3f4640 1 --2- 172.21.15.135:0/1574962115 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa188106170 0x7fa18810dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:14.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.071+0000 7fa18d3f4640 1 --2- 172.21.15.135:0/1574962115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa188101a50 0x7fa188105a90 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:14.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.071+0000 7fa18d3f4640 1 --2- 172.21.15.135:0/1574962115 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa1881010a0 0x7fa188101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:14.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.071+0000 7fa18d3f4640 1 -- 172.21.15.135:0/1574962115 >> 172.21.15.135:0/1574962115 conn(0x7fa188077f60 msgr2=0x7fa188078370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:14.074 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.071+0000 7fa18d3f4640 1 -- 172.21.15.135:0/1574962115 shutdown_connections 2024-04-20T12:34:14.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.071+0000 7fa18d3f4640 1 -- 172.21.15.135:0/1574962115 wait complete. 2024-04-20T12:34:14.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.072+0000 7fa18d3f4640 1 Processor -- start 2024-04-20T12:34:14.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.072+0000 7fa18d3f4640 1 -- start start 2024-04-20T12:34:14.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.072+0000 7fa18d3f4640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1881010a0 0x7fa188199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:14.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.072+0000 7fa18d3f4640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa188106170 0x7fa188199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:14.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.072+0000 7fa18d3f4640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa18819a130 0x7fa1881a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:14.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.072+0000 7fa18d3f4640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa188111200 con 0x7fa1881010a0 2024-04-20T12:34:14.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.072+0000 7fa18d3f4640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fa188111080 con 0x7fa188106170 2024-04-20T12:34:14.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.072+0000 7fa18d3f4640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fa188111380 con 0x7fa18819a130 2024-04-20T12:34:14.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.072+0000 7fa186ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1881010a0 0x7fa188199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:14.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.072+0000 7fa186ffd640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1881010a0 0x7fa188199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55648/0 (socket says 172.21.15.135:55648) 2024-04-20T12:34:14.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.072+0000 7fa186ffd640 1 -- 172.21.15.135:0/3803347013 learned_addr learned my addr 172.21.15.135:0/3803347013 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:34:14.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.072+0000 7fa1877fe640 1 --2- 172.21.15.135:0/3803347013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa18819a130 0x7fa1881a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:14.075 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.073+0000 7fa1867fc640 1 --2- 172.21.15.135:0/3803347013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa188106170 0x7fa188199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:14.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.073+0000 7fa186ffd640 1 -- 172.21.15.135:0/3803347013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa18819a130 msgr2=0x7fa1881a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:14.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.073+0000 7fa186ffd640 1 --2- 172.21.15.135:0/3803347013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa18819a130 0x7fa1881a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:14.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.073+0000 7fa186ffd640 1 -- 172.21.15.135:0/3803347013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa188106170 msgr2=0x7fa188199ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:14.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.073+0000 7fa186ffd640 1 --2- 172.21.15.135:0/3803347013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa188106170 0x7fa188199ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:14.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.073+0000 7fa186ffd640 1 -- 172.21.15.135:0/3803347013 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1881a4ee0 con 0x7fa1881010a0 2024-04-20T12:34:14.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.073+0000 7fa186ffd640 1 --2- 172.21.15.135:0/3803347013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1881010a0 0x7fa188199660 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00d950 tx=0x7fa17c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:14.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.073+0000 7fa16ffff640 1 -- 172.21.15.135:0/3803347013 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c017030 con 0x7fa1881010a0 2024-04-20T12:34:14.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.073+0000 7fa18d3f4640 1 -- 172.21.15.135:0/3803347013 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1881a51d0 con 0x7fa1881010a0 2024-04-20T12:34:14.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.073+0000 7fa16ffff640 1 -- 172.21.15.135:0/3803347013 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa17c004020 con 0x7fa1881010a0 2024-04-20T12:34:14.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.073+0000 7fa16ffff640 1 -- 172.21.15.135:0/3803347013 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0047a0 con 0x7fa1881010a0 2024-04-20T12:34:14.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.073+0000 7fa18d3f4640 1 -- 172.21.15.135:0/3803347013 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1881a5740 con 0x7fa1881010a0 2024-04-20T12:34:14.076 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.074+0000 7fa18d3f4640 1 -- 172.21.15.135:0/3803347013 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa188068d80 con 0x7fa1881010a0 2024-04-20T12:34:14.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.075+0000 7fa16ffff640 1 -- 172.21.15.135:0/3803347013 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fa17c0041d0 con 0x7fa1881010a0 2024-04-20T12:34:14.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.076+0000 7fa16ffff640 1 --2- 172.21.15.135:0/3803347013 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa1700a3d20 0x7fa1700a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:14.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.076+0000 7fa1867fc640 1 --2- 172.21.15.135:0/3803347013 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa1700a3d20 0x7fa1700a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:14.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.076+0000 7fa16ffff640 1 -- 172.21.15.135:0/3803347013 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9846+0+0 (secure 0 0 0) 0x7fa17c0d0cf0 con 0x7fa1881010a0 2024-04-20T12:34:14.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.076+0000 7fa1867fc640 1 --2- 172.21.15.135:0/3803347013 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa1700a3d20 0x7fa1700a61e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa178009230 tx=0x7fa178005fd0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:14.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.079+0000 7fa16ffff640 1 -- 172.21.15.135:0/3803347013 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fa17c09ce60 con 0x7fa1881010a0 2024-04-20T12:34:14.296 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.296+0000 7fa18d3f4640 1 -- 172.21.15.135:0/3803347013 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa1881093a0 con 0x7fa1881010a0 2024-04-20T12:34:14.329 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-b[52080]: ignoring --setuser ceph since I am not root 2024-04-20T12:34:14.330 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-b[52080]: ignoring --setgroup ceph since I am not root 2024-04-20T12:34:14.330 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-mds[52084]: -- 172.21.15.139:0/2061750580 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bd7c711a40 con 0x55bd7c6e5000 2024-04-20T12:34:14.330 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-b[52080]: starting mds.b at 2024-04-20T12:34:14.330 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-e[51458]: ignoring --setuser ceph since I am not root 2024-04-20T12:34:14.330 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-e[51458]: ignoring --setgroup ceph since I am not root 2024-04-20T12:34:14.330 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-mds[51462]: -- 172.21.15.139:0/1920844688 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5626250b7a40 con 0x56262508b000 2024-04-20T12:34:14.330 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-e[51458]: starting mds.e at 2024-04-20T12:34:14.331 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:34:13 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-k[51143]: ignoring --setuser ceph since I am not root 2024-04-20T12:34:14.331 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:34:13 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-k[51143]: ignoring --setgroup ceph since I am not root 2024-04-20T12:34:14.331 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:34:13 smithi139 ceph-mds[51147]: -- 172.21.15.139:0/2041682118 <== mon.2 v2:172.21.15.139:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e2c86764e0 con 0x55e2c864c800 2024-04-20T12:34:14.331 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:34:13 smithi139 ceph-mds[51147]: -- 172.21.15.139:0/2041682118 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e2c8679a40 con 0x55e2c864c800 2024-04-20T12:34:14.331 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:34:13 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-k[51143]: starting mds.k at 2024-04-20T12:34:14.332 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:34:13 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-h[51772]: ignoring --setuser ceph since I am not root 2024-04-20T12:34:14.332 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:34:13 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-h[51772]: ignoring --setgroup ceph since I am not root 2024-04-20T12:34:14.332 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:34:13 smithi139 ceph-mds[51776]: -- 172.21.15.139:0/2673669962 <== mon.0 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a6225e3a40 con 0x55a6225b6800 2024-04-20T12:34:14.332 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:34:13 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-h[51772]: starting mds.h at 2024-04-20T12:34:14.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:13 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-a[18260]: 2024-04-20T12:34:13.948+0000 7f7b1ec4d700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T12:34:14.364 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:34:13 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-g[57338]: ignoring --setuser ceph since I am not root 2024-04-20T12:34:14.364 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:34:13 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-g[57338]: ignoring --setgroup ceph since I am not root 2024-04-20T12:34:14.364 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:34:13 smithi135 ceph-mds[57342]: -- 172.21.15.135:0/2253644444 <== mon.1 v2:172.21.15.154:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d017d2ba40 con 0x55d017cfe800 2024-04-20T12:34:14.364 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:34:13 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-g[57338]: starting mds.g at 2024-04-20T12:34:14.364 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:34:13 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-a[57699]: ignoring --setuser ceph since I am not root 2024-04-20T12:34:14.364 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:34:13 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-a[57699]: ignoring --setgroup ceph since I am not root 2024-04-20T12:34:14.364 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:34:13 smithi135 ceph-mds[57703]: -- 172.21.15.135:0/3497342060 <== mon.0 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56097512fa40 con 0x560975103000 2024-04-20T12:34:14.364 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:34:13 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-a[57699]: starting mds.a at 2024-04-20T12:34:14.501 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-c[52302]: ignoring --setuser ceph since I am not root 2024-04-20T12:34:14.501 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-c[52302]: ignoring --setgroup ceph since I am not root 2024-04-20T12:34:14.501 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-mds[52306]: -- 172.21.15.154:0/1674438481 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5588f9bf84e0 con 0x5588f9bcf000 2024-04-20T12:34:14.501 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-mds[52306]: -- 172.21.15.154:0/1674438481 <== mon.0 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5588f9bfba40 con 0x5588f9bcf000 2024-04-20T12:34:14.501 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-c[52302]: starting mds.c at 2024-04-20T12:34:14.502 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-f[51996]: ignoring --setuser ceph since I am not root 2024-04-20T12:34:14.502 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-f[51996]: ignoring --setgroup ceph since I am not root 2024-04-20T12:34:14.502 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-mds[52000]: -- 172.21.15.154:0/392139008 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5556a7ddba40 con 0x5556a7daec00 2024-04-20T12:34:14.502 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-f[51996]: starting mds.f at 2024-04-20T12:34:14.502 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i[52605]: ignoring --setuser ceph since I am not root 2024-04-20T12:34:14.503 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i[52605]: ignoring --setgroup ceph since I am not root 2024-04-20T12:34:14.503 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-mds[52609]: -- 172.21.15.154:0/285388700 <== mon.0 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5602e2be5a40 con 0x5602e2bb8c00 2024-04-20T12:34:14.503 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i[52605]: starting mds.i at 2024-04-20T12:34:14.503 INFO:journalctl@ceph.mds.l.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-l[51675]: ignoring --setuser ceph since I am not root 2024-04-20T12:34:14.503 INFO:journalctl@ceph.mds.l.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-l[51675]: ignoring --setgroup ceph since I am not root 2024-04-20T12:34:14.503 INFO:journalctl@ceph.mds.l.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-mds[51679]: -- 172.21.15.154:0/888636994 <== mon.2 v2:172.21.15.139:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581b8ed1a40 con 0x5581b8ea4800 2024-04-20T12:34:14.503 INFO:journalctl@ceph.mds.l.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-l[51675]: starting mds.l at 2024-04-20T12:34:14.951 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.951+0000 7fa16ffff640 1 -- 172.21.15.135:0/3803347013 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7fa17c09c760 con 0x7fa1881010a0 2024-04-20T12:34:14.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.955+0000 7fa18d3f4640 1 -- 172.21.15.135:0/3803347013 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa1700a3d20 msgr2=0x7fa1700a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:14.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.955+0000 7fa18d3f4640 1 --2- 172.21.15.135:0/3803347013 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa1700a3d20 0x7fa1700a61e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa178009230 tx=0x7fa178005fd0 comp rx=0 tx=0).stop 2024-04-20T12:34:14.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.955+0000 7fa18d3f4640 1 -- 172.21.15.135:0/3803347013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1881010a0 msgr2=0x7fa188199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:14.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.955+0000 7fa18d3f4640 1 --2- 172.21.15.135:0/3803347013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1881010a0 0x7fa188199660 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00d950 tx=0x7fa17c00de10 comp rx=0 tx=0).stop 2024-04-20T12:34:14.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.955+0000 7fa18d3f4640 1 -- 172.21.15.135:0/3803347013 shutdown_connections 2024-04-20T12:34:14.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.955+0000 7fa18d3f4640 1 --2- 172.21.15.135:0/3803347013 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fa1700a3d20 0x7fa1700a61e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:14.955 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.955+0000 7fa18d3f4640 1 --2- 172.21.15.135:0/3803347013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa18819a130 0x7fa1881a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:14.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.955+0000 7fa18d3f4640 1 --2- 172.21.15.135:0/3803347013 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fa188106170 0x7fa188199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:14.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.955+0000 7fa18d3f4640 1 --2- 172.21.15.135:0/3803347013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1881010a0 0x7fa188199660 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:14.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.955+0000 7fa18d3f4640 1 -- 172.21.15.135:0/3803347013 >> 172.21.15.135:0/3803347013 conn(0x7fa188077f60 msgr2=0x7fa1880ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:14.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.956+0000 7fa18d3f4640 1 -- 172.21.15.135:0/3803347013 shutdown_connections 2024-04-20T12:34:14.956 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:14.956+0000 7fa18d3f4640 1 -- 172.21.15.135:0/3803347013 wait complete. 2024-04-20T12:34:14.970 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:14 smithi135 ceph-mon[18264]: pgmap v345: 129 pgs: 129 active+clean; 12 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 818 B/s wr, 11 op/s 2024-04-20T12:34:14.970 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:14 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/941880768' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-20T12:34:14.970 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:14 smithi135 ceph-mon[18264]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-20T12:34:14.970 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:14 smithi135 ceph-mon[18264]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T12:34:14.971 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:14 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/941880768' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-20T12:34:14.971 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:14 smithi135 ceph-mon[18264]: osdmap e106: 12 total, 12 up, 12 in 2024-04-20T12:34:14.971 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:14 smithi135 ceph-mon[18264]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-20T12:34:14.971 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:14 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3803347013' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-20T12:34:14.972 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-20T12:34:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-mon[22073]: pgmap v345: 129 pgs: 129 active+clean; 12 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 818 B/s wr, 11 op/s 2024-04-20T12:34:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/941880768' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-20T12:34:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-mon[22073]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-20T12:34:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-mon[22073]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T12:34:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/941880768' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-20T12:34:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-mon[22073]: osdmap e106: 12 total, 12 up, 12 in 2024-04-20T12:34:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-mon[22073]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-20T12:34:15.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:14 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3803347013' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-20T12:34:15.077 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.076+0000 7fe4f2232640 1 -- 172.21.15.135:0/2192963706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4ec074b50 msgr2=0x7fe4ec112ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:15.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.076+0000 7fe4f2232640 1 --2- 172.21.15.135:0/2192963706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4ec074b50 0x7fe4ec112ab0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009930 tx=0x7fe4e002bcb0 comp rx=0 tx=0).stop 2024-04-20T12:34:15.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.076+0000 7fe4f2232640 1 -- 172.21.15.135:0/2192963706 shutdown_connections 2024-04-20T12:34:15.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.076+0000 7fe4f2232640 1 --2- 172.21.15.135:0/2192963706 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec112ff0 0x7fe4ec1153e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:15.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.076+0000 7fe4f2232640 1 --2- 172.21.15.135:0/2192963706 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4ec074b50 0x7fe4ec112ab0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:15.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.076+0000 7fe4f2232640 1 --2- 172.21.15.135:0/2192963706 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4ec074230 0x7fe4ec074610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:15.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.076+0000 7fe4f2232640 1 -- 172.21.15.135:0/2192963706 >> 172.21.15.135:0/2192963706 conn(0x7fe4ec0793b0 msgr2=0x7fe4ec0797c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:15.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.076+0000 7fe4f2232640 1 -- 172.21.15.135:0/2192963706 shutdown_connections 2024-04-20T12:34:15.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.076+0000 7fe4f2232640 1 -- 172.21.15.135:0/2192963706 wait complete. 2024-04-20T12:34:15.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.076+0000 7fe4f2232640 1 Processor -- start 2024-04-20T12:34:15.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4f2232640 1 -- start start 2024-04-20T12:34:15.078 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4f2232640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4ec074230 0x7fe4ec19ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:15.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4f2232640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec074b50 0x7fe4ec19f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:15.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4f2232640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4ec112ff0 0x7fe4ec1a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:15.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4f2232640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec118920 con 0x7fe4ec074230 2024-04-20T12:34:15.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4f2232640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec1187a0 con 0x7fe4ec074b50 2024-04-20T12:34:15.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4f2232640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7fe4ec118aa0 con 0x7fe4ec112ff0 2024-04-20T12:34:15.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4eb7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4ec074230 0x7fe4ec19ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:15.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4eb7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4ec074230 0x7fe4ec19ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55662/0 (socket says 172.21.15.135:55662) 2024-04-20T12:34:15.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4eb7fe640 1 -- 172.21.15.135:0/2363331937 learned_addr learned my addr 172.21.15.135:0/2363331937 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:34:15.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4eaffd640 1 --2- 172.21.15.135:0/2363331937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec074b50 0x7fe4ec19f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:15.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4ebfff640 1 --2- 172.21.15.135:0/2363331937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4ec112ff0 0x7fe4ec1a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:15.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4eb7fe640 1 -- 172.21.15.135:0/2363331937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4ec112ff0 msgr2=0x7fe4ec1a3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:15.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4eb7fe640 1 --2- 172.21.15.135:0/2363331937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4ec112ff0 0x7fe4ec1a3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:15.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4eb7fe640 1 -- 172.21.15.135:0/2363331937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec074b50 msgr2=0x7fe4ec19f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:15.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4eb7fe640 1 --2- 172.21.15.135:0/2363331937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec074b50 0x7fe4ec19f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:15.079 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4eb7fe640 1 -- 172.21.15.135:0/2363331937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4ec1a3e50 con 0x7fe4ec074230 2024-04-20T12:34:15.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.077+0000 7fe4eb7fe640 1 --2- 172.21.15.135:0/2363331937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4ec074230 0x7fe4ec19ee60 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00c970 tx=0x7fe4dc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:15.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.078+0000 7fe4e8ff9640 1 -- 172.21.15.135:0/2363331937 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc007bb0 con 0x7fe4ec074230 2024-04-20T12:34:15.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.078+0000 7fe4e8ff9640 1 -- 172.21.15.135:0/2363331937 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4dc007d50 con 0x7fe4ec074230 2024-04-20T12:34:15.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.078+0000 7fe4f2232640 1 -- 172.21.15.135:0/2363331937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4ec1a4140 con 0x7fe4ec074230 2024-04-20T12:34:15.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.078+0000 7fe4e8ff9640 1 -- 172.21.15.135:0/2363331937 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc00f450 con 0x7fe4ec074230 2024-04-20T12:34:15.080 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.078+0000 7fe4f2232640 1 -- 172.21.15.135:0/2363331937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4ec1ab9d0 con 0x7fe4ec074230 2024-04-20T12:34:15.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-mon[21834]: pgmap v345: 129 pgs: 129 active+clean; 12 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 818 B/s wr, 11 op/s 2024-04-20T12:34:15.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/941880768' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-04-20T12:34:15.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-mon[21834]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-20T12:34:15.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-mon[21834]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-20T12:34:15.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/941880768' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-04-20T12:34:15.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-mon[21834]: osdmap e106: 12 total, 12 up, 12 in 2024-04-20T12:34:15.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-mon[21834]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-04-20T12:34:15.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:14 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3803347013' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-04-20T12:34:15.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.079+0000 7fe4f2232640 1 -- 172.21.15.135:0/2363331937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4ec0691d0 con 0x7fe4ec074230 2024-04-20T12:34:15.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.080+0000 7fe4e8ff9640 1 -- 172.21.15.135:0/2363331937 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7fe4dc005020 con 0x7fe4ec074230 2024-04-20T12:34:15.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.080+0000 7fe4e8ff9640 1 --2- 172.21.15.135:0/2363331937 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe4d40a3d20 0x7fe4d40a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:15.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.080+0000 7fe4eaffd640 1 --2- 172.21.15.135:0/2363331937 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe4d40a3d20 0x7fe4d40a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:15.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.080+0000 7fe4e8ff9640 1 -- 172.21.15.135:0/2363331937 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9846+0+0 (secure 0 0 0) 0x7fe4dc0d0bf0 con 0x7fe4ec074230 2024-04-20T12:34:15.082 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.081+0000 7fe4eaffd640 1 --2- 172.21.15.135:0/2363331937 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe4d40a3d20 0x7fe4d40a61e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0006010 tx=0x7fe4e002c7d0 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:15.084 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.085+0000 7fe4e8ff9640 1 -- 172.21.15.135:0/2363331937 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7fe4dc014030 con 0x7fe4ec074230 2024-04-20T12:34:15.263 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.264+0000 7fe4f2232640 1 -- 172.21.15.135:0/2363331937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe4ec1a01b0 con 0x7fe4ec074230 2024-04-20T12:34:15.962 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.962+0000 7fe4e8ff9640 1 -- 172.21.15.135:0/2363331937 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v107) ==== 181+0+0 (secure 0 0 0) 0x7fe4dc09cd60 con 0x7fe4ec074230 2024-04-20T12:34:15.962 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_metadata' removed 2024-04-20T12:34:15.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.965+0000 7fe4f2232640 1 -- 172.21.15.135:0/2363331937 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe4d40a3d20 msgr2=0x7fe4d40a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:15.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.965+0000 7fe4f2232640 1 --2- 172.21.15.135:0/2363331937 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe4d40a3d20 0x7fe4d40a61e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0006010 tx=0x7fe4e002c7d0 comp rx=0 tx=0).stop 2024-04-20T12:34:15.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.965+0000 7fe4f2232640 1 -- 172.21.15.135:0/2363331937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4ec074230 msgr2=0x7fe4ec19ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:15.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.965+0000 7fe4f2232640 1 --2- 172.21.15.135:0/2363331937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4ec074230 0x7fe4ec19ee60 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc00c970 tx=0x7fe4dc00ce30 comp rx=0 tx=0).stop 2024-04-20T12:34:15.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.965+0000 7fe4f2232640 1 -- 172.21.15.135:0/2363331937 shutdown_connections 2024-04-20T12:34:15.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.965+0000 7fe4f2232640 1 --2- 172.21.15.135:0/2363331937 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7fe4d40a3d20 0x7fe4d40a61e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:15.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.965+0000 7fe4f2232640 1 --2- 172.21.15.135:0/2363331937 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe4ec112ff0 0x7fe4ec1a3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:15.965 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.965+0000 7fe4f2232640 1 --2- 172.21.15.135:0/2363331937 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7fe4ec074b50 0x7fe4ec19f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:15.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.965+0000 7fe4f2232640 1 --2- 172.21.15.135:0/2363331937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4ec074230 0x7fe4ec19ee60 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:15.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.965+0000 7fe4f2232640 1 -- 172.21.15.135:0/2363331937 >> 172.21.15.135:0/2363331937 conn(0x7fe4ec0793b0 msgr2=0x7fe4ec0feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:15.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.965+0000 7fe4f2232640 1 -- 172.21.15.135:0/2363331937 shutdown_connections 2024-04-20T12:34:15.966 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:15.965+0000 7fe4f2232640 1 -- 172.21.15.135:0/2363331937 wait complete. 2024-04-20T12:34:15.980 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-20T12:34:15.980 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-20T12:34:15.980 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: Cluster is now healthy 2024-04-20T12:34:15.980 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/3803347013' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-20T12:34:15.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.135:6839/1525692375,v1:172.21.15.135:6840/1525692375] up:boot 2024-04-20T12:34:15.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.135:6838/4057436457,v1:172.21.15.135:6841/4057436457] up:boot 2024-04-20T12:34:15.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.139:6833/2223396482,v1:172.21.15.139:6834/2223396482] up:boot 2024-04-20T12:34:15.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.139:6832/2324403624,v1:172.21.15.139:6835/2324403624] up:boot 2024-04-20T12:34:15.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.139:6836/3668379068,v1:172.21.15.139:6838/3668379068] up:boot 2024-04-20T12:34:15.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.139:6837/206248861,v1:172.21.15.139:6839/206248861] up:boot 2024-04-20T12:34:15.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.154:6833/1747780634,v1:172.21.15.154:6834/1747780634] up:boot 2024-04-20T12:34:15.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.154:6832/2429489323,v1:172.21.15.154:6836/2429489323] up:boot 2024-04-20T12:34:15.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.154:6835/1518387126,v1:172.21.15.154:6838/1518387126] up:boot 2024-04-20T12:34:15.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: mds.? [v2:172.21.15.154:6837/3914577420,v1:172.21.15.154:6839/3914577420] up:boot 2024-04-20T12:34:15.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: fsmap 12 up:standby 2024-04-20T12:34:15.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-20T12:34:15.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-20T12:34:15.981 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-20T12:34:15.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-20T12:34:15.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-20T12:34:15.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-20T12:34:15.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-20T12:34:15.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-20T12:34:15.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-20T12:34:15.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-20T12:34:15.982 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:15 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2363331937' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-20T12:34:15.983 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-20T12:34:16.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-20T12:34:16.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-20T12:34:16.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: Cluster is now healthy 2024-04-20T12:34:16.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/3803347013' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-20T12:34:16.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.135:6839/1525692375,v1:172.21.15.135:6840/1525692375] up:boot 2024-04-20T12:34:16.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.135:6838/4057436457,v1:172.21.15.135:6841/4057436457] up:boot 2024-04-20T12:34:16.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.139:6833/2223396482,v1:172.21.15.139:6834/2223396482] up:boot 2024-04-20T12:34:16.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.139:6832/2324403624,v1:172.21.15.139:6835/2324403624] up:boot 2024-04-20T12:34:16.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.139:6836/3668379068,v1:172.21.15.139:6838/3668379068] up:boot 2024-04-20T12:34:16.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.139:6837/206248861,v1:172.21.15.139:6839/206248861] up:boot 2024-04-20T12:34:16.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.154:6833/1747780634,v1:172.21.15.154:6834/1747780634] up:boot 2024-04-20T12:34:16.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.154:6832/2429489323,v1:172.21.15.154:6836/2429489323] up:boot 2024-04-20T12:34:16.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.154:6835/1518387126,v1:172.21.15.154:6838/1518387126] up:boot 2024-04-20T12:34:16.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: mds.? [v2:172.21.15.154:6837/3914577420,v1:172.21.15.154:6839/3914577420] up:boot 2024-04-20T12:34:16.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: fsmap 12 up:standby 2024-04-20T12:34:16.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-20T12:34:16.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-20T12:34:16.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-20T12:34:16.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-20T12:34:16.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-20T12:34:16.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-20T12:34:16.002 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-20T12:34:16.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-20T12:34:16.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-20T12:34:16.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-20T12:34:16.003 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:15 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2363331937' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-20T12:34:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-20T12:34:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-20T12:34:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: Cluster is now healthy 2024-04-20T12:34:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/3803347013' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-04-20T12:34:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.135:6839/1525692375,v1:172.21.15.135:6840/1525692375] up:boot 2024-04-20T12:34:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.135:6838/4057436457,v1:172.21.15.135:6841/4057436457] up:boot 2024-04-20T12:34:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.139:6833/2223396482,v1:172.21.15.139:6834/2223396482] up:boot 2024-04-20T12:34:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.139:6832/2324403624,v1:172.21.15.139:6835/2324403624] up:boot 2024-04-20T12:34:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.139:6836/3668379068,v1:172.21.15.139:6838/3668379068] up:boot 2024-04-20T12:34:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.139:6837/206248861,v1:172.21.15.139:6839/206248861] up:boot 2024-04-20T12:34:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.154:6833/1747780634,v1:172.21.15.154:6834/1747780634] up:boot 2024-04-20T12:34:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.154:6832/2429489323,v1:172.21.15.154:6836/2429489323] up:boot 2024-04-20T12:34:16.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.154:6835/1518387126,v1:172.21.15.154:6838/1518387126] up:boot 2024-04-20T12:34:16.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: mds.? [v2:172.21.15.154:6837/3914577420,v1:172.21.15.154:6839/3914577420] up:boot 2024-04-20T12:34:16.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: fsmap 12 up:standby 2024-04-20T12:34:16.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-04-20T12:34:16.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-04-20T12:34:16.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-04-20T12:34:16.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-04-20T12:34:16.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-04-20T12:34:16.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-04-20T12:34:16.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-04-20T12:34:16.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-04-20T12:34:16.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-04-20T12:34:16.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: from='mgr.25093 172.21.15.135:0/3420729897' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-04-20T12:34:16.081 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:15 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2363331937' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-20T12:34:16.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.093+0000 7f792fc81640 1 -- 172.21.15.135:0/4109311688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281006f0 msgr2=0x7f7928100ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:16.095 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.093+0000 7f792fc81640 1 --2- 172.21.15.135:0/4109311688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281006f0 0x7f7928100ad0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f7918009900 tx=0x7f791802bc50 comp rx=0 tx=0).stop 2024-04-20T12:34:16.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.093+0000 7f792fc81640 1 -- 172.21.15.135:0/4109311688 shutdown_connections 2024-04-20T12:34:16.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.093+0000 7f792fc81640 1 --2- 172.21.15.135:0/4109311688 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7928107300 0x7f792810ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:16.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.093+0000 7f792fc81640 1 --2- 172.21.15.135:0/4109311688 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f79281010a0 0x7f7928106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:16.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.093+0000 7f792fc81640 1 --2- 172.21.15.135:0/4109311688 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281006f0 0x7f7928100ad0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:16.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.093+0000 7f792fc81640 1 -- 172.21.15.135:0/4109311688 >> 172.21.15.135:0/4109311688 conn(0x7f79280773f0 msgr2=0x7f79280fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:16.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.094+0000 7f792fc81640 1 -- 172.21.15.135:0/4109311688 shutdown_connections 2024-04-20T12:34:16.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.094+0000 7f792fc81640 1 -- 172.21.15.135:0/4109311688 wait complete. 2024-04-20T12:34:16.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.094+0000 7f792fc81640 1 Processor -- start 2024-04-20T12:34:16.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.094+0000 7f792fc81640 1 -- start start 2024-04-20T12:34:16.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.094+0000 7f792fc81640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281006f0 0x7f7928101660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:16.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.094+0000 7f792fc81640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7928107300 0x7f7928101ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:16.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.094+0000 7f792fc81640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79281020e0 0x7f79281a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:16.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.094+0000 7f792fc81640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7928112420 con 0x7f79281006f0 2024-04-20T12:34:16.096 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.094+0000 7f792fc81640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f79281122a0 con 0x7f7928107300 2024-04-20T12:34:16.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.094+0000 7f792fc81640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f79281125a0 con 0x7f79281020e0 2024-04-20T12:34:16.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.094+0000 7f792da1d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281006f0 0x7f7928101660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:16.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.094+0000 7f792da1d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281006f0 0x7f7928101660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55686/0 (socket says 172.21.15.135:55686) 2024-04-20T12:34:16.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.094+0000 7f792da1d640 1 -- 172.21.15.135:0/2123076572 learned_addr learned my addr 172.21.15.135:0/2123076572 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:34:16.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.094+0000 7f792e21e640 1 --2- 172.21.15.135:0/2123076572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79281020e0 0x7f79281a6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:16.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.095+0000 7f792d21c640 1 --2- 172.21.15.135:0/2123076572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7928107300 0x7f7928101ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:16.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.095+0000 7f792da1d640 1 -- 172.21.15.135:0/2123076572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79281020e0 msgr2=0x7f79281a6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:16.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.095+0000 7f792da1d640 1 --2- 172.21.15.135:0/2123076572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79281020e0 0x7f79281a6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:16.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.095+0000 7f792da1d640 1 -- 172.21.15.135:0/2123076572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7928107300 msgr2=0x7f7928101ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:16.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.095+0000 7f792da1d640 1 --2- 172.21.15.135:0/2123076572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7928107300 0x7f7928101ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:16.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.095+0000 7f792da1d640 1 -- 172.21.15.135:0/2123076572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79281a72f0 con 0x7f79281006f0 2024-04-20T12:34:16.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.095+0000 7f792d21c640 1 --2- 172.21.15.135:0/2123076572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7928107300 0x7f7928101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:34:16.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.095+0000 7f792da1d640 1 --2- 172.21.15.135:0/2123076572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281006f0 0x7f7928101660 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f7918006010 tx=0x7f791802cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:16.097 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.095+0000 7f791effd640 1 -- 172.21.15.135:0/2123076572 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918042020 con 0x7f79281006f0 2024-04-20T12:34:16.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.095+0000 7f791effd640 1 -- 172.21.15.135:0/2123076572 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79180054e0 con 0x7f79281006f0 2024-04-20T12:34:16.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.095+0000 7f792fc81640 1 -- 172.21.15.135:0/2123076572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79281a7580 con 0x7f79281006f0 2024-04-20T12:34:16.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.095+0000 7f791effd640 1 -- 172.21.15.135:0/2123076572 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791803e460 con 0x7f79281006f0 2024-04-20T12:34:16.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.095+0000 7f792fc81640 1 -- 172.21.15.135:0/2123076572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79281a7ad0 con 0x7f79281006f0 2024-04-20T12:34:16.098 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.096+0000 7f792fc81640 1 -- 172.21.15.135:0/2123076572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7928102b90 con 0x7f79281006f0 2024-04-20T12:34:16.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.097+0000 7f791effd640 1 -- 172.21.15.135:0/2123076572 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f7918045020 con 0x7f79281006f0 2024-04-20T12:34:16.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.098+0000 7f791effd640 1 --2- 172.21.15.135:0/2123076572 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f79140a3d50 0x7f79140a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:16.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.098+0000 7f792d21c640 1 --2- 172.21.15.135:0/2123076572 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f79140a3d50 0x7f79140a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:16.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.098+0000 7f791effd640 1 -- 172.21.15.135:0/2123076572 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9313+0+0 (secure 0 0 0) 0x7f79180f2b20 con 0x7f79281006f0 2024-04-20T12:34:16.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.098+0000 7f792d21c640 1 --2- 172.21.15.135:0/2123076572 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f79140a3d50 0x7f79140a6210 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7924006fd0 tx=0x7f7924008040 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:16.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.102+0000 7f791effd640 1 -- 172.21.15.135:0/2123076572 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f791804c020 con 0x7f79281006f0 2024-04-20T12:34:16.278 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.278+0000 7f792fc81640 1 -- 172.21.15.135:0/2123076572 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f792810a4b0 con 0x7f79281006f0 2024-04-20T12:34:16.971 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.971+0000 7f791effd640 1 -- 172.21.15.135:0/2123076572 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v108) ==== 169+0+0 (secure 0 0 0) 0x7f79180befb0 con 0x7f79281006f0 2024-04-20T12:34:16.971 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data' removed 2024-04-20T12:34:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.974+0000 7f792fc81640 1 -- 172.21.15.135:0/2123076572 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f79140a3d50 msgr2=0x7f79140a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.974+0000 7f792fc81640 1 --2- 172.21.15.135:0/2123076572 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f79140a3d50 0x7f79140a6210 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7924006fd0 tx=0x7f7924008040 comp rx=0 tx=0).stop 2024-04-20T12:34:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.974+0000 7f792fc81640 1 -- 172.21.15.135:0/2123076572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281006f0 msgr2=0x7f7928101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.974+0000 7f792fc81640 1 --2- 172.21.15.135:0/2123076572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281006f0 0x7f7928101660 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f7918006010 tx=0x7f791802cd90 comp rx=0 tx=0).stop 2024-04-20T12:34:16.974 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.975+0000 7f792fc81640 1 -- 172.21.15.135:0/2123076572 shutdown_connections 2024-04-20T12:34:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.975+0000 7f792fc81640 1 --2- 172.21.15.135:0/2123076572 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f79140a3d50 0x7f79140a6210 secure :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7924006fd0 tx=0x7f7924008040 comp rx=0 tx=0).stop 2024-04-20T12:34:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.975+0000 7f792fc81640 1 --2- 172.21.15.135:0/2123076572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79281020e0 0x7f79281a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.975+0000 7f792fc81640 1 --2- 172.21.15.135:0/2123076572 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f7928107300 0x7f7928101ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.975+0000 7f792fc81640 1 --2- 172.21.15.135:0/2123076572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f79281006f0 0x7f7928101660 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.975+0000 7f792fc81640 1 -- 172.21.15.135:0/2123076572 >> 172.21.15.135:0/2123076572 conn(0x7f79280773f0 msgr2=0x7f7928105630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.975+0000 7f792fc81640 1 -- 172.21.15.135:0/2123076572 shutdown_connections 2024-04-20T12:34:16.975 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:16.975+0000 7f792fc81640 1 -- 172.21.15.135:0/2123076572 wait complete. 2024-04-20T12:34:16.989 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-20T12:34:17.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.096+0000 7f422fe6d640 1 -- 172.21.15.135:0/2860790570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42281031c0 msgr2=0x7f42281035a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:17.099 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.096+0000 7f422fe6d640 1 --2- 172.21.15.135:0/2860790570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42281031c0 0x7f42281035a0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f4224009900 tx=0x7f422402bcd0 comp rx=0 tx=0).stop 2024-04-20T12:34:17.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.096+0000 7f422fe6d640 1 -- 172.21.15.135:0/2860790570 shutdown_connections 2024-04-20T12:34:17.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.096+0000 7f422fe6d640 1 --2- 172.21.15.135:0/2860790570 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f422810c590 0x7f422810e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:17.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.096+0000 7f422fe6d640 1 --2- 172.21.15.135:0/2860790570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4228103ae0 0x7f422810bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:17.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.096+0000 7f422fe6d640 1 --2- 172.21.15.135:0/2860790570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42281031c0 0x7f42281035a0 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:17.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.096+0000 7f422fe6d640 1 -- 172.21.15.135:0/2860790570 >> 172.21.15.135:0/2860790570 conn(0x7f42280771e0 msgr2=0x7f42280775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:17.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.096+0000 7f422fe6d640 1 -- 172.21.15.135:0/2860790570 shutdown_connections 2024-04-20T12:34:17.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.096+0000 7f422fe6d640 1 -- 172.21.15.135:0/2860790570 wait complete. 2024-04-20T12:34:17.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.097+0000 7f422fe6d640 1 Processor -- start 2024-04-20T12:34:17.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.097+0000 7f422fe6d640 1 -- start start 2024-04-20T12:34:17.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.097+0000 7f422fe6d640 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42281031c0 0x7f422819e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:17.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.097+0000 7f422fe6d640 1 --2- >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4228103ae0 0x7f422819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:17.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.097+0000 7f422fe6d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f422810c590 0x7f4228198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:17.100 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.097+0000 7f422fe6d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4228112380 con 0x7f422810c590 2024-04-20T12:34:17.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.097+0000 7f422fe6d640 1 -- --> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] -- mon_getmap magic: 0 -- 0x7f4228112200 con 0x7f4228103ae0 2024-04-20T12:34:17.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.097+0000 7f422fe6d640 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 -- 0x7f4228112500 con 0x7f42281031c0 2024-04-20T12:34:17.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.097+0000 7f422e40a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f422810c590 0x7f4228198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:17.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.097+0000 7f422e40a640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f422810c590 0x7f4228198760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:55700/0 (socket says 172.21.15.135:55700) 2024-04-20T12:34:17.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.097+0000 7f422e40a640 1 -- 172.21.15.135:0/2288582377 learned_addr learned my addr 172.21.15.135:0/2288582377 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-04-20T12:34:17.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.097+0000 7f422dc09640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42281031c0 0x7f422819e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:17.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.097+0000 7f422d408640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4228103ae0 0x7f422819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:17.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.097+0000 7f422e40a640 1 -- 172.21.15.135:0/2288582377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42281031c0 msgr2=0x7f422819e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:17.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.098+0000 7f422e40a640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42281031c0 0x7f422819e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:17.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.098+0000 7f422e40a640 1 -- 172.21.15.135:0/2288582377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4228103ae0 msgr2=0x7f422819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:17.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.098+0000 7f422e40a640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4228103ae0 0x7f422819ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:17.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.098+0000 7f422e40a640 1 -- 172.21.15.135:0/2288582377 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4228199020 con 0x7f422810c590 2024-04-20T12:34:17.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.098+0000 7f422dc09640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42281031c0 0x7f422819e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T12:34:17.101 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.098+0000 7f422d408640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4228103ae0 0x7f422819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T12:34:17.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.098+0000 7f422e40a640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f422810c590 0x7f4228198760 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f422000cab0 tx=0x7f422000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:17.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.098+0000 7f421effd640 1 -- 172.21.15.135:0/2288582377 <== mon.0 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422000ae20 con 0x7f422810c590 2024-04-20T12:34:17.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.098+0000 7f422fe6d640 1 -- 172.21.15.135:0/2288582377 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4228199310 con 0x7f422810c590 2024-04-20T12:34:17.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.098+0000 7f421effd640 1 -- 172.21.15.135:0/2288582377 <== mon.0 v2:172.21.15.135:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f422000f930 con 0x7f422810c590 2024-04-20T12:34:17.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.098+0000 7f421effd640 1 -- 172.21.15.135:0/2288582377 <== mon.0 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4220018b80 con 0x7f422810c590 2024-04-20T12:34:17.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.098+0000 7f422fe6d640 1 -- 172.21.15.135:0/2288582377 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42281a5620 con 0x7f422810c590 2024-04-20T12:34:17.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.099+0000 7f422fe6d640 1 -- 172.21.15.135:0/2288582377 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4228069e10 con 0x7f422810c590 2024-04-20T12:34:17.102 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.100+0000 7f421effd640 1 -- 172.21.15.135:0/2288582377 <== mon.0 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 26) ==== 138778+0+0 (secure 0 0 0) 0x7f422000fae0 con 0x7f422810c590 2024-04-20T12:34:17.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.101+0000 7f421effd640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f42140a3d20 0x7f42140a61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T12:34:17.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.101+0000 7f422dc09640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f42140a3d20 0x7f42140a61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T12:34:17.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.101+0000 7f421effd640 1 -- 172.21.15.135:0/2288582377 <== mon.0 v2:172.21.15.135:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8754+0+0 (secure 0 0 0) 0x7f42200d10c0 con 0x7f422810c590 2024-04-20T12:34:17.103 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.101+0000 7f422dc09640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f42140a3d20 0x7f42140a61e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4224006010 tx=0x7f422402cf90 comp rx=0 tx=0).ready entity=mgr.25093 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T12:34:17.105 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.105+0000 7f421effd640 1 -- 172.21.15.135:0/2288582377 <== mon.0 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188381 (secure 0 0 0) 0x7f4220014030 con 0x7f422810c590 2024-04-20T12:34:17.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:16 smithi154 ceph-mon[22073]: pgmap v348: 129 pgs: 129 active+clean; 12 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.0 KiB/s wr, 15 op/s 2024-04-20T12:34:17.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:16 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2363331937' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-20T12:34:17.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:16 smithi154 ceph-mon[22073]: osdmap e107: 12 total, 12 up, 12 in 2024-04-20T12:34:17.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:16 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2123076572' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-20T12:34:17.283 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.284+0000 7f422fe6d640 1 -- 172.21.15.135:0/2288582377 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4228107680 con 0x7f422810c590 2024-04-20T12:34:17.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:16 smithi139 ceph-mon[21834]: pgmap v348: 129 pgs: 129 active+clean; 12 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.0 KiB/s wr, 15 op/s 2024-04-20T12:34:17.329 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:16 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2363331937' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-20T12:34:17.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:16 smithi139 ceph-mon[21834]: osdmap e107: 12 total, 12 up, 12 in 2024-04-20T12:34:17.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:16 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2123076572' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-20T12:34:17.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:16 smithi135 ceph-mon[18264]: pgmap v348: 129 pgs: 129 active+clean; 12 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 1.0 KiB/s wr, 15 op/s 2024-04-20T12:34:17.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:16 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2363331937' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-04-20T12:34:17.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:16 smithi135 ceph-mon[18264]: osdmap e107: 12 total, 12 up, 12 in 2024-04-20T12:34:17.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:16 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2123076572' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-20T12:34:17.979 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.977+0000 7f421effd640 1 -- 172.21.15.135:0/2288582377 <== mon.0 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v109) ==== 178+0+0 (secure 0 0 0) 0x7f422009d670 con 0x7f422810c590 2024-04-20T12:34:17.979 INFO:teuthology.orchestra.run.smithi135.stderr:pool 'cephfs_data_ec' removed 2024-04-20T12:34:17.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.980+0000 7f422fe6d640 1 -- 172.21.15.135:0/2288582377 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f42140a3d20 msgr2=0x7f42140a61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:17.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.980+0000 7f422fe6d640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f42140a3d20 0x7f42140a61e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4224006010 tx=0x7f422402cf90 comp rx=0 tx=0).stop 2024-04-20T12:34:17.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.980+0000 7f422fe6d640 1 -- 172.21.15.135:0/2288582377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f422810c590 msgr2=0x7f4228198760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T12:34:17.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.980+0000 7f422fe6d640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f422810c590 0x7f4228198760 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f422000cab0 tx=0x7f422000cf70 comp rx=0 tx=0).stop 2024-04-20T12:34:17.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.980+0000 7f422fe6d640 1 -- 172.21.15.135:0/2288582377 shutdown_connections 2024-04-20T12:34:17.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.980+0000 7f422fe6d640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f422810c590 0x7f4228198760 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:17.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.980+0000 7f422fe6d640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] conn(0x7f4228103ae0 0x7f422819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:17.980 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.980+0000 7f422fe6d640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.135:6800/15232286,v1:172.21.15.135:6801/15232286] conn(0x7f42140a3d20 0x7f42140a61e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:17.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.980+0000 7f422fe6d640 1 --2- 172.21.15.135:0/2288582377 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42281031c0 0x7f422819e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T12:34:17.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.980+0000 7f422fe6d640 1 -- 172.21.15.135:0/2288582377 >> 172.21.15.135:0/2288582377 conn(0x7f42280771e0 msgr2=0x7f42280ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T12:34:17.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.980+0000 7f422fe6d640 1 -- 172.21.15.135:0/2288582377 shutdown_connections 2024-04-20T12:34:17.981 INFO:teuthology.orchestra.run.smithi135.stderr:2024-04-20T12:34:17.980+0000 7f422fe6d640 1 -- 172.21.15.135:0/2288582377 wait complete. 2024-04-20T12:34:17.996 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-20T12:34:18.022 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-20T12:34:18.054 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-20T12:34:18.086 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-20T12:34:18.086 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-20T12:34:18.102 DEBUG:teuthology.orchestra.run.smithi139:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-20T12:34:18.119 DEBUG:teuthology.orchestra.run.smithi154:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-20T12:34:18.143 INFO:tasks.cephadm:Stopping all daemons... 2024-04-20T12:34:18.143 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-04-20T12:34:18.143 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mon.a 2024-04-20T12:34:18.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:17 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2123076572' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-20T12:34:18.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:17 smithi154 ceph-mon[22073]: osdmap e108: 12 total, 12 up, 12 in 2024-04-20T12:34:18.251 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:17 smithi154 ceph-mon[22073]: from='client.? 172.21.15.135:0/2288582377' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-20T12:34:18.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:17 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2123076572' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-20T12:34:18.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:17 smithi139 ceph-mon[21834]: osdmap e108: 12 total, 12 up, 12 in 2024-04-20T12:34:18.330 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:17 smithi139 ceph-mon[21834]: from='client.? 172.21.15.135:0/2288582377' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-20T12:34:18.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:17 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2123076572' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-04-20T12:34:18.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:17 smithi135 ceph-mon[18264]: osdmap e108: 12 total, 12 up, 12 in 2024-04-20T12:34:18.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:17 smithi135 ceph-mon[18264]: from='client.? 172.21.15.135:0/2288582377' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-04-20T12:34:18.363 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:18 smithi135 systemd[1]: Stopping Ceph mon.a for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:34:18.791 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:18 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-a[18260]: 2024-04-20T12:34:18.473+0000 7f7b24458700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:34:18.791 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:18 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-a[18260]: 2024-04-20T12:34:18.473+0000 7f7b24458700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-04-20T12:34:18.791 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:18 smithi135 podman[87996]: 2024-04-20 12:34:18.494701221 +0000 UTC m=+0.159151369 container died a65046714468fb4b1a44c2b0e8a924c18e0bd2a7a117cbb4a713066265dbbbb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-20T12:34:19.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:18 smithi135 podman[87996]: 2024-04-20 12:34:18.967372749 +0000 UTC m=+0.631822897 container cleanup a65046714468fb4b1a44c2b0e8a924c18e0bd2a7a117cbb4a713066265dbbbb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-20T12:34:19.113 INFO:journalctl@ceph.mon.a.smithi135.stdout:Apr 20 12:34:18 smithi135 bash[87996]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-a 2024-04-20T12:34:19.435 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mon.a.service' 2024-04-20T12:34:19.481 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:34:19.481 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-04-20T12:34:19.481 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-04-20T12:34:19.481 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mon.b 2024-04-20T12:34:19.806 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:19 smithi139 systemd[1]: Stopping Ceph mon.b for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:34:20.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:19 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-b[21830]: 2024-04-20T12:34:19.807+0000 7f5ee6f28700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:34:20.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:19 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-b[21830]: 2024-04-20T12:34:19.807+0000 7f5ee6f28700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-04-20T12:34:20.080 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:19 smithi139 podman[57534]: 2024-04-20 12:34:19.848323831 +0000 UTC m=+0.160312958 container died e3d498ced670b170530ea9e4e99921a7192b7c38996e6b8d287f6ad02674ca1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T12:34:20.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:20 smithi139 podman[57534]: 2024-04-20 12:34:20.240909196 +0000 UTC m=+0.552898331 container cleanup e3d498ced670b170530ea9e4e99921a7192b7c38996e6b8d287f6ad02674ca1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416) 2024-04-20T12:34:20.499 INFO:journalctl@ceph.mon.b.smithi139.stdout:Apr 20 12:34:20 smithi139 bash[57534]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-b 2024-04-20T12:34:20.665 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mon.b.service' 2024-04-20T12:34:20.706 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:34:20.706 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-04-20T12:34:20.706 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-04-20T12:34:20.706 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mon.c 2024-04-20T12:34:21.001 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:20 smithi154 systemd[1]: Stopping Ceph mon.c for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:34:21.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:21 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-c[22060]: 2024-04-20T12:34:21.004+0000 7f3ca5f4f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:34:21.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:21 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-c[22060]: 2024-04-20T12:34:21.004+0000 7f3ca5f4f700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-04-20T12:34:21.496 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:21 smithi154 podman[58061]: 2024-04-20 12:34:21.229550066 +0000 UTC m=+0.339682479 container died efa34d747380206a0ed449e76c252323c3906321f488877da4d64ebe4f96e1b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:34:21.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:21 smithi154 podman[58061]: 2024-04-20 12:34:21.597135874 +0000 UTC m=+0.707268280 container cleanup efa34d747380206a0ed449e76c252323c3906321f488877da4d64ebe4f96e1b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, CEPH_POINT_RELEASE=) 2024-04-20T12:34:21.751 INFO:journalctl@ceph.mon.c.smithi154.stdout:Apr 20 12:34:21 smithi154 bash[58061]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mon-c 2024-04-20T12:34:21.976 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mon.c.service' 2024-04-20T12:34:22.023 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:34:22.024 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-04-20T12:34:22.024 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-04-20T12:34:22.024 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.x 2024-04-20T12:34:22.350 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:34:22 smithi135 systemd[1]: Stopping Ceph mgr.x for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:34:22.613 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:34:22 smithi135 podman[88204]: 2024-04-20 12:34:22.354514275 +0000 UTC m=+0.142063806 container died 9b7af0bd19de78b6b0c119cd0666f45add2bc17392aaf783d979e6fc9464dbda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5) 2024-04-20T12:34:23.012 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:34:22 smithi135 podman[88204]: 2024-04-20 12:34:22.775387097 +0000 UTC m=+0.562936628 container cleanup 9b7af0bd19de78b6b0c119cd0666f45add2bc17392aaf783d979e6fc9464dbda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a8c84f5997950fd7d008204839253291d52e6eda, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-20T12:34:23.012 INFO:journalctl@ceph.mgr.x.smithi135.stdout:Apr 20 12:34:22 smithi135 bash[88204]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-x 2024-04-20T12:34:23.223 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.x.service' 2024-04-20T12:34:23.258 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:34:23.258 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-04-20T12:34:23.258 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-04-20T12:34:23.259 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.y 2024-04-20T12:34:23.579 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:34:23 smithi139 systemd[1]: Stopping Ceph mgr.y for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:34:23.878 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:34:23 smithi139 podman[57744]: 2024-04-20 12:34:23.592400701 +0000 UTC m=+0.145278175 container died e48f990b6de0df804961fa78c4a2912676e88b99a0712a68cba71d1938fcd485 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5) 2024-04-20T12:34:24.255 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:34:23 smithi139 podman[57744]: 2024-04-20 12:34:23.988084607 +0000 UTC m=+0.540962082 container cleanup e48f990b6de0df804961fa78c4a2912676e88b99a0712a68cba71d1938fcd485 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T12:34:24.255 INFO:journalctl@ceph.mgr.y.smithi139.stdout:Apr 20 12:34:23 smithi139 bash[57744]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-y 2024-04-20T12:34:24.407 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.y.service' 2024-04-20T12:34:24.441 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:34:24.441 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-04-20T12:34:24.441 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-04-20T12:34:24.441 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.z 2024-04-20T12:34:24.751 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:34:24 smithi154 systemd[1]: Stopping Ceph mgr.z for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:34:25.227 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:34:24 smithi154 podman[58184]: 2024-04-20 12:34:24.924817581 +0000 UTC m=+0.286368983 container died c3d765456a4bccc8c097f366e2041eaa519f3646c4b69c8c01da25df2f40c6c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-04-20T12:34:25.501 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:34:25 smithi154 podman[58184]: 2024-04-20 12:34:25.327747516 +0000 UTC m=+0.689298905 container cleanup c3d765456a4bccc8c097f366e2041eaa519f3646c4b69c8c01da25df2f40c6c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , ceph=True) 2024-04-20T12:34:25.501 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:34:25 smithi154 bash[58184]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z 2024-04-20T12:34:25.751 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.z.service' 2024-04-20T12:34:25.771 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:34:25 smithi154 podman[58199]: 2024-04-20 12:34:25.512744367 +0000 UTC m=+0.577532627 container remove c3d765456a4bccc8c097f366e2041eaa519f3646c4b69c8c01da25df2f40c6c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0) 2024-04-20T12:34:25.771 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:34:25 smithi154 systemd[1]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-04-20T12:34:25.771 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:34:25 smithi154 systemd[1]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-04-20T12:34:25.771 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:34:25 smithi154 systemd[1]: Stopped Ceph mgr.z for 22180be8-ff0f-11ee-bc92-c7b262605968. 2024-04-20T12:34:25.772 INFO:journalctl@ceph.mgr.z.smithi154.stdout:Apr 20 12:34:25 smithi154 systemd[1]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mgr.z.service: Consumed 20.439s CPU time. 2024-04-20T12:34:25.785 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:34:25.785 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-04-20T12:34:25.785 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-20T12:34:25.786 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.0 2024-04-20T12:34:26.108 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:34:25 smithi135 systemd[1]: Stopping Ceph osd.0 for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:34:26.363 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:34:26 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-0[30636]: 2024-04-20T12:34:26.108+0000 7f35ebf51700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:34:26.363 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:34:26 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-0[30636]: 2024-04-20T12:34:26.108+0000 7f35ebf51700 -1 osd.0 109 *** Got signal Terminated *** 2024-04-20T12:34:26.363 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:34:26 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-0[30636]: 2024-04-20T12:34:26.108+0000 7f35ebf51700 -1 osd.0 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T12:34:31.934 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:34:31 smithi135 podman[88325]: 2024-04-20 12:34:31.630190856 +0000 UTC m=+5.647969043 container died bc8997c53f435c9b9d8a6445cc749210ef3624f7ec13f0d9b5c048716b5c862e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T12:34:32.286 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:34:32 smithi135 podman[88325]: 2024-04-20 12:34:32.034643955 +0000 UTC m=+6.052422139 container cleanup bc8997c53f435c9b9d8a6445cc749210ef3624f7ec13f0d9b5c048716b5c862e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-20T12:34:32.286 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:34:32 smithi135 bash[88325]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-0 2024-04-20T12:34:32.613 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:34:32 smithi135 podman[88341]: 2024-04-20 12:34:32.28741493 +0000 UTC m=+0.659052021 container remove bc8997c53f435c9b9d8a6445cc749210ef3624f7ec13f0d9b5c048716b5c862e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True) 2024-04-20T12:34:32.999 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:34:32 smithi135 podman[88431]: 2024-04-20 12:34:32.626373996 +0000 UTC m=+0.018130224 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:34:32.999 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:34:32 smithi135 podman[88431]: 2024-04-20 12:34:32.739099101 +0000 UTC m=+0.130855301 container create 71e68ad0c31950417c4ac9bcfcfe1b4fe4e10250f977a0b234025d61d840f499 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416) 2024-04-20T12:34:32.999 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:34:33 smithi135 podman[88431]: 2024-04-20 12:34:33.000666214 +0000 UTC m=+0.392422435 container init 71e68ad0c31950417c4ac9bcfcfe1b4fe4e10250f977a0b234025d61d840f499 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True) 2024-04-20T12:34:33.295 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:34:33 smithi135 podman[88431]: 2024-04-20 12:34:33.003832442 +0000 UTC m=+0.395588642 container start 71e68ad0c31950417c4ac9bcfcfe1b4fe4e10250f977a0b234025d61d840f499 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-0-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-20T12:34:33.295 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:34:33 smithi135 podman[88431]: 2024-04-20 12:34:33.101140779 +0000 UTC m=+0.492896995 container attach 71e68ad0c31950417c4ac9bcfcfe1b4fe4e10250f977a0b234025d61d840f499 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-0-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T12:34:33.603 INFO:journalctl@ceph.osd.0.smithi135.stdout:Apr 20 12:34:33 smithi135 podman[88431]: 2024-04-20 12:34:33.29695307 +0000 UTC m=+0.688709289 container died 71e68ad0c31950417c4ac9bcfcfe1b4fe4e10250f977a0b234025d61d840f499 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-20T12:34:33.955 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.0.service' 2024-04-20T12:34:33.993 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:34:33.993 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-20T12:34:33.994 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-20T12:34:33.994 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.1 2024-04-20T12:34:34.316 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:34:34 smithi139 systemd[1]: Stopping Ceph osd.1 for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:34:34.579 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:34:34 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-1[26426]: 2024-04-20T12:34:34.316+0000 7f44ffd92700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:34:34.579 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:34:34 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-1[26426]: 2024-04-20T12:34:34.316+0000 7f44ffd92700 -1 osd.1 109 *** Got signal Terminated *** 2024-04-20T12:34:34.579 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:34:34 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-1[26426]: 2024-04-20T12:34:34.316+0000 7f44ffd92700 -1 osd.1 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T12:34:39.934 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:34:39 smithi139 podman[57882]: 2024-04-20 12:34:39.634002815 +0000 UTC m=+5.439164677 container died 7ac513334d58ee44946eceaa4287af52009f27897c1a26871c320a3c10acf43b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-04-20T12:34:40.292 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:34:40 smithi139 podman[57882]: 2024-04-20 12:34:40.000696785 +0000 UTC m=+5.805858655 container cleanup 7ac513334d58ee44946eceaa4287af52009f27897c1a26871c320a3c10acf43b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:34:40.293 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:34:40 smithi139 bash[57882]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-1 2024-04-20T12:34:40.579 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:34:40 smithi139 podman[57900]: 2024-04-20 12:34:40.293827011 +0000 UTC m=+0.656702601 container remove 7ac513334d58ee44946eceaa4287af52009f27897c1a26871c320a3c10acf43b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-1, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-20T12:34:40.862 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:34:40 smithi139 podman[57993]: 2024-04-20 12:34:40.611413436 +0000 UTC m=+0.106879956 container create bd07894b257d0a19ffd4305814e16916e9039dc5febaf564c596de476a12b99e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-20T12:34:40.863 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:34:40 smithi139 podman[57993]: 2024-04-20 12:34:40.522335217 +0000 UTC m=+0.017801765 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:34:41.153 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:34:40 smithi139 podman[57993]: 2024-04-20 12:34:40.864335842 +0000 UTC m=+0.359802371 container init bd07894b257d0a19ffd4305814e16916e9039dc5febaf564c596de476a12b99e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-20T12:34:41.154 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:34:40 smithi139 podman[57993]: 2024-04-20 12:34:40.867453149 +0000 UTC m=+0.362919677 container start bd07894b257d0a19ffd4305814e16916e9039dc5febaf564c596de476a12b99e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-1-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T12:34:41.154 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:34:40 smithi139 podman[57993]: 2024-04-20 12:34:40.947667843 +0000 UTC m=+0.443134364 container attach bd07894b257d0a19ffd4305814e16916e9039dc5febaf564c596de476a12b99e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-20T12:34:41.431 INFO:journalctl@ceph.osd.1.smithi139.stdout:Apr 20 12:34:41 smithi139 podman[57993]: 2024-04-20 12:34:41.15518443 +0000 UTC m=+0.650650955 container died bd07894b257d0a19ffd4305814e16916e9039dc5febaf564c596de476a12b99e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-04-20T12:34:41.817 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.1.service' 2024-04-20T12:34:41.854 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:34:41.854 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-20T12:34:41.854 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-20T12:34:41.855 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.2 2024-04-20T12:34:42.251 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:34:41 smithi154 systemd[1]: Stopping Ceph osd.2 for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:34:42.751 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:34:42 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-2[27191]: 2024-04-20T12:34:42.282+0000 7f89b6ddb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:34:42.751 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:34:42 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-2[27191]: 2024-04-20T12:34:42.282+0000 7f89b6ddb700 -1 osd.2 109 *** Got signal Terminated *** 2024-04-20T12:34:42.751 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:34:42 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-2[27191]: 2024-04-20T12:34:42.282+0000 7f89b6ddb700 -1 osd.2 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T12:34:47.915 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:34:47 smithi154 podman[58323]: 2024-04-20 12:34:47.612113698 +0000 UTC m=+5.564589469 container died 46180f48b57b378f53ce0348516a1afedd79d4a8ade71b86faf66865d02d88ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-20T12:34:48.251 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:34:47 smithi154 podman[58323]: 2024-04-20 12:34:47.917206145 +0000 UTC m=+5.869681920 container cleanup 46180f48b57b378f53ce0348516a1afedd79d4a8ade71b86faf66865d02d88ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240416, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:34:48.251 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:34:47 smithi154 bash[58323]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-2 2024-04-20T12:34:48.251 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:34:48 smithi154 podman[58340]: 2024-04-20 12:34:48.144128455 +0000 UTC m=+0.529285506 container remove 46180f48b57b378f53ce0348516a1afedd79d4a8ade71b86faf66865d02d88ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-20T12:34:48.846 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:34:48 smithi154 podman[58427]: 2024-04-20 12:34:48.483790966 +0000 UTC m=+0.017332316 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:34:48.847 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:34:48 smithi154 podman[58427]: 2024-04-20 12:34:48.588529449 +0000 UTC m=+0.122070789 container create a60bf39dd36189f4c50e4228b6479944cdde6b63644e7117ffe1462ab7a026e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-2-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-20T12:34:48.847 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:34:48 smithi154 podman[58427]: 2024-04-20 12:34:48.848070574 +0000 UTC m=+0.381611917 container init a60bf39dd36189f4c50e4228b6479944cdde6b63644e7117ffe1462ab7a026e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS) 2024-04-20T12:34:49.143 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:34:48 smithi154 podman[58427]: 2024-04-20 12:34:48.851421315 +0000 UTC m=+0.384962658 container start a60bf39dd36189f4c50e4228b6479944cdde6b63644e7117ffe1462ab7a026e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-04-20T12:34:49.143 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:34:48 smithi154 podman[58427]: 2024-04-20 12:34:48.948457511 +0000 UTC m=+0.481998845 container attach a60bf39dd36189f4c50e4228b6479944cdde6b63644e7117ffe1462ab7a026e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5) 2024-04-20T12:34:49.413 INFO:journalctl@ceph.osd.2.smithi154.stdout:Apr 20 12:34:49 smithi154 podman[58427]: 2024-04-20 12:34:49.144545844 +0000 UTC m=+0.678087179 container died a60bf39dd36189f4c50e4228b6479944cdde6b63644e7117ffe1462ab7a026e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-2-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-20T12:34:49.795 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.2.service' 2024-04-20T12:34:49.834 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:34:49.834 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-20T12:34:49.834 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-20T12:34:49.834 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.3 2024-04-20T12:34:50.113 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:34:49 smithi135 systemd[1]: Stopping Ceph osd.3 for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:34:50.374 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:34:50 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-3[37160]: 2024-04-20T12:34:50.151+0000 7f1cb5392700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:34:50.374 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:34:50 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-3[37160]: 2024-04-20T12:34:50.151+0000 7f1cb5392700 -1 osd.3 109 *** Got signal Terminated *** 2024-04-20T12:34:50.374 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:34:50 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-3[37160]: 2024-04-20T12:34:50.151+0000 7f1cb5392700 -1 osd.3 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T12:34:53.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:34:53 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:34:53.422+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:34:54.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:34:53 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:34:53.662+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:34:54.652 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:34:54 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:34:54.394+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:34:54.652 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:34:54 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:34:54.321+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:34:54.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:34:54 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:34:54.506+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:34:55.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:34:54 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:34:54.683+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:34:55.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:34:55 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:34:55.415+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:34:55.751 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:34:55 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:34:55.297+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:34:55.821 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:34:55 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:34:55.500+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:34:55.827 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:34:55 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:34:55.652+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:34:55.827 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:34:55 smithi135 podman[88538]: 2024-04-20 12:34:55.532765612 +0000 UTC m=+5.507866666 container died 5b65a4c893dd50c592c1fdab495e7b28ba96ca0e1bb5d299b3cd9789a51bc0bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-3, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5) 2024-04-20T12:34:56.113 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:34:55 smithi135 podman[88538]: 2024-04-20 12:34:55.919764072 +0000 UTC m=+5.894865121 container cleanup 5b65a4c893dd50c592c1fdab495e7b28ba96ca0e1bb5d299b3cd9789a51bc0bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-3, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-20T12:34:56.113 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:34:55 smithi135 bash[88538]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-3 2024-04-20T12:34:56.537 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:34:56 smithi135 podman[88569]: 2024-04-20 12:34:56.22093038 +0000 UTC m=+0.691777961 container remove 5b65a4c893dd50c592c1fdab495e7b28ba96ca0e1bb5d299b3cd9789a51bc0bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-3, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416) 2024-04-20T12:34:56.751 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:34:56 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:34:56.332+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:34:56.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:34:56 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:34:56.400+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:34:56.791 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:34:56 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:34:56.629+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:34:56.791 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:34:56 smithi135 podman[88661]: 2024-04-20 12:34:56.441424663 +0000 UTC m=+0.018180438 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:34:56.791 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:34:56 smithi135 podman[88661]: 2024-04-20 12:34:56.564526006 +0000 UTC m=+0.141281763 container create 03a67582d42e94d3b6915f04753e5f16954db3f27210d1e118c6ee5aac8d6aa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240416) 2024-04-20T12:34:56.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:34:56 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:34:56.530+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:34:57.087 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:34:56 smithi135 podman[88661]: 2024-04-20 12:34:56.792619548 +0000 UTC m=+0.369375306 container init 03a67582d42e94d3b6915f04753e5f16954db3f27210d1e118c6ee5aac8d6aa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240416) 2024-04-20T12:34:57.087 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:34:56 smithi135 podman[88661]: 2024-04-20 12:34:56.795885643 +0000 UTC m=+0.372641404 container start 03a67582d42e94d3b6915f04753e5f16954db3f27210d1e118c6ee5aac8d6aa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416) 2024-04-20T12:34:57.087 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:34:56 smithi135 podman[88661]: 2024-04-20 12:34:56.901383222 +0000 UTC m=+0.478138983 container attach 03a67582d42e94d3b6915f04753e5f16954db3f27210d1e118c6ee5aac8d6aa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True) 2024-04-20T12:34:57.363 INFO:journalctl@ceph.osd.3.smithi135.stdout:Apr 20 12:34:57 smithi135 podman[88661]: 2024-04-20 12:34:57.088542981 +0000 UTC m=+0.665298749 container died 03a67582d42e94d3b6915f04753e5f16954db3f27210d1e118c6ee5aac8d6aa8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416) 2024-04-20T12:34:57.722 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.3.service' 2024-04-20T12:34:57.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:34:57 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:34:57.425+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:34:57.751 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:34:57 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:34:57.286+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:34:57.760 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:34:57.760 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-20T12:34:57.760 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-20T12:34:57.760 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.4 2024-04-20T12:34:57.829 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:34:57 smithi139 systemd[1]: Stopping Ceph osd.4 for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:34:57.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:34:57 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:34:57.575+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:34:58.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:34:57 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:34:57.658+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:34:58.329 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:34:58 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4[33080]: 2024-04-20T12:34:58.079+0000 7fc862f33700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:34:58.329 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:34:58 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4[33080]: 2024-04-20T12:34:58.080+0000 7fc862f33700 -1 osd.4 109 *** Got signal Terminated *** 2024-04-20T12:34:58.329 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:34:58 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4[33080]: 2024-04-20T12:34:58.080+0000 7fc862f33700 -1 osd.4 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T12:34:58.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:34:58 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:34:58.467+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:34:58.751 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:34:58 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:34:58.277+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:34:58.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:34:58 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:34:58.610+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:34:59.079 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:34:58 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:34:58.619+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:34:59.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:34:59 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:34:59.449+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:34:59.751 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:34:59 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:34:59.252+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:34:59.982 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:34:59 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:34:59.608+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:00.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:34:59 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:34:59.622+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:00.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:34:59 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:34:59.983+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:00.490 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:00 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:00.203+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:35:00.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:00 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:00.491+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:00.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:00 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:00.582+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:01.027 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:35:00 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4[33080]: 2024-04-20T12:35:00.883+0000 7fc85b51f700 -1 osd.4 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:34.885698+0000 front 2024-04-20T12:34:34.885667+0000 (oldest deadline 2024-04-20T12:35:00.785794+0000) 2024-04-20T12:35:01.028 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:00 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:00.641+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:01.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:01 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:01.028+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:01.461 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:01 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:01.209+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:35:01.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:01 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:01.462+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:01.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:01 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:01.570+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:01.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:01 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:01.570+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:01.873 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:01 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:01.624+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:02.329 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:35:01 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4[33080]: 2024-04-20T12:35:01.874+0000 7fc85b51f700 -1 osd.4 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:34.885698+0000 front 2024-04-20T12:34:34.885667+0000 (oldest deadline 2024-04-20T12:35:00.785794+0000) 2024-04-20T12:35:02.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:02 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:02.007+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:02.481 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:02 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:02.208+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:35:02.753 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:02 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:02.482+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:02.847 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:02 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:02.590+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:02.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:02 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:02.586+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:02.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:02 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:02.586+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:03.192 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:02 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:02.815+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:03.329 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:35:02 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4[33080]: 2024-04-20T12:35:02.848+0000 7fc85b51f700 -1 osd.4 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:34.885698+0000 front 2024-04-20T12:34:34.885667+0000 (oldest deadline 2024-04-20T12:35:00.785794+0000) 2024-04-20T12:35:03.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:02 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:02.978+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:03.489 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:03 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:03.193+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:35:03.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:03 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:03.490+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:03.905 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:03 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:03.612+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:03.905 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:35:03 smithi139 podman[58122]: 2024-04-20 12:35:03.598705286 +0000 UTC m=+5.640594531 container died 676b4eb81c2b71a6cfebdf97ab4d539943572983520bf7ebfdfecb5bd4157a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416) 2024-04-20T12:35:04.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:03 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:03.616+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:04.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:03 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:03.616+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:04.213 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:03 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:03.792+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:04.238 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:03 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:03.957+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:04.239 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:35:04 smithi139 podman[58122]: 2024-04-20 12:35:04.029987384 +0000 UTC m=+6.071876627 container cleanup 676b4eb81c2b71a6cfebdf97ab4d539943572983520bf7ebfdfecb5bd4157a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-04-20T12:35:04.239 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:35:04 smithi139 bash[58122]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4 2024-04-20T12:35:04.500 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:04 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:04.214+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:35:04.579 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:35:04 smithi139 podman[58139]: 2024-04-20 12:35:04.23972516 +0000 UTC m=+0.634463059 container remove 676b4eb81c2b71a6cfebdf97ab4d539943572983520bf7ebfdfecb5bd4157a40 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-04-20T12:35:04.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:04 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:04.501+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:04.863 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:04 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:04.423+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:04.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:04 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:04.647+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:04.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:04 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:04.647+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:04.891 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:04 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:04.614+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:04.892 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:04 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:04.614+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:04.892 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:35:04 smithi139 podman[58229]: 2024-04-20 12:35:04.551127878 +0000 UTC m=+0.017913985 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:35:04.892 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:35:04 smithi139 podman[58229]: 2024-04-20 12:35:04.657353134 +0000 UTC m=+0.124139269 container create 6db0de64bcd4de570b49e76e0af526f466def66dce72a510d5042a51375bc912 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-20T12:35:05.180 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:05 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:05.003+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:05.181 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:35:04 smithi139 podman[58229]: 2024-04-20 12:35:04.893157395 +0000 UTC m=+0.359943485 container init 6db0de64bcd4de570b49e76e0af526f466def66dce72a510d5042a51375bc912 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416) 2024-04-20T12:35:05.181 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:35:04 smithi139 podman[58229]: 2024-04-20 12:35:04.896740036 +0000 UTC m=+0.363526126 container start 6db0de64bcd4de570b49e76e0af526f466def66dce72a510d5042a51375bc912 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:35:05.181 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:35:04 smithi139 podman[58229]: 2024-04-20 12:35:04.968082986 +0000 UTC m=+0.434869078 container attach 6db0de64bcd4de570b49e76e0af526f466def66dce72a510d5042a51375bc912 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T12:35:05.200 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:04 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:04.768+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:05.469 INFO:journalctl@ceph.osd.4.smithi139.stdout:Apr 20 12:35:05 smithi139 podman[58229]: 2024-04-20 12:35:05.181923636 +0000 UTC m=+0.648709735 container died 6db0de64bcd4de570b49e76e0af526f466def66dce72a510d5042a51375bc912 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-4-deactivate, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-20T12:35:05.476 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:05 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:05.201+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:35:05.476 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:05 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:05.201+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.135744+0000 front 2024-04-20T12:34:39.135667+0000 (oldest deadline 2024-04-20T12:35:05.035611+0000) 2024-04-20T12:35:05.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:05 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:05.477+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:05.779 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:05 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:05.636+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:05.779 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:05 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:05.636+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:05.802 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.4.service' 2024-04-20T12:35:05.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:35:05.842 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-20T12:35:05.842 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-20T12:35:05.842 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.5 2024-04-20T12:35:05.863 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:05 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:05.419+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:05.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:05 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:05.659+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:05.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:05 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:05.659+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:06.155 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:05 smithi154 systemd[1]: Stopping Ceph osd.5 for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:35:06.155 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:05 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:05.792+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:06.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:06 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:06.049+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:06.453 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:06 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:06.155+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:35:06.454 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:06 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:06.155+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.135744+0000 front 2024-04-20T12:34:39.135667+0000 (oldest deadline 2024-04-20T12:35:05.035611+0000) 2024-04-20T12:35:06.454 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:06 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:06.389+0000 7f4ea6800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:35:06.454 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:06 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:06.389+0000 7f4ea6800700 -1 osd.5 109 *** Got signal Terminated *** 2024-04-20T12:35:06.454 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:06 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:06.389+0000 7f4ea6800700 -1 osd.5 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T12:35:06.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:06 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:06.454+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:06.863 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:06 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:06.389+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:06.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:06 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:06.627+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:06.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:06 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:06.627+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:07.046 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:06 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:06.682+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:07.047 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:06 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:06.682+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:07.188 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:06 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:06.792+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:07.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:07 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:07.047+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:07.484 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:07 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:07.189+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:35:07.484 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:07 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:07.189+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.135744+0000 front 2024-04-20T12:34:39.135667+0000 (oldest deadline 2024-04-20T12:35:05.035611+0000) 2024-04-20T12:35:07.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:07 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:07.485+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:07.863 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:07.411+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:07.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:07.585+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:07.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:07.585+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:08.079 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:07 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:07.649+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:08.079 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:07 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:07.649+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:08.182 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:07 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:07.767+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:08.501 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:08 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:08.183+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:35:08.501 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:08 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:08.183+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.135744+0000 front 2024-04-20T12:34:39.135667+0000 (oldest deadline 2024-04-20T12:35:05.035611+0000) 2024-04-20T12:35:08.579 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:08 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:08.092+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:08.863 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:08.374+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:08.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:08.621+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:08.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:08 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:08.621+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:09.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:08 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:08.771+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:09.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:08 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:08.771+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:09.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:08 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:08.534+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:09.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:08 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:08.534+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:09.079 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:08 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:08.626+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:09.079 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:08 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:08.626+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:09.501 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:09 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:09.159+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:35:09.501 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:09 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:09.159+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.135744+0000 front 2024-04-20T12:34:39.135667+0000 (oldest deadline 2024-04-20T12:35:05.035611+0000) 2024-04-20T12:35:09.582 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:09 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:09.089+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:09.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:09 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:09.334+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:09.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:09 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:09.334+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.599779+0000 front 2024-04-20T12:34:43.599618+0000 (oldest deadline 2024-04-20T12:35:08.899677+0000) 2024-04-20T12:35:10.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:09 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:09.578+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:10.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:09 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:09.578+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:10.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:09 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:09.763+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:10.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:09 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:09.763+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:10.070 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:09 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:09.599+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:10.070 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:09 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:09.599+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:10.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:09 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:09.614+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:10.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:09 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:09.614+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:10.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:10 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:10.071+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:10.501 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:10 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:10.181+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:35:10.501 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:10 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:10.181+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.135744+0000 front 2024-04-20T12:34:39.135667+0000 (oldest deadline 2024-04-20T12:35:05.035611+0000) 2024-04-20T12:35:10.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:10 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:10.346+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:10.614 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:10 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:10.346+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.599779+0000 front 2024-04-20T12:34:43.599618+0000 (oldest deadline 2024-04-20T12:35:08.899677+0000) 2024-04-20T12:35:10.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:10 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:10.579+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:10.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:10 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:10.579+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:11.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:10 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:10.561+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:11.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:10 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:10.561+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:11.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:10 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:10.767+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:11.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:10 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:10.767+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:11.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:10 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:10.650+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:11.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:10 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:10.650+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:11.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:11 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:11.078+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:11.501 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:11 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:11.169+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:27.934449+0000 front 2024-04-20T12:34:27.934387+0000 (oldest deadline 2024-04-20T12:34:53.834454+0000) 2024-04-20T12:35:11.501 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:11 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5[34140]: 2024-04-20T12:35:11.169+0000 7f4e9edec700 -1 osd.5 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.135744+0000 front 2024-04-20T12:34:39.135667+0000 (oldest deadline 2024-04-20T12:35:05.035611+0000) 2024-04-20T12:35:11.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:11 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:11.307+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:11.614 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:11 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:11.307+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.599779+0000 front 2024-04-20T12:34:43.599618+0000 (oldest deadline 2024-04-20T12:35:08.899677+0000) 2024-04-20T12:35:11.911 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:11 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:11.735+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:11.911 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:11 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:11.735+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:11.911 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:11 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:11.576+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:11.911 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:11 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:11.576+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:12.031 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:11 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:11.598+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:12.032 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:11 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:11.598+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:12.032 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:11 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:11.598+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:12.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:11 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:11.677+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:12.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:11 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:11.677+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:12.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:11 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:11.677+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:12.217 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:11 smithi154 podman[58546]: 2024-04-20 12:35:11.911477154 +0000 UTC m=+5.870008321 container died 6b4491bd02d0fff67344823c9ec76351dd6ddf3376f96edab6319c894fe24c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-20T12:35:12.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:12 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:12.031+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:12.501 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:12 smithi154 podman[58546]: 2024-04-20 12:35:12.308085418 +0000 UTC m=+6.266616626 container cleanup 6b4491bd02d0fff67344823c9ec76351dd6ddf3376f96edab6319c894fe24c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-04-20T12:35:12.501 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:12 smithi154 bash[58546]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5 2024-04-20T12:35:12.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:12 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:12.309+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:12.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:12 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:12.309+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.599779+0000 front 2024-04-20T12:34:43.599618+0000 (oldest deadline 2024-04-20T12:35:08.899677+0000) 2024-04-20T12:35:12.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:12 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:12.566+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:12.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:12 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:12.566+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:12.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:12 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:12.566+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:12.885 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:12 smithi154 podman[58563]: 2024-04-20 12:35:12.567846624 +0000 UTC m=+0.655156991 container remove 6b4491bd02d0fff67344823c9ec76351dd6ddf3376f96edab6319c894fe24c1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:35:12.885 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:12 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:12.763+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:12.885 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:12 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:12.763+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:12.886 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:12 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:12.589+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:12.886 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:12 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:12.589+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:13.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:12 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:12.682+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:13.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:12 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:12.682+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:13.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:12 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:12.682+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:13.187 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:12 smithi154 podman[58653]: 2024-04-20 12:35:12.788940575 +0000 UTC m=+0.018572560 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:35:13.187 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:12 smithi154 podman[58653]: 2024-04-20 12:35:12.92027447 +0000 UTC m=+0.149906500 container create fd10eee08dd75edea46e62fe70e14d52c154da69c19cf29e461d8b7476bafbb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416) 2024-04-20T12:35:13.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:12 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:12.984+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:13.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:12 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:12.984+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:45.051309+0000 front 2024-04-20T12:34:45.051504+0000 (oldest deadline 2024-04-20T12:35:12.651590+0000) 2024-04-20T12:35:13.481 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:13 smithi154 podman[58653]: 2024-04-20 12:35:13.188944396 +0000 UTC m=+0.418576381 container init fd10eee08dd75edea46e62fe70e14d52c154da69c19cf29e461d8b7476bafbb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T12:35:13.481 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:13 smithi154 podman[58653]: 2024-04-20 12:35:13.192341787 +0000 UTC m=+0.421973768 container start fd10eee08dd75edea46e62fe70e14d52c154da69c19cf29e461d8b7476bafbb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0) 2024-04-20T12:35:13.481 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:13 smithi154 podman[58653]: 2024-04-20 12:35:13.271863389 +0000 UTC m=+0.501495377 container attach fd10eee08dd75edea46e62fe70e14d52c154da69c19cf29e461d8b7476bafbb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2) 2024-04-20T12:35:13.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:13 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:13.265+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:13.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:13 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:13.265+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.599779+0000 front 2024-04-20T12:34:43.599618+0000 (oldest deadline 2024-04-20T12:35:08.899677+0000) 2024-04-20T12:35:13.751 INFO:journalctl@ceph.osd.5.smithi154.stdout:Apr 20 12:35:13 smithi154 podman[58653]: 2024-04-20 12:35:13.482860092 +0000 UTC m=+0.712492064 container died fd10eee08dd75edea46e62fe70e14d52c154da69c19cf29e461d8b7476bafbb7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5) 2024-04-20T12:35:13.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:13 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:13.622+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:13.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:13 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:13.622+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:13.945 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:13 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:13.585+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:13.945 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:13 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:13.586+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:13.945 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:13 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:13.586+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:14.066 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:13 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:13.767+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:14.066 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:13 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:13.767+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:14.085 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.5.service' 2024-04-20T12:35:14.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:13 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:13.689+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:14.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:13 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:13.689+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:14.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:13 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:13.689+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:14.124 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:35:14.124 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-20T12:35:14.124 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-04-20T12:35:14.124 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.6 2024-04-20T12:35:14.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:13 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:13.945+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:14.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:13 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:13.945+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:45.051309+0000 front 2024-04-20T12:34:45.051504+0000 (oldest deadline 2024-04-20T12:35:12.651590+0000) 2024-04-20T12:35:14.434 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:14 smithi135 systemd[1]: Stopping Ceph osd.6 for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:35:14.434 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:14 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:14.242+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:14.434 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:14 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:14.242+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.599779+0000 front 2024-04-20T12:34:43.599618+0000 (oldest deadline 2024-04-20T12:35:08.899677+0000) 2024-04-20T12:35:14.434 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:14 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:14.434+0000 7fde3527c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:35:14.434 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:14 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:14.434+0000 7fde3527c700 -1 osd.6 109 *** Got signal Terminated *** 2024-04-20T12:35:14.434 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:14 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:14.434+0000 7fde3527c700 -1 osd.6 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T12:35:14.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:14 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:14.557+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:14.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:14 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:14.557+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:14.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:14 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:14.557+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:15.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:14.630+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:15.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:14.630+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:15.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:14.771+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:15.002 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:14 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:14.771+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:15.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:14 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:14.720+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:15.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:14 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:14.720+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:15.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:14 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:14.720+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:15.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:14 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:14.953+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:15.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:14 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:14.953+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:45.051309+0000 front 2024-04-20T12:34:45.051504+0000 (oldest deadline 2024-04-20T12:35:12.651590+0000) 2024-04-20T12:35:15.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:15.254+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:15.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:15.254+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.599779+0000 front 2024-04-20T12:34:43.599618+0000 (oldest deadline 2024-04-20T12:35:08.899677+0000) 2024-04-20T12:35:15.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:15 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:15.521+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:15.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:15 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:15.521+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:15.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:15 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:15.521+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:16.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:15 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:15.798+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:16.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:15 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:15.798+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:16.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:15 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:15.602+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:16.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:15 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:15.602+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:16.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:15.680+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:16.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:15.680+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:16.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:15.680+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:16.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:15 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:15.953+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:16.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:15 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:15.953+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:45.051309+0000 front 2024-04-20T12:34:45.051504+0000 (oldest deadline 2024-04-20T12:35:12.651590+0000) 2024-04-20T12:35:16.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:16 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:16.260+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:16.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:16 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:16.260+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.599779+0000 front 2024-04-20T12:34:43.599618+0000 (oldest deadline 2024-04-20T12:35:08.899677+0000) 2024-04-20T12:35:16.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:16 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:16.538+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:16.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:16 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:16.538+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:16.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:16 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:16.538+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:17.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:16 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:16.829+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:17.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:16 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:16.829+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:17.002 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:16 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:16.601+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:17.002 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:16 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:16.601+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:17.002 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:16 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:16.601+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:17.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:16 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:16.682+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:17.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:16 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:16.682+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:17.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:16 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:16.682+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:17.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:16 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:16.966+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:17.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:16 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:16.966+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:45.051309+0000 front 2024-04-20T12:34:45.051504+0000 (oldest deadline 2024-04-20T12:35:12.651590+0000) 2024-04-20T12:35:17.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:17 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:17.233+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:17.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:17 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:17.233+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.599779+0000 front 2024-04-20T12:34:43.599618+0000 (oldest deadline 2024-04-20T12:35:08.899677+0000) 2024-04-20T12:35:17.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:17 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:17.509+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:17.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:17 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:17.509+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:17.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:17 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:17.509+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:18.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:17 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:17.809+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:18.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:17 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:17.809+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:18.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:17 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:17.560+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:18.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:17 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:17.560+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:18.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:17 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:17.560+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:18.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:17 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:17.640+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:18.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:17 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:17.640+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:18.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:17 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:17.640+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:18.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:17 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:17.973+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:18.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:17 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:17.974+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:45.051309+0000 front 2024-04-20T12:34:45.051504+0000 (oldest deadline 2024-04-20T12:35:12.651590+0000) 2024-04-20T12:35:18.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:18 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:18.257+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:18.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:18 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:18.257+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.599779+0000 front 2024-04-20T12:34:43.599618+0000 (oldest deadline 2024-04-20T12:35:08.899677+0000) 2024-04-20T12:35:18.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:18 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:18.473+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:18.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:18 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:18.473+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:18.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:18 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:18.473+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:18.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:18 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:18.473+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:19.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:18 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:18.788+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:19.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:18 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:18.788+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:19.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:18 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:18.574+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:19.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:18 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:18.574+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:19.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:18 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:18.574+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:19.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:18 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:18.671+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:19.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:18 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:18.671+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:19.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:18 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:18.671+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:19.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:18 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:18.671+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:19.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:18 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:18.988+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:19.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:18 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:18.988+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:45.051309+0000 front 2024-04-20T12:34:45.051504+0000 (oldest deadline 2024-04-20T12:35:12.651590+0000) 2024-04-20T12:35:19.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:19 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:19.229+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:35.398477+0000 front 2024-04-20T12:34:35.398468+0000 (oldest deadline 2024-04-20T12:35:03.599109+0000) 2024-04-20T12:35:19.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:19 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:19.229+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.599779+0000 front 2024-04-20T12:34:43.599618+0000 (oldest deadline 2024-04-20T12:35:08.899677+0000) 2024-04-20T12:35:19.613 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:19 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6[43981]: 2024-04-20T12:35:19.229+0000 7fde31870700 -1 osd.6 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:53.600712+0000 front 2024-04-20T12:34:53.600737+0000 (oldest deadline 2024-04-20T12:35:18.900890+0000) 2024-04-20T12:35:19.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:19 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:19.461+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:19.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:19 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:19.461+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:19.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:19 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:19.461+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:19.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:19 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:19.461+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:19.907 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:19 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:19.655+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:19.908 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:19 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:19.655+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:19.908 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:19 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:19.655+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:19.908 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:19 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:19.655+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:20.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:19 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:19.792+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:20.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:19 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:19.792+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:20.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:19 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:19.593+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:20.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:19 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:19.593+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:20.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:19 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:19.593+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:20.219 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:19 smithi135 podman[88767]: 2024-04-20 12:35:19.90909286 +0000 UTC m=+5.595209809 container died d9c0a89420b7d86f5cfab01a6dce210df467339bbc17b78797020a4e31f7293d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD) 2024-04-20T12:35:20.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:20 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:20.020+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:20.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:20 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:20.020+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:45.051309+0000 front 2024-04-20T12:34:45.051504+0000 (oldest deadline 2024-04-20T12:35:12.651590+0000) 2024-04-20T12:35:20.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:20 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:20.020+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:53.152880+0000 front 2024-04-20T12:34:53.152762+0000 (oldest deadline 2024-04-20T12:35:19.052663+0000) 2024-04-20T12:35:20.553 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:20 smithi135 podman[88767]: 2024-04-20 12:35:20.311446025 +0000 UTC m=+5.997562981 container cleanup d9c0a89420b7d86f5cfab01a6dce210df467339bbc17b78797020a4e31f7293d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-20T12:35:20.553 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:20 smithi135 bash[88767]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6 2024-04-20T12:35:20.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:20 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:20.490+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:20.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:20 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:20.490+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:20.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:20 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:20.490+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:20.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:20 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:20.490+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:20.863 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:20 smithi135 podman[88784]: 2024-04-20 12:35:20.554661566 +0000 UTC m=+0.636759579 container remove d9c0a89420b7d86f5cfab01a6dce210df467339bbc17b78797020a4e31f7293d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:35:20.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:20 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:20.606+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:20.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:20 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:20.606+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:20.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:20 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:20.606+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:20.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:20 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:20.606+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:21.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:20 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:20.802+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:21.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:20 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:20.802+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:21.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:20 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:20.802+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:54.309685+0000 front 2024-04-20T12:34:54.309794+0000 (oldest deadline 2024-04-20T12:35:20.209614+0000) 2024-04-20T12:35:21.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:20 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:20.584+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:21.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:20 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:20.584+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:21.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:20 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:20.584+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:21.149 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:20 smithi135 podman[88873]: 2024-04-20 12:35:20.872326772 +0000 UTC m=+0.109186859 container create ec872c41ec9c59ed8f77f55e6d16c8a820b38fa7c369ca829d43b52053152092 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-20T12:35:21.149 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:20 smithi135 podman[88873]: 2024-04-20 12:35:20.781872006 +0000 UTC m=+0.018732104 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:35:21.149 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:21 smithi135 podman[88873]: 2024-04-20 12:35:21.075602358 +0000 UTC m=+0.312462445 container init ec872c41ec9c59ed8f77f55e6d16c8a820b38fa7c369ca829d43b52053152092 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-20T12:35:21.149 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:21 smithi135 podman[88873]: 2024-04-20 12:35:21.078602395 +0000 UTC m=+0.315462487 container start ec872c41ec9c59ed8f77f55e6d16c8a820b38fa7c369ca829d43b52053152092 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-20T12:35:21.149 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:21 smithi135 podman[88873]: 2024-04-20 12:35:21.15075252 +0000 UTC m=+0.387612613 container attach ec872c41ec9c59ed8f77f55e6d16c8a820b38fa7c369ca829d43b52053152092 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-20T12:35:21.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:21 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:21.054+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:21.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:21 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:21.054+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:45.051309+0000 front 2024-04-20T12:34:45.051504+0000 (oldest deadline 2024-04-20T12:35:12.651590+0000) 2024-04-20T12:35:21.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:21 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:21.054+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:53.152880+0000 front 2024-04-20T12:34:53.152762+0000 (oldest deadline 2024-04-20T12:35:19.052663+0000) 2024-04-20T12:35:21.614 INFO:journalctl@ceph.osd.6.smithi135.stdout:Apr 20 12:35:21 smithi135 podman[88873]: 2024-04-20 12:35:21.369827873 +0000 UTC m=+0.606687960 container died ec872c41ec9c59ed8f77f55e6d16c8a820b38fa7c369ca829d43b52053152092 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T12:35:21.813 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:21 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:21.562+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:21.813 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:21 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:21.562+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:21.813 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:21 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:21.562+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:21.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:21 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:21.533+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:21.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:21 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:21.533+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:21.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:21 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:21.533+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:21.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:21 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:21.533+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:22.080 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:21 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:21.652+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:22.080 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:21 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:21.652+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:22.080 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:21 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:21.652+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:22.081 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:21 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:21.652+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:22.110 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.6.service' 2024-04-20T12:35:22.157 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:35:22.157 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-04-20T12:35:22.157 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-04-20T12:35:22.157 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.7 2024-04-20T12:35:22.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:21 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:21.814+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:22.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:21 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:21.814+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:22.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:21 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:21.814+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:54.309685+0000 front 2024-04-20T12:34:54.309794+0000 (oldest deadline 2024-04-20T12:35:20.209614+0000) 2024-04-20T12:35:22.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:22 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:22.031+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:22.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:22 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:22.031+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:45.051309+0000 front 2024-04-20T12:34:45.051504+0000 (oldest deadline 2024-04-20T12:35:12.651590+0000) 2024-04-20T12:35:22.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:22 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:22.031+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:53.152880+0000 front 2024-04-20T12:34:53.152762+0000 (oldest deadline 2024-04-20T12:35:19.052663+0000) 2024-04-20T12:35:22.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:22 smithi139 systemd[1]: Stopping Ceph osd.7 for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:35:22.791 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:22 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:22.537+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:22.791 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:22 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:22.537+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:22.792 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:22 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:22.537+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:22.829 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:22 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:22.473+0000 7feffaaa9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:35:22.829 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:22 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:22.473+0000 7feffaaa9700 -1 osd.7 109 *** Got signal Terminated *** 2024-04-20T12:35:22.830 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:22 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:22.473+0000 7feffaaa9700 -1 osd.7 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T12:35:22.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:22 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:22.524+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:22.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:22 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:22.524+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:22.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:22 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:22.524+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:22.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:22 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:22.524+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:23.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:22 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:22.640+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:23.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:22 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:22.640+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:23.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:22 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:22.640+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:23.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:22 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:22.640+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:23.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:22 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:22.792+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:23.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:22 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:22.792+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:23.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:22 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:22.792+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:54.309685+0000 front 2024-04-20T12:34:54.309794+0000 (oldest deadline 2024-04-20T12:35:20.209614+0000) 2024-04-20T12:35:23.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:23 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:23.061+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:23.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:23 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:23.061+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:45.051309+0000 front 2024-04-20T12:34:45.051504+0000 (oldest deadline 2024-04-20T12:35:12.651590+0000) 2024-04-20T12:35:23.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:23 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:23.061+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:53.152880+0000 front 2024-04-20T12:34:53.152762+0000 (oldest deadline 2024-04-20T12:35:19.052663+0000) 2024-04-20T12:35:23.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:23 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:23.495+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:23.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:23 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:23.495+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:23.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:23 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:23.495+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:23.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:23 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:23.495+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:23.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:23 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:23.601+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:23.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:23 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:23.601+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:23.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:23 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:23.601+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:23.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:23 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:23.601+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:24.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:23 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:23.587+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:24.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:23 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:23.587+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:24.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:23 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:23.587+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:24.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:23 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:23.823+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:24.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:23 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:23.823+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:24.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:23 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:23.823+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:54.309685+0000 front 2024-04-20T12:34:54.309794+0000 (oldest deadline 2024-04-20T12:35:20.209614+0000) 2024-04-20T12:35:24.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:23 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:23.823+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:00.210225+0000 front 2024-04-20T12:35:00.210278+0000 (oldest deadline 2024-04-20T12:35:23.710275+0000) 2024-04-20T12:35:24.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:24 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:24.018+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:24.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:24 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:24.018+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:45.051309+0000 front 2024-04-20T12:34:45.051504+0000 (oldest deadline 2024-04-20T12:35:12.651590+0000) 2024-04-20T12:35:24.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:24 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:24.018+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:53.152880+0000 front 2024-04-20T12:34:53.152762+0000 (oldest deadline 2024-04-20T12:35:19.052663+0000) 2024-04-20T12:35:24.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:24 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:24.529+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:24.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:24 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:24.529+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:24.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:24 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:24.529+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:24.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:24 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:24.529+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:24.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:24 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:24.529+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:24.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:24 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:24.569+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:24.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:24 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:24.569+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:24.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:24 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:24.569+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:24.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:24 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:24.569+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:25.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:24 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:24.624+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:25.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:24 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:24.624+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:25.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:24 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:24.624+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:25.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:24 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:24.864+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:25.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:24 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:24.864+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:25.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:24 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:24.864+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:54.309685+0000 front 2024-04-20T12:34:54.309794+0000 (oldest deadline 2024-04-20T12:35:20.209614+0000) 2024-04-20T12:35:25.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:24 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:24.864+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:00.210225+0000 front 2024-04-20T12:35:00.210278+0000 (oldest deadline 2024-04-20T12:35:23.710275+0000) 2024-04-20T12:35:25.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:25 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:25.041+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:25.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:25 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:25.041+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:45.051309+0000 front 2024-04-20T12:34:45.051504+0000 (oldest deadline 2024-04-20T12:35:12.651590+0000) 2024-04-20T12:35:25.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:25 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:25.041+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:53.152880+0000 front 2024-04-20T12:34:53.152762+0000 (oldest deadline 2024-04-20T12:35:19.052663+0000) 2024-04-20T12:35:25.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:25 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:25.556+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:25.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:25 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:25.556+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:25.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:25 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:25.556+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:25.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:25 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:25.556+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:25.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:25 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:25.556+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:25.860 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:25 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:25.595+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:25.860 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:25 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:25.595+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:25.860 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:25 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:25.595+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:25.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:25 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:25.539+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:25.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:25 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:25.539+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:25.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:25 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:25.539+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:25.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:25 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:25.539+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:25.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:25 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:25.539+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:26.202 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:25 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:25.860+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:26.202 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:25 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:25.860+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:26.202 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:25 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:25.860+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:54.309685+0000 front 2024-04-20T12:34:54.309794+0000 (oldest deadline 2024-04-20T12:35:20.209614+0000) 2024-04-20T12:35:26.202 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:25 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:25.860+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:00.210225+0000 front 2024-04-20T12:35:00.210278+0000 (oldest deadline 2024-04-20T12:35:23.710275+0000) 2024-04-20T12:35:26.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:26 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:26.045+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:26.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:26 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:26.045+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:45.051309+0000 front 2024-04-20T12:34:45.051504+0000 (oldest deadline 2024-04-20T12:35:12.651590+0000) 2024-04-20T12:35:26.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:26 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:26.045+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:53.152880+0000 front 2024-04-20T12:34:53.152762+0000 (oldest deadline 2024-04-20T12:35:19.052663+0000) 2024-04-20T12:35:26.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:26 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:26.045+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:02.453871+0000 front 2024-04-20T12:35:02.453900+0000 (oldest deadline 2024-04-20T12:35:25.353941+0000) 2024-04-20T12:35:26.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:26 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:26.550+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:26.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:26 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:26.550+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:26.831 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:26 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:26.550+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:26.831 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:26 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:26.551+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:26.831 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:26 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:26.551+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:26.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:26 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:26.575+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:26.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:26 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:26.575+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:26.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:26 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:26.575+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:26.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:26 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:26.575+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:26.864 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:26 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:26.575+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:27.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:26 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:26.630+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:27.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:26 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:26.630+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:27.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:26 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:26.630+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:27.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:26 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:26.630+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:27.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:26 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:26.848+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:27.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:26 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:26.848+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:27.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:26 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:26.848+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:54.309685+0000 front 2024-04-20T12:34:54.309794+0000 (oldest deadline 2024-04-20T12:35:20.209614+0000) 2024-04-20T12:35:27.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:26 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:26.848+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:00.210225+0000 front 2024-04-20T12:35:00.210278+0000 (oldest deadline 2024-04-20T12:35:23.710275+0000) 2024-04-20T12:35:27.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:27 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:27.077+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.949541+0000 front 2024-04-20T12:34:36.949525+0000 (oldest deadline 2024-04-20T12:34:59.849697+0000) 2024-04-20T12:35:27.329 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:27 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:27.077+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:45.051309+0000 front 2024-04-20T12:34:45.051504+0000 (oldest deadline 2024-04-20T12:35:12.651590+0000) 2024-04-20T12:35:27.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:27 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:27.077+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:53.152880+0000 front 2024-04-20T12:34:53.152762+0000 (oldest deadline 2024-04-20T12:35:19.052663+0000) 2024-04-20T12:35:27.330 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:27 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7[39932]: 2024-04-20T12:35:27.077+0000 7feff3095700 -1 osd.7 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:02.453871+0000 front 2024-04-20T12:35:02.453900+0000 (oldest deadline 2024-04-20T12:35:25.353941+0000) 2024-04-20T12:35:27.973 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:27 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:27.583+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:27.973 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:27 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:27.584+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:27.973 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:27 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:27.584+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:27.973 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:27 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:27.584+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:27.973 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:27 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:27.584+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:28.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:27 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:27.633+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:28.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:27 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:27.633+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:28.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:27 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:27.633+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:28.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:27 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:27.633+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:28.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:27 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:27.799+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:28.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:27 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:27.799+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:28.002 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:27 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:27.799+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:54.309685+0000 front 2024-04-20T12:34:54.309794+0000 (oldest deadline 2024-04-20T12:35:20.209614+0000) 2024-04-20T12:35:28.002 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:27 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:27.799+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:00.210225+0000 front 2024-04-20T12:35:00.210278+0000 (oldest deadline 2024-04-20T12:35:23.710275+0000) 2024-04-20T12:35:28.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:27 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:27.624+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:28.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:27 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:27.624+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:28.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:27 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:27.624+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:28.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:27 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:27.624+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:28.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:27 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:27.624+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:28.281 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:27 smithi139 podman[58335]: 2024-04-20 12:35:27.973694557 +0000 UTC m=+5.619779454 container died 78eee9b9fa040444a77567be016a32b5ad7ee1c7d62eb58d8b2798594997eb6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-20T12:35:28.550 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:28 smithi139 podman[58335]: 2024-04-20 12:35:28.382207021 +0000 UTC m=+6.028291909 container cleanup 78eee9b9fa040444a77567be016a32b5ad7ee1c7d62eb58d8b2798594997eb6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-20T12:35:28.550 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:28 smithi139 bash[58335]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7 2024-04-20T12:35:28.829 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:28 smithi139 podman[58350]: 2024-04-20 12:35:28.63407294 +0000 UTC m=+0.661101320 container remove 78eee9b9fa040444a77567be016a32b5ad7ee1c7d62eb58d8b2798594997eb6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-20T12:35:28.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:28 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:28.550+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:28.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:28 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:28.550+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:28.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:28 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:28.550+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:28.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:28 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:28.550+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:28.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:28 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:28.550+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:29.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:28 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:28.638+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:29.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:28 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:28.638+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:29.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:28 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:28.638+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:29.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:28 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:28.638+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:29.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:28 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:28.846+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:29.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:28 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:28.846+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:29.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:28 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:28.846+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:54.309685+0000 front 2024-04-20T12:34:54.309794+0000 (oldest deadline 2024-04-20T12:35:20.209614+0000) 2024-04-20T12:35:29.002 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:28 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:28.846+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:00.210225+0000 front 2024-04-20T12:35:00.210278+0000 (oldest deadline 2024-04-20T12:35:23.710275+0000) 2024-04-20T12:35:29.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:28 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:28.622+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:29.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:28 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:28.622+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:29.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:28 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:28.622+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:29.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:28 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:28.622+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:29.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:28 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:28.622+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:29.319 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:29 smithi139 podman[58441]: 2024-04-20 12:35:28.962144025 +0000 UTC m=+0.018315787 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:35:29.319 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:29 smithi139 podman[58441]: 2024-04-20 12:35:29.059744163 +0000 UTC m=+0.115915909 container create b692f5ae8551ab4ddb7086a15ba9b3c8df76e90413723d93637840de53ca6384 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-20T12:35:29.319 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:29 smithi139 podman[58441]: 2024-04-20 12:35:29.320475371 +0000 UTC m=+0.376647118 container init b692f5ae8551ab4ddb7086a15ba9b3c8df76e90413723d93637840de53ca6384 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416) 2024-04-20T12:35:29.580 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:29 smithi139 podman[58441]: 2024-04-20 12:35:29.323683528 +0000 UTC m=+0.379855280 container start b692f5ae8551ab4ddb7086a15ba9b3c8df76e90413723d93637840de53ca6384 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T12:35:29.580 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:29 smithi139 podman[58441]: 2024-04-20 12:35:29.412138013 +0000 UTC m=+0.468309762 container attach b692f5ae8551ab4ddb7086a15ba9b3c8df76e90413723d93637840de53ca6384 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-20T12:35:29.580 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:29 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:29.536+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:29.580 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:29 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:29.536+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:29.580 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:29 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:29.536+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:29.580 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:29 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:29.536+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:29.580 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:29 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:29.536+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:29.989 INFO:journalctl@ceph.osd.7.smithi139.stdout:Apr 20 12:35:29 smithi139 podman[58441]: 2024-04-20 12:35:29.619544408 +0000 UTC m=+0.675716158 container died b692f5ae8551ab4ddb7086a15ba9b3c8df76e90413723d93637840de53ca6384 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T12:35:30.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:29 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:29.662+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:30.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:29 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:29.662+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:30.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:29 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:29.662+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:30.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:29 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:29.662+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:30.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:29 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:29.893+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:30.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:29 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:29.893+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:30.002 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:29 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:29.893+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:54.309685+0000 front 2024-04-20T12:34:54.309794+0000 (oldest deadline 2024-04-20T12:35:20.209614+0000) 2024-04-20T12:35:30.002 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:29 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:29.893+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:00.210225+0000 front 2024-04-20T12:35:00.210278+0000 (oldest deadline 2024-04-20T12:35:23.710275+0000) 2024-04-20T12:35:30.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:29 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:29.661+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:30.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:29 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:29.661+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:30.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:29 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:29.661+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:30.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:29 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:29.661+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:30.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:29 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:29.661+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:30.281 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.7.service' 2024-04-20T12:35:30.317 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:35:30.318 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-04-20T12:35:30.318 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-04-20T12:35:30.318 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.8 2024-04-20T12:35:30.658 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:30 smithi154 systemd[1]: Stopping Ceph osd.8 for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:35:30.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:30 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:30.512+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:30.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:30 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:30.512+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:30.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:30 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:30.512+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:30.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:30 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:30.512+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:30.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:30 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:30.512+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:31.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:30 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:30.659+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:31.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:30 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:30.659+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:31.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:30 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:30.659+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:31.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:30 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:30.659+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:31.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:30 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:30.662+0000 7f247fb53700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:35:31.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:30 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:30.662+0000 7f247fb53700 -1 osd.8 109 *** Got signal Terminated *** 2024-04-20T12:35:31.002 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:30 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:30.662+0000 7f247fb53700 -1 osd.8 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T12:35:31.002 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:30 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:30.879+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:31.002 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:30 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:30.879+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:31.002 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:30 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:30.879+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:54.309685+0000 front 2024-04-20T12:34:54.309794+0000 (oldest deadline 2024-04-20T12:35:20.209614+0000) 2024-04-20T12:35:31.002 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:30 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:30.879+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:00.210225+0000 front 2024-04-20T12:35:00.210278+0000 (oldest deadline 2024-04-20T12:35:23.710275+0000) 2024-04-20T12:35:31.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:30 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:30.693+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:31.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:30 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:30.693+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:31.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:30 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:30.693+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:31.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:30 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:30.693+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:31.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:30 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:30.693+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:31.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:31 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:31.482+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:31.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:31 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:31.482+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:31.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:31 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:31.482+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:31.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:31 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:31.482+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:31.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:31 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:31.482+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:31.883 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:31 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:31.609+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:31.883 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:31 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:31.609+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:31.883 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:31 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:31.609+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:31.883 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:31 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:31.609+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:32.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:31 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:31.670+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:32.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:31 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:31.670+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:32.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:31 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:31.670+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:32.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:31 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:31.670+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:32.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:31 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:31.670+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:32.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:31 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:31.884+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:32.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:31 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:31.884+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:32.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:31 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:31.884+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:54.309685+0000 front 2024-04-20T12:34:54.309794+0000 (oldest deadline 2024-04-20T12:35:20.209614+0000) 2024-04-20T12:35:32.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:31 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:31.884+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:00.210225+0000 front 2024-04-20T12:35:00.210278+0000 (oldest deadline 2024-04-20T12:35:23.710275+0000) 2024-04-20T12:35:32.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:32 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:32.457+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:32.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:32 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:32.457+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:32.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:32 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:32.457+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:32.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:32 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:32.457+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:32.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:32 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:32.457+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:33.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:32 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:32.604+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:33.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:32 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:32.604+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:33.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:32 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:32.604+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:33.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:32 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:32.604+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:33.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:32 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:32.844+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:33.002 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:32 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:32.844+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:33.002 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:32 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:32.844+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:54.309685+0000 front 2024-04-20T12:34:54.309794+0000 (oldest deadline 2024-04-20T12:35:20.209614+0000) 2024-04-20T12:35:33.002 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:32 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:32.844+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:00.210225+0000 front 2024-04-20T12:35:00.210278+0000 (oldest deadline 2024-04-20T12:35:23.710275+0000) 2024-04-20T12:35:33.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:32 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:32.718+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:33.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:32 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:32.718+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:33.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:32 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:32.718+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:33.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:32 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:32.718+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:33.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:32 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:32.718+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:33.821 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:33 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:33.564+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:33.822 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:33 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:33.564+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:33.822 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:33 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:33.564+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:33.822 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:33 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:33.564+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:33.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:33 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:33.477+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:33.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:33 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:33.477+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:33.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:33 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:33.477+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:33.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:33 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:33.477+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:33.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:33 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:33.477+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:33.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:33 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:33.477+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:34.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:33 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:33.714+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:34.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:33 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:33.714+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:34.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:33 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:33.714+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:34.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:33 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:33.714+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:34.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:33 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:33.714+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:34.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:33 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:33.714+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:08.346523+0000 front 2024-04-20T12:35:08.346572+0000 (oldest deadline 2024-04-20T12:35:33.646386+0000) 2024-04-20T12:35:34.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:33 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:33.822+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:34.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:33 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:33.822+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:34.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:33 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:33.822+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:54.309685+0000 front 2024-04-20T12:34:54.309794+0000 (oldest deadline 2024-04-20T12:35:20.209614+0000) 2024-04-20T12:35:34.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:33 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:33.822+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:00.210225+0000 front 2024-04-20T12:35:00.210278+0000 (oldest deadline 2024-04-20T12:35:23.710275+0000) 2024-04-20T12:35:34.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:33 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:33.822+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:08.411214+0000 front 2024-04-20T12:35:08.411256+0000 (oldest deadline 2024-04-20T12:35:33.711446+0000) 2024-04-20T12:35:34.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:34 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:34.455+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:34.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:34 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:34.455+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:34.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:34 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:34.455+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:34.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:34 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:34.455+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:34.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:34 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:34.455+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:34.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:34 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:34.455+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:34.858 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:34 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:34.593+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:34.858 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:34 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:34.593+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:34.858 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:34 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:34.593+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:34.859 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:34 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:34.593+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:35.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:34 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:34.746+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:35.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:34 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:34.746+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:35.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:34 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:34.746+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:35.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:34 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:34.746+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:35.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:34 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:34.746+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:35.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:34 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:34.746+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:08.346523+0000 front 2024-04-20T12:35:08.346572+0000 (oldest deadline 2024-04-20T12:35:33.646386+0000) 2024-04-20T12:35:35.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:34 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:34.859+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:39.207385+0000 front 2024-04-20T12:34:39.207263+0000 (oldest deadline 2024-04-20T12:35:02.707219+0000) 2024-04-20T12:35:35.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:34 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:34.859+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.108499+0000 front 2024-04-20T12:34:46.108520+0000 (oldest deadline 2024-04-20T12:35:08.408629+0000) 2024-04-20T12:35:35.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:34 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:34.859+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:54.309685+0000 front 2024-04-20T12:34:54.309794+0000 (oldest deadline 2024-04-20T12:35:20.209614+0000) 2024-04-20T12:35:35.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:34 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:34.859+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:00.210225+0000 front 2024-04-20T12:35:00.210278+0000 (oldest deadline 2024-04-20T12:35:23.710275+0000) 2024-04-20T12:35:35.251 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:34 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8[40716]: 2024-04-20T12:35:34.859+0000 7f247c147700 -1 osd.8 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:08.411214+0000 front 2024-04-20T12:35:08.411256+0000 (oldest deadline 2024-04-20T12:35:33.711446+0000) 2024-04-20T12:35:35.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:35 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:35.474+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:35.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:35 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:35.474+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:35.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:35 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:35.474+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:35.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:35 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:35.474+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:35.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:35 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:35.474+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:35.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:35 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:35.474+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:36.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:35 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:35.632+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:36.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:35 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:35.632+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:36.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:35 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:35.632+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:36.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:35 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:35.632+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:36.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:35 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:35.632+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:36.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:35 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:35.781+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:36.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:35 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:35.781+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:36.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:35 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:35.781+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:36.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:35 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:35.781+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:36.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:35 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:35.781+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:36.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:35 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:35.781+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:08.346523+0000 front 2024-04-20T12:35:08.346572+0000 (oldest deadline 2024-04-20T12:35:33.646386+0000) 2024-04-20T12:35:36.370 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:36 smithi154 podman[58772]: 2024-04-20 12:35:36.034100628 +0000 UTC m=+5.523977330 container died a5ee2f2e77e485d8ca13e63e13459a6e103e5060fd2ae3b298c02a49689442ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-20T12:35:36.670 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:36 smithi154 podman[58772]: 2024-04-20 12:35:36.479640941 +0000 UTC m=+5.969517628 container cleanup a5ee2f2e77e485d8ca13e63e13459a6e103e5060fd2ae3b298c02a49689442ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T12:35:36.670 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:36 smithi154 bash[58772]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8 2024-04-20T12:35:36.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:36 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:36.455+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:36.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:36 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:36.455+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:36.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:36 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:36.455+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:36.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:36 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:36.455+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:36.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:36 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:36.455+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:36.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:36 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:36.455+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:37.001 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:36 smithi154 podman[58790]: 2024-04-20 12:35:36.681052446 +0000 UTC m=+0.645322863 container remove a5ee2f2e77e485d8ca13e63e13459a6e103e5060fd2ae3b298c02a49689442ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_CLEAN=True) 2024-04-20T12:35:37.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:36 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:36.671+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:37.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:36 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:36.671+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:37.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:36 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:36.671+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:37.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:36 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:36.671+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:37.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:36 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:36.671+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:37.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:36 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:36.816+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:37.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:36 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:36.816+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:37.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:36 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:36.816+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:37.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:36 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:36.816+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:37.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:36 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:36.816+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:37.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:36 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:36.816+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:08.346523+0000 front 2024-04-20T12:35:08.346572+0000 (oldest deadline 2024-04-20T12:35:33.646386+0000) 2024-04-20T12:35:37.425 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:37 smithi154 podman[58882]: 2024-04-20 12:35:36.989933093 +0000 UTC m=+0.017347150 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:35:37.425 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:37 smithi154 podman[58882]: 2024-04-20 12:35:37.107103804 +0000 UTC m=+0.134517832 container create a621c0a9ca3325341e5a9df62af5f73891e0152b7ac47208c2c9c2abed1a7845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T12:35:37.425 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:37 smithi154 podman[58882]: 2024-04-20 12:35:37.326660751 +0000 UTC m=+0.354074781 container init a621c0a9ca3325341e5a9df62af5f73891e0152b7ac47208c2c9c2abed1a7845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-20T12:35:37.425 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:37 smithi154 podman[58882]: 2024-04-20 12:35:37.329745805 +0000 UTC m=+0.357159838 container start a621c0a9ca3325341e5a9df62af5f73891e0152b7ac47208c2c9c2abed1a7845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:35:37.425 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:37 smithi154 podman[58882]: 2024-04-20 12:35:37.426585018 +0000 UTC m=+0.453999065 container attach a621c0a9ca3325341e5a9df62af5f73891e0152b7ac47208c2c9c2abed1a7845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416) 2024-04-20T12:35:37.751 INFO:journalctl@ceph.osd.8.smithi154.stdout:Apr 20 12:35:37 smithi154 podman[58882]: 2024-04-20 12:35:37.620754171 +0000 UTC m=+0.648168216 container died a621c0a9ca3325341e5a9df62af5f73891e0152b7ac47208c2c9c2abed1a7845 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-20T12:35:37.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:37 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:37.652+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:37.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:37 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:37.652+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:37.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:37 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:37.652+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:37.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:37 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:37.652+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:37.752 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:37 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:37.652+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:37.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:37 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:37.489+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:37.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:37 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:37.489+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:37.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:37 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:37.489+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:37.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:37 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:37.489+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:37.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:37 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:37.489+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:37.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:37 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:37.489+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:38.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:37 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:37.799+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:38.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:37 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:37.799+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:38.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:37 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:37.799+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:38.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:37 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:37.799+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:38.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:37 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:37.799+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:38.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:37 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:37.799+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:08.346523+0000 front 2024-04-20T12:35:08.346572+0000 (oldest deadline 2024-04-20T12:35:33.646386+0000) 2024-04-20T12:35:38.268 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.8.service' 2024-04-20T12:35:38.305 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:35:38.306 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-04-20T12:35:38.306 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-04-20T12:35:38.306 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.9 2024-04-20T12:35:38.613 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:38 smithi135 systemd[1]: Stopping Ceph osd.9 for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:35:38.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:38 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:38.534+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:38.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:38 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:38.534+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:38.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:38 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:38.534+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:38.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:38 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:38.534+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:38.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:38 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:38.534+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:38.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:38 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:38.534+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:39.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:38 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:38.631+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:39.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:38 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:38.631+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:39.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:38 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:38.631+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:39.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:38 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:38.631+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:39.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:38 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:38.631+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:39.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:38 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:38.617+0000 7f5e53ff6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:35:39.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:38 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:38.617+0000 7f5e53ff6700 -1 osd.9 109 *** Got signal Terminated *** 2024-04-20T12:35:39.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:38 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:38.617+0000 7f5e53ff6700 -1 osd.9 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T12:35:39.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:38 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:38.755+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:39.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:38 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:38.755+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:39.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:38 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:38.755+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:39.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:38 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:38.755+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:39.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:38 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:38.755+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:39.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:38 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:38.755+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:08.346523+0000 front 2024-04-20T12:35:08.346572+0000 (oldest deadline 2024-04-20T12:35:33.646386+0000) 2024-04-20T12:35:39.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:39 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:39.607+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:39.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:39 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:39.607+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:39.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:39 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:39.607+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:39.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:39 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:39.607+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:39.751 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:39 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:39.607+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:39.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:39 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:39.519+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:39.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:39 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:39.519+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:39.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:39 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:39.519+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:39.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:39 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:39.519+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:39.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:39 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:39.519+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:39.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:39 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:39.519+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:40.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:39 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:39.786+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:40.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:39 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:39.786+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:40.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:39 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:39.786+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:40.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:39 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:39.786+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:40.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:39 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:39.786+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:40.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:39 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:39.786+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:08.346523+0000 front 2024-04-20T12:35:08.346572+0000 (oldest deadline 2024-04-20T12:35:33.646386+0000) 2024-04-20T12:35:40.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:40 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:40.476+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:40.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:40 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:40.476+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:40.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:40 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:40.476+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:40.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:40 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:40.477+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:40.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:40 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:40.477+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:40.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:40 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:40.477+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:41.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:40 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:40.607+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:41.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:40 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:40.607+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:41.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:40 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:40.607+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:41.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:40 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:40.607+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:41.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:40 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:40.607+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:41.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:40 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:40.824+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:41.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:40 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:40.824+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:41.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:40 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:40.824+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:41.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:40 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:40.824+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:41.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:40 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:40.824+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:41.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:40 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:40.824+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:08.346523+0000 front 2024-04-20T12:35:08.346572+0000 (oldest deadline 2024-04-20T12:35:33.646386+0000) 2024-04-20T12:35:41.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:41 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:41.479+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:41.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:41 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:41.479+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:41.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:41 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:41.479+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:41.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:41 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:41.479+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:41.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:41 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:41.479+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:41.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:41 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:41.479+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:42.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:41 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:41.656+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:42.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:41 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:41.656+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:42.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:41 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:41.656+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:42.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:41 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:41.656+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:42.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:41 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:41.656+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:42.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:41 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:41.656+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:42.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:41 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:41.804+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:42.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:41 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:41.804+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:42.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:41 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:41.804+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:42.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:41 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:41.804+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:42.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:41 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:41.804+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:42.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:41 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:41.804+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:08.346523+0000 front 2024-04-20T12:35:08.346572+0000 (oldest deadline 2024-04-20T12:35:33.646386+0000) 2024-04-20T12:35:42.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:42 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:42.474+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:42.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:42 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:42.474+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:42.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:42 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:42.474+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:42.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:42 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:42.474+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:42.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:42 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:42.474+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:42.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:42 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:42.474+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:43.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:42 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:42.674+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:43.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:42 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:42.674+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:43.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:42 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:42.674+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:43.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:42 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:42.674+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:43.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:42 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:42.674+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:43.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:42 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:42.674+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:43.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:42 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:42.774+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:29.240981+0000 front 2024-04-20T12:34:29.241012+0000 (oldest deadline 2024-04-20T12:34:52.741068+0000) 2024-04-20T12:35:43.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:42 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:42.774+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:36.842151+0000 front 2024-04-20T12:34:36.842169+0000 (oldest deadline 2024-04-20T12:35:01.542181+0000) 2024-04-20T12:35:43.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:42 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:42.774+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.843247+0000 front 2024-04-20T12:34:46.843060+0000 (oldest deadline 2024-04-20T12:35:10.943046+0000) 2024-04-20T12:35:43.113 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:42 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:42.774+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.644007+0000 front 2024-04-20T12:34:52.643972+0000 (oldest deadline 2024-04-20T12:35:17.944087+0000) 2024-04-20T12:35:43.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:42 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:42.774+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.345601+0000 front 2024-04-20T12:35:01.345538+0000 (oldest deadline 2024-04-20T12:35:25.445381+0000) 2024-04-20T12:35:43.114 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:42 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9[51029]: 2024-04-20T12:35:42.774+0000 7f5e505ea700 -1 osd.9 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:08.346523+0000 front 2024-04-20T12:35:08.346572+0000 (oldest deadline 2024-04-20T12:35:33.646386+0000) 2024-04-20T12:35:43.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:43 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:43.439+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:43.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:43 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:43.439+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:43.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:43 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:43.439+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:43.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:43 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:43.439+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:43.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:43 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:43.439+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:43.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:43 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:43.439+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:43.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:43 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:43.439+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:18.721939+0000 front 2024-04-20T12:35:18.722004+0000 (oldest deadline 2024-04-20T12:35:42.821847+0000) 2024-04-20T12:35:44.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:43 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:43.675+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:44.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:43 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:43.675+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:44.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:43 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:43.675+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:44.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:43 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:43.675+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:44.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:43 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:43.675+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:44.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:43 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:43.675+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:44.267 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:44 smithi135 podman[88990]: 2024-04-20 12:35:44.002064847 +0000 UTC m=+5.506586484 container died 8806bdff5bc5ed723e15545e7350b59ca41cc5ac4e9d0224ccc6226318fc1ee4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T12:35:44.525 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:44 smithi135 podman[88990]: 2024-04-20 12:35:44.342138453 +0000 UTC m=+5.846660098 container cleanup 8806bdff5bc5ed723e15545e7350b59ca41cc5ac4e9d0224ccc6226318fc1ee4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-20T12:35:44.526 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:44 smithi135 bash[88990]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9 2024-04-20T12:35:44.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:44 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:44.448+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:44.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:44 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:44.448+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:44.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:44 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:44.448+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:44.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:44 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:44.448+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:44.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:44 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:44.448+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:44.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:44 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:44.448+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:44.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:44 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:44.448+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:18.721939+0000 front 2024-04-20T12:35:18.722004+0000 (oldest deadline 2024-04-20T12:35:42.821847+0000) 2024-04-20T12:35:44.863 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:44 smithi135 podman[89011]: 2024-04-20 12:35:44.527012412 +0000 UTC m=+0.515849167 container remove 8806bdff5bc5ed723e15545e7350b59ca41cc5ac4e9d0224ccc6226318fc1ee4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux ) 2024-04-20T12:35:45.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:44 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:44.694+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:45.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:44 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:44.694+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:45.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:44 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:44.694+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:45.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:44 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:44.694+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:45.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:44 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:44.694+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:45.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:44 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:44.694+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:45.255 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:44 smithi135 podman[89104]: 2024-04-20 12:35:44.84827501 +0000 UTC m=+0.017884770 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:35:45.255 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:44 smithi135 podman[89104]: 2024-04-20 12:35:44.969739061 +0000 UTC m=+0.139348855 container create df19e4eb332358a82ad2c09dbd879e2550d18824569e9dc82df53873f0c48245 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5) 2024-04-20T12:35:45.255 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:45 smithi135 podman[89104]: 2024-04-20 12:35:45.189847062 +0000 UTC m=+0.359456819 container init df19e4eb332358a82ad2c09dbd879e2550d18824569e9dc82df53873f0c48245 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-04-20T12:35:45.255 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:45 smithi135 podman[89104]: 2024-04-20 12:35:45.193144768 +0000 UTC m=+0.362754525 container start df19e4eb332358a82ad2c09dbd879e2550d18824569e9dc82df53873f0c48245 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2) 2024-04-20T12:35:45.255 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:45 smithi135 podman[89104]: 2024-04-20 12:35:45.256101167 +0000 UTC m=+0.425710933 container attach df19e4eb332358a82ad2c09dbd879e2550d18824569e9dc82df53873f0c48245 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-20T12:35:45.613 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:45 smithi135 podman[89104]: 2024-04-20 12:35:45.484729792 +0000 UTC m=+0.654339544 container died df19e4eb332358a82ad2c09dbd879e2550d18824569e9dc82df53873f0c48245 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True) 2024-04-20T12:35:45.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:45 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:45.410+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:45.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:45 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:45.410+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:45.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:45 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:45.410+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:45.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:45 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:45.410+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:45.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:45 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:45.410+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:45.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:45 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:45.410+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:45.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:45 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:45.410+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:18.721939+0000 front 2024-04-20T12:35:18.722004+0000 (oldest deadline 2024-04-20T12:35:42.821847+0000) 2024-04-20T12:35:46.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:45 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:45.657+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:46.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:45 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:45.657+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:46.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:45 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:45.657+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:46.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:45 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:45.657+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:46.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:45 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:45.657+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:46.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:45 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:45.657+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:46.030 INFO:journalctl@ceph.osd.9.smithi135.stdout:Apr 20 12:35:46 smithi135 podman[89130]: 2024-04-20 12:35:46.018674768 +0000 UTC m=+0.525377150 container remove df19e4eb332358a82ad2c09dbd879e2550d18824569e9dc82df53873f0c48245 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-20T12:35:46.035 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.9.service' 2024-04-20T12:35:46.076 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:35:46.076 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-04-20T12:35:46.076 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-04-20T12:35:46.076 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.10 2024-04-20T12:35:46.391 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:46 smithi139 systemd[1]: Stopping Ceph osd.10 for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:35:46.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:46 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:46.392+0000 7fbcd18d8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:35:46.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:46 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:46.392+0000 7fbcd18d8700 -1 osd.10 109 *** Got signal Terminated *** 2024-04-20T12:35:46.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:46 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:46.392+0000 7fbcd18d8700 -1 osd.10 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T12:35:46.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:46 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:46.398+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:46.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:46 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:46.398+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:46.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:46 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:46.398+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:46.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:46 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:46.398+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:46.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:46 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:46.398+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:46.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:46 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:46.398+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:46.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:46 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:46.398+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:18.721939+0000 front 2024-04-20T12:35:18.722004+0000 (oldest deadline 2024-04-20T12:35:42.821847+0000) 2024-04-20T12:35:47.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:46 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:46.663+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:47.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:46 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:46.663+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:47.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:46 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:46.663+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:47.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:46 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:46.663+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:47.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:46 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:46.663+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:47.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:46 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:46.663+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:47.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:47 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:47.434+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:47.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:47 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:47.434+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:47.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:47 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:47.434+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:47.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:47 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:47.434+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:47.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:47 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:47.434+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:47.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:47 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:47.434+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:47.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:47 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:47.434+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:18.721939+0000 front 2024-04-20T12:35:18.722004+0000 (oldest deadline 2024-04-20T12:35:42.821847+0000) 2024-04-20T12:35:48.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:47 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:47.699+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:48.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:47 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:47.699+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:48.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:47 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:47.699+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:48.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:47 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:47.699+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:48.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:47 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:47.699+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:48.002 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:47 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:47.699+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:48.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:48 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:48.439+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:48.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:48 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:48.439+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:48.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:48 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:48.439+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:48.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:48 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:48.439+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:48.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:48 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:48.439+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:48.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:48 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:48.439+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:48.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:48 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:48.439+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:18.721939+0000 front 2024-04-20T12:35:18.722004+0000 (oldest deadline 2024-04-20T12:35:42.821847+0000) 2024-04-20T12:35:48.949 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:48 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:48.683+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:48.949 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:48 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:48.683+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:48.949 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:48 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:48.683+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:48.949 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:48 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:48.683+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:48.949 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:48 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:48.683+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:48.949 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:48 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:48.683+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:48.949 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:48 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:48.683+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-04-20T12:35:24.936669+0000 front 2024-04-20T12:35:24.936635+0000 (oldest deadline 2024-04-20T12:35:48.436621+0000) 2024-04-20T12:35:49.829 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:49 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:49.437+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:49.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:49 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:49.437+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:49.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:49 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:49.437+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:49.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:49 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:49.437+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:49.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:49 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:49.437+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:49.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:49 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:49.437+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:49.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:49 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:49.437+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:18.721939+0000 front 2024-04-20T12:35:18.722004+0000 (oldest deadline 2024-04-20T12:35:42.821847+0000) 2024-04-20T12:35:50.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:49 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:49.662+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:50.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:49 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:49.662+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:50.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:49 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:49.662+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:50.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:49 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:49.662+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:50.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:49 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:49.662+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:50.002 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:49 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:49.662+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:50.002 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:49 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:49.662+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-04-20T12:35:24.936669+0000 front 2024-04-20T12:35:24.936635+0000 (oldest deadline 2024-04-20T12:35:48.436621+0000) 2024-04-20T12:35:50.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:50 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:50.469+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:30.815032+0000 front 2024-04-20T12:34:30.815193+0000 (oldest deadline 2024-04-20T12:34:53.715168+0000) 2024-04-20T12:35:50.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:50 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:50.469+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6804 osd.1 since back 2024-04-20T12:34:38.416152+0000 front 2024-04-20T12:34:38.416288+0000 (oldest deadline 2024-04-20T12:35:04.316333+0000) 2024-04-20T12:35:50.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:50 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:50.469+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:46.017518+0000 front 2024-04-20T12:34:46.017328+0000 (oldest deadline 2024-04-20T12:35:10.717218+0000) 2024-04-20T12:35:50.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:50 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:50.469+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:52.418423+0000 front 2024-04-20T12:34:52.418495+0000 (oldest deadline 2024-04-20T12:35:17.718210+0000) 2024-04-20T12:35:50.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:50 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:50.469+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:34:57.718605+0000 front 2024-04-20T12:34:57.718560+0000 (oldest deadline 2024-04-20T12:35:23.618580+0000) 2024-04-20T12:35:50.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:50 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:50.469+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.420519+0000 front 2024-04-20T12:35:09.420623+0000 (oldest deadline 2024-04-20T12:35:32.920316+0000) 2024-04-20T12:35:50.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:50 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10[46691]: 2024-04-20T12:35:50.469+0000 7fbcc9ec4700 -1 osd.10 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:18.721939+0000 front 2024-04-20T12:35:18.722004+0000 (oldest deadline 2024-04-20T12:35:42.821847+0000) 2024-04-20T12:35:51.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:50 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:50.638+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:51.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:50 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:50.638+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:51.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:50 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:50.638+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:51.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:50 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:50.638+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:51.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:50 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:50.638+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:51.002 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:50 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:50.638+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:51.002 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:50 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:50.638+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-04-20T12:35:24.936669+0000 front 2024-04-20T12:35:24.936635+0000 (oldest deadline 2024-04-20T12:35:48.436621+0000) 2024-04-20T12:35:52.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:51 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:51.615+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:52.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:51 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:51.615+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:52.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:51 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:51.615+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:52.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:51 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:51.615+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:52.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:51 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:51.615+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:52.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:51 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:51.615+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:52.002 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:51 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:51.615+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-04-20T12:35:24.936669+0000 front 2024-04-20T12:35:24.936635+0000 (oldest deadline 2024-04-20T12:35:48.436621+0000) 2024-04-20T12:35:52.275 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:51 smithi139 podman[58547]: 2024-04-20 12:35:51.926823677 +0000 UTC m=+5.663178375 container died 09d71cd3318781ce2892fb80f5e6d92a6a1add741c8e70648480900ebd1753b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-20T12:35:52.550 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:52 smithi139 podman[58547]: 2024-04-20 12:35:52.366842858 +0000 UTC m=+6.103197556 container cleanup 09d71cd3318781ce2892fb80f5e6d92a6a1add741c8e70648480900ebd1753b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-04-20T12:35:52.550 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:52 smithi139 bash[58547]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10 2024-04-20T12:35:52.830 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:52 smithi139 podman[58564]: 2024-04-20 12:35:52.551201015 +0000 UTC m=+0.624345170 container remove 09d71cd3318781ce2892fb80f5e6d92a6a1add741c8e70648480900ebd1753b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-04-20T12:35:53.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:52 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:52.585+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:53.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:52 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:52.585+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:53.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:52 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:52.585+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:53.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:52 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:52.585+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:53.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:52 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:52.585+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:53.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:52 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:52.585+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:53.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:52 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:52.585+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-04-20T12:35:24.936669+0000 front 2024-04-20T12:35:24.936635+0000 (oldest deadline 2024-04-20T12:35:48.436621+0000) 2024-04-20T12:35:53.294 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:52 smithi139 podman[58656]: 2024-04-20 12:35:52.985373211 +0000 UTC m=+0.115086881 container create 4558cdb8428278b7eab282d4e790f318c73ac9cbe30e0d5e26913bd475f7ff2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240416, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T12:35:53.294 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:52 smithi139 podman[58656]: 2024-04-20 12:35:52.888094416 +0000 UTC m=+0.017808059 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:35:53.295 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:53 smithi139 podman[58656]: 2024-04-20 12:35:53.212971727 +0000 UTC m=+0.342685359 container init 4558cdb8428278b7eab282d4e790f318c73ac9cbe30e0d5e26913bd475f7ff2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-20T12:35:53.295 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:53 smithi139 podman[58656]: 2024-04-20 12:35:53.216270869 +0000 UTC m=+0.345984502 container start 4558cdb8428278b7eab282d4e790f318c73ac9cbe30e0d5e26913bd475f7ff2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0) 2024-04-20T12:35:53.295 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:53 smithi139 podman[58656]: 2024-04-20 12:35:53.29582156 +0000 UTC m=+0.425535203 container attach 4558cdb8428278b7eab282d4e790f318c73ac9cbe30e0d5e26913bd475f7ff2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-04-20T12:35:53.579 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:53 smithi139 podman[58656]: 2024-04-20 12:35:53.505615659 +0000 UTC m=+0.635329288 container died 4558cdb8428278b7eab282d4e790f318c73ac9cbe30e0d5e26913bd475f7ff2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-04-20T12:35:54.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:53 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:53.622+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:54.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:53 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:53.622+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:54.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:53 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:53.622+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:54.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:53 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:53.622+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:54.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:53 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:53.622+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:54.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:53 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:53.622+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:54.002 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:53 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:53.622+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-04-20T12:35:24.936669+0000 front 2024-04-20T12:35:24.936635+0000 (oldest deadline 2024-04-20T12:35:48.436621+0000) 2024-04-20T12:35:54.035 INFO:journalctl@ceph.osd.10.smithi139.stdout:Apr 20 12:35:54 smithi139 podman[58682]: 2024-04-20 12:35:54.015891433 +0000 UTC m=+0.505241478 container remove 4558cdb8428278b7eab282d4e790f318c73ac9cbe30e0d5e26913bd475f7ff2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-10-deactivate, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:35:54.040 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.10.service' 2024-04-20T12:35:54.076 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:35:54.076 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-04-20T12:35:54.077 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-04-20T12:35:54.077 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.11 2024-04-20T12:35:54.390 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:54 smithi154 systemd[1]: Stopping Ceph osd.11 for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:35:54.390 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:54 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:54.390+0000 7f8d4f2ad700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:35:54.390 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:54 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:54.390+0000 7f8d4f2ad700 -1 osd.11 109 *** Got signal Terminated *** 2024-04-20T12:35:54.390 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:54 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:54.390+0000 7f8d4f2ad700 -1 osd.11 109 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-20T12:35:54.662 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:54 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:54.608+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:54.662 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:54 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:54.608+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:54.662 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:54 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:54.608+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:54.662 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:54 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:54.608+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:54.662 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:54 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:54.608+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:54.662 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:54 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:54.608+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:54.662 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:54 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:54.608+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-04-20T12:35:24.936669+0000 front 2024-04-20T12:35:24.936635+0000 (oldest deadline 2024-04-20T12:35:48.436621+0000) 2024-04-20T12:35:56.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:55 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:55.634+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:56.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:55 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:55.634+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:56.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:55 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:55.634+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:56.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:55 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:55.634+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:56.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:55 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:55.634+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:56.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:55 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:55.634+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:56.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:55 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:55.634+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-04-20T12:35:24.936669+0000 front 2024-04-20T12:35:24.936635+0000 (oldest deadline 2024-04-20T12:35:48.436621+0000) 2024-04-20T12:35:57.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:56 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:56.631+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:57.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:56 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:56.631+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:57.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:56 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:56.631+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:57.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:56 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:56.631+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:57.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:56 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:56.631+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:57.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:56 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:56.631+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:57.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:56 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:56.631+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-04-20T12:35:24.936669+0000 front 2024-04-20T12:35:24.936635+0000 (oldest deadline 2024-04-20T12:35:48.436621+0000) 2024-04-20T12:35:58.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:57 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:57.642+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:58.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:57 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:57.642+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:58.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:57 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:57.642+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:58.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:57 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:57.642+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:58.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:57 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:57.642+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:58.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:57 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:57.642+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:58.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:57 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:57.642+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-04-20T12:35:24.936669+0000 front 2024-04-20T12:35:24.936635+0000 (oldest deadline 2024-04-20T12:35:48.436621+0000) 2024-04-20T12:35:58.002 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:57 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:57.642+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6820 osd.8 since back 2024-04-20T12:35:32.338408+0000 front 2024-04-20T12:35:32.338438+0000 (oldest deadline 2024-04-20T12:35:57.038474+0000) 2024-04-20T12:35:59.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:58 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:58.683+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6806 osd.0 since back 2024-04-20T12:34:28.629870+0000 front 2024-04-20T12:34:28.630062+0000 (oldest deadline 2024-04-20T12:34:52.729927+0000) 2024-04-20T12:35:59.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:58 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:58.683+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6804 osd.2 since back 2024-04-20T12:34:43.331625+0000 front 2024-04-20T12:34:43.331657+0000 (oldest deadline 2024-04-20T12:35:08.031981+0000) 2024-04-20T12:35:59.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:58 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:58.683+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6814 osd.3 since back 2024-04-20T12:34:51.533019+0000 front 2024-04-20T12:34:51.533086+0000 (oldest deadline 2024-04-20T12:35:16.232937+0000) 2024-04-20T12:35:59.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:58 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:58.683+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6812 osd.4 since back 2024-04-20T12:35:01.534030+0000 front 2024-04-20T12:35:01.534125+0000 (oldest deadline 2024-04-20T12:35:26.134555+0000) 2024-04-20T12:35:59.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:58 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:58.683+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6812 osd.5 since back 2024-04-20T12:35:09.635338+0000 front 2024-04-20T12:35:09.635456+0000 (oldest deadline 2024-04-20T12:35:34.935417+0000) 2024-04-20T12:35:59.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:58 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:58.683+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.135:6822 osd.6 since back 2024-04-20T12:35:14.935830+0000 front 2024-04-20T12:35:14.935882+0000 (oldest deadline 2024-04-20T12:35:40.835821+0000) 2024-04-20T12:35:59.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:58 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:58.683+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.139:6820 osd.7 since back 2024-04-20T12:35:24.936669+0000 front 2024-04-20T12:35:24.936635+0000 (oldest deadline 2024-04-20T12:35:48.436621+0000) 2024-04-20T12:35:59.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:58 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11[47300]: 2024-04-20T12:35:58.683+0000 7f8d4b8a1700 -1 osd.11 109 heartbeat_check: no reply from 172.21.15.154:6820 osd.8 since back 2024-04-20T12:35:32.338408+0000 front 2024-04-20T12:35:32.338438+0000 (oldest deadline 2024-04-20T12:35:57.038474+0000) 2024-04-20T12:36:00.001 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:35:59 smithi154 podman[58999]: 2024-04-20 12:35:59.737930997 +0000 UTC m=+5.472482248 container died f7d7e0cc9f7271cfa8c0773628e35aefebc2d5e03563fe3da6a643b7a4f9671f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux ) 2024-04-20T12:36:00.357 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:36:00 smithi154 podman[58999]: 2024-04-20 12:36:00.107778702 +0000 UTC m=+5.842329956 container cleanup f7d7e0cc9f7271cfa8c0773628e35aefebc2d5e03563fe3da6a643b7a4f9671f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-04-20T12:36:00.357 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:36:00 smithi154 bash[58999]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11 2024-04-20T12:36:00.649 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:36:00 smithi154 podman[59028]: 2024-04-20 12:36:00.358789708 +0000 UTC m=+0.616625865 container remove f7d7e0cc9f7271cfa8c0773628e35aefebc2d5e03563fe3da6a643b7a4f9671f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-04-20T12:36:00.928 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:36:00 smithi154 podman[59121]: 2024-04-20 12:36:00.651324743 +0000 UTC m=+0.096674314 container create a81ceaf59c7b91ecca087e29f2b6dcbe00ec641c9e0aba74fe55307e7ad2d0d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5) 2024-04-20T12:36:00.928 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:36:00 smithi154 podman[59121]: 2024-04-20 12:36:00.572425816 +0000 UTC m=+0.017775393 image pull 76bc6b91b726a03b8b736eeeb35fc1ffd1469e23c7d60f5b444a217528d8906d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1 2024-04-20T12:36:00.928 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:36:00 smithi154 podman[59121]: 2024-04-20 12:36:00.845916976 +0000 UTC m=+0.291266553 container init a81ceaf59c7b91ecca087e29f2b6dcbe00ec641c9e0aba74fe55307e7ad2d0d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-20T12:36:00.928 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:36:00 smithi154 podman[59121]: 2024-04-20 12:36:00.849054541 +0000 UTC m=+0.294404110 container start a81ceaf59c7b91ecca087e29f2b6dcbe00ec641c9e0aba74fe55307e7ad2d0d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD) 2024-04-20T12:36:00.928 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:36:00 smithi154 podman[59121]: 2024-04-20 12:36:00.928930712 +0000 UTC m=+0.374280282 container attach a81ceaf59c7b91ecca087e29f2b6dcbe00ec641c9e0aba74fe55307e7ad2d0d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:36:01.251 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:36:01 smithi154 podman[59121]: 2024-04-20 12:36:01.142125449 +0000 UTC m=+0.587475018 container died a81ceaf59c7b91ecca087e29f2b6dcbe00ec641c9e0aba74fe55307e7ad2d0d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11-deactivate, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-20T12:36:01.616 INFO:journalctl@ceph.osd.11.smithi154.stdout:Apr 20 12:36:01 smithi154 podman[59146]: 2024-04-20 12:36:01.607423848 +0000 UTC m=+0.459393451 container remove a81ceaf59c7b91ecca087e29f2b6dcbe00ec641c9e0aba74fe55307e7ad2d0d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-20T12:36:01.622 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@osd.11.service' 2024-04-20T12:36:01.661 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:36:01.662 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-04-20T12:36:01.662 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-04-20T12:36:01.662 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.a 2024-04-20T12:36:02.079 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:36:01 smithi135 systemd[1]: Stopping Ceph mds.a for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:36:02.363 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:36:02 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-a[57699]: 2024-04-20T12:36:02.079+0000 7f52526d8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:36:02.364 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:36:02 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-a[57699]: 2024-04-20T12:36:02.079+0000 7f52526d8700 -1 mds.a *** got signal Terminated *** 2024-04-20T12:36:06.271 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:36:06 smithi135 podman[89227]: 2024-04-20 12:36:06.016003096 +0000 UTC m=+4.157267478 container died afdb2f191efb5e6f433b7be40617e0c36f681925128c7d06a6a898ec6fab8935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-a, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD) 2024-04-20T12:36:06.613 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:36:06 smithi135 podman[89227]: 2024-04-20 12:36:06.363862564 +0000 UTC m=+4.505126942 container cleanup afdb2f191efb5e6f433b7be40617e0c36f681925128c7d06a6a898ec6fab8935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-20T12:36:06.613 INFO:journalctl@ceph.mds.a.smithi135.stdout:Apr 20 12:36:06 smithi135 bash[89227]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-a 2024-04-20T12:36:06.795 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.a.service' 2024-04-20T12:36:06.828 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:36:06.829 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-04-20T12:36:06.829 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-04-20T12:36:06.829 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.d 2024-04-20T12:36:07.150 INFO:journalctl@ceph.mds.d.smithi135.stdout:Apr 20 12:36:06 smithi135 systemd[1]: Stopping Ceph mds.d for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:36:07.613 INFO:journalctl@ceph.mds.d.smithi135.stdout:Apr 20 12:36:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-d[56741]: 2024-04-20T12:36:07.150+0000 7fe3d8200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:36:07.613 INFO:journalctl@ceph.mds.d.smithi135.stdout:Apr 20 12:36:07 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-d[56741]: 2024-04-20T12:36:07.150+0000 7fe3d8200700 -1 mds.d *** got signal Terminated *** 2024-04-20T12:36:09.613 INFO:journalctl@ceph.mds.d.smithi135.stdout:Apr 20 12:36:09 smithi135 podman[89348]: 2024-04-20 12:36:09.340947256 +0000 UTC m=+2.295861990 container died c701bfef1c3c437e6dd63d2c6e4a533b3ee29e60618e4cb6949967ef7afc01ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-d, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-04-20T12:36:09.968 INFO:journalctl@ceph.mds.d.smithi135.stdout:Apr 20 12:36:09 smithi135 podman[89348]: 2024-04-20 12:36:09.72723978 +0000 UTC m=+2.682154564 container cleanup c701bfef1c3c437e6dd63d2c6e4a533b3ee29e60618e4cb6949967ef7afc01ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-d, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-20T12:36:09.969 INFO:journalctl@ceph.mds.d.smithi135.stdout:Apr 20 12:36:09 smithi135 bash[89348]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-d 2024-04-20T12:36:10.101 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.d.service' 2024-04-20T12:36:10.133 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:36:10.133 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-04-20T12:36:10.133 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-04-20T12:36:10.133 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.g 2024-04-20T12:36:10.363 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:36:10 smithi135 systemd[1]: Stopping Ceph mds.g for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:36:10.863 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:36:10 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-g[57338]: 2024-04-20T12:36:10.472+0000 7ff7b43a4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:36:10.863 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:36:10 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-g[57338]: 2024-04-20T12:36:10.472+0000 7ff7b43a4700 -1 mds.g *** got signal Terminated *** 2024-04-20T12:36:14.274 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:36:14 smithi135 podman[89468]: 2024-04-20 12:36:14.007439099 +0000 UTC m=+3.661482090 container died bf7dafa5f963b5cb184914b397532b1c077f0594d41d2623895a5c7cc7271f57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-g, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:36:14.613 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:36:14 smithi135 podman[89468]: 2024-04-20 12:36:14.365226823 +0000 UTC m=+4.019269806 container cleanup bf7dafa5f963b5cb184914b397532b1c077f0594d41d2623895a5c7cc7271f57 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-g, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240416, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:36:14.613 INFO:journalctl@ceph.mds.g.smithi135.stdout:Apr 20 12:36:14 smithi135 bash[89468]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-g 2024-04-20T12:36:14.792 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.g.service' 2024-04-20T12:36:14.822 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:36:14.822 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-04-20T12:36:14.823 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-04-20T12:36:14.823 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.j 2024-04-20T12:36:15.363 INFO:journalctl@ceph.mds.j.smithi135.stdout:Apr 20 12:36:14 smithi135 systemd[1]: Stopping Ceph mds.j for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:36:15.364 INFO:journalctl@ceph.mds.j.smithi135.stdout:Apr 20 12:36:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-j[56392]: 2024-04-20T12:36:15.135+0000 7ff79dd77700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:36:15.364 INFO:journalctl@ceph.mds.j.smithi135.stdout:Apr 20 12:36:15 smithi135 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-j[56392]: 2024-04-20T12:36:15.135+0000 7ff79dd77700 -1 mds.j *** got signal Terminated *** 2024-04-20T12:36:18.660 INFO:journalctl@ceph.mds.j.smithi135.stdout:Apr 20 12:36:18 smithi135 podman[89589]: 2024-04-20 12:36:18.403333905 +0000 UTC m=+3.365222173 container died 4b2f8d378929e2ae3e84373eab6c3fe14073ac31f8d07fbcd3507b57409f4d9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.build-date=20240416, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-04-20T12:36:19.011 INFO:journalctl@ceph.mds.j.smithi135.stdout:Apr 20 12:36:18 smithi135 podman[89589]: 2024-04-20 12:36:18.761765091 +0000 UTC m=+3.723653355 container cleanup 4b2f8d378929e2ae3e84373eab6c3fe14073ac31f8d07fbcd3507b57409f4d9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-j, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-04-20T12:36:19.012 INFO:journalctl@ceph.mds.j.smithi135.stdout:Apr 20 12:36:18 smithi135 bash[89589]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-j 2024-04-20T12:36:19.134 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.j.service' 2024-04-20T12:36:19.165 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:36:19.165 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-04-20T12:36:19.165 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-04-20T12:36:19.165 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.b 2024-04-20T12:36:19.482 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:36:19 smithi139 systemd[1]: Stopping Ceph mds.b for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:36:19.829 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:36:19 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-b[52080]: 2024-04-20T12:36:19.481+0000 7f8662fda700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:36:19.830 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:36:19 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-b[52080]: 2024-04-20T12:36:19.481+0000 7f8662fda700 -1 mds.b *** got signal Terminated *** 2024-04-20T12:36:22.307 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:36:22 smithi139 podman[58773]: 2024-04-20 12:36:22.02394804 +0000 UTC m=+2.658688231 container died f04bd8e05e6630373e7d47c7c62e959252fd818457c848e28d9d9011bd812e5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:36:22.579 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:36:22 smithi139 podman[58773]: 2024-04-20 12:36:22.424115052 +0000 UTC m=+3.058855238 container cleanup f04bd8e05e6630373e7d47c7c62e959252fd818457c848e28d9d9011bd812e5e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True) 2024-04-20T12:36:22.579 INFO:journalctl@ceph.mds.b.smithi139.stdout:Apr 20 12:36:22 smithi139 bash[58773]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-b 2024-04-20T12:36:22.793 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.b.service' 2024-04-20T12:36:22.827 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:36:22.827 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-04-20T12:36:22.827 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-04-20T12:36:22.828 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.e 2024-04-20T12:36:23.079 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:36:22 smithi139 systemd[1]: Stopping Ceph mds.e for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:36:23.579 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:36:23 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-e[51458]: 2024-04-20T12:36:23.152+0000 7f020f329700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:36:23.579 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:36:23 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-e[51458]: 2024-04-20T12:36:23.152+0000 7f020f329700 -1 mds.e *** got signal Terminated *** 2024-04-20T12:36:26.283 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:36:26 smithi139 podman[58895]: 2024-04-20 12:36:26.022356129 +0000 UTC m=+2.973681625 container died 9ef058c9b39aa4f9616b1724b2c05b30e19e98946d157f768a4a1e1079f6d37d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240416) 2024-04-20T12:36:26.569 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:36:26 smithi139 podman[58895]: 2024-04-20 12:36:26.369503686 +0000 UTC m=+3.320829190 container cleanup 9ef058c9b39aa4f9616b1724b2c05b30e19e98946d157f768a4a1e1079f6d37d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-e, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240416) 2024-04-20T12:36:26.569 INFO:journalctl@ceph.mds.e.smithi139.stdout:Apr 20 12:36:26 smithi139 bash[58895]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-e 2024-04-20T12:36:26.784 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.e.service' 2024-04-20T12:36:26.816 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:36:26.816 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-04-20T12:36:26.816 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-04-20T12:36:26.816 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.h 2024-04-20T12:36:27.139 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:36:26 smithi139 systemd[1]: Stopping Ceph mds.h for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:36:27.579 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:36:27 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-h[51772]: 2024-04-20T12:36:27.140+0000 7fd7811f6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:36:27.580 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:36:27 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-h[51772]: 2024-04-20T12:36:27.140+0000 7fd7811f6700 -1 mds.h *** got signal Terminated *** 2024-04-20T12:36:30.297 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:36:30 smithi139 podman[59016]: 2024-04-20 12:36:30.013719396 +0000 UTC m=+2.980567385 container died 404ea5bbd28dc57860f7f8433323adb22aff492313e4509bdb36b60d978b3148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-04-20T12:36:30.580 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:36:30 smithi139 podman[59016]: 2024-04-20 12:36:30.389863007 +0000 UTC m=+3.356710995 container cleanup 404ea5bbd28dc57860f7f8433323adb22aff492313e4509bdb36b60d978b3148 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240416) 2024-04-20T12:36:30.580 INFO:journalctl@ceph.mds.h.smithi139.stdout:Apr 20 12:36:30 smithi139 bash[59016]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-h 2024-04-20T12:36:30.812 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.h.service' 2024-04-20T12:36:30.844 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:36:30.845 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-04-20T12:36:30.845 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-04-20T12:36:30.845 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.k 2024-04-20T12:36:31.329 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:36:30 smithi139 systemd[1]: Stopping Ceph mds.k for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:36:31.329 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:36:31 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-k[51143]: 2024-04-20T12:36:31.144+0000 7f8652daa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:36:31.330 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:36:31 smithi139 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-k[51143]: 2024-04-20T12:36:31.144+0000 7f8652daa700 -1 mds.k *** got signal Terminated *** 2024-04-20T12:36:34.329 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:36:34 smithi139 podman[59149]: 2024-04-20 12:36:34.012474395 +0000 UTC m=+2.949620487 container died 0e720c91acaea9dbc5e4c0a9c22a1d2ed6f85ed5f38685116f45327a18f5b6d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-k, ceph=True, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS) 2024-04-20T12:36:34.743 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:36:34 smithi139 podman[59149]: 2024-04-20 12:36:34.47701717 +0000 UTC m=+3.414163251 container cleanup 0e720c91acaea9dbc5e4c0a9c22a1d2ed6f85ed5f38685116f45327a18f5b6d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, org.label-schema.build-date=20240416, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T12:36:34.743 INFO:journalctl@ceph.mds.k.smithi139.stdout:Apr 20 12:36:34 smithi139 bash[59149]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-k 2024-04-20T12:36:34.902 DEBUG:teuthology.orchestra.run.smithi139:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.k.service' 2024-04-20T12:36:34.935 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:36:34.935 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-04-20T12:36:34.935 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-04-20T12:36:34.935 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.c 2024-04-20T12:36:35.230 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:36:34 smithi154 systemd[1]: Stopping Ceph mds.c for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:36:35.500 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:36:35 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-c[52302]: 2024-04-20T12:36:35.230+0000 7f6728d07700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:36:35.500 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:36:35 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-c[52302]: 2024-04-20T12:36:35.230+0000 7f6728d07700 -1 mds.c *** got signal Terminated *** 2024-04-20T12:36:38.306 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:36:38 smithi154 podman[59225]: 2024-04-20 12:36:38.027669588 +0000 UTC m=+2.906231886 container died d4524ec46e592b6d611e03ea06d382e58e127e51b5cdeeacaa876af2d2fbe6da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-c, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-20T12:36:38.647 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:36:38 smithi154 podman[59225]: 2024-04-20 12:36:38.406077369 +0000 UTC m=+3.284639669 container cleanup d4524ec46e592b6d611e03ea06d382e58e127e51b5cdeeacaa876af2d2fbe6da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-c, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240416, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-20T12:36:38.647 INFO:journalctl@ceph.mds.c.smithi154.stdout:Apr 20 12:36:38 smithi154 bash[59225]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-c 2024-04-20T12:36:38.763 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.c.service' 2024-04-20T12:36:38.797 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:36:38.798 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-04-20T12:36:38.798 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-04-20T12:36:38.798 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.f 2024-04-20T12:36:39.001 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:36:38 smithi154 systemd[1]: Stopping Ceph mds.f for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:36:39.501 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:36:39 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-f[51996]: 2024-04-20T12:36:39.117+0000 7fd993215700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:36:39.501 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:36:39 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-f[51996]: 2024-04-20T12:36:39.117+0000 7fd993215700 -1 mds.f *** got signal Terminated *** 2024-04-20T12:36:42.302 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:36:42 smithi154 podman[59359]: 2024-04-20 12:36:42.028259565 +0000 UTC m=+3.014809875 container died d93374495849afd4614a03d8b84e8b6f041ecbb6d1ba5c41949ce8a386080234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240416, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-04-20T12:36:42.653 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:36:42 smithi154 podman[59359]: 2024-04-20 12:36:42.386818584 +0000 UTC m=+3.373368895 container cleanup d93374495849afd4614a03d8b84e8b6f041ecbb6d1ba5c41949ce8a386080234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-f, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_CLEAN=True, org.label-schema.build-date=20240416, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-20T12:36:42.653 INFO:journalctl@ceph.mds.f.smithi154.stdout:Apr 20 12:36:42 smithi154 bash[59359]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-f 2024-04-20T12:36:42.813 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.f.service' 2024-04-20T12:36:42.846 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:36:42.847 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-04-20T12:36:42.847 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-04-20T12:36:42.847 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.i 2024-04-20T12:36:43.172 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:36:42 smithi154 systemd[1]: Stopping Ceph mds.i for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:36:43.501 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:36:43 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i[52605]: 2024-04-20T12:36:43.173+0000 7f6a774bf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:36:43.501 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:36:43 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i[52605]: 2024-04-20T12:36:43.173+0000 7f6a774bf700 -1 mds.i *** got signal Terminated *** 2024-04-20T12:36:46.251 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:36:46 smithi154 podman[59482]: 2024-04-20 12:36:46.032146006 +0000 UTC m=+2.959676013 container died 103e36723ff223c481357770f10911a466fb5fdb34d69a4c0d3f4bf560e479b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240416, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-20T12:36:46.681 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:36:46 smithi154 podman[59482]: 2024-04-20 12:36:46.398481552 +0000 UTC m=+3.326011565 container cleanup 103e36723ff223c481357770f10911a466fb5fdb34d69a4c0d3f4bf560e479b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-20T12:36:46.682 INFO:journalctl@ceph.mds.i.smithi154.stdout:Apr 20 12:36:46 smithi154 bash[59482]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-i 2024-04-20T12:36:46.822 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.i.service' 2024-04-20T12:36:46.853 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:36:46.853 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-04-20T12:36:46.853 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-04-20T12:36:46.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.l 2024-04-20T12:36:47.001 INFO:journalctl@ceph.mds.l.smithi154.stdout:Apr 20 12:36:46 smithi154 systemd[1]: Stopping Ceph mds.l for 22180be8-ff0f-11ee-bc92-c7b262605968... 2024-04-20T12:36:47.501 INFO:journalctl@ceph.mds.l.smithi154.stdout:Apr 20 12:36:47 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-l[51675]: 2024-04-20T12:36:47.176+0000 7f184acaf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-20T12:36:47.501 INFO:journalctl@ceph.mds.l.smithi154.stdout:Apr 20 12:36:47 smithi154 ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-l[51675]: 2024-04-20T12:36:47.176+0000 7f184acaf700 -1 mds.l *** got signal Terminated *** 2024-04-20T12:36:50.325 INFO:journalctl@ceph.mds.l.smithi154.stdout:Apr 20 12:36:50 smithi154 podman[59602]: 2024-04-20 12:36:50.026285842 +0000 UTC m=+2.957484751 container died 08e3d48f573ba294f6775a3b5519faa3c775bdede2c821ce296d3567a6e72ae7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240416, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-20T12:36:50.325 INFO:journalctl@ceph.mds.l.smithi154.stdout:Apr 20 12:36:50 smithi154 podman[59602]: 2024-04-20 12:36:50.327095101 +0000 UTC m=+3.258294009 container cleanup 08e3d48f573ba294f6775a3b5519faa3c775bdede2c821ce296d3567a6e72ae7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240416, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-04-20T12:36:50.669 INFO:journalctl@ceph.mds.l.smithi154.stdout:Apr 20 12:36:50 smithi154 bash[59602]: ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-l 2024-04-20T12:36:50.670 INFO:journalctl@ceph.mds.l.smithi154.stdout:Apr 20 12:36:50 smithi154 podman[59615]: 2024-04-20 12:36:50.544707559 +0000 UTC m=+0.513369507 container remove 08e3d48f573ba294f6775a3b5519faa3c775bdede2c821ce296d3567a6e72ae7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:556b2d4db8c1fdd86d8938d44019b738fe91b025623acee0a51cae93523136b1, name=ceph-22180be8-ff0f-11ee-bc92-c7b262605968-mds-l, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240416.193735-a8c84f5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240416) 2024-04-20T12:36:50.680 DEBUG:teuthology.orchestra.run.smithi154:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22180be8-ff0f-11ee-bc92-c7b262605968@mds.l.service' 2024-04-20T12:36:50.710 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-20T12:36:50.710 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-04-20T12:36:50.710 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 --force --keep-logs 2024-04-20T12:36:50.899 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:36:53.391 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 --force --keep-logs 2024-04-20T12:36:53.581 INFO:teuthology.orchestra.run.smithi139.stdout:Deleting cluster with fsid: 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:36:55.879 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 --force --keep-logs 2024-04-20T12:36:56.070 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:36:58.355 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-20T12:36:58.388 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-20T12:36:58.414 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-20T12:36:58.439 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-20T12:36:58.441 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664595/remote/smithi135/crash 2024-04-20T12:36:58.442 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/crash -- . 2024-04-20T12:36:58.479 INFO:teuthology.orchestra.run.smithi135.stderr:tar: /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/crash: Cannot open: No such file or directory 2024-04-20T12:36:58.479 INFO:teuthology.orchestra.run.smithi135.stderr:tar: Error is not recoverable: exiting now 2024-04-20T12:36:58.482 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664595/remote/smithi139/crash 2024-04-20T12:36:58.483 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/crash -- . 2024-04-20T12:36:58.527 INFO:teuthology.orchestra.run.smithi139.stderr:tar: /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/crash: Cannot open: No such file or directory 2024-04-20T12:36:58.527 INFO:teuthology.orchestra.run.smithi139.stderr:tar: Error is not recoverable: exiting now 2024-04-20T12:36:58.529 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664595/remote/smithi154/crash 2024-04-20T12:36:58.530 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/crash -- . 2024-04-20T12:36:58.564 INFO:teuthology.orchestra.run.smithi154.stderr:tar: /var/lib/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/crash: Cannot open: No such file or directory 2024-04-20T12:36:58.564 INFO:teuthology.orchestra.run.smithi154.stderr:tar: Error is not recoverable: exiting now 2024-04-20T12:36:58.565 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-20T12:36:58.566 DEBUG:teuthology.orchestra.run.smithi135:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-04-20T12:36:58.601 INFO:tasks.cephadm:Compressing logs... 2024-04-20T12:36:58.601 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-20T12:36:58.644 DEBUG:teuthology.orchestra.run.smithi139:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-20T12:36:58.646 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-20T12:36:58.667 INFO:teuthology.orchestra.run.smithi135.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.log 2024-04-20T12:36:58.667 INFO:teuthology.orchestra.run.smithi135.stderr:: No such file or directory 2024-04-20T12:36:58.667 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.audit.log 2024-04-20T12:36:58.667 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.g.log 2024-04-20T12:36:58.667 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.j.log 2024-04-20T12:36:58.667 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.3.log 2024-04-20T12:36:58.676 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.0.log 2024-04-20T12:36:58.676 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.j.log: /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mgr.x.log 2024-04-20T12:36:58.676 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mon.a.log 2024-04-20T12:36:58.676 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mgr.x.log: gzip -5 87.5% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.log.gz 2024-04-20T12:36:58.677 INFO:teuthology.orchestra.run.smithi135.stderr: --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.6.log 2024-04-20T12:36:58.677 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.cephadm.log 2024-04-20T12:36:58.677 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mon.a.log: /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.6.log: 90.3% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.audit.log.gz 2024-04-20T12:36:58.677 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.a.log 2024-04-20T12:36:58.677 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.cephadm.log: 84.3% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.cephadm.log.gz 2024-04-20T12:36:58.677 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-volume.log 94.6% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.j.log.gz 2024-04-20T12:36:58.677 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-04-20T12:36:58.677 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.d.log 2024-04-20T12:36:58.680 INFO:teuthology.orchestra.run.smithi154.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.log 2024-04-20T12:36:58.680 INFO:teuthology.orchestra.run.smithi154.stderr:: No such file or directory 2024-04-20T12:36:58.680 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.2.log 2024-04-20T12:36:58.680 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.f.log 2024-04-20T12:36:58.680 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.log: /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.audit.log 2024-04-20T12:36:58.680 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.5.log 2024-04-20T12:36:58.681 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.c.log 2024-04-20T12:36:58.681 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mon.c.log 2024-04-20T12:36:58.681 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mgr.z.log 2024-04-20T12:36:58.681 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.i.log 2024-04-20T12:36:58.681 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mgr.z.log: 87.5% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.log.gz 2024-04-20T12:36:58.681 INFO:teuthology.orchestra.run.smithi154.stderr: 90.4% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.audit.log.gz 2024-04-20T12:36:58.681 INFO:teuthology.orchestra.run.smithi139.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.log 2024-04-20T12:36:58.681 INFO:teuthology.orchestra.run.smithi139.stderr:: No such file or directory 2024-04-20T12:36:58.681 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.audit.log 2024-04-20T12:36:58.681 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.7.log 2024-04-20T12:36:58.681 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.log: /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.b.log 2024-04-20T12:36:58.682 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.4.log 2024-04-20T12:36:58.682 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.1.log 2024-04-20T12:36:58.682 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.b.log: /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mgr.y.log 2024-04-20T12:36:58.682 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.h.log 2024-04-20T12:36:58.682 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.10.log 2024-04-20T12:36:58.682 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.h.log: 87.5% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.log.gz 2024-04-20T12:36:58.682 INFO:teuthology.orchestra.run.smithi139.stderr: 90.4% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.audit.log.gz 2024-04-20T12:36:58.682 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.cephadm.log 2024-04-20T12:36:58.682 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.e.log 2024-04-20T12:36:58.682 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.cephadm.log: 84.0% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.cephadm.log.gz 2024-04-20T12:36:58.682 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-volume.log 2024-04-20T12:36:58.682 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.e.log: 91.9% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mgr.y.log.gz 2024-04-20T12:36:58.684 INFO:teuthology.orchestra.run.smithi154.stderr: 91.9% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mgr.z.log.gz 2024-04-20T12:36:58.684 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.cephadm.log 2024-04-20T12:36:58.685 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.11.log 2024-04-20T12:36:58.685 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.8.log 2024-04-20T12:36:58.685 INFO:teuthology.orchestra.run.smithi154.stderr: 83.9% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph.cephadm.log.gz 2024-04-20T12:36:58.689 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mon.b.log 2024-04-20T12:36:58.689 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.9.log 2024-04-20T12:36:58.692 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.d.log: 94.6% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.d.log.gz 2024-04-20T12:36:58.694 INFO:teuthology.orchestra.run.smithi135.stderr: 91.0% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-volume.log.gz 2024-04-20T12:36:58.694 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-20T12:36:58.695 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-volume.log 2024-04-20T12:36:58.699 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.k.log 2024-04-20T12:36:58.701 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-volume.log.gz 2024-04-20T12:36:58.701 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-20T12:36:58.704 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-04-20T12:36:58.708 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.l.log 2024-04-20T12:36:58.720 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/cephadm.log: 93.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-20T12:36:58.728 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-20T12:36:58.734 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.log: 92.6% 94.5% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.g.log.gz 2024-04-20T12:36:58.734 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-20T12:36:58.736 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 91.0% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-volume.log.gz 2024-04-20T12:36:58.737 INFO:teuthology.orchestra.run.smithi135.stderr: -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-04-20T12:36:58.744 INFO:teuthology.orchestra.run.smithi139.stderr: 93.4% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.b.log.gz 2024-04-20T12:36:58.744 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.f.log.gz 2024-04-20T12:36:58.745 INFO:teuthology.orchestra.run.smithi154.stderr: 93.2% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.c.log.gz 2024-04-20T12:36:58.746 INFO:teuthology.orchestra.run.smithi154.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-20T12:36:58.754 INFO:teuthology.orchestra.run.smithi135.stderr: 93.2% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.a.log.gz 2024-04-20T12:36:58.765 INFO:teuthology.orchestra.run.smithi139.stderr: 94.5% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.e.log.gz 2024-04-20T12:36:58.766 INFO:teuthology.orchestra.run.smithi139.stderr: 94.5% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.k.log.gz 2024-04-20T12:36:58.799 INFO:teuthology.orchestra.run.smithi154.stderr: 94.4% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.l.log.gz 2024-04-20T12:36:59.045 INFO:teuthology.orchestra.run.smithi135.stderr: 90.2% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mgr.x.log.gz 2024-04-20T12:36:59.067 INFO:teuthology.orchestra.run.smithi139.stderr: 92.0% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mon.b.log.gz 2024-04-20T12:36:59.087 INFO:teuthology.orchestra.run.smithi154.stderr: 92.1% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mon.c.log.gz 2024-04-20T12:36:59.121 INFO:teuthology.orchestra.run.smithi139.stderr: 95.6% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.h.log.gz 2024-04-20T12:36:59.565 INFO:teuthology.orchestra.run.smithi135.stderr: 90.7% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mon.a.log.gz 2024-04-20T12:37:00.076 INFO:teuthology.orchestra.run.smithi154.stderr: 92.3% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.11.log.gz 2024-04-20T12:37:00.436 INFO:teuthology.orchestra.run.smithi139.stderr: 92.2% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.1.log.gz 2024-04-20T12:37:00.545 INFO:teuthology.orchestra.run.smithi135.stderr: 92.0% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.6.log.gz 2024-04-20T12:37:00.719 INFO:teuthology.orchestra.run.smithi154.stderr: 91.7% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.8.log.gz 2024-04-20T12:37:00.831 INFO:teuthology.orchestra.run.smithi135.stderr: 92.2% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.3.log.gz 2024-04-20T12:37:00.948 INFO:teuthology.orchestra.run.smithi135.stderr: 92.6% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.0.log.gz 2024-04-20T12:37:01.148 INFO:teuthology.orchestra.run.smithi139.stderr: 92.3% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.10.log.gz 2024-04-20T12:37:01.268 INFO:teuthology.orchestra.run.smithi139.stderr: 92.6% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.7.log.gz 2024-04-20T12:37:01.391 INFO:teuthology.orchestra.run.smithi135.stderr: 92.3% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.9.log.gz 2024-04-20T12:37:01.392 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-04-20T12:37:01.393 INFO:teuthology.orchestra.run.smithi135.stderr:real 0m2.736s 2024-04-20T12:37:01.393 INFO:teuthology.orchestra.run.smithi135.stderr:user 0m10.102s 2024-04-20T12:37:01.393 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m0.371s 2024-04-20T12:37:01.642 INFO:teuthology.orchestra.run.smithi139.stderr: 92.6% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.4.log.gz 2024-04-20T12:37:01.644 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-04-20T12:37:01.644 INFO:teuthology.orchestra.run.smithi139.stderr:real 0m2.986s 2024-04-20T12:37:01.644 INFO:teuthology.orchestra.run.smithi139.stderr:user 0m10.527s 2024-04-20T12:37:01.644 INFO:teuthology.orchestra.run.smithi139.stderr:sys 0m0.333s 2024-04-20T12:37:02.123 INFO:teuthology.orchestra.run.smithi154.stderr: 93.3% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.2.log.gz 2024-04-20T12:37:02.823 INFO:teuthology.orchestra.run.smithi154.stderr: 93.4% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-mds.i.log.gz 2024-04-20T12:37:04.151 INFO:teuthology.orchestra.run.smithi154.stderr: 94.6% -- replaced with /var/log/ceph/22180be8-ff0f-11ee-bc92-c7b262605968/ceph-osd.5.log.gz 2024-04-20T12:37:04.153 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-04-20T12:37:04.153 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m5.493s 2024-04-20T12:37:04.153 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m16.529s 2024-04-20T12:37:04.153 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m0.594s 2024-04-20T12:37:04.153 INFO:tasks.cephadm:Archiving logs... 2024-04-20T12:37:04.153 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664595/remote/smithi135/log 2024-04-20T12:37:04.154 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-20T12:37:05.679 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664595/remote/smithi139/log 2024-04-20T12:37:05.680 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-20T12:37:07.290 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664595/remote/smithi154/log 2024-04-20T12:37:07.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-20T12:37:09.663 INFO:tasks.cephadm:Removing cluster... 2024-04-20T12:37:09.664 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 --force 2024-04-20T12:37:09.854 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:37:10.188 DEBUG:teuthology.orchestra.run.smithi139:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 --force 2024-04-20T12:37:10.379 INFO:teuthology.orchestra.run.smithi139.stdout:Deleting cluster with fsid: 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:37:10.666 DEBUG:teuthology.orchestra.run.smithi154:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22180be8-ff0f-11ee-bc92-c7b262605968 --force 2024-04-20T12:37:10.858 INFO:teuthology.orchestra.run.smithi154.stdout:Deleting cluster with fsid: 22180be8-ff0f-11ee-bc92-c7b262605968 2024-04-20T12:37:11.404 INFO:tasks.cephadm:Removing cephadm ... 2024-04-20T12:37:11.405 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-20T12:37:11.423 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-20T12:37:11.440 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-20T12:37:11.455 INFO:tasks.cephadm:Teardown complete 2024-04-20T12:37:11.455 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-20T12:37:11.466 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-20T12:37:11.466 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-20T12:37:11.469 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-20T12:37:11.483 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-20T12:37:11.579 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-20T12:37:11.591 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-20T12:37:11.591 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T12:37:11.594 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T12:37:11.596 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T12:37:11.608 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-04-20T12:37:11.609 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-04-20T12:37:11.610 INFO:teuthology.orchestra.run.smithi154.stderr:bash: line 1: ntpq: command not found 2024-04-20T12:37:11.612 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T12:37:11.612 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-04-20T12:37:11.613 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 36 +855us[ +855us] +/- 81ms 2024-04-20T12:37:11.613 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv02.front.sepia.ceph.com 3 6 377 38 -131us[ -126us] +/- 67ms 2024-04-20T12:37:11.613 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 -414us[ -414us] +/- 66ms 2024-04-20T12:37:11.613 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T12:37:11.614 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T12:37:11.614 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-04-20T12:37:11.614 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 36 +814us[ +844us] +/- 81ms 2024-04-20T12:37:11.614 INFO:teuthology.orchestra.run.smithi139.stdout:^* hv02.front.sepia.ceph.com 3 6 377 36 -163us[ -133us] +/- 67ms 2024-04-20T12:37:11.615 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -512us[ -482us] +/- 66ms 2024-04-20T12:37:11.615 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T12:37:11.615 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T12:37:11.616 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2024-04-20T12:37:11.616 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 36 +845us[ +845us] +/- 81ms 2024-04-20T12:37:11.616 INFO:teuthology.orchestra.run.smithi154.stdout:^* hv02.front.sepia.ceph.com 3 6 377 37 -125us[ -111us] +/- 67ms 2024-04-20T12:37:11.616 INFO:teuthology.orchestra.run.smithi154.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -473us[ -473us] +/- 66ms 2024-04-20T12:37:11.616 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T12:37:11.616 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-20T12:37:11.628 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-20T12:37:11.629 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-20T12:37:11.660 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-20T12:37:11.728 DEBUG:teuthology.orchestra.run.smithi139:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-20T12:37:11.785 DEBUG:teuthology.orchestra.run.smithi154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-20T12:37:11.836 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T12:37:11.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T12:37:11.865 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T12:37:11.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T12:37:11.891 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T12:37:11.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T12:37:11.916 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-20T12:37:11.927 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-20T12:37:11.968 INFO:teuthology.task.internal:Duration was 1815.918658 seconds 2024-04-20T12:37:11.969 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-20T12:37:12.003 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-20T12:37:12.003 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-20T12:37:12.005 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-20T12:37:12.008 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-20T12:37:12.042 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T12:37:12.044 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T12:37:12.044 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T12:37:12.378 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-20T12:37:12.378 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-04-20T12:37:12.378 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-20T12:37:12.399 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2024-04-20T12:37:12.399 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-20T12:37:12.470 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-04-20T12:37:12.470 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-20T12:37:12.494 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-20T12:37:12.494 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-20T12:37:12.497 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-20T12:37:12.499 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-20T12:37:12.559 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-20T12:37:12.560 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-20T12:37:12.564 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-20T12:37:12.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-20T12:37:12.922 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-20T12:37:12.934 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-20T12:37:12.934 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-20T12:37:12.958 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-20T12:37:12.981 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-20T12:37:13.005 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-20T12:37:13.018 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-20T12:37:13.020 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-20T12:37:13.024 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-20T12:37:13.040 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-04-20T12:37:13.043 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2024-04-20T12:37:13.066 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-04-20T12:37:13.104 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-20T12:37:13.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T12:37:13.118 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-20T12:37:13.132 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T12:37:13.132 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-20T12:37:13.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T12:37:13.159 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-20T12:37:13.172 INFO:teuthology.task.internal:Transferring archived files... 2024-04-20T12:37:13.173 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664595/remote/smithi135 2024-04-20T12:37:13.173 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-20T12:37:13.212 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664595/remote/smithi139 2024-04-20T12:37:13.212 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-20T12:37:13.244 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664595/remote/smithi154 2024-04-20T12:37:13.244 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-20T12:37:13.275 INFO:teuthology.task.internal:Removing archive directory... 2024-04-20T12:37:13.276 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-20T12:37:13.278 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-20T12:37:13.280 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-20T12:37:13.325 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-20T12:37:13.339 INFO:teuthology.task.internal:Not uploading archives. 2024-04-20T12:37:13.339 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-20T12:37:13.399 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-20T12:37:13.400 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-20T12:37:13.402 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-20T12:37:13.404 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-20T12:37:13.414 INFO:teuthology.orchestra.run.smithi135.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 20 12:37 /home/ubuntu/cephtest 2024-04-20T12:37:13.416 INFO:teuthology.orchestra.run.smithi139.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 20 12:37 /home/ubuntu/cephtest 2024-04-20T12:37:13.418 INFO:teuthology.orchestra.run.smithi154.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 20 12:37 /home/ubuntu/cephtest 2024-04-20T12:37:13.419 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-20T12:37:13.435 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-20T12:37:13.503 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/direct_io}} duration: 1815.9186580181122 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-04-20T12:37:13.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-20T12:37:13.592 INFO:teuthology.run:pass